2023-12-03T11:21:56.598 INFO:root:teuthology version: 0.0.1.dev214+gf2de108 2023-12-03T11:21:56.598 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/alimasa-2023-12-03_11:04:43-rgw-wip-alimasa-multi-pubsub-etag-distro-default-smithi/7476143 --description rgw/verify/{0-install clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec s3tests-branch sharding$/{default} striping$/{stripe-greater-than-chunk} supported-random-distro$/{centos_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind} --verbose --owner scheduled_alimasa@teuthology --name alimasa-2023-12-03_11:04:43-rgw-wip-alimasa-multi-pubsub-etag-distro-default-smithi -- /home/teuthworker/archive/alimasa-2023-12-03_11:04:43-rgw-wip-alimasa-multi-pubsub-etag-distro-default-smithi/7476143/orig.config.yaml 2023-12-03T11:21:56.646 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-03T11:21:56.735 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/alimasa-2023-12-03_11:04:43-rgw-wip-alimasa-multi-pubsub-etag-distro-default-smithi/7476143 branch: wip-alimasa-multi-pubsub-etag description: rgw/verify/{0-install clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec s3tests-branch sharding$/{default} striping$/{stripe-greater-than-chunk} supported-random-distro$/{centos_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind} email: null first_in_suite: false job_id: '7476143' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: alimasa-2023-12-03_11:04:43-rgw-wip-alimasa-multi-pubsub-etag-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 10 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-alimasa-multi-pubsub-etag ceph: conf: client: debug rgw: 20 rgw bucket counters cache: true rgw crypt require ssl: false rgw crypt s3 kms backend: testing rgw crypt s3 kms encryption keys: testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= rgw d3n l1 datacache persistent path: /tmp/rgw_datacache/ rgw d3n l1 datacache size: 10737418240 rgw d3n l1 local datacache enabled: true rgw enable ops log: true rgw max chunk size: 4194304 rgw obj stripe size: 6291456 rgw torrent flag: true rgw user counters cache: true setgroup: ceph setuser: ceph global: mon client directed command retry: 5 ms inject socket failures: 5000 osd heartbeat grace: 40 osd_max_pg_log_entries: 10 osd_min_pg_log_entries: 10 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon osd crush smoke test: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd fast shutdown: false osd objectstore: bluestore osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(POOL_APP_NOT_ENABLED\) - not have an application enabled - \(OSD_SLOW_PING_TIME sha1: bcbf278cf395873c2a482f5a7b2345faf2160319 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: bcbf278cf395873c2a482f5a7b2345faf2160319 rgw: client.0: valgrind: - --tool=memcheck - --max-threads=1024 compression type: random datacache: true datacache_path: /tmp/rgw_datacache ec-data-pool: true frontend: beast storage classes: LUKEWARM, FROZEN s3tests: force-branch: ceph-master slow_backend: true storage classes: LUKEWARM, FROZEN thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-alimasa-multi-pubsub-etag sha1: bcbf278cf395873c2a482f5a7b2345faf2160319 owner: scheduled_alimasa@teuthology priority: 100 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - node-exporter.b sha1: bcbf278cf395873c2a482f5a7b2345faf2160319 sleep_before_teardown: 0 suite: rgw suite_branch: wip-alimasa-multi-pubsub-etag suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: bcbf278cf395873c2a482f5a7b2345faf2160319 targets: smithi003.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCNTFuByklhnpO0+opNoVMJTsTqSn0lWxlFcRGAzHsBX5iZ1bcebClYz+q1Ny3AYlc7WRevHLnClzc45Au3wuN4= smithi037.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFi1UWnXJSWurirYT2qCAUvkVy86eskTFZhVGp9xDcuSkRMKlGPj+peKsXJXoy2wdtO04GB8auqIP2xRc8mQ1Ws= tasks: - install: extra_system_packages: deb: - s3cmd rpm: - s3cmd - ceph: null - openssl_keys: null - rgw: client.0: null - tox: - client.0 - workunit: clients: client.0: - rgw/run-datacache.sh env: RGW_DATACACHE_PATH: /tmp/rgw_datacache - workunit: clients: client.0: - rgw/run-bucket-check.sh - workunit: clients: client.0: - cls/test_cls_lock.sh - cls/test_cls_log.sh - cls/test_cls_refcount.sh - cls/test_cls_rgw.sh - cls/test_cls_rgw_gc.sh - cls/test_cls_rgw_stats.sh - cls/test_cls_cmpomap.sh - cls/test_cls_2pc_queue.sh - rgw/test_rgw_gc_log.sh - rgw/test_rgw_obj.sh - rgw/test_librgw_file.sh - workunit: clients: client.0: - rgw/test_rgw_s3_mp_reupload.sh - ragweed: client.0: default-branch: ceph-master rgw_server: client.0 stages: prepare,check - workunit: clients: client.0: - rgw/run-reshard.sh - s3tests-java: client.0: force-branch: ceph-master force-repo: https://github.com/ceph/java_s3tests.git - s3tests: client.0: rgw_server: client.0 - workunit: clients: client.0: - rgw/run-versioning.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: f2de108beb0a6dde7f3e6c96039071828a1f6269 timestamp: 2023-12-03_11:04:43 tube: smithi user: alimasa verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.232157 2023-12-03T11:21:56.735 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa; will attempt to use it 2023-12-03T11:21:56.736 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks 2023-12-03T11:21:56.736 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-12-03T11:21:56.738 INFO:teuthology.task.internal:Checking packages... 2023-12-03T11:21:56.762 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'bcbf278cf395873c2a482f5a7b2345faf2160319' 2023-12-03T11:21:56.763 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-03T11:21:56.763 INFO:teuthology.packaging:ref: None 2023-12-03T11:21:56.763 INFO:teuthology.packaging:tag: None 2023-12-03T11:21:56.763 INFO:teuthology.packaging:branch: wip-alimasa-multi-pubsub-etag 2023-12-03T11:21:56.763 INFO:teuthology.packaging:sha1: bcbf278cf395873c2a482f5a7b2345faf2160319 2023-12-03T11:21:56.763 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-alimasa-multi-pubsub-etag 2023-12-03T11:21:56.998 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-7537.gbcbf278c 2023-12-03T11:21:56.998 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-12-03T11:21:57.005 INFO:teuthology.task.internal:no buildpackages task found 2023-12-03T11:21:57.005 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-12-03T11:21:57.010 INFO:teuthology.task.internal:Saving configuration 2023-12-03T11:21:57.028 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-12-03T11:21:57.034 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-03T11:21:57.061 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi003.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/alimasa-2023-12-03_11:04:43-rgw-wip-alimasa-multi-pubsub-etag-distro-default-smithi/7476143', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-03 11:17:03.906617', 'locked_by': 'scheduled_alimasa@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCNTFuByklhnpO0+opNoVMJTsTqSn0lWxlFcRGAzHsBX5iZ1bcebClYz+q1Ny3AYlc7WRevHLnClzc45Au3wuN4='} 2023-12-03T11:21:57.086 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi037.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/alimasa-2023-12-03_11:04:43-rgw-wip-alimasa-multi-pubsub-etag-distro-default-smithi/7476143', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-03 11:17:03.908545', 'locked_by': 'scheduled_alimasa@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFi1UWnXJSWurirYT2qCAUvkVy86eskTFZhVGp9xDcuSkRMKlGPj+peKsXJXoy2wdtO04GB8auqIP2xRc8mQ1Ws='} 2023-12-03T11:21:57.087 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-12-03T11:21:57.093 INFO:teuthology.task.internal:roles: ubuntu@smithi003.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2023-12-03T11:21:57.093 INFO:teuthology.task.internal:roles: ubuntu@smithi037.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2023-12-03T11:21:57.093 INFO:teuthology.run_tasks:Running task console_log... 2023-12-03T11:21:57.194 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fcc809b8f70>, signals=[15]) 2023-12-03T11:21:57.194 INFO:teuthology.run_tasks:Running task internal.connect... 2023-12-03T11:21:57.200 INFO:teuthology.task.internal:Opening connections... 2023-12-03T11:21:57.200 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi003.front.sepia.ceph.com 2023-12-03T11:21:57.203 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-03T11:21:57.302 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi037.front.sepia.ceph.com 2023-12-03T11:21:57.303 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-03T11:21:57.403 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-12-03T11:21:57.409 DEBUG:teuthology.orchestra.run.smithi003:> uname -m 2023-12-03T11:21:57.427 INFO:teuthology.orchestra.run.smithi003.stdout:x86_64 2023-12-03T11:21:57.428 DEBUG:teuthology.orchestra.run.smithi003:> cat /etc/os-release 2023-12-03T11:21:57.486 INFO:teuthology.orchestra.run.smithi003.stdout:NAME="CentOS Stream" 2023-12-03T11:21:57.486 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION="9" 2023-12-03T11:21:57.486 INFO:teuthology.orchestra.run.smithi003.stdout:ID="centos" 2023-12-03T11:21:57.486 INFO:teuthology.orchestra.run.smithi003.stdout:ID_LIKE="rhel fedora" 2023-12-03T11:21:57.486 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION_ID="9" 2023-12-03T11:21:57.486 INFO:teuthology.orchestra.run.smithi003.stdout:PLATFORM_ID="platform:el9" 2023-12-03T11:21:57.486 INFO:teuthology.orchestra.run.smithi003.stdout:PRETTY_NAME="CentOS Stream 9" 2023-12-03T11:21:57.487 INFO:teuthology.orchestra.run.smithi003.stdout:ANSI_COLOR="0;31" 2023-12-03T11:21:57.487 INFO:teuthology.orchestra.run.smithi003.stdout:LOGO="fedora-logo-icon" 2023-12-03T11:21:57.487 INFO:teuthology.orchestra.run.smithi003.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-12-03T11:21:57.487 INFO:teuthology.orchestra.run.smithi003.stdout:HOME_URL="https://centos.org/" 2023-12-03T11:21:57.487 INFO:teuthology.orchestra.run.smithi003.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-03T11:21:57.487 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-12-03T11:21:57.487 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-03T11:21:57.487 INFO:teuthology.lock.ops:Updating smithi003.front.sepia.ceph.com on lock server 2023-12-03T11:21:57.508 DEBUG:teuthology.orchestra.run.smithi037:> uname -m 2023-12-03T11:21:57.525 INFO:teuthology.orchestra.run.smithi037.stdout:x86_64 2023-12-03T11:21:57.526 DEBUG:teuthology.orchestra.run.smithi037:> cat /etc/os-release 2023-12-03T11:21:57.583 INFO:teuthology.orchestra.run.smithi037.stdout:NAME="CentOS Stream" 2023-12-03T11:21:57.583 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION="9" 2023-12-03T11:21:57.583 INFO:teuthology.orchestra.run.smithi037.stdout:ID="centos" 2023-12-03T11:21:57.583 INFO:teuthology.orchestra.run.smithi037.stdout:ID_LIKE="rhel fedora" 2023-12-03T11:21:57.583 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION_ID="9" 2023-12-03T11:21:57.583 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM_ID="platform:el9" 2023-12-03T11:21:57.584 INFO:teuthology.orchestra.run.smithi037.stdout:PRETTY_NAME="CentOS Stream 9" 2023-12-03T11:21:57.584 INFO:teuthology.orchestra.run.smithi037.stdout:ANSI_COLOR="0;31" 2023-12-03T11:21:57.584 INFO:teuthology.orchestra.run.smithi037.stdout:LOGO="fedora-logo-icon" 2023-12-03T11:21:57.584 INFO:teuthology.orchestra.run.smithi037.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-12-03T11:21:57.584 INFO:teuthology.orchestra.run.smithi037.stdout:HOME_URL="https://centos.org/" 2023-12-03T11:21:57.584 INFO:teuthology.orchestra.run.smithi037.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-03T11:21:57.584 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-12-03T11:21:57.584 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-03T11:21:57.584 INFO:teuthology.lock.ops:Updating smithi037.front.sepia.ceph.com on lock server 2023-12-03T11:21:57.607 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-12-03T11:21:57.617 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-12-03T11:21:57.623 INFO:teuthology.task.internal:Checking for old test directory... 2023-12-03T11:21:57.623 DEBUG:teuthology.orchestra.run.smithi003:> test '!' -e /home/ubuntu/cephtest 2023-12-03T11:21:57.626 DEBUG:teuthology.orchestra.run.smithi037:> test '!' -e /home/ubuntu/cephtest 2023-12-03T11:21:57.642 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-12-03T11:21:57.648 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-12-03T11:21:57.648 DEBUG:teuthology.orchestra.run.smithi003:> test -z $(ls -A /var/lib/ceph) 2023-12-03T11:21:57.684 DEBUG:teuthology.orchestra.run.smithi037:> test -z $(ls -A /var/lib/ceph) 2023-12-03T11:21:57.711 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-12-03T11:21:57.768 INFO:teuthology.run_tasks:Running task kernel... 2023-12-03T11:21:57.783 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-12-03T11:21:57.783 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-12-03T11:21:57.783 DEBUG:teuthology.orchestra.run.smithi003:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-03T11:21:57.784 DEBUG:teuthology.orchestra.run.smithi037:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-03T11:21:57.801 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-03T11:21:57.801 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-03T11:21:57.801 DEBUG:teuthology.orchestra.run.smithi003:> uname -r 2023-12-03T11:21:57.802 DEBUG:teuthology.orchestra.run.smithi037:> uname -r 2023-12-03T11:21:57.859 INFO:teuthology.orchestra.run.smithi037.stdout:5.14.0-361.el9.x86_64 2023-12-03T11:21:57.860 INFO:teuthology.task.kernel:Running kernel on smithi037: 5.14.0-361.el9.x86_64 2023-12-03T11:21:57.860 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum install -y kernel 2023-12-03T11:21:57.861 INFO:teuthology.orchestra.run.smithi003.stdout:5.14.0-361.el9.x86_64 2023-12-03T11:21:57.861 INFO:teuthology.task.kernel:Running kernel on smithi003: 5.14.0-361.el9.x86_64 2023-12-03T11:21:57.861 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum install -y kernel 2023-12-03T11:22:00.115 INFO:teuthology.orchestra.run.smithi003.stdout:CentOS-9 - AppStream 11 MB/s | 6.4 MB 00:00 2023-12-03T11:22:00.154 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS-9 - AppStream 11 MB/s | 6.4 MB 00:00 2023-12-03T11:22:01.499 INFO:teuthology.orchestra.run.smithi003.stdout:CentOS-9 - BaseOS 6.9 MB/s | 2.0 MB 00:00 2023-12-03T11:22:01.538 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS-9 - BaseOS 6.9 MB/s | 2.0 MB 00:00 2023-12-03T11:22:02.545 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 7.9 MB 00:00 2023-12-03T11:22:03.756 INFO:teuthology.orchestra.run.smithi003.stdout:CentOS Stream 9 - BaseOS 4.1 MB/s | 7.9 MB 00:01 2023-12-03T11:22:04.354 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - AppStream 29 MB/s | 18 MB 00:00 2023-12-03T11:22:06.474 INFO:teuthology.orchestra.run.smithi003.stdout:CentOS Stream 9 - AppStream 12 MB/s | 18 MB 00:01 2023-12-03T11:22:09.605 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - CRB 3.4 MB/s | 5.8 MB 00:01 2023-12-03T11:22:11.823 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - Extras packages 14 kB/s | 15 kB 00:01 2023-12-03T11:22:11.908 INFO:teuthology.orchestra.run.smithi003.stdout:CentOS Stream 9 - CRB 3.1 MB/s | 5.8 MB 00:01 2023-12-03T11:22:13.583 INFO:teuthology.orchestra.run.smithi003.stdout:CentOS Stream 9 - Extras packages 29 kB/s | 15 kB 00:00 2023-12-03T11:22:13.759 INFO:teuthology.orchestra.run.smithi037.stdout:Extra Packages for Enterprise Linux 11 MB/s | 20 MB 00:01 2023-12-03T11:22:14.593 INFO:teuthology.orchestra.run.smithi003.stdout:Extra Packages for Enterprise Linux 23 MB/s | 20 MB 00:00 2023-12-03T11:22:18.740 INFO:teuthology.orchestra.run.smithi037.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2023-12-03T11:22:19.493 INFO:teuthology.orchestra.run.smithi003.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2023-12-03T11:22:21.197 INFO:teuthology.orchestra.run.smithi037.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2023-12-03T11:22:21.197 INFO:teuthology.orchestra.run.smithi037.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2023-12-03T11:22:21.291 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2023-12-03T11:22:21.298 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2023-12-03T11:22:21.298 INFO:teuthology.orchestra.run.smithi037.stdout: Package Architecture Version Repository Size 2023-12-03T11:22:21.298 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2023-12-03T11:22:21.298 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2023-12-03T11:22:21.298 INFO:teuthology.orchestra.run.smithi037.stdout: kernel x86_64 5.14.0-388.el9 baseos 5.6 M 2023-12-03T11:22:21.298 INFO:teuthology.orchestra.run.smithi037.stdout:Installing dependencies: 2023-12-03T11:22:21.298 INFO:teuthology.orchestra.run.smithi037.stdout: kernel-core x86_64 5.14.0-388.el9 baseos 20 M 2023-12-03T11:22:21.298 INFO:teuthology.orchestra.run.smithi037.stdout: kernel-modules x86_64 5.14.0-388.el9 baseos 38 M 2023-12-03T11:22:21.299 INFO:teuthology.orchestra.run.smithi037.stdout: kernel-modules-core x86_64 5.14.0-388.el9 baseos 32 M 2023-12-03T11:22:21.299 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-03T11:22:21.299 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2023-12-03T11:22:21.299 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2023-12-03T11:22:21.299 INFO:teuthology.orchestra.run.smithi037.stdout:Install 4 Packages 2023-12-03T11:22:21.299 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-03T11:22:21.299 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 96 M 2023-12-03T11:22:21.299 INFO:teuthology.orchestra.run.smithi037.stdout:Installed size: 121 M 2023-12-03T11:22:21.300 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2023-12-03T11:22:21.885 INFO:teuthology.orchestra.run.smithi003.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2023-12-03T11:22:21.886 INFO:teuthology.orchestra.run.smithi003.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2023-12-03T11:22:21.925 INFO:teuthology.orchestra.run.smithi037.stdout:(1/4): kernel-5.14.0-388.el9.x86_64.rpm 9.6 MB/s | 5.6 MB 00:00 2023-12-03T11:22:21.975 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2023-12-03T11:22:21.984 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2023-12-03T11:22:21.984 INFO:teuthology.orchestra.run.smithi003.stdout: Package Architecture Version Repository Size 2023-12-03T11:22:21.984 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2023-12-03T11:22:21.984 INFO:teuthology.orchestra.run.smithi003.stdout:Installing: 2023-12-03T11:22:21.984 INFO:teuthology.orchestra.run.smithi003.stdout: kernel x86_64 5.14.0-388.el9 baseos 5.6 M 2023-12-03T11:22:21.984 INFO:teuthology.orchestra.run.smithi003.stdout:Installing dependencies: 2023-12-03T11:22:21.984 INFO:teuthology.orchestra.run.smithi003.stdout: kernel-core x86_64 5.14.0-388.el9 baseos 20 M 2023-12-03T11:22:21.984 INFO:teuthology.orchestra.run.smithi003.stdout: kernel-modules x86_64 5.14.0-388.el9 baseos 38 M 2023-12-03T11:22:21.984 INFO:teuthology.orchestra.run.smithi003.stdout: kernel-modules-core x86_64 5.14.0-388.el9 baseos 32 M 2023-12-03T11:22:21.984 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:22:21.984 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction Summary 2023-12-03T11:22:21.985 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2023-12-03T11:22:21.985 INFO:teuthology.orchestra.run.smithi003.stdout:Install 4 Packages 2023-12-03T11:22:21.985 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:22:21.985 INFO:teuthology.orchestra.run.smithi003.stdout:Total download size: 96 M 2023-12-03T11:22:21.985 INFO:teuthology.orchestra.run.smithi003.stdout:Installed size: 121 M 2023-12-03T11:22:21.985 INFO:teuthology.orchestra.run.smithi003.stdout:Downloading Packages: 2023-12-03T11:22:22.992 INFO:teuthology.orchestra.run.smithi037.stdout:(2/4): kernel-core-5.14.0-388.el9.x86_64.rpm 12 MB/s | 20 MB 00:01 2023-12-03T11:22:23.311 INFO:teuthology.orchestra.run.smithi003.stdout:(1/4): kernel-5.14.0-388.el9.x86_64.rpm 5.3 MB/s | 5.6 MB 00:01 2023-12-03T11:22:23.442 INFO:teuthology.orchestra.run.smithi037.stdout:(3/4): kernel-modules-5.14.0-388.el9.x86_64.rpm 18 MB/s | 38 MB 00:02 2023-12-03T11:22:23.743 INFO:teuthology.orchestra.run.smithi037.stdout:(4/4): kernel-modules-core-5.14.0-388.el9.x86_6 18 MB/s | 32 MB 00:01 2023-12-03T11:22:23.743 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2023-12-03T11:22:23.743 INFO:teuthology.orchestra.run.smithi037.stdout:Total 39 MB/s | 96 MB 00:02 2023-12-03T11:22:24.611 INFO:teuthology.orchestra.run.smithi003.stdout:(2/4): kernel-core-5.14.0-388.el9.x86_64.rpm 8.6 MB/s | 20 MB 00:02 2023-12-03T11:22:24.637 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2023-12-03T11:22:25.073 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2023-12-03T11:22:25.073 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2023-12-03T11:22:25.619 INFO:teuthology.orchestra.run.smithi003.stdout:(3/4): kernel-modules-5.14.0-388.el9.x86_64.rpm 11 MB/s | 38 MB 00:03 2023-12-03T11:22:26.028 INFO:teuthology.orchestra.run.smithi003.stdout:(4/4): kernel-modules-core-5.14.0-388.el9.x86_6 12 MB/s | 32 MB 00:02 2023-12-03T11:22:26.028 INFO:teuthology.orchestra.run.smithi003.stdout:-------------------------------------------------------------------------------- 2023-12-03T11:22:26.028 INFO:teuthology.orchestra.run.smithi003.stdout:Total 24 MB/s | 96 MB 00:04 2023-12-03T11:22:26.461 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2023-12-03T11:22:26.462 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2023-12-03T11:22:26.921 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction check 2023-12-03T11:22:27.364 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction check succeeded. 2023-12-03T11:22:27.364 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction test 2023-12-03T11:22:28.715 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction test succeeded. 2023-12-03T11:22:28.715 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction 2023-12-03T11:22:29.242 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2023-12-03T11:22:29.900 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : kernel-modules-core-5.14.0-388.el9.x86_64 1/4 2023-12-03T11:22:30.035 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : kernel-core-5.14.0-388.el9.x86_64 2/4 2023-12-03T11:22:31.495 INFO:teuthology.orchestra.run.smithi003.stdout: Preparing : 1/1 2023-12-03T11:22:32.169 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : kernel-modules-core-5.14.0-388.el9.x86_64 1/4 2023-12-03T11:22:32.311 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : kernel-core-5.14.0-388.el9.x86_64 2/4 2023-12-03T11:22:32.916 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: kernel-core-5.14.0-388.el9.x86_64 2/4 2023-12-03T11:22:33.113 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : kernel-modules-5.14.0-388.el9.x86_64 3/4 2023-12-03T11:22:35.255 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: kernel-core-5.14.0-388.el9.x86_64 2/4 2023-12-03T11:22:35.440 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : kernel-modules-5.14.0-388.el9.x86_64 3/4 2023-12-03T11:22:38.072 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: kernel-modules-5.14.0-388.el9.x86_64 3/4 2023-12-03T11:22:38.190 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : kernel-5.14.0-388.el9.x86_64 4/4 2023-12-03T11:22:40.393 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: kernel-modules-5.14.0-388.el9.x86_64 3/4 2023-12-03T11:22:40.507 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : kernel-5.14.0-388.el9.x86_64 4/4 2023-12-03T11:22:43.178 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: kernel-modules-core-5.14.0-388.el9.x86_64 4/4 2023-12-03T11:22:45.501 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: kernel-modules-core-5.14.0-388.el9.x86_64 4/4 2023-12-03T11:23:13.992 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: kernel-core-5.14.0-388.el9.x86_64 4/4 2023-12-03T11:23:14.037 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: kernel-modules-5.14.0-388.el9.x86_64 4/4 2023-12-03T11:23:14.491 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: kernel-5.14.0-388.el9.x86_64 4/4 2023-12-03T11:23:14.491 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : kernel-5.14.0-388.el9.x86_64 1/4 2023-12-03T11:23:14.491 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : kernel-core-5.14.0-388.el9.x86_64 2/4 2023-12-03T11:23:14.491 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : kernel-modules-5.14.0-388.el9.x86_64 3/4 2023-12-03T11:23:14.892 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : kernel-modules-core-5.14.0-388.el9.x86_64 4/4 2023-12-03T11:23:14.892 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-03T11:23:14.892 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2023-12-03T11:23:14.892 INFO:teuthology.orchestra.run.smithi037.stdout: kernel-5.14.0-388.el9.x86_64 2023-12-03T11:23:14.892 INFO:teuthology.orchestra.run.smithi037.stdout: kernel-core-5.14.0-388.el9.x86_64 2023-12-03T11:23:14.892 INFO:teuthology.orchestra.run.smithi037.stdout: kernel-modules-5.14.0-388.el9.x86_64 2023-12-03T11:23:14.892 INFO:teuthology.orchestra.run.smithi037.stdout: kernel-modules-core-5.14.0-388.el9.x86_64 2023-12-03T11:23:14.892 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-03T11:23:14.892 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2023-12-03T11:23:15.360 DEBUG:teuthology.orchestra.run.smithi037:> rpm -q kernel | sort -rV | head -n 1 2023-12-03T11:23:15.499 INFO:teuthology.orchestra.run.smithi037.stdout:kernel-5.14.0-388.el9.x86_64 2023-12-03T11:23:15.500 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-388.el9.x86_64 2023-12-03T11:23:15.500 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-388.el9.x86_64 2023-12-03T11:23:15.500 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-12-03T11:23:15.500 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-12-03T11:23:15.500 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2023-12-03T11:23:15.500 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi037.front.sepia.ceph.com, path=None, version=distro) 2023-12-03T11:23:15.500 DEBUG:teuthology.orchestra.run.smithi037:> rpm -q kernel | sort -rV | head -n 1 2023-12-03T11:23:15.624 INFO:teuthology.orchestra.run.smithi037.stdout:kernel-5.14.0-388.el9.x86_64 2023-12-03T11:23:15.624 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-388.el9.x86_64 2023-12-03T11:23:15.624 DEBUG:teuthology.orchestra.run.smithi037:> sudo rpm -qi grub2-tools 2023-12-03T11:23:15.662 INFO:teuthology.orchestra.run.smithi037.stdout:Name : grub2-tools 2023-12-03T11:23:15.662 INFO:teuthology.orchestra.run.smithi037.stdout:Epoch : 1 2023-12-03T11:23:15.662 INFO:teuthology.orchestra.run.smithi037.stdout:Version : 2.06 2023-12-03T11:23:15.662 INFO:teuthology.orchestra.run.smithi037.stdout:Release : 68.el9 2023-12-03T11:23:15.663 INFO:teuthology.orchestra.run.smithi037.stdout:Architecture: x86_64 2023-12-03T11:23:15.663 INFO:teuthology.orchestra.run.smithi037.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2023-12-03T11:23:15.663 INFO:teuthology.orchestra.run.smithi037.stdout:Group : Unspecified 2023-12-03T11:23:15.663 INFO:teuthology.orchestra.run.smithi037.stdout:Size : 8264254 2023-12-03T11:23:15.663 INFO:teuthology.orchestra.run.smithi037.stdout:License : GPLv3+ 2023-12-03T11:23:15.663 INFO:teuthology.orchestra.run.smithi037.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2023-12-03T11:23:15.663 INFO:teuthology.orchestra.run.smithi037.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2023-12-03T11:23:15.663 INFO:teuthology.orchestra.run.smithi037.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2023-12-03T11:23:15.663 INFO:teuthology.orchestra.run.smithi037.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2023-12-03T11:23:15.663 INFO:teuthology.orchestra.run.smithi037.stdout:Packager : builder@centos.org 2023-12-03T11:23:15.663 INFO:teuthology.orchestra.run.smithi037.stdout:Vendor : CentOS 2023-12-03T11:23:15.663 INFO:teuthology.orchestra.run.smithi037.stdout:URL : http://www.gnu.org/software/grub/ 2023-12-03T11:23:15.663 INFO:teuthology.orchestra.run.smithi037.stdout:Summary : Support tools for GRUB. 2023-12-03T11:23:15.663 INFO:teuthology.orchestra.run.smithi037.stdout:Description : 2023-12-03T11:23:15.663 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-03T11:23:15.664 INFO:teuthology.orchestra.run.smithi037.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-12-03T11:23:15.664 INFO:teuthology.orchestra.run.smithi037.stdout:customizable bootloader with modular architecture. It supports a rich 2023-12-03T11:23:15.664 INFO:teuthology.orchestra.run.smithi037.stdout:variety of kernel formats, file systems, computer architectures and 2023-12-03T11:23:15.664 INFO:teuthology.orchestra.run.smithi037.stdout:hardware devices. 2023-12-03T11:23:15.664 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-03T11:23:15.664 INFO:teuthology.orchestra.run.smithi037.stdout:This subpackage provides tools for support of all platforms. 2023-12-03T11:23:15.665 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-12-03T11:23:15.665 INFO:teuthology.task.kernel:Updating grub on smithi037 to boot 5.14.0-388.el9.x86_64 2023-12-03T11:23:15.665 DEBUG:teuthology.orchestra.run.smithi037:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-12-03T11:23:15.949 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: kernel-core-5.14.0-388.el9.x86_64 4/4 2023-12-03T11:23:15.994 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: kernel-modules-5.14.0-388.el9.x86_64 4/4 2023-12-03T11:23:16.288 INFO:teuthology.orchestra.run.smithi037.stderr:Generating grub configuration file ... 2023-12-03T11:23:16.443 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: kernel-5.14.0-388.el9.x86_64 4/4 2023-12-03T11:23:16.443 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : kernel-5.14.0-388.el9.x86_64 1/4 2023-12-03T11:23:16.443 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : kernel-core-5.14.0-388.el9.x86_64 2/4 2023-12-03T11:23:16.443 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : kernel-modules-5.14.0-388.el9.x86_64 3/4 2023-12-03T11:23:16.873 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : kernel-modules-core-5.14.0-388.el9.x86_64 4/4 2023-12-03T11:23:16.873 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:23:16.873 INFO:teuthology.orchestra.run.smithi003.stdout:Installed: 2023-12-03T11:23:16.873 INFO:teuthology.orchestra.run.smithi003.stdout: kernel-5.14.0-388.el9.x86_64 2023-12-03T11:23:16.873 INFO:teuthology.orchestra.run.smithi003.stdout: kernel-core-5.14.0-388.el9.x86_64 2023-12-03T11:23:16.873 INFO:teuthology.orchestra.run.smithi003.stdout: kernel-modules-5.14.0-388.el9.x86_64 2023-12-03T11:23:16.873 INFO:teuthology.orchestra.run.smithi003.stdout: kernel-modules-core-5.14.0-388.el9.x86_64 2023-12-03T11:23:16.874 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:23:16.874 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2023-12-03T11:23:17.359 DEBUG:teuthology.orchestra.run.smithi003:> rpm -q kernel | sort -rV | head -n 1 2023-12-03T11:23:17.525 INFO:teuthology.orchestra.run.smithi003.stdout:kernel-5.14.0-388.el9.x86_64 2023-12-03T11:23:17.525 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-388.el9.x86_64 2023-12-03T11:23:17.525 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-388.el9.x86_64 2023-12-03T11:23:17.525 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-12-03T11:23:17.525 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-12-03T11:23:17.525 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2023-12-03T11:23:17.526 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi003.front.sepia.ceph.com, path=None, version=distro) 2023-12-03T11:23:17.526 DEBUG:teuthology.orchestra.run.smithi003:> rpm -q kernel | sort -rV | head -n 1 2023-12-03T11:23:17.633 INFO:teuthology.orchestra.run.smithi037.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2023-12-03T11:23:17.649 INFO:teuthology.orchestra.run.smithi003.stdout:kernel-5.14.0-388.el9.x86_64 2023-12-03T11:23:17.649 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-388.el9.x86_64 2023-12-03T11:23:17.650 DEBUG:teuthology.orchestra.run.smithi003:> sudo rpm -qi grub2-tools 2023-12-03T11:23:17.666 INFO:teuthology.orchestra.run.smithi037.stderr:done 2023-12-03T11:23:17.668 DEBUG:teuthology.orchestra.run.smithi037:> mktemp 2023-12-03T11:23:17.683 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/tmp.gXR7ZeSM8t 2023-12-03T11:23:17.684 DEBUG:teuthology.orchestra.run.smithi037:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.gXR7ZeSM8t 2023-12-03T11:23:17.698 INFO:teuthology.orchestra.run.smithi003.stdout:Name : grub2-tools 2023-12-03T11:23:17.698 INFO:teuthology.orchestra.run.smithi003.stdout:Epoch : 1 2023-12-03T11:23:17.698 INFO:teuthology.orchestra.run.smithi003.stdout:Version : 2.06 2023-12-03T11:23:17.698 INFO:teuthology.orchestra.run.smithi003.stdout:Release : 68.el9 2023-12-03T11:23:17.698 INFO:teuthology.orchestra.run.smithi003.stdout:Architecture: x86_64 2023-12-03T11:23:17.698 INFO:teuthology.orchestra.run.smithi003.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2023-12-03T11:23:17.698 INFO:teuthology.orchestra.run.smithi003.stdout:Group : Unspecified 2023-12-03T11:23:17.698 INFO:teuthology.orchestra.run.smithi003.stdout:Size : 8264254 2023-12-03T11:23:17.699 INFO:teuthology.orchestra.run.smithi003.stdout:License : GPLv3+ 2023-12-03T11:23:17.699 INFO:teuthology.orchestra.run.smithi003.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2023-12-03T11:23:17.699 INFO:teuthology.orchestra.run.smithi003.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2023-12-03T11:23:17.699 INFO:teuthology.orchestra.run.smithi003.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2023-12-03T11:23:17.699 INFO:teuthology.orchestra.run.smithi003.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2023-12-03T11:23:17.699 INFO:teuthology.orchestra.run.smithi003.stdout:Packager : builder@centos.org 2023-12-03T11:23:17.699 INFO:teuthology.orchestra.run.smithi003.stdout:Vendor : CentOS 2023-12-03T11:23:17.699 INFO:teuthology.orchestra.run.smithi003.stdout:URL : http://www.gnu.org/software/grub/ 2023-12-03T11:23:17.699 INFO:teuthology.orchestra.run.smithi003.stdout:Summary : Support tools for GRUB. 2023-12-03T11:23:17.699 INFO:teuthology.orchestra.run.smithi003.stdout:Description : 2023-12-03T11:23:17.699 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:23:17.699 INFO:teuthology.orchestra.run.smithi003.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-12-03T11:23:17.699 INFO:teuthology.orchestra.run.smithi003.stdout:customizable bootloader with modular architecture. It supports a rich 2023-12-03T11:23:17.699 INFO:teuthology.orchestra.run.smithi003.stdout:variety of kernel formats, file systems, computer architectures and 2023-12-03T11:23:17.699 INFO:teuthology.orchestra.run.smithi003.stdout:hardware devices. 2023-12-03T11:23:17.700 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:23:17.700 INFO:teuthology.orchestra.run.smithi003.stdout:This subpackage provides tools for support of all platforms. 2023-12-03T11:23:17.700 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-12-03T11:23:17.700 INFO:teuthology.task.kernel:Updating grub on smithi003 to boot 5.14.0-388.el9.x86_64 2023-12-03T11:23:17.700 DEBUG:teuthology.orchestra.run.smithi003:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-12-03T11:23:17.764 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 0666 /tmp/tmp.gXR7ZeSM8t 2023-12-03T11:23:17.910 DEBUG:teuthology.orchestra.remote:smithi037:/tmp/tmp.gXR7ZeSM8t is 6KB 2023-12-03T11:23:17.958 DEBUG:teuthology.orchestra.run.smithi037:> rm -fr /tmp/tmp.gXR7ZeSM8t 2023-12-03T11:23:17.972 DEBUG:teuthology.orchestra.run.smithi037:> sudo /bin/ls /boot/loader/entries || true 2023-12-03T11:23:18.041 INFO:teuthology.orchestra.run.smithi037.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2023-12-03T11:23:18.041 INFO:teuthology.orchestra.run.smithi037.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2023-12-03T11:23:18.041 INFO:teuthology.orchestra.run.smithi037.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2023-12-03T11:23:18.041 INFO:teuthology.orchestra.run.smithi037.stdout:15949e3c88704300882482eddfd7baae-5.14.0-388.el9.x86_64.conf 2023-12-03T11:23:18.042 DEBUG:teuthology.orchestra.run.smithi037:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-388.el9.x86_64 2023-12-03T11:23:18.170 DEBUG:teuthology.orchestra.run.smithi037:> sudo shutdown -r now 2023-12-03T11:23:18.371 INFO:teuthology.orchestra.run.smithi003.stderr:Generating grub configuration file ... 2023-12-03T11:23:19.726 INFO:teuthology.orchestra.run.smithi003.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2023-12-03T11:23:19.759 INFO:teuthology.orchestra.run.smithi003.stderr:done 2023-12-03T11:23:19.772 DEBUG:teuthology.orchestra.run.smithi003:> mktemp 2023-12-03T11:23:19.788 INFO:teuthology.orchestra.run.smithi003.stdout:/tmp/tmp.hclrLdHO8y 2023-12-03T11:23:19.788 DEBUG:teuthology.orchestra.run.smithi003:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.hclrLdHO8y 2023-12-03T11:23:19.860 DEBUG:teuthology.orchestra.run.smithi003:> sudo chmod 0666 /tmp/tmp.hclrLdHO8y 2023-12-03T11:23:20.006 DEBUG:teuthology.orchestra.remote:smithi003:/tmp/tmp.hclrLdHO8y is 6KB 2023-12-03T11:23:20.055 DEBUG:teuthology.orchestra.run.smithi003:> rm -fr /tmp/tmp.hclrLdHO8y 2023-12-03T11:23:20.070 DEBUG:teuthology.orchestra.run.smithi003:> sudo /bin/ls /boot/loader/entries || true 2023-12-03T11:23:20.148 INFO:teuthology.orchestra.run.smithi003.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2023-12-03T11:23:20.148 INFO:teuthology.orchestra.run.smithi003.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2023-12-03T11:23:20.148 INFO:teuthology.orchestra.run.smithi003.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2023-12-03T11:23:20.148 INFO:teuthology.orchestra.run.smithi003.stdout:15949e3c88704300882482eddfd7baae-5.14.0-388.el9.x86_64.conf 2023-12-03T11:23:20.150 DEBUG:teuthology.orchestra.run.smithi003:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-388.el9.x86_64 2023-12-03T11:23:20.296 DEBUG:teuthology.orchestra.run.smithi003:> sudo shutdown -r now 2023-12-03T11:23:48.199 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2023-12-03T11:23:48.200 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi037.front.sepia.ceph.com' 2023-12-03T11:23:48.200 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-03T11:23:50.301 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-12-03T11:23:50.301 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi003.front.sepia.ceph.com' 2023-12-03T11:23:50.302 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-03T11:24:06.630 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.37 2023-12-03T11:24:08.674 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.3 2023-12-03T11:24:15.638 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi037.front.sepia.ceph.com' 2023-12-03T11:24:15.639 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-03T11:24:17.677 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi003.front.sepia.ceph.com' 2023-12-03T11:24:17.678 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-03T11:24:34.022 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.37 2023-12-03T11:24:46.034 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi037.front.sepia.ceph.com' 2023-12-03T11:24:46.035 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-03T11:24:46.474 DEBUG:teuthology.orchestra.run.smithi037:> true 2023-12-03T11:24:46.971 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi037.front.sepia.ceph.com' 2023-12-03T11:24:46.972 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-388.el9.x86_64"... 2023-12-03T11:24:46.972 DEBUG:teuthology.orchestra.run.smithi037:> uname -r 2023-12-03T11:24:46.986 INFO:teuthology.orchestra.run.smithi037.stdout:5.14.0-388.el9.x86_64 2023-12-03T11:24:46.986 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-388.el9.x86_64 vs 5.14.0-388.el9.x86_64 2023-12-03T11:24:46.986 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-12-03T11:24:46.986 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-12-03T11:24:47.988 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2023-12-03T11:24:47.988 DEBUG:teuthology.orchestra.run.smithi037:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-12-03T11:24:48.101 INFO:teuthology.orchestra.run.smithi037.stdout:ttyS1 2023-12-03T11:24:48.151 DEBUG:teuthology.parallel:result is None 2023-12-03T11:25:17.680 DEBUG:teuthology.orchestra.remote:timed out 2023-12-03T11:25:29.681 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi003.front.sepia.ceph.com' 2023-12-03T11:25:29.682 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-03T11:25:30.043 DEBUG:teuthology.orchestra.run.smithi003:> true 2023-12-03T11:25:30.419 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi003.front.sepia.ceph.com' 2023-12-03T11:25:30.419 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-388.el9.x86_64"... 2023-12-03T11:25:30.419 DEBUG:teuthology.orchestra.run.smithi003:> uname -r 2023-12-03T11:25:30.438 INFO:teuthology.orchestra.run.smithi003.stdout:5.14.0-388.el9.x86_64 2023-12-03T11:25:30.438 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-388.el9.x86_64 vs 5.14.0-388.el9.x86_64 2023-12-03T11:25:30.438 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-12-03T11:25:30.438 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-12-03T11:25:31.439 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-12-03T11:25:31.439 DEBUG:teuthology.orchestra.run.smithi003:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-12-03T11:25:31.501 INFO:teuthology.orchestra.run.smithi003.stdout:ttyS1 2023-12-03T11:25:31.540 DEBUG:teuthology.parallel:result is None 2023-12-03T11:25:31.541 INFO:teuthology.run_tasks:Running task internal.base... 2023-12-03T11:25:45.713 INFO:teuthology.task.internal:Creating test directory... 2023-12-03T11:25:45.714 DEBUG:teuthology.orchestra.run.smithi003:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-03T11:25:45.716 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-03T11:25:45.737 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-12-03T11:25:45.743 INFO:teuthology.run_tasks:Running task internal.archive... 2023-12-03T11:25:45.754 INFO:teuthology.task.internal:Creating archive directory... 2023-12-03T11:25:45.755 DEBUG:teuthology.orchestra.run.smithi003:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-03T11:25:45.775 DEBUG:teuthology.orchestra.run.smithi037:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-03T11:25:45.810 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-12-03T11:25:45.817 INFO:teuthology.task.internal:Enabling coredump saving... 2023-12-03T11:25:45.817 DEBUG:teuthology.orchestra.run.smithi003:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-03T11:25:45.839 DEBUG:teuthology.orchestra.run.smithi037:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-03T11:25:45.876 INFO:teuthology.orchestra.run.smithi003.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-03T11:25:45.890 INFO:teuthology.orchestra.run.smithi037.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-03T11:25:45.894 INFO:teuthology.orchestra.run.smithi003.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-03T11:25:45.908 INFO:teuthology.orchestra.run.smithi037.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-03T11:25:45.909 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-12-03T11:25:45.916 INFO:teuthology.task.internal:Configuring sudo... 2023-12-03T11:25:45.917 DEBUG:teuthology.orchestra.run.smithi003:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-03T11:25:45.939 DEBUG:teuthology.orchestra.run.smithi037:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-03T11:25:45.973 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-12-03T11:25:45.982 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-12-03T11:25:45.982 DEBUG:teuthology.orchestra.run.smithi003:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-03T11:25:46.013 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-03T11:25:46.029 DEBUG:teuthology.orchestra.run.smithi003:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-03T11:25:46.113 DEBUG:teuthology.orchestra.run.smithi003:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-03T11:25:46.162 DEBUG:teuthology.orchestra.run.smithi003:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-03T11:25:46.248 DEBUG:teuthology.orchestra.run.smithi003:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-03T11:25:46.295 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-12-03T11:25:46.295 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-03T11:25:46.367 DEBUG:teuthology.orchestra.run.smithi037:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-03T11:25:46.416 DEBUG:teuthology.orchestra.run.smithi037:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-03T11:25:46.471 DEBUG:teuthology.orchestra.run.smithi037:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-03T11:25:46.555 DEBUG:teuthology.orchestra.run.smithi037:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-03T11:25:46.606 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-12-03T11:25:46.606 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-03T11:25:46.679 DEBUG:teuthology.orchestra.run.smithi003:> sudo service rsyslog restart 2023-12-03T11:25:46.682 DEBUG:teuthology.orchestra.run.smithi037:> sudo service rsyslog restart 2023-12-03T11:25:46.731 INFO:teuthology.orchestra.run.smithi003.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-03T11:25:46.771 INFO:teuthology.orchestra.run.smithi037.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-03T11:25:47.159 INFO:teuthology.run_tasks:Running task internal.timer... 2023-12-03T11:25:47.167 INFO:teuthology.task.internal:Starting timer... 2023-12-03T11:25:47.167 INFO:teuthology.run_tasks:Running task pcp... 2023-12-03T11:25:47.177 INFO:teuthology.run_tasks:Running task selinux... 2023-12-03T11:25:47.186 DEBUG:teuthology.orchestra.run.smithi003:> sudo service auditd rotate 2023-12-03T11:25:47.245 INFO:teuthology.orchestra.run.smithi003.stdout:Rotating logs: 2023-12-03T11:25:47.247 DEBUG:teuthology.orchestra.run.smithi037:> sudo service auditd rotate 2023-12-03T11:25:47.314 INFO:teuthology.orchestra.run.smithi037.stdout:Rotating logs: 2023-12-03T11:25:47.316 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-12-03T11:25:47.316 DEBUG:teuthology.orchestra.run.smithi003:> /usr/sbin/getenforce 2023-12-03T11:25:47.344 INFO:teuthology.orchestra.run.smithi003.stdout:Permissive 2023-12-03T11:25:47.344 DEBUG:teuthology.orchestra.run.smithi037:> /usr/sbin/getenforce 2023-12-03T11:25:47.365 INFO:teuthology.orchestra.run.smithi037.stdout:Permissive 2023-12-03T11:25:47.365 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi003.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi037.front.sepia.ceph.com': 'permissive'} 2023-12-03T11:25:47.365 DEBUG:teuthology.orchestra.run.smithi003:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-03T11:25:47.417 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-03T11:25:47.417 DEBUG:teuthology.orchestra.run.smithi037:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-03T11:25:47.450 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-03T11:25:47.450 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-12-03T11:25:47.451 DEBUG:teuthology.orchestra.run.smithi003:> sudo /usr/sbin/setenforce permissive 2023-12-03T11:25:47.513 DEBUG:teuthology.orchestra.run.smithi037:> sudo /usr/sbin/setenforce permissive 2023-12-03T11:25:47.551 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-12-03T11:25:47.560 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-12-03T11:25:47.561 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-12-03T11:25:47.577 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-12-03T11:25:47.578 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi003.front.sepia.ceph.com,smithi037.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-12-03T11:31:33.593 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi003.front.sepia.ceph.com'), Remote(name='ubuntu@smithi037.front.sepia.ceph.com')] 2023-12-03T11:31:33.594 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi003.front.sepia.ceph.com' 2023-12-03T11:31:33.595 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-03T11:31:33.692 DEBUG:teuthology.orchestra.run.smithi003:> true 2023-12-03T11:31:33.761 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi003.front.sepia.ceph.com' 2023-12-03T11:31:33.761 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi037.front.sepia.ceph.com' 2023-12-03T11:31:33.762 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-03T11:31:33.862 DEBUG:teuthology.orchestra.run.smithi037:> true 2023-12-03T11:31:33.930 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi037.front.sepia.ceph.com' 2023-12-03T11:31:33.930 INFO:teuthology.run_tasks:Running task clock... 2023-12-03T11:31:33.949 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-12-03T11:31:33.949 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-03T11:31:33.950 DEBUG:teuthology.orchestra.run.smithi003:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-03T11:31:33.952 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-03T11:31:33.952 DEBUG:teuthology.orchestra.run.smithi037:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-03T11:31:33.986 INFO:teuthology.orchestra.run.smithi003.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-12-03T11:31:34.006 INFO:teuthology.orchestra.run.smithi003.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-12-03T11:31:34.007 INFO:teuthology.orchestra.run.smithi037.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-12-03T11:31:34.028 INFO:teuthology.orchestra.run.smithi037.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-12-03T11:31:34.043 INFO:teuthology.orchestra.run.smithi003.stderr:sudo: ntpd: command not found 2023-12-03T11:31:34.060 INFO:teuthology.orchestra.run.smithi003.stdout:506 Cannot talk to daemon 2023-12-03T11:31:34.065 INFO:teuthology.orchestra.run.smithi037.stderr:sudo: ntpd: command not found 2023-12-03T11:31:34.080 INFO:teuthology.orchestra.run.smithi003.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-12-03T11:31:34.082 INFO:teuthology.orchestra.run.smithi037.stdout:506 Cannot talk to daemon 2023-12-03T11:31:34.100 INFO:teuthology.orchestra.run.smithi003.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-12-03T11:31:34.102 INFO:teuthology.orchestra.run.smithi037.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-12-03T11:31:34.122 INFO:teuthology.orchestra.run.smithi037.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-12-03T11:31:34.147 INFO:teuthology.orchestra.run.smithi003.stderr:bash: line 1: ntpq: command not found 2023-12-03T11:31:34.150 INFO:teuthology.orchestra.run.smithi003.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-03T11:31:34.150 INFO:teuthology.orchestra.run.smithi003.stdout:=============================================================================== 2023-12-03T11:31:34.150 INFO:teuthology.orchestra.run.smithi003.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-03T11:31:34.150 INFO:teuthology.orchestra.run.smithi003.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-03T11:31:34.150 INFO:teuthology.orchestra.run.smithi003.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-03T11:31:34.150 INFO:teuthology.orchestra.run.smithi003.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-03T11:31:34.169 INFO:teuthology.orchestra.run.smithi037.stderr:bash: line 1: ntpq: command not found 2023-12-03T11:31:34.172 INFO:teuthology.orchestra.run.smithi037.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-03T11:31:34.172 INFO:teuthology.orchestra.run.smithi037.stdout:=============================================================================== 2023-12-03T11:31:34.173 INFO:teuthology.orchestra.run.smithi037.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-03T11:31:34.173 INFO:teuthology.orchestra.run.smithi037.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-03T11:31:34.173 INFO:teuthology.orchestra.run.smithi037.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-03T11:31:34.173 INFO:teuthology.orchestra.run.smithi037.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-03T11:31:34.174 INFO:teuthology.run_tasks:Running task install... 2023-12-03T11:31:34.182 DEBUG:teuthology.task.install:project ceph 2023-12-03T11:31:34.182 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'bcbf278cf395873c2a482f5a7b2345faf2160319'}} 2023-12-03T11:31:34.182 DEBUG:teuthology.task.install:config {'extra_system_packages': {'deb': ['s3cmd'], 'rpm': ['s3cmd']}, 'flavor': 'default', 'sha1': 'bcbf278cf395873c2a482f5a7b2345faf2160319'} 2023-12-03T11:31:34.182 INFO:teuthology.task.install:Using flavor: default 2023-12-03T11:31:34.188 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-12-03T11:31:34.188 INFO:teuthology.task.install:extra packages: [] 2023-12-03T11:31:34.189 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['s3cmd'], 'rpm': ['s3cmd']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'bcbf278cf395873c2a482f5a7b2345faf2160319', 'tag': None, 'wait_for_package': False} 2023-12-03T11:31:34.189 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bcbf278cf395873c2a482f5a7b2345faf2160319 2023-12-03T11:31:34.191 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['s3cmd'], 'rpm': ['s3cmd']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'bcbf278cf395873c2a482f5a7b2345faf2160319', 'tag': None, 'wait_for_package': False} 2023-12-03T11:31:34.191 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bcbf278cf395873c2a482f5a7b2345faf2160319 2023-12-03T11:31:34.333 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-alimasa-multi-pubsub-etag/bcbf278cf395873c2a482f5a7b2345faf2160319/centos/9/flavors/default/ 2023-12-03T11:31:34.334 INFO:teuthology.task.install.rpm:Package version is 18.0.0-7537.gbcbf278c 2023-12-03T11:31:34.401 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-alimasa-multi-pubsub-etag/bcbf278cf395873c2a482f5a7b2345faf2160319/centos/9/flavors/default/ 2023-12-03T11:31:34.401 INFO:teuthology.task.install.rpm:Package version is 18.0.0-7537.gbcbf278c 2023-12-03T11:31:34.448 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-alimasa-multi-pubsub-etag/bcbf278cf395873c2a482f5a7b2345faf2160319/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-alimasa-multi-pubsub-etag/bcbf278cf395873c2a482f5a7b2345faf2160319/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-alimasa-multi-pubsub-etag/bcbf278cf395873c2a482f5a7b2345faf2160319/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-12-03T11:31:34.448 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-12-03T11:31:34.448 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-12-03T11:31:34.481 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, s3cmd, s3cmd, s3cmd on remote rpm x86_64 2023-12-03T11:31:34.482 DEBUG:teuthology.orchestra.run.smithi003:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/bcbf278cf395873c2a482f5a7b2345faf2160319/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-12-03T11:31:34.554 DEBUG:teuthology.orchestra.run.smithi003:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-12-03T11:31:34.567 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-alimasa-multi-pubsub-etag/bcbf278cf395873c2a482f5a7b2345faf2160319/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-alimasa-multi-pubsub-etag/bcbf278cf395873c2a482f5a7b2345faf2160319/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-alimasa-multi-pubsub-etag/bcbf278cf395873c2a482f5a7b2345faf2160319/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-12-03T11:31:34.568 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-12-03T11:31:34.568 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-12-03T11:31:34.600 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, s3cmd, s3cmd, s3cmd, s3cmd on remote rpm x86_64 2023-12-03T11:31:34.601 DEBUG:teuthology.orchestra.run.smithi037:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/bcbf278cf395873c2a482f5a7b2345faf2160319/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-12-03T11:31:34.642 DEBUG:teuthology.orchestra.run.smithi003:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-12-03T11:31:34.672 INFO:teuthology.orchestra.run.smithi003.stdout:check_obsoletes = 1 2023-12-03T11:31:34.673 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum clean all 2023-12-03T11:31:34.674 DEBUG:teuthology.orchestra.run.smithi037:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-12-03T11:31:34.763 DEBUG:teuthology.orchestra.run.smithi037:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-12-03T11:31:34.793 INFO:teuthology.orchestra.run.smithi037.stdout:check_obsoletes = 1 2023-12-03T11:31:34.795 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum clean all 2023-12-03T11:31:34.935 INFO:teuthology.orchestra.run.smithi003.stdout:73 files removed 2023-12-03T11:31:34.964 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd s3cmd s3cmd s3cmd s3cmd 2023-12-03T11:31:35.060 INFO:teuthology.orchestra.run.smithi037.stdout:73 files removed 2023-12-03T11:31:35.087 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd s3cmd s3cmd s3cmd s3cmd 2023-12-03T11:31:35.716 INFO:teuthology.orchestra.run.smithi003.stdout:ceph packages for x86_64 189 kB/s | 78 kB 00:00 2023-12-03T11:31:35.737 INFO:teuthology.orchestra.run.smithi037.stdout:ceph packages for x86_64 252 kB/s | 78 kB 00:00 2023-12-03T11:31:36.104 INFO:teuthology.orchestra.run.smithi037.stdout:ceph noarch packages 30 kB/s | 9.5 kB 00:00 2023-12-03T11:31:36.289 INFO:teuthology.orchestra.run.smithi003.stdout:ceph noarch packages 18 kB/s | 9.5 kB 00:00 2023-12-03T11:31:36.521 INFO:teuthology.orchestra.run.smithi037.stdout:ceph source packages 4.9 kB/s | 1.9 kB 00:00 2023-12-03T11:31:36.614 INFO:teuthology.orchestra.run.smithi003.stdout:ceph source packages 6.5 kB/s | 1.9 kB 00:00 2023-12-03T11:31:37.090 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS-9 - AppStream 12 MB/s | 6.4 MB 00:00 2023-12-03T11:31:37.261 INFO:teuthology.orchestra.run.smithi003.stdout:CentOS-9 - AppStream 11 MB/s | 6.4 MB 00:00 2023-12-03T11:31:38.532 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS-9 - BaseOS 6.3 MB/s | 2.0 MB 00:00 2023-12-03T11:31:38.709 INFO:teuthology.orchestra.run.smithi003.stdout:CentOS-9 - BaseOS 6.7 MB/s | 2.0 MB 00:00 2023-12-03T11:31:40.975 INFO:teuthology.orchestra.run.smithi003.stdout:CentOS Stream 9 - BaseOS 4.1 MB/s | 7.9 MB 00:01 2023-12-03T11:31:41.548 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - BaseOS 3.0 MB/s | 7.9 MB 00:02 2023-12-03T11:31:44.399 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - AppStream 11 MB/s | 18 MB 00:01 2023-12-03T11:31:45.076 INFO:teuthology.orchestra.run.smithi003.stdout:CentOS Stream 9 - AppStream 6.2 MB/s | 18 MB 00:02 2023-12-03T11:31:49.052 INFO:teuthology.orchestra.run.smithi003.stdout:CentOS Stream 9 - CRB 13 MB/s | 5.8 MB 00:00 2023-12-03T11:31:49.253 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - CRB 4.4 MB/s | 5.8 MB 00:01 2023-12-03T11:31:50.718 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - Extras packages 51 kB/s | 15 kB 00:00 2023-12-03T11:31:51.444 INFO:teuthology.orchestra.run.smithi003.stdout:CentOS Stream 9 - Extras packages 12 kB/s | 15 kB 00:01 2023-12-03T11:31:51.928 INFO:teuthology.orchestra.run.smithi037.stdout:Extra Packages for Enterprise Linux 19 MB/s | 20 MB 00:01 2023-12-03T11:31:52.362 INFO:teuthology.orchestra.run.smithi003.stdout:Extra Packages for Enterprise Linux 26 MB/s | 20 MB 00:00 2023-12-03T11:31:56.914 INFO:teuthology.orchestra.run.smithi037.stdout:lab-extras 26 kB/s | 1.7 kB 00:00 2023-12-03T11:31:57.412 INFO:teuthology.orchestra.run.smithi003.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2023-12-03T11:31:59.687 INFO:teuthology.orchestra.run.smithi037.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2023-12-03T11:31:59.687 INFO:teuthology.orchestra.run.smithi037.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2023-12-03T11:31:59.760 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2023-12-03T11:31:59.778 INFO:teuthology.orchestra.run.smithi037.stdout:============================================================================================ 2023-12-03T11:31:59.778 INFO:teuthology.orchestra.run.smithi037.stdout: Package Arch Version Repository Size 2023-12-03T11:31:59.778 INFO:teuthology.orchestra.run.smithi037.stdout:============================================================================================ 2023-12-03T11:31:59.778 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2023-12-03T11:31:59.778 INFO:teuthology.orchestra.run.smithi037.stdout: ceph x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 6.6 k 2023-12-03T11:31:59.778 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-base x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 5.2 M 2023-12-03T11:31:59.778 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-fuse x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 860 k 2023-12-03T11:31:59.778 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 141 k 2023-12-03T11:31:59.778 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 1.5 M 2023-12-03T11:31:59.778 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-cephadm noarch 2:18.0.0-7537.gbcbf278c.el9 ceph-noarch 133 k 2023-12-03T11:31:59.778 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-dashboard noarch 2:18.0.0-7537.gbcbf278c.el9 ceph-noarch 1.8 M 2023-12-03T11:31:59.778 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-7537.gbcbf278c.el9 ceph-noarch 7.4 M 2023-12-03T11:31:59.779 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-rook noarch 2:18.0.0-7537.gbcbf278c.el9 ceph-noarch 50 k 2023-12-03T11:31:59.779 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-radosgw x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 8.6 M 2023-12-03T11:31:59.779 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-test x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 41 M 2023-12-03T11:31:59.779 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-volume noarch 2:18.0.0-7537.gbcbf278c.el9 ceph-noarch 262 k 2023-12-03T11:31:59.779 INFO:teuthology.orchestra.run.smithi037.stdout: cephadm noarch 2:18.0.0-7537.gbcbf278c.el9 ceph-noarch 774 k 2023-12-03T11:31:59.779 INFO:teuthology.orchestra.run.smithi037.stdout: libcephfs-devel x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 31 k 2023-12-03T11:31:59.779 INFO:teuthology.orchestra.run.smithi037.stdout: libcephfs2 x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 718 k 2023-12-03T11:31:59.779 INFO:teuthology.orchestra.run.smithi037.stdout: librados-devel x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 126 k 2023-12-03T11:31:59.779 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cephfs x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 162 k 2023-12-03T11:31:59.779 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rados x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 320 k 2023-12-03T11:31:59.779 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rbd x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 298 k 2023-12-03T11:31:59.779 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rgw x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 99 k 2023-12-03T11:31:59.779 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-fuse x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 85 k 2023-12-03T11:31:59.780 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-mirror x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 3.0 M 2023-12-03T11:31:59.780 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-nbd x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 170 k 2023-12-03T11:31:59.780 INFO:teuthology.orchestra.run.smithi037.stdout: s3cmd noarch 2.3.0-4.el9 epel 197 k 2023-12-03T11:31:59.780 INFO:teuthology.orchestra.run.smithi037.stdout:Upgrading: 2023-12-03T11:31:59.780 INFO:teuthology.orchestra.run.smithi037.stdout: librados2 x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 3.3 M 2023-12-03T11:31:59.780 INFO:teuthology.orchestra.run.smithi037.stdout: librbd1 x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 3.0 M 2023-12-03T11:31:59.780 INFO:teuthology.orchestra.run.smithi037.stdout:Installing dependencies: 2023-12-03T11:31:59.780 INFO:teuthology.orchestra.run.smithi037.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-12-03T11:31:59.780 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-common x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 19 M 2023-12-03T11:31:59.780 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-grafana-dashboards noarch 2:18.0.0-7537.gbcbf278c.el9 ceph-noarch 28 k 2023-12-03T11:31:59.780 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mds x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 2.1 M 2023-12-03T11:31:59.780 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-modules-core noarch 2:18.0.0-7537.gbcbf278c.el9 ceph-noarch 243 k 2023-12-03T11:31:59.780 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mon x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 4.4 M 2023-12-03T11:31:59.780 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-osd x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 18 M 2023-12-03T11:31:59.780 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-prometheus-alerts noarch 2:18.0.0-7537.gbcbf278c.el9 ceph-noarch 15 k 2023-12-03T11:31:59.781 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-selinux x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 24 k 2023-12-03T11:31:59.781 INFO:teuthology.orchestra.run.smithi037.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-12-03T11:31:59.781 INFO:teuthology.orchestra.run.smithi037.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-12-03T11:31:59.781 INFO:teuthology.orchestra.run.smithi037.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-12-03T11:31:59.781 INFO:teuthology.orchestra.run.smithi037.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-12-03T11:31:59.781 INFO:teuthology.orchestra.run.smithi037.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-12-03T11:31:59.781 INFO:teuthology.orchestra.run.smithi037.stdout: jq x86_64 1.6-16.el9 CentOS-AppStream 186 k 2023-12-03T11:31:59.781 INFO:teuthology.orchestra.run.smithi037.stdout: libarrow x86_64 9.0.0-9.el9 epel 4.4 M 2023-12-03T11:31:59.781 INFO:teuthology.orchestra.run.smithi037.stdout: libarrow-doc noarch 9.0.0-9.el9 epel 24 k 2023-12-03T11:31:59.781 INFO:teuthology.orchestra.run.smithi037.stdout: libcephsqlite x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 164 k 2023-12-03T11:31:59.781 INFO:teuthology.orchestra.run.smithi037.stdout: libgfortran x86_64 11.4.1-2.3.el9 CentOS-BaseOS 803 k 2023-12-03T11:31:59.781 INFO:teuthology.orchestra.run.smithi037.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-12-03T11:31:59.781 INFO:teuthology.orchestra.run.smithi037.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-12-03T11:31:59.782 INFO:teuthology.orchestra.run.smithi037.stdout: libquadmath x86_64 11.4.1-2.3.el9 CentOS-BaseOS 195 k 2023-12-03T11:31:59.782 INFO:teuthology.orchestra.run.smithi037.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2023-12-03T11:31:59.782 INFO:teuthology.orchestra.run.smithi037.stdout: libradosstriper1 x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 475 k 2023-12-03T11:31:59.782 INFO:teuthology.orchestra.run.smithi037.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-12-03T11:31:59.782 INFO:teuthology.orchestra.run.smithi037.stdout: librgw2 x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 4.8 M 2023-12-03T11:31:59.782 INFO:teuthology.orchestra.run.smithi037.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-12-03T11:31:59.782 INFO:teuthology.orchestra.run.smithi037.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-12-03T11:31:59.783 INFO:teuthology.orchestra.run.smithi037.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2023-12-03T11:31:59.783 INFO:teuthology.orchestra.run.smithi037.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2023-12-03T11:31:59.783 INFO:teuthology.orchestra.run.smithi037.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2023-12-03T11:31:59.783 INFO:teuthology.orchestra.run.smithi037.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2023-12-03T11:31:59.783 INFO:teuthology.orchestra.run.smithi037.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-12-03T11:31:59.784 INFO:teuthology.orchestra.run.smithi037.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-12-03T11:31:59.784 INFO:teuthology.orchestra.run.smithi037.stdout: parquet-libs x86_64 9.0.0-9.el9 epel 837 k 2023-12-03T11:31:59.784 INFO:teuthology.orchestra.run.smithi037.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-12-03T11:31:59.784 INFO:teuthology.orchestra.run.smithi037.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-12-03T11:31:59.784 INFO:teuthology.orchestra.run.smithi037.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-12-03T11:31:59.784 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-12-03T11:31:59.784 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ceph-argparse x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 45 k 2023-12-03T11:31:59.784 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ceph-common x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 129 k 2023-12-03T11:31:59.784 INFO:teuthology.orchestra.run.smithi037.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-12-03T11:31:59.785 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-12-03T11:31:59.785 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-12-03T11:31:59.785 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-12-03T11:31:59.785 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2023-12-03T11:31:59.785 INFO:teuthology.orchestra.run.smithi037.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2023-12-03T11:31:59.785 INFO:teuthology.orchestra.run.smithi037.stdout: python3-google-auth noarch 1:2.23.4-1.el9 epel 197 k 2023-12-03T11:31:59.785 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-12-03T11:31:59.785 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-12-03T11:31:59.785 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-12-03T11:31:59.786 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-12-03T11:31:59.786 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-12-03T11:31:59.786 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-12-03T11:31:59.786 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-12-03T11:31:59.786 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-12-03T11:31:59.786 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-12-03T11:31:59.787 INFO:teuthology.orchestra.run.smithi037.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-12-03T11:31:59.787 INFO:teuthology.orchestra.run.smithi037.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-12-03T11:31:59.787 INFO:teuthology.orchestra.run.smithi037.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-12-03T11:31:59.787 INFO:teuthology.orchestra.run.smithi037.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-12-03T11:31:59.787 INFO:teuthology.orchestra.run.smithi037.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-12-03T11:31:59.787 INFO:teuthology.orchestra.run.smithi037.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-12-03T11:31:59.787 INFO:teuthology.orchestra.run.smithi037.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-12-03T11:31:59.788 INFO:teuthology.orchestra.run.smithi037.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-12-03T11:31:59.788 INFO:teuthology.orchestra.run.smithi037.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-12-03T11:31:59.788 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-12-03T11:31:59.788 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-12-03T11:31:59.788 INFO:teuthology.orchestra.run.smithi037.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-12-03T11:31:59.788 INFO:teuthology.orchestra.run.smithi037.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-12-03T11:31:59.788 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-12-03T11:31:59.788 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-12-03T11:31:59.788 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-12-03T11:31:59.789 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-12-03T11:31:59.789 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2023-12-03T11:31:59.789 INFO:teuthology.orchestra.run.smithi037.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-12-03T11:31:59.789 INFO:teuthology.orchestra.run.smithi037.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2023-12-03T11:31:59.789 INFO:teuthology.orchestra.run.smithi037.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-12-03T11:31:59.789 INFO:teuthology.orchestra.run.smithi037.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-12-03T11:31:59.789 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-12-03T11:31:59.789 INFO:teuthology.orchestra.run.smithi037.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-12-03T11:31:59.789 INFO:teuthology.orchestra.run.smithi037.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-12-03T11:31:59.790 INFO:teuthology.orchestra.run.smithi037.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-12-03T11:31:59.790 INFO:teuthology.orchestra.run.smithi037.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-12-03T11:31:59.790 INFO:teuthology.orchestra.run.smithi037.stdout: python3-urllib3 noarch 1.26.5-4.el9 CentOS-BaseOS 187 k 2023-12-03T11:31:59.790 INFO:teuthology.orchestra.run.smithi037.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-12-03T11:31:59.790 INFO:teuthology.orchestra.run.smithi037.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-12-03T11:31:59.790 INFO:teuthology.orchestra.run.smithi037.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-12-03T11:31:59.791 INFO:teuthology.orchestra.run.smithi037.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-12-03T11:31:59.791 INFO:teuthology.orchestra.run.smithi037.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2023-12-03T11:31:59.791 INFO:teuthology.orchestra.run.smithi037.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-12-03T11:31:59.791 INFO:teuthology.orchestra.run.smithi037.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-12-03T11:31:59.791 INFO:teuthology.orchestra.run.smithi037.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-12-03T11:31:59.791 INFO:teuthology.orchestra.run.smithi037.stdout:Installing weak dependencies: 2023-12-03T11:31:59.791 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-12-03T11:31:59.792 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-03T11:31:59.792 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2023-12-03T11:31:59.792 INFO:teuthology.orchestra.run.smithi037.stdout:============================================================================================ 2023-12-03T11:31:59.792 INFO:teuthology.orchestra.run.smithi037.stdout:Install 118 Packages 2023-12-03T11:31:59.792 INFO:teuthology.orchestra.run.smithi037.stdout:Upgrade 2 Packages 2023-12-03T11:31:59.792 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-03T11:31:59.793 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 181 M 2023-12-03T11:31:59.793 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2023-12-03T11:32:00.224 INFO:teuthology.orchestra.run.smithi037.stdout:(1/120): ceph-18.0.0-7537.gbcbf278c.el9.x86_64. 41 kB/s | 6.6 kB 00:00 2023-12-03T11:32:00.242 INFO:teuthology.orchestra.run.smithi003.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2023-12-03T11:32:00.243 INFO:teuthology.orchestra.run.smithi003.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2023-12-03T11:32:00.318 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2023-12-03T11:32:00.337 INFO:teuthology.orchestra.run.smithi003.stdout:============================================================================================ 2023-12-03T11:32:00.337 INFO:teuthology.orchestra.run.smithi003.stdout: Package Arch Version Repository Size 2023-12-03T11:32:00.337 INFO:teuthology.orchestra.run.smithi003.stdout:============================================================================================ 2023-12-03T11:32:00.337 INFO:teuthology.orchestra.run.smithi003.stdout:Installing: 2023-12-03T11:32:00.338 INFO:teuthology.orchestra.run.smithi003.stdout: ceph x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 6.6 k 2023-12-03T11:32:00.338 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-base x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 5.2 M 2023-12-03T11:32:00.338 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-fuse x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 860 k 2023-12-03T11:32:00.338 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 141 k 2023-12-03T11:32:00.338 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mgr x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 1.5 M 2023-12-03T11:32:00.338 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mgr-cephadm noarch 2:18.0.0-7537.gbcbf278c.el9 ceph-noarch 133 k 2023-12-03T11:32:00.338 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mgr-dashboard noarch 2:18.0.0-7537.gbcbf278c.el9 ceph-noarch 1.8 M 2023-12-03T11:32:00.338 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-7537.gbcbf278c.el9 ceph-noarch 7.4 M 2023-12-03T11:32:00.338 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mgr-rook noarch 2:18.0.0-7537.gbcbf278c.el9 ceph-noarch 50 k 2023-12-03T11:32:00.338 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-radosgw x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 8.6 M 2023-12-03T11:32:00.338 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-test x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 41 M 2023-12-03T11:32:00.338 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-volume noarch 2:18.0.0-7537.gbcbf278c.el9 ceph-noarch 262 k 2023-12-03T11:32:00.338 INFO:teuthology.orchestra.run.smithi003.stdout: cephadm noarch 2:18.0.0-7537.gbcbf278c.el9 ceph-noarch 774 k 2023-12-03T11:32:00.339 INFO:teuthology.orchestra.run.smithi003.stdout: libcephfs-devel x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 31 k 2023-12-03T11:32:00.339 INFO:teuthology.orchestra.run.smithi003.stdout: libcephfs2 x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 718 k 2023-12-03T11:32:00.339 INFO:teuthology.orchestra.run.smithi003.stdout: librados-devel x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 126 k 2023-12-03T11:32:00.339 INFO:teuthology.orchestra.run.smithi003.stdout: python3-cephfs x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 162 k 2023-12-03T11:32:00.339 INFO:teuthology.orchestra.run.smithi003.stdout: python3-rados x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 320 k 2023-12-03T11:32:00.339 INFO:teuthology.orchestra.run.smithi003.stdout: python3-rbd x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 298 k 2023-12-03T11:32:00.339 INFO:teuthology.orchestra.run.smithi003.stdout: python3-rgw x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 99 k 2023-12-03T11:32:00.339 INFO:teuthology.orchestra.run.smithi003.stdout: rbd-fuse x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 85 k 2023-12-03T11:32:00.339 INFO:teuthology.orchestra.run.smithi003.stdout: rbd-mirror x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 3.0 M 2023-12-03T11:32:00.339 INFO:teuthology.orchestra.run.smithi003.stdout: rbd-nbd x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 170 k 2023-12-03T11:32:00.339 INFO:teuthology.orchestra.run.smithi003.stdout: s3cmd noarch 2.3.0-4.el9 epel 197 k 2023-12-03T11:32:00.339 INFO:teuthology.orchestra.run.smithi003.stdout:Upgrading: 2023-12-03T11:32:00.340 INFO:teuthology.orchestra.run.smithi003.stdout: librados2 x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 3.3 M 2023-12-03T11:32:00.340 INFO:teuthology.orchestra.run.smithi003.stdout: librbd1 x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 3.0 M 2023-12-03T11:32:00.340 INFO:teuthology.orchestra.run.smithi003.stdout:Installing dependencies: 2023-12-03T11:32:00.340 INFO:teuthology.orchestra.run.smithi003.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-12-03T11:32:00.340 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-common x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 19 M 2023-12-03T11:32:00.340 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-grafana-dashboards noarch 2:18.0.0-7537.gbcbf278c.el9 ceph-noarch 28 k 2023-12-03T11:32:00.340 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mds x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 2.1 M 2023-12-03T11:32:00.340 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mgr-modules-core noarch 2:18.0.0-7537.gbcbf278c.el9 ceph-noarch 243 k 2023-12-03T11:32:00.340 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mon x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 4.4 M 2023-12-03T11:32:00.340 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-osd x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 18 M 2023-12-03T11:32:00.340 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-prometheus-alerts noarch 2:18.0.0-7537.gbcbf278c.el9 ceph-noarch 15 k 2023-12-03T11:32:00.340 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-selinux x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 24 k 2023-12-03T11:32:00.340 INFO:teuthology.orchestra.run.smithi003.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-12-03T11:32:00.340 INFO:teuthology.orchestra.run.smithi003.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-12-03T11:32:00.340 INFO:teuthology.orchestra.run.smithi003.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-12-03T11:32:00.340 INFO:teuthology.orchestra.run.smithi003.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-12-03T11:32:00.341 INFO:teuthology.orchestra.run.smithi003.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-12-03T11:32:00.341 INFO:teuthology.orchestra.run.smithi003.stdout: jq x86_64 1.6-16.el9 CentOS-AppStream 186 k 2023-12-03T11:32:00.341 INFO:teuthology.orchestra.run.smithi003.stdout: libarrow x86_64 9.0.0-9.el9 epel 4.4 M 2023-12-03T11:32:00.341 INFO:teuthology.orchestra.run.smithi003.stdout: libarrow-doc noarch 9.0.0-9.el9 epel 24 k 2023-12-03T11:32:00.341 INFO:teuthology.orchestra.run.smithi003.stdout: libcephsqlite x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 164 k 2023-12-03T11:32:00.341 INFO:teuthology.orchestra.run.smithi003.stdout: libgfortran x86_64 11.4.1-2.3.el9 CentOS-BaseOS 803 k 2023-12-03T11:32:00.341 INFO:teuthology.orchestra.run.smithi003.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-12-03T11:32:00.341 INFO:teuthology.orchestra.run.smithi003.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-12-03T11:32:00.341 INFO:teuthology.orchestra.run.smithi003.stdout: libquadmath x86_64 11.4.1-2.3.el9 CentOS-BaseOS 195 k 2023-12-03T11:32:00.341 INFO:teuthology.orchestra.run.smithi003.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2023-12-03T11:32:00.341 INFO:teuthology.orchestra.run.smithi003.stdout: libradosstriper1 x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 475 k 2023-12-03T11:32:00.341 INFO:teuthology.orchestra.run.smithi003.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-12-03T11:32:00.341 INFO:teuthology.orchestra.run.smithi003.stdout: librgw2 x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 4.8 M 2023-12-03T11:32:00.341 INFO:teuthology.orchestra.run.smithi003.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-12-03T11:32:00.341 INFO:teuthology.orchestra.run.smithi003.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-12-03T11:32:00.342 INFO:teuthology.orchestra.run.smithi003.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2023-12-03T11:32:00.342 INFO:teuthology.orchestra.run.smithi003.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2023-12-03T11:32:00.342 INFO:teuthology.orchestra.run.smithi003.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2023-12-03T11:32:00.342 INFO:teuthology.orchestra.run.smithi003.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2023-12-03T11:32:00.342 INFO:teuthology.orchestra.run.smithi003.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-12-03T11:32:00.342 INFO:teuthology.orchestra.run.smithi003.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-12-03T11:32:00.342 INFO:teuthology.orchestra.run.smithi003.stdout: parquet-libs x86_64 9.0.0-9.el9 epel 837 k 2023-12-03T11:32:00.342 INFO:teuthology.orchestra.run.smithi003.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-12-03T11:32:00.342 INFO:teuthology.orchestra.run.smithi003.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-12-03T11:32:00.342 INFO:teuthology.orchestra.run.smithi003.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-12-03T11:32:00.342 INFO:teuthology.orchestra.run.smithi003.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-12-03T11:32:00.342 INFO:teuthology.orchestra.run.smithi003.stdout: python3-ceph-argparse x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 45 k 2023-12-03T11:32:00.342 INFO:teuthology.orchestra.run.smithi003.stdout: python3-ceph-common x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 129 k 2023-12-03T11:32:00.343 INFO:teuthology.orchestra.run.smithi003.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-12-03T11:32:00.343 INFO:teuthology.orchestra.run.smithi003.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-12-03T11:32:00.343 INFO:teuthology.orchestra.run.smithi003.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-12-03T11:32:00.343 INFO:teuthology.orchestra.run.smithi003.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-12-03T11:32:00.343 INFO:teuthology.orchestra.run.smithi003.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2023-12-03T11:32:00.343 INFO:teuthology.orchestra.run.smithi003.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2023-12-03T11:32:00.343 INFO:teuthology.orchestra.run.smithi003.stdout: python3-google-auth noarch 1:2.23.4-1.el9 epel 197 k 2023-12-03T11:32:00.343 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-12-03T11:32:00.343 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-12-03T11:32:00.343 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-12-03T11:32:00.343 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-12-03T11:32:00.343 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-12-03T11:32:00.344 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-12-03T11:32:00.344 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-12-03T11:32:00.344 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-12-03T11:32:00.344 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-12-03T11:32:00.344 INFO:teuthology.orchestra.run.smithi003.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-12-03T11:32:00.344 INFO:teuthology.orchestra.run.smithi003.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-12-03T11:32:00.344 INFO:teuthology.orchestra.run.smithi003.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-12-03T11:32:00.344 INFO:teuthology.orchestra.run.smithi003.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-12-03T11:32:00.344 INFO:teuthology.orchestra.run.smithi003.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-12-03T11:32:00.344 INFO:teuthology.orchestra.run.smithi003.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-12-03T11:32:00.344 INFO:teuthology.orchestra.run.smithi003.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-12-03T11:32:00.344 INFO:teuthology.orchestra.run.smithi003.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-12-03T11:32:00.345 INFO:teuthology.orchestra.run.smithi003.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-12-03T11:32:00.345 INFO:teuthology.orchestra.run.smithi003.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-12-03T11:32:00.345 INFO:teuthology.orchestra.run.smithi003.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-12-03T11:32:00.345 INFO:teuthology.orchestra.run.smithi003.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-12-03T11:32:00.345 INFO:teuthology.orchestra.run.smithi003.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-12-03T11:32:00.345 INFO:teuthology.orchestra.run.smithi003.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-12-03T11:32:00.345 INFO:teuthology.orchestra.run.smithi003.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-12-03T11:32:00.345 INFO:teuthology.orchestra.run.smithi003.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-12-03T11:32:00.345 INFO:teuthology.orchestra.run.smithi003.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-12-03T11:32:00.345 INFO:teuthology.orchestra.run.smithi003.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2023-12-03T11:32:00.345 INFO:teuthology.orchestra.run.smithi003.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-12-03T11:32:00.345 INFO:teuthology.orchestra.run.smithi003.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2023-12-03T11:32:00.345 INFO:teuthology.orchestra.run.smithi003.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-12-03T11:32:00.345 INFO:teuthology.orchestra.run.smithi003.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-12-03T11:32:00.346 INFO:teuthology.orchestra.run.smithi003.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-12-03T11:32:00.346 INFO:teuthology.orchestra.run.smithi003.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-12-03T11:32:00.346 INFO:teuthology.orchestra.run.smithi003.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-12-03T11:32:00.346 INFO:teuthology.orchestra.run.smithi003.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-12-03T11:32:00.346 INFO:teuthology.orchestra.run.smithi003.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-12-03T11:32:00.346 INFO:teuthology.orchestra.run.smithi003.stdout: python3-urllib3 noarch 1.26.5-4.el9 CentOS-BaseOS 187 k 2023-12-03T11:32:00.346 INFO:teuthology.orchestra.run.smithi003.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-12-03T11:32:00.346 INFO:teuthology.orchestra.run.smithi003.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-12-03T11:32:00.346 INFO:teuthology.orchestra.run.smithi003.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-12-03T11:32:00.346 INFO:teuthology.orchestra.run.smithi003.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-12-03T11:32:00.346 INFO:teuthology.orchestra.run.smithi003.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2023-12-03T11:32:00.346 INFO:teuthology.orchestra.run.smithi003.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-12-03T11:32:00.347 INFO:teuthology.orchestra.run.smithi003.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-12-03T11:32:00.347 INFO:teuthology.orchestra.run.smithi003.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-12-03T11:32:00.347 INFO:teuthology.orchestra.run.smithi003.stdout:Installing weak dependencies: 2023-12-03T11:32:00.347 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-12-03T11:32:00.347 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:32:00.347 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction Summary 2023-12-03T11:32:00.347 INFO:teuthology.orchestra.run.smithi003.stdout:============================================================================================ 2023-12-03T11:32:00.347 INFO:teuthology.orchestra.run.smithi003.stdout:Install 118 Packages 2023-12-03T11:32:00.347 INFO:teuthology.orchestra.run.smithi003.stdout:Upgrade 2 Packages 2023-12-03T11:32:00.347 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:32:00.348 INFO:teuthology.orchestra.run.smithi003.stdout:Total download size: 181 M 2023-12-03T11:32:00.348 INFO:teuthology.orchestra.run.smithi003.stdout:Downloading Packages: 2023-12-03T11:32:00.441 INFO:teuthology.orchestra.run.smithi037.stdout:(2/120): ceph-fuse-18.0.0-7537.gbcbf278c.el9.x8 3.9 MB/s | 860 kB 00:00 2023-12-03T11:32:00.499 INFO:teuthology.orchestra.run.smithi037.stdout:(3/120): ceph-immutable-object-cache-18.0.0-753 2.4 MB/s | 141 kB 00:00 2023-12-03T11:32:00.741 INFO:teuthology.orchestra.run.smithi037.stdout:(4/120): ceph-mds-18.0.0-7537.gbcbf278c.el9.x86 8.6 MB/s | 2.1 MB 00:00 2023-12-03T11:32:00.950 INFO:teuthology.orchestra.run.smithi037.stdout:(5/120): ceph-mgr-18.0.0-7537.gbcbf278c.el9.x86 7.0 MB/s | 1.5 MB 00:00 2023-12-03T11:32:01.288 INFO:teuthology.orchestra.run.smithi003.stdout:(1/120): ceph-18.0.0-7537.gbcbf278c.el9.x86_64. 20 kB/s | 6.6 kB 00:00 2023-12-03T11:32:01.564 INFO:teuthology.orchestra.run.smithi003.stdout:(2/120): ceph-fuse-18.0.0-7537.gbcbf278c.el9.x8 3.1 MB/s | 860 kB 00:00 2023-12-03T11:32:01.614 INFO:teuthology.orchestra.run.smithi003.stdout:(3/120): ceph-immutable-object-cache-18.0.0-753 2.8 MB/s | 141 kB 00:00 2023-12-03T11:32:01.650 INFO:teuthology.orchestra.run.smithi037.stdout:(6/120): ceph-common-18.0.0-7537.gbcbf278c.el9. 12 MB/s | 19 MB 00:01 2023-12-03T11:32:01.709 INFO:teuthology.orchestra.run.smithi037.stdout:(7/120): ceph-mon-18.0.0-7537.gbcbf278c.el9.x86 5.8 MB/s | 4.4 MB 00:00 2023-12-03T11:32:01.793 INFO:teuthology.orchestra.run.smithi037.stdout:(8/120): ceph-base-18.0.0-7537.gbcbf278c.el9.x8 3.0 MB/s | 5.2 MB 00:01 2023-12-03T11:32:01.881 INFO:teuthology.orchestra.run.smithi003.stdout:(4/120): ceph-mds-18.0.0-7537.gbcbf278c.el9.x86 7.8 MB/s | 2.1 MB 00:00 2023-12-03T11:32:01.909 INFO:teuthology.orchestra.run.smithi037.stdout:(9/120): ceph-selinux-18.0.0-7537.gbcbf278c.el9 207 kB/s | 24 kB 00:00 2023-12-03T11:32:02.181 INFO:teuthology.orchestra.run.smithi003.stdout:(5/120): ceph-mgr-18.0.0-7537.gbcbf278c.el9.x86 4.9 MB/s | 1.5 MB 00:00 2023-12-03T11:32:02.889 INFO:teuthology.orchestra.run.smithi003.stdout:(6/120): ceph-mon-18.0.0-7537.gbcbf278c.el9.x86 6.2 MB/s | 4.4 MB 00:00 2023-12-03T11:32:03.368 INFO:teuthology.orchestra.run.smithi037.stdout:(10/120): ceph-osd-18.0.0-7537.gbcbf278c.el9.x8 10 MB/s | 18 MB 00:01 2023-12-03T11:32:03.443 INFO:teuthology.orchestra.run.smithi037.stdout:(11/120): libcephfs-devel-18.0.0-7537.gbcbf278c 416 kB/s | 31 kB 00:00 2023-12-03T11:32:03.552 INFO:teuthology.orchestra.run.smithi037.stdout:(12/120): libcephfs2-18.0.0-7537.gbcbf278c.el9. 6.5 MB/s | 718 kB 00:00 2023-12-03T11:32:03.627 INFO:teuthology.orchestra.run.smithi037.stdout:(13/120): libcephsqlite-18.0.0-7537.gbcbf278c.e 2.1 MB/s | 164 kB 00:00 2023-12-03T11:32:03.702 INFO:teuthology.orchestra.run.smithi037.stdout:(14/120): librados-devel-18.0.0-7537.gbcbf278c. 1.6 MB/s | 126 kB 00:00 2023-12-03T11:32:03.802 INFO:teuthology.orchestra.run.smithi037.stdout:(15/120): libradosstriper1-18.0.0-7537.gbcbf278 4.7 MB/s | 475 kB 00:00 2023-12-03T11:32:04.477 INFO:teuthology.orchestra.run.smithi037.stdout:(16/120): librgw2-18.0.0-7537.gbcbf278c.el9.x86 7.1 MB/s | 4.8 MB 00:00 2023-12-03T11:32:04.536 INFO:teuthology.orchestra.run.smithi037.stdout:(17/120): python3-ceph-argparse-18.0.0-7537.gbc 775 kB/s | 45 kB 00:00 2023-12-03T11:32:04.606 INFO:teuthology.orchestra.run.smithi003.stdout:(7/120): ceph-common-18.0.0-7537.gbcbf278c.el9. 5.2 MB/s | 19 MB 00:03 2023-12-03T11:32:04.611 INFO:teuthology.orchestra.run.smithi037.stdout:(18/120): python3-ceph-common-18.0.0-7537.gbcbf 1.7 MB/s | 129 kB 00:00 2023-12-03T11:32:04.695 INFO:teuthology.orchestra.run.smithi037.stdout:(19/120): python3-cephfs-18.0.0-7537.gbcbf278c. 1.9 MB/s | 162 kB 00:00 2023-12-03T11:32:04.779 INFO:teuthology.orchestra.run.smithi037.stdout:(20/120): python3-rados-18.0.0-7537.gbcbf278c.e 3.8 MB/s | 320 kB 00:00 2023-12-03T11:32:04.879 INFO:teuthology.orchestra.run.smithi037.stdout:(21/120): ceph-radosgw-18.0.0-7537.gbcbf278c.el 2.7 MB/s | 8.6 MB 00:03 2023-12-03T11:32:04.904 INFO:teuthology.orchestra.run.smithi037.stdout:(22/120): python3-rbd-18.0.0-7537.gbcbf278c.el9 2.3 MB/s | 298 kB 00:00 2023-12-03T11:32:04.929 INFO:teuthology.orchestra.run.smithi037.stdout:(23/120): python3-rgw-18.0.0-7537.gbcbf278c.el9 1.9 MB/s | 99 kB 00:00 2023-12-03T11:32:04.955 INFO:teuthology.orchestra.run.smithi037.stdout:(24/120): rbd-fuse-18.0.0-7537.gbcbf278c.el9.x8 1.7 MB/s | 85 kB 00:00 2023-12-03T11:32:05.007 INFO:teuthology.orchestra.run.smithi003.stdout:(8/120): ceph-osd-18.0.0-7537.gbcbf278c.el9.x86 8.4 MB/s | 18 MB 00:02 2023-12-03T11:32:05.013 INFO:teuthology.orchestra.run.smithi037.stdout:(25/120): rbd-nbd-18.0.0-7537.gbcbf278c.el9.x86 2.9 MB/s | 170 kB 00:00 2023-12-03T11:32:05.065 INFO:teuthology.orchestra.run.smithi003.stdout:(9/120): ceph-selinux-18.0.0-7537.gbcbf278c.el9 416 kB/s | 24 kB 00:00 2023-12-03T11:32:05.072 INFO:teuthology.orchestra.run.smithi037.stdout:(26/120): ceph-grafana-dashboards-18.0.0-7537.g 480 kB/s | 28 kB 00:00 2023-12-03T11:32:05.164 INFO:teuthology.orchestra.run.smithi037.stdout:(27/120): ceph-mgr-cephadm-18.0.0-7537.gbcbf278 1.4 MB/s | 133 kB 00:00 2023-12-03T11:32:05.464 INFO:teuthology.orchestra.run.smithi037.stdout:(28/120): ceph-mgr-dashboard-18.0.0-7537.gbcbf2 5.9 MB/s | 1.8 MB 00:00 2023-12-03T11:32:05.791 INFO:teuthology.orchestra.run.smithi003.stdout:(10/120): ceph-radosgw-18.0.0-7537.gbcbf278c.el 7.3 MB/s | 8.6 MB 00:01 2023-12-03T11:32:05.848 INFO:teuthology.orchestra.run.smithi037.stdout:(29/120): rbd-mirror-18.0.0-7537.gbcbf278c.el9. 3.3 MB/s | 3.0 MB 00:00 2023-12-03T11:32:05.907 INFO:teuthology.orchestra.run.smithi003.stdout:(11/120): libcephfs-devel-18.0.0-7537.gbcbf278c 269 kB/s | 31 kB 00:00 2023-12-03T11:32:05.973 INFO:teuthology.orchestra.run.smithi037.stdout:(30/120): ceph-mgr-modules-core-18.0.0-7537.gbc 1.9 MB/s | 243 kB 00:00 2023-12-03T11:32:06.065 INFO:teuthology.orchestra.run.smithi037.stdout:(31/120): ceph-mgr-rook-18.0.0-7537.gbcbf278c.e 549 kB/s | 50 kB 00:00 2023-12-03T11:32:06.086 INFO:teuthology.orchestra.run.smithi003.stdout:(12/120): libcephfs2-18.0.0-7537.gbcbf278c.el9. 3.9 MB/s | 718 kB 00:00 2023-12-03T11:32:06.123 INFO:teuthology.orchestra.run.smithi037.stdout:(32/120): ceph-prometheus-alerts-18.0.0-7537.gb 259 kB/s | 15 kB 00:00 2023-12-03T11:32:06.186 INFO:teuthology.orchestra.run.smithi003.stdout:(13/120): libcephsqlite-18.0.0-7537.gbcbf278c.e 1.6 MB/s | 164 kB 00:00 2023-12-03T11:32:06.249 INFO:teuthology.orchestra.run.smithi037.stdout:(33/120): ceph-volume-18.0.0-7537.gbcbf278c.el9 2.1 MB/s | 262 kB 00:00 2023-12-03T11:32:06.295 INFO:teuthology.orchestra.run.smithi003.stdout:(14/120): librados-devel-18.0.0-7537.gbcbf278c. 1.1 MB/s | 126 kB 00:00 2023-12-03T11:32:06.349 INFO:teuthology.orchestra.run.smithi037.stdout:(34/120): ceph-mgr-diskprediction-local-18.0.0- 8.4 MB/s | 7.4 MB 00:00 2023-12-03T11:32:06.379 INFO:teuthology.orchestra.run.smithi003.stdout:(15/120): libradosstriper1-18.0.0-7537.gbcbf278 5.6 MB/s | 475 kB 00:00 2023-12-03T11:32:06.466 INFO:teuthology.orchestra.run.smithi037.stdout:(35/120): boost-program-options-1.75.0-8.el9.x8 908 kB/s | 106 kB 00:00 2023-12-03T11:32:06.491 INFO:teuthology.orchestra.run.smithi037.stdout:(36/120): flexiblas-3.0.4-8.el9.x86_64.rpm 1.2 MB/s | 32 kB 00:00 2023-12-03T11:32:06.550 INFO:teuthology.orchestra.run.smithi037.stdout:(37/120): cephadm-18.0.0-7537.gbcbf278c.el9.noa 2.5 MB/s | 774 kB 00:00 2023-12-03T11:32:06.608 INFO:teuthology.orchestra.run.smithi037.stdout:(38/120): flexiblas-netlib-3.0.4-8.el9.x86_64.r 26 MB/s | 3.0 MB 00:00 2023-12-03T11:32:06.634 INFO:teuthology.orchestra.run.smithi037.stdout:(39/120): flexiblas-openblas-openmp-3.0.4-8.el9 211 kB/s | 17 kB 00:00 2023-12-03T11:32:06.659 INFO:teuthology.orchestra.run.smithi037.stdout:(40/120): jq-1.6-16.el9.x86_64.rpm 3.6 MB/s | 186 kB 00:00 2023-12-03T11:32:06.684 INFO:teuthology.orchestra.run.smithi037.stdout:(41/120): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 159 kB 00:00 2023-12-03T11:32:06.709 INFO:teuthology.orchestra.run.smithi037.stdout:(42/120): librabbitmq-0.11.0-7.el9.x86_64.rpm 881 kB/s | 44 kB 00:00 2023-12-03T11:32:06.735 INFO:teuthology.orchestra.run.smithi037.stdout:(43/120): librdkafka-1.6.1-102.el9.x86_64.rpm 13 MB/s | 661 kB 00:00 2023-12-03T11:32:06.760 INFO:teuthology.orchestra.run.smithi037.stdout:(44/120): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.6 MB/s | 282 kB 00:00 2023-12-03T11:32:06.794 INFO:teuthology.orchestra.run.smithi037.stdout:(45/120): lua-5.4.4-4.el9.x86_64.rpm 3.1 MB/s | 187 kB 00:00 2023-12-03T11:32:06.819 INFO:teuthology.orchestra.run.smithi037.stdout:(46/120): oniguruma-6.9.6-1.el9.5.x86_64.rpm 3.6 MB/s | 217 kB 00:00 2023-12-03T11:32:06.853 INFO:teuthology.orchestra.run.smithi037.stdout:(47/120): openblas-0.3.21-2.el9.x86_64.rpm 581 kB/s | 34 kB 00:00 2023-12-03T11:32:06.945 INFO:teuthology.orchestra.run.smithi037.stdout:(48/120): openblas-openmp-0.3.21-2.el9.x86_64.r 38 MB/s | 4.7 MB 00:00 2023-12-03T11:32:06.987 INFO:teuthology.orchestra.run.smithi003.stdout:(16/120): librgw2-18.0.0-7537.gbcbf278c.el9.x86 7.9 MB/s | 4.8 MB 00:00 2023-12-03T11:32:07.046 INFO:teuthology.orchestra.run.smithi037.stdout:(49/120): python3-babel-2.9.1-2.el9.noarch.rpm 30 MB/s | 5.8 MB 00:00 2023-12-03T11:32:07.062 INFO:teuthology.orchestra.run.smithi003.stdout:(17/120): python3-ceph-argparse-18.0.0-7537.gbc 602 kB/s | 45 kB 00:00 2023-12-03T11:32:07.108 INFO:teuthology.orchestra.run.smithi037.stdout:(50/120): python3-jinja2-2.11.3-4.el9.noarch.rp 1.4 MB/s | 228 kB 00:00 2023-12-03T11:32:07.138 INFO:teuthology.orchestra.run.smithi037.stdout:(51/120): python3-jsonpatch-1.21-16.el9.noarch. 266 kB/s | 24 kB 00:00 2023-12-03T11:32:07.146 INFO:teuthology.orchestra.run.smithi003.stdout:(18/120): ceph-base-18.0.0-7537.gbcbf278c.el9.x 863 kB/s | 5.2 MB 00:06 2023-12-03T11:32:07.163 INFO:teuthology.orchestra.run.smithi037.stdout:(52/120): python3-jsonpointer-2.0-4.el9.noarch. 329 kB/s | 18 kB 00:00 2023-12-03T11:32:07.171 INFO:teuthology.orchestra.run.smithi003.stdout:(19/120): python3-ceph-common-18.0.0-7537.gbcbf 1.2 MB/s | 129 kB 00:00 2023-12-03T11:32:07.189 INFO:teuthology.orchestra.run.smithi037.stdout:(53/120): python3-mako-1.1.4-6.el9.noarch.rpm 2.8 MB/s | 144 kB 00:00 2023-12-03T11:32:07.214 INFO:teuthology.orchestra.run.smithi037.stdout:(54/120): python3-markupsafe-1.1.1-12.el9.x86_6 629 kB/s | 32 kB 00:00 2023-12-03T11:32:07.255 INFO:teuthology.orchestra.run.smithi003.stdout:(20/120): python3-rados-18.0.0-7537.gbcbf278c.e 3.8 MB/s | 320 kB 00:00 2023-12-03T11:32:07.280 INFO:teuthology.orchestra.run.smithi003.stdout:(21/120): python3-cephfs-18.0.0-7537.gbcbf278c. 1.2 MB/s | 162 kB 00:00 2023-12-03T11:32:07.323 INFO:teuthology.orchestra.run.smithi037.stdout:(55/120): python3-numpy-1.20.1-5.el9.x86_64.rpm 36 MB/s | 4.8 MB 00:00 2023-12-03T11:32:07.339 INFO:teuthology.orchestra.run.smithi003.stdout:(22/120): python3-rbd-18.0.0-7537.gbcbf278c.el9 3.5 MB/s | 298 kB 00:00 2023-12-03T11:32:07.347 INFO:teuthology.orchestra.run.smithi037.stdout:(56/120): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.6 MB/s | 217 kB 00:00 2023-12-03T11:32:07.365 INFO:teuthology.orchestra.run.smithi037.stdout:(57/120): python3-oauthlib-3.1.1-5.el9.noarch.r 4.1 MB/s | 174 kB 00:00 2023-12-03T11:32:07.390 INFO:teuthology.orchestra.run.smithi037.stdout:(58/120): python3-prettytable-0.7.2-27.el9.noar 990 kB/s | 41 kB 00:00 2023-12-03T11:32:07.405 INFO:teuthology.orchestra.run.smithi003.stdout:(23/120): python3-rgw-18.0.0-7537.gbcbf278c.el9 793 kB/s | 99 kB 00:00 2023-12-03T11:32:07.415 INFO:teuthology.orchestra.run.smithi037.stdout:(59/120): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.6 MB/s | 132 kB 00:00 2023-12-03T11:32:07.431 INFO:teuthology.orchestra.run.smithi003.stdout:(24/120): rbd-fuse-18.0.0-7537.gbcbf278c.el9.x8 932 kB/s | 85 kB 00:00 2023-12-03T11:32:07.440 INFO:teuthology.orchestra.run.smithi037.stdout:(60/120): python3-pyasn1-modules-0.4.8-6.el9.no 4.1 MB/s | 211 kB 00:00 2023-12-03T11:32:07.466 INFO:teuthology.orchestra.run.smithi037.stdout:(61/120): python3-pytz-2021.1-5.el9.noarch.rpm 950 kB/s | 47 kB 00:00 2023-12-03T11:32:07.491 INFO:teuthology.orchestra.run.smithi037.stdout:(62/120): python3-requests-oauthlib-1.3.0-12.el 855 kB/s | 43 kB 00:00 2023-12-03T11:32:07.523 INFO:teuthology.orchestra.run.smithi003.stdout:(25/120): rbd-nbd-18.0.0-7537.gbcbf278c.el9.x86 1.8 MB/s | 170 kB 00:00 2023-12-03T11:32:07.598 INFO:teuthology.orchestra.run.smithi003.stdout:(26/120): ceph-grafana-dashboards-18.0.0-7537.g 375 kB/s | 28 kB 00:00 2023-12-03T11:32:07.616 INFO:teuthology.orchestra.run.smithi037.stdout:(63/120): python3-toml-0.10.2-6.el9.noarch.rpm 314 kB/s | 39 kB 00:00 2023-12-03T11:32:07.673 INFO:teuthology.orchestra.run.smithi003.stdout:(27/120): ceph-mgr-cephadm-18.0.0-7537.gbcbf278 1.7 MB/s | 133 kB 00:00 2023-12-03T11:32:07.808 INFO:teuthology.orchestra.run.smithi037.stdout:(64/120): python3-scipy-1.6.2-8.el9.x86_64.rpm 46 MB/s | 16 MB 00:00 2023-12-03T11:32:07.833 INFO:teuthology.orchestra.run.smithi037.stdout:(65/120): socat-1.7.4.1-5.el9.x86_64.rpm 1.4 MB/s | 300 kB 00:00 2023-12-03T11:32:07.859 INFO:teuthology.orchestra.run.smithi037.stdout:(66/120): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 63 kB 00:00 2023-12-03T11:32:07.884 INFO:teuthology.orchestra.run.smithi037.stdout:(67/120): fuse-2.9.9-15.el9.x86_64.rpm 1.5 MB/s | 79 kB 00:00 2023-12-03T11:32:07.918 INFO:teuthology.orchestra.run.smithi037.stdout:(68/120): libgfortran-11.4.1-2.3.el9.x86_64.rpm 13 MB/s | 803 kB 00:00 2023-12-03T11:32:07.924 INFO:teuthology.orchestra.run.smithi003.stdout:(28/120): ceph-mgr-dashboard-18.0.0-7537.gbcbf2 7.0 MB/s | 1.8 MB 00:00 2023-12-03T11:32:07.943 INFO:teuthology.orchestra.run.smithi037.stdout:(69/120): libquadmath-11.4.1-2.3.el9.x86_64.rpm 3.3 MB/s | 195 kB 00:00 2023-12-03T11:32:07.968 INFO:teuthology.orchestra.run.smithi037.stdout:(70/120): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.7 MB/s | 241 kB 00:00 2023-12-03T11:32:08.002 INFO:teuthology.orchestra.run.smithi037.stdout:(71/120): python3-cryptography-36.0.1-4.el9.x86 20 MB/s | 1.1 MB 00:00 2023-12-03T11:32:08.027 INFO:teuthology.orchestra.run.smithi037.stdout:(72/120): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 103 kB 00:00 2023-12-03T11:32:08.053 INFO:teuthology.orchestra.run.smithi037.stdout:(73/120): python3-pycparser-2.20-6.el9.noarch.r 2.4 MB/s | 124 kB 00:00 2023-12-03T11:32:08.069 INFO:teuthology.orchestra.run.smithi037.stdout:(74/120): python3-requests-2.25.1-7.el9.noarch. 2.6 MB/s | 113 kB 00:00 2023-12-03T11:32:08.095 INFO:teuthology.orchestra.run.smithi037.stdout:(75/120): python3-urllib3-1.26.5-4.el9.noarch.r 4.4 MB/s | 187 kB 00:00 2023-12-03T11:32:08.178 INFO:teuthology.orchestra.run.smithi037.stdout:(76/120): lua-devel-5.4.4-4.el9.x86_64.rpm 267 kB/s | 22 kB 00:00 2023-12-03T11:32:08.545 INFO:teuthology.orchestra.run.smithi037.stdout:(77/120): gperftools-libs-2.9.1-2.el9.x86_64.rp 842 kB/s | 309 kB 00:00 2023-12-03T11:32:08.549 INFO:teuthology.orchestra.run.smithi003.stdout:(29/120): ceph-test-18.0.0-7537.gbcbf278c.el9.x 12 MB/s | 41 MB 00:03 2023-12-03T11:32:08.597 INFO:teuthology.orchestra.run.smithi037.stdout:(78/120): python3-devel-3.9.17-2.el9.x86_64.rpm 467 kB/s | 245 kB 00:00 2023-12-03T11:32:08.608 INFO:teuthology.orchestra.run.smithi003.stdout:(30/120): ceph-mgr-modules-core-18.0.0-7537.gbc 4.1 MB/s | 243 kB 00:00 2023-12-03T11:32:08.658 INFO:teuthology.orchestra.run.smithi003.stdout:(31/120): ceph-mgr-rook-18.0.0-7537.gbcbf278c.e 1.0 MB/s | 50 kB 00:00 2023-12-03T11:32:08.716 INFO:teuthology.orchestra.run.smithi003.stdout:(32/120): ceph-prometheus-alerts-18.0.0-7537.gb 260 kB/s | 15 kB 00:00 2023-12-03T11:32:08.806 INFO:teuthology.orchestra.run.smithi037.stdout:(79/120): libarrow-doc-9.0.0-9.el9.noarch.rpm 116 kB/s | 24 kB 00:00 2023-12-03T11:32:08.825 INFO:teuthology.orchestra.run.smithi003.stdout:(33/120): ceph-mgr-diskprediction-local-18.0.0- 8.2 MB/s | 7.4 MB 00:00 2023-12-03T11:32:08.850 INFO:teuthology.orchestra.run.smithi003.stdout:(34/120): ceph-volume-18.0.0-7537.gbcbf278c.el9 1.9 MB/s | 262 kB 00:00 2023-12-03T11:32:08.898 INFO:teuthology.orchestra.run.smithi037.stdout:(80/120): liboath-2.6.7-2.el9.x86_64.rpm 530 kB/s | 49 kB 00:00 2023-12-03T11:32:08.959 INFO:teuthology.orchestra.run.smithi003.stdout:(35/120): cephadm-18.0.0-7537.gbcbf278c.el9.noa 5.7 MB/s | 774 kB 00:00 2023-12-03T11:32:08.984 INFO:teuthology.orchestra.run.smithi003.stdout:(36/120): boost-program-options-1.75.0-8.el9.x8 792 kB/s | 106 kB 00:00 2023-12-03T11:32:08.990 INFO:teuthology.orchestra.run.smithi037.stdout:(81/120): libunwind-1.6.2-1.el9.x86_64.rpm 736 kB/s | 67 kB 00:00 2023-12-03T11:32:09.018 INFO:teuthology.orchestra.run.smithi003.stdout:(37/120): flexiblas-3.0.4-8.el9.x86_64.rpm 541 kB/s | 32 kB 00:00 2023-12-03T11:32:09.077 INFO:teuthology.orchestra.run.smithi003.stdout:(38/120): rbd-mirror-18.0.0-7537.gbcbf278c.el9. 1.8 MB/s | 3.0 MB 00:01 2023-12-03T11:32:09.107 INFO:teuthology.orchestra.run.smithi037.stdout:(82/120): luarocks-3.9.2-1.el9.noarch.rpm 1.3 MB/s | 151 kB 00:00 2023-12-03T11:32:09.202 INFO:teuthology.orchestra.run.smithi003.stdout:(39/120): flexiblas-openblas-openmp-3.0.4-8.el9 93 kB/s | 17 kB 00:00 2023-12-03T11:32:09.269 INFO:teuthology.orchestra.run.smithi003.stdout:(40/120): jq-1.6-16.el9.x86_64.rpm 972 kB/s | 186 kB 00:00 2023-12-03T11:32:09.361 INFO:teuthology.orchestra.run.smithi003.stdout:(41/120): flexiblas-netlib-3.0.4-8.el9.x86_64.r 7.9 MB/s | 3.0 MB 00:00 2023-12-03T11:32:09.386 INFO:teuthology.orchestra.run.smithi003.stdout:(42/120): libpmemobj-1.12.1-1.el9.x86_64.rpm 870 kB/s | 159 kB 00:00 2023-12-03T11:32:09.511 INFO:teuthology.orchestra.run.smithi003.stdout:(43/120): librabbitmq-0.11.0-7.el9.x86_64.rpm 183 kB/s | 44 kB 00:00 2023-12-03T11:32:09.545 INFO:teuthology.orchestra.run.smithi003.stdout:(44/120): librdkafka-1.6.1-102.el9.x86_64.rpm 3.5 MB/s | 661 kB 00:00 2023-12-03T11:32:09.549 INFO:teuthology.orchestra.run.smithi037.stdout:(83/120): parquet-libs-9.0.0-9.el9.x86_64.rpm 1.9 MB/s | 837 kB 00:00 2023-12-03T11:32:09.570 INFO:teuthology.orchestra.run.smithi003.stdout:(45/120): lua-5.4.4-4.el9.x86_64.rpm 3.2 MB/s | 187 kB 00:00 2023-12-03T11:32:09.596 INFO:teuthology.orchestra.run.smithi003.stdout:(46/120): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.3 MB/s | 282 kB 00:00 2023-12-03T11:32:09.621 INFO:teuthology.orchestra.run.smithi003.stdout:(47/120): oniguruma-6.9.6-1.el9.5.x86_64.rpm 2.8 MB/s | 217 kB 00:00 2023-12-03T11:32:09.646 INFO:teuthology.orchestra.run.smithi003.stdout:(48/120): openblas-0.3.21-2.el9.x86_64.rpm 458 kB/s | 34 kB 00:00 2023-12-03T11:32:09.846 INFO:teuthology.orchestra.run.smithi003.stdout:(49/120): python3-jinja2-2.11.3-4.el9.noarch.rp 1.1 MB/s | 228 kB 00:00 2023-12-03T11:32:09.883 INFO:teuthology.orchestra.run.smithi037.stdout:(84/120): python3-asyncssh-2.13.2-3.el9.noarch. 1.6 MB/s | 548 kB 00:00 2023-12-03T11:32:09.941 INFO:teuthology.orchestra.run.smithi037.stdout:(85/120): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 746 kB/s | 43 kB 00:00 2023-12-03T11:32:09.980 INFO:teuthology.orchestra.run.smithi003.stdout:(50/120): python3-babel-2.9.1-2.el9.noarch.rpm 16 MB/s | 5.8 MB 00:00 2023-12-03T11:32:10.000 INFO:teuthology.orchestra.run.smithi037.stdout:(86/120): python3-cachetools-4.2.4-1.el9.noarch 553 kB/s | 32 kB 00:00 2023-12-03T11:32:10.055 INFO:teuthology.orchestra.run.smithi003.stdout:(51/120): openblas-openmp-0.3.21-2.el9.x86_64.r 11 MB/s | 4.7 MB 00:00 2023-12-03T11:32:10.058 INFO:teuthology.orchestra.run.smithi037.stdout:(87/120): python3-certifi-2021.10.8-2.el9.noarc 257 kB/s | 15 kB 00:00 2023-12-03T11:32:10.080 INFO:teuthology.orchestra.run.smithi003.stdout:(52/120): python3-jsonpatch-1.21-16.el9.noarch. 105 kB/s | 24 kB 00:00 2023-12-03T11:32:10.106 INFO:teuthology.orchestra.run.smithi003.stdout:(53/120): python3-jsonpointer-2.0-4.el9.noarch. 146 kB/s | 18 kB 00:00 2023-12-03T11:32:10.131 INFO:teuthology.orchestra.run.smithi003.stdout:(54/120): python3-markupsafe-1.1.1-12.el9.x86_6 634 kB/s | 32 kB 00:00 2023-12-03T11:32:10.156 INFO:teuthology.orchestra.run.smithi003.stdout:(55/120): python3-mako-1.1.4-6.el9.noarch.rpm 1.9 MB/s | 144 kB 00:00 2023-12-03T11:32:10.192 INFO:teuthology.orchestra.run.smithi037.stdout:(88/120): python3-cheroot-8.6.0-4.el9.noarch.rp 1.3 MB/s | 172 kB 00:00 2023-12-03T11:32:10.290 INFO:teuthology.orchestra.run.smithi003.stdout:(56/120): python3-numpy-1.20.1-5.el9.x86_64.rpm 26 MB/s | 4.8 MB 00:00 2023-12-03T11:32:10.315 INFO:teuthology.orchestra.run.smithi003.stdout:(57/120): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.2 MB/s | 217 kB 00:00 2023-12-03T11:32:10.340 INFO:teuthology.orchestra.run.smithi003.stdout:(58/120): python3-oauthlib-3.1.1-5.el9.noarch.r 959 kB/s | 174 kB 00:00 2023-12-03T11:32:10.365 INFO:teuthology.orchestra.run.smithi003.stdout:(59/120): python3-prettytable-0.7.2-27.el9.noar 552 kB/s | 41 kB 00:00 2023-12-03T11:32:10.391 INFO:teuthology.orchestra.run.smithi003.stdout:(60/120): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.6 MB/s | 132 kB 00:00 2023-12-03T11:32:10.416 INFO:teuthology.orchestra.run.smithi003.stdout:(61/120): python3-pyasn1-modules-0.4.8-6.el9.no 2.7 MB/s | 211 kB 00:00 2023-12-03T11:32:10.441 INFO:teuthology.orchestra.run.smithi003.stdout:(62/120): python3-pytz-2021.1-5.el9.noarch.rpm 628 kB/s | 47 kB 00:00 2023-12-03T11:32:10.466 INFO:teuthology.orchestra.run.smithi003.stdout:(63/120): python3-requests-oauthlib-1.3.0-12.el 860 kB/s | 43 kB 00:00 2023-12-03T11:32:10.700 INFO:teuthology.orchestra.run.smithi003.stdout:(64/120): python3-toml-0.10.2-6.el9.noarch.rpm 149 kB/s | 39 kB 00:00 2023-12-03T11:32:10.725 INFO:teuthology.orchestra.run.smithi003.stdout:(65/120): socat-1.7.4.1-5.el9.x86_64.rpm 1.1 MB/s | 300 kB 00:00 2023-12-03T11:32:10.725 INFO:teuthology.orchestra.run.smithi037.stdout:(89/120): ceph-test-18.0.0-7537.gbcbf278c.el9.x 4.7 MB/s | 41 MB 00:08 2023-12-03T11:32:10.859 INFO:teuthology.orchestra.run.smithi037.stdout:(90/120): python3-cherrypy-18.6.1-2.el9.noarch. 537 kB/s | 358 kB 00:00 2023-12-03T11:32:10.892 INFO:teuthology.orchestra.run.smithi003.stdout:(66/120): python3-scipy-1.6.2-8.el9.x86_64.rpm 33 MB/s | 16 MB 00:00 2023-12-03T11:32:10.917 INFO:teuthology.orchestra.run.smithi003.stdout:(67/120): xmlstarlet-1.6.1-20.el9.x86_64.rpm 289 kB/s | 63 kB 00:00 2023-12-03T11:32:10.942 INFO:teuthology.orchestra.run.smithi003.stdout:(68/120): fuse-2.9.9-15.el9.x86_64.rpm 367 kB/s | 79 kB 00:00 2023-12-03T11:32:10.943 INFO:teuthology.orchestra.run.smithi037.stdout:(91/120): python3-jaraco-8.2.1-3.el9.noarch.rpm 192 kB/s | 11 kB 00:00 2023-12-03T11:32:10.985 INFO:teuthology.orchestra.run.smithi003.stdout:(69/120): libgfortran-11.4.1-2.3.el9.x86_64.rpm 8.6 MB/s | 803 kB 00:00 2023-12-03T11:32:11.001 INFO:teuthology.orchestra.run.smithi037.stdout:(92/120): python3-jaraco-classes-3.2.1-5.el9.no 312 kB/s | 18 kB 00:00 2023-12-03T11:32:11.010 INFO:teuthology.orchestra.run.smithi003.stdout:(70/120): libquadmath-11.4.1-2.3.el9.x86_64.rpm 2.9 MB/s | 195 kB 00:00 2023-12-03T11:32:11.035 INFO:teuthology.orchestra.run.smithi003.stdout:(71/120): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.6 MB/s | 241 kB 00:00 2023-12-03T11:32:11.060 INFO:teuthology.orchestra.run.smithi037.stdout:(93/120): python3-jaraco-collections-3.0.0-8.el 398 kB/s | 23 kB 00:00 2023-12-03T11:32:11.069 INFO:teuthology.orchestra.run.smithi003.stdout:(72/120): python3-cryptography-36.0.1-4.el9.x86 14 MB/s | 1.1 MB 00:00 2023-12-03T11:32:11.094 INFO:teuthology.orchestra.run.smithi003.stdout:(73/120): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 103 kB 00:00 2023-12-03T11:32:11.119 INFO:teuthology.orchestra.run.smithi037.stdout:(94/120): python3-jaraco-functools-3.5.0-2.el9. 333 kB/s | 19 kB 00:00 2023-12-03T11:32:11.120 INFO:teuthology.orchestra.run.smithi003.stdout:(74/120): python3-pycparser-2.20-6.el9.noarch.r 1.5 MB/s | 124 kB 00:00 2023-12-03T11:32:11.144 INFO:teuthology.orchestra.run.smithi003.stdout:(75/120): python3-requests-2.25.1-7.el9.noarch. 1.5 MB/s | 113 kB 00:00 2023-12-03T11:32:11.170 INFO:teuthology.orchestra.run.smithi003.stdout:(76/120): python3-urllib3-1.26.5-4.el9.noarch.r 3.7 MB/s | 187 kB 00:00 2023-12-03T11:32:11.177 INFO:teuthology.orchestra.run.smithi037.stdout:(95/120): libarrow-9.0.0-9.el9.x86_64.rpm 1.7 MB/s | 4.4 MB 00:02 2023-12-03T11:32:11.203 INFO:teuthology.orchestra.run.smithi037.stdout:(96/120): python3-jaraco-text-3.2.0-6.el9.noarc 236 kB/s | 20 kB 00:00 2023-12-03T11:32:11.228 INFO:teuthology.orchestra.run.smithi037.stdout:(97/120): python3-google-auth-2.23.4-1.el9.noar 394 kB/s | 197 kB 00:00 2023-12-03T11:32:11.245 INFO:teuthology.orchestra.run.smithi003.stdout:(77/120): lua-devel-5.4.4-4.el9.x86_64.rpm 224 kB/s | 22 kB 00:00 2023-12-03T11:32:11.253 INFO:teuthology.orchestra.run.smithi037.stdout:(98/120): python3-jwt+crypto-2.4.0-1.el9.noarch 120 kB/s | 9.0 kB 00:00 2023-12-03T11:32:11.278 INFO:teuthology.orchestra.run.smithi037.stdout:(99/120): python3-jwt-2.4.0-1.el9.noarch.rpm 543 kB/s | 41 kB 00:00 2023-12-03T11:32:11.312 INFO:teuthology.orchestra.run.smithi037.stdout:(100/120): python3-logutils-0.3.5-21.el9.noarch 789 kB/s | 46 kB 00:00 2023-12-03T11:32:11.337 INFO:teuthology.orchestra.run.smithi037.stdout:(101/120): python3-more-itertools-8.12.0-2.el9. 1.3 MB/s | 79 kB 00:00 2023-12-03T11:32:11.354 INFO:teuthology.orchestra.run.smithi003.stdout:(78/120): python3-devel-3.9.17-2.el9.x86_64.rpm 1.0 MB/s | 245 kB 00:00 2023-12-03T11:32:11.371 INFO:teuthology.orchestra.run.smithi037.stdout:(102/120): python3-natsort-7.1.1-5.el9.noarch.r 987 kB/s | 58 kB 00:00 2023-12-03T11:32:11.430 INFO:teuthology.orchestra.run.smithi037.stdout:(103/120): python3-portend-3.1.0-2.el9.noarch.r 282 kB/s | 16 kB 00:00 2023-12-03T11:32:11.488 INFO:teuthology.orchestra.run.smithi037.stdout:(104/120): python3-pecan-1.4.2-3.el9.noarch.rpm 1.8 MB/s | 272 kB 00:00 2023-12-03T11:32:11.520 INFO:teuthology.orchestra.run.smithi003.stdout:(79/120): gperftools-libs-2.9.1-2.el9.x86_64.rp 881 kB/s | 309 kB 00:00 2023-12-03T11:32:11.521 INFO:teuthology.orchestra.run.smithi037.stdout:(105/120): python3-pyOpenSSL-21.0.0-1.el9.noarc 981 kB/s | 90 kB 00:00 2023-12-03T11:32:11.537 INFO:teuthology.orchestra.run.smithi003.stdout:(80/120): libarrow-doc-9.0.0-9.el9.noarch.rpm 133 kB/s | 24 kB 00:00 2023-12-03T11:32:11.547 INFO:teuthology.orchestra.run.smithi037.stdout:(106/120): python3-repoze-lru-0.7-16.el9.noarch 525 kB/s | 31 kB 00:00 2023-12-03T11:32:11.579 INFO:teuthology.orchestra.run.smithi003.stdout:(81/120): liboath-2.6.7-2.el9.x86_64.rpm 831 kB/s | 49 kB 00:00 2023-12-03T11:32:11.606 INFO:teuthology.orchestra.run.smithi037.stdout:(107/120): python3-rsa-4.9-2.el9.noarch.rpm 1.0 MB/s | 59 kB 00:00 2023-12-03T11:32:11.639 INFO:teuthology.orchestra.run.smithi037.stdout:(108/120): python3-routes-2.5.1-5.el9.noarch.rp 1.6 MB/s | 188 kB 00:00 2023-12-03T11:32:11.654 INFO:teuthology.orchestra.run.smithi003.stdout:(82/120): luarocks-3.9.2-1.el9.noarch.rpm 2.0 MB/s | 151 kB 00:00 2023-12-03T11:32:11.664 INFO:teuthology.orchestra.run.smithi037.stdout:(109/120): python3-tempora-5.0.0-2.el9.noarch.r 610 kB/s | 36 kB 00:00 2023-12-03T11:32:11.688 INFO:teuthology.orchestra.run.smithi003.stdout:(83/120): libunwind-1.6.2-1.el9.x86_64.rpm 448 kB/s | 67 kB 00:00 2023-12-03T11:32:11.690 INFO:teuthology.orchestra.run.smithi037.stdout:(110/120): python3-typing-extensions-4.4.0-2.el 1.0 MB/s | 51 kB 00:00 2023-12-03T11:32:11.774 INFO:teuthology.orchestra.run.smithi037.stdout:(111/120): python3-websocket-client-1.2.3-2.el9 1.1 MB/s | 90 kB 00:00 2023-12-03T11:32:11.807 INFO:teuthology.orchestra.run.smithi037.stdout:(112/120): python3-kubernetes-26.1.0-2.el9.noar 1.8 MB/s | 1.0 MB 00:00 2023-12-03T11:32:11.813 INFO:teuthology.orchestra.run.smithi003.stdout:(84/120): libarrow-9.0.0-9.el9.x86_64.rpm 7.8 MB/s | 4.4 MB 00:00 2023-12-03T11:32:11.832 INFO:teuthology.orchestra.run.smithi037.stdout:(113/120): python3-webob-1.8.7-6.el9.noarch.rpm 1.3 MB/s | 230 kB 00:00 2023-12-03T11:32:11.855 INFO:teuthology.orchestra.run.smithi003.stdout:(85/120): parquet-libs-9.0.0-9.el9.x86_64.rpm 4.1 MB/s | 837 kB 00:00 2023-12-03T11:32:11.857 INFO:teuthology.orchestra.run.smithi037.stdout:(114/120): python3-zc-lockfile-2.0-10.el9.noarc 399 kB/s | 20 kB 00:00 2023-12-03T11:32:11.881 INFO:teuthology.orchestra.run.smithi003.stdout:(86/120): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 650 kB/s | 43 kB 00:00 2023-12-03T11:32:11.914 INFO:teuthology.orchestra.run.smithi003.stdout:(87/120): python3-asyncssh-2.13.2-3.el9.noarch. 2.4 MB/s | 548 kB 00:00 2023-12-03T11:32:11.939 INFO:teuthology.orchestra.run.smithi003.stdout:(88/120): python3-cachetools-4.2.4-1.el9.noarch 384 kB/s | 32 kB 00:00 2023-12-03T11:32:11.949 INFO:teuthology.orchestra.run.smithi037.stdout:(115/120): re2-20211101-3.el9.x86_64.rpm 1.6 MB/s | 192 kB 00:00 2023-12-03T11:32:11.965 INFO:teuthology.orchestra.run.smithi003.stdout:(89/120): python3-certifi-2021.10.8-2.el9.noarc 179 kB/s | 15 kB 00:00 2023-12-03T11:32:11.983 INFO:teuthology.orchestra.run.smithi037.stdout:(116/120): python3-werkzeug-2.0.3-3.el9.1.noarc 2.0 MB/s | 427 kB 00:00 2023-12-03T11:32:11.990 INFO:teuthology.orchestra.run.smithi003.stdout:(90/120): python3-cheroot-8.6.0-4.el9.noarch.rp 2.2 MB/s | 172 kB 00:00 2023-12-03T11:32:12.008 INFO:teuthology.orchestra.run.smithi037.stdout:(117/120): s3cmd-2.3.0-4.el9.noarch.rpm 1.3 MB/s | 197 kB 00:00 2023-12-03T11:32:12.015 INFO:teuthology.orchestra.run.smithi003.stdout:(91/120): python3-cherrypy-18.6.1-2.el9.noarch. 4.6 MB/s | 358 kB 00:00 2023-12-03T11:32:12.041 INFO:teuthology.orchestra.run.smithi003.stdout:(92/120): python3-google-auth-2.23.4-1.el9.noar 2.6 MB/s | 197 kB 00:00 2023-12-03T11:32:12.066 INFO:teuthology.orchestra.run.smithi003.stdout:(93/120): python3-jaraco-8.2.1-3.el9.noarch.rpm 141 kB/s | 11 kB 00:00 2023-12-03T11:32:12.091 INFO:teuthology.orchestra.run.smithi003.stdout:(94/120): python3-jaraco-classes-3.2.1-5.el9.no 234 kB/s | 18 kB 00:00 2023-12-03T11:32:12.116 INFO:teuthology.orchestra.run.smithi003.stdout:(95/120): python3-jaraco-collections-3.0.0-8.el 307 kB/s | 23 kB 00:00 2023-12-03T11:32:12.150 INFO:teuthology.orchestra.run.smithi003.stdout:(96/120): python3-jaraco-functools-3.5.0-2.el9. 232 kB/s | 19 kB 00:00 2023-12-03T11:32:12.175 INFO:teuthology.orchestra.run.smithi003.stdout:(97/120): python3-jaraco-text-3.2.0-6.el9.noarc 235 kB/s | 20 kB 00:00 2023-12-03T11:32:12.201 INFO:teuthology.orchestra.run.smithi003.stdout:(98/120): python3-jwt+crypto-2.4.0-1.el9.noarch 108 kB/s | 9.0 kB 00:00 2023-12-03T11:32:12.226 INFO:teuthology.orchestra.run.smithi003.stdout:(99/120): python3-jwt-2.4.0-1.el9.noarch.rpm 542 kB/s | 41 kB 00:00 2023-12-03T11:32:12.268 INFO:teuthology.orchestra.run.smithi003.stdout:(100/120): python3-logutils-0.3.5-21.el9.noarch 694 kB/s | 46 kB 00:00 2023-12-03T11:32:12.310 INFO:teuthology.orchestra.run.smithi003.stdout:(101/120): python3-kubernetes-26.1.0-2.el9.noar 7.6 MB/s | 1.0 MB 00:00 2023-12-03T11:32:12.343 INFO:teuthology.orchestra.run.smithi003.stdout:(102/120): python3-more-itertools-8.12.0-2.el9. 672 kB/s | 79 kB 00:00 2023-12-03T11:32:12.369 INFO:teuthology.orchestra.run.smithi003.stdout:(103/120): python3-natsort-7.1.1-5.el9.noarch.r 573 kB/s | 58 kB 00:00 2023-12-03T11:32:12.394 INFO:teuthology.orchestra.run.smithi003.stdout:(104/120): python3-pecan-1.4.2-3.el9.noarch.rpm 3.2 MB/s | 272 kB 00:00 2023-12-03T11:32:12.419 INFO:teuthology.orchestra.run.smithi003.stdout:(105/120): python3-portend-3.1.0-2.el9.noarch.r 218 kB/s | 16 kB 00:00 2023-12-03T11:32:12.453 INFO:teuthology.orchestra.run.smithi003.stdout:(106/120): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.0 MB/s | 90 kB 00:00 2023-12-03T11:32:12.459 INFO:teuthology.orchestra.run.smithi037.stdout:(118/120): librados2-18.0.0-7537.gbcbf278c.el9. 7.0 MB/s | 3.3 MB 00:00 2023-12-03T11:32:12.478 INFO:teuthology.orchestra.run.smithi003.stdout:(107/120): python3-repoze-lru-0.7-16.el9.noarch 367 kB/s | 31 kB 00:00 2023-12-03T11:32:12.503 INFO:teuthology.orchestra.run.smithi003.stdout:(108/120): python3-routes-2.5.1-5.el9.noarch.rp 2.2 MB/s | 188 kB 00:00 2023-12-03T11:32:12.528 INFO:teuthology.orchestra.run.smithi003.stdout:(109/120): python3-rsa-4.9-2.el9.noarch.rpm 784 kB/s | 59 kB 00:00 2023-12-03T11:32:12.554 INFO:teuthology.orchestra.run.smithi003.stdout:(110/120): python3-tempora-5.0.0-2.el9.noarch.r 475 kB/s | 36 kB 00:00 2023-12-03T11:32:12.579 INFO:teuthology.orchestra.run.smithi003.stdout:(111/120): python3-typing-extensions-4.4.0-2.el 675 kB/s | 51 kB 00:00 2023-12-03T11:32:12.592 INFO:teuthology.orchestra.run.smithi037.stdout:(119/120): librbd1-18.0.0-7537.gbcbf278c.el9.x8 5.1 MB/s | 3.0 MB 00:00 2023-12-03T11:32:12.604 INFO:teuthology.orchestra.run.smithi003.stdout:(112/120): python3-webob-1.8.7-6.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2023-12-03T11:32:12.630 INFO:teuthology.orchestra.run.smithi003.stdout:(113/120): python3-websocket-client-1.2.3-2.el9 1.2 MB/s | 90 kB 00:00 2023-12-03T11:32:12.663 INFO:teuthology.orchestra.run.smithi003.stdout:(114/120): python3-zc-lockfile-2.0-10.el9.noarc 341 kB/s | 20 kB 00:00 2023-12-03T11:32:12.697 INFO:teuthology.orchestra.run.smithi003.stdout:(115/120): python3-werkzeug-2.0.3-3.el9.1.noarc 3.6 MB/s | 427 kB 00:00 2023-12-03T11:32:12.722 INFO:teuthology.orchestra.run.smithi003.stdout:(116/120): re2-20211101-3.el9.x86_64.rpm 2.0 MB/s | 192 kB 00:00 2023-12-03T11:32:12.747 INFO:teuthology.orchestra.run.smithi003.stdout:(117/120): s3cmd-2.3.0-4.el9.noarch.rpm 2.3 MB/s | 197 kB 00:00 2023-12-03T11:32:12.809 INFO:teuthology.orchestra.run.smithi037.stdout:(120/120): thrift-0.15.0-2.el9.x86_64.rpm 1.8 MB/s | 1.6 MB 00:00 2023-12-03T11:32:12.815 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2023-12-03T11:32:12.815 INFO:teuthology.orchestra.run.smithi037.stdout:Total 14 MB/s | 181 MB 00:13 2023-12-03T11:32:12.840 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2023-12-03T11:32:12.864 INFO:teuthology.orchestra.run.smithi003.stdout:(118/120): thrift-0.15.0-2.el9.x86_64.rpm 9.5 MB/s | 1.6 MB 00:00 2023-12-03T11:32:12.950 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2023-12-03T11:32:12.950 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2023-12-03T11:32:13.023 INFO:teuthology.orchestra.run.smithi003.stdout:(119/120): librados2-18.0.0-7537.gbcbf278c.el9. 11 MB/s | 3.3 MB 00:00 2023-12-03T11:32:13.840 INFO:teuthology.orchestra.run.smithi003.stdout:(120/120): librbd1-18.0.0-7537.gbcbf278c.el9.x8 2.7 MB/s | 3.0 MB 00:01 2023-12-03T11:32:13.842 INFO:teuthology.orchestra.run.smithi003.stdout:-------------------------------------------------------------------------------- 2023-12-03T11:32:13.842 INFO:teuthology.orchestra.run.smithi003.stdout:Total 13 MB/s | 181 MB 00:13 2023-12-03T11:32:13.867 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction check 2023-12-03T11:32:13.976 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction check succeeded. 2023-12-03T11:32:13.976 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction test 2023-12-03T11:32:14.569 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2023-12-03T11:32:14.570 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2023-12-03T11:32:15.567 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction test succeeded. 2023-12-03T11:32:15.567 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction 2023-12-03T11:32:19.589 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2023-12-03T11:32:19.662 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : thrift-0.15.0-2.el9.x86_64 1/122 2023-12-03T11:32:19.695 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 2/122 2023-12-03T11:32:19.744 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 3/122 2023-12-03T11:32:19.772 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 4/122 2023-12-03T11:32:19.820 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 5/122 2023-12-03T11:32:20.174 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 6/122 2023-12-03T11:32:20.238 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : librados2-2:18.0.0-7537.gbcbf278c.el9.x86_64 7/122 2023-12-03T11:32:20.369 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librados2-2:18.0.0-7537.gbcbf278c.el9.x86_64 7/122 2023-12-03T11:32:20.398 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libcephfs2-2:18.0.0-7537.gbcbf278c.el9.x86_64 8/122 2023-12-03T11:32:20.490 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: libcephfs2-2:18.0.0-7537.gbcbf278c.el9.x86_64 8/122 2023-12-03T11:32:20.533 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-rados-2:18.0.0-7537.gbcbf278c.el9.x86_64 9/122 2023-12-03T11:32:20.549 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libcephsqlite-2:18.0.0-7537.gbcbf278c.el9.x86_64 10/122 2023-12-03T11:32:20.585 INFO:teuthology.orchestra.run.smithi003.stdout: Preparing : 1/1 2023-12-03T11:32:20.635 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: libcephsqlite-2:18.0.0-7537.gbcbf278c.el9.x86_64 10/122 2023-12-03T11:32:20.659 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : thrift-0.15.0-2.el9.x86_64 1/122 2023-12-03T11:32:20.675 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libradosstriper1-2:18.0.0-7537.gbcbf278c.el9.x86 11/122 2023-12-03T11:32:20.692 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 2/122 2023-12-03T11:32:20.806 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: libradosstriper1-2:18.0.0-7537.gbcbf278c.el9.x86 11/122 2023-12-03T11:32:20.846 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 12/122 2023-12-03T11:32:20.901 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 3/122 2023-12-03T11:32:20.920 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : liboath-2.6.7-2.el9.x86_64 13/122 2023-12-03T11:32:20.953 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 4/122 2023-12-03T11:32:20.979 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-urllib3-1.26.5-4.el9.noarch 14/122 2023-12-03T11:32:21.011 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 5/122 2023-12-03T11:32:21.013 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 15/122 2023-12-03T11:32:21.052 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libquadmath-11.4.1-2.3.el9.x86_64 16/122 2023-12-03T11:32:21.092 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libgfortran-11.4.1-2.3.el9.x86_64 17/122 2023-12-03T11:32:21.168 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 18/122 2023-12-03T11:32:21.208 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 19/122 2023-12-03T11:32:21.242 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 20/122 2023-12-03T11:32:21.268 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : lua-5.4.4-4.el9.x86_64 21/122 2023-12-03T11:32:21.341 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 22/122 2023-12-03T11:32:21.374 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-ceph-common-2:18.0.0-7537.gbcbf278c.el9. 23/122 2023-12-03T11:32:21.397 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 6/122 2023-12-03T11:32:21.417 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-ceph-argparse-2:18.0.0-7537.gbcbf278c.el 24/122 2023-12-03T11:32:21.436 INFO:teuthology.orchestra.run.smithi003.stdout: Upgrading : librados2-2:18.0.0-7537.gbcbf278c.el9.x86_64 7/122 2023-12-03T11:32:21.462 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cephfs-2:18.0.0-7537.gbcbf278c.el9.x86_6 25/122 2023-12-03T11:32:21.537 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 26/122 2023-12-03T11:32:21.557 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: librados2-2:18.0.0-7537.gbcbf278c.el9.x86_64 7/122 2023-12-03T11:32:21.587 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libcephfs2-2:18.0.0-7537.gbcbf278c.el9.x86_64 8/122 2023-12-03T11:32:21.620 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : luarocks-3.9.2-1.el9.noarch 27/122 2023-12-03T11:32:21.662 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: libcephfs2-2:18.0.0-7537.gbcbf278c.el9.x86_64 8/122 2023-12-03T11:32:21.705 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-rados-2:18.0.0-7537.gbcbf278c.el9.x86_64 9/122 2023-12-03T11:32:21.730 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libcephsqlite-2:18.0.0-7537.gbcbf278c.el9.x86_64 10/122 2023-12-03T11:32:21.776 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 28/122 2023-12-03T11:32:21.820 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: libcephsqlite-2:18.0.0-7537.gbcbf278c.el9.x86_64 10/122 2023-12-03T11:32:21.839 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 29/122 2023-12-03T11:32:21.847 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libradosstriper1-2:18.0.0-7537.gbcbf278c.el9.x86 11/122 2023-12-03T11:32:21.977 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: libradosstriper1-2:18.0.0-7537.gbcbf278c.el9.x86 11/122 2023-12-03T11:32:22.018 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 12/122 2023-12-03T11:32:22.091 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : liboath-2.6.7-2.el9.x86_64 13/122 2023-12-03T11:32:22.143 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-urllib3-1.26.5-4.el9.noarch 14/122 2023-12-03T11:32:22.179 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 15/122 2023-12-03T11:32:22.224 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libquadmath-11.4.1-2.3.el9.x86_64 16/122 2023-12-03T11:32:22.265 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libgfortran-11.4.1-2.3.el9.x86_64 17/122 2023-12-03T11:32:22.340 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 18/122 2023-12-03T11:32:22.388 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 19/122 2023-12-03T11:32:22.402 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-rsa-4.9-2.el9.noarch 30/122 2023-12-03T11:32:22.430 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 20/122 2023-12-03T11:32:22.457 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : lua-5.4.4-4.el9.x86_64 21/122 2023-12-03T11:32:22.486 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 31/122 2023-12-03T11:32:22.529 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 32/122 2023-12-03T11:32:22.530 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 22/122 2023-12-03T11:32:22.562 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-ceph-common-2:18.0.0-7537.gbcbf278c.el9. 23/122 2023-12-03T11:32:22.567 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : librados-devel-2:18.0.0-7537.gbcbf278c.el9.x86_6 33/122 2023-12-03T11:32:22.597 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 34/122 2023-12-03T11:32:22.606 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-ceph-argparse-2:18.0.0-7537.gbcbf278c.el 24/122 2023-12-03T11:32:22.634 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-cephfs-2:18.0.0-7537.gbcbf278c.el9.x86_6 25/122 2023-12-03T11:32:22.708 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : re2-1:20211101-3.el9.x86_64 35/122 2023-12-03T11:32:22.710 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 26/122 2023-12-03T11:32:22.743 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libarrow-9.0.0-9.el9.x86_64 36/122 2023-12-03T11:32:22.794 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : luarocks-3.9.2-1.el9.noarch 27/122 2023-12-03T11:32:22.799 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 37/122 2023-12-03T11:32:22.865 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 38/122 2023-12-03T11:32:22.901 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 39/122 2023-12-03T11:32:22.938 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 40/122 2023-12-03T11:32:22.949 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 28/122 2023-12-03T11:32:22.986 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 41/122 2023-12-03T11:32:23.020 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 29/122 2023-12-03T11:32:23.030 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 42/122 2023-12-03T11:32:23.072 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 43/122 2023-12-03T11:32:23.216 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 44/122 2023-12-03T11:32:23.257 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 45/122 2023-12-03T11:32:23.299 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 46/122 2023-12-03T11:32:23.389 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 47/122 2023-12-03T11:32:23.432 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-google-auth-1:2.23.4-1.el9.noarch 48/122 2023-12-03T11:32:23.473 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 49/122 2023-12-03T11:32:23.505 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 50/122 2023-12-03T11:32:23.595 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-rsa-4.9-2.el9.noarch 30/122 2023-12-03T11:32:23.605 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libarrow-doc-9.0.0-9.el9.noarch 51/122 2023-12-03T11:32:23.658 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 52/122 2023-12-03T11:32:23.674 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 31/122 2023-12-03T11:32:23.717 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-ply-3.11-14.el9.noarch 53/122 2023-12-03T11:32:23.718 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 32/122 2023-12-03T11:32:23.764 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : librados-devel-2:18.0.0-7537.gbcbf278c.el9.x86_6 33/122 2023-12-03T11:32:23.780 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 54/122 2023-12-03T11:32:23.803 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 34/122 2023-12-03T11:32:23.912 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : re2-1:20211101-3.el9.x86_64 35/122 2023-12-03T11:32:23.948 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libarrow-9.0.0-9.el9.x86_64 36/122 2023-12-03T11:32:23.985 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 55/122 2023-12-03T11:32:24.005 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 37/122 2023-12-03T11:32:24.029 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 56/122 2023-12-03T11:32:24.080 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 38/122 2023-12-03T11:32:24.115 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 39/122 2023-12-03T11:32:24.152 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 40/122 2023-12-03T11:32:24.167 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 57/122 2023-12-03T11:32:24.200 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 41/122 2023-12-03T11:32:24.215 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 58/122 2023-12-03T11:32:24.243 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 59/122 2023-12-03T11:32:24.253 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 42/122 2023-12-03T11:32:24.278 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 60/122 2023-12-03T11:32:24.303 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 43/122 2023-12-03T11:32:24.310 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 61/122 2023-12-03T11:32:24.343 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : fuse-2.9.9-15.el9.x86_64 62/122 2023-12-03T11:32:24.388 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 63/122 2023-12-03T11:32:24.423 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 64/122 2023-12-03T11:32:24.446 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 44/122 2023-12-03T11:32:24.452 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 65/122 2023-12-03T11:32:24.488 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 45/122 2023-12-03T11:32:24.525 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 66/122 2023-12-03T11:32:24.530 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 46/122 2023-12-03T11:32:24.580 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 67/122 2023-12-03T11:32:24.612 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 68/122 2023-12-03T11:32:24.627 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 47/122 2023-12-03T11:32:24.654 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 69/122 2023-12-03T11:32:24.662 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-google-auth-1:2.23.4-1.el9.noarch 48/122 2023-12-03T11:32:24.688 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 70/122 2023-12-03T11:32:24.703 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 49/122 2023-12-03T11:32:24.744 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 50/122 2023-12-03T11:32:24.784 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 71/122 2023-12-03T11:32:24.824 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 72/122 2023-12-03T11:32:24.871 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libarrow-doc-9.0.0-9.el9.noarch 51/122 2023-12-03T11:32:24.914 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 52/122 2023-12-03T11:32:24.932 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 73/122 2023-12-03T11:32:24.972 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-ply-3.11-14.el9.noarch 53/122 2023-12-03T11:32:24.985 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 74/122 2023-12-03T11:32:25.037 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 54/122 2023-12-03T11:32:25.251 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 55/122 2023-12-03T11:32:25.301 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 56/122 2023-12-03T11:32:25.447 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 57/122 2023-12-03T11:32:25.488 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 58/122 2023-12-03T11:32:25.515 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 59/122 2023-12-03T11:32:25.550 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 60/122 2023-12-03T11:32:25.599 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 61/122 2023-12-03T11:32:25.640 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : fuse-2.9.9-15.el9.x86_64 62/122 2023-12-03T11:32:25.685 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 63/122 2023-12-03T11:32:25.728 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 64/122 2023-12-03T11:32:25.758 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 65/122 2023-12-03T11:32:25.777 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 75/122 2023-12-03T11:32:25.830 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 76/122 2023-12-03T11:32:25.838 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 66/122 2023-12-03T11:32:25.864 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 77/122 2023-12-03T11:32:25.876 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 67/122 2023-12-03T11:32:25.896 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 78/122 2023-12-03T11:32:25.909 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 68/122 2023-12-03T11:32:25.952 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 69/122 2023-12-03T11:32:25.985 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 70/122 2023-12-03T11:32:26.072 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : openblas-0.3.21-2.el9.x86_64 79/122 2023-12-03T11:32:26.080 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 71/122 2023-12-03T11:32:26.094 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 80/122 2023-12-03T11:32:26.121 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 72/122 2023-12-03T11:32:26.166 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 81/122 2023-12-03T11:32:26.229 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 73/122 2023-12-03T11:32:26.281 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 74/122 2023-12-03T11:32:26.864 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 82/122 2023-12-03T11:32:26.986 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 83/122 2023-12-03T11:32:27.196 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 75/122 2023-12-03T11:32:27.242 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 76/122 2023-12-03T11:32:27.285 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 77/122 2023-12-03T11:32:27.317 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 78/122 2023-12-03T11:32:27.501 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : openblas-0.3.21-2.el9.x86_64 79/122 2023-12-03T11:32:27.531 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 80/122 2023-12-03T11:32:27.612 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 81/122 2023-12-03T11:32:28.311 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/122 2023-12-03T11:32:28.326 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 82/122 2023-12-03T11:32:28.375 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 85/122 2023-12-03T11:32:28.406 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 86/122 2023-12-03T11:32:28.439 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : jq-1.6-16.el9.x86_64 87/122 2023-12-03T11:32:28.442 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 83/122 2023-12-03T11:32:28.752 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 88/122 2023-12-03T11:32:28.786 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : librbd1-2:18.0.0-7537.gbcbf278c.el9.x86_64 89/122 2023-12-03T11:32:28.877 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librbd1-2:18.0.0-7537.gbcbf278c.el9.x86_64 89/122 2023-12-03T11:32:28.907 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-rbd-2:18.0.0-7537.gbcbf278c.el9.x86_64 90/122 2023-12-03T11:32:28.943 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 91/122 2023-12-03T11:32:29.394 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : parquet-libs-9.0.0-9.el9.x86_64 92/122 2023-12-03T11:32:29.422 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : librgw2-2:18.0.0-7537.gbcbf278c.el9.x86_64 93/122 2023-12-03T11:32:29.493 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librgw2-2:18.0.0-7537.gbcbf278c.el9.x86_64 93/122 2023-12-03T11:32:29.515 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-rgw-2:18.0.0-7537.gbcbf278c.el9.x86_64 94/122 2023-12-03T11:32:29.810 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/122 2023-12-03T11:32:29.898 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 85/122 2023-12-03T11:32:29.928 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 86/122 2023-12-03T11:32:29.961 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : jq-1.6-16.el9.x86_64 87/122 2023-12-03T11:32:30.273 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 88/122 2023-12-03T11:32:30.299 INFO:teuthology.orchestra.run.smithi003.stdout: Upgrading : librbd1-2:18.0.0-7537.gbcbf278c.el9.x86_64 89/122 2023-12-03T11:32:30.390 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: librbd1-2:18.0.0-7537.gbcbf278c.el9.x86_64 89/122 2023-12-03T11:32:30.420 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-rbd-2:18.0.0-7537.gbcbf278c.el9.x86_64 90/122 2023-12-03T11:32:30.457 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 91/122 2023-12-03T11:32:30.906 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : parquet-libs-9.0.0-9.el9.x86_64 92/122 2023-12-03T11:32:30.943 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : librgw2-2:18.0.0-7537.gbcbf278c.el9.x86_64 93/122 2023-12-03T11:32:31.015 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: librgw2-2:18.0.0-7537.gbcbf278c.el9.x86_64 93/122 2023-12-03T11:32:31.053 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-rgw-2:18.0.0-7537.gbcbf278c.el9.x86_64 94/122 2023-12-03T11:32:31.721 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-common-2:18.0.0-7537.gbcbf278c.el9.x86_64 95/122 2023-12-03T11:32:31.923 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-common-2:18.0.0-7537.gbcbf278c.el9.x86_64 95/122 2023-12-03T11:32:32.507 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-common-2:18.0.0-7537.gbcbf278c.el9.x86_64 95/122 2023-12-03T11:32:32.549 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-base-2:18.0.0-7537.gbcbf278c.el9.x86_64 96/122 2023-12-03T11:32:32.635 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-base-2:18.0.0-7537.gbcbf278c.el9.x86_64 96/122 2023-12-03T11:32:32.635 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-12-03T11:32:32.636 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-12-03T11:32:32.636 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-03T11:32:32.684 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-selinux-2:18.0.0-7537.gbcbf278c.el9.x86_64 97/122 2023-12-03T11:32:33.151 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-common-2:18.0.0-7537.gbcbf278c.el9.x86_64 95/122 2023-12-03T11:32:33.192 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-common-2:18.0.0-7537.gbcbf278c.el9.x86_64 95/122 2023-12-03T11:32:33.776 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-common-2:18.0.0-7537.gbcbf278c.el9.x86_64 95/122 2023-12-03T11:32:33.812 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-base-2:18.0.0-7537.gbcbf278c.el9.x86_64 96/122 2023-12-03T11:32:33.906 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-base-2:18.0.0-7537.gbcbf278c.el9.x86_64 96/122 2023-12-03T11:32:33.906 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-12-03T11:32:33.906 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-12-03T11:32:33.906 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:32:33.947 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-selinux-2:18.0.0-7537.gbcbf278c.el9.x86_64 97/122 2023-12-03T11:32:44.647 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-selinux-2:18.0.0-7537.gbcbf278c.el9.x86_64 97/122 2023-12-03T11:32:44.647 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /sys 2023-12-03T11:32:44.647 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /proc 2023-12-03T11:32:44.647 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /mnt 2023-12-03T11:32:44.647 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /var/tmp 2023-12-03T11:32:44.647 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /home 2023-12-03T11:32:44.647 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /root 2023-12-03T11:32:44.648 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /tmp 2023-12-03T11:32:44.648 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-03T11:32:44.809 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-volume-2:18.0.0-7537.gbcbf278c.el9.noarch 98/122 2023-12-03T11:32:44.825 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-volume-2:18.0.0-7537.gbcbf278c.el9.noarch 98/122 2023-12-03T11:32:44.826 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-03T11:32:44.826 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-12-03T11:32:44.826 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-03T11:32:45.663 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-selinux-2:18.0.0-7537.gbcbf278c.el9.x86_64 97/122 2023-12-03T11:32:45.663 INFO:teuthology.orchestra.run.smithi003.stdout:skipping the directory /sys 2023-12-03T11:32:45.663 INFO:teuthology.orchestra.run.smithi003.stdout:skipping the directory /proc 2023-12-03T11:32:45.663 INFO:teuthology.orchestra.run.smithi003.stdout:skipping the directory /mnt 2023-12-03T11:32:45.663 INFO:teuthology.orchestra.run.smithi003.stdout:skipping the directory /var/tmp 2023-12-03T11:32:45.664 INFO:teuthology.orchestra.run.smithi003.stdout:skipping the directory /home 2023-12-03T11:32:45.664 INFO:teuthology.orchestra.run.smithi003.stdout:skipping the directory /root 2023-12-03T11:32:45.664 INFO:teuthology.orchestra.run.smithi003.stdout:skipping the directory /tmp 2023-12-03T11:32:45.664 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:32:45.822 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-volume-2:18.0.0-7537.gbcbf278c.el9.noarch 98/122 2023-12-03T11:32:45.838 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-volume-2:18.0.0-7537.gbcbf278c.el9.noarch 98/122 2023-12-03T11:32:45.839 INFO:teuthology.orchestra.run.smithi003.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-03T11:32:45.839 INFO:teuthology.orchestra.run.smithi003.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-12-03T11:32:45.839 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:32:46.446 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-osd-2:18.0.0-7537.gbcbf278c.el9.x86_64 99/122 2023-12-03T11:32:46.473 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-osd-2:18.0.0-7537.gbcbf278c.el9.x86_64 99/122 2023-12-03T11:32:46.473 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-03T11:32:46.473 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-12-03T11:32:46.473 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-12-03T11:32:46.473 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-12-03T11:32:46.473 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-03T11:32:46.688 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mds-2:18.0.0-7537.gbcbf278c.el9.x86_64 100/122 2023-12-03T11:32:46.711 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mds-2:18.0.0-7537.gbcbf278c.el9.x86_64 100/122 2023-12-03T11:32:46.712 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-03T11:32:46.712 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-12-03T11:32:46.712 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-12-03T11:32:46.712 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-12-03T11:32:46.712 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-03T11:32:47.180 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mon-2:18.0.0-7537.gbcbf278c.el9.x86_64 101/122 2023-12-03T11:32:47.204 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mon-2:18.0.0-7537.gbcbf278c.el9.x86_64 101/122 2023-12-03T11:32:47.204 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-03T11:32:47.204 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-12-03T11:32:47.204 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-12-03T11:32:47.204 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-12-03T11:32:47.205 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-03T11:32:47.458 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-osd-2:18.0.0-7537.gbcbf278c.el9.x86_64 99/122 2023-12-03T11:32:47.485 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-osd-2:18.0.0-7537.gbcbf278c.el9.x86_64 99/122 2023-12-03T11:32:47.485 INFO:teuthology.orchestra.run.smithi003.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-03T11:32:47.485 INFO:teuthology.orchestra.run.smithi003.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-12-03T11:32:47.486 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-12-03T11:32:47.486 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-12-03T11:32:47.486 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:32:47.620 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: cephadm-2:18.0.0-7537.gbcbf278c.el9.noarch 102/122 2023-12-03T11:32:47.663 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : cephadm-2:18.0.0-7537.gbcbf278c.el9.noarch 102/122 2023-12-03T11:32:47.693 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-7537.gbcbf278c.e 103/122 2023-12-03T11:32:47.701 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-mds-2:18.0.0-7537.gbcbf278c.el9.x86_64 100/122 2023-12-03T11:32:47.725 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-mds-2:18.0.0-7537.gbcbf278c.el9.x86_64 100/122 2023-12-03T11:32:47.725 INFO:teuthology.orchestra.run.smithi003.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-03T11:32:47.725 INFO:teuthology.orchestra.run.smithi003.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-12-03T11:32:47.725 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-12-03T11:32:47.725 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-12-03T11:32:47.725 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:32:47.756 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-7537.gbcbf278c. 104/122 2023-12-03T11:32:47.786 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-7537.gbcbf278c.el9.noa 105/122 2023-12-03T11:32:48.019 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-7537.gbcbf278c.el9.noa 105/122 2023-12-03T11:32:48.045 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-7537.gbcbf278c.el9.n 106/122 2023-12-03T11:32:48.194 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-mon-2:18.0.0-7537.gbcbf278c.el9.x86_64 101/122 2023-12-03T11:32:48.217 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-mon-2:18.0.0-7537.gbcbf278c.el9.x86_64 101/122 2023-12-03T11:32:48.218 INFO:teuthology.orchestra.run.smithi003.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-03T11:32:48.218 INFO:teuthology.orchestra.run.smithi003.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-12-03T11:32:48.218 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-12-03T11:32:48.218 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-12-03T11:32:48.218 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:32:48.608 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: cephadm-2:18.0.0-7537.gbcbf278c.el9.noarch 102/122 2023-12-03T11:32:48.642 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : cephadm-2:18.0.0-7537.gbcbf278c.el9.noarch 102/122 2023-12-03T11:32:48.672 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-7537.gbcbf278c.e 103/122 2023-12-03T11:32:48.734 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-7537.gbcbf278c. 104/122 2023-12-03T11:32:48.765 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-7537.gbcbf278c.el9.noa 105/122 2023-12-03T11:32:48.996 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-7537.gbcbf278c.el9.noa 105/122 2023-12-03T11:32:49.033 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-7537.gbcbf278c.el9.n 106/122 2023-12-03T11:32:49.061 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-7537.gbcbf278c.el9.n 106/122 2023-12-03T11:32:49.087 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-7537.gbcb 107/122 2023-12-03T11:32:49.191 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-7537.gbcb 107/122 2023-12-03T11:32:49.350 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-7537.gbcbf278c.el 108/122 2023-12-03T11:32:49.380 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-2:18.0.0-7537.gbcbf278c.el9.x86_64 109/122 2023-12-03T11:32:49.404 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mgr-2:18.0.0-7537.gbcbf278c.el9.x86_64 109/122 2023-12-03T11:32:49.405 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-03T11:32:49.405 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-12-03T11:32:49.405 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-12-03T11:32:49.405 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-12-03T11:32:49.405 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-03T11:32:49.456 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-rook-2:18.0.0-7537.gbcbf278c.el9.noarch 110/122 2023-12-03T11:32:49.467 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-7537.gbcbf278c.el9.noarch 110/122 2023-12-03T11:32:50.046 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-7537.gbcbf278c.el9.n 106/122 2023-12-03T11:32:50.074 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-7537.gbcb 107/122 2023-12-03T11:32:50.178 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-7537.gbcb 107/122 2023-12-03T11:32:50.289 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-2:18.0.0-7537.gbcbf278c.el9.x86_64 111/122 2023-12-03T11:32:50.315 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-radosgw-2:18.0.0-7537.gbcbf278c.el9.x86_64 112/122 2023-12-03T11:32:50.339 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-7537.gbcbf278c.el9.x86_64 112/122 2023-12-03T11:32:50.339 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-03T11:32:50.339 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-12-03T11:32:50.339 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-12-03T11:32:50.339 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-12-03T11:32:50.339 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-03T11:32:50.343 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-7537.gbcbf278c.el 108/122 2023-12-03T11:32:50.368 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-mgr-2:18.0.0-7537.gbcbf278c.el9.x86_64 109/122 2023-12-03T11:32:50.391 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-7537.gbcbf2 113/122 2023-12-03T11:32:50.392 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-mgr-2:18.0.0-7537.gbcbf278c.el9.x86_64 109/122 2023-12-03T11:32:50.392 INFO:teuthology.orchestra.run.smithi003.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-03T11:32:50.392 INFO:teuthology.orchestra.run.smithi003.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-12-03T11:32:50.392 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-12-03T11:32:50.392 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-12-03T11:32:50.392 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:32:50.414 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-7537.gbcbf2 113/122 2023-12-03T11:32:50.414 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-03T11:32:50.414 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-12-03T11:32:50.414 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-03T11:32:50.435 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-mgr-rook-2:18.0.0-7537.gbcbf278c.el9.noarch 110/122 2023-12-03T11:32:50.447 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-7537.gbcbf278c.el9.noarch 110/122 2023-12-03T11:32:50.725 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : rbd-mirror-2:18.0.0-7537.gbcbf278c.el9.x86_64 114/122 2023-12-03T11:32:50.749 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: rbd-mirror-2:18.0.0-7537.gbcbf278c.el9.x86_64 114/122 2023-12-03T11:32:50.749 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-03T11:32:50.749 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-12-03T11:32:50.749 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-12-03T11:32:50.750 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-12-03T11:32:50.750 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-03T11:32:51.260 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-2:18.0.0-7537.gbcbf278c.el9.x86_64 111/122 2023-12-03T11:32:51.303 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-radosgw-2:18.0.0-7537.gbcbf278c.el9.x86_64 112/122 2023-12-03T11:32:51.327 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-7537.gbcbf278c.el9.x86_64 112/122 2023-12-03T11:32:51.327 INFO:teuthology.orchestra.run.smithi003.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-03T11:32:51.327 INFO:teuthology.orchestra.run.smithi003.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-12-03T11:32:51.327 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-12-03T11:32:51.327 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-12-03T11:32:51.327 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:32:51.370 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-7537.gbcbf2 113/122 2023-12-03T11:32:51.393 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-7537.gbcbf2 113/122 2023-12-03T11:32:51.393 INFO:teuthology.orchestra.run.smithi003.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-03T11:32:51.394 INFO:teuthology.orchestra.run.smithi003.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-12-03T11:32:51.394 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:32:51.696 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : rbd-mirror-2:18.0.0-7537.gbcbf278c.el9.x86_64 114/122 2023-12-03T11:32:51.719 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: rbd-mirror-2:18.0.0-7537.gbcbf278c.el9.x86_64 114/122 2023-12-03T11:32:51.720 INFO:teuthology.orchestra.run.smithi003.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-03T11:32:51.720 INFO:teuthology.orchestra.run.smithi003.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-12-03T11:32:51.720 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-12-03T11:32:51.720 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-12-03T11:32:51.720 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:32:54.779 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-test-2:18.0.0-7537.gbcbf278c.el9.x86_64 115/122 2023-12-03T11:32:54.821 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : rbd-fuse-2:18.0.0-7537.gbcbf278c.el9.x86_64 116/122 2023-12-03T11:32:54.922 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : rbd-nbd-2:18.0.0-7537.gbcbf278c.el9.x86_64 117/122 2023-12-03T11:32:54.952 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-fuse-2:18.0.0-7537.gbcbf278c.el9.x86_64 118/122 2023-12-03T11:32:55.012 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libcephfs-devel-2:18.0.0-7537.gbcbf278c.el9.x86_ 119/122 2023-12-03T11:32:55.042 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : s3cmd-2.3.0-4.el9.noarch 120/122 2023-12-03T11:32:55.042 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 121/122 2023-12-03T11:32:55.134 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 121/122 2023-12-03T11:32:55.134 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 122/122 2023-12-03T11:32:55.741 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-test-2:18.0.0-7537.gbcbf278c.el9.x86_64 115/122 2023-12-03T11:32:55.807 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : rbd-fuse-2:18.0.0-7537.gbcbf278c.el9.x86_64 116/122 2023-12-03T11:32:55.910 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : rbd-nbd-2:18.0.0-7537.gbcbf278c.el9.x86_64 117/122 2023-12-03T11:32:55.939 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-fuse-2:18.0.0-7537.gbcbf278c.el9.x86_64 118/122 2023-12-03T11:32:55.999 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libcephfs-devel-2:18.0.0-7537.gbcbf278c.el9.x86_ 119/122 2023-12-03T11:32:56.029 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : s3cmd-2.3.0-4.el9.noarch 120/122 2023-12-03T11:32:56.029 INFO:teuthology.orchestra.run.smithi003.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 121/122 2023-12-03T11:32:56.096 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 121/122 2023-12-03T11:32:56.096 INFO:teuthology.orchestra.run.smithi003.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 122/122 2023-12-03T11:32:59.252 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 122/122 2023-12-03T11:32:59.252 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-2:18.0.0-7537.gbcbf278c.el9.x86_64 1/122 2023-12-03T11:32:59.252 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-base-2:18.0.0-7537.gbcbf278c.el9.x86_64 2/122 2023-12-03T11:32:59.252 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-common-2:18.0.0-7537.gbcbf278c.el9.x86_64 3/122 2023-12-03T11:32:59.253 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-fuse-2:18.0.0-7537.gbcbf278c.el9.x86_64 4/122 2023-12-03T11:32:59.253 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-7537.gbcbf2 5/122 2023-12-03T11:32:59.253 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mds-2:18.0.0-7537.gbcbf278c.el9.x86_64 6/122 2023-12-03T11:32:59.253 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-2:18.0.0-7537.gbcbf278c.el9.x86_64 7/122 2023-12-03T11:32:59.253 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mon-2:18.0.0-7537.gbcbf278c.el9.x86_64 8/122 2023-12-03T11:32:59.253 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-osd-2:18.0.0-7537.gbcbf278c.el9.x86_64 9/122 2023-12-03T11:32:59.253 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-radosgw-2:18.0.0-7537.gbcbf278c.el9.x86_64 10/122 2023-12-03T11:32:59.253 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-selinux-2:18.0.0-7537.gbcbf278c.el9.x86_64 11/122 2023-12-03T11:32:59.253 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-test-2:18.0.0-7537.gbcbf278c.el9.x86_64 12/122 2023-12-03T11:32:59.253 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libcephfs-devel-2:18.0.0-7537.gbcbf278c.el9.x86_ 13/122 2023-12-03T11:32:59.253 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libcephfs2-2:18.0.0-7537.gbcbf278c.el9.x86_64 14/122 2023-12-03T11:32:59.253 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libcephsqlite-2:18.0.0-7537.gbcbf278c.el9.x86_64 15/122 2023-12-03T11:32:59.253 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librados-devel-2:18.0.0-7537.gbcbf278c.el9.x86_6 16/122 2023-12-03T11:32:59.253 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libradosstriper1-2:18.0.0-7537.gbcbf278c.el9.x86 17/122 2023-12-03T11:32:59.253 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librgw2-2:18.0.0-7537.gbcbf278c.el9.x86_64 18/122 2023-12-03T11:32:59.254 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-ceph-argparse-2:18.0.0-7537.gbcbf278c.el 19/122 2023-12-03T11:32:59.254 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-ceph-common-2:18.0.0-7537.gbcbf278c.el9. 20/122 2023-12-03T11:32:59.254 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cephfs-2:18.0.0-7537.gbcbf278c.el9.x86_6 21/122 2023-12-03T11:32:59.254 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-rados-2:18.0.0-7537.gbcbf278c.el9.x86_64 22/122 2023-12-03T11:32:59.254 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-rbd-2:18.0.0-7537.gbcbf278c.el9.x86_64 23/122 2023-12-03T11:32:59.254 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-rgw-2:18.0.0-7537.gbcbf278c.el9.x86_64 24/122 2023-12-03T11:32:59.254 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : rbd-fuse-2:18.0.0-7537.gbcbf278c.el9.x86_64 25/122 2023-12-03T11:32:59.254 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : rbd-mirror-2:18.0.0-7537.gbcbf278c.el9.x86_64 26/122 2023-12-03T11:32:59.254 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : rbd-nbd-2:18.0.0-7537.gbcbf278c.el9.x86_64 27/122 2023-12-03T11:32:59.254 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-7537.gbcbf278c. 28/122 2023-12-03T11:32:59.254 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-7537.gbcbf278c.el9.noa 29/122 2023-12-03T11:32:59.254 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-7537.gbcbf278c.el9.n 30/122 2023-12-03T11:32:59.254 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-7537.gbcb 31/122 2023-12-03T11:32:59.254 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-7537.gbcbf278c.el 32/122 2023-12-03T11:32:59.255 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-rook-2:18.0.0-7537.gbcbf278c.el9.noarch 33/122 2023-12-03T11:32:59.255 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-7537.gbcbf278c.e 34/122 2023-12-03T11:32:59.255 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-volume-2:18.0.0-7537.gbcbf278c.el9.noarch 35/122 2023-12-03T11:32:59.255 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : cephadm-2:18.0.0-7537.gbcbf278c.el9.noarch 36/122 2023-12-03T11:32:59.255 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 37/122 2023-12-03T11:32:59.255 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 38/122 2023-12-03T11:32:59.255 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 39/122 2023-12-03T11:32:59.255 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 40/122 2023-12-03T11:32:59.255 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : jq-1.6-16.el9.x86_64 41/122 2023-12-03T11:32:59.255 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 42/122 2023-12-03T11:32:59.255 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 43/122 2023-12-03T11:32:59.255 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 44/122 2023-12-03T11:32:59.255 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 45/122 2023-12-03T11:32:59.255 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : lua-5.4.4-4.el9.x86_64 46/122 2023-12-03T11:32:59.255 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 47/122 2023-12-03T11:32:59.256 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 48/122 2023-12-03T11:32:59.256 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 49/122 2023-12-03T11:32:59.256 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 50/122 2023-12-03T11:32:59.256 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 51/122 2023-12-03T11:32:59.256 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 52/122 2023-12-03T11:32:59.256 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 53/122 2023-12-03T11:32:59.256 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 54/122 2023-12-03T11:32:59.256 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 55/122 2023-12-03T11:32:59.256 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 56/122 2023-12-03T11:32:59.256 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 57/122 2023-12-03T11:32:59.256 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 58/122 2023-12-03T11:32:59.256 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 59/122 2023-12-03T11:32:59.256 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 60/122 2023-12-03T11:32:59.256 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 61/122 2023-12-03T11:32:59.257 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 62/122 2023-12-03T11:32:59.257 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 63/122 2023-12-03T11:32:59.257 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 64/122 2023-12-03T11:32:59.257 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 65/122 2023-12-03T11:32:59.257 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 66/122 2023-12-03T11:32:59.257 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 67/122 2023-12-03T11:32:59.257 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 68/122 2023-12-03T11:32:59.257 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libgfortran-11.4.1-2.3.el9.x86_64 69/122 2023-12-03T11:32:59.257 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libquadmath-11.4.1-2.3.el9.x86_64 70/122 2023-12-03T11:32:59.257 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 71/122 2023-12-03T11:32:59.257 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 72/122 2023-12-03T11:32:59.257 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-ply-3.11-14.el9.noarch 73/122 2023-12-03T11:32:59.257 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 74/122 2023-12-03T11:32:59.257 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 75/122 2023-12-03T11:32:59.257 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-urllib3-1.26.5-4.el9.noarch 76/122 2023-12-03T11:32:59.258 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 77/122 2023-12-03T11:32:59.258 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 78/122 2023-12-03T11:32:59.258 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 79/122 2023-12-03T11:32:59.258 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libarrow-9.0.0-9.el9.x86_64 80/122 2023-12-03T11:32:59.258 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libarrow-doc-9.0.0-9.el9.noarch 81/122 2023-12-03T11:32:59.258 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 82/122 2023-12-03T11:32:59.258 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 83/122 2023-12-03T11:32:59.258 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 84/122 2023-12-03T11:32:59.258 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : parquet-libs-9.0.0-9.el9.x86_64 85/122 2023-12-03T11:32:59.258 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 86/122 2023-12-03T11:32:59.258 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 87/122 2023-12-03T11:32:59.258 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 88/122 2023-12-03T11:32:59.258 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 89/122 2023-12-03T11:32:59.258 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 90/122 2023-12-03T11:32:59.258 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 91/122 2023-12-03T11:32:59.259 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-google-auth-1:2.23.4-1.el9.noarch 92/122 2023-12-03T11:32:59.259 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 93/122 2023-12-03T11:32:59.259 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 94/122 2023-12-03T11:32:59.259 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 95/122 2023-12-03T11:32:59.259 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 96/122 2023-12-03T11:32:59.259 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 97/122 2023-12-03T11:32:59.259 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 98/122 2023-12-03T11:32:59.259 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 99/122 2023-12-03T11:32:59.259 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 100/122 2023-12-03T11:32:59.259 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 101/122 2023-12-03T11:32:59.259 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 102/122 2023-12-03T11:32:59.259 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 103/122 2023-12-03T11:32:59.259 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 104/122 2023-12-03T11:32:59.259 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 105/122 2023-12-03T11:32:59.260 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 106/122 2023-12-03T11:32:59.260 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 107/122 2023-12-03T11:32:59.260 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 108/122 2023-12-03T11:32:59.260 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 109/122 2023-12-03T11:32:59.260 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 110/122 2023-12-03T11:32:59.260 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 111/122 2023-12-03T11:32:59.260 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 112/122 2023-12-03T11:32:59.260 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 113/122 2023-12-03T11:32:59.260 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 114/122 2023-12-03T11:32:59.260 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 115/122 2023-12-03T11:32:59.260 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : re2-1:20211101-3.el9.x86_64 116/122 2023-12-03T11:32:59.260 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : s3cmd-2.3.0-4.el9.noarch 117/122 2023-12-03T11:32:59.260 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 118/122 2023-12-03T11:32:59.260 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librados2-2:18.0.0-7537.gbcbf278c.el9.x86_64 119/122 2023-12-03T11:32:59.260 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 120/122 2023-12-03T11:32:59.261 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librbd1-2:18.0.0-7537.gbcbf278c.el9.x86_64 121/122 2023-12-03T11:33:00.373 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 122/122 2023-12-03T11:33:00.373 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-2:18.0.0-7537.gbcbf278c.el9.x86_64 1/122 2023-12-03T11:33:00.373 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-base-2:18.0.0-7537.gbcbf278c.el9.x86_64 2/122 2023-12-03T11:33:00.373 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-common-2:18.0.0-7537.gbcbf278c.el9.x86_64 3/122 2023-12-03T11:33:00.373 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-fuse-2:18.0.0-7537.gbcbf278c.el9.x86_64 4/122 2023-12-03T11:33:00.373 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-7537.gbcbf2 5/122 2023-12-03T11:33:00.373 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-mds-2:18.0.0-7537.gbcbf278c.el9.x86_64 6/122 2023-12-03T11:33:00.374 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-mgr-2:18.0.0-7537.gbcbf278c.el9.x86_64 7/122 2023-12-03T11:33:00.374 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-mon-2:18.0.0-7537.gbcbf278c.el9.x86_64 8/122 2023-12-03T11:33:00.374 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-osd-2:18.0.0-7537.gbcbf278c.el9.x86_64 9/122 2023-12-03T11:33:00.374 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-radosgw-2:18.0.0-7537.gbcbf278c.el9.x86_64 10/122 2023-12-03T11:33:00.374 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-selinux-2:18.0.0-7537.gbcbf278c.el9.x86_64 11/122 2023-12-03T11:33:00.374 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-test-2:18.0.0-7537.gbcbf278c.el9.x86_64 12/122 2023-12-03T11:33:00.374 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libcephfs-devel-2:18.0.0-7537.gbcbf278c.el9.x86_ 13/122 2023-12-03T11:33:00.374 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libcephfs2-2:18.0.0-7537.gbcbf278c.el9.x86_64 14/122 2023-12-03T11:33:00.374 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libcephsqlite-2:18.0.0-7537.gbcbf278c.el9.x86_64 15/122 2023-12-03T11:33:00.374 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : librados-devel-2:18.0.0-7537.gbcbf278c.el9.x86_6 16/122 2023-12-03T11:33:00.374 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libradosstriper1-2:18.0.0-7537.gbcbf278c.el9.x86 17/122 2023-12-03T11:33:00.374 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : librgw2-2:18.0.0-7537.gbcbf278c.el9.x86_64 18/122 2023-12-03T11:33:00.374 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-ceph-argparse-2:18.0.0-7537.gbcbf278c.el 19/122 2023-12-03T11:33:00.374 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-ceph-common-2:18.0.0-7537.gbcbf278c.el9. 20/122 2023-12-03T11:33:00.375 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-cephfs-2:18.0.0-7537.gbcbf278c.el9.x86_6 21/122 2023-12-03T11:33:00.375 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-rados-2:18.0.0-7537.gbcbf278c.el9.x86_64 22/122 2023-12-03T11:33:00.375 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-rbd-2:18.0.0-7537.gbcbf278c.el9.x86_64 23/122 2023-12-03T11:33:00.375 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-rgw-2:18.0.0-7537.gbcbf278c.el9.x86_64 24/122 2023-12-03T11:33:00.375 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : rbd-fuse-2:18.0.0-7537.gbcbf278c.el9.x86_64 25/122 2023-12-03T11:33:00.375 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : rbd-mirror-2:18.0.0-7537.gbcbf278c.el9.x86_64 26/122 2023-12-03T11:33:00.375 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : rbd-nbd-2:18.0.0-7537.gbcbf278c.el9.x86_64 27/122 2023-12-03T11:33:00.375 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-7537.gbcbf278c. 28/122 2023-12-03T11:33:00.375 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-7537.gbcbf278c.el9.noa 29/122 2023-12-03T11:33:00.376 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-7537.gbcbf278c.el9.n 30/122 2023-12-03T11:33:00.376 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-7537.gbcb 31/122 2023-12-03T11:33:00.376 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-7537.gbcbf278c.el 32/122 2023-12-03T11:33:00.376 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-mgr-rook-2:18.0.0-7537.gbcbf278c.el9.noarch 33/122 2023-12-03T11:33:00.376 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-7537.gbcbf278c.e 34/122 2023-12-03T11:33:00.376 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-volume-2:18.0.0-7537.gbcbf278c.el9.noarch 35/122 2023-12-03T11:33:00.376 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : cephadm-2:18.0.0-7537.gbcbf278c.el9.noarch 36/122 2023-12-03T11:33:00.376 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 37/122 2023-12-03T11:33:00.376 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 38/122 2023-12-03T11:33:00.376 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 39/122 2023-12-03T11:33:00.376 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 40/122 2023-12-03T11:33:00.376 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : jq-1.6-16.el9.x86_64 41/122 2023-12-03T11:33:00.377 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 42/122 2023-12-03T11:33:00.377 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 43/122 2023-12-03T11:33:00.377 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 44/122 2023-12-03T11:33:00.377 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 45/122 2023-12-03T11:33:00.377 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : lua-5.4.4-4.el9.x86_64 46/122 2023-12-03T11:33:00.377 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 47/122 2023-12-03T11:33:00.377 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 48/122 2023-12-03T11:33:00.377 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 49/122 2023-12-03T11:33:00.377 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 50/122 2023-12-03T11:33:00.377 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 51/122 2023-12-03T11:33:00.377 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 52/122 2023-12-03T11:33:00.377 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 53/122 2023-12-03T11:33:00.377 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 54/122 2023-12-03T11:33:00.378 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 55/122 2023-12-03T11:33:00.378 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 56/122 2023-12-03T11:33:00.378 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 57/122 2023-12-03T11:33:00.378 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 58/122 2023-12-03T11:33:00.378 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 59/122 2023-12-03T11:33:00.378 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 60/122 2023-12-03T11:33:00.378 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 61/122 2023-12-03T11:33:00.378 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 62/122 2023-12-03T11:33:00.378 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 63/122 2023-12-03T11:33:00.378 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 64/122 2023-12-03T11:33:00.378 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 65/122 2023-12-03T11:33:00.378 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 66/122 2023-12-03T11:33:00.378 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 67/122 2023-12-03T11:33:00.379 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 68/122 2023-12-03T11:33:00.379 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libgfortran-11.4.1-2.3.el9.x86_64 69/122 2023-12-03T11:33:00.379 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libquadmath-11.4.1-2.3.el9.x86_64 70/122 2023-12-03T11:33:00.379 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 71/122 2023-12-03T11:33:00.379 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 72/122 2023-12-03T11:33:00.379 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-ply-3.11-14.el9.noarch 73/122 2023-12-03T11:33:00.379 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 74/122 2023-12-03T11:33:00.379 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 75/122 2023-12-03T11:33:00.379 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-urllib3-1.26.5-4.el9.noarch 76/122 2023-12-03T11:33:00.379 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 77/122 2023-12-03T11:33:00.380 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 78/122 2023-12-03T11:33:00.380 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 79/122 2023-12-03T11:33:00.380 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libarrow-9.0.0-9.el9.x86_64 80/122 2023-12-03T11:33:00.380 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libarrow-doc-9.0.0-9.el9.noarch 81/122 2023-12-03T11:33:00.380 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 82/122 2023-12-03T11:33:00.380 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 83/122 2023-12-03T11:33:00.380 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 84/122 2023-12-03T11:33:00.380 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : parquet-libs-9.0.0-9.el9.x86_64 85/122 2023-12-03T11:33:00.380 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 86/122 2023-12-03T11:33:00.380 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 87/122 2023-12-03T11:33:00.380 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 88/122 2023-12-03T11:33:00.381 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 89/122 2023-12-03T11:33:00.381 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 90/122 2023-12-03T11:33:00.381 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 91/122 2023-12-03T11:33:00.381 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-google-auth-1:2.23.4-1.el9.noarch 92/122 2023-12-03T11:33:00.381 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 93/122 2023-12-03T11:33:00.381 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 94/122 2023-12-03T11:33:00.381 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 95/122 2023-12-03T11:33:00.381 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 96/122 2023-12-03T11:33:00.381 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 97/122 2023-12-03T11:33:00.381 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 98/122 2023-12-03T11:33:00.382 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 99/122 2023-12-03T11:33:00.382 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 100/122 2023-12-03T11:33:00.382 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 101/122 2023-12-03T11:33:00.382 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 102/122 2023-12-03T11:33:00.382 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 103/122 2023-12-03T11:33:00.382 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 104/122 2023-12-03T11:33:00.382 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 105/122 2023-12-03T11:33:00.382 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 106/122 2023-12-03T11:33:00.382 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 107/122 2023-12-03T11:33:00.382 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 108/122 2023-12-03T11:33:00.382 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 109/122 2023-12-03T11:33:00.383 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 110/122 2023-12-03T11:33:00.383 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 111/122 2023-12-03T11:33:00.383 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 112/122 2023-12-03T11:33:00.383 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 113/122 2023-12-03T11:33:00.383 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 114/122 2023-12-03T11:33:00.383 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 115/122 2023-12-03T11:33:00.383 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : re2-1:20211101-3.el9.x86_64 116/122 2023-12-03T11:33:00.383 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : s3cmd-2.3.0-4.el9.noarch 117/122 2023-12-03T11:33:00.383 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 118/122 2023-12-03T11:33:00.383 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : librados2-2:18.0.0-7537.gbcbf278c.el9.x86_64 119/122 2023-12-03T11:33:00.383 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 120/122 2023-12-03T11:33:00.384 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : librbd1-2:18.0.0-7537.gbcbf278c.el9.x86_64 121/122 2023-12-03T11:33:01.351 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 122/122 2023-12-03T11:33:01.351 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-03T11:33:01.351 INFO:teuthology.orchestra.run.smithi037.stdout:Upgraded: 2023-12-03T11:33:01.352 INFO:teuthology.orchestra.run.smithi037.stdout: librados2-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:33:01.352 INFO:teuthology.orchestra.run.smithi037.stdout: librbd1-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:33:01.352 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2023-12-03T11:33:01.352 INFO:teuthology.orchestra.run.smithi037.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-12-03T11:33:01.352 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:33:01.352 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-base-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:33:01.352 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-common-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:33:01.352 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-fuse-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:33:01.352 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-grafana-dashboards-2:18.0.0-7537.gbcbf278c.el9.noarch 2023-12-03T11:33:01.352 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-immutable-object-cache-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:33:01.352 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mds-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:33:01.352 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:33:01.352 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-cephadm-2:18.0.0-7537.gbcbf278c.el9.noarch 2023-12-03T11:33:01.352 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-dashboard-2:18.0.0-7537.gbcbf278c.el9.noarch 2023-12-03T11:33:01.353 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-diskprediction-local-2:18.0.0-7537.gbcbf278c.el9.noarch 2023-12-03T11:33:01.353 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-modules-core-2:18.0.0-7537.gbcbf278c.el9.noarch 2023-12-03T11:33:01.353 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-rook-2:18.0.0-7537.gbcbf278c.el9.noarch 2023-12-03T11:33:01.353 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mon-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:33:01.353 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-osd-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:33:01.353 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-prometheus-alerts-2:18.0.0-7537.gbcbf278c.el9.noarch 2023-12-03T11:33:01.353 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-radosgw-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:33:01.353 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-selinux-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:33:01.353 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-test-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:33:01.353 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-volume-2:18.0.0-7537.gbcbf278c.el9.noarch 2023-12-03T11:33:01.353 INFO:teuthology.orchestra.run.smithi037.stdout: cephadm-2:18.0.0-7537.gbcbf278c.el9.noarch 2023-12-03T11:33:01.353 INFO:teuthology.orchestra.run.smithi037.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-12-03T11:33:01.353 INFO:teuthology.orchestra.run.smithi037.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-12-03T11:33:01.353 INFO:teuthology.orchestra.run.smithi037.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-12-03T11:33:01.354 INFO:teuthology.orchestra.run.smithi037.stdout: fuse-2.9.9-15.el9.x86_64 2023-12-03T11:33:01.354 INFO:teuthology.orchestra.run.smithi037.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-12-03T11:33:01.354 INFO:teuthology.orchestra.run.smithi037.stdout: jq-1.6-16.el9.x86_64 2023-12-03T11:33:01.354 INFO:teuthology.orchestra.run.smithi037.stdout: libarrow-9.0.0-9.el9.x86_64 2023-12-03T11:33:01.354 INFO:teuthology.orchestra.run.smithi037.stdout: libarrow-doc-9.0.0-9.el9.noarch 2023-12-03T11:33:01.354 INFO:teuthology.orchestra.run.smithi037.stdout: libcephfs-devel-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:33:01.354 INFO:teuthology.orchestra.run.smithi037.stdout: libcephfs2-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:33:01.354 INFO:teuthology.orchestra.run.smithi037.stdout: libcephsqlite-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:33:01.354 INFO:teuthology.orchestra.run.smithi037.stdout: libgfortran-11.4.1-2.3.el9.x86_64 2023-12-03T11:33:01.354 INFO:teuthology.orchestra.run.smithi037.stdout: liboath-2.6.7-2.el9.x86_64 2023-12-03T11:33:01.354 INFO:teuthology.orchestra.run.smithi037.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-12-03T11:33:01.354 INFO:teuthology.orchestra.run.smithi037.stdout: libquadmath-11.4.1-2.3.el9.x86_64 2023-12-03T11:33:01.354 INFO:teuthology.orchestra.run.smithi037.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-12-03T11:33:01.354 INFO:teuthology.orchestra.run.smithi037.stdout: librados-devel-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:33:01.355 INFO:teuthology.orchestra.run.smithi037.stdout: libradosstriper1-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:33:01.355 INFO:teuthology.orchestra.run.smithi037.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-12-03T11:33:01.355 INFO:teuthology.orchestra.run.smithi037.stdout: librgw2-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:33:01.355 INFO:teuthology.orchestra.run.smithi037.stdout: libunwind-1.6.2-1.el9.x86_64 2023-12-03T11:33:01.355 INFO:teuthology.orchestra.run.smithi037.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-12-03T11:33:01.355 INFO:teuthology.orchestra.run.smithi037.stdout: lua-5.4.4-4.el9.x86_64 2023-12-03T11:33:01.355 INFO:teuthology.orchestra.run.smithi037.stdout: lua-devel-5.4.4-4.el9.x86_64 2023-12-03T11:33:01.355 INFO:teuthology.orchestra.run.smithi037.stdout: luarocks-3.9.2-1.el9.noarch 2023-12-03T11:33:01.355 INFO:teuthology.orchestra.run.smithi037.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-12-03T11:33:01.355 INFO:teuthology.orchestra.run.smithi037.stdout: openblas-0.3.21-2.el9.x86_64 2023-12-03T11:33:01.355 INFO:teuthology.orchestra.run.smithi037.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-12-03T11:33:01.356 INFO:teuthology.orchestra.run.smithi037.stdout: parquet-libs-9.0.0-9.el9.x86_64 2023-12-03T11:33:01.356 INFO:teuthology.orchestra.run.smithi037.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-12-03T11:33:01.356 INFO:teuthology.orchestra.run.smithi037.stdout: python3-babel-2.9.1-2.el9.noarch 2023-12-03T11:33:01.356 INFO:teuthology.orchestra.run.smithi037.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-12-03T11:33:01.356 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-12-03T11:33:01.356 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ceph-argparse-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:33:01.356 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ceph-common-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:33:01.356 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cephfs-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:33:01.356 INFO:teuthology.orchestra.run.smithi037.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-12-03T11:33:01.356 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-12-03T11:33:01.356 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-12-03T11:33:01.356 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-12-03T11:33:01.357 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-12-03T11:33:01.357 INFO:teuthology.orchestra.run.smithi037.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-12-03T11:33:01.357 INFO:teuthology.orchestra.run.smithi037.stdout: python3-google-auth-1:2.23.4-1.el9.noarch 2023-12-03T11:33:01.357 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-12-03T11:33:01.357 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-12-03T11:33:01.357 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-12-03T11:33:01.357 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-12-03T11:33:01.357 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-12-03T11:33:01.357 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-12-03T11:33:01.357 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-12-03T11:33:01.358 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-12-03T11:33:01.358 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-12-03T11:33:01.358 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-12-03T11:33:01.358 INFO:teuthology.orchestra.run.smithi037.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-12-03T11:33:01.358 INFO:teuthology.orchestra.run.smithi037.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-12-03T11:33:01.358 INFO:teuthology.orchestra.run.smithi037.stdout: python3-mako-1.1.4-6.el9.noarch 2023-12-03T11:33:01.358 INFO:teuthology.orchestra.run.smithi037.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-12-03T11:33:01.358 INFO:teuthology.orchestra.run.smithi037.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-12-03T11:33:01.359 INFO:teuthology.orchestra.run.smithi037.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-12-03T11:33:01.359 INFO:teuthology.orchestra.run.smithi037.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-12-03T11:33:01.359 INFO:teuthology.orchestra.run.smithi037.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-12-03T11:33:01.359 INFO:teuthology.orchestra.run.smithi037.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-12-03T11:33:01.359 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-12-03T11:33:01.359 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ply-3.11-14.el9.noarch 2023-12-03T11:33:01.359 INFO:teuthology.orchestra.run.smithi037.stdout: python3-portend-3.1.0-2.el9.noarch 2023-12-03T11:33:01.359 INFO:teuthology.orchestra.run.smithi037.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-12-03T11:33:01.359 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-12-03T11:33:01.359 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-12-03T11:33:01.360 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-12-03T11:33:01.360 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pycparser-2.20-6.el9.noarch 2023-12-03T11:33:01.360 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pytz-2021.1-5.el9.noarch 2023-12-03T11:33:01.360 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rados-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:33:01.360 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rbd-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:33:01.360 INFO:teuthology.orchestra.run.smithi037.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-12-03T11:33:01.360 INFO:teuthology.orchestra.run.smithi037.stdout: python3-requests-2.25.1-7.el9.noarch 2023-12-03T11:33:01.360 INFO:teuthology.orchestra.run.smithi037.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-12-03T11:33:01.360 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rgw-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:33:01.361 INFO:teuthology.orchestra.run.smithi037.stdout: python3-routes-2.5.1-5.el9.noarch 2023-12-03T11:33:01.361 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rsa-4.9-2.el9.noarch 2023-12-03T11:33:01.361 INFO:teuthology.orchestra.run.smithi037.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-12-03T11:33:01.361 INFO:teuthology.orchestra.run.smithi037.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-12-03T11:33:01.361 INFO:teuthology.orchestra.run.smithi037.stdout: python3-toml-0.10.2-6.el9.noarch 2023-12-03T11:33:01.361 INFO:teuthology.orchestra.run.smithi037.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-12-03T11:33:01.361 INFO:teuthology.orchestra.run.smithi037.stdout: python3-urllib3-1.26.5-4.el9.noarch 2023-12-03T11:33:01.361 INFO:teuthology.orchestra.run.smithi037.stdout: python3-webob-1.8.7-6.el9.noarch 2023-12-03T11:33:01.361 INFO:teuthology.orchestra.run.smithi037.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-12-03T11:33:01.361 INFO:teuthology.orchestra.run.smithi037.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-12-03T11:33:01.362 INFO:teuthology.orchestra.run.smithi037.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-12-03T11:33:01.362 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-fuse-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:33:01.362 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-mirror-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:33:01.362 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-nbd-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:33:01.362 INFO:teuthology.orchestra.run.smithi037.stdout: re2-1:20211101-3.el9.x86_64 2023-12-03T11:33:01.362 INFO:teuthology.orchestra.run.smithi037.stdout: s3cmd-2.3.0-4.el9.noarch 2023-12-03T11:33:01.362 INFO:teuthology.orchestra.run.smithi037.stdout: socat-1.7.4.1-5.el9.x86_64 2023-12-03T11:33:01.363 INFO:teuthology.orchestra.run.smithi037.stdout: thrift-0.15.0-2.el9.x86_64 2023-12-03T11:33:01.363 INFO:teuthology.orchestra.run.smithi037.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-12-03T11:33:01.363 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-03T11:33:01.363 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2023-12-03T11:33:01.668 DEBUG:teuthology.parallel:result is None 2023-12-03T11:33:02.447 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 122/122 2023-12-03T11:33:02.447 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:33:02.447 INFO:teuthology.orchestra.run.smithi003.stdout:Upgraded: 2023-12-03T11:33:02.447 INFO:teuthology.orchestra.run.smithi003.stdout: librados2-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:33:02.447 INFO:teuthology.orchestra.run.smithi003.stdout: librbd1-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:33:02.448 INFO:teuthology.orchestra.run.smithi003.stdout:Installed: 2023-12-03T11:33:02.448 INFO:teuthology.orchestra.run.smithi003.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-12-03T11:33:02.448 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:33:02.448 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-base-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:33:02.448 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-common-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:33:02.448 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-fuse-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:33:02.448 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-grafana-dashboards-2:18.0.0-7537.gbcbf278c.el9.noarch 2023-12-03T11:33:02.448 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-immutable-object-cache-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:33:02.448 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mds-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:33:02.448 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mgr-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:33:02.448 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mgr-cephadm-2:18.0.0-7537.gbcbf278c.el9.noarch 2023-12-03T11:33:02.448 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mgr-dashboard-2:18.0.0-7537.gbcbf278c.el9.noarch 2023-12-03T11:33:02.448 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mgr-diskprediction-local-2:18.0.0-7537.gbcbf278c.el9.noarch 2023-12-03T11:33:02.449 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mgr-modules-core-2:18.0.0-7537.gbcbf278c.el9.noarch 2023-12-03T11:33:02.449 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mgr-rook-2:18.0.0-7537.gbcbf278c.el9.noarch 2023-12-03T11:33:02.449 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mon-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:33:02.449 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-osd-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:33:02.449 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-prometheus-alerts-2:18.0.0-7537.gbcbf278c.el9.noarch 2023-12-03T11:33:02.449 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-radosgw-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:33:02.449 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-selinux-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:33:02.449 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-test-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:33:02.449 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-volume-2:18.0.0-7537.gbcbf278c.el9.noarch 2023-12-03T11:33:02.449 INFO:teuthology.orchestra.run.smithi003.stdout: cephadm-2:18.0.0-7537.gbcbf278c.el9.noarch 2023-12-03T11:33:02.449 INFO:teuthology.orchestra.run.smithi003.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-12-03T11:33:02.449 INFO:teuthology.orchestra.run.smithi003.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-12-03T11:33:02.449 INFO:teuthology.orchestra.run.smithi003.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-12-03T11:33:02.450 INFO:teuthology.orchestra.run.smithi003.stdout: fuse-2.9.9-15.el9.x86_64 2023-12-03T11:33:02.450 INFO:teuthology.orchestra.run.smithi003.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-12-03T11:33:02.450 INFO:teuthology.orchestra.run.smithi003.stdout: jq-1.6-16.el9.x86_64 2023-12-03T11:33:02.450 INFO:teuthology.orchestra.run.smithi003.stdout: libarrow-9.0.0-9.el9.x86_64 2023-12-03T11:33:02.450 INFO:teuthology.orchestra.run.smithi003.stdout: libarrow-doc-9.0.0-9.el9.noarch 2023-12-03T11:33:02.450 INFO:teuthology.orchestra.run.smithi003.stdout: libcephfs-devel-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:33:02.450 INFO:teuthology.orchestra.run.smithi003.stdout: libcephfs2-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:33:02.450 INFO:teuthology.orchestra.run.smithi003.stdout: libcephsqlite-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:33:02.450 INFO:teuthology.orchestra.run.smithi003.stdout: libgfortran-11.4.1-2.3.el9.x86_64 2023-12-03T11:33:02.450 INFO:teuthology.orchestra.run.smithi003.stdout: liboath-2.6.7-2.el9.x86_64 2023-12-03T11:33:02.450 INFO:teuthology.orchestra.run.smithi003.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-12-03T11:33:02.450 INFO:teuthology.orchestra.run.smithi003.stdout: libquadmath-11.4.1-2.3.el9.x86_64 2023-12-03T11:33:02.451 INFO:teuthology.orchestra.run.smithi003.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-12-03T11:33:02.451 INFO:teuthology.orchestra.run.smithi003.stdout: librados-devel-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:33:02.451 INFO:teuthology.orchestra.run.smithi003.stdout: libradosstriper1-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:33:02.451 INFO:teuthology.orchestra.run.smithi003.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-12-03T11:33:02.451 INFO:teuthology.orchestra.run.smithi003.stdout: librgw2-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:33:02.451 INFO:teuthology.orchestra.run.smithi003.stdout: libunwind-1.6.2-1.el9.x86_64 2023-12-03T11:33:02.451 INFO:teuthology.orchestra.run.smithi003.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-12-03T11:33:02.451 INFO:teuthology.orchestra.run.smithi003.stdout: lua-5.4.4-4.el9.x86_64 2023-12-03T11:33:02.451 INFO:teuthology.orchestra.run.smithi003.stdout: lua-devel-5.4.4-4.el9.x86_64 2023-12-03T11:33:02.451 INFO:teuthology.orchestra.run.smithi003.stdout: luarocks-3.9.2-1.el9.noarch 2023-12-03T11:33:02.451 INFO:teuthology.orchestra.run.smithi003.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-12-03T11:33:02.451 INFO:teuthology.orchestra.run.smithi003.stdout: openblas-0.3.21-2.el9.x86_64 2023-12-03T11:33:02.451 INFO:teuthology.orchestra.run.smithi003.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-12-03T11:33:02.452 INFO:teuthology.orchestra.run.smithi003.stdout: parquet-libs-9.0.0-9.el9.x86_64 2023-12-03T11:33:02.452 INFO:teuthology.orchestra.run.smithi003.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-12-03T11:33:02.452 INFO:teuthology.orchestra.run.smithi003.stdout: python3-babel-2.9.1-2.el9.noarch 2023-12-03T11:33:02.452 INFO:teuthology.orchestra.run.smithi003.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-12-03T11:33:02.452 INFO:teuthology.orchestra.run.smithi003.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-12-03T11:33:02.452 INFO:teuthology.orchestra.run.smithi003.stdout: python3-ceph-argparse-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:33:02.452 INFO:teuthology.orchestra.run.smithi003.stdout: python3-ceph-common-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:33:02.452 INFO:teuthology.orchestra.run.smithi003.stdout: python3-cephfs-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:33:02.452 INFO:teuthology.orchestra.run.smithi003.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-12-03T11:33:02.452 INFO:teuthology.orchestra.run.smithi003.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-12-03T11:33:02.452 INFO:teuthology.orchestra.run.smithi003.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-12-03T11:33:02.452 INFO:teuthology.orchestra.run.smithi003.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-12-03T11:33:02.453 INFO:teuthology.orchestra.run.smithi003.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-12-03T11:33:02.453 INFO:teuthology.orchestra.run.smithi003.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-12-03T11:33:02.453 INFO:teuthology.orchestra.run.smithi003.stdout: python3-google-auth-1:2.23.4-1.el9.noarch 2023-12-03T11:33:02.453 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-12-03T11:33:02.453 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-12-03T11:33:02.453 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-12-03T11:33:02.453 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-12-03T11:33:02.453 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-12-03T11:33:02.453 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-12-03T11:33:02.453 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-12-03T11:33:02.453 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-12-03T11:33:02.453 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-12-03T11:33:02.453 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-12-03T11:33:02.454 INFO:teuthology.orchestra.run.smithi003.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-12-03T11:33:02.454 INFO:teuthology.orchestra.run.smithi003.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-12-03T11:33:02.454 INFO:teuthology.orchestra.run.smithi003.stdout: python3-mako-1.1.4-6.el9.noarch 2023-12-03T11:33:02.454 INFO:teuthology.orchestra.run.smithi003.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-12-03T11:33:02.454 INFO:teuthology.orchestra.run.smithi003.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-12-03T11:33:02.454 INFO:teuthology.orchestra.run.smithi003.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-12-03T11:33:02.454 INFO:teuthology.orchestra.run.smithi003.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-12-03T11:33:02.454 INFO:teuthology.orchestra.run.smithi003.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-12-03T11:33:02.454 INFO:teuthology.orchestra.run.smithi003.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-12-03T11:33:02.454 INFO:teuthology.orchestra.run.smithi003.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-12-03T11:33:02.454 INFO:teuthology.orchestra.run.smithi003.stdout: python3-ply-3.11-14.el9.noarch 2023-12-03T11:33:02.454 INFO:teuthology.orchestra.run.smithi003.stdout: python3-portend-3.1.0-2.el9.noarch 2023-12-03T11:33:02.455 INFO:teuthology.orchestra.run.smithi003.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-12-03T11:33:02.455 INFO:teuthology.orchestra.run.smithi003.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-12-03T11:33:02.455 INFO:teuthology.orchestra.run.smithi003.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-12-03T11:33:02.455 INFO:teuthology.orchestra.run.smithi003.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-12-03T11:33:02.455 INFO:teuthology.orchestra.run.smithi003.stdout: python3-pycparser-2.20-6.el9.noarch 2023-12-03T11:33:02.455 INFO:teuthology.orchestra.run.smithi003.stdout: python3-pytz-2021.1-5.el9.noarch 2023-12-03T11:33:02.455 INFO:teuthology.orchestra.run.smithi003.stdout: python3-rados-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:33:02.455 INFO:teuthology.orchestra.run.smithi003.stdout: python3-rbd-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:33:02.455 INFO:teuthology.orchestra.run.smithi003.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-12-03T11:33:02.455 INFO:teuthology.orchestra.run.smithi003.stdout: python3-requests-2.25.1-7.el9.noarch 2023-12-03T11:33:02.455 INFO:teuthology.orchestra.run.smithi003.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-12-03T11:33:02.455 INFO:teuthology.orchestra.run.smithi003.stdout: python3-rgw-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:33:02.455 INFO:teuthology.orchestra.run.smithi003.stdout: python3-routes-2.5.1-5.el9.noarch 2023-12-03T11:33:02.456 INFO:teuthology.orchestra.run.smithi003.stdout: python3-rsa-4.9-2.el9.noarch 2023-12-03T11:33:02.456 INFO:teuthology.orchestra.run.smithi003.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-12-03T11:33:02.456 INFO:teuthology.orchestra.run.smithi003.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-12-03T11:33:02.456 INFO:teuthology.orchestra.run.smithi003.stdout: python3-toml-0.10.2-6.el9.noarch 2023-12-03T11:33:02.456 INFO:teuthology.orchestra.run.smithi003.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-12-03T11:33:02.456 INFO:teuthology.orchestra.run.smithi003.stdout: python3-urllib3-1.26.5-4.el9.noarch 2023-12-03T11:33:02.456 INFO:teuthology.orchestra.run.smithi003.stdout: python3-webob-1.8.7-6.el9.noarch 2023-12-03T11:33:02.456 INFO:teuthology.orchestra.run.smithi003.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-12-03T11:33:02.456 INFO:teuthology.orchestra.run.smithi003.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-12-03T11:33:02.456 INFO:teuthology.orchestra.run.smithi003.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-12-03T11:33:02.456 INFO:teuthology.orchestra.run.smithi003.stdout: rbd-fuse-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:33:02.456 INFO:teuthology.orchestra.run.smithi003.stdout: rbd-mirror-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:33:02.457 INFO:teuthology.orchestra.run.smithi003.stdout: rbd-nbd-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:33:02.457 INFO:teuthology.orchestra.run.smithi003.stdout: re2-1:20211101-3.el9.x86_64 2023-12-03T11:33:02.457 INFO:teuthology.orchestra.run.smithi003.stdout: s3cmd-2.3.0-4.el9.noarch 2023-12-03T11:33:02.457 INFO:teuthology.orchestra.run.smithi003.stdout: socat-1.7.4.1-5.el9.x86_64 2023-12-03T11:33:02.457 INFO:teuthology.orchestra.run.smithi003.stdout: thrift-0.15.0-2.el9.x86_64 2023-12-03T11:33:02.457 INFO:teuthology.orchestra.run.smithi003.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-12-03T11:33:02.457 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:33:02.457 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2023-12-03T11:33:02.797 DEBUG:teuthology.parallel:result is None 2023-12-03T11:33:02.798 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bcbf278cf395873c2a482f5a7b2345faf2160319 2023-12-03T11:33:02.960 DEBUG:teuthology.orchestra.run.smithi003:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-12-03T11:33:02.981 INFO:teuthology.orchestra.run.smithi003.stdout:18.0.0-7537.gbcbf278c.el9 2023-12-03T11:33:02.982 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-7537.gbcbf278c.el9 2023-12-03T11:33:02.982 INFO:teuthology.task.install:The correct ceph version 18.0.0-7537.gbcbf278c is installed. 2023-12-03T11:33:02.982 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bcbf278cf395873c2a482f5a7b2345faf2160319 2023-12-03T11:33:03.199 DEBUG:teuthology.orchestra.run.smithi037:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-12-03T11:33:03.225 INFO:teuthology.orchestra.run.smithi037.stdout:18.0.0-7537.gbcbf278c.el9 2023-12-03T11:33:03.225 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-7537.gbcbf278c.el9 2023-12-03T11:33:03.226 INFO:teuthology.task.install:The correct ceph version 18.0.0-7537.gbcbf278c is installed. 2023-12-03T11:33:03.226 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-12-03T11:33:03.226 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-12-03T11:33:03.226 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-03T11:33:03.259 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-12-03T11:33:03.259 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-03T11:33:03.304 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-12-03T11:33:03.304 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-12-03T11:33:03.304 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd of=/usr/bin/daemon-helper 2023-12-03T11:33:03.334 DEBUG:teuthology.orchestra.run.smithi003:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-03T11:33:03.405 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-12-03T11:33:03.405 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/usr/bin/daemon-helper 2023-12-03T11:33:03.441 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-03T11:33:03.516 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-12-03T11:33:03.516 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-12-03T11:33:03.516 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-03T11:33:03.547 DEBUG:teuthology.orchestra.run.smithi003:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-03T11:33:03.617 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-12-03T11:33:03.617 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-03T11:33:03.652 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-03T11:33:03.727 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-12-03T11:33:03.727 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-12-03T11:33:03.727 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd of=/usr/bin/stdin-killer 2023-12-03T11:33:03.757 DEBUG:teuthology.orchestra.run.smithi003:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-03T11:33:03.828 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-12-03T11:33:03.828 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/usr/bin/stdin-killer 2023-12-03T11:33:03.863 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-03T11:33:03.937 INFO:teuthology.run_tasks:Running task ceph... 2023-12-03T11:33:16.692 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-12-03T11:33:16.692 DEBUG:teuthology.orchestra.run.smithi003:> sudo chmod 777 /var/log/ceph 2023-12-03T11:33:16.695 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 777 /var/log/ceph 2023-12-03T11:33:16.733 INFO:tasks.ceph:Disabling ceph logrotate... 2023-12-03T11:33:16.734 DEBUG:teuthology.orchestra.run.smithi003:> sudo rm -f -- /etc/logrotate.d/ceph 2023-12-03T11:33:16.772 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -f -- /etc/logrotate.d/ceph 2023-12-03T11:33:16.809 INFO:tasks.ceph:Creating extra log directories... 2023-12-03T11:33:16.809 DEBUG:teuthology.orchestra.run.smithi003:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-12-03T11:33:16.847 DEBUG:teuthology.orchestra.run.smithi037:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-12-03T11:33:16.893 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-12-03T11:33:16.893 INFO:tasks.ceph:config {'conf': {'client': {'debug rgw': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw d3n l1 datacache persistent path': '/tmp/rgw_datacache/', 'rgw d3n l1 datacache size': 10737418240, 'rgw d3n l1 local datacache enabled': True, 'rgw enable ops log': True, 'rgw max chunk size': 4194304, 'rgw obj stripe size': 6291456, 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd heartbeat grace': 40, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon osd crush smoke test': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', '\\(OSD_SLOW_PING_TIME'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-12-03T11:33:16.893 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/alimasa-2023-12-03_11:04:43-rgw-wip-alimasa-multi-pubsub-etag-distro-default-smithi/7476143', 'branch': 'wip-alimasa-multi-pubsub-etag', 'description': 'rgw/verify/{0-install clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec s3tests-branch sharding$/{default} striping$/{stripe-greater-than-chunk} supported-random-distro$/{centos_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind}', 'email': None, 'first_in_suite': False, 'job_id': '7476143', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'alimasa-2023-12-03_11:04:43-rgw-wip-alimasa-multi-pubsub-etag-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 10}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-alimasa-multi-pubsub-etag'}, 'ceph': {'conf': {'client': {'debug rgw': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw d3n l1 datacache persistent path': '/tmp/rgw_datacache/', 'rgw d3n l1 datacache size': 10737418240, 'rgw d3n l1 local datacache enabled': True, 'rgw enable ops log': True, 'rgw max chunk size': 4194304, 'rgw obj stripe size': 6291456, 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd heartbeat grace': 40, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon osd crush smoke test': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', '\\(OSD_SLOW_PING_TIME'], 'sha1': 'bcbf278cf395873c2a482f5a7b2345faf2160319'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'bcbf278cf395873c2a482f5a7b2345faf2160319'}}, 'rgw': {'client.0': {'valgrind': ['--tool=memcheck', '--max-threads=1024']}, 'compression type': 'random', 'datacache': True, 'datacache_path': '/tmp/rgw_datacache', 'ec-data-pool': True, 'frontend': 'beast', 'storage classes': 'LUKEWARM, FROZEN'}, 's3tests': {'force-branch': 'ceph-master', 'slow_backend': True, 'storage classes': 'LUKEWARM, FROZEN'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-alimasa-multi-pubsub-etag', 'sha1': 'bcbf278cf395873c2a482f5a7b2345faf2160319'}}, 'owner': 'scheduled_alimasa@teuthology', 'priority': 100, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']], 'sha1': 'bcbf278cf395873c2a482f5a7b2345faf2160319', 'sleep_before_teardown': 0, 'suite': 'rgw', 'suite_branch': 'wip-alimasa-multi-pubsub-etag', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'bcbf278cf395873c2a482f5a7b2345faf2160319', 'targets': {'smithi003.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCNTFuByklhnpO0+opNoVMJTsTqSn0lWxlFcRGAzHsBX5iZ1bcebClYz+q1Ny3AYlc7WRevHLnClzc45Au3wuN4=', 'smithi037.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFi1UWnXJSWurirYT2qCAUvkVy86eskTFZhVGp9xDcuSkRMKlGPj+peKsXJXoy2wdtO04GB8auqIP2xRc8mQ1Ws='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_system_packages': {'deb': ['s3cmd'], 'rpm': ['s3cmd']}, 'flavor': 'default', 'sha1': 'bcbf278cf395873c2a482f5a7b2345faf2160319'}}, {'ceph': None}, {'openssl_keys': None}, {'rgw': {'client.0': None}}, {'tox': ['client.0']}, {'workunit': {'clients': {'client.0': ['rgw/run-datacache.sh']}, 'env': {'RGW_DATACACHE_PATH': '/tmp/rgw_datacache'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-bucket-check.sh']}}}, {'workunit': {'clients': {'client.0': ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'cls/test_cls_rgw_gc.sh', 'cls/test_cls_rgw_stats.sh', 'cls/test_cls_cmpomap.sh', 'cls/test_cls_2pc_queue.sh', 'rgw/test_rgw_gc_log.sh', 'rgw/test_rgw_obj.sh', 'rgw/test_librgw_file.sh']}}}, {'workunit': {'clients': {'client.0': ['rgw/test_rgw_s3_mp_reupload.sh']}}}, {'ragweed': {'client.0': {'default-branch': 'ceph-master', 'rgw_server': 'client.0', 'stages': 'prepare,check'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-reshard.sh']}}}, {'s3tests-java': {'client.0': {'force-branch': 'ceph-master', 'force-repo': 'https://github.com/ceph/java_s3tests.git'}}}, {'s3tests': {'client.0': {'rgw_server': 'client.0'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-versioning.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': 'f2de108beb0a6dde7f3e6c96039071828a1f6269', 'timestamp': '2023-12-03_11:04:43', 'tube': 'smithi', 'user': 'alimasa', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.232157'} 2023-12-03T11:33:16.894 DEBUG:teuthology.orchestra.run.smithi003:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-12-03T11:33:16.920 DEBUG:teuthology.orchestra.run.smithi037:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-12-03T11:33:16.938 DEBUG:teuthology.orchestra.run.smithi003:> sudo install -d -m0777 -- /var/run/ceph 2023-12-03T11:33:16.977 DEBUG:teuthology.orchestra.run.smithi037:> sudo install -d -m0777 -- /var/run/ceph 2023-12-03T11:33:17.010 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-12-03T11:33:17.010 DEBUG:teuthology.orchestra.run.smithi003:> dd if=/scratch_devs of=/dev/stdout 2023-12-03T11:33:17.065 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-12-03T11:33:17.065 DEBUG:teuthology.orchestra.run.smithi003:> stat /dev/vg_nvme/lv_1 2023-12-03T11:33:17.121 INFO:teuthology.orchestra.run.smithi003.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-12-03T11:33:17.121 INFO:teuthology.orchestra.run.smithi003.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-03T11:33:17.121 INFO:teuthology.orchestra.run.smithi003.stdout:Device: 5h/5d Inode: 662 Links: 1 2023-12-03T11:33:17.121 INFO:teuthology.orchestra.run.smithi003.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-03T11:33:17.121 INFO:teuthology.orchestra.run.smithi003.stdout:Context: system_u:object_r:device_t:s0 2023-12-03T11:33:17.121 INFO:teuthology.orchestra.run.smithi003.stdout:Access: 2023-12-03 11:32:56.508426645 +0000 2023-12-03T11:33:17.121 INFO:teuthology.orchestra.run.smithi003.stdout:Modify: 2023-12-03 11:31:00.495356727 +0000 2023-12-03T11:33:17.121 INFO:teuthology.orchestra.run.smithi003.stdout:Change: 2023-12-03 11:31:00.495356727 +0000 2023-12-03T11:33:17.121 INFO:teuthology.orchestra.run.smithi003.stdout: Birth: 2023-12-03 11:31:00.495356727 +0000 2023-12-03T11:33:17.122 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-12-03T11:33:17.191 INFO:teuthology.orchestra.run.smithi003.stderr:1+0 records in 2023-12-03T11:33:17.191 INFO:teuthology.orchestra.run.smithi003.stderr:1+0 records out 2023-12-03T11:33:17.192 INFO:teuthology.orchestra.run.smithi003.stderr:512 bytes copied, 0.000184125 s, 2.8 MB/s 2023-12-03T11:33:17.193 DEBUG:teuthology.orchestra.run.smithi003:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-12-03T11:33:17.249 DEBUG:teuthology.orchestra.run.smithi003:> stat /dev/vg_nvme/lv_2 2023-12-03T11:33:17.306 INFO:teuthology.orchestra.run.smithi003.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-12-03T11:33:17.306 INFO:teuthology.orchestra.run.smithi003.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-03T11:33:17.306 INFO:teuthology.orchestra.run.smithi003.stdout:Device: 5h/5d Inode: 684 Links: 1 2023-12-03T11:33:17.306 INFO:teuthology.orchestra.run.smithi003.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-03T11:33:17.306 INFO:teuthology.orchestra.run.smithi003.stdout:Context: system_u:object_r:device_t:s0 2023-12-03T11:33:17.306 INFO:teuthology.orchestra.run.smithi003.stdout:Access: 2023-12-03 11:32:56.508426645 +0000 2023-12-03T11:33:17.306 INFO:teuthology.orchestra.run.smithi003.stdout:Modify: 2023-12-03 11:31:01.011349387 +0000 2023-12-03T11:33:17.306 INFO:teuthology.orchestra.run.smithi003.stdout:Change: 2023-12-03 11:31:01.011349387 +0000 2023-12-03T11:33:17.306 INFO:teuthology.orchestra.run.smithi003.stdout: Birth: 2023-12-03 11:31:01.011349387 +0000 2023-12-03T11:33:17.307 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-12-03T11:33:17.375 INFO:teuthology.orchestra.run.smithi003.stderr:1+0 records in 2023-12-03T11:33:17.376 INFO:teuthology.orchestra.run.smithi003.stderr:1+0 records out 2023-12-03T11:33:17.376 INFO:teuthology.orchestra.run.smithi003.stderr:512 bytes copied, 0.000213986 s, 2.4 MB/s 2023-12-03T11:33:17.377 DEBUG:teuthology.orchestra.run.smithi003:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-12-03T11:33:17.433 DEBUG:teuthology.orchestra.run.smithi003:> stat /dev/vg_nvme/lv_3 2023-12-03T11:33:17.488 INFO:teuthology.orchestra.run.smithi003.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-12-03T11:33:17.488 INFO:teuthology.orchestra.run.smithi003.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-03T11:33:17.488 INFO:teuthology.orchestra.run.smithi003.stdout:Device: 5h/5d Inode: 700 Links: 1 2023-12-03T11:33:17.488 INFO:teuthology.orchestra.run.smithi003.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-03T11:33:17.488 INFO:teuthology.orchestra.run.smithi003.stdout:Context: system_u:object_r:device_t:s0 2023-12-03T11:33:17.488 INFO:teuthology.orchestra.run.smithi003.stdout:Access: 2023-12-03 11:32:56.509426631 +0000 2023-12-03T11:33:17.488 INFO:teuthology.orchestra.run.smithi003.stdout:Modify: 2023-12-03 11:31:01.526342061 +0000 2023-12-03T11:33:17.488 INFO:teuthology.orchestra.run.smithi003.stdout:Change: 2023-12-03 11:31:01.526342061 +0000 2023-12-03T11:33:17.488 INFO:teuthology.orchestra.run.smithi003.stdout: Birth: 2023-12-03 11:31:01.526342061 +0000 2023-12-03T11:33:17.489 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-12-03T11:33:17.557 INFO:teuthology.orchestra.run.smithi003.stderr:1+0 records in 2023-12-03T11:33:17.557 INFO:teuthology.orchestra.run.smithi003.stderr:1+0 records out 2023-12-03T11:33:17.557 INFO:teuthology.orchestra.run.smithi003.stderr:512 bytes copied, 0.000214321 s, 2.4 MB/s 2023-12-03T11:33:17.558 DEBUG:teuthology.orchestra.run.smithi003:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-12-03T11:33:17.615 DEBUG:teuthology.orchestra.run.smithi003:> stat /dev/vg_nvme/lv_4 2023-12-03T11:33:17.670 INFO:teuthology.orchestra.run.smithi003.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-12-03T11:33:17.670 INFO:teuthology.orchestra.run.smithi003.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-03T11:33:17.670 INFO:teuthology.orchestra.run.smithi003.stdout:Device: 5h/5d Inode: 721 Links: 1 2023-12-03T11:33:17.670 INFO:teuthology.orchestra.run.smithi003.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-03T11:33:17.670 INFO:teuthology.orchestra.run.smithi003.stdout:Context: system_u:object_r:device_t:s0 2023-12-03T11:33:17.671 INFO:teuthology.orchestra.run.smithi003.stdout:Access: 2023-12-03 11:32:56.509426631 +0000 2023-12-03T11:33:17.671 INFO:teuthology.orchestra.run.smithi003.stdout:Modify: 2023-12-03 11:31:02.030334891 +0000 2023-12-03T11:33:17.671 INFO:teuthology.orchestra.run.smithi003.stdout:Change: 2023-12-03 11:31:02.030334891 +0000 2023-12-03T11:33:17.671 INFO:teuthology.orchestra.run.smithi003.stdout: Birth: 2023-12-03 11:31:02.030334891 +0000 2023-12-03T11:33:17.671 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-12-03T11:33:17.739 INFO:teuthology.orchestra.run.smithi003.stderr:1+0 records in 2023-12-03T11:33:17.739 INFO:teuthology.orchestra.run.smithi003.stderr:1+0 records out 2023-12-03T11:33:17.739 INFO:teuthology.orchestra.run.smithi003.stderr:512 bytes copied, 0.000230179 s, 2.2 MB/s 2023-12-03T11:33:17.741 DEBUG:teuthology.orchestra.run.smithi003:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-12-03T11:33:17.797 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-03T11:33:17.797 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-12-03T11:33:17.797 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/scratch_devs of=/dev/stdout 2023-12-03T11:33:17.816 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-12-03T11:33:17.816 DEBUG:teuthology.orchestra.run.smithi037:> stat /dev/vg_nvme/lv_1 2023-12-03T11:33:17.875 INFO:teuthology.orchestra.run.smithi037.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-12-03T11:33:17.875 INFO:teuthology.orchestra.run.smithi037.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-03T11:33:17.876 INFO:teuthology.orchestra.run.smithi037.stdout:Device: 5h/5d Inode: 663 Links: 1 2023-12-03T11:33:17.876 INFO:teuthology.orchestra.run.smithi037.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-03T11:33:17.876 INFO:teuthology.orchestra.run.smithi037.stdout:Context: system_u:object_r:device_t:s0 2023-12-03T11:33:17.876 INFO:teuthology.orchestra.run.smithi037.stdout:Access: 2023-12-03 11:32:55.592022089 +0000 2023-12-03T11:33:17.876 INFO:teuthology.orchestra.run.smithi037.stdout:Modify: 2023-12-03 11:31:00.493788099 +0000 2023-12-03T11:33:17.876 INFO:teuthology.orchestra.run.smithi037.stdout:Change: 2023-12-03 11:31:00.493788099 +0000 2023-12-03T11:33:17.876 INFO:teuthology.orchestra.run.smithi037.stdout: Birth: 2023-12-03 11:31:00.493788099 +0000 2023-12-03T11:33:17.877 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-12-03T11:33:17.949 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records in 2023-12-03T11:33:17.949 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records out 2023-12-03T11:33:17.949 INFO:teuthology.orchestra.run.smithi037.stderr:512 bytes copied, 0.000206482 s, 2.5 MB/s 2023-12-03T11:33:17.950 DEBUG:teuthology.orchestra.run.smithi037:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-12-03T11:33:18.008 DEBUG:teuthology.orchestra.run.smithi037:> stat /dev/vg_nvme/lv_2 2023-12-03T11:33:18.065 INFO:teuthology.orchestra.run.smithi037.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-12-03T11:33:18.065 INFO:teuthology.orchestra.run.smithi037.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-03T11:33:18.065 INFO:teuthology.orchestra.run.smithi037.stdout:Device: 5h/5d Inode: 684 Links: 1 2023-12-03T11:33:18.065 INFO:teuthology.orchestra.run.smithi037.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-03T11:33:18.065 INFO:teuthology.orchestra.run.smithi037.stdout:Context: system_u:object_r:device_t:s0 2023-12-03T11:33:18.065 INFO:teuthology.orchestra.run.smithi037.stdout:Access: 2023-12-03 11:32:55.593022076 +0000 2023-12-03T11:33:18.066 INFO:teuthology.orchestra.run.smithi037.stdout:Modify: 2023-12-03 11:31:00.990781697 +0000 2023-12-03T11:33:18.066 INFO:teuthology.orchestra.run.smithi037.stdout:Change: 2023-12-03 11:31:00.990781697 +0000 2023-12-03T11:33:18.066 INFO:teuthology.orchestra.run.smithi037.stdout: Birth: 2023-12-03 11:31:00.990781697 +0000 2023-12-03T11:33:18.066 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-12-03T11:33:18.136 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records in 2023-12-03T11:33:18.136 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records out 2023-12-03T11:33:18.136 INFO:teuthology.orchestra.run.smithi037.stderr:512 bytes copied, 0.000220619 s, 2.3 MB/s 2023-12-03T11:33:18.137 DEBUG:teuthology.orchestra.run.smithi037:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-12-03T11:33:18.194 DEBUG:teuthology.orchestra.run.smithi037:> stat /dev/vg_nvme/lv_3 2023-12-03T11:33:18.251 INFO:teuthology.orchestra.run.smithi037.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-12-03T11:33:18.251 INFO:teuthology.orchestra.run.smithi037.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-03T11:33:18.252 INFO:teuthology.orchestra.run.smithi037.stdout:Device: 5h/5d Inode: 700 Links: 1 2023-12-03T11:33:18.252 INFO:teuthology.orchestra.run.smithi037.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-03T11:33:18.252 INFO:teuthology.orchestra.run.smithi037.stdout:Context: system_u:object_r:device_t:s0 2023-12-03T11:33:18.252 INFO:teuthology.orchestra.run.smithi037.stdout:Access: 2023-12-03 11:32:55.593022076 +0000 2023-12-03T11:33:18.252 INFO:teuthology.orchestra.run.smithi037.stdout:Modify: 2023-12-03 11:31:01.491775243 +0000 2023-12-03T11:33:18.253 INFO:teuthology.orchestra.run.smithi037.stdout:Change: 2023-12-03 11:31:01.491775243 +0000 2023-12-03T11:33:18.253 INFO:teuthology.orchestra.run.smithi037.stdout: Birth: 2023-12-03 11:31:01.491775243 +0000 2023-12-03T11:33:18.253 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-12-03T11:33:18.322 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records in 2023-12-03T11:33:18.322 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records out 2023-12-03T11:33:18.323 INFO:teuthology.orchestra.run.smithi037.stderr:512 bytes copied, 0.000203282 s, 2.5 MB/s 2023-12-03T11:33:18.323 DEBUG:teuthology.orchestra.run.smithi037:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-12-03T11:33:18.381 DEBUG:teuthology.orchestra.run.smithi037:> stat /dev/vg_nvme/lv_4 2023-12-03T11:33:18.437 INFO:teuthology.orchestra.run.smithi037.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-12-03T11:33:18.438 INFO:teuthology.orchestra.run.smithi037.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-03T11:33:18.438 INFO:teuthology.orchestra.run.smithi037.stdout:Device: 5h/5d Inode: 720 Links: 1 2023-12-03T11:33:18.438 INFO:teuthology.orchestra.run.smithi037.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-03T11:33:18.438 INFO:teuthology.orchestra.run.smithi037.stdout:Context: system_u:object_r:device_t:s0 2023-12-03T11:33:18.438 INFO:teuthology.orchestra.run.smithi037.stdout:Access: 2023-12-03 11:32:55.594022063 +0000 2023-12-03T11:33:18.438 INFO:teuthology.orchestra.run.smithi037.stdout:Modify: 2023-12-03 11:31:01.996768738 +0000 2023-12-03T11:33:18.438 INFO:teuthology.orchestra.run.smithi037.stdout:Change: 2023-12-03 11:31:01.996768738 +0000 2023-12-03T11:33:18.439 INFO:teuthology.orchestra.run.smithi037.stdout: Birth: 2023-12-03 11:31:01.996768738 +0000 2023-12-03T11:33:18.439 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-12-03T11:33:18.507 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records in 2023-12-03T11:33:18.508 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records out 2023-12-03T11:33:18.508 INFO:teuthology.orchestra.run.smithi037.stderr:512 bytes copied, 0.000182783 s, 2.8 MB/s 2023-12-03T11:33:18.510 DEBUG:teuthology.orchestra.run.smithi037:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-12-03T11:33:18.566 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-03T11:33:18.566 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi003.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi037.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-12-03T11:33:18.566 INFO:tasks.ceph:Generating config... 2023-12-03T11:33:18.568 INFO:tasks.ceph:[client] debug rgw = 20 2023-12-03T11:33:18.568 INFO:tasks.ceph:[client] rgw bucket counters cache = True 2023-12-03T11:33:18.568 INFO:tasks.ceph:[client] rgw crypt require ssl = False 2023-12-03T11:33:18.568 INFO:tasks.ceph:[client] rgw crypt s3 kms backend = testing 2023-12-03T11:33:18.568 INFO:tasks.ceph:[client] rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2023-12-03T11:33:18.568 INFO:tasks.ceph:[client] rgw d3n l1 datacache persistent path = /tmp/rgw_datacache/ 2023-12-03T11:33:18.568 INFO:tasks.ceph:[client] rgw d3n l1 datacache size = 10737418240 2023-12-03T11:33:18.568 INFO:tasks.ceph:[client] rgw d3n l1 local datacache enabled = True 2023-12-03T11:33:18.568 INFO:tasks.ceph:[client] rgw enable ops log = True 2023-12-03T11:33:18.569 INFO:tasks.ceph:[client] rgw max chunk size = 4194304 2023-12-03T11:33:18.569 INFO:tasks.ceph:[client] rgw obj stripe size = 6291456 2023-12-03T11:33:18.569 INFO:tasks.ceph:[client] rgw torrent flag = True 2023-12-03T11:33:18.569 INFO:tasks.ceph:[client] rgw user counters cache = True 2023-12-03T11:33:18.569 INFO:tasks.ceph:[client] setgroup = ceph 2023-12-03T11:33:18.569 INFO:tasks.ceph:[client] setuser = ceph 2023-12-03T11:33:18.569 INFO:tasks.ceph:[global] mon client directed command retry = 5 2023-12-03T11:33:18.569 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2023-12-03T11:33:18.569 INFO:tasks.ceph:[global] osd heartbeat grace = 40 2023-12-03T11:33:18.569 INFO:tasks.ceph:[global] osd_max_pg_log_entries = 10 2023-12-03T11:33:18.569 INFO:tasks.ceph:[global] osd_min_pg_log_entries = 10 2023-12-03T11:33:18.569 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-12-03T11:33:18.570 INFO:tasks.ceph:[mgr] debug ms = 1 2023-12-03T11:33:18.570 INFO:tasks.ceph:[mon] debug mon = 20 2023-12-03T11:33:18.570 INFO:tasks.ceph:[mon] debug ms = 1 2023-12-03T11:33:18.570 INFO:tasks.ceph:[mon] debug paxos = 20 2023-12-03T11:33:18.570 INFO:tasks.ceph:[mon] mon osd crush smoke test = False 2023-12-03T11:33:18.570 INFO:tasks.ceph:[osd] bdev async discard = True 2023-12-03T11:33:18.570 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-12-03T11:33:18.570 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-12-03T11:33:18.570 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-12-03T11:33:18.570 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-12-03T11:33:18.570 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-12-03T11:33:18.570 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-12-03T11:33:18.571 INFO:tasks.ceph:[osd] debug ms = 1 2023-12-03T11:33:18.571 INFO:tasks.ceph:[osd] debug osd = 20 2023-12-03T11:33:18.571 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-12-03T11:33:18.571 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-12-03T11:33:18.571 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-12-03T11:33:18.571 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-12-03T11:33:18.571 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-12-03T11:33:18.571 INFO:tasks.ceph:[osd] osd fast shutdown = False 2023-12-03T11:33:18.571 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-12-03T11:33:18.571 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2023-12-03T11:33:18.571 INFO:tasks.ceph:Setting up mon.a... 2023-12-03T11:33:18.572 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-12-03T11:33:18.634 INFO:teuthology.orchestra.run.smithi003.stdout:creating /etc/ceph/ceph.keyring 2023-12-03T11:33:18.637 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-12-03T11:33:18.688 DEBUG:teuthology.orchestra.run.smithi003:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-03T11:33:18.720 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.3'), ('mon.c', '[v2:172.21.15.3:3301,v1:172.21.15.3:6790]'), ('mon.b', '172.21.15.37')] 2023-12-03T11:33:18.721 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.3,[v2:172.21.15.3:3301,v1:172.21.15.3:6790],172.21.15.37', 'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd heartbeat grace': 40, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon osd crush smoke test': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': True, 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug rgw': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw d3n l1 datacache persistent path': '/tmp/rgw_datacache/', 'rgw d3n l1 datacache size': 10737418240, 'rgw d3n l1 local datacache enabled': True, 'rgw max chunk size': 4194304, 'rgw obj stripe size': 6291456, 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}} 2023-12-03T11:33:18.723 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-12-03T11:33:18.723 DEBUG:teuthology.orchestra.run.smithi003:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-12-03T11:33:18.776 DEBUG:teuthology.orchestra.run.smithi003:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.3 --addv c '[v2:172.21.15.3:3301,v1:172.21.15.3:6790]' --add b 172.21.15.37 --print /home/ubuntu/cephtest/ceph.monmap 2023-12-03T11:33:18.862 INFO:teuthology.orchestra.run.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:33:18.862 INFO:teuthology.orchestra.run.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:33:18.863 INFO:teuthology.orchestra.run.smithi003.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-12-03T11:33:18.863 INFO:teuthology.orchestra.run.smithi003.stdout:monmaptool: generated fsid 296556de-a4fc-4095-9b6d-0fe813c2865c 2023-12-03T11:33:18.863 INFO:teuthology.orchestra.run.smithi003.stdout:setting min_mon_release = pacific 2023-12-03T11:33:18.863 INFO:teuthology.orchestra.run.smithi003.stdout:epoch 0 2023-12-03T11:33:18.863 INFO:teuthology.orchestra.run.smithi003.stdout:fsid 296556de-a4fc-4095-9b6d-0fe813c2865c 2023-12-03T11:33:18.863 INFO:teuthology.orchestra.run.smithi003.stdout:last_changed 2023-12-03T11:33:18.862564+0000 2023-12-03T11:33:18.864 INFO:teuthology.orchestra.run.smithi003.stdout:created 2023-12-03T11:33:18.862564+0000 2023-12-03T11:33:18.864 INFO:teuthology.orchestra.run.smithi003.stdout:min_mon_release 16 (pacific) 2023-12-03T11:33:18.864 INFO:teuthology.orchestra.run.smithi003.stdout:election_strategy: 1 2023-12-03T11:33:18.864 INFO:teuthology.orchestra.run.smithi003.stdout:0: [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] mon.a 2023-12-03T11:33:18.865 INFO:teuthology.orchestra.run.smithi003.stdout:1: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.b 2023-12-03T11:33:18.865 INFO:teuthology.orchestra.run.smithi003.stdout:2: [v2:172.21.15.3:3301/0,v1:172.21.15.3:6790/0] mon.c 2023-12-03T11:33:18.865 INFO:teuthology.orchestra.run.smithi003.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-12-03T11:33:18.866 DEBUG:teuthology.orchestra.run.smithi003:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-12-03T11:33:18.882 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 296556de-a4fc-4095-9b6d-0fe813c2865c... 2023-12-03T11:33:18.883 DEBUG:teuthology.orchestra.run.smithi003:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-12-03T11:33:18.924 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-12-03T11:33:18.983 INFO:teuthology.orchestra.run.smithi003.stdout:[global] 2023-12-03T11:33:18.983 INFO:teuthology.orchestra.run.smithi003.stdout: chdir = "" 2023-12-03T11:33:18.983 INFO:teuthology.orchestra.run.smithi003.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-12-03T11:33:18.983 INFO:teuthology.orchestra.run.smithi003.stdout: auth supported = cephx 2023-12-03T11:33:18.983 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:33:18.983 INFO:teuthology.orchestra.run.smithi003.stdout: filestore xattr use omap = true 2023-12-03T11:33:18.983 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:33:18.983 INFO:teuthology.orchestra.run.smithi003.stdout: mon clock drift allowed = 1.000 2023-12-03T11:33:18.983 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:33:18.984 INFO:teuthology.orchestra.run.smithi003.stdout: osd crush chooseleaf type = 0 2023-12-03T11:33:18.984 INFO:teuthology.orchestra.run.smithi003.stdout: auth debug = true 2023-12-03T11:33:18.984 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:33:18.984 INFO:teuthology.orchestra.run.smithi003.stdout: ms die on old message = true 2023-12-03T11:33:18.984 INFO:teuthology.orchestra.run.smithi003.stdout: ms die on bug = true 2023-12-03T11:33:18.984 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:33:18.984 INFO:teuthology.orchestra.run.smithi003.stdout: mon max pg per osd = 10000 # >= luminous 2023-12-03T11:33:18.984 INFO:teuthology.orchestra.run.smithi003.stdout: mon pg warn max object skew = 0 2023-12-03T11:33:18.984 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:33:18.985 INFO:teuthology.orchestra.run.smithi003.stdout: # disable pg_autoscaler by default for new pools 2023-12-03T11:33:18.985 INFO:teuthology.orchestra.run.smithi003.stdout: osd_pool_default_pg_autoscale_mode = off 2023-12-03T11:33:18.985 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:33:18.985 INFO:teuthology.orchestra.run.smithi003.stdout: osd pool default size = 2 2023-12-03T11:33:18.985 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:33:18.985 INFO:teuthology.orchestra.run.smithi003.stdout: mon osd allow primary affinity = true 2023-12-03T11:33:18.985 INFO:teuthology.orchestra.run.smithi003.stdout: mon osd allow pg remap = true 2023-12-03T11:33:18.985 INFO:teuthology.orchestra.run.smithi003.stdout: mon warn on legacy crush tunables = false 2023-12-03T11:33:18.985 INFO:teuthology.orchestra.run.smithi003.stdout: mon warn on crush straw calc version zero = false 2023-12-03T11:33:18.985 INFO:teuthology.orchestra.run.smithi003.stdout: mon warn on no sortbitwise = false 2023-12-03T11:33:18.986 INFO:teuthology.orchestra.run.smithi003.stdout: mon warn on osd down out interval zero = false 2023-12-03T11:33:18.986 INFO:teuthology.orchestra.run.smithi003.stdout: mon warn on too few osds = false 2023-12-03T11:33:18.986 INFO:teuthology.orchestra.run.smithi003.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-12-03T11:33:18.986 INFO:teuthology.orchestra.run.smithi003.stdout: mon_warn_on_pool_no_redundancy = false 2023-12-03T11:33:18.986 INFO:teuthology.orchestra.run.smithi003.stdout: mon_allow_pool_size_one = true 2023-12-03T11:33:18.986 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:33:18.986 INFO:teuthology.orchestra.run.smithi003.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-12-03T11:33:18.986 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:33:18.986 INFO:teuthology.orchestra.run.smithi003.stdout: osd default data pool replay window = 5 2023-12-03T11:33:18.987 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:33:18.987 INFO:teuthology.orchestra.run.smithi003.stdout: mon allow pool delete = true 2023-12-03T11:33:18.987 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:33:18.987 INFO:teuthology.orchestra.run.smithi003.stdout: mon cluster log file level = debug 2023-12-03T11:33:18.987 INFO:teuthology.orchestra.run.smithi003.stdout: debug asserts on shutdown = true 2023-12-03T11:33:18.987 INFO:teuthology.orchestra.run.smithi003.stdout: mon health detail to clog = false 2023-12-03T11:33:18.987 INFO:teuthology.orchestra.run.smithi003.stdout: mon host = "172.21.15.3,[v2:172.21.15.3:3301,v1:172.21.15.3:6790],172.21.15.37" 2023-12-03T11:33:18.987 INFO:teuthology.orchestra.run.smithi003.stdout: mon client directed command retry = 5 2023-12-03T11:33:18.987 INFO:teuthology.orchestra.run.smithi003.stdout: ms inject socket failures = 5000 2023-12-03T11:33:18.988 INFO:teuthology.orchestra.run.smithi003.stdout: osd heartbeat grace = 40 2023-12-03T11:33:18.988 INFO:teuthology.orchestra.run.smithi003.stdout: osd_max_pg_log_entries = 10 2023-12-03T11:33:18.988 INFO:teuthology.orchestra.run.smithi003.stdout: osd_min_pg_log_entries = 10 2023-12-03T11:33:18.988 INFO:teuthology.orchestra.run.smithi003.stdout: fsid = 296556de-a4fc-4095-9b6d-0fe813c2865c 2023-12-03T11:33:18.988 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:33:18.988 INFO:teuthology.orchestra.run.smithi003.stdout:[osd] 2023-12-03T11:33:18.988 INFO:teuthology.orchestra.run.smithi003.stdout: osd journal size = 100 2023-12-03T11:33:18.988 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:33:18.988 INFO:teuthology.orchestra.run.smithi003.stdout: osd scrub load threshold = 5.0 2023-12-03T11:33:18.989 INFO:teuthology.orchestra.run.smithi003.stdout: osd scrub max interval = 600 2023-12-03T11:33:18.989 INFO:teuthology.orchestra.run.smithi003.stdout: osd mclock profile = high_recovery_ops 2023-12-03T11:33:18.989 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:33:18.989 INFO:teuthology.orchestra.run.smithi003.stdout: osd recover clone overlap = true 2023-12-03T11:33:18.989 INFO:teuthology.orchestra.run.smithi003.stdout: osd recovery max chunk = 1048576 2023-12-03T11:33:18.989 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:33:18.989 INFO:teuthology.orchestra.run.smithi003.stdout: osd debug shutdown = true 2023-12-03T11:33:18.989 INFO:teuthology.orchestra.run.smithi003.stdout: osd debug op order = true 2023-12-03T11:33:18.990 INFO:teuthology.orchestra.run.smithi003.stdout: osd debug verify stray on activate = true 2023-12-03T11:33:18.990 INFO:teuthology.orchestra.run.smithi003.stdout: osd debug trim objects = true 2023-12-03T11:33:18.990 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:33:18.990 INFO:teuthology.orchestra.run.smithi003.stdout: osd open classes on start = true 2023-12-03T11:33:18.990 INFO:teuthology.orchestra.run.smithi003.stdout: osd debug pg log writeout = true 2023-12-03T11:33:18.990 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:33:18.990 INFO:teuthology.orchestra.run.smithi003.stdout: osd deep scrub update digest min age = 30 2023-12-03T11:33:18.990 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:33:18.990 INFO:teuthology.orchestra.run.smithi003.stdout: osd map max advance = 10 2023-12-03T11:33:18.991 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:33:18.991 INFO:teuthology.orchestra.run.smithi003.stdout: journal zero on create = true 2023-12-03T11:33:18.991 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:33:18.991 INFO:teuthology.orchestra.run.smithi003.stdout: filestore ondisk finisher threads = 3 2023-12-03T11:33:18.991 INFO:teuthology.orchestra.run.smithi003.stdout: filestore apply finisher threads = 3 2023-12-03T11:33:18.991 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:33:18.991 INFO:teuthology.orchestra.run.smithi003.stdout: bdev debug aio = true 2023-12-03T11:33:18.992 INFO:teuthology.orchestra.run.smithi003.stdout: osd debug misdirected ops = true 2023-12-03T11:33:18.992 INFO:teuthology.orchestra.run.smithi003.stdout: bdev async discard = True 2023-12-03T11:33:18.992 INFO:teuthology.orchestra.run.smithi003.stdout: bdev enable discard = True 2023-12-03T11:33:18.992 INFO:teuthology.orchestra.run.smithi003.stdout: bluestore allocator = bitmap 2023-12-03T11:33:18.992 INFO:teuthology.orchestra.run.smithi003.stdout: bluestore block size = 96636764160 2023-12-03T11:33:18.992 INFO:teuthology.orchestra.run.smithi003.stdout: bluestore fsck on mount = True 2023-12-03T11:33:18.993 INFO:teuthology.orchestra.run.smithi003.stdout: debug bluefs = 1/20 2023-12-03T11:33:18.993 INFO:teuthology.orchestra.run.smithi003.stdout: debug bluestore = 1/20 2023-12-03T11:33:18.993 INFO:teuthology.orchestra.run.smithi003.stdout: debug ms = 1 2023-12-03T11:33:18.993 INFO:teuthology.orchestra.run.smithi003.stdout: debug osd = 20 2023-12-03T11:33:18.993 INFO:teuthology.orchestra.run.smithi003.stdout: debug rocksdb = 4/10 2023-12-03T11:33:18.993 INFO:teuthology.orchestra.run.smithi003.stdout: mon osd backfillfull_ratio = 0.85 2023-12-03T11:33:18.993 INFO:teuthology.orchestra.run.smithi003.stdout: mon osd full ratio = 0.9 2023-12-03T11:33:18.993 INFO:teuthology.orchestra.run.smithi003.stdout: mon osd nearfull ratio = 0.8 2023-12-03T11:33:18.994 INFO:teuthology.orchestra.run.smithi003.stdout: osd failsafe full ratio = 0.95 2023-12-03T11:33:18.994 INFO:teuthology.orchestra.run.smithi003.stdout: osd fast shutdown = False 2023-12-03T11:33:18.994 INFO:teuthology.orchestra.run.smithi003.stdout: osd objectstore = bluestore 2023-12-03T11:33:18.994 INFO:teuthology.orchestra.run.smithi003.stdout: osd shutdown pgref assert = True 2023-12-03T11:33:18.994 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:33:18.994 INFO:teuthology.orchestra.run.smithi003.stdout:[mgr] 2023-12-03T11:33:18.994 INFO:teuthology.orchestra.run.smithi003.stdout: debug ms = 1 2023-12-03T11:33:18.995 INFO:teuthology.orchestra.run.smithi003.stdout: debug mgr = 20 2023-12-03T11:33:18.995 INFO:teuthology.orchestra.run.smithi003.stdout: debug mon = 20 2023-12-03T11:33:18.995 INFO:teuthology.orchestra.run.smithi003.stdout: debug auth = 20 2023-12-03T11:33:18.995 INFO:teuthology.orchestra.run.smithi003.stdout: mon reweight min pgs per osd = 4 2023-12-03T11:33:18.995 INFO:teuthology.orchestra.run.smithi003.stdout: mon reweight min bytes per osd = 10 2023-12-03T11:33:18.995 INFO:teuthology.orchestra.run.smithi003.stdout: mgr/telemetry/nag = false 2023-12-03T11:33:18.995 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:33:18.996 INFO:teuthology.orchestra.run.smithi003.stdout:[mon] 2023-12-03T11:33:18.996 INFO:teuthology.orchestra.run.smithi003.stdout: debug ms = 1 2023-12-03T11:33:18.996 INFO:teuthology.orchestra.run.smithi003.stdout: debug mon = 20 2023-12-03T11:33:18.996 INFO:teuthology.orchestra.run.smithi003.stdout: debug paxos = 20 2023-12-03T11:33:18.996 INFO:teuthology.orchestra.run.smithi003.stdout: debug auth = 20 2023-12-03T11:33:18.996 INFO:teuthology.orchestra.run.smithi003.stdout: mon data avail warn = 5 2023-12-03T11:33:18.996 INFO:teuthology.orchestra.run.smithi003.stdout: mon mgr mkfs grace = 240 2023-12-03T11:33:18.997 INFO:teuthology.orchestra.run.smithi003.stdout: mon reweight min pgs per osd = 4 2023-12-03T11:33:18.997 INFO:teuthology.orchestra.run.smithi003.stdout: mon osd reporter subtree level = osd 2023-12-03T11:33:18.997 INFO:teuthology.orchestra.run.smithi003.stdout: mon osd prime pg temp = true 2023-12-03T11:33:18.997 INFO:teuthology.orchestra.run.smithi003.stdout: mon reweight min bytes per osd = 10 2023-12-03T11:33:18.997 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:33:18.997 INFO:teuthology.orchestra.run.smithi003.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-12-03T11:33:18.998 INFO:teuthology.orchestra.run.smithi003.stdout: auth mon ticket ttl = 660 # 11m 2023-12-03T11:33:18.998 INFO:teuthology.orchestra.run.smithi003.stdout: auth service ticket ttl = 240 # 4m 2023-12-03T11:33:18.998 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:33:18.998 INFO:teuthology.orchestra.run.smithi003.stdout: # don't complain about insecure global_id in the test suite 2023-12-03T11:33:18.998 INFO:teuthology.orchestra.run.smithi003.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-12-03T11:33:18.998 INFO:teuthology.orchestra.run.smithi003.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-12-03T11:33:18.999 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:33:18.999 INFO:teuthology.orchestra.run.smithi003.stdout: # 1m isn't quite enough 2023-12-03T11:33:18.999 INFO:teuthology.orchestra.run.smithi003.stdout: mon_down_mkfs_grace = 2m 2023-12-03T11:33:18.999 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:33:18.999 INFO:teuthology.orchestra.run.smithi003.stdout: mon_warn_on_filestore_osds = false 2023-12-03T11:33:18.999 INFO:teuthology.orchestra.run.smithi003.stdout: mon osd crush smoke test = False 2023-12-03T11:33:19.000 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:33:19.000 INFO:teuthology.orchestra.run.smithi003.stdout:[client] 2023-12-03T11:33:19.000 INFO:teuthology.orchestra.run.smithi003.stdout: rgw cache enabled = true 2023-12-03T11:33:19.000 INFO:teuthology.orchestra.run.smithi003.stdout: rgw enable ops log = True 2023-12-03T11:33:19.000 INFO:teuthology.orchestra.run.smithi003.stdout: rgw enable usage log = true 2023-12-03T11:33:19.000 INFO:teuthology.orchestra.run.smithi003.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-12-03T11:33:19.001 INFO:teuthology.orchestra.run.smithi003.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-12-03T11:33:19.001 INFO:teuthology.orchestra.run.smithi003.stdout: debug rgw = 20 2023-12-03T11:33:19.001 INFO:teuthology.orchestra.run.smithi003.stdout: rgw bucket counters cache = True 2023-12-03T11:33:19.001 INFO:teuthology.orchestra.run.smithi003.stdout: rgw crypt require ssl = False 2023-12-03T11:33:19.001 INFO:teuthology.orchestra.run.smithi003.stdout: rgw crypt s3 kms backend = testing 2023-12-03T11:33:19.001 INFO:teuthology.orchestra.run.smithi003.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2023-12-03T11:33:19.002 INFO:teuthology.orchestra.run.smithi003.stdout: rgw d3n l1 datacache persistent path = /tmp/rgw_datacache/ 2023-12-03T11:33:19.002 INFO:teuthology.orchestra.run.smithi003.stdout: rgw d3n l1 datacache size = 10737418240 2023-12-03T11:33:19.002 INFO:teuthology.orchestra.run.smithi003.stdout: rgw d3n l1 local datacache enabled = True 2023-12-03T11:33:19.002 INFO:teuthology.orchestra.run.smithi003.stdout: rgw max chunk size = 4194304 2023-12-03T11:33:19.002 INFO:teuthology.orchestra.run.smithi003.stdout: rgw obj stripe size = 6291456 2023-12-03T11:33:19.002 INFO:teuthology.orchestra.run.smithi003.stdout: rgw torrent flag = True 2023-12-03T11:33:19.003 INFO:teuthology.orchestra.run.smithi003.stdout: rgw user counters cache = True 2023-12-03T11:33:19.003 INFO:teuthology.orchestra.run.smithi003.stdout: setgroup = ceph 2023-12-03T11:33:19.003 INFO:teuthology.orchestra.run.smithi003.stdout: setuser = ceph 2023-12-03T11:33:19.003 INFO:teuthology.orchestra.run.smithi003.stdout:[mon.a] 2023-12-03T11:33:19.003 INFO:teuthology.orchestra.run.smithi003.stdout:[mon.c] 2023-12-03T11:33:19.003 INFO:teuthology.orchestra.run.smithi003.stdout:[mon.b] 2023-12-03T11:33:19.005 INFO:teuthology.orchestra.run.smithi037.stdout:[global] 2023-12-03T11:33:19.005 INFO:teuthology.orchestra.run.smithi037.stdout: chdir = "" 2023-12-03T11:33:19.005 INFO:teuthology.orchestra.run.smithi037.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-12-03T11:33:19.005 INFO:teuthology.orchestra.run.smithi037.stdout: auth supported = cephx 2023-12-03T11:33:19.005 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-03T11:33:19.005 INFO:teuthology.orchestra.run.smithi037.stdout: filestore xattr use omap = true 2023-12-03T11:33:19.005 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-03T11:33:19.005 INFO:teuthology.orchestra.run.smithi037.stdout: mon clock drift allowed = 1.000 2023-12-03T11:33:19.005 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-03T11:33:19.006 INFO:teuthology.orchestra.run.smithi037.stdout: osd crush chooseleaf type = 0 2023-12-03T11:33:19.006 INFO:teuthology.orchestra.run.smithi037.stdout: auth debug = true 2023-12-03T11:33:19.006 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-03T11:33:19.006 INFO:teuthology.orchestra.run.smithi037.stdout: ms die on old message = true 2023-12-03T11:33:19.006 INFO:teuthology.orchestra.run.smithi037.stdout: ms die on bug = true 2023-12-03T11:33:19.006 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-03T11:33:19.006 INFO:teuthology.orchestra.run.smithi037.stdout: mon max pg per osd = 10000 # >= luminous 2023-12-03T11:33:19.006 INFO:teuthology.orchestra.run.smithi037.stdout: mon pg warn max object skew = 0 2023-12-03T11:33:19.006 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-03T11:33:19.007 INFO:teuthology.orchestra.run.smithi037.stdout: # disable pg_autoscaler by default for new pools 2023-12-03T11:33:19.007 INFO:teuthology.orchestra.run.smithi037.stdout: osd_pool_default_pg_autoscale_mode = off 2023-12-03T11:33:19.007 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-03T11:33:19.007 INFO:teuthology.orchestra.run.smithi037.stdout: osd pool default size = 2 2023-12-03T11:33:19.007 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-03T11:33:19.007 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd allow primary affinity = true 2023-12-03T11:33:19.007 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd allow pg remap = true 2023-12-03T11:33:19.007 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on legacy crush tunables = false 2023-12-03T11:33:19.007 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on crush straw calc version zero = false 2023-12-03T11:33:19.007 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on no sortbitwise = false 2023-12-03T11:33:19.008 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on osd down out interval zero = false 2023-12-03T11:33:19.008 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on too few osds = false 2023-12-03T11:33:19.008 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-12-03T11:33:19.008 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_pool_no_redundancy = false 2023-12-03T11:33:19.008 INFO:teuthology.orchestra.run.smithi037.stdout: mon_allow_pool_size_one = true 2023-12-03T11:33:19.008 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-03T11:33:19.008 INFO:teuthology.orchestra.run.smithi037.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-12-03T11:33:19.008 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-03T11:33:19.008 INFO:teuthology.orchestra.run.smithi037.stdout: osd default data pool replay window = 5 2023-12-03T11:33:19.008 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-03T11:33:19.008 INFO:teuthology.orchestra.run.smithi037.stdout: mon allow pool delete = true 2023-12-03T11:33:19.008 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-03T11:33:19.008 INFO:teuthology.orchestra.run.smithi037.stdout: mon cluster log file level = debug 2023-12-03T11:33:19.009 INFO:teuthology.orchestra.run.smithi037.stdout: debug asserts on shutdown = true 2023-12-03T11:33:19.009 INFO:teuthology.orchestra.run.smithi037.stdout: mon health detail to clog = false 2023-12-03T11:33:19.009 INFO:teuthology.orchestra.run.smithi037.stdout: mon host = "172.21.15.3,[v2:172.21.15.3:3301,v1:172.21.15.3:6790],172.21.15.37" 2023-12-03T11:33:19.009 INFO:teuthology.orchestra.run.smithi037.stdout: mon client directed command retry = 5 2023-12-03T11:33:19.009 INFO:teuthology.orchestra.run.smithi037.stdout: ms inject socket failures = 5000 2023-12-03T11:33:19.009 INFO:teuthology.orchestra.run.smithi037.stdout: osd heartbeat grace = 40 2023-12-03T11:33:19.009 INFO:teuthology.orchestra.run.smithi037.stdout: osd_max_pg_log_entries = 10 2023-12-03T11:33:19.009 INFO:teuthology.orchestra.run.smithi037.stdout: osd_min_pg_log_entries = 10 2023-12-03T11:33:19.009 INFO:teuthology.orchestra.run.smithi037.stdout: fsid = 296556de-a4fc-4095-9b6d-0fe813c2865c 2023-12-03T11:33:19.009 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-03T11:33:19.009 INFO:teuthology.orchestra.run.smithi037.stdout:[osd] 2023-12-03T11:33:19.009 INFO:teuthology.orchestra.run.smithi037.stdout: osd journal size = 100 2023-12-03T11:33:19.009 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-03T11:33:19.009 INFO:teuthology.orchestra.run.smithi037.stdout: osd scrub load threshold = 5.0 2023-12-03T11:33:19.009 INFO:teuthology.orchestra.run.smithi037.stdout: osd scrub max interval = 600 2023-12-03T11:33:19.009 INFO:teuthology.orchestra.run.smithi037.stdout: osd mclock profile = high_recovery_ops 2023-12-03T11:33:19.010 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-03T11:33:19.010 INFO:teuthology.orchestra.run.smithi037.stdout: osd recover clone overlap = true 2023-12-03T11:33:19.010 INFO:teuthology.orchestra.run.smithi037.stdout: osd recovery max chunk = 1048576 2023-12-03T11:33:19.010 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-03T11:33:19.010 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug shutdown = true 2023-12-03T11:33:19.010 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug op order = true 2023-12-03T11:33:19.010 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug verify stray on activate = true 2023-12-03T11:33:19.010 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug trim objects = true 2023-12-03T11:33:19.010 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-03T11:33:19.010 INFO:teuthology.orchestra.run.smithi037.stdout: osd open classes on start = true 2023-12-03T11:33:19.010 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug pg log writeout = true 2023-12-03T11:33:19.010 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-03T11:33:19.010 INFO:teuthology.orchestra.run.smithi037.stdout: osd deep scrub update digest min age = 30 2023-12-03T11:33:19.010 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-03T11:33:19.010 INFO:teuthology.orchestra.run.smithi037.stdout: osd map max advance = 10 2023-12-03T11:33:19.011 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-03T11:33:19.011 INFO:teuthology.orchestra.run.smithi037.stdout: journal zero on create = true 2023-12-03T11:33:19.011 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-03T11:33:19.011 INFO:teuthology.orchestra.run.smithi037.stdout: filestore ondisk finisher threads = 3 2023-12-03T11:33:19.011 INFO:teuthology.orchestra.run.smithi037.stdout: filestore apply finisher threads = 3 2023-12-03T11:33:19.011 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-03T11:33:19.011 INFO:teuthology.orchestra.run.smithi037.stdout: bdev debug aio = true 2023-12-03T11:33:19.011 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug misdirected ops = true 2023-12-03T11:33:19.011 INFO:teuthology.orchestra.run.smithi037.stdout: bdev async discard = True 2023-12-03T11:33:19.011 INFO:teuthology.orchestra.run.smithi037.stdout: bdev enable discard = True 2023-12-03T11:33:19.011 INFO:teuthology.orchestra.run.smithi037.stdout: bluestore allocator = bitmap 2023-12-03T11:33:19.011 INFO:teuthology.orchestra.run.smithi037.stdout: bluestore block size = 96636764160 2023-12-03T11:33:19.011 INFO:teuthology.orchestra.run.smithi037.stdout: bluestore fsck on mount = True 2023-12-03T11:33:19.011 INFO:teuthology.orchestra.run.smithi037.stdout: debug bluefs = 1/20 2023-12-03T11:33:19.011 INFO:teuthology.orchestra.run.smithi037.stdout: debug bluestore = 1/20 2023-12-03T11:33:19.012 INFO:teuthology.orchestra.run.smithi037.stdout: debug ms = 1 2023-12-03T11:33:19.012 INFO:teuthology.orchestra.run.smithi037.stdout: debug osd = 20 2023-12-03T11:33:19.012 INFO:teuthology.orchestra.run.smithi037.stdout: debug rocksdb = 4/10 2023-12-03T11:33:19.012 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd backfillfull_ratio = 0.85 2023-12-03T11:33:19.012 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd full ratio = 0.9 2023-12-03T11:33:19.012 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd nearfull ratio = 0.8 2023-12-03T11:33:19.012 INFO:teuthology.orchestra.run.smithi037.stdout: osd failsafe full ratio = 0.95 2023-12-03T11:33:19.012 INFO:teuthology.orchestra.run.smithi037.stdout: osd fast shutdown = False 2023-12-03T11:33:19.012 INFO:teuthology.orchestra.run.smithi037.stdout: osd objectstore = bluestore 2023-12-03T11:33:19.012 INFO:teuthology.orchestra.run.smithi037.stdout: osd shutdown pgref assert = True 2023-12-03T11:33:19.012 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-03T11:33:19.012 INFO:teuthology.orchestra.run.smithi037.stdout:[mgr] 2023-12-03T11:33:19.012 INFO:teuthology.orchestra.run.smithi037.stdout: debug ms = 1 2023-12-03T11:33:19.012 INFO:teuthology.orchestra.run.smithi037.stdout: debug mgr = 20 2023-12-03T11:33:19.012 INFO:teuthology.orchestra.run.smithi037.stdout: debug mon = 20 2023-12-03T11:33:19.013 INFO:teuthology.orchestra.run.smithi037.stdout: debug auth = 20 2023-12-03T11:33:19.013 INFO:teuthology.orchestra.run.smithi037.stdout: mon reweight min pgs per osd = 4 2023-12-03T11:33:19.013 INFO:teuthology.orchestra.run.smithi037.stdout: mon reweight min bytes per osd = 10 2023-12-03T11:33:19.013 INFO:teuthology.orchestra.run.smithi037.stdout: mgr/telemetry/nag = false 2023-12-03T11:33:19.013 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-03T11:33:19.013 INFO:teuthology.orchestra.run.smithi037.stdout:[mon] 2023-12-03T11:33:19.013 INFO:teuthology.orchestra.run.smithi037.stdout: debug ms = 1 2023-12-03T11:33:19.013 INFO:teuthology.orchestra.run.smithi037.stdout: debug mon = 20 2023-12-03T11:33:19.013 INFO:teuthology.orchestra.run.smithi037.stdout: debug paxos = 20 2023-12-03T11:33:19.013 INFO:teuthology.orchestra.run.smithi037.stdout: debug auth = 20 2023-12-03T11:33:19.013 INFO:teuthology.orchestra.run.smithi037.stdout: mon data avail warn = 5 2023-12-03T11:33:19.013 INFO:teuthology.orchestra.run.smithi037.stdout: mon mgr mkfs grace = 240 2023-12-03T11:33:19.013 INFO:teuthology.orchestra.run.smithi037.stdout: mon reweight min pgs per osd = 4 2023-12-03T11:33:19.013 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd reporter subtree level = osd 2023-12-03T11:33:19.013 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd prime pg temp = true 2023-12-03T11:33:19.014 INFO:teuthology.orchestra.run.smithi037.stdout: mon reweight min bytes per osd = 10 2023-12-03T11:33:19.014 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-03T11:33:19.014 INFO:teuthology.orchestra.run.smithi037.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-12-03T11:33:19.014 INFO:teuthology.orchestra.run.smithi037.stdout: auth mon ticket ttl = 660 # 11m 2023-12-03T11:33:19.014 INFO:teuthology.orchestra.run.smithi037.stdout: auth service ticket ttl = 240 # 4m 2023-12-03T11:33:19.014 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-03T11:33:19.014 INFO:teuthology.orchestra.run.smithi037.stdout: # don't complain about insecure global_id in the test suite 2023-12-03T11:33:19.014 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-12-03T11:33:19.014 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-12-03T11:33:19.014 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-03T11:33:19.014 INFO:teuthology.orchestra.run.smithi037.stdout: # 1m isn't quite enough 2023-12-03T11:33:19.014 INFO:teuthology.orchestra.run.smithi037.stdout: mon_down_mkfs_grace = 2m 2023-12-03T11:33:19.014 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-03T11:33:19.014 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_filestore_osds = false 2023-12-03T11:33:19.015 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd crush smoke test = False 2023-12-03T11:33:19.015 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-03T11:33:19.015 INFO:teuthology.orchestra.run.smithi037.stdout:[client] 2023-12-03T11:33:19.015 INFO:teuthology.orchestra.run.smithi037.stdout: rgw cache enabled = true 2023-12-03T11:33:19.015 INFO:teuthology.orchestra.run.smithi037.stdout: rgw enable ops log = True 2023-12-03T11:33:19.015 INFO:teuthology.orchestra.run.smithi037.stdout: rgw enable usage log = true 2023-12-03T11:33:19.015 INFO:teuthology.orchestra.run.smithi037.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-12-03T11:33:19.015 INFO:teuthology.orchestra.run.smithi037.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-12-03T11:33:19.015 INFO:teuthology.orchestra.run.smithi037.stdout: debug rgw = 20 2023-12-03T11:33:19.015 INFO:teuthology.orchestra.run.smithi037.stdout: rgw bucket counters cache = True 2023-12-03T11:33:19.015 INFO:teuthology.orchestra.run.smithi037.stdout: rgw crypt require ssl = False 2023-12-03T11:33:19.015 INFO:teuthology.orchestra.run.smithi037.stdout: rgw crypt s3 kms backend = testing 2023-12-03T11:33:19.015 INFO:teuthology.orchestra.run.smithi037.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2023-12-03T11:33:19.015 INFO:teuthology.orchestra.run.smithi037.stdout: rgw d3n l1 datacache persistent path = /tmp/rgw_datacache/ 2023-12-03T11:33:19.016 INFO:teuthology.orchestra.run.smithi037.stdout: rgw d3n l1 datacache size = 10737418240 2023-12-03T11:33:19.016 INFO:teuthology.orchestra.run.smithi037.stdout: rgw d3n l1 local datacache enabled = True 2023-12-03T11:33:19.016 INFO:teuthology.orchestra.run.smithi037.stdout: rgw max chunk size = 4194304 2023-12-03T11:33:19.016 INFO:teuthology.orchestra.run.smithi037.stdout: rgw obj stripe size = 6291456 2023-12-03T11:33:19.016 INFO:teuthology.orchestra.run.smithi037.stdout: rgw torrent flag = True 2023-12-03T11:33:19.016 INFO:teuthology.orchestra.run.smithi037.stdout: rgw user counters cache = True 2023-12-03T11:33:19.016 INFO:teuthology.orchestra.run.smithi037.stdout: setgroup = ceph 2023-12-03T11:33:19.016 INFO:teuthology.orchestra.run.smithi037.stdout: setuser = ceph 2023-12-03T11:33:19.016 INFO:teuthology.orchestra.run.smithi037.stdout:[mon.a] 2023-12-03T11:33:19.016 INFO:teuthology.orchestra.run.smithi037.stdout:[mon.c] 2023-12-03T11:33:19.016 INFO:teuthology.orchestra.run.smithi037.stdout:[mon.b] 2023-12-03T11:33:19.016 INFO:tasks.ceph:Creating admin key on mon.a... 2023-12-03T11:33:19.017 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-12-03T11:33:19.105 INFO:tasks.ceph:Copying monmap to all nodes... 2023-12-03T11:33:19.105 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-12-03T11:33:19.105 DEBUG:teuthology.orchestra.run.smithi003:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-12-03T11:33:19.120 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-12-03T11:33:19.120 DEBUG:teuthology.orchestra.run.smithi003:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-12-03T11:33:19.175 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi003.front.sepia.ceph.com 2023-12-03T11:33:19.175 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-12-03T11:33:19.175 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd of=/etc/ceph/ceph.keyring 2023-12-03T11:33:19.175 DEBUG:teuthology.orchestra.run.smithi003:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-03T11:33:19.261 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-12-03T11:33:19.261 DEBUG:teuthology.orchestra.run.smithi003:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-12-03T11:33:19.317 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi037.front.sepia.ceph.com 2023-12-03T11:33:19.318 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-12-03T11:33:19.318 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/etc/ceph/ceph.keyring 2023-12-03T11:33:19.318 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-03T11:33:19.366 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-12-03T11:33:19.366 DEBUG:teuthology.orchestra.run.smithi037:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-12-03T11:33:19.421 INFO:tasks.ceph:Setting up mon nodes... 2023-12-03T11:33:19.422 INFO:tasks.ceph:Setting up mgr nodes... 2023-12-03T11:33:19.422 DEBUG:teuthology.orchestra.run.smithi003:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-12-03T11:33:19.485 INFO:teuthology.orchestra.run.smithi003.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-12-03T11:33:19.488 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-12-03T11:33:19.563 INFO:teuthology.orchestra.run.smithi037.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-12-03T11:33:19.566 INFO:tasks.ceph:Setting up mds nodes... 2023-12-03T11:33:19.566 INFO:tasks.ceph_client:Setting up client nodes... 2023-12-03T11:33:19.566 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-12-03T11:33:19.613 INFO:teuthology.orchestra.run.smithi003.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-12-03T11:33:19.632 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-12-03T11:33:19.678 INFO:teuthology.orchestra.run.smithi037.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-12-03T11:33:19.697 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-12-03T11:33:19.697 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi003.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi037.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-12-03T11:33:19.697 DEBUG:teuthology.orchestra.run.smithi003:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-12-03T11:33:19.728 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-03T11:33:19.728 INFO:tasks.ceph:role: osd.0 2023-12-03T11:33:19.728 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi003.front.sepia.ceph.com 2023-12-03T11:33:19.728 DEBUG:teuthology.orchestra.run.smithi003:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-12-03T11:33:19.805 INFO:teuthology.orchestra.run.smithi003.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-12-03T11:33:19.805 INFO:teuthology.orchestra.run.smithi003.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-03T11:33:19.805 INFO:teuthology.orchestra.run.smithi003.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-03T11:33:19.806 INFO:teuthology.orchestra.run.smithi003.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-03T11:33:19.806 INFO:teuthology.orchestra.run.smithi003.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-03T11:33:19.806 INFO:teuthology.orchestra.run.smithi003.stdout: = sunit=0 swidth=0 blks 2023-12-03T11:33:19.806 INFO:teuthology.orchestra.run.smithi003.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-03T11:33:19.806 INFO:teuthology.orchestra.run.smithi003.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-03T11:33:19.806 INFO:teuthology.orchestra.run.smithi003.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-03T11:33:19.806 INFO:teuthology.orchestra.run.smithi003.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-03T11:33:20.305 INFO:teuthology.orchestra.run.smithi003.stdout:Discarding blocks...Done. 2023-12-03T11:33:20.307 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi003.front.sepia.ceph.com -o noatime 2023-12-03T11:33:20.307 DEBUG:teuthology.orchestra.run.smithi003:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-12-03T11:33:20.440 DEBUG:teuthology.orchestra.run.smithi003:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-12-03T11:33:20.479 DEBUG:teuthology.orchestra.run.smithi003:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-12-03T11:33:20.550 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-03T11:33:20.551 INFO:tasks.ceph:role: osd.1 2023-12-03T11:33:20.551 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi003.front.sepia.ceph.com 2023-12-03T11:33:20.551 DEBUG:teuthology.orchestra.run.smithi003:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-12-03T11:33:20.629 INFO:teuthology.orchestra.run.smithi003.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-12-03T11:33:20.629 INFO:teuthology.orchestra.run.smithi003.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-03T11:33:20.630 INFO:teuthology.orchestra.run.smithi003.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-03T11:33:20.630 INFO:teuthology.orchestra.run.smithi003.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-03T11:33:20.630 INFO:teuthology.orchestra.run.smithi003.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-03T11:33:20.630 INFO:teuthology.orchestra.run.smithi003.stdout: = sunit=0 swidth=0 blks 2023-12-03T11:33:20.630 INFO:teuthology.orchestra.run.smithi003.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-03T11:33:20.630 INFO:teuthology.orchestra.run.smithi003.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-03T11:33:20.630 INFO:teuthology.orchestra.run.smithi003.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-03T11:33:20.630 INFO:teuthology.orchestra.run.smithi003.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-03T11:33:21.069 INFO:teuthology.orchestra.run.smithi003.stdout:Discarding blocks...Done. 2023-12-03T11:33:21.071 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi003.front.sepia.ceph.com -o noatime 2023-12-03T11:33:21.072 DEBUG:teuthology.orchestra.run.smithi003:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-12-03T11:33:21.165 DEBUG:teuthology.orchestra.run.smithi003:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-12-03T11:33:21.200 DEBUG:teuthology.orchestra.run.smithi003:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-12-03T11:33:21.271 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-03T11:33:21.271 INFO:tasks.ceph:role: osd.2 2023-12-03T11:33:21.271 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi003.front.sepia.ceph.com 2023-12-03T11:33:21.271 DEBUG:teuthology.orchestra.run.smithi003:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-12-03T11:33:21.348 INFO:teuthology.orchestra.run.smithi003.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-12-03T11:33:21.349 INFO:teuthology.orchestra.run.smithi003.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-03T11:33:21.349 INFO:teuthology.orchestra.run.smithi003.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-03T11:33:21.349 INFO:teuthology.orchestra.run.smithi003.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-03T11:33:21.349 INFO:teuthology.orchestra.run.smithi003.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-03T11:33:21.349 INFO:teuthology.orchestra.run.smithi003.stdout: = sunit=0 swidth=0 blks 2023-12-03T11:33:21.349 INFO:teuthology.orchestra.run.smithi003.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-03T11:33:21.349 INFO:teuthology.orchestra.run.smithi003.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-03T11:33:21.349 INFO:teuthology.orchestra.run.smithi003.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-03T11:33:21.349 INFO:teuthology.orchestra.run.smithi003.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-03T11:33:21.832 INFO:teuthology.orchestra.run.smithi003.stdout:Discarding blocks...Done. 2023-12-03T11:33:21.834 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi003.front.sepia.ceph.com -o noatime 2023-12-03T11:33:21.835 DEBUG:teuthology.orchestra.run.smithi003:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-12-03T11:33:21.989 DEBUG:teuthology.orchestra.run.smithi003:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-12-03T11:33:22.023 DEBUG:teuthology.orchestra.run.smithi003:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-12-03T11:33:22.094 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-03T11:33:22.095 INFO:tasks.ceph:role: osd.3 2023-12-03T11:33:22.095 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi003.front.sepia.ceph.com 2023-12-03T11:33:22.095 DEBUG:teuthology.orchestra.run.smithi003:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-12-03T11:33:22.172 INFO:teuthology.orchestra.run.smithi003.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-12-03T11:33:22.173 INFO:teuthology.orchestra.run.smithi003.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-03T11:33:22.173 INFO:teuthology.orchestra.run.smithi003.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-03T11:33:22.173 INFO:teuthology.orchestra.run.smithi003.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-03T11:33:22.173 INFO:teuthology.orchestra.run.smithi003.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-03T11:33:22.173 INFO:teuthology.orchestra.run.smithi003.stdout: = sunit=0 swidth=0 blks 2023-12-03T11:33:22.173 INFO:teuthology.orchestra.run.smithi003.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-03T11:33:22.173 INFO:teuthology.orchestra.run.smithi003.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-03T11:33:22.173 INFO:teuthology.orchestra.run.smithi003.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-03T11:33:22.173 INFO:teuthology.orchestra.run.smithi003.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-03T11:33:22.687 INFO:teuthology.orchestra.run.smithi003.stdout:Discarding blocks...Done. 2023-12-03T11:33:22.689 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi003.front.sepia.ceph.com -o noatime 2023-12-03T11:33:22.689 DEBUG:teuthology.orchestra.run.smithi003:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-12-03T11:33:22.810 DEBUG:teuthology.orchestra.run.smithi003:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-12-03T11:33:22.848 DEBUG:teuthology.orchestra.run.smithi003:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-03T11:33:22.952 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:33:22.951+0000 7eff69a25500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-12-03T11:33:22.952 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:33:22.951+0000 7eff69a25500 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-12-03T11:33:22.953 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:33:22.951+0000 7eff69a25500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-12-03T11:33:22.953 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:33:22.951+0000 7eff69a25500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-12-03T11:33:22.953 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:33:22.951+0000 7eff69a25500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-12-03T11:33:22.953 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:33:22.952+0000 7eff69a25500 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-12-03T11:33:25.809 DEBUG:teuthology.orchestra.run.smithi003:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-12-03T11:33:25.844 DEBUG:teuthology.orchestra.run.smithi003:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-03T11:33:25.940 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:33:25.938+0000 7f9281614500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-12-03T11:33:25.940 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:33:25.940+0000 7f9281614500 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-12-03T11:33:25.940 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:33:25.940+0000 7f9281614500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-12-03T11:33:25.940 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:33:25.940+0000 7f9281614500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-12-03T11:33:25.940 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:33:25.940+0000 7f9281614500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-12-03T11:33:25.941 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:33:25.940+0000 7f9281614500 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-12-03T11:33:28.800 DEBUG:teuthology.orchestra.run.smithi003:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-12-03T11:33:28.836 DEBUG:teuthology.orchestra.run.smithi003:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-03T11:33:28.931 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:33:28.930+0000 7f9fb1a14500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-12-03T11:33:28.931 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:33:28.930+0000 7f9fb1a14500 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-12-03T11:33:28.931 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:33:28.930+0000 7f9fb1a14500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-12-03T11:33:28.931 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:33:28.930+0000 7f9fb1a14500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-12-03T11:33:28.932 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:33:28.930+0000 7f9fb1a14500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-12-03T11:33:28.932 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:33:28.930+0000 7f9fb1a14500 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-12-03T11:33:31.792 DEBUG:teuthology.orchestra.run.smithi003:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-12-03T11:33:31.827 DEBUG:teuthology.orchestra.run.smithi003:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-03T11:33:31.923 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:33:31.922+0000 7fdc8ea8c500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-12-03T11:33:31.923 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:33:31.922+0000 7fdc8ea8c500 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-12-03T11:33:31.923 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:33:31.922+0000 7fdc8ea8c500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-12-03T11:33:31.923 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:33:31.922+0000 7fdc8ea8c500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-12-03T11:33:31.924 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:33:31.922+0000 7fdc8ea8c500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-12-03T11:33:31.924 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:33:31.922+0000 7fdc8ea8c500 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-12-03T11:33:34.779 DEBUG:teuthology.orchestra.run.smithi003:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-12-03T11:33:34.816 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-12-03T11:33:34.852 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-03T11:33:34.852 INFO:tasks.ceph:role: osd.4 2023-12-03T11:33:34.852 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi037.front.sepia.ceph.com 2023-12-03T11:33:34.853 DEBUG:teuthology.orchestra.run.smithi037:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-12-03T11:33:34.935 INFO:teuthology.orchestra.run.smithi037.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-12-03T11:33:34.935 INFO:teuthology.orchestra.run.smithi037.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-03T11:33:34.935 INFO:teuthology.orchestra.run.smithi037.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-03T11:33:34.935 INFO:teuthology.orchestra.run.smithi037.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-03T11:33:34.935 INFO:teuthology.orchestra.run.smithi037.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-03T11:33:34.935 INFO:teuthology.orchestra.run.smithi037.stdout: = sunit=0 swidth=0 blks 2023-12-03T11:33:34.935 INFO:teuthology.orchestra.run.smithi037.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-03T11:33:34.935 INFO:teuthology.orchestra.run.smithi037.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-03T11:33:34.935 INFO:teuthology.orchestra.run.smithi037.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-03T11:33:34.935 INFO:teuthology.orchestra.run.smithi037.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-03T11:33:35.437 INFO:teuthology.orchestra.run.smithi037.stdout:Discarding blocks...Done. 2023-12-03T11:33:35.440 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi037.front.sepia.ceph.com -o noatime 2023-12-03T11:33:35.440 DEBUG:teuthology.orchestra.run.smithi037:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-12-03T11:33:35.555 DEBUG:teuthology.orchestra.run.smithi037:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-12-03T11:33:35.596 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-12-03T11:33:35.667 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-03T11:33:35.667 INFO:tasks.ceph:role: osd.5 2023-12-03T11:33:35.667 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi037.front.sepia.ceph.com 2023-12-03T11:33:35.667 DEBUG:teuthology.orchestra.run.smithi037:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-12-03T11:33:35.745 INFO:teuthology.orchestra.run.smithi037.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-12-03T11:33:35.745 INFO:teuthology.orchestra.run.smithi037.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-03T11:33:35.745 INFO:teuthology.orchestra.run.smithi037.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-03T11:33:35.745 INFO:teuthology.orchestra.run.smithi037.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-03T11:33:35.745 INFO:teuthology.orchestra.run.smithi037.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-03T11:33:35.745 INFO:teuthology.orchestra.run.smithi037.stdout: = sunit=0 swidth=0 blks 2023-12-03T11:33:35.745 INFO:teuthology.orchestra.run.smithi037.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-03T11:33:35.745 INFO:teuthology.orchestra.run.smithi037.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-03T11:33:35.745 INFO:teuthology.orchestra.run.smithi037.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-03T11:33:35.745 INFO:teuthology.orchestra.run.smithi037.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-03T11:33:36.198 INFO:teuthology.orchestra.run.smithi037.stdout:Discarding blocks...Done. 2023-12-03T11:33:36.200 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi037.front.sepia.ceph.com -o noatime 2023-12-03T11:33:36.200 DEBUG:teuthology.orchestra.run.smithi037:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-12-03T11:33:36.301 DEBUG:teuthology.orchestra.run.smithi037:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-12-03T11:33:36.335 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-12-03T11:33:36.407 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-03T11:33:36.407 INFO:tasks.ceph:role: osd.6 2023-12-03T11:33:36.407 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi037.front.sepia.ceph.com 2023-12-03T11:33:36.407 DEBUG:teuthology.orchestra.run.smithi037:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-12-03T11:33:36.485 INFO:teuthology.orchestra.run.smithi037.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-12-03T11:33:36.485 INFO:teuthology.orchestra.run.smithi037.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-03T11:33:36.485 INFO:teuthology.orchestra.run.smithi037.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-03T11:33:36.485 INFO:teuthology.orchestra.run.smithi037.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-03T11:33:36.485 INFO:teuthology.orchestra.run.smithi037.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-03T11:33:36.485 INFO:teuthology.orchestra.run.smithi037.stdout: = sunit=0 swidth=0 blks 2023-12-03T11:33:36.485 INFO:teuthology.orchestra.run.smithi037.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-03T11:33:36.485 INFO:teuthology.orchestra.run.smithi037.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-03T11:33:36.485 INFO:teuthology.orchestra.run.smithi037.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-03T11:33:36.485 INFO:teuthology.orchestra.run.smithi037.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-03T11:33:36.969 INFO:teuthology.orchestra.run.smithi037.stdout:Discarding blocks...Done. 2023-12-03T11:33:36.971 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi037.front.sepia.ceph.com -o noatime 2023-12-03T11:33:36.971 DEBUG:teuthology.orchestra.run.smithi037:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-12-03T11:33:37.122 DEBUG:teuthology.orchestra.run.smithi037:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-12-03T11:33:37.160 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-12-03T11:33:37.232 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-03T11:33:37.232 INFO:tasks.ceph:role: osd.7 2023-12-03T11:33:37.232 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi037.front.sepia.ceph.com 2023-12-03T11:33:37.232 DEBUG:teuthology.orchestra.run.smithi037:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-12-03T11:33:37.310 INFO:teuthology.orchestra.run.smithi037.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-12-03T11:33:37.310 INFO:teuthology.orchestra.run.smithi037.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-03T11:33:37.310 INFO:teuthology.orchestra.run.smithi037.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-03T11:33:37.310 INFO:teuthology.orchestra.run.smithi037.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-03T11:33:37.310 INFO:teuthology.orchestra.run.smithi037.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-03T11:33:37.310 INFO:teuthology.orchestra.run.smithi037.stdout: = sunit=0 swidth=0 blks 2023-12-03T11:33:37.310 INFO:teuthology.orchestra.run.smithi037.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-03T11:33:37.311 INFO:teuthology.orchestra.run.smithi037.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-03T11:33:37.311 INFO:teuthology.orchestra.run.smithi037.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-03T11:33:37.311 INFO:teuthology.orchestra.run.smithi037.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-03T11:33:37.806 INFO:teuthology.orchestra.run.smithi037.stdout:Discarding blocks...Done. 2023-12-03T11:33:37.808 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi037.front.sepia.ceph.com -o noatime 2023-12-03T11:33:37.808 DEBUG:teuthology.orchestra.run.smithi037:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-12-03T11:33:37.941 DEBUG:teuthology.orchestra.run.smithi037:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-12-03T11:33:37.983 DEBUG:teuthology.orchestra.run.smithi037:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-03T11:33:38.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-03T11:33:38.091+0000 7fafe161d500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-12-03T11:33:38.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-03T11:33:38.091+0000 7fafe161d500 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-12-03T11:33:38.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-03T11:33:38.091+0000 7fafe161d500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-12-03T11:33:38.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-03T11:33:38.091+0000 7fafe161d500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-12-03T11:33:38.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-03T11:33:38.091+0000 7fafe161d500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-12-03T11:33:38.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-03T11:33:38.092+0000 7fafe161d500 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-12-03T11:33:40.948 DEBUG:teuthology.orchestra.run.smithi037:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-12-03T11:33:40.984 DEBUG:teuthology.orchestra.run.smithi037:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-03T11:33:41.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-03T11:33:41.079+0000 7f6d88ec9500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-12-03T11:33:41.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-03T11:33:41.079+0000 7f6d88ec9500 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-12-03T11:33:41.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-03T11:33:41.079+0000 7f6d88ec9500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-12-03T11:33:41.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-03T11:33:41.079+0000 7f6d88ec9500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-12-03T11:33:41.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-03T11:33:41.079+0000 7f6d88ec9500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-12-03T11:33:41.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-03T11:33:41.080+0000 7f6d88ec9500 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-12-03T11:33:43.941 DEBUG:teuthology.orchestra.run.smithi037:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-12-03T11:33:43.976 DEBUG:teuthology.orchestra.run.smithi037:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-03T11:33:44.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-03T11:33:44.071+0000 7f1fe7b12500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-12-03T11:33:44.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-03T11:33:44.071+0000 7f1fe7b12500 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-12-03T11:33:44.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-03T11:33:44.071+0000 7f1fe7b12500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-12-03T11:33:44.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-03T11:33:44.071+0000 7f1fe7b12500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-12-03T11:33:44.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-03T11:33:44.071+0000 7f1fe7b12500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-12-03T11:33:44.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-03T11:33:44.072+0000 7f1fe7b12500 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-12-03T11:33:46.927 DEBUG:teuthology.orchestra.run.smithi037:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-12-03T11:33:46.962 DEBUG:teuthology.orchestra.run.smithi037:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-03T11:33:47.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-03T11:33:47.057+0000 7f8dc7014500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-12-03T11:33:47.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-03T11:33:47.057+0000 7f8dc7014500 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-12-03T11:33:47.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-03T11:33:47.057+0000 7f8dc7014500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-12-03T11:33:47.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-03T11:33:47.057+0000 7f8dc7014500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-12-03T11:33:47.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-03T11:33:47.057+0000 7f8dc7014500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-12-03T11:33:47.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-03T11:33:47.058+0000 7f8dc7014500 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-12-03T11:33:49.917 DEBUG:teuthology.orchestra.run.smithi037:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-12-03T11:33:49.954 INFO:tasks.ceph:Reading keys from all nodes... 2023-12-03T11:33:49.954 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-12-03T11:33:49.954 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-12-03T11:33:49.991 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-12-03T11:33:49.991 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-12-03T11:33:50.065 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-12-03T11:33:50.066 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-12-03T11:33:50.139 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-12-03T11:33:50.139 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-12-03T11:33:50.212 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-12-03T11:33:50.212 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-12-03T11:33:50.286 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-12-03T11:33:50.286 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-12-03T11:33:50.322 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-12-03T11:33:50.322 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-12-03T11:33:50.397 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-12-03T11:33:50.397 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-12-03T11:33:50.470 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-12-03T11:33:50.470 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-12-03T11:33:50.542 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-12-03T11:33:50.543 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-12-03T11:33:50.613 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-12-03T11:33:50.614 DEBUG:teuthology.orchestra.run.smithi003:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-12-03T11:33:50.632 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-12-03T11:33:50.633 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-12-03T11:33:50.670 INFO:tasks.ceph:Adding keys to all mons... 2023-12-03T11:33:50.670 DEBUG:teuthology.orchestra.run.smithi003:> sudo tee -a /etc/ceph/ceph.keyring 2023-12-03T11:33:50.675 DEBUG:teuthology.orchestra.run.smithi037:> sudo tee -a /etc/ceph/ceph.keyring 2023-12-03T11:33:50.713 INFO:teuthology.orchestra.run.smithi003.stdout:[mgr.y] 2023-12-03T11:33:50.713 INFO:teuthology.orchestra.run.smithi003.stdout: key = AQB/Z2xloQTyHBAAcMvjnRyhzeaSar1H/GD/bQ== 2023-12-03T11:33:50.713 INFO:teuthology.orchestra.run.smithi003.stdout:[osd.0] 2023-12-03T11:33:50.713 INFO:teuthology.orchestra.run.smithi003.stdout: key = AQCCZ2xlThLHOBAAjxvjo7FGgTnu92Dyu42Ibw== 2023-12-03T11:33:50.714 INFO:teuthology.orchestra.run.smithi003.stdout:[osd.1] 2023-12-03T11:33:50.714 INFO:teuthology.orchestra.run.smithi003.stdout: key = AQCFZ2xl9Y4FOBAAr/mXZdOIqVJNoh1dfmAlPw== 2023-12-03T11:33:50.714 INFO:teuthology.orchestra.run.smithi003.stdout:[osd.2] 2023-12-03T11:33:50.714 INFO:teuthology.orchestra.run.smithi003.stdout: key = AQCIZ2xlovR+NxAAuDTn3valKw/zg6XrqrvXMg== 2023-12-03T11:33:50.714 INFO:teuthology.orchestra.run.smithi003.stdout:[osd.3] 2023-12-03T11:33:50.714 INFO:teuthology.orchestra.run.smithi003.stdout: key = AQCLZ2xlomMGNxAAZ2275YGjpgPdhnACHZ+zwQ== 2023-12-03T11:33:50.714 INFO:teuthology.orchestra.run.smithi003.stdout:[mgr.x] 2023-12-03T11:33:50.714 INFO:teuthology.orchestra.run.smithi003.stdout: key = AQB/Z2xlkuSXIRAAWdaiEWTZdlRWqbvEhXRhAw== 2023-12-03T11:33:50.714 INFO:teuthology.orchestra.run.smithi003.stdout:[osd.4] 2023-12-03T11:33:50.714 INFO:teuthology.orchestra.run.smithi003.stdout: key = AQCSZ2xlw2GDBRAA5GT/j4KQuev1pcG31srBcQ== 2023-12-03T11:33:50.714 INFO:teuthology.orchestra.run.smithi003.stdout:[osd.5] 2023-12-03T11:33:50.715 INFO:teuthology.orchestra.run.smithi003.stdout: key = AQCVZ2xllz3LBBAAARV3wejQAQnmlC8OBIg7qQ== 2023-12-03T11:33:50.715 INFO:teuthology.orchestra.run.smithi003.stdout:[osd.6] 2023-12-03T11:33:50.715 INFO:teuthology.orchestra.run.smithi003.stdout: key = AQCYZ2xl95ZRBBAA2kc2qIAuNSbJUvPUg5GJfQ== 2023-12-03T11:33:50.715 INFO:teuthology.orchestra.run.smithi003.stdout:[osd.7] 2023-12-03T11:33:50.715 INFO:teuthology.orchestra.run.smithi003.stdout: key = AQCbZ2xlqTl9AxAAVbNXXt/7fA218ZgXENB1uA== 2023-12-03T11:33:50.715 INFO:teuthology.orchestra.run.smithi003.stdout:[client.0] 2023-12-03T11:33:50.715 INFO:teuthology.orchestra.run.smithi003.stdout: key = AQB/Z2xlq0aXJBAAkKzZqV4qL32Ij/din7qjMg== 2023-12-03T11:33:50.715 INFO:teuthology.orchestra.run.smithi003.stdout:[client.1] 2023-12-03T11:33:50.715 INFO:teuthology.orchestra.run.smithi003.stdout: key = AQB/Z2xlkAN1KBAAu+kWMG86EdUTqk9T4UmoRQ== 2023-12-03T11:33:50.740 INFO:teuthology.orchestra.run.smithi037.stdout:[mgr.y] 2023-12-03T11:33:50.740 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQB/Z2xloQTyHBAAcMvjnRyhzeaSar1H/GD/bQ== 2023-12-03T11:33:50.740 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.0] 2023-12-03T11:33:50.741 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQCCZ2xlThLHOBAAjxvjo7FGgTnu92Dyu42Ibw== 2023-12-03T11:33:50.741 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.1] 2023-12-03T11:33:50.741 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQCFZ2xl9Y4FOBAAr/mXZdOIqVJNoh1dfmAlPw== 2023-12-03T11:33:50.741 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.2] 2023-12-03T11:33:50.741 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQCIZ2xlovR+NxAAuDTn3valKw/zg6XrqrvXMg== 2023-12-03T11:33:50.741 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.3] 2023-12-03T11:33:50.741 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQCLZ2xlomMGNxAAZ2275YGjpgPdhnACHZ+zwQ== 2023-12-03T11:33:50.741 INFO:teuthology.orchestra.run.smithi037.stdout:[mgr.x] 2023-12-03T11:33:50.741 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQB/Z2xlkuSXIRAAWdaiEWTZdlRWqbvEhXRhAw== 2023-12-03T11:33:50.741 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.4] 2023-12-03T11:33:50.741 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQCSZ2xlw2GDBRAA5GT/j4KQuev1pcG31srBcQ== 2023-12-03T11:33:50.742 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.5] 2023-12-03T11:33:50.742 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQCVZ2xllz3LBBAAARV3wejQAQnmlC8OBIg7qQ== 2023-12-03T11:33:50.742 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.6] 2023-12-03T11:33:50.742 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQCYZ2xl95ZRBBAA2kc2qIAuNSbJUvPUg5GJfQ== 2023-12-03T11:33:50.742 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.7] 2023-12-03T11:33:50.742 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQCbZ2xlqTl9AxAAVbNXXt/7fA218ZgXENB1uA== 2023-12-03T11:33:50.742 INFO:teuthology.orchestra.run.smithi037.stdout:[client.0] 2023-12-03T11:33:50.742 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQB/Z2xlq0aXJBAAkKzZqV4qL32Ij/din7qjMg== 2023-12-03T11:33:50.742 INFO:teuthology.orchestra.run.smithi037.stdout:[client.1] 2023-12-03T11:33:50.742 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQB/Z2xlkAN1KBAAu+kWMG86EdUTqk9T4UmoRQ== 2023-12-03T11:33:50.743 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-03T11:33:50.758 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-03T11:33:50.840 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-03T11:33:50.843 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-03T11:33:50.899 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-03T11:33:50.902 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-03T11:33:50.957 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-03T11:33:50.960 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-03T11:33:51.015 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-03T11:33:51.017 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-03T11:33:51.073 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-03T11:33:51.076 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-03T11:33:51.132 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-03T11:33:51.134 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-03T11:33:51.189 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-03T11:33:51.191 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-03T11:33:51.246 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-03T11:33:51.248 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-03T11:33:51.304 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-03T11:33:51.306 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-03T11:33:51.361 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-03T11:33:51.363 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-03T11:33:51.421 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-03T11:33:51.424 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-03T11:33:51.482 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-12-03T11:33:51.483 DEBUG:teuthology.orchestra.run.smithi003:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-12-03T11:33:51.513 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-12-03T11:33:51.615 DEBUG:teuthology.orchestra.run.smithi003:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-12-03T11:33:51.645 DEBUG:teuthology.orchestra.run.smithi003:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-12-03T11:33:51.715 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-12-03T11:33:51.818 DEBUG:teuthology.orchestra.run.smithi003:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-12-03T11:33:51.848 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-12-03T11:33:51.881 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-12-03T11:33:51.984 DEBUG:teuthology.orchestra.run.smithi037:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-12-03T11:33:52.015 DEBUG:teuthology.orchestra.run.smithi003:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-12-03T11:33:52.017 DEBUG:teuthology.orchestra.run.smithi037:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-12-03T11:33:52.070 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-12-03T11:33:52.070 INFO:tasks.ceph.mon.a:Restarting daemon 2023-12-03T11:33:52.070 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-12-03T11:33:52.073 INFO:tasks.ceph.mon.a:Started 2023-12-03T11:33:52.073 INFO:tasks.ceph.mon.c:Restarting daemon 2023-12-03T11:33:52.073 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-12-03T11:33:52.075 INFO:tasks.ceph.mon.c:Started 2023-12-03T11:33:52.075 INFO:tasks.ceph.mon.b:Restarting daemon 2023-12-03T11:33:52.075 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-12-03T11:33:52.112 INFO:tasks.ceph.mon.b:Started 2023-12-03T11:33:52.113 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-12-03T11:33:52.113 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-12-03T11:33:52.113 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-12-03T11:33:52.115 INFO:tasks.ceph.mgr.y:Started 2023-12-03T11:33:52.116 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-12-03T11:33:52.116 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-12-03T11:33:52.117 INFO:tasks.ceph.mgr.x:Started 2023-12-03T11:33:52.118 INFO:tasks.ceph:Setting crush tunables to default 2023-12-03T11:33:52.118 DEBUG:teuthology.orchestra.run.smithi003:> sudo ceph --cluster ceph osd crush tunables default 2023-12-03T11:33:57.601 INFO:teuthology.orchestra.run.smithi003.stderr:adjusted tunables profile to default 2023-12-03T11:33:57.613 INFO:tasks.ceph:check_enable_crimson: False 2023-12-03T11:33:57.613 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-12-03T11:33:57.614 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-12-03T11:33:57.614 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-12-03T11:33:57.644 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-12-03T11:33:57.645 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-12-03T11:33:57.715 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-12-03T11:33:57.715 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-12-03T11:33:57.786 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-12-03T11:33:57.787 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-12-03T11:33:57.857 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-12-03T11:33:57.858 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-12-03T11:33:57.889 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-12-03T11:33:57.889 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-12-03T11:33:57.931 INFO:tasks.ceph.mgr.x.smithi037.stderr:2023-12-03T11:33:57.930+0000 7f2c40a32040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-03T11:33:57.959 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-12-03T11:33:57.959 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-12-03T11:33:57.986 INFO:tasks.ceph.mgr.x.smithi037.stderr:2023-12-03T11:33:57.985+0000 7f2c40a32040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-03T11:33:58.005 INFO:tasks.ceph.mgr.y.smithi003.stderr:2023-12-03T11:33:58.004+0000 7fcb05632040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-03T11:33:58.016 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-12-03T11:33:58.016 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-12-03T11:33:58.059 INFO:tasks.ceph.mgr.y.smithi003.stderr:2023-12-03T11:33:58.057+0000 7fcb05632040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-03T11:33:58.087 DEBUG:teuthology.orchestra.run.smithi037:> sudo ceph --cluster ceph osd new 6cb349c1-e98d-4d40-a1c6-719931c2433e 0 2023-12-03T11:33:58.320 INFO:teuthology.orchestra.run.smithi037.stdout:0 2023-12-03T11:33:58.331 DEBUG:teuthology.orchestra.run.smithi037:> sudo ceph --cluster ceph osd new 29af9a08-8d13-4db7-94bf-fa5f8469039f 1 2023-12-03T11:33:58.528 INFO:teuthology.orchestra.run.smithi037.stdout:1 2023-12-03T11:33:58.540 DEBUG:teuthology.orchestra.run.smithi037:> sudo ceph --cluster ceph osd new 22ce18a4-e878-41ef-82c5-52125c0b9f9d 2 2023-12-03T11:33:58.559 INFO:tasks.ceph.mgr.x.smithi037.stderr:2023-12-03T11:33:58.558+0000 7f2c40a32040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-03T11:33:58.610 INFO:tasks.ceph.mgr.y.smithi003.stderr:2023-12-03T11:33:58.609+0000 7fcb05632040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-03T11:33:58.615 INFO:tasks.ceph.mgr.x.smithi037.stderr:2023-12-03T11:33:58.614+0000 7f2c40a32040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-03T11:33:58.664 INFO:tasks.ceph.mgr.x.smithi037.stderr:2023-12-03T11:33:58.663+0000 7f2c40a32040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-03T11:33:58.665 INFO:tasks.ceph.mgr.y.smithi003.stderr:2023-12-03T11:33:58.664+0000 7fcb05632040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-03T11:33:58.712 INFO:tasks.ceph.mgr.y.smithi003.stderr:2023-12-03T11:33:58.711+0000 7fcb05632040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-03T11:33:58.720 INFO:tasks.ceph.mgr.x.smithi037.stderr:2023-12-03T11:33:58.719+0000 7f2c40a32040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-03T11:33:58.734 INFO:teuthology.orchestra.run.smithi037.stdout:2 2023-12-03T11:33:58.745 DEBUG:teuthology.orchestra.run.smithi037:> sudo ceph --cluster ceph osd new 4df4c3a4-ebbe-4aee-ab54-08e16bf294ba 3 2023-12-03T11:33:58.765 INFO:tasks.ceph.mgr.x.smithi037.stderr:2023-12-03T11:33:58.764+0000 7f2c40a32040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-03T11:33:58.768 INFO:tasks.ceph.mgr.y.smithi003.stderr:2023-12-03T11:33:58.767+0000 7fcb05632040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-03T11:33:58.812 INFO:tasks.ceph.mgr.y.smithi003.stderr:2023-12-03T11:33:58.811+0000 7fcb05632040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-03T11:33:58.873 INFO:tasks.ceph.mgr.x.smithi037.stderr:2023-12-03T11:33:58.872+0000 7f2c40a32040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-12-03T11:33:58.918 INFO:tasks.ceph.mgr.y.smithi003.stderr:2023-12-03T11:33:58.917+0000 7fcb05632040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-12-03T11:33:58.948 INFO:tasks.ceph.mgr.x.smithi037.stderr:2023-12-03T11:33:58.946+0000 7f2c40a32040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-03T11:33:58.953 INFO:teuthology.orchestra.run.smithi037.stdout:3 2023-12-03T11:33:58.964 DEBUG:teuthology.orchestra.run.smithi037:> sudo ceph --cluster ceph osd new 6b07e955-b242-4c31-8d20-80831c1d0fd3 4 2023-12-03T11:33:58.992 INFO:tasks.ceph.mgr.y.smithi003.stderr:2023-12-03T11:33:58.991+0000 7fcb05632040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-03T11:33:58.997 INFO:tasks.ceph.mgr.x.smithi037.stderr:2023-12-03T11:33:58.996+0000 7f2c40a32040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-03T11:33:59.039 INFO:tasks.ceph.mgr.y.smithi003.stderr:2023-12-03T11:33:59.038+0000 7fcb05632040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-03T11:33:59.053 INFO:tasks.ceph.mgr.x.smithi037.stderr:2023-12-03T11:33:59.052+0000 7f2c40a32040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-03T11:33:59.094 INFO:tasks.ceph.mgr.y.smithi003.stderr:2023-12-03T11:33:59.093+0000 7fcb05632040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-03T11:33:59.121 INFO:tasks.ceph.mgr.x.smithi037.stderr:2023-12-03T11:33:59.119+0000 7f2c40a32040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-03T11:33:59.142 INFO:tasks.ceph.mgr.y.smithi003.stderr:2023-12-03T11:33:59.141+0000 7fcb05632040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-03T11:33:59.242 INFO:teuthology.orchestra.run.smithi037.stdout:4 2023-12-03T11:33:59.253 DEBUG:teuthology.orchestra.run.smithi037:> sudo ceph --cluster ceph osd new 9938502b-e142-4b89-a48a-6c3c9bbca294 5 2023-12-03T11:33:59.484 INFO:teuthology.orchestra.run.smithi037.stdout:5 2023-12-03T11:33:59.495 DEBUG:teuthology.orchestra.run.smithi037:> sudo ceph --cluster ceph osd new b43d611a-db56-44f9-b573-447c982094e9 6 2023-12-03T11:33:59.544 INFO:tasks.ceph.mgr.y.smithi003.stderr:2023-12-03T11:33:59.542+0000 7fcb05632040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-12-03T11:33:59.576 INFO:tasks.ceph.mgr.x.smithi037.stderr:2023-12-03T11:33:59.575+0000 7f2c40a32040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-12-03T11:33:59.685 INFO:teuthology.orchestra.run.smithi037.stdout:6 2023-12-03T11:33:59.686 INFO:tasks.ceph.mgr.y.smithi003.stderr:2023-12-03T11:33:59.685+0000 7fcb05632040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-12-03T11:33:59.696 DEBUG:teuthology.orchestra.run.smithi037:> sudo ceph --cluster ceph osd new 36796be9-0082-4e57-82c4-5cf46cad0a40 7 2023-12-03T11:33:59.721 INFO:tasks.ceph.mgr.x.smithi037.stderr:2023-12-03T11:33:59.720+0000 7f2c40a32040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-12-03T11:33:59.812 INFO:tasks.ceph.mgr.y.smithi003.stderr:2023-12-03T11:33:59.811+0000 7fcb05632040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-03T11:33:59.849 INFO:tasks.ceph.mgr.x.smithi037.stderr:2023-12-03T11:33:59.848+0000 7f2c40a32040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-03T11:33:59.859 INFO:tasks.ceph.mgr.y.smithi003.stderr:2023-12-03T11:33:59.858+0000 7fcb05632040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-03T11:33:59.897 INFO:teuthology.orchestra.run.smithi037.stdout:7 2023-12-03T11:33:59.897 INFO:tasks.ceph.mgr.x.smithi037.stderr:2023-12-03T11:33:59.896+0000 7f2c40a32040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-03T11:33:59.908 INFO:tasks.ceph.osd.0:Restarting daemon 2023-12-03T11:33:59.908 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-12-03T11:33:59.910 INFO:tasks.ceph.osd.0:Started 2023-12-03T11:33:59.910 INFO:tasks.ceph.osd.1:Restarting daemon 2023-12-03T11:33:59.910 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-12-03T11:33:59.912 INFO:tasks.ceph.osd.1:Started 2023-12-03T11:33:59.912 INFO:tasks.ceph.osd.2:Restarting daemon 2023-12-03T11:33:59.912 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-12-03T11:33:59.914 INFO:tasks.ceph.osd.2:Started 2023-12-03T11:33:59.914 INFO:tasks.ceph.osd.3:Restarting daemon 2023-12-03T11:33:59.915 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-12-03T11:33:59.917 INFO:tasks.ceph.osd.3:Started 2023-12-03T11:33:59.917 INFO:tasks.ceph.osd.4:Restarting daemon 2023-12-03T11:33:59.917 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-12-03T11:33:59.950 INFO:tasks.ceph.osd.4:Started 2023-12-03T11:33:59.950 INFO:tasks.ceph.osd.5:Restarting daemon 2023-12-03T11:33:59.951 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-12-03T11:33:59.953 INFO:tasks.ceph.osd.5:Started 2023-12-03T11:33:59.953 INFO:tasks.ceph.osd.6:Restarting daemon 2023-12-03T11:33:59.953 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-12-03T11:33:59.955 INFO:tasks.ceph.osd.6:Started 2023-12-03T11:33:59.955 INFO:tasks.ceph.osd.7:Restarting daemon 2023-12-03T11:33:59.955 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-12-03T11:33:59.957 INFO:tasks.ceph.osd.7:Started 2023-12-03T11:33:59.957 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-03T11:33:59.978 INFO:tasks.ceph.mgr.y.smithi003.stderr:2023-12-03T11:33:59.977+0000 7fcb05632040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-03T11:34:00.010 INFO:tasks.ceph.mgr.x.smithi037.stderr:2023-12-03T11:34:00.009+0000 7f2c40a32040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-03T11:34:00.098 INFO:tasks.ceph.mgr.y.smithi003.stderr:2023-12-03T11:34:00.097+0000 7fcb05632040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-03T11:34:00.117 INFO:tasks.ceph.mgr.x.smithi037.stderr:2023-12-03T11:34:00.115+0000 7f2c40a32040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-03T11:34:00.149 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:34:00.149 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":10,"fsid":"296556de-a4fc-4095-9b6d-0fe813c2865c","created":"2023-12-03T11:33:57.425611+0000","modified":"2023-12-03T11:33:59.893751+0000","last_up_change":"0.000000","last_in_change":"2023-12-03T11:33:59.893751+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"6cb349c1-e98d-4d40-a1c6-719931c2433e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"29af9a08-8d13-4db7-94bf-fa5f8469039f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"22ce18a4-e878-41ef-82c5-52125c0b9f9d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"4df4c3a4-ebbe-4aee-ab54-08e16bf294ba","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"6b07e955-b242-4c31-8d20-80831c1d0fd3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"9938502b-e142-4b89-a48a-6c3c9bbca294","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"b43d611a-db56-44f9-b573-447c982094e9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"36796be9-0082-4e57-82c4-5cf46cad0a40","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-03T11:34:00.161 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-12-03T11:34:00.161 INFO:tasks.ceph:Waiting for OSDs to come up 2023-12-03T11:34:00.246 INFO:tasks.ceph.mgr.y.smithi003.stderr:2023-12-03T11:34:00.245+0000 7fcb05632040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-03T11:34:00.264 INFO:tasks.ceph.mgr.x.smithi037.stderr:2023-12-03T11:34:00.263+0000 7f2c40a32040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-03T11:34:00.291 INFO:tasks.ceph.mgr.y.smithi003.stderr:2023-12-03T11:34:00.290+0000 7fcb05632040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-03T11:34:00.308 INFO:tasks.ceph.mgr.x.smithi037.stderr:2023-12-03T11:34:00.307+0000 7f2c40a32040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-03T11:34:00.438 INFO:tasks.ceph.mgr.y.smithi003.stderr:2023-12-03T11:34:00.437+0000 7fcb05632040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-03T11:34:00.456 INFO:tasks.ceph.mgr.x.smithi037.stderr:2023-12-03T11:34:00.454+0000 7f2c40a32040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-03T11:34:00.532 INFO:tasks.ceph.osd.2.smithi003.stderr:2023-12-03T11:34:00.531+0000 7f138bed4500 -1 Falling back to public interface 2023-12-03T11:34:00.535 INFO:tasks.ceph.osd.0.smithi003.stderr:2023-12-03T11:34:00.534+0000 7f13707f9500 -1 Falling back to public interface 2023-12-03T11:34:00.540 INFO:tasks.ceph.osd.3.smithi003.stderr:2023-12-03T11:34:00.538+0000 7fa1de22a500 -1 Falling back to public interface 2023-12-03T11:34:00.540 INFO:tasks.ceph.osd.1.smithi003.stderr:2023-12-03T11:34:00.539+0000 7f25125e2500 -1 Falling back to public interface 2023-12-03T11:34:00.560 INFO:tasks.ceph.osd.4.smithi037.stderr:2023-12-03T11:34:00.559+0000 7fb10f8b2500 -1 Falling back to public interface 2023-12-03T11:34:00.561 INFO:tasks.ceph.osd.5.smithi037.stderr:2023-12-03T11:34:00.560+0000 7f2ef7110500 -1 Falling back to public interface 2023-12-03T11:34:00.561 INFO:tasks.ceph.osd.5.smithi037.stderr:2023-12-03T11:34:00.560+0000 7f2ef60b7640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6804/0: (98) Address already in use 2023-12-03T11:34:00.582 INFO:tasks.ceph.osd.6.smithi037.stderr:2023-12-03T11:34:00.581+0000 7fc814e98500 -1 Falling back to public interface 2023-12-03T11:34:00.583 INFO:tasks.ceph.osd.7.smithi037.stderr:2023-12-03T11:34:00.581+0000 7ffbf6a49500 -1 Falling back to public interface 2023-12-03T11:34:00.583 INFO:tasks.ceph.osd.7.smithi037.stderr:2023-12-03T11:34:00.582+0000 7ffbf59f0640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6816/0: (98) Address already in use 2023-12-03T11:34:00.584 INFO:tasks.ceph.osd.7.smithi037.stderr:2023-12-03T11:34:00.583+0000 7ffbf59f0640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6820/0: (98) Address already in use 2023-12-03T11:34:00.585 INFO:tasks.ceph.osd.7.smithi037.stderr:2023-12-03T11:34:00.584+0000 7ffbf59f0640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6824/0: (98) Address already in use 2023-12-03T11:34:00.585 INFO:tasks.ceph.osd.7.smithi037.stderr:2023-12-03T11:34:00.584+0000 7ffbf59f0640 -1 PosixStack listen unable to listen on v1:0.0.0.0:6826/0: (98) Address already in use 2023-12-03T11:34:00.586 INFO:tasks.ceph.osd.7.smithi037.stderr:2023-12-03T11:34:00.585+0000 7ffbf59f0640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6828/0: (98) Address already in use 2023-12-03T11:34:00.966 DEBUG:teuthology.orchestra.run.smithi003:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-12-03T11:34:01.130 INFO:teuthology.misc.health.smithi003.stdout: 2023-12-03T11:34:01.130 INFO:teuthology.misc.health.smithi003.stdout:{"epoch":10,"fsid":"296556de-a4fc-4095-9b6d-0fe813c2865c","created":"2023-12-03T11:33:57.425611+0000","modified":"2023-12-03T11:33:59.893751+0000","last_up_change":"0.000000","last_in_change":"2023-12-03T11:33:59.893751+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"6cb349c1-e98d-4d40-a1c6-719931c2433e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"29af9a08-8d13-4db7-94bf-fa5f8469039f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"22ce18a4-e878-41ef-82c5-52125c0b9f9d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"4df4c3a4-ebbe-4aee-ab54-08e16bf294ba","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"6b07e955-b242-4c31-8d20-80831c1d0fd3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"9938502b-e142-4b89-a48a-6c3c9bbca294","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"b43d611a-db56-44f9-b573-447c982094e9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"36796be9-0082-4e57-82c4-5cf46cad0a40","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-03T11:34:01.140 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-12-03T11:34:01.284 INFO:tasks.ceph.mgr.x.smithi037.stderr:2023-12-03T11:34:01.283+0000 7f2c40a32040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-03T11:34:01.292 INFO:tasks.ceph.mgr.y.smithi003.stderr:2023-12-03T11:34:01.291+0000 7fcb05632040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-03T11:34:01.568 INFO:tasks.ceph.mgr.x.smithi037.stderr:2023-12-03T11:34:01.566+0000 7f2c40a32040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-03T11:34:01.578 INFO:tasks.ceph.mgr.y.smithi003.stderr:2023-12-03T11:34:01.577+0000 7fcb05632040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-03T11:34:01.621 INFO:tasks.ceph.mgr.x.smithi037.stderr:2023-12-03T11:34:01.620+0000 7f2c40a32040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-03T11:34:01.632 INFO:tasks.ceph.mgr.y.smithi003.stderr:2023-12-03T11:34:01.631+0000 7fcb05632040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-03T11:34:01.726 INFO:tasks.ceph.mgr.x.smithi037.stderr:2023-12-03T11:34:01.725+0000 7f2c40a32040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-03T11:34:01.737 INFO:tasks.ceph.mgr.y.smithi003.stderr:2023-12-03T11:34:01.736+0000 7fcb05632040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-03T11:34:02.752 INFO:tasks.ceph.mgr.x.smithi037.stderr:2023-12-03T11:34:02.751+0000 7f2be16d7640 -1 mgr.server handle_report got status from non-daemon mon.b 2023-12-03T11:34:02.753 INFO:tasks.ceph.mgr.x.smithi037.stderr:2023-12-03T11:34:02.751+0000 7f2be16d7640 -1 mgr.server handle_report got status from non-daemon mon.c 2023-12-03T11:34:03.997 INFO:tasks.ceph.osd.2.smithi003.stderr:2023-12-03T11:34:03.996+0000 7f138bed4500 -1 osd.2 0 log_to_monitors true 2023-12-03T11:34:04.017 INFO:tasks.ceph.osd.5.smithi037.stderr:2023-12-03T11:34:04.015+0000 7f2ef7110500 -1 osd.5 0 log_to_monitors true 2023-12-03T11:34:04.056 INFO:tasks.ceph.osd.0.smithi003.stderr:2023-12-03T11:34:04.054+0000 7f13707f9500 -1 osd.0 0 log_to_monitors true 2023-12-03T11:34:04.069 INFO:tasks.ceph.osd.4.smithi037.stderr:2023-12-03T11:34:04.068+0000 7fb10f8b2500 -1 osd.4 0 log_to_monitors true 2023-12-03T11:34:04.072 INFO:tasks.ceph.osd.1.smithi003.stderr:2023-12-03T11:34:04.071+0000 7f25125e2500 -1 osd.1 0 log_to_monitors true 2023-12-03T11:34:04.074 INFO:tasks.ceph.osd.3.smithi003.stderr:2023-12-03T11:34:04.073+0000 7fa1de22a500 -1 osd.3 0 log_to_monitors true 2023-12-03T11:34:04.094 INFO:tasks.ceph.osd.7.smithi037.stderr:2023-12-03T11:34:04.093+0000 7ffbf6a49500 -1 osd.7 0 log_to_monitors true 2023-12-03T11:34:04.100 INFO:tasks.ceph.osd.6.smithi037.stderr:2023-12-03T11:34:04.100+0000 7fc814e98500 -1 osd.6 0 log_to_monitors true 2023-12-03T11:34:07.876 INFO:tasks.ceph.osd.7.smithi037.stderr:2023-12-03T11:34:07.875+0000 7ffbf21b4640 -1 osd.7 0 waiting for initial osdmap 2023-12-03T11:34:07.889 INFO:tasks.ceph.osd.7.smithi037.stderr:2023-12-03T11:34:07.889+0000 7ffbea7ec640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-03T11:34:07.898 INFO:tasks.ceph.osd.0.smithi003.stderr:2023-12-03T11:34:07.897+0000 7f136bf64640 -1 osd.0 0 waiting for initial osdmap 2023-12-03T11:34:07.908 INFO:tasks.ceph.osd.3.smithi003.stderr:2023-12-03T11:34:07.907+0000 7fa1d8eed640 -1 osd.3 0 waiting for initial osdmap 2023-12-03T11:34:07.911 INFO:tasks.ceph.osd.2.smithi003.stderr:2023-12-03T11:34:07.910+0000 7f138763f640 -1 osd.2 0 waiting for initial osdmap 2023-12-03T11:34:07.912 INFO:tasks.ceph.osd.0.smithi003.stderr:2023-12-03T11:34:07.911+0000 7f136459c640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-03T11:34:07.915 INFO:tasks.ceph.osd.5.smithi037.stderr:2023-12-03T11:34:07.915+0000 7f2ef287b640 -1 osd.5 0 waiting for initial osdmap 2023-12-03T11:34:07.921 INFO:tasks.ceph.osd.6.smithi037.stderr:2023-12-03T11:34:07.921+0000 7fc810603640 -1 osd.6 0 waiting for initial osdmap 2023-12-03T11:34:07.923 INFO:tasks.ceph.osd.3.smithi003.stderr:2023-12-03T11:34:07.922+0000 7fa1d1525640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-03T11:34:07.926 INFO:tasks.ceph.osd.2.smithi003.stderr:2023-12-03T11:34:07.925+0000 7f137fc77640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-03T11:34:07.931 INFO:tasks.ceph.osd.5.smithi037.stderr:2023-12-03T11:34:07.931+0000 7f2eeaeb3640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-03T11:34:07.934 INFO:tasks.ceph.osd.6.smithi037.stderr:2023-12-03T11:34:07.934+0000 7fc808c3b640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-03T11:34:07.934 INFO:tasks.ceph.osd.4.smithi037.stderr:2023-12-03T11:34:07.934+0000 7fb10c855640 -1 osd.4 0 waiting for initial osdmap 2023-12-03T11:34:07.935 INFO:tasks.ceph.osd.1.smithi003.stderr:2023-12-03T11:34:07.934+0000 7f250dd4f640 -1 osd.1 0 waiting for initial osdmap 2023-12-03T11:34:07.946 DEBUG:teuthology.orchestra.run.smithi003:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-12-03T11:34:07.947 INFO:tasks.ceph.osd.1.smithi003.stderr:2023-12-03T11:34:07.946+0000 7f2506387640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-03T11:34:07.950 INFO:tasks.ceph.osd.4.smithi037.stderr:2023-12-03T11:34:07.950+0000 7fb103655640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-03T11:34:08.230 INFO:teuthology.misc.health.smithi003.stdout: 2023-12-03T11:34:08.230 INFO:teuthology.misc.health.smithi003.stdout:{"epoch":12,"fsid":"296556de-a4fc-4095-9b6d-0fe813c2865c","created":"2023-12-03T11:33:57.425611+0000","modified":"2023-12-03T11:34:05.755889+0000","last_up_change":"0.000000","last_in_change":"2023-12-03T11:33:59.893751+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"6cb349c1-e98d-4d40-a1c6-719931c2433e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"29af9a08-8d13-4db7-94bf-fa5f8469039f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"22ce18a4-e878-41ef-82c5-52125c0b9f9d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"4df4c3a4-ebbe-4aee-ab54-08e16bf294ba","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"6b07e955-b242-4c31-8d20-80831c1d0fd3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"9938502b-e142-4b89-a48a-6c3c9bbca294","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"b43d611a-db56-44f9-b573-447c982094e9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"36796be9-0082-4e57-82c4-5cf46cad0a40","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-03T11:34:08.241 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-12-03T11:34:15.048 DEBUG:teuthology.orchestra.run.smithi003:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-12-03T11:34:15.341 INFO:teuthology.misc.health.smithi003.stdout: 2023-12-03T11:34:15.342 INFO:teuthology.misc.health.smithi003.stdout:{"epoch":16,"fsid":"296556de-a4fc-4095-9b6d-0fe813c2865c","created":"2023-12-03T11:33:57.425611+0000","modified":"2023-12-03T11:34:11.921063+0000","last_up_change":"2023-12-03T11:34:08.901760+0000","last_in_change":"2023-12-03T11:33:59.893751+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-03T11:34:09.771483+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6cb349c1-e98d-4d40-a1c6-719931c2433e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":263125788},{"type":"v1","addr":"172.21.15.3:6809","nonce":263125788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6810","nonce":263125788},{"type":"v1","addr":"172.21.15.3:6811","nonce":263125788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":263125788},{"type":"v1","addr":"172.21.15.3:6815","nonce":263125788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6812","nonce":263125788},{"type":"v1","addr":"172.21.15.3:6813","nonce":263125788}]},"public_addr":"172.21.15.3:6809/263125788","cluster_addr":"172.21.15.3:6811/263125788","heartbeat_back_addr":"172.21.15.3:6815/263125788","heartbeat_front_addr":"172.21.15.3:6813/263125788","state":["exists","up"]},{"osd":1,"uuid":"29af9a08-8d13-4db7-94bf-fa5f8469039f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6816","nonce":2638197404},{"type":"v1","addr":"172.21.15.3:6818","nonce":2638197404}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6820","nonce":2638197404},{"type":"v1","addr":"172.21.15.3:6821","nonce":2638197404}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6827","nonce":2638197404},{"type":"v1","addr":"172.21.15.3:6829","nonce":2638197404}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6823","nonce":2638197404},{"type":"v1","addr":"172.21.15.3:6825","nonce":2638197404}]},"public_addr":"172.21.15.3:6818/2638197404","cluster_addr":"172.21.15.3:6821/2638197404","heartbeat_back_addr":"172.21.15.3:6829/2638197404","heartbeat_front_addr":"172.21.15.3:6825/2638197404","state":["exists","up"]},{"osd":2,"uuid":"22ce18a4-e878-41ef-82c5-52125c0b9f9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":2373485412},{"type":"v1","addr":"172.21.15.3:6801","nonce":2373485412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":2373485412},{"type":"v1","addr":"172.21.15.3:6803","nonce":2373485412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6806","nonce":2373485412},{"type":"v1","addr":"172.21.15.3:6807","nonce":2373485412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":2373485412},{"type":"v1","addr":"172.21.15.3:6805","nonce":2373485412}]},"public_addr":"172.21.15.3:6801/2373485412","cluster_addr":"172.21.15.3:6803/2373485412","heartbeat_back_addr":"172.21.15.3:6807/2373485412","heartbeat_front_addr":"172.21.15.3:6805/2373485412","state":["exists","up"]},{"osd":3,"uuid":"4df4c3a4-ebbe-4aee-ab54-08e16bf294ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6817","nonce":3356208405},{"type":"v1","addr":"172.21.15.3:6819","nonce":3356208405}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6822","nonce":3356208405},{"type":"v1","addr":"172.21.15.3:6824","nonce":3356208405}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6830","nonce":3356208405},{"type":"v1","addr":"172.21.15.3:6831","nonce":3356208405}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":3356208405},{"type":"v1","addr":"172.21.15.3:6828","nonce":3356208405}]},"public_addr":"172.21.15.3:6819/3356208405","cluster_addr":"172.21.15.3:6824/3356208405","heartbeat_back_addr":"172.21.15.3:6831/3356208405","heartbeat_front_addr":"172.21.15.3:6828/3356208405","state":["exists","up"]},{"osd":4,"uuid":"6b07e955-b242-4c31-8d20-80831c1d0fd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1554898664},{"type":"v1","addr":"172.21.15.37:6801","nonce":1554898664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1554898664},{"type":"v1","addr":"172.21.15.37:6803","nonce":1554898664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1554898664},{"type":"v1","addr":"172.21.15.37:6810","nonce":1554898664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1554898664},{"type":"v1","addr":"172.21.15.37:6806","nonce":1554898664}]},"public_addr":"172.21.15.37:6801/1554898664","cluster_addr":"172.21.15.37:6803/1554898664","heartbeat_back_addr":"172.21.15.37:6810/1554898664","heartbeat_front_addr":"172.21.15.37:6806/1554898664","state":["exists","up"]},{"osd":5,"uuid":"9938502b-e142-4b89-a48a-6c3c9bbca294","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6805","nonce":1692844418},{"type":"v1","addr":"172.21.15.37:6807","nonce":1692844418}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6809","nonce":1692844418},{"type":"v1","addr":"172.21.15.37:6811","nonce":1692844418}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1692844418},{"type":"v1","addr":"172.21.15.37:6815","nonce":1692844418}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1692844418},{"type":"v1","addr":"172.21.15.37:6813","nonce":1692844418}]},"public_addr":"172.21.15.37:6807/1692844418","cluster_addr":"172.21.15.37:6811/1692844418","heartbeat_back_addr":"172.21.15.37:6815/1692844418","heartbeat_front_addr":"172.21.15.37:6813/1692844418","state":["exists","up"]},{"osd":6,"uuid":"b43d611a-db56-44f9-b573-447c982094e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":3770469300},{"type":"v1","addr":"172.21.15.37:6818","nonce":3770469300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3770469300},{"type":"v1","addr":"172.21.15.37:6822","nonce":3770469300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":3770469300},{"type":"v1","addr":"172.21.15.37:6831","nonce":3770469300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":3770469300},{"type":"v1","addr":"172.21.15.37:6826","nonce":3770469300}]},"public_addr":"172.21.15.37:6818/3770469300","cluster_addr":"172.21.15.37:6822/3770469300","heartbeat_back_addr":"172.21.15.37:6831/3770469300","heartbeat_front_addr":"172.21.15.37:6826/3770469300","state":["exists","up"]},{"osd":7,"uuid":"36796be9-0082-4e57-82c4-5cf46cad0a40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6817","nonce":511039327},{"type":"v1","addr":"172.21.15.37:6819","nonce":511039327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":511039327},{"type":"v1","addr":"172.21.15.37:6823","nonce":511039327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6829","nonce":511039327},{"type":"v1","addr":"172.21.15.37:6830","nonce":511039327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":511039327},{"type":"v1","addr":"172.21.15.37:6827","nonce":511039327}]},"public_addr":"172.21.15.37:6819/511039327","cluster_addr":"172.21.15.37:6823/511039327","heartbeat_back_addr":"172.21.15.37:6830/511039327","heartbeat_front_addr":"172.21.15.37:6827/511039327","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-03T11:34:05.045727+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-03T11:34:05.084173+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-03T11:34:05.020910+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-03T11:34:05.036173+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-03T11:34:05.093500+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-03T11:34:04.976342+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-03T11:34:05.113351+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-03T11:34:05.048972+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-03T11:34:15.352 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-12-03T11:34:15.353 INFO:tasks.ceph:Creating RBD pool 2023-12-03T11:34:15.353 DEBUG:teuthology.orchestra.run.smithi003:> sudo ceph --cluster ceph osd pool create rbd 8 2023-12-03T11:34:16.361 INFO:teuthology.orchestra.run.smithi003.stderr:pool 'rbd' created 2023-12-03T11:34:16.379 DEBUG:teuthology.orchestra.run.smithi003:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-12-03T11:34:17.374 INFO:teuthology.orchestra.run.smithi003.stderr:enabled application 'rbd' on pool 'rbd' 2023-12-03T11:34:17.391 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-12-03T11:34:17.391 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-12-03T11:34:17.391 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-12-03T11:34:17.391 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-12-03T11:34:17.392 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-12-03T11:34:17.743 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:34:17.753 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":5,"active_gid":4110,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":2165065416},{"type":"v1","addr":"172.21.15.37:6833","nonce":2165065416}]},"active_addr":"172.21.15.37:6833/2165065416","active_change":"2023-12-03T11:34:01.739103+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4104,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.37:0","nonce":4229748252}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.37:0","nonce":3332934561}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.37:0","nonce":3619571373}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.37:0","nonce":2011881494}]}]} 2023-12-03T11:34:17.757 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-12-03T11:34:17.757 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-12-03T11:34:17.757 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-03T11:34:18.052 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:34:18.052 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":18,"fsid":"296556de-a4fc-4095-9b6d-0fe813c2865c","created":"2023-12-03T11:33:57.425611+0000","modified":"2023-12-03T11:34:17.361339+0000","last_up_change":"2023-12-03T11:34:08.901760+0000","last_in_change":"2023-12-03T11:33:59.893751+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-03T11:34:09.771483+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-12-03T11:34:15.645357+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6cb349c1-e98d-4d40-a1c6-719931c2433e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":263125788},{"type":"v1","addr":"172.21.15.3:6809","nonce":263125788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6810","nonce":263125788},{"type":"v1","addr":"172.21.15.3:6811","nonce":263125788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":263125788},{"type":"v1","addr":"172.21.15.3:6815","nonce":263125788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6812","nonce":263125788},{"type":"v1","addr":"172.21.15.3:6813","nonce":263125788}]},"public_addr":"172.21.15.3:6809/263125788","cluster_addr":"172.21.15.3:6811/263125788","heartbeat_back_addr":"172.21.15.3:6815/263125788","heartbeat_front_addr":"172.21.15.3:6813/263125788","state":["exists","up"]},{"osd":1,"uuid":"29af9a08-8d13-4db7-94bf-fa5f8469039f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6816","nonce":2638197404},{"type":"v1","addr":"172.21.15.3:6818","nonce":2638197404}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6820","nonce":2638197404},{"type":"v1","addr":"172.21.15.3:6821","nonce":2638197404}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6827","nonce":2638197404},{"type":"v1","addr":"172.21.15.3:6829","nonce":2638197404}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6823","nonce":2638197404},{"type":"v1","addr":"172.21.15.3:6825","nonce":2638197404}]},"public_addr":"172.21.15.3:6818/2638197404","cluster_addr":"172.21.15.3:6821/2638197404","heartbeat_back_addr":"172.21.15.3:6829/2638197404","heartbeat_front_addr":"172.21.15.3:6825/2638197404","state":["exists","up"]},{"osd":2,"uuid":"22ce18a4-e878-41ef-82c5-52125c0b9f9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":2373485412},{"type":"v1","addr":"172.21.15.3:6801","nonce":2373485412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":2373485412},{"type":"v1","addr":"172.21.15.3:6803","nonce":2373485412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6806","nonce":2373485412},{"type":"v1","addr":"172.21.15.3:6807","nonce":2373485412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":2373485412},{"type":"v1","addr":"172.21.15.3:6805","nonce":2373485412}]},"public_addr":"172.21.15.3:6801/2373485412","cluster_addr":"172.21.15.3:6803/2373485412","heartbeat_back_addr":"172.21.15.3:6807/2373485412","heartbeat_front_addr":"172.21.15.3:6805/2373485412","state":["exists","up"]},{"osd":3,"uuid":"4df4c3a4-ebbe-4aee-ab54-08e16bf294ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6817","nonce":3356208405},{"type":"v1","addr":"172.21.15.3:6819","nonce":3356208405}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6822","nonce":3356208405},{"type":"v1","addr":"172.21.15.3:6824","nonce":3356208405}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6830","nonce":3356208405},{"type":"v1","addr":"172.21.15.3:6831","nonce":3356208405}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":3356208405},{"type":"v1","addr":"172.21.15.3:6828","nonce":3356208405}]},"public_addr":"172.21.15.3:6819/3356208405","cluster_addr":"172.21.15.3:6824/3356208405","heartbeat_back_addr":"172.21.15.3:6831/3356208405","heartbeat_front_addr":"172.21.15.3:6828/3356208405","state":["exists","up"]},{"osd":4,"uuid":"6b07e955-b242-4c31-8d20-80831c1d0fd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1554898664},{"type":"v1","addr":"172.21.15.37:6801","nonce":1554898664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1554898664},{"type":"v1","addr":"172.21.15.37:6803","nonce":1554898664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1554898664},{"type":"v1","addr":"172.21.15.37:6810","nonce":1554898664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1554898664},{"type":"v1","addr":"172.21.15.37:6806","nonce":1554898664}]},"public_addr":"172.21.15.37:6801/1554898664","cluster_addr":"172.21.15.37:6803/1554898664","heartbeat_back_addr":"172.21.15.37:6810/1554898664","heartbeat_front_addr":"172.21.15.37:6806/1554898664","state":["exists","up"]},{"osd":5,"uuid":"9938502b-e142-4b89-a48a-6c3c9bbca294","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6805","nonce":1692844418},{"type":"v1","addr":"172.21.15.37:6807","nonce":1692844418}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6809","nonce":1692844418},{"type":"v1","addr":"172.21.15.37:6811","nonce":1692844418}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1692844418},{"type":"v1","addr":"172.21.15.37:6815","nonce":1692844418}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1692844418},{"type":"v1","addr":"172.21.15.37:6813","nonce":1692844418}]},"public_addr":"172.21.15.37:6807/1692844418","cluster_addr":"172.21.15.37:6811/1692844418","heartbeat_back_addr":"172.21.15.37:6815/1692844418","heartbeat_front_addr":"172.21.15.37:6813/1692844418","state":["exists","up"]},{"osd":6,"uuid":"b43d611a-db56-44f9-b573-447c982094e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":3770469300},{"type":"v1","addr":"172.21.15.37:6818","nonce":3770469300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3770469300},{"type":"v1","addr":"172.21.15.37:6822","nonce":3770469300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":3770469300},{"type":"v1","addr":"172.21.15.37:6831","nonce":3770469300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":3770469300},{"type":"v1","addr":"172.21.15.37:6826","nonce":3770469300}]},"public_addr":"172.21.15.37:6818/3770469300","cluster_addr":"172.21.15.37:6822/3770469300","heartbeat_back_addr":"172.21.15.37:6831/3770469300","heartbeat_front_addr":"172.21.15.37:6826/3770469300","state":["exists","up"]},{"osd":7,"uuid":"36796be9-0082-4e57-82c4-5cf46cad0a40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6817","nonce":511039327},{"type":"v1","addr":"172.21.15.37:6819","nonce":511039327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":511039327},{"type":"v1","addr":"172.21.15.37:6823","nonce":511039327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6829","nonce":511039327},{"type":"v1","addr":"172.21.15.37:6830","nonce":511039327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":511039327},{"type":"v1","addr":"172.21.15.37:6827","nonce":511039327}]},"public_addr":"172.21.15.37:6819/511039327","cluster_addr":"172.21.15.37:6823/511039327","heartbeat_back_addr":"172.21.15.37:6830/511039327","heartbeat_front_addr":"172.21.15.37:6827/511039327","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-03T11:34:05.045727+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-03T11:34:05.084173+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-03T11:34:05.020910+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-03T11:34:05.036173+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-03T11:34:05.093500+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-03T11:34:04.976342+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-03T11:34:05.113351+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-03T11:34:05.048972+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-03T11:34:18.065 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-12-03T11:34:18.065 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-03T11:34:18.358 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:34:18.359 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":18,"fsid":"296556de-a4fc-4095-9b6d-0fe813c2865c","created":"2023-12-03T11:33:57.425611+0000","modified":"2023-12-03T11:34:17.361339+0000","last_up_change":"2023-12-03T11:34:08.901760+0000","last_in_change":"2023-12-03T11:33:59.893751+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-03T11:34:09.771483+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-12-03T11:34:15.645357+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6cb349c1-e98d-4d40-a1c6-719931c2433e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":263125788},{"type":"v1","addr":"172.21.15.3:6809","nonce":263125788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6810","nonce":263125788},{"type":"v1","addr":"172.21.15.3:6811","nonce":263125788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":263125788},{"type":"v1","addr":"172.21.15.3:6815","nonce":263125788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6812","nonce":263125788},{"type":"v1","addr":"172.21.15.3:6813","nonce":263125788}]},"public_addr":"172.21.15.3:6809/263125788","cluster_addr":"172.21.15.3:6811/263125788","heartbeat_back_addr":"172.21.15.3:6815/263125788","heartbeat_front_addr":"172.21.15.3:6813/263125788","state":["exists","up"]},{"osd":1,"uuid":"29af9a08-8d13-4db7-94bf-fa5f8469039f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6816","nonce":2638197404},{"type":"v1","addr":"172.21.15.3:6818","nonce":2638197404}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6820","nonce":2638197404},{"type":"v1","addr":"172.21.15.3:6821","nonce":2638197404}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6827","nonce":2638197404},{"type":"v1","addr":"172.21.15.3:6829","nonce":2638197404}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6823","nonce":2638197404},{"type":"v1","addr":"172.21.15.3:6825","nonce":2638197404}]},"public_addr":"172.21.15.3:6818/2638197404","cluster_addr":"172.21.15.3:6821/2638197404","heartbeat_back_addr":"172.21.15.3:6829/2638197404","heartbeat_front_addr":"172.21.15.3:6825/2638197404","state":["exists","up"]},{"osd":2,"uuid":"22ce18a4-e878-41ef-82c5-52125c0b9f9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":2373485412},{"type":"v1","addr":"172.21.15.3:6801","nonce":2373485412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":2373485412},{"type":"v1","addr":"172.21.15.3:6803","nonce":2373485412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6806","nonce":2373485412},{"type":"v1","addr":"172.21.15.3:6807","nonce":2373485412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":2373485412},{"type":"v1","addr":"172.21.15.3:6805","nonce":2373485412}]},"public_addr":"172.21.15.3:6801/2373485412","cluster_addr":"172.21.15.3:6803/2373485412","heartbeat_back_addr":"172.21.15.3:6807/2373485412","heartbeat_front_addr":"172.21.15.3:6805/2373485412","state":["exists","up"]},{"osd":3,"uuid":"4df4c3a4-ebbe-4aee-ab54-08e16bf294ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6817","nonce":3356208405},{"type":"v1","addr":"172.21.15.3:6819","nonce":3356208405}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6822","nonce":3356208405},{"type":"v1","addr":"172.21.15.3:6824","nonce":3356208405}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6830","nonce":3356208405},{"type":"v1","addr":"172.21.15.3:6831","nonce":3356208405}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":3356208405},{"type":"v1","addr":"172.21.15.3:6828","nonce":3356208405}]},"public_addr":"172.21.15.3:6819/3356208405","cluster_addr":"172.21.15.3:6824/3356208405","heartbeat_back_addr":"172.21.15.3:6831/3356208405","heartbeat_front_addr":"172.21.15.3:6828/3356208405","state":["exists","up"]},{"osd":4,"uuid":"6b07e955-b242-4c31-8d20-80831c1d0fd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1554898664},{"type":"v1","addr":"172.21.15.37:6801","nonce":1554898664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1554898664},{"type":"v1","addr":"172.21.15.37:6803","nonce":1554898664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1554898664},{"type":"v1","addr":"172.21.15.37:6810","nonce":1554898664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1554898664},{"type":"v1","addr":"172.21.15.37:6806","nonce":1554898664}]},"public_addr":"172.21.15.37:6801/1554898664","cluster_addr":"172.21.15.37:6803/1554898664","heartbeat_back_addr":"172.21.15.37:6810/1554898664","heartbeat_front_addr":"172.21.15.37:6806/1554898664","state":["exists","up"]},{"osd":5,"uuid":"9938502b-e142-4b89-a48a-6c3c9bbca294","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6805","nonce":1692844418},{"type":"v1","addr":"172.21.15.37:6807","nonce":1692844418}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6809","nonce":1692844418},{"type":"v1","addr":"172.21.15.37:6811","nonce":1692844418}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1692844418},{"type":"v1","addr":"172.21.15.37:6815","nonce":1692844418}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1692844418},{"type":"v1","addr":"172.21.15.37:6813","nonce":1692844418}]},"public_addr":"172.21.15.37:6807/1692844418","cluster_addr":"172.21.15.37:6811/1692844418","heartbeat_back_addr":"172.21.15.37:6815/1692844418","heartbeat_front_addr":"172.21.15.37:6813/1692844418","state":["exists","up"]},{"osd":6,"uuid":"b43d611a-db56-44f9-b573-447c982094e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":3770469300},{"type":"v1","addr":"172.21.15.37:6818","nonce":3770469300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3770469300},{"type":"v1","addr":"172.21.15.37:6822","nonce":3770469300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":3770469300},{"type":"v1","addr":"172.21.15.37:6831","nonce":3770469300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":3770469300},{"type":"v1","addr":"172.21.15.37:6826","nonce":3770469300}]},"public_addr":"172.21.15.37:6818/3770469300","cluster_addr":"172.21.15.37:6822/3770469300","heartbeat_back_addr":"172.21.15.37:6831/3770469300","heartbeat_front_addr":"172.21.15.37:6826/3770469300","state":["exists","up"]},{"osd":7,"uuid":"36796be9-0082-4e57-82c4-5cf46cad0a40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6817","nonce":511039327},{"type":"v1","addr":"172.21.15.37:6819","nonce":511039327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":511039327},{"type":"v1","addr":"172.21.15.37:6823","nonce":511039327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6829","nonce":511039327},{"type":"v1","addr":"172.21.15.37:6830","nonce":511039327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":511039327},{"type":"v1","addr":"172.21.15.37:6827","nonce":511039327}]},"public_addr":"172.21.15.37:6819/511039327","cluster_addr":"172.21.15.37:6823/511039327","heartbeat_back_addr":"172.21.15.37:6830/511039327","heartbeat_front_addr":"172.21.15.37:6827/511039327","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-03T11:34:05.045727+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-03T11:34:05.084173+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-03T11:34:05.020910+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-03T11:34:05.036173+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-03T11:34:05.093500+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-03T11:34:04.976342+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-03T11:34:05.113351+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-03T11:34:05.048972+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-03T11:34:18.371 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-12-03T11:34:18.372 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-12-03T11:34:18.372 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-12-03T11:34:18.373 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-12-03T11:34:18.373 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-12-03T11:34:18.373 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-12-03T11:34:18.374 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-12-03T11:34:18.374 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-12-03T11:34:18.636 INFO:teuthology.orchestra.run.smithi003.stdout:55834574853 2023-12-03T11:34:18.637 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-12-03T11:34:18.640 INFO:teuthology.orchestra.run.smithi003.stdout:55834574852 2023-12-03T11:34:18.640 INFO:teuthology.orchestra.run.smithi003.stdout:55834574852 2023-12-03T11:34:18.641 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-12-03T11:34:18.641 INFO:teuthology.orchestra.run.smithi003.stdout:55834574854 2023-12-03T11:34:18.642 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-12-03T11:34:18.642 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-12-03T11:34:18.643 INFO:teuthology.orchestra.run.smithi003.stdout:55834574853 2023-12-03T11:34:18.643 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-12-03T11:34:18.644 INFO:teuthology.orchestra.run.smithi003.stdout:55834574851 2023-12-03T11:34:18.644 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-12-03T11:34:18.645 INFO:teuthology.orchestra.run.smithi003.stdout:55834574852 2023-12-03T11:34:18.646 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-12-03T11:34:18.646 INFO:teuthology.orchestra.run.smithi003.stdout:55834574852 2023-12-03T11:34:18.647 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-12-03T11:34:19.215 INFO:teuthology.orchestra.run.smithi003.stdout:55834574852 2023-12-03T11:34:19.234 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.7 2023-12-03T11:34:19.258 INFO:teuthology.orchestra.run.smithi003.stdout:55834574851 2023-12-03T11:34:19.271 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.2 2023-12-03T11:34:19.293 INFO:teuthology.orchestra.run.smithi003.stdout:55834574851 2023-12-03T11:34:19.304 INFO:teuthology.orchestra.run.smithi003.stdout:55834574852 2023-12-03T11:34:19.307 INFO:teuthology.orchestra.run.smithi003.stdout:55834574853 2023-12-03T11:34:19.308 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.3 2023-12-03T11:34:19.310 INFO:teuthology.orchestra.run.smithi003.stdout:55834574851 2023-12-03T11:34:19.311 INFO:teuthology.orchestra.run.smithi003.stdout:55834574851 2023-12-03T11:34:19.313 INFO:teuthology.orchestra.run.smithi003.stdout:55834574850 2023-12-03T11:34:19.324 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.1 2023-12-03T11:34:19.326 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.6 2023-12-03T11:34:19.329 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.4 2023-12-03T11:34:19.332 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.5 2023-12-03T11:34:19.334 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574850 for osd.0 2023-12-03T11:34:20.235 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-12-03T11:34:20.272 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-12-03T11:34:20.309 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-12-03T11:34:20.325 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-12-03T11:34:20.327 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-12-03T11:34:20.330 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-12-03T11:34:20.333 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-12-03T11:34:20.335 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-12-03T11:34:20.793 INFO:teuthology.orchestra.run.smithi003.stdout:55834574853 2023-12-03T11:34:20.815 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.7 2023-12-03T11:34:20.815 DEBUG:teuthology.parallel:result is None 2023-12-03T11:34:20.832 INFO:teuthology.orchestra.run.smithi003.stdout:55834574852 2023-12-03T11:34:20.845 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.2 2023-12-03T11:34:20.845 DEBUG:teuthology.parallel:result is None 2023-12-03T11:34:20.915 INFO:teuthology.orchestra.run.smithi003.stdout:55834574852 2023-12-03T11:34:20.930 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.3 2023-12-03T11:34:20.930 DEBUG:teuthology.parallel:result is None 2023-12-03T11:34:20.945 INFO:teuthology.orchestra.run.smithi003.stdout:55834574853 2023-12-03T11:34:20.958 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.1 2023-12-03T11:34:20.958 DEBUG:teuthology.parallel:result is None 2023-12-03T11:34:20.980 INFO:teuthology.orchestra.run.smithi003.stdout:55834574852 2023-12-03T11:34:20.990 INFO:teuthology.orchestra.run.smithi003.stdout:55834574852 2023-12-03T11:34:20.991 INFO:teuthology.orchestra.run.smithi003.stdout:55834574851 2023-12-03T11:34:20.992 INFO:teuthology.orchestra.run.smithi003.stdout:55834574854 2023-12-03T11:34:20.997 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.5 2023-12-03T11:34:20.997 DEBUG:teuthology.parallel:result is None 2023-12-03T11:34:21.006 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.4 2023-12-03T11:34:21.007 DEBUG:teuthology.parallel:result is None 2023-12-03T11:34:21.007 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574851 for osd.0 2023-12-03T11:34:21.008 DEBUG:teuthology.parallel:result is None 2023-12-03T11:34:21.008 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.6 2023-12-03T11:34:21.008 DEBUG:teuthology.parallel:result is None 2023-12-03T11:34:21.008 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-12-03T11:34:21.008 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-03T11:34:21.343 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:34:21.343 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2023-12-03T11:34:21.355 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":17,"stamp":"2023-12-03T11:34:19.746959+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":7,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":218760,"kb_used_data":2568,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755960,"statfs":{"total":773094113280,"available":772870103040,"internally_reserved":0,"allocated":2629632,"data_stored":1639072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000728"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-03T11:34:18.381430+0000","last_change":"2023-12-03T11:34:17.376695+0000","last_active":"2023-12-03T11:34:18.381430+0000","last_peered":"2023-12-03T11:34:18.381430+0000","last_clean":"2023-12-03T11:34:18.381430+0000","last_became_active":"2023-12-03T11:34:17.376275+0000","last_became_peered":"2023-12-03T11:34:17.376275+0000","last_unstale":"2023-12-03T11:34:18.381430+0000","last_undegraded":"2023-12-03T11:34:18.381430+0000","last_fullsized":"2023-12-03T11:34:18.381430+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-03T11:34:16.354224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-03T11:34:16.354224+0000","last_clean_scrub_stamp":"2023-12-03T11:34:16.354224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-04T13:19:35.293720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-03T11:34:17.383277+0000","last_change":"2023-12-03T11:34:17.378508+0000","last_active":"2023-12-03T11:34:17.383277+0000","last_peered":"2023-12-03T11:34:17.383277+0000","last_clean":"2023-12-03T11:34:17.383277+0000","last_became_active":"2023-12-03T11:34:17.378167+0000","last_became_peered":"2023-12-03T11:34:17.378167+0000","last_unstale":"2023-12-03T11:34:17.383277+0000","last_undegraded":"2023-12-03T11:34:17.383277+0000","last_fullsized":"2023-12-03T11:34:17.383277+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-03T11:34:16.354224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-03T11:34:16.354224+0000","last_clean_scrub_stamp":"2023-12-03T11:34:16.354224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-04T16:06:54.185341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-03T11:34:18.376137+0000","last_change":"2023-12-03T11:34:17.502510+0000","last_active":"2023-12-03T11:34:18.376137+0000","last_peered":"2023-12-03T11:34:18.376137+0000","last_clean":"2023-12-03T11:34:18.376137+0000","last_became_active":"2023-12-03T11:34:17.502221+0000","last_became_peered":"2023-12-03T11:34:17.502221+0000","last_unstale":"2023-12-03T11:34:18.376137+0000","last_undegraded":"2023-12-03T11:34:18.376137+0000","last_fullsized":"2023-12-03T11:34:18.376137+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-03T11:34:16.354224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-03T11:34:16.354224+0000","last_clean_scrub_stamp":"2023-12-03T11:34:16.354224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-04T22:01:25.195383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-03T11:34:17.506030+0000","last_change":"2023-12-03T11:34:17.502653+0000","last_active":"2023-12-03T11:34:17.506030+0000","last_peered":"2023-12-03T11:34:17.506030+0000","last_clean":"2023-12-03T11:34:17.506030+0000","last_became_active":"2023-12-03T11:34:17.502328+0000","last_became_peered":"2023-12-03T11:34:17.502328+0000","last_unstale":"2023-12-03T11:34:17.506030+0000","last_undegraded":"2023-12-03T11:34:17.506030+0000","last_fullsized":"2023-12-03T11:34:17.506030+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-03T11:34:16.354224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-03T11:34:16.354224+0000","last_clean_scrub_stamp":"2023-12-03T11:34:16.354224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-04T12:22:34.726374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-03T11:34:17.379658+0000","last_change":"2023-12-03T11:34:17.378899+0000","last_active":"2023-12-03T11:34:17.379658+0000","last_peered":"2023-12-03T11:34:17.379658+0000","last_clean":"2023-12-03T11:34:17.379658+0000","last_became_active":"2023-12-03T11:34:17.378576+0000","last_became_peered":"2023-12-03T11:34:17.378576+0000","last_unstale":"2023-12-03T11:34:17.379658+0000","last_undegraded":"2023-12-03T11:34:17.379658+0000","last_fullsized":"2023-12-03T11:34:17.379658+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-03T11:34:16.354224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-03T11:34:16.354224+0000","last_clean_scrub_stamp":"2023-12-03T11:34:16.354224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-04T23:11:40.327903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-03T11:34:17.385828+0000","last_change":"2023-12-03T11:34:17.382224+0000","last_active":"2023-12-03T11:34:17.385828+0000","last_peered":"2023-12-03T11:34:17.385828+0000","last_clean":"2023-12-03T11:34:17.385828+0000","last_became_active":"2023-12-03T11:34:17.381832+0000","last_became_peered":"2023-12-03T11:34:17.381832+0000","last_unstale":"2023-12-03T11:34:17.385828+0000","last_undegraded":"2023-12-03T11:34:17.385828+0000","last_fullsized":"2023-12-03T11:34:17.385828+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-03T11:34:16.354224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-03T11:34:16.354224+0000","last_clean_scrub_stamp":"2023-12-03T11:34:16.354224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-04T14:58:00.667566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-03T11:34:18.376074+0000","last_change":"2023-12-03T11:34:17.381266+0000","last_active":"2023-12-03T11:34:18.376074+0000","last_peered":"2023-12-03T11:34:18.376074+0000","last_clean":"2023-12-03T11:34:18.376074+0000","last_became_active":"2023-12-03T11:34:17.380952+0000","last_became_peered":"2023-12-03T11:34:17.380952+0000","last_unstale":"2023-12-03T11:34:18.376074+0000","last_undegraded":"2023-12-03T11:34:18.376074+0000","last_fullsized":"2023-12-03T11:34:18.376074+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-03T11:34:16.354224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-03T11:34:16.354224+0000","last_clean_scrub_stamp":"2023-12-03T11:34:16.354224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-04T18:18:15.686690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-03T11:34:17.380352+0000","last_change":"2023-12-03T11:34:17.379647+0000","last_active":"2023-12-03T11:34:17.380352+0000","last_peered":"2023-12-03T11:34:17.380352+0000","last_clean":"2023-12-03T11:34:17.380352+0000","last_became_active":"2023-12-03T11:34:17.379343+0000","last_became_peered":"2023-12-03T11:34:17.379343+0000","last_unstale":"2023-12-03T11:34:17.380352+0000","last_undegraded":"2023-12-03T11:34:17.380352+0000","last_fullsized":"2023-12-03T11:34:17.380352+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-03T11:34:16.354224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-03T11:34:16.354224+0000","last_clean_scrub_stamp":"2023-12-03T11:34:16.354224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-04T16:01:31.759972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":164,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-03T11:34:17.373962+0000","last_change":"2023-12-03T11:34:11.022286+0000","last_active":"2023-12-03T11:34:17.373962+0000","last_peered":"2023-12-03T11:34:17.373962+0000","last_clean":"2023-12-03T11:34:17.373962+0000","last_became_active":"2023-12-03T11:34:11.021102+0000","last_became_peered":"2023-12-03T11:34:11.021102+0000","last_unstale":"2023-12-03T11:34:17.373962+0000","last_undegraded":"2023-12-03T11:34:17.373962+0000","last_fullsized":"2023-12-03T11:34:17.373962+0000","mapping_epoch":14,"log_start":"15'100","ondisk_log_start":"15'100","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-03T11:34:09.903321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-03T11:34:09.903321+0000","last_clean_scrub_stamp":"2023-12-03T11:34:09.903321+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-04T12:03:35.023923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27780,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344060,"statfs":{"total":96636764160,"available":96608317440,"internally_reserved":0,"allocated":774144,"data_stored":647660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.373}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":180224,"data_stored":57292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":180224,"data_stored":57292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81599999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84099999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27200,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":180224,"data_stored":57292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":180224,"data_stored":57292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76200000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72099999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":180224,"data_stored":57292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28299999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34300000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":180224,"data_stored":57292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73299999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27780,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344060,"statfs":{"total":96636764160,"available":96608317440,"internally_reserved":0,"allocated":774144,"data_stored":647660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-03T11:34:21.356 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-03T11:34:21.650 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:34:21.650 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2023-12-03T11:34:21.662 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":17,"stamp":"2023-12-03T11:34:19.746959+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":7,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":218760,"kb_used_data":2568,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755960,"statfs":{"total":773094113280,"available":772870103040,"internally_reserved":0,"allocated":2629632,"data_stored":1639072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000728"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-03T11:34:18.381430+0000","last_change":"2023-12-03T11:34:17.376695+0000","last_active":"2023-12-03T11:34:18.381430+0000","last_peered":"2023-12-03T11:34:18.381430+0000","last_clean":"2023-12-03T11:34:18.381430+0000","last_became_active":"2023-12-03T11:34:17.376275+0000","last_became_peered":"2023-12-03T11:34:17.376275+0000","last_unstale":"2023-12-03T11:34:18.381430+0000","last_undegraded":"2023-12-03T11:34:18.381430+0000","last_fullsized":"2023-12-03T11:34:18.381430+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-03T11:34:16.354224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-03T11:34:16.354224+0000","last_clean_scrub_stamp":"2023-12-03T11:34:16.354224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-04T13:19:35.293720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-03T11:34:17.383277+0000","last_change":"2023-12-03T11:34:17.378508+0000","last_active":"2023-12-03T11:34:17.383277+0000","last_peered":"2023-12-03T11:34:17.383277+0000","last_clean":"2023-12-03T11:34:17.383277+0000","last_became_active":"2023-12-03T11:34:17.378167+0000","last_became_peered":"2023-12-03T11:34:17.378167+0000","last_unstale":"2023-12-03T11:34:17.383277+0000","last_undegraded":"2023-12-03T11:34:17.383277+0000","last_fullsized":"2023-12-03T11:34:17.383277+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-03T11:34:16.354224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-03T11:34:16.354224+0000","last_clean_scrub_stamp":"2023-12-03T11:34:16.354224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-04T16:06:54.185341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-03T11:34:18.376137+0000","last_change":"2023-12-03T11:34:17.502510+0000","last_active":"2023-12-03T11:34:18.376137+0000","last_peered":"2023-12-03T11:34:18.376137+0000","last_clean":"2023-12-03T11:34:18.376137+0000","last_became_active":"2023-12-03T11:34:17.502221+0000","last_became_peered":"2023-12-03T11:34:17.502221+0000","last_unstale":"2023-12-03T11:34:18.376137+0000","last_undegraded":"2023-12-03T11:34:18.376137+0000","last_fullsized":"2023-12-03T11:34:18.376137+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-03T11:34:16.354224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-03T11:34:16.354224+0000","last_clean_scrub_stamp":"2023-12-03T11:34:16.354224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-04T22:01:25.195383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-03T11:34:17.506030+0000","last_change":"2023-12-03T11:34:17.502653+0000","last_active":"2023-12-03T11:34:17.506030+0000","last_peered":"2023-12-03T11:34:17.506030+0000","last_clean":"2023-12-03T11:34:17.506030+0000","last_became_active":"2023-12-03T11:34:17.502328+0000","last_became_peered":"2023-12-03T11:34:17.502328+0000","last_unstale":"2023-12-03T11:34:17.506030+0000","last_undegraded":"2023-12-03T11:34:17.506030+0000","last_fullsized":"2023-12-03T11:34:17.506030+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-03T11:34:16.354224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-03T11:34:16.354224+0000","last_clean_scrub_stamp":"2023-12-03T11:34:16.354224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-04T12:22:34.726374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-03T11:34:17.379658+0000","last_change":"2023-12-03T11:34:17.378899+0000","last_active":"2023-12-03T11:34:17.379658+0000","last_peered":"2023-12-03T11:34:17.379658+0000","last_clean":"2023-12-03T11:34:17.379658+0000","last_became_active":"2023-12-03T11:34:17.378576+0000","last_became_peered":"2023-12-03T11:34:17.378576+0000","last_unstale":"2023-12-03T11:34:17.379658+0000","last_undegraded":"2023-12-03T11:34:17.379658+0000","last_fullsized":"2023-12-03T11:34:17.379658+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-03T11:34:16.354224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-03T11:34:16.354224+0000","last_clean_scrub_stamp":"2023-12-03T11:34:16.354224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-04T23:11:40.327903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-03T11:34:17.385828+0000","last_change":"2023-12-03T11:34:17.382224+0000","last_active":"2023-12-03T11:34:17.385828+0000","last_peered":"2023-12-03T11:34:17.385828+0000","last_clean":"2023-12-03T11:34:17.385828+0000","last_became_active":"2023-12-03T11:34:17.381832+0000","last_became_peered":"2023-12-03T11:34:17.381832+0000","last_unstale":"2023-12-03T11:34:17.385828+0000","last_undegraded":"2023-12-03T11:34:17.385828+0000","last_fullsized":"2023-12-03T11:34:17.385828+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-03T11:34:16.354224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-03T11:34:16.354224+0000","last_clean_scrub_stamp":"2023-12-03T11:34:16.354224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-04T14:58:00.667566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-03T11:34:18.376074+0000","last_change":"2023-12-03T11:34:17.381266+0000","last_active":"2023-12-03T11:34:18.376074+0000","last_peered":"2023-12-03T11:34:18.376074+0000","last_clean":"2023-12-03T11:34:18.376074+0000","last_became_active":"2023-12-03T11:34:17.380952+0000","last_became_peered":"2023-12-03T11:34:17.380952+0000","last_unstale":"2023-12-03T11:34:18.376074+0000","last_undegraded":"2023-12-03T11:34:18.376074+0000","last_fullsized":"2023-12-03T11:34:18.376074+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-03T11:34:16.354224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-03T11:34:16.354224+0000","last_clean_scrub_stamp":"2023-12-03T11:34:16.354224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-04T18:18:15.686690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-03T11:34:17.380352+0000","last_change":"2023-12-03T11:34:17.379647+0000","last_active":"2023-12-03T11:34:17.380352+0000","last_peered":"2023-12-03T11:34:17.380352+0000","last_clean":"2023-12-03T11:34:17.380352+0000","last_became_active":"2023-12-03T11:34:17.379343+0000","last_became_peered":"2023-12-03T11:34:17.379343+0000","last_unstale":"2023-12-03T11:34:17.380352+0000","last_undegraded":"2023-12-03T11:34:17.380352+0000","last_fullsized":"2023-12-03T11:34:17.380352+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-03T11:34:16.354224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-03T11:34:16.354224+0000","last_clean_scrub_stamp":"2023-12-03T11:34:16.354224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-04T16:01:31.759972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":164,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-03T11:34:17.373962+0000","last_change":"2023-12-03T11:34:11.022286+0000","last_active":"2023-12-03T11:34:17.373962+0000","last_peered":"2023-12-03T11:34:17.373962+0000","last_clean":"2023-12-03T11:34:17.373962+0000","last_became_active":"2023-12-03T11:34:11.021102+0000","last_became_peered":"2023-12-03T11:34:11.021102+0000","last_unstale":"2023-12-03T11:34:17.373962+0000","last_undegraded":"2023-12-03T11:34:17.373962+0000","last_fullsized":"2023-12-03T11:34:17.373962+0000","mapping_epoch":14,"log_start":"15'100","ondisk_log_start":"15'100","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-03T11:34:09.903321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-03T11:34:09.903321+0000","last_clean_scrub_stamp":"2023-12-03T11:34:09.903321+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-04T12:03:35.023923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27780,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344060,"statfs":{"total":96636764160,"available":96608317440,"internally_reserved":0,"allocated":774144,"data_stored":647660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.373}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":180224,"data_stored":57292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":180224,"data_stored":57292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81599999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84099999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27200,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":180224,"data_stored":57292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":180224,"data_stored":57292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76200000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72099999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":180224,"data_stored":57292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28299999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34300000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":180224,"data_stored":57292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73299999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27780,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344060,"statfs":{"total":96636764160,"available":96608317440,"internally_reserved":0,"allocated":774144,"data_stored":647660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-03T11:34:21.663 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-12-03T11:34:21.663 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-12-03T11:34:21.663 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-12-03T11:34:21.664 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-12-03T11:34:21.992 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:34:21.992 INFO:teuthology.orchestra.run.smithi003.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-12-03T11:34:22.005 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-12-03T11:34:22.005 INFO:teuthology.run_tasks:Running task openssl_keys... 2023-12-03T11:34:22.017 INFO:teuthology.run_tasks:Running task rgw... 2023-12-03T11:34:22.041 DEBUG:tasks.rgw:config is {'client.0': {'valgrind': ['--tool=memcheck', '--max-threads=1024']}} 2023-12-03T11:34:22.041 DEBUG:tasks.rgw:client list is dict_keys(['client.0']) 2023-12-03T11:34:22.041 INFO:tasks.rgw:Creating data pools 2023-12-03T11:34:22.041 DEBUG:tasks.rgw:Obtaining remote for client client.0 2023-12-03T11:34:22.041 DEBUG:teuthology.orchestra.run.smithi003:> sudo ceph osd erasure-code-profile set client.0 k=2 m=1 crush-failure-domain=osd --cluster ceph 2023-12-03T11:34:23.191 DEBUG:teuthology.orchestra.run.smithi003:> sudo ceph osd pool create default.rgw.buckets.data 64 64 erasure client.0 --cluster ceph 2023-12-03T11:34:25.396 INFO:teuthology.orchestra.run.smithi003.stderr:pool 'default.rgw.buckets.data' created 2023-12-03T11:34:25.421 DEBUG:teuthology.orchestra.run.smithi003:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2023-12-03T11:34:26.409 INFO:teuthology.orchestra.run.smithi003.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2023-12-03T11:34:26.446 DEBUG:teuthology.orchestra.run.smithi003:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2023-12-03T11:34:27.410 INFO:teuthology.orchestra.run.smithi003.stderr:pool 'default.rgw.buckets.index' created 2023-12-03T11:34:27.431 DEBUG:teuthology.orchestra.run.smithi003:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2023-12-03T11:34:28.419 INFO:teuthology.orchestra.run.smithi003.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2023-12-03T11:34:28.454 DEBUG:tasks.rgw:Pools created 2023-12-03T11:34:28.454 INFO:tasks.rgw:Configuring compression type = random 2023-12-03T11:34:28.454 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2023-12-03T11:34:28.455 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2023-12-03T11:34:28.455 DEBUG:teuthology.orchestra.run.smithi003:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2023-12-03T11:34:28.554 INFO:teuthology.orchestra.run.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:34:28.554 INFO:teuthology.orchestra.run.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:34:28.566 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:28.565+0000 7f4c6c328800 20 rados->read ofs=0 len=0 2023-12-03T11:34:30.442 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:30.440+0000 7f4c6c328800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:34:30.442 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:30.440+0000 7f4c6c328800 20 realm 2023-12-03T11:34:30.442 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:30.440+0000 7f4c6c328800 20 rados->read ofs=0 len=0 2023-12-03T11:34:30.442 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:30.441+0000 7f4c6c328800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:34:30.443 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:30.441+0000 7f4c6c328800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:34:30.443 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:30.441+0000 7f4c6c328800 20 rados->read ofs=0 len=0 2023-12-03T11:34:30.443 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:30.441+0000 7f4c6c328800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:34:30.443 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:30.441+0000 7f4c6c328800 20 rados->read ofs=0 len=0 2023-12-03T11:34:30.444 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:30.443+0000 7f4c6c328800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:34:30.444 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:30.443+0000 7f4c6c328800 20 rados->read ofs=0 len=0 2023-12-03T11:34:30.444 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:30.443+0000 7f4c6c328800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:34:30.444 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:30.443+0000 7f4c6c328800 20 rados->read ofs=0 len=0 2023-12-03T11:34:30.444 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:30.443+0000 7f4c6c328800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:34:30.444 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:30.443+0000 7f4c6c328800 10 Creating default zonegroup 2023-12-03T11:34:30.445 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:30.443+0000 7f4c6c328800 10 couldn't find old data placement pools config, setting up new ones for the zone 2023-12-03T11:34:30.456 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:30.455+0000 7f4c67f77640 0 -- 172.21.15.3:0/942488261 >> [v2:172.21.15.37:6805/1692844418,v1:172.21.15.37:6807/1692844418] conn(0x55f390d1d010 msgr2=0x55f390d1f400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:34:30.459 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:30.458+0000 7f4c6c328800 10 WARNING: driver->list_zones() returned r=-2 2023-12-03T11:34:30.459 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:30.458+0000 7f4c6c328800 20 rados->read ofs=0 len=0 2023-12-03T11:34:30.460 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:30.459+0000 7f4c6c328800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:34:30.463 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:30.462+0000 7f4c6c328800 20 rados->read ofs=0 len=0 2023-12-03T11:34:30.463 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:30.462+0000 7f4c6c328800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:34:30.463 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:30.462+0000 7f4c6c328800 10 could not read realm id: (2) No such file or directory 2023-12-03T11:34:30.463 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:30.462+0000 7f4c6c328800 10 WARNING: failed to set zone as default, r=-22 2023-12-03T11:34:30.463 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:30.462+0000 7f4c6c328800 20 rados->read ofs=0 len=0 2023-12-03T11:34:30.463 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:30.462+0000 7f4c6c328800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:34:30.466 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:30.465+0000 7f4c6c328800 20 rados->read ofs=0 len=0 2023-12-03T11:34:30.467 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:30.466+0000 7f4c6c328800 20 rados_obj.operate() r=0 bl.length=874 2023-12-03T11:34:30.467 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:30.466+0000 7f4c6c328800 20 rados->read ofs=0 len=0 2023-12-03T11:34:30.469 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:30.469+0000 7f4c67f77640 0 -- 172.21.15.3:0/942488261 >> [v2:172.21.15.37:6805/1692844418,v1:172.21.15.37:6807/1692844418] conn(0x7f4c40074f70 msgr2=0x7f4c40077360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:34:30.469 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:30.469+0000 7f4c6c328800 20 rados_obj.operate() r=0 bl.length=420 2023-12-03T11:34:30.469 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:30.469+0000 7f4c6c328800 10 Using default name default 2023-12-03T11:34:30.469 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:30.469+0000 7f4c6c328800 20 rados->read ofs=0 len=0 2023-12-03T11:34:30.470 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:30.469+0000 7f4c6c328800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:34:30.470 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:30.469+0000 7f4c6c328800 20 rados->read ofs=0 len=0 2023-12-03T11:34:30.471 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:30.469+0000 7f4c6c328800 20 rados_obj.operate() r=0 bl.length=874 2023-12-03T11:34:30.471 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:30.469+0000 7f4c6c328800 20 zone default found 2023-12-03T11:34:30.471 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:30.469+0000 7f4c6c328800 4 Realm: () 2023-12-03T11:34:30.471 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:30.469+0000 7f4c6c328800 4 ZoneGroup: default (6a811aad-435d-4fdd-93c9-b7e0b50de429) 2023-12-03T11:34:30.471 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:30.469+0000 7f4c6c328800 4 Zone: default (83aabb46-04b5-4c96-9933-c6bfb1173a73) 2023-12-03T11:34:30.471 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:30.469+0000 7f4c6c328800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:34:30.471 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:30.469+0000 7f4c6c328800 20 zonegroup default 2023-12-03T11:34:30.471 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:30.469+0000 7f4c6c328800 20 rados->read ofs=0 len=0 2023-12-03T11:34:30.471 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:30.470+0000 7f4c6c328800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:34:30.471 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:30.470+0000 7f4c6c328800 20 rados->read ofs=0 len=0 2023-12-03T11:34:32.444 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:32.443+0000 7f4c6c328800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:34:32.444 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:32.443+0000 7f4c6c328800 20 rados->read ofs=0 len=0 2023-12-03T11:34:32.446 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:32.445+0000 7f4c6c328800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:34:32.446 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:32.445+0000 7f4c6c328800 20 started sync module instance, tier type = 2023-12-03T11:34:32.446 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:32.445+0000 7f4c6c328800 20 started zone id=83aabb46-04b5-4c96-9933-c6bfb1173a73 (name=default) with tier type = 2023-12-03T11:34:34.477 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.476+0000 7f4c6c328800 20 add_watcher() i=0 2023-12-03T11:34:34.477 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.476+0000 7f4c6c328800 20 add_watcher() i=1 2023-12-03T11:34:34.477 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.476+0000 7f4c6c328800 20 add_watcher() i=2 2023-12-03T11:34:34.477 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.476+0000 7f4c6c328800 20 add_watcher() i=3 2023-12-03T11:34:34.477 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.476+0000 7f4c6c328800 20 add_watcher() i=4 2023-12-03T11:34:34.477 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.476+0000 7f4c6c328800 20 add_watcher() i=5 2023-12-03T11:34:34.478 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.476+0000 7f4c6c328800 20 add_watcher() i=6 2023-12-03T11:34:34.478 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.477+0000 7f4c6c328800 20 add_watcher() i=7 2023-12-03T11:34:34.478 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.477+0000 7f4c6c328800 2 all 8 watchers are set, enabling cache 2023-12-03T11:34:34.478 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.477+0000 7f4c6c328800 5 tl::expected, obj_version>, boost::system::error_code> logback_generations::read(const DoutPrefixProvider*, optional_yield):410: oid=data_loggenerations_metadata not found 2023-12-03T11:34:34.478 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.477+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.0 2023-12-03T11:34:34.478 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.477+0000 7f4c6c328800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:34:34.479 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.478+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.0 does not exist 2023-12-03T11:34:34.479 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.478+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.1 2023-12-03T11:34:34.479 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.478+0000 7f4c6c328800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:34:34.480 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.478+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.1 does not exist 2023-12-03T11:34:34.480 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.478+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.2 2023-12-03T11:34:34.480 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.478+0000 7f4c6c328800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:34:34.480 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.479+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.2 does not exist 2023-12-03T11:34:34.480 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.479+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.3 2023-12-03T11:34:34.480 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.479+0000 7f4c6c328800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:34:34.480 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.479+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.3 does not exist 2023-12-03T11:34:34.480 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.479+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.4 2023-12-03T11:34:34.480 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.479+0000 7f4c6c328800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:34:34.481 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.479+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.4 does not exist 2023-12-03T11:34:34.481 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.479+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.5 2023-12-03T11:34:34.481 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.479+0000 7f4c6c328800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:34:34.481 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.479+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.5 does not exist 2023-12-03T11:34:34.481 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.479+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.6 2023-12-03T11:34:34.481 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.479+0000 7f4c6c328800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:34:34.481 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.480+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.6 does not exist 2023-12-03T11:34:34.481 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.480+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.7 2023-12-03T11:34:34.482 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.480+0000 7f4c6c328800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:34:34.482 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.480+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.7 does not exist 2023-12-03T11:34:34.482 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.480+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.8 2023-12-03T11:34:34.482 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.480+0000 7f4c6c328800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:34:34.483 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.480+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.8 does not exist 2023-12-03T11:34:34.483 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.480+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.9 2023-12-03T11:34:34.483 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.480+0000 7f4c6c328800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:34:34.483 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.481+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.9 does not exist 2023-12-03T11:34:34.483 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.481+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.10 2023-12-03T11:34:34.483 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.481+0000 7f4c6c328800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:34:34.483 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.481+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.10 does not exist 2023-12-03T11:34:34.484 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.481+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.11 2023-12-03T11:34:34.484 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.481+0000 7f4c6c328800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:34:34.484 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.481+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.11 does not exist 2023-12-03T11:34:34.484 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.481+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.12 2023-12-03T11:34:34.484 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.481+0000 7f4c6c328800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:34:34.484 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.481+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.12 does not exist 2023-12-03T11:34:34.484 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.481+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.13 2023-12-03T11:34:34.484 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.481+0000 7f4c6c328800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:34:34.484 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.482+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.13 does not exist 2023-12-03T11:34:34.485 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.482+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.14 2023-12-03T11:34:34.485 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.482+0000 7f4c6c328800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:34:34.490 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.482+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.14 does not exist 2023-12-03T11:34:34.490 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.482+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.15 2023-12-03T11:34:34.490 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.482+0000 7f4c6c328800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:34:34.490 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.482+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.15 does not exist 2023-12-03T11:34:34.490 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.482+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.16 2023-12-03T11:34:34.490 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.482+0000 7f4c6c328800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:34:34.490 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.483+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.16 does not exist 2023-12-03T11:34:34.491 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.483+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.17 2023-12-03T11:34:34.491 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.483+0000 7f4c6c328800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:34:34.491 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.483+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.17 does not exist 2023-12-03T11:34:34.491 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.483+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.18 2023-12-03T11:34:34.491 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.483+0000 7f4c6c328800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:34:34.491 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.483+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.18 does not exist 2023-12-03T11:34:34.491 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.483+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.19 2023-12-03T11:34:34.491 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.483+0000 7f4c6c328800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:34:34.492 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.483+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.19 does not exist 2023-12-03T11:34:34.492 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.483+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.20 2023-12-03T11:34:34.492 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.483+0000 7f4c6c328800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:34:34.492 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.484+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.20 does not exist 2023-12-03T11:34:34.492 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.484+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.21 2023-12-03T11:34:34.492 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.484+0000 7f4c6c328800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:34:34.492 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.484+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.21 does not exist 2023-12-03T11:34:34.493 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.484+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.22 2023-12-03T11:34:34.493 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.484+0000 7f4c6c328800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:34:34.493 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.484+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.22 does not exist 2023-12-03T11:34:34.493 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.484+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.23 2023-12-03T11:34:34.493 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.484+0000 7f4c6c328800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:34:34.493 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.485+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.23 does not exist 2023-12-03T11:34:34.494 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.485+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.24 2023-12-03T11:34:34.494 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.485+0000 7f4c6c328800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:34:34.494 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.485+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.24 does not exist 2023-12-03T11:34:34.494 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.485+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.25 2023-12-03T11:34:34.494 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.485+0000 7f4c6c328800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:34:34.494 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.485+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.25 does not exist 2023-12-03T11:34:34.494 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.485+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.26 2023-12-03T11:34:34.494 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.485+0000 7f4c6c328800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:34:34.495 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.485+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.26 does not exist 2023-12-03T11:34:34.495 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.485+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.27 2023-12-03T11:34:34.495 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.485+0000 7f4c6c328800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:34:34.495 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.486+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.27 does not exist 2023-12-03T11:34:34.495 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.486+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.28 2023-12-03T11:34:34.495 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.486+0000 7f4c6c328800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:34:34.495 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.486+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.28 does not exist 2023-12-03T11:34:34.495 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.486+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.29 2023-12-03T11:34:34.495 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.486+0000 7f4c6c328800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:34:34.495 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.486+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.29 does not exist 2023-12-03T11:34:34.495 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.486+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.30 2023-12-03T11:34:34.495 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.486+0000 7f4c6c328800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:34:34.495 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.486+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.30 does not exist 2023-12-03T11:34:34.495 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.486+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.31 2023-12-03T11:34:34.496 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.486+0000 7f4c6c328800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:34:34.496 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.487+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.31 does not exist 2023-12-03T11:34:34.496 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.487+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.32 2023-12-03T11:34:34.496 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.487+0000 7f4c6c328800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:34:34.496 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.487+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.32 does not exist 2023-12-03T11:34:34.496 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.487+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.33 2023-12-03T11:34:34.496 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.487+0000 7f4c6c328800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:34:34.496 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.487+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.33 does not exist 2023-12-03T11:34:34.496 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.487+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.34 2023-12-03T11:34:34.496 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.487+0000 7f4c6c328800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:34:34.496 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.488+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.34 does not exist 2023-12-03T11:34:34.496 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.488+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.35 2023-12-03T11:34:34.497 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.488+0000 7f4c6c328800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:34:34.497 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.488+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.35 does not exist 2023-12-03T11:34:34.497 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.488+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.36 2023-12-03T11:34:34.497 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.488+0000 7f4c6c328800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:34:34.497 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.488+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.36 does not exist 2023-12-03T11:34:34.497 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.488+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.37 2023-12-03T11:34:34.497 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.488+0000 7f4c6c328800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:34:34.498 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.488+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.37 does not exist 2023-12-03T11:34:34.498 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.488+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.38 2023-12-03T11:34:34.498 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.488+0000 7f4c6c328800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:34:34.498 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.489+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.38 does not exist 2023-12-03T11:34:34.498 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.489+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.39 2023-12-03T11:34:34.498 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.489+0000 7f4c6c328800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:34:34.507 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.489+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.39 does not exist 2023-12-03T11:34:34.507 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.489+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.40 2023-12-03T11:34:34.507 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.489+0000 7f4c6c328800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:34:34.507 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.489+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.40 does not exist 2023-12-03T11:34:34.507 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.489+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.41 2023-12-03T11:34:34.507 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.489+0000 7f4c6c328800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:34:34.508 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.490+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.41 does not exist 2023-12-03T11:34:34.508 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.490+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.42 2023-12-03T11:34:34.508 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.490+0000 7f4c6c328800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:34:34.508 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.490+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.42 does not exist 2023-12-03T11:34:34.508 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.490+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.43 2023-12-03T11:34:34.508 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.490+0000 7f4c6c328800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:34:34.508 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.490+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.43 does not exist 2023-12-03T11:34:34.508 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.490+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.44 2023-12-03T11:34:34.508 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.490+0000 7f4c6c328800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:34:34.508 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.490+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.44 does not exist 2023-12-03T11:34:34.508 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.490+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.45 2023-12-03T11:34:34.509 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.490+0000 7f4c6c328800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:34:34.509 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.491+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.45 does not exist 2023-12-03T11:34:34.509 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.491+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.46 2023-12-03T11:34:34.509 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.491+0000 7f4c6c328800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:34:34.509 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.491+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.46 does not exist 2023-12-03T11:34:34.509 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.491+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.47 2023-12-03T11:34:34.509 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.491+0000 7f4c6c328800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:34:34.509 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.491+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.47 does not exist 2023-12-03T11:34:34.509 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.491+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.48 2023-12-03T11:34:34.509 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.491+0000 7f4c6c328800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:34:34.509 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.492+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.48 does not exist 2023-12-03T11:34:34.509 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.492+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.49 2023-12-03T11:34:34.509 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.492+0000 7f4c6c328800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:34:34.509 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.492+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.49 does not exist 2023-12-03T11:34:34.510 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.492+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.50 2023-12-03T11:34:34.510 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.492+0000 7f4c6c328800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:34:34.510 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.492+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.50 does not exist 2023-12-03T11:34:34.510 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.492+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.51 2023-12-03T11:34:34.510 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.492+0000 7f4c6c328800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:34:34.510 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.492+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.51 does not exist 2023-12-03T11:34:34.510 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.492+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.52 2023-12-03T11:34:34.510 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.492+0000 7f4c6c328800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:34:34.510 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.493+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.52 does not exist 2023-12-03T11:34:34.510 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.493+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.53 2023-12-03T11:34:34.510 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.493+0000 7f4c6c328800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:34:34.511 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.493+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.53 does not exist 2023-12-03T11:34:34.511 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.493+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.54 2023-12-03T11:34:34.511 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.493+0000 7f4c6c328800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:34:34.511 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.493+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.54 does not exist 2023-12-03T11:34:34.511 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.493+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.55 2023-12-03T11:34:34.511 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.493+0000 7f4c6c328800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:34:34.511 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.493+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.55 does not exist 2023-12-03T11:34:34.511 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.493+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.56 2023-12-03T11:34:34.511 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.493+0000 7f4c6c328800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:34:34.511 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.494+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.56 does not exist 2023-12-03T11:34:34.512 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.494+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.57 2023-12-03T11:34:34.512 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.494+0000 7f4c6c328800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:34:34.512 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.494+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.57 does not exist 2023-12-03T11:34:34.512 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.494+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.58 2023-12-03T11:34:34.512 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.494+0000 7f4c6c328800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:34:34.512 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.494+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.58 does not exist 2023-12-03T11:34:34.512 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.494+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.59 2023-12-03T11:34:34.512 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.494+0000 7f4c6c328800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:34:34.512 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.495+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.59 does not exist 2023-12-03T11:34:34.512 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.495+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.60 2023-12-03T11:34:34.512 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.495+0000 7f4c6c328800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:34:34.512 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.495+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.60 does not exist 2023-12-03T11:34:34.513 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.495+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.61 2023-12-03T11:34:34.513 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.495+0000 7f4c6c328800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:34:34.513 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.495+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.61 does not exist 2023-12-03T11:34:34.513 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.495+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.62 2023-12-03T11:34:34.513 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.495+0000 7f4c6c328800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:34:34.513 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.495+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.62 does not exist 2023-12-03T11:34:34.513 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.496+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.63 2023-12-03T11:34:34.513 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.496+0000 7f4c6c328800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:34:34.513 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.496+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.63 does not exist 2023-12-03T11:34:34.513 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.496+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.64 2023-12-03T11:34:34.513 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.496+0000 7f4c6c328800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:34:34.513 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.496+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.64 does not exist 2023-12-03T11:34:34.513 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.496+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.65 2023-12-03T11:34:34.513 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.496+0000 7f4c6c328800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:34:34.513 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.496+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.65 does not exist 2023-12-03T11:34:34.514 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.496+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.66 2023-12-03T11:34:34.514 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.496+0000 7f4c6c328800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:34:34.514 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.496+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.66 does not exist 2023-12-03T11:34:34.514 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.496+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.67 2023-12-03T11:34:34.514 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.496+0000 7f4c6c328800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:34:34.514 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.497+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.67 does not exist 2023-12-03T11:34:34.514 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.497+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.68 2023-12-03T11:34:34.514 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.497+0000 7f4c6c328800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:34:34.514 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.497+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.68 does not exist 2023-12-03T11:34:34.514 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.497+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.69 2023-12-03T11:34:34.514 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.497+0000 7f4c6c328800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:34:34.514 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.497+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.69 does not exist 2023-12-03T11:34:34.514 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.497+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.70 2023-12-03T11:34:34.515 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.497+0000 7f4c6c328800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:34:34.515 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.497+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.70 does not exist 2023-12-03T11:34:34.515 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.497+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.71 2023-12-03T11:34:34.515 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.497+0000 7f4c6c328800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:34:34.515 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.498+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.71 does not exist 2023-12-03T11:34:34.515 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.498+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.72 2023-12-03T11:34:34.515 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.498+0000 7f4c6c328800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:34:34.515 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.498+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.72 does not exist 2023-12-03T11:34:34.515 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.498+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.73 2023-12-03T11:34:34.515 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.498+0000 7f4c6c328800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:34:34.515 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.498+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.73 does not exist 2023-12-03T11:34:34.515 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.498+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.74 2023-12-03T11:34:34.515 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.498+0000 7f4c6c328800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:34:34.516 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.498+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.74 does not exist 2023-12-03T11:34:34.516 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.498+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.75 2023-12-03T11:34:34.516 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.498+0000 7f4c6c328800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:34:34.516 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.499+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.75 does not exist 2023-12-03T11:34:34.516 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.499+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.76 2023-12-03T11:34:34.516 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.499+0000 7f4c6c328800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:34:34.516 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.499+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.76 does not exist 2023-12-03T11:34:34.516 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.499+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.77 2023-12-03T11:34:34.516 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.499+0000 7f4c6c328800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:34:34.516 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.499+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.77 does not exist 2023-12-03T11:34:34.516 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.499+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.78 2023-12-03T11:34:34.516 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.499+0000 7f4c6c328800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:34:34.516 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.500+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.78 does not exist 2023-12-03T11:34:34.516 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.500+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.79 2023-12-03T11:34:34.517 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.500+0000 7f4c6c328800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:34:34.517 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.500+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.79 does not exist 2023-12-03T11:34:34.517 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.500+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.80 2023-12-03T11:34:34.517 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.500+0000 7f4c6c328800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:34:34.517 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.500+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.80 does not exist 2023-12-03T11:34:34.517 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.500+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.81 2023-12-03T11:34:34.517 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.500+0000 7f4c6c328800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:34:34.517 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.500+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.81 does not exist 2023-12-03T11:34:34.517 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.500+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.82 2023-12-03T11:34:34.517 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.500+0000 7f4c6c328800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:34:34.517 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.501+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.82 does not exist 2023-12-03T11:34:34.518 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.501+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.83 2023-12-03T11:34:34.518 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.501+0000 7f4c6c328800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:34:34.518 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.501+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.83 does not exist 2023-12-03T11:34:34.518 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.501+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.84 2023-12-03T11:34:34.518 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.501+0000 7f4c6c328800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:34:34.518 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.501+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.84 does not exist 2023-12-03T11:34:34.518 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.501+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.85 2023-12-03T11:34:34.518 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.501+0000 7f4c6c328800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:34:34.518 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.501+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.85 does not exist 2023-12-03T11:34:34.518 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.501+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.86 2023-12-03T11:34:34.518 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.501+0000 7f4c6c328800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:34:34.519 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.502+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.86 does not exist 2023-12-03T11:34:34.519 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.502+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.87 2023-12-03T11:34:34.519 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.502+0000 7f4c6c328800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:34:34.519 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.502+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.87 does not exist 2023-12-03T11:34:34.519 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.502+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.88 2023-12-03T11:34:34.519 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.502+0000 7f4c6c328800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:34:34.519 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.502+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.88 does not exist 2023-12-03T11:34:34.519 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.502+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.89 2023-12-03T11:34:34.519 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.502+0000 7f4c6c328800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:34:34.519 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.503+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.89 does not exist 2023-12-03T11:34:34.519 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.503+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.90 2023-12-03T11:34:34.519 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.503+0000 7f4c6c328800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:34:34.519 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.503+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.90 does not exist 2023-12-03T11:34:34.519 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.503+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.91 2023-12-03T11:34:34.519 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.503+0000 7f4c6c328800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:34:34.520 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.503+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.91 does not exist 2023-12-03T11:34:34.520 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.503+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.92 2023-12-03T11:34:34.520 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.503+0000 7f4c6c328800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:34:34.520 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.503+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.92 does not exist 2023-12-03T11:34:34.520 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.503+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.93 2023-12-03T11:34:34.520 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.503+0000 7f4c6c328800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:34:34.520 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.504+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.93 does not exist 2023-12-03T11:34:34.520 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.504+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.94 2023-12-03T11:34:34.520 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.504+0000 7f4c6c328800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:34:34.520 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.504+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.94 does not exist 2023-12-03T11:34:34.520 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.504+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.95 2023-12-03T11:34:34.520 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.504+0000 7f4c6c328800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:34:34.521 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.504+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.95 does not exist 2023-12-03T11:34:34.521 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.504+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.96 2023-12-03T11:34:34.521 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.504+0000 7f4c6c328800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:34:34.521 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.504+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.96 does not exist 2023-12-03T11:34:34.521 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.504+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.97 2023-12-03T11:34:34.521 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.504+0000 7f4c6c328800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:34:34.521 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.505+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.97 does not exist 2023-12-03T11:34:34.521 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.505+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.98 2023-12-03T11:34:34.521 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.505+0000 7f4c6c328800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:34:34.521 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.505+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.98 does not exist 2023-12-03T11:34:34.521 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.505+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.99 2023-12-03T11:34:34.521 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.505+0000 7f4c6c328800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:34:34.521 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.505+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.99 does not exist 2023-12-03T11:34:34.521 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.505+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.100 2023-12-03T11:34:34.522 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.505+0000 7f4c6c328800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:34:34.522 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.506+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.100 does not exist 2023-12-03T11:34:34.522 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.506+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.101 2023-12-03T11:34:34.522 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.506+0000 7f4c6c328800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:34:34.522 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.506+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.101 does not exist 2023-12-03T11:34:34.522 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.506+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.102 2023-12-03T11:34:34.522 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.506+0000 7f4c6c328800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:34:34.522 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.506+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.102 does not exist 2023-12-03T11:34:34.522 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.506+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.103 2023-12-03T11:34:34.522 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.506+0000 7f4c6c328800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:34:34.522 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.506+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.103 does not exist 2023-12-03T11:34:34.523 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.506+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.104 2023-12-03T11:34:34.523 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.506+0000 7f4c6c328800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:34:34.526 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.507+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.104 does not exist 2023-12-03T11:34:34.526 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.507+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.105 2023-12-03T11:34:34.526 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.507+0000 7f4c6c328800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:34:34.526 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.507+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.105 does not exist 2023-12-03T11:34:34.526 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.507+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.106 2023-12-03T11:34:34.526 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.507+0000 7f4c6c328800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:34:34.526 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.507+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.106 does not exist 2023-12-03T11:34:34.526 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.507+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.107 2023-12-03T11:34:34.526 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.507+0000 7f4c6c328800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:34:34.526 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.507+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.107 does not exist 2023-12-03T11:34:34.527 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.507+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.108 2023-12-03T11:34:34.527 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.507+0000 7f4c6c328800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:34:34.527 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.507+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.108 does not exist 2023-12-03T11:34:34.527 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.507+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.109 2023-12-03T11:34:34.527 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.507+0000 7f4c6c328800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:34:34.527 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.508+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.109 does not exist 2023-12-03T11:34:34.527 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.508+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.110 2023-12-03T11:34:34.527 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.508+0000 7f4c6c328800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:34:34.527 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.508+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.110 does not exist 2023-12-03T11:34:34.527 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.508+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.111 2023-12-03T11:34:34.527 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.508+0000 7f4c6c328800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:34:34.527 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.508+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.111 does not exist 2023-12-03T11:34:34.527 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.508+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.112 2023-12-03T11:34:34.527 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.508+0000 7f4c6c328800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:34:34.528 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.509+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.112 does not exist 2023-12-03T11:34:34.528 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.509+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.113 2023-12-03T11:34:34.528 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.509+0000 7f4c6c328800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:34:34.528 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.509+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.113 does not exist 2023-12-03T11:34:34.528 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.509+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.114 2023-12-03T11:34:34.528 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.509+0000 7f4c6c328800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:34:34.528 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.509+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.114 does not exist 2023-12-03T11:34:34.528 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.509+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.115 2023-12-03T11:34:34.528 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.509+0000 7f4c6c328800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:34:34.528 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.510+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.115 does not exist 2023-12-03T11:34:34.528 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.510+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.116 2023-12-03T11:34:34.528 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.510+0000 7f4c6c328800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:34:34.528 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.510+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.116 does not exist 2023-12-03T11:34:34.529 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.510+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.117 2023-12-03T11:34:34.529 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.510+0000 7f4c6c328800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:34:34.529 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.510+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.117 does not exist 2023-12-03T11:34:34.529 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.510+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.118 2023-12-03T11:34:34.529 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.510+0000 7f4c6c328800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:34:34.529 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.510+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.118 does not exist 2023-12-03T11:34:34.529 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.510+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.119 2023-12-03T11:34:34.529 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.510+0000 7f4c6c328800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:34:34.529 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.510+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.119 does not exist 2023-12-03T11:34:34.529 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.510+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.120 2023-12-03T11:34:34.529 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.510+0000 7f4c6c328800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:34:34.529 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.511+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.120 does not exist 2023-12-03T11:34:34.529 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.511+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.121 2023-12-03T11:34:34.529 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.511+0000 7f4c6c328800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:34:34.529 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.511+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.121 does not exist 2023-12-03T11:34:34.530 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.511+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.122 2023-12-03T11:34:34.530 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.511+0000 7f4c6c328800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:34:34.530 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.511+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.122 does not exist 2023-12-03T11:34:34.530 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.511+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.123 2023-12-03T11:34:34.530 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.511+0000 7f4c6c328800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:34:34.530 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.511+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.123 does not exist 2023-12-03T11:34:34.530 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.511+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.124 2023-12-03T11:34:34.530 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.511+0000 7f4c6c328800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:34:34.530 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.512+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.124 does not exist 2023-12-03T11:34:34.530 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.512+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.125 2023-12-03T11:34:34.531 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.512+0000 7f4c6c328800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:34:34.531 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.512+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.125 does not exist 2023-12-03T11:34:34.531 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.512+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.126 2023-12-03T11:34:34.531 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.512+0000 7f4c6c328800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:34:34.531 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.512+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.126 does not exist 2023-12-03T11:34:34.531 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.512+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.127 2023-12-03T11:34:34.531 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.512+0000 7f4c6c328800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:34:34.531 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.512+0000 7f4c6c328800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.127 does not exist 2023-12-03T11:34:34.531 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.512+0000 7f4c6c328800 20 static int rgw::cls::fifo::FIFO::create(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, std::optional >, bool, uint64_t, uint64_t):1210 entering 2023-12-03T11:34:34.531 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.515+0000 7f4c6c328800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:34:34.531 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.518+0000 7f4c2dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:34:34.532 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.518+0000 7f4c6c328800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:34:34.532 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:34.518+0000 7f4c6c328800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:34:37.453 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:37.452+0000 7f4c6c328800 10 rgw_init_ioctx warning: failed to set recovery_priority on default.rgw.meta 2023-12-03T11:34:37.454 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:37.452+0000 7f4c6c328800 5 note: GC not initialized 2023-12-03T11:34:37.454 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:37.453+0000 7f4b9cff9640 20 reqs_thread_entry: start 2023-12-03T11:34:37.454 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:37.453+0000 7f4c6c328800 20 init_complete bucket index max shards: 11 2023-12-03T11:34:37.454 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:37.453+0000 7f4c6c328800 20 Filter name: none 2023-12-03T11:34:37.455 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:37.453+0000 7f4b8a7fc640 20 reqs_thread_entry: start 2023-12-03T11:34:37.488 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:37.487+0000 7f4c2dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:34:37.492 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:37.491+0000 7f4c6c328800 20 remove_watcher() i=0 2023-12-03T11:34:37.492 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:37.491+0000 7f4c6c328800 2 removed watcher, disabling cache 2023-12-03T11:34:37.493 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:37.492+0000 7f4c6c328800 20 remove_watcher() i=1 2023-12-03T11:34:37.496 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:37.495+0000 7f4c6c328800 20 remove_watcher() i=2 2023-12-03T11:34:37.500 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:37.500+0000 7f4c6c328800 20 remove_watcher() i=3 2023-12-03T11:34:37.502 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:37.501+0000 7f4c6c328800 20 remove_watcher() i=4 2023-12-03T11:34:37.503 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:37.502+0000 7f4c6c328800 20 remove_watcher() i=5 2023-12-03T11:34:37.507 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:37.506+0000 7f4c6c328800 20 remove_watcher() i=6 2023-12-03T11:34:37.508 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:37.507+0000 7f4c6c328800 20 remove_watcher() i=7 2023-12-03T11:34:37.596 INFO:teuthology.orchestra.run.smithi003.stdout:[] 2023-12-03T11:34:37.596 DEBUG:tasks.util.rgw: json result: [] 2023-12-03T11:34:37.596 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2023-12-03T11:34:37.597 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2023-12-03T11:34:37.597 DEBUG:teuthology.orchestra.run.smithi003:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement modify --rgw-zone default --placement-id default-placement --compression random 2023-12-03T11:34:37.651 INFO:teuthology.orchestra.run.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:34:37.651 INFO:teuthology.orchestra.run.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:34:37.663 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:37.662+0000 7fb34860f800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:34:37.664 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:37.662+0000 7fb34860f800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:34:37.667 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:37.666+0000 7fb281ffb640 20 reqs_thread_entry: start 2023-12-03T11:34:37.678 INFO:teuthology.orchestra.run.smithi003.stdout:{"id":"83aabb46-04b5-4c96-9933-c6bfb1173a73","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":"","notif_pool":"default.rgw.log:notif"} 2023-12-03T11:34:37.678 DEBUG:tasks.util.rgw: json result: {'id': '83aabb46-04b5-4c96-9933-c6bfb1173a73', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': '', 'notif_pool': 'default.rgw.log:notif'} 2023-12-03T11:34:37.678 INFO:tasks.rgw:Preparing directory for rgw datacache at /tmp/rgw_datacache 2023-12-03T11:34:37.679 DEBUG:teuthology.orchestra.run.smithi003:> mkdir -p /tmp/rgw_datacache 2023-12-03T11:34:37.694 DEBUG:teuthology.orchestra.run.smithi003:> sudo chmod a+rwx /tmp/rgw_datacache 2023-12-03T11:34:37.765 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2023-12-03T11:34:37.765 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2023-12-03T11:34:37.765 DEBUG:teuthology.orchestra.run.smithi003:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2023-12-03T11:34:37.847 INFO:teuthology.orchestra.run.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:34:37.847 INFO:teuthology.orchestra.run.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:34:37.859 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:37.858+0000 7f6257328800 20 rados->read ofs=0 len=0 2023-12-03T11:34:37.861 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:37.860+0000 7f6257328800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:34:37.861 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:37.860+0000 7f6257328800 20 realm 2023-12-03T11:34:37.861 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:37.860+0000 7f6257328800 20 rados->read ofs=0 len=0 2023-12-03T11:34:37.861 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:37.860+0000 7f6257328800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:34:37.861 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:37.860+0000 7f6257328800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:34:37.861 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:37.860+0000 7f6257328800 20 rados->read ofs=0 len=0 2023-12-03T11:34:37.861 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:37.860+0000 7f6257328800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:34:37.861 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:37.860+0000 7f6257328800 20 rados->read ofs=0 len=0 2023-12-03T11:34:37.862 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:37.861+0000 7f6257328800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:34:37.862 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:37.861+0000 7f6257328800 20 rados->read ofs=0 len=0 2023-12-03T11:34:37.862 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:37.861+0000 7f6257328800 20 rados_obj.operate() r=0 bl.length=890 2023-12-03T11:34:37.863 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:37.861+0000 7f6257328800 20 searching for the correct realm 2023-12-03T11:34:37.874 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:37.873+0000 7f6252fd0640 0 -- 172.21.15.3:0/3810349309 >> [v2:172.21.15.37:6805/1692844418,v1:172.21.15.37:6807/1692844418] conn(0x564e16e655c0 msgr2=0x564e16e679b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:34:37.875 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:37.874+0000 7f6257328800 20 RGWRados::pool_iterate: got zone_info.83aabb46-04b5-4c96-9933-c6bfb1173a73 2023-12-03T11:34:37.875 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:37.874+0000 7f6257328800 20 RGWRados::pool_iterate: got zonegroup_info.6a811aad-435d-4fdd-93c9-b7e0b50de429 2023-12-03T11:34:37.875 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:37.874+0000 7f6257328800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:34:37.875 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:37.874+0000 7f6257328800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:34:37.875 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:37.874+0000 7f6257328800 20 rados->read ofs=0 len=0 2023-12-03T11:34:37.875 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:37.874+0000 7f6257328800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:34:37.876 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:37.874+0000 7f6257328800 20 rados->read ofs=0 len=0 2023-12-03T11:34:37.876 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:37.874+0000 7f6257328800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:34:37.876 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:37.874+0000 7f6257328800 20 rados->read ofs=0 len=0 2023-12-03T11:34:37.877 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:37.874+0000 7f6257328800 20 rados_obj.operate() r=0 bl.length=420 2023-12-03T11:34:37.877 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:37.874+0000 7f6257328800 20 zone default found 2023-12-03T11:34:37.877 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:37.874+0000 7f6257328800 4 Realm: () 2023-12-03T11:34:37.877 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:37.874+0000 7f6257328800 4 ZoneGroup: default (6a811aad-435d-4fdd-93c9-b7e0b50de429) 2023-12-03T11:34:37.877 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:37.874+0000 7f6257328800 4 Zone: default (83aabb46-04b5-4c96-9933-c6bfb1173a73) 2023-12-03T11:34:37.877 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:37.874+0000 7f6257328800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:34:37.877 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:37.874+0000 7f6257328800 20 zonegroup default 2023-12-03T11:34:37.877 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:37.874+0000 7f6257328800 20 rados->read ofs=0 len=0 2023-12-03T11:34:37.877 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:37.875+0000 7f6257328800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:34:37.877 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:37.875+0000 7f6257328800 20 rados->read ofs=0 len=0 2023-12-03T11:34:37.877 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:37.875+0000 7f6257328800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:34:37.877 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:37.875+0000 7f6257328800 20 rados->read ofs=0 len=0 2023-12-03T11:34:37.877 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:37.875+0000 7f6257328800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:34:37.878 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:37.875+0000 7f6257328800 20 started sync module instance, tier type = 2023-12-03T11:34:37.878 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:37.875+0000 7f6257328800 20 started zone id=83aabb46-04b5-4c96-9933-c6bfb1173a73 (name=default) with tier type = 2023-12-03T11:34:37.889 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:37.888+0000 7f6252fd0640 0 -- 172.21.15.3:0/3810349309 >> [v2:172.21.15.3:6808/263125788,v1:172.21.15.3:6809/263125788] conn(0x7f624801a040 msgr2=0x7f6248089730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:34:37.889 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:37.888+0000 7f6257328800 20 add_watcher() i=0 2023-12-03T11:34:37.889 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:37.888+0000 7f6257328800 20 add_watcher() i=1 2023-12-03T11:34:37.890 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:37.888+0000 7f6257328800 20 add_watcher() i=2 2023-12-03T11:34:37.890 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:37.888+0000 7f6257328800 20 add_watcher() i=3 2023-12-03T11:34:37.890 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:37.888+0000 7f6257328800 20 add_watcher() i=4 2023-12-03T11:34:37.890 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:37.888+0000 7f6257328800 20 add_watcher() i=5 2023-12-03T11:34:37.892 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:37.890+0000 7f6257328800 20 add_watcher() i=6 2023-12-03T11:34:37.892 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:37.891+0000 7f6257328800 20 add_watcher() i=7 2023-12-03T11:34:37.892 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:37.891+0000 7f6257328800 2 all 8 watchers are set, enabling cache 2023-12-03T11:34:37.894 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:37.893+0000 7f6193fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:34:37.894 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:37.893+0000 7f6257328800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:34:37.894 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:37.893+0000 7f6257328800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:34:37.899 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:37.897+0000 7f6257328800 5 note: GC not initialized 2023-12-03T11:34:37.899 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:37.898+0000 7f6182ffd640 20 reqs_thread_entry: start 2023-12-03T11:34:37.899 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:37.898+0000 7f6257328800 20 init_complete bucket index max shards: 11 2023-12-03T11:34:37.899 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:37.898+0000 7f6257328800 20 Filter name: none 2023-12-03T11:34:37.899 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:37.898+0000 7f6180ff9640 20 reqs_thread_entry: start 2023-12-03T11:34:37.909 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:37.908+0000 7f6193fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:34:37.911 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:37.911+0000 7f6257328800 20 remove_watcher() i=0 2023-12-03T11:34:37.912 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:37.911+0000 7f6257328800 2 removed watcher, disabling cache 2023-12-03T11:34:37.913 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:37.912+0000 7f6257328800 20 remove_watcher() i=1 2023-12-03T11:34:37.916 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:37.915+0000 7f6257328800 20 remove_watcher() i=2 2023-12-03T11:34:37.917 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:37.916+0000 7f6257328800 20 remove_watcher() i=3 2023-12-03T11:34:37.918 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:37.917+0000 7f6257328800 20 remove_watcher() i=4 2023-12-03T11:34:37.919 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:37.918+0000 7f6257328800 20 remove_watcher() i=5 2023-12-03T11:34:37.921 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:37.920+0000 7f6257328800 20 remove_watcher() i=6 2023-12-03T11:34:37.922 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:37.921+0000 7f6257328800 20 remove_watcher() i=7 2023-12-03T11:34:37.927 INFO:teuthology.orchestra.run.smithi003.stdout:[] 2023-12-03T11:34:37.927 DEBUG:tasks.util.rgw: json result: [] 2023-12-03T11:34:37.927 INFO:tasks.rgw:Configuring storage class type = LUKEWARM 2023-12-03T11:34:37.927 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2023-12-03T11:34:37.927 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2023-12-03T11:34:37.927 DEBUG:teuthology.orchestra.run.smithi003:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM 2023-12-03T11:34:38.015 INFO:teuthology.orchestra.run.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:34:38.015 INFO:teuthology.orchestra.run.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:34:38.026 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:38.025+0000 7fc1b060f800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:34:38.026 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:38.025+0000 7fc1b060f800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:34:38.030 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:38.029+0000 7fc0e9ffb640 20 reqs_thread_entry: start 2023-12-03T11:34:38.039 INFO:teuthology.orchestra.run.smithi003.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["LUKEWARM","STANDARD"]}}] 2023-12-03T11:34:38.039 DEBUG:tasks.util.rgw: json result: [{'key': 'default-placement', 'val': {'name': 'default-placement', 'tags': [], 'storage_classes': ['LUKEWARM', 'STANDARD']}}] 2023-12-03T11:34:38.039 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2023-12-03T11:34:38.039 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2023-12-03T11:34:38.039 DEBUG:teuthology.orchestra.run.smithi003:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM --data-pool default.rgw.buckets.data.lukewarm 2023-12-03T11:34:38.089 INFO:teuthology.orchestra.run.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:34:38.089 INFO:teuthology.orchestra.run.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:34:38.100 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:38.099+0000 7fdb04f28800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:34:38.100 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:38.099+0000 7fdb04f28800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:34:38.103 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:38.102+0000 7fda3effd640 20 reqs_thread_entry: start 2023-12-03T11:34:38.112 INFO:teuthology.orchestra.run.smithi003.stdout:{"id":"83aabb46-04b5-4c96-9933-c6bfb1173a73","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":"","notif_pool":"default.rgw.log:notif"} 2023-12-03T11:34:38.113 DEBUG:tasks.util.rgw: json result: {'id': '83aabb46-04b5-4c96-9933-c6bfb1173a73', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'LUKEWARM': {'data_pool': 'default.rgw.buckets.data.lukewarm'}, 'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': '', 'notif_pool': 'default.rgw.log:notif'} 2023-12-03T11:34:38.113 INFO:tasks.rgw:Configuring storage class type = FROZEN 2023-12-03T11:34:38.113 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2023-12-03T11:34:38.113 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2023-12-03T11:34:38.113 DEBUG:teuthology.orchestra.run.smithi003:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN 2023-12-03T11:34:38.161 INFO:teuthology.orchestra.run.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:34:38.161 INFO:teuthology.orchestra.run.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:34:38.172 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:38.171+0000 7f20a5124800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:34:38.173 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:38.171+0000 7f20a5124800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:34:38.176 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:38.175+0000 7f1fdeffd640 20 reqs_thread_entry: start 2023-12-03T11:34:38.185 INFO:teuthology.orchestra.run.smithi003.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["FROZEN","LUKEWARM","STANDARD"]}}] 2023-12-03T11:34:38.185 DEBUG:tasks.util.rgw: json result: [{'key': 'default-placement', 'val': {'name': 'default-placement', 'tags': [], 'storage_classes': ['FROZEN', 'LUKEWARM', 'STANDARD']}}] 2023-12-03T11:34:38.185 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2023-12-03T11:34:38.185 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2023-12-03T11:34:38.185 DEBUG:teuthology.orchestra.run.smithi003:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN --data-pool default.rgw.buckets.data.frozen 2023-12-03T11:34:38.235 INFO:teuthology.orchestra.run.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:34:38.235 INFO:teuthology.orchestra.run.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:34:38.247 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:38.246+0000 7fccd1721800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:34:38.247 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:38.246+0000 7fccd1721800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:34:38.250 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:34:38.249+0000 7fcc0affd640 20 reqs_thread_entry: start 2023-12-03T11:34:38.260 INFO:teuthology.orchestra.run.smithi003.stdout:{"id":"83aabb46-04b5-4c96-9933-c6bfb1173a73","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"FROZEN":{"data_pool":"default.rgw.buckets.data.frozen"},"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":"","notif_pool":"default.rgw.log:notif"} 2023-12-03T11:34:38.260 DEBUG:tasks.util.rgw: json result: {'id': '83aabb46-04b5-4c96-9933-c6bfb1173a73', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'FROZEN': {'data_pool': 'default.rgw.buckets.data.frozen'}, 'LUKEWARM': {'data_pool': 'default.rgw.buckets.data.lukewarm'}, 'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': '', 'notif_pool': 'default.rgw.log:notif'} 2023-12-03T11:34:38.260 INFO:tasks.rgw:Starting rgw... 2023-12-03T11:34:38.260 INFO:tasks.rgw:rgw client.0 config is {'valgrind': ['--tool=memcheck', '--max-threads=1024']} 2023-12-03T11:34:38.260 INFO:tasks.rgw:Using beast as radosgw frontend 2023-12-03T11:34:38.260 DEBUG:tasks.ceph_manager:running ceph.client.0 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/ceph.client.0.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck', '--max-threads=1024'] 2023-12-03T11:34:38.260 INFO:tasks.rgw.client.0:Restarting daemon 2023-12-03T11:34:38.261 DEBUG:teuthology.orchestra.run.smithi003:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/ceph.client.0.log --time-stamp=yes --vgdb=yes --tool=memcheck --max-threads=1024 radosgw --rgw-frontends 'beast port=80' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2023-12-03T11:34:38.263 INFO:tasks.rgw.client.0:Started 2023-12-03T11:34:38.263 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on http://smithi003.front.sepia.ceph.com:80/ 2023-12-03T11:34:38.263 DEBUG:teuthology.orchestra.run.smithi003:> curl http://smithi003.front.sepia.ceph.com:80/ 2023-12-03T11:34:38.282 DEBUG:teuthology.orchestra.run:got remote process result: 7 2023-12-03T11:34:38.283 INFO:teuthology.orchestra.run.smithi003.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2023-12-03T11:34:38.283 INFO:teuthology.orchestra.run.smithi003.stderr: Dload Upload Total Spent Left Speed 2023-12-03T11:34:38.283 INFO:teuthology.orchestra.run.smithi003.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2023-12-03T11:34:38.283 INFO:teuthology.orchestra.run.smithi003.stderr:curl: (7) Failed to connect to smithi003.front.sepia.ceph.com port 80: Connection refused 2023-12-03T11:34:39.284 DEBUG:teuthology.orchestra.run.smithi003:> curl http://smithi003.front.sepia.ceph.com:80/ 2023-12-03T11:34:39.303 INFO:teuthology.orchestra.run.smithi003.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2023-12-03T11:34:39.303 INFO:teuthology.orchestra.run.smithi003.stderr: Dload Upload Total Spent Left Speed 2023-12-03T11:34:39.305 DEBUG:teuthology.orchestra.run:got remote process result: 7 2023-12-03T11:34:39.305 INFO:teuthology.orchestra.run.smithi003.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2023-12-03T11:34:39.305 INFO:teuthology.orchestra.run.smithi003.stderr:curl: (7) Failed to connect to smithi003.front.sepia.ceph.com port 80: Connection refused 2023-12-03T11:34:41.307 DEBUG:teuthology.orchestra.run.smithi003:> curl http://smithi003.front.sepia.ceph.com:80/ 2023-12-03T11:34:41.326 DEBUG:teuthology.orchestra.run:got remote process result: 7 2023-12-03T11:34:41.327 INFO:teuthology.orchestra.run.smithi003.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2023-12-03T11:34:41.327 INFO:teuthology.orchestra.run.smithi003.stderr: Dload Upload Total Spent Left Speed 2023-12-03T11:34:41.327 INFO:teuthology.orchestra.run.smithi003.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2023-12-03T11:34:41.327 INFO:teuthology.orchestra.run.smithi003.stderr:curl: (7) Failed to connect to smithi003.front.sepia.ceph.com port 80: Connection refused 2023-12-03T11:34:45.329 DEBUG:teuthology.orchestra.run.smithi003:> curl http://smithi003.front.sepia.ceph.com:80/ 2023-12-03T11:34:45.347 INFO:teuthology.orchestra.run.smithi003.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2023-12-03T11:34:45.348 INFO:teuthology.orchestra.run.smithi003.stderr: Dload Upload Total Spent Left Speed 2023-12-03T11:34:45.349 DEBUG:teuthology.orchestra.run:got remote process result: 7 2023-12-03T11:34:45.349 INFO:teuthology.orchestra.run.smithi003.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2023-12-03T11:34:45.349 INFO:teuthology.orchestra.run.smithi003.stderr:curl: (7) Failed to connect to smithi003.front.sepia.ceph.com port 80: Connection refused 2023-12-03T11:34:53.350 DEBUG:teuthology.orchestra.run.smithi003:> curl http://smithi003.front.sepia.ceph.com:80/ 2023-12-03T11:34:53.369 INFO:teuthology.orchestra.run.smithi003.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2023-12-03T11:34:53.369 INFO:teuthology.orchestra.run.smithi003.stderr: Dload Upload Total Spent Left Speed 2023-12-03T11:35:02.362 INFO:teuthology.orchestra.run.smithi003.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- 0:00:01 --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- 0:00:02 --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- 0:00:03 --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- 0:00:04 --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- 0:00:05 --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- 0:00:06 --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- 0:00:07 --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- 0:00:08 --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- 0:00:08 --:--:-- 0 100 214 0 214 0 0 23 0 --:--:-- 0:00:08 --:--:-- 56 2023-12-03T11:35:02.362 INFO:teuthology.orchestra.run.smithi003.stdout:anonymous 2023-12-03T11:35:02.362 INFO:teuthology.run_tasks:Running task tox... 2023-12-03T11:35:02.374 INFO:tasks.tox:Deploying tox from pip... 2023-12-03T11:35:02.375 DEBUG:teuthology.orchestra.run.smithi003:> python3 -m venv /home/ubuntu/cephtest/tox-venv 2023-12-03T11:35:04.931 DEBUG:teuthology.orchestra.run.smithi003:> source /home/ubuntu/cephtest/tox-venv/bin/activate && pip install tox==3.15.0 2023-12-03T11:35:06.332 INFO:teuthology.orchestra.run.smithi003.stdout:Collecting tox==3.15.0 2023-12-03T11:35:06.424 INFO:teuthology.orchestra.run.smithi003.stdout: Downloading tox-3.15.0-py2.py3-none-any.whl (82 kB) 2023-12-03T11:35:07.061 INFO:teuthology.orchestra.run.smithi003.stdout:Collecting virtualenv!=20.0.0,!=20.0.1,!=20.0.2,!=20.0.3,!=20.0.4,!=20.0.5,!=20.0.6,!=20.0.7,>=16.0.0 2023-12-03T11:35:07.080 INFO:teuthology.orchestra.run.smithi003.stdout: Downloading virtualenv-20.25.0-py3-none-any.whl (3.8 MB) 2023-12-03T11:35:07.531 INFO:teuthology.orchestra.run.smithi003.stdout:Collecting py<2,>=1.4.17 2023-12-03T11:35:07.548 INFO:teuthology.orchestra.run.smithi003.stdout: Downloading py-1.11.0-py2.py3-none-any.whl (98 kB) 2023-12-03T11:35:07.839 INFO:teuthology.orchestra.run.smithi003.stdout:Collecting toml>=0.9.4 2023-12-03T11:35:07.856 INFO:teuthology.orchestra.run.smithi003.stdout: Downloading toml-0.10.2-py2.py3-none-any.whl (16 kB) 2023-12-03T11:35:08.291 INFO:teuthology.orchestra.run.smithi003.stdout:Collecting six<2,>=1.14.0 2023-12-03T11:35:08.309 INFO:teuthology.orchestra.run.smithi003.stdout: Downloading six-1.16.0-py2.py3-none-any.whl (11 kB) 2023-12-03T11:35:08.631 INFO:teuthology.orchestra.run.smithi003.stdout:Collecting filelock<4,>=3.0.0 2023-12-03T11:35:08.652 INFO:teuthology.orchestra.run.smithi003.stdout: Downloading filelock-3.13.1-py3-none-any.whl (11 kB) 2023-12-03T11:35:08.937 INFO:teuthology.orchestra.run.smithi003.stdout:Collecting pluggy<1,>=0.12.0 2023-12-03T11:35:08.954 INFO:teuthology.orchestra.run.smithi003.stdout: Downloading pluggy-0.13.1-py2.py3-none-any.whl (18 kB) 2023-12-03T11:35:09.255 INFO:teuthology.orchestra.run.smithi003.stdout:Collecting packaging>=14 2023-12-03T11:35:09.273 INFO:teuthology.orchestra.run.smithi003.stdout: Downloading packaging-23.2-py3-none-any.whl (53 kB) 2023-12-03T11:35:09.598 INFO:teuthology.orchestra.run.smithi003.stdout:Collecting distlib<1,>=0.3.7 2023-12-03T11:35:09.616 INFO:teuthology.orchestra.run.smithi003.stdout: Downloading distlib-0.3.7-py2.py3-none-any.whl (468 kB) 2023-12-03T11:35:09.926 INFO:teuthology.orchestra.run.smithi003.stdout:Collecting platformdirs<5,>=3.9.1 2023-12-03T11:35:09.943 INFO:teuthology.orchestra.run.smithi003.stdout: Downloading platformdirs-4.0.0-py3-none-any.whl (17 kB) 2023-12-03T11:35:10.064 INFO:teuthology.orchestra.run.smithi003.stdout:Installing collected packages: platformdirs, filelock, distlib, virtualenv, toml, six, py, pluggy, packaging, tox 2023-12-03T11:35:10.917 INFO:teuthology.orchestra.run.smithi003.stdout:Successfully installed distlib-0.3.7 filelock-3.13.1 packaging-23.2 platformdirs-4.0.0 pluggy-0.13.1 py-1.11.0 six-1.16.0 toml-0.10.2 tox-3.15.0 virtualenv-20.25.0 2023-12-03T11:35:11.132 INFO:teuthology.orchestra.run.smithi003.stderr:WARNING: You are using pip version 21.2.3; however, version 23.3.1 is available. 2023-12-03T11:35:11.132 INFO:teuthology.orchestra.run.smithi003.stderr:You should consider upgrading via the '/home/ubuntu/cephtest/tox-venv/bin/python3 -m pip install --upgrade pip' command. 2023-12-03T11:35:11.195 INFO:teuthology.run_tasks:Running task workunit... 2023-12-03T11:35:11.207 INFO:tasks.workunit:Pulling workunits from ref bcbf278cf395873c2a482f5a7b2345faf2160319 2023-12-03T11:35:11.207 INFO:tasks.workunit:Making a separate scratch dir for every client... 2023-12-03T11:35:11.208 DEBUG:teuthology.orchestra.run.smithi003:> stat -- /home/ubuntu/cephtest/mnt.0 2023-12-03T11:35:11.222 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-03T11:35:11.223 INFO:teuthology.orchestra.run.smithi003.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2023-12-03T11:35:11.223 DEBUG:teuthology.orchestra.run.smithi003:> mkdir -- /home/ubuntu/cephtest/mnt.0 2023-12-03T11:35:11.278 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2023-12-03T11:35:11.279 DEBUG:teuthology.orchestra.run.smithi003:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2023-12-03T11:35:11.334 INFO:tasks.workunit:timeout=3h 2023-12-03T11:35:11.334 INFO:tasks.workunit:cleanup=True 2023-12-03T11:35:11.334 DEBUG:teuthology.orchestra.run.smithi003:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout bcbf278cf395873c2a482f5a7b2345faf2160319 2023-12-03T11:35:11.390 INFO:tasks.workunit.client.0.smithi003.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2023-12-03T11:36:16.251 INFO:tasks.workunit.client.0.smithi003.stderr:Updating files: 97% (11846/12123) Updating files: 98% (11881/12123) Updating files: 99% (12002/12123) Updating files: 100% (12123/12123) Updating files: 100% (12123/12123), done. 2023-12-03T11:36:16.593 INFO:tasks.workunit.client.0.smithi003.stderr:Note: switching to 'bcbf278cf395873c2a482f5a7b2345faf2160319'. 2023-12-03T11:36:16.593 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:36:16.593 INFO:tasks.workunit.client.0.smithi003.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-12-03T11:36:16.593 INFO:tasks.workunit.client.0.smithi003.stderr:changes and commit them, and you can discard any commits you make in this 2023-12-03T11:36:16.593 INFO:tasks.workunit.client.0.smithi003.stderr:state without impacting any branches by switching back to a branch. 2023-12-03T11:36:16.593 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:36:16.593 INFO:tasks.workunit.client.0.smithi003.stderr:If you want to create a new branch to retain commits you create, you may 2023-12-03T11:36:16.593 INFO:tasks.workunit.client.0.smithi003.stderr:do so (now or later) by using -c with the switch command. Example: 2023-12-03T11:36:16.593 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:36:16.594 INFO:tasks.workunit.client.0.smithi003.stderr: git switch -c 2023-12-03T11:36:16.594 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:36:16.594 INFO:tasks.workunit.client.0.smithi003.stderr:Or undo this operation with: 2023-12-03T11:36:16.594 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:36:16.594 INFO:tasks.workunit.client.0.smithi003.stderr: git switch - 2023-12-03T11:36:16.594 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:36:16.594 INFO:tasks.workunit.client.0.smithi003.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-12-03T11:36:16.594 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:36:16.594 INFO:tasks.workunit.client.0.smithi003.stderr:HEAD is now at bcbf278cf39 RGW:pubsub publish commit with etag populated 2023-12-03T11:36:16.596 DEBUG:teuthology.orchestra.run.smithi003:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2023-12-03T11:36:16.664 INFO:tasks.workunit.client.0.smithi003.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2023-12-03T11:36:16.666 INFO:tasks.workunit.client.0.smithi003.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-12-03T11:36:16.666 INFO:tasks.workunit.client.0.smithi003.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2023-12-03T11:36:17.305 INFO:tasks.workunit.client.0.smithi003.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2023-12-03T11:36:17.369 INFO:tasks.workunit.client.0.smithi003.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2023-12-03T11:36:17.412 INFO:tasks.workunit.client.0.smithi003.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-12-03T11:36:17.413 INFO:tasks.workunit.client.0.smithi003.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-12-03T11:36:17.413 INFO:tasks.workunit.client.0.smithi003.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2023-12-03T11:36:17.453 INFO:tasks.workunit.client.0.smithi003.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-12-03T11:36:17.456 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-12-03T11:36:17.456 DEBUG:teuthology.orchestra.run.smithi003:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2023-12-03T11:36:17.511 INFO:tasks.workunit:Running workunits matching rgw/run-datacache.sh on client.0... 2023-12-03T11:36:17.513 INFO:tasks.workunit:Running workunit rgw/run-datacache.sh... 2023-12-03T11:36:17.513 DEBUG:teuthology.orchestra.run.smithi003:workunit test rgw/run-datacache.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bcbf278cf395873c2a482f5a7b2345faf2160319 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RGW_DATACACHE_PATH=/tmp/rgw_datacache adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-datacache.sh 2023-12-03T11:36:17.573 INFO:tasks.workunit.client.0.smithi003.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-datacache.sh 2023-12-03T11:36:17.573 INFO:tasks.workunit.client.0.smithi003.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2023-12-03T11:36:17.574 INFO:tasks.workunit.client.0.smithi003.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2023-12-03T11:36:20.050 INFO:tasks.workunit.client.0.smithi003.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2023-12-03T11:36:20.050 INFO:tasks.workunit.client.0.smithi003.stderr:++ deactivate nondestructive 2023-12-03T11:36:20.050 INFO:tasks.workunit.client.0.smithi003.stderr:++ '[' -n '' ']' 2023-12-03T11:36:20.050 INFO:tasks.workunit.client.0.smithi003.stderr:++ '[' -n '' ']' 2023-12-03T11:36:20.050 INFO:tasks.workunit.client.0.smithi003.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2023-12-03T11:36:20.050 INFO:tasks.workunit.client.0.smithi003.stderr:++ hash -r 2023-12-03T11:36:20.050 INFO:tasks.workunit.client.0.smithi003.stderr:++ '[' -n '' ']' 2023-12-03T11:36:20.050 INFO:tasks.workunit.client.0.smithi003.stderr:++ unset VIRTUAL_ENV 2023-12-03T11:36:20.051 INFO:tasks.workunit.client.0.smithi003.stderr:++ '[' '!' nondestructive = nondestructive ']' 2023-12-03T11:36:20.051 INFO:tasks.workunit.client.0.smithi003.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2023-12-03T11:36:20.051 INFO:tasks.workunit.client.0.smithi003.stderr:++ export VIRTUAL_ENV 2023-12-03T11:36:20.051 INFO:tasks.workunit.client.0.smithi003.stderr:++ _OLD_VIRTUAL_PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2023-12-03T11:36:20.052 INFO:tasks.workunit.client.0.smithi003.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2023-12-03T11:36:20.052 INFO:tasks.workunit.client.0.smithi003.stderr:++ export PATH 2023-12-03T11:36:20.052 INFO:tasks.workunit.client.0.smithi003.stderr:++ '[' -n '' ']' 2023-12-03T11:36:20.052 INFO:tasks.workunit.client.0.smithi003.stderr:++ '[' -z '' ']' 2023-12-03T11:36:20.052 INFO:tasks.workunit.client.0.smithi003.stderr:++ _OLD_VIRTUAL_PS1= 2023-12-03T11:36:20.052 INFO:tasks.workunit.client.0.smithi003.stderr:++ PS1='(rgw) ' 2023-12-03T11:36:20.052 INFO:tasks.workunit.client.0.smithi003.stderr:++ export PS1 2023-12-03T11:36:20.052 INFO:tasks.workunit.client.0.smithi003.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2023-12-03T11:36:20.052 INFO:tasks.workunit.client.0.smithi003.stderr:++ hash -r 2023-12-03T11:36:20.052 INFO:tasks.workunit.client.0.smithi003.stderr:+ pip install pip --upgrade 2023-12-03T11:36:20.292 INFO:tasks.workunit.client.0.smithi003.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.2.3) 2023-12-03T11:36:20.504 INFO:tasks.workunit.client.0.smithi003.stdout:Collecting pip 2023-12-03T11:36:21.100 INFO:tasks.workunit.client.0.smithi003.stdout: Downloading pip-23.3.1-py3-none-any.whl (2.1 MB) 2023-12-03T11:36:24.227 INFO:tasks.workunit.client.0.smithi003.stdout:Installing collected packages: pip 2023-12-03T11:36:24.227 INFO:tasks.workunit.client.0.smithi003.stdout: Attempting uninstall: pip 2023-12-03T11:36:24.227 INFO:tasks.workunit.client.0.smithi003.stdout: Found existing installation: pip 21.2.3 2023-12-03T11:36:24.390 INFO:tasks.workunit.client.0.smithi003.stdout: Uninstalling pip-21.2.3: 2023-12-03T11:36:24.395 INFO:tasks.workunit.client.0.smithi003.stdout: Successfully uninstalled pip-21.2.3 2023-12-03T11:36:25.410 INFO:tasks.workunit.client.0.smithi003.stdout:Successfully installed pip-23.3.1 2023-12-03T11:36:25.664 INFO:tasks.workunit.client.0.smithi003.stderr:+ pip install configobj 2023-12-03T11:36:26.664 INFO:tasks.workunit.client.0.smithi003.stdout:Collecting configobj 2023-12-03T11:36:27.155 INFO:tasks.workunit.client.0.smithi003.stdout: Downloading configobj-5.0.8-py2.py3-none-any.whl (36 kB) 2023-12-03T11:36:27.647 INFO:tasks.workunit.client.0.smithi003.stdout:Collecting six (from configobj) 2023-12-03T11:36:27.840 INFO:tasks.workunit.client.0.smithi003.stdout: Downloading six-1.16.0-py2.py3-none-any.whl (11 kB) 2023-12-03T11:36:27.938 INFO:tasks.workunit.client.0.smithi003.stdout:Installing collected packages: six, configobj 2023-12-03T11:36:28.070 INFO:tasks.workunit.client.0.smithi003.stdout:Successfully installed configobj-5.0.8 six-1.16.0 2023-12-03T11:36:28.141 INFO:tasks.workunit.client.0.smithi003.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_datacache.py 2023-12-03T11:36:28.176 INFO:tasks.workunit.client.0.smithi003.stderr:DEBUG:root:datacache dir from config is: /tmp/rgw_datacache 2023-12-03T11:36:28.176 INFO:tasks.workunit.client.0.smithi003.stderr:DEBUG:root:exec_cmd(pwd) 2023-12-03T11:36:28.178 INFO:tasks.workunit.client.0.smithi003.stderr:INFO:root:command succeeded 2023-12-03T11:36:28.178 INFO:tasks.workunit.client.0.smithi003.stderr:INFO:root:b'/home/ubuntu/cephtest/mnt.0/client.0/tmp\n' 2023-12-03T11:36:28.178 INFO:tasks.workunit.client.0.smithi003.stderr:DEBUG:root:pwd is: /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-12-03T11:36:28.178 INFO:tasks.workunit.client.0.smithi003.stderr:DEBUG:root:exec_cmd(sudo netstat -nltp | egrep "rados|valgr") 2023-12-03T11:36:28.239 INFO:tasks.workunit.client.0.smithi003.stderr:INFO:root:command succeeded 2023-12-03T11:36:28.239 INFO:tasks.workunit.client.0.smithi003.stderr:INFO:root:b'tcp 0 0 0.0.0.0:80 0.0.0.0:* LISTEN 92282/valgrind \ntcp6 0 0 :::80 :::* LISTEN 92282/valgrind \n' 2023-12-03T11:36:28.239 INFO:tasks.workunit.client.0.smithi003.stderr:INFO:root:radosgw port: 80 2023-12-03T11:36:28.239 INFO:tasks.workunit.client.0.smithi003.stderr:INFO:root:radosgw endpoint is: 127.0.0.1 2023-12-03T11:36:28.239 INFO:tasks.workunit.client.0.smithi003.stderr:DEBUG:root:exec_cmd(dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/client.0/tmp/7M.dat bs=1M count=7) 2023-12-03T11:36:28.261 INFO:tasks.workunit.client.0.smithi003.stderr:INFO:root:command succeeded 2023-12-03T11:36:28.261 INFO:tasks.workunit.client.0.smithi003.stderr:INFO:root:b'' 2023-12-03T11:36:28.261 INFO:tasks.workunit.client.0.smithi003.stderr:DEBUG:root:exec_cmd(radosgw-admin user create --uid rgw_datacache_user --display-name DatacacheUser --access-key NX5QOQKC6BH2IDN8HC7A --secret LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn) 2023-12-03T11:36:28.405 INFO:tasks.workunit.client.0.smithi003.stderr:INFO:root:command succeeded 2023-12-03T11:36:28.405 INFO:tasks.workunit.client.0.smithi003.stderr:INFO:root:b'{\n "user_id": "rgw_datacache_user",\n "display_name": "DatacacheUser",\n "email": "",\n "suspended": 0,\n "max_buckets": 1000,\n "subusers": [],\n "keys": [\n {\n "user": "rgw_datacache_user",\n "access_key": "NX5QOQKC6BH2IDN8HC7A",\n "secret_key": "LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn"\n }\n ],\n "swift_keys": [],\n "caps": [],\n "op_mask": "read, write, delete",\n "default_placement": "",\n "default_storage_class": "",\n "placement_tags": [],\n "bucket_quota": {\n "enabled": false,\n "check_on_raw": false,\n "max_size": -1,\n "max_size_kb": 0,\n "max_objects": -1\n },\n "user_quota": {\n "enabled": false,\n "check_on_raw": false,\n "max_size": -1,\n "max_size_kb": 0,\n "max_objects": -1\n },\n "temp_url_keys": [],\n "type": "rgw",\n "mfa_ids": []\n}\n\n' 2023-12-03T11:36:28.405 INFO:tasks.workunit.client.0.smithi003.stderr:INFO:root:Creating s3cmd config... 2023-12-03T11:36:28.406 INFO:tasks.workunit.client.0.smithi003.stderr:INFO:root:proto for s3cmd config is http 2023-12-03T11:36:28.406 INFO:tasks.workunit.client.0.smithi003.stderr:INFO:root:s3cmd config written 2023-12-03T11:36:28.406 INFO:tasks.workunit.client.0.smithi003.stderr:DEBUG:root:exec_cmd(s3cmd --access_key=NX5QOQKC6BH2IDN8HC7A --secret_key=LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn --config=/home/ubuntu/cephtest/mnt.0/client.0/tmp/s3cfg --no-check-hostname --host=127.0.0.1 mb s3://datacachebucket) 2023-12-03T11:36:28.973 INFO:tasks.workunit.client.0.smithi003.stderr:INFO:root:command succeeded 2023-12-03T11:36:28.973 INFO:tasks.workunit.client.0.smithi003.stderr:INFO:root:b"Bucket 's3://datacachebucket/' created\n" 2023-12-03T11:36:28.973 INFO:tasks.workunit.client.0.smithi003.stderr:DEBUG:root:exec_cmd(s3cmd --access_key=NX5QOQKC6BH2IDN8HC7A --secret_key=LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn --config=/home/ubuntu/cephtest/mnt.0/client.0/tmp/s3cfg --no-check-hostname --host=127.0.0.1 put /home/ubuntu/cephtest/mnt.0/client.0/tmp/7M.dat s3://datacachebucket) 2023-12-03T11:36:30.624 INFO:tasks.workunit.client.0.smithi003.stderr:INFO:root:command succeeded 2023-12-03T11:36:30.624 INFO:tasks.workunit.client.0.smithi003.stderr:INFO:root:b"upload: '/home/ubuntu/cephtest/mnt.0/client.0/tmp/7M.dat' -> 's3://datacachebucket/7M.dat' (7340032 bytes in 1.4 seconds, 4.90 MB/s) [1 of 1]\n" 2023-12-03T11:36:30.624 INFO:tasks.workunit.client.0.smithi003.stderr:DEBUG:root:exec_cmd(s3cmd --access_key=NX5QOQKC6BH2IDN8HC7A --secret_key=LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn --config=/home/ubuntu/cephtest/mnt.0/client.0/tmp/s3cfg --no-check-hostname --host=127.0.0.1 get s3://datacachebucket/7M.dat /home/ubuntu/cephtest/mnt.0/client.0/tmp/7M-get.dat --force) 2023-12-03T11:36:31.126 INFO:tasks.workunit.client.0.smithi003.stderr:INFO:root:command succeeded 2023-12-03T11:36:31.126 INFO:tasks.workunit.client.0.smithi003.stderr:INFO:root:b"download: 's3://datacachebucket/7M.dat' -> '/home/ubuntu/cephtest/mnt.0/client.0/tmp/7M-get.dat' (7340032 bytes in 0.3 seconds, 27.12 MB/s)\n" 2023-12-03T11:36:31.126 INFO:tasks.workunit.client.0.smithi003.stderr:DEBUG:root:exec_cmd(radosgw-admin object stat --bucket=datacachebucket --object=7M.dat) 2023-12-03T11:36:31.240 INFO:tasks.workunit.client.0.smithi003.stderr:INFO:root:command succeeded 2023-12-03T11:36:31.240 INFO:tasks.workunit.client.0.smithi003.stderr:INFO:root:b'{\n "name": "7M.dat",\n "size": 7340376,\n "policy": {\n "acl": {\n "acl_user_map": [\n {\n "user": "rgw_datacache_user",\n "acl": 15\n }\n ],\n "acl_group_map": [],\n "grant_map": [\n {\n "id": "rgw_datacache_user",\n "grant": {\n "type": {\n "type": 0\n },\n "id": "rgw_datacache_user",\n "email": "",\n "permission": {\n "flags": 15\n },\n "name": "DatacacheUser",\n "group": 0,\n "url_spec": ""\n }\n }\n ]\n },\n "owner": {\n "id": "rgw_datacache_user",\n "display_name": "DatacacheUser"\n }\n },\n "compression": {\n "compression_type": "snappy",\n "orig_size": 7340032,\n "blocks": [\n {\n "old_ofs": 0,\n "new_ofs": 0,\n "len": 4194500\n },\n {\n "old_ofs": 4194304,\n "new_ofs": 4194500,\n "len": 3145876\n }\n ]\n },\n "etag": "d38b373bc2463471a32d3efcd0cf2307",\n "tag": "83aabb46-04b5-4c96-9933-c6bfb1173a73.4653.5726661499804430027",\n "manifest": {\n "objs": [],\n "obj_size": 7340376,\n "explicit_objs": false,\n "head_size": 4194304,\n "max_head_size": 4194304,\n "prefix": ".JpybQKwEODiNkVCAB6d3pP__RKsNo-t_",\n "rules": [\n {\n "key": 0,\n "val": {\n "start_part_num": 0,\n "start_ofs": 4194304,\n "part_size": 0,\n "stripe_max_size": 6291456,\n "override_prefix": ""\n }\n }\n ],\n "tail_instance": "",\n "tail_placement": {\n "bucket": {\n "name": "datacachebucket",\n "marker": "83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.1",\n "bucket_id": "83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.1",\n "tenant": "",\n "explicit_placement": {\n "data_pool": "",\n "data_extra_pool": "",\n "index_pool": ""\n }\n },\n "placement_rule": "default-placement"\n },\n "tier_type": "",\n "begin_iter": {\n "part_ofs": 0,\n "stripe_ofs": 0,\n "ofs": 0,\n "stripe_size": 4194304,\n "cur_part_id": 0,\n "cur_stripe": 0,\n "cur_override_prefix": "",\n "location": {\n "placement_rule": "default-placement",\n "obj": {\n "bucket": {\n "name": "datacachebucket",\n "marker": "83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.1",\n "bucket_id": "83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.1",\n "tenant": "",\n "explicit_placement": {\n "data_pool": "",\n "data_extra_pool": "",\n "index_pool": ""\n }\n },\n "key": {\n "name": "7M.dat",\n "instance": "",\n "ns": ""\n }\n },\n "raw_obj": {\n "pool": "",\n "oid": "",\n "loc": ""\n },\n "is_raw": false\n }\n },\n "end_iter": {\n "part_ofs": 4194304,\n "stripe_ofs": 4194304,\n "ofs": 7340376,\n "stripe_size": 3146072,\n "cur_part_id": 0,\n "cur_stripe": 1,\n "cur_override_prefix": "",\n "location": {\n "placement_rule": "default-placement",\n "obj": {\n "bucket": {\n "name": "datacachebucket",\n "marker": "83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.1",\n "bucket_id": "83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.1",\n "tenant": "",\n "explicit_placement": {\n "data_pool": "",\n "data_extra_pool": "",\n "index_pool": ""\n }\n },\n "key": {\n "name": ".JpybQKwEODiNkVCAB6d3pP__RKsNo-t_1",\n "instance": "",\n "ns": "shadow"\n }\n },\n "raw_obj": {\n "pool": "",\n "oid": "",\n "loc": ""\n },\n "is_raw": false\n }\n }\n },\n "pg_ver": 0,\n "source_zone": 0,\n "torrent": "",\n "attrs": {\n "user.rgw.content_type": "application/octet-stream",\n "user.rgw.storage_class": "STANDARD",\n "user.rgw.tail_tag": "83aabb46-04b5-4c96-9933-c6bfb1173a73.4653.5726661499804430027",\n "user.rgw.x-amz-content-sha256": "2931bb5156e88f2ff578b27d0bbd8812a8a0e89ef1cc4082736c8c68bd9d6739",\n "user.rgw.x-amz-date": "20231203T113629Z",\n "user.rgw.x-amz-meta-s3cmd-attrs": "atime:1701603388/ctime:1701603388/gid:1301/gname:ubuntu/md5:d38b373bc2463471a32d3efcd0cf2307/mode:33188/mtime:1701603388/uid:1000/uname:ubuntu"\n }\n}\n' 2023-12-03T11:36:31.240 INFO:tasks.workunit.client.0.smithi003.stderr:DEBUG:root:Cached object name is: .JpybQKwEODiNkVCAB6d3pP__RKsNo-t_ 2023-12-03T11:36:31.241 INFO:tasks.workunit.client.0.smithi003.stderr:DEBUG:root:exec_cmd(find /tmp/rgw_datacache -type f | wc -l) 2023-12-03T11:36:31.251 INFO:tasks.workunit.client.0.smithi003.stderr:INFO:root:command succeeded 2023-12-03T11:36:31.251 INFO:tasks.workunit.client.0.smithi003.stderr:INFO:root:b'0\n' 2023-12-03T11:36:31.251 INFO:tasks.workunit.client.0.smithi003.stderr:DEBUG:root:Check cache dir content: 0 2023-12-03T11:36:31.251 INFO:tasks.workunit.client.0.smithi003.stderr:INFO:root:NOTICE: datacache test object not found, inspect if datacache was bypassed or disabled during this check. 2023-12-03T11:36:31.251 INFO:tasks.workunit.client.0.smithi003.stderr:INFO:root:Completed Datacache tests 2023-12-03T11:36:31.257 INFO:tasks.workunit.client.0.smithi003.stderr:+ deactivate 2023-12-03T11:36:31.257 INFO:tasks.workunit.client.0.smithi003.stderr:+ '[' -n /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin ']' 2023-12-03T11:36:31.257 INFO:tasks.workunit.client.0.smithi003.stderr:+ PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2023-12-03T11:36:31.258 INFO:tasks.workunit.client.0.smithi003.stderr:+ export PATH 2023-12-03T11:36:31.258 INFO:tasks.workunit.client.0.smithi003.stderr:+ unset _OLD_VIRTUAL_PATH 2023-12-03T11:36:31.258 INFO:tasks.workunit.client.0.smithi003.stderr:+ '[' -n '' ']' 2023-12-03T11:36:31.258 INFO:tasks.workunit.client.0.smithi003.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2023-12-03T11:36:31.258 INFO:tasks.workunit.client.0.smithi003.stderr:+ hash -r 2023-12-03T11:36:31.258 INFO:tasks.workunit.client.0.smithi003.stderr:+ '[' -n '' ']' 2023-12-03T11:36:31.258 INFO:tasks.workunit.client.0.smithi003.stderr:+ unset VIRTUAL_ENV 2023-12-03T11:36:31.258 INFO:tasks.workunit.client.0.smithi003.stderr:+ '[' '!' '' = nondestructive ']' 2023-12-03T11:36:31.258 INFO:tasks.workunit.client.0.smithi003.stderr:+ unset -f deactivate 2023-12-03T11:36:31.258 INFO:tasks.workunit.client.0.smithi003.stderr:+ echo OK. 2023-12-03T11:36:31.259 INFO:tasks.workunit.client.0.smithi003.stdout:OK. 2023-12-03T11:36:31.259 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-12-03T11:36:31.260 DEBUG:teuthology.orchestra.run.smithi003:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-12-03T11:36:31.333 INFO:tasks.workunit:Stopping ['rgw/run-datacache.sh'] on client.0... 2023-12-03T11:36:31.333 DEBUG:teuthology.orchestra.run.smithi003:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2023-12-03T11:36:31.638 DEBUG:teuthology.parallel:result is None 2023-12-03T11:36:31.639 DEBUG:teuthology.orchestra.run.smithi003:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2023-12-03T11:36:31.669 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2023-12-03T11:36:31.669 DEBUG:teuthology.orchestra.run.smithi003:> rmdir -- /home/ubuntu/cephtest/mnt.0 2023-12-03T11:36:31.773 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2023-12-03T11:36:31.773 INFO:teuthology.run_tasks:Running task workunit... 2023-12-03T11:36:31.781 INFO:tasks.workunit:Pulling workunits from ref bcbf278cf395873c2a482f5a7b2345faf2160319 2023-12-03T11:36:31.782 INFO:tasks.workunit:Making a separate scratch dir for every client... 2023-12-03T11:36:31.782 DEBUG:teuthology.orchestra.run.smithi003:> stat -- /home/ubuntu/cephtest/mnt.0 2023-12-03T11:36:31.798 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-03T11:36:31.798 INFO:teuthology.orchestra.run.smithi003.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2023-12-03T11:36:31.798 DEBUG:teuthology.orchestra.run.smithi003:> mkdir -- /home/ubuntu/cephtest/mnt.0 2023-12-03T11:36:31.854 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2023-12-03T11:36:31.854 DEBUG:teuthology.orchestra.run.smithi003:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2023-12-03T11:36:31.910 INFO:tasks.workunit:timeout=3h 2023-12-03T11:36:31.910 INFO:tasks.workunit:cleanup=True 2023-12-03T11:36:31.911 DEBUG:teuthology.orchestra.run.smithi003:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout bcbf278cf395873c2a482f5a7b2345faf2160319 2023-12-03T11:36:31.966 INFO:tasks.workunit.client.0.smithi003.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2023-12-03T11:37:36.266 INFO:tasks.workunit.client.0.smithi003.stderr:Updating files: 99% (12045/12123) Updating files: 100% (12123/12123) Updating files: 100% (12123/12123), done. 2023-12-03T11:37:36.607 INFO:tasks.workunit.client.0.smithi003.stderr:Note: switching to 'bcbf278cf395873c2a482f5a7b2345faf2160319'. 2023-12-03T11:37:36.607 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:37:36.607 INFO:tasks.workunit.client.0.smithi003.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-12-03T11:37:36.607 INFO:tasks.workunit.client.0.smithi003.stderr:changes and commit them, and you can discard any commits you make in this 2023-12-03T11:37:36.607 INFO:tasks.workunit.client.0.smithi003.stderr:state without impacting any branches by switching back to a branch. 2023-12-03T11:37:36.607 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:37:36.607 INFO:tasks.workunit.client.0.smithi003.stderr:If you want to create a new branch to retain commits you create, you may 2023-12-03T11:37:36.607 INFO:tasks.workunit.client.0.smithi003.stderr:do so (now or later) by using -c with the switch command. Example: 2023-12-03T11:37:36.607 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:37:36.607 INFO:tasks.workunit.client.0.smithi003.stderr: git switch -c 2023-12-03T11:37:36.607 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:37:36.608 INFO:tasks.workunit.client.0.smithi003.stderr:Or undo this operation with: 2023-12-03T11:37:36.608 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:37:36.608 INFO:tasks.workunit.client.0.smithi003.stderr: git switch - 2023-12-03T11:37:36.608 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:37:36.608 INFO:tasks.workunit.client.0.smithi003.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-12-03T11:37:36.608 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:37:36.608 INFO:tasks.workunit.client.0.smithi003.stderr:HEAD is now at bcbf278cf39 RGW:pubsub publish commit with etag populated 2023-12-03T11:37:36.610 DEBUG:teuthology.orchestra.run.smithi003:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2023-12-03T11:37:36.665 INFO:tasks.workunit.client.0.smithi003.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2023-12-03T11:37:36.668 INFO:tasks.workunit.client.0.smithi003.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-12-03T11:37:36.668 INFO:tasks.workunit.client.0.smithi003.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2023-12-03T11:37:36.718 INFO:tasks.workunit.client.0.smithi003.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2023-12-03T11:37:36.770 INFO:tasks.workunit.client.0.smithi003.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2023-12-03T11:37:36.811 INFO:tasks.workunit.client.0.smithi003.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-12-03T11:37:36.813 INFO:tasks.workunit.client.0.smithi003.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-12-03T11:37:36.813 INFO:tasks.workunit.client.0.smithi003.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2023-12-03T11:37:36.854 INFO:tasks.workunit.client.0.smithi003.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-12-03T11:37:36.857 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-12-03T11:37:36.857 DEBUG:teuthology.orchestra.run.smithi003:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2023-12-03T11:37:36.912 INFO:tasks.workunit:Running workunits matching rgw/run-bucket-check.sh on client.0... 2023-12-03T11:37:36.914 INFO:tasks.workunit:Running workunit rgw/run-bucket-check.sh... 2023-12-03T11:37:36.914 DEBUG:teuthology.orchestra.run.smithi003:workunit test rgw/run-bucket-check.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bcbf278cf395873c2a482f5a7b2345faf2160319 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-bucket-check.sh 2023-12-03T11:37:36.971 INFO:tasks.workunit.client.0.smithi003.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-bucket-check.sh 2023-12-03T11:37:36.972 INFO:tasks.workunit.client.0.smithi003.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2023-12-03T11:37:36.972 INFO:tasks.workunit.client.0.smithi003.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2023-12-03T11:37:39.437 INFO:tasks.workunit.client.0.smithi003.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2023-12-03T11:37:39.437 INFO:tasks.workunit.client.0.smithi003.stderr:++ deactivate nondestructive 2023-12-03T11:37:39.437 INFO:tasks.workunit.client.0.smithi003.stderr:++ '[' -n '' ']' 2023-12-03T11:37:39.437 INFO:tasks.workunit.client.0.smithi003.stderr:++ '[' -n '' ']' 2023-12-03T11:37:39.437 INFO:tasks.workunit.client.0.smithi003.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2023-12-03T11:37:39.437 INFO:tasks.workunit.client.0.smithi003.stderr:++ hash -r 2023-12-03T11:37:39.437 INFO:tasks.workunit.client.0.smithi003.stderr:++ '[' -n '' ']' 2023-12-03T11:37:39.438 INFO:tasks.workunit.client.0.smithi003.stderr:++ unset VIRTUAL_ENV 2023-12-03T11:37:39.438 INFO:tasks.workunit.client.0.smithi003.stderr:++ '[' '!' nondestructive = nondestructive ']' 2023-12-03T11:37:39.438 INFO:tasks.workunit.client.0.smithi003.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2023-12-03T11:37:39.438 INFO:tasks.workunit.client.0.smithi003.stderr:++ export VIRTUAL_ENV 2023-12-03T11:37:39.438 INFO:tasks.workunit.client.0.smithi003.stderr:++ _OLD_VIRTUAL_PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2023-12-03T11:37:39.439 INFO:tasks.workunit.client.0.smithi003.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2023-12-03T11:37:39.439 INFO:tasks.workunit.client.0.smithi003.stderr:++ export PATH 2023-12-03T11:37:39.439 INFO:tasks.workunit.client.0.smithi003.stderr:++ '[' -n '' ']' 2023-12-03T11:37:39.439 INFO:tasks.workunit.client.0.smithi003.stderr:++ '[' -z '' ']' 2023-12-03T11:37:39.439 INFO:tasks.workunit.client.0.smithi003.stderr:++ _OLD_VIRTUAL_PS1= 2023-12-03T11:37:39.439 INFO:tasks.workunit.client.0.smithi003.stderr:++ PS1='(rgw) ' 2023-12-03T11:37:39.439 INFO:tasks.workunit.client.0.smithi003.stderr:++ export PS1 2023-12-03T11:37:39.439 INFO:tasks.workunit.client.0.smithi003.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2023-12-03T11:37:39.439 INFO:tasks.workunit.client.0.smithi003.stderr:++ hash -r 2023-12-03T11:37:39.439 INFO:tasks.workunit.client.0.smithi003.stderr:+ pip install pip --upgrade 2023-12-03T11:37:39.678 INFO:tasks.workunit.client.0.smithi003.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.2.3) 2023-12-03T11:37:39.880 INFO:tasks.workunit.client.0.smithi003.stdout:Collecting pip 2023-12-03T11:37:39.887 INFO:tasks.workunit.client.0.smithi003.stdout: Using cached pip-23.3.1-py3-none-any.whl (2.1 MB) 2023-12-03T11:37:39.936 INFO:tasks.workunit.client.0.smithi003.stdout:Installing collected packages: pip 2023-12-03T11:37:39.936 INFO:tasks.workunit.client.0.smithi003.stdout: Attempting uninstall: pip 2023-12-03T11:37:39.936 INFO:tasks.workunit.client.0.smithi003.stdout: Found existing installation: pip 21.2.3 2023-12-03T11:37:40.096 INFO:tasks.workunit.client.0.smithi003.stdout: Uninstalling pip-21.2.3: 2023-12-03T11:37:40.101 INFO:tasks.workunit.client.0.smithi003.stdout: Successfully uninstalled pip-21.2.3 2023-12-03T11:37:41.122 INFO:tasks.workunit.client.0.smithi003.stdout:Successfully installed pip-23.3.1 2023-12-03T11:37:41.170 INFO:tasks.workunit.client.0.smithi003.stderr:+ pip install boto3 2023-12-03T11:37:43.267 INFO:tasks.workunit.client.0.smithi003.stdout:Collecting boto3 2023-12-03T11:37:43.344 INFO:tasks.workunit.client.0.smithi003.stdout: Downloading boto3-1.33.6-py3-none-any.whl.metadata (6.7 kB) 2023-12-03T11:37:44.756 INFO:tasks.workunit.client.0.smithi003.stdout:Collecting botocore<1.34.0,>=1.33.6 (from boto3) 2023-12-03T11:37:44.773 INFO:tasks.workunit.client.0.smithi003.stdout: Downloading botocore-1.33.6-py3-none-any.whl.metadata (6.1 kB) 2023-12-03T11:37:45.023 INFO:tasks.workunit.client.0.smithi003.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2023-12-03T11:37:45.040 INFO:tasks.workunit.client.0.smithi003.stdout: Downloading jmespath-1.0.1-py3-none-any.whl (20 kB) 2023-12-03T11:37:45.312 INFO:tasks.workunit.client.0.smithi003.stdout:Collecting s3transfer<0.9.0,>=0.8.2 (from boto3) 2023-12-03T11:37:45.329 INFO:tasks.workunit.client.0.smithi003.stdout: Downloading s3transfer-0.8.2-py3-none-any.whl.metadata (1.8 kB) 2023-12-03T11:37:45.639 INFO:tasks.workunit.client.0.smithi003.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.34.0,>=1.33.6->boto3) 2023-12-03T11:37:45.656 INFO:tasks.workunit.client.0.smithi003.stdout: Downloading python_dateutil-2.8.2-py2.py3-none-any.whl (247 kB) 2023-12-03T11:37:45.750 INFO:tasks.workunit.client.0.smithi003.stdout: ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 247.7/247.7 kB 2.6 MB/s eta 0:00:00 2023-12-03T11:37:46.037 INFO:tasks.workunit.client.0.smithi003.stdout:Collecting urllib3<1.27,>=1.25.4 (from botocore<1.34.0,>=1.33.6->boto3) 2023-12-03T11:37:46.053 INFO:tasks.workunit.client.0.smithi003.stdout: Downloading urllib3-1.26.18-py2.py3-none-any.whl.metadata (48 kB) 2023-12-03T11:37:46.118 INFO:tasks.workunit.client.0.smithi003.stdout: ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 48.9/48.9 kB 625.8 kB/s eta 0:00:00 2023-12-03T11:37:46.472 INFO:tasks.workunit.client.0.smithi003.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.34.0,>=1.33.6->boto3) 2023-12-03T11:37:46.473 INFO:tasks.workunit.client.0.smithi003.stdout: Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2023-12-03T11:37:46.514 INFO:tasks.workunit.client.0.smithi003.stdout:Downloading boto3-1.33.6-py3-none-any.whl (139 kB) 2023-12-03T11:37:46.568 INFO:tasks.workunit.client.0.smithi003.stdout: ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 139.3/139.3 kB 2.5 MB/s eta 0:00:00 2023-12-03T11:37:46.596 INFO:tasks.workunit.client.0.smithi003.stdout:Downloading botocore-1.33.6-py3-none-any.whl (11.8 MB) 2023-12-03T11:37:46.846 INFO:tasks.workunit.client.0.smithi003.stdout: ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 11.8/11.8 MB 48.3 MB/s eta 0:00:00 2023-12-03T11:37:46.865 INFO:tasks.workunit.client.0.smithi003.stdout:Downloading s3transfer-0.8.2-py3-none-any.whl (82 kB) 2023-12-03T11:37:46.919 INFO:tasks.workunit.client.0.smithi003.stdout: ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 82.0/82.0 kB 1.4 MB/s eta 0:00:00 2023-12-03T11:37:46.937 INFO:tasks.workunit.client.0.smithi003.stdout:Downloading urllib3-1.26.18-py2.py3-none-any.whl (143 kB) 2023-12-03T11:37:46.986 INFO:tasks.workunit.client.0.smithi003.stdout: ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 143.8/143.8 kB 2.8 MB/s eta 0:00:00 2023-12-03T11:37:47.091 INFO:tasks.workunit.client.0.smithi003.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2023-12-03T11:37:48.157 INFO:tasks.workunit.client.0.smithi003.stdout:Successfully installed boto3-1.33.6 botocore-1.33.6 jmespath-1.0.1 python-dateutil-2.8.2 s3transfer-0.8.2 six-1.16.0 urllib3-1.26.18 2023-12-03T11:37:48.285 INFO:tasks.workunit.client.0.smithi003.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_bucket_check.py 2023-12-03T11:37:48.423 INFO:tasks.workunit.client.0.smithi003.stderr:radosgw-admin user create --uid check-tester --display-name "Check Testing" --access-key OJODXSLNX4LUNHQG99PA --secret 3l6ffld34qaymfomuh832j94738aie2x4p2o8h6n 2023-12-03T11:37:48.458 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:37:48.458 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:37:48.473 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:48.471+0000 7f02ea337800 20 rados->read ofs=0 len=0 2023-12-03T11:37:48.475 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:48.473+0000 7f02ea337800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:48.475 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:48.473+0000 7f02ea337800 20 realm 2023-12-03T11:37:48.475 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:48.473+0000 7f02ea337800 20 rados->read ofs=0 len=0 2023-12-03T11:37:48.475 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:48.473+0000 7f02ea337800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:48.475 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:48.473+0000 7f02ea337800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:37:48.475 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:48.473+0000 7f02ea337800 20 rados->read ofs=0 len=0 2023-12-03T11:37:48.475 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:48.474+0000 7f02ea337800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:48.475 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:48.474+0000 7f02ea337800 20 rados->read ofs=0 len=0 2023-12-03T11:37:48.475 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:48.475+0000 7f02ea337800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:37:48.476 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:48.475+0000 7f02ea337800 20 rados->read ofs=0 len=0 2023-12-03T11:37:48.476 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:48.475+0000 7f02ea337800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:37:48.476 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:48.475+0000 7f02ea337800 20 searching for the correct realm 2023-12-03T11:37:48.486 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:48.485+0000 7f02e58cc640 0 -- 172.21.15.3:0/4148508212 >> [v2:172.21.15.3:6817/3356208405,v1:172.21.15.3:6819/3356208405] conn(0x55e3092ea910 msgr2=0x55e3092ecd00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-03T11:37:48.488 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:48.487+0000 7f02ea337800 20 RGWRados::pool_iterate: got zone_info.83aabb46-04b5-4c96-9933-c6bfb1173a73 2023-12-03T11:37:48.488 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:48.487+0000 7f02ea337800 20 RGWRados::pool_iterate: got zonegroup_info.6a811aad-435d-4fdd-93c9-b7e0b50de429 2023-12-03T11:37:48.489 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:48.487+0000 7f02ea337800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:37:48.489 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:48.487+0000 7f02ea337800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:37:48.489 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:48.487+0000 7f02ea337800 20 rados->read ofs=0 len=0 2023-12-03T11:37:48.489 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:48.487+0000 7f02ea337800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:48.489 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:48.487+0000 7f02ea337800 20 rados->read ofs=0 len=0 2023-12-03T11:37:48.490 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:48.488+0000 7f02ea337800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:37:48.490 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:48.488+0000 7f02ea337800 20 rados->read ofs=0 len=0 2023-12-03T11:37:48.490 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:48.488+0000 7f02ea337800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:37:48.490 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:48.488+0000 7f02ea337800 20 zone default found 2023-12-03T11:37:48.490 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:48.488+0000 7f02ea337800 4 Realm: () 2023-12-03T11:37:48.491 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:48.488+0000 7f02ea337800 4 ZoneGroup: default (6a811aad-435d-4fdd-93c9-b7e0b50de429) 2023-12-03T11:37:48.491 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:48.488+0000 7f02ea337800 4 Zone: default (83aabb46-04b5-4c96-9933-c6bfb1173a73) 2023-12-03T11:37:48.491 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:48.488+0000 7f02ea337800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:37:48.491 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:48.488+0000 7f02ea337800 20 zonegroup default 2023-12-03T11:37:48.491 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:48.488+0000 7f02ea337800 20 rados->read ofs=0 len=0 2023-12-03T11:37:48.491 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:48.488+0000 7f02ea337800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:48.491 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:48.488+0000 7f02ea337800 20 rados->read ofs=0 len=0 2023-12-03T11:37:48.491 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:48.489+0000 7f02ea337800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:48.491 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:48.489+0000 7f02ea337800 20 rados->read ofs=0 len=0 2023-12-03T11:37:48.491 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:48.489+0000 7f02ea337800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:48.491 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:48.489+0000 7f02ea337800 20 started sync module instance, tier type = 2023-12-03T11:37:48.491 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:48.489+0000 7f02ea337800 20 started zone id=83aabb46-04b5-4c96-9933-c6bfb1173a73 (name=default) with tier type = 2023-12-03T11:37:48.495 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:48.494+0000 7f02e60cd640 0 -- 172.21.15.3:0/4148508212 >> [v2:172.21.15.3:6800/2373485412,v1:172.21.15.3:6801/2373485412] conn(0x7f02e001b410 msgr2=0x7f02e001b830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:37:48.500 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:48.499+0000 7f02ea337800 20 add_watcher() i=0 2023-12-03T11:37:48.500 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:48.499+0000 7f02ea337800 20 add_watcher() i=1 2023-12-03T11:37:48.501 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:48.499+0000 7f02ea337800 20 add_watcher() i=2 2023-12-03T11:37:48.501 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:48.499+0000 7f02ea337800 20 add_watcher() i=3 2023-12-03T11:37:48.501 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:48.499+0000 7f02ea337800 20 add_watcher() i=4 2023-12-03T11:37:48.501 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:48.499+0000 7f02ea337800 20 add_watcher() i=5 2023-12-03T11:37:48.501 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:48.499+0000 7f02ea337800 20 add_watcher() i=6 2023-12-03T11:37:48.501 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:48.500+0000 7f02ea337800 20 add_watcher() i=7 2023-12-03T11:37:48.501 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:48.500+0000 7f02ea337800 2 all 8 watchers are set, enabling cache 2023-12-03T11:37:48.503 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:48.502+0000 7f02abfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:37:48.503 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:48.502+0000 7f02ea337800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:37:48.503 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:48.502+0000 7f02ea337800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:37:48.510 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:48.508+0000 7f02ea337800 5 note: GC not initialized 2023-12-03T11:37:48.510 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:48.508+0000 7f021affd640 20 reqs_thread_entry: start 2023-12-03T11:37:48.510 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:48.508+0000 7f02ea337800 20 init_complete bucket index max shards: 11 2023-12-03T11:37:48.510 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:48.508+0000 7f02ea337800 20 Filter name: none 2023-12-03T11:37:48.510 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:48.509+0000 7f0218ff9640 20 reqs_thread_entry: start 2023-12-03T11:37:48.510 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:48.509+0000 7f02ea337800 10 cache get: name=default.rgw.meta+users.uid+check-tester : miss 2023-12-03T11:37:48.510 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:48.509+0000 7f02ea337800 20 rados->read ofs=0 len=0 2023-12-03T11:37:48.511 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:48.509+0000 7f02ea337800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:48.511 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:48.509+0000 7f02ea337800 10 cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x0 2023-12-03T11:37:48.511 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:48.509+0000 7f02ea337800 10 adding default.rgw.meta+users.uid+check-tester to cache LRU end 2023-12-03T11:37:48.511 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:48.509+0000 7f02ea337800 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : miss 2023-12-03T11:37:48.511 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:48.509+0000 7f02ea337800 20 rados->read ofs=0 len=0 2023-12-03T11:37:48.511 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:48.509+0000 7f02ea337800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:48.511 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:48.509+0000 7f02ea337800 10 cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x0 2023-12-03T11:37:48.511 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:48.509+0000 7f02ea337800 10 adding default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2023-12-03T11:37:48.511 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:48.509+0000 7f02ea337800 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : hit (negative entry) 2023-12-03T11:37:48.512 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:48.509+0000 7f02ea337800 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : hit (negative entry) 2023-12-03T11:37:48.512 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:48.511+0000 7f02ea337800 10 cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x17 2023-12-03T11:37:48.512 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:48.511+0000 7f02ea337800 10 moving default.rgw.meta+users.uid+check-tester to cache LRU end 2023-12-03T11:37:48.512 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:48.511+0000 7f02ea337800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:check-tester, ofs0, ns] 2023-12-03T11:37:48.513 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:48.512+0000 7f02d4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 163208757249 cookie 94433600005408 notifier 4592 bl.length()=559 2023-12-03T11:37:48.513 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:48.512+0000 7f02d4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x17 2023-12-03T11:37:48.513 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:48.512+0000 7f02d4ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+check-tester to cache LRU end 2023-12-03T11:37:48.516 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:48.515+0000 7f02ea337800 10 cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x7 2023-12-03T11:37:48.516 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:48.515+0000 7f02ea337800 10 moving default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2023-12-03T11:37:48.516 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:48.515+0000 7f02ea337800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.keys:OJODXSLNX4LUNHQG99PA, ofs0, ns] 2023-12-03T11:37:48.516 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:48.515+0000 7f02d4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 163208757249 cookie 139650324869120 notifier 4592 bl.length()=186 2023-12-03T11:37:48.517 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:48.515+0000 7f02d4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x7 2023-12-03T11:37:48.517 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:48.515+0000 7f02d4ff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2023-12-03T11:37:48.518 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:48.517+0000 7f02abfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:37:48.521 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:48.520+0000 7f02ea337800 20 remove_watcher() i=0 2023-12-03T11:37:48.521 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:48.520+0000 7f02ea337800 2 removed watcher, disabling cache 2023-12-03T11:37:48.522 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:48.521+0000 7f02ea337800 20 remove_watcher() i=1 2023-12-03T11:37:48.523 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:48.522+0000 7f02ea337800 20 remove_watcher() i=2 2023-12-03T11:37:48.525 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:48.524+0000 7f02ea337800 20 remove_watcher() i=3 2023-12-03T11:37:48.526 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:48.525+0000 7f02ea337800 20 remove_watcher() i=4 2023-12-03T11:37:48.527 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:48.526+0000 7f02ea337800 20 remove_watcher() i=5 2023-12-03T11:37:48.528 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:48.527+0000 7f02ea337800 20 remove_watcher() i=6 2023-12-03T11:37:48.529 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:48.528+0000 7f02ea337800 20 remove_watcher() i=7 2023-12-03T11:37:49.369 INFO:tasks.workunit.client.0.smithi003.stderr:TEST: recalculated bucket check stats are correct 2023-12-03T11:37:49.369 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:37:49.371 INFO:tasks.workunit.client.0.smithi003.stderr:radosgw-admin bucket check --fix --bucket check-bucket 2023-12-03T11:37:49.401 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:37:49.401 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:37:49.415 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.414+0000 7f3eb2322800 20 rados->read ofs=0 len=0 2023-12-03T11:37:49.417 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.415+0000 7f3eb2322800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:49.417 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.415+0000 7f3eb2322800 20 realm 2023-12-03T11:37:49.417 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.415+0000 7f3eb2322800 20 rados->read ofs=0 len=0 2023-12-03T11:37:49.417 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.415+0000 7f3eb2322800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:49.417 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.415+0000 7f3eb2322800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:37:49.417 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.415+0000 7f3eb2322800 20 rados->read ofs=0 len=0 2023-12-03T11:37:49.417 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.416+0000 7f3eb2322800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:49.417 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.416+0000 7f3eb2322800 20 rados->read ofs=0 len=0 2023-12-03T11:37:49.418 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.417+0000 7f3eb2322800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:37:49.418 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.417+0000 7f3eb2322800 20 rados->read ofs=0 len=0 2023-12-03T11:37:49.418 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.417+0000 7f3eb2322800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:37:49.418 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.417+0000 7f3eb2322800 20 searching for the correct realm 2023-12-03T11:37:49.429 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.428+0000 7f3ead7a5640 0 -- 172.21.15.3:0/1874885491 >> [v2:172.21.15.3:6817/3356208405,v1:172.21.15.3:6819/3356208405] conn(0x5613b365d260 msgr2=0x5613b365f650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:37:49.430 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.429+0000 7f3eb2322800 20 RGWRados::pool_iterate: got zone_info.83aabb46-04b5-4c96-9933-c6bfb1173a73 2023-12-03T11:37:49.430 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.429+0000 7f3eb2322800 20 RGWRados::pool_iterate: got zonegroup_info.6a811aad-435d-4fdd-93c9-b7e0b50de429 2023-12-03T11:37:49.430 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.429+0000 7f3eb2322800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:37:49.430 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.429+0000 7f3eb2322800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:37:49.431 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.429+0000 7f3eb2322800 20 rados->read ofs=0 len=0 2023-12-03T11:37:49.431 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.429+0000 7f3eb2322800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:49.431 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.429+0000 7f3eb2322800 20 rados->read ofs=0 len=0 2023-12-03T11:37:49.432 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.430+0000 7f3eb2322800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:37:49.432 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.430+0000 7f3eb2322800 20 rados->read ofs=0 len=0 2023-12-03T11:37:49.432 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.430+0000 7f3eb2322800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:37:49.432 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.430+0000 7f3eb2322800 20 zone default found 2023-12-03T11:37:49.432 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.430+0000 7f3eb2322800 4 Realm: () 2023-12-03T11:37:49.432 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.430+0000 7f3eb2322800 4 ZoneGroup: default (6a811aad-435d-4fdd-93c9-b7e0b50de429) 2023-12-03T11:37:49.432 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.430+0000 7f3eb2322800 4 Zone: default (83aabb46-04b5-4c96-9933-c6bfb1173a73) 2023-12-03T11:37:49.432 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.430+0000 7f3eb2322800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:37:49.432 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.430+0000 7f3eb2322800 20 zonegroup default 2023-12-03T11:37:49.433 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.430+0000 7f3eb2322800 20 rados->read ofs=0 len=0 2023-12-03T11:37:49.433 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.430+0000 7f3eb2322800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:49.433 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.430+0000 7f3eb2322800 20 rados->read ofs=0 len=0 2023-12-03T11:37:49.433 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.431+0000 7f3eb2322800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:49.433 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.431+0000 7f3eb2322800 20 rados->read ofs=0 len=0 2023-12-03T11:37:49.433 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.431+0000 7f3eb2322800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:49.433 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.431+0000 7f3eb2322800 20 started sync module instance, tier type = 2023-12-03T11:37:49.433 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.431+0000 7f3eb2322800 20 started zone id=83aabb46-04b5-4c96-9933-c6bfb1173a73 (name=default) with tier type = 2023-12-03T11:37:49.445 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.444+0000 7f3eae7a7640 0 -- 172.21.15.3:0/1874885491 >> [v2:172.21.15.37:6816/3770469300,v1:172.21.15.37:6818/3770469300] conn(0x7f3ea403b440 msgr2=0x7f3ea403b8c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:37:49.451 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.449+0000 7f3eb2322800 20 add_watcher() i=0 2023-12-03T11:37:49.451 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.449+0000 7f3eb2322800 20 add_watcher() i=1 2023-12-03T11:37:49.451 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.449+0000 7f3eb2322800 20 add_watcher() i=2 2023-12-03T11:37:49.451 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.449+0000 7f3eb2322800 20 add_watcher() i=3 2023-12-03T11:37:49.451 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.449+0000 7f3eb2322800 20 add_watcher() i=4 2023-12-03T11:37:49.451 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.449+0000 7f3eb2322800 20 add_watcher() i=5 2023-12-03T11:37:49.451 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.450+0000 7f3eb2322800 20 add_watcher() i=6 2023-12-03T11:37:49.453 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.452+0000 7f3eb2322800 20 add_watcher() i=7 2023-12-03T11:37:49.453 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.452+0000 7f3eb2322800 2 all 8 watchers are set, enabling cache 2023-12-03T11:37:49.456 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.455+0000 7f3e737e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:37:49.456 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.455+0000 7f3eb2322800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:37:49.456 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.455+0000 7f3eb2322800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:37:49.463 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.461+0000 7f3eb2322800 5 note: GC not initialized 2023-12-03T11:37:49.463 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.461+0000 7f3de27fc640 20 reqs_thread_entry: start 2023-12-03T11:37:49.463 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.461+0000 7f3eb2322800 20 init_complete bucket index max shards: 11 2023-12-03T11:37:49.463 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.461+0000 7f3eb2322800 20 Filter name: none 2023-12-03T11:37:49.463 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.461+0000 7f3dd3fff640 20 reqs_thread_entry: start 2023-12-03T11:37:49.463 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.461+0000 7f3eb2322800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2023-12-03T11:37:49.463 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.461+0000 7f3eb2322800 20 rados->read ofs=0 len=0 2023-12-03T11:37:49.464 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.462+0000 7f3eb2322800 20 rados_obj.operate() r=0 bl.length=190 2023-12-03T11:37:49.464 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.462+0000 7f3eb2322800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2023-12-03T11:37:49.464 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.462+0000 7f3eb2322800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2023-12-03T11:37:49.464 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.462+0000 7f3eb2322800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2 : miss 2023-12-03T11:37:49.464 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.462+0000 7f3eb2322800 20 rados->read ofs=0 len=0 2023-12-03T11:37:49.464 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.462+0000 7f3eb2322800 20 rados_obj.operate() r=0 bl.length=368 2023-12-03T11:37:49.465 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.462+0000 7f3eb2322800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2 info.flags=0x17 2023-12-03T11:37:49.465 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.462+0000 7f3eb2322800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2 to cache LRU end 2023-12-03T11:37:49.465 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.462+0000 7f3eb2322800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:37:49.465 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.462+0000 7f3eb2322800 10 updating xattr: name=user.rgw.acl bl.length()=179 2023-12-03T11:37:49.465 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.463+0000 7f3eb2322800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2 2023-12-03T11:37:49.465 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.463+0000 7f3eb2322800 20 list_objects_ordered: starting attempt 1 2023-12-03T11:37:49.465 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.463+0000 7f3eb2322800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2023-12-03T11:37:49.465 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.463+0000 7f3eb2322800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2023-12-03T11:37:49.466 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.463+0000 7f3eb2322800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2023-12-03T11:37:49.466 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.463+0000 7f3eb2322800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2023-12-03T11:37:49.466 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.463+0000 7f3eb2322800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2023-12-03T11:37:49.473 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.472+0000 7f3e737e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:37:49.475 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.474+0000 7f3eb2322800 20 remove_watcher() i=0 2023-12-03T11:37:49.476 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.474+0000 7f3eb2322800 2 removed watcher, disabling cache 2023-12-03T11:37:49.477 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.476+0000 7f3eb2322800 20 remove_watcher() i=1 2023-12-03T11:37:49.478 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.477+0000 7f3eb2322800 20 remove_watcher() i=2 2023-12-03T11:37:49.479 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.478+0000 7f3eb2322800 20 remove_watcher() i=3 2023-12-03T11:37:49.480 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.479+0000 7f3eb2322800 20 remove_watcher() i=4 2023-12-03T11:37:49.481 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.480+0000 7f3eb2322800 20 remove_watcher() i=5 2023-12-03T11:37:49.482 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.481+0000 7f3eb2322800 20 remove_watcher() i=6 2023-12-03T11:37:49.483 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.482+0000 7f3eb2322800 20 remove_watcher() i=7 2023-12-03T11:37:49.490 INFO:tasks.workunit.client.0.smithi003.stderr:radosgw-admin bucket stats --bucket check-bucket 2023-12-03T11:37:49.517 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:37:49.517 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:37:49.532 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.531+0000 7fbabbf30800 20 rados->read ofs=0 len=0 2023-12-03T11:37:49.534 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.532+0000 7fbabbf30800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:49.534 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.532+0000 7fbabbf30800 20 realm 2023-12-03T11:37:49.534 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.532+0000 7fbabbf30800 20 rados->read ofs=0 len=0 2023-12-03T11:37:49.534 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.532+0000 7fbabbf30800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:49.534 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.532+0000 7fbabbf30800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:37:49.534 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.532+0000 7fbabbf30800 20 rados->read ofs=0 len=0 2023-12-03T11:37:49.534 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.533+0000 7fbabbf30800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:49.534 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.533+0000 7fbabbf30800 20 rados->read ofs=0 len=0 2023-12-03T11:37:49.535 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.533+0000 7fbabbf30800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:37:49.535 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.533+0000 7fbabbf30800 20 rados->read ofs=0 len=0 2023-12-03T11:37:49.535 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.534+0000 7fbabbf30800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:37:49.535 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.534+0000 7fbabbf30800 20 searching for the correct realm 2023-12-03T11:37:49.545 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.544+0000 7fbab74c5640 0 -- 172.21.15.3:0/3297179063 >> [v2:172.21.15.3:6817/3356208405,v1:172.21.15.3:6819/3356208405] conn(0x55b31951cd10 msgr2=0x55b31951f100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:37:49.547 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.546+0000 7fbabbf30800 20 RGWRados::pool_iterate: got zone_info.83aabb46-04b5-4c96-9933-c6bfb1173a73 2023-12-03T11:37:49.547 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.546+0000 7fbabbf30800 20 RGWRados::pool_iterate: got zonegroup_info.6a811aad-435d-4fdd-93c9-b7e0b50de429 2023-12-03T11:37:49.547 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.546+0000 7fbabbf30800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:37:49.547 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.546+0000 7fbabbf30800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:37:49.547 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.546+0000 7fbabbf30800 20 rados->read ofs=0 len=0 2023-12-03T11:37:49.547 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.546+0000 7fbabbf30800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:49.548 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.546+0000 7fbabbf30800 20 rados->read ofs=0 len=0 2023-12-03T11:37:49.549 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.546+0000 7fbabbf30800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:37:49.549 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.546+0000 7fbabbf30800 20 rados->read ofs=0 len=0 2023-12-03T11:37:49.549 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.547+0000 7fbabbf30800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:37:49.549 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.547+0000 7fbabbf30800 20 zone default found 2023-12-03T11:37:49.549 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.547+0000 7fbabbf30800 4 Realm: () 2023-12-03T11:37:49.549 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.547+0000 7fbabbf30800 4 ZoneGroup: default (6a811aad-435d-4fdd-93c9-b7e0b50de429) 2023-12-03T11:37:49.549 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.547+0000 7fbabbf30800 4 Zone: default (83aabb46-04b5-4c96-9933-c6bfb1173a73) 2023-12-03T11:37:49.550 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.547+0000 7fbabbf30800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:37:49.550 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.547+0000 7fbabbf30800 20 zonegroup default 2023-12-03T11:37:49.550 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.547+0000 7fbabbf30800 20 rados->read ofs=0 len=0 2023-12-03T11:37:49.550 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.547+0000 7fbabbf30800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:49.550 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.547+0000 7fbabbf30800 20 rados->read ofs=0 len=0 2023-12-03T11:37:49.550 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.547+0000 7fbabbf30800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:49.550 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.547+0000 7fbabbf30800 20 rados->read ofs=0 len=0 2023-12-03T11:37:49.550 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.547+0000 7fbabbf30800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:49.550 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.548+0000 7fbabbf30800 20 started sync module instance, tier type = 2023-12-03T11:37:49.550 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.548+0000 7fbabbf30800 20 started zone id=83aabb46-04b5-4c96-9933-c6bfb1173a73 (name=default) with tier type = 2023-12-03T11:37:49.553 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.552+0000 7fbab7cc6640 0 -- 172.21.15.3:0/3297179063 >> [v2:172.21.15.3:6800/2373485412,v1:172.21.15.3:6801/2373485412] conn(0x7fbab007e7a0 msgr2=0x7fbab0056e30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:37:49.559 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.558+0000 7fbabbf30800 20 add_watcher() i=0 2023-12-03T11:37:49.559 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.558+0000 7fbabbf30800 20 add_watcher() i=1 2023-12-03T11:37:49.559 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.558+0000 7fbabbf30800 20 add_watcher() i=2 2023-12-03T11:37:49.560 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.558+0000 7fbabbf30800 20 add_watcher() i=3 2023-12-03T11:37:49.560 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.558+0000 7fbabbf30800 20 add_watcher() i=4 2023-12-03T11:37:49.560 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.558+0000 7fbabbf30800 20 add_watcher() i=5 2023-12-03T11:37:49.560 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.558+0000 7fbabbf30800 20 add_watcher() i=6 2023-12-03T11:37:49.560 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.559+0000 7fbabbf30800 20 add_watcher() i=7 2023-12-03T11:37:49.560 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.559+0000 7fbabbf30800 2 all 8 watchers are set, enabling cache 2023-12-03T11:37:49.562 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.561+0000 7fba7dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:37:49.562 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.561+0000 7fbabbf30800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:37:49.562 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.561+0000 7fbabbf30800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:37:49.568 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.567+0000 7fbabbf30800 5 note: GC not initialized 2023-12-03T11:37:49.568 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.567+0000 7fb9f4ff9640 20 reqs_thread_entry: start 2023-12-03T11:37:49.569 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.567+0000 7fbabbf30800 20 init_complete bucket index max shards: 11 2023-12-03T11:37:49.569 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.567+0000 7fbabbf30800 20 Filter name: none 2023-12-03T11:37:49.569 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.567+0000 7fb9ea7fc640 20 reqs_thread_entry: start 2023-12-03T11:37:49.569 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.567+0000 7fbabbf30800 20 rados->read ofs=0 len=0 2023-12-03T11:37:49.570 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.568+0000 7fbabbf30800 20 rados_obj.operate() r=0 bl.length=190 2023-12-03T11:37:49.570 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.568+0000 7fbabbf30800 20 rados->read ofs=0 len=0 2023-12-03T11:37:49.570 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.568+0000 7fbabbf30800 20 rados_obj.operate() r=0 bl.length=368 2023-12-03T11:37:49.570 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.568+0000 7fbabbf30800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:37:49.570 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.568+0000 7fbabbf30800 20 rados->read ofs=0 len=0 2023-12-03T11:37:49.570 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.568+0000 7fbabbf30800 20 rados_obj.operate() r=0 bl.length=190 2023-12-03T11:37:49.570 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.568+0000 7fbabbf30800 20 rados->read ofs=0 len=0 2023-12-03T11:37:49.570 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.569+0000 7fbabbf30800 20 rados_obj.operate() r=0 bl.length=368 2023-12-03T11:37:49.570 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.569+0000 7fbabbf30800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:37:49.571 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.570+0000 7fbabbf30800 20 rados->read ofs=0 len=0 2023-12-03T11:37:49.571 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.570+0000 7fbabbf30800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:49.572 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.571+0000 7fba7dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:37:49.574 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.573+0000 7fbabbf30800 20 remove_watcher() i=0 2023-12-03T11:37:49.574 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.573+0000 7fbabbf30800 2 removed watcher, disabling cache 2023-12-03T11:37:49.575 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.574+0000 7fbabbf30800 20 remove_watcher() i=1 2023-12-03T11:37:49.576 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.576+0000 7fbabbf30800 20 remove_watcher() i=2 2023-12-03T11:37:49.578 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.577+0000 7fbabbf30800 20 remove_watcher() i=3 2023-12-03T11:37:49.580 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.579+0000 7fbabbf30800 20 remove_watcher() i=4 2023-12-03T11:37:49.581 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.580+0000 7fbabbf30800 20 remove_watcher() i=5 2023-12-03T11:37:49.582 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.581+0000 7fbabbf30800 20 remove_watcher() i=6 2023-12-03T11:37:49.583 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.582+0000 7fbabbf30800 20 remove_watcher() i=7 2023-12-03T11:37:49.588 INFO:tasks.workunit.client.0.smithi003.stderr:{'rgw.main': {'size': 54, 'size_actual': 24576, 'size_utilized': 86, 'size_kb': 1, 'size_kb_actual': 24, 'size_kb_utilized': 1, 'num_objects': 6}} 2023-12-03T11:37:49.588 INFO:tasks.workunit.client.0.smithi003.stderr:TEST: bucket check unlinked does not report normal entries 2023-12-03T11:37:49.588 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:37:49.589 INFO:tasks.workunit.client.0.smithi003.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2023-12-03T11:37:49.621 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:37:49.621 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:37:49.635 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.634+0000 7f3497322800 20 rados->read ofs=0 len=0 2023-12-03T11:37:49.637 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.636+0000 7f3497322800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:49.637 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.636+0000 7f3497322800 20 realm 2023-12-03T11:37:49.637 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.636+0000 7f3497322800 20 rados->read ofs=0 len=0 2023-12-03T11:37:49.637 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.636+0000 7f3497322800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:49.637 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.636+0000 7f3497322800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:37:49.637 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.636+0000 7f3497322800 20 rados->read ofs=0 len=0 2023-12-03T11:37:49.637 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.636+0000 7f3497322800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:49.637 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.636+0000 7f3497322800 20 rados->read ofs=0 len=0 2023-12-03T11:37:49.638 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.637+0000 7f3497322800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:37:49.638 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.637+0000 7f3497322800 20 rados->read ofs=0 len=0 2023-12-03T11:37:49.638 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.637+0000 7f3497322800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:37:49.638 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.637+0000 7f3497322800 20 searching for the correct realm 2023-12-03T11:37:49.649 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.648+0000 7f3492f70640 0 -- 172.21.15.3:0/1339088750 >> [v2:172.21.15.37:6805/1692844418,v1:172.21.15.37:6807/1692844418] conn(0x555ced128630 msgr2=0x555ced12aa20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:37:49.651 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.649+0000 7f3497322800 20 RGWRados::pool_iterate: got zone_info.83aabb46-04b5-4c96-9933-c6bfb1173a73 2023-12-03T11:37:49.651 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.649+0000 7f3497322800 20 RGWRados::pool_iterate: got zonegroup_info.6a811aad-435d-4fdd-93c9-b7e0b50de429 2023-12-03T11:37:49.651 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.649+0000 7f3497322800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:37:49.651 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.649+0000 7f3497322800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:37:49.651 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.649+0000 7f3497322800 20 rados->read ofs=0 len=0 2023-12-03T11:37:49.651 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.649+0000 7f3497322800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:49.651 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.649+0000 7f3497322800 20 rados->read ofs=0 len=0 2023-12-03T11:37:49.651 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.650+0000 7f3497322800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:37:49.651 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.650+0000 7f3497322800 20 rados->read ofs=0 len=0 2023-12-03T11:37:49.652 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.650+0000 7f3497322800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:37:49.652 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.650+0000 7f3497322800 20 zone default found 2023-12-03T11:37:49.652 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.650+0000 7f3497322800 4 Realm: () 2023-12-03T11:37:49.652 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.650+0000 7f3497322800 4 ZoneGroup: default (6a811aad-435d-4fdd-93c9-b7e0b50de429) 2023-12-03T11:37:49.653 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.650+0000 7f3497322800 4 Zone: default (83aabb46-04b5-4c96-9933-c6bfb1173a73) 2023-12-03T11:37:49.653 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.650+0000 7f3497322800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:37:49.653 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.650+0000 7f3497322800 20 zonegroup default 2023-12-03T11:37:49.653 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.650+0000 7f3497322800 20 rados->read ofs=0 len=0 2023-12-03T11:37:49.653 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.650+0000 7f3497322800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:49.653 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.650+0000 7f3497322800 20 rados->read ofs=0 len=0 2023-12-03T11:37:49.653 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.651+0000 7f3497322800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:49.653 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.651+0000 7f3497322800 20 rados->read ofs=0 len=0 2023-12-03T11:37:49.653 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.651+0000 7f3497322800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:49.653 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.651+0000 7f3497322800 20 started sync module instance, tier type = 2023-12-03T11:37:49.653 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.651+0000 7f3497322800 20 started zone id=83aabb46-04b5-4c96-9933-c6bfb1173a73 (name=default) with tier type = 2023-12-03T11:37:49.663 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.662+0000 7f349276f640 0 -- 172.21.15.3:0/1339088750 >> [v2:172.21.15.3:6817/3356208405,v1:172.21.15.3:6819/3356208405] conn(0x555ced12d5d0 msgr2=0x555ced12f9c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:37:49.666 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.665+0000 7f3497322800 20 add_watcher() i=0 2023-12-03T11:37:49.666 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.665+0000 7f3497322800 20 add_watcher() i=1 2023-12-03T11:37:49.666 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.665+0000 7f3497322800 20 add_watcher() i=2 2023-12-03T11:37:49.666 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.665+0000 7f3497322800 20 add_watcher() i=3 2023-12-03T11:37:49.666 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.665+0000 7f3497322800 20 add_watcher() i=4 2023-12-03T11:37:49.666 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.665+0000 7f3497322800 20 add_watcher() i=5 2023-12-03T11:37:49.666 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.665+0000 7f3497322800 20 add_watcher() i=6 2023-12-03T11:37:49.667 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.666+0000 7f3497322800 20 add_watcher() i=7 2023-12-03T11:37:49.667 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.666+0000 7f3497322800 2 all 8 watchers are set, enabling cache 2023-12-03T11:37:49.668 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.667+0000 7f33d3fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:37:49.669 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.668+0000 7f3497322800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:37:49.669 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.668+0000 7f3497322800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:37:49.675 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.674+0000 7f3497322800 5 note: GC not initialized 2023-12-03T11:37:49.675 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.674+0000 7f33c2ffd640 20 reqs_thread_entry: start 2023-12-03T11:37:49.675 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.674+0000 7f3497322800 20 init_complete bucket index max shards: 11 2023-12-03T11:37:49.675 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.674+0000 7f3497322800 20 Filter name: none 2023-12-03T11:37:49.676 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.674+0000 7f33c0ff9640 20 reqs_thread_entry: start 2023-12-03T11:37:49.676 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.674+0000 7f3497322800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2023-12-03T11:37:49.676 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.674+0000 7f3497322800 20 rados->read ofs=0 len=0 2023-12-03T11:37:49.677 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.675+0000 7f3497322800 20 rados_obj.operate() r=0 bl.length=190 2023-12-03T11:37:49.677 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.675+0000 7f3497322800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2023-12-03T11:37:49.677 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.675+0000 7f3497322800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2023-12-03T11:37:49.677 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.675+0000 7f3497322800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2 : miss 2023-12-03T11:37:49.677 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.675+0000 7f3497322800 20 rados->read ofs=0 len=0 2023-12-03T11:37:49.677 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.675+0000 7f3497322800 20 rados_obj.operate() r=0 bl.length=368 2023-12-03T11:37:49.677 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.675+0000 7f3497322800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2 info.flags=0x17 2023-12-03T11:37:49.677 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.675+0000 7f3497322800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2 to cache LRU end 2023-12-03T11:37:49.677 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.675+0000 7f3497322800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:37:49.677 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.675+0000 7f3497322800 10 updating xattr: name=user.rgw.acl bl.length()=179 2023-12-03T11:37:49.677 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.675+0000 7f3497322800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2 2023-12-03T11:37:49.677 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.675+0000 7f3497322800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.0 2023-12-03T11:37:49.677 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.675+0000 7f3497322800 1 NOTICE: finished shard 0 (0 entries found) 2023-12-03T11:37:49.678 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.675+0000 7f3497322800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.1 2023-12-03T11:37:49.678 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.676+0000 7f3497322800 1 NOTICE: finished shard 1 (0 entries found) 2023-12-03T11:37:49.678 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.676+0000 7f3497322800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.2 2023-12-03T11:37:49.678 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.677+0000 7f3497322800 1 NOTICE: finished shard 2 (0 entries found) 2023-12-03T11:37:49.678 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.677+0000 7f3497322800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.3 2023-12-03T11:37:49.678 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.677+0000 7f3497322800 1 NOTICE: finished shard 3 (0 entries found) 2023-12-03T11:37:49.679 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.677+0000 7f3497322800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.4 2023-12-03T11:37:49.679 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.678+0000 7f3497322800 1 NOTICE: finished shard 4 (0 entries found) 2023-12-03T11:37:49.679 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.678+0000 7f3497322800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.5 2023-12-03T11:37:49.679 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.678+0000 7f3497322800 1 NOTICE: finished shard 5 (0 entries found) 2023-12-03T11:37:49.679 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.678+0000 7f3497322800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.6 2023-12-03T11:37:49.680 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.679+0000 7f3497322800 1 NOTICE: finished shard 6 (0 entries found) 2023-12-03T11:37:49.680 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.679+0000 7f3497322800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.7 2023-12-03T11:37:49.680 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.679+0000 7f3497322800 1 NOTICE: finished shard 7 (0 entries found) 2023-12-03T11:37:49.680 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.679+0000 7f3497322800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.8 2023-12-03T11:37:49.680 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.680+0000 7f3497322800 1 NOTICE: finished shard 8 (0 entries found) 2023-12-03T11:37:49.681 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.680+0000 7f3497322800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.9 2023-12-03T11:37:49.681 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.680+0000 7f3497322800 1 NOTICE: finished shard 9 (0 entries found) 2023-12-03T11:37:49.681 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.680+0000 7f3497322800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.10 2023-12-03T11:37:49.682 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.681+0000 7f3497322800 1 NOTICE: finished shard 10 (0 entries found) 2023-12-03T11:37:49.682 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.681+0000 7f3497322800 1 NOTICE: finished all shards (0 entries found) 2023-12-03T11:37:49.682 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.681+0000 7f33d3fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:37:49.685 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.684+0000 7f3497322800 20 remove_watcher() i=0 2023-12-03T11:37:49.685 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.684+0000 7f3497322800 2 removed watcher, disabling cache 2023-12-03T11:37:49.686 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.685+0000 7f3497322800 20 remove_watcher() i=1 2023-12-03T11:37:49.687 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.686+0000 7f3497322800 20 remove_watcher() i=2 2023-12-03T11:37:49.688 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.687+0000 7f3497322800 20 remove_watcher() i=3 2023-12-03T11:37:49.689 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.688+0000 7f3497322800 20 remove_watcher() i=4 2023-12-03T11:37:49.690 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.689+0000 7f3497322800 20 remove_watcher() i=5 2023-12-03T11:37:49.691 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.690+0000 7f3497322800 20 remove_watcher() i=6 2023-12-03T11:37:49.692 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:49.691+0000 7f3497322800 20 remove_watcher() i=7 2023-12-03T11:37:49.699 INFO:tasks.workunit.client.0.smithi003.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2023-12-03T11:37:50.094 INFO:tasks.workunit.client.0.smithi003.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2023-12-03T11:37:51.577 INFO:tasks.workunit.client.0.smithi003.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2023-12-03T11:37:51.579 INFO:tasks.workunit.client.0.smithi003.stderr:radosgw-admin bi list --bucket check-bucket --object c 2023-12-03T11:37:51.612 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:37:51.612 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:37:51.627 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.626+0000 7f19ded11800 20 rados->read ofs=0 len=0 2023-12-03T11:37:51.630 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.628+0000 7f19ded11800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:51.630 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.628+0000 7f19ded11800 20 realm 2023-12-03T11:37:51.630 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.628+0000 7f19ded11800 20 rados->read ofs=0 len=0 2023-12-03T11:37:51.630 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.628+0000 7f19ded11800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:51.630 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.628+0000 7f19ded11800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:37:51.630 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.628+0000 7f19ded11800 20 rados->read ofs=0 len=0 2023-12-03T11:37:51.630 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.629+0000 7f19ded11800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:51.630 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.629+0000 7f19ded11800 20 rados->read ofs=0 len=0 2023-12-03T11:37:51.631 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.630+0000 7f19ded11800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:37:51.631 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.630+0000 7f19ded11800 20 rados->read ofs=0 len=0 2023-12-03T11:37:51.631 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.630+0000 7f19ded11800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:37:51.631 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.630+0000 7f19ded11800 20 searching for the correct realm 2023-12-03T11:37:51.643 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.642+0000 7f19dc818640 0 -- 172.21.15.3:0/253166671 >> [v2:172.21.15.37:6805/1692844418,v1:172.21.15.37:6807/1692844418] conn(0x556376f933e0 msgr2=0x556376f957f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:37:51.644 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.643+0000 7f19ded11800 20 RGWRados::pool_iterate: got zone_info.83aabb46-04b5-4c96-9933-c6bfb1173a73 2023-12-03T11:37:51.644 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.643+0000 7f19ded11800 20 RGWRados::pool_iterate: got zonegroup_info.6a811aad-435d-4fdd-93c9-b7e0b50de429 2023-12-03T11:37:51.644 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.643+0000 7f19ded11800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:37:51.645 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.643+0000 7f19ded11800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:37:51.645 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.643+0000 7f19ded11800 20 rados->read ofs=0 len=0 2023-12-03T11:37:51.645 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.643+0000 7f19ded11800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:51.645 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.643+0000 7f19ded11800 20 rados->read ofs=0 len=0 2023-12-03T11:37:51.646 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.644+0000 7f19ded11800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:37:51.646 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.644+0000 7f19ded11800 20 rados->read ofs=0 len=0 2023-12-03T11:37:51.646 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.644+0000 7f19ded11800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:37:51.646 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.644+0000 7f19ded11800 20 zone default found 2023-12-03T11:37:51.646 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.644+0000 7f19ded11800 4 Realm: () 2023-12-03T11:37:51.646 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.644+0000 7f19ded11800 4 ZoneGroup: default (6a811aad-435d-4fdd-93c9-b7e0b50de429) 2023-12-03T11:37:51.646 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.644+0000 7f19ded11800 4 Zone: default (83aabb46-04b5-4c96-9933-c6bfb1173a73) 2023-12-03T11:37:51.646 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.644+0000 7f19ded11800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:37:51.647 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.644+0000 7f19ded11800 20 zonegroup default 2023-12-03T11:37:51.647 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.644+0000 7f19ded11800 20 rados->read ofs=0 len=0 2023-12-03T11:37:51.647 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.644+0000 7f19ded11800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:51.647 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.644+0000 7f19ded11800 20 rados->read ofs=0 len=0 2023-12-03T11:37:51.647 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.645+0000 7f19ded11800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:51.647 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.645+0000 7f19ded11800 20 rados->read ofs=0 len=0 2023-12-03T11:37:51.647 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.645+0000 7f19ded11800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:51.647 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.645+0000 7f19ded11800 20 started sync module instance, tier type = 2023-12-03T11:37:51.647 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.645+0000 7f19ded11800 20 started zone id=83aabb46-04b5-4c96-9933-c6bfb1173a73 (name=default) with tier type = 2023-12-03T11:37:51.654 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.653+0000 7f19dd019640 0 -- 172.21.15.3:0/253166671 >> [v2:172.21.15.37:6816/3770469300,v1:172.21.15.37:6818/3770469300] conn(0x7f19d0054c70 msgr2=0x7f19d0063420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:37:51.659 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.658+0000 7f19ded11800 20 add_watcher() i=0 2023-12-03T11:37:51.659 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.658+0000 7f19ded11800 20 add_watcher() i=1 2023-12-03T11:37:51.659 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.658+0000 7f19ded11800 20 add_watcher() i=2 2023-12-03T11:37:51.659 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.658+0000 7f19ded11800 20 add_watcher() i=3 2023-12-03T11:37:51.660 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.658+0000 7f19ded11800 20 add_watcher() i=4 2023-12-03T11:37:51.660 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.658+0000 7f19ded11800 20 add_watcher() i=5 2023-12-03T11:37:51.662 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.661+0000 7f19ded11800 20 add_watcher() i=6 2023-12-03T11:37:51.662 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.661+0000 7f19ded11800 20 add_watcher() i=7 2023-12-03T11:37:51.662 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.661+0000 7f19ded11800 2 all 8 watchers are set, enabling cache 2023-12-03T11:37:51.664 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.663+0000 7f19a2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:37:51.664 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.663+0000 7f19ded11800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:37:51.664 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.663+0000 7f19ded11800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:37:51.671 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.669+0000 7f19ded11800 5 note: GC not initialized 2023-12-03T11:37:51.671 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.670+0000 7f1911ffb640 20 reqs_thread_entry: start 2023-12-03T11:37:51.671 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.670+0000 7f19ded11800 20 init_complete bucket index max shards: 11 2023-12-03T11:37:51.671 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.670+0000 7f19ded11800 20 Filter name: none 2023-12-03T11:37:51.671 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.670+0000 7f19037fe640 20 reqs_thread_entry: start 2023-12-03T11:37:51.671 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.670+0000 7f19ded11800 20 rados->read ofs=0 len=0 2023-12-03T11:37:51.672 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.670+0000 7f19ded11800 20 rados_obj.operate() r=0 bl.length=190 2023-12-03T11:37:51.672 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.670+0000 7f19ded11800 20 rados->read ofs=0 len=0 2023-12-03T11:37:51.672 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.671+0000 7f19ded11800 20 rados_obj.operate() r=0 bl.length=368 2023-12-03T11:37:51.672 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.671+0000 7f19ded11800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:37:51.672 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.671+0000 7f19ded11800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2023-12-03T11:37:51.673 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.671+0000 7f19ded11800 20 INFO: main: starting shard=0 2023-12-03T11:37:51.673 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.671+0000 7f19ded11800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.0 2023-12-03T11:37:51.673 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.671+0000 7f19ded11800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:37:51.673 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.671+0000 7f19ded11800 20 INFO: main: starting shard=1 2023-12-03T11:37:51.673 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.671+0000 7f19ded11800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.1 2023-12-03T11:37:51.673 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.672+0000 7f19ded11800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:37:51.673 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.672+0000 7f19ded11800 20 INFO: main: starting shard=2 2023-12-03T11:37:51.673 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.672+0000 7f19ded11800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.2 2023-12-03T11:37:51.673 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.672+0000 7f19ded11800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:37:51.674 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.672+0000 7f19ded11800 20 INFO: main: starting shard=3 2023-12-03T11:37:51.674 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.672+0000 7f19ded11800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.3 2023-12-03T11:37:51.674 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.673+0000 7f19ded11800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:37:51.674 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.673+0000 7f19ded11800 20 INFO: main: starting shard=4 2023-12-03T11:37:51.674 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.673+0000 7f19ded11800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.4 2023-12-03T11:37:51.674 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.673+0000 7f19ded11800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:37:51.675 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.673+0000 7f19ded11800 20 INFO: main: starting shard=5 2023-12-03T11:37:51.675 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.673+0000 7f19ded11800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.5 2023-12-03T11:37:51.675 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.674+0000 7f19ded11800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:37:51.675 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.674+0000 7f19ded11800 20 INFO: main: starting shard=6 2023-12-03T11:37:51.675 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.674+0000 7f19ded11800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.6 2023-12-03T11:37:51.676 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.674+0000 7f19ded11800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:37:51.676 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.674+0000 7f19ded11800 20 INFO: main: starting shard=7 2023-12-03T11:37:51.676 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.674+0000 7f19ded11800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.7 2023-12-03T11:37:51.676 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.675+0000 7f19ded11800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:37:51.676 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.675+0000 7f19ded11800 20 INFO: main: starting shard=8 2023-12-03T11:37:51.676 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.675+0000 7f19ded11800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.8 2023-12-03T11:37:51.677 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.676+0000 7f19ded11800 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2023-12-03T11:37:51.677 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.676+0000 7f19ded11800 20 INFO: main: starting shard=9 2023-12-03T11:37:51.677 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.676+0000 7f19ded11800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.9 2023-12-03T11:37:51.677 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.676+0000 7f19ded11800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:37:51.677 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.676+0000 7f19ded11800 20 INFO: main: starting shard=10 2023-12-03T11:37:51.678 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.676+0000 7f19ded11800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.10 2023-12-03T11:37:51.678 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.677+0000 7f19ded11800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:37:51.678 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.677+0000 7f19ded11800 20 INFO: main: done 2023-12-03T11:37:51.681 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.678+0000 7f19a2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:37:51.681 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.681+0000 7f19ded11800 20 remove_watcher() i=0 2023-12-03T11:37:51.682 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.681+0000 7f19ded11800 2 removed watcher, disabling cache 2023-12-03T11:37:51.683 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.682+0000 7f19ded11800 20 remove_watcher() i=1 2023-12-03T11:37:51.684 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.683+0000 7f19ded11800 20 remove_watcher() i=2 2023-12-03T11:37:51.685 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.684+0000 7f19ded11800 20 remove_watcher() i=3 2023-12-03T11:37:51.687 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.686+0000 7f19ded11800 20 remove_watcher() i=4 2023-12-03T11:37:51.688 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.687+0000 7f19ded11800 20 remove_watcher() i=5 2023-12-03T11:37:51.689 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.688+0000 7f19ded11800 20 remove_watcher() i=6 2023-12-03T11:37:51.690 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.689+0000 7f19ded11800 20 remove_watcher() i=7 2023-12-03T11:37:51.825 INFO:tasks.workunit.client.0.smithi003.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2023-12-03T11:37:51.827 INFO:tasks.workunit.client.0.smithi003.stderr:radosgw-admin bi list --bucket check-bucket --object d 2023-12-03T11:37:51.858 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:37:51.858 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:37:51.872 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.871+0000 7f0b589dc800 20 rados->read ofs=0 len=0 2023-12-03T11:37:51.874 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.873+0000 7f0b589dc800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:51.874 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.873+0000 7f0b589dc800 20 realm 2023-12-03T11:37:51.875 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.873+0000 7f0b589dc800 20 rados->read ofs=0 len=0 2023-12-03T11:37:51.875 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.873+0000 7f0b589dc800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:51.875 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.873+0000 7f0b589dc800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:37:51.875 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.873+0000 7f0b589dc800 20 rados->read ofs=0 len=0 2023-12-03T11:37:51.875 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.873+0000 7f0b589dc800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:51.875 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.873+0000 7f0b589dc800 20 rados->read ofs=0 len=0 2023-12-03T11:37:51.875 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.874+0000 7f0b589dc800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:37:51.875 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.874+0000 7f0b589dc800 20 rados->read ofs=0 len=0 2023-12-03T11:37:51.876 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.875+0000 7f0b589dc800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:37:51.876 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.875+0000 7f0b589dc800 20 searching for the correct realm 2023-12-03T11:37:51.885 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.884+0000 7f0b564dc640 0 -- 172.21.15.3:0/1146293055 >> [v2:172.21.15.37:6805/1692844418,v1:172.21.15.37:6807/1692844418] conn(0x55f324cf4cd0 msgr2=0x55f324cf70e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:37:51.891 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.886+0000 7f0b589dc800 20 RGWRados::pool_iterate: got zone_info.83aabb46-04b5-4c96-9933-c6bfb1173a73 2023-12-03T11:37:51.891 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.886+0000 7f0b589dc800 20 RGWRados::pool_iterate: got zonegroup_info.6a811aad-435d-4fdd-93c9-b7e0b50de429 2023-12-03T11:37:51.891 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.886+0000 7f0b589dc800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:37:51.891 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.886+0000 7f0b589dc800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:37:51.891 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.886+0000 7f0b589dc800 20 rados->read ofs=0 len=0 2023-12-03T11:37:51.891 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.886+0000 7f0b589dc800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:51.891 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.886+0000 7f0b589dc800 20 rados->read ofs=0 len=0 2023-12-03T11:37:51.891 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.887+0000 7f0b589dc800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:37:51.891 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.887+0000 7f0b589dc800 20 rados->read ofs=0 len=0 2023-12-03T11:37:51.891 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.887+0000 7f0b589dc800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:37:51.891 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.887+0000 7f0b589dc800 20 zone default found 2023-12-03T11:37:51.891 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.887+0000 7f0b589dc800 4 Realm: () 2023-12-03T11:37:51.891 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.887+0000 7f0b589dc800 4 ZoneGroup: default (6a811aad-435d-4fdd-93c9-b7e0b50de429) 2023-12-03T11:37:51.892 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.887+0000 7f0b589dc800 4 Zone: default (83aabb46-04b5-4c96-9933-c6bfb1173a73) 2023-12-03T11:37:51.892 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.887+0000 7f0b589dc800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:37:51.892 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.887+0000 7f0b589dc800 20 zonegroup default 2023-12-03T11:37:51.892 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.887+0000 7f0b589dc800 20 rados->read ofs=0 len=0 2023-12-03T11:37:51.892 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.887+0000 7f0b589dc800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:51.892 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.887+0000 7f0b589dc800 20 rados->read ofs=0 len=0 2023-12-03T11:37:51.892 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.887+0000 7f0b589dc800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:51.892 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.887+0000 7f0b589dc800 20 rados->read ofs=0 len=0 2023-12-03T11:37:51.892 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.888+0000 7f0b589dc800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:51.892 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.888+0000 7f0b589dc800 20 started sync module instance, tier type = 2023-12-03T11:37:51.892 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.888+0000 7f0b589dc800 20 started zone id=83aabb46-04b5-4c96-9933-c6bfb1173a73 (name=default) with tier type = 2023-12-03T11:37:51.897 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.896+0000 7f0b56cdd640 0 -- 172.21.15.3:0/1146293055 >> [v2:172.21.15.37:6816/3770469300,v1:172.21.15.37:6818/3770469300] conn(0x7f0b4c07b040 msgr2=0x7f0b4c07c940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:37:51.904 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.903+0000 7f0b589dc800 20 add_watcher() i=0 2023-12-03T11:37:51.904 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.903+0000 7f0b589dc800 20 add_watcher() i=1 2023-12-03T11:37:51.904 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.903+0000 7f0b589dc800 20 add_watcher() i=2 2023-12-03T11:37:51.904 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.903+0000 7f0b589dc800 20 add_watcher() i=3 2023-12-03T11:37:51.904 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.903+0000 7f0b589dc800 20 add_watcher() i=4 2023-12-03T11:37:51.904 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.903+0000 7f0b589dc800 20 add_watcher() i=5 2023-12-03T11:37:51.905 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.903+0000 7f0b589dc800 20 add_watcher() i=6 2023-12-03T11:37:51.905 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.904+0000 7f0b589dc800 20 add_watcher() i=7 2023-12-03T11:37:51.905 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.904+0000 7f0b589dc800 2 all 8 watchers are set, enabling cache 2023-12-03T11:37:51.907 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.906+0000 7f0b1bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:37:51.907 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.906+0000 7f0b589dc800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:37:51.907 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.906+0000 7f0b589dc800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:37:51.914 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.912+0000 7f0b589dc800 5 note: GC not initialized 2023-12-03T11:37:51.914 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.912+0000 7f0a8affd640 20 reqs_thread_entry: start 2023-12-03T11:37:51.914 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.913+0000 7f0b589dc800 20 init_complete bucket index max shards: 11 2023-12-03T11:37:51.914 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.913+0000 7f0b589dc800 20 Filter name: none 2023-12-03T11:37:51.914 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.913+0000 7f0a88ff9640 20 reqs_thread_entry: start 2023-12-03T11:37:51.914 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.913+0000 7f0b589dc800 20 rados->read ofs=0 len=0 2023-12-03T11:37:51.915 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.913+0000 7f0b589dc800 20 rados_obj.operate() r=0 bl.length=190 2023-12-03T11:37:51.915 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.913+0000 7f0b589dc800 20 rados->read ofs=0 len=0 2023-12-03T11:37:51.915 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.913+0000 7f0b589dc800 20 rados_obj.operate() r=0 bl.length=368 2023-12-03T11:37:51.915 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.913+0000 7f0b589dc800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:37:51.915 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.913+0000 7f0b589dc800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2023-12-03T11:37:51.915 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.913+0000 7f0b589dc800 20 INFO: main: starting shard=0 2023-12-03T11:37:51.915 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.914+0000 7f0b589dc800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.0 2023-12-03T11:37:51.916 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.914+0000 7f0b589dc800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:37:51.916 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.914+0000 7f0b589dc800 20 INFO: main: starting shard=1 2023-12-03T11:37:51.916 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.914+0000 7f0b589dc800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.1 2023-12-03T11:37:51.916 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.914+0000 7f0b589dc800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:37:51.916 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.914+0000 7f0b589dc800 20 INFO: main: starting shard=2 2023-12-03T11:37:51.916 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.914+0000 7f0b589dc800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.2 2023-12-03T11:37:51.917 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.915+0000 7f0b589dc800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:37:51.917 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.915+0000 7f0b589dc800 20 INFO: main: starting shard=3 2023-12-03T11:37:51.917 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.915+0000 7f0b589dc800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.3 2023-12-03T11:37:51.917 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.915+0000 7f0b589dc800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:37:51.917 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.915+0000 7f0b589dc800 20 INFO: main: starting shard=4 2023-12-03T11:37:51.917 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.915+0000 7f0b589dc800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.4 2023-12-03T11:37:51.918 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.916+0000 7f0b589dc800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:37:51.918 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.916+0000 7f0b589dc800 20 INFO: main: starting shard=5 2023-12-03T11:37:51.918 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.916+0000 7f0b589dc800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.5 2023-12-03T11:37:51.918 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.916+0000 7f0b589dc800 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2023-12-03T11:37:51.918 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.916+0000 7f0b589dc800 20 INFO: main: starting shard=6 2023-12-03T11:37:51.918 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.916+0000 7f0b589dc800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.6 2023-12-03T11:37:51.918 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.917+0000 7f0b589dc800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:37:51.918 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.917+0000 7f0b589dc800 20 INFO: main: starting shard=7 2023-12-03T11:37:51.918 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.917+0000 7f0b589dc800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.7 2023-12-03T11:37:51.919 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.918+0000 7f0b589dc800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:37:51.919 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.918+0000 7f0b589dc800 20 INFO: main: starting shard=8 2023-12-03T11:37:51.919 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.918+0000 7f0b589dc800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.8 2023-12-03T11:37:51.919 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.918+0000 7f0b589dc800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:37:51.920 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.918+0000 7f0b589dc800 20 INFO: main: starting shard=9 2023-12-03T11:37:51.920 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.918+0000 7f0b589dc800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.9 2023-12-03T11:37:51.920 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.919+0000 7f0b589dc800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:37:51.920 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.919+0000 7f0b589dc800 20 INFO: main: starting shard=10 2023-12-03T11:37:51.920 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.919+0000 7f0b589dc800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.10 2023-12-03T11:37:51.920 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.919+0000 7f0b589dc800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:37:51.920 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.919+0000 7f0b589dc800 20 INFO: main: done 2023-12-03T11:37:51.921 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.920+0000 7f0b1bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:37:51.923 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.922+0000 7f0b589dc800 20 remove_watcher() i=0 2023-12-03T11:37:51.924 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.922+0000 7f0b589dc800 2 removed watcher, disabling cache 2023-12-03T11:37:51.924 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.923+0000 7f0b589dc800 20 remove_watcher() i=1 2023-12-03T11:37:51.925 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.924+0000 7f0b589dc800 20 remove_watcher() i=2 2023-12-03T11:37:51.927 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.926+0000 7f0b589dc800 20 remove_watcher() i=3 2023-12-03T11:37:51.928 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.927+0000 7f0b589dc800 20 remove_watcher() i=4 2023-12-03T11:37:51.929 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.928+0000 7f0b589dc800 20 remove_watcher() i=5 2023-12-03T11:37:51.930 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.929+0000 7f0b589dc800 20 remove_watcher() i=6 2023-12-03T11:37:51.931 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:51.930+0000 7f0b589dc800 20 remove_watcher() i=7 2023-12-03T11:37:52.037 INFO:tasks.workunit.client.0.smithi003.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2023-12-03T11:37:52.039 INFO:tasks.workunit.client.0.smithi003.stderr:radosgw-admin bi list --bucket check-bucket --object e 2023-12-03T11:37:52.068 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:37:52.069 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:37:52.083 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.082+0000 7f90a2d3e800 20 rados->read ofs=0 len=0 2023-12-03T11:37:52.084 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.083+0000 7f90a2d3e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:52.084 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.083+0000 7f90a2d3e800 20 realm 2023-12-03T11:37:52.084 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.083+0000 7f90a2d3e800 20 rados->read ofs=0 len=0 2023-12-03T11:37:52.085 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.083+0000 7f90a2d3e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:52.085 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.083+0000 7f90a2d3e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:37:52.085 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.083+0000 7f90a2d3e800 20 rados->read ofs=0 len=0 2023-12-03T11:37:52.085 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.083+0000 7f90a2d3e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:52.085 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.083+0000 7f90a2d3e800 20 rados->read ofs=0 len=0 2023-12-03T11:37:52.086 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.084+0000 7f90a2d3e800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:37:52.086 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.084+0000 7f90a2d3e800 20 rados->read ofs=0 len=0 2023-12-03T11:37:52.086 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.085+0000 7f90a2d3e800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:37:52.086 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.085+0000 7f90a2d3e800 20 searching for the correct realm 2023-12-03T11:37:52.096 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.095+0000 7f909eb03640 0 -- 172.21.15.3:0/81107561 >> [v2:172.21.15.37:6805/1692844418,v1:172.21.15.37:6807/1692844418] conn(0x55591d838cd0 msgr2=0x55591d83b0c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:37:52.098 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.096+0000 7f90a2d3e800 20 RGWRados::pool_iterate: got zone_info.83aabb46-04b5-4c96-9933-c6bfb1173a73 2023-12-03T11:37:52.098 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.096+0000 7f90a2d3e800 20 RGWRados::pool_iterate: got zonegroup_info.6a811aad-435d-4fdd-93c9-b7e0b50de429 2023-12-03T11:37:52.098 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.096+0000 7f90a2d3e800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:37:52.098 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.096+0000 7f90a2d3e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:37:52.098 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.096+0000 7f90a2d3e800 20 rados->read ofs=0 len=0 2023-12-03T11:37:52.098 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.097+0000 7f90a2d3e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:52.098 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.097+0000 7f90a2d3e800 20 rados->read ofs=0 len=0 2023-12-03T11:37:52.099 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.097+0000 7f90a2d3e800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:37:52.099 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.097+0000 7f90a2d3e800 20 rados->read ofs=0 len=0 2023-12-03T11:37:52.099 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.097+0000 7f90a2d3e800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:37:52.099 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.097+0000 7f90a2d3e800 20 zone default found 2023-12-03T11:37:52.099 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.097+0000 7f90a2d3e800 4 Realm: () 2023-12-03T11:37:52.099 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.097+0000 7f90a2d3e800 4 ZoneGroup: default (6a811aad-435d-4fdd-93c9-b7e0b50de429) 2023-12-03T11:37:52.100 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.097+0000 7f90a2d3e800 4 Zone: default (83aabb46-04b5-4c96-9933-c6bfb1173a73) 2023-12-03T11:37:52.100 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.097+0000 7f90a2d3e800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:37:52.100 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.097+0000 7f90a2d3e800 20 zonegroup default 2023-12-03T11:37:52.100 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.097+0000 7f90a2d3e800 20 rados->read ofs=0 len=0 2023-12-03T11:37:52.100 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.098+0000 7f90a2d3e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:52.100 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.098+0000 7f90a2d3e800 20 rados->read ofs=0 len=0 2023-12-03T11:37:52.100 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.098+0000 7f90a2d3e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:52.100 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.098+0000 7f90a2d3e800 20 rados->read ofs=0 len=0 2023-12-03T11:37:52.100 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.098+0000 7f90a2d3e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:52.100 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.098+0000 7f90a2d3e800 20 started sync module instance, tier type = 2023-12-03T11:37:52.100 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.098+0000 7f90a2d3e800 20 started zone id=83aabb46-04b5-4c96-9933-c6bfb1173a73 (name=default) with tier type = 2023-12-03T11:37:52.108 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.107+0000 7f909e302640 0 -- 172.21.15.3:0/81107561 >> [v2:172.21.15.3:6817/3356208405,v1:172.21.15.3:6819/3356208405] conn(0x55591d83d8b0 msgr2=0x55591d83fcc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:37:52.112 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.110+0000 7f90a2d3e800 20 add_watcher() i=0 2023-12-03T11:37:52.112 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.110+0000 7f90a2d3e800 20 add_watcher() i=1 2023-12-03T11:37:52.112 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.110+0000 7f90a2d3e800 20 add_watcher() i=2 2023-12-03T11:37:52.112 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.110+0000 7f90a2d3e800 20 add_watcher() i=3 2023-12-03T11:37:52.112 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.110+0000 7f90a2d3e800 20 add_watcher() i=4 2023-12-03T11:37:52.112 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.110+0000 7f90a2d3e800 20 add_watcher() i=5 2023-12-03T11:37:52.112 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.111+0000 7f90a2d3e800 20 add_watcher() i=6 2023-12-03T11:37:52.112 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.112+0000 7f90a2d3e800 20 add_watcher() i=7 2023-12-03T11:37:52.113 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.112+0000 7f90a2d3e800 2 all 8 watchers are set, enabling cache 2023-12-03T11:37:52.115 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.113+0000 7f8fdffff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:37:52.115 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.114+0000 7f90a2d3e800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:37:52.115 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.114+0000 7f90a2d3e800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:37:52.121 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.120+0000 7f90a2d3e800 5 note: GC not initialized 2023-12-03T11:37:52.121 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.120+0000 7f8fceffd640 20 reqs_thread_entry: start 2023-12-03T11:37:52.121 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.120+0000 7f90a2d3e800 20 init_complete bucket index max shards: 11 2023-12-03T11:37:52.121 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.120+0000 7f90a2d3e800 20 Filter name: none 2023-12-03T11:37:52.122 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.121+0000 7f8fccff9640 20 reqs_thread_entry: start 2023-12-03T11:37:52.122 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.121+0000 7f90a2d3e800 20 rados->read ofs=0 len=0 2023-12-03T11:37:52.122 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.121+0000 7f90a2d3e800 20 rados_obj.operate() r=0 bl.length=190 2023-12-03T11:37:52.122 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.121+0000 7f90a2d3e800 20 rados->read ofs=0 len=0 2023-12-03T11:37:52.123 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.121+0000 7f90a2d3e800 20 rados_obj.operate() r=0 bl.length=368 2023-12-03T11:37:52.123 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.121+0000 7f90a2d3e800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:37:52.123 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.121+0000 7f90a2d3e800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2023-12-03T11:37:52.123 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.121+0000 7f90a2d3e800 20 INFO: main: starting shard=0 2023-12-03T11:37:52.123 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.121+0000 7f90a2d3e800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.0 2023-12-03T11:37:52.123 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.122+0000 7f90a2d3e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:37:52.123 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.122+0000 7f90a2d3e800 20 INFO: main: starting shard=1 2023-12-03T11:37:52.123 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.122+0000 7f90a2d3e800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.1 2023-12-03T11:37:52.124 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.122+0000 7f90a2d3e800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2023-12-03T11:37:52.124 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.122+0000 7f90a2d3e800 20 INFO: main: starting shard=2 2023-12-03T11:37:52.124 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.122+0000 7f90a2d3e800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.2 2023-12-03T11:37:52.124 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.123+0000 7f90a2d3e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:37:52.124 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.123+0000 7f90a2d3e800 20 INFO: main: starting shard=3 2023-12-03T11:37:52.124 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.123+0000 7f90a2d3e800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.3 2023-12-03T11:37:52.125 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.123+0000 7f90a2d3e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:37:52.125 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.123+0000 7f90a2d3e800 20 INFO: main: starting shard=4 2023-12-03T11:37:52.125 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.123+0000 7f90a2d3e800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.4 2023-12-03T11:37:52.125 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.124+0000 7f90a2d3e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:37:52.125 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.124+0000 7f90a2d3e800 20 INFO: main: starting shard=5 2023-12-03T11:37:52.125 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.124+0000 7f90a2d3e800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.5 2023-12-03T11:37:52.126 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.124+0000 7f90a2d3e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:37:52.126 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.125+0000 7f90a2d3e800 20 INFO: main: starting shard=6 2023-12-03T11:37:52.126 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.125+0000 7f90a2d3e800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.6 2023-12-03T11:37:52.126 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.125+0000 7f90a2d3e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:37:52.126 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.125+0000 7f90a2d3e800 20 INFO: main: starting shard=7 2023-12-03T11:37:52.126 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.125+0000 7f90a2d3e800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.7 2023-12-03T11:37:52.126 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.125+0000 7f90a2d3e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:37:52.127 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.125+0000 7f90a2d3e800 20 INFO: main: starting shard=8 2023-12-03T11:37:52.127 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.125+0000 7f90a2d3e800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.8 2023-12-03T11:37:52.127 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.126+0000 7f90a2d3e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:37:52.127 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.126+0000 7f90a2d3e800 20 INFO: main: starting shard=9 2023-12-03T11:37:52.127 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.126+0000 7f90a2d3e800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.9 2023-12-03T11:37:52.127 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.126+0000 7f90a2d3e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:37:52.127 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.126+0000 7f90a2d3e800 20 INFO: main: starting shard=10 2023-12-03T11:37:52.127 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.126+0000 7f90a2d3e800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.10 2023-12-03T11:37:52.128 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.127+0000 7f90a2d3e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:37:52.128 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.127+0000 7f90a2d3e800 20 INFO: main: done 2023-12-03T11:37:52.129 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.128+0000 7f8fdffff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:37:52.131 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.130+0000 7f90a2d3e800 20 remove_watcher() i=0 2023-12-03T11:37:52.131 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.130+0000 7f90a2d3e800 2 removed watcher, disabling cache 2023-12-03T11:37:52.133 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.132+0000 7f90a2d3e800 20 remove_watcher() i=1 2023-12-03T11:37:52.134 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.133+0000 7f90a2d3e800 20 remove_watcher() i=2 2023-12-03T11:37:52.135 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.134+0000 7f90a2d3e800 20 remove_watcher() i=3 2023-12-03T11:37:52.136 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.135+0000 7f90a2d3e800 20 remove_watcher() i=4 2023-12-03T11:37:52.137 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.136+0000 7f90a2d3e800 20 remove_watcher() i=5 2023-12-03T11:37:52.138 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.137+0000 7f90a2d3e800 20 remove_watcher() i=6 2023-12-03T11:37:52.140 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.139+0000 7f90a2d3e800 20 remove_watcher() i=7 2023-12-03T11:37:52.260 INFO:tasks.workunit.client.0.smithi003.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2023-12-03T11:37:52.261 INFO:tasks.workunit.client.0.smithi003.stderr:radosgw-admin bi list --bucket check-bucket --object f 2023-12-03T11:37:52.291 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:37:52.292 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:37:52.306 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.305+0000 7f75f1ddc800 20 rados->read ofs=0 len=0 2023-12-03T11:37:52.308 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.306+0000 7f75f1ddc800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:52.308 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.306+0000 7f75f1ddc800 20 realm 2023-12-03T11:37:52.308 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.306+0000 7f75f1ddc800 20 rados->read ofs=0 len=0 2023-12-03T11:37:52.308 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.307+0000 7f75f1ddc800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:52.308 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.307+0000 7f75f1ddc800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:37:52.308 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.307+0000 7f75f1ddc800 20 rados->read ofs=0 len=0 2023-12-03T11:37:52.308 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.307+0000 7f75f1ddc800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:52.308 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.307+0000 7f75f1ddc800 20 rados->read ofs=0 len=0 2023-12-03T11:37:52.309 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.308+0000 7f75f1ddc800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:37:52.309 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.308+0000 7f75f1ddc800 20 rados->read ofs=0 len=0 2023-12-03T11:37:52.309 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.308+0000 7f75f1ddc800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:37:52.309 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.308+0000 7f75f1ddc800 20 searching for the correct realm 2023-12-03T11:37:52.319 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.318+0000 7f75ef8dc640 0 -- 172.21.15.3:0/124444895 >> [v2:172.21.15.37:6805/1692844418,v1:172.21.15.37:6807/1692844418] conn(0x562bd4295b40 msgr2=0x562bd4297f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:37:52.321 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.319+0000 7f75f1ddc800 20 RGWRados::pool_iterate: got zone_info.83aabb46-04b5-4c96-9933-c6bfb1173a73 2023-12-03T11:37:52.321 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.319+0000 7f75f1ddc800 20 RGWRados::pool_iterate: got zonegroup_info.6a811aad-435d-4fdd-93c9-b7e0b50de429 2023-12-03T11:37:52.321 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.319+0000 7f75f1ddc800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:37:52.321 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.319+0000 7f75f1ddc800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:37:52.321 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.319+0000 7f75f1ddc800 20 rados->read ofs=0 len=0 2023-12-03T11:37:52.321 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.320+0000 7f75f1ddc800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:52.321 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.320+0000 7f75f1ddc800 20 rados->read ofs=0 len=0 2023-12-03T11:37:52.322 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.320+0000 7f75f1ddc800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:37:52.322 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.320+0000 7f75f1ddc800 20 rados->read ofs=0 len=0 2023-12-03T11:37:52.322 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.320+0000 7f75f1ddc800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:37:52.322 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.320+0000 7f75f1ddc800 20 zone default found 2023-12-03T11:37:52.322 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.320+0000 7f75f1ddc800 4 Realm: () 2023-12-03T11:37:52.322 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.320+0000 7f75f1ddc800 4 ZoneGroup: default (6a811aad-435d-4fdd-93c9-b7e0b50de429) 2023-12-03T11:37:52.323 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.320+0000 7f75f1ddc800 4 Zone: default (83aabb46-04b5-4c96-9933-c6bfb1173a73) 2023-12-03T11:37:52.323 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.320+0000 7f75f1ddc800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:37:52.323 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.320+0000 7f75f1ddc800 20 zonegroup default 2023-12-03T11:37:52.323 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.320+0000 7f75f1ddc800 20 rados->read ofs=0 len=0 2023-12-03T11:37:52.323 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.320+0000 7f75f1ddc800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:52.323 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.320+0000 7f75f1ddc800 20 rados->read ofs=0 len=0 2023-12-03T11:37:52.323 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.321+0000 7f75f1ddc800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:52.323 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.321+0000 7f75f1ddc800 20 rados->read ofs=0 len=0 2023-12-03T11:37:52.323 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.321+0000 7f75f1ddc800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:52.323 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.321+0000 7f75f1ddc800 20 started sync module instance, tier type = 2023-12-03T11:37:52.323 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.321+0000 7f75f1ddc800 20 started zone id=83aabb46-04b5-4c96-9933-c6bfb1173a73 (name=default) with tier type = 2023-12-03T11:37:52.330 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.329+0000 7f75f00dd640 0 -- 172.21.15.3:0/124444895 >> [v2:172.21.15.37:6816/3770469300,v1:172.21.15.37:6818/3770469300] conn(0x7f75e409dab0 msgr2=0x7f75e40a0120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:37:52.335 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.334+0000 7f75f1ddc800 20 add_watcher() i=0 2023-12-03T11:37:52.335 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.334+0000 7f75f1ddc800 20 add_watcher() i=1 2023-12-03T11:37:52.335 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.334+0000 7f75f1ddc800 20 add_watcher() i=2 2023-12-03T11:37:52.335 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.334+0000 7f75f1ddc800 20 add_watcher() i=3 2023-12-03T11:37:52.336 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.334+0000 7f75f1ddc800 20 add_watcher() i=4 2023-12-03T11:37:52.336 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.334+0000 7f75f1ddc800 20 add_watcher() i=5 2023-12-03T11:37:52.336 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.334+0000 7f75f1ddc800 20 add_watcher() i=6 2023-12-03T11:37:52.340 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.339+0000 7f75f1ddc800 20 add_watcher() i=7 2023-12-03T11:37:52.340 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.339+0000 7f75f1ddc800 2 all 8 watchers are set, enabling cache 2023-12-03T11:37:52.342 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.341+0000 7f75b5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:37:52.342 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.341+0000 7f75f1ddc800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:37:52.342 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.341+0000 7f75f1ddc800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:37:52.349 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.347+0000 7f75f1ddc800 5 note: GC not initialized 2023-12-03T11:37:52.349 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.347+0000 7f752cff9640 20 reqs_thread_entry: start 2023-12-03T11:37:52.349 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.347+0000 7f75f1ddc800 20 init_complete bucket index max shards: 11 2023-12-03T11:37:52.349 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.347+0000 7f75f1ddc800 20 Filter name: none 2023-12-03T11:37:52.349 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.348+0000 7f75227fc640 20 reqs_thread_entry: start 2023-12-03T11:37:52.349 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.348+0000 7f75f1ddc800 20 rados->read ofs=0 len=0 2023-12-03T11:37:52.350 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.348+0000 7f75f1ddc800 20 rados_obj.operate() r=0 bl.length=190 2023-12-03T11:37:52.350 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.348+0000 7f75f1ddc800 20 rados->read ofs=0 len=0 2023-12-03T11:37:52.350 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.348+0000 7f75f1ddc800 20 rados_obj.operate() r=0 bl.length=368 2023-12-03T11:37:52.350 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.348+0000 7f75f1ddc800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:37:52.350 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.348+0000 7f75f1ddc800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2023-12-03T11:37:52.350 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.348+0000 7f75f1ddc800 20 INFO: main: starting shard=0 2023-12-03T11:37:52.350 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.348+0000 7f75f1ddc800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.0 2023-12-03T11:37:52.350 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.349+0000 7f75f1ddc800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:37:52.350 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.349+0000 7f75f1ddc800 20 INFO: main: starting shard=1 2023-12-03T11:37:52.351 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.349+0000 7f75f1ddc800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.1 2023-12-03T11:37:52.351 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.349+0000 7f75f1ddc800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:37:52.351 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.349+0000 7f75f1ddc800 20 INFO: main: starting shard=2 2023-12-03T11:37:52.351 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.349+0000 7f75f1ddc800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.2 2023-12-03T11:37:52.351 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.350+0000 7f75f1ddc800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:37:52.351 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.350+0000 7f75f1ddc800 20 INFO: main: starting shard=3 2023-12-03T11:37:52.352 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.350+0000 7f75f1ddc800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.3 2023-12-03T11:37:52.352 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.350+0000 7f75f1ddc800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:37:52.352 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.350+0000 7f75f1ddc800 20 INFO: main: starting shard=4 2023-12-03T11:37:52.352 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.350+0000 7f75f1ddc800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.4 2023-12-03T11:37:52.352 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.351+0000 7f75f1ddc800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:37:52.352 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.351+0000 7f75f1ddc800 20 INFO: main: starting shard=5 2023-12-03T11:37:52.352 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.351+0000 7f75f1ddc800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.5 2023-12-03T11:37:52.352 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.351+0000 7f75f1ddc800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:37:52.352 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.351+0000 7f75f1ddc800 20 INFO: main: starting shard=6 2023-12-03T11:37:52.353 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.351+0000 7f75f1ddc800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.6 2023-12-03T11:37:52.353 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.352+0000 7f75f1ddc800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:37:52.353 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.352+0000 7f75f1ddc800 20 INFO: main: starting shard=7 2023-12-03T11:37:52.353 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.352+0000 7f75f1ddc800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.7 2023-12-03T11:37:52.353 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.352+0000 7f75f1ddc800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:37:52.353 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.352+0000 7f75f1ddc800 20 INFO: main: starting shard=8 2023-12-03T11:37:52.354 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.352+0000 7f75f1ddc800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.8 2023-12-03T11:37:52.354 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.353+0000 7f75f1ddc800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:37:52.354 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.353+0000 7f75f1ddc800 20 INFO: main: starting shard=9 2023-12-03T11:37:52.354 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.353+0000 7f75f1ddc800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.9 2023-12-03T11:37:52.354 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.353+0000 7f75f1ddc800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:37:52.355 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.353+0000 7f75f1ddc800 20 INFO: main: starting shard=10 2023-12-03T11:37:52.355 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.353+0000 7f75f1ddc800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.10 2023-12-03T11:37:52.355 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.354+0000 7f75f1ddc800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2023-12-03T11:37:52.355 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.354+0000 7f75f1ddc800 20 INFO: main: done 2023-12-03T11:37:52.355 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.355+0000 7f75b5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:37:52.358 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.357+0000 7f75f1ddc800 20 remove_watcher() i=0 2023-12-03T11:37:52.358 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.357+0000 7f75f1ddc800 2 removed watcher, disabling cache 2023-12-03T11:37:52.359 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.358+0000 7f75f1ddc800 20 remove_watcher() i=1 2023-12-03T11:37:52.360 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.359+0000 7f75f1ddc800 20 remove_watcher() i=2 2023-12-03T11:37:52.361 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.360+0000 7f75f1ddc800 20 remove_watcher() i=3 2023-12-03T11:37:52.362 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.361+0000 7f75f1ddc800 20 remove_watcher() i=4 2023-12-03T11:37:52.364 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.363+0000 7f75f1ddc800 20 remove_watcher() i=5 2023-12-03T11:37:52.365 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.364+0000 7f75f1ddc800 20 remove_watcher() i=6 2023-12-03T11:37:52.365 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:52.365+0000 7f75f1ddc800 20 remove_watcher() i=7 2023-12-03T11:37:52.393 INFO:tasks.workunit.client.0.smithi003.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2023-12-03T11:37:52.799 INFO:tasks.workunit.client.0.smithi003.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2023-12-03T11:37:53.188 INFO:tasks.workunit.client.0.smithi003.stderr:TEST: bucket check unlinked finds unlistable entries 2023-12-03T11:37:53.189 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:37:53.190 INFO:tasks.workunit.client.0.smithi003.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2023-12-03T11:37:53.222 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:37:53.222 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:37:53.236 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.235+0000 7fbf2c935800 20 rados->read ofs=0 len=0 2023-12-03T11:37:53.238 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.237+0000 7fbf2c935800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:53.238 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.237+0000 7fbf2c935800 20 realm 2023-12-03T11:37:53.238 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.237+0000 7fbf2c935800 20 rados->read ofs=0 len=0 2023-12-03T11:37:53.239 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.237+0000 7fbf2c935800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:53.239 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.237+0000 7fbf2c935800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:37:53.239 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.237+0000 7fbf2c935800 20 rados->read ofs=0 len=0 2023-12-03T11:37:53.239 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.237+0000 7fbf2c935800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:53.239 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.237+0000 7fbf2c935800 20 rados->read ofs=0 len=0 2023-12-03T11:37:53.239 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.238+0000 7fbf2c935800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:37:53.240 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.238+0000 7fbf2c935800 20 rados->read ofs=0 len=0 2023-12-03T11:37:53.240 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.238+0000 7fbf2c935800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:37:53.240 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.238+0000 7fbf2c935800 20 searching for the correct realm 2023-12-03T11:37:53.251 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.250+0000 7fbf1ffff640 0 -- 172.21.15.3:0/548817951 >> [v2:172.21.15.3:6817/3356208405,v1:172.21.15.3:6819/3356208405] conn(0x560f7d9e00d0 msgr2=0x560f7d9e24c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:37:53.251 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.250+0000 7fbf2c935800 20 RGWRados::pool_iterate: got zone_info.83aabb46-04b5-4c96-9933-c6bfb1173a73 2023-12-03T11:37:53.252 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.250+0000 7fbf2c935800 20 RGWRados::pool_iterate: got zonegroup_info.6a811aad-435d-4fdd-93c9-b7e0b50de429 2023-12-03T11:37:53.252 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.250+0000 7fbf2c935800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:37:53.252 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.250+0000 7fbf2c935800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:37:53.252 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.250+0000 7fbf2c935800 20 rados->read ofs=0 len=0 2023-12-03T11:37:53.252 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.250+0000 7fbf2c935800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:53.252 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.251+0000 7fbf2c935800 20 rados->read ofs=0 len=0 2023-12-03T11:37:53.253 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.251+0000 7fbf2c935800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:37:53.253 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.251+0000 7fbf2c935800 20 rados->read ofs=0 len=0 2023-12-03T11:37:53.253 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.251+0000 7fbf2c935800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:37:53.253 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.251+0000 7fbf2c935800 20 zone default found 2023-12-03T11:37:53.253 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.251+0000 7fbf2c935800 4 Realm: () 2023-12-03T11:37:53.253 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.251+0000 7fbf2c935800 4 ZoneGroup: default (6a811aad-435d-4fdd-93c9-b7e0b50de429) 2023-12-03T11:37:53.253 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.251+0000 7fbf2c935800 4 Zone: default (83aabb46-04b5-4c96-9933-c6bfb1173a73) 2023-12-03T11:37:53.253 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.251+0000 7fbf2c935800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:37:53.253 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.251+0000 7fbf2c935800 20 zonegroup default 2023-12-03T11:37:53.253 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.251+0000 7fbf2c935800 20 rados->read ofs=0 len=0 2023-12-03T11:37:53.253 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.251+0000 7fbf2c935800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:53.253 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.251+0000 7fbf2c935800 20 rados->read ofs=0 len=0 2023-12-03T11:37:53.253 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.252+0000 7fbf2c935800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:53.254 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.252+0000 7fbf2c935800 20 rados->read ofs=0 len=0 2023-12-03T11:37:53.254 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.252+0000 7fbf2c935800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:53.254 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.252+0000 7fbf2c935800 20 started sync module instance, tier type = 2023-12-03T11:37:53.254 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.252+0000 7fbf2c935800 20 started zone id=83aabb46-04b5-4c96-9933-c6bfb1173a73 (name=default) with tier type = 2023-12-03T11:37:53.263 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.262+0000 7fbf1ffff640 0 -- 172.21.15.3:0/548817951 >> [v2:172.21.15.3:6817/3356208405,v1:172.21.15.3:6819/3356208405] conn(0x7fbf000773d0 msgr2=0x7fbf00079800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-03T11:37:53.267 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.266+0000 7fbf2c935800 20 add_watcher() i=0 2023-12-03T11:37:53.267 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.266+0000 7fbf2c935800 20 add_watcher() i=1 2023-12-03T11:37:53.267 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.266+0000 7fbf2c935800 20 add_watcher() i=2 2023-12-03T11:37:53.267 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.266+0000 7fbf2c935800 20 add_watcher() i=3 2023-12-03T11:37:53.267 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.266+0000 7fbf2c935800 20 add_watcher() i=4 2023-12-03T11:37:53.267 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.266+0000 7fbf2c935800 20 add_watcher() i=5 2023-12-03T11:37:53.267 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.266+0000 7fbf2c935800 20 add_watcher() i=6 2023-12-03T11:37:53.267 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.266+0000 7fbf2c935800 20 add_watcher() i=7 2023-12-03T11:37:53.268 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.266+0000 7fbf2c935800 2 all 8 watchers are set, enabling cache 2023-12-03T11:37:53.269 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.268+0000 7fbeee7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:37:53.270 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.269+0000 7fbf2c935800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:37:53.270 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.269+0000 7fbf2c935800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:37:53.276 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.275+0000 7fbf2c935800 5 note: GC not initialized 2023-12-03T11:37:53.276 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.275+0000 7fbe5d7fa640 20 reqs_thread_entry: start 2023-12-03T11:37:53.276 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.275+0000 7fbf2c935800 20 init_complete bucket index max shards: 11 2023-12-03T11:37:53.276 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.275+0000 7fbf2c935800 20 Filter name: none 2023-12-03T11:37:53.276 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.275+0000 7fbe56ffd640 20 reqs_thread_entry: start 2023-12-03T11:37:53.276 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.275+0000 7fbf2c935800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2023-12-03T11:37:53.276 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.275+0000 7fbf2c935800 20 rados->read ofs=0 len=0 2023-12-03T11:37:53.277 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.275+0000 7fbf2c935800 20 rados_obj.operate() r=0 bl.length=190 2023-12-03T11:37:53.277 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.275+0000 7fbf2c935800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2023-12-03T11:37:53.277 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.275+0000 7fbf2c935800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2023-12-03T11:37:53.278 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.275+0000 7fbf2c935800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2 : miss 2023-12-03T11:37:53.278 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.275+0000 7fbf2c935800 20 rados->read ofs=0 len=0 2023-12-03T11:37:53.278 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.276+0000 7fbf2c935800 20 rados_obj.operate() r=0 bl.length=368 2023-12-03T11:37:53.278 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.276+0000 7fbf2c935800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2 info.flags=0x17 2023-12-03T11:37:53.278 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.276+0000 7fbf2c935800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2 to cache LRU end 2023-12-03T11:37:53.278 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.276+0000 7fbf2c935800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:37:53.278 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.276+0000 7fbf2c935800 10 updating xattr: name=user.rgw.acl bl.length()=179 2023-12-03T11:37:53.278 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.276+0000 7fbf2c935800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2 2023-12-03T11:37:53.278 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.276+0000 7fbf2c935800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.0 2023-12-03T11:37:53.278 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.276+0000 7fbf2c935800 1 NOTICE: finished shard 0 (0 entries found) 2023-12-03T11:37:53.278 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.276+0000 7fbf2c935800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.1 2023-12-03T11:37:53.279 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.277+0000 7fbf2c935800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.2 2023-12-03T11:37:53.279 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.277+0000 7fbf2c935800 1 NOTICE: finished shard 2 (0 entries found) 2023-12-03T11:37:53.279 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.277+0000 7fbf2c935800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.3 2023-12-03T11:37:53.279 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.278+0000 7fbf2c935800 1 NOTICE: finished shard 3 (0 entries found) 2023-12-03T11:37:53.279 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.278+0000 7fbf2c935800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.4 2023-12-03T11:37:53.279 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.278+0000 7fbf2c935800 1 NOTICE: finished shard 4 (0 entries found) 2023-12-03T11:37:53.279 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.278+0000 7fbf2c935800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.5 2023-12-03T11:37:53.280 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.279+0000 7fbf2c935800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.6 2023-12-03T11:37:53.280 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.279+0000 7fbf2c935800 1 NOTICE: finished shard 6 (0 entries found) 2023-12-03T11:37:53.280 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.279+0000 7fbf2c935800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.7 2023-12-03T11:37:53.280 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.280+0000 7fbf2c935800 1 NOTICE: finished shard 7 (0 entries found) 2023-12-03T11:37:53.281 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.280+0000 7fbf2c935800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.8 2023-12-03T11:37:53.281 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.280+0000 7fbf2c935800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.9 2023-12-03T11:37:53.281 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.280+0000 7fbf2c935800 1 NOTICE: finished shard 9 (0 entries found) 2023-12-03T11:37:53.281 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.280+0000 7fbf2c935800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.10 2023-12-03T11:37:53.282 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.281+0000 7fbf2c935800 1 NOTICE: finished shard 1 (1 entries found) 2023-12-03T11:37:53.282 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.281+0000 7fbf2c935800 1 NOTICE: finished shard 5 (1 entries found) 2023-12-03T11:37:53.282 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.281+0000 7fbf2c935800 1 NOTICE: finished shard 8 (1 entries found) 2023-12-03T11:37:53.282 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.281+0000 7fbf2c935800 1 NOTICE: finished shard 10 (1 entries found) 2023-12-03T11:37:53.283 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.281+0000 7fbf2c935800 1 NOTICE: finished all shards (4 entries found) 2023-12-03T11:37:53.283 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.282+0000 7fbeee7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:37:53.285 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.285+0000 7fbf2c935800 20 remove_watcher() i=0 2023-12-03T11:37:53.286 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.285+0000 7fbf2c935800 2 removed watcher, disabling cache 2023-12-03T11:37:53.287 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.286+0000 7fbf2c935800 20 remove_watcher() i=1 2023-12-03T11:37:53.288 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.287+0000 7fbf2c935800 20 remove_watcher() i=2 2023-12-03T11:37:53.289 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.288+0000 7fbf2c935800 20 remove_watcher() i=3 2023-12-03T11:37:53.290 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.289+0000 7fbf2c935800 20 remove_watcher() i=4 2023-12-03T11:37:53.292 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.291+0000 7fbf2c935800 20 remove_watcher() i=5 2023-12-03T11:37:53.293 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.292+0000 7fbf2c935800 20 remove_watcher() i=6 2023-12-03T11:37:53.294 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.293+0000 7fbf2c935800 20 remove_watcher() i=7 2023-12-03T11:37:53.299 INFO:tasks.workunit.client.0.smithi003.stderr:TEST: unlinked entries are not listable 2023-12-03T11:37:53.299 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:37:53.410 INFO:tasks.workunit.client.0.smithi003.stderr:TEST: GET returns 404 for unlinked entry keys that have no other versions 2023-12-03T11:37:53.410 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:37:53.532 INFO:tasks.workunit.client.0.smithi003.stderr:TEST: bucket check unlinked fixes unlistable entries 2023-12-03T11:37:53.532 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:37:53.534 INFO:tasks.workunit.client.0.smithi003.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2023-12-03T11:37:53.569 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:37:53.569 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:37:53.585 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.584+0000 7fbaf8122800 20 rados->read ofs=0 len=0 2023-12-03T11:37:53.587 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.586+0000 7fbaf8122800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:53.587 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.586+0000 7fbaf8122800 20 realm 2023-12-03T11:37:53.587 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.586+0000 7fbaf8122800 20 rados->read ofs=0 len=0 2023-12-03T11:37:53.587 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.586+0000 7fbaf8122800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:53.587 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.586+0000 7fbaf8122800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:37:53.587 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.586+0000 7fbaf8122800 20 rados->read ofs=0 len=0 2023-12-03T11:37:53.587 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.586+0000 7fbaf8122800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:53.588 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.586+0000 7fbaf8122800 20 rados->read ofs=0 len=0 2023-12-03T11:37:53.588 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.587+0000 7fbaf8122800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:37:53.588 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.587+0000 7fbaf8122800 20 rados->read ofs=0 len=0 2023-12-03T11:37:53.588 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.587+0000 7fbaf8122800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:37:53.589 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.587+0000 7fbaf8122800 20 searching for the correct realm 2023-12-03T11:37:53.598 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.597+0000 7fbaf35c8640 0 -- 172.21.15.3:0/2472375787 >> [v2:172.21.15.3:6817/3356208405,v1:172.21.15.3:6819/3356208405] conn(0x55a7aade79e0 msgr2=0x55a7aade9dd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:37:53.600 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.599+0000 7fbaf8122800 20 RGWRados::pool_iterate: got zone_info.83aabb46-04b5-4c96-9933-c6bfb1173a73 2023-12-03T11:37:53.600 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.599+0000 7fbaf8122800 20 RGWRados::pool_iterate: got zonegroup_info.6a811aad-435d-4fdd-93c9-b7e0b50de429 2023-12-03T11:37:53.600 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.599+0000 7fbaf8122800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:37:53.601 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.599+0000 7fbaf8122800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:37:53.601 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.599+0000 7fbaf8122800 20 rados->read ofs=0 len=0 2023-12-03T11:37:53.601 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.599+0000 7fbaf8122800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:53.601 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.599+0000 7fbaf8122800 20 rados->read ofs=0 len=0 2023-12-03T11:37:53.602 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.600+0000 7fbaf8122800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:37:53.602 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.600+0000 7fbaf8122800 20 rados->read ofs=0 len=0 2023-12-03T11:37:53.602 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.600+0000 7fbaf8122800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:37:53.602 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.600+0000 7fbaf8122800 20 zone default found 2023-12-03T11:37:53.602 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.600+0000 7fbaf8122800 4 Realm: () 2023-12-03T11:37:53.602 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.600+0000 7fbaf8122800 4 ZoneGroup: default (6a811aad-435d-4fdd-93c9-b7e0b50de429) 2023-12-03T11:37:53.602 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.600+0000 7fbaf8122800 4 Zone: default (83aabb46-04b5-4c96-9933-c6bfb1173a73) 2023-12-03T11:37:53.602 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.600+0000 7fbaf8122800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:37:53.602 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.600+0000 7fbaf8122800 20 zonegroup default 2023-12-03T11:37:53.602 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.600+0000 7fbaf8122800 20 rados->read ofs=0 len=0 2023-12-03T11:37:53.602 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.600+0000 7fbaf8122800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:53.602 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.600+0000 7fbaf8122800 20 rados->read ofs=0 len=0 2023-12-03T11:37:53.603 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.601+0000 7fbaf8122800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:53.603 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.601+0000 7fbaf8122800 20 rados->read ofs=0 len=0 2023-12-03T11:37:53.603 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.601+0000 7fbaf8122800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:53.603 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.601+0000 7fbaf8122800 20 started sync module instance, tier type = 2023-12-03T11:37:53.603 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.601+0000 7fbaf8122800 20 started zone id=83aabb46-04b5-4c96-9933-c6bfb1173a73 (name=default) with tier type = 2023-12-03T11:37:53.607 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.606+0000 7fbaf3dc9640 0 -- 172.21.15.3:0/2472375787 >> [v2:172.21.15.3:6800/2373485412,v1:172.21.15.3:6801/2373485412] conn(0x7fbaec0870c0 msgr2=0x7fbaec076aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-03T11:37:53.619 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.618+0000 7fbaf8122800 20 add_watcher() i=0 2023-12-03T11:37:53.619 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.618+0000 7fbaf8122800 20 add_watcher() i=1 2023-12-03T11:37:53.619 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.618+0000 7fbaf8122800 20 add_watcher() i=2 2023-12-03T11:37:53.619 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.618+0000 7fbaf8122800 20 add_watcher() i=3 2023-12-03T11:37:53.619 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.618+0000 7fbaf8122800 20 add_watcher() i=4 2023-12-03T11:37:53.619 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.618+0000 7fbaf8122800 20 add_watcher() i=5 2023-12-03T11:37:53.619 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.618+0000 7fbaf8122800 20 add_watcher() i=6 2023-12-03T11:37:53.620 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.619+0000 7fbaf8122800 20 add_watcher() i=7 2023-12-03T11:37:53.620 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.619+0000 7fbaf8122800 2 all 8 watchers are set, enabling cache 2023-12-03T11:37:53.623 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.622+0000 7fbab9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:37:53.623 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.622+0000 7fbaf8122800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:37:53.623 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.622+0000 7fbaf8122800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:37:53.630 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.628+0000 7fbaf8122800 5 note: GC not initialized 2023-12-03T11:37:53.630 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.628+0000 7fba30ff9640 20 reqs_thread_entry: start 2023-12-03T11:37:53.630 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.628+0000 7fbaf8122800 20 init_complete bucket index max shards: 11 2023-12-03T11:37:53.630 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.629+0000 7fbaf8122800 20 Filter name: none 2023-12-03T11:37:53.630 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.629+0000 7fba267fc640 20 reqs_thread_entry: start 2023-12-03T11:37:53.630 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.629+0000 7fbaf8122800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2023-12-03T11:37:53.630 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.629+0000 7fbaf8122800 20 rados->read ofs=0 len=0 2023-12-03T11:37:53.631 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.629+0000 7fbaf8122800 20 rados_obj.operate() r=0 bl.length=190 2023-12-03T11:37:53.631 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.629+0000 7fbaf8122800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2023-12-03T11:37:53.631 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.629+0000 7fbaf8122800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2023-12-03T11:37:53.632 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.629+0000 7fbaf8122800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2 : miss 2023-12-03T11:37:53.632 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.629+0000 7fbaf8122800 20 rados->read ofs=0 len=0 2023-12-03T11:37:53.632 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.629+0000 7fbaf8122800 20 rados_obj.operate() r=0 bl.length=368 2023-12-03T11:37:53.632 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.629+0000 7fbaf8122800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2 info.flags=0x17 2023-12-03T11:37:53.632 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.629+0000 7fbaf8122800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2 to cache LRU end 2023-12-03T11:37:53.632 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.629+0000 7fbaf8122800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:37:53.632 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.629+0000 7fbaf8122800 10 updating xattr: name=user.rgw.acl bl.length()=179 2023-12-03T11:37:53.632 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.629+0000 7fbaf8122800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2 2023-12-03T11:37:53.632 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.629+0000 7fbaf8122800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.0 2023-12-03T11:37:53.632 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.630+0000 7fbaf8122800 1 NOTICE: finished shard 0 (0 entries removed) 2023-12-03T11:37:53.632 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.630+0000 7fbaf8122800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.1 2023-12-03T11:37:53.632 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.630+0000 7fbaf8122800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.2 2023-12-03T11:37:53.633 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.631+0000 7fbaf8122800 1 NOTICE: finished shard 2 (0 entries removed) 2023-12-03T11:37:53.633 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.631+0000 7fbaf8122800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.3 2023-12-03T11:37:53.633 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.631+0000 7fbaf8122800 1 NOTICE: finished shard 3 (0 entries removed) 2023-12-03T11:37:53.633 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.631+0000 7fbaf8122800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.4 2023-12-03T11:37:53.633 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.632+0000 7fbaf8122800 1 NOTICE: finished shard 4 (0 entries removed) 2023-12-03T11:37:53.633 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.632+0000 7fbaf8122800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.5 2023-12-03T11:37:53.634 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.632+0000 7fbaf8122800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.6 2023-12-03T11:37:53.634 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.633+0000 7fbaf8122800 1 NOTICE: finished shard 6 (0 entries removed) 2023-12-03T11:37:53.634 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.633+0000 7fbaf8122800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.7 2023-12-03T11:37:53.634 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.633+0000 7fbaf8122800 1 NOTICE: finished shard 7 (0 entries removed) 2023-12-03T11:37:53.634 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.633+0000 7fbaf8122800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.8 2023-12-03T11:37:53.635 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.634+0000 7fbaf8122800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.9 2023-12-03T11:37:53.635 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.634+0000 7fbaf8122800 1 NOTICE: finished shard 9 (0 entries removed) 2023-12-03T11:37:53.635 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.634+0000 7fbaf8122800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.10 2023-12-03T11:37:53.636 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.635+0000 7fbaf8122800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.1 2023-12-03T11:37:53.636 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.635+0000 7fbaf8122800 20 get_obj_state: octx=0x7fbae407f000 obj=check-bucket:e state=0x55a7aaedab48 s->prefetch_data=0 2023-12-03T11:37:53.636 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.635+0000 7fbaf8122800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.5 2023-12-03T11:37:53.636 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.635+0000 7fbaf8122800 20 get_obj_state: octx=0x7fbae4056280 obj=check-bucket:d state=0x55a7aaedbb78 s->prefetch_data=0 2023-12-03T11:37:53.637 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.635+0000 7fbaf8122800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.8 2023-12-03T11:37:53.637 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.636+0000 7fbaf8122800 20 get_obj_state: octx=0x55a7aac14fa0 obj=check-bucket:c state=0x55a7aaefcbd8 s->prefetch_data=0 2023-12-03T11:37:53.638 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.636+0000 7fbaf8122800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.10 2023-12-03T11:37:53.638 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.636+0000 7fbaf8122800 20 get_obj_state: octx=0x55a7aae99570 obj=check-bucket:f state=0x55a7aaefd728 s->prefetch_data=0 2023-12-03T11:37:53.638 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.636+0000 7fbaf8122800 20 get_obj_state: setting s->obj_tag to jwqlge1jzhzbxxe903xogkm573za7cc6 2023-12-03T11:37:53.638 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.636+0000 7fbaf8122800 20 get_obj_state_impl: setting s->olh_tag to n316sidiyg5h84gl0roz50vjtv3qqyo4 2023-12-03T11:37:53.638 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.636+0000 7fbaf8122800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=n316sidiyg5h84gl0roz50vjtv3qqyo4 2023-12-03T11:37:53.638 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.636+0000 7fbaf8122800 20 get_obj_state: setting s->obj_tag to 93720bokhbz6k5xrji09v8rinjzq0898 2023-12-03T11:37:53.638 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.636+0000 7fbaf8122800 20 get_obj_state_impl: setting s->olh_tag to u4taor11tdv16xuv6nawa0tk3y55yh2c 2023-12-03T11:37:53.638 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.636+0000 7fbaf8122800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=u4taor11tdv16xuv6nawa0tk3y55yh2c 2023-12-03T11:37:53.638 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.636+0000 7fbaf8122800 20 get_obj_state: setting s->obj_tag to e51361bkdagimfcjyb1bby275786zhwe 2023-12-03T11:37:53.638 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.636+0000 7fbaf8122800 20 get_obj_state_impl: setting s->olh_tag to zr60zyqkfv3h2y0jzo1k4nq2fmm96bcw 2023-12-03T11:37:53.638 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.636+0000 7fbaf8122800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=zr60zyqkfv3h2y0jzo1k4nq2fmm96bcw 2023-12-03T11:37:53.638 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.636+0000 7fbaf8122800 20 get_obj_state: setting s->obj_tag to duklko1jdx59rzd3xlv7oddu04w7d610 2023-12-03T11:37:53.638 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.636+0000 7fbaf8122800 20 get_obj_state_impl: setting s->olh_tag to dq0yqj5dezajboclau0g0gboq72sg73n 2023-12-03T11:37:53.639 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.636+0000 7fbaf8122800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=dq0yqj5dezajboclau0g0gboq72sg73n 2023-12-03T11:37:53.639 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.638+0000 7fbaf8122800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.1 2023-12-03T11:37:53.641 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.640+0000 7fbaf8122800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.8 2023-12-03T11:37:53.642 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.641+0000 7fbaf8122800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.5 2023-12-03T11:37:53.642 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.641+0000 7fbaf8122800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.10 2023-12-03T11:37:53.647 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.646+0000 7fbaf8122800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.1 2023-12-03T11:37:53.649 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.646+0000 7fbaf8122800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.5 2023-12-03T11:37:53.649 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.646+0000 7fbaf8122800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.8 2023-12-03T11:37:53.649 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.646+0000 7fbaf8122800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.10 2023-12-03T11:37:53.649 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.646+0000 7fbaf8122800 20 olh_log_entry: epoch=2 op=2 key=e[] 2023-12-03T11:37:53.649 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.646+0000 7fbaf8122800 20 olh_log_entry: epoch=2 op=3 key=e[kOBzLqpdeUVGdEr674GJ1ujkkYIYqtn] 2023-12-03T11:37:53.649 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.646+0000 7fbaf8122800 20 get_obj_state: octx=0x7fbae407f000 obj=check-bucket:_:kOBzLqpdeUVGdEr674GJ1ujkkYIYqtn_e state=0x55a7aaf11668 s->prefetch_data=0 2023-12-03T11:37:53.649 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.646+0000 7fbaf8122800 20 olh_log_entry: epoch=3 op=3 key=d[LAConEfDqwMtU3G6LSaq9IAcIauRcEr] 2023-12-03T11:37:53.649 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.646+0000 7fbaf8122800 20 get_obj_state: octx=0x7fbae4056280 obj=check-bucket:_:LAConEfDqwMtU3G6LSaq9IAcIauRcEr_d state=0x55a7aaf17558 s->prefetch_data=0 2023-12-03T11:37:53.649 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.646+0000 7fbaf8122800 20 olh_log_entry: epoch=3 op=3 key=c[4BQmj04rh6kvN6-OMf8ejLg0RwWaHcn] 2023-12-03T11:37:53.649 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.646+0000 7fbaf8122800 20 get_obj_state: octx=0x55a7aac14fa0 obj=check-bucket:_:4BQmj04rh6kvN6-OMf8ejLg0RwWaHcn_c state=0x55a7aaf032c8 s->prefetch_data=0 2023-12-03T11:37:53.649 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.646+0000 7fbaf8122800 20 olh_log_entry: epoch=2 op=2 key=f[] 2023-12-03T11:37:53.649 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.646+0000 7fbaf8122800 20 olh_log_entry: epoch=2 op=3 key=f[2.cSLHlKZlPr3zyKNxb12DubaMoOLss] 2023-12-03T11:37:53.649 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.647+0000 7fbaf8122800 20 get_obj_state: octx=0x55a7aae99570 obj=check-bucket:_:2.cSLHlKZlPr3zyKNxb12DubaMoOLss_f state=0x55a7aaf244c8 s->prefetch_data=0 2023-12-03T11:37:53.650 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.647+0000 7fbaf8122800 10 manifest: total_size = 9 2023-12-03T11:37:53.650 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.647+0000 7fbaf8122800 20 get_obj_state: setting s->obj_tag to 83aabb46-04b5-4c96-9933-c6bfb1173a73.4653.840118850458577064 2023-12-03T11:37:53.650 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.647+0000 7fbaf8122800 20 get_obj_state: octx=0x7fbae407f000 obj=check-bucket:_:kOBzLqpdeUVGdEr674GJ1ujkkYIYqtn_e state=0x55a7aaf11668 s->prefetch_data=0 2023-12-03T11:37:53.650 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.647+0000 7fbaf8122800 20 prepare_atomic_modification: state is not atomic. state=0x55a7aaf11668 2023-12-03T11:37:53.650 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.647+0000 7fbaf8122800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.1 2023-12-03T11:37:53.650 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.647+0000 7fbaf8122800 10 manifest: total_size = 12 2023-12-03T11:37:53.650 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.647+0000 7fbaf8122800 20 get_obj_state: setting s->obj_tag to 83aabb46-04b5-4c96-9933-c6bfb1173a73.4653.3602302086350739474 2023-12-03T11:37:53.650 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.647+0000 7fbaf8122800 20 get_obj_state: octx=0x7fbae4056280 obj=check-bucket:_:LAConEfDqwMtU3G6LSaq9IAcIauRcEr_d state=0x55a7aaf17558 s->prefetch_data=0 2023-12-03T11:37:53.650 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.647+0000 7fbaf8122800 20 prepare_atomic_modification: state is not atomic. state=0x55a7aaf17558 2023-12-03T11:37:53.650 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.647+0000 7fbaf8122800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.5 2023-12-03T11:37:53.650 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.647+0000 7fbaf8122800 10 manifest: total_size = 9 2023-12-03T11:37:53.650 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.647+0000 7fbaf8122800 20 get_obj_state: setting s->obj_tag to 83aabb46-04b5-4c96-9933-c6bfb1173a73.4653.8353061967155860815 2023-12-03T11:37:53.650 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.647+0000 7fbaf8122800 20 get_obj_state: octx=0x55a7aac14fa0 obj=check-bucket:_:4BQmj04rh6kvN6-OMf8ejLg0RwWaHcn_c state=0x55a7aaf032c8 s->prefetch_data=0 2023-12-03T11:37:53.650 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.647+0000 7fbaf8122800 20 prepare_atomic_modification: state is not atomic. state=0x55a7aaf032c8 2023-12-03T11:37:53.651 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.647+0000 7fbaf8122800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.8 2023-12-03T11:37:53.651 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.647+0000 7fbaf8122800 10 manifest: total_size = 9 2023-12-03T11:37:53.651 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.647+0000 7fbaf8122800 20 get_obj_state: setting s->obj_tag to 83aabb46-04b5-4c96-9933-c6bfb1173a73.4653.3322186113005101316 2023-12-03T11:37:53.651 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.647+0000 7fbaf8122800 20 get_obj_state: octx=0x55a7aae99570 obj=check-bucket:_:2.cSLHlKZlPr3zyKNxb12DubaMoOLss_f state=0x55a7aaf244c8 s->prefetch_data=0 2023-12-03T11:37:53.651 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.647+0000 7fbaf8122800 20 prepare_atomic_modification: state is not atomic. state=0x55a7aaf244c8 2023-12-03T11:37:53.651 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.647+0000 7fbaf8122800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.10 2023-12-03T11:37:53.660 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.659+0000 7fbada7fc640 20 handle_completion(): completion ok for obj=d[LAConEfDqwMtU3G6LSaq9IAcIauRcEr] 2023-12-03T11:37:53.661 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.659+0000 7fbad9ffb640 20 handle_completion(): completion ok for obj=e[kOBzLqpdeUVGdEr674GJ1ujkkYIYqtn] 2023-12-03T11:37:53.662 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.661+0000 7fbaf8122800 20 get_obj_state: octx=0x55a7aae99570 obj=check-bucket:f state=0x55a7aaefd728 s->prefetch_data=0 2023-12-03T11:37:53.662 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.661+0000 7fbaf8122800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=dq0yqj5dezajboclau0g0gboq72sg73n 2023-12-03T11:37:53.662 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.661+0000 7fbaf8122800 20 get_obj_state: octx=0x7fbae407f000 obj=check-bucket:e state=0x55a7aaedab48 s->prefetch_data=0 2023-12-03T11:37:53.662 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.661+0000 7fbaf8122800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=n316sidiyg5h84gl0roz50vjtv3qqyo4 2023-12-03T11:37:53.662 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.661+0000 7fbaf8122800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.5 2023-12-03T11:37:53.663 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.661+0000 7fbaf8122800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.5 2023-12-03T11:37:53.663 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.662+0000 7fbada7fc640 20 handle_completion(): completion ok for obj=f[2.cSLHlKZlPr3zyKNxb12DubaMoOLss] 2023-12-03T11:37:53.667 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.665+0000 7fbaf8122800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.8 2023-12-03T11:37:53.667 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.665+0000 7fbaf8122800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.8 2023-12-03T11:37:53.667 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.665+0000 7fbada7fc640 20 handle_completion(): completion ok for obj=c[4BQmj04rh6kvN6-OMf8ejLg0RwWaHcn] 2023-12-03T11:37:53.667 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.666+0000 7fbaf8122800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.5 2023-12-03T11:37:53.667 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.666+0000 7fbaf8122800 1 NOTICE: finished shard 5 (1 entries removed) 2023-12-03T11:37:53.671 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.670+0000 7fbaf8122800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.8 2023-12-03T11:37:53.671 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.670+0000 7fbaf8122800 1 NOTICE: finished shard 8 (1 entries removed) 2023-12-03T11:37:53.672 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.671+0000 7fbaf8122800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.1 2023-12-03T11:37:53.675 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.674+0000 7fbaf8122800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.10 2023-12-03T11:37:53.677 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.676+0000 7fbaf8122800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.1 2023-12-03T11:37:53.677 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.676+0000 7fbaf8122800 1 NOTICE: finished shard 1 (1 entries removed) 2023-12-03T11:37:53.680 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.678+0000 7fbaf8122800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.10 2023-12-03T11:37:53.680 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.678+0000 7fbaf8122800 1 NOTICE: finished shard 10 (1 entries removed) 2023-12-03T11:37:53.680 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.678+0000 7fbaf8122800 1 NOTICE: finished all shards (4 entries removed) 2023-12-03T11:37:53.680 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.679+0000 7fbab9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:37:53.683 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.682+0000 7fbaf8122800 20 remove_watcher() i=0 2023-12-03T11:37:53.683 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.682+0000 7fbaf8122800 2 removed watcher, disabling cache 2023-12-03T11:37:53.684 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.683+0000 7fbaf8122800 20 remove_watcher() i=1 2023-12-03T11:37:53.685 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.684+0000 7fbaf8122800 20 remove_watcher() i=2 2023-12-03T11:37:53.686 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.685+0000 7fbaf8122800 20 remove_watcher() i=3 2023-12-03T11:37:53.687 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.686+0000 7fbaf8122800 20 remove_watcher() i=4 2023-12-03T11:37:53.688 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.687+0000 7fbaf8122800 20 remove_watcher() i=5 2023-12-03T11:37:53.689 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.688+0000 7fbaf8122800 20 remove_watcher() i=6 2023-12-03T11:37:53.690 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.689+0000 7fbaf8122800 20 remove_watcher() i=7 2023-12-03T11:37:53.763 INFO:tasks.workunit.client.0.smithi003.stderr:TEST: bucket check unlinked does not affect normal entries 2023-12-03T11:37:53.763 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:37:53.916 INFO:tasks.workunit.client.0.smithi003.stderr:TEST: bucket check unlinked does not find new unlistable entries after fix 2023-12-03T11:37:53.916 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:37:53.917 INFO:tasks.workunit.client.0.smithi003.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2023-12-03T11:37:53.948 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:37:53.949 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:37:53.963 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.962+0000 7f7765ac0800 20 rados->read ofs=0 len=0 2023-12-03T11:37:53.965 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.963+0000 7f7765ac0800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:53.965 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.963+0000 7f7765ac0800 20 realm 2023-12-03T11:37:53.965 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.963+0000 7f7765ac0800 20 rados->read ofs=0 len=0 2023-12-03T11:37:53.965 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.964+0000 7f7765ac0800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:53.965 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.964+0000 7f7765ac0800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:37:53.965 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.964+0000 7f7765ac0800 20 rados->read ofs=0 len=0 2023-12-03T11:37:53.965 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.964+0000 7f7765ac0800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:53.965 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.964+0000 7f7765ac0800 20 rados->read ofs=0 len=0 2023-12-03T11:37:53.966 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.965+0000 7f7765ac0800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:37:53.966 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.965+0000 7f7765ac0800 20 rados->read ofs=0 len=0 2023-12-03T11:37:53.966 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.965+0000 7f7765ac0800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:37:53.966 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.965+0000 7f7765ac0800 20 searching for the correct realm 2023-12-03T11:37:53.977 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.976+0000 7f7762dbf640 0 -- 172.21.15.3:0/380163317 >> [v2:172.21.15.3:6817/3356208405,v1:172.21.15.3:6819/3356208405] conn(0x555d92daecb0 msgr2=0x555d92db10a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:37:53.978 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.977+0000 7f7765ac0800 20 RGWRados::pool_iterate: got zone_info.83aabb46-04b5-4c96-9933-c6bfb1173a73 2023-12-03T11:37:53.978 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.977+0000 7f7765ac0800 20 RGWRados::pool_iterate: got zonegroup_info.6a811aad-435d-4fdd-93c9-b7e0b50de429 2023-12-03T11:37:53.978 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.977+0000 7f7765ac0800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:37:53.978 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.977+0000 7f7765ac0800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:37:53.978 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.977+0000 7f7765ac0800 20 rados->read ofs=0 len=0 2023-12-03T11:37:53.978 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.977+0000 7f7765ac0800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:53.979 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.977+0000 7f7765ac0800 20 rados->read ofs=0 len=0 2023-12-03T11:37:53.979 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.977+0000 7f7765ac0800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:37:53.979 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.978+0000 7f7765ac0800 20 rados->read ofs=0 len=0 2023-12-03T11:37:53.979 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.978+0000 7f7765ac0800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:37:53.980 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.978+0000 7f7765ac0800 20 zone default found 2023-12-03T11:37:53.980 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.978+0000 7f7765ac0800 4 Realm: () 2023-12-03T11:37:53.980 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.978+0000 7f7765ac0800 4 ZoneGroup: default (6a811aad-435d-4fdd-93c9-b7e0b50de429) 2023-12-03T11:37:53.980 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.978+0000 7f7765ac0800 4 Zone: default (83aabb46-04b5-4c96-9933-c6bfb1173a73) 2023-12-03T11:37:53.980 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.978+0000 7f7765ac0800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:37:53.980 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.978+0000 7f7765ac0800 20 zonegroup default 2023-12-03T11:37:53.980 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.978+0000 7f7765ac0800 20 rados->read ofs=0 len=0 2023-12-03T11:37:53.980 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.978+0000 7f7765ac0800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:53.980 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.978+0000 7f7765ac0800 20 rados->read ofs=0 len=0 2023-12-03T11:37:53.980 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.978+0000 7f7765ac0800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:53.980 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.978+0000 7f7765ac0800 20 rados->read ofs=0 len=0 2023-12-03T11:37:53.981 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.979+0000 7f7765ac0800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:53.981 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.979+0000 7f7765ac0800 20 started sync module instance, tier type = 2023-12-03T11:37:53.981 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.979+0000 7f7765ac0800 20 started zone id=83aabb46-04b5-4c96-9933-c6bfb1173a73 (name=default) with tier type = 2023-12-03T11:37:53.989 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.988+0000 7f7762dbf640 0 -- 172.21.15.3:0/380163317 >> [v2:172.21.15.3:6817/3356208405,v1:172.21.15.3:6819/3356208405] conn(0x7f773c0773d0 msgr2=0x7f773c079800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-03T11:37:53.996 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.995+0000 7f7765ac0800 20 add_watcher() i=0 2023-12-03T11:37:53.997 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.995+0000 7f7765ac0800 20 add_watcher() i=1 2023-12-03T11:37:53.997 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.995+0000 7f7765ac0800 20 add_watcher() i=2 2023-12-03T11:37:53.997 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.995+0000 7f7765ac0800 20 add_watcher() i=3 2023-12-03T11:37:53.997 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.995+0000 7f7765ac0800 20 add_watcher() i=4 2023-12-03T11:37:53.997 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.995+0000 7f7765ac0800 20 add_watcher() i=5 2023-12-03T11:37:53.997 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.995+0000 7f7765ac0800 20 add_watcher() i=6 2023-12-03T11:37:53.997 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.996+0000 7f7765ac0800 20 add_watcher() i=7 2023-12-03T11:37:53.998 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.996+0000 7f7765ac0800 2 all 8 watchers are set, enabling cache 2023-12-03T11:37:53.999 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.998+0000 7f77297e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:37:54.000 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.999+0000 7f7765ac0800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:37:54.000 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:53.999+0000 7f7765ac0800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:37:54.006 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.005+0000 7f7765ac0800 5 note: GC not initialized 2023-12-03T11:37:54.007 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.005+0000 7f7697fff640 20 reqs_thread_entry: start 2023-12-03T11:37:54.007 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.005+0000 7f7765ac0800 20 init_complete bucket index max shards: 11 2023-12-03T11:37:54.007 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.005+0000 7f7765ac0800 20 Filter name: none 2023-12-03T11:37:54.007 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.005+0000 7f7695ffb640 20 reqs_thread_entry: start 2023-12-03T11:37:54.007 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.005+0000 7f7765ac0800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2023-12-03T11:37:54.007 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.005+0000 7f7765ac0800 20 rados->read ofs=0 len=0 2023-12-03T11:37:54.008 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.006+0000 7f7765ac0800 20 rados_obj.operate() r=0 bl.length=190 2023-12-03T11:37:54.008 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.006+0000 7f7765ac0800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2023-12-03T11:37:54.008 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.006+0000 7f7765ac0800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2023-12-03T11:37:54.008 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.006+0000 7f7765ac0800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2 : miss 2023-12-03T11:37:54.008 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.006+0000 7f7765ac0800 20 rados->read ofs=0 len=0 2023-12-03T11:37:54.008 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.006+0000 7f7765ac0800 20 rados_obj.operate() r=0 bl.length=368 2023-12-03T11:37:54.008 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.006+0000 7f7765ac0800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2 info.flags=0x17 2023-12-03T11:37:54.008 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.006+0000 7f7765ac0800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2 to cache LRU end 2023-12-03T11:37:54.008 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.006+0000 7f7765ac0800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:37:54.008 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.006+0000 7f7765ac0800 10 updating xattr: name=user.rgw.acl bl.length()=179 2023-12-03T11:37:54.008 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.006+0000 7f7765ac0800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2 2023-12-03T11:37:54.008 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.006+0000 7f7765ac0800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.0 2023-12-03T11:37:54.008 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.006+0000 7f7765ac0800 1 NOTICE: finished shard 0 (0 entries found) 2023-12-03T11:37:54.009 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.006+0000 7f7765ac0800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.1 2023-12-03T11:37:54.009 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.007+0000 7f7765ac0800 1 NOTICE: finished shard 1 (0 entries found) 2023-12-03T11:37:54.009 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.007+0000 7f7765ac0800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.2 2023-12-03T11:37:54.009 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.007+0000 7f7765ac0800 1 NOTICE: finished shard 2 (0 entries found) 2023-12-03T11:37:54.010 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.007+0000 7f7765ac0800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.3 2023-12-03T11:37:54.010 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.008+0000 7f7765ac0800 1 NOTICE: finished shard 3 (0 entries found) 2023-12-03T11:37:54.010 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.008+0000 7f7765ac0800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.4 2023-12-03T11:37:54.010 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.008+0000 7f7765ac0800 1 NOTICE: finished shard 4 (0 entries found) 2023-12-03T11:37:54.010 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.008+0000 7f7765ac0800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.5 2023-12-03T11:37:54.010 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.009+0000 7f7765ac0800 1 NOTICE: finished shard 5 (0 entries found) 2023-12-03T11:37:54.010 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.009+0000 7f7765ac0800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.6 2023-12-03T11:37:54.011 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.009+0000 7f7765ac0800 1 NOTICE: finished shard 6 (0 entries found) 2023-12-03T11:37:54.011 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.009+0000 7f7765ac0800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.7 2023-12-03T11:37:54.011 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.010+0000 7f7765ac0800 1 NOTICE: finished shard 7 (0 entries found) 2023-12-03T11:37:54.011 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.010+0000 7f7765ac0800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.8 2023-12-03T11:37:54.012 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.010+0000 7f7765ac0800 1 NOTICE: finished shard 8 (0 entries found) 2023-12-03T11:37:54.012 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.010+0000 7f7765ac0800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.9 2023-12-03T11:37:54.012 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.011+0000 7f7765ac0800 1 NOTICE: finished shard 9 (0 entries found) 2023-12-03T11:37:54.012 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.011+0000 7f7765ac0800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.10 2023-12-03T11:37:54.013 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.012+0000 7f7765ac0800 1 NOTICE: finished shard 10 (0 entries found) 2023-12-03T11:37:54.013 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.012+0000 7f7765ac0800 1 NOTICE: finished all shards (0 entries found) 2023-12-03T11:37:54.013 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.012+0000 7f77297e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:37:54.016 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.015+0000 7f7765ac0800 20 remove_watcher() i=0 2023-12-03T11:37:54.016 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.015+0000 7f7765ac0800 2 removed watcher, disabling cache 2023-12-03T11:37:54.017 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.016+0000 7f7765ac0800 20 remove_watcher() i=1 2023-12-03T11:37:54.020 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.019+0000 7f7765ac0800 20 remove_watcher() i=2 2023-12-03T11:37:54.021 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.020+0000 7f7765ac0800 20 remove_watcher() i=3 2023-12-03T11:37:54.022 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.021+0000 7f7765ac0800 20 remove_watcher() i=4 2023-12-03T11:37:54.023 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.022+0000 7f7765ac0800 20 remove_watcher() i=5 2023-12-03T11:37:54.024 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.023+0000 7f7765ac0800 20 remove_watcher() i=6 2023-12-03T11:37:54.025 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.024+0000 7f7765ac0800 20 remove_watcher() i=7 2023-12-03T11:37:54.197 INFO:tasks.workunit.client.0.smithi003.stderr:radosgw-admin bi list --bucket check-bucket --object d 2023-12-03T11:37:54.227 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:37:54.227 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:37:54.242 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.240+0000 7f8fbf927800 20 rados->read ofs=0 len=0 2023-12-03T11:37:54.244 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.242+0000 7f8fbf927800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:54.244 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.242+0000 7f8fbf927800 20 realm 2023-12-03T11:37:54.244 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.242+0000 7f8fbf927800 20 rados->read ofs=0 len=0 2023-12-03T11:37:54.244 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.242+0000 7f8fbf927800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:54.244 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.242+0000 7f8fbf927800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:37:54.244 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.242+0000 7f8fbf927800 20 rados->read ofs=0 len=0 2023-12-03T11:37:54.244 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.243+0000 7f8fbf927800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:54.244 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.243+0000 7f8fbf927800 20 rados->read ofs=0 len=0 2023-12-03T11:37:54.244 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.244+0000 7f8fbf927800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:37:54.245 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.244+0000 7f8fbf927800 20 rados->read ofs=0 len=0 2023-12-03T11:37:54.245 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.244+0000 7f8fbf927800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:37:54.245 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.244+0000 7f8fbf927800 20 searching for the correct realm 2023-12-03T11:37:54.256 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.255+0000 7f8fbb5f4640 0 -- 172.21.15.3:0/3211773554 >> [v2:172.21.15.37:6805/1692844418,v1:172.21.15.37:6807/1692844418] conn(0x55f6bc4c6ad0 msgr2=0x55f6bc4c8ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:37:54.258 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.257+0000 7f8fbf927800 20 RGWRados::pool_iterate: got zone_info.83aabb46-04b5-4c96-9933-c6bfb1173a73 2023-12-03T11:37:54.258 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.257+0000 7f8fbf927800 20 RGWRados::pool_iterate: got zonegroup_info.6a811aad-435d-4fdd-93c9-b7e0b50de429 2023-12-03T11:37:54.258 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.257+0000 7f8fbf927800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:37:54.258 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.257+0000 7f8fbf927800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:37:54.258 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.257+0000 7f8fbf927800 20 rados->read ofs=0 len=0 2023-12-03T11:37:54.258 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.257+0000 7f8fbf927800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:54.258 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.257+0000 7f8fbf927800 20 rados->read ofs=0 len=0 2023-12-03T11:37:54.259 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.257+0000 7f8fbf927800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:37:54.259 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.257+0000 7f8fbf927800 20 rados->read ofs=0 len=0 2023-12-03T11:37:54.259 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.257+0000 7f8fbf927800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:37:54.259 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.257+0000 7f8fbf927800 20 zone default found 2023-12-03T11:37:54.260 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.257+0000 7f8fbf927800 4 Realm: () 2023-12-03T11:37:54.260 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.257+0000 7f8fbf927800 4 ZoneGroup: default (6a811aad-435d-4fdd-93c9-b7e0b50de429) 2023-12-03T11:37:54.260 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.257+0000 7f8fbf927800 4 Zone: default (83aabb46-04b5-4c96-9933-c6bfb1173a73) 2023-12-03T11:37:54.260 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.257+0000 7f8fbf927800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:37:54.260 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.257+0000 7f8fbf927800 20 zonegroup default 2023-12-03T11:37:54.260 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.257+0000 7f8fbf927800 20 rados->read ofs=0 len=0 2023-12-03T11:37:54.260 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.258+0000 7f8fbf927800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:54.260 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.258+0000 7f8fbf927800 20 rados->read ofs=0 len=0 2023-12-03T11:37:54.260 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.258+0000 7f8fbf927800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:54.260 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.258+0000 7f8fbf927800 20 rados->read ofs=0 len=0 2023-12-03T11:37:54.260 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.258+0000 7f8fbf927800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:54.260 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.258+0000 7f8fbf927800 20 started sync module instance, tier type = 2023-12-03T11:37:54.260 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.258+0000 7f8fbf927800 20 started zone id=83aabb46-04b5-4c96-9933-c6bfb1173a73 (name=default) with tier type = 2023-12-03T11:37:54.267 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.266+0000 7f8fbbdf5640 0 -- 172.21.15.3:0/3211773554 >> [v2:172.21.15.37:6816/3770469300,v1:172.21.15.37:6818/3770469300] conn(0x7f8fb0016400 msgr2=0x7f8fb0016880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:37:54.271 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.270+0000 7f8fbf927800 20 add_watcher() i=0 2023-12-03T11:37:54.271 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.270+0000 7f8fbf927800 20 add_watcher() i=1 2023-12-03T11:37:54.271 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.270+0000 7f8fbf927800 20 add_watcher() i=2 2023-12-03T11:37:54.271 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.270+0000 7f8fbf927800 20 add_watcher() i=3 2023-12-03T11:37:54.271 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.270+0000 7f8fbf927800 20 add_watcher() i=4 2023-12-03T11:37:54.271 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.270+0000 7f8fbf927800 20 add_watcher() i=5 2023-12-03T11:37:54.271 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.270+0000 7f8fbf927800 20 add_watcher() i=6 2023-12-03T11:37:54.272 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.271+0000 7f8fbf927800 20 add_watcher() i=7 2023-12-03T11:37:54.272 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.271+0000 7f8fbf927800 2 all 8 watchers are set, enabling cache 2023-12-03T11:37:54.273 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.272+0000 7f8f817e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:37:54.274 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.273+0000 7f8fbf927800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:37:54.274 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.273+0000 7f8fbf927800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:37:54.280 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.278+0000 7f8fbf927800 5 note: GC not initialized 2023-12-03T11:37:54.280 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.279+0000 7f8eeffff640 20 reqs_thread_entry: start 2023-12-03T11:37:54.280 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.279+0000 7f8fbf927800 20 init_complete bucket index max shards: 11 2023-12-03T11:37:54.280 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.279+0000 7f8fbf927800 20 Filter name: none 2023-12-03T11:37:54.280 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.279+0000 7f8eedffb640 20 reqs_thread_entry: start 2023-12-03T11:37:54.280 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.279+0000 7f8fbf927800 20 rados->read ofs=0 len=0 2023-12-03T11:37:54.281 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.279+0000 7f8fbf927800 20 rados_obj.operate() r=0 bl.length=190 2023-12-03T11:37:54.281 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.279+0000 7f8fbf927800 20 rados->read ofs=0 len=0 2023-12-03T11:37:54.281 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.280+0000 7f8fbf927800 20 rados_obj.operate() r=0 bl.length=368 2023-12-03T11:37:54.281 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.280+0000 7f8fbf927800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:37:54.281 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.280+0000 7f8fbf927800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2023-12-03T11:37:54.281 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.280+0000 7f8fbf927800 20 INFO: main: starting shard=0 2023-12-03T11:37:54.281 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.280+0000 7f8fbf927800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.0 2023-12-03T11:37:54.282 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.280+0000 7f8fbf927800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:37:54.282 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.280+0000 7f8fbf927800 20 INFO: main: starting shard=1 2023-12-03T11:37:54.282 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.280+0000 7f8fbf927800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.1 2023-12-03T11:37:54.282 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.281+0000 7f8fbf927800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:37:54.282 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.281+0000 7f8fbf927800 20 INFO: main: starting shard=2 2023-12-03T11:37:54.282 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.281+0000 7f8fbf927800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.2 2023-12-03T11:37:54.283 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.281+0000 7f8fbf927800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:37:54.283 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.281+0000 7f8fbf927800 20 INFO: main: starting shard=3 2023-12-03T11:37:54.283 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.281+0000 7f8fbf927800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.3 2023-12-03T11:37:54.283 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.282+0000 7f8fbf927800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:37:54.283 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.282+0000 7f8fbf927800 20 INFO: main: starting shard=4 2023-12-03T11:37:54.283 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.282+0000 7f8fbf927800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.4 2023-12-03T11:37:54.284 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.282+0000 7f8fbf927800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:37:54.284 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.282+0000 7f8fbf927800 20 INFO: main: starting shard=5 2023-12-03T11:37:54.284 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.282+0000 7f8fbf927800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.5 2023-12-03T11:37:54.284 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.283+0000 7f8fbf927800 20 INFO: main: bi_list() returned without error; entries.size()=2, is_truncated=0, marker= 2023-12-03T11:37:54.284 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.283+0000 7f8fbf927800 20 INFO: main: starting shard=6 2023-12-03T11:37:54.284 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.283+0000 7f8fbf927800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.6 2023-12-03T11:37:54.285 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.283+0000 7f8fbf927800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:37:54.285 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.283+0000 7f8fbf927800 20 INFO: main: starting shard=7 2023-12-03T11:37:54.285 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.283+0000 7f8fbf927800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.7 2023-12-03T11:37:54.285 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.284+0000 7f8fbf927800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:37:54.285 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.284+0000 7f8fbf927800 20 INFO: main: starting shard=8 2023-12-03T11:37:54.285 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.284+0000 7f8fbf927800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.8 2023-12-03T11:37:54.286 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.284+0000 7f8fbf927800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:37:54.286 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.284+0000 7f8fbf927800 20 INFO: main: starting shard=9 2023-12-03T11:37:54.286 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.284+0000 7f8fbf927800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.9 2023-12-03T11:37:54.286 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.285+0000 7f8fbf927800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:37:54.286 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.285+0000 7f8fbf927800 20 INFO: main: starting shard=10 2023-12-03T11:37:54.286 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.285+0000 7f8fbf927800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.10 2023-12-03T11:37:54.286 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.285+0000 7f8fbf927800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:37:54.287 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.285+0000 7f8fbf927800 20 INFO: main: done 2023-12-03T11:37:54.287 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.286+0000 7f8f817e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:37:54.289 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.288+0000 7f8fbf927800 20 remove_watcher() i=0 2023-12-03T11:37:54.289 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.288+0000 7f8fbf927800 2 removed watcher, disabling cache 2023-12-03T11:37:54.290 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.289+0000 7f8fbf927800 20 remove_watcher() i=1 2023-12-03T11:37:54.291 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.290+0000 7f8fbf927800 20 remove_watcher() i=2 2023-12-03T11:37:54.293 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.292+0000 7f8fbf927800 20 remove_watcher() i=3 2023-12-03T11:37:54.294 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.293+0000 7f8fbf927800 20 remove_watcher() i=4 2023-12-03T11:37:54.295 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.294+0000 7f8fbf927800 20 remove_watcher() i=5 2023-12-03T11:37:54.296 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.295+0000 7f8fbf927800 20 remove_watcher() i=6 2023-12-03T11:37:54.297 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.296+0000 7f8fbf927800 20 remove_watcher() i=7 2023-12-03T11:37:54.303 INFO:tasks.workunit.client.0.smithi003.stderr:radosgw-admin bi list --bucket check-bucket --object c 2023-12-03T11:37:54.332 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:37:54.333 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:37:54.348 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.347+0000 7f2d8d11f800 20 rados->read ofs=0 len=0 2023-12-03T11:37:54.350 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.348+0000 7f2d8d11f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:54.350 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.348+0000 7f2d8d11f800 20 realm 2023-12-03T11:37:54.350 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.348+0000 7f2d8d11f800 20 rados->read ofs=0 len=0 2023-12-03T11:37:54.350 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.349+0000 7f2d8d11f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:54.350 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.349+0000 7f2d8d11f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:37:54.350 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.349+0000 7f2d8d11f800 20 rados->read ofs=0 len=0 2023-12-03T11:37:54.350 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.349+0000 7f2d8d11f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:54.350 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.349+0000 7f2d8d11f800 20 rados->read ofs=0 len=0 2023-12-03T11:37:54.351 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.350+0000 7f2d8d11f800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:37:54.351 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.350+0000 7f2d8d11f800 20 rados->read ofs=0 len=0 2023-12-03T11:37:54.351 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.350+0000 7f2d8d11f800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:37:54.352 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.350+0000 7f2d8d11f800 20 searching for the correct realm 2023-12-03T11:37:54.360 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.359+0000 7f2d88d4d640 0 -- 172.21.15.3:0/2383867882 >> [v2:172.21.15.3:6808/263125788,v1:172.21.15.3:6809/263125788] conn(0x7f2d7c045910 msgr2=0x7f2d7c01c3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:37:54.363 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.362+0000 7f2d8d11f800 20 RGWRados::pool_iterate: got zone_info.83aabb46-04b5-4c96-9933-c6bfb1173a73 2023-12-03T11:37:54.363 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.362+0000 7f2d8d11f800 20 RGWRados::pool_iterate: got zonegroup_info.6a811aad-435d-4fdd-93c9-b7e0b50de429 2023-12-03T11:37:54.363 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.362+0000 7f2d8d11f800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:37:54.363 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.362+0000 7f2d8d11f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:37:54.364 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.362+0000 7f2d8d11f800 20 rados->read ofs=0 len=0 2023-12-03T11:37:54.364 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.362+0000 7f2d8d11f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:54.364 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.362+0000 7f2d8d11f800 20 rados->read ofs=0 len=0 2023-12-03T11:37:54.365 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.363+0000 7f2d8d11f800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:37:54.365 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.363+0000 7f2d8d11f800 20 rados->read ofs=0 len=0 2023-12-03T11:37:54.365 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.363+0000 7f2d8d11f800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:37:54.365 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.363+0000 7f2d8d11f800 20 zone default found 2023-12-03T11:37:54.365 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.363+0000 7f2d8d11f800 4 Realm: () 2023-12-03T11:37:54.365 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.363+0000 7f2d8d11f800 4 ZoneGroup: default (6a811aad-435d-4fdd-93c9-b7e0b50de429) 2023-12-03T11:37:54.366 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.363+0000 7f2d8d11f800 4 Zone: default (83aabb46-04b5-4c96-9933-c6bfb1173a73) 2023-12-03T11:37:54.366 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.363+0000 7f2d8d11f800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:37:54.366 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.363+0000 7f2d8d11f800 20 zonegroup default 2023-12-03T11:37:54.366 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.363+0000 7f2d8d11f800 20 rados->read ofs=0 len=0 2023-12-03T11:37:54.366 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.363+0000 7f2d8d11f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:54.366 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.363+0000 7f2d8d11f800 20 rados->read ofs=0 len=0 2023-12-03T11:37:54.366 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.364+0000 7f2d8d11f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:54.366 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.364+0000 7f2d8d11f800 20 rados->read ofs=0 len=0 2023-12-03T11:37:54.366 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.364+0000 7f2d8d11f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:54.366 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.364+0000 7f2d8d11f800 20 started sync module instance, tier type = 2023-12-03T11:37:54.366 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.364+0000 7f2d8d11f800 20 started zone id=83aabb46-04b5-4c96-9933-c6bfb1173a73 (name=default) with tier type = 2023-12-03T11:37:54.367 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.365+0000 7f2d88d4d640 0 -- 172.21.15.3:0/2383867882 >> [v2:172.21.15.37:6805/1692844418,v1:172.21.15.37:6807/1692844418] conn(0x55b83360bb70 msgr2=0x55b83360df60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-03T11:37:54.376 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.375+0000 7f2d8d11f800 20 add_watcher() i=0 2023-12-03T11:37:54.376 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.375+0000 7f2d8d11f800 20 add_watcher() i=1 2023-12-03T11:37:54.376 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.375+0000 7f2d8d11f800 20 add_watcher() i=2 2023-12-03T11:37:54.376 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.375+0000 7f2d8d11f800 20 add_watcher() i=3 2023-12-03T11:37:54.376 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.375+0000 7f2d8d11f800 20 add_watcher() i=4 2023-12-03T11:37:54.376 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.375+0000 7f2d8d11f800 20 add_watcher() i=5 2023-12-03T11:37:54.376 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.375+0000 7f2d8d11f800 20 add_watcher() i=6 2023-12-03T11:37:54.377 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.376+0000 7f2d8d11f800 20 add_watcher() i=7 2023-12-03T11:37:54.377 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.376+0000 7f2d8d11f800 2 all 8 watchers are set, enabling cache 2023-12-03T11:37:54.379 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.378+0000 7f2d4efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:37:54.379 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.378+0000 7f2d8d11f800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:37:54.379 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.378+0000 7f2d8d11f800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:37:54.386 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.384+0000 7f2d8d11f800 5 note: GC not initialized 2023-12-03T11:37:54.386 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.384+0000 7f2cbdffb640 20 reqs_thread_entry: start 2023-12-03T11:37:54.386 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.384+0000 7f2d8d11f800 20 init_complete bucket index max shards: 11 2023-12-03T11:37:54.386 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.384+0000 7f2d8d11f800 20 Filter name: none 2023-12-03T11:37:54.386 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.385+0000 7f2caf7fe640 20 reqs_thread_entry: start 2023-12-03T11:37:54.386 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.385+0000 7f2d8d11f800 20 rados->read ofs=0 len=0 2023-12-03T11:37:54.387 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.385+0000 7f2d8d11f800 20 rados_obj.operate() r=0 bl.length=190 2023-12-03T11:37:54.387 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.385+0000 7f2d8d11f800 20 rados->read ofs=0 len=0 2023-12-03T11:37:54.387 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.385+0000 7f2d8d11f800 20 rados_obj.operate() r=0 bl.length=368 2023-12-03T11:37:54.387 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.385+0000 7f2d8d11f800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:37:54.387 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.385+0000 7f2d8d11f800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2023-12-03T11:37:54.387 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.385+0000 7f2d8d11f800 20 INFO: main: starting shard=0 2023-12-03T11:37:54.387 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.386+0000 7f2d8d11f800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.0 2023-12-03T11:37:54.388 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.386+0000 7f2d8d11f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:37:54.388 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.386+0000 7f2d8d11f800 20 INFO: main: starting shard=1 2023-12-03T11:37:54.388 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.386+0000 7f2d8d11f800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.1 2023-12-03T11:37:54.388 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.387+0000 7f2d8d11f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:37:54.388 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.387+0000 7f2d8d11f800 20 INFO: main: starting shard=2 2023-12-03T11:37:54.388 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.387+0000 7f2d8d11f800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.2 2023-12-03T11:37:54.389 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.387+0000 7f2d8d11f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:37:54.389 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.387+0000 7f2d8d11f800 20 INFO: main: starting shard=3 2023-12-03T11:37:54.389 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.387+0000 7f2d8d11f800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.3 2023-12-03T11:37:54.389 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.388+0000 7f2d8d11f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:37:54.389 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.388+0000 7f2d8d11f800 20 INFO: main: starting shard=4 2023-12-03T11:37:54.389 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.388+0000 7f2d8d11f800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.4 2023-12-03T11:37:54.389 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.388+0000 7f2d8d11f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:37:54.389 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.388+0000 7f2d8d11f800 20 INFO: main: starting shard=5 2023-12-03T11:37:54.389 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.388+0000 7f2d8d11f800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.5 2023-12-03T11:37:54.390 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.389+0000 7f2d8d11f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:37:54.390 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.389+0000 7f2d8d11f800 20 INFO: main: starting shard=6 2023-12-03T11:37:54.390 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.389+0000 7f2d8d11f800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.6 2023-12-03T11:37:54.391 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.389+0000 7f2d8d11f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:37:54.391 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.389+0000 7f2d8d11f800 20 INFO: main: starting shard=7 2023-12-03T11:37:54.391 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.389+0000 7f2d8d11f800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.7 2023-12-03T11:37:54.391 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.390+0000 7f2d8d11f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:37:54.391 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.390+0000 7f2d8d11f800 20 INFO: main: starting shard=8 2023-12-03T11:37:54.391 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.390+0000 7f2d8d11f800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.8 2023-12-03T11:37:54.392 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.390+0000 7f2d8d11f800 20 INFO: main: bi_list() returned without error; entries.size()=2, is_truncated=0, marker= 2023-12-03T11:37:54.392 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.390+0000 7f2d8d11f800 20 INFO: main: starting shard=9 2023-12-03T11:37:54.392 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.390+0000 7f2d8d11f800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.9 2023-12-03T11:37:54.392 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.391+0000 7f2d8d11f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:37:54.392 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.391+0000 7f2d8d11f800 20 INFO: main: starting shard=10 2023-12-03T11:37:54.392 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.391+0000 7f2d8d11f800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.10 2023-12-03T11:37:54.392 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.391+0000 7f2d8d11f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:37:54.392 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.391+0000 7f2d8d11f800 20 INFO: main: done 2023-12-03T11:37:54.393 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.392+0000 7f2d4efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:37:54.395 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.394+0000 7f2d8d11f800 20 remove_watcher() i=0 2023-12-03T11:37:54.396 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.394+0000 7f2d8d11f800 2 removed watcher, disabling cache 2023-12-03T11:37:54.397 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.396+0000 7f2d8d11f800 20 remove_watcher() i=1 2023-12-03T11:37:54.398 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.397+0000 7f2d8d11f800 20 remove_watcher() i=2 2023-12-03T11:37:54.399 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.398+0000 7f2d8d11f800 20 remove_watcher() i=3 2023-12-03T11:37:54.400 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.399+0000 7f2d8d11f800 20 remove_watcher() i=4 2023-12-03T11:37:54.402 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.401+0000 7f2d8d11f800 20 remove_watcher() i=5 2023-12-03T11:37:54.403 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.402+0000 7f2d8d11f800 20 remove_watcher() i=6 2023-12-03T11:37:54.404 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.403+0000 7f2d8d11f800 20 remove_watcher() i=7 2023-12-03T11:37:54.409 INFO:tasks.workunit.client.0.smithi003.stderr:TEST: bucket check olh finds leftover OLH entries 2023-12-03T11:37:54.409 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:37:54.411 INFO:tasks.workunit.client.0.smithi003.stderr:radosgw-admin bucket check olh --bucket check-bucket --dump-keys 2023-12-03T11:37:54.443 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:37:54.443 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:37:54.457 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.456+0000 7f00c132f800 20 rados->read ofs=0 len=0 2023-12-03T11:37:54.459 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.458+0000 7f00c132f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:54.459 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.458+0000 7f00c132f800 20 realm 2023-12-03T11:37:54.459 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.458+0000 7f00c132f800 20 rados->read ofs=0 len=0 2023-12-03T11:37:54.459 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.458+0000 7f00c132f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:54.459 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.458+0000 7f00c132f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:37:54.459 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.458+0000 7f00c132f800 20 rados->read ofs=0 len=0 2023-12-03T11:37:54.460 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.458+0000 7f00c132f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:54.460 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.458+0000 7f00c132f800 20 rados->read ofs=0 len=0 2023-12-03T11:37:54.460 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.459+0000 7f00c132f800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:37:54.460 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.459+0000 7f00c132f800 20 rados->read ofs=0 len=0 2023-12-03T11:37:54.461 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.459+0000 7f00c132f800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:37:54.461 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.459+0000 7f00c132f800 20 searching for the correct realm 2023-12-03T11:37:54.470 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.469+0000 7f00bd068640 0 -- 172.21.15.3:0/2656918092 >> [v2:172.21.15.3:6800/2373485412,v1:172.21.15.3:6801/2373485412] conn(0x7f00b80223f0 msgr2=0x7f00b8022810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:37:54.472 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.470+0000 7f00c132f800 20 RGWRados::pool_iterate: got zone_info.83aabb46-04b5-4c96-9933-c6bfb1173a73 2023-12-03T11:37:54.472 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.470+0000 7f00c132f800 20 RGWRados::pool_iterate: got zonegroup_info.6a811aad-435d-4fdd-93c9-b7e0b50de429 2023-12-03T11:37:54.472 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.470+0000 7f00c132f800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:37:54.472 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.470+0000 7f00c132f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:37:54.472 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.470+0000 7f00c132f800 20 rados->read ofs=0 len=0 2023-12-03T11:37:54.473 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.470+0000 7f00c132f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:54.473 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.470+0000 7f00c132f800 20 rados->read ofs=0 len=0 2023-12-03T11:37:54.473 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.470+0000 7f00c132f800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:37:54.473 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.471+0000 7f00c132f800 20 rados->read ofs=0 len=0 2023-12-03T11:37:54.473 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.471+0000 7f00c132f800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:37:54.473 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.471+0000 7f00c132f800 20 zone default found 2023-12-03T11:37:54.473 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.471+0000 7f00c132f800 4 Realm: () 2023-12-03T11:37:54.473 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.471+0000 7f00c132f800 4 ZoneGroup: default (6a811aad-435d-4fdd-93c9-b7e0b50de429) 2023-12-03T11:37:54.473 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.471+0000 7f00c132f800 4 Zone: default (83aabb46-04b5-4c96-9933-c6bfb1173a73) 2023-12-03T11:37:54.473 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.471+0000 7f00c132f800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:37:54.473 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.471+0000 7f00c132f800 20 zonegroup default 2023-12-03T11:37:54.473 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.471+0000 7f00c132f800 20 rados->read ofs=0 len=0 2023-12-03T11:37:54.473 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.471+0000 7f00c132f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:54.473 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.471+0000 7f00c132f800 20 rados->read ofs=0 len=0 2023-12-03T11:37:54.474 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.471+0000 7f00c132f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:54.474 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.471+0000 7f00c132f800 20 rados->read ofs=0 len=0 2023-12-03T11:37:54.474 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.472+0000 7f00c132f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:54.474 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.472+0000 7f00c132f800 20 started sync module instance, tier type = 2023-12-03T11:37:54.474 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.472+0000 7f00c132f800 20 started zone id=83aabb46-04b5-4c96-9933-c6bfb1173a73 (name=default) with tier type = 2023-12-03T11:37:54.483 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.481+0000 7f00bd869640 0 -- 172.21.15.3:0/2656918092 >> [v2:172.21.15.37:6816/3770469300,v1:172.21.15.37:6818/3770469300] conn(0x7f00b40cc0e0 msgr2=0x7f00b40970d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-03T11:37:54.486 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.485+0000 7f00c132f800 20 add_watcher() i=0 2023-12-03T11:37:54.486 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.485+0000 7f00c132f800 20 add_watcher() i=1 2023-12-03T11:37:54.486 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.485+0000 7f00c132f800 20 add_watcher() i=2 2023-12-03T11:37:54.486 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.485+0000 7f00c132f800 20 add_watcher() i=3 2023-12-03T11:37:54.486 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.485+0000 7f00c132f800 20 add_watcher() i=4 2023-12-03T11:37:54.486 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.485+0000 7f00c132f800 20 add_watcher() i=5 2023-12-03T11:37:54.487 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.485+0000 7f00c132f800 20 add_watcher() i=6 2023-12-03T11:37:54.488 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.487+0000 7f00c132f800 20 add_watcher() i=7 2023-12-03T11:37:54.488 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.487+0000 7f00c132f800 2 all 8 watchers are set, enabling cache 2023-12-03T11:37:54.489 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.488+0000 7f0082fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:37:54.490 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.489+0000 7f00c132f800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:37:54.490 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.489+0000 7f00c132f800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:37:54.496 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.495+0000 7f00c132f800 5 note: GC not initialized 2023-12-03T11:37:54.496 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.495+0000 7efff1ffb640 20 reqs_thread_entry: start 2023-12-03T11:37:54.497 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.495+0000 7f00c132f800 20 init_complete bucket index max shards: 11 2023-12-03T11:37:54.497 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.495+0000 7f00c132f800 20 Filter name: none 2023-12-03T11:37:54.497 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.495+0000 7effe37fe640 20 reqs_thread_entry: start 2023-12-03T11:37:54.497 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.495+0000 7f00c132f800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2023-12-03T11:37:54.497 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.495+0000 7f00c132f800 20 rados->read ofs=0 len=0 2023-12-03T11:37:54.498 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.496+0000 7f00c132f800 20 rados_obj.operate() r=0 bl.length=190 2023-12-03T11:37:54.498 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.496+0000 7f00c132f800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2023-12-03T11:37:54.498 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.496+0000 7f00c132f800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2023-12-03T11:37:54.498 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.496+0000 7f00c132f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2 : miss 2023-12-03T11:37:54.498 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.496+0000 7f00c132f800 20 rados->read ofs=0 len=0 2023-12-03T11:37:54.498 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.496+0000 7f00c132f800 20 rados_obj.operate() r=0 bl.length=368 2023-12-03T11:37:54.498 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.496+0000 7f00c132f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2 info.flags=0x17 2023-12-03T11:37:54.498 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.496+0000 7f00c132f800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2 to cache LRU end 2023-12-03T11:37:54.498 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.496+0000 7f00c132f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:37:54.498 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.496+0000 7f00c132f800 10 updating xattr: name=user.rgw.acl bl.length()=179 2023-12-03T11:37:54.498 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.496+0000 7f00c132f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2 2023-12-03T11:37:54.499 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.496+0000 7f00c132f800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.0 2023-12-03T11:37:54.499 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.497+0000 7f00c132f800 1 NOTICE: finished shard 0 (0 entries found) 2023-12-03T11:37:54.499 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.497+0000 7f00c132f800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.1 2023-12-03T11:37:54.499 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.498+0000 7f00c132f800 1 NOTICE: finished shard 1 (0 entries found) 2023-12-03T11:37:54.499 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.498+0000 7f00c132f800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.2 2023-12-03T11:37:54.500 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.499+0000 7f00c132f800 1 NOTICE: finished shard 2 (0 entries found) 2023-12-03T11:37:54.500 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.499+0000 7f00c132f800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.3 2023-12-03T11:37:54.500 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.499+0000 7f00c132f800 1 NOTICE: finished shard 3 (0 entries found) 2023-12-03T11:37:54.500 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.499+0000 7f00c132f800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.4 2023-12-03T11:37:54.500 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.499+0000 7f00c132f800 1 NOTICE: finished shard 4 (0 entries found) 2023-12-03T11:37:54.500 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.499+0000 7f00c132f800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.5 2023-12-03T11:37:54.501 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.500+0000 7f00c132f800 1 NOTICE: finished shard 5 (1 entries found) 2023-12-03T11:37:54.501 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.500+0000 7f00c132f800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.6 2023-12-03T11:37:54.501 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.501+0000 7f00c132f800 1 NOTICE: finished shard 6 (0 entries found) 2023-12-03T11:37:54.502 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.501+0000 7f00c132f800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.7 2023-12-03T11:37:54.502 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.501+0000 7f00c132f800 1 NOTICE: finished shard 7 (0 entries found) 2023-12-03T11:37:54.502 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.501+0000 7f00c132f800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.8 2023-12-03T11:37:54.502 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.501+0000 7f00c132f800 1 NOTICE: finished shard 8 (1 entries found) 2023-12-03T11:37:54.503 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.501+0000 7f00c132f800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.9 2023-12-03T11:37:54.503 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.502+0000 7f00c132f800 1 NOTICE: finished shard 9 (0 entries found) 2023-12-03T11:37:54.503 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.502+0000 7f00c132f800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.10 2023-12-03T11:37:54.503 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.502+0000 7f00c132f800 1 NOTICE: finished shard 10 (0 entries found) 2023-12-03T11:37:54.503 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.502+0000 7f00c132f800 1 NOTICE: finished all shards (2 entries found) 2023-12-03T11:37:54.504 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.503+0000 7f0082fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:37:54.507 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.505+0000 7f00c132f800 20 remove_watcher() i=0 2023-12-03T11:37:54.507 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.505+0000 7f00c132f800 2 removed watcher, disabling cache 2023-12-03T11:37:54.508 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.507+0000 7f00c132f800 20 remove_watcher() i=1 2023-12-03T11:37:54.509 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.508+0000 7f00c132f800 20 remove_watcher() i=2 2023-12-03T11:37:54.511 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.510+0000 7f00c132f800 20 remove_watcher() i=3 2023-12-03T11:37:54.512 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.511+0000 7f00c132f800 20 remove_watcher() i=4 2023-12-03T11:37:54.513 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.512+0000 7f00c132f800 20 remove_watcher() i=5 2023-12-03T11:37:54.514 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.513+0000 7f00c132f800 20 remove_watcher() i=6 2023-12-03T11:37:54.515 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.514+0000 7f00c132f800 20 remove_watcher() i=7 2023-12-03T11:37:54.520 INFO:tasks.workunit.client.0.smithi003.stderr:TEST: bucket check olh fixes leftover OLH entries 2023-12-03T11:37:54.520 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:37:54.522 INFO:tasks.workunit.client.0.smithi003.stderr:radosgw-admin bucket check olh --bucket check-bucket --fix --rgw-olh-pending-timeout-sec 0 --dump-keys 2023-12-03T11:37:54.554 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:37:54.554 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:37:54.568 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.567+0000 7f26cc322800 20 rados->read ofs=0 len=0 2023-12-03T11:37:54.570 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.568+0000 7f26cc322800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:54.570 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.568+0000 7f26cc322800 20 realm 2023-12-03T11:37:54.570 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.568+0000 7f26cc322800 20 rados->read ofs=0 len=0 2023-12-03T11:37:54.570 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.569+0000 7f26cc322800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:54.570 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.569+0000 7f26cc322800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:37:54.570 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.569+0000 7f26cc322800 20 rados->read ofs=0 len=0 2023-12-03T11:37:54.570 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.569+0000 7f26cc322800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:54.570 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.569+0000 7f26cc322800 20 rados->read ofs=0 len=0 2023-12-03T11:37:54.571 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.570+0000 7f26cc322800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:37:54.571 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.570+0000 7f26cc322800 20 rados->read ofs=0 len=0 2023-12-03T11:37:54.571 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.570+0000 7f26cc322800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:37:54.571 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.570+0000 7f26cc322800 20 searching for the correct realm 2023-12-03T11:37:54.581 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.580+0000 7f26c807e640 0 -- 172.21.15.3:0/438614340 >> [v2:172.21.15.37:6805/1692844418,v1:172.21.15.37:6807/1692844418] conn(0x559632f63130 msgr2=0x559632f65520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:37:54.582 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.580+0000 7f26cc322800 20 RGWRados::pool_iterate: got zone_info.83aabb46-04b5-4c96-9933-c6bfb1173a73 2023-12-03T11:37:54.582 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.580+0000 7f26cc322800 20 RGWRados::pool_iterate: got zonegroup_info.6a811aad-435d-4fdd-93c9-b7e0b50de429 2023-12-03T11:37:54.582 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.580+0000 7f26cc322800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:37:54.582 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.580+0000 7f26cc322800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:37:54.582 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.580+0000 7f26cc322800 20 rados->read ofs=0 len=0 2023-12-03T11:37:54.582 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.581+0000 7f26cc322800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:54.582 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.581+0000 7f26cc322800 20 rados->read ofs=0 len=0 2023-12-03T11:37:54.583 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.581+0000 7f26cc322800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:37:54.583 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.581+0000 7f26cc322800 20 rados->read ofs=0 len=0 2023-12-03T11:37:54.584 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.581+0000 7f26cc322800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:37:54.584 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.581+0000 7f26cc322800 20 zone default found 2023-12-03T11:37:54.584 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.581+0000 7f26cc322800 4 Realm: () 2023-12-03T11:37:54.584 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.581+0000 7f26cc322800 4 ZoneGroup: default (6a811aad-435d-4fdd-93c9-b7e0b50de429) 2023-12-03T11:37:54.584 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.581+0000 7f26cc322800 4 Zone: default (83aabb46-04b5-4c96-9933-c6bfb1173a73) 2023-12-03T11:37:54.584 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.581+0000 7f26cc322800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:37:54.584 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.581+0000 7f26cc322800 20 zonegroup default 2023-12-03T11:37:54.584 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.581+0000 7f26cc322800 20 rados->read ofs=0 len=0 2023-12-03T11:37:54.584 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.581+0000 7f26cc322800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:54.584 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.582+0000 7f26cc322800 20 rados->read ofs=0 len=0 2023-12-03T11:37:54.584 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.582+0000 7f26cc322800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:54.584 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.582+0000 7f26cc322800 20 rados->read ofs=0 len=0 2023-12-03T11:37:54.584 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.582+0000 7f26cc322800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:54.584 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.582+0000 7f26cc322800 20 started sync module instance, tier type = 2023-12-03T11:37:54.585 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.582+0000 7f26cc322800 20 started zone id=83aabb46-04b5-4c96-9933-c6bfb1173a73 (name=default) with tier type = 2023-12-03T11:37:54.596 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.594+0000 7f26c787d640 0 -- 172.21.15.3:0/438614340 >> [v2:172.21.15.3:6817/3356208405,v1:172.21.15.3:6819/3356208405] conn(0x559632f680c0 msgr2=0x559632f6a4b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:37:54.597 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.595+0000 7f26cc322800 20 add_watcher() i=0 2023-12-03T11:37:54.597 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.595+0000 7f26cc322800 20 add_watcher() i=1 2023-12-03T11:37:54.597 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.595+0000 7f26cc322800 20 add_watcher() i=2 2023-12-03T11:37:54.597 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.595+0000 7f26cc322800 20 add_watcher() i=3 2023-12-03T11:37:54.597 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.595+0000 7f26cc322800 20 add_watcher() i=4 2023-12-03T11:37:54.597 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.595+0000 7f26cc322800 20 add_watcher() i=5 2023-12-03T11:37:54.600 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.599+0000 7f26cc322800 20 add_watcher() i=6 2023-12-03T11:37:54.600 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.599+0000 7f26cc322800 20 add_watcher() i=7 2023-12-03T11:37:54.600 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.599+0000 7f26cc322800 2 all 8 watchers are set, enabling cache 2023-12-03T11:37:54.602 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.601+0000 7f268e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:37:54.602 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.601+0000 7f26cc322800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:37:54.602 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.601+0000 7f26cc322800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:37:54.608 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.607+0000 7f26cc322800 5 note: GC not initialized 2023-12-03T11:37:54.608 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.607+0000 7f25fd7fa640 20 reqs_thread_entry: start 2023-12-03T11:37:54.608 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.607+0000 7f26cc322800 20 init_complete bucket index max shards: 11 2023-12-03T11:37:54.609 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.607+0000 7f26cc322800 20 Filter name: none 2023-12-03T11:37:54.609 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.607+0000 7f25f6ffd640 20 reqs_thread_entry: start 2023-12-03T11:37:54.609 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.607+0000 7f26cc322800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2023-12-03T11:37:54.609 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.607+0000 7f26cc322800 20 rados->read ofs=0 len=0 2023-12-03T11:37:54.609 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.608+0000 7f26cc322800 20 rados_obj.operate() r=0 bl.length=190 2023-12-03T11:37:54.610 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.608+0000 7f26cc322800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2023-12-03T11:37:54.610 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.608+0000 7f26cc322800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2023-12-03T11:37:54.610 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.608+0000 7f26cc322800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2 : miss 2023-12-03T11:37:54.610 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.608+0000 7f26cc322800 20 rados->read ofs=0 len=0 2023-12-03T11:37:54.610 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.608+0000 7f26cc322800 20 rados_obj.operate() r=0 bl.length=368 2023-12-03T11:37:54.610 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.608+0000 7f26cc322800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2 info.flags=0x17 2023-12-03T11:37:54.610 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.608+0000 7f26cc322800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2 to cache LRU end 2023-12-03T11:37:54.610 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.608+0000 7f26cc322800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:37:54.610 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.608+0000 7f26cc322800 10 updating xattr: name=user.rgw.acl bl.length()=179 2023-12-03T11:37:54.610 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.608+0000 7f26cc322800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2 2023-12-03T11:37:54.610 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.608+0000 7f26cc322800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.0 2023-12-03T11:37:54.610 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.608+0000 7f26cc322800 1 NOTICE: finished shard 0 (0 entries removed) 2023-12-03T11:37:54.610 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.608+0000 7f26cc322800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.1 2023-12-03T11:37:54.611 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.609+0000 7f26cc322800 1 NOTICE: finished shard 1 (0 entries removed) 2023-12-03T11:37:54.611 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.609+0000 7f26cc322800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.2 2023-12-03T11:37:54.611 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.609+0000 7f26cc322800 1 NOTICE: finished shard 2 (0 entries removed) 2023-12-03T11:37:54.611 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.609+0000 7f26cc322800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.3 2023-12-03T11:37:54.611 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.610+0000 7f26cc322800 1 NOTICE: finished shard 3 (0 entries removed) 2023-12-03T11:37:54.611 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.610+0000 7f26cc322800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.4 2023-12-03T11:37:54.612 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.610+0000 7f26cc322800 1 NOTICE: finished shard 4 (0 entries removed) 2023-12-03T11:37:54.612 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.610+0000 7f26cc322800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.5 2023-12-03T11:37:54.612 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.611+0000 7f26cc322800 20 get_obj_state: octx=0x559632d9cf90 obj=check-bucket:d state=0x559633017fd8 s->prefetch_data=0 2023-12-03T11:37:54.612 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.611+0000 7f26cc322800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.6 2023-12-03T11:37:54.612 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.611+0000 7f26cc322800 1 NOTICE: finished shard 6 (0 entries removed) 2023-12-03T11:37:54.612 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.611+0000 7f26cc322800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.7 2023-12-03T11:37:54.613 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.612+0000 7f26cc322800 1 NOTICE: finished shard 7 (0 entries removed) 2023-12-03T11:37:54.613 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.612+0000 7f26cc322800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.8 2023-12-03T11:37:54.613 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.612+0000 7f26cc322800 20 get_obj_state: octx=0x559633015e40 obj=check-bucket:c state=0x559633039958 s->prefetch_data=0 2023-12-03T11:37:54.614 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.612+0000 7f26cc322800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.9 2023-12-03T11:37:54.614 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.613+0000 7f26cc322800 1 NOTICE: finished shard 9 (0 entries removed) 2023-12-03T11:37:54.614 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.613+0000 7f26cc322800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.10 2023-12-03T11:37:54.615 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.613+0000 7f26cc322800 1 NOTICE: finished shard 10 (0 entries removed) 2023-12-03T11:37:54.615 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.613+0000 7f26cc322800 20 get_obj_state: setting s->obj_tag to 93720bokhbz6k5xrji09v8rinjzq0898 2023-12-03T11:37:54.615 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.613+0000 7f26cc322800 20 get_obj_state_impl: setting s->olh_tag to u4taor11tdv16xuv6nawa0tk3y55yh2c 2023-12-03T11:37:54.615 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.613+0000 7f26cc322800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.5 2023-12-03T11:37:54.615 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.613+0000 7f26cc322800 20 get_obj_state: setting s->obj_tag to e51361bkdagimfcjyb1bby275786zhwe 2023-12-03T11:37:54.615 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.613+0000 7f26cc322800 20 get_obj_state_impl: setting s->olh_tag to zr60zyqkfv3h2y0jzo1k4nq2fmm96bcw 2023-12-03T11:37:54.615 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.613+0000 7f26cc322800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.8 2023-12-03T11:37:54.615 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.613+0000 7f26cc322800 20 olh_log_entry: epoch=4 op=2 key=d[] 2023-12-03T11:37:54.615 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.613+0000 7f26cc322800 20 olh_log_entry: epoch=4 op=3 key=d[eIAPYUyCpTeGh7zMv5Iiwz9mRsrSWlq] 2023-12-03T11:37:54.616 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.613+0000 7f26cc322800 20 get_obj_state: octx=0x5596330149f0 obj=check-bucket:_:eIAPYUyCpTeGh7zMv5Iiwz9mRsrSWlq_d state=0x55963303fa08 s->prefetch_data=0 2023-12-03T11:37:54.616 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.613+0000 7f26cc322800 20 olh_log_entry: epoch=4 op=2 key=c[] 2023-12-03T11:37:54.616 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.613+0000 7f26cc322800 20 olh_log_entry: epoch=4 op=3 key=c[dDIdBXsZuKkNR4WJyN.NcfiyFV4L0CN] 2023-12-03T11:37:54.616 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.613+0000 7f26cc322800 20 get_obj_state: octx=0x559633038af0 obj=check-bucket:_:dDIdBXsZuKkNR4WJyN.NcfiyFV4L0CN_c state=0x5596330475c8 s->prefetch_data=0 2023-12-03T11:37:54.616 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.615+0000 7f26cc322800 20 get_obj_state: octx=0x5596330149f0 obj=check-bucket:d state=0x55963305bd58 s->prefetch_data=0 2023-12-03T11:37:54.616 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.615+0000 7f26cc322800 20 get_obj_state: octx=0x559633038af0 obj=check-bucket:c state=0x55963305acf8 s->prefetch_data=0 2023-12-03T11:37:54.617 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.616+0000 7f26cc322800 20 get_obj_state: setting s->obj_tag to 93720bokhbz6k5xrji09v8rinjzq0898 2023-12-03T11:37:54.617 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.616+0000 7f26cc322800 20 get_obj_state_impl: setting s->olh_tag to u4taor11tdv16xuv6nawa0tk3y55yh2c 2023-12-03T11:37:54.617 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.616+0000 7f26cc322800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=u4taor11tdv16xuv6nawa0tk3y55yh2c 2023-12-03T11:37:54.617 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.616+0000 7f26cc322800 20 get_obj_state: setting s->obj_tag to e51361bkdagimfcjyb1bby275786zhwe 2023-12-03T11:37:54.617 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.616+0000 7f26cc322800 20 get_obj_state_impl: setting s->olh_tag to zr60zyqkfv3h2y0jzo1k4nq2fmm96bcw 2023-12-03T11:37:54.617 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.616+0000 7f26cc322800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=zr60zyqkfv3h2y0jzo1k4nq2fmm96bcw 2023-12-03T11:37:54.628 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.627+0000 7f26cc322800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.5 2023-12-03T11:37:54.629 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.628+0000 7f26cc322800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.8 2023-12-03T11:37:54.632 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.631+0000 7f26cc322800 1 NOTICE: finished shard 5 (1 entries removed) 2023-12-03T11:37:54.632 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.631+0000 7f26cc322800 1 NOTICE: finished shard 8 (1 entries removed) 2023-12-03T11:37:54.632 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.631+0000 7f26cc322800 1 NOTICE: finished all shards (2 entries removed) 2023-12-03T11:37:54.633 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.632+0000 7f268e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:37:54.635 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.634+0000 7f26cc322800 20 remove_watcher() i=0 2023-12-03T11:37:54.635 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.634+0000 7f26cc322800 2 removed watcher, disabling cache 2023-12-03T11:37:54.636 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.635+0000 7f26cc322800 20 remove_watcher() i=1 2023-12-03T11:37:54.637 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.637+0000 7f26cc322800 20 remove_watcher() i=2 2023-12-03T11:37:54.639 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.638+0000 7f26cc322800 20 remove_watcher() i=3 2023-12-03T11:37:54.639 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.639+0000 7f26cc322800 20 remove_watcher() i=4 2023-12-03T11:37:54.641 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.640+0000 7f26cc322800 20 remove_watcher() i=5 2023-12-03T11:37:54.643 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.642+0000 7f26cc322800 20 remove_watcher() i=6 2023-12-03T11:37:54.644 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.643+0000 7f26cc322800 20 remove_watcher() i=7 2023-12-03T11:37:54.650 INFO:tasks.workunit.client.0.smithi003.stderr:radosgw-admin bi list --bucket check-bucket --object d 2023-12-03T11:37:54.680 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:37:54.680 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:37:54.694 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.693+0000 7fe4a4337800 20 rados->read ofs=0 len=0 2023-12-03T11:37:54.696 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.694+0000 7fe4a4337800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:54.696 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.694+0000 7fe4a4337800 20 realm 2023-12-03T11:37:54.696 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.694+0000 7fe4a4337800 20 rados->read ofs=0 len=0 2023-12-03T11:37:54.696 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.695+0000 7fe4a4337800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:54.696 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.695+0000 7fe4a4337800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:37:54.696 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.695+0000 7fe4a4337800 20 rados->read ofs=0 len=0 2023-12-03T11:37:54.696 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.695+0000 7fe4a4337800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:54.696 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.695+0000 7fe4a4337800 20 rados->read ofs=0 len=0 2023-12-03T11:37:54.697 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.696+0000 7fe4a4337800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:37:54.697 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.696+0000 7fe4a4337800 20 rados->read ofs=0 len=0 2023-12-03T11:37:54.697 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.696+0000 7fe4a4337800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:37:54.697 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.696+0000 7fe4a4337800 20 searching for the correct realm 2023-12-03T11:37:54.707 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.706+0000 7fe4a00cd640 0 -- 172.21.15.3:0/3436932832 >> [v2:172.21.15.37:6805/1692844418,v1:172.21.15.37:6807/1692844418] conn(0x55b04dc47e70 msgr2=0x55b04dc4a260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:37:54.708 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.707+0000 7fe4a4337800 20 RGWRados::pool_iterate: got zone_info.83aabb46-04b5-4c96-9933-c6bfb1173a73 2023-12-03T11:37:54.709 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.707+0000 7fe4a4337800 20 RGWRados::pool_iterate: got zonegroup_info.6a811aad-435d-4fdd-93c9-b7e0b50de429 2023-12-03T11:37:54.709 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.707+0000 7fe4a4337800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:37:54.709 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.707+0000 7fe4a4337800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:37:54.709 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.707+0000 7fe4a4337800 20 rados->read ofs=0 len=0 2023-12-03T11:37:54.709 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.707+0000 7fe4a4337800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:54.709 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.707+0000 7fe4a4337800 20 rados->read ofs=0 len=0 2023-12-03T11:37:54.710 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.708+0000 7fe4a4337800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:37:54.710 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.708+0000 7fe4a4337800 20 rados->read ofs=0 len=0 2023-12-03T11:37:54.710 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.708+0000 7fe4a4337800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:37:54.710 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.708+0000 7fe4a4337800 20 zone default found 2023-12-03T11:37:54.710 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.708+0000 7fe4a4337800 4 Realm: () 2023-12-03T11:37:54.711 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.708+0000 7fe4a4337800 4 ZoneGroup: default (6a811aad-435d-4fdd-93c9-b7e0b50de429) 2023-12-03T11:37:54.711 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.708+0000 7fe4a4337800 4 Zone: default (83aabb46-04b5-4c96-9933-c6bfb1173a73) 2023-12-03T11:37:54.711 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.708+0000 7fe4a4337800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:37:54.711 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.708+0000 7fe4a4337800 20 zonegroup default 2023-12-03T11:37:54.711 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.708+0000 7fe4a4337800 20 rados->read ofs=0 len=0 2023-12-03T11:37:54.711 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.708+0000 7fe4a4337800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:54.711 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.708+0000 7fe4a4337800 20 rados->read ofs=0 len=0 2023-12-03T11:37:54.711 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.709+0000 7fe4a4337800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:54.711 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.709+0000 7fe4a4337800 20 rados->read ofs=0 len=0 2023-12-03T11:37:54.711 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.709+0000 7fe4a4337800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:54.711 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.709+0000 7fe4a4337800 20 started sync module instance, tier type = 2023-12-03T11:37:54.711 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.709+0000 7fe4a4337800 20 started zone id=83aabb46-04b5-4c96-9933-c6bfb1173a73 (name=default) with tier type = 2023-12-03T11:37:54.717 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.715+0000 7fe4a08ce640 0 -- 172.21.15.3:0/3436932832 >> [v2:172.21.15.37:6816/3770469300,v1:172.21.15.37:6818/3770469300] conn(0x7fe494060570 msgr2=0x7fe494057030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:37:54.725 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.723+0000 7fe4a4337800 20 add_watcher() i=0 2023-12-03T11:37:54.725 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.723+0000 7fe4a4337800 20 add_watcher() i=1 2023-12-03T11:37:54.725 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.723+0000 7fe4a4337800 20 add_watcher() i=2 2023-12-03T11:37:54.725 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.723+0000 7fe4a4337800 20 add_watcher() i=3 2023-12-03T11:37:54.725 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.724+0000 7fe4a4337800 20 add_watcher() i=4 2023-12-03T11:37:54.725 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.724+0000 7fe4a4337800 20 add_watcher() i=5 2023-12-03T11:37:54.725 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.724+0000 7fe4a4337800 20 add_watcher() i=6 2023-12-03T11:37:54.728 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.727+0000 7fe4a4337800 20 add_watcher() i=7 2023-12-03T11:37:54.728 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.727+0000 7fe4a4337800 2 all 8 watchers are set, enabling cache 2023-12-03T11:37:54.730 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.729+0000 7fe4667e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:37:54.730 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.729+0000 7fe4a4337800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:37:54.730 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.729+0000 7fe4a4337800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:37:54.736 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.735+0000 7fe4a4337800 5 note: GC not initialized 2023-12-03T11:37:54.737 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.735+0000 7fe3d57fa640 20 reqs_thread_entry: start 2023-12-03T11:37:54.737 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.735+0000 7fe4a4337800 20 init_complete bucket index max shards: 11 2023-12-03T11:37:54.737 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.735+0000 7fe4a4337800 20 Filter name: none 2023-12-03T11:37:54.737 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.735+0000 7fe3ceffd640 20 reqs_thread_entry: start 2023-12-03T11:37:54.737 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.736+0000 7fe4a4337800 20 rados->read ofs=0 len=0 2023-12-03T11:37:54.737 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.736+0000 7fe4a4337800 20 rados_obj.operate() r=0 bl.length=190 2023-12-03T11:37:54.738 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.736+0000 7fe4a4337800 20 rados->read ofs=0 len=0 2023-12-03T11:37:54.738 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.736+0000 7fe4a4337800 20 rados_obj.operate() r=0 bl.length=368 2023-12-03T11:37:54.738 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.736+0000 7fe4a4337800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:37:54.738 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.736+0000 7fe4a4337800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2023-12-03T11:37:54.738 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.736+0000 7fe4a4337800 20 INFO: main: starting shard=0 2023-12-03T11:37:54.738 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.736+0000 7fe4a4337800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.0 2023-12-03T11:37:54.739 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.737+0000 7fe4a4337800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:37:54.739 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.737+0000 7fe4a4337800 20 INFO: main: starting shard=1 2023-12-03T11:37:54.739 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.737+0000 7fe4a4337800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.1 2023-12-03T11:37:54.739 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.737+0000 7fe4a4337800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:37:54.739 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.737+0000 7fe4a4337800 20 INFO: main: starting shard=2 2023-12-03T11:37:54.739 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.737+0000 7fe4a4337800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.2 2023-12-03T11:37:54.740 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.738+0000 7fe4a4337800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:37:54.740 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.738+0000 7fe4a4337800 20 INFO: main: starting shard=3 2023-12-03T11:37:54.740 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.738+0000 7fe4a4337800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.3 2023-12-03T11:37:54.740 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.739+0000 7fe4a4337800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:37:54.740 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.739+0000 7fe4a4337800 20 INFO: main: starting shard=4 2023-12-03T11:37:54.740 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.739+0000 7fe4a4337800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.4 2023-12-03T11:37:54.740 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.739+0000 7fe4a4337800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:37:54.741 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.739+0000 7fe4a4337800 20 INFO: main: starting shard=5 2023-12-03T11:37:54.741 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.739+0000 7fe4a4337800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.5 2023-12-03T11:37:54.741 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.739+0000 7fe4a4337800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:37:54.741 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.739+0000 7fe4a4337800 20 INFO: main: starting shard=6 2023-12-03T11:37:54.741 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.739+0000 7fe4a4337800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.6 2023-12-03T11:37:54.741 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.740+0000 7fe4a4337800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:37:54.741 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.740+0000 7fe4a4337800 20 INFO: main: starting shard=7 2023-12-03T11:37:54.741 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.740+0000 7fe4a4337800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.7 2023-12-03T11:37:54.742 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.740+0000 7fe4a4337800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:37:54.742 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.740+0000 7fe4a4337800 20 INFO: main: starting shard=8 2023-12-03T11:37:54.742 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.740+0000 7fe4a4337800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.8 2023-12-03T11:37:54.742 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.741+0000 7fe4a4337800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:37:54.742 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.741+0000 7fe4a4337800 20 INFO: main: starting shard=9 2023-12-03T11:37:54.743 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.741+0000 7fe4a4337800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.9 2023-12-03T11:37:54.743 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.741+0000 7fe4a4337800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:37:54.743 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.741+0000 7fe4a4337800 20 INFO: main: starting shard=10 2023-12-03T11:37:54.743 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.741+0000 7fe4a4337800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.10 2023-12-03T11:37:54.743 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.742+0000 7fe4a4337800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:37:54.743 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.742+0000 7fe4a4337800 20 INFO: main: done 2023-12-03T11:37:54.744 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.743+0000 7fe4667e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:37:54.746 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.745+0000 7fe4a4337800 20 remove_watcher() i=0 2023-12-03T11:37:54.746 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.745+0000 7fe4a4337800 2 removed watcher, disabling cache 2023-12-03T11:37:54.747 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.746+0000 7fe4a4337800 20 remove_watcher() i=1 2023-12-03T11:37:54.748 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.747+0000 7fe4a4337800 20 remove_watcher() i=2 2023-12-03T11:37:54.750 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.749+0000 7fe4a4337800 20 remove_watcher() i=3 2023-12-03T11:37:54.751 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.750+0000 7fe4a4337800 20 remove_watcher() i=4 2023-12-03T11:37:54.752 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.751+0000 7fe4a4337800 20 remove_watcher() i=5 2023-12-03T11:37:54.753 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.752+0000 7fe4a4337800 20 remove_watcher() i=6 2023-12-03T11:37:54.754 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.753+0000 7fe4a4337800 20 remove_watcher() i=7 2023-12-03T11:37:54.760 INFO:tasks.workunit.client.0.smithi003.stderr:radosgw-admin bi list --bucket check-bucket --object c 2023-12-03T11:37:54.790 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:37:54.790 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:37:54.805 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.804+0000 7fc9b313a800 20 rados->read ofs=0 len=0 2023-12-03T11:37:54.807 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.806+0000 7fc9b313a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:54.807 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.806+0000 7fc9b313a800 20 realm 2023-12-03T11:37:54.807 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.806+0000 7fc9b313a800 20 rados->read ofs=0 len=0 2023-12-03T11:37:54.807 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.806+0000 7fc9b313a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:54.807 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.806+0000 7fc9b313a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:37:54.807 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.806+0000 7fc9b313a800 20 rados->read ofs=0 len=0 2023-12-03T11:37:54.807 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.806+0000 7fc9b313a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:54.807 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.806+0000 7fc9b313a800 20 rados->read ofs=0 len=0 2023-12-03T11:37:54.808 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.807+0000 7fc9b313a800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:37:54.808 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.807+0000 7fc9b313a800 20 rados->read ofs=0 len=0 2023-12-03T11:37:54.808 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.807+0000 7fc9b313a800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:37:54.808 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.807+0000 7fc9b313a800 20 searching for the correct realm 2023-12-03T11:37:54.817 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.816+0000 7fc9aee06640 0 -- 172.21.15.3:0/1476916939 >> [v2:172.21.15.37:6805/1692844418,v1:172.21.15.37:6807/1692844418] conn(0x563114386310 msgr2=0x563114388700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-03T11:37:54.819 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.818+0000 7fc9b313a800 20 RGWRados::pool_iterate: got zone_info.83aabb46-04b5-4c96-9933-c6bfb1173a73 2023-12-03T11:37:54.819 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.818+0000 7fc9b313a800 20 RGWRados::pool_iterate: got zonegroup_info.6a811aad-435d-4fdd-93c9-b7e0b50de429 2023-12-03T11:37:54.819 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.818+0000 7fc9b313a800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:37:54.819 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.818+0000 7fc9b313a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:37:54.819 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.818+0000 7fc9b313a800 20 rados->read ofs=0 len=0 2023-12-03T11:37:54.820 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.818+0000 7fc9b313a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:54.820 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.818+0000 7fc9b313a800 20 rados->read ofs=0 len=0 2023-12-03T11:37:54.821 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.818+0000 7fc9b313a800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:37:54.821 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.818+0000 7fc9b313a800 20 rados->read ofs=0 len=0 2023-12-03T11:37:54.821 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.819+0000 7fc9b313a800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:37:54.821 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.819+0000 7fc9b313a800 20 zone default found 2023-12-03T11:37:54.821 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.819+0000 7fc9b313a800 4 Realm: () 2023-12-03T11:37:54.821 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.819+0000 7fc9b313a800 4 ZoneGroup: default (6a811aad-435d-4fdd-93c9-b7e0b50de429) 2023-12-03T11:37:54.821 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.819+0000 7fc9b313a800 4 Zone: default (83aabb46-04b5-4c96-9933-c6bfb1173a73) 2023-12-03T11:37:54.821 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.819+0000 7fc9b313a800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:37:54.821 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.819+0000 7fc9b313a800 20 zonegroup default 2023-12-03T11:37:54.821 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.819+0000 7fc9b313a800 20 rados->read ofs=0 len=0 2023-12-03T11:37:54.821 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.819+0000 7fc9b313a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:54.821 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.819+0000 7fc9b313a800 20 rados->read ofs=0 len=0 2023-12-03T11:37:54.821 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.819+0000 7fc9b313a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:54.821 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.819+0000 7fc9b313a800 20 rados->read ofs=0 len=0 2023-12-03T11:37:54.821 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.820+0000 7fc9b313a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:54.822 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.820+0000 7fc9b313a800 20 started sync module instance, tier type = 2023-12-03T11:37:54.822 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.820+0000 7fc9b313a800 20 started zone id=83aabb46-04b5-4c96-9933-c6bfb1173a73 (name=default) with tier type = 2023-12-03T11:37:54.829 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.828+0000 7fc9ae605640 0 -- 172.21.15.3:0/1476916939 >> [v2:172.21.15.3:6817/3356208405,v1:172.21.15.3:6819/3356208405] conn(0x56311438b320 msgr2=0x56311438d710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-03T11:37:54.834 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.833+0000 7fc9b313a800 20 add_watcher() i=0 2023-12-03T11:37:54.834 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.833+0000 7fc9b313a800 20 add_watcher() i=1 2023-12-03T11:37:54.834 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.833+0000 7fc9b313a800 20 add_watcher() i=2 2023-12-03T11:37:54.835 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.833+0000 7fc9b313a800 20 add_watcher() i=3 2023-12-03T11:37:54.835 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.833+0000 7fc9b313a800 20 add_watcher() i=4 2023-12-03T11:37:54.835 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.833+0000 7fc9b313a800 20 add_watcher() i=5 2023-12-03T11:37:54.835 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.833+0000 7fc9b313a800 20 add_watcher() i=6 2023-12-03T11:37:54.835 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.834+0000 7fc9b313a800 20 add_watcher() i=7 2023-12-03T11:37:54.835 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.834+0000 7fc9b313a800 2 all 8 watchers are set, enabling cache 2023-12-03T11:37:54.837 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.836+0000 7fc8effff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:37:54.837 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.836+0000 7fc9b313a800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:37:54.837 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.836+0000 7fc9b313a800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:37:54.844 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.842+0000 7fc9b313a800 5 note: GC not initialized 2023-12-03T11:37:54.844 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.843+0000 7fc8deffd640 20 reqs_thread_entry: start 2023-12-03T11:37:54.844 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.843+0000 7fc9b313a800 20 init_complete bucket index max shards: 11 2023-12-03T11:37:54.844 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.843+0000 7fc9b313a800 20 Filter name: none 2023-12-03T11:37:54.844 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.843+0000 7fc8dcff9640 20 reqs_thread_entry: start 2023-12-03T11:37:54.844 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.843+0000 7fc9b313a800 20 rados->read ofs=0 len=0 2023-12-03T11:37:54.845 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.843+0000 7fc9b313a800 20 rados_obj.operate() r=0 bl.length=190 2023-12-03T11:37:54.845 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.843+0000 7fc9b313a800 20 rados->read ofs=0 len=0 2023-12-03T11:37:54.845 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.844+0000 7fc9b313a800 20 rados_obj.operate() r=0 bl.length=368 2023-12-03T11:37:54.846 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.844+0000 7fc9b313a800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:37:54.846 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.844+0000 7fc9b313a800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2023-12-03T11:37:54.846 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.844+0000 7fc9b313a800 20 INFO: main: starting shard=0 2023-12-03T11:37:54.846 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.844+0000 7fc9b313a800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.0 2023-12-03T11:37:54.846 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.844+0000 7fc9b313a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:37:54.846 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.844+0000 7fc9b313a800 20 INFO: main: starting shard=1 2023-12-03T11:37:54.846 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.844+0000 7fc9b313a800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.1 2023-12-03T11:37:54.847 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.845+0000 7fc9b313a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:37:54.847 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.845+0000 7fc9b313a800 20 INFO: main: starting shard=2 2023-12-03T11:37:54.847 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.845+0000 7fc9b313a800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.2 2023-12-03T11:37:54.847 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.845+0000 7fc9b313a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:37:54.847 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.845+0000 7fc9b313a800 20 INFO: main: starting shard=3 2023-12-03T11:37:54.847 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.845+0000 7fc9b313a800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.3 2023-12-03T11:37:54.847 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.846+0000 7fc9b313a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:37:54.847 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.846+0000 7fc9b313a800 20 INFO: main: starting shard=4 2023-12-03T11:37:54.847 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.846+0000 7fc9b313a800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.4 2023-12-03T11:37:54.848 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.846+0000 7fc9b313a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:37:54.848 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.846+0000 7fc9b313a800 20 INFO: main: starting shard=5 2023-12-03T11:37:54.848 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.846+0000 7fc9b313a800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.5 2023-12-03T11:37:54.848 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.846+0000 7fc9b313a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:37:54.848 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.846+0000 7fc9b313a800 20 INFO: main: starting shard=6 2023-12-03T11:37:54.848 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.846+0000 7fc9b313a800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.6 2023-12-03T11:37:54.848 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.847+0000 7fc9b313a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:37:54.848 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.847+0000 7fc9b313a800 20 INFO: main: starting shard=7 2023-12-03T11:37:54.849 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.847+0000 7fc9b313a800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.7 2023-12-03T11:37:54.849 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.847+0000 7fc9b313a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:37:54.849 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.847+0000 7fc9b313a800 20 INFO: main: starting shard=8 2023-12-03T11:37:54.849 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.847+0000 7fc9b313a800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.8 2023-12-03T11:37:54.850 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.848+0000 7fc9b313a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:37:54.850 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.848+0000 7fc9b313a800 20 INFO: main: starting shard=9 2023-12-03T11:37:54.850 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.848+0000 7fc9b313a800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.9 2023-12-03T11:37:54.850 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.848+0000 7fc9b313a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:37:54.850 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.848+0000 7fc9b313a800 20 INFO: main: starting shard=10 2023-12-03T11:37:54.850 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.848+0000 7fc9b313a800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.10 2023-12-03T11:37:54.850 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.849+0000 7fc9b313a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:37:54.850 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.849+0000 7fc9b313a800 20 INFO: main: done 2023-12-03T11:37:54.850 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.849+0000 7fc8effff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:37:54.852 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.851+0000 7fc9b313a800 20 remove_watcher() i=0 2023-12-03T11:37:54.853 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.851+0000 7fc9b313a800 2 removed watcher, disabling cache 2023-12-03T11:37:54.854 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.853+0000 7fc9b313a800 20 remove_watcher() i=1 2023-12-03T11:37:54.855 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.854+0000 7fc9b313a800 20 remove_watcher() i=2 2023-12-03T11:37:54.857 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.856+0000 7fc9b313a800 20 remove_watcher() i=3 2023-12-03T11:37:54.858 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.857+0000 7fc9b313a800 20 remove_watcher() i=4 2023-12-03T11:37:54.860 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.858+0000 7fc9b313a800 20 remove_watcher() i=5 2023-12-03T11:37:54.861 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.860+0000 7fc9b313a800 20 remove_watcher() i=6 2023-12-03T11:37:54.862 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.861+0000 7fc9b313a800 20 remove_watcher() i=7 2023-12-03T11:37:54.867 INFO:tasks.workunit.client.0.smithi003.stderr:TEST: bucket check olh does not find new leftover OLH entries after fix 2023-12-03T11:37:54.867 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:37:54.868 INFO:tasks.workunit.client.0.smithi003.stderr:radosgw-admin bucket check olh --bucket check-bucket --dump-keys 2023-12-03T11:37:54.898 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:37:54.898 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:37:54.912 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.911+0000 7fd1a7d26800 20 rados->read ofs=0 len=0 2023-12-03T11:37:54.914 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.913+0000 7fd1a7d26800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:54.914 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.913+0000 7fd1a7d26800 20 realm 2023-12-03T11:37:54.914 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.913+0000 7fd1a7d26800 20 rados->read ofs=0 len=0 2023-12-03T11:37:54.914 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.913+0000 7fd1a7d26800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:54.915 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.913+0000 7fd1a7d26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:37:54.915 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.913+0000 7fd1a7d26800 20 rados->read ofs=0 len=0 2023-12-03T11:37:54.915 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.913+0000 7fd1a7d26800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:54.915 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.913+0000 7fd1a7d26800 20 rados->read ofs=0 len=0 2023-12-03T11:37:54.915 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.914+0000 7fd1a7d26800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:37:54.915 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.914+0000 7fd1a7d26800 20 rados->read ofs=0 len=0 2023-12-03T11:37:54.916 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.914+0000 7fd1a7d26800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:37:54.916 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.914+0000 7fd1a7d26800 20 searching for the correct realm 2023-12-03T11:37:54.925 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.924+0000 7fd1a39d0640 0 -- 172.21.15.3:0/383551865 >> [v2:172.21.15.37:6805/1692844418,v1:172.21.15.37:6807/1692844418] conn(0x5574b58ed100 msgr2=0x5574b58ef4f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:37:54.927 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.925+0000 7fd1a7d26800 20 RGWRados::pool_iterate: got zone_info.83aabb46-04b5-4c96-9933-c6bfb1173a73 2023-12-03T11:37:54.927 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.925+0000 7fd1a7d26800 20 RGWRados::pool_iterate: got zonegroup_info.6a811aad-435d-4fdd-93c9-b7e0b50de429 2023-12-03T11:37:54.928 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.925+0000 7fd1a7d26800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:37:54.928 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.925+0000 7fd1a7d26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:37:54.928 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.925+0000 7fd1a7d26800 20 rados->read ofs=0 len=0 2023-12-03T11:37:54.928 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.925+0000 7fd1a7d26800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:54.928 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.925+0000 7fd1a7d26800 20 rados->read ofs=0 len=0 2023-12-03T11:37:54.928 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.926+0000 7fd1a7d26800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:37:54.928 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.926+0000 7fd1a7d26800 20 rados->read ofs=0 len=0 2023-12-03T11:37:54.929 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.926+0000 7fd1a7d26800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:37:54.929 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.926+0000 7fd1a7d26800 20 zone default found 2023-12-03T11:37:54.929 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.926+0000 7fd1a7d26800 4 Realm: () 2023-12-03T11:37:54.929 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.926+0000 7fd1a7d26800 4 ZoneGroup: default (6a811aad-435d-4fdd-93c9-b7e0b50de429) 2023-12-03T11:37:54.929 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.926+0000 7fd1a7d26800 4 Zone: default (83aabb46-04b5-4c96-9933-c6bfb1173a73) 2023-12-03T11:37:54.929 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.926+0000 7fd1a7d26800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:37:54.929 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.926+0000 7fd1a7d26800 20 zonegroup default 2023-12-03T11:37:54.929 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.926+0000 7fd1a7d26800 20 rados->read ofs=0 len=0 2023-12-03T11:37:54.930 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.926+0000 7fd1a7d26800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:54.930 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.926+0000 7fd1a7d26800 20 rados->read ofs=0 len=0 2023-12-03T11:37:54.930 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.927+0000 7fd1a7d26800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:54.930 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.927+0000 7fd1a7d26800 20 rados->read ofs=0 len=0 2023-12-03T11:37:54.930 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.927+0000 7fd1a7d26800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:54.930 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.927+0000 7fd1a7d26800 20 started sync module instance, tier type = 2023-12-03T11:37:54.930 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.927+0000 7fd1a7d26800 20 started zone id=83aabb46-04b5-4c96-9933-c6bfb1173a73 (name=default) with tier type = 2023-12-03T11:37:54.935 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.934+0000 7fd1a31cf640 0 -- 172.21.15.3:0/383551865 >> [v2:172.21.15.3:6817/3356208405,v1:172.21.15.3:6819/3356208405] conn(0x5574b58f20c0 msgr2=0x5574b58f44b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:37:54.940 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.939+0000 7fd1a7d26800 20 add_watcher() i=0 2023-12-03T11:37:54.940 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.939+0000 7fd1a7d26800 20 add_watcher() i=1 2023-12-03T11:37:54.940 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.939+0000 7fd1a7d26800 20 add_watcher() i=2 2023-12-03T11:37:54.940 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.939+0000 7fd1a7d26800 20 add_watcher() i=3 2023-12-03T11:37:54.940 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.939+0000 7fd1a7d26800 20 add_watcher() i=4 2023-12-03T11:37:54.940 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.939+0000 7fd1a7d26800 20 add_watcher() i=5 2023-12-03T11:37:54.940 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.939+0000 7fd1a7d26800 20 add_watcher() i=6 2023-12-03T11:37:54.941 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.940+0000 7fd1a7d26800 20 add_watcher() i=7 2023-12-03T11:37:54.941 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.940+0000 7fd1a7d26800 2 all 8 watchers are set, enabling cache 2023-12-03T11:37:54.942 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.941+0000 7fd169fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:37:54.943 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.942+0000 7fd1a7d26800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:37:54.943 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.942+0000 7fd1a7d26800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:37:54.949 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.948+0000 7fd1a7d26800 5 note: GC not initialized 2023-12-03T11:37:54.950 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.948+0000 7fd0e0ff9640 20 reqs_thread_entry: start 2023-12-03T11:37:54.950 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.948+0000 7fd1a7d26800 20 init_complete bucket index max shards: 11 2023-12-03T11:37:54.950 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.948+0000 7fd1a7d26800 20 Filter name: none 2023-12-03T11:37:54.950 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.948+0000 7fd0d67fc640 20 reqs_thread_entry: start 2023-12-03T11:37:54.950 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.948+0000 7fd1a7d26800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2023-12-03T11:37:54.950 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.948+0000 7fd1a7d26800 20 rados->read ofs=0 len=0 2023-12-03T11:37:54.951 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.949+0000 7fd1a7d26800 20 rados_obj.operate() r=0 bl.length=190 2023-12-03T11:37:54.951 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.949+0000 7fd1a7d26800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2023-12-03T11:37:54.951 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.949+0000 7fd1a7d26800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2023-12-03T11:37:54.951 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.949+0000 7fd1a7d26800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2 : miss 2023-12-03T11:37:54.951 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.949+0000 7fd1a7d26800 20 rados->read ofs=0 len=0 2023-12-03T11:37:54.951 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.949+0000 7fd1a7d26800 20 rados_obj.operate() r=0 bl.length=368 2023-12-03T11:37:54.951 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.949+0000 7fd1a7d26800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2 info.flags=0x17 2023-12-03T11:37:54.951 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.949+0000 7fd1a7d26800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2 to cache LRU end 2023-12-03T11:37:54.951 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.949+0000 7fd1a7d26800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:37:54.951 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.949+0000 7fd1a7d26800 10 updating xattr: name=user.rgw.acl bl.length()=179 2023-12-03T11:37:54.951 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.949+0000 7fd1a7d26800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2 2023-12-03T11:37:54.952 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.949+0000 7fd1a7d26800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.0 2023-12-03T11:37:54.952 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.950+0000 7fd1a7d26800 1 NOTICE: finished shard 0 (0 entries found) 2023-12-03T11:37:54.952 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.950+0000 7fd1a7d26800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.1 2023-12-03T11:37:54.952 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.950+0000 7fd1a7d26800 1 NOTICE: finished shard 1 (0 entries found) 2023-12-03T11:37:54.952 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.950+0000 7fd1a7d26800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.2 2023-12-03T11:37:54.952 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.951+0000 7fd1a7d26800 1 NOTICE: finished shard 2 (0 entries found) 2023-12-03T11:37:54.952 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.951+0000 7fd1a7d26800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.3 2023-12-03T11:37:54.952 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.951+0000 7fd1a7d26800 1 NOTICE: finished shard 3 (0 entries found) 2023-12-03T11:37:54.952 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.951+0000 7fd1a7d26800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.4 2023-12-03T11:37:54.953 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.952+0000 7fd1a7d26800 1 NOTICE: finished shard 4 (0 entries found) 2023-12-03T11:37:54.953 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.952+0000 7fd1a7d26800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.5 2023-12-03T11:37:54.953 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.952+0000 7fd1a7d26800 1 NOTICE: finished shard 5 (0 entries found) 2023-12-03T11:37:54.953 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.952+0000 7fd1a7d26800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.6 2023-12-03T11:37:54.953 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.952+0000 7fd1a7d26800 1 NOTICE: finished shard 6 (0 entries found) 2023-12-03T11:37:54.954 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.952+0000 7fd1a7d26800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.7 2023-12-03T11:37:54.954 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.953+0000 7fd1a7d26800 1 NOTICE: finished shard 7 (0 entries found) 2023-12-03T11:37:54.954 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.953+0000 7fd1a7d26800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.8 2023-12-03T11:37:54.954 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.953+0000 7fd1a7d26800 1 NOTICE: finished shard 8 (0 entries found) 2023-12-03T11:37:54.955 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.953+0000 7fd1a7d26800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.9 2023-12-03T11:37:54.955 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.954+0000 7fd1a7d26800 1 NOTICE: finished shard 9 (0 entries found) 2023-12-03T11:37:54.955 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.954+0000 7fd1a7d26800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.10 2023-12-03T11:37:54.955 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.954+0000 7fd1a7d26800 1 NOTICE: finished shard 10 (0 entries found) 2023-12-03T11:37:54.955 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.954+0000 7fd1a7d26800 1 NOTICE: finished all shards (0 entries found) 2023-12-03T11:37:54.956 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.955+0000 7fd169fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:37:54.958 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.957+0000 7fd1a7d26800 20 remove_watcher() i=0 2023-12-03T11:37:54.958 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.957+0000 7fd1a7d26800 2 removed watcher, disabling cache 2023-12-03T11:37:54.959 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.958+0000 7fd1a7d26800 20 remove_watcher() i=1 2023-12-03T11:37:54.960 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.959+0000 7fd1a7d26800 20 remove_watcher() i=2 2023-12-03T11:37:54.961 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.960+0000 7fd1a7d26800 20 remove_watcher() i=3 2023-12-03T11:37:54.962 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.961+0000 7fd1a7d26800 20 remove_watcher() i=4 2023-12-03T11:37:54.965 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.962+0000 7fd1a7d26800 20 remove_watcher() i=5 2023-12-03T11:37:54.966 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.963+0000 7fd1a7d26800 20 remove_watcher() i=6 2023-12-03T11:37:54.966 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:54.964+0000 7fd1a7d26800 20 remove_watcher() i=7 2023-12-03T11:37:54.970 INFO:tasks.workunit.client.0.smithi003.stderr:TEST: verify that bucket check fixes do not affect null version objects 2023-12-03T11:37:54.970 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:37:55.083 INFO:tasks.workunit.client.0.smithi003.stderr:TEST: bucket check stats are correct in the presence of unlinked entries 2023-12-03T11:37:55.084 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:37:55.812 INFO:tasks.workunit.client.0.smithi003.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2023-12-03T11:37:56.202 INFO:tasks.workunit.client.0.smithi003.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2023-12-03T11:37:57.685 INFO:tasks.workunit.client.0.smithi003.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2023-12-03T11:37:57.687 INFO:tasks.workunit.client.0.smithi003.stderr:radosgw-admin bi list --bucket check-bucket --object c 2023-12-03T11:37:57.720 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:37:57.720 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:37:57.736 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:57.735+0000 7f124cd40800 20 rados->read ofs=0 len=0 2023-12-03T11:37:57.738 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:57.736+0000 7f124cd40800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:57.738 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:57.736+0000 7f124cd40800 20 realm 2023-12-03T11:37:57.738 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:57.736+0000 7f124cd40800 20 rados->read ofs=0 len=0 2023-12-03T11:37:57.738 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:57.737+0000 7f124cd40800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:57.738 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:57.737+0000 7f124cd40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:37:57.738 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:57.737+0000 7f124cd40800 20 rados->read ofs=0 len=0 2023-12-03T11:37:57.738 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:57.737+0000 7f124cd40800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:57.738 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:57.737+0000 7f124cd40800 20 rados->read ofs=0 len=0 2023-12-03T11:37:57.739 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:57.738+0000 7f124cd40800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:37:57.739 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:57.738+0000 7f124cd40800 20 rados->read ofs=0 len=0 2023-12-03T11:37:57.739 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:57.738+0000 7f124cd40800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:37:57.739 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:57.738+0000 7f124cd40800 20 searching for the correct realm 2023-12-03T11:37:57.751 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:57.750+0000 7f1248b03640 0 -- 172.21.15.3:0/2052774253 >> [v2:172.21.15.37:6805/1692844418,v1:172.21.15.37:6807/1692844418] conn(0x55b6ceca0830 msgr2=0x55b6ceca2c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:37:57.754 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:57.752+0000 7f124cd40800 20 RGWRados::pool_iterate: got zone_info.83aabb46-04b5-4c96-9933-c6bfb1173a73 2023-12-03T11:37:57.754 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:57.752+0000 7f124cd40800 20 RGWRados::pool_iterate: got zonegroup_info.6a811aad-435d-4fdd-93c9-b7e0b50de429 2023-12-03T11:37:57.754 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:57.752+0000 7f124cd40800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:37:57.754 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:57.752+0000 7f124cd40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:37:57.754 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:57.753+0000 7f124cd40800 20 rados->read ofs=0 len=0 2023-12-03T11:37:57.754 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:57.753+0000 7f124cd40800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:57.754 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:57.753+0000 7f124cd40800 20 rados->read ofs=0 len=0 2023-12-03T11:37:57.755 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:57.753+0000 7f124cd40800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:37:57.755 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:57.753+0000 7f124cd40800 20 rados->read ofs=0 len=0 2023-12-03T11:37:57.755 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:57.754+0000 7f124cd40800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:37:57.755 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:57.754+0000 7f124cd40800 20 zone default found 2023-12-03T11:37:57.755 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:57.754+0000 7f124cd40800 4 Realm: () 2023-12-03T11:37:57.755 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:57.754+0000 7f124cd40800 4 ZoneGroup: default (6a811aad-435d-4fdd-93c9-b7e0b50de429) 2023-12-03T11:37:57.755 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:57.754+0000 7f124cd40800 4 Zone: default (83aabb46-04b5-4c96-9933-c6bfb1173a73) 2023-12-03T11:37:57.756 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:57.754+0000 7f124cd40800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:37:57.756 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:57.754+0000 7f124cd40800 20 zonegroup default 2023-12-03T11:37:57.756 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:57.754+0000 7f124cd40800 20 rados->read ofs=0 len=0 2023-12-03T11:37:57.756 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:57.754+0000 7f124cd40800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:57.756 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:57.754+0000 7f124cd40800 20 rados->read ofs=0 len=0 2023-12-03T11:37:57.756 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:57.754+0000 7f124cd40800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:57.756 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:57.754+0000 7f124cd40800 20 rados->read ofs=0 len=0 2023-12-03T11:37:57.756 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:57.755+0000 7f124cd40800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:57.757 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:57.755+0000 7f124cd40800 20 started sync module instance, tier type = 2023-12-03T11:37:57.757 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:57.755+0000 7f124cd40800 20 started zone id=83aabb46-04b5-4c96-9933-c6bfb1173a73 (name=default) with tier type = 2023-12-03T11:37:57.763 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:57.762+0000 7f1248302640 0 -- 172.21.15.3:0/2052774253 >> [v2:172.21.15.3:6817/3356208405,v1:172.21.15.3:6819/3356208405] conn(0x55b6ceca5860 msgr2=0x55b6ceca7c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:37:57.766 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:57.765+0000 7f124cd40800 20 add_watcher() i=0 2023-12-03T11:37:57.766 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:57.765+0000 7f124cd40800 20 add_watcher() i=1 2023-12-03T11:37:57.766 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:57.765+0000 7f124cd40800 20 add_watcher() i=2 2023-12-03T11:37:57.767 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:57.765+0000 7f124cd40800 20 add_watcher() i=3 2023-12-03T11:37:57.767 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:57.765+0000 7f124cd40800 20 add_watcher() i=4 2023-12-03T11:37:57.767 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:57.765+0000 7f124cd40800 20 add_watcher() i=5 2023-12-03T11:37:57.767 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:57.765+0000 7f124cd40800 20 add_watcher() i=6 2023-12-03T11:37:57.767 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:57.766+0000 7f124cd40800 20 add_watcher() i=7 2023-12-03T11:37:57.768 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:57.766+0000 7f124cd40800 2 all 8 watchers are set, enabling cache 2023-12-03T11:37:57.769 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:57.768+0000 7f120efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:37:57.770 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:57.769+0000 7f124cd40800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:37:57.770 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:57.769+0000 7f124cd40800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:37:57.777 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:57.775+0000 7f124cd40800 5 note: GC not initialized 2023-12-03T11:37:57.777 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:57.775+0000 7f117dffb640 20 reqs_thread_entry: start 2023-12-03T11:37:57.777 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:57.775+0000 7f124cd40800 20 init_complete bucket index max shards: 11 2023-12-03T11:37:57.777 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:57.775+0000 7f124cd40800 20 Filter name: none 2023-12-03T11:37:57.777 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:57.776+0000 7f116f7fe640 20 reqs_thread_entry: start 2023-12-03T11:37:57.777 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:57.776+0000 7f124cd40800 20 rados->read ofs=0 len=0 2023-12-03T11:37:57.778 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:57.776+0000 7f124cd40800 20 rados_obj.operate() r=0 bl.length=190 2023-12-03T11:37:57.778 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:57.776+0000 7f124cd40800 20 rados->read ofs=0 len=0 2023-12-03T11:37:57.778 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:57.776+0000 7f124cd40800 20 rados_obj.operate() r=0 bl.length=368 2023-12-03T11:37:57.778 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:57.776+0000 7f124cd40800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:37:57.778 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:57.776+0000 7f124cd40800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2023-12-03T11:37:57.778 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:57.776+0000 7f124cd40800 20 INFO: main: starting shard=0 2023-12-03T11:37:57.778 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:57.776+0000 7f124cd40800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.0 2023-12-03T11:37:57.778 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:57.777+0000 7f124cd40800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:37:57.779 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:57.777+0000 7f124cd40800 20 INFO: main: starting shard=1 2023-12-03T11:37:57.779 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:57.777+0000 7f124cd40800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.1 2023-12-03T11:37:57.779 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:57.777+0000 7f124cd40800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:37:57.779 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:57.777+0000 7f124cd40800 20 INFO: main: starting shard=2 2023-12-03T11:37:57.779 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:57.777+0000 7f124cd40800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.2 2023-12-03T11:37:57.779 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:57.778+0000 7f124cd40800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:37:57.779 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:57.778+0000 7f124cd40800 20 INFO: main: starting shard=3 2023-12-03T11:37:57.780 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:57.778+0000 7f124cd40800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.3 2023-12-03T11:37:57.780 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:57.779+0000 7f124cd40800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:37:57.780 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:57.779+0000 7f124cd40800 20 INFO: main: starting shard=4 2023-12-03T11:37:57.780 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:57.779+0000 7f124cd40800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.4 2023-12-03T11:37:57.780 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:57.779+0000 7f124cd40800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:37:57.780 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:57.779+0000 7f124cd40800 20 INFO: main: starting shard=5 2023-12-03T11:37:57.780 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:57.779+0000 7f124cd40800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.5 2023-12-03T11:37:57.781 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:57.780+0000 7f124cd40800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:37:57.781 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:57.780+0000 7f124cd40800 20 INFO: main: starting shard=6 2023-12-03T11:37:57.781 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:57.780+0000 7f124cd40800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.6 2023-12-03T11:37:57.781 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:57.780+0000 7f124cd40800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:37:57.782 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:57.780+0000 7f124cd40800 20 INFO: main: starting shard=7 2023-12-03T11:37:57.782 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:57.780+0000 7f124cd40800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.7 2023-12-03T11:37:57.782 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:57.781+0000 7f124cd40800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:37:57.782 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:57.781+0000 7f124cd40800 20 INFO: main: starting shard=8 2023-12-03T11:37:57.782 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:57.781+0000 7f124cd40800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.8 2023-12-03T11:37:57.783 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:57.781+0000 7f124cd40800 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2023-12-03T11:37:57.783 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:57.781+0000 7f124cd40800 20 INFO: main: starting shard=9 2023-12-03T11:37:57.783 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:57.781+0000 7f124cd40800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.9 2023-12-03T11:37:57.783 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:57.782+0000 7f124cd40800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:37:57.783 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:57.782+0000 7f124cd40800 20 INFO: main: starting shard=10 2023-12-03T11:37:57.783 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:57.782+0000 7f124cd40800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.10 2023-12-03T11:37:57.784 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:57.783+0000 7f124cd40800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:37:57.784 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:57.783+0000 7f124cd40800 20 INFO: main: done 2023-12-03T11:37:57.784 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:57.783+0000 7f120efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:37:57.787 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:57.786+0000 7f124cd40800 20 remove_watcher() i=0 2023-12-03T11:37:57.787 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:57.786+0000 7f124cd40800 2 removed watcher, disabling cache 2023-12-03T11:37:57.788 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:57.787+0000 7f124cd40800 20 remove_watcher() i=1 2023-12-03T11:37:57.789 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:57.788+0000 7f124cd40800 20 remove_watcher() i=2 2023-12-03T11:37:57.790 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:57.789+0000 7f124cd40800 20 remove_watcher() i=3 2023-12-03T11:37:57.791 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:57.790+0000 7f124cd40800 20 remove_watcher() i=4 2023-12-03T11:37:57.793 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:57.792+0000 7f124cd40800 20 remove_watcher() i=5 2023-12-03T11:37:57.794 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:57.793+0000 7f124cd40800 20 remove_watcher() i=6 2023-12-03T11:37:57.795 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:57.794+0000 7f124cd40800 20 remove_watcher() i=7 2023-12-03T11:37:57.905 INFO:tasks.workunit.client.0.smithi003.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2023-12-03T11:37:57.907 INFO:tasks.workunit.client.0.smithi003.stderr:radosgw-admin bi list --bucket check-bucket --object d 2023-12-03T11:37:57.936 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:37:57.937 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:37:57.950 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:57.949+0000 7f2d6e71f800 20 rados->read ofs=0 len=0 2023-12-03T11:37:57.952 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:57.951+0000 7f2d6e71f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:57.952 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:57.951+0000 7f2d6e71f800 20 realm 2023-12-03T11:37:57.952 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:57.951+0000 7f2d6e71f800 20 rados->read ofs=0 len=0 2023-12-03T11:37:57.952 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:57.951+0000 7f2d6e71f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:57.952 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:57.951+0000 7f2d6e71f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:37:57.953 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:57.951+0000 7f2d6e71f800 20 rados->read ofs=0 len=0 2023-12-03T11:37:57.953 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:57.951+0000 7f2d6e71f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:57.953 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:57.951+0000 7f2d6e71f800 20 rados->read ofs=0 len=0 2023-12-03T11:37:58.155 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.154+0000 7f2d6e71f800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:37:58.155 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.154+0000 7f2d6e71f800 20 rados->read ofs=0 len=0 2023-12-03T11:37:58.155 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.154+0000 7f2d6e71f800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:37:58.155 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.154+0000 7f2d6e71f800 20 searching for the correct realm 2023-12-03T11:37:58.167 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.166+0000 7f2d6a34d640 0 -- 172.21.15.3:0/1687420915 >> [v2:172.21.15.3:6800/2373485412,v1:172.21.15.3:6801/2373485412] conn(0x7f2d6401e040 msgr2=0x7f2d64027730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:37:58.169 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.167+0000 7f2d6e71f800 20 RGWRados::pool_iterate: got zone_info.83aabb46-04b5-4c96-9933-c6bfb1173a73 2023-12-03T11:37:58.169 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.167+0000 7f2d6e71f800 20 RGWRados::pool_iterate: got zonegroup_info.6a811aad-435d-4fdd-93c9-b7e0b50de429 2023-12-03T11:37:58.169 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.167+0000 7f2d6e71f800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:37:58.169 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.167+0000 7f2d6e71f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:37:58.169 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.167+0000 7f2d6e71f800 20 rados->read ofs=0 len=0 2023-12-03T11:37:58.169 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.168+0000 7f2d6e71f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:58.169 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.168+0000 7f2d6e71f800 20 rados->read ofs=0 len=0 2023-12-03T11:37:58.170 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.168+0000 7f2d6e71f800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:37:58.170 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.168+0000 7f2d6e71f800 20 rados->read ofs=0 len=0 2023-12-03T11:37:58.170 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.168+0000 7f2d6e71f800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:37:58.170 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.168+0000 7f2d6e71f800 20 zone default found 2023-12-03T11:37:58.171 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.168+0000 7f2d6e71f800 4 Realm: () 2023-12-03T11:37:58.171 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.168+0000 7f2d6e71f800 4 ZoneGroup: default (6a811aad-435d-4fdd-93c9-b7e0b50de429) 2023-12-03T11:37:58.171 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.168+0000 7f2d6e71f800 4 Zone: default (83aabb46-04b5-4c96-9933-c6bfb1173a73) 2023-12-03T11:37:58.171 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.168+0000 7f2d6e71f800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:37:58.171 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.168+0000 7f2d6e71f800 20 zonegroup default 2023-12-03T11:37:58.171 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.168+0000 7f2d6e71f800 20 rados->read ofs=0 len=0 2023-12-03T11:37:58.171 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.169+0000 7f2d6e71f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:58.171 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.169+0000 7f2d6e71f800 20 rados->read ofs=0 len=0 2023-12-03T11:37:58.171 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.169+0000 7f2d6e71f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:58.171 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.169+0000 7f2d6e71f800 20 rados->read ofs=0 len=0 2023-12-03T11:37:58.171 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.169+0000 7f2d6e71f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:58.171 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.169+0000 7f2d6e71f800 20 started sync module instance, tier type = 2023-12-03T11:37:58.171 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.169+0000 7f2d6e71f800 20 started zone id=83aabb46-04b5-4c96-9933-c6bfb1173a73 (name=default) with tier type = 2023-12-03T11:37:58.177 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.176+0000 7f2d6a34d640 0 -- 172.21.15.3:0/1687420915 >> [v2:172.21.15.3:6800/2373485412,v1:172.21.15.3:6801/2373485412] conn(0x7f2d44077380 msgr2=0x7f2d440797b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:37:58.182 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.180+0000 7f2d6e71f800 20 add_watcher() i=0 2023-12-03T11:37:58.182 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.180+0000 7f2d6e71f800 20 add_watcher() i=1 2023-12-03T11:37:58.182 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.180+0000 7f2d6e71f800 20 add_watcher() i=2 2023-12-03T11:37:58.182 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.180+0000 7f2d6e71f800 20 add_watcher() i=3 2023-12-03T11:37:58.182 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.180+0000 7f2d6e71f800 20 add_watcher() i=4 2023-12-03T11:37:58.182 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.180+0000 7f2d6e71f800 20 add_watcher() i=5 2023-12-03T11:37:58.182 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.180+0000 7f2d6e71f800 20 add_watcher() i=6 2023-12-03T11:37:58.182 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.181+0000 7f2d6e71f800 20 add_watcher() i=7 2023-12-03T11:37:58.183 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.181+0000 7f2d6e71f800 2 all 8 watchers are set, enabling cache 2023-12-03T11:37:58.184 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.183+0000 7f2d2ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:37:58.185 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.184+0000 7f2d6e71f800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:37:58.185 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.184+0000 7f2d6e71f800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:37:58.192 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.190+0000 7f2d6e71f800 5 note: GC not initialized 2023-12-03T11:37:58.192 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.190+0000 7f2c9effd640 20 reqs_thread_entry: start 2023-12-03T11:37:58.192 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.190+0000 7f2d6e71f800 20 init_complete bucket index max shards: 11 2023-12-03T11:37:58.192 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.190+0000 7f2d6e71f800 20 Filter name: none 2023-12-03T11:37:58.192 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.191+0000 7f2c9cff9640 20 reqs_thread_entry: start 2023-12-03T11:37:58.192 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.191+0000 7f2d6e71f800 20 rados->read ofs=0 len=0 2023-12-03T11:37:58.193 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.191+0000 7f2d6e71f800 20 rados_obj.operate() r=0 bl.length=190 2023-12-03T11:37:58.193 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.191+0000 7f2d6e71f800 20 rados->read ofs=0 len=0 2023-12-03T11:37:58.193 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.191+0000 7f2d6e71f800 20 rados_obj.operate() r=0 bl.length=368 2023-12-03T11:37:58.193 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.191+0000 7f2d6e71f800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:37:58.193 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.191+0000 7f2d6e71f800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2023-12-03T11:37:58.194 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.191+0000 7f2d6e71f800 20 INFO: main: starting shard=0 2023-12-03T11:37:58.194 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.191+0000 7f2d6e71f800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.0 2023-12-03T11:37:58.194 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.192+0000 7f2d6e71f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:37:58.194 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.192+0000 7f2d6e71f800 20 INFO: main: starting shard=1 2023-12-03T11:37:58.194 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.192+0000 7f2d6e71f800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.1 2023-12-03T11:37:58.195 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.192+0000 7f2d6e71f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:37:58.195 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.192+0000 7f2d6e71f800 20 INFO: main: starting shard=2 2023-12-03T11:37:58.195 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.192+0000 7f2d6e71f800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.2 2023-12-03T11:37:58.195 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.193+0000 7f2d6e71f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:37:58.195 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.193+0000 7f2d6e71f800 20 INFO: main: starting shard=3 2023-12-03T11:37:58.195 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.193+0000 7f2d6e71f800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.3 2023-12-03T11:37:58.195 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.193+0000 7f2d6e71f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:37:58.195 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.193+0000 7f2d6e71f800 20 INFO: main: starting shard=4 2023-12-03T11:37:58.195 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.194+0000 7f2d6e71f800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.4 2023-12-03T11:37:58.196 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.194+0000 7f2d6e71f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:37:58.196 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.194+0000 7f2d6e71f800 20 INFO: main: starting shard=5 2023-12-03T11:37:58.196 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.194+0000 7f2d6e71f800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.5 2023-12-03T11:37:58.196 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.195+0000 7f2d6e71f800 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2023-12-03T11:37:58.196 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.195+0000 7f2d6e71f800 20 INFO: main: starting shard=6 2023-12-03T11:37:58.196 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.195+0000 7f2d6e71f800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.6 2023-12-03T11:37:58.197 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.195+0000 7f2d6e71f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:37:58.197 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.195+0000 7f2d6e71f800 20 INFO: main: starting shard=7 2023-12-03T11:37:58.197 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.195+0000 7f2d6e71f800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.7 2023-12-03T11:37:58.197 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.196+0000 7f2d6e71f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:37:58.197 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.196+0000 7f2d6e71f800 20 INFO: main: starting shard=8 2023-12-03T11:37:58.198 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.196+0000 7f2d6e71f800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.8 2023-12-03T11:37:58.198 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.196+0000 7f2d6e71f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:37:58.198 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.196+0000 7f2d6e71f800 20 INFO: main: starting shard=9 2023-12-03T11:37:58.198 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.196+0000 7f2d6e71f800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.9 2023-12-03T11:37:58.198 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.197+0000 7f2d6e71f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:37:58.198 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.197+0000 7f2d6e71f800 20 INFO: main: starting shard=10 2023-12-03T11:37:58.198 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.197+0000 7f2d6e71f800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.10 2023-12-03T11:37:58.199 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.198+0000 7f2d6e71f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:37:58.199 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.198+0000 7f2d6e71f800 20 INFO: main: done 2023-12-03T11:37:58.199 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.198+0000 7f2d2ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:37:58.202 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.201+0000 7f2d6e71f800 20 remove_watcher() i=0 2023-12-03T11:37:58.202 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.201+0000 7f2d6e71f800 2 removed watcher, disabling cache 2023-12-03T11:37:58.203 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.202+0000 7f2d6e71f800 20 remove_watcher() i=1 2023-12-03T11:37:58.204 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.204+0000 7f2d6e71f800 20 remove_watcher() i=2 2023-12-03T11:37:58.206 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.205+0000 7f2d6e71f800 20 remove_watcher() i=3 2023-12-03T11:37:58.207 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.206+0000 7f2d6e71f800 20 remove_watcher() i=4 2023-12-03T11:37:58.208 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.207+0000 7f2d6e71f800 20 remove_watcher() i=5 2023-12-03T11:37:58.209 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.208+0000 7f2d6e71f800 20 remove_watcher() i=6 2023-12-03T11:37:58.210 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.209+0000 7f2d6e71f800 20 remove_watcher() i=7 2023-12-03T11:37:58.336 INFO:tasks.workunit.client.0.smithi003.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2023-12-03T11:37:58.338 INFO:tasks.workunit.client.0.smithi003.stderr:radosgw-admin bi list --bucket check-bucket --object e 2023-12-03T11:37:58.367 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:37:58.368 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:37:58.382 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.381+0000 7f154c92f800 20 rados->read ofs=0 len=0 2023-12-03T11:37:58.384 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.383+0000 7f154c92f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:58.384 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.383+0000 7f154c92f800 20 realm 2023-12-03T11:37:58.384 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.383+0000 7f154c92f800 20 rados->read ofs=0 len=0 2023-12-03T11:37:58.384 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.383+0000 7f154c92f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:58.384 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.383+0000 7f154c92f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:37:58.385 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.383+0000 7f154c92f800 20 rados->read ofs=0 len=0 2023-12-03T11:37:58.385 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.383+0000 7f154c92f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:58.385 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.383+0000 7f154c92f800 20 rados->read ofs=0 len=0 2023-12-03T11:37:58.385 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.384+0000 7f154c92f800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:37:58.385 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.384+0000 7f154c92f800 20 rados->read ofs=0 len=0 2023-12-03T11:37:58.385 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.384+0000 7f154c92f800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:37:58.386 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.384+0000 7f154c92f800 20 searching for the correct realm 2023-12-03T11:37:58.397 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.396+0000 7f154857e640 0 -- 172.21.15.3:0/270051459 >> [v2:172.21.15.37:6805/1692844418,v1:172.21.15.37:6807/1692844418] conn(0x55b0722e1130 msgr2=0x55b0722e3520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:37:58.398 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.397+0000 7f154c92f800 20 RGWRados::pool_iterate: got zone_info.83aabb46-04b5-4c96-9933-c6bfb1173a73 2023-12-03T11:37:58.398 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.397+0000 7f154c92f800 20 RGWRados::pool_iterate: got zonegroup_info.6a811aad-435d-4fdd-93c9-b7e0b50de429 2023-12-03T11:37:58.398 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.397+0000 7f154c92f800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:37:58.398 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.397+0000 7f154c92f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:37:58.398 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.397+0000 7f154c92f800 20 rados->read ofs=0 len=0 2023-12-03T11:37:58.398 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.397+0000 7f154c92f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:58.398 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.397+0000 7f154c92f800 20 rados->read ofs=0 len=0 2023-12-03T11:37:58.400 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.397+0000 7f154c92f800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:37:58.400 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.397+0000 7f154c92f800 20 rados->read ofs=0 len=0 2023-12-03T11:37:58.400 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.398+0000 7f154c92f800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:37:58.400 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.398+0000 7f154c92f800 20 zone default found 2023-12-03T11:37:58.400 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.398+0000 7f154c92f800 4 Realm: () 2023-12-03T11:37:58.400 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.398+0000 7f154c92f800 4 ZoneGroup: default (6a811aad-435d-4fdd-93c9-b7e0b50de429) 2023-12-03T11:37:58.400 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.398+0000 7f154c92f800 4 Zone: default (83aabb46-04b5-4c96-9933-c6bfb1173a73) 2023-12-03T11:37:58.400 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.398+0000 7f154c92f800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:37:58.400 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.398+0000 7f154c92f800 20 zonegroup default 2023-12-03T11:37:58.400 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.398+0000 7f154c92f800 20 rados->read ofs=0 len=0 2023-12-03T11:37:58.400 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.398+0000 7f154c92f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:58.400 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.398+0000 7f154c92f800 20 rados->read ofs=0 len=0 2023-12-03T11:37:58.400 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.398+0000 7f154c92f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:58.401 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.398+0000 7f154c92f800 20 rados->read ofs=0 len=0 2023-12-03T11:37:58.401 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.399+0000 7f154c92f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:58.401 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.399+0000 7f154c92f800 20 started sync module instance, tier type = 2023-12-03T11:37:58.401 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.399+0000 7f154c92f800 20 started zone id=83aabb46-04b5-4c96-9933-c6bfb1173a73 (name=default) with tier type = 2023-12-03T11:37:58.415 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.414+0000 7f1547d7d640 0 -- 172.21.15.3:0/270051459 >> [v2:172.21.15.3:6817/3356208405,v1:172.21.15.3:6819/3356208405] conn(0x55b0722e60d0 msgr2=0x55b0722e84c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:37:58.417 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.416+0000 7f154c92f800 20 add_watcher() i=0 2023-12-03T11:37:58.417 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.416+0000 7f154c92f800 20 add_watcher() i=1 2023-12-03T11:37:58.417 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.416+0000 7f154c92f800 20 add_watcher() i=2 2023-12-03T11:37:58.417 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.416+0000 7f154c92f800 20 add_watcher() i=3 2023-12-03T11:37:58.417 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.416+0000 7f154c92f800 20 add_watcher() i=4 2023-12-03T11:37:58.417 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.416+0000 7f154c92f800 20 add_watcher() i=5 2023-12-03T11:37:58.421 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.420+0000 7f154c92f800 20 add_watcher() i=6 2023-12-03T11:37:58.421 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.420+0000 7f154c92f800 20 add_watcher() i=7 2023-12-03T11:37:58.421 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.420+0000 7f154c92f800 2 all 8 watchers are set, enabling cache 2023-12-03T11:37:58.423 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.422+0000 7f150e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:37:58.423 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.422+0000 7f154c92f800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:37:58.423 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.422+0000 7f154c92f800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:37:58.430 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.429+0000 7f154c92f800 5 note: GC not initialized 2023-12-03T11:37:58.430 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.429+0000 7f147d7fa640 20 reqs_thread_entry: start 2023-12-03T11:37:58.430 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.429+0000 7f154c92f800 20 init_complete bucket index max shards: 11 2023-12-03T11:37:58.430 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.429+0000 7f154c92f800 20 Filter name: none 2023-12-03T11:37:58.431 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.429+0000 7f1476ffd640 20 reqs_thread_entry: start 2023-12-03T11:37:58.431 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.429+0000 7f154c92f800 20 rados->read ofs=0 len=0 2023-12-03T11:37:58.431 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.430+0000 7f154c92f800 20 rados_obj.operate() r=0 bl.length=190 2023-12-03T11:37:58.431 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.430+0000 7f154c92f800 20 rados->read ofs=0 len=0 2023-12-03T11:37:58.432 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.430+0000 7f154c92f800 20 rados_obj.operate() r=0 bl.length=368 2023-12-03T11:37:58.432 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.430+0000 7f154c92f800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:37:58.432 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.430+0000 7f154c92f800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2023-12-03T11:37:58.432 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.430+0000 7f154c92f800 20 INFO: main: starting shard=0 2023-12-03T11:37:58.432 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.430+0000 7f154c92f800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.0 2023-12-03T11:37:58.432 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.430+0000 7f154c92f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:37:58.432 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.430+0000 7f154c92f800 20 INFO: main: starting shard=1 2023-12-03T11:37:58.432 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.430+0000 7f154c92f800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.1 2023-12-03T11:37:58.433 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.431+0000 7f154c92f800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2023-12-03T11:37:58.433 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.431+0000 7f154c92f800 20 INFO: main: starting shard=2 2023-12-03T11:37:58.433 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.431+0000 7f154c92f800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.2 2023-12-03T11:37:58.433 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.432+0000 7f154c92f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:37:58.433 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.432+0000 7f154c92f800 20 INFO: main: starting shard=3 2023-12-03T11:37:58.433 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.432+0000 7f154c92f800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.3 2023-12-03T11:37:58.434 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.432+0000 7f154c92f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:37:58.434 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.432+0000 7f154c92f800 20 INFO: main: starting shard=4 2023-12-03T11:37:58.434 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.432+0000 7f154c92f800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.4 2023-12-03T11:37:58.434 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.433+0000 7f154c92f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:37:58.434 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.433+0000 7f154c92f800 20 INFO: main: starting shard=5 2023-12-03T11:37:58.434 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.433+0000 7f154c92f800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.5 2023-12-03T11:37:58.435 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.433+0000 7f154c92f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:37:58.435 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.433+0000 7f154c92f800 20 INFO: main: starting shard=6 2023-12-03T11:37:58.435 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.433+0000 7f154c92f800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.6 2023-12-03T11:37:58.435 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.433+0000 7f154c92f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:37:58.435 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.433+0000 7f154c92f800 20 INFO: main: starting shard=7 2023-12-03T11:37:58.435 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.433+0000 7f154c92f800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.7 2023-12-03T11:37:58.436 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.434+0000 7f154c92f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:37:58.436 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.434+0000 7f154c92f800 20 INFO: main: starting shard=8 2023-12-03T11:37:58.436 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.434+0000 7f154c92f800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.8 2023-12-03T11:37:58.436 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.434+0000 7f154c92f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:37:58.436 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.434+0000 7f154c92f800 20 INFO: main: starting shard=9 2023-12-03T11:37:58.436 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.434+0000 7f154c92f800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.9 2023-12-03T11:37:58.436 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.435+0000 7f154c92f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:37:58.436 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.435+0000 7f154c92f800 20 INFO: main: starting shard=10 2023-12-03T11:37:58.436 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.435+0000 7f154c92f800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.10 2023-12-03T11:37:58.437 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.435+0000 7f154c92f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:37:58.437 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.435+0000 7f154c92f800 20 INFO: main: done 2023-12-03T11:37:58.437 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.436+0000 7f150e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:37:58.440 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.439+0000 7f154c92f800 20 remove_watcher() i=0 2023-12-03T11:37:58.440 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.439+0000 7f154c92f800 2 removed watcher, disabling cache 2023-12-03T11:37:58.441 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.440+0000 7f154c92f800 20 remove_watcher() i=1 2023-12-03T11:37:58.442 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.441+0000 7f154c92f800 20 remove_watcher() i=2 2023-12-03T11:37:58.444 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.443+0000 7f154c92f800 20 remove_watcher() i=3 2023-12-03T11:37:58.445 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.444+0000 7f154c92f800 20 remove_watcher() i=4 2023-12-03T11:37:58.446 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.445+0000 7f154c92f800 20 remove_watcher() i=5 2023-12-03T11:37:58.447 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.446+0000 7f154c92f800 20 remove_watcher() i=6 2023-12-03T11:37:58.448 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.447+0000 7f154c92f800 20 remove_watcher() i=7 2023-12-03T11:37:58.559 INFO:tasks.workunit.client.0.smithi003.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2023-12-03T11:37:58.561 INFO:tasks.workunit.client.0.smithi003.stderr:radosgw-admin bi list --bucket check-bucket --object f 2023-12-03T11:37:58.590 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:37:58.590 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:37:58.605 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.604+0000 7f487f2ba800 20 rados->read ofs=0 len=0 2023-12-03T11:37:58.607 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.606+0000 7f487f2ba800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:58.607 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.606+0000 7f487f2ba800 20 realm 2023-12-03T11:37:58.607 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.606+0000 7f487f2ba800 20 rados->read ofs=0 len=0 2023-12-03T11:37:58.607 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.606+0000 7f487f2ba800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:58.607 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.606+0000 7f487f2ba800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:37:58.607 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.606+0000 7f487f2ba800 20 rados->read ofs=0 len=0 2023-12-03T11:37:58.608 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.606+0000 7f487f2ba800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:58.608 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.606+0000 7f487f2ba800 20 rados->read ofs=0 len=0 2023-12-03T11:37:58.608 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.607+0000 7f487f2ba800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:37:58.608 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.607+0000 7f487f2ba800 20 rados->read ofs=0 len=0 2023-12-03T11:37:58.609 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.608+0000 7f487f2ba800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:37:58.609 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.608+0000 7f487f2ba800 20 searching for the correct realm 2023-12-03T11:37:58.620 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.619+0000 7f487c5b9640 0 -- 172.21.15.3:0/2984391136 >> [v2:172.21.15.3:6817/3356208405,v1:172.21.15.3:6819/3356208405] conn(0x564df62a3410 msgr2=0x564df62a5800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:37:58.621 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.620+0000 7f487f2ba800 20 RGWRados::pool_iterate: got zone_info.83aabb46-04b5-4c96-9933-c6bfb1173a73 2023-12-03T11:37:58.621 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.620+0000 7f487f2ba800 20 RGWRados::pool_iterate: got zonegroup_info.6a811aad-435d-4fdd-93c9-b7e0b50de429 2023-12-03T11:37:58.621 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.620+0000 7f487f2ba800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:37:58.621 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.620+0000 7f487f2ba800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:37:58.621 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.620+0000 7f487f2ba800 20 rados->read ofs=0 len=0 2023-12-03T11:37:58.621 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.620+0000 7f487f2ba800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:58.621 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.620+0000 7f487f2ba800 20 rados->read ofs=0 len=0 2023-12-03T11:37:58.622 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.620+0000 7f487f2ba800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:37:58.622 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.620+0000 7f487f2ba800 20 rados->read ofs=0 len=0 2023-12-03T11:37:58.622 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.621+0000 7f487f2ba800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:37:58.622 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.621+0000 7f487f2ba800 20 zone default found 2023-12-03T11:37:58.622 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.621+0000 7f487f2ba800 4 Realm: () 2023-12-03T11:37:58.623 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.621+0000 7f487f2ba800 4 ZoneGroup: default (6a811aad-435d-4fdd-93c9-b7e0b50de429) 2023-12-03T11:37:58.623 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.621+0000 7f487f2ba800 4 Zone: default (83aabb46-04b5-4c96-9933-c6bfb1173a73) 2023-12-03T11:37:58.623 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.621+0000 7f487f2ba800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:37:58.623 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.621+0000 7f487f2ba800 20 zonegroup default 2023-12-03T11:37:58.623 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.621+0000 7f487f2ba800 20 rados->read ofs=0 len=0 2023-12-03T11:37:58.623 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.621+0000 7f487f2ba800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:58.623 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.621+0000 7f487f2ba800 20 rados->read ofs=0 len=0 2023-12-03T11:37:58.623 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.621+0000 7f487f2ba800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:58.623 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.621+0000 7f487f2ba800 20 rados->read ofs=0 len=0 2023-12-03T11:37:58.624 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.621+0000 7f487f2ba800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:58.624 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.622+0000 7f487f2ba800 20 started sync module instance, tier type = 2023-12-03T11:37:58.624 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.622+0000 7f487f2ba800 20 started zone id=83aabb46-04b5-4c96-9933-c6bfb1173a73 (name=default) with tier type = 2023-12-03T11:37:58.635 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.634+0000 7f487c5b9640 0 -- 172.21.15.3:0/2984391136 >> [v2:172.21.15.3:6817/3356208405,v1:172.21.15.3:6819/3356208405] conn(0x7f4858077350 msgr2=0x7f4858079780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-03T11:37:58.637 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.636+0000 7f487f2ba800 20 add_watcher() i=0 2023-12-03T11:37:58.637 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.636+0000 7f487f2ba800 20 add_watcher() i=1 2023-12-03T11:37:58.638 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.636+0000 7f487f2ba800 20 add_watcher() i=2 2023-12-03T11:37:58.638 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.636+0000 7f487f2ba800 20 add_watcher() i=3 2023-12-03T11:37:58.638 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.636+0000 7f487f2ba800 20 add_watcher() i=4 2023-12-03T11:37:58.638 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.636+0000 7f487f2ba800 20 add_watcher() i=5 2023-12-03T11:37:58.638 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.636+0000 7f487f2ba800 20 add_watcher() i=6 2023-12-03T11:37:58.640 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.639+0000 7f487f2ba800 20 add_watcher() i=7 2023-12-03T11:37:58.640 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.639+0000 7f487f2ba800 2 all 8 watchers are set, enabling cache 2023-12-03T11:37:58.642 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.641+0000 7f4842fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:37:58.642 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.641+0000 7f487f2ba800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:37:58.642 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.641+0000 7f487f2ba800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:37:58.649 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.647+0000 7f487f2ba800 5 note: GC not initialized 2023-12-03T11:37:58.649 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.647+0000 7f47b1ffb640 20 reqs_thread_entry: start 2023-12-03T11:37:58.649 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.647+0000 7f487f2ba800 20 init_complete bucket index max shards: 11 2023-12-03T11:37:58.649 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.647+0000 7f487f2ba800 20 Filter name: none 2023-12-03T11:37:58.649 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.648+0000 7f47a37fe640 20 reqs_thread_entry: start 2023-12-03T11:37:58.649 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.648+0000 7f487f2ba800 20 rados->read ofs=0 len=0 2023-12-03T11:37:58.650 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.648+0000 7f487f2ba800 20 rados_obj.operate() r=0 bl.length=190 2023-12-03T11:37:58.650 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.648+0000 7f487f2ba800 20 rados->read ofs=0 len=0 2023-12-03T11:37:58.650 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.648+0000 7f487f2ba800 20 rados_obj.operate() r=0 bl.length=368 2023-12-03T11:37:58.650 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.648+0000 7f487f2ba800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:37:58.650 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.648+0000 7f487f2ba800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2023-12-03T11:37:58.651 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.648+0000 7f487f2ba800 20 INFO: main: starting shard=0 2023-12-03T11:37:58.651 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.648+0000 7f487f2ba800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.0 2023-12-03T11:37:58.651 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.649+0000 7f487f2ba800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:37:58.651 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.649+0000 7f487f2ba800 20 INFO: main: starting shard=1 2023-12-03T11:37:58.651 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.649+0000 7f487f2ba800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.1 2023-12-03T11:37:58.652 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.649+0000 7f487f2ba800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:37:58.652 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.649+0000 7f487f2ba800 20 INFO: main: starting shard=2 2023-12-03T11:37:58.652 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.649+0000 7f487f2ba800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.2 2023-12-03T11:37:58.652 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.650+0000 7f487f2ba800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:37:58.652 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.650+0000 7f487f2ba800 20 INFO: main: starting shard=3 2023-12-03T11:37:58.652 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.650+0000 7f487f2ba800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.3 2023-12-03T11:37:58.652 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.650+0000 7f487f2ba800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:37:58.652 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.651+0000 7f487f2ba800 20 INFO: main: starting shard=4 2023-12-03T11:37:58.652 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.651+0000 7f487f2ba800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.4 2023-12-03T11:37:58.653 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.651+0000 7f487f2ba800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:37:58.653 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.651+0000 7f487f2ba800 20 INFO: main: starting shard=5 2023-12-03T11:37:58.653 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.651+0000 7f487f2ba800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.5 2023-12-03T11:37:58.653 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.651+0000 7f487f2ba800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:37:58.653 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.651+0000 7f487f2ba800 20 INFO: main: starting shard=6 2023-12-03T11:37:58.653 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.651+0000 7f487f2ba800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.6 2023-12-03T11:37:58.653 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.652+0000 7f487f2ba800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:37:58.654 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.652+0000 7f487f2ba800 20 INFO: main: starting shard=7 2023-12-03T11:37:58.654 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.652+0000 7f487f2ba800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.7 2023-12-03T11:37:58.654 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.653+0000 7f487f2ba800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:37:58.654 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.653+0000 7f487f2ba800 20 INFO: main: starting shard=8 2023-12-03T11:37:58.657 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.653+0000 7f487f2ba800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.8 2023-12-03T11:37:58.657 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.653+0000 7f487f2ba800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:37:58.657 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.653+0000 7f487f2ba800 20 INFO: main: starting shard=9 2023-12-03T11:37:58.657 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.653+0000 7f487f2ba800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.9 2023-12-03T11:37:58.658 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.654+0000 7f487f2ba800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:37:58.658 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.654+0000 7f487f2ba800 20 INFO: main: starting shard=10 2023-12-03T11:37:58.658 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.654+0000 7f487f2ba800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.10 2023-12-03T11:37:58.658 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.654+0000 7f487f2ba800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2023-12-03T11:37:58.658 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.654+0000 7f487f2ba800 20 INFO: main: done 2023-12-03T11:37:58.658 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.655+0000 7f4842fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:37:58.659 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.657+0000 7f487f2ba800 20 remove_watcher() i=0 2023-12-03T11:37:58.659 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.657+0000 7f487f2ba800 2 removed watcher, disabling cache 2023-12-03T11:37:58.660 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.659+0000 7f487f2ba800 20 remove_watcher() i=1 2023-12-03T11:37:58.661 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.660+0000 7f487f2ba800 20 remove_watcher() i=2 2023-12-03T11:37:58.663 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.662+0000 7f487f2ba800 20 remove_watcher() i=3 2023-12-03T11:37:58.664 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.663+0000 7f487f2ba800 20 remove_watcher() i=4 2023-12-03T11:37:58.665 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.664+0000 7f487f2ba800 20 remove_watcher() i=5 2023-12-03T11:37:58.666 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.665+0000 7f487f2ba800 20 remove_watcher() i=6 2023-12-03T11:37:58.667 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:58.666+0000 7f487f2ba800 20 remove_watcher() i=7 2023-12-03T11:37:58.696 INFO:tasks.workunit.client.0.smithi003.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2023-12-03T11:37:59.091 INFO:tasks.workunit.client.0.smithi003.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2023-12-03T11:37:59.488 INFO:tasks.workunit.client.0.smithi003.stderr:radosgw-admin bucket check --fix --bucket check-bucket 2023-12-03T11:37:59.516 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:37:59.516 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:37:59.530 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.529+0000 7efc0232f800 20 rados->read ofs=0 len=0 2023-12-03T11:37:59.533 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.531+0000 7efc0232f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:59.533 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.531+0000 7efc0232f800 20 realm 2023-12-03T11:37:59.533 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.531+0000 7efc0232f800 20 rados->read ofs=0 len=0 2023-12-03T11:37:59.533 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.531+0000 7efc0232f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:59.533 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.531+0000 7efc0232f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:37:59.533 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.531+0000 7efc0232f800 20 rados->read ofs=0 len=0 2023-12-03T11:37:59.533 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.531+0000 7efc0232f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:59.533 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.531+0000 7efc0232f800 20 rados->read ofs=0 len=0 2023-12-03T11:37:59.533 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.532+0000 7efc0232f800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:37:59.534 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.532+0000 7efc0232f800 20 rados->read ofs=0 len=0 2023-12-03T11:37:59.534 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.533+0000 7efc0232f800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:37:59.534 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.533+0000 7efc0232f800 20 searching for the correct realm 2023-12-03T11:37:59.545 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.544+0000 7efbfdf7e640 0 -- 172.21.15.3:0/851244927 >> [v2:172.21.15.37:6805/1692844418,v1:172.21.15.37:6807/1692844418] conn(0x561e51a92140 msgr2=0x561e51a94550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:37:59.547 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.545+0000 7efc0232f800 20 RGWRados::pool_iterate: got zone_info.83aabb46-04b5-4c96-9933-c6bfb1173a73 2023-12-03T11:37:59.547 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.545+0000 7efc0232f800 20 RGWRados::pool_iterate: got zonegroup_info.6a811aad-435d-4fdd-93c9-b7e0b50de429 2023-12-03T11:37:59.547 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.545+0000 7efc0232f800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:37:59.547 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.545+0000 7efc0232f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:37:59.547 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.545+0000 7efc0232f800 20 rados->read ofs=0 len=0 2023-12-03T11:37:59.547 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.545+0000 7efc0232f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:59.547 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.545+0000 7efc0232f800 20 rados->read ofs=0 len=0 2023-12-03T11:37:59.547 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.546+0000 7efc0232f800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:37:59.547 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.546+0000 7efc0232f800 20 rados->read ofs=0 len=0 2023-12-03T11:37:59.548 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.546+0000 7efc0232f800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:37:59.549 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.546+0000 7efc0232f800 20 zone default found 2023-12-03T11:37:59.549 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.546+0000 7efc0232f800 4 Realm: () 2023-12-03T11:37:59.549 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.546+0000 7efc0232f800 4 ZoneGroup: default (6a811aad-435d-4fdd-93c9-b7e0b50de429) 2023-12-03T11:37:59.549 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.546+0000 7efc0232f800 4 Zone: default (83aabb46-04b5-4c96-9933-c6bfb1173a73) 2023-12-03T11:37:59.549 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.546+0000 7efc0232f800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:37:59.549 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.546+0000 7efc0232f800 20 zonegroup default 2023-12-03T11:37:59.549 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.546+0000 7efc0232f800 20 rados->read ofs=0 len=0 2023-12-03T11:37:59.549 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.546+0000 7efc0232f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:59.549 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.546+0000 7efc0232f800 20 rados->read ofs=0 len=0 2023-12-03T11:37:59.549 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.547+0000 7efc0232f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:59.549 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.547+0000 7efc0232f800 20 rados->read ofs=0 len=0 2023-12-03T11:37:59.549 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.547+0000 7efc0232f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:59.549 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.547+0000 7efc0232f800 20 started sync module instance, tier type = 2023-12-03T11:37:59.549 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.547+0000 7efc0232f800 20 started zone id=83aabb46-04b5-4c96-9933-c6bfb1173a73 (name=default) with tier type = 2023-12-03T11:37:59.559 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.558+0000 7efbfe77f640 0 -- 172.21.15.3:0/851244927 >> [v2:172.21.15.37:6816/3770469300,v1:172.21.15.37:6818/3770469300] conn(0x7efbe8075bd0 msgr2=0x7efbe8086ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:37:59.561 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.560+0000 7efc0232f800 20 add_watcher() i=0 2023-12-03T11:37:59.562 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.560+0000 7efc0232f800 20 add_watcher() i=1 2023-12-03T11:37:59.562 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.560+0000 7efc0232f800 20 add_watcher() i=2 2023-12-03T11:37:59.562 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.560+0000 7efc0232f800 20 add_watcher() i=3 2023-12-03T11:37:59.562 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.560+0000 7efc0232f800 20 add_watcher() i=4 2023-12-03T11:37:59.562 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.560+0000 7efc0232f800 20 add_watcher() i=5 2023-12-03T11:37:59.562 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.560+0000 7efc0232f800 20 add_watcher() i=6 2023-12-03T11:37:59.564 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.563+0000 7efc0232f800 20 add_watcher() i=7 2023-12-03T11:37:59.564 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.563+0000 7efc0232f800 2 all 8 watchers are set, enabling cache 2023-12-03T11:37:59.566 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.565+0000 7efbc37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:37:59.566 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.565+0000 7efc0232f800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:37:59.566 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.565+0000 7efc0232f800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:37:59.573 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.571+0000 7efc0232f800 5 note: GC not initialized 2023-12-03T11:37:59.573 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.571+0000 7efb327fc640 20 reqs_thread_entry: start 2023-12-03T11:37:59.573 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.571+0000 7efc0232f800 20 init_complete bucket index max shards: 11 2023-12-03T11:37:59.573 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.571+0000 7efc0232f800 20 Filter name: none 2023-12-03T11:37:59.573 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.571+0000 7efb23fff640 20 reqs_thread_entry: start 2023-12-03T11:37:59.573 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.571+0000 7efc0232f800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2023-12-03T11:37:59.573 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.571+0000 7efc0232f800 20 rados->read ofs=0 len=0 2023-12-03T11:37:59.574 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.572+0000 7efc0232f800 20 rados_obj.operate() r=0 bl.length=190 2023-12-03T11:37:59.574 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.572+0000 7efc0232f800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2023-12-03T11:37:59.575 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.572+0000 7efc0232f800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2023-12-03T11:37:59.575 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.572+0000 7efc0232f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2 : miss 2023-12-03T11:37:59.575 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.572+0000 7efc0232f800 20 rados->read ofs=0 len=0 2023-12-03T11:37:59.575 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.572+0000 7efc0232f800 20 rados_obj.operate() r=0 bl.length=368 2023-12-03T11:37:59.575 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.572+0000 7efc0232f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2 info.flags=0x17 2023-12-03T11:37:59.575 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.572+0000 7efc0232f800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2 to cache LRU end 2023-12-03T11:37:59.575 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.572+0000 7efc0232f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:37:59.575 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.572+0000 7efc0232f800 10 updating xattr: name=user.rgw.acl bl.length()=179 2023-12-03T11:37:59.575 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.573+0000 7efc0232f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2 2023-12-03T11:37:59.575 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.573+0000 7efc0232f800 20 list_objects_ordered: starting attempt 1 2023-12-03T11:37:59.575 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.573+0000 7efc0232f800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2023-12-03T11:37:59.576 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.573+0000 7efc0232f800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2023-12-03T11:37:59.576 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.573+0000 7efc0232f800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2023-12-03T11:37:59.576 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.573+0000 7efc0232f800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2023-12-03T11:37:59.576 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.573+0000 7efc0232f800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2023-12-03T11:37:59.579 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.578+0000 7efbc37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:37:59.581 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.580+0000 7efc0232f800 20 remove_watcher() i=0 2023-12-03T11:37:59.581 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.580+0000 7efc0232f800 2 removed watcher, disabling cache 2023-12-03T11:37:59.582 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.581+0000 7efc0232f800 20 remove_watcher() i=1 2023-12-03T11:37:59.584 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.582+0000 7efc0232f800 20 remove_watcher() i=2 2023-12-03T11:37:59.585 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.584+0000 7efc0232f800 20 remove_watcher() i=3 2023-12-03T11:37:59.586 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.585+0000 7efc0232f800 20 remove_watcher() i=4 2023-12-03T11:37:59.587 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.586+0000 7efc0232f800 20 remove_watcher() i=5 2023-12-03T11:37:59.589 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.588+0000 7efc0232f800 20 remove_watcher() i=6 2023-12-03T11:37:59.590 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.589+0000 7efc0232f800 20 remove_watcher() i=7 2023-12-03T11:37:59.596 INFO:tasks.workunit.client.0.smithi003.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2023-12-03T11:37:59.630 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:37:59.630 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:37:59.645 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.644+0000 7f7dd89af800 20 rados->read ofs=0 len=0 2023-12-03T11:37:59.647 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.646+0000 7f7dd89af800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:59.647 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.646+0000 7f7dd89af800 20 realm 2023-12-03T11:37:59.647 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.646+0000 7f7dd89af800 20 rados->read ofs=0 len=0 2023-12-03T11:37:59.647 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.646+0000 7f7dd89af800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:59.647 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.646+0000 7f7dd89af800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:37:59.648 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.646+0000 7f7dd89af800 20 rados->read ofs=0 len=0 2023-12-03T11:37:59.648 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.646+0000 7f7dd89af800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:59.648 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.646+0000 7f7dd89af800 20 rados->read ofs=0 len=0 2023-12-03T11:37:59.648 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.647+0000 7f7dd89af800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:37:59.648 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.647+0000 7f7dd89af800 20 rados->read ofs=0 len=0 2023-12-03T11:37:59.648 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.647+0000 7f7dd89af800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:37:59.648 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.647+0000 7f7dd89af800 20 searching for the correct realm 2023-12-03T11:37:59.660 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.658+0000 7f7dd64af640 0 -- 172.21.15.3:0/1464747523 >> [v2:172.21.15.37:6805/1692844418,v1:172.21.15.37:6807/1692844418] conn(0x5617bb7631d0 msgr2=0x5617bb7655c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-03T11:37:59.716 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.660+0000 7f7dd89af800 20 RGWRados::pool_iterate: got zone_info.83aabb46-04b5-4c96-9933-c6bfb1173a73 2023-12-03T11:37:59.716 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.660+0000 7f7dd89af800 20 RGWRados::pool_iterate: got zonegroup_info.6a811aad-435d-4fdd-93c9-b7e0b50de429 2023-12-03T11:37:59.716 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.660+0000 7f7dd89af800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:37:59.716 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.660+0000 7f7dd89af800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:37:59.717 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.660+0000 7f7dd89af800 20 rados->read ofs=0 len=0 2023-12-03T11:37:59.717 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.660+0000 7f7dd89af800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:59.717 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.660+0000 7f7dd89af800 20 rados->read ofs=0 len=0 2023-12-03T11:37:59.717 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.660+0000 7f7dd89af800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:37:59.717 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.660+0000 7f7dd89af800 20 rados->read ofs=0 len=0 2023-12-03T11:37:59.717 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.660+0000 7f7dd89af800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:37:59.717 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.660+0000 7f7dd89af800 20 zone default found 2023-12-03T11:37:59.717 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.660+0000 7f7dd89af800 4 Realm: () 2023-12-03T11:37:59.717 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.660+0000 7f7dd89af800 4 ZoneGroup: default (6a811aad-435d-4fdd-93c9-b7e0b50de429) 2023-12-03T11:37:59.717 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.660+0000 7f7dd89af800 4 Zone: default (83aabb46-04b5-4c96-9933-c6bfb1173a73) 2023-12-03T11:37:59.717 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.660+0000 7f7dd89af800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:37:59.717 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.660+0000 7f7dd89af800 20 zonegroup default 2023-12-03T11:37:59.717 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.660+0000 7f7dd89af800 20 rados->read ofs=0 len=0 2023-12-03T11:37:59.717 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.661+0000 7f7dd89af800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:59.718 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.661+0000 7f7dd89af800 20 rados->read ofs=0 len=0 2023-12-03T11:37:59.718 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.661+0000 7f7dd89af800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:59.718 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.661+0000 7f7dd89af800 20 rados->read ofs=0 len=0 2023-12-03T11:37:59.718 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.661+0000 7f7dd89af800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:59.718 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.661+0000 7f7dd89af800 20 started sync module instance, tier type = 2023-12-03T11:37:59.718 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.661+0000 7f7dd89af800 20 started zone id=83aabb46-04b5-4c96-9933-c6bfb1173a73 (name=default) with tier type = 2023-12-03T11:37:59.718 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.673+0000 7f7dd5cae640 0 -- 172.21.15.3:0/1464747523 >> [v2:172.21.15.3:6817/3356208405,v1:172.21.15.3:6819/3356208405] conn(0x5617bb768170 msgr2=0x5617bb76a560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:37:59.718 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.675+0000 7f7dd89af800 20 add_watcher() i=0 2023-12-03T11:37:59.718 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.675+0000 7f7dd89af800 20 add_watcher() i=1 2023-12-03T11:37:59.718 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.675+0000 7f7dd89af800 20 add_watcher() i=2 2023-12-03T11:37:59.718 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.675+0000 7f7dd89af800 20 add_watcher() i=3 2023-12-03T11:37:59.718 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.675+0000 7f7dd89af800 20 add_watcher() i=4 2023-12-03T11:37:59.718 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.675+0000 7f7dd89af800 20 add_watcher() i=5 2023-12-03T11:37:59.719 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.675+0000 7f7dd89af800 20 add_watcher() i=6 2023-12-03T11:37:59.719 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.676+0000 7f7dd89af800 20 add_watcher() i=7 2023-12-03T11:37:59.719 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.676+0000 7f7dd89af800 2 all 8 watchers are set, enabling cache 2023-12-03T11:37:59.719 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.678+0000 7f7d9bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:37:59.719 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.678+0000 7f7dd89af800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:37:59.719 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.678+0000 7f7dd89af800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:37:59.719 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.684+0000 7f7dd89af800 5 note: GC not initialized 2023-12-03T11:37:59.719 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.684+0000 7f7d0affd640 20 reqs_thread_entry: start 2023-12-03T11:37:59.719 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.684+0000 7f7dd89af800 20 init_complete bucket index max shards: 11 2023-12-03T11:37:59.719 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.684+0000 7f7dd89af800 20 Filter name: none 2023-12-03T11:37:59.719 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.685+0000 7f7d08ff9640 20 reqs_thread_entry: start 2023-12-03T11:37:59.719 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.685+0000 7f7dd89af800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2023-12-03T11:37:59.719 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.685+0000 7f7dd89af800 20 rados->read ofs=0 len=0 2023-12-03T11:37:59.719 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.685+0000 7f7dd89af800 20 rados_obj.operate() r=0 bl.length=190 2023-12-03T11:37:59.719 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.685+0000 7f7dd89af800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2023-12-03T11:37:59.720 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.685+0000 7f7dd89af800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2023-12-03T11:37:59.720 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.685+0000 7f7dd89af800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2 : miss 2023-12-03T11:37:59.720 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.685+0000 7f7dd89af800 20 rados->read ofs=0 len=0 2023-12-03T11:37:59.720 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.685+0000 7f7dd89af800 20 rados_obj.operate() r=0 bl.length=368 2023-12-03T11:37:59.720 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.685+0000 7f7dd89af800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2 info.flags=0x17 2023-12-03T11:37:59.720 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.685+0000 7f7dd89af800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2 to cache LRU end 2023-12-03T11:37:59.720 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.685+0000 7f7dd89af800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:37:59.720 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.685+0000 7f7dd89af800 10 updating xattr: name=user.rgw.acl bl.length()=179 2023-12-03T11:37:59.720 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.685+0000 7f7dd89af800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2 2023-12-03T11:37:59.720 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.686+0000 7f7dd89af800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.0 2023-12-03T11:37:59.720 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.686+0000 7f7dd89af800 1 NOTICE: finished shard 0 (0 entries removed) 2023-12-03T11:37:59.720 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.686+0000 7f7dd89af800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.1 2023-12-03T11:37:59.720 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.687+0000 7f7dd89af800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.2 2023-12-03T11:37:59.720 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.687+0000 7f7dd89af800 1 NOTICE: finished shard 2 (0 entries removed) 2023-12-03T11:37:59.720 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.687+0000 7f7dd89af800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.3 2023-12-03T11:37:59.721 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.687+0000 7f7dd89af800 1 NOTICE: finished shard 3 (0 entries removed) 2023-12-03T11:37:59.721 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.687+0000 7f7dd89af800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.4 2023-12-03T11:37:59.721 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.688+0000 7f7dd89af800 1 NOTICE: finished shard 4 (0 entries removed) 2023-12-03T11:37:59.721 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.688+0000 7f7dd89af800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.5 2023-12-03T11:37:59.721 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.688+0000 7f7dd89af800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.6 2023-12-03T11:37:59.721 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.689+0000 7f7dd89af800 1 NOTICE: finished shard 6 (0 entries removed) 2023-12-03T11:37:59.721 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.689+0000 7f7dd89af800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.7 2023-12-03T11:37:59.721 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.689+0000 7f7dd89af800 1 NOTICE: finished shard 7 (0 entries removed) 2023-12-03T11:37:59.721 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.689+0000 7f7dd89af800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.8 2023-12-03T11:37:59.721 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.690+0000 7f7dd89af800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.9 2023-12-03T11:37:59.721 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.690+0000 7f7dd89af800 1 NOTICE: finished shard 9 (0 entries removed) 2023-12-03T11:37:59.721 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.690+0000 7f7dd89af800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.10 2023-12-03T11:37:59.721 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.691+0000 7f7dd89af800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.1 2023-12-03T11:37:59.721 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.691+0000 7f7dd89af800 20 get_obj_state: octx=0x7f7dc804a000 obj=check-bucket:e state=0x5617bb814ce8 s->prefetch_data=0 2023-12-03T11:37:59.721 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.691+0000 7f7dd89af800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.5 2023-12-03T11:37:59.722 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.691+0000 7f7dd89af800 20 get_obj_state: octx=0x7f7dd0056510 obj=check-bucket:d state=0x5617bb816c28 s->prefetch_data=0 2023-12-03T11:37:59.722 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.691+0000 7f7dd89af800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.8 2023-12-03T11:37:59.722 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.692+0000 7f7dd89af800 20 get_obj_state: octx=0x5617bb59bfa0 obj=check-bucket:c state=0x5617bb87a398 s->prefetch_data=0 2023-12-03T11:37:59.722 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.692+0000 7f7dd89af800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.10 2023-12-03T11:37:59.722 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.692+0000 7f7dd89af800 20 get_obj_state: octx=0x5617bb7f2530 obj=check-bucket:f state=0x5617bb87b868 s->prefetch_data=0 2023-12-03T11:37:59.722 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.692+0000 7f7dd89af800 20 get_obj_state: setting s->obj_tag to 97sib27ggm71cnzkxkkdxe566627v0jw 2023-12-03T11:37:59.722 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.692+0000 7f7dd89af800 20 get_obj_state_impl: setting s->olh_tag to 04pw0iripsto3ne1itbvvzk9jj9ihrfe 2023-12-03T11:37:59.722 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.692+0000 7f7dd89af800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=04pw0iripsto3ne1itbvvzk9jj9ihrfe 2023-12-03T11:37:59.722 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.692+0000 7f7dd89af800 20 get_obj_state: setting s->obj_tag to zaxlje19kcflvht0scv44sqh12mtnf3i 2023-12-03T11:37:59.722 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.692+0000 7f7dd89af800 20 get_obj_state_impl: setting s->olh_tag to acuylojas932m20rtjtr5f9myfd9uc69 2023-12-03T11:37:59.722 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.692+0000 7f7dd89af800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=acuylojas932m20rtjtr5f9myfd9uc69 2023-12-03T11:37:59.722 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.692+0000 7f7dd89af800 20 get_obj_state: setting s->obj_tag to sn20lt1gmjq2ajzdw5oxjm2mbdwlpig9 2023-12-03T11:37:59.722 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.692+0000 7f7dd89af800 20 get_obj_state_impl: setting s->olh_tag to xeb5d0qpfw6dgckgpc9mtxwxuh2126vq 2023-12-03T11:37:59.723 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.692+0000 7f7dd89af800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=xeb5d0qpfw6dgckgpc9mtxwxuh2126vq 2023-12-03T11:37:59.723 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.692+0000 7f7dd89af800 20 get_obj_state: setting s->obj_tag to odn1piu24f1iy954bud0z2vizbh01up4 2023-12-03T11:37:59.723 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.692+0000 7f7dd89af800 20 get_obj_state_impl: setting s->olh_tag to pc7lw768haybnq91oap13k9cxwhwdzb0 2023-12-03T11:37:59.723 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.692+0000 7f7dd89af800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=pc7lw768haybnq91oap13k9cxwhwdzb0 2023-12-03T11:37:59.723 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.694+0000 7f7dd89af800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.8 2023-12-03T11:37:59.723 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.694+0000 7f7dd89af800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.5 2023-12-03T11:37:59.723 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.695+0000 7f7dd89af800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.1 2023-12-03T11:37:59.723 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.696+0000 7f7dd89af800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.8 2023-12-03T11:37:59.723 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.696+0000 7f7dd89af800 20 olh_log_entry: epoch=3 op=3 key=c[R6L072nXXbFOR1Ubv3206TyLhEuwb2v] 2023-12-03T11:37:59.723 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.696+0000 7f7dd89af800 20 get_obj_state: octx=0x5617bb59bfa0 obj=check-bucket:_:R6L072nXXbFOR1Ubv3206TyLhEuwb2v_c state=0x5617bb893668 s->prefetch_data=0 2023-12-03T11:37:59.723 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.696+0000 7f7dd89af800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.5 2023-12-03T11:37:59.723 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.696+0000 7f7dd89af800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.1 2023-12-03T11:37:59.723 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.696+0000 7f7dd89af800 20 olh_log_entry: epoch=3 op=3 key=d[x7NOwE0M9Og8Esei.zfDYOsZNN1KBzv] 2023-12-03T11:37:59.724 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.696+0000 7f7dd89af800 20 get_obj_state: octx=0x7f7dd0056510 obj=check-bucket:_:x7NOwE0M9Og8Esei.zfDYOsZNN1KBzv_d state=0x5617bb8909d8 s->prefetch_data=0 2023-12-03T11:37:59.724 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.697+0000 7f7dd89af800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.10 2023-12-03T11:37:59.724 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.697+0000 7f7dd89af800 10 manifest: total_size = 11 2023-12-03T11:37:59.724 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.697+0000 7f7dd89af800 20 get_obj_state: setting s->obj_tag to 83aabb46-04b5-4c96-9933-c6bfb1173a73.4653.6760711108833191147 2023-12-03T11:37:59.724 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.697+0000 7f7dd89af800 20 get_obj_state: octx=0x5617bb59bfa0 obj=check-bucket:_:R6L072nXXbFOR1Ubv3206TyLhEuwb2v_c state=0x5617bb893668 s->prefetch_data=0 2023-12-03T11:37:59.724 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.697+0000 7f7dd89af800 20 prepare_atomic_modification: state is not atomic. state=0x5617bb893668 2023-12-03T11:37:59.724 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.697+0000 7f7dd89af800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.8 2023-12-03T11:37:59.724 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.697+0000 7f7dd89af800 20 olh_log_entry: epoch=2 op=2 key=e[] 2023-12-03T11:37:59.724 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.697+0000 7f7dd89af800 20 olh_log_entry: epoch=2 op=3 key=e[vQq5HCio1qJuWYfR26ZExH8P6YkMz2V] 2023-12-03T11:37:59.724 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.697+0000 7f7dd89af800 20 get_obj_state: octx=0x7f7dc804a000 obj=check-bucket:_:vQq5HCio1qJuWYfR26ZExH8P6YkMz2V_e state=0x5617bb8a2c18 s->prefetch_data=0 2023-12-03T11:37:59.724 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.697+0000 7f7dd89af800 10 manifest: total_size = 22 2023-12-03T11:37:59.724 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.697+0000 7f7dd89af800 20 get_obj_state: setting s->obj_tag to 83aabb46-04b5-4c96-9933-c6bfb1173a73.4653.4119294223088228998 2023-12-03T11:37:59.724 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.697+0000 7f7dd89af800 20 get_obj_state: octx=0x7f7dd0056510 obj=check-bucket:_:x7NOwE0M9Og8Esei.zfDYOsZNN1KBzv_d state=0x5617bb8909d8 s->prefetch_data=0 2023-12-03T11:37:59.724 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.697+0000 7f7dd89af800 20 prepare_atomic_modification: state is not atomic. state=0x5617bb8909d8 2023-12-03T11:37:59.725 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.697+0000 7f7dd89af800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.5 2023-12-03T11:37:59.725 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.697+0000 7f7dd89af800 10 manifest: total_size = 22 2023-12-03T11:37:59.725 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.697+0000 7f7dd89af800 20 get_obj_state: setting s->obj_tag to 83aabb46-04b5-4c96-9933-c6bfb1173a73.4653.14450384866986390991 2023-12-03T11:37:59.725 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.697+0000 7f7dd89af800 20 get_obj_state: octx=0x7f7dc804a000 obj=check-bucket:_:vQq5HCio1qJuWYfR26ZExH8P6YkMz2V_e state=0x5617bb8a2c18 s->prefetch_data=0 2023-12-03T11:37:59.725 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.697+0000 7f7dd89af800 20 prepare_atomic_modification: state is not atomic. state=0x5617bb8a2c18 2023-12-03T11:37:59.725 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.697+0000 7f7dd89af800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.1 2023-12-03T11:37:59.725 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.700+0000 7f7dd89af800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.10 2023-12-03T11:37:59.725 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.700+0000 7f7dd89af800 20 olh_log_entry: epoch=2 op=2 key=f[] 2023-12-03T11:37:59.725 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.700+0000 7f7dd89af800 20 olh_log_entry: epoch=2 op=3 key=f[v4xF3TUpiNFzNCw-74jG6tGd9LlZqgd] 2023-12-03T11:37:59.725 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.700+0000 7f7dd89af800 20 get_obj_state: octx=0x5617bb7f2530 obj=check-bucket:_:v4xF3TUpiNFzNCw-74jG6tGd9LlZqgd_f state=0x5617bb8a9ce8 s->prefetch_data=0 2023-12-03T11:37:59.725 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.701+0000 7f7dd89af800 10 manifest: total_size = 22 2023-12-03T11:37:59.725 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.701+0000 7f7dd89af800 20 get_obj_state: setting s->obj_tag to 83aabb46-04b5-4c96-9933-c6bfb1173a73.4653.18372767989573052254 2023-12-03T11:37:59.725 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.701+0000 7f7dd89af800 20 get_obj_state: octx=0x5617bb7f2530 obj=check-bucket:_:v4xF3TUpiNFzNCw-74jG6tGd9LlZqgd_f state=0x5617bb8a9ce8 s->prefetch_data=0 2023-12-03T11:37:59.725 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.701+0000 7f7dd89af800 20 prepare_atomic_modification: state is not atomic. state=0x5617bb8a9ce8 2023-12-03T11:37:59.725 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.701+0000 7f7dd89af800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.10 2023-12-03T11:37:59.726 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.704+0000 7f7dc4ff9640 20 handle_completion(): completion ok for obj=c[R6L072nXXbFOR1Ubv3206TyLhEuwb2v] 2023-12-03T11:37:59.726 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.704+0000 7f7dd89af800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.8 2023-12-03T11:37:59.726 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.704+0000 7f7dd89af800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.8 2023-12-03T11:37:59.726 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.705+0000 7f7dc4ff9640 20 handle_completion(): completion ok for obj=d[x7NOwE0M9Og8Esei.zfDYOsZNN1KBzv] 2023-12-03T11:37:59.726 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.706+0000 7f7dd89af800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.8 2023-12-03T11:37:59.726 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.706+0000 7f7dd89af800 1 NOTICE: finished shard 8 (1 entries removed) 2023-12-03T11:37:59.726 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.708+0000 7f7dc4ff9640 20 handle_completion(): completion ok for obj=e[vQq5HCio1qJuWYfR26ZExH8P6YkMz2V] 2023-12-03T11:37:59.726 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.708+0000 7f7dd89af800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.5 2023-12-03T11:37:59.726 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.708+0000 7f7dd89af800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.5 2023-12-03T11:37:59.726 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.709+0000 7f7dd89af800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.5 2023-12-03T11:37:59.726 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.709+0000 7f7dd89af800 1 NOTICE: finished shard 5 (1 entries removed) 2023-12-03T11:37:59.726 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.711+0000 7f7dd89af800 20 get_obj_state: octx=0x7f7dc804a000 obj=check-bucket:e state=0x5617bb814ce8 s->prefetch_data=0 2023-12-03T11:37:59.726 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.711+0000 7f7dd89af800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=04pw0iripsto3ne1itbvvzk9jj9ihrfe 2023-12-03T11:37:59.727 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.716+0000 7f7db7fff640 20 handle_completion(): completion ok for obj=f[v4xF3TUpiNFzNCw-74jG6tGd9LlZqgd] 2023-12-03T11:37:59.727 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.716+0000 7f7dd89af800 20 get_obj_state: octx=0x5617bb7f2530 obj=check-bucket:f state=0x5617bb87b868 s->prefetch_data=0 2023-12-03T11:37:59.727 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.716+0000 7f7dd89af800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=pc7lw768haybnq91oap13k9cxwhwdzb0 2023-12-03T11:37:59.727 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.721+0000 7f7dd89af800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.1 2023-12-03T11:37:59.728 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.722+0000 7f7dd89af800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.1 2023-12-03T11:37:59.728 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.722+0000 7f7dd89af800 1 NOTICE: finished shard 1 (1 entries removed) 2023-12-03T11:37:59.730 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.729+0000 7f7dd89af800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.10 2023-12-03T11:37:59.734 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.732+0000 7f7dd89af800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.2.10 2023-12-03T11:37:59.734 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.733+0000 7f7dd89af800 1 NOTICE: finished shard 10 (1 entries removed) 2023-12-03T11:37:59.734 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.733+0000 7f7dd89af800 1 NOTICE: finished all shards (4 entries removed) 2023-12-03T11:37:59.734 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.733+0000 7f7d9bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:37:59.737 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.736+0000 7f7dd89af800 20 remove_watcher() i=0 2023-12-03T11:37:59.737 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.736+0000 7f7dd89af800 2 removed watcher, disabling cache 2023-12-03T11:37:59.738 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.737+0000 7f7dd89af800 20 remove_watcher() i=1 2023-12-03T11:37:59.739 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.738+0000 7f7dd89af800 20 remove_watcher() i=2 2023-12-03T11:37:59.740 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.739+0000 7f7dd89af800 20 remove_watcher() i=3 2023-12-03T11:37:59.741 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.740+0000 7f7dd89af800 20 remove_watcher() i=4 2023-12-03T11:37:59.742 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.741+0000 7f7dd89af800 20 remove_watcher() i=5 2023-12-03T11:37:59.744 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.743+0000 7f7dd89af800 20 remove_watcher() i=6 2023-12-03T11:37:59.745 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.744+0000 7f7dd89af800 20 remove_watcher() i=7 2023-12-03T11:37:59.954 INFO:tasks.workunit.client.0.smithi003.stderr:radosgw-admin bucket stats --bucket check-bucket 2023-12-03T11:37:59.981 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:37:59.982 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:37:59.995 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.994+0000 7ff79b72f800 20 rados->read ofs=0 len=0 2023-12-03T11:37:59.998 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.996+0000 7ff79b72f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:59.998 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.996+0000 7ff79b72f800 20 realm 2023-12-03T11:37:59.998 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.996+0000 7ff79b72f800 20 rados->read ofs=0 len=0 2023-12-03T11:37:59.998 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.996+0000 7ff79b72f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:59.998 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.996+0000 7ff79b72f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:37:59.998 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.996+0000 7ff79b72f800 20 rados->read ofs=0 len=0 2023-12-03T11:37:59.998 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.997+0000 7ff79b72f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:59.998 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.997+0000 7ff79b72f800 20 rados->read ofs=0 len=0 2023-12-03T11:37:59.999 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.997+0000 7ff79b72f800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:37:59.999 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.997+0000 7ff79b72f800 20 rados->read ofs=0 len=0 2023-12-03T11:37:59.999 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.998+0000 7ff79b72f800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:37:59.999 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:37:59.998+0000 7ff79b72f800 20 searching for the correct realm 2023-12-03T11:38:00.010 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:38:00.009+0000 7ff797b7f640 0 -- 172.21.15.3:0/3000185764 >> [v2:172.21.15.37:6816/3770469300,v1:172.21.15.37:6818/3770469300] conn(0x7ff78c064950 msgr2=0x7ff78c0723f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:38:00.010 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:38:00.009+0000 7ff79b72f800 20 RGWRados::pool_iterate: got zone_info.83aabb46-04b5-4c96-9933-c6bfb1173a73 2023-12-03T11:38:00.010 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:38:00.009+0000 7ff79b72f800 20 RGWRados::pool_iterate: got zonegroup_info.6a811aad-435d-4fdd-93c9-b7e0b50de429 2023-12-03T11:38:00.010 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:38:00.009+0000 7ff79b72f800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:38:00.010 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:38:00.009+0000 7ff79b72f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:38:00.011 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:38:00.009+0000 7ff79b72f800 20 rados->read ofs=0 len=0 2023-12-03T11:38:00.011 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:38:00.009+0000 7ff79b72f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:00.011 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:38:00.009+0000 7ff79b72f800 20 rados->read ofs=0 len=0 2023-12-03T11:38:00.012 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:38:00.009+0000 7ff79b72f800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:38:00.012 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:38:00.009+0000 7ff79b72f800 20 rados->read ofs=0 len=0 2023-12-03T11:38:00.012 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:38:00.010+0000 7ff79b72f800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:38:00.012 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:38:00.010+0000 7ff79b72f800 20 zone default found 2023-12-03T11:38:00.012 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:38:00.010+0000 7ff79b72f800 4 Realm: () 2023-12-03T11:38:00.012 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:38:00.010+0000 7ff79b72f800 4 ZoneGroup: default (6a811aad-435d-4fdd-93c9-b7e0b50de429) 2023-12-03T11:38:00.012 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:38:00.010+0000 7ff79b72f800 4 Zone: default (83aabb46-04b5-4c96-9933-c6bfb1173a73) 2023-12-03T11:38:00.013 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:38:00.010+0000 7ff79b72f800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:38:00.013 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:38:00.010+0000 7ff79b72f800 20 zonegroup default 2023-12-03T11:38:00.013 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:38:00.010+0000 7ff79b72f800 20 rados->read ofs=0 len=0 2023-12-03T11:38:00.013 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:38:00.010+0000 7ff79b72f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:00.013 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:38:00.010+0000 7ff79b72f800 20 rados->read ofs=0 len=0 2023-12-03T11:38:00.013 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:38:00.010+0000 7ff79b72f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:00.013 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:38:00.010+0000 7ff79b72f800 20 rados->read ofs=0 len=0 2023-12-03T11:38:00.013 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:38:00.010+0000 7ff79b72f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:00.013 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:38:00.010+0000 7ff79b72f800 20 started sync module instance, tier type = 2023-12-03T11:38:00.013 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:38:00.011+0000 7ff79b72f800 20 started zone id=83aabb46-04b5-4c96-9933-c6bfb1173a73 (name=default) with tier type = 2023-12-03T11:38:00.021 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:38:00.020+0000 7ff79737e640 0 -- 172.21.15.3:0/3000185764 >> [v2:172.21.15.3:6808/263125788,v1:172.21.15.3:6809/263125788] conn(0x7ff78c07f3e0 msgr2=0x7ff78c07f840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:38:00.022 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:38:00.020+0000 7ff79b72f800 20 add_watcher() i=0 2023-12-03T11:38:00.022 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:38:00.020+0000 7ff79b72f800 20 add_watcher() i=1 2023-12-03T11:38:00.022 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:38:00.020+0000 7ff79b72f800 20 add_watcher() i=2 2023-12-03T11:38:00.022 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:38:00.020+0000 7ff79b72f800 20 add_watcher() i=3 2023-12-03T11:38:00.022 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:38:00.020+0000 7ff79b72f800 20 add_watcher() i=4 2023-12-03T11:38:00.022 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:38:00.020+0000 7ff79b72f800 20 add_watcher() i=5 2023-12-03T11:38:00.022 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:38:00.020+0000 7ff79b72f800 20 add_watcher() i=6 2023-12-03T11:38:00.023 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:38:00.021+0000 7ff79b72f800 20 add_watcher() i=7 2023-12-03T11:38:00.023 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:38:00.021+0000 7ff79b72f800 2 all 8 watchers are set, enabling cache 2023-12-03T11:38:00.024 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:38:00.023+0000 7ff75d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:38:00.024 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:38:00.023+0000 7ff79b72f800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:38:00.025 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:38:00.023+0000 7ff79b72f800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:38:00.031 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:38:00.029+0000 7ff79b72f800 5 note: GC not initialized 2023-12-03T11:38:00.031 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:38:00.030+0000 7ff6cbfff640 20 reqs_thread_entry: start 2023-12-03T11:38:00.031 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:38:00.030+0000 7ff79b72f800 20 init_complete bucket index max shards: 11 2023-12-03T11:38:00.031 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:38:00.030+0000 7ff79b72f800 20 Filter name: none 2023-12-03T11:38:00.031 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:38:00.030+0000 7ff6c9ffb640 20 reqs_thread_entry: start 2023-12-03T11:38:00.031 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:38:00.030+0000 7ff79b72f800 20 rados->read ofs=0 len=0 2023-12-03T11:38:00.032 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:38:00.030+0000 7ff79b72f800 20 rados_obj.operate() r=0 bl.length=190 2023-12-03T11:38:00.032 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:38:00.030+0000 7ff79b72f800 20 rados->read ofs=0 len=0 2023-12-03T11:38:00.032 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:38:00.031+0000 7ff79b72f800 20 rados_obj.operate() r=0 bl.length=368 2023-12-03T11:38:00.032 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:38:00.031+0000 7ff79b72f800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:38:00.033 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:38:00.031+0000 7ff79b72f800 20 rados->read ofs=0 len=0 2023-12-03T11:38:00.033 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:38:00.031+0000 7ff79b72f800 20 rados_obj.operate() r=0 bl.length=190 2023-12-03T11:38:00.033 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:38:00.031+0000 7ff79b72f800 20 rados->read ofs=0 len=0 2023-12-03T11:38:00.033 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:38:00.032+0000 7ff79b72f800 20 rados_obj.operate() r=0 bl.length=368 2023-12-03T11:38:00.033 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:38:00.032+0000 7ff79b72f800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:38:00.034 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:38:00.033+0000 7ff79b72f800 20 rados->read ofs=0 len=0 2023-12-03T11:38:00.034 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:38:00.033+0000 7ff79b72f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:00.035 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:38:00.034+0000 7ff75d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:38:00.037 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:38:00.036+0000 7ff79b72f800 20 remove_watcher() i=0 2023-12-03T11:38:00.037 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:38:00.036+0000 7ff79b72f800 2 removed watcher, disabling cache 2023-12-03T11:38:00.039 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:38:00.038+0000 7ff79b72f800 20 remove_watcher() i=1 2023-12-03T11:38:00.040 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:38:00.039+0000 7ff79b72f800 20 remove_watcher() i=2 2023-12-03T11:38:00.041 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:38:00.040+0000 7ff79b72f800 20 remove_watcher() i=3 2023-12-03T11:38:00.042 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:38:00.041+0000 7ff79b72f800 20 remove_watcher() i=4 2023-12-03T11:38:00.043 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:38:00.042+0000 7ff79b72f800 20 remove_watcher() i=5 2023-12-03T11:38:00.044 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:38:00.043+0000 7ff79b72f800 20 remove_watcher() i=6 2023-12-03T11:38:00.045 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:38:00.044+0000 7ff79b72f800 20 remove_watcher() i=7 2023-12-03T11:38:00.049 INFO:tasks.workunit.client.0.smithi003.stderr:{'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}} 2023-12-03T11:38:00.050 INFO:tasks.workunit.client.0.smithi003.stderr:Deleting bucket check-bucket 2023-12-03T11:38:00.277 INFO:tasks.workunit.client.0.smithi003.stderr:Completed bucket check tests 2023-12-03T11:38:00.277 INFO:tasks.workunit.client.0.smithi003.stdout:connected to http://localhost:80 2023-12-03T11:38:00.333 INFO:tasks.workunit.client.0.smithi003.stderr:+ deactivate 2023-12-03T11:38:00.334 INFO:tasks.workunit.client.0.smithi003.stderr:+ '[' -n /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin ']' 2023-12-03T11:38:00.334 INFO:tasks.workunit.client.0.smithi003.stderr:+ PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2023-12-03T11:38:00.334 INFO:tasks.workunit.client.0.smithi003.stderr:+ export PATH 2023-12-03T11:38:00.334 INFO:tasks.workunit.client.0.smithi003.stderr:+ unset _OLD_VIRTUAL_PATH 2023-12-03T11:38:00.334 INFO:tasks.workunit.client.0.smithi003.stderr:+ '[' -n '' ']' 2023-12-03T11:38:00.334 INFO:tasks.workunit.client.0.smithi003.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2023-12-03T11:38:00.334 INFO:tasks.workunit.client.0.smithi003.stderr:+ hash -r 2023-12-03T11:38:00.334 INFO:tasks.workunit.client.0.smithi003.stderr:+ '[' -n '' ']' 2023-12-03T11:38:00.334 INFO:tasks.workunit.client.0.smithi003.stderr:+ unset VIRTUAL_ENV 2023-12-03T11:38:00.334 INFO:tasks.workunit.client.0.smithi003.stderr:+ '[' '!' '' = nondestructive ']' 2023-12-03T11:38:00.334 INFO:tasks.workunit.client.0.smithi003.stderr:+ unset -f deactivate 2023-12-03T11:38:00.334 INFO:tasks.workunit.client.0.smithi003.stderr:+ echo OK. 2023-12-03T11:38:00.335 INFO:tasks.workunit.client.0.smithi003.stdout:OK. 2023-12-03T11:38:00.336 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-12-03T11:38:00.336 DEBUG:teuthology.orchestra.run.smithi003:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-12-03T11:38:00.407 INFO:tasks.workunit:Stopping ['rgw/run-bucket-check.sh'] on client.0... 2023-12-03T11:38:00.407 DEBUG:teuthology.orchestra.run.smithi003:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2023-12-03T11:38:00.765 DEBUG:teuthology.parallel:result is None 2023-12-03T11:38:00.765 DEBUG:teuthology.orchestra.run.smithi003:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2023-12-03T11:38:00.797 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2023-12-03T11:38:00.797 DEBUG:teuthology.orchestra.run.smithi003:> rmdir -- /home/ubuntu/cephtest/mnt.0 2023-12-03T11:38:00.852 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2023-12-03T11:38:00.852 INFO:teuthology.run_tasks:Running task workunit... 2023-12-03T11:38:00.862 INFO:tasks.workunit:Pulling workunits from ref bcbf278cf395873c2a482f5a7b2345faf2160319 2023-12-03T11:38:00.862 INFO:tasks.workunit:Making a separate scratch dir for every client... 2023-12-03T11:38:00.862 DEBUG:teuthology.orchestra.run.smithi003:> stat -- /home/ubuntu/cephtest/mnt.0 2023-12-03T11:38:00.907 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-03T11:38:00.907 INFO:teuthology.orchestra.run.smithi003.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2023-12-03T11:38:00.908 DEBUG:teuthology.orchestra.run.smithi003:> mkdir -- /home/ubuntu/cephtest/mnt.0 2023-12-03T11:38:00.963 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2023-12-03T11:38:00.963 DEBUG:teuthology.orchestra.run.smithi003:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2023-12-03T11:38:01.018 INFO:tasks.workunit:timeout=3h 2023-12-03T11:38:01.018 INFO:tasks.workunit:cleanup=True 2023-12-03T11:38:01.018 DEBUG:teuthology.orchestra.run.smithi003:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout bcbf278cf395873c2a482f5a7b2345faf2160319 2023-12-03T11:38:01.074 INFO:tasks.workunit.client.0.smithi003.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2023-12-03T11:39:06.704 INFO:tasks.workunit.client.0.smithi003.stderr:Updating files: 98% (11930/12123) Updating files: 99% (12002/12123) Updating files: 100% (12123/12123) Updating files: 100% (12123/12123), done. 2023-12-03T11:39:07.300 INFO:tasks.workunit.client.0.smithi003.stderr:Note: switching to 'bcbf278cf395873c2a482f5a7b2345faf2160319'. 2023-12-03T11:39:07.300 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:39:07.300 INFO:tasks.workunit.client.0.smithi003.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-12-03T11:39:07.300 INFO:tasks.workunit.client.0.smithi003.stderr:changes and commit them, and you can discard any commits you make in this 2023-12-03T11:39:07.300 INFO:tasks.workunit.client.0.smithi003.stderr:state without impacting any branches by switching back to a branch. 2023-12-03T11:39:07.300 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:39:07.300 INFO:tasks.workunit.client.0.smithi003.stderr:If you want to create a new branch to retain commits you create, you may 2023-12-03T11:39:07.300 INFO:tasks.workunit.client.0.smithi003.stderr:do so (now or later) by using -c with the switch command. Example: 2023-12-03T11:39:07.300 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:39:07.300 INFO:tasks.workunit.client.0.smithi003.stderr: git switch -c 2023-12-03T11:39:07.300 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:39:07.300 INFO:tasks.workunit.client.0.smithi003.stderr:Or undo this operation with: 2023-12-03T11:39:07.301 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:39:07.301 INFO:tasks.workunit.client.0.smithi003.stderr: git switch - 2023-12-03T11:39:07.301 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:39:07.301 INFO:tasks.workunit.client.0.smithi003.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-12-03T11:39:07.301 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:39:07.301 INFO:tasks.workunit.client.0.smithi003.stderr:HEAD is now at bcbf278cf39 RGW:pubsub publish commit with etag populated 2023-12-03T11:39:07.303 DEBUG:teuthology.orchestra.run.smithi003:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2023-12-03T11:39:07.359 INFO:tasks.workunit.client.0.smithi003.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2023-12-03T11:39:07.361 INFO:tasks.workunit.client.0.smithi003.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-12-03T11:39:07.361 INFO:tasks.workunit.client.0.smithi003.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2023-12-03T11:39:07.411 INFO:tasks.workunit.client.0.smithi003.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2023-12-03T11:39:07.462 INFO:tasks.workunit.client.0.smithi003.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2023-12-03T11:39:07.504 INFO:tasks.workunit.client.0.smithi003.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-12-03T11:39:07.506 INFO:tasks.workunit.client.0.smithi003.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-12-03T11:39:07.506 INFO:tasks.workunit.client.0.smithi003.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2023-12-03T11:39:07.546 INFO:tasks.workunit.client.0.smithi003.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-12-03T11:39:07.549 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-12-03T11:39:07.549 DEBUG:teuthology.orchestra.run.smithi003:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2023-12-03T11:39:07.605 INFO:tasks.workunit:Running workunits matching cls/test_cls_lock.sh on client.0... 2023-12-03T11:39:07.606 INFO:tasks.workunit:Running workunit cls/test_cls_lock.sh... 2023-12-03T11:39:07.606 DEBUG:teuthology.orchestra.run.smithi003:workunit test cls/test_cls_lock.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bcbf278cf395873c2a482f5a7b2345faf2160319 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_lock.sh 2023-12-03T11:39:07.674 INFO:tasks.workunit.client.0.smithi003.stdout:Running main() from gmock_main.cc 2023-12-03T11:39:07.675 INFO:tasks.workunit.client.0.smithi003.stdout:[==========] Running 11 tests from 1 test suite. 2023-12-03T11:39:07.675 INFO:tasks.workunit.client.0.smithi003.stdout:[----------] Global test environment set-up. 2023-12-03T11:39:07.675 INFO:tasks.workunit.client.0.smithi003.stdout:[----------] 11 tests from ClsLock 2023-12-03T11:39:07.675 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] ClsLock.TestMultiLocking 2023-12-03T11:39:09.928 INFO:tasks.workunit.client.0.smithi003.stdout:lock: mylock 2023-12-03T11:39:09.929 INFO:tasks.workunit.client.0.smithi003.stdout: lock_type: exclusive 2023-12-03T11:39:09.929 INFO:tasks.workunit.client.0.smithi003.stdout: tag: 2023-12-03T11:39:09.929 INFO:tasks.workunit.client.0.smithi003.stdout: lockers: 2023-12-03T11:39:09.929 INFO:tasks.workunit.client.0.smithi003.stdout: client.5295 expiration=2023-12-03T11:41:09.922819+0000 addr=v1:172.21.15.3:0/2950719659 cookie= 2023-12-03T11:39:09.936 INFO:tasks.workunit.client.0.smithi003.stdout:lock: mylock 2023-12-03T11:39:09.936 INFO:tasks.workunit.client.0.smithi003.stdout: lock_type: shared 2023-12-03T11:39:09.936 INFO:tasks.workunit.client.0.smithi003.stdout: tag: 2023-12-03T11:39:09.936 INFO:tasks.workunit.client.0.smithi003.stdout: lockers: 2023-12-03T11:39:09.936 INFO:tasks.workunit.client.0.smithi003.stdout: client.5126 expiration=0.000000 addr=v1:172.21.15.3:0/4209202517 cookie= 2023-12-03T11:39:09.936 INFO:tasks.workunit.client.0.smithi003.stdout: client.5295 expiration=2023-12-03T11:41:09.932796+0000 addr=v1:172.21.15.3:0/2950719659 cookie= 2023-12-03T11:39:09.938 INFO:tasks.workunit.client.0.smithi003.stdout:lock: mylock 2023-12-03T11:39:09.938 INFO:tasks.workunit.client.0.smithi003.stdout: lock_type: shared 2023-12-03T11:39:09.938 INFO:tasks.workunit.client.0.smithi003.stdout: tag: 2023-12-03T11:39:09.938 INFO:tasks.workunit.client.0.smithi003.stdout: lockers: 2023-12-03T11:39:09.938 INFO:tasks.workunit.client.0.smithi003.stdout: client.5126 expiration=0.000000 addr=v1:172.21.15.3:0/4209202517 cookie= 2023-12-03T11:39:10.494 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] ClsLock.TestMultiLocking (2820 ms) 2023-12-03T11:39:10.494 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] ClsLock.TestMeta 2023-12-03T11:39:12.749 INFO:tasks.workunit.client.0.smithi003.stdout:lock: mylock 2023-12-03T11:39:12.749 INFO:tasks.workunit.client.0.smithi003.stdout: lock_type: shared 2023-12-03T11:39:12.749 INFO:tasks.workunit.client.0.smithi003.stdout: tag: 2023-12-03T11:39:12.749 INFO:tasks.workunit.client.0.smithi003.stdout: lockers: 2023-12-03T11:39:12.749 INFO:tasks.workunit.client.0.smithi003.stdout: client.5138 expiration=0.000000 addr=v1:172.21.15.3:0/791950951 cookie= 2023-12-03T11:39:12.751 INFO:tasks.workunit.client.0.smithi003.stdout:lock: mylock 2023-12-03T11:39:12.752 INFO:tasks.workunit.client.0.smithi003.stdout: lock_type: exclusive 2023-12-03T11:39:12.752 INFO:tasks.workunit.client.0.smithi003.stdout: tag: new_tag 2023-12-03T11:39:12.752 INFO:tasks.workunit.client.0.smithi003.stdout: lockers: 2023-12-03T11:39:12.752 INFO:tasks.workunit.client.0.smithi003.stdout: client.5307 expiration=0.000000 addr=v1:172.21.15.3:0/3670313492 cookie= 2023-12-03T11:39:13.520 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] ClsLock.TestMeta (3026 ms) 2023-12-03T11:39:13.520 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] ClsLock.TestCookie 2023-12-03T11:39:15.545 INFO:tasks.workunit.client.0.smithi003.stdout:lock: mylock 2023-12-03T11:39:15.545 INFO:tasks.workunit.client.0.smithi003.stdout: lock_type: exclusive 2023-12-03T11:39:15.546 INFO:tasks.workunit.client.0.smithi003.stdout: tag: 2023-12-03T11:39:15.546 INFO:tasks.workunit.client.0.smithi003.stdout: lockers: 2023-12-03T11:39:15.547 INFO:tasks.workunit.client.0.smithi003.stdout:lock: mylock 2023-12-03T11:39:15.548 INFO:tasks.workunit.client.0.smithi003.stdout: lock_type: shared 2023-12-03T11:39:15.548 INFO:tasks.workunit.client.0.smithi003.stdout: tag: 2023-12-03T11:39:15.548 INFO:tasks.workunit.client.0.smithi003.stdout: lockers: 2023-12-03T11:39:15.548 INFO:tasks.workunit.client.0.smithi003.stdout: client.5144 expiration=0.000000 addr=v1:172.21.15.3:0/1402576315 cookie= 2023-12-03T11:39:15.548 INFO:tasks.workunit.client.0.smithi003.stdout: client.5144 expiration=0.000000 addr=v1:172.21.15.3:0/1402576315 cookie=new cookie 2023-12-03T11:39:16.527 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] ClsLock.TestCookie (3006 ms) 2023-12-03T11:39:16.527 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] ClsLock.TestMultipleLocks 2023-12-03T11:39:19.568 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] ClsLock.TestMultipleLocks (3042 ms) 2023-12-03T11:39:19.568 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] ClsLock.TestLockDuration 2023-12-03T11:39:26.914 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] ClsLock.TestLockDuration (7345 ms) 2023-12-03T11:39:26.914 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] ClsLock.TestAssertLocked 2023-12-03T11:39:29.941 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] ClsLock.TestAssertLocked (3028 ms) 2023-12-03T11:39:29.942 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] ClsLock.TestSetCookie 2023-12-03T11:39:32.956 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] ClsLock.TestSetCookie (3013 ms) 2023-12-03T11:39:32.956 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] ClsLock.TestRenew 2023-12-03T11:39:53.257 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] ClsLock.TestRenew (20303 ms) 2023-12-03T11:39:53.257 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralBasic 2023-12-03T11:40:00.309 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] ClsLock.TestExclusiveEphemeralBasic (7052 ms) 2023-12-03T11:40:00.309 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealEphemeral 2023-12-03T11:40:08.248 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealEphemeral (7938 ms) 2023-12-03T11:40:08.248 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealExclusive 2023-12-03T11:40:16.249 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealExclusive (8001 ms) 2023-12-03T11:40:16.249 INFO:tasks.workunit.client.0.smithi003.stdout:[----------] 11 tests from ClsLock (68574 ms total) 2023-12-03T11:40:16.249 INFO:tasks.workunit.client.0.smithi003.stdout: 2023-12-03T11:40:16.249 INFO:tasks.workunit.client.0.smithi003.stdout:[----------] Global test environment tear-down 2023-12-03T11:40:16.249 INFO:tasks.workunit.client.0.smithi003.stdout:[==========] 11 tests from 1 test suite ran. (68574 ms total) 2023-12-03T11:40:16.249 INFO:tasks.workunit.client.0.smithi003.stdout:[ PASSED ] 11 tests. 2023-12-03T11:40:16.252 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-12-03T11:40:16.253 DEBUG:teuthology.orchestra.run.smithi003:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-12-03T11:40:16.332 INFO:tasks.workunit:Running workunits matching cls/test_cls_log.sh on client.0... 2023-12-03T11:40:16.334 INFO:tasks.workunit:Running workunit cls/test_cls_log.sh... 2023-12-03T11:40:16.335 DEBUG:teuthology.orchestra.run.smithi003:workunit test cls/test_cls_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bcbf278cf395873c2a482f5a7b2345faf2160319 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_log.sh 2023-12-03T11:40:16.406 INFO:tasks.workunit.client.0.smithi003.stdout:Running main() from gmock_main.cc 2023-12-03T11:40:16.406 INFO:tasks.workunit.client.0.smithi003.stdout:[==========] Running 4 tests from 1 test suite. 2023-12-03T11:40:16.406 INFO:tasks.workunit.client.0.smithi003.stdout:[----------] Global test environment set-up. 2023-12-03T11:40:16.406 INFO:tasks.workunit.client.0.smithi003.stdout:[----------] 4 tests from cls_log 2023-12-03T11:40:16.406 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] cls_log.test_log_add_same_time 2023-12-03T11:40:19.256 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] cls_log.test_log_add_same_time (2850 ms) 2023-12-03T11:40:19.256 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] cls_log.test_log_add_different_time 2023-12-03T11:40:22.292 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] cls_log.test_log_add_different_time (3037 ms) 2023-12-03T11:40:22.293 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] cls_log.trim_by_time 2023-12-03T11:40:25.297 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] cls_log.trim_by_time (3003 ms) 2023-12-03T11:40:25.297 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] cls_log.trim_by_marker 2023-12-03T11:40:28.324 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] cls_log.trim_by_marker (3029 ms) 2023-12-03T11:40:28.324 INFO:tasks.workunit.client.0.smithi003.stdout:[----------] 4 tests from cls_log (11919 ms total) 2023-12-03T11:40:28.324 INFO:tasks.workunit.client.0.smithi003.stdout: 2023-12-03T11:40:28.324 INFO:tasks.workunit.client.0.smithi003.stdout:[----------] Global test environment tear-down 2023-12-03T11:40:28.324 INFO:tasks.workunit.client.0.smithi003.stdout:[==========] 4 tests from 1 test suite ran. (11919 ms total) 2023-12-03T11:40:28.324 INFO:tasks.workunit.client.0.smithi003.stdout:[ PASSED ] 4 tests. 2023-12-03T11:40:28.328 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-12-03T11:40:28.329 DEBUG:teuthology.orchestra.run.smithi003:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-12-03T11:40:28.405 INFO:tasks.workunit:Running workunits matching cls/test_cls_refcount.sh on client.0... 2023-12-03T11:40:28.406 INFO:tasks.workunit:Running workunit cls/test_cls_refcount.sh... 2023-12-03T11:40:28.407 DEBUG:teuthology.orchestra.run.smithi003:workunit test cls/test_cls_refcount.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bcbf278cf395873c2a482f5a7b2345faf2160319 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_refcount.sh 2023-12-03T11:40:28.479 INFO:tasks.workunit.client.0.smithi003.stdout:Running main() from gmock_main.cc 2023-12-03T11:40:28.479 INFO:tasks.workunit.client.0.smithi003.stdout:[==========] Running 10 tests from 1 test suite. 2023-12-03T11:40:28.479 INFO:tasks.workunit.client.0.smithi003.stdout:[----------] Global test environment set-up. 2023-12-03T11:40:28.479 INFO:tasks.workunit.client.0.smithi003.stdout:[----------] 10 tests from cls_refcount 2023-12-03T11:40:28.479 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] cls_refcount.test_implicit 2023-12-03T11:40:31.385 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] cls_refcount.test_implicit (2906 ms) 2023-12-03T11:40:31.385 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] cls_refcount.test_implicit_idempotent 2023-12-03T11:40:34.413 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] cls_refcount.test_implicit_idempotent (3027 ms) 2023-12-03T11:40:34.413 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] cls_refcount.test_put_snap 2023-12-03T11:40:42.522 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] cls_refcount.test_put_snap (8110 ms) 2023-12-03T11:40:42.523 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] cls_refcount.test_explicit 2023-12-03T11:40:45.537 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] cls_refcount.test_explicit (3015 ms) 2023-12-03T11:40:45.537 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] cls_refcount.set 2023-12-03T11:40:48.570 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] cls_refcount.set (3032 ms) 2023-12-03T11:40:48.570 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] cls_refcount.test_implicit_ec 2023-12-03T11:40:55.605 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] cls_refcount.test_implicit_ec (7036 ms) 2023-12-03T11:40:55.606 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] cls_refcount.test_implicit_idempotent_ec 2023-12-03T11:41:02.662 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] cls_refcount.test_implicit_idempotent_ec (7057 ms) 2023-12-03T11:41:02.663 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] cls_refcount.test_put_snap_ec 2023-12-03T11:41:14.776 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] cls_refcount.test_put_snap_ec (12114 ms) 2023-12-03T11:41:14.776 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] cls_refcount.test_explicit_ec 2023-12-03T11:41:21.787 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] cls_refcount.test_explicit_ec (7011 ms) 2023-12-03T11:41:21.788 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] cls_refcount.set_ec 2023-12-03T11:41:28.835 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] cls_refcount.set_ec (7047 ms) 2023-12-03T11:41:28.835 INFO:tasks.workunit.client.0.smithi003.stdout:[----------] 10 tests from cls_refcount (60356 ms total) 2023-12-03T11:41:28.835 INFO:tasks.workunit.client.0.smithi003.stdout: 2023-12-03T11:41:28.835 INFO:tasks.workunit.client.0.smithi003.stdout:[----------] Global test environment tear-down 2023-12-03T11:41:28.835 INFO:tasks.workunit.client.0.smithi003.stdout:[==========] 10 tests from 1 test suite ran. (60356 ms total) 2023-12-03T11:41:28.835 INFO:tasks.workunit.client.0.smithi003.stdout:[ PASSED ] 10 tests. 2023-12-03T11:41:28.838 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-12-03T11:41:28.838 DEBUG:teuthology.orchestra.run.smithi003:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-12-03T11:41:28.914 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw.sh on client.0... 2023-12-03T11:41:28.915 INFO:tasks.workunit:Running workunit cls/test_cls_rgw.sh... 2023-12-03T11:41:28.915 DEBUG:teuthology.orchestra.run.smithi003:workunit test cls/test_cls_rgw.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bcbf278cf395873c2a482f5a7b2345faf2160319 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw.sh 2023-12-03T11:41:28.987 INFO:tasks.workunit.client.0.smithi003.stdout:Running main() from gmock_main.cc 2023-12-03T11:41:28.987 INFO:tasks.workunit.client.0.smithi003.stdout:[==========] Running 16 tests from 1 test suite. 2023-12-03T11:41:28.987 INFO:tasks.workunit.client.0.smithi003.stdout:[----------] Global test environment set-up. 2023-12-03T11:41:28.987 INFO:tasks.workunit.client.0.smithi003.stdout:[----------] 16 tests from cls_rgw 2023-12-03T11:41:30.864 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] cls_rgw.index_basic 2023-12-03T11:41:30.911 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] cls_rgw.index_basic (47 ms) 2023-12-03T11:41:30.911 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] cls_rgw.index_multiple_obj_writers 2023-12-03T11:41:30.947 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] cls_rgw.index_multiple_obj_writers (36 ms) 2023-12-03T11:41:30.948 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] cls_rgw.index_remove_object 2023-12-03T11:41:30.995 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] cls_rgw.index_remove_object (48 ms) 2023-12-03T11:41:30.995 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] cls_rgw.index_suggest 2023-12-03T11:41:32.501 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] cls_rgw.index_suggest (1503 ms) 2023-12-03T11:41:32.501 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] cls_rgw.index_suggest_complete 2023-12-03T11:41:32.504 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] cls_rgw.index_suggest_complete (6 ms) 2023-12-03T11:41:32.504 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] cls_rgw.index_list 2023-12-03T11:41:32.530 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] cls_rgw.index_list (25 ms) 2023-12-03T11:41:32.530 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] cls_rgw.index_list_delimited 2023-12-03T11:41:52.768 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] cls_rgw.index_list_delimited (20238 ms) 2023-12-03T11:41:52.768 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] cls_rgw.bi_list 2023-12-03T11:41:52.842 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] cls_rgw.bi_list (75 ms) 2023-12-03T11:41:52.845 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] cls_rgw.gc_set 2023-12-03T11:41:52.853 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] cls_rgw.gc_set (11 ms) 2023-12-03T11:41:52.853 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] cls_rgw.gc_list 2023-12-03T11:41:52.863 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] cls_rgw.gc_list (10 ms) 2023-12-03T11:41:52.863 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] cls_rgw.gc_defer 2023-12-03T11:41:59.358 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] cls_rgw.gc_defer (6495 ms) 2023-12-03T11:41:59.358 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] cls_rgw.usage_basic 2023-12-03T11:41:59.452 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] cls_rgw.usage_basic (94 ms) 2023-12-03T11:41:59.452 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] cls_rgw.usage_clear_no_obj 2023-12-03T11:41:59.454 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] cls_rgw.usage_clear_no_obj (1 ms) 2023-12-03T11:41:59.454 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] cls_rgw.usage_clear 2023-12-03T11:41:59.552 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] cls_rgw.usage_clear (99 ms) 2023-12-03T11:41:59.552 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] cls_rgw.bi_log_trim 2023-12-03T11:41:59.596 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] cls_rgw.bi_log_trim (43 ms) 2023-12-03T11:41:59.596 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] cls_rgw.index_racing_removes 2023-12-03T11:41:59.616 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] cls_rgw.index_racing_removes (21 ms) 2023-12-03T11:42:00.373 INFO:tasks.workunit.client.0.smithi003.stdout:[----------] 16 tests from cls_rgw (28752 ms total) 2023-12-03T11:42:00.373 INFO:tasks.workunit.client.0.smithi003.stdout: 2023-12-03T11:42:00.373 INFO:tasks.workunit.client.0.smithi003.stdout:[----------] Global test environment tear-down 2023-12-03T11:42:00.373 INFO:tasks.workunit.client.0.smithi003.stdout:[==========] 16 tests from 1 test suite ran. (31385 ms total) 2023-12-03T11:42:00.373 INFO:tasks.workunit.client.0.smithi003.stdout:[ PASSED ] 16 tests. 2023-12-03T11:42:00.376 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-12-03T11:42:00.376 DEBUG:teuthology.orchestra.run.smithi003:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-12-03T11:42:00.450 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw_gc.sh on client.0... 2023-12-03T11:42:00.451 INFO:tasks.workunit:Running workunit cls/test_cls_rgw_gc.sh... 2023-12-03T11:42:00.451 DEBUG:teuthology.orchestra.run.smithi003:workunit test cls/test_cls_rgw_gc.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bcbf278cf395873c2a482f5a7b2345faf2160319 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw_gc.sh 2023-12-03T11:42:00.522 INFO:tasks.workunit.client.0.smithi003.stdout:Running main() from gmock_main.cc 2023-12-03T11:42:00.522 INFO:tasks.workunit.client.0.smithi003.stdout:[==========] Running 9 tests from 1 test suite. 2023-12-03T11:42:00.522 INFO:tasks.workunit.client.0.smithi003.stdout:[----------] Global test environment set-up. 2023-12-03T11:42:00.522 INFO:tasks.workunit.client.0.smithi003.stdout:[----------] 9 tests from cls_rgw_gc 2023-12-03T11:42:00.522 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] cls_rgw_gc.init 2023-12-03T11:42:02.382 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] cls_rgw_gc.init (1859 ms) 2023-12-03T11:42:02.382 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops1 2023-12-03T11:42:02.399 INFO:tasks.workunit.client.0.smithi003.stderr:[ ] list info tag = chain-0 2023-12-03T11:42:02.399 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] cls_rgw_gc.gc_queue_ops1 (17 ms) 2023-12-03T11:42:02.399 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops2 2023-12-03T11:42:02.406 INFO:tasks.workunit.client.0.smithi003.stderr:[ ] next_marker is: = 0/4263 2023-12-03T11:42:02.406 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] cls_rgw_gc.gc_queue_ops2 (8 ms) 2023-12-03T11:42:02.406 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops5 2023-12-03T11:42:02.415 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] cls_rgw_gc.gc_queue_ops5 (9 ms) 2023-12-03T11:42:02.415 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops6 2023-12-03T11:42:02.456 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] cls_rgw_gc.gc_queue_ops6 (41 ms) 2023-12-03T11:42:02.456 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops7 2023-12-03T11:42:02.464 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] cls_rgw_gc.gc_queue_ops7 (8 ms) 2023-12-03T11:42:02.464 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops8 2023-12-03T11:42:02.474 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] cls_rgw_gc.gc_queue_ops8 (10 ms) 2023-12-03T11:42:02.475 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops9 2023-12-03T11:42:02.485 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] cls_rgw_gc.gc_queue_ops9 (10 ms) 2023-12-03T11:42:02.486 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] cls_rgw_gc.finalize 2023-12-03T11:42:03.383 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] cls_rgw_gc.finalize (899 ms) 2023-12-03T11:42:03.383 INFO:tasks.workunit.client.0.smithi003.stdout:[----------] 9 tests from cls_rgw_gc (2861 ms total) 2023-12-03T11:42:03.383 INFO:tasks.workunit.client.0.smithi003.stdout: 2023-12-03T11:42:03.383 INFO:tasks.workunit.client.0.smithi003.stdout:[----------] Global test environment tear-down 2023-12-03T11:42:03.384 INFO:tasks.workunit.client.0.smithi003.stdout:[==========] 9 tests from 1 test suite ran. (2861 ms total) 2023-12-03T11:42:03.384 INFO:tasks.workunit.client.0.smithi003.stdout:[ PASSED ] 9 tests. 2023-12-03T11:42:03.386 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-12-03T11:42:03.386 DEBUG:teuthology.orchestra.run.smithi003:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-12-03T11:42:03.463 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw_stats.sh on client.0... 2023-12-03T11:42:03.464 INFO:tasks.workunit:Running workunit cls/test_cls_rgw_stats.sh... 2023-12-03T11:42:03.464 DEBUG:teuthology.orchestra.run.smithi003:workunit test cls/test_cls_rgw_stats.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bcbf278cf395873c2a482f5a7b2345faf2160319 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw_stats.sh 2023-12-03T11:42:03.545 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:42:03.545 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:42:03.545 INFO:tasks.workunit.client.0.smithi003.stdout:[==========] Running 1 test from 1 test suite. 2023-12-03T11:42:03.546 INFO:tasks.workunit.client.0.smithi003.stdout:[----------] Global test environment set-up. 2023-12-03T11:42:05.399 INFO:tasks.workunit.client.0.smithi003.stdout:[----------] 1 test from cls_rgw_stats 2023-12-03T11:42:05.400 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] cls_rgw_stats.simulate 2023-12-03T11:42:05.416 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.415+0000 7f8723d84780 1 > prepared operation key=VENJI0KD1XDW tag=A3EI9KVMCBGN type=del size=2099314 2023-12-03T11:42:05.417 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.416+0000 7f8723d84780 1 > prepared operation key=VENJI0KD1XDW tag=SO01ONL82SHN type=del size=3435543 2023-12-03T11:42:05.418 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.418+0000 7f8723d84780 1 > prepared operation key=7THZZ1J5LOZK tag=QZWGQDLWSG8F type=write size=93519 2023-12-03T11:42:05.420 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.419+0000 7f8723d84780 1 > prepared operation key=OGACI7CRPMT7 tag=8UAMWTOPNP4M type=del size=3195479 2023-12-03T11:42:05.423 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.422+0000 7f8723d84780 1 > prepared part key=_multipart_G36T76K8O7A1.2~D0K9GYJJWF5K.0 size=688528 2023-12-03T11:42:05.423 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.422+0000 7f8723d84780 1 > prepared multipart upload key=G36T76K8O7A1 upload=D0K9GYJJWF5K tag=CNOIFJYNIFB9 type=write size=1737104 2023-12-03T11:42:05.425 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.424+0000 7f8723d84780 1 > prepared part key=_multipart_931GNEXBHH35.2~O1TUVL14ASN2.0 size=1048576 2023-12-03T11:42:05.426 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.425+0000 7f8723d84780 1 > prepared part key=_multipart_931GNEXBHH35.2~O1TUVL14ASN2.1 size=368214 2023-12-03T11:42:05.426 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.425+0000 7f8723d84780 1 > prepared multipart upload key=931GNEXBHH35 upload=O1TUVL14ASN2 tag=4RNSS2H9PLI6 type=write size=2465366 2023-12-03T11:42:05.428 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.427+0000 7f8723d84780 1 > prepared operation key=7THZZ1J5LOZK tag=VPQVO90RJQJF type=del size=65323 2023-12-03T11:42:05.429 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.428+0000 7f8723d84780 1 > prepared operation key=EITMJKL0LCYC tag=GLWIPESA7G9T type=del size=3326977 2023-12-03T11:42:05.430 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.429+0000 7f8723d84780 1 > prepared operation key=5UYL15O31IHM tag=1LQ69H1Z79YE type=del size=386709 2023-12-03T11:42:05.433 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.432+0000 7f8723d84780 1 > prepared part key=_multipart_UWS266H06VDK.2~4ZE2COIRDWGU.0 size=1048576 2023-12-03T11:42:05.434 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.433+0000 7f8723d84780 1 > prepared part key=_multipart_UWS266H06VDK.2~4ZE2COIRDWGU.1 size=1048576 2023-12-03T11:42:05.435 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.434+0000 7f8723d84780 1 > prepared part key=_multipart_UWS266H06VDK.2~4ZE2COIRDWGU.2 size=771355 2023-12-03T11:42:05.435 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.434+0000 7f8723d84780 1 > prepared multipart upload key=UWS266H06VDK upload=4ZE2COIRDWGU tag=DP1J8LT5XOQR type=write size=3917083 2023-12-03T11:42:05.436 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.435+0000 7f8723d84780 1 > prepared operation key=5UYL15O31IHM tag=OADA6OCP2Z7V type=del size=2856263 2023-12-03T11:42:05.438 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.437+0000 7f8723d84780 1 > prepared operation key=LCK58DDM5XU9 tag=54C2Z1KPZF4K type=write size=936109 2023-12-03T11:42:05.442 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.441+0000 7f8723d84780 1 > prepared part key=_multipart_CKABTI1EOAWB.2~N7U96R58ZF5K.0 size=1048576 2023-12-03T11:42:05.443 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.442+0000 7f8723d84780 1 > prepared part key=_multipart_CKABTI1EOAWB.2~N7U96R58ZF5K.1 size=228989 2023-12-03T11:42:05.443 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.442+0000 7f8723d84780 1 > prepared multipart upload key=CKABTI1EOAWB upload=N7U96R58ZF5K tag=1GTR05PEL7VJ type=write size=2326141 2023-12-03T11:42:05.444 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.443+0000 7f8723d84780 1 > prepared operation key=HIU6L0NQ8Q95 tag=3QR5EKYMH6EC type=del size=1828888 2023-12-03T11:42:05.447 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.446+0000 7f8723d84780 1 > prepared part key=_multipart_EITMJKL0LCYC.2~L89XLNSNUQO5.0 size=714194 2023-12-03T11:42:05.447 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.446+0000 7f8723d84780 1 > prepared multipart upload key=EITMJKL0LCYC upload=L89XLNSNUQO5 tag=L79SAROT8V0E type=write size=1762770 2023-12-03T11:42:05.449 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.447+0000 7f8723d84780 1 > prepared operation key=96RAVVSUKH0Y tag=WE9RQHW5HMNY type=del size=1608401 2023-12-03T11:42:05.450 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.449+0000 7f8723d84780 1 < completed delete operation key=VENJI0KD1XDW tag=A3EI9KVMCBGN type=del 2023-12-03T11:42:05.451 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.450+0000 7f8723d84780 1 > prepared operation key=AB0SN0E49Z5F tag=20XU8I2BYFZU type=del size=549654 2023-12-03T11:42:05.454 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.453+0000 7f8723d84780 1 < suggested remove operation key=VENJI0KD1XDW tag=SO01ONL82SHN type=del 2023-12-03T11:42:05.455 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.454+0000 7f8723d84780 1 > prepared operation key=LCK58DDM5XU9 tag=5H74ZBDBGJH4 type=del size=3381295 2023-12-03T11:42:05.457 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.456+0000 7f8723d84780 1 < completed write operation key=7THZZ1J5LOZK tag=QZWGQDLWSG8F type=write size=93519 2023-12-03T11:42:05.458 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.457+0000 7f8723d84780 1 > prepared operation key=J33T5S893LMV tag=SO3GQBSPEMCK type=del size=1294509 2023-12-03T11:42:05.460 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.459+0000 7f8723d84780 1 < canceled operation key=OGACI7CRPMT7 tag=8UAMWTOPNP4M type=del size=3195479 2023-12-03T11:42:05.462 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.461+0000 7f8723d84780 1 > prepared part key=_multipart_HIU6L0NQ8Q95.2~TQQPKZ13AW70.0 size=1048576 2023-12-03T11:42:05.463 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.462+0000 7f8723d84780 1 > prepared part key=_multipart_HIU6L0NQ8Q95.2~TQQPKZ13AW70.1 size=991348 2023-12-03T11:42:05.463 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.462+0000 7f8723d84780 1 > prepared multipart upload key=HIU6L0NQ8Q95 upload=TQQPKZ13AW70 tag=HNSEAB0MXDID type=write size=3088500 2023-12-03T11:42:05.464 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.463+0000 7f8723d84780 1 < completed part key=_multipart_G36T76K8O7A1.2~D0K9GYJJWF5K.0 size=688528 2023-12-03T11:42:05.467 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.466+0000 7f8723d84780 1 < completed multipart upload key=G36T76K8O7A1 upload=D0K9GYJJWF5K tag=CNOIFJYNIFB9 type=write size=1737104 2023-12-03T11:42:05.469 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.468+0000 7f8723d84780 1 > prepared part key=_multipart_M4VKPN6INFNZ.2~DXGMFG1M1SM7.0 size=1048576 2023-12-03T11:42:05.470 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.469+0000 7f8723d84780 1 > prepared part key=_multipart_M4VKPN6INFNZ.2~DXGMFG1M1SM7.1 size=1048576 2023-12-03T11:42:05.471 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.470+0000 7f8723d84780 1 > prepared part key=_multipart_M4VKPN6INFNZ.2~DXGMFG1M1SM7.2 size=64709 2023-12-03T11:42:05.471 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.470+0000 7f8723d84780 1 > prepared multipart upload key=M4VKPN6INFNZ upload=DXGMFG1M1SM7 tag=FG94OXUINSBO type=write size=3210437 2023-12-03T11:42:05.473 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.471+0000 7f8723d84780 1 < completed part key=_multipart_931GNEXBHH35.2~O1TUVL14ASN2.0 size=1048576 2023-12-03T11:42:05.474 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.473+0000 7f8723d84780 1 < completed part key=_multipart_931GNEXBHH35.2~O1TUVL14ASN2.1 size=368214 2023-12-03T11:42:05.476 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.475+0000 7f8723d84780 1 < completed multipart upload key=931GNEXBHH35 upload=O1TUVL14ASN2 tag=4RNSS2H9PLI6 type=write size=2465366 2023-12-03T11:42:05.477 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.476+0000 7f8723d84780 1 > prepared operation key=OPQPIDJ2PBVU tag=V4Z03D5P0QE7 type=del size=886650 2023-12-03T11:42:05.478 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.477+0000 7f8723d84780 1 < completed delete operation key=7THZZ1J5LOZK tag=VPQVO90RJQJF type=del 2023-12-03T11:42:05.480 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.479+0000 7f8723d84780 1 > prepared operation key=AB0SN0E49Z5F tag=82WLJHIU0Z5V type=del size=2423397 2023-12-03T11:42:05.481 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.480+0000 7f8723d84780 1 < completed delete operation key=EITMJKL0LCYC tag=GLWIPESA7G9T type=del 2023-12-03T11:42:05.482 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.481+0000 7f8723d84780 1 > prepared operation key=EY9ZG5KOTBWM tag=O2BAK795RS2Y type=del size=1768363 2023-12-03T11:42:05.485 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.484+0000 7f8723d84780 1 < suggested update operation key=5UYL15O31IHM tag=1LQ69H1Z79YE type=del size=386709 2023-12-03T11:42:05.487 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.486+0000 7f8723d84780 1 > prepared part key=_multipart_OGACI7CRPMT7.2~4OUWJ2Q2I1WS.0 size=214587 2023-12-03T11:42:05.487 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.486+0000 7f8723d84780 1 > prepared multipart upload key=OGACI7CRPMT7 upload=4OUWJ2Q2I1WS tag=2JSOX8MGP69A type=write size=1263163 2023-12-03T11:42:05.488 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.487+0000 7f8723d84780 1 < completed part key=_multipart_UWS266H06VDK.2~4ZE2COIRDWGU.0 size=1048576 2023-12-03T11:42:05.490 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.488+0000 7f8723d84780 1 < completed part key=_multipart_UWS266H06VDK.2~4ZE2COIRDWGU.1 size=1048576 2023-12-03T11:42:05.491 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.489+0000 7f8723d84780 1 < completed part key=_multipart_UWS266H06VDK.2~4ZE2COIRDWGU.2 size=771355 2023-12-03T11:42:05.493 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.492+0000 7f8723d84780 1 < completed multipart upload key=UWS266H06VDK upload=4ZE2COIRDWGU tag=DP1J8LT5XOQR type=write size=3917083 2023-12-03T11:42:05.495 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.494+0000 7f8723d84780 1 > prepared part key=_multipart_Y6S7QI60GCLE.2~UW5NYKOZN2NC.0 size=326438 2023-12-03T11:42:05.495 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.494+0000 7f8723d84780 1 > prepared multipart upload key=Y6S7QI60GCLE upload=UW5NYKOZN2NC tag=PLL7U1AZMMFM type=write size=1375014 2023-12-03T11:42:05.497 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.496+0000 7f8723d84780 -1 < failed to complete operation key=5UYL15O31IHM tag=OADA6OCP2Z7V type=del size=2856263: (22) Invalid argument 2023-12-03T11:42:05.499 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.498+0000 7f8723d84780 1 > prepared part key=_multipart_TSTIBGVYUZZZ.2~BI8QMWLB1NAR.0 size=1048576 2023-12-03T11:42:05.500 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.499+0000 7f8723d84780 1 > prepared part key=_multipart_TSTIBGVYUZZZ.2~BI8QMWLB1NAR.1 size=862207 2023-12-03T11:42:05.500 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.499+0000 7f8723d84780 1 > prepared multipart upload key=TSTIBGVYUZZZ upload=BI8QMWLB1NAR tag=RGV9CD4ZOKLA type=write size=2959359 2023-12-03T11:42:05.502 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.501+0000 7f8723d84780 1 < suggested remove operation key=LCK58DDM5XU9 tag=54C2Z1KPZF4K type=write 2023-12-03T11:42:05.505 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.504+0000 7f8723d84780 1 > prepared part key=_multipart_UWS266H06VDK.2~Y2WIQ6CXFBE7.0 size=1030297 2023-12-03T11:42:05.505 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.504+0000 7f8723d84780 1 > prepared multipart upload key=UWS266H06VDK upload=Y2WIQ6CXFBE7 tag=FM7U1D9DIBVD type=write size=2078873 2023-12-03T11:42:05.507 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.505+0000 7f8723d84780 1 < completed part key=_multipart_CKABTI1EOAWB.2~N7U96R58ZF5K.0 size=1048576 2023-12-03T11:42:05.507 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.506+0000 7f8723d84780 1 < completed part key=_multipart_CKABTI1EOAWB.2~N7U96R58ZF5K.1 size=228989 2023-12-03T11:42:05.510 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.509+0000 7f8723d84780 1 < completed multipart upload key=CKABTI1EOAWB upload=N7U96R58ZF5K tag=1GTR05PEL7VJ type=write size=2326141 2023-12-03T11:42:05.511 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.510+0000 7f8723d84780 1 > prepared operation key=M4VKPN6INFNZ tag=JG9JP3DYPK1I type=del size=3725027 2023-12-03T11:42:05.513 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.512+0000 7f8723d84780 1 < completed delete operation key=HIU6L0NQ8Q95 tag=3QR5EKYMH6EC type=del 2023-12-03T11:42:05.514 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.513+0000 7f8723d84780 1 > prepared operation key=FCA2R3HR61S2 tag=9VNEBVU97CWE type=del size=3072064 2023-12-03T11:42:05.514 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.513+0000 7f8723d84780 1 < canceled part key=_multipart_EITMJKL0LCYC.2~L89XLNSNUQO5.0 size=714194 2023-12-03T11:42:05.517 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.515+0000 7f8723d84780 1 < canceled multipart upload key=EITMJKL0LCYC upload=L89XLNSNUQO5 tag=L79SAROT8V0E type=write size=1762770 2023-12-03T11:42:05.517 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.516+0000 7f8723d84780 1 > prepared operation key=OPQPIDJ2PBVU tag=S5FB9BFMSR97 type=del size=536407 2023-12-03T11:42:05.520 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.519+0000 7f8723d84780 1 < suggested remove operation key=96RAVVSUKH0Y tag=WE9RQHW5HMNY type=del 2023-12-03T11:42:05.522 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.521+0000 7f8723d84780 1 > prepared operation key=12XG7YPYTN4U tag=V0JXTAXYYKQJ type=del size=2248294 2023-12-03T11:42:05.523 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.522+0000 7f8723d84780 1 < completed delete operation key=AB0SN0E49Z5F tag=20XU8I2BYFZU type=del 2023-12-03T11:42:05.524 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.523+0000 7f8723d84780 1 > prepared operation key=CKABTI1EOAWB tag=R59SOFJOGOPB type=del size=62678 2023-12-03T11:42:05.526 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.524+0000 7f8723d84780 -1 < failed to complete operation key=LCK58DDM5XU9 tag=5H74ZBDBGJH4 type=del size=3381295: (22) Invalid argument 2023-12-03T11:42:05.527 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.526+0000 7f8723d84780 1 > prepared part key=_multipart_931GNEXBHH35.2~RWT8HEZ82B3R.0 size=1048576 2023-12-03T11:42:05.528 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.527+0000 7f8723d84780 1 > prepared part key=_multipart_931GNEXBHH35.2~RWT8HEZ82B3R.1 size=766500 2023-12-03T11:42:05.529 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.527+0000 7f8723d84780 1 > prepared multipart upload key=931GNEXBHH35 upload=RWT8HEZ82B3R tag=OEL70IUALMA8 type=write size=2863652 2023-12-03T11:42:05.530 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.529+0000 7f8723d84780 1 < completed delete operation key=J33T5S893LMV tag=SO3GQBSPEMCK type=del 2023-12-03T11:42:05.532 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.531+0000 7f8723d84780 1 > prepared part key=_multipart_J33T5S893LMV.2~VQT65Y0HH6VM.0 size=1048576 2023-12-03T11:42:05.533 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.532+0000 7f8723d84780 1 > prepared part key=_multipart_J33T5S893LMV.2~VQT65Y0HH6VM.1 size=678317 2023-12-03T11:42:05.533 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.532+0000 7f8723d84780 1 > prepared multipart upload key=J33T5S893LMV upload=VQT65Y0HH6VM tag=ICR2R138DLTD type=write size=2775469 2023-12-03T11:42:05.534 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.533+0000 7f8723d84780 1 < completed part key=_multipart_HIU6L0NQ8Q95.2~TQQPKZ13AW70.0 size=1048576 2023-12-03T11:42:05.535 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.534+0000 7f8723d84780 1 < completed part key=_multipart_HIU6L0NQ8Q95.2~TQQPKZ13AW70.1 size=991348 2023-12-03T11:42:05.537 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.536+0000 7f8723d84780 1 < completed multipart upload key=HIU6L0NQ8Q95 upload=TQQPKZ13AW70 tag=HNSEAB0MXDID type=write size=3088500 2023-12-03T11:42:05.538 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.537+0000 7f8723d84780 1 > prepared operation key=DMQX2DGDLU7D tag=T5XEZH2QMH82 type=del size=2441887 2023-12-03T11:42:05.540 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.539+0000 7f8723d84780 1 < completed part key=_multipart_M4VKPN6INFNZ.2~DXGMFG1M1SM7.0 size=1048576 2023-12-03T11:42:05.541 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.540+0000 7f8723d84780 1 < completed part key=_multipart_M4VKPN6INFNZ.2~DXGMFG1M1SM7.1 size=1048576 2023-12-03T11:42:05.542 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.541+0000 7f8723d84780 1 < completed part key=_multipart_M4VKPN6INFNZ.2~DXGMFG1M1SM7.2 size=64709 2023-12-03T11:42:05.544 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.543+0000 7f8723d84780 1 < completed multipart upload key=M4VKPN6INFNZ upload=DXGMFG1M1SM7 tag=FG94OXUINSBO type=write size=3210437 2023-12-03T11:42:05.545 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.544+0000 7f8723d84780 1 > prepared operation key=Y6S7QI60GCLE tag=6ITAPCAPUMUI type=del size=1505093 2023-12-03T11:42:05.548 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.547+0000 7f8723d84780 1 < suggested remove operation key=OPQPIDJ2PBVU tag=V4Z03D5P0QE7 type=del 2023-12-03T11:42:05.550 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.549+0000 7f8723d84780 1 > prepared part key=_multipart_Y6S7QI60GCLE.2~VPFN730AIRFG.0 size=1048576 2023-12-03T11:42:05.552 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.551+0000 7f8723d84780 1 > prepared part key=_multipart_Y6S7QI60GCLE.2~VPFN730AIRFG.1 size=1048576 2023-12-03T11:42:05.553 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.552+0000 7f8723d84780 1 > prepared part key=_multipart_Y6S7QI60GCLE.2~VPFN730AIRFG.2 size=438560 2023-12-03T11:42:05.553 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.552+0000 7f8723d84780 1 > prepared multipart upload key=Y6S7QI60GCLE upload=VPFN730AIRFG tag=7KW63GFAFUI1 type=write size=3584288 2023-12-03T11:42:05.556 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.554+0000 7f8723d84780 1 < completed delete operation key=AB0SN0E49Z5F tag=82WLJHIU0Z5V type=del 2023-12-03T11:42:05.558 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.557+0000 7f8723d84780 1 > prepared part key=_multipart_8NONX2I08YMJ.2~BXOM63HM0XSF.0 size=665552 2023-12-03T11:42:05.558 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.557+0000 7f8723d84780 1 > prepared multipart upload key=8NONX2I08YMJ upload=BXOM63HM0XSF tag=5UHIDSFGVEN0 type=write size=1714128 2023-12-03T11:42:05.560 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.559+0000 7f8723d84780 1 < suggested remove operation key=EY9ZG5KOTBWM tag=O2BAK795RS2Y type=del 2023-12-03T11:42:05.561 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.560+0000 7f8723d84780 1 > prepared operation key=OPQPIDJ2PBVU tag=NV4Z4EUXMFP0 type=write size=72990 2023-12-03T11:42:05.563 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.562+0000 7f8723d84780 1 < completed part key=_multipart_OGACI7CRPMT7.2~4OUWJ2Q2I1WS.0 size=214587 2023-12-03T11:42:05.565 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.564+0000 7f8723d84780 1 < completed multipart upload key=OGACI7CRPMT7 upload=4OUWJ2Q2I1WS tag=2JSOX8MGP69A type=write size=1263163 2023-12-03T11:42:05.566 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.565+0000 7f8723d84780 1 > prepared operation key=K83BTR5BOLZE tag=3RGGFA9N3X9L type=del size=3142910 2023-12-03T11:42:05.567 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.566+0000 7f8723d84780 1 < completed part key=_multipart_Y6S7QI60GCLE.2~UW5NYKOZN2NC.0 size=326438 2023-12-03T11:42:05.569 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.568+0000 7f8723d84780 1 < completed multipart upload key=Y6S7QI60GCLE upload=UW5NYKOZN2NC tag=PLL7U1AZMMFM type=write size=1375014 2023-12-03T11:42:05.571 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.570+0000 7f8723d84780 1 > prepared operation key=W2704YS8KYQB tag=C494LT070MW8 type=write size=128302 2023-12-03T11:42:05.577 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.571+0000 7f8723d84780 1 < completed part key=_multipart_TSTIBGVYUZZZ.2~BI8QMWLB1NAR.0 size=1048576 2023-12-03T11:42:05.577 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.572+0000 7f8723d84780 1 < completed part key=_multipart_TSTIBGVYUZZZ.2~BI8QMWLB1NAR.1 size=862207 2023-12-03T11:42:05.577 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.574+0000 7f8723d84780 1 < completed multipart upload key=TSTIBGVYUZZZ upload=BI8QMWLB1NAR tag=RGV9CD4ZOKLA type=write size=2959359 2023-12-03T11:42:05.578 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.577+0000 7f8723d84780 1 > prepared part key=_multipart_FCA2R3HR61S2.2~SKAQX75O089O.0 size=798832 2023-12-03T11:42:05.578 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.577+0000 7f8723d84780 1 > prepared multipart upload key=FCA2R3HR61S2 upload=SKAQX75O089O tag=7YRSK43VLQZE type=write size=1847408 2023-12-03T11:42:05.579 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.578+0000 7f8723d84780 1 < completed part key=_multipart_UWS266H06VDK.2~Y2WIQ6CXFBE7.0 size=1030297 2023-12-03T11:42:05.581 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.580+0000 7f8723d84780 1 < completed multipart upload key=UWS266H06VDK upload=Y2WIQ6CXFBE7 tag=FM7U1D9DIBVD type=write size=2078873 2023-12-03T11:42:05.584 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.583+0000 7f8723d84780 1 > prepared part key=_multipart_EY9ZG5KOTBWM.2~PIHXIBK1Z4FZ.0 size=1048576 2023-12-03T11:42:05.585 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.584+0000 7f8723d84780 1 > prepared part key=_multipart_EY9ZG5KOTBWM.2~PIHXIBK1Z4FZ.1 size=24232 2023-12-03T11:42:05.585 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.584+0000 7f8723d84780 1 > prepared multipart upload key=EY9ZG5KOTBWM upload=PIHXIBK1Z4FZ tag=D4V92PYHSXWY type=write size=2121384 2023-12-03T11:42:05.586 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.585+0000 7f8723d84780 1 < completed delete operation key=M4VKPN6INFNZ tag=JG9JP3DYPK1I type=del 2023-12-03T11:42:05.587 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.586+0000 7f8723d84780 1 > prepared operation key=M4VKPN6INFNZ tag=50OG0G2DO7N3 type=write size=449949 2023-12-03T11:42:05.589 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.588+0000 7f8723d84780 1 < completed delete operation key=FCA2R3HR61S2 tag=9VNEBVU97CWE type=del 2023-12-03T11:42:05.591 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.590+0000 7f8723d84780 1 > prepared part key=_multipart_96RAVVSUKH0Y.2~PG5ZFOQHY8OS.0 size=1048576 2023-12-03T11:42:05.592 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.591+0000 7f8723d84780 1 > prepared part key=_multipart_96RAVVSUKH0Y.2~PG5ZFOQHY8OS.1 size=1048576 2023-12-03T11:42:05.593 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.592+0000 7f8723d84780 1 > prepared part key=_multipart_96RAVVSUKH0Y.2~PG5ZFOQHY8OS.2 size=37652 2023-12-03T11:42:05.593 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.592+0000 7f8723d84780 1 > prepared multipart upload key=96RAVVSUKH0Y upload=PG5ZFOQHY8OS tag=ZHPGFWYIAW0L type=write size=3183380 2023-12-03T11:42:05.595 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.594+0000 7f8723d84780 1 < suggested remove operation key=OPQPIDJ2PBVU tag=S5FB9BFMSR97 type=del 2023-12-03T11:42:05.598 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.597+0000 7f8723d84780 1 > prepared part key=_multipart_TSTIBGVYUZZZ.2~1MWRH823OBHI.0 size=749712 2023-12-03T11:42:05.598 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.597+0000 7f8723d84780 1 > prepared multipart upload key=TSTIBGVYUZZZ upload=1MWRH823OBHI tag=HVU7TMGSYVX0 type=write size=1798288 2023-12-03T11:42:05.599 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.598+0000 7f8723d84780 1 < completed delete operation key=12XG7YPYTN4U tag=V0JXTAXYYKQJ type=del 2023-12-03T11:42:05.600 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.599+0000 7f8723d84780 1 > prepared operation key=DMQX2DGDLU7D tag=XSL3KDT63FD5 type=del size=897300 2023-12-03T11:42:05.601 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.600+0000 7f8723d84780 1 < completed delete operation key=CKABTI1EOAWB tag=R59SOFJOGOPB type=del 2023-12-03T11:42:05.604 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.603+0000 7f8723d84780 1 > prepared part key=_multipart_HIU6L0NQ8Q95.2~3NHCWWDNSKVU.0 size=1048576 2023-12-03T11:42:05.605 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.604+0000 7f8723d84780 1 > prepared part key=_multipart_HIU6L0NQ8Q95.2~3NHCWWDNSKVU.1 size=1048576 2023-12-03T11:42:05.605 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.604+0000 7f8723d84780 1 > prepared part key=_multipart_HIU6L0NQ8Q95.2~3NHCWWDNSKVU.2 size=459554 2023-12-03T11:42:05.606 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.605+0000 7f8723d84780 1 > prepared multipart upload key=HIU6L0NQ8Q95 upload=3NHCWWDNSKVU tag=P1V4CZI589I1 type=write size=3605282 2023-12-03T11:42:05.607 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.606+0000 7f8723d84780 1 < completed part key=_multipart_931GNEXBHH35.2~RWT8HEZ82B3R.0 size=1048576 2023-12-03T11:42:05.608 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.607+0000 7f8723d84780 1 < completed part key=_multipart_931GNEXBHH35.2~RWT8HEZ82B3R.1 size=766500 2023-12-03T11:42:05.610 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.609+0000 7f8723d84780 1 < completed multipart upload key=931GNEXBHH35 upload=RWT8HEZ82B3R tag=OEL70IUALMA8 type=write size=2863652 2023-12-03T11:42:05.611 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.610+0000 7f8723d84780 1 > prepared operation key=DMQX2DGDLU7D tag=HUNWUM7KD7O8 type=del size=3105568 2023-12-03T11:42:05.611 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.610+0000 7f8723d84780 1 < canceled part key=_multipart_J33T5S893LMV.2~VQT65Y0HH6VM.0 size=1048576 2023-12-03T11:42:05.612 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.611+0000 7f8723d84780 1 < completed part key=_multipart_J33T5S893LMV.2~VQT65Y0HH6VM.1 size=678317 2023-12-03T11:42:05.614 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.613+0000 7f8723d84780 1 < canceled multipart upload key=J33T5S893LMV upload=VQT65Y0HH6VM tag=ICR2R138DLTD type=write size=2775469 2023-12-03T11:42:05.617 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.615+0000 7f8723d84780 1 > prepared part key=_multipart_OGACI7CRPMT7.2~BFSF56CBNP5W.0 size=603168 2023-12-03T11:42:05.617 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.615+0000 7f8723d84780 1 > prepared multipart upload key=OGACI7CRPMT7 upload=BFSF56CBNP5W tag=F98KOLBRTHYU type=write size=1651744 2023-12-03T11:42:05.617 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.616+0000 7f8723d84780 1 < completed delete operation key=DMQX2DGDLU7D tag=T5XEZH2QMH82 type=del 2023-12-03T11:42:05.619 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.618+0000 7f8723d84780 1 > prepared operation key=10JRIKOZ16FY tag=AA7USI5DDGF7 type=write size=755921 2023-12-03T11:42:05.621 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.620+0000 7f8723d84780 1 < suggested update operation key=Y6S7QI60GCLE tag=6ITAPCAPUMUI type=del size=1505093 2023-12-03T11:42:05.623 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.622+0000 7f8723d84780 1 > prepared part key=_multipart_LMVO6CVEPN3K.2~ENNAHGS84H3D.0 size=1048576 2023-12-03T11:42:05.624 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.623+0000 7f8723d84780 1 > prepared part key=_multipart_LMVO6CVEPN3K.2~ENNAHGS84H3D.1 size=631572 2023-12-03T11:42:05.624 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.623+0000 7f8723d84780 1 > prepared multipart upload key=LMVO6CVEPN3K upload=ENNAHGS84H3D tag=MVCYA0Q08OQP type=write size=2728724 2023-12-03T11:42:05.625 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.624+0000 7f8723d84780 1 < completed part key=_multipart_Y6S7QI60GCLE.2~VPFN730AIRFG.0 size=1048576 2023-12-03T11:42:05.625 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.624+0000 7f8723d84780 1 < canceled part key=_multipart_Y6S7QI60GCLE.2~VPFN730AIRFG.1 size=1048576 2023-12-03T11:42:05.626 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.625+0000 7f8723d84780 1 < completed part key=_multipart_Y6S7QI60GCLE.2~VPFN730AIRFG.2 size=438560 2023-12-03T11:42:05.628 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.627+0000 7f8723d84780 1 < canceled multipart upload key=Y6S7QI60GCLE upload=VPFN730AIRFG tag=7KW63GFAFUI1 type=write size=3584288 2023-12-03T11:42:05.630 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.629+0000 7f8723d84780 1 > prepared operation key=D3JEVEY0E29E tag=ABGMHF1XTIWR type=del size=3618248 2023-12-03T11:42:05.631 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.630+0000 7f8723d84780 1 < completed part key=_multipart_8NONX2I08YMJ.2~BXOM63HM0XSF.0 size=665552 2023-12-03T11:42:05.633 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.632+0000 7f8723d84780 1 < completed multipart upload key=8NONX2I08YMJ upload=BXOM63HM0XSF tag=5UHIDSFGVEN0 type=write size=1714128 2023-12-03T11:42:05.634 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.633+0000 7f8723d84780 1 > prepared operation key=12XG7YPYTN4U tag=MUEBZN7ESPDJ type=write size=632151 2023-12-03T11:42:05.634 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.633+0000 7f8723d84780 -1 < no bi entry to suggest for operation key=OPQPIDJ2PBVU tag=NV4Z4EUXMFP0 type=write size=72990: (2) No such file or directory 2023-12-03T11:42:05.636 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.636+0000 7f8723d84780 1 > prepared part key=_multipart_Y6S7QI60GCLE.2~DSXGKHW5ISC9.0 size=936000 2023-12-03T11:42:05.637 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.636+0000 7f8723d84780 1 > prepared multipart upload key=Y6S7QI60GCLE upload=DSXGKHW5ISC9 tag=AIUK1CODZGA2 type=write size=1984576 2023-12-03T11:42:05.638 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.637+0000 7f8723d84780 1 < completed delete operation key=K83BTR5BOLZE tag=3RGGFA9N3X9L type=del 2023-12-03T11:42:05.640 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.639+0000 7f8723d84780 1 > prepared part key=_multipart_931GNEXBHH35.2~E3HBP3Q717FR.0 size=1048576 2023-12-03T11:42:05.641 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.640+0000 7f8723d84780 1 > prepared part key=_multipart_931GNEXBHH35.2~E3HBP3Q717FR.1 size=546237 2023-12-03T11:42:05.641 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.640+0000 7f8723d84780 1 > prepared multipart upload key=931GNEXBHH35 upload=E3HBP3Q717FR tag=HGMBI8OWAXHO type=write size=2643389 2023-12-03T11:42:05.642 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.641+0000 7f8723d84780 1 < completed write operation key=W2704YS8KYQB tag=C494LT070MW8 type=write size=128302 2023-12-03T11:42:05.643 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.642+0000 7f8723d84780 1 > prepared operation key=G36T76K8O7A1 tag=CZBM9YNF4WLR type=del size=2674289 2023-12-03T11:42:05.644 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.643+0000 7f8723d84780 1 < completed part key=_multipart_FCA2R3HR61S2.2~SKAQX75O089O.0 size=798832 2023-12-03T11:42:05.646 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.645+0000 7f8723d84780 1 < completed multipart upload key=FCA2R3HR61S2 upload=SKAQX75O089O tag=7YRSK43VLQZE type=write size=1847408 2023-12-03T11:42:05.647 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.646+0000 7f8723d84780 1 > prepared operation key=10JRIKOZ16FY tag=28CAALUAIX1O type=del size=65321 2023-12-03T11:42:05.649 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.648+0000 7f8723d84780 1 < completed part key=_multipart_EY9ZG5KOTBWM.2~PIHXIBK1Z4FZ.0 size=1048576 2023-12-03T11:42:05.650 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.649+0000 7f8723d84780 1 < completed part key=_multipart_EY9ZG5KOTBWM.2~PIHXIBK1Z4FZ.1 size=24232 2023-12-03T11:42:05.652 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.650+0000 7f8723d84780 1 < completed multipart upload key=EY9ZG5KOTBWM upload=PIHXIBK1Z4FZ tag=D4V92PYHSXWY type=write size=2121384 2023-12-03T11:42:05.653 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.652+0000 7f8723d84780 1 > prepared operation key=DMQX2DGDLU7D tag=C4PZ94JHQTKL type=del size=1416918 2023-12-03T11:42:05.654 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.653+0000 7f8723d84780 1 < completed write operation key=M4VKPN6INFNZ tag=50OG0G2DO7N3 type=write size=449949 2023-12-03T11:42:05.655 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.654+0000 7f8723d84780 1 > prepared operation key=CKABTI1EOAWB tag=9EN9QQJ2DAS9 type=write size=1016600 2023-12-03T11:42:05.656 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.655+0000 7f8723d84780 1 < completed part key=_multipart_96RAVVSUKH0Y.2~PG5ZFOQHY8OS.0 size=1048576 2023-12-03T11:42:05.657 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.656+0000 7f8723d84780 1 < completed part key=_multipart_96RAVVSUKH0Y.2~PG5ZFOQHY8OS.1 size=1048576 2023-12-03T11:42:05.658 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.657+0000 7f8723d84780 1 < completed part key=_multipart_96RAVVSUKH0Y.2~PG5ZFOQHY8OS.2 size=37652 2023-12-03T11:42:05.660 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.659+0000 7f8723d84780 1 < completed multipart upload key=96RAVVSUKH0Y upload=PG5ZFOQHY8OS tag=ZHPGFWYIAW0L type=write size=3183380 2023-12-03T11:42:05.663 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.662+0000 7f8723d84780 1 > prepared part key=_multipart_J33T5S893LMV.2~VC8J986PWJEG.0 size=326794 2023-12-03T11:42:05.663 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.662+0000 7f8723d84780 1 > prepared multipart upload key=J33T5S893LMV upload=VC8J986PWJEG tag=H9UP8MNUT3T1 type=write size=1375370 2023-12-03T11:42:05.664 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.663+0000 7f8723d84780 1 < completed part key=_multipart_TSTIBGVYUZZZ.2~1MWRH823OBHI.0 size=749712 2023-12-03T11:42:05.667 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.666+0000 7f8723d84780 1 < completed multipart upload key=TSTIBGVYUZZZ upload=1MWRH823OBHI tag=HVU7TMGSYVX0 type=write size=1798288 2023-12-03T11:42:05.671 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.670+0000 7f8723d84780 1 > prepared part key=_multipart_5UYL15O31IHM.2~LMOBE5BKWO62.0 size=1048576 2023-12-03T11:42:05.672 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.671+0000 7f8723d84780 1 > prepared part key=_multipart_5UYL15O31IHM.2~LMOBE5BKWO62.1 size=1048576 2023-12-03T11:42:05.673 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.672+0000 7f8723d84780 1 > prepared part key=_multipart_5UYL15O31IHM.2~LMOBE5BKWO62.2 size=480194 2023-12-03T11:42:05.674 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.672+0000 7f8723d84780 1 > prepared multipart upload key=5UYL15O31IHM upload=LMOBE5BKWO62 tag=3RR20LUSF8GZ type=write size=3625922 2023-12-03T11:42:05.674 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.673+0000 7f8723d84780 1 < canceled operation key=DMQX2DGDLU7D tag=XSL3KDT63FD5 type=del size=897300 2023-12-03T11:42:05.677 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.676+0000 7f8723d84780 1 > prepared part key=_multipart_LCK58DDM5XU9.2~0B3RWCS27KZU.0 size=1048576 2023-12-03T11:42:05.678 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.677+0000 7f8723d84780 1 > prepared part key=_multipart_LCK58DDM5XU9.2~0B3RWCS27KZU.1 size=376458 2023-12-03T11:42:05.678 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.677+0000 7f8723d84780 1 > prepared multipart upload key=LCK58DDM5XU9 upload=0B3RWCS27KZU tag=R1MQXWFN65O2 type=write size=2473610 2023-12-03T11:42:05.679 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.678+0000 7f8723d84780 1 < completed part key=_multipart_HIU6L0NQ8Q95.2~3NHCWWDNSKVU.0 size=1048576 2023-12-03T11:42:05.680 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.679+0000 7f8723d84780 1 < completed part key=_multipart_HIU6L0NQ8Q95.2~3NHCWWDNSKVU.1 size=1048576 2023-12-03T11:42:05.681 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.680+0000 7f8723d84780 1 < completed part key=_multipart_HIU6L0NQ8Q95.2~3NHCWWDNSKVU.2 size=459554 2023-12-03T11:42:05.683 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.682+0000 7f8723d84780 1 < completed multipart upload key=HIU6L0NQ8Q95 upload=3NHCWWDNSKVU tag=P1V4CZI589I1 type=write size=3605282 2023-12-03T11:42:05.685 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.683+0000 7f8723d84780 1 > prepared operation key=Y6S7QI60GCLE tag=XRW2CU8KXH82 type=del size=2809550 2023-12-03T11:42:05.687 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.686+0000 7f8723d84780 1 < suggested update operation key=DMQX2DGDLU7D tag=HUNWUM7KD7O8 type=del size=3105568 2023-12-03T11:42:05.688 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.687+0000 7f8723d84780 1 > prepared operation key=10JRIKOZ16FY tag=SZOGT0JQPG8F type=del size=539945 2023-12-03T11:42:05.689 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.688+0000 7f8723d84780 1 < completed part key=_multipart_OGACI7CRPMT7.2~BFSF56CBNP5W.0 size=603168 2023-12-03T11:42:05.691 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.690+0000 7f8723d84780 1 < completed multipart upload key=OGACI7CRPMT7 upload=BFSF56CBNP5W tag=F98KOLBRTHYU type=write size=1651744 2023-12-03T11:42:05.694 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.693+0000 7f8723d84780 1 > prepared part key=_multipart_D3JEVEY0E29E.2~XP50BF61YSLI.0 size=1048576 2023-12-03T11:42:05.695 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.694+0000 7f8723d84780 1 > prepared part key=_multipart_D3JEVEY0E29E.2~XP50BF61YSLI.1 size=506008 2023-12-03T11:42:05.695 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.694+0000 7f8723d84780 1 > prepared multipart upload key=D3JEVEY0E29E upload=XP50BF61YSLI tag=MBYIC0BQHFNK type=write size=2603160 2023-12-03T11:42:05.697 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.695+0000 7f8723d84780 1 < completed write operation key=10JRIKOZ16FY tag=AA7USI5DDGF7 type=write size=755921 2023-12-03T11:42:05.698 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.697+0000 7f8723d84780 1 > prepared part key=_multipart_Y6S7QI60GCLE.2~1W7TYDKHRHW7.0 size=1048576 2023-12-03T11:42:05.701 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.698+0000 7f8723d84780 1 > prepared part key=_multipart_Y6S7QI60GCLE.2~1W7TYDKHRHW7.1 size=788558 2023-12-03T11:42:05.701 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.698+0000 7f8723d84780 1 > prepared multipart upload key=Y6S7QI60GCLE upload=1W7TYDKHRHW7 tag=BYU0LCUSYTZA type=write size=2885710 2023-12-03T11:42:05.701 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.699+0000 7f8723d84780 1 < completed part key=_multipart_LMVO6CVEPN3K.2~ENNAHGS84H3D.0 size=1048576 2023-12-03T11:42:05.701 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.700+0000 7f8723d84780 1 < completed part key=_multipart_LMVO6CVEPN3K.2~ENNAHGS84H3D.1 size=631572 2023-12-03T11:42:05.703 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.702+0000 7f8723d84780 1 < completed multipart upload key=LMVO6CVEPN3K upload=ENNAHGS84H3D tag=MVCYA0Q08OQP type=write size=2728724 2023-12-03T11:42:05.704 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.703+0000 7f8723d84780 1 > prepared operation key=UWS266H06VDK tag=TTM7MJIO3036 type=write size=728244 2023-12-03T11:42:05.706 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.705+0000 7f8723d84780 1 < completed delete operation key=D3JEVEY0E29E tag=ABGMHF1XTIWR type=del 2023-12-03T11:42:05.708 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.707+0000 7f8723d84780 1 > prepared part key=_multipart_KS5J7E7KE2IJ.2~MWKHF37PX9NQ.0 size=1048576 2023-12-03T11:42:05.709 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.708+0000 7f8723d84780 1 > prepared part key=_multipart_KS5J7E7KE2IJ.2~MWKHF37PX9NQ.1 size=970158 2023-12-03T11:42:05.710 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.708+0000 7f8723d84780 1 > prepared multipart upload key=KS5J7E7KE2IJ upload=MWKHF37PX9NQ tag=0JVY6LFHM4AQ type=write size=3067310 2023-12-03T11:42:05.711 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.710+0000 7f8723d84780 1 < canceled operation key=12XG7YPYTN4U tag=MUEBZN7ESPDJ type=write size=632151 2023-12-03T11:42:05.712 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.711+0000 7f8723d84780 1 > prepared operation key=EY9ZG5KOTBWM tag=XPAET8AAQEOR type=del size=4110632 2023-12-03T11:42:05.713 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.712+0000 7f8723d84780 1 < completed part key=_multipart_Y6S7QI60GCLE.2~DSXGKHW5ISC9.0 size=936000 2023-12-03T11:42:05.715 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.714+0000 7f8723d84780 1 < completed multipart upload key=Y6S7QI60GCLE upload=DSXGKHW5ISC9 tag=AIUK1CODZGA2 type=write size=1984576 2023-12-03T11:42:05.716 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.715+0000 7f8723d84780 1 > prepared operation key=D3JEVEY0E29E tag=7CL5TFOYTBR1 type=del size=3613930 2023-12-03T11:42:05.717 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.716+0000 7f8723d84780 1 < canceled part key=_multipart_931GNEXBHH35.2~E3HBP3Q717FR.0 size=1048576 2023-12-03T11:42:05.718 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.717+0000 7f8723d84780 1 < completed part key=_multipart_931GNEXBHH35.2~E3HBP3Q717FR.1 size=546237 2023-12-03T11:42:05.719 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.718+0000 7f8723d84780 1 < canceled multipart upload key=931GNEXBHH35 upload=E3HBP3Q717FR tag=HGMBI8OWAXHO type=write size=2643389 2023-12-03T11:42:05.720 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.719+0000 7f8723d84780 1 > prepared operation key=8NONX2I08YMJ tag=1LHBYY2CQ5TN type=del size=2497849 2023-12-03T11:42:05.722 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.721+0000 7f8723d84780 1 < completed delete operation key=G36T76K8O7A1 tag=CZBM9YNF4WLR type=del 2023-12-03T11:42:05.724 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.723+0000 7f8723d84780 1 > prepared part key=_multipart_DMQX2DGDLU7D.2~1BUEVVV294OC.0 size=1048576 2023-12-03T11:42:05.725 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.724+0000 7f8723d84780 1 > prepared part key=_multipart_DMQX2DGDLU7D.2~1BUEVVV294OC.1 size=1048576 2023-12-03T11:42:05.725 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.724+0000 7f8723d84780 1 > prepared part key=_multipart_DMQX2DGDLU7D.2~1BUEVVV294OC.2 size=825854 2023-12-03T11:42:05.726 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.724+0000 7f8723d84780 1 > prepared multipart upload key=DMQX2DGDLU7D upload=1BUEVVV294OC tag=OCCXKYVFSUXW type=write size=3971582 2023-12-03T11:42:05.727 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.726+0000 7f8723d84780 1 < completed delete operation key=10JRIKOZ16FY tag=28CAALUAIX1O type=del 2023-12-03T11:42:05.729 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.728+0000 7f8723d84780 1 > prepared part key=_multipart_TSTIBGVYUZZZ.2~E65N34HN8NKY.0 size=566811 2023-12-03T11:42:05.729 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.728+0000 7f8723d84780 1 > prepared multipart upload key=TSTIBGVYUZZZ upload=E65N34HN8NKY tag=KZP8P6JTLDWY type=write size=1615387 2023-12-03T11:42:05.730 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.729+0000 7f8723d84780 -1 < failed to complete operation key=DMQX2DGDLU7D tag=C4PZ94JHQTKL type=del size=1416918: (22) Invalid argument 2023-12-03T11:42:05.731 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.730+0000 7f8723d84780 1 > prepared operation key=7VMTBKUWU59F tag=X0O0W2JSF8FY type=del size=4064835 2023-12-03T11:42:05.733 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.732+0000 7f8723d84780 1 < completed write operation key=CKABTI1EOAWB tag=9EN9QQJ2DAS9 type=write size=1016600 2023-12-03T11:42:05.734 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.733+0000 7f8723d84780 1 > prepared operation key=4I8PWBZOLDUG tag=YQUNHMYFJEWM type=del size=81057 2023-12-03T11:42:05.735 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.734+0000 7f8723d84780 1 < completed part key=_multipart_J33T5S893LMV.2~VC8J986PWJEG.0 size=326794 2023-12-03T11:42:05.737 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.736+0000 7f8723d84780 1 < completed multipart upload key=J33T5S893LMV upload=VC8J986PWJEG tag=H9UP8MNUT3T1 type=write size=1375370 2023-12-03T11:42:05.738 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.737+0000 7f8723d84780 1 > prepared operation key=LMVO6CVEPN3K tag=KLPBPDX7VP4S type=del size=3279344 2023-12-03T11:42:05.739 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.738+0000 7f8723d84780 1 < completed part key=_multipart_5UYL15O31IHM.2~LMOBE5BKWO62.0 size=1048576 2023-12-03T11:42:05.740 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.739+0000 7f8723d84780 1 < completed part key=_multipart_5UYL15O31IHM.2~LMOBE5BKWO62.1 size=1048576 2023-12-03T11:42:05.741 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.740+0000 7f8723d84780 1 < completed part key=_multipart_5UYL15O31IHM.2~LMOBE5BKWO62.2 size=480194 2023-12-03T11:42:05.743 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.742+0000 7f8723d84780 1 < completed multipart upload key=5UYL15O31IHM upload=LMOBE5BKWO62 tag=3RR20LUSF8GZ type=write size=3625922 2023-12-03T11:42:05.745 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.744+0000 7f8723d84780 1 > prepared part key=_multipart_HIU6L0NQ8Q95.2~PP1DY0JUVKCI.0 size=1048576 2023-12-03T11:42:05.746 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.745+0000 7f8723d84780 1 > prepared part key=_multipart_HIU6L0NQ8Q95.2~PP1DY0JUVKCI.1 size=933793 2023-12-03T11:42:05.746 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.745+0000 7f8723d84780 1 > prepared multipart upload key=HIU6L0NQ8Q95 upload=PP1DY0JUVKCI tag=XK02UJKLYN9U type=write size=3030945 2023-12-03T11:42:05.747 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.746+0000 7f8723d84780 1 < completed part key=_multipart_LCK58DDM5XU9.2~0B3RWCS27KZU.0 size=1048576 2023-12-03T11:42:05.748 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.747+0000 7f8723d84780 1 < completed part key=_multipart_LCK58DDM5XU9.2~0B3RWCS27KZU.1 size=376458 2023-12-03T11:42:05.750 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.749+0000 7f8723d84780 1 < completed multipart upload key=LCK58DDM5XU9 upload=0B3RWCS27KZU tag=R1MQXWFN65O2 type=write size=2473610 2023-12-03T11:42:05.751 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.750+0000 7f8723d84780 1 > prepared operation key=G36T76K8O7A1 tag=5MXVTW7GHJ0L type=write size=168480 2023-12-03T11:42:05.752 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.751+0000 7f8723d84780 1 < completed delete operation key=Y6S7QI60GCLE tag=XRW2CU8KXH82 type=del 2023-12-03T11:42:05.754 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.753+0000 7f8723d84780 1 > prepared part key=_multipart_KS5J7E7KE2IJ.2~S4AHLTUVACWS.0 size=1048576 2023-12-03T11:42:05.755 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.754+0000 7f8723d84780 1 > prepared part key=_multipart_KS5J7E7KE2IJ.2~S4AHLTUVACWS.1 size=1048576 2023-12-03T11:42:05.756 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.755+0000 7f8723d84780 1 > prepared part key=_multipart_KS5J7E7KE2IJ.2~S4AHLTUVACWS.2 size=120771 2023-12-03T11:42:05.756 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.755+0000 7f8723d84780 1 > prepared multipart upload key=KS5J7E7KE2IJ upload=S4AHLTUVACWS tag=WTRI7ABCXCB9 type=write size=3266499 2023-12-03T11:42:05.757 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.756+0000 7f8723d84780 1 < completed delete operation key=10JRIKOZ16FY tag=SZOGT0JQPG8F type=del 2023-12-03T11:42:05.758 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.757+0000 7f8723d84780 1 > prepared operation key=OPQPIDJ2PBVU tag=KI2TTUS9K5OT type=del size=3775249 2023-12-03T11:42:05.760 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.759+0000 7f8723d84780 1 < completed part key=_multipart_D3JEVEY0E29E.2~XP50BF61YSLI.0 size=1048576 2023-12-03T11:42:05.761 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.760+0000 7f8723d84780 1 < completed part key=_multipart_D3JEVEY0E29E.2~XP50BF61YSLI.1 size=506008 2023-12-03T11:42:05.763 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.762+0000 7f8723d84780 1 < completed multipart upload key=D3JEVEY0E29E upload=XP50BF61YSLI tag=MBYIC0BQHFNK type=write size=2603160 2023-12-03T11:42:05.764 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.763+0000 7f8723d84780 1 > prepared operation key=UWS266H06VDK tag=DT4QXSJM2HMQ type=del size=3236686 2023-12-03T11:42:05.766 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.764+0000 7f8723d84780 1 < completed part key=_multipart_Y6S7QI60GCLE.2~1W7TYDKHRHW7.0 size=1048576 2023-12-03T11:42:05.769 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.767+0000 7f8723d84780 1 < completed part key=_multipart_Y6S7QI60GCLE.2~1W7TYDKHRHW7.1 size=788558 2023-12-03T11:42:05.770 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.769+0000 7f8723d84780 1 < completed multipart upload key=Y6S7QI60GCLE upload=1W7TYDKHRHW7 tag=BYU0LCUSYTZA type=write size=2885710 2023-12-03T11:42:05.771 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.770+0000 7f8723d84780 1 > prepared operation key=J33T5S893LMV tag=PMT9719B9E4I type=write size=867611 2023-12-03T11:42:05.772 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.771+0000 7f8723d84780 1 < completed write operation key=UWS266H06VDK tag=TTM7MJIO3036 type=write size=728244 2023-12-03T11:42:05.773 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.772+0000 7f8723d84780 1 > prepared operation key=LMVO6CVEPN3K tag=7SPULT1G6IOW type=del size=819792 2023-12-03T11:42:05.775 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.774+0000 7f8723d84780 1 < completed part key=_multipart_KS5J7E7KE2IJ.2~MWKHF37PX9NQ.0 size=1048576 2023-12-03T11:42:05.777 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.774+0000 7f8723d84780 1 < completed part key=_multipart_KS5J7E7KE2IJ.2~MWKHF37PX9NQ.1 size=970158 2023-12-03T11:42:05.778 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.777+0000 7f8723d84780 1 < completed multipart upload key=KS5J7E7KE2IJ upload=MWKHF37PX9NQ tag=0JVY6LFHM4AQ type=write size=3067310 2023-12-03T11:42:05.779 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.778+0000 7f8723d84780 1 > prepared operation key=HIU6L0NQ8Q95 tag=G39WMC533GUJ type=del size=2149001 2023-12-03T11:42:05.781 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.780+0000 7f8723d84780 1 < completed delete operation key=EY9ZG5KOTBWM tag=XPAET8AAQEOR type=del 2023-12-03T11:42:05.782 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.781+0000 7f8723d84780 1 > prepared operation key=AB0SN0E49Z5F tag=P05CZM8J9EV5 type=del size=3650077 2023-12-03T11:42:05.784 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.782+0000 7f8723d84780 1 < completed delete operation key=D3JEVEY0E29E tag=7CL5TFOYTBR1 type=del 2023-12-03T11:42:05.785 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.783+0000 7f8723d84780 1 > prepared operation key=M4VKPN6INFNZ tag=K3NDKJDTH900 type=del size=108200 2023-12-03T11:42:05.785 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.785+0000 7f8723d84780 1 < completed delete operation key=8NONX2I08YMJ tag=1LHBYY2CQ5TN type=del 2023-12-03T11:42:05.788 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.787+0000 7f8723d84780 1 > prepared part key=_multipart_5UYL15O31IHM.2~LYD7PRBVJD0O.0 size=1024077 2023-12-03T11:42:05.788 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.787+0000 7f8723d84780 1 > prepared multipart upload key=5UYL15O31IHM upload=LYD7PRBVJD0O tag=OJDT43Z7TVQM type=write size=2072653 2023-12-03T11:42:05.789 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.788+0000 7f8723d84780 1 < completed part key=_multipart_DMQX2DGDLU7D.2~1BUEVVV294OC.0 size=1048576 2023-12-03T11:42:05.789 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.788+0000 7f8723d84780 1 < canceled part key=_multipart_DMQX2DGDLU7D.2~1BUEVVV294OC.1 size=1048576 2023-12-03T11:42:05.790 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.789+0000 7f8723d84780 1 < completed part key=_multipart_DMQX2DGDLU7D.2~1BUEVVV294OC.2 size=825854 2023-12-03T11:42:05.792 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.791+0000 7f8723d84780 1 < canceled multipart upload key=DMQX2DGDLU7D upload=1BUEVVV294OC tag=OCCXKYVFSUXW type=write size=3971582 2023-12-03T11:42:05.793 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.792+0000 7f8723d84780 1 > prepared operation key=10JRIKOZ16FY tag=1530OPV86UT0 type=del size=464270 2023-12-03T11:42:05.795 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.794+0000 7f8723d84780 1 < completed part key=_multipart_TSTIBGVYUZZZ.2~E65N34HN8NKY.0 size=566811 2023-12-03T11:42:05.797 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.796+0000 7f8723d84780 1 < completed multipart upload key=TSTIBGVYUZZZ upload=E65N34HN8NKY tag=KZP8P6JTLDWY type=write size=1615387 2023-12-03T11:42:05.798 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.797+0000 7f8723d84780 1 > prepared operation key=931GNEXBHH35 tag=R9OHQ4DUSEMA type=del size=4154067 2023-12-03T11:42:05.800 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.799+0000 7f8723d84780 1 < suggested remove operation key=7VMTBKUWU59F tag=X0O0W2JSF8FY type=del 2023-12-03T11:42:05.801 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.800+0000 7f8723d84780 1 > prepared operation key=LMVO6CVEPN3K tag=UGFF8L7ZYTBJ type=del size=2069178 2023-12-03T11:42:05.804 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.803+0000 7f8723d84780 1 < suggested remove operation key=4I8PWBZOLDUG tag=YQUNHMYFJEWM type=del 2023-12-03T11:42:05.806 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.805+0000 7f8723d84780 1 > prepared part key=_multipart_O7VVHXLDSY57.2~Y88ZNE3913OR.0 size=422317 2023-12-03T11:42:05.806 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.805+0000 7f8723d84780 1 > prepared multipart upload key=O7VVHXLDSY57 upload=Y88ZNE3913OR tag=9MH7P6Y558XQ type=write size=1470893 2023-12-03T11:42:05.807 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.806+0000 7f8723d84780 1 < completed delete operation key=LMVO6CVEPN3K tag=KLPBPDX7VP4S type=del 2023-12-03T11:42:05.808 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.807+0000 7f8723d84780 1 > prepared operation key=96RAVVSUKH0Y tag=PHBNUS921FAB type=del size=3495670 2023-12-03T11:42:05.809 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.808+0000 7f8723d84780 1 < completed part key=_multipart_HIU6L0NQ8Q95.2~PP1DY0JUVKCI.0 size=1048576 2023-12-03T11:42:05.810 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.809+0000 7f8723d84780 1 < completed part key=_multipart_HIU6L0NQ8Q95.2~PP1DY0JUVKCI.1 size=933793 2023-12-03T11:42:05.813 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.811+0000 7f8723d84780 1 < completed multipart upload key=HIU6L0NQ8Q95 upload=PP1DY0JUVKCI tag=XK02UJKLYN9U type=write size=3030945 2023-12-03T11:42:05.814 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.813+0000 7f8723d84780 1 > prepared operation key=M4VKPN6INFNZ tag=PR9DQCW9YSA9 type=del size=1338371 2023-12-03T11:42:05.815 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.814+0000 7f8723d84780 1 < completed write operation key=G36T76K8O7A1 tag=5MXVTW7GHJ0L type=write size=168480 2023-12-03T11:42:05.816 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.815+0000 7f8723d84780 1 > prepared operation key=EY9ZG5KOTBWM tag=E3X6QSGUPHMF type=del size=220001 2023-12-03T11:42:05.817 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.816+0000 7f8723d84780 1 < completed part key=_multipart_KS5J7E7KE2IJ.2~S4AHLTUVACWS.0 size=1048576 2023-12-03T11:42:05.817 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.816+0000 7f8723d84780 1 < canceled part key=_multipart_KS5J7E7KE2IJ.2~S4AHLTUVACWS.1 size=1048576 2023-12-03T11:42:05.818 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.817+0000 7f8723d84780 1 < completed part key=_multipart_KS5J7E7KE2IJ.2~S4AHLTUVACWS.2 size=120771 2023-12-03T11:42:05.821 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.820+0000 7f8723d84780 1 < canceled multipart upload key=KS5J7E7KE2IJ upload=S4AHLTUVACWS tag=WTRI7ABCXCB9 type=write size=3266499 2023-12-03T11:42:05.822 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.821+0000 7f8723d84780 1 > prepared operation key=4I8PWBZOLDUG tag=MFX9M0P7U57Z type=del size=3449084 2023-12-03T11:42:05.823 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.822+0000 7f8723d84780 1 < completed delete operation key=OPQPIDJ2PBVU tag=KI2TTUS9K5OT type=del 2023-12-03T11:42:05.824 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.823+0000 7f8723d84780 1 > prepared operation key=G36T76K8O7A1 tag=2QRNN040CWUG type=write size=437420 2023-12-03T11:42:05.826 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.825+0000 7f8723d84780 1 < completed delete operation key=UWS266H06VDK tag=DT4QXSJM2HMQ type=del 2023-12-03T11:42:05.827 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.826+0000 7f8723d84780 1 > prepared operation key=EITMJKL0LCYC tag=YRENOV4ZNOPH type=write size=646358 2023-12-03T11:42:05.828 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.827+0000 7f8723d84780 1 < completed write operation key=J33T5S893LMV tag=PMT9719B9E4I type=write size=867611 2023-12-03T11:42:05.831 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.830+0000 7f8723d84780 1 > prepared part key=_multipart_D3JEVEY0E29E.2~IGKVP3VSFM9L.0 size=1048576 2023-12-03T11:42:05.832 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.831+0000 7f8723d84780 1 > prepared part key=_multipart_D3JEVEY0E29E.2~IGKVP3VSFM9L.1 size=183319 2023-12-03T11:42:05.832 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.831+0000 7f8723d84780 1 > prepared multipart upload key=D3JEVEY0E29E upload=IGKVP3VSFM9L tag=PW8I21JMYCWU type=write size=2280471 2023-12-03T11:42:05.835 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.833+0000 7f8723d84780 1 < suggested remove operation key=LMVO6CVEPN3K tag=7SPULT1G6IOW type=del 2023-12-03T11:42:05.837 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.836+0000 7f8723d84780 1 > prepared part key=_multipart_4I8PWBZOLDUG.2~EB72ZWHGGF0K.0 size=1048576 2023-12-03T11:42:05.838 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.837+0000 7f8723d84780 1 > prepared part key=_multipart_4I8PWBZOLDUG.2~EB72ZWHGGF0K.1 size=1048576 2023-12-03T11:42:05.839 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.838+0000 7f8723d84780 1 > prepared part key=_multipart_4I8PWBZOLDUG.2~EB72ZWHGGF0K.2 size=1047296 2023-12-03T11:42:05.839 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.838+0000 7f8723d84780 1 > prepared multipart upload key=4I8PWBZOLDUG upload=EB72ZWHGGF0K tag=Z1Q004ZURVKU type=write size=4193024 2023-12-03T11:42:05.841 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.840+0000 7f8723d84780 1 < canceled operation key=HIU6L0NQ8Q95 tag=G39WMC533GUJ type=del size=2149001 2023-12-03T11:42:05.842 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.841+0000 7f8723d84780 1 > prepared operation key=W2704YS8KYQB tag=24FTFZZNNTDM type=del size=1009988 2023-12-03T11:42:05.844 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.843+0000 7f8723d84780 1 < suggested remove operation key=AB0SN0E49Z5F tag=P05CZM8J9EV5 type=del 2023-12-03T11:42:05.846 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.845+0000 7f8723d84780 1 > prepared part key=_multipart_AB0SN0E49Z5F.2~2FUI0IRIS6G0.0 size=1048576 2023-12-03T11:42:05.847 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.846+0000 7f8723d84780 1 > prepared part key=_multipart_AB0SN0E49Z5F.2~2FUI0IRIS6G0.1 size=1048576 2023-12-03T11:42:05.848 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.847+0000 7f8723d84780 1 > prepared part key=_multipart_AB0SN0E49Z5F.2~2FUI0IRIS6G0.2 size=51749 2023-12-03T11:42:05.848 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.847+0000 7f8723d84780 1 > prepared multipart upload key=AB0SN0E49Z5F upload=2FUI0IRIS6G0 tag=SC1PES2OWYF1 type=write size=3197477 2023-12-03T11:42:05.849 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.848+0000 7f8723d84780 1 < completed delete operation key=M4VKPN6INFNZ tag=K3NDKJDTH900 type=del 2023-12-03T11:42:05.851 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.850+0000 7f8723d84780 1 > prepared part key=_multipart_TSTIBGVYUZZZ.2~GMBUEUEGSKJK.0 size=1048576 2023-12-03T11:42:05.852 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.851+0000 7f8723d84780 1 > prepared part key=_multipart_TSTIBGVYUZZZ.2~GMBUEUEGSKJK.1 size=1048576 2023-12-03T11:42:05.853 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.852+0000 7f8723d84780 1 > prepared part key=_multipart_TSTIBGVYUZZZ.2~GMBUEUEGSKJK.2 size=616012 2023-12-03T11:42:05.853 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.852+0000 7f8723d84780 1 > prepared multipart upload key=TSTIBGVYUZZZ upload=GMBUEUEGSKJK tag=LNBOBIMH9VCC type=write size=3761740 2023-12-03T11:42:05.854 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.853+0000 7f8723d84780 1 < completed part key=_multipart_5UYL15O31IHM.2~LYD7PRBVJD0O.0 size=1024077 2023-12-03T11:42:05.856 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.855+0000 7f8723d84780 1 < completed multipart upload key=5UYL15O31IHM upload=LYD7PRBVJD0O tag=OJDT43Z7TVQM type=write size=2072653 2023-12-03T11:42:05.858 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.857+0000 7f8723d84780 1 > prepared part key=_multipart_CKABTI1EOAWB.2~F0A7XGQTYC0Y.0 size=1048576 2023-12-03T11:42:05.859 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.858+0000 7f8723d84780 1 > prepared part key=_multipart_CKABTI1EOAWB.2~F0A7XGQTYC0Y.1 size=855350 2023-12-03T11:42:05.859 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.858+0000 7f8723d84780 1 > prepared multipart upload key=CKABTI1EOAWB upload=F0A7XGQTYC0Y tag=V1UP5CD2TQLE type=write size=2952502 2023-12-03T11:42:05.860 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.859+0000 7f8723d84780 1 < completed delete operation key=10JRIKOZ16FY tag=1530OPV86UT0 type=del 2023-12-03T11:42:05.862 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.861+0000 7f8723d84780 1 > prepared part key=_multipart_D3JEVEY0E29E.2~E0E6I1WHQP5F.0 size=458950 2023-12-03T11:42:05.862 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.861+0000 7f8723d84780 1 > prepared multipart upload key=D3JEVEY0E29E upload=E0E6I1WHQP5F tag=NMM72GM9YYCZ type=write size=1507526 2023-12-03T11:42:05.863 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.862+0000 7f8723d84780 1 < canceled operation key=931GNEXBHH35 tag=R9OHQ4DUSEMA type=del size=4154067 2023-12-03T11:42:05.867 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.864+0000 7f8723d84780 1 > prepared part key=_multipart_5UYL15O31IHM.2~4JK9M5SZIB3C.0 size=1048576 2023-12-03T11:42:05.867 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.866+0000 7f8723d84780 1 > prepared part key=_multipart_5UYL15O31IHM.2~4JK9M5SZIB3C.1 size=106493 2023-12-03T11:42:05.867 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.866+0000 7f8723d84780 1 > prepared multipart upload key=5UYL15O31IHM upload=4JK9M5SZIB3C tag=99Y7MNECU804 type=write size=2203645 2023-12-03T11:42:05.868 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.867+0000 7f8723d84780 -1 < failed to complete operation key=LMVO6CVEPN3K tag=UGFF8L7ZYTBJ type=del size=2069178: (22) Invalid argument 2023-12-03T11:42:05.869 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.868+0000 7f8723d84780 1 > prepared operation key=VENJI0KD1XDW tag=ONKBA9UXYNUU type=del size=3091391 2023-12-03T11:42:05.870 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.869+0000 7f8723d84780 1 < completed part key=_multipart_O7VVHXLDSY57.2~Y88ZNE3913OR.0 size=422317 2023-12-03T11:42:05.872 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.871+0000 7f8723d84780 1 < completed multipart upload key=O7VVHXLDSY57 upload=Y88ZNE3913OR tag=9MH7P6Y558XQ type=write size=1470893 2023-12-03T11:42:05.874 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.873+0000 7f8723d84780 1 > prepared operation key=D3JEVEY0E29E tag=R37JJAGJXOTN type=write size=610092 2023-12-03T11:42:05.875 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.874+0000 7f8723d84780 1 < completed delete operation key=96RAVVSUKH0Y tag=PHBNUS921FAB type=del 2023-12-03T11:42:05.877 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.876+0000 7f8723d84780 1 > prepared part key=_multipart_TSTIBGVYUZZZ.2~EJFT8UR86XFL.0 size=1048576 2023-12-03T11:42:05.878 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.877+0000 7f8723d84780 1 > prepared part key=_multipart_TSTIBGVYUZZZ.2~EJFT8UR86XFL.1 size=1048576 2023-12-03T11:42:05.879 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.878+0000 7f8723d84780 1 > prepared part key=_multipart_TSTIBGVYUZZZ.2~EJFT8UR86XFL.2 size=570724 2023-12-03T11:42:05.879 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.878+0000 7f8723d84780 1 > prepared multipart upload key=TSTIBGVYUZZZ upload=EJFT8UR86XFL tag=6VNWTEH3O67V type=write size=3716452 2023-12-03T11:42:05.881 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.880+0000 7f8723d84780 1 < suggested update operation key=M4VKPN6INFNZ tag=PR9DQCW9YSA9 type=del size=1338371 2023-12-03T11:42:05.883 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.882+0000 7f8723d84780 1 > prepared operation key=Y6S7QI60GCLE tag=1PSAM3YOWLXV type=del size=3586364 2023-12-03T11:42:05.884 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.883+0000 7f8723d84780 1 < completed delete operation key=EY9ZG5KOTBWM tag=E3X6QSGUPHMF type=del 2023-12-03T11:42:05.885 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.884+0000 7f8723d84780 1 > prepared operation key=KS5J7E7KE2IJ tag=OH0F48H209SO type=write size=955357 2023-12-03T11:42:05.886 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.885+0000 7f8723d84780 1 < completed delete operation key=4I8PWBZOLDUG tag=MFX9M0P7U57Z type=del 2023-12-03T11:42:05.887 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.886+0000 7f8723d84780 1 > prepared operation key=AB0SN0E49Z5F tag=7MM8O20YSYED type=del size=315036 2023-12-03T11:42:05.889 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.888+0000 7f8723d84780 1 < completed write operation key=G36T76K8O7A1 tag=2QRNN040CWUG type=write size=437420 2023-12-03T11:42:05.890 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.889+0000 7f8723d84780 1 > prepared operation key=M4VKPN6INFNZ tag=XI95PJ2ZDO5P type=write size=915498 2023-12-03T11:42:05.891 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.890+0000 7f8723d84780 1 < completed write operation key=EITMJKL0LCYC tag=YRENOV4ZNOPH type=write size=646358 2023-12-03T11:42:05.892 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.891+0000 7f8723d84780 1 > prepared operation key=AB0SN0E49Z5F tag=7XEH4MIVKDV5 type=del size=3726054 2023-12-03T11:42:05.893 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.892+0000 7f8723d84780 1 < completed part key=_multipart_D3JEVEY0E29E.2~IGKVP3VSFM9L.0 size=1048576 2023-12-03T11:42:05.895 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.894+0000 7f8723d84780 1 < completed part key=_multipart_D3JEVEY0E29E.2~IGKVP3VSFM9L.1 size=183319 2023-12-03T11:42:05.897 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.896+0000 7f8723d84780 1 < completed multipart upload key=D3JEVEY0E29E upload=IGKVP3VSFM9L tag=PW8I21JMYCWU type=write size=2280471 2023-12-03T11:42:05.898 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.897+0000 7f8723d84780 1 > prepared operation key=CKABTI1EOAWB tag=C4TH753XSDSJ type=del size=360913 2023-12-03T11:42:05.900 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.899+0000 7f8723d84780 1 < completed part key=_multipart_4I8PWBZOLDUG.2~EB72ZWHGGF0K.0 size=1048576 2023-12-03T11:42:05.901 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.900+0000 7f8723d84780 1 < completed part key=_multipart_4I8PWBZOLDUG.2~EB72ZWHGGF0K.1 size=1048576 2023-12-03T11:42:05.901 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.900+0000 7f8723d84780 1 < canceled part key=_multipart_4I8PWBZOLDUG.2~EB72ZWHGGF0K.2 size=1047296 2023-12-03T11:42:05.903 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.902+0000 7f8723d84780 1 < canceled multipart upload key=4I8PWBZOLDUG upload=EB72ZWHGGF0K tag=Z1Q004ZURVKU type=write size=4193024 2023-12-03T11:42:05.904 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.903+0000 7f8723d84780 1 > prepared operation key=VENJI0KD1XDW tag=6Y1LO1NFDN74 type=del size=2157477 2023-12-03T11:42:05.905 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.904+0000 7f8723d84780 1 < completed delete operation key=W2704YS8KYQB tag=24FTFZZNNTDM type=del 2023-12-03T11:42:05.908 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.906+0000 7f8723d84780 1 > prepared part key=_multipart_AB0SN0E49Z5F.2~ESBZFDLFXSD2.0 size=795397 2023-12-03T11:42:05.908 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.906+0000 7f8723d84780 1 > prepared multipart upload key=AB0SN0E49Z5F upload=ESBZFDLFXSD2 tag=CMR2V31R6QPH type=write size=1843973 2023-12-03T11:42:05.909 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.907+0000 7f8723d84780 1 < completed part key=_multipart_AB0SN0E49Z5F.2~2FUI0IRIS6G0.0 size=1048576 2023-12-03T11:42:05.909 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.908+0000 7f8723d84780 1 < completed part key=_multipart_AB0SN0E49Z5F.2~2FUI0IRIS6G0.1 size=1048576 2023-12-03T11:42:05.910 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.909+0000 7f8723d84780 1 < completed part key=_multipart_AB0SN0E49Z5F.2~2FUI0IRIS6G0.2 size=51749 2023-12-03T11:42:05.912 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.911+0000 7f8723d84780 1 < completed multipart upload key=AB0SN0E49Z5F upload=2FUI0IRIS6G0 tag=SC1PES2OWYF1 type=write size=3197477 2023-12-03T11:42:05.915 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.914+0000 7f8723d84780 1 > prepared part key=_multipart_Y6S7QI60GCLE.2~NFF7LEZF9IZL.0 size=631924 2023-12-03T11:42:05.915 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.914+0000 7f8723d84780 1 > prepared multipart upload key=Y6S7QI60GCLE upload=NFF7LEZF9IZL tag=TDIBYIFWCQOI type=write size=1680500 2023-12-03T11:42:05.916 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.915+0000 7f8723d84780 1 < completed part key=_multipart_TSTIBGVYUZZZ.2~GMBUEUEGSKJK.0 size=1048576 2023-12-03T11:42:05.917 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.916+0000 7f8723d84780 1 < completed part key=_multipart_TSTIBGVYUZZZ.2~GMBUEUEGSKJK.1 size=1048576 2023-12-03T11:42:05.918 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.917+0000 7f8723d84780 1 < completed part key=_multipart_TSTIBGVYUZZZ.2~GMBUEUEGSKJK.2 size=616012 2023-12-03T11:42:05.920 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.919+0000 7f8723d84780 1 < completed multipart upload key=TSTIBGVYUZZZ upload=GMBUEUEGSKJK tag=LNBOBIMH9VCC type=write size=3761740 2023-12-03T11:42:05.922 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.921+0000 7f8723d84780 1 > prepared part key=_multipart_5UYL15O31IHM.2~8KYMH8NTAL7X.0 size=1048576 2023-12-03T11:42:05.923 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.922+0000 7f8723d84780 1 > prepared part key=_multipart_5UYL15O31IHM.2~8KYMH8NTAL7X.1 size=802858 2023-12-03T11:42:05.923 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.922+0000 7f8723d84780 1 > prepared multipart upload key=5UYL15O31IHM upload=8KYMH8NTAL7X tag=26LZCKA3U5X3 type=write size=2900010 2023-12-03T11:42:05.924 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.923+0000 7f8723d84780 1 < completed part key=_multipart_CKABTI1EOAWB.2~F0A7XGQTYC0Y.0 size=1048576 2023-12-03T11:42:05.925 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.924+0000 7f8723d84780 1 < completed part key=_multipart_CKABTI1EOAWB.2~F0A7XGQTYC0Y.1 size=855350 2023-12-03T11:42:05.929 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.928+0000 7f8723d84780 1 < completed multipart upload key=CKABTI1EOAWB upload=F0A7XGQTYC0Y tag=V1UP5CD2TQLE type=write size=2952502 2023-12-03T11:42:05.930 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.929+0000 7f8723d84780 1 > prepared operation key=J33T5S893LMV tag=VU7754PSS123 type=del size=1268890 2023-12-03T11:42:05.931 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.930+0000 7f8723d84780 1 < completed part key=_multipart_D3JEVEY0E29E.2~E0E6I1WHQP5F.0 size=458950 2023-12-03T11:42:05.933 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.932+0000 7f8723d84780 1 < completed multipart upload key=D3JEVEY0E29E upload=E0E6I1WHQP5F tag=NMM72GM9YYCZ type=write size=1507526 2023-12-03T11:42:05.934 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.933+0000 7f8723d84780 1 > prepared operation key=D3JEVEY0E29E tag=4FO2KD0VTQ9N type=del size=2964354 2023-12-03T11:42:05.936 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.935+0000 7f8723d84780 1 < completed part key=_multipart_5UYL15O31IHM.2~4JK9M5SZIB3C.0 size=1048576 2023-12-03T11:42:05.937 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.936+0000 7f8723d84780 1 < completed part key=_multipart_5UYL15O31IHM.2~4JK9M5SZIB3C.1 size=106493 2023-12-03T11:42:05.939 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.937+0000 7f8723d84780 1 < completed multipart upload key=5UYL15O31IHM upload=4JK9M5SZIB3C tag=99Y7MNECU804 type=write size=2203645 2023-12-03T11:42:05.940 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.939+0000 7f8723d84780 1 > prepared operation key=DMQX2DGDLU7D tag=OCN0WOLNVAGF type=del size=3192882 2023-12-03T11:42:05.942 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.941+0000 7f8723d84780 1 < suggested remove operation key=VENJI0KD1XDW tag=ONKBA9UXYNUU type=del 2023-12-03T11:42:05.943 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.942+0000 7f8723d84780 1 > prepared operation key=EY9ZG5KOTBWM tag=LUWXEPFL2S65 type=del size=2030935 2023-12-03T11:42:05.946 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.945+0000 7f8723d84780 1 < suggested remove operation key=D3JEVEY0E29E tag=R37JJAGJXOTN type=write 2023-12-03T11:42:05.948 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.947+0000 7f8723d84780 1 > prepared operation key=12XG7YPYTN4U tag=GL3Y4N7Q5QTO type=del size=2416977 2023-12-03T11:42:05.949 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.948+0000 7f8723d84780 1 < completed part key=_multipart_TSTIBGVYUZZZ.2~EJFT8UR86XFL.0 size=1048576 2023-12-03T11:42:05.950 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.949+0000 7f8723d84780 1 < completed part key=_multipart_TSTIBGVYUZZZ.2~EJFT8UR86XFL.1 size=1048576 2023-12-03T11:42:05.951 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.950+0000 7f8723d84780 1 < completed part key=_multipart_TSTIBGVYUZZZ.2~EJFT8UR86XFL.2 size=570724 2023-12-03T11:42:05.953 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.952+0000 7f8723d84780 1 < completed multipart upload key=TSTIBGVYUZZZ upload=EJFT8UR86XFL tag=6VNWTEH3O67V type=write size=3716452 2023-12-03T11:42:05.954 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.953+0000 7f8723d84780 1 > prepared operation key=G36T76K8O7A1 tag=N2HAU5INPJCM type=del size=3139718 2023-12-03T11:42:05.955 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.954+0000 7f8723d84780 1 < completed delete operation key=Y6S7QI60GCLE tag=1PSAM3YOWLXV type=del 2023-12-03T11:42:05.957 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.956+0000 7f8723d84780 1 > prepared part key=_multipart_Y6S7QI60GCLE.2~ZY2UD0JO0CGJ.0 size=1048576 2023-12-03T11:42:05.958 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.957+0000 7f8723d84780 1 > prepared part key=_multipart_Y6S7QI60GCLE.2~ZY2UD0JO0CGJ.1 size=1048576 2023-12-03T11:42:05.959 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.958+0000 7f8723d84780 1 > prepared part key=_multipart_Y6S7QI60GCLE.2~ZY2UD0JO0CGJ.2 size=31930 2023-12-03T11:42:05.959 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.958+0000 7f8723d84780 1 > prepared multipart upload key=Y6S7QI60GCLE upload=ZY2UD0JO0CGJ tag=4TO21RAFL3XR type=write size=3177658 2023-12-03T11:42:05.960 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.959+0000 7f8723d84780 1 < completed write operation key=KS5J7E7KE2IJ tag=OH0F48H209SO type=write size=955357 2023-12-03T11:42:05.962 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.961+0000 7f8723d84780 1 > prepared part key=_multipart_EITMJKL0LCYC.2~SOUT7CUANSME.0 size=248233 2023-12-03T11:42:05.962 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.961+0000 7f8723d84780 1 > prepared multipart upload key=EITMJKL0LCYC upload=SOUT7CUANSME tag=C4RL3ZSBR541 type=write size=1296809 2023-12-03T11:42:05.965 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.964+0000 7f8723d84780 1 < suggested remove operation key=AB0SN0E49Z5F tag=7MM8O20YSYED type=del 2023-12-03T11:42:05.966 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.965+0000 7f8723d84780 1 > prepared operation key=D3JEVEY0E29E tag=PC2XZ9838W1I type=del size=2247864 2023-12-03T11:42:05.967 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.966+0000 7f8723d84780 1 < completed write operation key=M4VKPN6INFNZ tag=XI95PJ2ZDO5P type=write size=915498 2023-12-03T11:42:05.968 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.967+0000 7f8723d84780 1 > prepared operation key=EITMJKL0LCYC tag=V5RJUIJCJ75C type=del size=2415311 2023-12-03T11:42:05.969 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.968+0000 7f8723d84780 -1 < failed to complete operation key=AB0SN0E49Z5F tag=7XEH4MIVKDV5 type=del size=3726054: (22) Invalid argument 2023-12-03T11:42:05.971 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.970+0000 7f8723d84780 1 > prepared part key=_multipart_FCA2R3HR61S2.2~BQA2I0NJAUC7.0 size=1048576 2023-12-03T11:42:05.973 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.972+0000 7f8723d84780 1 > prepared part key=_multipart_FCA2R3HR61S2.2~BQA2I0NJAUC7.1 size=749576 2023-12-03T11:42:05.973 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.972+0000 7f8723d84780 1 > prepared multipart upload key=FCA2R3HR61S2 upload=BQA2I0NJAUC7 tag=3LFQVTQUGDX7 type=write size=2846728 2023-12-03T11:42:05.974 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.973+0000 7f8723d84780 1 < completed delete operation key=CKABTI1EOAWB tag=C4TH753XSDSJ type=del 2023-12-03T11:42:05.976 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.975+0000 7f8723d84780 1 > prepared part key=_multipart_O7VVHXLDSY57.2~U80HSQ6UAZEU.0 size=1048576 2023-12-03T11:42:05.977 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.976+0000 7f8723d84780 1 > prepared part key=_multipart_O7VVHXLDSY57.2~U80HSQ6UAZEU.1 size=695951 2023-12-03T11:42:05.977 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.976+0000 7f8723d84780 1 > prepared multipart upload key=O7VVHXLDSY57 upload=U80HSQ6UAZEU tag=L0LG9NUMBKWQ type=write size=2793103 2023-12-03T11:42:05.978 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.977+0000 7f8723d84780 -1 < failed to complete operation key=VENJI0KD1XDW tag=6Y1LO1NFDN74 type=del size=2157477: (22) Invalid argument 2023-12-03T11:42:05.980 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.979+0000 7f8723d84780 1 > prepared operation key=7THZZ1J5LOZK tag=K5NSKOOHPBP9 type=del size=2107818 2023-12-03T11:42:05.982 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.981+0000 7f8723d84780 1 < completed part key=_multipart_AB0SN0E49Z5F.2~ESBZFDLFXSD2.0 size=795397 2023-12-03T11:42:05.985 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.983+0000 7f8723d84780 1 < completed multipart upload key=AB0SN0E49Z5F upload=ESBZFDLFXSD2 tag=CMR2V31R6QPH type=write size=1843973 2023-12-03T11:42:05.985 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.984+0000 7f8723d84780 1 > prepared operation key=O7VVHXLDSY57 tag=4Y53JD9EWTRY type=del size=2534636 2023-12-03T11:42:05.987 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.986+0000 7f8723d84780 1 < completed part key=_multipart_Y6S7QI60GCLE.2~NFF7LEZF9IZL.0 size=631924 2023-12-03T11:42:05.989 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.988+0000 7f8723d84780 1 < completed multipart upload key=Y6S7QI60GCLE upload=NFF7LEZF9IZL tag=TDIBYIFWCQOI type=write size=1680500 2023-12-03T11:42:05.992 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.991+0000 7f8723d84780 1 > prepared part key=_multipart_EITMJKL0LCYC.2~6UH5RQ0OPVS3.0 size=179466 2023-12-03T11:42:05.992 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.991+0000 7f8723d84780 1 > prepared multipart upload key=EITMJKL0LCYC upload=6UH5RQ0OPVS3 tag=PF6370PZQ39L type=write size=1228042 2023-12-03T11:42:05.993 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.992+0000 7f8723d84780 1 < completed part key=_multipart_5UYL15O31IHM.2~8KYMH8NTAL7X.0 size=1048576 2023-12-03T11:42:05.994 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.993+0000 7f8723d84780 1 < completed part key=_multipart_5UYL15O31IHM.2~8KYMH8NTAL7X.1 size=802858 2023-12-03T11:42:05.997 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.996+0000 7f8723d84780 1 < completed multipart upload key=5UYL15O31IHM upload=8KYMH8NTAL7X tag=26LZCKA3U5X3 type=write size=2900010 2023-12-03T11:42:05.998 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.997+0000 7f8723d84780 1 > prepared operation key=12XG7YPYTN4U tag=M3EWLL84CM0X type=del size=3704379 2023-12-03T11:42:05.999 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:05.998+0000 7f8723d84780 1 < completed delete operation key=J33T5S893LMV tag=VU7754PSS123 type=del 2023-12-03T11:42:06.002 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.001+0000 7f8723d84780 1 > prepared part key=_multipart_4I8PWBZOLDUG.2~LV38ZZF2Z9C2.0 size=1048576 2023-12-03T11:42:06.002 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.001+0000 7f8723d84780 1 > prepared part key=_multipart_4I8PWBZOLDUG.2~LV38ZZF2Z9C2.1 size=904664 2023-12-03T11:42:06.003 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.001+0000 7f8723d84780 1 > prepared multipart upload key=4I8PWBZOLDUG upload=LV38ZZF2Z9C2 tag=0MIZRP34N5FE type=write size=3001816 2023-12-03T11:42:06.004 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.003+0000 7f8723d84780 -1 < failed to complete operation key=D3JEVEY0E29E tag=4FO2KD0VTQ9N type=del size=2964354: (22) Invalid argument 2023-12-03T11:42:06.005 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.004+0000 7f8723d84780 1 > prepared operation key=HIU6L0NQ8Q95 tag=9V9FT2CXSB3R type=del size=2763472 2023-12-03T11:42:06.006 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.005+0000 7f8723d84780 1 < completed delete operation key=DMQX2DGDLU7D tag=OCN0WOLNVAGF type=del 2023-12-03T11:42:06.008 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.007+0000 7f8723d84780 1 > prepared part key=_multipart_5UYL15O31IHM.2~LU6YPYJVBFI9.0 size=1048576 2023-12-03T11:42:06.009 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.008+0000 7f8723d84780 1 > prepared part key=_multipart_5UYL15O31IHM.2~LU6YPYJVBFI9.1 size=1048576 2023-12-03T11:42:06.011 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.010+0000 7f8723d84780 1 > prepared part key=_multipart_5UYL15O31IHM.2~LU6YPYJVBFI9.2 size=120220 2023-12-03T11:42:06.012 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.010+0000 7f8723d84780 1 > prepared multipart upload key=5UYL15O31IHM upload=LU6YPYJVBFI9 tag=6SQ1B2O4ADWP type=write size=3265948 2023-12-03T11:42:06.013 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.012+0000 7f8723d84780 1 < completed delete operation key=EY9ZG5KOTBWM tag=LUWXEPFL2S65 type=del 2023-12-03T11:42:06.016 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.015+0000 7f8723d84780 1 > prepared part key=_multipart_UWS266H06VDK.2~OBJXFUGT9WGB.0 size=714269 2023-12-03T11:42:06.017 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.015+0000 7f8723d84780 1 > prepared multipart upload key=UWS266H06VDK upload=OBJXFUGT9WGB tag=0RK35SO3PTS9 type=write size=1762845 2023-12-03T11:42:06.019 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.018+0000 7f8723d84780 1 < suggested update operation key=12XG7YPYTN4U tag=GL3Y4N7Q5QTO type=del size=2416977 2023-12-03T11:42:06.020 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.019+0000 7f8723d84780 1 > prepared operation key=931GNEXBHH35 tag=OEZW9485CFMJ type=write size=748262 2023-12-03T11:42:06.022 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.021+0000 7f8723d84780 1 < completed delete operation key=G36T76K8O7A1 tag=N2HAU5INPJCM type=del 2023-12-03T11:42:06.023 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.022+0000 7f8723d84780 1 > prepared operation key=7THZZ1J5LOZK tag=EBNDAPQBI3R9 type=del size=491954 2023-12-03T11:42:06.025 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.023+0000 7f8723d84780 1 < completed part key=_multipart_Y6S7QI60GCLE.2~ZY2UD0JO0CGJ.0 size=1048576 2023-12-03T11:42:06.025 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.024+0000 7f8723d84780 1 < completed part key=_multipart_Y6S7QI60GCLE.2~ZY2UD0JO0CGJ.1 size=1048576 2023-12-03T11:42:06.026 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.025+0000 7f8723d84780 1 < completed part key=_multipart_Y6S7QI60GCLE.2~ZY2UD0JO0CGJ.2 size=31930 2023-12-03T11:42:06.028 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.027+0000 7f8723d84780 1 < completed multipart upload key=Y6S7QI60GCLE upload=ZY2UD0JO0CGJ tag=4TO21RAFL3XR type=write size=3177658 2023-12-03T11:42:06.030 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.029+0000 7f8723d84780 1 > prepared part key=_multipart_D3JEVEY0E29E.2~JJ4QYX8SQ0SV.0 size=1048576 2023-12-03T11:42:06.031 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.030+0000 7f8723d84780 1 > prepared part key=_multipart_D3JEVEY0E29E.2~JJ4QYX8SQ0SV.1 size=1048576 2023-12-03T11:42:06.032 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.031+0000 7f8723d84780 1 > prepared part key=_multipart_D3JEVEY0E29E.2~JJ4QYX8SQ0SV.2 size=801860 2023-12-03T11:42:06.032 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.031+0000 7f8723d84780 1 > prepared multipart upload key=D3JEVEY0E29E upload=JJ4QYX8SQ0SV tag=UPBESWBGM7Y9 type=write size=3947588 2023-12-03T11:42:06.033 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.032+0000 7f8723d84780 1 < completed part key=_multipart_EITMJKL0LCYC.2~SOUT7CUANSME.0 size=248233 2023-12-03T11:42:06.035 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.034+0000 7f8723d84780 1 < completed multipart upload key=EITMJKL0LCYC upload=SOUT7CUANSME tag=C4RL3ZSBR541 type=write size=1296809 2023-12-03T11:42:06.037 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.036+0000 7f8723d84780 1 > prepared operation key=KS5J7E7KE2IJ tag=Y6GA1YFZ2X98 type=del size=2668366 2023-12-03T11:42:06.038 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.037+0000 7f8723d84780 1 < completed delete operation key=D3JEVEY0E29E tag=PC2XZ9838W1I type=del 2023-12-03T11:42:06.040 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.039+0000 7f8723d84780 1 > prepared part key=_multipart_W2704YS8KYQB.2~SC96DOQ1FNTF.0 size=1048576 2023-12-03T11:42:06.041 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.040+0000 7f8723d84780 1 > prepared part key=_multipart_W2704YS8KYQB.2~SC96DOQ1FNTF.1 size=1048576 2023-12-03T11:42:06.042 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.041+0000 7f8723d84780 1 > prepared part key=_multipart_W2704YS8KYQB.2~SC96DOQ1FNTF.2 size=332208 2023-12-03T11:42:06.042 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.041+0000 7f8723d84780 1 > prepared multipart upload key=W2704YS8KYQB upload=SC96DOQ1FNTF tag=50OOFEW5J7KS type=write size=3477936 2023-12-03T11:42:06.044 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.043+0000 7f8723d84780 1 < suggested remove operation key=EITMJKL0LCYC tag=V5RJUIJCJ75C type=del 2023-12-03T11:42:06.045 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.044+0000 7f8723d84780 1 > prepared operation key=931GNEXBHH35 tag=E25UHQA3PBXH type=del size=3704893 2023-12-03T11:42:06.046 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.045+0000 7f8723d84780 1 < completed part key=_multipart_FCA2R3HR61S2.2~BQA2I0NJAUC7.0 size=1048576 2023-12-03T11:42:06.047 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.046+0000 7f8723d84780 1 < completed part key=_multipart_FCA2R3HR61S2.2~BQA2I0NJAUC7.1 size=749576 2023-12-03T11:42:06.049 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.048+0000 7f8723d84780 1 < completed multipart upload key=FCA2R3HR61S2 upload=BQA2I0NJAUC7 tag=3LFQVTQUGDX7 type=write size=2846728 2023-12-03T11:42:06.050 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.049+0000 7f8723d84780 1 > prepared operation key=10JRIKOZ16FY tag=GLMUPT2SI9D6 type=del size=595686 2023-12-03T11:42:06.051 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.050+0000 7f8723d84780 1 < completed part key=_multipart_O7VVHXLDSY57.2~U80HSQ6UAZEU.0 size=1048576 2023-12-03T11:42:06.052 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.051+0000 7f8723d84780 1 < completed part key=_multipart_O7VVHXLDSY57.2~U80HSQ6UAZEU.1 size=695951 2023-12-03T11:42:06.055 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.054+0000 7f8723d84780 1 < completed multipart upload key=O7VVHXLDSY57 upload=U80HSQ6UAZEU tag=L0LG9NUMBKWQ type=write size=2793103 2023-12-03T11:42:06.056 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.055+0000 7f8723d84780 1 > prepared operation key=M4VKPN6INFNZ tag=EYO9LW8865JU type=del size=83174 2023-12-03T11:42:06.057 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.056+0000 7f8723d84780 1 < completed delete operation key=7THZZ1J5LOZK tag=K5NSKOOHPBP9 type=del 2023-12-03T11:42:06.058 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.057+0000 7f8723d84780 1 > prepared operation key=G36T76K8O7A1 tag=CBU3TFIJSNJ4 type=write size=801788 2023-12-03T11:42:06.059 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.059+0000 7f8723d84780 1 < completed delete operation key=O7VVHXLDSY57 tag=4Y53JD9EWTRY type=del 2023-12-03T11:42:06.061 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.060+0000 7f8723d84780 1 > prepared operation key=AB0SN0E49Z5F tag=QZWJ3BUFHV0J type=write size=596246 2023-12-03T11:42:06.062 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.061+0000 7f8723d84780 1 < completed part key=_multipart_EITMJKL0LCYC.2~6UH5RQ0OPVS3.0 size=179466 2023-12-03T11:42:06.064 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.063+0000 7f8723d84780 1 < completed multipart upload key=EITMJKL0LCYC upload=6UH5RQ0OPVS3 tag=PF6370PZQ39L type=write size=1228042 2023-12-03T11:42:06.066 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.064+0000 7f8723d84780 1 > prepared operation key=DMQX2DGDLU7D tag=HIG796K9P9CD type=del size=1879411 2023-12-03T11:42:06.068 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.067+0000 7f8723d84780 1 < suggested remove operation key=12XG7YPYTN4U tag=M3EWLL84CM0X type=del 2023-12-03T11:42:06.069 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.068+0000 7f8723d84780 1 > prepared operation key=96RAVVSUKH0Y tag=XPIC1R986L9Q type=del size=3161653 2023-12-03T11:42:06.070 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.069+0000 7f8723d84780 1 < completed part key=_multipart_4I8PWBZOLDUG.2~LV38ZZF2Z9C2.0 size=1048576 2023-12-03T11:42:06.070 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.069+0000 7f8723d84780 1 < canceled part key=_multipart_4I8PWBZOLDUG.2~LV38ZZF2Z9C2.1 size=904664 2023-12-03T11:42:06.072 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.071+0000 7f8723d84780 1 < canceled multipart upload key=4I8PWBZOLDUG upload=LV38ZZF2Z9C2 tag=0MIZRP34N5FE type=write size=3001816 2023-12-03T11:42:06.073 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.072+0000 7f8723d84780 1 > prepared operation key=VENJI0KD1XDW tag=33P8T75CG4C3 type=del size=3579002 2023-12-03T11:42:06.075 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.074+0000 7f8723d84780 1 < completed delete operation key=HIU6L0NQ8Q95 tag=9V9FT2CXSB3R type=del 2023-12-03T11:42:06.077 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.076+0000 7f8723d84780 1 > prepared part key=_multipart_VENJI0KD1XDW.2~J3G1TKE1UNNL.0 size=1048576 2023-12-03T11:42:06.078 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.077+0000 7f8723d84780 1 > prepared part key=_multipart_VENJI0KD1XDW.2~J3G1TKE1UNNL.1 size=1048576 2023-12-03T11:42:06.079 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.078+0000 7f8723d84780 1 > prepared part key=_multipart_VENJI0KD1XDW.2~J3G1TKE1UNNL.2 size=814882 2023-12-03T11:42:06.079 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.078+0000 7f8723d84780 1 > prepared multipart upload key=VENJI0KD1XDW upload=J3G1TKE1UNNL tag=KYNTXWZ00W09 type=write size=3960610 2023-12-03T11:42:06.080 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.079+0000 7f8723d84780 1 < completed part key=_multipart_5UYL15O31IHM.2~LU6YPYJVBFI9.0 size=1048576 2023-12-03T11:42:06.081 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.080+0000 7f8723d84780 1 < completed part key=_multipart_5UYL15O31IHM.2~LU6YPYJVBFI9.1 size=1048576 2023-12-03T11:42:06.082 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.081+0000 7f8723d84780 1 < completed part key=_multipart_5UYL15O31IHM.2~LU6YPYJVBFI9.2 size=120220 2023-12-03T11:42:06.084 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.083+0000 7f8723d84780 1 < completed multipart upload key=5UYL15O31IHM upload=LU6YPYJVBFI9 tag=6SQ1B2O4ADWP type=write size=3265948 2023-12-03T11:42:06.086 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.085+0000 7f8723d84780 1 > prepared part key=_multipart_DMQX2DGDLU7D.2~YJ0B8EMPMMO5.0 size=425220 2023-12-03T11:42:06.086 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.085+0000 7f8723d84780 1 > prepared multipart upload key=DMQX2DGDLU7D upload=YJ0B8EMPMMO5 tag=XXPQ5IG5ZWSZ type=write size=1473796 2023-12-03T11:42:06.088 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.087+0000 7f8723d84780 1 < completed part key=_multipart_UWS266H06VDK.2~OBJXFUGT9WGB.0 size=714269 2023-12-03T11:42:06.090 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.089+0000 7f8723d84780 1 < completed multipart upload key=UWS266H06VDK upload=OBJXFUGT9WGB tag=0RK35SO3PTS9 type=write size=1762845 2023-12-03T11:42:06.091 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.090+0000 7f8723d84780 1 > prepared operation key=10JRIKOZ16FY tag=OY2CO0280JLL type=del size=2847322 2023-12-03T11:42:06.093 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.092+0000 7f8723d84780 1 < suggested remove operation key=931GNEXBHH35 tag=OEZW9485CFMJ type=write 2023-12-03T11:42:06.095 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.094+0000 7f8723d84780 1 > prepared operation key=Y6S7QI60GCLE tag=TZPTKUL8BA9A type=del size=3775405 2023-12-03T11:42:06.096 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.095+0000 7f8723d84780 1 < completed delete operation key=7THZZ1J5LOZK tag=EBNDAPQBI3R9 type=del 2023-12-03T11:42:06.097 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.096+0000 7f8723d84780 1 > prepared operation key=G36T76K8O7A1 tag=4ZIIZZHHUYBL type=del size=705528 2023-12-03T11:42:06.098 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.097+0000 7f8723d84780 1 < completed part key=_multipart_D3JEVEY0E29E.2~JJ4QYX8SQ0SV.0 size=1048576 2023-12-03T11:42:06.099 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.098+0000 7f8723d84780 1 < completed part key=_multipart_D3JEVEY0E29E.2~JJ4QYX8SQ0SV.1 size=1048576 2023-12-03T11:42:06.100 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.099+0000 7f8723d84780 1 < completed part key=_multipart_D3JEVEY0E29E.2~JJ4QYX8SQ0SV.2 size=801860 2023-12-03T11:42:06.102 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.101+0000 7f8723d84780 1 < completed multipart upload key=D3JEVEY0E29E upload=JJ4QYX8SQ0SV tag=UPBESWBGM7Y9 type=write size=3947588 2023-12-03T11:42:06.103 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.102+0000 7f8723d84780 1 > prepared operation key=CKABTI1EOAWB tag=IL73HIIU2IDN type=del size=3127593 2023-12-03T11:42:06.106 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.105+0000 7f8723d84780 1 < suggested update operation key=KS5J7E7KE2IJ tag=Y6GA1YFZ2X98 type=del size=2668366 2023-12-03T11:42:06.108 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.107+0000 7f8723d84780 1 > prepared part key=_multipart_AB0SN0E49Z5F.2~AHLL9S94ZFWO.0 size=1048576 2023-12-03T11:42:06.109 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.108+0000 7f8723d84780 1 > prepared part key=_multipart_AB0SN0E49Z5F.2~AHLL9S94ZFWO.1 size=1048576 2023-12-03T11:42:06.110 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.109+0000 7f8723d84780 1 > prepared part key=_multipart_AB0SN0E49Z5F.2~AHLL9S94ZFWO.2 size=916022 2023-12-03T11:42:06.110 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.109+0000 7f8723d84780 1 > prepared multipart upload key=AB0SN0E49Z5F upload=AHLL9S94ZFWO tag=B7DLQ4QVKYF3 type=write size=4061750 2023-12-03T11:42:06.110 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.109+0000 7f8723d84780 1 < canceled part key=_multipart_W2704YS8KYQB.2~SC96DOQ1FNTF.0 size=1048576 2023-12-03T11:42:06.111 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.110+0000 7f8723d84780 1 < completed part key=_multipart_W2704YS8KYQB.2~SC96DOQ1FNTF.1 size=1048576 2023-12-03T11:42:06.112 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.111+0000 7f8723d84780 1 < completed part key=_multipart_W2704YS8KYQB.2~SC96DOQ1FNTF.2 size=332208 2023-12-03T11:42:06.114 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.113+0000 7f8723d84780 1 < canceled multipart upload key=W2704YS8KYQB upload=SC96DOQ1FNTF tag=50OOFEW5J7KS type=write size=3477936 2023-12-03T11:42:06.115 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.114+0000 7f8723d84780 1 > prepared operation key=VENJI0KD1XDW tag=4CRMSPI3ZWUG type=del size=3204001 2023-12-03T11:42:06.116 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.115+0000 7f8723d84780 -1 < failed to complete operation key=931GNEXBHH35 tag=E25UHQA3PBXH type=del size=3704893: (22) Invalid argument 2023-12-03T11:42:06.119 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.118+0000 7f8723d84780 1 > prepared part key=_multipart_7VMTBKUWU59F.2~CBBWASPQT1RK.0 size=1048576 2023-12-03T11:42:06.120 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.119+0000 7f8723d84780 1 > prepared part key=_multipart_7VMTBKUWU59F.2~CBBWASPQT1RK.1 size=264096 2023-12-03T11:42:06.120 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.119+0000 7f8723d84780 1 > prepared multipart upload key=7VMTBKUWU59F upload=CBBWASPQT1RK tag=5VZCRJCLYWYM type=write size=2361248 2023-12-03T11:42:06.122 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.121+0000 7f8723d84780 1 < suggested remove operation key=10JRIKOZ16FY tag=GLMUPT2SI9D6 type=del 2023-12-03T11:42:06.123 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.122+0000 7f8723d84780 1 > prepared operation key=M4VKPN6INFNZ tag=R5NA57F6OHXT type=del size=842029 2023-12-03T11:42:06.126 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.124+0000 7f8723d84780 1 < completed delete operation key=M4VKPN6INFNZ tag=EYO9LW8865JU type=del 2023-12-03T11:42:06.127 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.126+0000 7f8723d84780 1 > prepared operation key=FCA2R3HR61S2 tag=O4TJ5KWYFP73 type=del size=223519 2023-12-03T11:42:06.128 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.127+0000 7f8723d84780 1 < completed write operation key=G36T76K8O7A1 tag=CBU3TFIJSNJ4 type=write size=801788 2023-12-03T11:42:06.130 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.129+0000 7f8723d84780 1 > prepared part key=_multipart_OGACI7CRPMT7.2~31BTU3AULIJJ.0 size=1048576 2023-12-03T11:42:06.131 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.130+0000 7f8723d84780 1 > prepared part key=_multipart_OGACI7CRPMT7.2~31BTU3AULIJJ.1 size=1048576 2023-12-03T11:42:06.132 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.131+0000 7f8723d84780 1 > prepared part key=_multipart_OGACI7CRPMT7.2~31BTU3AULIJJ.2 size=367545 2023-12-03T11:42:06.132 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.131+0000 7f8723d84780 1 > prepared multipart upload key=OGACI7CRPMT7 upload=31BTU3AULIJJ tag=G63L63HXDEJ0 type=write size=3513273 2023-12-03T11:42:06.134 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.132+0000 7f8723d84780 1 < completed write operation key=AB0SN0E49Z5F tag=QZWJ3BUFHV0J type=write size=596246 2023-12-03T11:42:06.135 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.134+0000 7f8723d84780 1 > prepared operation key=10JRIKOZ16FY tag=YBALO2Z1PRXN type=del size=2425006 2023-12-03T11:42:06.137 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.136+0000 7f8723d84780 1 < suggested remove operation key=DMQX2DGDLU7D tag=HIG796K9P9CD type=del 2023-12-03T11:42:06.139 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.138+0000 7f8723d84780 1 > prepared part key=_multipart_CKABTI1EOAWB.2~6RKL5J4BM1Z8.0 size=197118 2023-12-03T11:42:06.140 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.138+0000 7f8723d84780 1 > prepared multipart upload key=CKABTI1EOAWB upload=6RKL5J4BM1Z8 tag=OZGI1A0PG5AS type=write size=1245694 2023-12-03T11:42:06.141 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.140+0000 7f8723d84780 1 < completed delete operation key=96RAVVSUKH0Y tag=XPIC1R986L9Q type=del 2023-12-03T11:42:06.143 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.142+0000 7f8723d84780 1 > prepared part key=_multipart_OPQPIDJ2PBVU.2~004F6Q6DAHTQ.0 size=1048576 2023-12-03T11:42:06.144 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.143+0000 7f8723d84780 1 > prepared part key=_multipart_OPQPIDJ2PBVU.2~004F6Q6DAHTQ.1 size=623856 2023-12-03T11:42:06.144 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.143+0000 7f8723d84780 1 > prepared multipart upload key=OPQPIDJ2PBVU upload=004F6Q6DAHTQ tag=P4LON2B73K0U type=write size=2721008 2023-12-03T11:42:06.145 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.144+0000 7f8723d84780 1 < canceled operation key=VENJI0KD1XDW tag=33P8T75CG4C3 type=del size=3579002 2023-12-03T11:42:06.146 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.145+0000 7f8723d84780 1 > prepared operation key=TSTIBGVYUZZZ tag=GX5VXPXGD4UV type=del size=978348 2023-12-03T11:42:06.148 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.146+0000 7f8723d84780 1 < completed part key=_multipart_VENJI0KD1XDW.2~J3G1TKE1UNNL.0 size=1048576 2023-12-03T11:42:06.148 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.147+0000 7f8723d84780 1 < completed part key=_multipart_VENJI0KD1XDW.2~J3G1TKE1UNNL.1 size=1048576 2023-12-03T11:42:06.149 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.147+0000 7f8723d84780 1 < canceled part key=_multipart_VENJI0KD1XDW.2~J3G1TKE1UNNL.2 size=814882 2023-12-03T11:42:06.150 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.149+0000 7f8723d84780 1 < canceled multipart upload key=VENJI0KD1XDW upload=J3G1TKE1UNNL tag=KYNTXWZ00W09 type=write size=3960610 2023-12-03T11:42:06.153 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.151+0000 7f8723d84780 1 > prepared part key=_multipart_CKABTI1EOAWB.2~G3NMW0HT0I4N.0 size=1048576 2023-12-03T11:42:06.154 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.152+0000 7f8723d84780 1 > prepared part key=_multipart_CKABTI1EOAWB.2~G3NMW0HT0I4N.1 size=1048576 2023-12-03T11:42:06.154 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.153+0000 7f8723d84780 1 > prepared part key=_multipart_CKABTI1EOAWB.2~G3NMW0HT0I4N.2 size=440804 2023-12-03T11:42:06.155 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.153+0000 7f8723d84780 1 > prepared multipart upload key=CKABTI1EOAWB upload=G3NMW0HT0I4N tag=3DOPDIUDSMCS type=write size=3586532 2023-12-03T11:42:06.156 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.155+0000 7f8723d84780 1 < completed part key=_multipart_DMQX2DGDLU7D.2~YJ0B8EMPMMO5.0 size=425220 2023-12-03T11:42:06.158 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.157+0000 7f8723d84780 1 < completed multipart upload key=DMQX2DGDLU7D upload=YJ0B8EMPMMO5 tag=XXPQ5IG5ZWSZ type=write size=1473796 2023-12-03T11:42:06.160 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.159+0000 7f8723d84780 1 > prepared part key=_multipart_4I8PWBZOLDUG.2~XF9XZA9JJTOB.0 size=1048576 2023-12-03T11:42:06.161 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.160+0000 7f8723d84780 1 > prepared part key=_multipart_4I8PWBZOLDUG.2~XF9XZA9JJTOB.1 size=67534 2023-12-03T11:42:06.161 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.160+0000 7f8723d84780 1 > prepared multipart upload key=4I8PWBZOLDUG upload=XF9XZA9JJTOB tag=WZDCV4AEJP3L type=write size=2164686 2023-12-03T11:42:06.164 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.163+0000 7f8723d84780 1 < suggested update operation key=10JRIKOZ16FY tag=OY2CO0280JLL type=del size=2847322 2023-12-03T11:42:06.165 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.164+0000 7f8723d84780 1 > prepared operation key=8NONX2I08YMJ tag=122FIJ2FARJ9 type=del size=3220031 2023-12-03T11:42:06.166 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.165+0000 7f8723d84780 1 < completed delete operation key=Y6S7QI60GCLE tag=TZPTKUL8BA9A type=del 2023-12-03T11:42:06.169 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.168+0000 7f8723d84780 1 > prepared part key=_multipart_TSTIBGVYUZZZ.2~O0QYJJL103EM.0 size=1048576 2023-12-03T11:42:06.170 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.169+0000 7f8723d84780 1 > prepared part key=_multipart_TSTIBGVYUZZZ.2~O0QYJJL103EM.1 size=703696 2023-12-03T11:42:06.170 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.169+0000 7f8723d84780 1 > prepared multipart upload key=TSTIBGVYUZZZ upload=O0QYJJL103EM tag=LDKOY0UCJDAE type=write size=2800848 2023-12-03T11:42:06.171 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.170+0000 7f8723d84780 1 < completed delete operation key=G36T76K8O7A1 tag=4ZIIZZHHUYBL type=del 2023-12-03T11:42:06.173 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.172+0000 7f8723d84780 1 > prepared operation key=G36T76K8O7A1 tag=BFMS4NYJ1CK4 type=del size=598768 2023-12-03T11:42:06.174 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.173+0000 7f8723d84780 1 < completed delete operation key=CKABTI1EOAWB tag=IL73HIIU2IDN type=del 2023-12-03T11:42:06.175 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.174+0000 7f8723d84780 1 > prepared operation key=4I8PWBZOLDUG tag=U4M8KOGJFSSP type=del size=889076 2023-12-03T11:42:06.177 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.176+0000 7f8723d84780 1 < completed part key=_multipart_AB0SN0E49Z5F.2~AHLL9S94ZFWO.0 size=1048576 2023-12-03T11:42:06.178 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.177+0000 7f8723d84780 1 < completed part key=_multipart_AB0SN0E49Z5F.2~AHLL9S94ZFWO.1 size=1048576 2023-12-03T11:42:06.179 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.178+0000 7f8723d84780 1 < completed part key=_multipart_AB0SN0E49Z5F.2~AHLL9S94ZFWO.2 size=916022 2023-12-03T11:42:06.181 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.180+0000 7f8723d84780 1 < completed multipart upload key=AB0SN0E49Z5F upload=AHLL9S94ZFWO tag=B7DLQ4QVKYF3 type=write size=4061750 2023-12-03T11:42:06.183 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.182+0000 7f8723d84780 1 > prepared part key=_multipart_931GNEXBHH35.2~MTCRG7XM2ENO.0 size=577970 2023-12-03T11:42:06.183 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.182+0000 7f8723d84780 1 > prepared multipart upload key=931GNEXBHH35 upload=MTCRG7XM2ENO tag=5J2AMSIHAPYC type=write size=1626546 2023-12-03T11:42:06.184 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.183+0000 7f8723d84780 1 < canceled operation key=VENJI0KD1XDW tag=4CRMSPI3ZWUG type=del size=3204001 2023-12-03T11:42:06.186 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.185+0000 7f8723d84780 1 > prepared operation key=4I8PWBZOLDUG tag=E2BFOUM4DQ5C type=write size=996640 2023-12-03T11:42:06.189 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.186+0000 7f8723d84780 1 < completed part key=_multipart_7VMTBKUWU59F.2~CBBWASPQT1RK.0 size=1048576 2023-12-03T11:42:06.190 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.187+0000 7f8723d84780 1 < completed part key=_multipart_7VMTBKUWU59F.2~CBBWASPQT1RK.1 size=264096 2023-12-03T11:42:06.190 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.189+0000 7f8723d84780 1 < completed multipart upload key=7VMTBKUWU59F upload=CBBWASPQT1RK tag=5VZCRJCLYWYM type=write size=2361248 2023-12-03T11:42:06.192 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.191+0000 7f8723d84780 1 > prepared part key=_multipart_EY9ZG5KOTBWM.2~0HHLFTNYTY0H.0 size=1048576 2023-12-03T11:42:06.193 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.192+0000 7f8723d84780 1 > prepared part key=_multipart_EY9ZG5KOTBWM.2~0HHLFTNYTY0H.1 size=1048576 2023-12-03T11:42:06.194 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.193+0000 7f8723d84780 1 > prepared part key=_multipart_EY9ZG5KOTBWM.2~0HHLFTNYTY0H.2 size=1000741 2023-12-03T11:42:06.194 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.193+0000 7f8723d84780 1 > prepared multipart upload key=EY9ZG5KOTBWM upload=0HHLFTNYTY0H tag=OMNSKEG7Q2T3 type=write size=4146469 2023-12-03T11:42:06.195 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.194+0000 7f8723d84780 1 < completed delete operation key=M4VKPN6INFNZ tag=R5NA57F6OHXT type=del 2023-12-03T11:42:06.197 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.195+0000 7f8723d84780 1 > prepared operation key=O7VVHXLDSY57 tag=FZJWVTJ7B41U type=del size=2696991 2023-12-03T11:42:06.197 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.196+0000 7f8723d84780 1 < canceled operation key=FCA2R3HR61S2 tag=O4TJ5KWYFP73 type=del size=223519 2023-12-03T11:42:06.199 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.198+0000 7f8723d84780 1 > prepared part key=_multipart_EY9ZG5KOTBWM.2~0ZIWQSRFH82V.0 size=1048576 2023-12-03T11:42:06.200 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.199+0000 7f8723d84780 1 > prepared part key=_multipart_EY9ZG5KOTBWM.2~0ZIWQSRFH82V.1 size=1048576 2023-12-03T11:42:06.201 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.200+0000 7f8723d84780 1 > prepared part key=_multipart_EY9ZG5KOTBWM.2~0ZIWQSRFH82V.2 size=74855 2023-12-03T11:42:06.201 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.200+0000 7f8723d84780 1 > prepared multipart upload key=EY9ZG5KOTBWM upload=0ZIWQSRFH82V tag=SW6RNNA1DCG2 type=write size=3220583 2023-12-03T11:42:06.202 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.201+0000 7f8723d84780 1 < completed part key=_multipart_OGACI7CRPMT7.2~31BTU3AULIJJ.0 size=1048576 2023-12-03T11:42:06.203 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.202+0000 7f8723d84780 1 < completed part key=_multipart_OGACI7CRPMT7.2~31BTU3AULIJJ.1 size=1048576 2023-12-03T11:42:06.204 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.203+0000 7f8723d84780 1 < completed part key=_multipart_OGACI7CRPMT7.2~31BTU3AULIJJ.2 size=367545 2023-12-03T11:42:06.206 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.205+0000 7f8723d84780 1 < completed multipart upload key=OGACI7CRPMT7 upload=31BTU3AULIJJ tag=G63L63HXDEJ0 type=write size=3513273 2023-12-03T11:42:06.208 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.207+0000 7f8723d84780 1 > prepared part key=_multipart_TSTIBGVYUZZZ.2~JV0YARILNWC3.0 size=1048576 2023-12-03T11:42:06.209 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.208+0000 7f8723d84780 1 > prepared part key=_multipart_TSTIBGVYUZZZ.2~JV0YARILNWC3.1 size=1048576 2023-12-03T11:42:06.210 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.209+0000 7f8723d84780 1 > prepared part key=_multipart_TSTIBGVYUZZZ.2~JV0YARILNWC3.2 size=140814 2023-12-03T11:42:06.210 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.209+0000 7f8723d84780 1 > prepared multipart upload key=TSTIBGVYUZZZ upload=JV0YARILNWC3 tag=WGUE2RWEU7Q4 type=write size=3286542 2023-12-03T11:42:06.212 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.211+0000 7f8723d84780 -1 < failed to complete operation key=10JRIKOZ16FY tag=YBALO2Z1PRXN type=del size=2425006: (22) Invalid argument 2023-12-03T11:42:06.213 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.212+0000 7f8723d84780 1 > prepared operation key=DMQX2DGDLU7D tag=SZRFSN3WXLWX type=del size=857118 2023-12-03T11:42:06.214 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.213+0000 7f8723d84780 1 < completed part key=_multipart_CKABTI1EOAWB.2~6RKL5J4BM1Z8.0 size=197118 2023-12-03T11:42:06.217 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.216+0000 7f8723d84780 1 < completed multipart upload key=CKABTI1EOAWB upload=6RKL5J4BM1Z8 tag=OZGI1A0PG5AS type=write size=1245694 2023-12-03T11:42:06.218 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.217+0000 7f8723d84780 1 > prepared operation key=K83BTR5BOLZE tag=YCCI7R612T3M type=del size=1769505 2023-12-03T11:42:06.219 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.218+0000 7f8723d84780 1 < completed part key=_multipart_OPQPIDJ2PBVU.2~004F6Q6DAHTQ.0 size=1048576 2023-12-03T11:42:06.220 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.219+0000 7f8723d84780 1 < completed part key=_multipart_OPQPIDJ2PBVU.2~004F6Q6DAHTQ.1 size=623856 2023-12-03T11:42:06.223 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.221+0000 7f8723d84780 1 < completed multipart upload key=OPQPIDJ2PBVU upload=004F6Q6DAHTQ tag=P4LON2B73K0U type=write size=2721008 2023-12-03T11:42:06.224 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.223+0000 7f8723d84780 1 > prepared operation key=O7VVHXLDSY57 tag=WMZEHQHN4EYZ type=del size=3562391 2023-12-03T11:42:06.225 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.224+0000 7f8723d84780 1 < completed delete operation key=TSTIBGVYUZZZ tag=GX5VXPXGD4UV type=del 2023-12-03T11:42:06.227 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.225+0000 7f8723d84780 1 > prepared operation key=HIU6L0NQ8Q95 tag=CF3WC34VKCQ5 type=del size=1382435 2023-12-03T11:42:06.228 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.227+0000 7f8723d84780 1 < completed part key=_multipart_CKABTI1EOAWB.2~G3NMW0HT0I4N.0 size=1048576 2023-12-03T11:42:06.229 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.228+0000 7f8723d84780 1 < completed part key=_multipart_CKABTI1EOAWB.2~G3NMW0HT0I4N.1 size=1048576 2023-12-03T11:42:06.230 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.229+0000 7f8723d84780 1 < completed part key=_multipart_CKABTI1EOAWB.2~G3NMW0HT0I4N.2 size=440804 2023-12-03T11:42:06.232 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.231+0000 7f8723d84780 1 < completed multipart upload key=CKABTI1EOAWB upload=G3NMW0HT0I4N tag=3DOPDIUDSMCS type=write size=3586532 2023-12-03T11:42:06.233 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.232+0000 7f8723d84780 1 > prepared operation key=D3JEVEY0E29E tag=ZP9LRZ20TUCV type=del size=261937 2023-12-03T11:42:06.234 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.233+0000 7f8723d84780 1 < completed part key=_multipart_4I8PWBZOLDUG.2~XF9XZA9JJTOB.0 size=1048576 2023-12-03T11:42:06.235 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.234+0000 7f8723d84780 1 < completed part key=_multipart_4I8PWBZOLDUG.2~XF9XZA9JJTOB.1 size=67534 2023-12-03T11:42:06.237 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.236+0000 7f8723d84780 1 < completed multipart upload key=4I8PWBZOLDUG upload=XF9XZA9JJTOB tag=WZDCV4AEJP3L type=write size=2164686 2023-12-03T11:42:06.239 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.238+0000 7f8723d84780 1 > prepared operation key=TSTIBGVYUZZZ tag=Y7YEK1XLCK77 type=del size=2042243 2023-12-03T11:42:06.240 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.239+0000 7f8723d84780 1 < completed delete operation key=8NONX2I08YMJ tag=122FIJ2FARJ9 type=del 2023-12-03T11:42:06.243 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.242+0000 7f8723d84780 1 > prepared operation key=K83BTR5BOLZE tag=TH4RL1KML7Y7 type=del size=3894072 2023-12-03T11:42:06.244 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.243+0000 7f8723d84780 1 < completed part key=_multipart_TSTIBGVYUZZZ.2~O0QYJJL103EM.0 size=1048576 2023-12-03T11:42:06.245 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.244+0000 7f8723d84780 1 < completed part key=_multipart_TSTIBGVYUZZZ.2~O0QYJJL103EM.1 size=703696 2023-12-03T11:42:06.247 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.246+0000 7f8723d84780 1 < completed multipart upload key=TSTIBGVYUZZZ upload=O0QYJJL103EM tag=LDKOY0UCJDAE type=write size=2800848 2023-12-03T11:42:06.248 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.247+0000 7f8723d84780 1 > prepared operation key=G36T76K8O7A1 tag=Y9I985KWE7A9 type=del size=462087 2023-12-03T11:42:06.250 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.249+0000 7f8723d84780 1 < canceled operation key=G36T76K8O7A1 tag=BFMS4NYJ1CK4 type=del size=598768 2023-12-03T11:42:06.252 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.251+0000 7f8723d84780 1 > prepared part key=_multipart_W2704YS8KYQB.2~72JMGHAGMLIS.0 size=428230 2023-12-03T11:42:06.252 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.251+0000 7f8723d84780 1 > prepared multipart upload key=W2704YS8KYQB upload=72JMGHAGMLIS tag=W7M7N9EXIS6M type=write size=1476806 2023-12-03T11:42:06.254 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.253+0000 7f8723d84780 1 < suggested update operation key=4I8PWBZOLDUG tag=U4M8KOGJFSSP type=del size=889076 2023-12-03T11:42:06.257 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.256+0000 7f8723d84780 1 > prepared part key=_multipart_KS5J7E7KE2IJ.2~GWNZ5VUKQBAE.0 size=1048576 2023-12-03T11:42:06.258 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.257+0000 7f8723d84780 1 > prepared part key=_multipart_KS5J7E7KE2IJ.2~GWNZ5VUKQBAE.1 size=1048576 2023-12-03T11:42:06.259 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.258+0000 7f8723d84780 1 > prepared part key=_multipart_KS5J7E7KE2IJ.2~GWNZ5VUKQBAE.2 size=310105 2023-12-03T11:42:06.259 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.258+0000 7f8723d84780 1 > prepared multipart upload key=KS5J7E7KE2IJ upload=GWNZ5VUKQBAE tag=0UIKOL82F0WZ type=write size=3455833 2023-12-03T11:42:06.260 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.259+0000 7f8723d84780 1 < completed part key=_multipart_931GNEXBHH35.2~MTCRG7XM2ENO.0 size=577970 2023-12-03T11:42:06.262 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.261+0000 7f8723d84780 1 < completed multipart upload key=931GNEXBHH35 upload=MTCRG7XM2ENO tag=5J2AMSIHAPYC type=write size=1626546 2023-12-03T11:42:06.264 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.263+0000 7f8723d84780 1 > prepared operation key=HIU6L0NQ8Q95 tag=2XLYL34Q0189 type=del size=1403609 2023-12-03T11:42:06.265 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.264+0000 7f8723d84780 -1 < failed to complete operation key=4I8PWBZOLDUG tag=E2BFOUM4DQ5C type=write size=996640: (22) Invalid argument 2023-12-03T11:42:06.266 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.265+0000 7f8723d84780 1 > prepared operation key=KS5J7E7KE2IJ tag=3MY6PP6CKXOQ type=del size=894145 2023-12-03T11:42:06.267 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.266+0000 7f8723d84780 1 < completed part key=_multipart_EY9ZG5KOTBWM.2~0HHLFTNYTY0H.0 size=1048576 2023-12-03T11:42:06.268 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.267+0000 7f8723d84780 1 < completed part key=_multipart_EY9ZG5KOTBWM.2~0HHLFTNYTY0H.1 size=1048576 2023-12-03T11:42:06.268 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.267+0000 7f8723d84780 1 < canceled part key=_multipart_EY9ZG5KOTBWM.2~0HHLFTNYTY0H.2 size=1000741 2023-12-03T11:42:06.270 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.269+0000 7f8723d84780 1 < canceled multipart upload key=EY9ZG5KOTBWM upload=0HHLFTNYTY0H tag=OMNSKEG7Q2T3 type=write size=4146469 2023-12-03T11:42:06.272 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.271+0000 7f8723d84780 1 > prepared part key=_multipart_K83BTR5BOLZE.2~B5VFFIU4KEQ2.0 size=612439 2023-12-03T11:42:06.273 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.271+0000 7f8723d84780 1 > prepared multipart upload key=K83BTR5BOLZE upload=B5VFFIU4KEQ2 tag=8UD49IHSIU50 type=write size=1661015 2023-12-03T11:42:06.274 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.273+0000 7f8723d84780 1 < completed delete operation key=O7VVHXLDSY57 tag=FZJWVTJ7B41U type=del 2023-12-03T11:42:06.275 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.274+0000 7f8723d84780 1 > prepared operation key=VENJI0KD1XDW tag=2MAU68K0Q84I type=del size=3434489 2023-12-03T11:42:06.276 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.275+0000 7f8723d84780 1 < completed part key=_multipart_EY9ZG5KOTBWM.2~0ZIWQSRFH82V.0 size=1048576 2023-12-03T11:42:06.277 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.276+0000 7f8723d84780 1 < completed part key=_multipart_EY9ZG5KOTBWM.2~0ZIWQSRFH82V.1 size=1048576 2023-12-03T11:42:06.278 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.277+0000 7f8723d84780 1 < completed part key=_multipart_EY9ZG5KOTBWM.2~0ZIWQSRFH82V.2 size=74855 2023-12-03T11:42:06.280 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.279+0000 7f8723d84780 1 < completed multipart upload key=EY9ZG5KOTBWM upload=0ZIWQSRFH82V tag=SW6RNNA1DCG2 type=write size=3220583 2023-12-03T11:42:06.281 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.280+0000 7f8723d84780 1 > prepared operation key=12XG7YPYTN4U tag=O9VSCLTPRF4E type=del size=1775621 2023-12-03T11:42:06.283 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.282+0000 7f8723d84780 1 < completed part key=_multipart_TSTIBGVYUZZZ.2~JV0YARILNWC3.0 size=1048576 2023-12-03T11:42:06.284 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.283+0000 7f8723d84780 1 < completed part key=_multipart_TSTIBGVYUZZZ.2~JV0YARILNWC3.1 size=1048576 2023-12-03T11:42:06.285 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.284+0000 7f8723d84780 1 < completed part key=_multipart_TSTIBGVYUZZZ.2~JV0YARILNWC3.2 size=140814 2023-12-03T11:42:06.287 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.286+0000 7f8723d84780 1 < completed multipart upload key=TSTIBGVYUZZZ upload=JV0YARILNWC3 tag=WGUE2RWEU7Q4 type=write size=3286542 2023-12-03T11:42:06.288 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.287+0000 7f8723d84780 1 > prepared operation key=M4VKPN6INFNZ tag=A3Y1H2W81DVB type=del size=1435870 2023-12-03T11:42:06.289 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.288+0000 7f8723d84780 1 < completed delete operation key=DMQX2DGDLU7D tag=SZRFSN3WXLWX type=del 2023-12-03T11:42:06.291 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.290+0000 7f8723d84780 1 > prepared part key=_multipart_UWS266H06VDK.2~JHN80VUCOF0N.0 size=533899 2023-12-03T11:42:06.291 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.290+0000 7f8723d84780 1 > prepared multipart upload key=UWS266H06VDK upload=JHN80VUCOF0N tag=3X3R14Z75AU0 type=write size=1582475 2023-12-03T11:42:06.292 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.291+0000 7f8723d84780 1 < completed delete operation key=K83BTR5BOLZE tag=YCCI7R612T3M type=del 2023-12-03T11:42:06.294 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.293+0000 7f8723d84780 1 > prepared operation key=VENJI0KD1XDW tag=YHH21CL7RQW8 type=del size=3803381 2023-12-03T11:42:06.295 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.294+0000 7f8723d84780 1 < completed delete operation key=O7VVHXLDSY57 tag=WMZEHQHN4EYZ type=del 2023-12-03T11:42:06.296 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.295+0000 7f8723d84780 1 > prepared operation key=K83BTR5BOLZE tag=PTOERDT0HZ7G type=del size=952711 2023-12-03T11:42:06.298 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.297+0000 7f8723d84780 1 < suggested update operation key=HIU6L0NQ8Q95 tag=CF3WC34VKCQ5 type=del size=1382435 2023-12-03T11:42:06.299 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.298+0000 7f8723d84780 1 > prepared operation key=G36T76K8O7A1 tag=ZWOEIP1Q8OH5 type=del size=2293647 2023-12-03T11:42:06.300 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.299+0000 7f8723d84780 1 < completed delete operation key=D3JEVEY0E29E tag=ZP9LRZ20TUCV type=del 2023-12-03T11:42:06.302 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.301+0000 7f8723d84780 1 > prepared operation key=D3JEVEY0E29E tag=UESA6B30Y7UK type=del size=1473912 2023-12-03T11:42:06.303 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.302+0000 7f8723d84780 1 < completed delete operation key=TSTIBGVYUZZZ tag=Y7YEK1XLCK77 type=del 2023-12-03T11:42:06.305 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.304+0000 7f8723d84780 1 > prepared part key=_multipart_KS5J7E7KE2IJ.2~67ZU8JK0NIJF.0 size=1048576 2023-12-03T11:42:06.306 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.305+0000 7f8723d84780 1 > prepared part key=_multipart_KS5J7E7KE2IJ.2~67ZU8JK0NIJF.1 size=741658 2023-12-03T11:42:06.306 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.305+0000 7f8723d84780 1 > prepared multipart upload key=KS5J7E7KE2IJ upload=67ZU8JK0NIJF tag=FM1YC10ISD5N type=write size=2838810 2023-12-03T11:42:06.308 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.307+0000 7f8723d84780 1 < suggested update operation key=K83BTR5BOLZE tag=TH4RL1KML7Y7 type=del size=3894072 2023-12-03T11:42:06.309 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.308+0000 7f8723d84780 1 > prepared operation key=10JRIKOZ16FY tag=24DH1LZ5CBUV type=del size=183191 2023-12-03T11:42:06.310 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.309+0000 7f8723d84780 1 < completed delete operation key=G36T76K8O7A1 tag=Y9I985KWE7A9 type=del 2023-12-03T11:42:06.311 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.310+0000 7f8723d84780 1 > prepared operation key=KS5J7E7KE2IJ tag=XRFE7UKBAHW4 type=del size=1144454 2023-12-03T11:42:06.312 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.311+0000 7f8723d84780 1 < completed part key=_multipart_W2704YS8KYQB.2~72JMGHAGMLIS.0 size=428230 2023-12-03T11:42:06.314 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.313+0000 7f8723d84780 1 < completed multipart upload key=W2704YS8KYQB upload=72JMGHAGMLIS tag=W7M7N9EXIS6M type=write size=1476806 2023-12-03T11:42:06.316 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.315+0000 7f8723d84780 1 > prepared part key=_multipart_LCK58DDM5XU9.2~4QHRPRO4ERRC.0 size=1048576 2023-12-03T11:42:06.317 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.316+0000 7f8723d84780 1 > prepared part key=_multipart_LCK58DDM5XU9.2~4QHRPRO4ERRC.1 size=1048576 2023-12-03T11:42:06.318 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.317+0000 7f8723d84780 1 > prepared part key=_multipart_LCK58DDM5XU9.2~4QHRPRO4ERRC.2 size=242248 2023-12-03T11:42:06.318 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.317+0000 7f8723d84780 1 > prepared multipart upload key=LCK58DDM5XU9 upload=4QHRPRO4ERRC tag=OQROI67OJIL8 type=write size=3387976 2023-12-03T11:42:06.320 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.319+0000 7f8723d84780 1 < completed part key=_multipart_KS5J7E7KE2IJ.2~GWNZ5VUKQBAE.0 size=1048576 2023-12-03T11:42:06.320 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.319+0000 7f8723d84780 1 < completed part key=_multipart_KS5J7E7KE2IJ.2~GWNZ5VUKQBAE.1 size=1048576 2023-12-03T11:42:06.321 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.320+0000 7f8723d84780 1 < completed part key=_multipart_KS5J7E7KE2IJ.2~GWNZ5VUKQBAE.2 size=310105 2023-12-03T11:42:06.323 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.322+0000 7f8723d84780 1 < completed multipart upload key=KS5J7E7KE2IJ upload=GWNZ5VUKQBAE tag=0UIKOL82F0WZ type=write size=3455833 2023-12-03T11:42:06.325 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.324+0000 7f8723d84780 1 > prepared operation key=OPQPIDJ2PBVU tag=I7L6I93C1V00 type=del size=600321 2023-12-03T11:42:06.326 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.325+0000 7f8723d84780 -1 < failed to complete operation key=HIU6L0NQ8Q95 tag=2XLYL34Q0189 type=del size=1403609: (22) Invalid argument 2023-12-03T11:42:06.328 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.327+0000 7f8723d84780 1 > prepared part key=_multipart_LMVO6CVEPN3K.2~PVEWGCTA9LX9.0 size=693093 2023-12-03T11:42:06.328 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.327+0000 7f8723d84780 1 > prepared multipart upload key=LMVO6CVEPN3K upload=PVEWGCTA9LX9 tag=NHEDS3E1GXAM type=write size=1741669 2023-12-03T11:42:06.329 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.328+0000 7f8723d84780 1 < completed delete operation key=KS5J7E7KE2IJ tag=3MY6PP6CKXOQ type=del 2023-12-03T11:42:06.331 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.330+0000 7f8723d84780 1 > prepared part key=_multipart_O7VVHXLDSY57.2~M20SWYP2RF71.0 size=1048576 2023-12-03T11:42:06.332 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.331+0000 7f8723d84780 1 > prepared part key=_multipart_O7VVHXLDSY57.2~M20SWYP2RF71.1 size=348572 2023-12-03T11:42:06.332 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.331+0000 7f8723d84780 1 > prepared multipart upload key=O7VVHXLDSY57 upload=M20SWYP2RF71 tag=C3JLHTTWCP1U type=write size=2445724 2023-12-03T11:42:06.333 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.332+0000 7f8723d84780 1 < completed part key=_multipart_K83BTR5BOLZE.2~B5VFFIU4KEQ2.0 size=612439 2023-12-03T11:42:06.335 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.334+0000 7f8723d84780 1 < completed multipart upload key=K83BTR5BOLZE upload=B5VFFIU4KEQ2 tag=8UD49IHSIU50 type=write size=1661015 2023-12-03T11:42:06.336 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.335+0000 7f8723d84780 1 > prepared operation key=4I8PWBZOLDUG tag=2Z5E86WDG8VA type=del size=2407846 2023-12-03T11:42:06.338 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.337+0000 7f8723d84780 1 < completed delete operation key=VENJI0KD1XDW tag=2MAU68K0Q84I type=del 2023-12-03T11:42:06.341 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.338+0000 7f8723d84780 1 > prepared operation key=K83BTR5BOLZE tag=ATI9J6WQV43L type=del size=1664297 2023-12-03T11:42:06.341 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.339+0000 7f8723d84780 1 < completed delete operation key=12XG7YPYTN4U tag=O9VSCLTPRF4E type=del 2023-12-03T11:42:06.342 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.341+0000 7f8723d84780 1 > prepared operation key=12XG7YPYTN4U tag=NQULL58Q9I3P type=write size=184063 2023-12-03T11:42:06.344 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.343+0000 7f8723d84780 1 < suggested update operation key=M4VKPN6INFNZ tag=A3Y1H2W81DVB type=del size=1435870 2023-12-03T11:42:06.346 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.345+0000 7f8723d84780 1 > prepared operation key=K83BTR5BOLZE tag=QX86TSM3XQAE type=del size=2479642 2023-12-03T11:42:06.347 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.346+0000 7f8723d84780 1 < completed part key=_multipart_UWS266H06VDK.2~JHN80VUCOF0N.0 size=533899 2023-12-03T11:42:06.349 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.348+0000 7f8723d84780 1 < completed multipart upload key=UWS266H06VDK upload=JHN80VUCOF0N tag=3X3R14Z75AU0 type=write size=1582475 2023-12-03T11:42:06.351 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.350+0000 7f8723d84780 1 > prepared operation key=DMQX2DGDLU7D tag=40FVAPSXGANH type=del size=3214756 2023-12-03T11:42:06.352 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.351+0000 7f8723d84780 1 < completed delete operation key=VENJI0KD1XDW tag=YHH21CL7RQW8 type=del 2023-12-03T11:42:06.354 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.353+0000 7f8723d84780 1 > prepared operation key=D3JEVEY0E29E tag=W8DYKQMM7USL type=del size=795603 2023-12-03T11:42:06.356 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.355+0000 7f8723d84780 -1 < failed to complete operation key=K83BTR5BOLZE tag=PTOERDT0HZ7G type=del size=952711: (22) Invalid argument 2023-12-03T11:42:06.357 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.356+0000 7f8723d84780 1 > prepared operation key=O7VVHXLDSY57 tag=3OXWFGIKJOCJ type=del size=4049651 2023-12-03T11:42:06.358 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.357+0000 7f8723d84780 1 < completed delete operation key=G36T76K8O7A1 tag=ZWOEIP1Q8OH5 type=del 2023-12-03T11:42:06.360 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.359+0000 7f8723d84780 1 > prepared operation key=O7VVHXLDSY57 tag=0REYPUG4CIK7 type=del size=1764788 2023-12-03T11:42:06.361 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.360+0000 7f8723d84780 1 < completed delete operation key=D3JEVEY0E29E tag=UESA6B30Y7UK type=del 2023-12-03T11:42:06.362 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.361+0000 7f8723d84780 1 > prepared operation key=8NONX2I08YMJ tag=6U21K7JGC3CY type=del size=439536 2023-12-03T11:42:06.363 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.362+0000 7f8723d84780 1 < completed part key=_multipart_KS5J7E7KE2IJ.2~67ZU8JK0NIJF.0 size=1048576 2023-12-03T11:42:06.364 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.363+0000 7f8723d84780 1 < completed part key=_multipart_KS5J7E7KE2IJ.2~67ZU8JK0NIJF.1 size=741658 2023-12-03T11:42:06.366 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.365+0000 7f8723d84780 1 < completed multipart upload key=KS5J7E7KE2IJ upload=67ZU8JK0NIJF tag=FM1YC10ISD5N type=write size=2838810 2023-12-03T11:42:06.368 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.367+0000 7f8723d84780 1 > prepared operation key=FCA2R3HR61S2 tag=SCBSPLTWZPZ4 type=del size=2571920 2023-12-03T11:42:06.369 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.368+0000 7f8723d84780 1 < completed delete operation key=10JRIKOZ16FY tag=24DH1LZ5CBUV type=del 2023-12-03T11:42:06.371 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.370+0000 7f8723d84780 1 > prepared part key=_multipart_Y6S7QI60GCLE.2~ANR8Q9LRR2F5.0 size=1048576 2023-12-03T11:42:06.372 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.371+0000 7f8723d84780 1 > prepared part key=_multipart_Y6S7QI60GCLE.2~ANR8Q9LRR2F5.1 size=575791 2023-12-03T11:42:06.372 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.371+0000 7f8723d84780 1 > prepared multipart upload key=Y6S7QI60GCLE upload=ANR8Q9LRR2F5 tag=1SBWJE8SYLB7 type=write size=2672943 2023-12-03T11:42:06.373 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.372+0000 7f8723d84780 1 < completed delete operation key=KS5J7E7KE2IJ tag=XRFE7UKBAHW4 type=del 2023-12-03T11:42:06.375 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.374+0000 7f8723d84780 1 > prepared part key=_multipart_FCA2R3HR61S2.2~U4A3NHIQXBLY.0 size=1048576 2023-12-03T11:42:06.376 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.375+0000 7f8723d84780 1 > prepared part key=_multipart_FCA2R3HR61S2.2~U4A3NHIQXBLY.1 size=127806 2023-12-03T11:42:06.376 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.375+0000 7f8723d84780 1 > prepared multipart upload key=FCA2R3HR61S2 upload=U4A3NHIQXBLY tag=3WJNKWYAOARW type=write size=2224958 2023-12-03T11:42:06.378 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.377+0000 7f8723d84780 1 < completed part key=_multipart_LCK58DDM5XU9.2~4QHRPRO4ERRC.0 size=1048576 2023-12-03T11:42:06.381 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.378+0000 7f8723d84780 1 < completed part key=_multipart_LCK58DDM5XU9.2~4QHRPRO4ERRC.1 size=1048576 2023-12-03T11:42:06.381 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.379+0000 7f8723d84780 1 < completed part key=_multipart_LCK58DDM5XU9.2~4QHRPRO4ERRC.2 size=242248 2023-12-03T11:42:06.382 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.381+0000 7f8723d84780 1 < completed multipart upload key=LCK58DDM5XU9 upload=4QHRPRO4ERRC tag=OQROI67OJIL8 type=write size=3387976 2023-12-03T11:42:06.384 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.383+0000 7f8723d84780 1 > prepared part key=_multipart_CKABTI1EOAWB.2~HU1JYWJF6E4L.0 size=14133 2023-12-03T11:42:06.384 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.383+0000 7f8723d84780 1 > prepared multipart upload key=CKABTI1EOAWB upload=HU1JYWJF6E4L tag=OC15UAZ1NLVI type=write size=1062709 2023-12-03T11:42:06.385 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.384+0000 7f8723d84780 1 < canceled operation key=OPQPIDJ2PBVU tag=I7L6I93C1V00 type=del size=600321 2023-12-03T11:42:06.387 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.386+0000 7f8723d84780 1 > prepared part key=_multipart_HIU6L0NQ8Q95.2~7B9X3ZAKCV4U.0 size=905844 2023-12-03T11:42:06.387 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.386+0000 7f8723d84780 1 > prepared multipart upload key=HIU6L0NQ8Q95 upload=7B9X3ZAKCV4U tag=2AB92B91HYO0 type=write size=1954420 2023-12-03T11:42:06.388 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.387+0000 7f8723d84780 1 < completed part key=_multipart_LMVO6CVEPN3K.2~PVEWGCTA9LX9.0 size=693093 2023-12-03T11:42:06.390 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.389+0000 7f8723d84780 1 < completed multipart upload key=LMVO6CVEPN3K upload=PVEWGCTA9LX9 tag=NHEDS3E1GXAM type=write size=1741669 2023-12-03T11:42:06.391 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.390+0000 7f8723d84780 1 > prepared operation key=KS5J7E7KE2IJ tag=O0OR8KCZTUEI type=del size=279821 2023-12-03T11:42:06.392 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.391+0000 7f8723d84780 1 < canceled part key=_multipart_O7VVHXLDSY57.2~M20SWYP2RF71.0 size=1048576 2023-12-03T11:42:06.393 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.392+0000 7f8723d84780 1 < completed part key=_multipart_O7VVHXLDSY57.2~M20SWYP2RF71.1 size=348572 2023-12-03T11:42:06.396 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.395+0000 7f8723d84780 1 < canceled multipart upload key=O7VVHXLDSY57 upload=M20SWYP2RF71 tag=C3JLHTTWCP1U type=write size=2445724 2023-12-03T11:42:06.398 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.397+0000 7f8723d84780 1 > prepared operation key=EITMJKL0LCYC tag=3IZMNUUX9H1T type=del size=338536 2023-12-03T11:42:06.404 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.403+0000 7f8723d84780 1 < completed delete operation key=4I8PWBZOLDUG tag=2Z5E86WDG8VA type=del 2023-12-03T11:42:06.407 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.406+0000 7f8723d84780 1 > prepared part key=_multipart_HIU6L0NQ8Q95.2~DQ11CV9PMP85.0 size=1048576 2023-12-03T11:42:06.408 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.407+0000 7f8723d84780 1 > prepared part key=_multipart_HIU6L0NQ8Q95.2~DQ11CV9PMP85.1 size=64293 2023-12-03T11:42:06.408 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.407+0000 7f8723d84780 1 > prepared multipart upload key=HIU6L0NQ8Q95 upload=DQ11CV9PMP85 tag=MGQY27C3D5W2 type=write size=2161445 2023-12-03T11:42:06.410 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.409+0000 7f8723d84780 1 < suggested remove operation key=K83BTR5BOLZE tag=ATI9J6WQV43L type=del 2023-12-03T11:42:06.412 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.411+0000 7f8723d84780 1 > prepared operation key=VENJI0KD1XDW tag=9K69W96LGKOS type=del size=1781549 2023-12-03T11:42:06.413 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.412+0000 7f8723d84780 1 < completed write operation key=12XG7YPYTN4U tag=NQULL58Q9I3P type=write size=184063 2023-12-03T11:42:06.414 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.413+0000 7f8723d84780 1 > prepared operation key=CKABTI1EOAWB tag=YV3WOGRQL6JX type=del size=1462994 2023-12-03T11:42:06.415 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.414+0000 7f8723d84780 -1 < failed to complete operation key=K83BTR5BOLZE tag=QX86TSM3XQAE type=del size=2479642: (22) Invalid argument 2023-12-03T11:42:06.417 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.416+0000 7f8723d84780 1 > prepared operation key=VENJI0KD1XDW tag=20P84EJWXHQP type=del size=4059291 2023-12-03T11:42:06.419 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.418+0000 7f8723d84780 1 < suggested remove operation key=DMQX2DGDLU7D tag=40FVAPSXGANH type=del 2023-12-03T11:42:06.420 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.419+0000 7f8723d84780 1 > prepared operation key=LCK58DDM5XU9 tag=I6W7CC7URYI3 type=write size=478179 2023-12-03T11:42:06.421 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.420+0000 7f8723d84780 1 < completed delete operation key=D3JEVEY0E29E tag=W8DYKQMM7USL type=del 2023-12-03T11:42:06.423 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.422+0000 7f8723d84780 1 > prepared operation key=G36T76K8O7A1 tag=ZK8IHUFSKAZE type=del size=4089825 2023-12-03T11:42:06.424 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.423+0000 7f8723d84780 1 < completed delete operation key=O7VVHXLDSY57 tag=3OXWFGIKJOCJ type=del 2023-12-03T11:42:06.426 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.425+0000 7f8723d84780 1 > prepared part key=_multipart_J33T5S893LMV.2~TM27BGRU6QEO.0 size=913107 2023-12-03T11:42:06.426 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.425+0000 7f8723d84780 1 > prepared multipart upload key=J33T5S893LMV upload=TM27BGRU6QEO tag=Z43NFP8O70UB type=write size=1961683 2023-12-03T11:42:06.427 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.426+0000 7f8723d84780 1 < completed delete operation key=O7VVHXLDSY57 tag=0REYPUG4CIK7 type=del 2023-12-03T11:42:06.430 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.429+0000 7f8723d84780 1 > prepared part key=_multipart_OPQPIDJ2PBVU.2~XQ0CHXTZQCFL.0 size=792329 2023-12-03T11:42:06.430 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.429+0000 7f8723d84780 1 > prepared multipart upload key=OPQPIDJ2PBVU upload=XQ0CHXTZQCFL tag=3SVOB9LNVC12 type=write size=1840905 2023-12-03T11:42:06.432 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.431+0000 7f8723d84780 1 < suggested remove operation key=8NONX2I08YMJ tag=6U21K7JGC3CY type=del 2023-12-03T11:42:06.435 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.433+0000 7f8723d84780 1 > prepared part key=_multipart_W2704YS8KYQB.2~FPMAH04EUB0Q.0 size=1048576 2023-12-03T11:42:06.435 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.434+0000 7f8723d84780 1 > prepared part key=_multipart_W2704YS8KYQB.2~FPMAH04EUB0Q.1 size=633165 2023-12-03T11:42:06.436 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.434+0000 7f8723d84780 1 > prepared multipart upload key=W2704YS8KYQB upload=FPMAH04EUB0Q tag=G2Y01OS3EQMG type=write size=2730317 2023-12-03T11:42:06.439 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.437+0000 7f8723d84780 1 < suggested remove operation key=FCA2R3HR61S2 tag=SCBSPLTWZPZ4 type=del 2023-12-03T11:42:06.442 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.441+0000 7f8723d84780 1 > prepared operation key=EY9ZG5KOTBWM tag=3RY75HZK3HCP type=del size=1648595 2023-12-03T11:42:06.444 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.443+0000 7f8723d84780 1 < completed part key=_multipart_Y6S7QI60GCLE.2~ANR8Q9LRR2F5.0 size=1048576 2023-12-03T11:42:06.445 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.444+0000 7f8723d84780 1 < completed part key=_multipart_Y6S7QI60GCLE.2~ANR8Q9LRR2F5.1 size=575791 2023-12-03T11:42:06.447 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.446+0000 7f8723d84780 1 < completed multipart upload key=Y6S7QI60GCLE upload=ANR8Q9LRR2F5 tag=1SBWJE8SYLB7 type=write size=2672943 2023-12-03T11:42:06.448 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.447+0000 7f8723d84780 1 > prepared operation key=OGACI7CRPMT7 tag=MR5QIW1GJG8P type=write size=292430 2023-12-03T11:42:06.449 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.448+0000 7f8723d84780 1 < completed part key=_multipart_FCA2R3HR61S2.2~U4A3NHIQXBLY.0 size=1048576 2023-12-03T11:42:06.450 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.449+0000 7f8723d84780 1 < completed part key=_multipart_FCA2R3HR61S2.2~U4A3NHIQXBLY.1 size=127806 2023-12-03T11:42:06.452 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.451+0000 7f8723d84780 1 < completed multipart upload key=FCA2R3HR61S2 upload=U4A3NHIQXBLY tag=3WJNKWYAOARW type=write size=2224958 2023-12-03T11:42:06.453 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.452+0000 7f8723d84780 1 > prepared operation key=LCK58DDM5XU9 tag=32NN7GDNVMBR type=write size=700674 2023-12-03T11:42:06.455 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.454+0000 7f8723d84780 1 < completed part key=_multipart_CKABTI1EOAWB.2~HU1JYWJF6E4L.0 size=14133 2023-12-03T11:42:06.457 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.456+0000 7f8723d84780 1 < completed multipart upload key=CKABTI1EOAWB upload=HU1JYWJF6E4L tag=OC15UAZ1NLVI type=write size=1062709 2023-12-03T11:42:06.458 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.457+0000 7f8723d84780 1 > prepared operation key=J33T5S893LMV tag=3UHRW19ERFLR type=del size=2621732 2023-12-03T11:42:06.458 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.457+0000 7f8723d84780 1 < canceled part key=_multipart_HIU6L0NQ8Q95.2~7B9X3ZAKCV4U.0 size=905844 2023-12-03T11:42:06.460 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.459+0000 7f8723d84780 1 < canceled multipart upload key=HIU6L0NQ8Q95 upload=7B9X3ZAKCV4U tag=2AB92B91HYO0 type=write size=1954420 2023-12-03T11:42:06.462 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.461+0000 7f8723d84780 1 > prepared part key=_multipart_M4VKPN6INFNZ.2~KJKBQD14GXBW.0 size=1048576 2023-12-03T11:42:06.463 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.462+0000 7f8723d84780 1 > prepared part key=_multipart_M4VKPN6INFNZ.2~KJKBQD14GXBW.1 size=1048576 2023-12-03T11:42:06.464 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.463+0000 7f8723d84780 1 > prepared part key=_multipart_M4VKPN6INFNZ.2~KJKBQD14GXBW.2 size=780879 2023-12-03T11:42:06.464 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.463+0000 7f8723d84780 1 > prepared multipart upload key=M4VKPN6INFNZ upload=KJKBQD14GXBW tag=RVF95CAOQHOO type=write size=3926607 2023-12-03T11:42:06.465 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.464+0000 7f8723d84780 1 < completed delete operation key=KS5J7E7KE2IJ tag=O0OR8KCZTUEI type=del 2023-12-03T11:42:06.468 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.467+0000 7f8723d84780 1 > prepared part key=_multipart_AB0SN0E49Z5F.2~OFCNLCNSYBSW.0 size=1048576 2023-12-03T11:42:06.469 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.468+0000 7f8723d84780 1 > prepared part key=_multipart_AB0SN0E49Z5F.2~OFCNLCNSYBSW.1 size=1048576 2023-12-03T11:42:06.470 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.469+0000 7f8723d84780 1 > prepared part key=_multipart_AB0SN0E49Z5F.2~OFCNLCNSYBSW.2 size=572588 2023-12-03T11:42:06.470 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.469+0000 7f8723d84780 1 > prepared multipart upload key=AB0SN0E49Z5F upload=OFCNLCNSYBSW tag=BTEM4SG5ZLTN type=write size=3718316 2023-12-03T11:42:06.471 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.470+0000 7f8723d84780 1 < completed delete operation key=EITMJKL0LCYC tag=3IZMNUUX9H1T type=del 2023-12-03T11:42:06.473 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.472+0000 7f8723d84780 1 > prepared part key=_multipart_5UYL15O31IHM.2~AHP75O5JYB7T.0 size=273508 2023-12-03T11:42:06.473 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.472+0000 7f8723d84780 1 > prepared multipart upload key=5UYL15O31IHM upload=AHP75O5JYB7T tag=JZT4EWLRBMLS type=write size=1322084 2023-12-03T11:42:06.474 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.473+0000 7f8723d84780 1 < completed part key=_multipart_HIU6L0NQ8Q95.2~DQ11CV9PMP85.0 size=1048576 2023-12-03T11:42:06.475 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.474+0000 7f8723d84780 1 < completed part key=_multipart_HIU6L0NQ8Q95.2~DQ11CV9PMP85.1 size=64293 2023-12-03T11:42:06.479 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.478+0000 7f8723d84780 1 < completed multipart upload key=HIU6L0NQ8Q95 upload=DQ11CV9PMP85 tag=MGQY27C3D5W2 type=write size=2161445 2023-12-03T11:42:06.481 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.480+0000 7f8723d84780 1 > prepared operation key=W2704YS8KYQB tag=OZNGZZI9KEKY type=del size=1329546 2023-12-03T11:42:06.483 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.482+0000 7f8723d84780 1 < suggested remove operation key=VENJI0KD1XDW tag=9K69W96LGKOS type=del 2023-12-03T11:42:06.485 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.484+0000 7f8723d84780 1 > prepared operation key=LCK58DDM5XU9 tag=NNFX68LRYSKS type=del size=933308 2023-12-03T11:42:06.486 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.485+0000 7f8723d84780 1 < completed delete operation key=CKABTI1EOAWB tag=YV3WOGRQL6JX type=del 2023-12-03T11:42:06.488 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.487+0000 7f8723d84780 1 > prepared part key=_multipart_AB0SN0E49Z5F.2~TB31X8PLZW65.0 size=1048576 2023-12-03T11:42:06.489 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.488+0000 7f8723d84780 1 > prepared part key=_multipart_AB0SN0E49Z5F.2~TB31X8PLZW65.1 size=1048576 2023-12-03T11:42:06.490 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.489+0000 7f8723d84780 1 > prepared part key=_multipart_AB0SN0E49Z5F.2~TB31X8PLZW65.2 size=268214 2023-12-03T11:42:06.490 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.489+0000 7f8723d84780 1 > prepared multipart upload key=AB0SN0E49Z5F upload=TB31X8PLZW65 tag=BC3WJ5OT72Z9 type=write size=3413942 2023-12-03T11:42:06.490 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.489+0000 7f8723d84780 -1 < no bi entry to suggest for operation key=VENJI0KD1XDW tag=20P84EJWXHQP type=del size=4059291: (2) No such file or directory 2023-12-03T11:42:06.492 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.491+0000 7f8723d84780 1 > prepared operation key=D3JEVEY0E29E tag=86FC0ERKMOXQ type=del size=3472634 2023-12-03T11:42:06.493 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.492+0000 7f8723d84780 1 < canceled operation key=LCK58DDM5XU9 tag=I6W7CC7URYI3 type=write size=478179 2023-12-03T11:42:06.495 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.493+0000 7f8723d84780 1 > prepared operation key=931GNEXBHH35 tag=YGWCO1F5QXS0 type=del size=4085926 2023-12-03T11:42:06.496 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.495+0000 7f8723d84780 1 < completed delete operation key=G36T76K8O7A1 tag=ZK8IHUFSKAZE type=del 2023-12-03T11:42:06.497 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.496+0000 7f8723d84780 1 > prepared operation key=VENJI0KD1XDW tag=HC94J4DIS3Q6 type=write size=111971 2023-12-03T11:42:06.498 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.497+0000 7f8723d84780 1 < completed part key=_multipart_J33T5S893LMV.2~TM27BGRU6QEO.0 size=913107 2023-12-03T11:42:06.500 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.499+0000 7f8723d84780 1 < completed multipart upload key=J33T5S893LMV upload=TM27BGRU6QEO tag=Z43NFP8O70UB type=write size=1961683 2023-12-03T11:42:06.501 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.500+0000 7f8723d84780 1 > prepared operation key=5UYL15O31IHM tag=EST9VC9L4D1P type=write size=77456 2023-12-03T11:42:06.502 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.501+0000 7f8723d84780 1 < completed part key=_multipart_OPQPIDJ2PBVU.2~XQ0CHXTZQCFL.0 size=792329 2023-12-03T11:42:06.504 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.503+0000 7f8723d84780 1 < completed multipart upload key=OPQPIDJ2PBVU upload=XQ0CHXTZQCFL tag=3SVOB9LNVC12 type=write size=1840905 2023-12-03T11:42:06.506 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.505+0000 7f8723d84780 1 > prepared operation key=W2704YS8KYQB tag=IR9RQGQY38GG type=del size=1811897 2023-12-03T11:42:06.507 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.506+0000 7f8723d84780 1 < completed part key=_multipart_W2704YS8KYQB.2~FPMAH04EUB0Q.0 size=1048576 2023-12-03T11:42:06.508 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.507+0000 7f8723d84780 1 < completed part key=_multipart_W2704YS8KYQB.2~FPMAH04EUB0Q.1 size=633165 2023-12-03T11:42:06.510 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.509+0000 7f8723d84780 1 < completed multipart upload key=W2704YS8KYQB upload=FPMAH04EUB0Q tag=G2Y01OS3EQMG type=write size=2730317 2023-12-03T11:42:06.511 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.510+0000 7f8723d84780 1 > prepared operation key=VENJI0KD1XDW tag=81H2ZIE0XX4E type=del size=3384048 2023-12-03T11:42:06.512 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.511+0000 7f8723d84780 1 < completed delete operation key=EY9ZG5KOTBWM tag=3RY75HZK3HCP type=del 2023-12-03T11:42:06.514 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.513+0000 7f8723d84780 1 > prepared operation key=J33T5S893LMV tag=S5SLQMKBWAMP type=write size=752682 2023-12-03T11:42:06.516 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.515+0000 7f8723d84780 1 < suggested update operation key=OGACI7CRPMT7 tag=MR5QIW1GJG8P type=write size=292430 2023-12-03T11:42:06.518 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.517+0000 7f8723d84780 1 > prepared part key=_multipart_7THZZ1J5LOZK.2~Y4S7SGSE5FUJ.0 size=1048576 2023-12-03T11:42:06.519 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.518+0000 7f8723d84780 1 > prepared part key=_multipart_7THZZ1J5LOZK.2~Y4S7SGSE5FUJ.1 size=1048576 2023-12-03T11:42:06.520 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.519+0000 7f8723d84780 1 > prepared part key=_multipart_7THZZ1J5LOZK.2~Y4S7SGSE5FUJ.2 size=191432 2023-12-03T11:42:06.520 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.519+0000 7f8723d84780 1 > prepared multipart upload key=7THZZ1J5LOZK upload=Y4S7SGSE5FUJ tag=6RVLX9EIJ2R2 type=write size=3337160 2023-12-03T11:42:06.522 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.521+0000 7f8723d84780 1 < suggested remove operation key=LCK58DDM5XU9 tag=32NN7GDNVMBR type=write 2023-12-03T11:42:06.524 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.523+0000 7f8723d84780 1 > prepared part key=_multipart_931GNEXBHH35.2~Z0EKNWM5PLQR.0 size=1048576 2023-12-03T11:42:06.525 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.524+0000 7f8723d84780 1 > prepared part key=_multipart_931GNEXBHH35.2~Z0EKNWM5PLQR.1 size=1013433 2023-12-03T11:42:06.525 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.524+0000 7f8723d84780 1 > prepared multipart upload key=931GNEXBHH35 upload=Z0EKNWM5PLQR tag=MRC1BEWN4WV1 type=write size=3110585 2023-12-03T11:42:06.526 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.525+0000 7f8723d84780 1 < canceled operation key=J33T5S893LMV tag=3UHRW19ERFLR type=del size=2621732 2023-12-03T11:42:06.529 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.528+0000 7f8723d84780 1 > prepared part key=_multipart_LCK58DDM5XU9.2~P2SJO6LIWRVT.0 size=502591 2023-12-03T11:42:06.529 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.528+0000 7f8723d84780 1 > prepared multipart upload key=LCK58DDM5XU9 upload=P2SJO6LIWRVT tag=D1FHO5J33VGI type=write size=1551167 2023-12-03T11:42:06.530 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.529+0000 7f8723d84780 1 < completed part key=_multipart_M4VKPN6INFNZ.2~KJKBQD14GXBW.0 size=1048576 2023-12-03T11:42:06.531 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.530+0000 7f8723d84780 1 < completed part key=_multipart_M4VKPN6INFNZ.2~KJKBQD14GXBW.1 size=1048576 2023-12-03T11:42:06.532 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.531+0000 7f8723d84780 1 < completed part key=_multipart_M4VKPN6INFNZ.2~KJKBQD14GXBW.2 size=780879 2023-12-03T11:42:06.534 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.532+0000 7f8723d84780 1 < completed multipart upload key=M4VKPN6INFNZ upload=KJKBQD14GXBW tag=RVF95CAOQHOO type=write size=3926607 2023-12-03T11:42:06.536 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.535+0000 7f8723d84780 1 > prepared part key=_multipart_96RAVVSUKH0Y.2~TCRZ8NUY8LC8.0 size=1048576 2023-12-03T11:42:06.536 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.535+0000 7f8723d84780 1 > prepared part key=_multipart_96RAVVSUKH0Y.2~TCRZ8NUY8LC8.1 size=834881 2023-12-03T11:42:06.536 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.535+0000 7f8723d84780 1 > prepared multipart upload key=96RAVVSUKH0Y upload=TCRZ8NUY8LC8 tag=L39BYP7I03YU type=write size=2932033 2023-12-03T11:42:06.537 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.536+0000 7f8723d84780 1 < canceled part key=_multipart_AB0SN0E49Z5F.2~OFCNLCNSYBSW.0 size=1048576 2023-12-03T11:42:06.538 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.537+0000 7f8723d84780 1 < completed part key=_multipart_AB0SN0E49Z5F.2~OFCNLCNSYBSW.1 size=1048576 2023-12-03T11:42:06.538 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.537+0000 7f8723d84780 1 < completed part key=_multipart_AB0SN0E49Z5F.2~OFCNLCNSYBSW.2 size=572588 2023-12-03T11:42:06.541 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.540+0000 7f8723d84780 1 < canceled multipart upload key=AB0SN0E49Z5F upload=OFCNLCNSYBSW tag=BTEM4SG5ZLTN type=write size=3718316 2023-12-03T11:42:06.542 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.541+0000 7f8723d84780 1 > prepared operation key=O7VVHXLDSY57 tag=HHJZY87UALFQ type=del size=2788787 2023-12-03T11:42:06.543 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.542+0000 7f8723d84780 1 < completed part key=_multipart_5UYL15O31IHM.2~AHP75O5JYB7T.0 size=273508 2023-12-03T11:42:06.545 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.544+0000 7f8723d84780 1 < completed multipart upload key=5UYL15O31IHM upload=AHP75O5JYB7T tag=JZT4EWLRBMLS type=write size=1322084 2023-12-03T11:42:06.548 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.546+0000 7f8723d84780 1 > prepared operation key=D3JEVEY0E29E tag=2ZZ662HMX0BD type=del size=458046 2023-12-03T11:42:06.548 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.547+0000 7f8723d84780 1 < completed delete operation key=W2704YS8KYQB tag=OZNGZZI9KEKY type=del 2023-12-03T11:42:06.549 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.548+0000 7f8723d84780 1 > prepared operation key=5UYL15O31IHM tag=O1JMMTP8ZXO2 type=del size=1871945 2023-12-03T11:42:06.550 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.549+0000 7f8723d84780 -1 < failed to complete operation key=LCK58DDM5XU9 tag=NNFX68LRYSKS type=del size=933308: (22) Invalid argument 2023-12-03T11:42:06.553 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.552+0000 7f8723d84780 1 > prepared part key=_multipart_UWS266H06VDK.2~GXB2TMPKRF3E.0 size=1048576 2023-12-03T11:42:06.554 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.552+0000 7f8723d84780 1 > prepared part key=_multipart_UWS266H06VDK.2~GXB2TMPKRF3E.1 size=1048576 2023-12-03T11:42:06.554 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.553+0000 7f8723d84780 1 > prepared part key=_multipart_UWS266H06VDK.2~GXB2TMPKRF3E.2 size=437524 2023-12-03T11:42:06.554 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.553+0000 7f8723d84780 1 > prepared multipart upload key=UWS266H06VDK upload=GXB2TMPKRF3E tag=A2SYV8HRKMK6 type=write size=3583252 2023-12-03T11:42:06.556 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.555+0000 7f8723d84780 1 < completed part key=_multipart_AB0SN0E49Z5F.2~TB31X8PLZW65.0 size=1048576 2023-12-03T11:42:06.557 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.556+0000 7f8723d84780 1 < completed part key=_multipart_AB0SN0E49Z5F.2~TB31X8PLZW65.1 size=1048576 2023-12-03T11:42:06.558 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.556+0000 7f8723d84780 1 < completed part key=_multipart_AB0SN0E49Z5F.2~TB31X8PLZW65.2 size=268214 2023-12-03T11:42:06.560 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.559+0000 7f8723d84780 1 < completed multipart upload key=AB0SN0E49Z5F upload=TB31X8PLZW65 tag=BC3WJ5OT72Z9 type=write size=3413942 2023-12-03T11:42:06.561 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.560+0000 7f8723d84780 1 > prepared operation key=10JRIKOZ16FY tag=J8XK96RPIB19 type=del size=3493601 2023-12-03T11:42:06.562 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.561+0000 7f8723d84780 1 < completed delete operation key=D3JEVEY0E29E tag=86FC0ERKMOXQ type=del 2023-12-03T11:42:06.563 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.562+0000 7f8723d84780 1 > prepared operation key=OGACI7CRPMT7 tag=EOEERXSRVOMM type=write size=748736 2023-12-03T11:42:06.564 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.563+0000 7f8723d84780 1 < completed delete operation key=931GNEXBHH35 tag=YGWCO1F5QXS0 type=del 2023-12-03T11:42:06.566 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.565+0000 7f8723d84780 1 > prepared operation key=TSTIBGVYUZZZ tag=A7FM27Z9924A type=del size=846199 2023-12-03T11:42:06.568 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.567+0000 7f8723d84780 1 < suggested update operation key=VENJI0KD1XDW tag=HC94J4DIS3Q6 type=write size=111971 2023-12-03T11:42:06.570 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.569+0000 7f8723d84780 1 > prepared part key=_multipart_7VMTBKUWU59F.2~GU54ZXEE7UR9.0 size=1048576 2023-12-03T11:42:06.571 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.570+0000 7f8723d84780 1 > prepared part key=_multipart_7VMTBKUWU59F.2~GU54ZXEE7UR9.1 size=695225 2023-12-03T11:42:06.571 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.570+0000 7f8723d84780 1 > prepared multipart upload key=7VMTBKUWU59F upload=GU54ZXEE7UR9 tag=2SSZNSB3HQAW type=write size=2792377 2023-12-03T11:42:06.572 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.571+0000 7f8723d84780 1 < completed write operation key=5UYL15O31IHM tag=EST9VC9L4D1P type=write size=77456 2023-12-03T11:42:06.573 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.572+0000 7f8723d84780 1 > prepared operation key=UWS266H06VDK tag=GJ5QU77JYSQ5 type=write size=540780 2023-12-03T11:42:06.575 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.574+0000 7f8723d84780 1 < completed delete operation key=W2704YS8KYQB tag=IR9RQGQY38GG type=del 2023-12-03T11:42:06.576 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.575+0000 7f8723d84780 1 > prepared operation key=J33T5S893LMV tag=RP6MS2P53U1J type=del size=2680602 2023-12-03T11:42:06.577 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.576+0000 7f8723d84780 -1 < failed to complete operation key=VENJI0KD1XDW tag=81H2ZIE0XX4E type=del size=3384048: (22) Invalid argument 2023-12-03T11:42:06.579 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.578+0000 7f8723d84780 1 > prepared part key=_multipart_HIU6L0NQ8Q95.2~1Q2N82ED6GXU.0 size=65496 2023-12-03T11:42:06.579 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.578+0000 7f8723d84780 1 > prepared multipart upload key=HIU6L0NQ8Q95 upload=1Q2N82ED6GXU tag=3RKDU2NC08PP type=write size=1114072 2023-12-03T11:42:06.580 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.579+0000 7f8723d84780 1 < completed write operation key=J33T5S893LMV tag=S5SLQMKBWAMP type=write size=752682 2023-12-03T11:42:06.582 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.581+0000 7f8723d84780 1 > prepared part key=_multipart_LMVO6CVEPN3K.2~FZXQKYQ21GKQ.0 size=1048576 2023-12-03T11:42:06.583 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.582+0000 7f8723d84780 1 > prepared part key=_multipart_LMVO6CVEPN3K.2~FZXQKYQ21GKQ.1 size=32112 2023-12-03T11:42:06.584 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.582+0000 7f8723d84780 1 > prepared multipart upload key=LMVO6CVEPN3K upload=FZXQKYQ21GKQ tag=M45TS20L147F type=write size=2129264 2023-12-03T11:42:06.585 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.584+0000 7f8723d84780 1 < completed part key=_multipart_7THZZ1J5LOZK.2~Y4S7SGSE5FUJ.0 size=1048576 2023-12-03T11:42:06.586 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.585+0000 7f8723d84780 1 < completed part key=_multipart_7THZZ1J5LOZK.2~Y4S7SGSE5FUJ.1 size=1048576 2023-12-03T11:42:06.587 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.586+0000 7f8723d84780 1 < completed part key=_multipart_7THZZ1J5LOZK.2~Y4S7SGSE5FUJ.2 size=191432 2023-12-03T11:42:06.589 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.588+0000 7f8723d84780 1 < completed multipart upload key=7THZZ1J5LOZK upload=Y4S7SGSE5FUJ tag=6RVLX9EIJ2R2 type=write size=3337160 2023-12-03T11:42:06.591 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.590+0000 7f8723d84780 1 > prepared part key=_multipart_G36T76K8O7A1.2~H8K458LTMYYY.0 size=1048576 2023-12-03T11:42:06.592 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.591+0000 7f8723d84780 1 > prepared part key=_multipart_G36T76K8O7A1.2~H8K458LTMYYY.1 size=1048576 2023-12-03T11:42:06.593 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.592+0000 7f8723d84780 1 > prepared part key=_multipart_G36T76K8O7A1.2~H8K458LTMYYY.2 size=1018547 2023-12-03T11:42:06.594 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.592+0000 7f8723d84780 1 > prepared multipart upload key=G36T76K8O7A1 upload=H8K458LTMYYY tag=N8KOWAV612J7 type=write size=4164275 2023-12-03T11:42:06.594 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.593+0000 7f8723d84780 1 < canceled part key=_multipart_931GNEXBHH35.2~Z0EKNWM5PLQR.0 size=1048576 2023-12-03T11:42:06.598 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.594+0000 7f8723d84780 1 < completed part key=_multipart_931GNEXBHH35.2~Z0EKNWM5PLQR.1 size=1013433 2023-12-03T11:42:06.598 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.596+0000 7f8723d84780 1 < canceled multipart upload key=931GNEXBHH35 upload=Z0EKNWM5PLQR tag=MRC1BEWN4WV1 type=write size=3110585 2023-12-03T11:42:06.598 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.597+0000 7f8723d84780 1 > prepared operation key=VENJI0KD1XDW tag=AGWC0V7WBIXH type=del size=827275 2023-12-03T11:42:06.599 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.598+0000 7f8723d84780 1 < completed part key=_multipart_LCK58DDM5XU9.2~P2SJO6LIWRVT.0 size=502591 2023-12-03T11:42:06.601 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.600+0000 7f8723d84780 1 < completed multipart upload key=LCK58DDM5XU9 upload=P2SJO6LIWRVT tag=D1FHO5J33VGI type=write size=1551167 2023-12-03T11:42:06.602 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.601+0000 7f8723d84780 1 > prepared operation key=D3JEVEY0E29E tag=CD341Y7DC3RE type=write size=665092 2023-12-03T11:42:06.603 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.602+0000 7f8723d84780 1 < completed part key=_multipart_96RAVVSUKH0Y.2~TCRZ8NUY8LC8.0 size=1048576 2023-12-03T11:42:06.604 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.603+0000 7f8723d84780 1 < completed part key=_multipart_96RAVVSUKH0Y.2~TCRZ8NUY8LC8.1 size=834881 2023-12-03T11:42:06.606 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.605+0000 7f8723d84780 1 < completed multipart upload key=96RAVVSUKH0Y upload=TCRZ8NUY8LC8 tag=L39BYP7I03YU type=write size=2932033 2023-12-03T11:42:06.608 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.607+0000 7f8723d84780 1 > prepared part key=_multipart_OPQPIDJ2PBVU.2~JHIHVV3ZQ503.0 size=110218 2023-12-03T11:42:06.608 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.607+0000 7f8723d84780 1 > prepared multipart upload key=OPQPIDJ2PBVU upload=JHIHVV3ZQ503 tag=0NAVZI6TMNYQ type=write size=1158794 2023-12-03T11:42:06.609 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.608+0000 7f8723d84780 1 < completed delete operation key=O7VVHXLDSY57 tag=HHJZY87UALFQ type=del 2023-12-03T11:42:06.611 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.610+0000 7f8723d84780 1 > prepared part key=_multipart_J33T5S893LMV.2~4Z3D1LRX01BJ.0 size=1048576 2023-12-03T11:42:06.612 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.611+0000 7f8723d84780 1 > prepared part key=_multipart_J33T5S893LMV.2~4Z3D1LRX01BJ.1 size=1048576 2023-12-03T11:42:06.613 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.612+0000 7f8723d84780 1 > prepared part key=_multipart_J33T5S893LMV.2~4Z3D1LRX01BJ.2 size=433681 2023-12-03T11:42:06.613 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.612+0000 7f8723d84780 1 > prepared multipart upload key=J33T5S893LMV upload=4Z3D1LRX01BJ tag=SEN3ZXZJFCHA type=write size=3579409 2023-12-03T11:42:06.614 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.613+0000 7f8723d84780 1 < canceled operation key=D3JEVEY0E29E tag=2ZZ662HMX0BD type=del size=458046 2023-12-03T11:42:06.617 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.616+0000 7f8723d84780 1 > prepared part key=_multipart_4I8PWBZOLDUG.2~56RG4F3OBQVX.0 size=803839 2023-12-03T11:42:06.617 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.616+0000 7f8723d84780 1 > prepared multipart upload key=4I8PWBZOLDUG upload=56RG4F3OBQVX tag=OZTJ8EF1SVXM type=write size=1852415 2023-12-03T11:42:06.618 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.617+0000 7f8723d84780 1 < completed delete operation key=5UYL15O31IHM tag=O1JMMTP8ZXO2 type=del 2023-12-03T11:42:06.619 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.618+0000 7f8723d84780 1 > prepared operation key=TSTIBGVYUZZZ tag=V425L4KZZ7WO type=del size=485032 2023-12-03T11:42:06.620 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.619+0000 7f8723d84780 1 < completed part key=_multipart_UWS266H06VDK.2~GXB2TMPKRF3E.0 size=1048576 2023-12-03T11:42:06.621 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.620+0000 7f8723d84780 1 < completed part key=_multipart_UWS266H06VDK.2~GXB2TMPKRF3E.1 size=1048576 2023-12-03T11:42:06.622 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.621+0000 7f8723d84780 1 < completed part key=_multipart_UWS266H06VDK.2~GXB2TMPKRF3E.2 size=437524 2023-12-03T11:42:06.624 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.623+0000 7f8723d84780 1 < completed multipart upload key=UWS266H06VDK upload=GXB2TMPKRF3E tag=A2SYV8HRKMK6 type=write size=3583252 2023-12-03T11:42:06.626 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.625+0000 7f8723d84780 1 > prepared part key=_multipart_EY9ZG5KOTBWM.2~LII7BKVCFPRM.0 size=1048576 2023-12-03T11:42:06.627 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.626+0000 7f8723d84780 1 > prepared part key=_multipart_EY9ZG5KOTBWM.2~LII7BKVCFPRM.1 size=1048576 2023-12-03T11:42:06.628 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.627+0000 7f8723d84780 1 > prepared part key=_multipart_EY9ZG5KOTBWM.2~LII7BKVCFPRM.2 size=881445 2023-12-03T11:42:06.628 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.627+0000 7f8723d84780 1 > prepared multipart upload key=EY9ZG5KOTBWM upload=LII7BKVCFPRM tag=Y4HM1EP6KW9H type=write size=4027173 2023-12-03T11:42:06.629 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.628+0000 7f8723d84780 1 < completed delete operation key=10JRIKOZ16FY tag=J8XK96RPIB19 type=del 2023-12-03T11:42:06.631 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.630+0000 7f8723d84780 1 > prepared part key=_multipart_EY9ZG5KOTBWM.2~BQCU8INCFLNN.0 size=1048576 2023-12-03T11:42:06.632 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.631+0000 7f8723d84780 1 > prepared part key=_multipart_EY9ZG5KOTBWM.2~BQCU8INCFLNN.1 size=546989 2023-12-03T11:42:06.632 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.631+0000 7f8723d84780 1 > prepared multipart upload key=EY9ZG5KOTBWM upload=BQCU8INCFLNN tag=362HB44DC8K1 type=write size=2644141 2023-12-03T11:42:06.633 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.632+0000 7f8723d84780 1 < completed write operation key=OGACI7CRPMT7 tag=EOEERXSRVOMM type=write size=748736 2023-12-03T11:42:06.635 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.634+0000 7f8723d84780 1 > prepared operation key=OPQPIDJ2PBVU tag=T0KBI8VSB2JO type=del size=920571 2023-12-03T11:42:06.636 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.635+0000 7f8723d84780 1 < completed delete operation key=TSTIBGVYUZZZ tag=A7FM27Z9924A type=del 2023-12-03T11:42:06.637 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.636+0000 7f8723d84780 1 > prepared operation key=7THZZ1J5LOZK tag=FEJFS94U7V0A type=del size=3030218 2023-12-03T11:42:06.638 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.637+0000 7f8723d84780 1 < completed part key=_multipart_7VMTBKUWU59F.2~GU54ZXEE7UR9.0 size=1048576 2023-12-03T11:42:06.638 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.637+0000 7f8723d84780 1 < canceled part key=_multipart_7VMTBKUWU59F.2~GU54ZXEE7UR9.1 size=695225 2023-12-03T11:42:06.640 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.639+0000 7f8723d84780 1 < canceled multipart upload key=7VMTBKUWU59F upload=GU54ZXEE7UR9 tag=2SSZNSB3HQAW type=write size=2792377 2023-12-03T11:42:06.641 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.640+0000 7f8723d84780 1 > prepared operation key=EY9ZG5KOTBWM tag=IEQUJU4EW610 type=del size=251912 2023-12-03T11:42:06.643 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.641+0000 7f8723d84780 1 < completed write operation key=UWS266H06VDK tag=GJ5QU77JYSQ5 type=write size=540780 2023-12-03T11:42:06.644 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.643+0000 7f8723d84780 1 > prepared operation key=G36T76K8O7A1 tag=5OTLPG5TK2RT type=del size=3782217 2023-12-03T11:42:06.646 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.645+0000 7f8723d84780 1 < suggested update operation key=J33T5S893LMV tag=RP6MS2P53U1J type=del size=2680602 2023-12-03T11:42:06.648 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.647+0000 7f8723d84780 1 > prepared part key=_multipart_DMQX2DGDLU7D.2~9JP2ELPVCS6Y.0 size=1048576 2023-12-03T11:42:06.649 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.648+0000 7f8723d84780 1 > prepared part key=_multipart_DMQX2DGDLU7D.2~9JP2ELPVCS6Y.1 size=1048576 2023-12-03T11:42:06.650 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.649+0000 7f8723d84780 1 > prepared part key=_multipart_DMQX2DGDLU7D.2~9JP2ELPVCS6Y.2 size=481636 2023-12-03T11:42:06.650 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.649+0000 7f8723d84780 1 > prepared multipart upload key=DMQX2DGDLU7D upload=9JP2ELPVCS6Y tag=IMPGUAQBRFJF type=write size=3627364 2023-12-03T11:42:06.651 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.650+0000 7f8723d84780 1 < completed part key=_multipart_HIU6L0NQ8Q95.2~1Q2N82ED6GXU.0 size=65496 2023-12-03T11:42:06.653 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.652+0000 7f8723d84780 1 < completed multipart upload key=HIU6L0NQ8Q95 upload=1Q2N82ED6GXU tag=3RKDU2NC08PP type=write size=1114072 2023-12-03T11:42:06.654 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.653+0000 7f8723d84780 1 > prepared operation key=5UYL15O31IHM tag=SOQOVG95GDH2 type=del size=1416542 2023-12-03T11:42:06.655 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.654+0000 7f8723d84780 1 < completed part key=_multipart_LMVO6CVEPN3K.2~FZXQKYQ21GKQ.0 size=1048576 2023-12-03T11:42:06.656 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.655+0000 7f8723d84780 1 < completed part key=_multipart_LMVO6CVEPN3K.2~FZXQKYQ21GKQ.1 size=32112 2023-12-03T11:42:06.658 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.657+0000 7f8723d84780 1 < completed multipart upload key=LMVO6CVEPN3K upload=FZXQKYQ21GKQ tag=M45TS20L147F type=write size=2129264 2023-12-03T11:42:06.661 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.660+0000 7f8723d84780 1 > prepared part key=_multipart_7THZZ1J5LOZK.2~CADGA3AB4XC4.0 size=662292 2023-12-03T11:42:06.661 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.660+0000 7f8723d84780 1 > prepared multipart upload key=7THZZ1J5LOZK upload=CADGA3AB4XC4 tag=L5TPI739E9TW type=write size=1710868 2023-12-03T11:42:06.662 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.661+0000 7f8723d84780 1 < completed part key=_multipart_G36T76K8O7A1.2~H8K458LTMYYY.0 size=1048576 2023-12-03T11:42:06.663 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.662+0000 7f8723d84780 1 < completed part key=_multipart_G36T76K8O7A1.2~H8K458LTMYYY.1 size=1048576 2023-12-03T11:42:06.664 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.663+0000 7f8723d84780 1 < completed part key=_multipart_G36T76K8O7A1.2~H8K458LTMYYY.2 size=1018547 2023-12-03T11:42:06.666 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.665+0000 7f8723d84780 1 < completed multipart upload key=G36T76K8O7A1 upload=H8K458LTMYYY tag=N8KOWAV612J7 type=write size=4164275 2023-12-03T11:42:06.669 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.668+0000 7f8723d84780 1 > prepared part key=_multipart_VENJI0KD1XDW.2~B2NFI3EH0J40.0 size=1048576 2023-12-03T11:42:06.670 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.669+0000 7f8723d84780 1 > prepared part key=_multipart_VENJI0KD1XDW.2~B2NFI3EH0J40.1 size=435400 2023-12-03T11:42:06.670 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.669+0000 7f8723d84780 1 > prepared multipart upload key=VENJI0KD1XDW upload=B2NFI3EH0J40 tag=Y8SOERK4UF1Y type=write size=2532552 2023-12-03T11:42:06.671 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.670+0000 7f8723d84780 1 < completed delete operation key=VENJI0KD1XDW tag=AGWC0V7WBIXH type=del 2023-12-03T11:42:06.672 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.671+0000 7f8723d84780 1 > prepared operation key=OGACI7CRPMT7 tag=SS1I0KMYK1PB type=del size=1386641 2023-12-03T11:42:06.673 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.672+0000 7f8723d84780 1 < completed write operation key=D3JEVEY0E29E tag=CD341Y7DC3RE type=write size=665092 2023-12-03T11:42:06.674 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.673+0000 7f8723d84780 1 > prepared operation key=931GNEXBHH35 tag=EQJJQUXOG3GA type=del size=1500442 2023-12-03T11:42:06.675 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.674+0000 7f8723d84780 1 < completed part key=_multipart_OPQPIDJ2PBVU.2~JHIHVV3ZQ503.0 size=110218 2023-12-03T11:42:06.678 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.677+0000 7f8723d84780 1 < completed multipart upload key=OPQPIDJ2PBVU upload=JHIHVV3ZQ503 tag=0NAVZI6TMNYQ type=write size=1158794 2023-12-03T11:42:06.680 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.679+0000 7f8723d84780 1 > prepared part key=_multipart_K83BTR5BOLZE.2~523J63QU6M4Z.0 size=634149 2023-12-03T11:42:06.680 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.679+0000 7f8723d84780 1 > prepared multipart upload key=K83BTR5BOLZE upload=523J63QU6M4Z tag=O2V1QL29GMRV type=write size=1682725 2023-12-03T11:42:06.682 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.681+0000 7f8723d84780 1 < completed part key=_multipart_J33T5S893LMV.2~4Z3D1LRX01BJ.0 size=1048576 2023-12-03T11:42:06.683 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.682+0000 7f8723d84780 1 < completed part key=_multipart_J33T5S893LMV.2~4Z3D1LRX01BJ.1 size=1048576 2023-12-03T11:42:06.684 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.683+0000 7f8723d84780 1 < completed part key=_multipart_J33T5S893LMV.2~4Z3D1LRX01BJ.2 size=433681 2023-12-03T11:42:06.686 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.685+0000 7f8723d84780 1 < completed multipart upload key=J33T5S893LMV upload=4Z3D1LRX01BJ tag=SEN3ZXZJFCHA type=write size=3579409 2023-12-03T11:42:06.687 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.686+0000 7f8723d84780 1 > prepared operation key=FCA2R3HR61S2 tag=MH6B3KHP2KUP type=del size=2448790 2023-12-03T11:42:06.688 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.687+0000 7f8723d84780 1 < completed part key=_multipart_4I8PWBZOLDUG.2~56RG4F3OBQVX.0 size=803839 2023-12-03T11:42:06.690 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.689+0000 7f8723d84780 1 < completed multipart upload key=4I8PWBZOLDUG upload=56RG4F3OBQVX tag=OZTJ8EF1SVXM type=write size=1852415 2023-12-03T11:42:06.691 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.690+0000 7f8723d84780 1 > prepared operation key=K83BTR5BOLZE tag=V2AESXLLZAHO type=del size=1002047 2023-12-03T11:42:06.692 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.691+0000 7f8723d84780 1 < completed delete operation key=TSTIBGVYUZZZ tag=V425L4KZZ7WO type=del 2023-12-03T11:42:06.694 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.693+0000 7f8723d84780 1 > prepared part key=_multipart_TSTIBGVYUZZZ.2~FVFLX7DQ537J.0 size=1048576 2023-12-03T11:42:06.695 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.694+0000 7f8723d84780 1 > prepared part key=_multipart_TSTIBGVYUZZZ.2~FVFLX7DQ537J.1 size=1048576 2023-12-03T11:42:06.696 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.695+0000 7f8723d84780 1 > prepared part key=_multipart_TSTIBGVYUZZZ.2~FVFLX7DQ537J.2 size=612656 2023-12-03T11:42:06.696 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.695+0000 7f8723d84780 1 > prepared multipart upload key=TSTIBGVYUZZZ upload=FVFLX7DQ537J tag=FJ9D0QQAWTML type=write size=3758384 2023-12-03T11:42:06.697 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.696+0000 7f8723d84780 1 < completed part key=_multipart_EY9ZG5KOTBWM.2~LII7BKVCFPRM.0 size=1048576 2023-12-03T11:42:06.699 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.697+0000 7f8723d84780 1 < completed part key=_multipart_EY9ZG5KOTBWM.2~LII7BKVCFPRM.1 size=1048576 2023-12-03T11:42:06.699 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.698+0000 7f8723d84780 1 < completed part key=_multipart_EY9ZG5KOTBWM.2~LII7BKVCFPRM.2 size=881445 2023-12-03T11:42:06.702 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.701+0000 7f8723d84780 1 < completed multipart upload key=EY9ZG5KOTBWM upload=LII7BKVCFPRM tag=Y4HM1EP6KW9H type=write size=4027173 2023-12-03T11:42:06.704 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.703+0000 7f8723d84780 1 > prepared part key=_multipart_FCA2R3HR61S2.2~W9LYS21PMSPS.0 size=1048576 2023-12-03T11:42:06.705 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.704+0000 7f8723d84780 1 > prepared part key=_multipart_FCA2R3HR61S2.2~W9LYS21PMSPS.1 size=694791 2023-12-03T11:42:06.705 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.704+0000 7f8723d84780 1 > prepared multipart upload key=FCA2R3HR61S2 upload=W9LYS21PMSPS tag=TJQIO8CU1VCL type=write size=2791943 2023-12-03T11:42:06.706 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.705+0000 7f8723d84780 1 < completed part key=_multipart_EY9ZG5KOTBWM.2~BQCU8INCFLNN.0 size=1048576 2023-12-03T11:42:06.707 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.706+0000 7f8723d84780 1 < completed part key=_multipart_EY9ZG5KOTBWM.2~BQCU8INCFLNN.1 size=546989 2023-12-03T11:42:06.709 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.708+0000 7f8723d84780 1 < completed multipart upload key=EY9ZG5KOTBWM upload=BQCU8INCFLNN tag=362HB44DC8K1 type=write size=2644141 2023-12-03T11:42:06.711 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.710+0000 7f8723d84780 1 > prepared part key=_multipart_UWS266H06VDK.2~STAH26LC5RB4.0 size=1048576 2023-12-03T11:42:06.712 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.711+0000 7f8723d84780 1 > prepared part key=_multipart_UWS266H06VDK.2~STAH26LC5RB4.1 size=1048576 2023-12-03T11:42:06.713 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.712+0000 7f8723d84780 1 > prepared part key=_multipart_UWS266H06VDK.2~STAH26LC5RB4.2 size=490757 2023-12-03T11:42:06.713 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.712+0000 7f8723d84780 1 > prepared multipart upload key=UWS266H06VDK upload=STAH26LC5RB4 tag=BKOIKFO25HP7 type=write size=3636485 2023-12-03T11:42:06.714 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.713+0000 7f8723d84780 1 < completed delete operation key=OPQPIDJ2PBVU tag=T0KBI8VSB2JO type=del 2023-12-03T11:42:06.716 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.715+0000 7f8723d84780 1 > prepared part key=_multipart_LCK58DDM5XU9.2~SYPZ0YE9U9MX.0 size=152945 2023-12-03T11:42:06.716 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.715+0000 7f8723d84780 1 > prepared multipart upload key=LCK58DDM5XU9 upload=SYPZ0YE9U9MX tag=RIVI5LBBAZZW type=write size=1201521 2023-12-03T11:42:06.718 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.717+0000 7f8723d84780 1 < suggested remove operation key=7THZZ1J5LOZK tag=FEJFS94U7V0A type=del 2023-12-03T11:42:06.719 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.718+0000 7f8723d84780 1 > prepared operation key=12XG7YPYTN4U tag=YUVF45DY8OF0 type=del size=1623707 2023-12-03T11:42:06.720 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.719+0000 7f8723d84780 1 < completed delete operation key=EY9ZG5KOTBWM tag=IEQUJU4EW610 type=del 2023-12-03T11:42:06.721 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.720+0000 7f8723d84780 1 > prepared operation key=HIU6L0NQ8Q95 tag=ZMEE8ZYYC8CM type=write size=548409 2023-12-03T11:42:06.724 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.722+0000 7f8723d84780 1 < suggested remove operation key=G36T76K8O7A1 tag=5OTLPG5TK2RT type=del 2023-12-03T11:42:06.725 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.724+0000 7f8723d84780 1 > prepared operation key=931GNEXBHH35 tag=KAAVLDE12GFE type=write size=772542 2023-12-03T11:42:06.726 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.725+0000 7f8723d84780 1 < completed part key=_multipart_DMQX2DGDLU7D.2~9JP2ELPVCS6Y.0 size=1048576 2023-12-03T11:42:06.727 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.726+0000 7f8723d84780 1 < completed part key=_multipart_DMQX2DGDLU7D.2~9JP2ELPVCS6Y.1 size=1048576 2023-12-03T11:42:06.728 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.727+0000 7f8723d84780 1 < completed part key=_multipart_DMQX2DGDLU7D.2~9JP2ELPVCS6Y.2 size=481636 2023-12-03T11:42:06.730 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.729+0000 7f8723d84780 1 < completed multipart upload key=DMQX2DGDLU7D upload=9JP2ELPVCS6Y tag=IMPGUAQBRFJF type=write size=3627364 2023-12-03T11:42:06.732 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.731+0000 7f8723d84780 1 > prepared part key=_multipart_TSTIBGVYUZZZ.2~GDT6FYSL38FI.0 size=626263 2023-12-03T11:42:06.732 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.731+0000 7f8723d84780 1 > prepared multipart upload key=TSTIBGVYUZZZ upload=GDT6FYSL38FI tag=81GLOTZCC7MH type=write size=1674839 2023-12-03T11:42:06.735 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.734+0000 7f8723d84780 1 < suggested update operation key=5UYL15O31IHM tag=SOQOVG95GDH2 type=del size=1416542 2023-12-03T11:42:06.736 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.735+0000 7f8723d84780 1 > prepared operation key=UWS266H06VDK tag=9LKOK1AMJUBU type=del size=2543881 2023-12-03T11:42:06.737 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.736+0000 7f8723d84780 1 < completed part key=_multipart_7THZZ1J5LOZK.2~CADGA3AB4XC4.0 size=662292 2023-12-03T11:42:06.739 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.738+0000 7f8723d84780 1 < completed multipart upload key=7THZZ1J5LOZK upload=CADGA3AB4XC4 tag=L5TPI739E9TW type=write size=1710868 2023-12-03T11:42:06.741 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.740+0000 7f8723d84780 1 > prepared part key=_multipart_G36T76K8O7A1.2~IC51PMAW3J85.0 size=1048576 2023-12-03T11:42:06.742 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.741+0000 7f8723d84780 1 > prepared part key=_multipart_G36T76K8O7A1.2~IC51PMAW3J85.1 size=33036 2023-12-03T11:42:06.742 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.741+0000 7f8723d84780 1 > prepared multipart upload key=G36T76K8O7A1 upload=IC51PMAW3J85 tag=15TF78NWDF7K type=write size=2130188 2023-12-03T11:42:06.743 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.742+0000 7f8723d84780 1 < completed part key=_multipart_VENJI0KD1XDW.2~B2NFI3EH0J40.0 size=1048576 2023-12-03T11:42:06.744 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.743+0000 7f8723d84780 1 < completed part key=_multipart_VENJI0KD1XDW.2~B2NFI3EH0J40.1 size=435400 2023-12-03T11:42:06.746 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.745+0000 7f8723d84780 1 < completed multipart upload key=VENJI0KD1XDW upload=B2NFI3EH0J40 tag=Y8SOERK4UF1Y type=write size=2532552 2023-12-03T11:42:06.748 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.747+0000 7f8723d84780 1 > prepared operation key=CKABTI1EOAWB tag=DOH0AN5KHRC8 type=del size=448334 2023-12-03T11:42:06.749 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.748+0000 7f8723d84780 1 < canceled operation key=OGACI7CRPMT7 tag=SS1I0KMYK1PB type=del size=1386641 2023-12-03T11:42:06.750 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.749+0000 7f8723d84780 1 > prepared operation key=J33T5S893LMV tag=BDMCS1L3LK0U type=write size=123450 2023-12-03T11:42:06.751 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.750+0000 7f8723d84780 1 < completed delete operation key=931GNEXBHH35 tag=EQJJQUXOG3GA type=del 2023-12-03T11:42:06.754 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.753+0000 7f8723d84780 1 > prepared part key=_multipart_K83BTR5BOLZE.2~2APK6JWYI1XF.0 size=1048576 2023-12-03T11:42:06.755 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.753+0000 7f8723d84780 1 > prepared part key=_multipart_K83BTR5BOLZE.2~2APK6JWYI1XF.1 size=906113 2023-12-03T11:42:06.755 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.754+0000 7f8723d84780 1 > prepared multipart upload key=K83BTR5BOLZE upload=2APK6JWYI1XF tag=KYC5J5ZLP3SX type=write size=3003265 2023-12-03T11:42:06.756 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.755+0000 7f8723d84780 1 < completed part key=_multipart_K83BTR5BOLZE.2~523J63QU6M4Z.0 size=634149 2023-12-03T11:42:06.758 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.757+0000 7f8723d84780 1 < completed multipart upload key=K83BTR5BOLZE upload=523J63QU6M4Z tag=O2V1QL29GMRV type=write size=1682725 2023-12-03T11:42:06.759 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.758+0000 7f8723d84780 1 > prepared operation key=Y6S7QI60GCLE tag=NPZIQLJSGRI1 type=del size=1889230 2023-12-03T11:42:06.761 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.760+0000 7f8723d84780 1 < completed delete operation key=FCA2R3HR61S2 tag=MH6B3KHP2KUP type=del 2023-12-03T11:42:06.762 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.761+0000 7f8723d84780 1 > prepared operation key=M4VKPN6INFNZ tag=KUFHUIRAJVXP type=del size=1772781 2023-12-03T11:42:06.763 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.762+0000 7f8723d84780 1 < completed delete operation key=K83BTR5BOLZE tag=V2AESXLLZAHO type=del 2023-12-03T11:42:06.766 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.765+0000 7f8723d84780 1 > prepared operation key=12XG7YPYTN4U tag=GPJO116HW51K type=del size=2101263 2023-12-03T11:42:06.767 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.766+0000 7f8723d84780 1 < completed part key=_multipart_TSTIBGVYUZZZ.2~FVFLX7DQ537J.0 size=1048576 2023-12-03T11:42:06.768 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.767+0000 7f8723d84780 1 < completed part key=_multipart_TSTIBGVYUZZZ.2~FVFLX7DQ537J.1 size=1048576 2023-12-03T11:42:06.769 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.768+0000 7f8723d84780 1 < completed part key=_multipart_TSTIBGVYUZZZ.2~FVFLX7DQ537J.2 size=612656 2023-12-03T11:42:06.771 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.770+0000 7f8723d84780 1 < completed multipart upload key=TSTIBGVYUZZZ upload=FVFLX7DQ537J tag=FJ9D0QQAWTML type=write size=3758384 2023-12-03T11:42:06.772 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.771+0000 7f8723d84780 1 > prepared operation key=8NONX2I08YMJ tag=AJGFMK9AWJAK type=write size=226845 2023-12-03T11:42:06.773 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.772+0000 7f8723d84780 1 < completed part key=_multipart_FCA2R3HR61S2.2~W9LYS21PMSPS.0 size=1048576 2023-12-03T11:42:06.774 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.773+0000 7f8723d84780 1 < completed part key=_multipart_FCA2R3HR61S2.2~W9LYS21PMSPS.1 size=694791 2023-12-03T11:42:06.776 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.775+0000 7f8723d84780 1 < completed multipart upload key=FCA2R3HR61S2 upload=W9LYS21PMSPS tag=TJQIO8CU1VCL type=write size=2791943 2023-12-03T11:42:06.778 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.778+0000 7f8723d84780 1 > prepared part key=_multipart_K83BTR5BOLZE.2~K20MHKK109BG.0 size=710799 2023-12-03T11:42:06.779 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.778+0000 7f8723d84780 1 > prepared multipart upload key=K83BTR5BOLZE upload=K20MHKK109BG tag=VOU62N1YUFCH type=write size=1759375 2023-12-03T11:42:06.780 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.779+0000 7f8723d84780 1 < completed part key=_multipart_UWS266H06VDK.2~STAH26LC5RB4.0 size=1048576 2023-12-03T11:42:06.781 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.780+0000 7f8723d84780 1 < completed part key=_multipart_UWS266H06VDK.2~STAH26LC5RB4.1 size=1048576 2023-12-03T11:42:06.782 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.781+0000 7f8723d84780 1 < completed part key=_multipart_UWS266H06VDK.2~STAH26LC5RB4.2 size=490757 2023-12-03T11:42:06.784 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.783+0000 7f8723d84780 1 < completed multipart upload key=UWS266H06VDK upload=STAH26LC5RB4 tag=BKOIKFO25HP7 type=write size=3636485 2023-12-03T11:42:06.785 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.784+0000 7f8723d84780 1 > prepared operation key=OGACI7CRPMT7 tag=9HRO7994I4EU type=write size=216555 2023-12-03T11:42:06.786 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.784+0000 7f8723d84780 1 < canceled part key=_multipart_LCK58DDM5XU9.2~SYPZ0YE9U9MX.0 size=152945 2023-12-03T11:42:06.788 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.787+0000 7f8723d84780 1 < canceled multipart upload key=LCK58DDM5XU9 upload=SYPZ0YE9U9MX tag=RIVI5LBBAZZW type=write size=1201521 2023-12-03T11:42:06.789 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.788+0000 7f8723d84780 1 > prepared operation key=931GNEXBHH35 tag=PAG3D6X8YU7B type=del size=3203063 2023-12-03T11:42:06.791 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.790+0000 7f8723d84780 1 < completed delete operation key=12XG7YPYTN4U tag=YUVF45DY8OF0 type=del 2023-12-03T11:42:06.793 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.792+0000 7f8723d84780 1 > prepared part key=_multipart_OPQPIDJ2PBVU.2~LEITWMB70RQT.0 size=1048576 2023-12-03T11:42:06.794 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.793+0000 7f8723d84780 1 > prepared part key=_multipart_OPQPIDJ2PBVU.2~LEITWMB70RQT.1 size=832672 2023-12-03T11:42:06.794 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.793+0000 7f8723d84780 1 > prepared multipart upload key=OPQPIDJ2PBVU upload=LEITWMB70RQT tag=IQR8ZHWCMEJZ type=write size=2929824 2023-12-03T11:42:06.796 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.795+0000 7f8723d84780 1 < suggested update operation key=HIU6L0NQ8Q95 tag=ZMEE8ZYYC8CM type=write size=548409 2023-12-03T11:42:06.799 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.798+0000 7f8723d84780 1 > prepared part key=_multipart_HIU6L0NQ8Q95.2~UGO8EVFOF43T.0 size=320874 2023-12-03T11:42:06.799 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.798+0000 7f8723d84780 1 > prepared multipart upload key=HIU6L0NQ8Q95 upload=UGO8EVFOF43T tag=LT7FYIKFT1Y6 type=write size=1369450 2023-12-03T11:42:06.800 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.799+0000 7f8723d84780 1 < completed write operation key=931GNEXBHH35 tag=KAAVLDE12GFE type=write size=772542 2023-12-03T11:42:06.801 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.800+0000 7f8723d84780 1 > prepared operation key=EITMJKL0LCYC tag=LTJIV16DQ0MA type=del size=1996889 2023-12-03T11:42:06.802 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.801+0000 7f8723d84780 1 < completed part key=_multipart_TSTIBGVYUZZZ.2~GDT6FYSL38FI.0 size=626263 2023-12-03T11:42:06.805 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.804+0000 7f8723d84780 1 < completed multipart upload key=TSTIBGVYUZZZ upload=GDT6FYSL38FI tag=81GLOTZCC7MH type=write size=1674839 2023-12-03T11:42:06.806 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.805+0000 7f8723d84780 1 > prepared operation key=KS5J7E7KE2IJ tag=GIMH4ESGNNUC type=write size=741175 2023-12-03T11:42:06.809 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.807+0000 7f8723d84780 1 < suggested update operation key=UWS266H06VDK tag=9LKOK1AMJUBU type=del size=2543881 2023-12-03T11:42:06.810 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.809+0000 7f8723d84780 1 > prepared operation key=EITMJKL0LCYC tag=RCLEJM5458JV type=del size=3330994 2023-12-03T11:42:06.811 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.810+0000 7f8723d84780 1 < completed part key=_multipart_G36T76K8O7A1.2~IC51PMAW3J85.0 size=1048576 2023-12-03T11:42:06.811 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.810+0000 7f8723d84780 1 < canceled part key=_multipart_G36T76K8O7A1.2~IC51PMAW3J85.1 size=33036 2023-12-03T11:42:06.813 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.812+0000 7f8723d84780 1 < canceled multipart upload key=G36T76K8O7A1 upload=IC51PMAW3J85 tag=15TF78NWDF7K type=write size=2130188 2023-12-03T11:42:06.815 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.814+0000 7f8723d84780 1 > prepared operation key=10JRIKOZ16FY tag=GX2K0MGG1AXF type=del size=3586737 2023-12-03T11:42:06.816 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.815+0000 7f8723d84780 1 < completed delete operation key=CKABTI1EOAWB tag=DOH0AN5KHRC8 type=del 2023-12-03T11:42:06.817 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.816+0000 7f8723d84780 1 > prepared operation key=KS5J7E7KE2IJ tag=VYGPJL5UZE5K type=del size=2538622 2023-12-03T11:42:06.819 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.818+0000 7f8723d84780 1 < completed write operation key=J33T5S893LMV tag=BDMCS1L3LK0U type=write size=123450 2023-12-03T11:42:06.820 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.819+0000 7f8723d84780 1 > prepared operation key=96RAVVSUKH0Y tag=BEBUJ2G121BD type=del size=3480366 2023-12-03T11:42:06.821 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.820+0000 7f8723d84780 1 < completed part key=_multipart_K83BTR5BOLZE.2~2APK6JWYI1XF.0 size=1048576 2023-12-03T11:42:06.822 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.821+0000 7f8723d84780 1 < completed part key=_multipart_K83BTR5BOLZE.2~2APK6JWYI1XF.1 size=906113 2023-12-03T11:42:06.824 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.823+0000 7f8723d84780 1 < completed multipart upload key=K83BTR5BOLZE upload=2APK6JWYI1XF tag=KYC5J5ZLP3SX type=write size=3003265 2023-12-03T11:42:06.825 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.824+0000 7f8723d84780 1 > prepared operation key=5UYL15O31IHM tag=7T50MLP2ZEUE type=del size=107171 2023-12-03T11:42:06.826 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.825+0000 7f8723d84780 1 < completed delete operation key=Y6S7QI60GCLE tag=NPZIQLJSGRI1 type=del 2023-12-03T11:42:06.828 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.827+0000 7f8723d84780 1 > prepared part key=_multipart_J33T5S893LMV.2~S0K0TH1HB8MW.0 size=1048576 2023-12-03T11:42:06.829 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.828+0000 7f8723d84780 1 > prepared part key=_multipart_J33T5S893LMV.2~S0K0TH1HB8MW.1 size=1048576 2023-12-03T11:42:06.830 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.829+0000 7f8723d84780 1 > prepared part key=_multipart_J33T5S893LMV.2~S0K0TH1HB8MW.2 size=415756 2023-12-03T11:42:06.830 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.829+0000 7f8723d84780 1 > prepared multipart upload key=J33T5S893LMV upload=S0K0TH1HB8MW tag=RLFKC82W2R0D type=write size=3561484 2023-12-03T11:42:06.831 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.831+0000 7f8723d84780 1 < completed delete operation key=M4VKPN6INFNZ tag=KUFHUIRAJVXP type=del 2023-12-03T11:42:06.833 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.832+0000 7f8723d84780 1 > prepared operation key=12XG7YPYTN4U tag=SA7Q8CSVYDMS type=del size=978498 2023-12-03T11:42:06.835 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.834+0000 7f8723d84780 1 < suggested remove operation key=12XG7YPYTN4U tag=GPJO116HW51K type=del 2023-12-03T11:42:06.837 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.836+0000 7f8723d84780 1 > prepared part key=_multipart_D3JEVEY0E29E.2~B5VB1GURE19G.0 size=1048576 2023-12-03T11:42:06.838 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.837+0000 7f8723d84780 1 > prepared part key=_multipart_D3JEVEY0E29E.2~B5VB1GURE19G.1 size=415565 2023-12-03T11:42:06.838 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.837+0000 7f8723d84780 1 > prepared multipart upload key=D3JEVEY0E29E upload=B5VB1GURE19G tag=CFYFR1KY2KXC type=write size=2512717 2023-12-03T11:42:06.839 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.838+0000 7f8723d84780 1 < canceled operation key=8NONX2I08YMJ tag=AJGFMK9AWJAK type=write size=226845 2023-12-03T11:42:06.840 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.839+0000 7f8723d84780 1 > prepared operation key=UWS266H06VDK tag=YE7YNIYB2BYW type=del size=2211450 2023-12-03T11:42:06.842 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.841+0000 7f8723d84780 1 < completed part key=_multipart_K83BTR5BOLZE.2~K20MHKK109BG.0 size=710799 2023-12-03T11:42:06.844 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.843+0000 7f8723d84780 1 < completed multipart upload key=K83BTR5BOLZE upload=K20MHKK109BG tag=VOU62N1YUFCH type=write size=1759375 2023-12-03T11:42:06.845 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.844+0000 7f8723d84780 1 > prepared operation key=OGACI7CRPMT7 tag=1ZGRULV3BGYX type=write size=454324 2023-12-03T11:42:06.846 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.845+0000 7f8723d84780 1 < completed write operation key=OGACI7CRPMT7 tag=9HRO7994I4EU type=write size=216555 2023-12-03T11:42:06.848 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.847+0000 7f8723d84780 1 > prepared operation key=7VMTBKUWU59F tag=RXKAZS4GEUFC type=write size=793023 2023-12-03T11:42:06.849 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.848+0000 7f8723d84780 1 < completed delete operation key=931GNEXBHH35 tag=PAG3D6X8YU7B type=del 2023-12-03T11:42:06.850 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.849+0000 7f8723d84780 1 > prepared operation key=10JRIKOZ16FY tag=C3C8WBZRAG3G type=del size=561035 2023-12-03T11:42:06.852 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.851+0000 7f8723d84780 1 < completed part key=_multipart_OPQPIDJ2PBVU.2~LEITWMB70RQT.0 size=1048576 2023-12-03T11:42:06.853 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.852+0000 7f8723d84780 1 < completed part key=_multipart_OPQPIDJ2PBVU.2~LEITWMB70RQT.1 size=832672 2023-12-03T11:42:06.855 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.854+0000 7f8723d84780 1 < completed multipart upload key=OPQPIDJ2PBVU upload=LEITWMB70RQT tag=IQR8ZHWCMEJZ type=write size=2929824 2023-12-03T11:42:06.857 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.856+0000 7f8723d84780 1 > prepared part key=_multipart_10JRIKOZ16FY.2~EW61QAAP99IW.0 size=1048576 2023-12-03T11:42:06.858 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.857+0000 7f8723d84780 1 > prepared part key=_multipart_10JRIKOZ16FY.2~EW61QAAP99IW.1 size=599349 2023-12-03T11:42:06.858 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.857+0000 7f8723d84780 1 > prepared multipart upload key=10JRIKOZ16FY upload=EW61QAAP99IW tag=6SKMDBQVOW7S type=write size=2696501 2023-12-03T11:42:06.858 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.857+0000 7f8723d84780 1 < canceled part key=_multipart_HIU6L0NQ8Q95.2~UGO8EVFOF43T.0 size=320874 2023-12-03T11:42:06.860 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.859+0000 7f8723d84780 1 < canceled multipart upload key=HIU6L0NQ8Q95 upload=UGO8EVFOF43T tag=LT7FYIKFT1Y6 type=write size=1369450 2023-12-03T11:42:06.861 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.860+0000 7f8723d84780 1 > prepared operation key=LMVO6CVEPN3K tag=BMLN8RRTPYTI type=del size=343641 2023-12-03T11:42:06.862 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.861+0000 7f8723d84780 1 < completed delete operation key=EITMJKL0LCYC tag=LTJIV16DQ0MA type=del 2023-12-03T11:42:06.865 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.864+0000 7f8723d84780 1 > prepared part key=_multipart_VENJI0KD1XDW.2~2RXB7ZQV48RY.0 size=287071 2023-12-03T11:42:06.865 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.864+0000 7f8723d84780 1 > prepared multipart upload key=VENJI0KD1XDW upload=2RXB7ZQV48RY tag=GH05FWPB8JH4 type=write size=1335647 2023-12-03T11:42:06.866 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.865+0000 7f8723d84780 1 < completed write operation key=KS5J7E7KE2IJ tag=GIMH4ESGNNUC type=write size=741175 2023-12-03T11:42:06.874 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.873+0000 7f8723d84780 1 > prepared operation key=EITMJKL0LCYC tag=7DW77XM8AV15 type=write size=576337 2023-12-03T11:42:06.875 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.874+0000 7f8723d84780 1 < completed delete operation key=EITMJKL0LCYC tag=RCLEJM5458JV type=del 2023-12-03T11:42:06.876 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.875+0000 7f8723d84780 1 > prepared operation key=KS5J7E7KE2IJ tag=DBRJRJGIYRWG type=del size=1071605 2023-12-03T11:42:06.877 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.876+0000 7f8723d84780 1 < completed delete operation key=10JRIKOZ16FY tag=GX2K0MGG1AXF type=del 2023-12-03T11:42:06.879 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.878+0000 7f8723d84780 1 > prepared operation key=OPQPIDJ2PBVU tag=33GCHWYJ1L0F type=del size=864656 2023-12-03T11:42:06.880 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.879+0000 7f8723d84780 1 < completed delete operation key=KS5J7E7KE2IJ tag=VYGPJL5UZE5K type=del 2023-12-03T11:42:06.882 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.881+0000 7f8723d84780 1 > prepared part key=_multipart_OPQPIDJ2PBVU.2~N8HBWFQHHJQW.0 size=1048576 2023-12-03T11:42:06.883 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.882+0000 7f8723d84780 1 > prepared part key=_multipart_OPQPIDJ2PBVU.2~N8HBWFQHHJQW.1 size=1048576 2023-12-03T11:42:06.884 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.883+0000 7f8723d84780 1 > prepared part key=_multipart_OPQPIDJ2PBVU.2~N8HBWFQHHJQW.2 size=1025406 2023-12-03T11:42:06.884 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.883+0000 7f8723d84780 1 > prepared multipart upload key=OPQPIDJ2PBVU upload=N8HBWFQHHJQW tag=6Y3UWR2S9UGY type=write size=4171134 2023-12-03T11:42:06.885 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.884+0000 7f8723d84780 1 < completed delete operation key=96RAVVSUKH0Y tag=BEBUJ2G121BD type=del 2023-12-03T11:42:06.887 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.885+0000 7f8723d84780 1 > prepared operation key=8NONX2I08YMJ tag=KJ6RNYLKZMXF type=write size=351848 2023-12-03T11:42:06.889 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.888+0000 7f8723d84780 1 < suggested update operation key=5UYL15O31IHM tag=7T50MLP2ZEUE type=del size=107171 2023-12-03T11:42:06.890 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.889+0000 7f8723d84780 1 > prepared operation key=7VMTBKUWU59F tag=U698WZ2ZONHR type=del size=2776940 2023-12-03T11:42:06.891 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.890+0000 7f8723d84780 1 < completed part key=_multipart_J33T5S893LMV.2~S0K0TH1HB8MW.0 size=1048576 2023-12-03T11:42:06.892 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.891+0000 7f8723d84780 1 < completed part key=_multipart_J33T5S893LMV.2~S0K0TH1HB8MW.1 size=1048576 2023-12-03T11:42:06.893 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.892+0000 7f8723d84780 1 < completed part key=_multipart_J33T5S893LMV.2~S0K0TH1HB8MW.2 size=415756 2023-12-03T11:42:06.895 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.894+0000 7f8723d84780 1 < completed multipart upload key=J33T5S893LMV upload=S0K0TH1HB8MW tag=RLFKC82W2R0D type=write size=3561484 2023-12-03T11:42:06.896 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.895+0000 7f8723d84780 1 > prepared operation key=G36T76K8O7A1 tag=TLX832C762PV type=del size=1639111 2023-12-03T11:42:06.897 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.896+0000 7f8723d84780 -1 < no bi entry to suggest for operation key=12XG7YPYTN4U tag=SA7Q8CSVYDMS type=del size=978498: (2) No such file or directory 2023-12-03T11:42:06.899 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.898+0000 7f8723d84780 1 > prepared part key=_multipart_7THZZ1J5LOZK.2~ZHCJ0AUQHD7J.0 size=674886 2023-12-03T11:42:06.899 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.898+0000 7f8723d84780 1 > prepared multipart upload key=7THZZ1J5LOZK upload=ZHCJ0AUQHD7J tag=2ULBCJQES43T type=write size=1723462 2023-12-03T11:42:06.900 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.899+0000 7f8723d84780 1 < completed part key=_multipart_D3JEVEY0E29E.2~B5VB1GURE19G.0 size=1048576 2023-12-03T11:42:06.901 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.900+0000 7f8723d84780 1 < completed part key=_multipart_D3JEVEY0E29E.2~B5VB1GURE19G.1 size=415565 2023-12-03T11:42:06.903 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.902+0000 7f8723d84780 1 < completed multipart upload key=D3JEVEY0E29E upload=B5VB1GURE19G tag=CFYFR1KY2KXC type=write size=2512717 2023-12-03T11:42:06.904 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.903+0000 7f8723d84780 1 > prepared operation key=J33T5S893LMV tag=VLIKVEMK9SYN type=del size=1064002 2023-12-03T11:42:06.906 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.905+0000 7f8723d84780 1 < suggested remove operation key=UWS266H06VDK tag=YE7YNIYB2BYW type=del 2023-12-03T11:42:06.908 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.907+0000 7f8723d84780 1 > prepared operation key=DMQX2DGDLU7D tag=HL2BR2CH0JJT type=del size=2871380 2023-12-03T11:42:06.909 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.908+0000 7f8723d84780 1 < completed write operation key=OGACI7CRPMT7 tag=1ZGRULV3BGYX type=write size=454324 2023-12-03T11:42:06.911 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.910+0000 7f8723d84780 1 > prepared part key=_multipart_TSTIBGVYUZZZ.2~CWVVEIR0RFKV.0 size=1048576 2023-12-03T11:42:06.912 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.911+0000 7f8723d84780 1 > prepared part key=_multipart_TSTIBGVYUZZZ.2~CWVVEIR0RFKV.1 size=1048576 2023-12-03T11:42:06.913 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.912+0000 7f8723d84780 1 > prepared part key=_multipart_TSTIBGVYUZZZ.2~CWVVEIR0RFKV.2 size=689279 2023-12-03T11:42:06.913 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.912+0000 7f8723d84780 1 > prepared multipart upload key=TSTIBGVYUZZZ upload=CWVVEIR0RFKV tag=3ZIWP2LMTR4Y type=write size=3835007 2023-12-03T11:42:06.915 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.914+0000 7f8723d84780 1 < suggested remove operation key=7VMTBKUWU59F tag=RXKAZS4GEUFC type=write 2023-12-03T11:42:06.917 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.916+0000 7f8723d84780 1 > prepared part key=_multipart_7THZZ1J5LOZK.2~IO7MRWSYRALM.0 size=1048576 2023-12-03T11:42:06.918 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.917+0000 7f8723d84780 1 > prepared part key=_multipart_7THZZ1J5LOZK.2~IO7MRWSYRALM.1 size=1048576 2023-12-03T11:42:06.919 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.918+0000 7f8723d84780 1 > prepared part key=_multipart_7THZZ1J5LOZK.2~IO7MRWSYRALM.2 size=272471 2023-12-03T11:42:06.919 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.918+0000 7f8723d84780 1 > prepared multipart upload key=7THZZ1J5LOZK upload=IO7MRWSYRALM tag=RQPTVMTMS6SJ type=write size=3418199 2023-12-03T11:42:06.920 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.919+0000 7f8723d84780 1 < completed delete operation key=10JRIKOZ16FY tag=C3C8WBZRAG3G type=del 2023-12-03T11:42:06.922 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.921+0000 7f8723d84780 1 > prepared operation key=LCK58DDM5XU9 tag=RJ6RBDRN7IUM type=del size=288050 2023-12-03T11:42:06.923 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.922+0000 7f8723d84780 1 < completed part key=_multipart_10JRIKOZ16FY.2~EW61QAAP99IW.0 size=1048576 2023-12-03T11:42:06.924 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.923+0000 7f8723d84780 1 < completed part key=_multipart_10JRIKOZ16FY.2~EW61QAAP99IW.1 size=599349 2023-12-03T11:42:06.926 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.925+0000 7f8723d84780 1 < completed multipart upload key=10JRIKOZ16FY upload=EW61QAAP99IW tag=6SKMDBQVOW7S type=write size=2696501 2023-12-03T11:42:06.927 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.926+0000 7f8723d84780 1 > prepared operation key=5UYL15O31IHM tag=F26B1U0CHPNA type=del size=2537825 2023-12-03T11:42:06.929 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.928+0000 7f8723d84780 1 < completed delete operation key=LMVO6CVEPN3K tag=BMLN8RRTPYTI type=del 2023-12-03T11:42:06.932 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.931+0000 7f8723d84780 1 > prepared part key=_multipart_LCK58DDM5XU9.2~G64XXHIN7P6O.0 size=1048576 2023-12-03T11:42:06.933 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.932+0000 7f8723d84780 1 > prepared part key=_multipart_LCK58DDM5XU9.2~G64XXHIN7P6O.1 size=1048576 2023-12-03T11:42:06.934 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.933+0000 7f8723d84780 1 > prepared part key=_multipart_LCK58DDM5XU9.2~G64XXHIN7P6O.2 size=606008 2023-12-03T11:42:06.934 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.933+0000 7f8723d84780 1 > prepared multipart upload key=LCK58DDM5XU9 upload=G64XXHIN7P6O tag=DIAG8JGBNYFY type=write size=3751736 2023-12-03T11:42:06.936 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.935+0000 7f8723d84780 1 < completed part key=_multipart_VENJI0KD1XDW.2~2RXB7ZQV48RY.0 size=287071 2023-12-03T11:42:06.939 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.938+0000 7f8723d84780 1 < completed multipart upload key=VENJI0KD1XDW upload=2RXB7ZQV48RY tag=GH05FWPB8JH4 type=write size=1335647 2023-12-03T11:42:06.941 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.940+0000 7f8723d84780 1 > prepared part key=_multipart_OGACI7CRPMT7.2~HVQLX5EFYHE8.0 size=1048576 2023-12-03T11:42:06.942 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.941+0000 7f8723d84780 1 > prepared part key=_multipart_OGACI7CRPMT7.2~HVQLX5EFYHE8.1 size=343824 2023-12-03T11:42:06.942 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.941+0000 7f8723d84780 1 > prepared multipart upload key=OGACI7CRPMT7 upload=HVQLX5EFYHE8 tag=6HTNGF9E6QUE type=write size=2440976 2023-12-03T11:42:06.944 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.943+0000 7f8723d84780 1 < suggested update operation key=EITMJKL0LCYC tag=7DW77XM8AV15 type=write size=576337 2023-12-03T11:42:06.945 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.944+0000 7f8723d84780 1 > prepared operation key=DMQX2DGDLU7D tag=E1OAV4N4KKWU type=del size=3342747 2023-12-03T11:42:06.946 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.945+0000 7f8723d84780 1 < completed delete operation key=KS5J7E7KE2IJ tag=DBRJRJGIYRWG type=del 2023-12-03T11:42:06.947 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.946+0000 7f8723d84780 1 > prepared operation key=W2704YS8KYQB tag=3T0W9073BK1M type=del size=454902 2023-12-03T11:42:06.949 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.948+0000 7f8723d84780 1 < suggested remove operation key=OPQPIDJ2PBVU tag=33GCHWYJ1L0F type=del 2023-12-03T11:42:06.950 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.949+0000 7f8723d84780 1 > prepared operation key=931GNEXBHH35 tag=5P4QU5PMIWV7 type=del size=1461789 2023-12-03T11:42:06.951 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.950+0000 7f8723d84780 1 < canceled part key=_multipart_OPQPIDJ2PBVU.2~N8HBWFQHHJQW.0 size=1048576 2023-12-03T11:42:06.952 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.951+0000 7f8723d84780 1 < completed part key=_multipart_OPQPIDJ2PBVU.2~N8HBWFQHHJQW.1 size=1048576 2023-12-03T11:42:06.953 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.952+0000 7f8723d84780 1 < completed part key=_multipart_OPQPIDJ2PBVU.2~N8HBWFQHHJQW.2 size=1025406 2023-12-03T11:42:06.955 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.954+0000 7f8723d84780 1 < canceled multipart upload key=OPQPIDJ2PBVU upload=N8HBWFQHHJQW tag=6Y3UWR2S9UGY type=write size=4171134 2023-12-03T11:42:06.956 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.955+0000 7f8723d84780 1 > prepared operation key=K83BTR5BOLZE tag=Y4KB0K5K54M1 type=write size=976074 2023-12-03T11:42:06.957 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.956+0000 7f8723d84780 1 < completed write operation key=8NONX2I08YMJ tag=KJ6RNYLKZMXF type=write size=351848 2023-12-03T11:42:06.959 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.958+0000 7f8723d84780 1 > prepared part key=_multipart_W2704YS8KYQB.2~V707NBBTUBZR.0 size=990001 2023-12-03T11:42:06.959 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.958+0000 7f8723d84780 1 > prepared multipart upload key=W2704YS8KYQB upload=V707NBBTUBZR tag=6I4GUNPOGCEG type=write size=2038577 2023-12-03T11:42:06.960 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.959+0000 7f8723d84780 -1 < failed to complete operation key=7VMTBKUWU59F tag=U698WZ2ZONHR type=del size=2776940: (22) Invalid argument 2023-12-03T11:42:06.961 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.960+0000 7f8723d84780 1 > prepared operation key=OGACI7CRPMT7 tag=6YVX801SA5I8 type=write size=894732 2023-12-03T11:42:06.963 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.962+0000 7f8723d84780 1 < suggested remove operation key=G36T76K8O7A1 tag=TLX832C762PV type=del 2023-12-03T11:42:06.965 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.964+0000 7f8723d84780 1 > prepared part key=_multipart_J33T5S893LMV.2~QDIZMYDVDP73.0 size=1048576 2023-12-03T11:42:06.966 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.965+0000 7f8723d84780 1 > prepared part key=_multipart_J33T5S893LMV.2~QDIZMYDVDP73.1 size=41310 2023-12-03T11:42:06.966 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.965+0000 7f8723d84780 1 > prepared multipart upload key=J33T5S893LMV upload=QDIZMYDVDP73 tag=VBXI8B2EJ5WC type=write size=2138462 2023-12-03T11:42:06.967 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.966+0000 7f8723d84780 1 < completed part key=_multipart_7THZZ1J5LOZK.2~ZHCJ0AUQHD7J.0 size=674886 2023-12-03T11:42:06.969 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.968+0000 7f8723d84780 1 < completed multipart upload key=7THZZ1J5LOZK upload=ZHCJ0AUQHD7J tag=2ULBCJQES43T type=write size=1723462 2023-12-03T11:42:06.971 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.970+0000 7f8723d84780 1 > prepared operation key=EY9ZG5KOTBWM tag=ZAQW23NN6LAZ type=del size=744590 2023-12-03T11:42:06.972 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.971+0000 7f8723d84780 1 < completed delete operation key=J33T5S893LMV tag=VLIKVEMK9SYN type=del 2023-12-03T11:42:06.973 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.972+0000 7f8723d84780 1 > prepared operation key=931GNEXBHH35 tag=SGP8N3KVJHBD type=del size=733139 2023-12-03T11:42:06.974 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.973+0000 7f8723d84780 1 < canceled operation key=DMQX2DGDLU7D tag=HL2BR2CH0JJT type=del size=2871380 2023-12-03T11:42:06.975 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.974+0000 7f8723d84780 1 > prepared operation key=7THZZ1J5LOZK tag=SI32G4OKSFD8 type=del size=1183337 2023-12-03T11:42:06.977 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.976+0000 7f8723d84780 1 < completed part key=_multipart_TSTIBGVYUZZZ.2~CWVVEIR0RFKV.0 size=1048576 2023-12-03T11:42:06.978 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.977+0000 7f8723d84780 1 < completed part key=_multipart_TSTIBGVYUZZZ.2~CWVVEIR0RFKV.1 size=1048576 2023-12-03T11:42:06.979 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.977+0000 7f8723d84780 1 < completed part key=_multipart_TSTIBGVYUZZZ.2~CWVVEIR0RFKV.2 size=689279 2023-12-03T11:42:06.980 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.979+0000 7f8723d84780 1 < completed multipart upload key=TSTIBGVYUZZZ upload=CWVVEIR0RFKV tag=3ZIWP2LMTR4Y type=write size=3835007 2023-12-03T11:42:06.983 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.982+0000 7f8723d84780 1 > prepared part key=_multipart_931GNEXBHH35.2~U2GHFX0NA1OV.0 size=1048576 2023-12-03T11:42:06.984 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.983+0000 7f8723d84780 1 > prepared part key=_multipart_931GNEXBHH35.2~U2GHFX0NA1OV.1 size=1048576 2023-12-03T11:42:06.985 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.984+0000 7f8723d84780 1 > prepared part key=_multipart_931GNEXBHH35.2~U2GHFX0NA1OV.2 size=175823 2023-12-03T11:42:06.985 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.984+0000 7f8723d84780 1 > prepared multipart upload key=931GNEXBHH35 upload=U2GHFX0NA1OV tag=7K2OP7VGXCGY type=write size=3321551 2023-12-03T11:42:06.986 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.985+0000 7f8723d84780 1 < completed part key=_multipart_7THZZ1J5LOZK.2~IO7MRWSYRALM.0 size=1048576 2023-12-03T11:42:06.987 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.986+0000 7f8723d84780 1 < completed part key=_multipart_7THZZ1J5LOZK.2~IO7MRWSYRALM.1 size=1048576 2023-12-03T11:42:06.988 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.987+0000 7f8723d84780 1 < completed part key=_multipart_7THZZ1J5LOZK.2~IO7MRWSYRALM.2 size=272471 2023-12-03T11:42:06.990 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.989+0000 7f8723d84780 1 < completed multipart upload key=7THZZ1J5LOZK upload=IO7MRWSYRALM tag=RQPTVMTMS6SJ type=write size=3418199 2023-12-03T11:42:06.991 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.990+0000 7f8723d84780 1 > prepared operation key=J33T5S893LMV tag=N8F97DQEN173 type=del size=927409 2023-12-03T11:42:06.993 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.992+0000 7f8723d84780 1 < completed delete operation key=LCK58DDM5XU9 tag=RJ6RBDRN7IUM type=del 2023-12-03T11:42:06.994 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.993+0000 7f8723d84780 1 > prepared operation key=5UYL15O31IHM tag=0YYI35EC73F7 type=write size=150285 2023-12-03T11:42:06.995 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.994+0000 7f8723d84780 1 < canceled operation key=5UYL15O31IHM tag=F26B1U0CHPNA type=del size=2537825 2023-12-03T11:42:06.996 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.995+0000 7f8723d84780 1 > prepared operation key=EITMJKL0LCYC tag=266FH5T5OV56 type=del size=768431 2023-12-03T11:42:06.997 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.996+0000 7f8723d84780 1 < completed part key=_multipart_LCK58DDM5XU9.2~G64XXHIN7P6O.0 size=1048576 2023-12-03T11:42:06.998 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.997+0000 7f8723d84780 1 < completed part key=_multipart_LCK58DDM5XU9.2~G64XXHIN7P6O.1 size=1048576 2023-12-03T11:42:06.999 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:06.998+0000 7f8723d84780 1 < completed part key=_multipart_LCK58DDM5XU9.2~G64XXHIN7P6O.2 size=606008 2023-12-03T11:42:07.001 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.000+0000 7f8723d84780 1 < completed multipart upload key=LCK58DDM5XU9 upload=G64XXHIN7P6O tag=DIAG8JGBNYFY type=write size=3751736 2023-12-03T11:42:07.002 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.001+0000 7f8723d84780 1 > prepared operation key=OPQPIDJ2PBVU tag=M5NQQSX7UHDJ type=del size=2850061 2023-12-03T11:42:07.003 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.002+0000 7f8723d84780 1 < completed part key=_multipart_OGACI7CRPMT7.2~HVQLX5EFYHE8.0 size=1048576 2023-12-03T11:42:07.005 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.003+0000 7f8723d84780 1 < completed part key=_multipart_OGACI7CRPMT7.2~HVQLX5EFYHE8.1 size=343824 2023-12-03T11:42:07.006 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.005+0000 7f8723d84780 1 < completed multipart upload key=OGACI7CRPMT7 upload=HVQLX5EFYHE8 tag=6HTNGF9E6QUE type=write size=2440976 2023-12-03T11:42:07.009 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.007+0000 7f8723d84780 1 > prepared operation key=J33T5S893LMV tag=S943FK9HT9N6 type=write size=144679 2023-12-03T11:42:07.010 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.008+0000 7f8723d84780 1 < completed delete operation key=DMQX2DGDLU7D tag=E1OAV4N4KKWU type=del 2023-12-03T11:42:07.010 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.009+0000 7f8723d84780 1 > prepared operation key=8NONX2I08YMJ tag=50OHC6MFO8TS type=write size=30843 2023-12-03T11:42:07.011 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.010+0000 7f8723d84780 1 < completed delete operation key=W2704YS8KYQB tag=3T0W9073BK1M type=del 2023-12-03T11:42:07.014 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.013+0000 7f8723d84780 1 > prepared operation key=W2704YS8KYQB tag=K9MCT2CJM949 type=write size=152551 2023-12-03T11:42:07.015 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.014+0000 7f8723d84780 1 < canceled operation key=931GNEXBHH35 tag=5P4QU5PMIWV7 type=del size=1461789 2023-12-03T11:42:07.016 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.015+0000 7f8723d84780 1 > prepared operation key=LCK58DDM5XU9 tag=TBKBTW69ZJNS type=del size=3846852 2023-12-03T11:42:07.017 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.017+0000 7f8723d84780 1 < completed write operation key=K83BTR5BOLZE tag=Y4KB0K5K54M1 type=write size=976074 2023-12-03T11:42:07.019 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.018+0000 7f8723d84780 1 > prepared operation key=LMVO6CVEPN3K tag=VJM621ZG8AKV type=del size=3034627 2023-12-03T11:42:07.020 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.019+0000 7f8723d84780 1 < completed part key=_multipart_W2704YS8KYQB.2~V707NBBTUBZR.0 size=990001 2023-12-03T11:42:07.022 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.021+0000 7f8723d84780 1 < completed multipart upload key=W2704YS8KYQB upload=V707NBBTUBZR tag=6I4GUNPOGCEG type=write size=2038577 2023-12-03T11:42:07.024 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.023+0000 7f8723d84780 1 > prepared part key=_multipart_TSTIBGVYUZZZ.2~594YRDR3S8YK.0 size=930340 2023-12-03T11:42:07.024 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.023+0000 7f8723d84780 1 > prepared multipart upload key=TSTIBGVYUZZZ upload=594YRDR3S8YK tag=IDD5EMNWR8YN type=write size=1978916 2023-12-03T11:42:07.026 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.025+0000 7f8723d84780 1 < suggested remove operation key=OGACI7CRPMT7 tag=6YVX801SA5I8 type=write 2023-12-03T11:42:07.028 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.027+0000 7f8723d84780 1 > prepared part key=_multipart_DMQX2DGDLU7D.2~QVACN3XQA9FB.0 size=540461 2023-12-03T11:42:07.029 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.027+0000 7f8723d84780 1 > prepared multipart upload key=DMQX2DGDLU7D upload=QVACN3XQA9FB tag=HHG3JWO695WD type=write size=1589037 2023-12-03T11:42:07.030 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.029+0000 7f8723d84780 1 < completed part key=_multipart_J33T5S893LMV.2~QDIZMYDVDP73.0 size=1048576 2023-12-03T11:42:07.030 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.029+0000 7f8723d84780 1 < canceled part key=_multipart_J33T5S893LMV.2~QDIZMYDVDP73.1 size=41310 2023-12-03T11:42:07.032 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.030+0000 7f8723d84780 1 < canceled multipart upload key=J33T5S893LMV upload=QDIZMYDVDP73 tag=VBXI8B2EJ5WC type=write size=2138462 2023-12-03T11:42:07.033 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.032+0000 7f8723d84780 1 > prepared operation key=TSTIBGVYUZZZ tag=SB1UPCK5ECPK type=del size=2469235 2023-12-03T11:42:07.035 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.034+0000 7f8723d84780 1 < suggested update operation key=EY9ZG5KOTBWM tag=ZAQW23NN6LAZ type=del size=744590 2023-12-03T11:42:07.036 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.035+0000 7f8723d84780 1 > prepared operation key=Y6S7QI60GCLE tag=Q1SFIT0VAIOH type=del size=3898044 2023-12-03T11:42:07.038 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.036+0000 7f8723d84780 1 < completed delete operation key=931GNEXBHH35 tag=SGP8N3KVJHBD type=del 2023-12-03T11:42:07.039 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.038+0000 7f8723d84780 1 > prepared operation key=12XG7YPYTN4U tag=F77EQ7O1CSXZ type=del size=3464573 2023-12-03T11:42:07.040 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.039+0000 7f8723d84780 1 < completed delete operation key=7THZZ1J5LOZK tag=SI32G4OKSFD8 type=del 2023-12-03T11:42:07.042 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.041+0000 7f8723d84780 1 > prepared part key=_multipart_J33T5S893LMV.2~LNYSK3J7NZKV.0 size=1048576 2023-12-03T11:42:07.043 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.042+0000 7f8723d84780 1 > prepared part key=_multipart_J33T5S893LMV.2~LNYSK3J7NZKV.1 size=321525 2023-12-03T11:42:07.043 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.042+0000 7f8723d84780 1 > prepared multipart upload key=J33T5S893LMV upload=LNYSK3J7NZKV tag=7LKVECNTSKEW type=write size=2418677 2023-12-03T11:42:07.044 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.043+0000 7f8723d84780 1 < completed part key=_multipart_931GNEXBHH35.2~U2GHFX0NA1OV.0 size=1048576 2023-12-03T11:42:07.046 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.045+0000 7f8723d84780 1 < completed part key=_multipart_931GNEXBHH35.2~U2GHFX0NA1OV.1 size=1048576 2023-12-03T11:42:07.047 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.046+0000 7f8723d84780 1 < completed part key=_multipart_931GNEXBHH35.2~U2GHFX0NA1OV.2 size=175823 2023-12-03T11:42:07.049 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.048+0000 7f8723d84780 1 < completed multipart upload key=931GNEXBHH35 upload=U2GHFX0NA1OV tag=7K2OP7VGXCGY type=write size=3321551 2023-12-03T11:42:07.051 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.050+0000 7f8723d84780 1 > prepared part key=_multipart_M4VKPN6INFNZ.2~5D6CULI5CUDY.0 size=1048576 2023-12-03T11:42:07.052 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.051+0000 7f8723d84780 1 > prepared part key=_multipart_M4VKPN6INFNZ.2~5D6CULI5CUDY.1 size=155921 2023-12-03T11:42:07.052 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.051+0000 7f8723d84780 1 > prepared multipart upload key=M4VKPN6INFNZ upload=5D6CULI5CUDY tag=KJDQ3YZYI401 type=write size=2253073 2023-12-03T11:42:07.054 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.053+0000 7f8723d84780 1 < completed delete operation key=J33T5S893LMV tag=N8F97DQEN173 type=del 2023-12-03T11:42:07.055 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.054+0000 7f8723d84780 1 > prepared operation key=Y6S7QI60GCLE tag=BYIWJX573Z2F type=write size=1035424 2023-12-03T11:42:07.056 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.055+0000 7f8723d84780 1 < completed write operation key=5UYL15O31IHM tag=0YYI35EC73F7 type=write size=150285 2023-12-03T11:42:07.058 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.057+0000 7f8723d84780 1 > prepared part key=_multipart_EY9ZG5KOTBWM.2~7H9U9GL6BX39.0 size=1048576 2023-12-03T11:42:07.059 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.058+0000 7f8723d84780 1 > prepared part key=_multipart_EY9ZG5KOTBWM.2~7H9U9GL6BX39.1 size=1048576 2023-12-03T11:42:07.060 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.059+0000 7f8723d84780 1 > prepared part key=_multipart_EY9ZG5KOTBWM.2~7H9U9GL6BX39.2 size=1001788 2023-12-03T11:42:07.060 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.059+0000 7f8723d84780 1 > prepared multipart upload key=EY9ZG5KOTBWM upload=7H9U9GL6BX39 tag=LIVMB4Y5TS0E type=write size=4147516 2023-12-03T11:42:07.061 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.060+0000 7f8723d84780 1 < canceled operation key=EITMJKL0LCYC tag=266FH5T5OV56 type=del size=768431 2023-12-03T11:42:07.062 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.061+0000 7f8723d84780 1 > prepared operation key=W2704YS8KYQB tag=IX4D11T2AWFC type=del size=139369 2023-12-03T11:42:07.063 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.062+0000 7f8723d84780 1 < completed delete operation key=OPQPIDJ2PBVU tag=M5NQQSX7UHDJ type=del 2023-12-03T11:42:07.065 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.064+0000 7f8723d84780 1 > prepared part key=_multipart_931GNEXBHH35.2~3L6WUKLO6CD5.0 size=229009 2023-12-03T11:42:07.065 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.064+0000 7f8723d84780 1 > prepared multipart upload key=931GNEXBHH35 upload=3L6WUKLO6CD5 tag=HJXQF141MA5L type=write size=1277585 2023-12-03T11:42:07.067 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.066+0000 7f8723d84780 1 < completed write operation key=J33T5S893LMV tag=S943FK9HT9N6 type=write size=144679 2023-12-03T11:42:07.068 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.067+0000 7f8723d84780 1 > prepared operation key=M4VKPN6INFNZ tag=NWPLVYLWK47V type=del size=8202 2023-12-03T11:42:07.069 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.068+0000 7f8723d84780 1 < completed write operation key=8NONX2I08YMJ tag=50OHC6MFO8TS type=write size=30843 2023-12-03T11:42:07.070 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.069+0000 7f8723d84780 1 > prepared operation key=8NONX2I08YMJ tag=A1AAHF19QIU2 type=del size=2069066 2023-12-03T11:42:07.071 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.070+0000 7f8723d84780 1 < completed write operation key=W2704YS8KYQB tag=K9MCT2CJM949 type=write size=152551 2023-12-03T11:42:07.073 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.072+0000 7f8723d84780 1 > prepared operation key=EY9ZG5KOTBWM tag=OFZJRMGN2DVR type=del size=1161332 2023-12-03T11:42:07.074 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.073+0000 7f8723d84780 1 < completed delete operation key=LCK58DDM5XU9 tag=TBKBTW69ZJNS type=del 2023-12-03T11:42:07.075 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.074+0000 7f8723d84780 1 > prepared operation key=M4VKPN6INFNZ tag=BLCK0SKU5UL3 type=del size=1594527 2023-12-03T11:42:07.076 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.075+0000 7f8723d84780 1 < completed delete operation key=LMVO6CVEPN3K tag=VJM621ZG8AKV type=del 2023-12-03T11:42:07.079 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.078+0000 7f8723d84780 1 > prepared part key=_multipart_5UYL15O31IHM.2~LXCZ8TT6IYBR.0 size=1048576 2023-12-03T11:42:07.080 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.079+0000 7f8723d84780 1 > prepared part key=_multipart_5UYL15O31IHM.2~LXCZ8TT6IYBR.1 size=1048576 2023-12-03T11:42:07.081 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.080+0000 7f8723d84780 1 > prepared part key=_multipart_5UYL15O31IHM.2~LXCZ8TT6IYBR.2 size=226227 2023-12-03T11:42:07.081 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.080+0000 7f8723d84780 1 > prepared multipart upload key=5UYL15O31IHM upload=LXCZ8TT6IYBR tag=4OXJMK3ZXK1T type=write size=3371955 2023-12-03T11:42:07.082 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.081+0000 7f8723d84780 1 < completed part key=_multipart_TSTIBGVYUZZZ.2~594YRDR3S8YK.0 size=930340 2023-12-03T11:42:07.084 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.083+0000 7f8723d84780 1 < completed multipart upload key=TSTIBGVYUZZZ upload=594YRDR3S8YK tag=IDD5EMNWR8YN type=write size=1978916 2023-12-03T11:42:07.089 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.088+0000 7f8723d84780 1 > prepared part key=_multipart_D3JEVEY0E29E.2~GD8BRQW19NKF.0 size=420390 2023-12-03T11:42:07.089 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.088+0000 7f8723d84780 1 > prepared multipart upload key=D3JEVEY0E29E upload=GD8BRQW19NKF tag=JR9NHX1PC3NZ type=write size=1468966 2023-12-03T11:42:07.090 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.089+0000 7f8723d84780 1 < completed part key=_multipart_DMQX2DGDLU7D.2~QVACN3XQA9FB.0 size=540461 2023-12-03T11:42:07.093 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.092+0000 7f8723d84780 1 < completed multipart upload key=DMQX2DGDLU7D upload=QVACN3XQA9FB tag=HHG3JWO695WD type=write size=1589037 2023-12-03T11:42:07.094 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.093+0000 7f8723d84780 1 > prepared operation key=12XG7YPYTN4U tag=UCLNPBPZOGNR type=del size=3514767 2023-12-03T11:42:07.095 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.094+0000 7f8723d84780 1 < completed delete operation key=TSTIBGVYUZZZ tag=SB1UPCK5ECPK type=del 2023-12-03T11:42:07.097 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.096+0000 7f8723d84780 1 > prepared part key=_multipart_Y6S7QI60GCLE.2~O2PV7OMF6IMV.0 size=1048576 2023-12-03T11:42:07.098 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.097+0000 7f8723d84780 1 > prepared part key=_multipart_Y6S7QI60GCLE.2~O2PV7OMF6IMV.1 size=1048576 2023-12-03T11:42:07.099 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.098+0000 7f8723d84780 1 > prepared part key=_multipart_Y6S7QI60GCLE.2~O2PV7OMF6IMV.2 size=189225 2023-12-03T11:42:07.100 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.098+0000 7f8723d84780 1 > prepared multipart upload key=Y6S7QI60GCLE upload=O2PV7OMF6IMV tag=R1GMETS05X36 type=write size=3334953 2023-12-03T11:42:07.100 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.099+0000 7f8723d84780 1 < completed delete operation key=Y6S7QI60GCLE tag=Q1SFIT0VAIOH type=del 2023-12-03T11:42:07.102 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.101+0000 7f8723d84780 1 > prepared part key=_multipart_HIU6L0NQ8Q95.2~PCTST4TCL6HQ.0 size=1048576 2023-12-03T11:42:07.103 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.102+0000 7f8723d84780 1 > prepared part key=_multipart_HIU6L0NQ8Q95.2~PCTST4TCL6HQ.1 size=630008 2023-12-03T11:42:07.103 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.102+0000 7f8723d84780 1 > prepared multipart upload key=HIU6L0NQ8Q95 upload=PCTST4TCL6HQ tag=0DHDIAPO8YRV type=write size=2727160 2023-12-03T11:42:07.104 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.103+0000 7f8723d84780 1 < completed delete operation key=12XG7YPYTN4U tag=F77EQ7O1CSXZ type=del 2023-12-03T11:42:07.106 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.105+0000 7f8723d84780 1 > prepared part key=_multipart_DMQX2DGDLU7D.2~ACD7GIBQVG45.0 size=397389 2023-12-03T11:42:07.106 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.105+0000 7f8723d84780 1 > prepared multipart upload key=DMQX2DGDLU7D upload=ACD7GIBQVG45 tag=2SJ99QN8FKND type=write size=1445965 2023-12-03T11:42:07.108 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.106+0000 7f8723d84780 1 < completed part key=_multipart_J33T5S893LMV.2~LNYSK3J7NZKV.0 size=1048576 2023-12-03T11:42:07.108 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.106+0000 7f8723d84780 1 < canceled part key=_multipart_J33T5S893LMV.2~LNYSK3J7NZKV.1 size=321525 2023-12-03T11:42:07.109 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.108+0000 7f8723d84780 1 < canceled multipart upload key=J33T5S893LMV upload=LNYSK3J7NZKV tag=7LKVECNTSKEW type=write size=2418677 2023-12-03T11:42:07.111 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.110+0000 7f8723d84780 1 > prepared operation key=VENJI0KD1XDW tag=7GEYKL0L4BC1 type=del size=1009777 2023-12-03T11:42:07.112 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.111+0000 7f8723d84780 1 < completed part key=_multipart_M4VKPN6INFNZ.2~5D6CULI5CUDY.0 size=1048576 2023-12-03T11:42:07.113 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.112+0000 7f8723d84780 1 < completed part key=_multipart_M4VKPN6INFNZ.2~5D6CULI5CUDY.1 size=155921 2023-12-03T11:42:07.115 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.114+0000 7f8723d84780 1 < completed multipart upload key=M4VKPN6INFNZ upload=5D6CULI5CUDY tag=KJDQ3YZYI401 type=write size=2253073 2023-12-03T11:42:07.116 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.115+0000 7f8723d84780 1 > prepared operation key=OGACI7CRPMT7 tag=HSYRXJ5DEPG7 type=del size=111941 2023-12-03T11:42:07.117 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.116+0000 7f8723d84780 1 < completed write operation key=Y6S7QI60GCLE tag=BYIWJX573Z2F type=write size=1035424 2023-12-03T11:42:07.118 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.117+0000 7f8723d84780 1 > prepared operation key=M4VKPN6INFNZ tag=M318JI2C68EZ type=del size=614424 2023-12-03T11:42:07.119 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.118+0000 7f8723d84780 1 < completed part key=_multipart_EY9ZG5KOTBWM.2~7H9U9GL6BX39.0 size=1048576 2023-12-03T11:42:07.120 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.119+0000 7f8723d84780 1 < completed part key=_multipart_EY9ZG5KOTBWM.2~7H9U9GL6BX39.1 size=1048576 2023-12-03T11:42:07.122 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.120+0000 7f8723d84780 1 < completed part key=_multipart_EY9ZG5KOTBWM.2~7H9U9GL6BX39.2 size=1001788 2023-12-03T11:42:07.123 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.122+0000 7f8723d84780 1 < completed multipart upload key=EY9ZG5KOTBWM upload=7H9U9GL6BX39 tag=LIVMB4Y5TS0E type=write size=4147516 2023-12-03T11:42:07.126 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.125+0000 7f8723d84780 1 > prepared part key=_multipart_12XG7YPYTN4U.2~IUHDARRXAQ4J.0 size=1048576 2023-12-03T11:42:07.127 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.126+0000 7f8723d84780 1 > prepared part key=_multipart_12XG7YPYTN4U.2~IUHDARRXAQ4J.1 size=51975 2023-12-03T11:42:07.127 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.126+0000 7f8723d84780 1 > prepared multipart upload key=12XG7YPYTN4U upload=IUHDARRXAQ4J tag=9BTA4JC0N7L4 type=write size=2149127 2023-12-03T11:42:07.128 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.127+0000 7f8723d84780 1 < completed delete operation key=W2704YS8KYQB tag=IX4D11T2AWFC type=del 2023-12-03T11:42:07.130 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.129+0000 7f8723d84780 1 > prepared operation key=OPQPIDJ2PBVU tag=S2KLCC84CXGQ type=del size=2827458 2023-12-03T11:42:07.131 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.130+0000 7f8723d84780 1 < completed part key=_multipart_931GNEXBHH35.2~3L6WUKLO6CD5.0 size=229009 2023-12-03T11:42:07.133 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.132+0000 7f8723d84780 1 < completed multipart upload key=931GNEXBHH35 upload=3L6WUKLO6CD5 tag=HJXQF141MA5L type=write size=1277585 2023-12-03T11:42:07.135 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.134+0000 7f8723d84780 1 > prepared part key=_multipart_FCA2R3HR61S2.2~J01CL57ADW4U.0 size=1048576 2023-12-03T11:42:07.136 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.135+0000 7f8723d84780 1 > prepared part key=_multipart_FCA2R3HR61S2.2~J01CL57ADW4U.1 size=1048576 2023-12-03T11:42:07.137 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.136+0000 7f8723d84780 1 > prepared part key=_multipart_FCA2R3HR61S2.2~J01CL57ADW4U.2 size=313696 2023-12-03T11:42:07.137 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.136+0000 7f8723d84780 1 > prepared multipart upload key=FCA2R3HR61S2 upload=J01CL57ADW4U tag=QWM21T1JUD20 type=write size=3459424 2023-12-03T11:42:07.140 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.139+0000 7f8723d84780 1 < suggested update operation key=M4VKPN6INFNZ tag=NWPLVYLWK47V type=del size=8202 2023-12-03T11:42:07.141 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.140+0000 7f8723d84780 1 > prepared operation key=Y6S7QI60GCLE tag=WKOXTQIG8I73 type=del size=3897041 2023-12-03T11:42:07.142 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.141+0000 7f8723d84780 1 < completed delete operation key=8NONX2I08YMJ tag=A1AAHF19QIU2 type=del 2023-12-03T11:42:07.143 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.142+0000 7f8723d84780 1 > prepared operation key=HIU6L0NQ8Q95 tag=F1CVM969HIDS type=del size=224263 2023-12-03T11:42:07.145 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.144+0000 7f8723d84780 1 < completed delete operation key=EY9ZG5KOTBWM tag=OFZJRMGN2DVR type=del 2023-12-03T11:42:07.146 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.145+0000 7f8723d84780 1 > prepared operation key=10JRIKOZ16FY tag=218EK0EVULU4 type=del size=845754 2023-12-03T11:42:07.147 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.146+0000 7f8723d84780 -1 < failed to complete operation key=M4VKPN6INFNZ tag=BLCK0SKU5UL3 type=del size=1594527: (22) Invalid argument 2023-12-03T11:42:07.149 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.147+0000 7f8723d84780 1 > prepared operation key=12XG7YPYTN4U tag=ZO9X5BZ43KKG type=del size=3631037 2023-12-03T11:42:07.149 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.148+0000 7f8723d84780 1 < completed part key=_multipart_5UYL15O31IHM.2~LXCZ8TT6IYBR.0 size=1048576 2023-12-03T11:42:07.151 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.150+0000 7f8723d84780 1 < completed part key=_multipart_5UYL15O31IHM.2~LXCZ8TT6IYBR.1 size=1048576 2023-12-03T11:42:07.152 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.151+0000 7f8723d84780 1 < completed part key=_multipart_5UYL15O31IHM.2~LXCZ8TT6IYBR.2 size=226227 2023-12-03T11:42:07.154 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.153+0000 7f8723d84780 1 < completed multipart upload key=5UYL15O31IHM upload=LXCZ8TT6IYBR tag=4OXJMK3ZXK1T type=write size=3371955 2023-12-03T11:42:07.156 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.154+0000 7f8723d84780 1 > prepared operation key=O7VVHXLDSY57 tag=UOJ8NQLUGRJR type=del size=241991 2023-12-03T11:42:07.156 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.155+0000 7f8723d84780 1 < completed part key=_multipart_D3JEVEY0E29E.2~GD8BRQW19NKF.0 size=420390 2023-12-03T11:42:07.159 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.158+0000 7f8723d84780 1 < completed multipart upload key=D3JEVEY0E29E upload=GD8BRQW19NKF tag=JR9NHX1PC3NZ type=write size=1468966 2023-12-03T11:42:07.160 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.159+0000 7f8723d84780 1 > prepared operation key=G36T76K8O7A1 tag=U3HNLO91INQW type=del size=3897483 2023-12-03T11:42:07.162 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.161+0000 7f8723d84780 1 < suggested update operation key=12XG7YPYTN4U tag=UCLNPBPZOGNR type=del size=3514767 2023-12-03T11:42:07.166 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.165+0000 7f8723d84780 1 > prepared part key=_multipart_12XG7YPYTN4U.2~5QBA6XILUVW8.0 size=1024022 2023-12-03T11:42:07.166 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.165+0000 7f8723d84780 1 > prepared multipart upload key=12XG7YPYTN4U upload=5QBA6XILUVW8 tag=O6HSSNYW3HP3 type=write size=2072598 2023-12-03T11:42:07.168 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.167+0000 7f8723d84780 1 < completed part key=_multipart_Y6S7QI60GCLE.2~O2PV7OMF6IMV.0 size=1048576 2023-12-03T11:42:07.169 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.168+0000 7f8723d84780 1 < completed part key=_multipart_Y6S7QI60GCLE.2~O2PV7OMF6IMV.1 size=1048576 2023-12-03T11:42:07.170 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.169+0000 7f8723d84780 1 < completed part key=_multipart_Y6S7QI60GCLE.2~O2PV7OMF6IMV.2 size=189225 2023-12-03T11:42:07.173 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.172+0000 7f8723d84780 1 < completed multipart upload key=Y6S7QI60GCLE upload=O2PV7OMF6IMV tag=R1GMETS05X36 type=write size=3334953 2023-12-03T11:42:07.174 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.174+0000 7f8723d84780 1 > prepared operation key=OPQPIDJ2PBVU tag=E7IO7AEZERD2 type=del size=3892006 2023-12-03T11:42:07.176 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.175+0000 7f8723d84780 1 < completed part key=_multipart_HIU6L0NQ8Q95.2~PCTST4TCL6HQ.0 size=1048576 2023-12-03T11:42:07.177 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.176+0000 7f8723d84780 1 < completed part key=_multipart_HIU6L0NQ8Q95.2~PCTST4TCL6HQ.1 size=630008 2023-12-03T11:42:07.179 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.178+0000 7f8723d84780 1 < completed multipart upload key=HIU6L0NQ8Q95 upload=PCTST4TCL6HQ tag=0DHDIAPO8YRV type=write size=2727160 2023-12-03T11:42:07.181 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.180+0000 7f8723d84780 1 > prepared part key=_multipart_D3JEVEY0E29E.2~M3HJCJIH2QE9.0 size=413517 2023-12-03T11:42:07.181 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.180+0000 7f8723d84780 1 > prepared multipart upload key=D3JEVEY0E29E upload=M3HJCJIH2QE9 tag=JZ8F4AYW7MJT type=write size=1462093 2023-12-03T11:42:07.182 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.181+0000 7f8723d84780 1 < completed part key=_multipart_DMQX2DGDLU7D.2~ACD7GIBQVG45.0 size=397389 2023-12-03T11:42:07.184 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.183+0000 7f8723d84780 1 < completed multipart upload key=DMQX2DGDLU7D upload=ACD7GIBQVG45 tag=2SJ99QN8FKND type=write size=1445965 2023-12-03T11:42:07.186 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.185+0000 7f8723d84780 1 > prepared part key=_multipart_96RAVVSUKH0Y.2~CBD24KKNYDSS.0 size=1048576 2023-12-03T11:42:07.187 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.186+0000 7f8723d84780 1 > prepared part key=_multipart_96RAVVSUKH0Y.2~CBD24KKNYDSS.1 size=185185 2023-12-03T11:42:07.187 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.186+0000 7f8723d84780 1 > prepared multipart upload key=96RAVVSUKH0Y upload=CBD24KKNYDSS tag=7W37Z6NY4Z75 type=write size=2282337 2023-12-03T11:42:07.188 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.187+0000 7f8723d84780 1 < completed delete operation key=VENJI0KD1XDW tag=7GEYKL0L4BC1 type=del 2023-12-03T11:42:07.189 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.188+0000 7f8723d84780 1 > prepared operation key=7VMTBKUWU59F tag=PJVAQ70Q53US type=write size=108908 2023-12-03T11:42:07.191 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.190+0000 7f8723d84780 1 < completed delete operation key=OGACI7CRPMT7 tag=HSYRXJ5DEPG7 type=del 2023-12-03T11:42:07.193 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.192+0000 7f8723d84780 1 > prepared part key=_multipart_OGACI7CRPMT7.2~FS521UY2VO2U.0 size=1048576 2023-12-03T11:42:07.194 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.193+0000 7f8723d84780 1 > prepared part key=_multipart_OGACI7CRPMT7.2~FS521UY2VO2U.1 size=292559 2023-12-03T11:42:07.194 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.193+0000 7f8723d84780 1 > prepared multipart upload key=OGACI7CRPMT7 upload=FS521UY2VO2U tag=ZFRQ3IJHAH1P type=write size=2389711 2023-12-03T11:42:07.196 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.195+0000 7f8723d84780 1 < suggested update operation key=M4VKPN6INFNZ tag=M318JI2C68EZ type=del size=614424 2023-12-03T11:42:07.197 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.196+0000 7f8723d84780 1 > prepared operation key=5UYL15O31IHM tag=IX0F5QOY5RTT type=del size=3630910 2023-12-03T11:42:07.198 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.197+0000 7f8723d84780 1 < canceled part key=_multipart_12XG7YPYTN4U.2~IUHDARRXAQ4J.0 size=1048576 2023-12-03T11:42:07.199 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.198+0000 7f8723d84780 1 < completed part key=_multipart_12XG7YPYTN4U.2~IUHDARRXAQ4J.1 size=51975 2023-12-03T11:42:07.200 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.199+0000 7f8723d84780 1 < canceled multipart upload key=12XG7YPYTN4U upload=IUHDARRXAQ4J tag=9BTA4JC0N7L4 type=write size=2149127 2023-12-03T11:42:07.203 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.202+0000 7f8723d84780 1 > prepared part key=_multipart_KS5J7E7KE2IJ.2~XNWHQ1M3VXOY.0 size=1048576 2023-12-03T11:42:07.204 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.203+0000 7f8723d84780 1 > prepared part key=_multipart_KS5J7E7KE2IJ.2~XNWHQ1M3VXOY.1 size=1048576 2023-12-03T11:42:07.205 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.203+0000 7f8723d84780 1 > prepared part key=_multipart_KS5J7E7KE2IJ.2~XNWHQ1M3VXOY.2 size=825497 2023-12-03T11:42:07.205 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.203+0000 7f8723d84780 1 > prepared multipart upload key=KS5J7E7KE2IJ upload=XNWHQ1M3VXOY tag=E9M8XVIWDIRG type=write size=3971225 2023-12-03T11:42:07.206 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.205+0000 7f8723d84780 1 < canceled operation key=OPQPIDJ2PBVU tag=S2KLCC84CXGQ type=del size=2827458 2023-12-03T11:42:07.208 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.207+0000 7f8723d84780 1 > prepared part key=_multipart_10JRIKOZ16FY.2~1OP4MRYJ1WUO.0 size=1048576 2023-12-03T11:42:07.209 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.208+0000 7f8723d84780 1 > prepared part key=_multipart_10JRIKOZ16FY.2~1OP4MRYJ1WUO.1 size=1048576 2023-12-03T11:42:07.210 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.209+0000 7f8723d84780 1 > prepared part key=_multipart_10JRIKOZ16FY.2~1OP4MRYJ1WUO.2 size=951179 2023-12-03T11:42:07.210 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.209+0000 7f8723d84780 1 > prepared multipart upload key=10JRIKOZ16FY upload=1OP4MRYJ1WUO tag=1B703P0KL0V1 type=write size=4096907 2023-12-03T11:42:07.211 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.210+0000 7f8723d84780 1 < completed part key=_multipart_FCA2R3HR61S2.2~J01CL57ADW4U.0 size=1048576 2023-12-03T11:42:07.212 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.211+0000 7f8723d84780 1 < completed part key=_multipart_FCA2R3HR61S2.2~J01CL57ADW4U.1 size=1048576 2023-12-03T11:42:07.213 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.212+0000 7f8723d84780 1 < completed part key=_multipart_FCA2R3HR61S2.2~J01CL57ADW4U.2 size=313696 2023-12-03T11:42:07.218 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.214+0000 7f8723d84780 1 < completed multipart upload key=FCA2R3HR61S2 upload=J01CL57ADW4U tag=QWM21T1JUD20 type=write size=3459424 2023-12-03T11:42:07.218 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.215+0000 7f8723d84780 1 > prepared operation key=OPQPIDJ2PBVU tag=FSQWCELDOALE type=del size=730425 2023-12-03T11:42:07.218 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.217+0000 7f8723d84780 1 < suggested update operation key=Y6S7QI60GCLE tag=WKOXTQIG8I73 type=del size=3897041 2023-12-03T11:42:07.220 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.219+0000 7f8723d84780 1 > prepared part key=_multipart_96RAVVSUKH0Y.2~LKR6GNLBSC1I.0 size=1048576 2023-12-03T11:42:07.221 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.220+0000 7f8723d84780 1 > prepared part key=_multipart_96RAVVSUKH0Y.2~LKR6GNLBSC1I.1 size=717622 2023-12-03T11:42:07.221 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.220+0000 7f8723d84780 1 > prepared multipart upload key=96RAVVSUKH0Y upload=LKR6GNLBSC1I tag=ZYB8ELIC5ZNT type=write size=2814774 2023-12-03T11:42:07.222 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.221+0000 7f8723d84780 1 < canceled operation key=HIU6L0NQ8Q95 tag=F1CVM969HIDS type=del size=224263 2023-12-03T11:42:07.224 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.223+0000 7f8723d84780 1 > prepared operation key=AB0SN0E49Z5F tag=7BS8CTQS9KWD type=del size=672067 2023-12-03T11:42:07.226 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.224+0000 7f8723d84780 1 < completed delete operation key=10JRIKOZ16FY tag=218EK0EVULU4 type=del 2023-12-03T11:42:07.226 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.225+0000 7f8723d84780 1 > prepared operation key=O7VVHXLDSY57 tag=EBA2M6PCI448 type=del size=1750319 2023-12-03T11:42:07.227 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.226+0000 7f8723d84780 -1 < failed to complete operation key=12XG7YPYTN4U tag=ZO9X5BZ43KKG type=del size=3631037: (22) Invalid argument 2023-12-03T11:42:07.228 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.227+0000 7f8723d84780 1 > prepared operation key=D3JEVEY0E29E tag=TDZU6W8N5Z7F type=del size=30563 2023-12-03T11:42:07.231 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.230+0000 7f8723d84780 1 < suggested remove operation key=O7VVHXLDSY57 tag=UOJ8NQLUGRJR type=del 2023-12-03T11:42:07.233 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.232+0000 7f8723d84780 1 > prepared part key=_multipart_OGACI7CRPMT7.2~FTCYVIPTH3EU.0 size=1048576 2023-12-03T11:42:07.234 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.233+0000 7f8723d84780 1 > prepared part key=_multipart_OGACI7CRPMT7.2~FTCYVIPTH3EU.1 size=549271 2023-12-03T11:42:07.234 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.233+0000 7f8723d84780 1 > prepared multipart upload key=OGACI7CRPMT7 upload=FTCYVIPTH3EU tag=E2DYTORLCFP4 type=write size=2646423 2023-12-03T11:42:07.235 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.234+0000 7f8723d84780 1 < completed delete operation key=G36T76K8O7A1 tag=U3HNLO91INQW type=del 2023-12-03T11:42:07.236 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.235+0000 7f8723d84780 1 > prepared operation key=HIU6L0NQ8Q95 tag=JXNRPOT2UXE1 type=del size=1278501 2023-12-03T11:42:07.237 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.235+0000 7f8723d84780 1 < canceled part key=_multipart_12XG7YPYTN4U.2~5QBA6XILUVW8.0 size=1024022 2023-12-03T11:42:07.238 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.237+0000 7f8723d84780 1 < canceled multipart upload key=12XG7YPYTN4U upload=5QBA6XILUVW8 tag=O6HSSNYW3HP3 type=write size=2072598 2023-12-03T11:42:07.240 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.238+0000 7f8723d84780 1 > prepared operation key=O7VVHXLDSY57 tag=4X1NRSA9LA05 type=del size=3067603 2023-12-03T11:42:07.242 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.241+0000 7f8723d84780 1 < suggested update operation key=OPQPIDJ2PBVU tag=E7IO7AEZERD2 type=del size=3892006 2023-12-03T11:42:07.243 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.242+0000 7f8723d84780 1 > prepared operation key=LMVO6CVEPN3K tag=PXO6YEUFTIE6 type=del size=636482 2023-12-03T11:42:07.244 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.243+0000 7f8723d84780 1 < completed part key=_multipart_D3JEVEY0E29E.2~M3HJCJIH2QE9.0 size=413517 2023-12-03T11:42:07.246 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.245+0000 7f8723d84780 1 < completed multipart upload key=D3JEVEY0E29E upload=M3HJCJIH2QE9 tag=JZ8F4AYW7MJT type=write size=1462093 2023-12-03T11:42:07.248 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.247+0000 7f8723d84780 1 > prepared operation key=D3JEVEY0E29E tag=3UFUPLD3WBEQ type=write size=520604 2023-12-03T11:42:07.248 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.247+0000 7f8723d84780 1 < canceled part key=_multipart_96RAVVSUKH0Y.2~CBD24KKNYDSS.0 size=1048576 2023-12-03T11:42:07.249 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.248+0000 7f8723d84780 1 < completed part key=_multipart_96RAVVSUKH0Y.2~CBD24KKNYDSS.1 size=185185 2023-12-03T11:42:07.251 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.250+0000 7f8723d84780 1 < canceled multipart upload key=96RAVVSUKH0Y upload=CBD24KKNYDSS tag=7W37Z6NY4Z75 type=write size=2282337 2023-12-03T11:42:07.253 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.252+0000 7f8723d84780 1 > prepared part key=_multipart_J33T5S893LMV.2~0R7E6XXTCTF3.0 size=1048576 2023-12-03T11:42:07.254 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.253+0000 7f8723d84780 1 > prepared part key=_multipart_J33T5S893LMV.2~0R7E6XXTCTF3.1 size=589440 2023-12-03T11:42:07.255 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.253+0000 7f8723d84780 1 > prepared multipart upload key=J33T5S893LMV upload=0R7E6XXTCTF3 tag=HRFIX1YUIO9Y type=write size=2686592 2023-12-03T11:42:07.256 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.254+0000 7f8723d84780 1 < completed write operation key=7VMTBKUWU59F tag=PJVAQ70Q53US type=write size=108908 2023-12-03T11:42:07.258 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.257+0000 7f8723d84780 1 > prepared operation key=DMQX2DGDLU7D tag=3VAO51L9OS1G type=del size=1024647 2023-12-03T11:42:07.260 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.258+0000 7f8723d84780 1 < completed part key=_multipart_OGACI7CRPMT7.2~FS521UY2VO2U.0 size=1048576 2023-12-03T11:42:07.260 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.259+0000 7f8723d84780 1 < completed part key=_multipart_OGACI7CRPMT7.2~FS521UY2VO2U.1 size=292559 2023-12-03T11:42:07.263 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.262+0000 7f8723d84780 1 < completed multipart upload key=OGACI7CRPMT7 upload=FS521UY2VO2U tag=ZFRQ3IJHAH1P type=write size=2389711 2023-12-03T11:42:07.265 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.264+0000 7f8723d84780 1 > prepared part key=_multipart_J33T5S893LMV.2~UHW5C2OGMRX2.0 size=931747 2023-12-03T11:42:07.265 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.264+0000 7f8723d84780 1 > prepared multipart upload key=J33T5S893LMV upload=UHW5C2OGMRX2 tag=SOPHFFE4NTE5 type=write size=1980323 2023-12-03T11:42:07.266 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.265+0000 7f8723d84780 1 < completed delete operation key=5UYL15O31IHM tag=IX0F5QOY5RTT type=del 2023-12-03T11:42:07.267 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.266+0000 7f8723d84780 1 > prepared operation key=7VMTBKUWU59F tag=CPN1Z5KC7C8O type=del size=2295947 2023-12-03T11:42:07.268 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.267+0000 7f8723d84780 1 < completed part key=_multipart_KS5J7E7KE2IJ.2~XNWHQ1M3VXOY.0 size=1048576 2023-12-03T11:42:07.269 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.268+0000 7f8723d84780 1 < completed part key=_multipart_KS5J7E7KE2IJ.2~XNWHQ1M3VXOY.1 size=1048576 2023-12-03T11:42:07.271 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.269+0000 7f8723d84780 1 < completed part key=_multipart_KS5J7E7KE2IJ.2~XNWHQ1M3VXOY.2 size=825497 2023-12-03T11:42:07.272 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.271+0000 7f8723d84780 1 < completed multipart upload key=KS5J7E7KE2IJ upload=XNWHQ1M3VXOY tag=E9M8XVIWDIRG type=write size=3971225 2023-12-03T11:42:07.274 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.273+0000 7f8723d84780 1 > prepared operation key=DMQX2DGDLU7D tag=4GRY0W89Y3BW type=del size=1986192 2023-12-03T11:42:07.275 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.274+0000 7f8723d84780 1 < completed part key=_multipart_10JRIKOZ16FY.2~1OP4MRYJ1WUO.0 size=1048576 2023-12-03T11:42:07.276 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.275+0000 7f8723d84780 1 < completed part key=_multipart_10JRIKOZ16FY.2~1OP4MRYJ1WUO.1 size=1048576 2023-12-03T11:42:07.277 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.276+0000 7f8723d84780 1 < completed part key=_multipart_10JRIKOZ16FY.2~1OP4MRYJ1WUO.2 size=951179 2023-12-03T11:42:07.280 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.279+0000 7f8723d84780 1 < completed multipart upload key=10JRIKOZ16FY upload=1OP4MRYJ1WUO tag=1B703P0KL0V1 type=write size=4096907 2023-12-03T11:42:07.282 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.280+0000 7f8723d84780 1 > prepared operation key=LCK58DDM5XU9 tag=HH35O8WRJCE1 type=write size=628084 2023-12-03T11:42:07.283 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.281+0000 7f8723d84780 -1 < failed to complete operation key=OPQPIDJ2PBVU tag=FSQWCELDOALE type=del size=730425: (22) Invalid argument 2023-12-03T11:42:07.284 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.283+0000 7f8723d84780 1 > prepared operation key=KS5J7E7KE2IJ tag=DTFTB17PA0P6 type=write size=765019 2023-12-03T11:42:07.285 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.284+0000 7f8723d84780 1 < completed part key=_multipart_96RAVVSUKH0Y.2~LKR6GNLBSC1I.0 size=1048576 2023-12-03T11:42:07.285 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.284+0000 7f8723d84780 1 < canceled part key=_multipart_96RAVVSUKH0Y.2~LKR6GNLBSC1I.1 size=717622 2023-12-03T11:42:07.287 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.286+0000 7f8723d84780 1 < canceled multipart upload key=96RAVVSUKH0Y upload=LKR6GNLBSC1I tag=ZYB8ELIC5ZNT type=write size=2814774 2023-12-03T11:42:07.289 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.288+0000 7f8723d84780 1 > prepared part key=_multipart_HIU6L0NQ8Q95.2~AO16FW10G921.0 size=634678 2023-12-03T11:42:07.290 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.288+0000 7f8723d84780 1 > prepared multipart upload key=HIU6L0NQ8Q95 upload=AO16FW10G921 tag=RYBJKVLQGWJT type=write size=1683254 2023-12-03T11:42:07.290 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.289+0000 7f8723d84780 1 < completed delete operation key=AB0SN0E49Z5F tag=7BS8CTQS9KWD type=del 2023-12-03T11:42:07.291 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.290+0000 7f8723d84780 1 > prepared operation key=8NONX2I08YMJ tag=O1QRMR0A1MIX type=write size=1010938 2023-12-03T11:42:07.292 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.291+0000 7f8723d84780 -1 < failed to complete operation key=O7VVHXLDSY57 tag=EBA2M6PCI448 type=del size=1750319: (22) Invalid argument 2023-12-03T11:42:07.294 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.292+0000 7f8723d84780 1 > prepared operation key=4I8PWBZOLDUG tag=V2DG1YV0Y2ZU type=write size=568136 2023-12-03T11:42:07.296 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.295+0000 7f8723d84780 1 < suggested update operation key=D3JEVEY0E29E tag=TDZU6W8N5Z7F type=del size=30563 2023-12-03T11:42:07.297 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.296+0000 7f8723d84780 1 > prepared operation key=OPQPIDJ2PBVU tag=G2KXXDH7Z7R7 type=del size=1411273 2023-12-03T11:42:07.297 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.296+0000 7f8723d84780 1 < canceled part key=_multipart_OGACI7CRPMT7.2~FTCYVIPTH3EU.0 size=1048576 2023-12-03T11:42:07.298 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.297+0000 7f8723d84780 1 < completed part key=_multipart_OGACI7CRPMT7.2~FTCYVIPTH3EU.1 size=549271 2023-12-03T11:42:07.300 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.299+0000 7f8723d84780 1 < canceled multipart upload key=OGACI7CRPMT7 upload=FTCYVIPTH3EU tag=E2DYTORLCFP4 type=write size=2646423 2023-12-03T11:42:07.301 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.300+0000 7f8723d84780 1 > prepared operation key=O7VVHXLDSY57 tag=TTKMWA6Q7W1M type=write size=362703 2023-12-03T11:42:07.302 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.301+0000 7f8723d84780 1 < completed delete operation key=HIU6L0NQ8Q95 tag=JXNRPOT2UXE1 type=del 2023-12-03T11:42:07.303 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.302+0000 7f8723d84780 1 > prepared operation key=EITMJKL0LCYC tag=2F20U680F6XE type=write size=235930 2023-12-03T11:42:07.305 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.304+0000 7f8723d84780 1 < completed delete operation key=O7VVHXLDSY57 tag=4X1NRSA9LA05 type=del 2023-12-03T11:42:07.306 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.305+0000 7f8723d84780 1 > prepared operation key=7VMTBKUWU59F tag=XVITVXAHIJBY type=del size=1305244 2023-12-03T11:42:07.307 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.306+0000 7f8723d84780 1 < canceled operation key=LMVO6CVEPN3K tag=PXO6YEUFTIE6 type=del size=636482 2023-12-03T11:42:07.308 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.307+0000 7f8723d84780 1 > prepared operation key=D3JEVEY0E29E tag=EN9THFLLMRSD type=write size=774289 2023-12-03T11:42:07.309 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.308+0000 7f8723d84780 -1 < failed to complete operation key=D3JEVEY0E29E tag=3UFUPLD3WBEQ type=write size=520604: (22) Invalid argument 2023-12-03T11:42:07.310 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.309+0000 7f8723d84780 1 > prepared operation key=CKABTI1EOAWB tag=R2X8GUUOQO9K type=write size=657088 2023-12-03T11:42:07.311 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.310+0000 7f8723d84780 1 < completed part key=_multipart_J33T5S893LMV.2~0R7E6XXTCTF3.0 size=1048576 2023-12-03T11:42:07.312 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.311+0000 7f8723d84780 1 < completed part key=_multipart_J33T5S893LMV.2~0R7E6XXTCTF3.1 size=589440 2023-12-03T11:42:07.314 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.313+0000 7f8723d84780 1 < completed multipart upload key=J33T5S893LMV upload=0R7E6XXTCTF3 tag=HRFIX1YUIO9Y type=write size=2686592 2023-12-03T11:42:07.317 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.316+0000 7f8723d84780 1 > prepared part key=_multipart_J33T5S893LMV.2~2GTU2EP1BIWY.0 size=1048576 2023-12-03T11:42:07.317 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.316+0000 7f8723d84780 1 > prepared part key=_multipart_J33T5S893LMV.2~2GTU2EP1BIWY.1 size=1048576 2023-12-03T11:42:07.318 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.317+0000 7f8723d84780 1 > prepared part key=_multipart_J33T5S893LMV.2~2GTU2EP1BIWY.2 size=742745 2023-12-03T11:42:07.318 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.317+0000 7f8723d84780 1 > prepared multipart upload key=J33T5S893LMV upload=2GTU2EP1BIWY tag=5VD30TNQKSZP type=write size=3888473 2023-12-03T11:42:07.319 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.319+0000 7f8723d84780 1 < canceled operation key=DMQX2DGDLU7D tag=3VAO51L9OS1G type=del size=1024647 2023-12-03T11:42:07.321 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.320+0000 7f8723d84780 1 > prepared operation key=Y6S7QI60GCLE tag=H300COIZCZQI type=del size=3723889 2023-12-03T11:42:07.326 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.321+0000 7f8723d84780 1 < completed part key=_multipart_J33T5S893LMV.2~UHW5C2OGMRX2.0 size=931747 2023-12-03T11:42:07.327 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.323+0000 7f8723d84780 1 < completed multipart upload key=J33T5S893LMV upload=UHW5C2OGMRX2 tag=SOPHFFE4NTE5 type=write size=1980323 2023-12-03T11:42:07.327 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.325+0000 7f8723d84780 1 > prepared part key=_multipart_D3JEVEY0E29E.2~88R0BZ2DM5IG.0 size=1048576 2023-12-03T11:42:07.327 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.326+0000 7f8723d84780 1 > prepared part key=_multipart_D3JEVEY0E29E.2~88R0BZ2DM5IG.1 size=214395 2023-12-03T11:42:07.327 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.326+0000 7f8723d84780 1 > prepared multipart upload key=D3JEVEY0E29E upload=88R0BZ2DM5IG tag=NIHOZPF9R9HL type=write size=2311547 2023-12-03T11:42:07.328 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.327+0000 7f8723d84780 1 < completed delete operation key=7VMTBKUWU59F tag=CPN1Z5KC7C8O type=del 2023-12-03T11:42:07.329 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.328+0000 7f8723d84780 1 > prepared operation key=K83BTR5BOLZE tag=ROCJF6M26CL3 type=del size=1336299 2023-12-03T11:42:07.331 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.330+0000 7f8723d84780 1 < suggested remove operation key=DMQX2DGDLU7D tag=4GRY0W89Y3BW type=del 2023-12-03T11:42:07.332 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.331+0000 7f8723d84780 1 > prepared operation key=O7VVHXLDSY57 tag=5EVLZU4OBQ1W type=del size=4172047 2023-12-03T11:42:07.334 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.334+0000 7f8723d84780 1 < suggested update operation key=LCK58DDM5XU9 tag=HH35O8WRJCE1 type=write size=628084 2023-12-03T11:42:07.336 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.335+0000 7f8723d84780 1 > prepared operation key=LCK58DDM5XU9 tag=72YQ15XBE47E type=write size=986797 2023-12-03T11:42:07.337 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.336+0000 7f8723d84780 1 < completed write operation key=KS5J7E7KE2IJ tag=DTFTB17PA0P6 type=write size=765019 2023-12-03T11:42:07.338 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.337+0000 7f8723d84780 1 > prepared operation key=10JRIKOZ16FY tag=274YYUJZIJAA type=del size=2726020 2023-12-03T11:42:07.338 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.337+0000 7f8723d84780 1 < canceled part key=_multipart_HIU6L0NQ8Q95.2~AO16FW10G921.0 size=634678 2023-12-03T11:42:07.340 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.339+0000 7f8723d84780 1 < canceled multipart upload key=HIU6L0NQ8Q95 upload=AO16FW10G921 tag=RYBJKVLQGWJT type=write size=1683254 2023-12-03T11:42:07.341 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.340+0000 7f8723d84780 1 > prepared operation key=O7VVHXLDSY57 tag=9FY5GCRD3REJ type=del size=927313 2023-12-03T11:42:07.342 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.341+0000 7f8723d84780 1 < completed write operation key=8NONX2I08YMJ tag=O1QRMR0A1MIX type=write size=1010938 2023-12-03T11:42:07.344 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.343+0000 7f8723d84780 1 > prepared part key=_multipart_931GNEXBHH35.2~QAUFN5D2TVOE.0 size=300226 2023-12-03T11:42:07.344 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.343+0000 7f8723d84780 1 > prepared multipart upload key=931GNEXBHH35 upload=QAUFN5D2TVOE tag=B0N6E6QUAV42 type=write size=1348802 2023-12-03T11:42:07.346 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.345+0000 7f8723d84780 1 < suggested remove operation key=4I8PWBZOLDUG tag=V2DG1YV0Y2ZU type=write 2023-12-03T11:42:07.348 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.347+0000 7f8723d84780 1 > prepared part key=_multipart_O7VVHXLDSY57.2~NYFH0HB79VLI.0 size=1048576 2023-12-03T11:42:07.349 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.348+0000 7f8723d84780 1 > prepared part key=_multipart_O7VVHXLDSY57.2~NYFH0HB79VLI.1 size=592416 2023-12-03T11:42:07.349 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.348+0000 7f8723d84780 1 > prepared multipart upload key=O7VVHXLDSY57 upload=NYFH0HB79VLI tag=VLIYEUGCVBTA type=write size=2689568 2023-12-03T11:42:07.350 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.349+0000 7f8723d84780 1 < completed delete operation key=OPQPIDJ2PBVU tag=G2KXXDH7Z7R7 type=del 2023-12-03T11:42:07.351 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.350+0000 7f8723d84780 1 > prepared operation key=AB0SN0E49Z5F tag=M28VO6CED9U4 type=write size=648715 2023-12-03T11:42:07.353 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.352+0000 7f8723d84780 1 < completed write operation key=O7VVHXLDSY57 tag=TTKMWA6Q7W1M type=write size=362703 2023-12-03T11:42:07.354 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.353+0000 7f8723d84780 1 > prepared operation key=Y6S7QI60GCLE tag=QW3HC732BHVU type=write size=226301 2023-12-03T11:42:07.355 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.354+0000 7f8723d84780 1 < canceled operation key=EITMJKL0LCYC tag=2F20U680F6XE type=write size=235930 2023-12-03T11:42:07.356 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.355+0000 7f8723d84780 1 > prepared operation key=W2704YS8KYQB tag=DYDFKP4KRQ41 type=del size=2013202 2023-12-03T11:42:07.357 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.356+0000 7f8723d84780 1 < completed delete operation key=7VMTBKUWU59F tag=XVITVXAHIJBY type=del 2023-12-03T11:42:07.358 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.357+0000 7f8723d84780 1 > prepared operation key=VENJI0KD1XDW tag=OTYMP7ZLXO4X type=del size=3156823 2023-12-03T11:42:07.359 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.358+0000 7f8723d84780 1 < canceled operation key=D3JEVEY0E29E tag=EN9THFLLMRSD type=write size=774289 2023-12-03T11:42:07.361 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.360+0000 7f8723d84780 1 > prepared part key=_multipart_LMVO6CVEPN3K.2~27HNW1WMED5A.0 size=724680 2023-12-03T11:42:07.362 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.360+0000 7f8723d84780 1 > prepared multipart upload key=LMVO6CVEPN3K upload=27HNW1WMED5A tag=BAXKUR1DZ6V3 type=write size=1773256 2023-12-03T11:42:07.363 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.362+0000 7f8723d84780 1 < completed write operation key=CKABTI1EOAWB tag=R2X8GUUOQO9K type=write size=657088 2023-12-03T11:42:07.364 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.363+0000 7f8723d84780 1 > prepared operation key=CKABTI1EOAWB tag=TEXTYBBRNDWU type=del size=1009277 2023-12-03T11:42:07.365 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.364+0000 7f8723d84780 1 < completed part key=_multipart_J33T5S893LMV.2~2GTU2EP1BIWY.0 size=1048576 2023-12-03T11:42:07.366 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.365+0000 7f8723d84780 1 < completed part key=_multipart_J33T5S893LMV.2~2GTU2EP1BIWY.1 size=1048576 2023-12-03T11:42:07.367 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.366+0000 7f8723d84780 1 < completed part key=_multipart_J33T5S893LMV.2~2GTU2EP1BIWY.2 size=742745 2023-12-03T11:42:07.369 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.368+0000 7f8723d84780 1 < completed multipart upload key=J33T5S893LMV upload=2GTU2EP1BIWY tag=5VD30TNQKSZP type=write size=3888473 2023-12-03T11:42:07.371 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.370+0000 7f8723d84780 1 > prepared part key=_multipart_W2704YS8KYQB.2~6IP2N8AHSS96.0 size=1048576 2023-12-03T11:42:07.372 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.371+0000 7f8723d84780 1 > prepared part key=_multipart_W2704YS8KYQB.2~6IP2N8AHSS96.1 size=113425 2023-12-03T11:42:07.372 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.371+0000 7f8723d84780 1 > prepared multipart upload key=W2704YS8KYQB upload=6IP2N8AHSS96 tag=138BBHJLSQIO type=write size=2210577 2023-12-03T11:42:07.373 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.372+0000 7f8723d84780 1 < completed delete operation key=Y6S7QI60GCLE tag=H300COIZCZQI type=del 2023-12-03T11:42:07.376 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.375+0000 7f8723d84780 1 > prepared part key=_multipart_7THZZ1J5LOZK.2~PV8J0UNNSPS8.0 size=689207 2023-12-03T11:42:07.376 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.375+0000 7f8723d84780 1 > prepared multipart upload key=7THZZ1J5LOZK upload=PV8J0UNNSPS8 tag=GIT5SM6478LI type=write size=1737783 2023-12-03T11:42:07.377 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.376+0000 7f8723d84780 1 < completed part key=_multipart_D3JEVEY0E29E.2~88R0BZ2DM5IG.0 size=1048576 2023-12-03T11:42:07.378 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.377+0000 7f8723d84780 1 < completed part key=_multipart_D3JEVEY0E29E.2~88R0BZ2DM5IG.1 size=214395 2023-12-03T11:42:07.380 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.379+0000 7f8723d84780 1 < completed multipart upload key=D3JEVEY0E29E upload=88R0BZ2DM5IG tag=NIHOZPF9R9HL type=write size=2311547 2023-12-03T11:42:07.381 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.380+0000 7f8723d84780 1 > prepared operation key=HIU6L0NQ8Q95 tag=STCWWP3E67I7 type=del size=2278256 2023-12-03T11:42:07.383 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.382+0000 7f8723d84780 1 < completed delete operation key=K83BTR5BOLZE tag=ROCJF6M26CL3 type=del 2023-12-03T11:42:07.384 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.383+0000 7f8723d84780 1 > prepared operation key=TSTIBGVYUZZZ tag=Y90VWXR9I8NB type=write size=519016 2023-12-03T11:42:07.385 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.384+0000 7f8723d84780 1 < completed delete operation key=O7VVHXLDSY57 tag=5EVLZU4OBQ1W type=del 2023-12-03T11:42:07.387 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.386+0000 7f8723d84780 1 > prepared part key=_multipart_TSTIBGVYUZZZ.2~ZLM2IOX34NY7.0 size=1048576 2023-12-03T11:42:07.389 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.388+0000 7f8723d84780 1 > prepared part key=_multipart_TSTIBGVYUZZZ.2~ZLM2IOX34NY7.1 size=972162 2023-12-03T11:42:07.389 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.388+0000 7f8723d84780 1 > prepared multipart upload key=TSTIBGVYUZZZ upload=ZLM2IOX34NY7 tag=6YK3E8X7P12X type=write size=3069314 2023-12-03T11:42:07.391 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.390+0000 7f8723d84780 1 < canceled operation key=LCK58DDM5XU9 tag=72YQ15XBE47E type=write size=986797 2023-12-03T11:42:07.393 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.392+0000 7f8723d84780 1 > prepared operation key=D3JEVEY0E29E tag=FN97SUBZAE02 type=del size=3878256 2023-12-03T11:42:07.395 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.394+0000 7f8723d84780 1 < suggested remove operation key=10JRIKOZ16FY tag=274YYUJZIJAA type=del 2023-12-03T11:42:07.397 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.396+0000 7f8723d84780 1 > prepared part key=_multipart_UWS266H06VDK.2~M1LX2RYZ1O8V.0 size=1048576 2023-12-03T11:42:07.398 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.397+0000 7f8723d84780 1 > prepared part key=_multipart_UWS266H06VDK.2~M1LX2RYZ1O8V.1 size=21152 2023-12-03T11:42:07.398 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.397+0000 7f8723d84780 1 > prepared multipart upload key=UWS266H06VDK upload=M1LX2RYZ1O8V tag=6AWY2DTN49QU type=write size=2118304 2023-12-03T11:42:07.400 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.399+0000 7f8723d84780 1 < completed delete operation key=O7VVHXLDSY57 tag=9FY5GCRD3REJ type=del 2023-12-03T11:42:07.401 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.400+0000 7f8723d84780 1 > prepared operation key=OPQPIDJ2PBVU tag=666M1YQUECSM type=del size=2318893 2023-12-03T11:42:07.402 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.401+0000 7f8723d84780 1 < completed part key=_multipart_931GNEXBHH35.2~QAUFN5D2TVOE.0 size=300226 2023-12-03T11:42:07.404 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.403+0000 7f8723d84780 1 < completed multipart upload key=931GNEXBHH35 upload=QAUFN5D2TVOE tag=B0N6E6QUAV42 type=write size=1348802 2023-12-03T11:42:07.405 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.404+0000 7f8723d84780 1 > prepared operation key=DMQX2DGDLU7D tag=8GWGOGAEGM33 type=write size=232564 2023-12-03T11:42:07.405 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.404+0000 7f8723d84780 1 < canceled part key=_multipart_O7VVHXLDSY57.2~NYFH0HB79VLI.0 size=1048576 2023-12-03T11:42:07.406 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.405+0000 7f8723d84780 1 < completed part key=_multipart_O7VVHXLDSY57.2~NYFH0HB79VLI.1 size=592416 2023-12-03T11:42:07.408 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.407+0000 7f8723d84780 1 < canceled multipart upload key=O7VVHXLDSY57 upload=NYFH0HB79VLI tag=VLIYEUGCVBTA type=write size=2689568 2023-12-03T11:42:07.410 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.409+0000 7f8723d84780 1 > prepared part key=_multipart_EY9ZG5KOTBWM.2~KMQ2WJSMQMOE.0 size=1048576 2023-12-03T11:42:07.410 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.409+0000 7f8723d84780 1 > prepared part key=_multipart_EY9ZG5KOTBWM.2~KMQ2WJSMQMOE.1 size=1048576 2023-12-03T11:42:07.411 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.410+0000 7f8723d84780 1 > prepared part key=_multipart_EY9ZG5KOTBWM.2~KMQ2WJSMQMOE.2 size=608643 2023-12-03T11:42:07.412 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.410+0000 7f8723d84780 1 > prepared multipart upload key=EY9ZG5KOTBWM upload=KMQ2WJSMQMOE tag=KM40HADTLHJD type=write size=3754371 2023-12-03T11:42:07.413 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.411+0000 7f8723d84780 1 < completed write operation key=AB0SN0E49Z5F tag=M28VO6CED9U4 type=write size=648715 2023-12-03T11:42:07.414 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.413+0000 7f8723d84780 1 > prepared operation key=96RAVVSUKH0Y tag=13AKRX69O0FT type=del size=2966534 2023-12-03T11:42:07.415 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.414+0000 7f8723d84780 1 < completed write operation key=Y6S7QI60GCLE tag=QW3HC732BHVU type=write size=226301 2023-12-03T11:42:07.417 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.416+0000 7f8723d84780 1 > prepared part key=_multipart_10JRIKOZ16FY.2~Y5IAB4MJBC6M.0 size=1048576 2023-12-03T11:42:07.418 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.417+0000 7f8723d84780 1 > prepared part key=_multipart_10JRIKOZ16FY.2~Y5IAB4MJBC6M.1 size=495251 2023-12-03T11:42:07.418 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.417+0000 7f8723d84780 1 > prepared multipart upload key=10JRIKOZ16FY upload=Y5IAB4MJBC6M tag=GB12ACJ0EZE5 type=write size=2592403 2023-12-03T11:42:07.421 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.418+0000 7f8723d84780 1 < completed delete operation key=W2704YS8KYQB tag=DYDFKP4KRQ41 type=del 2023-12-03T11:42:07.421 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.420+0000 7f8723d84780 1 > prepared part key=_multipart_TSTIBGVYUZZZ.2~YGN0UVP2F93V.0 size=1048576 2023-12-03T11:42:07.423 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.421+0000 7f8723d84780 1 > prepared part key=_multipart_TSTIBGVYUZZZ.2~YGN0UVP2F93V.1 size=720701 2023-12-03T11:42:07.424 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.421+0000 7f8723d84780 1 > prepared multipart upload key=TSTIBGVYUZZZ upload=YGN0UVP2F93V tag=T2GWGJJMTKL5 type=write size=2817853 2023-12-03T11:42:07.424 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.423+0000 7f8723d84780 1 < completed delete operation key=VENJI0KD1XDW tag=OTYMP7ZLXO4X type=del 2023-12-03T11:42:07.426 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.425+0000 7f8723d84780 1 > prepared part key=_multipart_UWS266H06VDK.2~46STWOIAIC4H.0 size=1048576 2023-12-03T11:42:07.428 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.426+0000 7f8723d84780 1 > prepared part key=_multipart_UWS266H06VDK.2~46STWOIAIC4H.1 size=1048576 2023-12-03T11:42:07.428 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.427+0000 7f8723d84780 1 > prepared part key=_multipart_UWS266H06VDK.2~46STWOIAIC4H.2 size=575163 2023-12-03T11:42:07.428 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.427+0000 7f8723d84780 1 > prepared multipart upload key=UWS266H06VDK upload=46STWOIAIC4H tag=9OY5L5M6OPDO type=write size=3720891 2023-12-03T11:42:07.429 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.428+0000 7f8723d84780 1 < completed part key=_multipart_LMVO6CVEPN3K.2~27HNW1WMED5A.0 size=724680 2023-12-03T11:42:07.431 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.430+0000 7f8723d84780 1 < completed multipart upload key=LMVO6CVEPN3K upload=27HNW1WMED5A tag=BAXKUR1DZ6V3 type=write size=1773256 2023-12-03T11:42:07.432 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.431+0000 7f8723d84780 1 > prepared operation key=LMVO6CVEPN3K tag=E7DPH220YXPE type=del size=4042392 2023-12-03T11:42:07.433 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.432+0000 7f8723d84780 1 < completed delete operation key=CKABTI1EOAWB tag=TEXTYBBRNDWU type=del 2023-12-03T11:42:07.434 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.433+0000 7f8723d84780 1 > prepared operation key=UWS266H06VDK tag=N4G2VJF45VA0 type=write size=302977 2023-12-03T11:42:07.435 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.434+0000 7f8723d84780 1 < completed part key=_multipart_W2704YS8KYQB.2~6IP2N8AHSS96.0 size=1048576 2023-12-03T11:42:07.436 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.435+0000 7f8723d84780 1 < completed part key=_multipart_W2704YS8KYQB.2~6IP2N8AHSS96.1 size=113425 2023-12-03T11:42:07.438 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.437+0000 7f8723d84780 1 < completed multipart upload key=W2704YS8KYQB upload=6IP2N8AHSS96 tag=138BBHJLSQIO type=write size=2210577 2023-12-03T11:42:07.440 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.439+0000 7f8723d84780 1 > prepared operation key=VENJI0KD1XDW tag=YXUK9WE180ZF type=del size=1921788 2023-12-03T11:42:07.441 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.440+0000 7f8723d84780 1 < completed part key=_multipart_7THZZ1J5LOZK.2~PV8J0UNNSPS8.0 size=689207 2023-12-03T11:42:07.443 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.442+0000 7f8723d84780 1 < completed multipart upload key=7THZZ1J5LOZK upload=PV8J0UNNSPS8 tag=GIT5SM6478LI type=write size=1737783 2023-12-03T11:42:07.444 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.443+0000 7f8723d84780 1 > prepared operation key=5UYL15O31IHM tag=JR136H5NE6A2 type=del size=686333 2023-12-03T11:42:07.445 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.444+0000 7f8723d84780 1 < completed delete operation key=HIU6L0NQ8Q95 tag=STCWWP3E67I7 type=del 2023-12-03T11:42:07.446 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.445+0000 7f8723d84780 1 > prepared operation key=K83BTR5BOLZE tag=10DFK2VNC2TQ type=del size=3938471 2023-12-03T11:42:07.447 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.446+0000 7f8723d84780 1 < canceled operation key=TSTIBGVYUZZZ tag=Y90VWXR9I8NB type=write size=519016 2023-12-03T11:42:07.449 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.448+0000 7f8723d84780 1 > prepared operation key=TSTIBGVYUZZZ tag=V0DVOZ5NES1V type=del size=4115263 2023-12-03T11:42:07.449 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.448+0000 7f8723d84780 1 < canceled part key=_multipart_TSTIBGVYUZZZ.2~ZLM2IOX34NY7.0 size=1048576 2023-12-03T11:42:07.450 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.449+0000 7f8723d84780 1 < completed part key=_multipart_TSTIBGVYUZZZ.2~ZLM2IOX34NY7.1 size=972162 2023-12-03T11:42:07.452 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.451+0000 7f8723d84780 1 < canceled multipart upload key=TSTIBGVYUZZZ upload=ZLM2IOX34NY7 tag=6YK3E8X7P12X type=write size=3069314 2023-12-03T11:42:07.454 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.453+0000 7f8723d84780 1 > prepared part key=_multipart_J33T5S893LMV.2~JHN5BBHWZUM6.0 size=1048576 2023-12-03T11:42:07.456 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.454+0000 7f8723d84780 1 > prepared part key=_multipart_J33T5S893LMV.2~JHN5BBHWZUM6.1 size=490268 2023-12-03T11:42:07.456 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.454+0000 7f8723d84780 1 > prepared multipart upload key=J33T5S893LMV upload=JHN5BBHWZUM6 tag=Z4T8NAETE39Z type=write size=2587420 2023-12-03T11:42:07.456 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.455+0000 7f8723d84780 1 < completed delete operation key=D3JEVEY0E29E tag=FN97SUBZAE02 type=del 2023-12-03T11:42:07.457 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.456+0000 7f8723d84780 1 > prepared operation key=LCK58DDM5XU9 tag=BRBJET0RU6HX type=del size=3754059 2023-12-03T11:42:07.458 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.457+0000 7f8723d84780 1 < completed part key=_multipart_UWS266H06VDK.2~M1LX2RYZ1O8V.0 size=1048576 2023-12-03T11:42:07.459 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.458+0000 7f8723d84780 1 < completed part key=_multipart_UWS266H06VDK.2~M1LX2RYZ1O8V.1 size=21152 2023-12-03T11:42:07.462 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.461+0000 7f8723d84780 1 < completed multipart upload key=UWS266H06VDK upload=M1LX2RYZ1O8V tag=6AWY2DTN49QU type=write size=2118304 2023-12-03T11:42:07.463 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.462+0000 7f8723d84780 1 > prepared operation key=FCA2R3HR61S2 tag=N6DVYQ4Y44O4 type=del size=3752468 2023-12-03T11:42:07.465 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.464+0000 7f8723d84780 1 < suggested update operation key=OPQPIDJ2PBVU tag=666M1YQUECSM type=del size=2318893 2023-12-03T11:42:07.467 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.466+0000 7f8723d84780 1 > prepared part key=_multipart_HIU6L0NQ8Q95.2~5L5AKBMURAPH.0 size=1048576 2023-12-03T11:42:07.468 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.467+0000 7f8723d84780 1 > prepared part key=_multipart_HIU6L0NQ8Q95.2~5L5AKBMURAPH.1 size=813627 2023-12-03T11:42:07.468 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.467+0000 7f8723d84780 1 > prepared multipart upload key=HIU6L0NQ8Q95 upload=5L5AKBMURAPH tag=P1QAN6C37Y6Z type=write size=2910779 2023-12-03T11:42:07.469 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.468+0000 7f8723d84780 1 < canceled operation key=DMQX2DGDLU7D tag=8GWGOGAEGM33 type=write size=232564 2023-12-03T11:42:07.470 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.469+0000 7f8723d84780 1 > prepared operation key=OGACI7CRPMT7 tag=IBQMS5H2506P type=del size=104082 2023-12-03T11:42:07.472 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.471+0000 7f8723d84780 1 < completed part key=_multipart_EY9ZG5KOTBWM.2~KMQ2WJSMQMOE.0 size=1048576 2023-12-03T11:42:07.473 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.472+0000 7f8723d84780 1 < completed part key=_multipart_EY9ZG5KOTBWM.2~KMQ2WJSMQMOE.1 size=1048576 2023-12-03T11:42:07.474 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.472+0000 7f8723d84780 1 < completed part key=_multipart_EY9ZG5KOTBWM.2~KMQ2WJSMQMOE.2 size=608643 2023-12-03T11:42:07.476 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.475+0000 7f8723d84780 1 < completed multipart upload key=EY9ZG5KOTBWM upload=KMQ2WJSMQMOE tag=KM40HADTLHJD type=write size=3754371 2023-12-03T11:42:07.478 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.477+0000 7f8723d84780 1 > prepared part key=_multipart_W2704YS8KYQB.2~3N3N1VQQN8SL.0 size=1048576 2023-12-03T11:42:07.479 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.478+0000 7f8723d84780 1 > prepared part key=_multipart_W2704YS8KYQB.2~3N3N1VQQN8SL.1 size=211844 2023-12-03T11:42:07.479 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.478+0000 7f8723d84780 1 > prepared multipart upload key=W2704YS8KYQB upload=3N3N1VQQN8SL tag=DA8CGLRCMHQ5 type=write size=2308996 2023-12-03T11:42:07.480 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.479+0000 7f8723d84780 1 < completed delete operation key=96RAVVSUKH0Y tag=13AKRX69O0FT type=del 2023-12-03T11:42:07.481 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.480+0000 7f8723d84780 1 > prepared operation key=K83BTR5BOLZE tag=BDSZNMQ6ZDE0 type=del size=2456080 2023-12-03T11:42:07.483 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.482+0000 7f8723d84780 1 < completed part key=_multipart_10JRIKOZ16FY.2~Y5IAB4MJBC6M.0 size=1048576 2023-12-03T11:42:07.484 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.483+0000 7f8723d84780 1 < completed part key=_multipart_10JRIKOZ16FY.2~Y5IAB4MJBC6M.1 size=495251 2023-12-03T11:42:07.486 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.485+0000 7f8723d84780 1 < completed multipart upload key=10JRIKOZ16FY upload=Y5IAB4MJBC6M tag=GB12ACJ0EZE5 type=write size=2592403 2023-12-03T11:42:07.488 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.487+0000 7f8723d84780 1 > prepared part key=_multipart_5UYL15O31IHM.2~Y6ACKBTXGXNZ.0 size=1048576 2023-12-03T11:42:07.490 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.489+0000 7f8723d84780 1 > prepared part key=_multipart_5UYL15O31IHM.2~Y6ACKBTXGXNZ.1 size=35965 2023-12-03T11:42:07.490 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.489+0000 7f8723d84780 1 > prepared multipart upload key=5UYL15O31IHM upload=Y6ACKBTXGXNZ tag=S28YP7MUGIX5 type=write size=2133117 2023-12-03T11:42:07.492 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.491+0000 7f8723d84780 1 < completed part key=_multipart_TSTIBGVYUZZZ.2~YGN0UVP2F93V.0 size=1048576 2023-12-03T11:42:07.493 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.492+0000 7f8723d84780 1 < completed part key=_multipart_TSTIBGVYUZZZ.2~YGN0UVP2F93V.1 size=720701 2023-12-03T11:42:07.495 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.494+0000 7f8723d84780 1 < completed multipart upload key=TSTIBGVYUZZZ upload=YGN0UVP2F93V tag=T2GWGJJMTKL5 type=write size=2817853 2023-12-03T11:42:07.496 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.495+0000 7f8723d84780 1 > prepared operation key=AB0SN0E49Z5F tag=L9C0PVWJ0D3H type=del size=921736 2023-12-03T11:42:07.498 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.496+0000 7f8723d84780 1 < completed part key=_multipart_UWS266H06VDK.2~46STWOIAIC4H.0 size=1048576 2023-12-03T11:42:07.498 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.497+0000 7f8723d84780 1 < completed part key=_multipart_UWS266H06VDK.2~46STWOIAIC4H.1 size=1048576 2023-12-03T11:42:07.499 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.498+0000 7f8723d84780 1 < completed part key=_multipart_UWS266H06VDK.2~46STWOIAIC4H.2 size=575163 2023-12-03T11:42:07.503 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.502+0000 7f8723d84780 1 < completed multipart upload key=UWS266H06VDK upload=46STWOIAIC4H tag=9OY5L5M6OPDO type=write size=3720891 2023-12-03T11:42:07.504 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.503+0000 7f8723d84780 1 > prepared operation key=HIU6L0NQ8Q95 tag=QMXDU3XMCIN2 type=del size=3589024 2023-12-03T11:42:07.505 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.504+0000 7f8723d84780 1 < completed delete operation key=LMVO6CVEPN3K tag=E7DPH220YXPE type=del 2023-12-03T11:42:07.506 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.505+0000 7f8723d84780 1 > prepared operation key=7VMTBKUWU59F tag=51Q2AKNNSJE2 type=del size=2236827 2023-12-03T11:42:07.507 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.506+0000 7f8723d84780 1 < completed write operation key=UWS266H06VDK tag=N4G2VJF45VA0 type=write size=302977 2023-12-03T11:42:07.510 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.509+0000 7f8723d84780 1 > prepared part key=_multipart_UWS266H06VDK.2~6H56B9QNDX3K.0 size=1048576 2023-12-03T11:42:07.511 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.510+0000 7f8723d84780 1 > prepared part key=_multipart_UWS266H06VDK.2~6H56B9QNDX3K.1 size=1048576 2023-12-03T11:42:07.511 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.510+0000 7f8723d84780 1 > prepared part key=_multipart_UWS266H06VDK.2~6H56B9QNDX3K.2 size=25699 2023-12-03T11:42:07.512 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.510+0000 7f8723d84780 1 > prepared multipart upload key=UWS266H06VDK upload=6H56B9QNDX3K tag=6C5YH2D3WZUT type=write size=3171427 2023-12-03T11:42:07.513 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.512+0000 7f8723d84780 1 < completed delete operation key=VENJI0KD1XDW tag=YXUK9WE180ZF type=del 2023-12-03T11:42:07.515 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.514+0000 7f8723d84780 1 > prepared part key=_multipart_UWS266H06VDK.2~2X0XVZRJ2628.0 size=1048576 2023-12-03T11:42:07.516 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.515+0000 7f8723d84780 1 > prepared part key=_multipart_UWS266H06VDK.2~2X0XVZRJ2628.1 size=1040938 2023-12-03T11:42:07.516 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.515+0000 7f8723d84780 1 > prepared multipart upload key=UWS266H06VDK upload=2X0XVZRJ2628 tag=P535ECHOU8ZK type=write size=3138090 2023-12-03T11:42:07.517 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.516+0000 7f8723d84780 1 < canceled operation key=5UYL15O31IHM tag=JR136H5NE6A2 type=del size=686333 2023-12-03T11:42:07.518 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.517+0000 7f8723d84780 1 > prepared operation key=K83BTR5BOLZE tag=LUCE82RVN1V9 type=del size=2799859 2023-12-03T11:42:07.519 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.518+0000 7f8723d84780 1 < completed delete operation key=K83BTR5BOLZE tag=10DFK2VNC2TQ type=del 2023-12-03T11:42:07.521 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.520+0000 7f8723d84780 1 > prepared operation key=7THZZ1J5LOZK tag=S74OPZL01G9L type=del size=1189751 2023-12-03T11:42:07.523 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.522+0000 7f8723d84780 1 < suggested update operation key=TSTIBGVYUZZZ tag=V0DVOZ5NES1V type=del size=4115263 2023-12-03T11:42:07.525 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.524+0000 7f8723d84780 1 > prepared part key=_multipart_CKABTI1EOAWB.2~0X333KKOT920.0 size=386088 2023-12-03T11:42:07.525 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.524+0000 7f8723d84780 1 > prepared multipart upload key=CKABTI1EOAWB upload=0X333KKOT920 tag=JQQ94K5Y3MTR type=write size=1434664 2023-12-03T11:42:07.526 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.525+0000 7f8723d84780 1 < completed part key=_multipart_J33T5S893LMV.2~JHN5BBHWZUM6.0 size=1048576 2023-12-03T11:42:07.527 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.526+0000 7f8723d84780 1 < completed part key=_multipart_J33T5S893LMV.2~JHN5BBHWZUM6.1 size=490268 2023-12-03T11:42:07.530 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.528+0000 7f8723d84780 1 < completed multipart upload key=J33T5S893LMV upload=JHN5BBHWZUM6 tag=Z4T8NAETE39Z type=write size=2587420 2023-12-03T11:42:07.532 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.531+0000 7f8723d84780 1 > prepared part key=_multipart_EY9ZG5KOTBWM.2~QAQK41JFFP2T.0 size=1048576 2023-12-03T11:42:07.533 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.532+0000 7f8723d84780 1 > prepared part key=_multipart_EY9ZG5KOTBWM.2~QAQK41JFFP2T.1 size=1048576 2023-12-03T11:42:07.534 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.532+0000 7f8723d84780 1 > prepared part key=_multipart_EY9ZG5KOTBWM.2~QAQK41JFFP2T.2 size=781663 2023-12-03T11:42:07.534 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.532+0000 7f8723d84780 1 > prepared multipart upload key=EY9ZG5KOTBWM upload=QAQK41JFFP2T tag=FA5NNL0FKVUF type=write size=3927391 2023-12-03T11:42:07.535 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.534+0000 7f8723d84780 1 < completed delete operation key=LCK58DDM5XU9 tag=BRBJET0RU6HX type=del 2023-12-03T11:42:07.536 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.535+0000 7f8723d84780 1 > prepared operation key=G36T76K8O7A1 tag=V70LUN6RI1ZK type=del size=2811408 2023-12-03T11:42:07.537 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.536+0000 7f8723d84780 1 < completed delete operation key=FCA2R3HR61S2 tag=N6DVYQ4Y44O4 type=del 2023-12-03T11:42:07.539 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.538+0000 7f8723d84780 1 > prepared part key=_multipart_LMVO6CVEPN3K.2~TVIHMJSPG6FB.0 size=1048576 2023-12-03T11:42:07.540 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.539+0000 7f8723d84780 1 > prepared part key=_multipart_LMVO6CVEPN3K.2~TVIHMJSPG6FB.1 size=1048576 2023-12-03T11:42:07.541 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.540+0000 7f8723d84780 1 > prepared part key=_multipart_LMVO6CVEPN3K.2~TVIHMJSPG6FB.2 size=389872 2023-12-03T11:42:07.541 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.540+0000 7f8723d84780 1 > prepared multipart upload key=LMVO6CVEPN3K upload=TVIHMJSPG6FB tag=J2M52ES879PZ type=write size=3535600 2023-12-03T11:42:07.543 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.542+0000 7f8723d84780 1 < completed part key=_multipart_HIU6L0NQ8Q95.2~5L5AKBMURAPH.0 size=1048576 2023-12-03T11:42:07.544 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.543+0000 7f8723d84780 1 < completed part key=_multipart_HIU6L0NQ8Q95.2~5L5AKBMURAPH.1 size=813627 2023-12-03T11:42:07.546 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.545+0000 7f8723d84780 1 < completed multipart upload key=HIU6L0NQ8Q95 upload=5L5AKBMURAPH tag=P1QAN6C37Y6Z type=write size=2910779 2023-12-03T11:42:07.547 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.546+0000 7f8723d84780 1 > prepared operation key=K83BTR5BOLZE tag=Z7A0Y60PGFWF type=write size=853348 2023-12-03T11:42:07.548 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.547+0000 7f8723d84780 1 < completed delete operation key=OGACI7CRPMT7 tag=IBQMS5H2506P type=del 2023-12-03T11:42:07.551 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.550+0000 7f8723d84780 1 > prepared part key=_multipart_7THZZ1J5LOZK.2~KKNPJQSEOU9I.0 size=1048576 2023-12-03T11:42:07.552 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.551+0000 7f8723d84780 1 > prepared part key=_multipart_7THZZ1J5LOZK.2~KKNPJQSEOU9I.1 size=1048576 2023-12-03T11:42:07.553 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.552+0000 7f8723d84780 1 > prepared part key=_multipart_7THZZ1J5LOZK.2~KKNPJQSEOU9I.2 size=1032390 2023-12-03T11:42:07.553 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.552+0000 7f8723d84780 1 > prepared multipart upload key=7THZZ1J5LOZK upload=KKNPJQSEOU9I tag=L0VB4C2RAPZE type=write size=4178118 2023-12-03T11:42:07.554 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.553+0000 7f8723d84780 1 < completed part key=_multipart_W2704YS8KYQB.2~3N3N1VQQN8SL.0 size=1048576 2023-12-03T11:42:07.556 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.554+0000 7f8723d84780 1 < completed part key=_multipart_W2704YS8KYQB.2~3N3N1VQQN8SL.1 size=211844 2023-12-03T11:42:07.557 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.557+0000 7f8723d84780 1 < completed multipart upload key=W2704YS8KYQB upload=3N3N1VQQN8SL tag=DA8CGLRCMHQ5 type=write size=2308996 2023-12-03T11:42:07.560 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.559+0000 7f8723d84780 1 > prepared part key=_multipart_4I8PWBZOLDUG.2~H5KK9NPH5J8R.0 size=1048576 2023-12-03T11:42:07.561 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.560+0000 7f8723d84780 1 > prepared part key=_multipart_4I8PWBZOLDUG.2~H5KK9NPH5J8R.1 size=1048576 2023-12-03T11:42:07.562 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.561+0000 7f8723d84780 1 > prepared part key=_multipart_4I8PWBZOLDUG.2~H5KK9NPH5J8R.2 size=9473 2023-12-03T11:42:07.562 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.561+0000 7f8723d84780 1 > prepared multipart upload key=4I8PWBZOLDUG upload=H5KK9NPH5J8R tag=T0G48WQJ3VWT type=write size=3155201 2023-12-03T11:42:07.564 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.563+0000 7f8723d84780 1 < completed delete operation key=K83BTR5BOLZE tag=BDSZNMQ6ZDE0 type=del 2023-12-03T11:42:07.565 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.564+0000 7f8723d84780 1 > prepared operation key=10JRIKOZ16FY tag=CVJFDJ71EWZ9 type=write size=651662 2023-12-03T11:42:07.566 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.565+0000 7f8723d84780 1 < completed part key=_multipart_5UYL15O31IHM.2~Y6ACKBTXGXNZ.0 size=1048576 2023-12-03T11:42:07.567 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.566+0000 7f8723d84780 1 < completed part key=_multipart_5UYL15O31IHM.2~Y6ACKBTXGXNZ.1 size=35965 2023-12-03T11:42:07.570 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.568+0000 7f8723d84780 1 < completed multipart upload key=5UYL15O31IHM upload=Y6ACKBTXGXNZ tag=S28YP7MUGIX5 type=write size=2133117 2023-12-03T11:42:07.570 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.569+0000 7f8723d84780 1 > prepared operation key=J33T5S893LMV tag=1IDS9FFSI56T type=del size=1442571 2023-12-03T11:42:07.573 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.572+0000 7f8723d84780 1 < suggested remove operation key=AB0SN0E49Z5F tag=L9C0PVWJ0D3H type=del 2023-12-03T11:42:07.574 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.573+0000 7f8723d84780 1 > prepared operation key=EY9ZG5KOTBWM tag=LW1ILMZGW9Z5 type=write size=603262 2023-12-03T11:42:07.575 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.574+0000 7f8723d84780 1 < completed delete operation key=HIU6L0NQ8Q95 tag=QMXDU3XMCIN2 type=del 2023-12-03T11:42:07.576 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.575+0000 7f8723d84780 1 > prepared operation key=M4VKPN6INFNZ tag=5NWK99UG2R9V type=write size=722946 2023-12-03T11:42:07.578 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.577+0000 7f8723d84780 1 < suggested remove operation key=7VMTBKUWU59F tag=51Q2AKNNSJE2 type=del 2023-12-03T11:42:07.579 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.578+0000 7f8723d84780 1 > prepared operation key=8NONX2I08YMJ tag=P1H9OJ4TPC0S type=del size=3859280 2023-12-03T11:42:07.581 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.580+0000 7f8723d84780 1 < completed part key=_multipart_UWS266H06VDK.2~6H56B9QNDX3K.0 size=1048576 2023-12-03T11:42:07.582 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.581+0000 7f8723d84780 1 < completed part key=_multipart_UWS266H06VDK.2~6H56B9QNDX3K.1 size=1048576 2023-12-03T11:42:07.583 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.582+0000 7f8723d84780 1 < completed part key=_multipart_UWS266H06VDK.2~6H56B9QNDX3K.2 size=25699 2023-12-03T11:42:07.585 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.584+0000 7f8723d84780 1 < completed multipart upload key=UWS266H06VDK upload=6H56B9QNDX3K tag=6C5YH2D3WZUT type=write size=3171427 2023-12-03T11:42:07.586 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.585+0000 7f8723d84780 1 > prepared operation key=LCK58DDM5XU9 tag=HCE5OED1RX24 type=del size=3435911 2023-12-03T11:42:07.587 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.586+0000 7f8723d84780 1 < completed part key=_multipart_UWS266H06VDK.2~2X0XVZRJ2628.0 size=1048576 2023-12-03T11:42:07.588 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.587+0000 7f8723d84780 1 < completed part key=_multipart_UWS266H06VDK.2~2X0XVZRJ2628.1 size=1040938 2023-12-03T11:42:07.590 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.589+0000 7f8723d84780 1 < completed multipart upload key=UWS266H06VDK upload=2X0XVZRJ2628 tag=P535ECHOU8ZK type=write size=3138090 2023-12-03T11:42:07.591 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.590+0000 7f8723d84780 1 > prepared operation key=UWS266H06VDK tag=MB0QU16P3X4C type=del size=838004 2023-12-03T11:42:07.593 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.592+0000 7f8723d84780 1 < completed delete operation key=K83BTR5BOLZE tag=LUCE82RVN1V9 type=del 2023-12-03T11:42:07.594 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.593+0000 7f8723d84780 1 > prepared operation key=CKABTI1EOAWB tag=5L3G3D15203N type=del size=3996209 2023-12-03T11:42:07.595 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.594+0000 7f8723d84780 1 < completed delete operation key=7THZZ1J5LOZK tag=S74OPZL01G9L type=del 2023-12-03T11:42:07.596 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.595+0000 7f8723d84780 1 > prepared operation key=LCK58DDM5XU9 tag=KQEIAGX7IKZB type=del size=3093958 2023-12-03T11:42:07.598 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.597+0000 7f8723d84780 1 < completed part key=_multipart_CKABTI1EOAWB.2~0X333KKOT920.0 size=386088 2023-12-03T11:42:07.600 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.599+0000 7f8723d84780 1 < completed multipart upload key=CKABTI1EOAWB upload=0X333KKOT920 tag=JQQ94K5Y3MTR type=write size=1434664 2023-12-03T11:42:07.602 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.601+0000 7f8723d84780 1 > prepared part key=_multipart_Y6S7QI60GCLE.2~ZLYBGH3XY418.0 size=491039 2023-12-03T11:42:07.602 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.601+0000 7f8723d84780 1 > prepared multipart upload key=Y6S7QI60GCLE upload=ZLYBGH3XY418 tag=9MAWJCW1CJFY type=write size=1539615 2023-12-03T11:42:07.603 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.602+0000 7f8723d84780 1 < completed part key=_multipart_EY9ZG5KOTBWM.2~QAQK41JFFP2T.0 size=1048576 2023-12-03T11:42:07.604 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.603+0000 7f8723d84780 1 < completed part key=_multipart_EY9ZG5KOTBWM.2~QAQK41JFFP2T.1 size=1048576 2023-12-03T11:42:07.605 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.604+0000 7f8723d84780 1 < completed part key=_multipart_EY9ZG5KOTBWM.2~QAQK41JFFP2T.2 size=781663 2023-12-03T11:42:07.607 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.606+0000 7f8723d84780 1 < completed multipart upload key=EY9ZG5KOTBWM upload=QAQK41JFFP2T tag=FA5NNL0FKVUF type=write size=3927391 2023-12-03T11:42:07.609 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.608+0000 7f8723d84780 1 > prepared operation key=LMVO6CVEPN3K tag=6U1ZLKLGYHYM type=del size=1290322 2023-12-03T11:42:07.610 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.609+0000 7f8723d84780 1 < completed delete operation key=G36T76K8O7A1 tag=V70LUN6RI1ZK type=del 2023-12-03T11:42:07.612 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.611+0000 7f8723d84780 1 > prepared part key=_multipart_OGACI7CRPMT7.2~LCRW74Q7NQQ8.0 size=1048576 2023-12-03T11:42:07.614 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.612+0000 7f8723d84780 1 > prepared part key=_multipart_OGACI7CRPMT7.2~LCRW74Q7NQQ8.1 size=314184 2023-12-03T11:42:07.614 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.612+0000 7f8723d84780 1 > prepared multipart upload key=OGACI7CRPMT7 upload=LCRW74Q7NQQ8 tag=38K3ZZDXPUMR type=write size=2411336 2023-12-03T11:42:07.615 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.614+0000 7f8723d84780 1 < completed part key=_multipart_LMVO6CVEPN3K.2~TVIHMJSPG6FB.0 size=1048576 2023-12-03T11:42:07.616 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.615+0000 7f8723d84780 1 < completed part key=_multipart_LMVO6CVEPN3K.2~TVIHMJSPG6FB.1 size=1048576 2023-12-03T11:42:07.617 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.616+0000 7f8723d84780 1 < completed part key=_multipart_LMVO6CVEPN3K.2~TVIHMJSPG6FB.2 size=389872 2023-12-03T11:42:07.619 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.618+0000 7f8723d84780 1 < completed multipart upload key=LMVO6CVEPN3K upload=TVIHMJSPG6FB tag=J2M52ES879PZ type=write size=3535600 2023-12-03T11:42:07.620 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.619+0000 7f8723d84780 1 > prepared operation key=7THZZ1J5LOZK tag=2SMQTMVBXPR6 type=del size=2897778 2023-12-03T11:42:07.622 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.621+0000 7f8723d84780 1 < canceled operation key=K83BTR5BOLZE tag=Z7A0Y60PGFWF type=write size=853348 2023-12-03T11:42:07.623 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.622+0000 7f8723d84780 1 > prepared operation key=D3JEVEY0E29E tag=RPJV3GDZWPV8 type=del size=1329294 2023-12-03T11:42:07.625 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.623+0000 7f8723d84780 1 < completed part key=_multipart_7THZZ1J5LOZK.2~KKNPJQSEOU9I.0 size=1048576 2023-12-03T11:42:07.625 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.624+0000 7f8723d84780 1 < completed part key=_multipart_7THZZ1J5LOZK.2~KKNPJQSEOU9I.1 size=1048576 2023-12-03T11:42:07.626 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.625+0000 7f8723d84780 1 < completed part key=_multipart_7THZZ1J5LOZK.2~KKNPJQSEOU9I.2 size=1032390 2023-12-03T11:42:07.628 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.627+0000 7f8723d84780 1 < completed multipart upload key=7THZZ1J5LOZK upload=KKNPJQSEOU9I tag=L0VB4C2RAPZE type=write size=4178118 2023-12-03T11:42:07.629 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.628+0000 7f8723d84780 1 > prepared operation key=12XG7YPYTN4U tag=TOQFIITDZX5T type=write size=212345 2023-12-03T11:42:07.630 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.629+0000 7f8723d84780 1 < completed part key=_multipart_4I8PWBZOLDUG.2~H5KK9NPH5J8R.0 size=1048576 2023-12-03T11:42:07.631 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.630+0000 7f8723d84780 1 < completed part key=_multipart_4I8PWBZOLDUG.2~H5KK9NPH5J8R.1 size=1048576 2023-12-03T11:42:07.632 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.631+0000 7f8723d84780 1 < completed part key=_multipart_4I8PWBZOLDUG.2~H5KK9NPH5J8R.2 size=9473 2023-12-03T11:42:07.634 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.633+0000 7f8723d84780 1 < completed multipart upload key=4I8PWBZOLDUG upload=H5KK9NPH5J8R tag=T0G48WQJ3VWT type=write size=3155201 2023-12-03T11:42:07.636 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.634+0000 7f8723d84780 1 > prepared operation key=UWS266H06VDK tag=34N10037S91U type=del size=1723746 2023-12-03T11:42:07.638 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.636+0000 7f8723d84780 1 < completed write operation key=10JRIKOZ16FY tag=CVJFDJ71EWZ9 type=write size=651662 2023-12-03T11:42:07.638 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.637+0000 7f8723d84780 1 > prepared operation key=HIU6L0NQ8Q95 tag=QNA4JPAEN3MH type=del size=2030929 2023-12-03T11:42:07.641 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.640+0000 7f8723d84780 1 < suggested remove operation key=J33T5S893LMV tag=1IDS9FFSI56T type=del 2023-12-03T11:42:07.642 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.641+0000 7f8723d84780 1 > prepared operation key=W2704YS8KYQB tag=5OIW1RU0HKY2 type=del size=3731984 2023-12-03T11:42:07.645 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.643+0000 7f8723d84780 1 < suggested remove operation key=EY9ZG5KOTBWM tag=LW1ILMZGW9Z5 type=write 2023-12-03T11:42:07.646 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.645+0000 7f8723d84780 1 > prepared operation key=EY9ZG5KOTBWM tag=XLF4U1LZYQ3Q type=del size=2220713 2023-12-03T11:42:07.648 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.647+0000 7f8723d84780 1 < suggested remove operation key=M4VKPN6INFNZ tag=5NWK99UG2R9V type=write 2023-12-03T11:42:07.650 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.649+0000 7f8723d84780 1 > prepared part key=_multipart_FCA2R3HR61S2.2~UKQRL0BM1INK.0 size=645008 2023-12-03T11:42:07.650 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.649+0000 7f8723d84780 1 > prepared multipart upload key=FCA2R3HR61S2 upload=UKQRL0BM1INK tag=7F5U2UTW0Z35 type=write size=1693584 2023-12-03T11:42:07.652 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.651+0000 7f8723d84780 1 < suggested update operation key=8NONX2I08YMJ tag=P1H9OJ4TPC0S type=del size=3859280 2023-12-03T11:42:07.655 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.653+0000 7f8723d84780 1 > prepared part key=_multipart_5UYL15O31IHM.2~TVBRXS1MBFCK.0 size=563015 2023-12-03T11:42:07.655 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.653+0000 7f8723d84780 1 > prepared multipart upload key=5UYL15O31IHM upload=TVBRXS1MBFCK tag=LDQ3HF7WN4GI type=write size=1611591 2023-12-03T11:42:07.657 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.655+0000 7f8723d84780 1 < suggested update operation key=LCK58DDM5XU9 tag=HCE5OED1RX24 type=del size=3435911 2023-12-03T11:42:07.658 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.657+0000 7f8723d84780 1 > prepared part key=_multipart_UWS266H06VDK.2~E24T578MVALP.0 size=364697 2023-12-03T11:42:07.658 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.657+0000 7f8723d84780 1 > prepared multipart upload key=UWS266H06VDK upload=E24T578MVALP tag=QNLHKW2KN1F2 type=write size=1413273 2023-12-03T11:42:07.659 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.658+0000 7f8723d84780 1 < canceled operation key=UWS266H06VDK tag=MB0QU16P3X4C type=del size=838004 2023-12-03T11:42:07.660 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.659+0000 7f8723d84780 1 > prepared operation key=D3JEVEY0E29E tag=T70V1SRXYDHQ type=del size=41957 2023-12-03T11:42:07.662 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.661+0000 7f8723d84780 1 < completed delete operation key=CKABTI1EOAWB tag=5L3G3D15203N type=del 2023-12-03T11:42:07.664 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.663+0000 7f8723d84780 1 > prepared part key=_multipart_FCA2R3HR61S2.2~4M4DPPWE2NB7.0 size=1048576 2023-12-03T11:42:07.665 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.664+0000 7f8723d84780 1 > prepared part key=_multipart_FCA2R3HR61S2.2~4M4DPPWE2NB7.1 size=529517 2023-12-03T11:42:07.665 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.664+0000 7f8723d84780 1 > prepared multipart upload key=FCA2R3HR61S2 upload=4M4DPPWE2NB7 tag=9QVIMPDDLN73 type=write size=2626669 2023-12-03T11:42:07.666 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.665+0000 7f8723d84780 -1 < failed to complete operation key=LCK58DDM5XU9 tag=KQEIAGX7IKZB type=del size=3093958: (22) Invalid argument 2023-12-03T11:42:07.668 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.667+0000 7f8723d84780 1 > prepared part key=_multipart_UWS266H06VDK.2~09AMYVWAUBDC.0 size=1048576 2023-12-03T11:42:07.669 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.668+0000 7f8723d84780 1 > prepared part key=_multipart_UWS266H06VDK.2~09AMYVWAUBDC.1 size=1048576 2023-12-03T11:42:07.670 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.669+0000 7f8723d84780 1 > prepared part key=_multipart_UWS266H06VDK.2~09AMYVWAUBDC.2 size=137904 2023-12-03T11:42:07.670 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.669+0000 7f8723d84780 1 > prepared multipart upload key=UWS266H06VDK upload=09AMYVWAUBDC tag=LLJEEMTCOYQL type=write size=3283632 2023-12-03T11:42:07.671 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.670+0000 7f8723d84780 1 < completed part key=_multipart_Y6S7QI60GCLE.2~ZLYBGH3XY418.0 size=491039 2023-12-03T11:42:07.673 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.672+0000 7f8723d84780 1 < completed multipart upload key=Y6S7QI60GCLE upload=ZLYBGH3XY418 tag=9MAWJCW1CJFY type=write size=1539615 2023-12-03T11:42:07.675 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.674+0000 7f8723d84780 1 > prepared part key=_multipart_7VMTBKUWU59F.2~2X544TNJYASE.0 size=1048576 2023-12-03T11:42:07.676 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.675+0000 7f8723d84780 1 > prepared part key=_multipart_7VMTBKUWU59F.2~2X544TNJYASE.1 size=1048576 2023-12-03T11:42:07.677 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.676+0000 7f8723d84780 1 > prepared part key=_multipart_7VMTBKUWU59F.2~2X544TNJYASE.2 size=68512 2023-12-03T11:42:07.677 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.676+0000 7f8723d84780 1 > prepared multipart upload key=7VMTBKUWU59F upload=2X544TNJYASE tag=1TN8W6DSOWJQ type=write size=3214240 2023-12-03T11:42:07.678 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.677+0000 7f8723d84780 1 < completed delete operation key=LMVO6CVEPN3K tag=6U1ZLKLGYHYM type=del 2023-12-03T11:42:07.682 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.679+0000 7f8723d84780 1 > prepared part key=_multipart_D3JEVEY0E29E.2~7P8TS7P03E5K.0 size=1048576 2023-12-03T11:42:07.682 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.680+0000 7f8723d84780 1 > prepared part key=_multipart_D3JEVEY0E29E.2~7P8TS7P03E5K.1 size=844117 2023-12-03T11:42:07.682 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.680+0000 7f8723d84780 1 > prepared multipart upload key=D3JEVEY0E29E upload=7P8TS7P03E5K tag=OPFENN312QA6 type=write size=2941269 2023-12-03T11:42:07.683 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.682+0000 7f8723d84780 1 < completed part key=_multipart_OGACI7CRPMT7.2~LCRW74Q7NQQ8.0 size=1048576 2023-12-03T11:42:07.684 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.683+0000 7f8723d84780 1 < completed part key=_multipart_OGACI7CRPMT7.2~LCRW74Q7NQQ8.1 size=314184 2023-12-03T11:42:07.686 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.685+0000 7f8723d84780 1 < completed multipart upload key=OGACI7CRPMT7 upload=LCRW74Q7NQQ8 tag=38K3ZZDXPUMR type=write size=2411336 2023-12-03T11:42:07.688 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.686+0000 7f8723d84780 1 > prepared operation key=TSTIBGVYUZZZ tag=PB0C9S1B636V type=del size=3630981 2023-12-03T11:42:07.690 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.689+0000 7f8723d84780 1 < suggested remove operation key=7THZZ1J5LOZK tag=2SMQTMVBXPR6 type=del 2023-12-03T11:42:07.691 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.690+0000 7f8723d84780 1 > prepared operation key=J33T5S893LMV tag=PLL9KDMSZUWN type=del size=4106462 2023-12-03T11:42:07.692 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.691+0000 7f8723d84780 1 < completed delete operation key=D3JEVEY0E29E tag=RPJV3GDZWPV8 type=del 2023-12-03T11:42:07.693 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.692+0000 7f8723d84780 1 > prepared operation key=W2704YS8KYQB tag=WU5CTEDD4COK type=del size=4013230 2023-12-03T11:42:07.695 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.694+0000 7f8723d84780 1 < canceled operation key=12XG7YPYTN4U tag=TOQFIITDZX5T type=write size=212345 2023-12-03T11:42:07.696 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.695+0000 7f8723d84780 1 > prepared operation key=OGACI7CRPMT7 tag=P99FCVO02S8V type=del size=3108231 2023-12-03T11:42:07.697 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.696+0000 7f8723d84780 1 < completed delete operation key=UWS266H06VDK tag=34N10037S91U type=del 2023-12-03T11:42:07.699 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.698+0000 7f8723d84780 1 > prepared operation key=EITMJKL0LCYC tag=JU7TPVLI51US type=del size=2140907 2023-12-03T11:42:07.700 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.699+0000 7f8723d84780 1 < canceled operation key=HIU6L0NQ8Q95 tag=QNA4JPAEN3MH type=del size=2030929 2023-12-03T11:42:07.701 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.700+0000 7f8723d84780 1 > prepared operation key=W2704YS8KYQB tag=MMYRE1MOV86L type=del size=213329 2023-12-03T11:42:07.704 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.703+0000 7f8723d84780 1 < suggested update operation key=W2704YS8KYQB tag=5OIW1RU0HKY2 type=del size=3731984 2023-12-03T11:42:07.706 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.704+0000 7f8723d84780 1 > prepared operation key=KS5J7E7KE2IJ tag=1D8CNJPFQ47A type=del size=2801233 2023-12-03T11:42:07.707 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.706+0000 7f8723d84780 1 < completed delete operation key=EY9ZG5KOTBWM tag=XLF4U1LZYQ3Q type=del 2023-12-03T11:42:07.708 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.707+0000 7f8723d84780 1 > prepared operation key=TSTIBGVYUZZZ tag=MWNRU62ZHW8R type=write size=223019 2023-12-03T11:42:07.709 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.708+0000 7f8723d84780 1 < completed part key=_multipart_FCA2R3HR61S2.2~UKQRL0BM1INK.0 size=645008 2023-12-03T11:42:07.711 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.710+0000 7f8723d84780 1 < completed multipart upload key=FCA2R3HR61S2 upload=UKQRL0BM1INK tag=7F5U2UTW0Z35 type=write size=1693584 2023-12-03T11:42:07.713 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.712+0000 7f8723d84780 1 > prepared operation key=K83BTR5BOLZE tag=2JUVNKKY1M61 type=del size=1160903 2023-12-03T11:42:07.714 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.713+0000 7f8723d84780 1 < completed part key=_multipart_5UYL15O31IHM.2~TVBRXS1MBFCK.0 size=563015 2023-12-03T11:42:07.718 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.717+0000 7f8723d84780 1 < completed multipart upload key=5UYL15O31IHM upload=TVBRXS1MBFCK tag=LDQ3HF7WN4GI type=write size=1611591 2023-12-03T11:42:07.720 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.719+0000 7f8723d84780 1 > prepared part key=_multipart_5UYL15O31IHM.2~0B5MNC2VFU8I.0 size=26283 2023-12-03T11:42:07.720 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.719+0000 7f8723d84780 1 > prepared multipart upload key=5UYL15O31IHM upload=0B5MNC2VFU8I tag=K31MKNBF1D4F type=write size=1074859 2023-12-03T11:42:07.722 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.721+0000 7f8723d84780 1 < completed part key=_multipart_UWS266H06VDK.2~E24T578MVALP.0 size=364697 2023-12-03T11:42:07.724 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.723+0000 7f8723d84780 1 < completed multipart upload key=UWS266H06VDK upload=E24T578MVALP tag=QNLHKW2KN1F2 type=write size=1413273 2023-12-03T11:42:07.726 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.725+0000 7f8723d84780 1 > prepared part key=_multipart_EITMJKL0LCYC.2~32C0HFNXQ480.0 size=464033 2023-12-03T11:42:07.726 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.725+0000 7f8723d84780 1 > prepared multipart upload key=EITMJKL0LCYC upload=32C0HFNXQ480 tag=LSMHNOMZNZT2 type=write size=1512609 2023-12-03T11:42:07.727 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.726+0000 7f8723d84780 1 < completed delete operation key=D3JEVEY0E29E tag=T70V1SRXYDHQ type=del 2023-12-03T11:42:07.729 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.728+0000 7f8723d84780 1 > prepared part key=_multipart_96RAVVSUKH0Y.2~M86F0I4GEBDL.0 size=763459 2023-12-03T11:42:07.729 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.728+0000 7f8723d84780 1 > prepared multipart upload key=96RAVVSUKH0Y upload=M86F0I4GEBDL tag=KKPZDDF6QC7C type=write size=1812035 2023-12-03T11:42:07.732 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.731+0000 7f8723d84780 1 < completed part key=_multipart_FCA2R3HR61S2.2~4M4DPPWE2NB7.0 size=1048576 2023-12-03T11:42:07.733 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.732+0000 7f8723d84780 1 < completed part key=_multipart_FCA2R3HR61S2.2~4M4DPPWE2NB7.1 size=529517 2023-12-03T11:42:07.736 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.735+0000 7f8723d84780 1 < completed multipart upload key=FCA2R3HR61S2 upload=4M4DPPWE2NB7 tag=9QVIMPDDLN73 type=write size=2626669 2023-12-03T11:42:07.738 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.737+0000 7f8723d84780 1 > prepared operation key=VENJI0KD1XDW tag=3A6XK9GS7KKJ type=del size=2595729 2023-12-03T11:42:07.738 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.737+0000 7f8723d84780 1 < canceled part key=_multipart_UWS266H06VDK.2~09AMYVWAUBDC.0 size=1048576 2023-12-03T11:42:07.738 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.737+0000 7f8723d84780 1 < canceled part key=_multipart_UWS266H06VDK.2~09AMYVWAUBDC.1 size=1048576 2023-12-03T11:42:07.739 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.738+0000 7f8723d84780 1 < completed part key=_multipart_UWS266H06VDK.2~09AMYVWAUBDC.2 size=137904 2023-12-03T11:42:07.741 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.740+0000 7f8723d84780 1 < canceled multipart upload key=UWS266H06VDK upload=09AMYVWAUBDC tag=LLJEEMTCOYQL type=write size=3283632 2023-12-03T11:42:07.742 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.741+0000 7f8723d84780 1 > prepared operation key=8NONX2I08YMJ tag=Y7RQ8I43L8VZ type=del size=2568730 2023-12-03T11:42:07.742 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.741+0000 7f8723d84780 1 < canceled part key=_multipart_7VMTBKUWU59F.2~2X544TNJYASE.0 size=1048576 2023-12-03T11:42:07.743 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.742+0000 7f8723d84780 1 < completed part key=_multipart_7VMTBKUWU59F.2~2X544TNJYASE.1 size=1048576 2023-12-03T11:42:07.744 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.743+0000 7f8723d84780 1 < completed part key=_multipart_7VMTBKUWU59F.2~2X544TNJYASE.2 size=68512 2023-12-03T11:42:07.746 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.745+0000 7f8723d84780 1 < canceled multipart upload key=7VMTBKUWU59F upload=2X544TNJYASE tag=1TN8W6DSOWJQ type=write size=3214240 2023-12-03T11:42:07.747 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.746+0000 7f8723d84780 1 > prepared operation key=931GNEXBHH35 tag=K61SMCTU45I1 type=del size=464253 2023-12-03T11:42:07.749 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.748+0000 7f8723d84780 1 < completed part key=_multipart_D3JEVEY0E29E.2~7P8TS7P03E5K.0 size=1048576 2023-12-03T11:42:07.750 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.749+0000 7f8723d84780 1 < completed part key=_multipart_D3JEVEY0E29E.2~7P8TS7P03E5K.1 size=844117 2023-12-03T11:42:07.752 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.751+0000 7f8723d84780 1 < completed multipart upload key=D3JEVEY0E29E upload=7P8TS7P03E5K tag=OPFENN312QA6 type=write size=2941269 2023-12-03T11:42:07.753 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.752+0000 7f8723d84780 1 > prepared operation key=96RAVVSUKH0Y tag=G1I5PORS3OB4 type=del size=776416 2023-12-03T11:42:07.754 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.753+0000 7f8723d84780 1 < canceled operation key=TSTIBGVYUZZZ tag=PB0C9S1B636V type=del size=3630981 2023-12-03T11:42:07.755 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.754+0000 7f8723d84780 1 > prepared operation key=LCK58DDM5XU9 tag=5G3VVTIMW7Z8 type=write size=600991 2023-12-03T11:42:07.756 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.756+0000 7f8723d84780 1 < completed delete operation key=J33T5S893LMV tag=PLL9KDMSZUWN type=del 2023-12-03T11:42:07.758 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.757+0000 7f8723d84780 1 > prepared operation key=OPQPIDJ2PBVU tag=KICS4WA15YOW type=del size=2690617 2023-12-03T11:42:07.759 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.758+0000 7f8723d84780 -1 < failed to complete operation key=W2704YS8KYQB tag=WU5CTEDD4COK type=del size=4013230: (22) Invalid argument 2023-12-03T11:42:07.760 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.759+0000 7f8723d84780 1 > prepared operation key=FCA2R3HR61S2 tag=91HR112XYOVI type=write size=319902 2023-12-03T11:42:07.761 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.760+0000 7f8723d84780 1 < completed delete operation key=OGACI7CRPMT7 tag=P99FCVO02S8V type=del 2023-12-03T11:42:07.763 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.762+0000 7f8723d84780 1 > prepared part key=_multipart_FCA2R3HR61S2.2~CO1WO8ZXOB0B.0 size=1048576 2023-12-03T11:42:07.764 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.763+0000 7f8723d84780 1 > prepared part key=_multipart_FCA2R3HR61S2.2~CO1WO8ZXOB0B.1 size=1048576 2023-12-03T11:42:07.765 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.764+0000 7f8723d84780 1 > prepared part key=_multipart_FCA2R3HR61S2.2~CO1WO8ZXOB0B.2 size=755051 2023-12-03T11:42:07.765 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.764+0000 7f8723d84780 1 > prepared multipart upload key=FCA2R3HR61S2 upload=CO1WO8ZXOB0B tag=ZPHJBGJU8WOS type=write size=3900779 2023-12-03T11:42:07.767 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.766+0000 7f8723d84780 1 < suggested remove operation key=EITMJKL0LCYC tag=JU7TPVLI51US type=del 2023-12-03T11:42:07.769 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.768+0000 7f8723d84780 1 > prepared operation key=5UYL15O31IHM tag=YB0IUHWYKHQA type=del size=2974955 2023-12-03T11:42:07.772 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.769+0000 7f8723d84780 -1 < failed to complete operation key=W2704YS8KYQB tag=MMYRE1MOV86L type=del size=213329: (22) Invalid argument 2023-12-03T11:42:07.773 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.770+0000 7f8723d84780 1 > prepared operation key=G36T76K8O7A1 tag=RPN98JG1H13C type=del size=3663323 2023-12-03T11:42:07.773 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.771+0000 7f8723d84780 1 < completed delete operation key=KS5J7E7KE2IJ tag=1D8CNJPFQ47A type=del 2023-12-03T11:42:07.774 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.773+0000 7f8723d84780 1 > prepared part key=_multipart_O7VVHXLDSY57.2~0B8DNK1CEX38.0 size=312575 2023-12-03T11:42:07.775 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.773+0000 7f8723d84780 1 > prepared multipart upload key=O7VVHXLDSY57 upload=0B8DNK1CEX38 tag=3WI3QG2Q7I67 type=write size=1361151 2023-12-03T11:42:07.775 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.774+0000 7f8723d84780 1 < completed write operation key=TSTIBGVYUZZZ tag=MWNRU62ZHW8R type=write size=223019 2023-12-03T11:42:07.777 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.776+0000 7f8723d84780 1 > prepared operation key=931GNEXBHH35 tag=I4ZKTAA2EWO4 type=del size=3367452 2023-12-03T11:42:07.778 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.777+0000 7f8723d84780 1 < completed delete operation key=K83BTR5BOLZE tag=2JUVNKKY1M61 type=del 2023-12-03T11:42:07.779 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.778+0000 7f8723d84780 1 > prepared operation key=7VMTBKUWU59F tag=7DSR5H3TGR0T type=write size=405701 2023-12-03T11:42:07.780 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.779+0000 7f8723d84780 1 < completed part key=_multipart_5UYL15O31IHM.2~0B5MNC2VFU8I.0 size=26283 2023-12-03T11:42:07.782 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.781+0000 7f8723d84780 1 < completed multipart upload key=5UYL15O31IHM upload=0B5MNC2VFU8I tag=K31MKNBF1D4F type=write size=1074859 2023-12-03T11:42:07.783 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.782+0000 7f8723d84780 1 > prepared operation key=UWS266H06VDK tag=VRSLOGAJQ95E type=del size=1272437 2023-12-03T11:42:07.785 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.783+0000 7f8723d84780 1 < completed part key=_multipart_EITMJKL0LCYC.2~32C0HFNXQ480.0 size=464033 2023-12-03T11:42:07.786 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.785+0000 7f8723d84780 1 < completed multipart upload key=EITMJKL0LCYC upload=32C0HFNXQ480 tag=LSMHNOMZNZT2 type=write size=1512609 2023-12-03T11:42:07.787 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.787+0000 7f8723d84780 1 > prepared operation key=4I8PWBZOLDUG tag=Z90GGNKZG4HL type=del size=3805338 2023-12-03T11:42:07.789 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.788+0000 7f8723d84780 1 < completed part key=_multipart_96RAVVSUKH0Y.2~M86F0I4GEBDL.0 size=763459 2023-12-03T11:42:07.790 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.790+0000 7f8723d84780 1 < completed multipart upload key=96RAVVSUKH0Y upload=M86F0I4GEBDL tag=KKPZDDF6QC7C type=write size=1812035 2023-12-03T11:42:07.792 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.791+0000 7f8723d84780 1 > prepared operation key=EITMJKL0LCYC tag=ZLL28GMDVB7O type=del size=2072439 2023-12-03T11:42:07.794 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.793+0000 7f8723d84780 1 < suggested remove operation key=VENJI0KD1XDW tag=3A6XK9GS7KKJ type=del 2023-12-03T11:42:07.796 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.795+0000 7f8723d84780 1 > prepared operation key=CKABTI1EOAWB tag=KTQRX4KIZ6E4 type=write size=366330 2023-12-03T11:42:07.797 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.796+0000 7f8723d84780 1 < canceled operation key=8NONX2I08YMJ tag=Y7RQ8I43L8VZ type=del size=2568730 2023-12-03T11:42:07.799 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.798+0000 7f8723d84780 1 > prepared part key=_multipart_931GNEXBHH35.2~ID1XYUJVMWAV.0 size=1048576 2023-12-03T11:42:07.800 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.799+0000 7f8723d84780 1 > prepared part key=_multipart_931GNEXBHH35.2~ID1XYUJVMWAV.1 size=839458 2023-12-03T11:42:07.800 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.799+0000 7f8723d84780 1 > prepared multipart upload key=931GNEXBHH35 upload=ID1XYUJVMWAV tag=T5IWKM69N0P9 type=write size=2936610 2023-12-03T11:42:07.802 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.800+0000 7f8723d84780 1 < completed delete operation key=931GNEXBHH35 tag=K61SMCTU45I1 type=del 2023-12-03T11:42:07.804 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.803+0000 7f8723d84780 1 > prepared part key=_multipart_OPQPIDJ2PBVU.2~GUEUMH41EDBV.0 size=837063 2023-12-03T11:42:07.804 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.803+0000 7f8723d84780 1 > prepared multipart upload key=OPQPIDJ2PBVU upload=GUEUMH41EDBV tag=YJ2JT8UZ3SOQ type=write size=1885639 2023-12-03T11:42:07.806 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.805+0000 7f8723d84780 1 < suggested update operation key=96RAVVSUKH0Y tag=G1I5PORS3OB4 type=del size=776416 2023-12-03T11:42:07.808 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.807+0000 7f8723d84780 1 > prepared part key=_multipart_FCA2R3HR61S2.2~UBC27QITDRGU.0 size=1048576 2023-12-03T11:42:07.809 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.808+0000 7f8723d84780 1 > prepared part key=_multipart_FCA2R3HR61S2.2~UBC27QITDRGU.1 size=873470 2023-12-03T11:42:07.809 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.808+0000 7f8723d84780 1 > prepared multipart upload key=FCA2R3HR61S2 upload=UBC27QITDRGU tag=062YS6D86T1X type=write size=2970622 2023-12-03T11:42:07.810 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.809+0000 7f8723d84780 1 < completed write operation key=LCK58DDM5XU9 tag=5G3VVTIMW7Z8 type=write size=600991 2023-12-03T11:42:07.813 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.812+0000 7f8723d84780 1 > prepared part key=_multipart_HIU6L0NQ8Q95.2~LR9UUBP921TB.0 size=1048576 2023-12-03T11:42:07.813 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.812+0000 7f8723d84780 1 > prepared part key=_multipart_HIU6L0NQ8Q95.2~LR9UUBP921TB.1 size=1048576 2023-12-03T11:42:07.815 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.814+0000 7f8723d84780 1 > prepared part key=_multipart_HIU6L0NQ8Q95.2~LR9UUBP921TB.2 size=953195 2023-12-03T11:42:07.815 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.814+0000 7f8723d84780 1 > prepared multipart upload key=HIU6L0NQ8Q95 upload=LR9UUBP921TB tag=K6Y5XMPL4WB8 type=write size=4098923 2023-12-03T11:42:07.816 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.815+0000 7f8723d84780 1 < completed delete operation key=OPQPIDJ2PBVU tag=KICS4WA15YOW type=del 2023-12-03T11:42:07.817 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.816+0000 7f8723d84780 1 > prepared operation key=LCK58DDM5XU9 tag=7PLJ6VCK4O4M type=del size=1703528 2023-12-03T11:42:07.818 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.817+0000 7f8723d84780 1 < completed write operation key=FCA2R3HR61S2 tag=91HR112XYOVI type=write size=319902 2023-12-03T11:42:07.820 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.819+0000 7f8723d84780 1 > prepared operation key=UWS266H06VDK tag=FYVBQ6E254SM type=del size=2681886 2023-12-03T11:42:07.821 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.820+0000 7f8723d84780 1 < completed part key=_multipart_FCA2R3HR61S2.2~CO1WO8ZXOB0B.0 size=1048576 2023-12-03T11:42:07.822 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.821+0000 7f8723d84780 1 < completed part key=_multipart_FCA2R3HR61S2.2~CO1WO8ZXOB0B.1 size=1048576 2023-12-03T11:42:07.823 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.822+0000 7f8723d84780 1 < completed part key=_multipart_FCA2R3HR61S2.2~CO1WO8ZXOB0B.2 size=755051 2023-12-03T11:42:07.825 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.824+0000 7f8723d84780 1 < completed multipart upload key=FCA2R3HR61S2 upload=CO1WO8ZXOB0B tag=ZPHJBGJU8WOS type=write size=3900779 2023-12-03T11:42:07.827 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.826+0000 7f8723d84780 1 > prepared part key=_multipart_D3JEVEY0E29E.2~2TFL0DBKT5BU.0 size=1048576 2023-12-03T11:42:07.828 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.827+0000 7f8723d84780 1 > prepared part key=_multipart_D3JEVEY0E29E.2~2TFL0DBKT5BU.1 size=662820 2023-12-03T11:42:07.828 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.827+0000 7f8723d84780 1 > prepared multipart upload key=D3JEVEY0E29E upload=2TFL0DBKT5BU tag=NBQ8561OJX14 type=write size=2759972 2023-12-03T11:42:07.829 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.828+0000 7f8723d84780 1 < completed delete operation key=5UYL15O31IHM tag=YB0IUHWYKHQA type=del 2023-12-03T11:42:07.833 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.830+0000 7f8723d84780 1 > prepared part key=_multipart_J33T5S893LMV.2~VSHINZ3C12T4.0 size=1048576 2023-12-03T11:42:07.833 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.831+0000 7f8723d84780 1 > prepared part key=_multipart_J33T5S893LMV.2~VSHINZ3C12T4.1 size=1048576 2023-12-03T11:42:07.833 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.832+0000 7f8723d84780 1 > prepared part key=_multipart_J33T5S893LMV.2~VSHINZ3C12T4.2 size=779269 2023-12-03T11:42:07.833 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.832+0000 7f8723d84780 1 > prepared multipart upload key=J33T5S893LMV upload=VSHINZ3C12T4 tag=TS1I1XY28SA4 type=write size=3924997 2023-12-03T11:42:07.838 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.834+0000 7f8723d84780 1 < suggested update operation key=G36T76K8O7A1 tag=RPN98JG1H13C type=del size=3663323 2023-12-03T11:42:07.838 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.836+0000 7f8723d84780 1 > prepared part key=_multipart_W2704YS8KYQB.2~ZUUCQLY47M0F.0 size=1048576 2023-12-03T11:42:07.839 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.838+0000 7f8723d84780 1 > prepared part key=_multipart_W2704YS8KYQB.2~ZUUCQLY47M0F.1 size=88541 2023-12-03T11:42:07.839 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.838+0000 7f8723d84780 1 > prepared multipart upload key=W2704YS8KYQB upload=ZUUCQLY47M0F tag=I94ASDUOJ3HB type=write size=2185693 2023-12-03T11:42:07.840 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.839+0000 7f8723d84780 1 < completed part key=_multipart_O7VVHXLDSY57.2~0B8DNK1CEX38.0 size=312575 2023-12-03T11:42:07.842 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.841+0000 7f8723d84780 1 < completed multipart upload key=O7VVHXLDSY57 upload=0B8DNK1CEX38 tag=3WI3QG2Q7I67 type=write size=1361151 2023-12-03T11:42:07.843 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.842+0000 7f8723d84780 1 > prepared operation key=TSTIBGVYUZZZ tag=9WO8ZYITM2QH type=write size=495131 2023-12-03T11:42:07.846 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.845+0000 7f8723d84780 1 < suggested update operation key=931GNEXBHH35 tag=I4ZKTAA2EWO4 type=del size=3367452 2023-12-03T11:42:07.848 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.847+0000 7f8723d84780 1 > prepared part key=_multipart_K83BTR5BOLZE.2~CIECORH6V10T.0 size=1048576 2023-12-03T11:42:07.849 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.848+0000 7f8723d84780 1 > prepared part key=_multipart_K83BTR5BOLZE.2~CIECORH6V10T.1 size=1048576 2023-12-03T11:42:07.850 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.849+0000 7f8723d84780 1 > prepared part key=_multipart_K83BTR5BOLZE.2~CIECORH6V10T.2 size=345752 2023-12-03T11:42:07.850 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.849+0000 7f8723d84780 1 > prepared multipart upload key=K83BTR5BOLZE upload=CIECORH6V10T tag=Y75FXQD62AIY type=write size=3491480 2023-12-03T11:42:07.851 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.850+0000 7f8723d84780 1 < completed write operation key=7VMTBKUWU59F tag=7DSR5H3TGR0T type=write size=405701 2023-12-03T11:42:07.852 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.851+0000 7f8723d84780 1 > prepared operation key=10JRIKOZ16FY tag=ZFNINI272LTR type=del size=3037057 2023-12-03T11:42:07.854 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.852+0000 7f8723d84780 1 < canceled operation key=UWS266H06VDK tag=VRSLOGAJQ95E type=del size=1272437 2023-12-03T11:42:07.855 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.854+0000 7f8723d84780 1 > prepared operation key=7THZZ1J5LOZK tag=JBUSXY8L29HX type=write size=444920 2023-12-03T11:42:07.856 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.855+0000 7f8723d84780 1 < completed delete operation key=4I8PWBZOLDUG tag=Z90GGNKZG4HL type=del 2023-12-03T11:42:07.857 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.856+0000 7f8723d84780 1 > prepared operation key=12XG7YPYTN4U tag=LH46YMEM2J1M type=del size=3268426 2023-12-03T11:42:07.858 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.857+0000 7f8723d84780 1 < completed delete operation key=EITMJKL0LCYC tag=ZLL28GMDVB7O type=del 2023-12-03T11:42:07.861 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.860+0000 7f8723d84780 1 > prepared part key=_multipart_K83BTR5BOLZE.2~R19R6CO4NQ3B.0 size=1048576 2023-12-03T11:42:07.862 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.861+0000 7f8723d84780 1 > prepared part key=_multipart_K83BTR5BOLZE.2~R19R6CO4NQ3B.1 size=1048576 2023-12-03T11:42:07.863 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.862+0000 7f8723d84780 1 > prepared part key=_multipart_K83BTR5BOLZE.2~R19R6CO4NQ3B.2 size=448698 2023-12-03T11:42:07.863 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.862+0000 7f8723d84780 1 > prepared multipart upload key=K83BTR5BOLZE upload=R19R6CO4NQ3B tag=DMXVJ7XQVH9C type=write size=3594426 2023-12-03T11:42:07.864 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.863+0000 7f8723d84780 1 < canceled operation key=CKABTI1EOAWB tag=KTQRX4KIZ6E4 type=write size=366330 2023-12-03T11:42:07.865 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.864+0000 7f8723d84780 1 > prepared operation key=OGACI7CRPMT7 tag=CAT9TYP9KG2N type=del size=3960677 2023-12-03T11:42:07.866 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.865+0000 7f8723d84780 1 < completed part key=_multipart_931GNEXBHH35.2~ID1XYUJVMWAV.0 size=1048576 2023-12-03T11:42:07.867 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.866+0000 7f8723d84780 1 < completed part key=_multipart_931GNEXBHH35.2~ID1XYUJVMWAV.1 size=839458 2023-12-03T11:42:07.869 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.868+0000 7f8723d84780 1 < completed multipart upload key=931GNEXBHH35 upload=ID1XYUJVMWAV tag=T5IWKM69N0P9 type=write size=2936610 2023-12-03T11:42:07.871 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.870+0000 7f8723d84780 1 > prepared part key=_multipart_W2704YS8KYQB.2~KHMZ910AMBL4.0 size=1048576 2023-12-03T11:42:07.872 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.871+0000 7f8723d84780 1 > prepared part key=_multipart_W2704YS8KYQB.2~KHMZ910AMBL4.1 size=642310 2023-12-03T11:42:07.872 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.871+0000 7f8723d84780 1 > prepared multipart upload key=W2704YS8KYQB upload=KHMZ910AMBL4 tag=LJVTNIMADNKX type=write size=2739462 2023-12-03T11:42:07.873 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.872+0000 7f8723d84780 1 < completed part key=_multipart_OPQPIDJ2PBVU.2~GUEUMH41EDBV.0 size=837063 2023-12-03T11:42:07.875 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.874+0000 7f8723d84780 1 < completed multipart upload key=OPQPIDJ2PBVU upload=GUEUMH41EDBV tag=YJ2JT8UZ3SOQ type=write size=1885639 2023-12-03T11:42:07.876 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.875+0000 7f8723d84780 1 > prepared operation key=LMVO6CVEPN3K tag=S8DEGLP8MD0T type=del size=2589146 2023-12-03T11:42:07.877 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.876+0000 7f8723d84780 1 < completed part key=_multipart_FCA2R3HR61S2.2~UBC27QITDRGU.0 size=1048576 2023-12-03T11:42:07.878 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.877+0000 7f8723d84780 1 < completed part key=_multipart_FCA2R3HR61S2.2~UBC27QITDRGU.1 size=873470 2023-12-03T11:42:07.880 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.879+0000 7f8723d84780 1 < completed multipart upload key=FCA2R3HR61S2 upload=UBC27QITDRGU tag=062YS6D86T1X type=write size=2970622 2023-12-03T11:42:07.882 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.881+0000 7f8723d84780 1 > prepared operation key=FCA2R3HR61S2 tag=A3NBOV1XKVD7 type=del size=3392847 2023-12-03T11:42:07.883 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.882+0000 7f8723d84780 1 < completed part key=_multipart_HIU6L0NQ8Q95.2~LR9UUBP921TB.0 size=1048576 2023-12-03T11:42:07.884 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.883+0000 7f8723d84780 1 < completed part key=_multipart_HIU6L0NQ8Q95.2~LR9UUBP921TB.1 size=1048576 2023-12-03T11:42:07.884 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.883+0000 7f8723d84780 1 < canceled part key=_multipart_HIU6L0NQ8Q95.2~LR9UUBP921TB.2 size=953195 2023-12-03T11:42:07.886 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.885+0000 7f8723d84780 1 < canceled multipart upload key=HIU6L0NQ8Q95 upload=LR9UUBP921TB tag=K6Y5XMPL4WB8 type=write size=4098923 2023-12-03T11:42:07.888 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.887+0000 7f8723d84780 1 > prepared part key=_multipart_7THZZ1J5LOZK.2~N8EZUSI29QUT.0 size=1048576 2023-12-03T11:42:07.889 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.888+0000 7f8723d84780 1 > prepared part key=_multipart_7THZZ1J5LOZK.2~N8EZUSI29QUT.1 size=1048576 2023-12-03T11:42:07.890 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.889+0000 7f8723d84780 1 > prepared part key=_multipart_7THZZ1J5LOZK.2~N8EZUSI29QUT.2 size=206785 2023-12-03T11:42:07.890 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.889+0000 7f8723d84780 1 > prepared multipart upload key=7THZZ1J5LOZK upload=N8EZUSI29QUT tag=1ICCUWWLBJI3 type=write size=3352513 2023-12-03T11:42:07.891 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.890+0000 7f8723d84780 1 < completed delete operation key=LCK58DDM5XU9 tag=7PLJ6VCK4O4M type=del 2023-12-03T11:42:07.893 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.892+0000 7f8723d84780 1 > prepared part key=_multipart_AB0SN0E49Z5F.2~KFA5TNU1PHVQ.0 size=1048576 2023-12-03T11:42:07.894 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.893+0000 7f8723d84780 1 > prepared part key=_multipart_AB0SN0E49Z5F.2~KFA5TNU1PHVQ.1 size=544925 2023-12-03T11:42:07.894 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.893+0000 7f8723d84780 1 > prepared multipart upload key=AB0SN0E49Z5F upload=KFA5TNU1PHVQ tag=VGQQI19RGENC type=write size=2642077 2023-12-03T11:42:07.895 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.894+0000 7f8723d84780 1 < completed delete operation key=UWS266H06VDK tag=FYVBQ6E254SM type=del 2023-12-03T11:42:07.897 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.896+0000 7f8723d84780 1 > prepared part key=_multipart_LCK58DDM5XU9.2~KULZF42DC3FZ.0 size=1048576 2023-12-03T11:42:07.899 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.897+0000 7f8723d84780 1 > prepared part key=_multipart_LCK58DDM5XU9.2~KULZF42DC3FZ.1 size=437466 2023-12-03T11:42:07.899 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.897+0000 7f8723d84780 1 > prepared multipart upload key=LCK58DDM5XU9 upload=KULZF42DC3FZ tag=CYWPQBKOLH2Q type=write size=2534618 2023-12-03T11:42:07.900 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.899+0000 7f8723d84780 1 < completed part key=_multipart_D3JEVEY0E29E.2~2TFL0DBKT5BU.0 size=1048576 2023-12-03T11:42:07.901 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.900+0000 7f8723d84780 1 < completed part key=_multipart_D3JEVEY0E29E.2~2TFL0DBKT5BU.1 size=662820 2023-12-03T11:42:07.903 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.902+0000 7f8723d84780 1 < completed multipart upload key=D3JEVEY0E29E upload=2TFL0DBKT5BU tag=NBQ8561OJX14 type=write size=2759972 2023-12-03T11:42:07.904 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.903+0000 7f8723d84780 1 > prepared operation key=EITMJKL0LCYC tag=LL2SOMSXVR4M type=del size=2225480 2023-12-03T11:42:07.905 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.904+0000 7f8723d84780 1 < completed part key=_multipart_J33T5S893LMV.2~VSHINZ3C12T4.0 size=1048576 2023-12-03T11:42:07.905 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.904+0000 7f8723d84780 1 < canceled part key=_multipart_J33T5S893LMV.2~VSHINZ3C12T4.1 size=1048576 2023-12-03T11:42:07.906 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.904+0000 7f8723d84780 1 < canceled part key=_multipart_J33T5S893LMV.2~VSHINZ3C12T4.2 size=779269 2023-12-03T11:42:07.907 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.906+0000 7f8723d84780 1 < canceled multipart upload key=J33T5S893LMV upload=VSHINZ3C12T4 tag=TS1I1XY28SA4 type=write size=3924997 2023-12-03T11:42:07.909 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.908+0000 7f8723d84780 1 > prepared part key=_multipart_D3JEVEY0E29E.2~MF6TX2B4OORC.0 size=1048576 2023-12-03T11:42:07.910 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.909+0000 7f8723d84780 1 > prepared part key=_multipart_D3JEVEY0E29E.2~MF6TX2B4OORC.1 size=646960 2023-12-03T11:42:07.910 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.909+0000 7f8723d84780 1 > prepared multipart upload key=D3JEVEY0E29E upload=MF6TX2B4OORC tag=XK4DFD7W5MK0 type=write size=2744112 2023-12-03T11:42:07.911 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.910+0000 7f8723d84780 1 < completed part key=_multipart_W2704YS8KYQB.2~ZUUCQLY47M0F.0 size=1048576 2023-12-03T11:42:07.912 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.911+0000 7f8723d84780 1 < completed part key=_multipart_W2704YS8KYQB.2~ZUUCQLY47M0F.1 size=88541 2023-12-03T11:42:07.914 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.913+0000 7f8723d84780 1 < completed multipart upload key=W2704YS8KYQB upload=ZUUCQLY47M0F tag=I94ASDUOJ3HB type=write size=2185693 2023-12-03T11:42:07.917 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.916+0000 7f8723d84780 1 > prepared part key=_multipart_KS5J7E7KE2IJ.2~9WDC4OUCHM4L.0 size=496540 2023-12-03T11:42:07.917 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.916+0000 7f8723d84780 1 > prepared multipart upload key=KS5J7E7KE2IJ upload=9WDC4OUCHM4L tag=75YAUGK7L5PP type=write size=1545116 2023-12-03T11:42:07.918 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.917+0000 7f8723d84780 1 < completed write operation key=TSTIBGVYUZZZ tag=9WO8ZYITM2QH type=write size=495131 2023-12-03T11:42:07.919 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.918+0000 7f8723d84780 1 > prepared operation key=12XG7YPYTN4U tag=ULWIPTFFPXM6 type=del size=2172098 2023-12-03T11:42:07.920 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.919+0000 7f8723d84780 1 < completed part key=_multipart_K83BTR5BOLZE.2~CIECORH6V10T.0 size=1048576 2023-12-03T11:42:07.921 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.920+0000 7f8723d84780 1 < completed part key=_multipart_K83BTR5BOLZE.2~CIECORH6V10T.1 size=1048576 2023-12-03T11:42:07.921 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.920+0000 7f8723d84780 1 < canceled part key=_multipart_K83BTR5BOLZE.2~CIECORH6V10T.2 size=345752 2023-12-03T11:42:07.923 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.922+0000 7f8723d84780 1 < canceled multipart upload key=K83BTR5BOLZE upload=CIECORH6V10T tag=Y75FXQD62AIY type=write size=3491480 2023-12-03T11:42:07.925 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.924+0000 7f8723d84780 1 > prepared operation key=KS5J7E7KE2IJ tag=0Y0I9IO8IRK1 type=del size=3783486 2023-12-03T11:42:07.927 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.926+0000 7f8723d84780 1 < suggested update operation key=10JRIKOZ16FY tag=ZFNINI272LTR type=del size=3037057 2023-12-03T11:42:07.929 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.928+0000 7f8723d84780 1 > prepared part key=_multipart_7THZZ1J5LOZK.2~KF9LSBV3SN57.0 size=530678 2023-12-03T11:42:07.929 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.928+0000 7f8723d84780 1 > prepared multipart upload key=7THZZ1J5LOZK upload=KF9LSBV3SN57 tag=AA5AJY4IX0VL type=write size=1579254 2023-12-03T11:42:07.930 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.929+0000 7f8723d84780 1 < completed write operation key=7THZZ1J5LOZK tag=JBUSXY8L29HX type=write size=444920 2023-12-03T11:42:07.933 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.932+0000 7f8723d84780 1 > prepared part key=_multipart_EY9ZG5KOTBWM.2~YB18B9ZNY17C.0 size=1048576 2023-12-03T11:42:07.933 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.932+0000 7f8723d84780 1 > prepared part key=_multipart_EY9ZG5KOTBWM.2~YB18B9ZNY17C.1 size=1048576 2023-12-03T11:42:07.935 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.933+0000 7f8723d84780 1 > prepared part key=_multipart_EY9ZG5KOTBWM.2~YB18B9ZNY17C.2 size=544845 2023-12-03T11:42:07.935 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.933+0000 7f8723d84780 1 > prepared multipart upload key=EY9ZG5KOTBWM upload=YB18B9ZNY17C tag=8GFA80CXC0MS type=write size=3690573 2023-12-03T11:42:07.936 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.935+0000 7f8723d84780 1 < completed delete operation key=12XG7YPYTN4U tag=LH46YMEM2J1M type=del 2023-12-03T11:42:07.939 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.938+0000 7f8723d84780 1 > prepared part key=_multipart_K83BTR5BOLZE.2~U94HVFOTTOEG.0 size=1048576 2023-12-03T11:42:07.940 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.939+0000 7f8723d84780 1 > prepared part key=_multipart_K83BTR5BOLZE.2~U94HVFOTTOEG.1 size=1048576 2023-12-03T11:42:07.941 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.940+0000 7f8723d84780 1 > prepared part key=_multipart_K83BTR5BOLZE.2~U94HVFOTTOEG.2 size=374963 2023-12-03T11:42:07.941 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.940+0000 7f8723d84780 1 > prepared multipart upload key=K83BTR5BOLZE upload=U94HVFOTTOEG tag=UM2PG5KYOA88 type=write size=3520691 2023-12-03T11:42:07.942 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.941+0000 7f8723d84780 1 < completed part key=_multipart_K83BTR5BOLZE.2~R19R6CO4NQ3B.0 size=1048576 2023-12-03T11:42:07.944 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.943+0000 7f8723d84780 1 < completed part key=_multipart_K83BTR5BOLZE.2~R19R6CO4NQ3B.1 size=1048576 2023-12-03T11:42:07.945 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.944+0000 7f8723d84780 1 < completed part key=_multipart_K83BTR5BOLZE.2~R19R6CO4NQ3B.2 size=448698 2023-12-03T11:42:07.947 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.946+0000 7f8723d84780 1 < completed multipart upload key=K83BTR5BOLZE upload=R19R6CO4NQ3B tag=DMXVJ7XQVH9C type=write size=3594426 2023-12-03T11:42:07.949 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.948+0000 7f8723d84780 1 > prepared operation key=G36T76K8O7A1 tag=4PH502YC2Y4N type=write size=423081 2023-12-03T11:42:07.950 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.949+0000 7f8723d84780 1 < canceled operation key=OGACI7CRPMT7 tag=CAT9TYP9KG2N type=del size=3960677 2023-12-03T11:42:07.951 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.950+0000 7f8723d84780 1 > prepared operation key=5UYL15O31IHM tag=SGY0Q98J41G4 type=write size=494738 2023-12-03T11:42:07.952 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.951+0000 7f8723d84780 1 < completed part key=_multipart_W2704YS8KYQB.2~KHMZ910AMBL4.0 size=1048576 2023-12-03T11:42:07.953 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.952+0000 7f8723d84780 1 < completed part key=_multipart_W2704YS8KYQB.2~KHMZ910AMBL4.1 size=642310 2023-12-03T11:42:07.956 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.955+0000 7f8723d84780 1 < completed multipart upload key=W2704YS8KYQB upload=KHMZ910AMBL4 tag=LJVTNIMADNKX type=write size=2739462 2023-12-03T11:42:07.957 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.956+0000 7f8723d84780 1 > prepared operation key=DMQX2DGDLU7D tag=32KOA56VOZWK type=del size=1505784 2023-12-03T11:42:07.958 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.957+0000 7f8723d84780 1 < canceled operation key=LMVO6CVEPN3K tag=S8DEGLP8MD0T type=del size=2589146 2023-12-03T11:42:07.959 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.958+0000 7f8723d84780 1 > prepared operation key=UWS266H06VDK tag=1Y4VZN85C45R type=del size=2455207 2023-12-03T11:42:07.960 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.959+0000 7f8723d84780 1 < canceled operation key=FCA2R3HR61S2 tag=A3NBOV1XKVD7 type=del size=3392847 2023-12-03T11:42:07.962 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.961+0000 7f8723d84780 1 > prepared operation key=OPQPIDJ2PBVU tag=OPWPHDONOGF0 type=del size=631515 2023-12-03T11:42:07.963 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.962+0000 7f8723d84780 1 < completed part key=_multipart_7THZZ1J5LOZK.2~N8EZUSI29QUT.0 size=1048576 2023-12-03T11:42:07.964 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.963+0000 7f8723d84780 1 < completed part key=_multipart_7THZZ1J5LOZK.2~N8EZUSI29QUT.1 size=1048576 2023-12-03T11:42:07.965 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.964+0000 7f8723d84780 1 < completed part key=_multipart_7THZZ1J5LOZK.2~N8EZUSI29QUT.2 size=206785 2023-12-03T11:42:07.968 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.967+0000 7f8723d84780 1 < completed multipart upload key=7THZZ1J5LOZK upload=N8EZUSI29QUT tag=1ICCUWWLBJI3 type=write size=3352513 2023-12-03T11:42:07.969 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.968+0000 7f8723d84780 1 > prepared operation key=7VMTBKUWU59F tag=GU6SPXDDDOG6 type=del size=2487733 2023-12-03T11:42:07.970 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.969+0000 7f8723d84780 1 < completed part key=_multipart_AB0SN0E49Z5F.2~KFA5TNU1PHVQ.0 size=1048576 2023-12-03T11:42:07.971 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.970+0000 7f8723d84780 1 < completed part key=_multipart_AB0SN0E49Z5F.2~KFA5TNU1PHVQ.1 size=544925 2023-12-03T11:42:07.973 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.972+0000 7f8723d84780 1 < completed multipart upload key=AB0SN0E49Z5F upload=KFA5TNU1PHVQ tag=VGQQI19RGENC type=write size=2642077 2023-12-03T11:42:07.975 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.973+0000 7f8723d84780 1 > prepared operation key=J33T5S893LMV tag=3XSDQ5TYK1FV type=del size=1090271 2023-12-03T11:42:07.976 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.974+0000 7f8723d84780 1 < completed part key=_multipart_LCK58DDM5XU9.2~KULZF42DC3FZ.0 size=1048576 2023-12-03T11:42:07.976 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.975+0000 7f8723d84780 1 < completed part key=_multipart_LCK58DDM5XU9.2~KULZF42DC3FZ.1 size=437466 2023-12-03T11:42:07.979 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.978+0000 7f8723d84780 1 < completed multipart upload key=LCK58DDM5XU9 upload=KULZF42DC3FZ tag=CYWPQBKOLH2Q type=write size=2534618 2023-12-03T11:42:07.981 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.980+0000 7f8723d84780 1 > prepared part key=_multipart_CKABTI1EOAWB.2~2R63FXVLUM63.0 size=82084 2023-12-03T11:42:07.981 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.980+0000 7f8723d84780 1 > prepared multipart upload key=CKABTI1EOAWB upload=2R63FXVLUM63 tag=82OC2T6NR1BA type=write size=1130660 2023-12-03T11:42:07.983 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.981+0000 7f8723d84780 1 < completed delete operation key=EITMJKL0LCYC tag=LL2SOMSXVR4M type=del 2023-12-03T11:42:07.984 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.983+0000 7f8723d84780 1 > prepared operation key=OGACI7CRPMT7 tag=ZJDFSXKPHC0B type=write size=399854 2023-12-03T11:42:07.985 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.984+0000 7f8723d84780 1 < completed part key=_multipart_D3JEVEY0E29E.2~MF6TX2B4OORC.0 size=1048576 2023-12-03T11:42:07.986 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.985+0000 7f8723d84780 1 < completed part key=_multipart_D3JEVEY0E29E.2~MF6TX2B4OORC.1 size=646960 2023-12-03T11:42:07.988 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.987+0000 7f8723d84780 1 < completed multipart upload key=D3JEVEY0E29E upload=MF6TX2B4OORC tag=XK4DFD7W5MK0 type=write size=2744112 2023-12-03T11:42:07.990 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.989+0000 7f8723d84780 1 > prepared operation key=96RAVVSUKH0Y tag=3KWSVOBVDXHX type=del size=1959888 2023-12-03T11:42:07.991 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.990+0000 7f8723d84780 1 < completed part key=_multipart_KS5J7E7KE2IJ.2~9WDC4OUCHM4L.0 size=496540 2023-12-03T11:42:07.993 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.992+0000 7f8723d84780 1 < completed multipart upload key=KS5J7E7KE2IJ upload=9WDC4OUCHM4L tag=75YAUGK7L5PP type=write size=1545116 2023-12-03T11:42:07.994 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.993+0000 7f8723d84780 1 > prepared operation key=UWS266H06VDK tag=CCGG8K3J0U4E type=del size=2408856 2023-12-03T11:42:07.995 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.994+0000 7f8723d84780 1 < completed delete operation key=12XG7YPYTN4U tag=ULWIPTFFPXM6 type=del 2023-12-03T11:42:07.996 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.995+0000 7f8723d84780 1 > prepared operation key=OGACI7CRPMT7 tag=W5CYJDCC7PI0 type=del size=1004871 2023-12-03T11:42:07.998 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.997+0000 7f8723d84780 1 < completed delete operation key=KS5J7E7KE2IJ tag=0Y0I9IO8IRK1 type=del 2023-12-03T11:42:07.999 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.998+0000 7f8723d84780 1 > prepared operation key=OGACI7CRPMT7 tag=L9BPXMM3LHD0 type=del size=2926133 2023-12-03T11:42:08.000 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:07.999+0000 7f8723d84780 1 < completed part key=_multipart_7THZZ1J5LOZK.2~KF9LSBV3SN57.0 size=530678 2023-12-03T11:42:08.002 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.001+0000 7f8723d84780 1 < completed multipart upload key=7THZZ1J5LOZK upload=KF9LSBV3SN57 tag=AA5AJY4IX0VL type=write size=1579254 2023-12-03T11:42:08.003 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.002+0000 7f8723d84780 1 > prepared operation key=Y6S7QI60GCLE tag=FDOFPY3STSNF type=del size=3494469 2023-12-03T11:42:08.004 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.003+0000 7f8723d84780 1 < completed part key=_multipart_EY9ZG5KOTBWM.2~YB18B9ZNY17C.0 size=1048576 2023-12-03T11:42:08.005 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.004+0000 7f8723d84780 1 < completed part key=_multipart_EY9ZG5KOTBWM.2~YB18B9ZNY17C.1 size=1048576 2023-12-03T11:42:08.006 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.005+0000 7f8723d84780 1 < completed part key=_multipart_EY9ZG5KOTBWM.2~YB18B9ZNY17C.2 size=544845 2023-12-03T11:42:08.008 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.007+0000 7f8723d84780 1 < completed multipart upload key=EY9ZG5KOTBWM upload=YB18B9ZNY17C tag=8GFA80CXC0MS type=write size=3690573 2023-12-03T11:42:08.010 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.009+0000 7f8723d84780 1 > prepared part key=_multipart_CKABTI1EOAWB.2~BA82XXXM67T9.0 size=147429 2023-12-03T11:42:08.010 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.009+0000 7f8723d84780 1 > prepared multipart upload key=CKABTI1EOAWB upload=BA82XXXM67T9 tag=8IC4SYSMOOB5 type=write size=1196005 2023-12-03T11:42:08.011 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.010+0000 7f8723d84780 1 < completed part key=_multipart_K83BTR5BOLZE.2~U94HVFOTTOEG.0 size=1048576 2023-12-03T11:42:08.012 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.011+0000 7f8723d84780 1 < completed part key=_multipart_K83BTR5BOLZE.2~U94HVFOTTOEG.1 size=1048576 2023-12-03T11:42:08.013 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.012+0000 7f8723d84780 1 < completed part key=_multipart_K83BTR5BOLZE.2~U94HVFOTTOEG.2 size=374963 2023-12-03T11:42:08.015 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.014+0000 7f8723d84780 1 < completed multipart upload key=K83BTR5BOLZE upload=U94HVFOTTOEG tag=UM2PG5KYOA88 type=write size=3520691 2023-12-03T11:42:08.016 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.015+0000 7f8723d84780 1 > prepared operation key=DMQX2DGDLU7D tag=11EWT1653M3N type=del size=2059683 2023-12-03T11:42:08.019 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.018+0000 7f8723d84780 1 < suggested remove operation key=G36T76K8O7A1 tag=4PH502YC2Y4N type=write 2023-12-03T11:42:08.022 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.021+0000 7f8723d84780 1 > prepared part key=_multipart_OGACI7CRPMT7.2~J2XJCB8RZH53.0 size=1048576 2023-12-03T11:42:08.023 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.022+0000 7f8723d84780 1 > prepared part key=_multipart_OGACI7CRPMT7.2~J2XJCB8RZH53.1 size=524357 2023-12-03T11:42:08.023 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.022+0000 7f8723d84780 1 > prepared multipart upload key=OGACI7CRPMT7 upload=J2XJCB8RZH53 tag=2BYC16BQDGH4 type=write size=2621509 2023-12-03T11:42:08.025 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.024+0000 7f8723d84780 1 < suggested update operation key=5UYL15O31IHM tag=SGY0Q98J41G4 type=write size=494738 2023-12-03T11:42:08.027 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.026+0000 7f8723d84780 1 > prepared operation key=J33T5S893LMV tag=ZGI4GVSPVGI7 type=del size=3509022 2023-12-03T11:42:08.028 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.027+0000 7f8723d84780 1 < completed delete operation key=DMQX2DGDLU7D tag=32KOA56VOZWK type=del 2023-12-03T11:42:08.029 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.028+0000 7f8723d84780 1 > prepared operation key=LCK58DDM5XU9 tag=1A81U5RNWCP7 type=del size=763071 2023-12-03T11:42:08.031 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.030+0000 7f8723d84780 1 < completed delete operation key=UWS266H06VDK tag=1Y4VZN85C45R type=del 2023-12-03T11:42:08.033 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.032+0000 7f8723d84780 1 > prepared part key=_multipart_AB0SN0E49Z5F.2~J9E57XAZNSVI.0 size=1048576 2023-12-03T11:42:08.037 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.033+0000 7f8723d84780 1 > prepared part key=_multipart_AB0SN0E49Z5F.2~J9E57XAZNSVI.1 size=1048576 2023-12-03T11:42:08.037 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.034+0000 7f8723d84780 1 > prepared part key=_multipart_AB0SN0E49Z5F.2~J9E57XAZNSVI.2 size=479112 2023-12-03T11:42:08.037 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.034+0000 7f8723d84780 1 > prepared multipart upload key=AB0SN0E49Z5F upload=J9E57XAZNSVI tag=LX8EBDIQW9I0 type=write size=3624840 2023-12-03T11:42:08.037 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.036+0000 7f8723d84780 1 < completed delete operation key=OPQPIDJ2PBVU tag=OPWPHDONOGF0 type=del 2023-12-03T11:42:08.038 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.037+0000 7f8723d84780 1 > prepared operation key=O7VVHXLDSY57 tag=FSLIV2LS2MHD type=del size=2840457 2023-12-03T11:42:08.039 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.038+0000 7f8723d84780 1 < completed delete operation key=7VMTBKUWU59F tag=GU6SPXDDDOG6 type=del 2023-12-03T11:42:08.042 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.041+0000 7f8723d84780 1 > prepared part key=_multipart_OGACI7CRPMT7.2~037EQ3JG7QGY.0 size=1048576 2023-12-03T11:42:08.043 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.042+0000 7f8723d84780 1 > prepared part key=_multipart_OGACI7CRPMT7.2~037EQ3JG7QGY.1 size=1048576 2023-12-03T11:42:08.044 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.043+0000 7f8723d84780 1 > prepared part key=_multipart_OGACI7CRPMT7.2~037EQ3JG7QGY.2 size=588796 2023-12-03T11:42:08.044 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.043+0000 7f8723d84780 1 > prepared multipart upload key=OGACI7CRPMT7 upload=037EQ3JG7QGY tag=ITKYTHGFTZTW type=write size=3734524 2023-12-03T11:42:08.045 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.044+0000 7f8723d84780 1 < completed delete operation key=J33T5S893LMV tag=3XSDQ5TYK1FV type=del 2023-12-03T11:42:08.047 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.046+0000 7f8723d84780 1 > prepared operation key=CKABTI1EOAWB tag=ICU61VP8N66A type=del size=35743 2023-12-03T11:42:08.048 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.047+0000 7f8723d84780 1 < completed part key=_multipart_CKABTI1EOAWB.2~2R63FXVLUM63.0 size=82084 2023-12-03T11:42:08.050 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.049+0000 7f8723d84780 1 < completed multipart upload key=CKABTI1EOAWB upload=2R63FXVLUM63 tag=82OC2T6NR1BA type=write size=1130660 2023-12-03T11:42:08.052 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.051+0000 7f8723d84780 1 > prepared operation key=96RAVVSUKH0Y tag=XEP842FS2357 type=del size=770689 2023-12-03T11:42:08.054 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.053+0000 7f8723d84780 1 < suggested update operation key=OGACI7CRPMT7 tag=ZJDFSXKPHC0B type=write size=399854 2023-12-03T11:42:08.057 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.056+0000 7f8723d84780 1 > prepared part key=_multipart_OPQPIDJ2PBVU.2~VVYRSWREJQ3C.0 size=397896 2023-12-03T11:42:08.057 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.056+0000 7f8723d84780 1 > prepared multipart upload key=OPQPIDJ2PBVU upload=VVYRSWREJQ3C tag=BPSNM2MJJUBO type=write size=1446472 2023-12-03T11:42:08.058 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.057+0000 7f8723d84780 1 < completed delete operation key=96RAVVSUKH0Y tag=3KWSVOBVDXHX type=del 2023-12-03T11:42:08.060 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.059+0000 7f8723d84780 1 > prepared operation key=O7VVHXLDSY57 tag=9NCV4MC7ZJYW type=del size=725066 2023-12-03T11:42:08.061 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.060+0000 7f8723d84780 1 < completed delete operation key=UWS266H06VDK tag=CCGG8K3J0U4E type=del 2023-12-03T11:42:08.063 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.062+0000 7f8723d84780 1 > prepared operation key=FCA2R3HR61S2 tag=AIARRO1DG0X2 type=del size=3468454 2023-12-03T11:42:08.065 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.064+0000 7f8723d84780 1 < suggested remove operation key=OGACI7CRPMT7 tag=W5CYJDCC7PI0 type=del 2023-12-03T11:42:08.067 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.066+0000 7f8723d84780 1 > prepared part key=_multipart_HIU6L0NQ8Q95.2~U8QIIZXFH06X.0 size=1048576 2023-12-03T11:42:08.068 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.067+0000 7f8723d84780 1 > prepared part key=_multipart_HIU6L0NQ8Q95.2~U8QIIZXFH06X.1 size=1024974 2023-12-03T11:42:08.068 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.067+0000 7f8723d84780 1 > prepared multipart upload key=HIU6L0NQ8Q95 upload=U8QIIZXFH06X tag=Y4CQPIZQA34R type=write size=3122126 2023-12-03T11:42:08.068 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.067+0000 7f8723d84780 -1 < no bi entry to suggest for operation key=OGACI7CRPMT7 tag=L9BPXMM3LHD0 type=del size=2926133: (2) No such file or directory 2023-12-03T11:42:08.070 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.069+0000 7f8723d84780 1 > prepared operation key=EITMJKL0LCYC tag=03PB3EG7V1J9 type=del size=1027710 2023-12-03T11:42:08.071 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.070+0000 7f8723d84780 1 < canceled operation key=Y6S7QI60GCLE tag=FDOFPY3STSNF type=del size=3494469 2023-12-03T11:42:08.073 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.072+0000 7f8723d84780 1 > prepared part key=_multipart_J33T5S893LMV.2~PW9VF6ACFJ65.0 size=1048576 2023-12-03T11:42:08.075 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.074+0000 7f8723d84780 1 > prepared part key=_multipart_J33T5S893LMV.2~PW9VF6ACFJ65.1 size=1048576 2023-12-03T11:42:08.076 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.075+0000 7f8723d84780 1 > prepared part key=_multipart_J33T5S893LMV.2~PW9VF6ACFJ65.2 size=839302 2023-12-03T11:42:08.076 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.075+0000 7f8723d84780 1 > prepared multipart upload key=J33T5S893LMV upload=PW9VF6ACFJ65 tag=L850TTFKQJXQ type=write size=3985030 2023-12-03T11:42:08.077 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.076+0000 7f8723d84780 1 < completed part key=_multipart_CKABTI1EOAWB.2~BA82XXXM67T9.0 size=147429 2023-12-03T11:42:08.079 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.078+0000 7f8723d84780 1 < completed multipart upload key=CKABTI1EOAWB upload=BA82XXXM67T9 tag=8IC4SYSMOOB5 type=write size=1196005 2023-12-03T11:42:08.080 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.079+0000 7f8723d84780 1 > prepared operation key=UWS266H06VDK tag=LD4SXH7HXU5A type=del size=4141386 2023-12-03T11:42:08.081 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.080+0000 7f8723d84780 1 < completed delete operation key=DMQX2DGDLU7D tag=11EWT1653M3N type=del 2023-12-03T11:42:08.083 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.082+0000 7f8723d84780 1 > prepared part key=_multipart_DMQX2DGDLU7D.2~3TA11FIUYPIV.0 size=1048576 2023-12-03T11:42:08.084 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.083+0000 7f8723d84780 1 > prepared part key=_multipart_DMQX2DGDLU7D.2~3TA11FIUYPIV.1 size=1048576 2023-12-03T11:42:08.085 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.084+0000 7f8723d84780 1 > prepared part key=_multipart_DMQX2DGDLU7D.2~3TA11FIUYPIV.2 size=136552 2023-12-03T11:42:08.085 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.084+0000 7f8723d84780 1 > prepared multipart upload key=DMQX2DGDLU7D upload=3TA11FIUYPIV tag=TOJ95VD3CAD6 type=write size=3282280 2023-12-03T11:42:08.086 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.085+0000 7f8723d84780 1 < completed part key=_multipart_OGACI7CRPMT7.2~J2XJCB8RZH53.0 size=1048576 2023-12-03T11:42:08.087 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.086+0000 7f8723d84780 1 < completed part key=_multipart_OGACI7CRPMT7.2~J2XJCB8RZH53.1 size=524357 2023-12-03T11:42:08.089 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.088+0000 7f8723d84780 1 < completed multipart upload key=OGACI7CRPMT7 upload=J2XJCB8RZH53 tag=2BYC16BQDGH4 type=write size=2621509 2023-12-03T11:42:08.090 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.089+0000 7f8723d84780 1 > prepared operation key=EITMJKL0LCYC tag=ENZIC398LZZ1 type=del size=3613015 2023-12-03T11:42:08.091 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.090+0000 7f8723d84780 1 < completed delete operation key=J33T5S893LMV tag=ZGI4GVSPVGI7 type=del 2023-12-03T11:42:08.093 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.092+0000 7f8723d84780 1 > prepared part key=_multipart_EITMJKL0LCYC.2~0HOFMPWFBLDY.0 size=1048576 2023-12-03T11:42:08.094 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.093+0000 7f8723d84780 1 > prepared part key=_multipart_EITMJKL0LCYC.2~0HOFMPWFBLDY.1 size=355482 2023-12-03T11:42:08.094 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.093+0000 7f8723d84780 1 > prepared multipart upload key=EITMJKL0LCYC upload=0HOFMPWFBLDY tag=PBVGZ2F857JV type=write size=2452634 2023-12-03T11:42:08.096 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.095+0000 7f8723d84780 1 < completed delete operation key=LCK58DDM5XU9 tag=1A81U5RNWCP7 type=del 2023-12-03T11:42:08.098 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.097+0000 7f8723d84780 1 > prepared part key=_multipart_931GNEXBHH35.2~SF57OSIOP8HG.0 size=1048576 2023-12-03T11:42:08.099 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.098+0000 7f8723d84780 1 > prepared part key=_multipart_931GNEXBHH35.2~SF57OSIOP8HG.1 size=1048576 2023-12-03T11:42:08.100 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.099+0000 7f8723d84780 1 > prepared part key=_multipart_931GNEXBHH35.2~SF57OSIOP8HG.2 size=334085 2023-12-03T11:42:08.100 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.099+0000 7f8723d84780 1 > prepared multipart upload key=931GNEXBHH35 upload=SF57OSIOP8HG tag=RC437SJB2HWC type=write size=3479813 2023-12-03T11:42:08.101 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.100+0000 7f8723d84780 1 < completed part key=_multipart_AB0SN0E49Z5F.2~J9E57XAZNSVI.0 size=1048576 2023-12-03T11:42:08.102 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.101+0000 7f8723d84780 1 < completed part key=_multipart_AB0SN0E49Z5F.2~J9E57XAZNSVI.1 size=1048576 2023-12-03T11:42:08.103 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.102+0000 7f8723d84780 1 < completed part key=_multipart_AB0SN0E49Z5F.2~J9E57XAZNSVI.2 size=479112 2023-12-03T11:42:08.105 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.104+0000 7f8723d84780 1 < completed multipart upload key=AB0SN0E49Z5F upload=J9E57XAZNSVI tag=LX8EBDIQW9I0 type=write size=3624840 2023-12-03T11:42:08.108 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.107+0000 7f8723d84780 1 > prepared part key=_multipart_7VMTBKUWU59F.2~F24M4MD5L6PP.0 size=345960 2023-12-03T11:42:08.108 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.107+0000 7f8723d84780 1 > prepared multipart upload key=7VMTBKUWU59F upload=F24M4MD5L6PP tag=FMJSAISX8HXC type=write size=1394536 2023-12-03T11:42:08.110 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.109+0000 7f8723d84780 1 < suggested update operation key=O7VVHXLDSY57 tag=FSLIV2LS2MHD type=del size=2840457 2023-12-03T11:42:08.112 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.111+0000 7f8723d84780 1 > prepared part key=_multipart_12XG7YPYTN4U.2~JHE5EYQHLG7I.0 size=1048576 2023-12-03T11:42:08.113 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.112+0000 7f8723d84780 1 > prepared part key=_multipart_12XG7YPYTN4U.2~JHE5EYQHLG7I.1 size=1048576 2023-12-03T11:42:08.114 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.113+0000 7f8723d84780 1 > prepared part key=_multipart_12XG7YPYTN4U.2~JHE5EYQHLG7I.2 size=224434 2023-12-03T11:42:08.114 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.113+0000 7f8723d84780 1 > prepared multipart upload key=12XG7YPYTN4U upload=JHE5EYQHLG7I tag=259RA9VZNMTM type=write size=3370162 2023-12-03T11:42:08.115 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.114+0000 7f8723d84780 1 < completed part key=_multipart_OGACI7CRPMT7.2~037EQ3JG7QGY.0 size=1048576 2023-12-03T11:42:08.116 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.115+0000 7f8723d84780 1 < completed part key=_multipart_OGACI7CRPMT7.2~037EQ3JG7QGY.1 size=1048576 2023-12-03T11:42:08.117 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.116+0000 7f8723d84780 1 < completed part key=_multipart_OGACI7CRPMT7.2~037EQ3JG7QGY.2 size=588796 2023-12-03T11:42:08.119 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.118+0000 7f8723d84780 1 < completed multipart upload key=OGACI7CRPMT7 upload=037EQ3JG7QGY tag=ITKYTHGFTZTW type=write size=3734524 2023-12-03T11:42:08.121 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.120+0000 7f8723d84780 1 > prepared operation key=TSTIBGVYUZZZ tag=8MIAYYRKXR7Y type=del size=2998657 2023-12-03T11:42:08.122 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.121+0000 7f8723d84780 1 < completed delete operation key=CKABTI1EOAWB tag=ICU61VP8N66A type=del 2023-12-03T11:42:08.123 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.122+0000 7f8723d84780 1 > prepared operation key=M4VKPN6INFNZ tag=12E0VN45LEY4 type=del size=1352546 2023-12-03T11:42:08.125 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.124+0000 7f8723d84780 1 < suggested remove operation key=96RAVVSUKH0Y tag=XEP842FS2357 type=del 2023-12-03T11:42:08.126 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.125+0000 7f8723d84780 1 > prepared operation key=W2704YS8KYQB tag=DAQ9RNVDRQ66 type=write size=1033216 2023-12-03T11:42:08.128 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.127+0000 7f8723d84780 1 < completed part key=_multipart_OPQPIDJ2PBVU.2~VVYRSWREJQ3C.0 size=397896 2023-12-03T11:42:08.130 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.129+0000 7f8723d84780 1 < completed multipart upload key=OPQPIDJ2PBVU upload=VVYRSWREJQ3C tag=BPSNM2MJJUBO type=write size=1446472 2023-12-03T11:42:08.132 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.131+0000 7f8723d84780 1 > prepared part key=_multipart_J33T5S893LMV.2~ZALDO7TBS159.0 size=1048576 2023-12-03T11:42:08.133 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.132+0000 7f8723d84780 1 > prepared part key=_multipart_J33T5S893LMV.2~ZALDO7TBS159.1 size=1048576 2023-12-03T11:42:08.134 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.133+0000 7f8723d84780 1 > prepared part key=_multipart_J33T5S893LMV.2~ZALDO7TBS159.2 size=1044083 2023-12-03T11:42:08.134 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.133+0000 7f8723d84780 1 > prepared multipart upload key=J33T5S893LMV upload=ZALDO7TBS159 tag=S1PUWSCX38MY type=write size=4189811 2023-12-03T11:42:08.136 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.135+0000 7f8723d84780 1 < suggested remove operation key=O7VVHXLDSY57 tag=9NCV4MC7ZJYW type=del 2023-12-03T11:42:08.138 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.137+0000 7f8723d84780 1 > prepared part key=_multipart_7VMTBKUWU59F.2~90UY3GZ9QCFY.0 size=1048576 2023-12-03T11:42:08.139 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.138+0000 7f8723d84780 1 > prepared part key=_multipart_7VMTBKUWU59F.2~90UY3GZ9QCFY.1 size=1048576 2023-12-03T11:42:08.140 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.139+0000 7f8723d84780 1 > prepared part key=_multipart_7VMTBKUWU59F.2~90UY3GZ9QCFY.2 size=752498 2023-12-03T11:42:08.140 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.139+0000 7f8723d84780 1 > prepared multipart upload key=7VMTBKUWU59F upload=90UY3GZ9QCFY tag=267PXJ5BSVAF type=write size=3898226 2023-12-03T11:42:08.142 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.141+0000 7f8723d84780 1 < canceled operation key=FCA2R3HR61S2 tag=AIARRO1DG0X2 type=del size=3468454 2023-12-03T11:42:08.143 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.142+0000 7f8723d84780 1 > prepared operation key=EITMJKL0LCYC tag=XVFOK4ZARXD3 type=del size=3921220 2023-12-03T11:42:08.143 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.142+0000 7f8723d84780 1 < canceled part key=_multipart_HIU6L0NQ8Q95.2~U8QIIZXFH06X.0 size=1048576 2023-12-03T11:42:08.144 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.142+0000 7f8723d84780 1 < canceled part key=_multipart_HIU6L0NQ8Q95.2~U8QIIZXFH06X.1 size=1024974 2023-12-03T11:42:08.145 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.144+0000 7f8723d84780 1 < canceled multipart upload key=HIU6L0NQ8Q95 upload=U8QIIZXFH06X tag=Y4CQPIZQA34R type=write size=3122126 2023-12-03T11:42:08.146 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.145+0000 7f8723d84780 1 > prepared operation key=OPQPIDJ2PBVU tag=99AAZCFFRTCH type=del size=175771 2023-12-03T11:42:08.148 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.147+0000 7f8723d84780 1 < completed delete operation key=EITMJKL0LCYC tag=03PB3EG7V1J9 type=del 2023-12-03T11:42:08.149 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.148+0000 7f8723d84780 1 > prepared operation key=10JRIKOZ16FY tag=DDZBI1A5PSK0 type=del size=2916662 2023-12-03T11:42:08.150 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.149+0000 7f8723d84780 1 < completed part key=_multipart_J33T5S893LMV.2~PW9VF6ACFJ65.0 size=1048576 2023-12-03T11:42:08.151 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.150+0000 7f8723d84780 1 < completed part key=_multipart_J33T5S893LMV.2~PW9VF6ACFJ65.1 size=1048576 2023-12-03T11:42:08.151 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.150+0000 7f8723d84780 1 < canceled part key=_multipart_J33T5S893LMV.2~PW9VF6ACFJ65.2 size=839302 2023-12-03T11:42:08.153 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.152+0000 7f8723d84780 1 < canceled multipart upload key=J33T5S893LMV upload=PW9VF6ACFJ65 tag=L850TTFKQJXQ type=write size=3985030 2023-12-03T11:42:08.154 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.153+0000 7f8723d84780 1 > prepared operation key=LCK58DDM5XU9 tag=XCJ5RM5ABAOF type=del size=259417 2023-12-03T11:42:08.156 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.155+0000 7f8723d84780 1 < completed delete operation key=UWS266H06VDK tag=LD4SXH7HXU5A type=del 2023-12-03T11:42:08.158 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.157+0000 7f8723d84780 1 > prepared operation key=12XG7YPYTN4U tag=IHSF3GKBP94G type=del size=783049 2023-12-03T11:42:08.160 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.159+0000 7f8723d84780 1 < completed part key=_multipart_DMQX2DGDLU7D.2~3TA11FIUYPIV.0 size=1048576 2023-12-03T11:42:08.161 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.160+0000 7f8723d84780 1 < completed part key=_multipart_DMQX2DGDLU7D.2~3TA11FIUYPIV.1 size=1048576 2023-12-03T11:42:08.161 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.161+0000 7f8723d84780 1 < completed part key=_multipart_DMQX2DGDLU7D.2~3TA11FIUYPIV.2 size=136552 2023-12-03T11:42:08.163 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.162+0000 7f8723d84780 1 < completed multipart upload key=DMQX2DGDLU7D upload=3TA11FIUYPIV tag=TOJ95VD3CAD6 type=write size=3282280 2023-12-03T11:42:08.165 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.164+0000 7f8723d84780 1 > prepared operation key=EITMJKL0LCYC tag=5MZMA1OM0K4O type=del size=1931139 2023-12-03T11:42:08.167 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.166+0000 7f8723d84780 1 < suggested update operation key=EITMJKL0LCYC tag=ENZIC398LZZ1 type=del size=3613015 2023-12-03T11:42:08.168 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.167+0000 7f8723d84780 1 > prepared operation key=LCK58DDM5XU9 tag=B3OBQL4SMWBC type=write size=464626 2023-12-03T11:42:08.169 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.168+0000 7f8723d84780 1 < completed part key=_multipart_EITMJKL0LCYC.2~0HOFMPWFBLDY.0 size=1048576 2023-12-03T11:42:08.170 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.169+0000 7f8723d84780 1 < completed part key=_multipart_EITMJKL0LCYC.2~0HOFMPWFBLDY.1 size=355482 2023-12-03T11:42:08.172 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.171+0000 7f8723d84780 1 < completed multipart upload key=EITMJKL0LCYC upload=0HOFMPWFBLDY tag=PBVGZ2F857JV type=write size=2452634 2023-12-03T11:42:08.174 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.173+0000 7f8723d84780 1 > prepared operation key=VENJI0KD1XDW tag=3ECBDH9A90AM type=del size=1081150 2023-12-03T11:42:08.175 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.174+0000 7f8723d84780 1 < completed part key=_multipart_931GNEXBHH35.2~SF57OSIOP8HG.0 size=1048576 2023-12-03T11:42:08.176 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.175+0000 7f8723d84780 1 < completed part key=_multipart_931GNEXBHH35.2~SF57OSIOP8HG.1 size=1048576 2023-12-03T11:42:08.177 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.176+0000 7f8723d84780 1 < completed part key=_multipart_931GNEXBHH35.2~SF57OSIOP8HG.2 size=334085 2023-12-03T11:42:08.179 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.178+0000 7f8723d84780 1 < completed multipart upload key=931GNEXBHH35 upload=SF57OSIOP8HG tag=RC437SJB2HWC type=write size=3479813 2023-12-03T11:42:08.180 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.179+0000 7f8723d84780 1 > prepared operation key=W2704YS8KYQB tag=WCJ0SH5A8ZOS type=del size=1100713 2023-12-03T11:42:08.180 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.179+0000 7f8723d84780 1 < canceled part key=_multipart_7VMTBKUWU59F.2~F24M4MD5L6PP.0 size=345960 2023-12-03T11:42:08.182 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.181+0000 7f8723d84780 1 < canceled multipart upload key=7VMTBKUWU59F upload=F24M4MD5L6PP tag=FMJSAISX8HXC type=write size=1394536 2023-12-03T11:42:08.183 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.182+0000 7f8723d84780 1 > prepared operation key=10JRIKOZ16FY tag=P76C5IGPGTH2 type=del size=2584197 2023-12-03T11:42:08.184 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.183+0000 7f8723d84780 1 < completed part key=_multipart_12XG7YPYTN4U.2~JHE5EYQHLG7I.0 size=1048576 2023-12-03T11:42:08.186 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.185+0000 7f8723d84780 1 < completed part key=_multipart_12XG7YPYTN4U.2~JHE5EYQHLG7I.1 size=1048576 2023-12-03T11:42:08.187 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.186+0000 7f8723d84780 1 < completed part key=_multipart_12XG7YPYTN4U.2~JHE5EYQHLG7I.2 size=224434 2023-12-03T11:42:08.189 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.188+0000 7f8723d84780 1 < completed multipart upload key=12XG7YPYTN4U upload=JHE5EYQHLG7I tag=259RA9VZNMTM type=write size=3370162 2023-12-03T11:42:08.190 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.189+0000 7f8723d84780 1 > prepared operation key=10JRIKOZ16FY tag=OH6ROUGPC677 type=write size=385182 2023-12-03T11:42:08.191 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.190+0000 7f8723d84780 1 < completed delete operation key=TSTIBGVYUZZZ tag=8MIAYYRKXR7Y type=del 2023-12-03T11:42:08.192 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.191+0000 7f8723d84780 1 > prepared operation key=931GNEXBHH35 tag=BBIEGVPAKN3C type=del size=1769241 2023-12-03T11:42:08.193 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.192+0000 7f8723d84780 1 < completed delete operation key=M4VKPN6INFNZ tag=12E0VN45LEY4 type=del 2023-12-03T11:42:08.195 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.193+0000 7f8723d84780 1 > prepared operation key=EY9ZG5KOTBWM tag=8KHGKGFBJIDF type=write size=560228 2023-12-03T11:42:08.196 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.195+0000 7f8723d84780 1 < completed write operation key=W2704YS8KYQB tag=DAQ9RNVDRQ66 type=write size=1033216 2023-12-03T11:42:08.197 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.196+0000 7f8723d84780 1 > prepared operation key=10JRIKOZ16FY tag=3JRS5DPLDTII type=del size=3639927 2023-12-03T11:42:08.198 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.196+0000 7f8723d84780 1 < canceled part key=_multipart_J33T5S893LMV.2~ZALDO7TBS159.0 size=1048576 2023-12-03T11:42:08.198 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.197+0000 7f8723d84780 1 < completed part key=_multipart_J33T5S893LMV.2~ZALDO7TBS159.1 size=1048576 2023-12-03T11:42:08.199 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.198+0000 7f8723d84780 1 < completed part key=_multipart_J33T5S893LMV.2~ZALDO7TBS159.2 size=1044083 2023-12-03T11:42:08.202 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.200+0000 7f8723d84780 1 < canceled multipart upload key=J33T5S893LMV upload=ZALDO7TBS159 tag=S1PUWSCX38MY type=write size=4189811 2023-12-03T11:42:08.202 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.201+0000 7f8723d84780 1 > prepared operation key=4I8PWBZOLDUG tag=SCMF0ASXEQSP type=del size=2884678 2023-12-03T11:42:08.204 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.203+0000 7f8723d84780 1 < completed part key=_multipart_7VMTBKUWU59F.2~90UY3GZ9QCFY.0 size=1048576 2023-12-03T11:42:08.205 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.204+0000 7f8723d84780 1 < completed part key=_multipart_7VMTBKUWU59F.2~90UY3GZ9QCFY.1 size=1048576 2023-12-03T11:42:08.206 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.205+0000 7f8723d84780 1 < completed part key=_multipart_7VMTBKUWU59F.2~90UY3GZ9QCFY.2 size=752498 2023-12-03T11:42:08.208 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.207+0000 7f8723d84780 1 < completed multipart upload key=7VMTBKUWU59F upload=90UY3GZ9QCFY tag=267PXJ5BSVAF type=write size=3898226 2023-12-03T11:42:08.209 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.208+0000 7f8723d84780 1 > prepared operation key=K83BTR5BOLZE tag=VN82GGTLKD4Q type=del size=2672954 2023-12-03T11:42:08.210 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.209+0000 7f8723d84780 -1 < failed to complete operation key=EITMJKL0LCYC tag=XVFOK4ZARXD3 type=del size=3921220: (22) Invalid argument 2023-12-03T11:42:08.212 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.211+0000 7f8723d84780 1 > prepared operation key=CKABTI1EOAWB tag=78XJQDABO0BE type=del size=1426570 2023-12-03T11:42:08.214 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.213+0000 7f8723d84780 1 < suggested remove operation key=OPQPIDJ2PBVU tag=99AAZCFFRTCH type=del 2023-12-03T11:42:08.215 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.214+0000 7f8723d84780 1 > prepared operation key=EY9ZG5KOTBWM tag=2WY72LIEAS0W type=del size=3068244 2023-12-03T11:42:08.216 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.215+0000 7f8723d84780 1 < completed delete operation key=10JRIKOZ16FY tag=DDZBI1A5PSK0 type=del 2023-12-03T11:42:08.218 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.216+0000 7f8723d84780 1 > prepared operation key=UWS266H06VDK tag=0N7L9RTBOLE0 type=del size=3608441 2023-12-03T11:42:08.220 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.219+0000 7f8723d84780 1 < suggested update operation key=LCK58DDM5XU9 tag=XCJ5RM5ABAOF type=del size=259417 2023-12-03T11:42:08.221 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.220+0000 7f8723d84780 1 > prepared operation key=UWS266H06VDK tag=Y1SMKEXU4L0Q type=del size=1166589 2023-12-03T11:42:08.222 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.221+0000 7f8723d84780 1 < completed delete operation key=12XG7YPYTN4U tag=IHSF3GKBP94G type=del 2023-12-03T11:42:08.224 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.223+0000 7f8723d84780 1 > prepared part key=_multipart_D3JEVEY0E29E.2~3Z9GJUHCSPA8.0 size=867636 2023-12-03T11:42:08.224 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.223+0000 7f8723d84780 1 > prepared multipart upload key=D3JEVEY0E29E upload=3Z9GJUHCSPA8 tag=12SLYZRX5GM1 type=write size=1916212 2023-12-03T11:42:08.225 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.224+0000 7f8723d84780 -1 < failed to complete operation key=EITMJKL0LCYC tag=5MZMA1OM0K4O type=del size=1931139: (22) Invalid argument 2023-12-03T11:42:08.227 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.226+0000 7f8723d84780 1 > prepared operation key=8NONX2I08YMJ tag=4KEYGDKNRMUR type=del size=1243403 2023-12-03T11:42:08.228 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.227+0000 7f8723d84780 -1 < failed to complete operation key=LCK58DDM5XU9 tag=B3OBQL4SMWBC type=write size=464626: (22) Invalid argument 2023-12-03T11:42:08.230 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.229+0000 7f8723d84780 1 > prepared part key=_multipart_FCA2R3HR61S2.2~IWA9ZPPOXFF5.0 size=484769 2023-12-03T11:42:08.230 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.229+0000 7f8723d84780 1 > prepared multipart upload key=FCA2R3HR61S2 upload=IWA9ZPPOXFF5 tag=DU19S5NOLKKW type=write size=1533345 2023-12-03T11:42:08.233 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.232+0000 7f8723d84780 1 < suggested remove operation key=VENJI0KD1XDW tag=3ECBDH9A90AM type=del 2023-12-03T11:42:08.236 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.235+0000 7f8723d84780 1 > prepared part key=_multipart_M4VKPN6INFNZ.2~KDDKA8DGP2XY.0 size=1048576 2023-12-03T11:42:08.237 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.236+0000 7f8723d84780 1 > prepared part key=_multipart_M4VKPN6INFNZ.2~KDDKA8DGP2XY.1 size=1048576 2023-12-03T11:42:08.238 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.237+0000 7f8723d84780 1 > prepared part key=_multipart_M4VKPN6INFNZ.2~KDDKA8DGP2XY.2 size=844948 2023-12-03T11:42:08.238 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.237+0000 7f8723d84780 1 > prepared multipart upload key=M4VKPN6INFNZ upload=KDDKA8DGP2XY tag=3IDVWRPHG9WO type=write size=3990676 2023-12-03T11:42:08.241 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.238+0000 7f8723d84780 1 < completed delete operation key=W2704YS8KYQB tag=WCJ0SH5A8ZOS type=del 2023-12-03T11:42:08.242 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.239+0000 7f8723d84780 1 > prepared operation key=8NONX2I08YMJ tag=JYD9711XBIJ7 type=del size=1859964 2023-12-03T11:42:08.242 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.240+0000 7f8723d84780 1 < completed delete operation key=10JRIKOZ16FY tag=P76C5IGPGTH2 type=del 2023-12-03T11:42:08.242 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.241+0000 7f8723d84780 1 > prepared operation key=OPQPIDJ2PBVU tag=H04DAD66TS4E type=del size=2617709 2023-12-03T11:42:08.244 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.243+0000 7f8723d84780 1 < completed write operation key=10JRIKOZ16FY tag=OH6ROUGPC677 type=write size=385182 2023-12-03T11:42:08.246 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.245+0000 7f8723d84780 1 > prepared part key=_multipart_DMQX2DGDLU7D.2~QZPTCN8UXLRJ.0 size=1048576 2023-12-03T11:42:08.247 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.246+0000 7f8723d84780 1 > prepared part key=_multipart_DMQX2DGDLU7D.2~QZPTCN8UXLRJ.1 size=977842 2023-12-03T11:42:08.247 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.246+0000 7f8723d84780 1 > prepared multipart upload key=DMQX2DGDLU7D upload=QZPTCN8UXLRJ tag=CSCNBNC9GRAL type=write size=3074994 2023-12-03T11:42:08.249 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.248+0000 7f8723d84780 1 < completed delete operation key=931GNEXBHH35 tag=BBIEGVPAKN3C type=del 2023-12-03T11:42:08.250 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.249+0000 7f8723d84780 1 > prepared operation key=7THZZ1J5LOZK tag=PLDBWM09FTTY type=del size=1864056 2023-12-03T11:42:08.251 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.250+0000 7f8723d84780 1 < completed write operation key=EY9ZG5KOTBWM tag=8KHGKGFBJIDF type=write size=560228 2023-12-03T11:42:08.253 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.252+0000 7f8723d84780 1 > prepared operation key=Y6S7QI60GCLE tag=AJSMN4U9BJLU type=del size=2735494 2023-12-03T11:42:08.254 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.253+0000 7f8723d84780 1 < completed delete operation key=10JRIKOZ16FY tag=3JRS5DPLDTII type=del 2023-12-03T11:42:08.256 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.255+0000 7f8723d84780 1 > prepared part key=_multipart_FCA2R3HR61S2.2~IGMMCB7VR229.0 size=1048576 2023-12-03T11:42:08.257 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.256+0000 7f8723d84780 1 > prepared part key=_multipart_FCA2R3HR61S2.2~IGMMCB7VR229.1 size=79062 2023-12-03T11:42:08.257 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.256+0000 7f8723d84780 1 > prepared multipart upload key=FCA2R3HR61S2 upload=IGMMCB7VR229 tag=HA9BI5T6T2QW type=write size=2176214 2023-12-03T11:42:08.260 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.259+0000 7f8723d84780 1 < suggested remove operation key=4I8PWBZOLDUG tag=SCMF0ASXEQSP type=del 2023-12-03T11:42:08.262 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.261+0000 7f8723d84780 1 > prepared operation key=D3JEVEY0E29E tag=YXSHCIGL65TD type=del size=1202249 2023-12-03T11:42:08.265 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.264+0000 7f8723d84780 1 < suggested update operation key=K83BTR5BOLZE tag=VN82GGTLKD4Q type=del size=2672954 2023-12-03T11:42:08.269 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.268+0000 7f8723d84780 1 > prepared part key=_multipart_VENJI0KD1XDW.2~J8VFQQ4HAYJY.0 size=1048576 2023-12-03T11:42:08.270 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.269+0000 7f8723d84780 1 > prepared part key=_multipart_VENJI0KD1XDW.2~J8VFQQ4HAYJY.1 size=1048576 2023-12-03T11:42:08.271 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.270+0000 7f8723d84780 1 > prepared part key=_multipart_VENJI0KD1XDW.2~J8VFQQ4HAYJY.2 size=753865 2023-12-03T11:42:08.271 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.270+0000 7f8723d84780 1 > prepared multipart upload key=VENJI0KD1XDW upload=J8VFQQ4HAYJY tag=7YJSXUWB3EKT type=write size=3899593 2023-12-03T11:42:08.272 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.271+0000 7f8723d84780 1 < completed delete operation key=CKABTI1EOAWB tag=78XJQDABO0BE type=del 2023-12-03T11:42:08.273 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.272+0000 7f8723d84780 1 > prepared operation key=4I8PWBZOLDUG tag=CNUA7V96LN0K type=del size=1695105 2023-12-03T11:42:08.275 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.274+0000 7f8723d84780 1 < suggested update operation key=EY9ZG5KOTBWM tag=2WY72LIEAS0W type=del size=3068244 2023-12-03T11:42:08.277 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.275+0000 7f8723d84780 1 > prepared operation key=LCK58DDM5XU9 tag=ZIUE4TVOKDDL type=del size=2983469 2023-12-03T11:42:08.278 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.277+0000 7f8723d84780 1 < completed delete operation key=UWS266H06VDK tag=0N7L9RTBOLE0 type=del 2023-12-03T11:42:08.280 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.279+0000 7f8723d84780 1 > prepared part key=_multipart_DMQX2DGDLU7D.2~8OV9O7JTXKWN.0 size=534124 2023-12-03T11:42:08.280 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.279+0000 7f8723d84780 1 > prepared multipart upload key=DMQX2DGDLU7D upload=8OV9O7JTXKWN tag=007YIG8GFHIQ type=write size=1582700 2023-12-03T11:42:08.281 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.280+0000 7f8723d84780 1 < completed delete operation key=UWS266H06VDK tag=Y1SMKEXU4L0Q type=del 2023-12-03T11:42:08.282 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.281+0000 7f8723d84780 1 > prepared operation key=CKABTI1EOAWB tag=O28RSRMTYFGF type=write size=353696 2023-12-03T11:42:08.283 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.282+0000 7f8723d84780 1 < completed part key=_multipart_D3JEVEY0E29E.2~3Z9GJUHCSPA8.0 size=867636 2023-12-03T11:42:08.285 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.284+0000 7f8723d84780 1 < completed multipart upload key=D3JEVEY0E29E upload=3Z9GJUHCSPA8 tag=12SLYZRX5GM1 type=write size=1916212 2023-12-03T11:42:08.286 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.285+0000 7f8723d84780 1 > prepared operation key=LMVO6CVEPN3K tag=XWLJ110OT93H type=write size=712327 2023-12-03T11:42:08.287 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.286+0000 7f8723d84780 1 < completed delete operation key=8NONX2I08YMJ tag=4KEYGDKNRMUR type=del 2023-12-03T11:42:08.288 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.288+0000 7f8723d84780 1 > prepared operation key=EITMJKL0LCYC tag=HYG0544QTHXZ type=del size=1331278 2023-12-03T11:42:08.290 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.289+0000 7f8723d84780 1 < completed part key=_multipart_FCA2R3HR61S2.2~IWA9ZPPOXFF5.0 size=484769 2023-12-03T11:42:08.292 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.291+0000 7f8723d84780 1 < completed multipart upload key=FCA2R3HR61S2 upload=IWA9ZPPOXFF5 tag=DU19S5NOLKKW type=write size=1533345 2023-12-03T11:42:08.293 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.292+0000 7f8723d84780 1 > prepared operation key=TSTIBGVYUZZZ tag=FGEMVD5JEW7W type=write size=109597 2023-12-03T11:42:08.294 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.293+0000 7f8723d84780 1 < completed part key=_multipart_M4VKPN6INFNZ.2~KDDKA8DGP2XY.0 size=1048576 2023-12-03T11:42:08.295 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.294+0000 7f8723d84780 1 < completed part key=_multipart_M4VKPN6INFNZ.2~KDDKA8DGP2XY.1 size=1048576 2023-12-03T11:42:08.296 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.295+0000 7f8723d84780 1 < completed part key=_multipart_M4VKPN6INFNZ.2~KDDKA8DGP2XY.2 size=844948 2023-12-03T11:42:08.298 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.297+0000 7f8723d84780 1 < completed multipart upload key=M4VKPN6INFNZ upload=KDDKA8DGP2XY tag=3IDVWRPHG9WO type=write size=3990676 2023-12-03T11:42:08.300 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.299+0000 7f8723d84780 1 > prepared part key=_multipart_CKABTI1EOAWB.2~3SUDZ0SHGTIQ.0 size=1048576 2023-12-03T11:42:08.301 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.300+0000 7f8723d84780 1 > prepared part key=_multipart_CKABTI1EOAWB.2~3SUDZ0SHGTIQ.1 size=1048576 2023-12-03T11:42:08.302 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.301+0000 7f8723d84780 1 > prepared part key=_multipart_CKABTI1EOAWB.2~3SUDZ0SHGTIQ.2 size=433850 2023-12-03T11:42:08.302 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.301+0000 7f8723d84780 1 > prepared multipart upload key=CKABTI1EOAWB upload=3SUDZ0SHGTIQ tag=IZKK1KOZGNV2 type=write size=3579578 2023-12-03T11:42:08.304 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.302+0000 7f8723d84780 1 < completed delete operation key=8NONX2I08YMJ tag=JYD9711XBIJ7 type=del 2023-12-03T11:42:08.309 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.304+0000 7f8723d84780 1 > prepared operation key=7THZZ1J5LOZK tag=8R59U8WCTUYT type=del size=3317363 2023-12-03T11:42:08.309 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.305+0000 7f8723d84780 1 < canceled operation key=OPQPIDJ2PBVU tag=H04DAD66TS4E type=del size=2617709 2023-12-03T11:42:08.309 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.306+0000 7f8723d84780 1 > prepared operation key=M4VKPN6INFNZ tag=125NDOF57AGV type=write size=624883 2023-12-03T11:42:08.309 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.306+0000 7f8723d84780 1 < canceled part key=_multipart_DMQX2DGDLU7D.2~QZPTCN8UXLRJ.0 size=1048576 2023-12-03T11:42:08.309 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.307+0000 7f8723d84780 1 < completed part key=_multipart_DMQX2DGDLU7D.2~QZPTCN8UXLRJ.1 size=977842 2023-12-03T11:42:08.310 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.309+0000 7f8723d84780 1 < canceled multipart upload key=DMQX2DGDLU7D upload=QZPTCN8UXLRJ tag=CSCNBNC9GRAL type=write size=3074994 2023-12-03T11:42:08.311 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.310+0000 7f8723d84780 1 > prepared operation key=Y6S7QI60GCLE tag=ZG2YKL4PJLS7 type=del size=3449251 2023-12-03T11:42:08.312 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.311+0000 7f8723d84780 1 < completed delete operation key=7THZZ1J5LOZK tag=PLDBWM09FTTY type=del 2023-12-03T11:42:08.313 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.312+0000 7f8723d84780 1 > prepared operation key=OGACI7CRPMT7 tag=X30WIZDM5EEH type=write size=182833 2023-12-03T11:42:08.315 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.314+0000 7f8723d84780 1 < suggested update operation key=Y6S7QI60GCLE tag=AJSMN4U9BJLU type=del size=2735494 2023-12-03T11:42:08.317 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.316+0000 7f8723d84780 1 > prepared operation key=931GNEXBHH35 tag=1YXC90V599BK type=del size=1031421 2023-12-03T11:42:08.318 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.317+0000 7f8723d84780 1 < completed part key=_multipart_FCA2R3HR61S2.2~IGMMCB7VR229.0 size=1048576 2023-12-03T11:42:08.319 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.318+0000 7f8723d84780 1 < completed part key=_multipart_FCA2R3HR61S2.2~IGMMCB7VR229.1 size=79062 2023-12-03T11:42:08.322 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.320+0000 7f8723d84780 1 < completed multipart upload key=FCA2R3HR61S2 upload=IGMMCB7VR229 tag=HA9BI5T6T2QW type=write size=2176214 2023-12-03T11:42:08.322 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.321+0000 7f8723d84780 1 > prepared operation key=M4VKPN6INFNZ tag=83271TXH9PKK type=del size=1801031 2023-12-03T11:42:08.323 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.322+0000 7f8723d84780 1 < completed delete operation key=D3JEVEY0E29E tag=YXSHCIGL65TD type=del 2023-12-03T11:42:08.325 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.323+0000 7f8723d84780 1 > prepared operation key=W2704YS8KYQB tag=GYBEXFZNSI7C type=del size=61071 2023-12-03T11:42:08.326 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.325+0000 7f8723d84780 1 < completed part key=_multipart_VENJI0KD1XDW.2~J8VFQQ4HAYJY.0 size=1048576 2023-12-03T11:42:08.327 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.326+0000 7f8723d84780 1 < completed part key=_multipart_VENJI0KD1XDW.2~J8VFQQ4HAYJY.1 size=1048576 2023-12-03T11:42:08.328 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.327+0000 7f8723d84780 1 < completed part key=_multipart_VENJI0KD1XDW.2~J8VFQQ4HAYJY.2 size=753865 2023-12-03T11:42:08.330 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.329+0000 7f8723d84780 1 < completed multipart upload key=VENJI0KD1XDW upload=J8VFQQ4HAYJY tag=7YJSXUWB3EKT type=write size=3899593 2023-12-03T11:42:08.332 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.331+0000 7f8723d84780 1 > prepared part key=_multipart_DMQX2DGDLU7D.2~LKEO8LDT6LKE.0 size=1048576 2023-12-03T11:42:08.333 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.332+0000 7f8723d84780 1 > prepared part key=_multipart_DMQX2DGDLU7D.2~LKEO8LDT6LKE.1 size=1048576 2023-12-03T11:42:08.334 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.333+0000 7f8723d84780 1 > prepared part key=_multipart_DMQX2DGDLU7D.2~LKEO8LDT6LKE.2 size=756200 2023-12-03T11:42:08.334 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.333+0000 7f8723d84780 1 > prepared multipart upload key=DMQX2DGDLU7D upload=LKEO8LDT6LKE tag=RNR8ZPYLJIDO type=write size=3901928 2023-12-03T11:42:08.335 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.334+0000 7f8723d84780 1 < completed delete operation key=4I8PWBZOLDUG tag=CNUA7V96LN0K type=del 2023-12-03T11:42:08.337 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.336+0000 7f8723d84780 1 > prepared part key=_multipart_5UYL15O31IHM.2~5JJ75MA0LUMV.0 size=1048576 2023-12-03T11:42:08.338 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.337+0000 7f8723d84780 1 > prepared part key=_multipart_5UYL15O31IHM.2~5JJ75MA0LUMV.1 size=1048576 2023-12-03T11:42:08.339 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.338+0000 7f8723d84780 1 > prepared part key=_multipart_5UYL15O31IHM.2~5JJ75MA0LUMV.2 size=129078 2023-12-03T11:42:08.339 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.338+0000 7f8723d84780 1 > prepared multipart upload key=5UYL15O31IHM upload=5JJ75MA0LUMV tag=NWQZQD2WZR9K type=write size=3274806 2023-12-03T11:42:08.340 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.339+0000 7f8723d84780 1 < completed delete operation key=LCK58DDM5XU9 tag=ZIUE4TVOKDDL type=del 2023-12-03T11:42:08.342 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.341+0000 7f8723d84780 1 > prepared part key=_multipart_5UYL15O31IHM.2~0KCG9YFI3C22.0 size=1048576 2023-12-03T11:42:08.343 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.342+0000 7f8723d84780 1 > prepared part key=_multipart_5UYL15O31IHM.2~0KCG9YFI3C22.1 size=1048576 2023-12-03T11:42:08.344 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.343+0000 7f8723d84780 1 > prepared part key=_multipart_5UYL15O31IHM.2~0KCG9YFI3C22.2 size=396426 2023-12-03T11:42:08.344 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.343+0000 7f8723d84780 1 > prepared multipart upload key=5UYL15O31IHM upload=0KCG9YFI3C22 tag=CGX191D72RAE type=write size=3542154 2023-12-03T11:42:08.345 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.343+0000 7f8723d84780 1 < canceled part key=_multipart_DMQX2DGDLU7D.2~8OV9O7JTXKWN.0 size=534124 2023-12-03T11:42:08.346 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.345+0000 7f8723d84780 1 < canceled multipart upload key=DMQX2DGDLU7D upload=8OV9O7JTXKWN tag=007YIG8GFHIQ type=write size=1582700 2023-12-03T11:42:08.347 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.346+0000 7f8723d84780 1 > prepared operation key=5UYL15O31IHM tag=Y38HRZTW4B9D type=del size=1698243 2023-12-03T11:42:08.348 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.347+0000 7f8723d84780 1 < completed write operation key=CKABTI1EOAWB tag=O28RSRMTYFGF type=write size=353696 2023-12-03T11:42:08.351 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.349+0000 7f8723d84780 1 > prepared part key=_multipart_8NONX2I08YMJ.2~K9WQ69FIURPK.0 size=502149 2023-12-03T11:42:08.351 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.349+0000 7f8723d84780 1 > prepared multipart upload key=8NONX2I08YMJ upload=K9WQ69FIURPK tag=WZ3YDJPONBD5 type=write size=1550725 2023-12-03T11:42:08.352 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.351+0000 7f8723d84780 1 < completed write operation key=LMVO6CVEPN3K tag=XWLJ110OT93H type=write size=712327 2023-12-03T11:42:08.353 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.352+0000 7f8723d84780 1 > prepared operation key=CKABTI1EOAWB tag=TO6N87FO8CG0 type=del size=1001852 2023-12-03T11:42:08.354 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.353+0000 7f8723d84780 1 < completed delete operation key=EITMJKL0LCYC tag=HYG0544QTHXZ type=del 2023-12-03T11:42:08.358 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.354+0000 7f8723d84780 1 > prepared operation key=OPQPIDJ2PBVU tag=UHXUMZ1W265S type=del size=2280804 2023-12-03T11:42:08.358 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.355+0000 7f8723d84780 1 < completed write operation key=TSTIBGVYUZZZ tag=FGEMVD5JEW7W type=write size=109597 2023-12-03T11:42:08.359 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.358+0000 7f8723d84780 1 > prepared part key=_multipart_96RAVVSUKH0Y.2~8GVPZJ6YR4ZP.0 size=1048576 2023-12-03T11:42:08.360 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.359+0000 7f8723d84780 1 > prepared part key=_multipart_96RAVVSUKH0Y.2~8GVPZJ6YR4ZP.1 size=312532 2023-12-03T11:42:08.360 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.359+0000 7f8723d84780 1 > prepared multipart upload key=96RAVVSUKH0Y upload=8GVPZJ6YR4ZP tag=CWISS6LKHLQ7 type=write size=2409684 2023-12-03T11:42:08.361 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.360+0000 7f8723d84780 1 < completed part key=_multipart_CKABTI1EOAWB.2~3SUDZ0SHGTIQ.0 size=1048576 2023-12-03T11:42:08.362 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.361+0000 7f8723d84780 1 < completed part key=_multipart_CKABTI1EOAWB.2~3SUDZ0SHGTIQ.1 size=1048576 2023-12-03T11:42:08.363 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.362+0000 7f8723d84780 1 < completed part key=_multipart_CKABTI1EOAWB.2~3SUDZ0SHGTIQ.2 size=433850 2023-12-03T11:42:08.365 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.364+0000 7f8723d84780 1 < completed multipart upload key=CKABTI1EOAWB upload=3SUDZ0SHGTIQ tag=IZKK1KOZGNV2 type=write size=3579578 2023-12-03T11:42:08.367 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.366+0000 7f8723d84780 1 > prepared operation key=4I8PWBZOLDUG tag=5VIAHEZMPDKD type=del size=2177107 2023-12-03T11:42:08.368 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.367+0000 7f8723d84780 1 < completed delete operation key=7THZZ1J5LOZK tag=8R59U8WCTUYT type=del 2023-12-03T11:42:08.369 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.368+0000 7f8723d84780 1 > prepared operation key=96RAVVSUKH0Y tag=3V9PUTUBHVF3 type=write size=643264 2023-12-03T11:42:08.370 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.369+0000 7f8723d84780 1 < completed write operation key=M4VKPN6INFNZ tag=125NDOF57AGV type=write size=624883 2023-12-03T11:42:08.372 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.371+0000 7f8723d84780 1 > prepared part key=_multipart_FCA2R3HR61S2.2~OW0912ID6GKZ.0 size=1048576 2023-12-03T11:42:08.373 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.372+0000 7f8723d84780 1 > prepared part key=_multipart_FCA2R3HR61S2.2~OW0912ID6GKZ.1 size=993484 2023-12-03T11:42:08.374 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.372+0000 7f8723d84780 1 > prepared multipart upload key=FCA2R3HR61S2 upload=OW0912ID6GKZ tag=X9TRNC6JAM91 type=write size=3090636 2023-12-03T11:42:08.376 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.375+0000 7f8723d84780 1 < suggested remove operation key=Y6S7QI60GCLE tag=ZG2YKL4PJLS7 type=del 2023-12-03T11:42:08.377 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.376+0000 7f8723d84780 1 > prepared operation key=K83BTR5BOLZE tag=OVH2F5UFTRE3 type=del size=3251133 2023-12-03T11:42:08.379 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.378+0000 7f8723d84780 1 < suggested update operation key=OGACI7CRPMT7 tag=X30WIZDM5EEH type=write size=182833 2023-12-03T11:42:08.381 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.380+0000 7f8723d84780 1 > prepared operation key=J33T5S893LMV tag=8P9242UKN2UM type=del size=3734061 2023-12-03T11:42:08.382 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.381+0000 7f8723d84780 1 < completed delete operation key=931GNEXBHH35 tag=1YXC90V599BK type=del 2023-12-03T11:42:08.383 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.382+0000 7f8723d84780 1 > prepared operation key=G36T76K8O7A1 tag=J377WF0RI4WS type=del size=3968498 2023-12-03T11:42:08.385 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.384+0000 7f8723d84780 1 < suggested update operation key=M4VKPN6INFNZ tag=83271TXH9PKK type=del size=1801031 2023-12-03T11:42:08.387 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.386+0000 7f8723d84780 1 > prepared part key=_multipart_DMQX2DGDLU7D.2~N2CB1NDMBEG4.0 size=1048576 2023-12-03T11:42:08.388 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.387+0000 7f8723d84780 1 > prepared part key=_multipart_DMQX2DGDLU7D.2~N2CB1NDMBEG4.1 size=1048576 2023-12-03T11:42:08.389 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.388+0000 7f8723d84780 1 > prepared part key=_multipart_DMQX2DGDLU7D.2~N2CB1NDMBEG4.2 size=1002259 2023-12-03T11:42:08.389 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.388+0000 7f8723d84780 1 > prepared multipart upload key=DMQX2DGDLU7D upload=N2CB1NDMBEG4 tag=XUB7LFD80LLS type=write size=4147987 2023-12-03T11:42:08.391 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.390+0000 7f8723d84780 1 < completed delete operation key=W2704YS8KYQB tag=GYBEXFZNSI7C type=del 2023-12-03T11:42:08.392 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.391+0000 7f8723d84780 1 > prepared operation key=K83BTR5BOLZE tag=2FJERGV0SPE1 type=del size=3889458 2023-12-03T11:42:08.392 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.391+0000 7f8723d84780 1 < canceled part key=_multipart_DMQX2DGDLU7D.2~LKEO8LDT6LKE.0 size=1048576 2023-12-03T11:42:08.393 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.392+0000 7f8723d84780 1 < completed part key=_multipart_DMQX2DGDLU7D.2~LKEO8LDT6LKE.1 size=1048576 2023-12-03T11:42:08.394 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.393+0000 7f8723d84780 1 < completed part key=_multipart_DMQX2DGDLU7D.2~LKEO8LDT6LKE.2 size=756200 2023-12-03T11:42:08.397 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.396+0000 7f8723d84780 1 < canceled multipart upload key=DMQX2DGDLU7D upload=LKEO8LDT6LKE tag=RNR8ZPYLJIDO type=write size=3901928 2023-12-03T11:42:08.400 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.399+0000 7f8723d84780 1 > prepared operation key=DMQX2DGDLU7D tag=5ZMUSP04RKH9 type=del size=3820559 2023-12-03T11:42:08.401 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.400+0000 7f8723d84780 1 < completed part key=_multipart_5UYL15O31IHM.2~5JJ75MA0LUMV.0 size=1048576 2023-12-03T11:42:08.402 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.401+0000 7f8723d84780 1 < completed part key=_multipart_5UYL15O31IHM.2~5JJ75MA0LUMV.1 size=1048576 2023-12-03T11:42:08.403 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.402+0000 7f8723d84780 1 < completed part key=_multipart_5UYL15O31IHM.2~5JJ75MA0LUMV.2 size=129078 2023-12-03T11:42:08.405 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.404+0000 7f8723d84780 1 < completed multipart upload key=5UYL15O31IHM upload=5JJ75MA0LUMV tag=NWQZQD2WZR9K type=write size=3274806 2023-12-03T11:42:08.407 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.406+0000 7f8723d84780 1 > prepared part key=_multipart_TSTIBGVYUZZZ.2~X5R2Y2MRLQ58.0 size=1048576 2023-12-03T11:42:08.408 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.407+0000 7f8723d84780 1 > prepared part key=_multipart_TSTIBGVYUZZZ.2~X5R2Y2MRLQ58.1 size=1048576 2023-12-03T11:42:08.409 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.408+0000 7f8723d84780 1 > prepared part key=_multipart_TSTIBGVYUZZZ.2~X5R2Y2MRLQ58.2 size=833360 2023-12-03T11:42:08.409 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.408+0000 7f8723d84780 1 > prepared multipart upload key=TSTIBGVYUZZZ upload=X5R2Y2MRLQ58 tag=ZVVHKYUNA8NX type=write size=3979088 2023-12-03T11:42:08.410 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.409+0000 7f8723d84780 1 < completed part key=_multipart_5UYL15O31IHM.2~0KCG9YFI3C22.0 size=1048576 2023-12-03T11:42:08.411 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.410+0000 7f8723d84780 1 < completed part key=_multipart_5UYL15O31IHM.2~0KCG9YFI3C22.1 size=1048576 2023-12-03T11:42:08.412 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.411+0000 7f8723d84780 1 < completed part key=_multipart_5UYL15O31IHM.2~0KCG9YFI3C22.2 size=396426 2023-12-03T11:42:08.414 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.413+0000 7f8723d84780 1 < completed multipart upload key=5UYL15O31IHM upload=0KCG9YFI3C22 tag=CGX191D72RAE type=write size=3542154 2023-12-03T11:42:08.416 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.415+0000 7f8723d84780 1 > prepared operation key=VENJI0KD1XDW tag=S75IVY1IDU2W type=del size=1744571 2023-12-03T11:42:08.417 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.416+0000 7f8723d84780 1 < canceled operation key=5UYL15O31IHM tag=Y38HRZTW4B9D type=del size=1698243 2023-12-03T11:42:08.419 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.418+0000 7f8723d84780 1 > prepared part key=_multipart_TSTIBGVYUZZZ.2~L0IPA6EQ8EC1.0 size=1048576 2023-12-03T11:42:08.420 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.419+0000 7f8723d84780 1 > prepared part key=_multipart_TSTIBGVYUZZZ.2~L0IPA6EQ8EC1.1 size=1048576 2023-12-03T11:42:08.421 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.420+0000 7f8723d84780 1 > prepared part key=_multipart_TSTIBGVYUZZZ.2~L0IPA6EQ8EC1.2 size=1044662 2023-12-03T11:42:08.421 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.420+0000 7f8723d84780 1 > prepared multipart upload key=TSTIBGVYUZZZ upload=L0IPA6EQ8EC1 tag=TXQI2X8DQ9AH type=write size=4190390 2023-12-03T11:42:08.422 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.421+0000 7f8723d84780 1 < completed part key=_multipart_8NONX2I08YMJ.2~K9WQ69FIURPK.0 size=502149 2023-12-03T11:42:08.424 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.423+0000 7f8723d84780 1 < completed multipart upload key=8NONX2I08YMJ upload=K9WQ69FIURPK tag=WZ3YDJPONBD5 type=write size=1550725 2023-12-03T11:42:08.427 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.426+0000 7f8723d84780 1 > prepared part key=_multipart_HIU6L0NQ8Q95.2~P01116IBSWVE.0 size=1048576 2023-12-03T11:42:08.428 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.427+0000 7f8723d84780 1 > prepared part key=_multipart_HIU6L0NQ8Q95.2~P01116IBSWVE.1 size=1048576 2023-12-03T11:42:08.429 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.428+0000 7f8723d84780 1 > prepared part key=_multipart_HIU6L0NQ8Q95.2~P01116IBSWVE.2 size=578198 2023-12-03T11:42:08.429 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.428+0000 7f8723d84780 1 > prepared multipart upload key=HIU6L0NQ8Q95 upload=P01116IBSWVE tag=D18ZIRND9A8C type=write size=3723926 2023-12-03T11:42:08.430 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.429+0000 7f8723d84780 1 < canceled operation key=CKABTI1EOAWB tag=TO6N87FO8CG0 type=del size=1001852 2023-12-03T11:42:08.431 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.430+0000 7f8723d84780 1 > prepared operation key=EY9ZG5KOTBWM tag=AQ2LKR2WU1AL type=del size=3824913 2023-12-03T11:42:08.433 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.431+0000 7f8723d84780 1 < completed delete operation key=OPQPIDJ2PBVU tag=UHXUMZ1W265S type=del 2023-12-03T11:42:08.434 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.433+0000 7f8723d84780 1 > prepared operation key=W2704YS8KYQB tag=XQOT1M2YCJHE type=del size=169571 2023-12-03T11:42:08.435 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.434+0000 7f8723d84780 1 < completed part key=_multipart_96RAVVSUKH0Y.2~8GVPZJ6YR4ZP.0 size=1048576 2023-12-03T11:42:08.436 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.435+0000 7f8723d84780 1 < completed part key=_multipart_96RAVVSUKH0Y.2~8GVPZJ6YR4ZP.1 size=312532 2023-12-03T11:42:08.438 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.437+0000 7f8723d84780 1 < completed multipart upload key=96RAVVSUKH0Y upload=8GVPZJ6YR4ZP tag=CWISS6LKHLQ7 type=write size=2409684 2023-12-03T11:42:08.441 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.439+0000 7f8723d84780 1 > prepared part key=_multipart_5UYL15O31IHM.2~AO7P1A161MIJ.0 size=815432 2023-12-03T11:42:08.441 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.439+0000 7f8723d84780 1 > prepared multipart upload key=5UYL15O31IHM upload=AO7P1A161MIJ tag=QTSUNVDZX0IJ type=write size=1864008 2023-12-03T11:42:08.442 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.440+0000 7f8723d84780 1 < completed delete operation key=4I8PWBZOLDUG tag=5VIAHEZMPDKD type=del 2023-12-03T11:42:08.443 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.442+0000 7f8723d84780 1 > prepared part key=_multipart_OPQPIDJ2PBVU.2~LOD2JVW31B7O.0 size=692229 2023-12-03T11:42:08.443 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.442+0000 7f8723d84780 1 > prepared multipart upload key=OPQPIDJ2PBVU upload=LOD2JVW31B7O tag=4J7MFV2LREV9 type=write size=1740805 2023-12-03T11:42:08.445 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.444+0000 7f8723d84780 1 < completed write operation key=96RAVVSUKH0Y tag=3V9PUTUBHVF3 type=write size=643264 2023-12-03T11:42:08.447 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.446+0000 7f8723d84780 1 > prepared part key=_multipart_Y6S7QI60GCLE.2~2HAQI7OOAHR8.0 size=432571 2023-12-03T11:42:08.447 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.446+0000 7f8723d84780 1 > prepared multipart upload key=Y6S7QI60GCLE upload=2HAQI7OOAHR8 tag=VG7WU7XEWHP3 type=write size=1481147 2023-12-03T11:42:08.448 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.447+0000 7f8723d84780 1 < completed part key=_multipart_FCA2R3HR61S2.2~OW0912ID6GKZ.0 size=1048576 2023-12-03T11:42:08.449 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.448+0000 7f8723d84780 1 < completed part key=_multipart_FCA2R3HR61S2.2~OW0912ID6GKZ.1 size=993484 2023-12-03T11:42:08.451 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.450+0000 7f8723d84780 1 < completed multipart upload key=FCA2R3HR61S2 upload=OW0912ID6GKZ tag=X9TRNC6JAM91 type=write size=3090636 2023-12-03T11:42:08.455 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.453+0000 7f8723d84780 1 > prepared part key=_multipart_HIU6L0NQ8Q95.2~111NZSC86N5W.0 size=765974 2023-12-03T11:42:08.455 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.453+0000 7f8723d84780 1 > prepared multipart upload key=HIU6L0NQ8Q95 upload=111NZSC86N5W tag=Q9XYOTV5HG4D type=write size=1814550 2023-12-03T11:42:08.455 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.454+0000 7f8723d84780 1 < completed delete operation key=K83BTR5BOLZE tag=OVH2F5UFTRE3 type=del 2023-12-03T11:42:08.457 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.456+0000 7f8723d84780 1 > prepared part key=_multipart_5UYL15O31IHM.2~6HGT47BPA3IO.0 size=1048576 2023-12-03T11:42:08.458 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.457+0000 7f8723d84780 1 > prepared part key=_multipart_5UYL15O31IHM.2~6HGT47BPA3IO.1 size=1048576 2023-12-03T11:42:08.459 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.458+0000 7f8723d84780 1 > prepared part key=_multipart_5UYL15O31IHM.2~6HGT47BPA3IO.2 size=257462 2023-12-03T11:42:08.459 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.458+0000 7f8723d84780 1 > prepared multipart upload key=5UYL15O31IHM upload=6HGT47BPA3IO tag=K6XKUIE3EM5D type=write size=3403190 2023-12-03T11:42:08.461 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.460+0000 7f8723d84780 1 < suggested remove operation key=J33T5S893LMV tag=8P9242UKN2UM type=del 2023-12-03T11:42:08.463 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.462+0000 7f8723d84780 1 > prepared part key=_multipart_AB0SN0E49Z5F.2~LQDDFG43DNLY.0 size=1048576 2023-12-03T11:42:08.464 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.463+0000 7f8723d84780 1 > prepared part key=_multipart_AB0SN0E49Z5F.2~LQDDFG43DNLY.1 size=655758 2023-12-03T11:42:08.464 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.463+0000 7f8723d84780 1 > prepared multipart upload key=AB0SN0E49Z5F upload=LQDDFG43DNLY tag=IR92Y933CEAW type=write size=2752910 2023-12-03T11:42:08.466 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.465+0000 7f8723d84780 1 < completed delete operation key=G36T76K8O7A1 tag=J377WF0RI4WS type=del 2023-12-03T11:42:08.467 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.466+0000 7f8723d84780 1 > prepared operation key=5UYL15O31IHM tag=W53589MS7JE6 type=del size=3253532 2023-12-03T11:42:08.468 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.467+0000 7f8723d84780 1 < completed part key=_multipart_DMQX2DGDLU7D.2~N2CB1NDMBEG4.0 size=1048576 2023-12-03T11:42:08.469 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.468+0000 7f8723d84780 1 < completed part key=_multipart_DMQX2DGDLU7D.2~N2CB1NDMBEG4.1 size=1048576 2023-12-03T11:42:08.470 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.469+0000 7f8723d84780 1 < completed part key=_multipart_DMQX2DGDLU7D.2~N2CB1NDMBEG4.2 size=1002259 2023-12-03T11:42:08.472 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.471+0000 7f8723d84780 1 < completed multipart upload key=DMQX2DGDLU7D upload=N2CB1NDMBEG4 tag=XUB7LFD80LLS type=write size=4147987 2023-12-03T11:42:08.474 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.473+0000 7f8723d84780 1 > prepared part key=_multipart_G36T76K8O7A1.2~2RK2H7WZEPZ0.0 size=298128 2023-12-03T11:42:08.474 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.473+0000 7f8723d84780 1 > prepared multipart upload key=G36T76K8O7A1 upload=2RK2H7WZEPZ0 tag=IXZ3OYXP5ENF type=write size=1346704 2023-12-03T11:42:08.475 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.474+0000 7f8723d84780 1 < completed delete operation key=K83BTR5BOLZE tag=2FJERGV0SPE1 type=del 2023-12-03T11:42:08.477 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.476+0000 7f8723d84780 1 > prepared operation key=10JRIKOZ16FY tag=1EVGT9T7FE20 type=del size=1763329 2023-12-03T11:42:08.478 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.477+0000 7f8723d84780 1 < canceled operation key=DMQX2DGDLU7D tag=5ZMUSP04RKH9 type=del size=3820559 2023-12-03T11:42:08.480 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.479+0000 7f8723d84780 1 > prepared part key=_multipart_G36T76K8O7A1.2~2RM2B329TAAB.0 size=1048576 2023-12-03T11:42:08.481 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.480+0000 7f8723d84780 1 > prepared part key=_multipart_G36T76K8O7A1.2~2RM2B329TAAB.1 size=1048576 2023-12-03T11:42:08.482 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.481+0000 7f8723d84780 1 > prepared part key=_multipart_G36T76K8O7A1.2~2RM2B329TAAB.2 size=178664 2023-12-03T11:42:08.482 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.481+0000 7f8723d84780 1 > prepared multipart upload key=G36T76K8O7A1 upload=2RM2B329TAAB tag=0HE6LL8PBH8X type=write size=3324392 2023-12-03T11:42:08.483 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.482+0000 7f8723d84780 1 < completed part key=_multipart_TSTIBGVYUZZZ.2~X5R2Y2MRLQ58.0 size=1048576 2023-12-03T11:42:08.484 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.483+0000 7f8723d84780 1 < completed part key=_multipart_TSTIBGVYUZZZ.2~X5R2Y2MRLQ58.1 size=1048576 2023-12-03T11:42:08.485 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.484+0000 7f8723d84780 1 < completed part key=_multipart_TSTIBGVYUZZZ.2~X5R2Y2MRLQ58.2 size=833360 2023-12-03T11:42:08.487 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.486+0000 7f8723d84780 1 < completed multipart upload key=TSTIBGVYUZZZ upload=X5R2Y2MRLQ58 tag=ZVVHKYUNA8NX type=write size=3979088 2023-12-03T11:42:08.488 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.487+0000 7f8723d84780 1 > prepared operation key=HIU6L0NQ8Q95 tag=3D5T77XKH393 type=del size=2398622 2023-12-03T11:42:08.490 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.489+0000 7f8723d84780 1 < completed delete operation key=VENJI0KD1XDW tag=S75IVY1IDU2W type=del 2023-12-03T11:42:08.491 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.490+0000 7f8723d84780 1 > prepared operation key=VENJI0KD1XDW tag=NUJYR4H07DJ0 type=del size=2393595 2023-12-03T11:42:08.492 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.491+0000 7f8723d84780 1 < completed part key=_multipart_TSTIBGVYUZZZ.2~L0IPA6EQ8EC1.0 size=1048576 2023-12-03T11:42:08.493 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.492+0000 7f8723d84780 1 < completed part key=_multipart_TSTIBGVYUZZZ.2~L0IPA6EQ8EC1.1 size=1048576 2023-12-03T11:42:08.494 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.493+0000 7f8723d84780 1 < completed part key=_multipart_TSTIBGVYUZZZ.2~L0IPA6EQ8EC1.2 size=1044662 2023-12-03T11:42:08.496 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.495+0000 7f8723d84780 1 < completed multipart upload key=TSTIBGVYUZZZ upload=L0IPA6EQ8EC1 tag=TXQI2X8DQ9AH type=write size=4190390 2023-12-03T11:42:08.497 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.496+0000 7f8723d84780 1 > prepared operation key=Y6S7QI60GCLE tag=OS1WIDUMPA0X type=write size=51543 2023-12-03T11:42:08.498 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.497+0000 7f8723d84780 1 < completed part key=_multipart_HIU6L0NQ8Q95.2~P01116IBSWVE.0 size=1048576 2023-12-03T11:42:08.499 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.498+0000 7f8723d84780 1 < completed part key=_multipart_HIU6L0NQ8Q95.2~P01116IBSWVE.1 size=1048576 2023-12-03T11:42:08.500 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.499+0000 7f8723d84780 1 < completed part key=_multipart_HIU6L0NQ8Q95.2~P01116IBSWVE.2 size=578198 2023-12-03T11:42:08.502 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.501+0000 7f8723d84780 1 < completed multipart upload key=HIU6L0NQ8Q95 upload=P01116IBSWVE tag=D18ZIRND9A8C type=write size=3723926 2023-12-03T11:42:08.504 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.503+0000 7f8723d84780 1 > prepared part key=_multipart_4I8PWBZOLDUG.2~UW4P6P6VSKJ0.0 size=1048576 2023-12-03T11:42:08.505 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.504+0000 7f8723d84780 1 > prepared part key=_multipart_4I8PWBZOLDUG.2~UW4P6P6VSKJ0.1 size=1048576 2023-12-03T11:42:08.506 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.505+0000 7f8723d84780 1 > prepared part key=_multipart_4I8PWBZOLDUG.2~UW4P6P6VSKJ0.2 size=530699 2023-12-03T11:42:08.506 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.505+0000 7f8723d84780 1 > prepared multipart upload key=4I8PWBZOLDUG upload=UW4P6P6VSKJ0 tag=NSJLDGJC0PHN type=write size=3676427 2023-12-03T11:42:08.508 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.506+0000 7f8723d84780 1 < canceled operation key=EY9ZG5KOTBWM tag=AQ2LKR2WU1AL type=del size=3824913 2023-12-03T11:42:08.510 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.509+0000 7f8723d84780 1 > prepared part key=_multipart_4I8PWBZOLDUG.2~48MZUW3QRHAS.0 size=1048576 2023-12-03T11:42:08.511 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.510+0000 7f8723d84780 1 > prepared part key=_multipart_4I8PWBZOLDUG.2~48MZUW3QRHAS.1 size=1048576 2023-12-03T11:42:08.511 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.510+0000 7f8723d84780 1 > prepared part key=_multipart_4I8PWBZOLDUG.2~48MZUW3QRHAS.2 size=984216 2023-12-03T11:42:08.512 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.510+0000 7f8723d84780 1 > prepared multipart upload key=4I8PWBZOLDUG upload=48MZUW3QRHAS tag=69W2XG75QUXV type=write size=4129944 2023-12-03T11:42:08.513 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.512+0000 7f8723d84780 1 < completed delete operation key=W2704YS8KYQB tag=XQOT1M2YCJHE type=del 2023-12-03T11:42:08.515 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.514+0000 7f8723d84780 1 > prepared part key=_multipart_M4VKPN6INFNZ.2~3MAWOFNKWFRQ.0 size=1048576 2023-12-03T11:42:08.516 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.515+0000 7f8723d84780 1 > prepared part key=_multipart_M4VKPN6INFNZ.2~3MAWOFNKWFRQ.1 size=815324 2023-12-03T11:42:08.516 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.515+0000 7f8723d84780 1 > prepared multipart upload key=M4VKPN6INFNZ upload=3MAWOFNKWFRQ tag=JHIXL3PC20CS type=write size=2912476 2023-12-03T11:42:08.517 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.516+0000 7f8723d84780 1 < completed part key=_multipart_5UYL15O31IHM.2~AO7P1A161MIJ.0 size=815432 2023-12-03T11:42:08.519 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.518+0000 7f8723d84780 1 < completed multipart upload key=5UYL15O31IHM upload=AO7P1A161MIJ tag=QTSUNVDZX0IJ type=write size=1864008 2023-12-03T11:42:08.521 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.520+0000 7f8723d84780 1 > prepared part key=_multipart_M4VKPN6INFNZ.2~A5SIFUH9ICXN.0 size=1048576 2023-12-03T11:42:08.522 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.521+0000 7f8723d84780 1 > prepared part key=_multipart_M4VKPN6INFNZ.2~A5SIFUH9ICXN.1 size=423415 2023-12-03T11:42:08.522 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.521+0000 7f8723d84780 1 > prepared multipart upload key=M4VKPN6INFNZ upload=A5SIFUH9ICXN tag=DI1E88U0SJNW type=write size=2520567 2023-12-03T11:42:08.523 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.522+0000 7f8723d84780 1 < completed part key=_multipart_OPQPIDJ2PBVU.2~LOD2JVW31B7O.0 size=692229 2023-12-03T11:42:08.526 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.525+0000 7f8723d84780 1 < completed multipart upload key=OPQPIDJ2PBVU upload=LOD2JVW31B7O tag=4J7MFV2LREV9 type=write size=1740805 2023-12-03T11:42:08.527 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.526+0000 7f8723d84780 1 > prepared operation key=FCA2R3HR61S2 tag=FBMGXRZ272A9 type=del size=3934927 2023-12-03T11:42:08.528 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.527+0000 7f8723d84780 1 < completed part key=_multipart_Y6S7QI60GCLE.2~2HAQI7OOAHR8.0 size=432571 2023-12-03T11:42:08.531 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.529+0000 7f8723d84780 1 < completed multipart upload key=Y6S7QI60GCLE upload=2HAQI7OOAHR8 tag=VG7WU7XEWHP3 type=write size=1481147 2023-12-03T11:42:08.532 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.531+0000 7f8723d84780 1 > prepared part key=_multipart_O7VVHXLDSY57.2~53SFV7PZV121.0 size=1048576 2023-12-03T11:42:08.534 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.532+0000 7f8723d84780 1 > prepared part key=_multipart_O7VVHXLDSY57.2~53SFV7PZV121.1 size=1048576 2023-12-03T11:42:08.534 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.533+0000 7f8723d84780 1 > prepared part key=_multipart_O7VVHXLDSY57.2~53SFV7PZV121.2 size=377761 2023-12-03T11:42:08.535 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.533+0000 7f8723d84780 1 > prepared multipart upload key=O7VVHXLDSY57 upload=53SFV7PZV121 tag=LHXMUC15BNYU type=write size=3523489 2023-12-03T11:42:08.536 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.535+0000 7f8723d84780 1 < completed part key=_multipart_HIU6L0NQ8Q95.2~111NZSC86N5W.0 size=765974 2023-12-03T11:42:08.538 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.537+0000 7f8723d84780 1 < completed multipart upload key=HIU6L0NQ8Q95 upload=111NZSC86N5W tag=Q9XYOTV5HG4D type=write size=1814550 2023-12-03T11:42:08.539 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.538+0000 7f8723d84780 1 > prepared operation key=D3JEVEY0E29E tag=7QG4IZ2EH6Z8 type=del size=1282170 2023-12-03T11:42:08.540 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.539+0000 7f8723d84780 1 < completed part key=_multipart_5UYL15O31IHM.2~6HGT47BPA3IO.0 size=1048576 2023-12-03T11:42:08.541 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.540+0000 7f8723d84780 1 < completed part key=_multipart_5UYL15O31IHM.2~6HGT47BPA3IO.1 size=1048576 2023-12-03T11:42:08.542 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.541+0000 7f8723d84780 1 < completed part key=_multipart_5UYL15O31IHM.2~6HGT47BPA3IO.2 size=257462 2023-12-03T11:42:08.544 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.543+0000 7f8723d84780 1 < completed multipart upload key=5UYL15O31IHM upload=6HGT47BPA3IO tag=K6XKUIE3EM5D type=write size=3403190 2023-12-03T11:42:08.545 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.544+0000 7f8723d84780 1 > prepared operation key=DMQX2DGDLU7D tag=S511DVJJ03JY type=del size=891500 2023-12-03T11:42:08.546 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.545+0000 7f8723d84780 1 < completed part key=_multipart_AB0SN0E49Z5F.2~LQDDFG43DNLY.0 size=1048576 2023-12-03T11:42:08.547 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.546+0000 7f8723d84780 1 < completed part key=_multipart_AB0SN0E49Z5F.2~LQDDFG43DNLY.1 size=655758 2023-12-03T11:42:08.549 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.548+0000 7f8723d84780 1 < completed multipart upload key=AB0SN0E49Z5F upload=LQDDFG43DNLY tag=IR92Y933CEAW type=write size=2752910 2023-12-03T11:42:08.550 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.549+0000 7f8723d84780 1 > prepared operation key=EY9ZG5KOTBWM tag=C0L7K2W24RPA type=write size=432618 2023-12-03T11:42:08.552 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.551+0000 7f8723d84780 1 < suggested update operation key=5UYL15O31IHM tag=W53589MS7JE6 type=del size=3253532 2023-12-03T11:42:08.554 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.553+0000 7f8723d84780 1 > prepared part key=_multipart_96RAVVSUKH0Y.2~AQ5YA2BWXCAR.0 size=1048576 2023-12-03T11:42:08.555 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.554+0000 7f8723d84780 1 > prepared part key=_multipart_96RAVVSUKH0Y.2~AQ5YA2BWXCAR.1 size=1048576 2023-12-03T11:42:08.556 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.555+0000 7f8723d84780 1 > prepared part key=_multipart_96RAVVSUKH0Y.2~AQ5YA2BWXCAR.2 size=84096 2023-12-03T11:42:08.556 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.555+0000 7f8723d84780 1 > prepared multipart upload key=96RAVVSUKH0Y upload=AQ5YA2BWXCAR tag=A10IG3UPA42O type=write size=3229824 2023-12-03T11:42:08.557 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.556+0000 7f8723d84780 1 < completed part key=_multipart_G36T76K8O7A1.2~2RK2H7WZEPZ0.0 size=298128 2023-12-03T11:42:08.559 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.558+0000 7f8723d84780 1 < completed multipart upload key=G36T76K8O7A1 upload=2RK2H7WZEPZ0 tag=IXZ3OYXP5ENF type=write size=1346704 2023-12-03T11:42:08.560 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.559+0000 7f8723d84780 1 > prepared operation key=G36T76K8O7A1 tag=1RNS79CQPGTX type=del size=1177642 2023-12-03T11:42:08.562 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.561+0000 7f8723d84780 1 < completed delete operation key=10JRIKOZ16FY tag=1EVGT9T7FE20 type=del 2023-12-03T11:42:08.564 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.563+0000 7f8723d84780 1 > prepared part key=_multipart_M4VKPN6INFNZ.2~16A4HG0VU55J.0 size=1048576 2023-12-03T11:42:08.565 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.564+0000 7f8723d84780 1 > prepared part key=_multipart_M4VKPN6INFNZ.2~16A4HG0VU55J.1 size=563162 2023-12-03T11:42:08.565 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.564+0000 7f8723d84780 1 > prepared multipart upload key=M4VKPN6INFNZ upload=16A4HG0VU55J tag=QIB8M7A51NFT type=write size=2660314 2023-12-03T11:42:08.567 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.565+0000 7f8723d84780 1 < completed part key=_multipart_G36T76K8O7A1.2~2RM2B329TAAB.0 size=1048576 2023-12-03T11:42:08.568 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.566+0000 7f8723d84780 1 < completed part key=_multipart_G36T76K8O7A1.2~2RM2B329TAAB.1 size=1048576 2023-12-03T11:42:08.569 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.567+0000 7f8723d84780 1 < completed part key=_multipart_G36T76K8O7A1.2~2RM2B329TAAB.2 size=178664 2023-12-03T11:42:08.571 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.569+0000 7f8723d84780 1 < completed multipart upload key=G36T76K8O7A1 upload=2RM2B329TAAB tag=0HE6LL8PBH8X type=write size=3324392 2023-12-03T11:42:08.573 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.571+0000 7f8723d84780 1 > prepared part key=_multipart_LCK58DDM5XU9.2~BQ62O2FXAE00.0 size=195416 2023-12-03T11:42:08.573 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.571+0000 7f8723d84780 1 > prepared multipart upload key=LCK58DDM5XU9 upload=BQ62O2FXAE00 tag=S2NMVKVXHECC type=write size=1243992 2023-12-03T11:42:08.574 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.573+0000 7f8723d84780 1 < canceled operation key=HIU6L0NQ8Q95 tag=3D5T77XKH393 type=del size=2398622 2023-12-03T11:42:08.575 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.574+0000 7f8723d84780 1 > prepared operation key=Y6S7QI60GCLE tag=XRB7QR167GBZ type=del size=2536324 2023-12-03T11:42:08.576 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.575+0000 7f8723d84780 1 < completed delete operation key=VENJI0KD1XDW tag=NUJYR4H07DJ0 type=del 2023-12-03T11:42:08.577 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.576+0000 7f8723d84780 1 > prepared operation key=931GNEXBHH35 tag=25K316EFKV3F type=del size=3543805 2023-12-03T11:42:08.579 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.578+0000 7f8723d84780 1 < completed write operation key=Y6S7QI60GCLE tag=OS1WIDUMPA0X type=write size=51543 2023-12-03T11:42:08.580 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.579+0000 7f8723d84780 1 > prepared operation key=OGACI7CRPMT7 tag=99UFQD66D4DE type=del size=3013843 2023-12-03T11:42:08.581 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.580+0000 7f8723d84780 1 < completed part key=_multipart_4I8PWBZOLDUG.2~UW4P6P6VSKJ0.0 size=1048576 2023-12-03T11:42:08.582 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.581+0000 7f8723d84780 1 < completed part key=_multipart_4I8PWBZOLDUG.2~UW4P6P6VSKJ0.1 size=1048576 2023-12-03T11:42:08.583 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.582+0000 7f8723d84780 1 < completed part key=_multipart_4I8PWBZOLDUG.2~UW4P6P6VSKJ0.2 size=530699 2023-12-03T11:42:08.586 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.584+0000 7f8723d84780 1 < completed multipart upload key=4I8PWBZOLDUG upload=UW4P6P6VSKJ0 tag=NSJLDGJC0PHN type=write size=3676427 2023-12-03T11:42:08.587 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.586+0000 7f8723d84780 1 > prepared part key=_multipart_W2704YS8KYQB.2~5W3SI0ZT1LRD.0 size=1048576 2023-12-03T11:42:08.588 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.587+0000 7f8723d84780 1 > prepared part key=_multipart_W2704YS8KYQB.2~5W3SI0ZT1LRD.1 size=1048576 2023-12-03T11:42:08.589 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.588+0000 7f8723d84780 1 > prepared part key=_multipart_W2704YS8KYQB.2~5W3SI0ZT1LRD.2 size=118363 2023-12-03T11:42:08.589 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.588+0000 7f8723d84780 1 > prepared multipart upload key=W2704YS8KYQB upload=5W3SI0ZT1LRD tag=9LOAWTUF3WZ5 type=write size=3264091 2023-12-03T11:42:08.590 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.589+0000 7f8723d84780 1 < completed part key=_multipart_4I8PWBZOLDUG.2~48MZUW3QRHAS.0 size=1048576 2023-12-03T11:42:08.591 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.590+0000 7f8723d84780 1 < completed part key=_multipart_4I8PWBZOLDUG.2~48MZUW3QRHAS.1 size=1048576 2023-12-03T11:42:08.592 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.591+0000 7f8723d84780 1 < completed part key=_multipart_4I8PWBZOLDUG.2~48MZUW3QRHAS.2 size=984216 2023-12-03T11:42:08.595 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.593+0000 7f8723d84780 1 < completed multipart upload key=4I8PWBZOLDUG upload=48MZUW3QRHAS tag=69W2XG75QUXV type=write size=4129944 2023-12-03T11:42:08.596 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.594+0000 7f8723d84780 1 > prepared operation key=TSTIBGVYUZZZ tag=JCV74963EGR0 type=write size=960316 2023-12-03T11:42:08.597 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.596+0000 7f8723d84780 1 < completed part key=_multipart_M4VKPN6INFNZ.2~3MAWOFNKWFRQ.0 size=1048576 2023-12-03T11:42:08.598 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.597+0000 7f8723d84780 1 < completed part key=_multipart_M4VKPN6INFNZ.2~3MAWOFNKWFRQ.1 size=815324 2023-12-03T11:42:08.600 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.599+0000 7f8723d84780 1 < completed multipart upload key=M4VKPN6INFNZ upload=3MAWOFNKWFRQ tag=JHIXL3PC20CS type=write size=2912476 2023-12-03T11:42:08.602 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.601+0000 7f8723d84780 1 > prepared part key=_multipart_KS5J7E7KE2IJ.2~H3OVA83SLQ4W.0 size=478557 2023-12-03T11:42:08.602 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.601+0000 7f8723d84780 1 > prepared multipart upload key=KS5J7E7KE2IJ upload=H3OVA83SLQ4W tag=48Q4IBURGYFC type=write size=1527133 2023-12-03T11:42:08.604 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.603+0000 7f8723d84780 1 < completed part key=_multipart_M4VKPN6INFNZ.2~A5SIFUH9ICXN.0 size=1048576 2023-12-03T11:42:08.605 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.604+0000 7f8723d84780 1 < completed part key=_multipart_M4VKPN6INFNZ.2~A5SIFUH9ICXN.1 size=423415 2023-12-03T11:42:08.607 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.606+0000 7f8723d84780 1 < completed multipart upload key=M4VKPN6INFNZ upload=A5SIFUH9ICXN tag=DI1E88U0SJNW type=write size=2520567 2023-12-03T11:42:08.608 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.607+0000 7f8723d84780 1 > prepared operation key=7THZZ1J5LOZK tag=PU4SBE6RS4HG type=del size=4068875 2023-12-03T11:42:08.609 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.608+0000 7f8723d84780 1 < completed delete operation key=FCA2R3HR61S2 tag=FBMGXRZ272A9 type=del 2023-12-03T11:42:08.611 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.609+0000 7f8723d84780 1 > prepared operation key=LMVO6CVEPN3K tag=KXS6P8N1MM4G type=del size=2873813 2023-12-03T11:42:08.612 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.611+0000 7f8723d84780 1 < completed part key=_multipart_O7VVHXLDSY57.2~53SFV7PZV121.0 size=1048576 2023-12-03T11:42:08.613 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.612+0000 7f8723d84780 1 < completed part key=_multipart_O7VVHXLDSY57.2~53SFV7PZV121.1 size=1048576 2023-12-03T11:42:08.614 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.613+0000 7f8723d84780 1 < completed part key=_multipart_O7VVHXLDSY57.2~53SFV7PZV121.2 size=377761 2023-12-03T11:42:08.616 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.615+0000 7f8723d84780 1 < completed multipart upload key=O7VVHXLDSY57 upload=53SFV7PZV121 tag=LHXMUC15BNYU type=write size=3523489 2023-12-03T11:42:08.618 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.617+0000 7f8723d84780 1 > prepared part key=_multipart_UWS266H06VDK.2~FDP202I80ET8.0 size=1048576 2023-12-03T11:42:08.619 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.618+0000 7f8723d84780 1 > prepared part key=_multipart_UWS266H06VDK.2~FDP202I80ET8.1 size=1048576 2023-12-03T11:42:08.620 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.619+0000 7f8723d84780 1 > prepared part key=_multipart_UWS266H06VDK.2~FDP202I80ET8.2 size=371226 2023-12-03T11:42:08.620 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.619+0000 7f8723d84780 1 > prepared multipart upload key=UWS266H06VDK upload=FDP202I80ET8 tag=BE3FF0DKO7M4 type=write size=3516954 2023-12-03T11:42:08.622 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.621+0000 7f8723d84780 1 < suggested remove operation key=D3JEVEY0E29E tag=7QG4IZ2EH6Z8 type=del 2023-12-03T11:42:08.624 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.623+0000 7f8723d84780 1 > prepared part key=_multipart_K83BTR5BOLZE.2~4UYM1YH212RX.0 size=1048576 2023-12-03T11:42:08.625 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.624+0000 7f8723d84780 1 > prepared part key=_multipart_K83BTR5BOLZE.2~4UYM1YH212RX.1 size=1048576 2023-12-03T11:42:08.626 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.625+0000 7f8723d84780 1 > prepared part key=_multipart_K83BTR5BOLZE.2~4UYM1YH212RX.2 size=652882 2023-12-03T11:42:08.626 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.625+0000 7f8723d84780 1 > prepared multipart upload key=K83BTR5BOLZE upload=4UYM1YH212RX tag=J8W0Q7YNS4PC type=write size=3798610 2023-12-03T11:42:08.627 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.626+0000 7f8723d84780 1 < completed delete operation key=DMQX2DGDLU7D tag=S511DVJJ03JY type=del 2023-12-03T11:42:08.628 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.627+0000 7f8723d84780 1 > prepared operation key=LMVO6CVEPN3K tag=NJGYCW3EFFCK type=del size=2629534 2023-12-03T11:42:08.631 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.630+0000 7f8723d84780 1 < suggested remove operation key=EY9ZG5KOTBWM tag=C0L7K2W24RPA type=write 2023-12-03T11:42:08.634 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.633+0000 7f8723d84780 1 > prepared part key=_multipart_D3JEVEY0E29E.2~HLQQS3LYSQ6O.0 size=1048576 2023-12-03T11:42:08.635 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.634+0000 7f8723d84780 1 > prepared part key=_multipart_D3JEVEY0E29E.2~HLQQS3LYSQ6O.1 size=345154 2023-12-03T11:42:08.635 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.634+0000 7f8723d84780 1 > prepared multipart upload key=D3JEVEY0E29E upload=HLQQS3LYSQ6O tag=7RRUT2EVF84L type=write size=2442306 2023-12-03T11:42:08.636 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.635+0000 7f8723d84780 1 < completed part key=_multipart_96RAVVSUKH0Y.2~AQ5YA2BWXCAR.0 size=1048576 2023-12-03T11:42:08.638 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.636+0000 7f8723d84780 1 < completed part key=_multipart_96RAVVSUKH0Y.2~AQ5YA2BWXCAR.1 size=1048576 2023-12-03T11:42:08.639 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.637+0000 7f8723d84780 1 < completed part key=_multipart_96RAVVSUKH0Y.2~AQ5YA2BWXCAR.2 size=84096 2023-12-03T11:42:08.640 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.639+0000 7f8723d84780 1 < completed multipart upload key=96RAVVSUKH0Y upload=AQ5YA2BWXCAR tag=A10IG3UPA42O type=write size=3229824 2023-12-03T11:42:08.641 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.640+0000 7f8723d84780 1 > prepared operation key=EY9ZG5KOTBWM tag=WKBS2MKVGILD type=write size=1022558 2023-12-03T11:42:08.642 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.641+0000 7f8723d84780 1 < completed delete operation key=G36T76K8O7A1 tag=1RNS79CQPGTX type=del 2023-12-03T11:42:08.644 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.643+0000 7f8723d84780 1 > prepared part key=_multipart_W2704YS8KYQB.2~TI84Y2DXMXEA.0 size=727990 2023-12-03T11:42:08.644 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.643+0000 7f8723d84780 1 > prepared multipart upload key=W2704YS8KYQB upload=TI84Y2DXMXEA tag=23CAP5Y78KDC type=write size=1776566 2023-12-03T11:42:08.646 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.645+0000 7f8723d84780 1 < completed part key=_multipart_M4VKPN6INFNZ.2~16A4HG0VU55J.0 size=1048576 2023-12-03T11:42:08.649 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.646+0000 7f8723d84780 1 < completed part key=_multipart_M4VKPN6INFNZ.2~16A4HG0VU55J.1 size=563162 2023-12-03T11:42:08.649 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.648+0000 7f8723d84780 1 < completed multipart upload key=M4VKPN6INFNZ upload=16A4HG0VU55J tag=QIB8M7A51NFT type=write size=2660314 2023-12-03T11:42:08.650 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.649+0000 7f8723d84780 1 > prepared operation key=931GNEXBHH35 tag=8RO28LC2HTJT type=del size=2637823 2023-12-03T11:42:08.651 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.650+0000 7f8723d84780 1 < completed part key=_multipart_LCK58DDM5XU9.2~BQ62O2FXAE00.0 size=195416 2023-12-03T11:42:08.653 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.652+0000 7f8723d84780 1 < completed multipart upload key=LCK58DDM5XU9 upload=BQ62O2FXAE00 tag=S2NMVKVXHECC type=write size=1243992 2023-12-03T11:42:08.655 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.654+0000 7f8723d84780 1 > prepared operation key=EY9ZG5KOTBWM tag=033G3QEP9TVW type=del size=3625548 2023-12-03T11:42:08.656 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.655+0000 7f8723d84780 1 < completed delete operation key=Y6S7QI60GCLE tag=XRB7QR167GBZ type=del 2023-12-03T11:42:08.658 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.657+0000 7f8723d84780 1 > prepared part key=_multipart_10JRIKOZ16FY.2~UGVUSPFRF1CS.0 size=435111 2023-12-03T11:42:08.658 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.657+0000 7f8723d84780 1 > prepared multipart upload key=10JRIKOZ16FY upload=UGVUSPFRF1CS tag=K8NHCK5ANS85 type=write size=1483687 2023-12-03T11:42:08.659 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.658+0000 7f8723d84780 1 < completed delete operation key=931GNEXBHH35 tag=25K316EFKV3F type=del 2023-12-03T11:42:08.661 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.660+0000 7f8723d84780 1 > prepared part key=_multipart_931GNEXBHH35.2~DWC1MO7I91W8.0 size=1048576 2023-12-03T11:42:08.662 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.661+0000 7f8723d84780 1 > prepared part key=_multipart_931GNEXBHH35.2~DWC1MO7I91W8.1 size=500872 2023-12-03T11:42:08.662 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.661+0000 7f8723d84780 1 > prepared multipart upload key=931GNEXBHH35 upload=DWC1MO7I91W8 tag=75X6YDEHN9GG type=write size=2598024 2023-12-03T11:42:08.665 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.664+0000 7f8723d84780 1 < suggested remove operation key=OGACI7CRPMT7 tag=99UFQD66D4DE type=del 2023-12-03T11:42:08.666 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.665+0000 7f8723d84780 1 > prepared operation key=KS5J7E7KE2IJ tag=H7NSYBRPYGKB type=del size=1398303 2023-12-03T11:42:08.669 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.666+0000 7f8723d84780 1 < completed part key=_multipart_W2704YS8KYQB.2~5W3SI0ZT1LRD.0 size=1048576 2023-12-03T11:42:08.669 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.667+0000 7f8723d84780 1 < completed part key=_multipart_W2704YS8KYQB.2~5W3SI0ZT1LRD.1 size=1048576 2023-12-03T11:42:08.670 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.667+0000 7f8723d84780 1 < canceled part key=_multipart_W2704YS8KYQB.2~5W3SI0ZT1LRD.2 size=118363 2023-12-03T11:42:08.670 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.669+0000 7f8723d84780 1 < canceled multipart upload key=W2704YS8KYQB upload=5W3SI0ZT1LRD tag=9LOAWTUF3WZ5 type=write size=3264091 2023-12-03T11:42:08.672 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.671+0000 7f8723d84780 1 > prepared part key=_multipart_TSTIBGVYUZZZ.2~1659RDDIY8LW.0 size=1048576 2023-12-03T11:42:08.673 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.672+0000 7f8723d84780 1 > prepared part key=_multipart_TSTIBGVYUZZZ.2~1659RDDIY8LW.1 size=1048576 2023-12-03T11:42:08.674 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.673+0000 7f8723d84780 1 > prepared part key=_multipart_TSTIBGVYUZZZ.2~1659RDDIY8LW.2 size=265326 2023-12-03T11:42:08.674 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.673+0000 7f8723d84780 1 > prepared multipart upload key=TSTIBGVYUZZZ upload=1659RDDIY8LW tag=QGKS98U3D1KQ type=write size=3411054 2023-12-03T11:42:08.676 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.675+0000 7f8723d84780 1 < completed write operation key=TSTIBGVYUZZZ tag=JCV74963EGR0 type=write size=960316 2023-12-03T11:42:08.677 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.676+0000 7f8723d84780 1 > prepared operation key=OGACI7CRPMT7 tag=JN37Q6RM6EYV type=del size=2433306 2023-12-03T11:42:08.678 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.677+0000 7f8723d84780 1 < completed part key=_multipart_KS5J7E7KE2IJ.2~H3OVA83SLQ4W.0 size=478557 2023-12-03T11:42:08.680 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.679+0000 7f8723d84780 1 < completed multipart upload key=KS5J7E7KE2IJ upload=H3OVA83SLQ4W tag=48Q4IBURGYFC type=write size=1527133 2023-12-03T11:42:08.682 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.681+0000 7f8723d84780 1 > prepared operation key=5UYL15O31IHM tag=H0DHD0RV6V2P type=del size=2823126 2023-12-03T11:42:08.683 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.682+0000 7f8723d84780 1 < completed delete operation key=7THZZ1J5LOZK tag=PU4SBE6RS4HG type=del 2023-12-03T11:42:08.684 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.683+0000 7f8723d84780 1 > prepared operation key=O7VVHXLDSY57 tag=LHNU8WBIH38K type=del size=2039306 2023-12-03T11:42:08.686 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.685+0000 7f8723d84780 1 < completed delete operation key=LMVO6CVEPN3K tag=KXS6P8N1MM4G type=del 2023-12-03T11:42:08.687 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.686+0000 7f8723d84780 1 > prepared operation key=OPQPIDJ2PBVU tag=VCB7MG7O8ZCK type=write size=300282 2023-12-03T11:42:08.688 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.687+0000 7f8723d84780 1 < completed part key=_multipart_UWS266H06VDK.2~FDP202I80ET8.0 size=1048576 2023-12-03T11:42:08.689 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.688+0000 7f8723d84780 1 < completed part key=_multipart_UWS266H06VDK.2~FDP202I80ET8.1 size=1048576 2023-12-03T11:42:08.690 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.689+0000 7f8723d84780 1 < completed part key=_multipart_UWS266H06VDK.2~FDP202I80ET8.2 size=371226 2023-12-03T11:42:08.692 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.691+0000 7f8723d84780 1 < completed multipart upload key=UWS266H06VDK upload=FDP202I80ET8 tag=BE3FF0DKO7M4 type=write size=3516954 2023-12-03T11:42:08.695 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.694+0000 7f8723d84780 1 > prepared part key=_multipart_12XG7YPYTN4U.2~N1FE3TQ3HVLG.0 size=1048576 2023-12-03T11:42:08.696 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.695+0000 7f8723d84780 1 > prepared part key=_multipart_12XG7YPYTN4U.2~N1FE3TQ3HVLG.1 size=1048576 2023-12-03T11:42:08.697 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.696+0000 7f8723d84780 1 > prepared part key=_multipart_12XG7YPYTN4U.2~N1FE3TQ3HVLG.2 size=444114 2023-12-03T11:42:08.697 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.696+0000 7f8723d84780 1 > prepared multipart upload key=12XG7YPYTN4U upload=N1FE3TQ3HVLG tag=0H0U24LDMR4P type=write size=3589842 2023-12-03T11:42:08.698 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.697+0000 7f8723d84780 1 < completed part key=_multipart_K83BTR5BOLZE.2~4UYM1YH212RX.0 size=1048576 2023-12-03T11:42:08.699 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.698+0000 7f8723d84780 1 < completed part key=_multipart_K83BTR5BOLZE.2~4UYM1YH212RX.1 size=1048576 2023-12-03T11:42:08.700 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.699+0000 7f8723d84780 1 < completed part key=_multipart_K83BTR5BOLZE.2~4UYM1YH212RX.2 size=652882 2023-12-03T11:42:08.702 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.701+0000 7f8723d84780 1 < completed multipart upload key=K83BTR5BOLZE upload=4UYM1YH212RX tag=J8W0Q7YNS4PC type=write size=3798610 2023-12-03T11:42:08.704 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.703+0000 7f8723d84780 1 > prepared operation key=KS5J7E7KE2IJ tag=03RPYTAZU3OO type=write size=671060 2023-12-03T11:42:08.705 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.704+0000 7f8723d84780 1 < completed delete operation key=LMVO6CVEPN3K tag=NJGYCW3EFFCK type=del 2023-12-03T11:42:08.706 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.705+0000 7f8723d84780 1 > prepared operation key=7THZZ1J5LOZK tag=86NOSTKQDRKO type=del size=3186426 2023-12-03T11:42:08.707 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.706+0000 7f8723d84780 1 < completed part key=_multipart_D3JEVEY0E29E.2~HLQQS3LYSQ6O.0 size=1048576 2023-12-03T11:42:08.708 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.707+0000 7f8723d84780 1 < completed part key=_multipart_D3JEVEY0E29E.2~HLQQS3LYSQ6O.1 size=345154 2023-12-03T11:42:08.714 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.710+0000 7f8723d84780 1 < completed multipart upload key=D3JEVEY0E29E upload=HLQQS3LYSQ6O tag=7RRUT2EVF84L type=write size=2442306 2023-12-03T11:42:08.714 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.711+0000 7f8723d84780 1 > prepared operation key=EY9ZG5KOTBWM tag=02EQZMESR0R0 type=del size=3960036 2023-12-03T11:42:08.714 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.713+0000 7f8723d84780 1 < suggested remove operation key=EY9ZG5KOTBWM tag=WKBS2MKVGILD type=write 2023-12-03T11:42:08.716 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.714+0000 7f8723d84780 1 > prepared operation key=HIU6L0NQ8Q95 tag=9JHXGYQDH980 type=del size=1781988 2023-12-03T11:42:08.717 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.716+0000 7f8723d84780 1 < completed part key=_multipart_W2704YS8KYQB.2~TI84Y2DXMXEA.0 size=727990 2023-12-03T11:42:08.719 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.718+0000 7f8723d84780 1 < completed multipart upload key=W2704YS8KYQB upload=TI84Y2DXMXEA tag=23CAP5Y78KDC type=write size=1776566 2023-12-03T11:42:08.720 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.719+0000 7f8723d84780 1 > prepared operation key=D3JEVEY0E29E tag=QVL2S871YCJ6 type=del size=1683722 2023-12-03T11:42:08.721 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.720+0000 7f8723d84780 1 < completed delete operation key=931GNEXBHH35 tag=8RO28LC2HTJT type=del 2023-12-03T11:42:08.722 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.721+0000 7f8723d84780 1 > prepared operation key=931GNEXBHH35 tag=RTS2Y9MDVFSE type=del size=1355874 2023-12-03T11:42:08.724 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.722+0000 7f8723d84780 -1 < failed to complete operation key=EY9ZG5KOTBWM tag=033G3QEP9TVW type=del size=3625548: (22) Invalid argument 2023-12-03T11:42:08.726 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.725+0000 7f8723d84780 1 > prepared part key=_multipart_UWS266H06VDK.2~8EHA6SXXWWJB.0 size=1048576 2023-12-03T11:42:08.726 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.725+0000 7f8723d84780 1 > prepared part key=_multipart_UWS266H06VDK.2~8EHA6SXXWWJB.1 size=1048576 2023-12-03T11:42:08.728 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.726+0000 7f8723d84780 1 > prepared part key=_multipart_UWS266H06VDK.2~8EHA6SXXWWJB.2 size=983099 2023-12-03T11:42:08.728 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.726+0000 7f8723d84780 1 > prepared multipart upload key=UWS266H06VDK upload=8EHA6SXXWWJB tag=ZUJA8PPIW9BW type=write size=4128827 2023-12-03T11:42:08.729 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.728+0000 7f8723d84780 1 < completed part key=_multipart_10JRIKOZ16FY.2~UGVUSPFRF1CS.0 size=435111 2023-12-03T11:42:08.731 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.730+0000 7f8723d84780 1 < completed multipart upload key=10JRIKOZ16FY upload=UGVUSPFRF1CS tag=K8NHCK5ANS85 type=write size=1483687 2023-12-03T11:42:08.732 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.731+0000 7f8723d84780 1 > prepared operation key=12XG7YPYTN4U tag=F11HECME4WVY type=write size=137835 2023-12-03T11:42:08.733 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.732+0000 7f8723d84780 1 < completed part key=_multipart_931GNEXBHH35.2~DWC1MO7I91W8.0 size=1048576 2023-12-03T11:42:08.734 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.733+0000 7f8723d84780 1 < completed part key=_multipart_931GNEXBHH35.2~DWC1MO7I91W8.1 size=500872 2023-12-03T11:42:08.736 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.735+0000 7f8723d84780 1 < completed multipart upload key=931GNEXBHH35 upload=DWC1MO7I91W8 tag=75X6YDEHN9GG type=write size=2598024 2023-12-03T11:42:08.737 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.736+0000 7f8723d84780 1 > prepared operation key=5UYL15O31IHM tag=77WP53WX7OJI type=del size=480653 2023-12-03T11:42:08.740 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.739+0000 7f8723d84780 1 < suggested remove operation key=KS5J7E7KE2IJ tag=H7NSYBRPYGKB type=del 2023-12-03T11:42:08.742 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.741+0000 7f8723d84780 1 > prepared part key=_multipart_DMQX2DGDLU7D.2~YB7TB6TTYQL8.0 size=1048576 2023-12-03T11:42:08.743 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.742+0000 7f8723d84780 1 > prepared part key=_multipart_DMQX2DGDLU7D.2~YB7TB6TTYQL8.1 size=734695 2023-12-03T11:42:08.743 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.742+0000 7f8723d84780 1 > prepared multipart upload key=DMQX2DGDLU7D upload=YB7TB6TTYQL8 tag=QGKV71WI0QDN type=write size=2831847 2023-12-03T11:42:08.744 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.743+0000 7f8723d84780 1 < completed part key=_multipart_TSTIBGVYUZZZ.2~1659RDDIY8LW.0 size=1048576 2023-12-03T11:42:08.745 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.744+0000 7f8723d84780 1 < completed part key=_multipart_TSTIBGVYUZZZ.2~1659RDDIY8LW.1 size=1048576 2023-12-03T11:42:08.747 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.746+0000 7f8723d84780 1 < completed part key=_multipart_TSTIBGVYUZZZ.2~1659RDDIY8LW.2 size=265326 2023-12-03T11:42:08.749 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.748+0000 7f8723d84780 1 < completed multipart upload key=TSTIBGVYUZZZ upload=1659RDDIY8LW tag=QGKS98U3D1KQ type=write size=3411054 2023-12-03T11:42:08.750 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.749+0000 7f8723d84780 1 > prepared operation key=7VMTBKUWU59F tag=AMKW58TIRB8X type=del size=2920758 2023-12-03T11:42:08.751 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.750+0000 7f8723d84780 1 < completed delete operation key=OGACI7CRPMT7 tag=JN37Q6RM6EYV type=del 2023-12-03T11:42:08.752 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.751+0000 7f8723d84780 1 > prepared operation key=8NONX2I08YMJ tag=V8LHAC2Z2WCS type=del size=1060135 2023-12-03T11:42:08.753 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.752+0000 7f8723d84780 1 < completed delete operation key=5UYL15O31IHM tag=H0DHD0RV6V2P type=del 2023-12-03T11:42:08.755 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.754+0000 7f8723d84780 1 > prepared part key=_multipart_10JRIKOZ16FY.2~J7MFRQC0LJE8.0 size=592305 2023-12-03T11:42:08.755 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.754+0000 7f8723d84780 1 > prepared multipart upload key=10JRIKOZ16FY upload=J7MFRQC0LJE8 tag=MXUP6YP8V7MO type=write size=1640881 2023-12-03T11:42:08.756 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.755+0000 7f8723d84780 1 < completed delete operation key=O7VVHXLDSY57 tag=LHNU8WBIH38K type=del 2023-12-03T11:42:08.757 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.756+0000 7f8723d84780 1 > prepared operation key=LCK58DDM5XU9 tag=256HUBPHGIYA type=del size=2886508 2023-12-03T11:42:08.759 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.758+0000 7f8723d84780 1 < completed write operation key=OPQPIDJ2PBVU tag=VCB7MG7O8ZCK type=write size=300282 2023-12-03T11:42:08.760 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.759+0000 7f8723d84780 1 > prepared operation key=W2704YS8KYQB tag=8B9033P6OT8O type=del size=302761 2023-12-03T11:42:08.761 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.760+0000 7f8723d84780 1 < completed part key=_multipart_12XG7YPYTN4U.2~N1FE3TQ3HVLG.0 size=1048576 2023-12-03T11:42:08.762 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.761+0000 7f8723d84780 1 < completed part key=_multipart_12XG7YPYTN4U.2~N1FE3TQ3HVLG.1 size=1048576 2023-12-03T11:42:08.763 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.762+0000 7f8723d84780 1 < completed part key=_multipart_12XG7YPYTN4U.2~N1FE3TQ3HVLG.2 size=444114 2023-12-03T11:42:08.765 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.764+0000 7f8723d84780 1 < completed multipart upload key=12XG7YPYTN4U upload=N1FE3TQ3HVLG tag=0H0U24LDMR4P type=write size=3589842 2023-12-03T11:42:08.767 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.766+0000 7f8723d84780 1 > prepared part key=_multipart_FCA2R3HR61S2.2~V2K9S73MUV8L.0 size=826794 2023-12-03T11:42:08.767 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.766+0000 7f8723d84780 1 > prepared multipart upload key=FCA2R3HR61S2 upload=V2K9S73MUV8L tag=CH14X5LVGNC7 type=write size=1875370 2023-12-03T11:42:08.767 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.766+0000 7f8723d84780 -1 < no bi entry to suggest for operation key=KS5J7E7KE2IJ tag=03RPYTAZU3OO type=write size=671060: (2) No such file or directory 2023-12-03T11:42:08.769 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.768+0000 7f8723d84780 1 > prepared part key=_multipart_TSTIBGVYUZZZ.2~5S6HH52V1UFF.0 size=1048576 2023-12-03T11:42:08.770 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.769+0000 7f8723d84780 1 > prepared part key=_multipart_TSTIBGVYUZZZ.2~5S6HH52V1UFF.1 size=1048576 2023-12-03T11:42:08.771 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.770+0000 7f8723d84780 1 > prepared part key=_multipart_TSTIBGVYUZZZ.2~5S6HH52V1UFF.2 size=283255 2023-12-03T11:42:08.771 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.770+0000 7f8723d84780 1 > prepared multipart upload key=TSTIBGVYUZZZ upload=5S6HH52V1UFF tag=KS62J0JR3KKM type=write size=3428983 2023-12-03T11:42:08.772 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.771+0000 7f8723d84780 1 < completed delete operation key=7THZZ1J5LOZK tag=86NOSTKQDRKO type=del 2023-12-03T11:42:08.773 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.772+0000 7f8723d84780 1 > prepared operation key=EY9ZG5KOTBWM tag=6I4L1E2E7N1B type=del size=3396671 2023-12-03T11:42:08.775 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.774+0000 7f8723d84780 1 < suggested remove operation key=EY9ZG5KOTBWM tag=02EQZMESR0R0 type=del 2023-12-03T11:42:08.776 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.775+0000 7f8723d84780 1 > prepared operation key=G36T76K8O7A1 tag=6NRFNC7YTQRO type=del size=2235229 2023-12-03T11:42:08.778 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.777+0000 7f8723d84780 1 < suggested remove operation key=HIU6L0NQ8Q95 tag=9JHXGYQDH980 type=del 2023-12-03T11:42:08.780 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.779+0000 7f8723d84780 1 > prepared part key=_multipart_FCA2R3HR61S2.2~D1PHE7PY7BW5.0 size=522814 2023-12-03T11:42:08.781 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.779+0000 7f8723d84780 1 > prepared multipart upload key=FCA2R3HR61S2 upload=D1PHE7PY7BW5 tag=BJ83PDMCAWA2 type=write size=1571390 2023-12-03T11:42:08.782 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.781+0000 7f8723d84780 1 < completed delete operation key=D3JEVEY0E29E tag=QVL2S871YCJ6 type=del 2023-12-03T11:42:08.783 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.782+0000 7f8723d84780 1 > prepared operation key=W2704YS8KYQB tag=3ID0IOCH07HU type=del size=2813670 2023-12-03T11:42:08.784 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.783+0000 7f8723d84780 1 < completed delete operation key=931GNEXBHH35 tag=RTS2Y9MDVFSE type=del 2023-12-03T11:42:08.786 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.785+0000 7f8723d84780 1 > prepared part key=_multipart_5UYL15O31IHM.2~X304E479QUEL.0 size=702272 2023-12-03T11:42:08.786 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.785+0000 7f8723d84780 1 > prepared multipart upload key=5UYL15O31IHM upload=X304E479QUEL tag=YM3R4S9LSUNL type=write size=1750848 2023-12-03T11:42:08.789 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.786+0000 7f8723d84780 1 < completed part key=_multipart_UWS266H06VDK.2~8EHA6SXXWWJB.0 size=1048576 2023-12-03T11:42:08.789 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.787+0000 7f8723d84780 1 < completed part key=_multipart_UWS266H06VDK.2~8EHA6SXXWWJB.1 size=1048576 2023-12-03T11:42:08.789 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.787+0000 7f8723d84780 1 < canceled part key=_multipart_UWS266H06VDK.2~8EHA6SXXWWJB.2 size=983099 2023-12-03T11:42:08.790 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.789+0000 7f8723d84780 1 < canceled multipart upload key=UWS266H06VDK upload=8EHA6SXXWWJB tag=ZUJA8PPIW9BW type=write size=4128827 2023-12-03T11:42:08.791 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.790+0000 7f8723d84780 1 > prepared operation key=96RAVVSUKH0Y tag=BNW16L5INKO7 type=del size=233214 2023-12-03T11:42:08.793 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.792+0000 7f8723d84780 1 < completed write operation key=12XG7YPYTN4U tag=F11HECME4WVY type=write size=137835 2023-12-03T11:42:08.794 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.793+0000 7f8723d84780 1 > prepared operation key=J33T5S893LMV tag=9XIA73D6OYAL type=del size=1211252 2023-12-03T11:42:08.796 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.795+0000 7f8723d84780 1 < suggested update operation key=5UYL15O31IHM tag=77WP53WX7OJI type=del size=480653 2023-12-03T11:42:08.798 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.797+0000 7f8723d84780 1 > prepared part key=_multipart_HIU6L0NQ8Q95.2~YZQ6AJODEIZV.0 size=667389 2023-12-03T11:42:08.798 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.797+0000 7f8723d84780 1 > prepared multipart upload key=HIU6L0NQ8Q95 upload=YZQ6AJODEIZV tag=UY0H3UXJI6QD type=write size=1715965 2023-12-03T11:42:08.799 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.798+0000 7f8723d84780 1 < completed part key=_multipart_DMQX2DGDLU7D.2~YB7TB6TTYQL8.0 size=1048576 2023-12-03T11:42:08.800 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.799+0000 7f8723d84780 1 < completed part key=_multipart_DMQX2DGDLU7D.2~YB7TB6TTYQL8.1 size=734695 2023-12-03T11:42:08.802 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.801+0000 7f8723d84780 1 < completed multipart upload key=DMQX2DGDLU7D upload=YB7TB6TTYQL8 tag=QGKV71WI0QDN type=write size=2831847 2023-12-03T11:42:08.803 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.802+0000 7f8723d84780 1 > prepared operation key=4I8PWBZOLDUG tag=4AXKSCYFY4NU type=del size=2440149 2023-12-03T11:42:08.805 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.804+0000 7f8723d84780 1 < completed delete operation key=7VMTBKUWU59F tag=AMKW58TIRB8X type=del 2023-12-03T11:42:08.806 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.805+0000 7f8723d84780 1 > prepared operation key=VENJI0KD1XDW tag=BMD0TDI5TMUW type=del size=1590449 2023-12-03T11:42:08.807 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.806+0000 7f8723d84780 1 < completed delete operation key=8NONX2I08YMJ tag=V8LHAC2Z2WCS type=del 2023-12-03T11:42:08.808 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.807+0000 7f8723d84780 1 > prepared operation key=12XG7YPYTN4U tag=LGPBUB1LDK2B type=del size=2381538 2023-12-03T11:42:08.810 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.809+0000 7f8723d84780 1 < completed part key=_multipart_10JRIKOZ16FY.2~J7MFRQC0LJE8.0 size=592305 2023-12-03T11:42:08.812 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.811+0000 7f8723d84780 1 < completed multipart upload key=10JRIKOZ16FY upload=J7MFRQC0LJE8 tag=MXUP6YP8V7MO type=write size=1640881 2023-12-03T11:42:08.814 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.813+0000 7f8723d84780 1 > prepared part key=_multipart_8NONX2I08YMJ.2~4YAD880UTIF4.0 size=1048576 2023-12-03T11:42:08.815 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.814+0000 7f8723d84780 1 > prepared part key=_multipart_8NONX2I08YMJ.2~4YAD880UTIF4.1 size=1048576 2023-12-03T11:42:08.816 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.815+0000 7f8723d84780 1 > prepared part key=_multipart_8NONX2I08YMJ.2~4YAD880UTIF4.2 size=336068 2023-12-03T11:42:08.816 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.815+0000 7f8723d84780 1 > prepared multipart upload key=8NONX2I08YMJ upload=4YAD880UTIF4 tag=FF0LWW32AMJ7 type=write size=3481796 2023-12-03T11:42:08.818 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.817+0000 7f8723d84780 1 < completed delete operation key=LCK58DDM5XU9 tag=256HUBPHGIYA type=del 2023-12-03T11:42:08.819 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.818+0000 7f8723d84780 1 > prepared operation key=AB0SN0E49Z5F tag=P7QOBWHKX0IT type=del size=2062156 2023-12-03T11:42:08.821 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.820+0000 7f8723d84780 1 < suggested update operation key=W2704YS8KYQB tag=8B9033P6OT8O type=del size=302761 2023-12-03T11:42:08.822 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.821+0000 7f8723d84780 1 > prepared operation key=K83BTR5BOLZE tag=R2WO388ETLEH type=del size=1795145 2023-12-03T11:42:08.824 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.823+0000 7f8723d84780 1 < completed part key=_multipart_FCA2R3HR61S2.2~V2K9S73MUV8L.0 size=826794 2023-12-03T11:42:08.826 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.825+0000 7f8723d84780 1 < completed multipart upload key=FCA2R3HR61S2 upload=V2K9S73MUV8L tag=CH14X5LVGNC7 type=write size=1875370 2023-12-03T11:42:08.828 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.827+0000 7f8723d84780 1 > prepared part key=_multipart_OPQPIDJ2PBVU.2~OQG7WZWR9KMD.0 size=774674 2023-12-03T11:42:08.828 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.827+0000 7f8723d84780 1 > prepared multipart upload key=OPQPIDJ2PBVU upload=OQG7WZWR9KMD tag=4WTVAXM3SI4K type=write size=1823250 2023-12-03T11:42:08.829 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.828+0000 7f8723d84780 1 < completed part key=_multipart_TSTIBGVYUZZZ.2~5S6HH52V1UFF.0 size=1048576 2023-12-03T11:42:08.829 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.828+0000 7f8723d84780 1 < canceled part key=_multipart_TSTIBGVYUZZZ.2~5S6HH52V1UFF.1 size=1048576 2023-12-03T11:42:08.830 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.829+0000 7f8723d84780 1 < completed part key=_multipart_TSTIBGVYUZZZ.2~5S6HH52V1UFF.2 size=283255 2023-12-03T11:42:08.832 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.831+0000 7f8723d84780 1 < canceled multipart upload key=TSTIBGVYUZZZ upload=5S6HH52V1UFF tag=KS62J0JR3KKM type=write size=3428983 2023-12-03T11:42:08.833 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.832+0000 7f8723d84780 1 > prepared operation key=UWS266H06VDK tag=88VPLXHPSUB2 type=write size=802909 2023-12-03T11:42:08.834 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.833+0000 7f8723d84780 -1 < failed to complete operation key=EY9ZG5KOTBWM tag=6I4L1E2E7N1B type=del size=3396671: (22) Invalid argument 2023-12-03T11:42:08.837 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.836+0000 7f8723d84780 1 > prepared part key=_multipart_K83BTR5BOLZE.2~IS4N2WHAJXN5.0 size=1048576 2023-12-03T11:42:08.838 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.837+0000 7f8723d84780 1 > prepared part key=_multipart_K83BTR5BOLZE.2~IS4N2WHAJXN5.1 size=955661 2023-12-03T11:42:08.838 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.837+0000 7f8723d84780 1 > prepared multipart upload key=K83BTR5BOLZE upload=IS4N2WHAJXN5 tag=TPORWS4YN69L type=write size=3052813 2023-12-03T11:42:08.839 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.838+0000 7f8723d84780 1 < canceled operation key=G36T76K8O7A1 tag=6NRFNC7YTQRO type=del size=2235229 2023-12-03T11:42:08.840 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.839+0000 7f8723d84780 1 > prepared operation key=G36T76K8O7A1 tag=Y15OJ4E83D81 type=del size=487378 2023-12-03T11:42:08.841 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.840+0000 7f8723d84780 1 < completed part key=_multipart_FCA2R3HR61S2.2~D1PHE7PY7BW5.0 size=522814 2023-12-03T11:42:08.843 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.842+0000 7f8723d84780 1 < completed multipart upload key=FCA2R3HR61S2 upload=D1PHE7PY7BW5 tag=BJ83PDMCAWA2 type=write size=1571390 2023-12-03T11:42:08.845 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.844+0000 7f8723d84780 1 > prepared part key=_multipart_OGACI7CRPMT7.2~G2UBT50LG0OM.0 size=1048576 2023-12-03T11:42:08.846 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.845+0000 7f8723d84780 1 > prepared part key=_multipart_OGACI7CRPMT7.2~G2UBT50LG0OM.1 size=978890 2023-12-03T11:42:08.846 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.845+0000 7f8723d84780 1 > prepared multipart upload key=OGACI7CRPMT7 upload=G2UBT50LG0OM tag=JP3GZZMS8SHB type=write size=3076042 2023-12-03T11:42:08.848 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.846+0000 7f8723d84780 -1 < failed to complete operation key=W2704YS8KYQB tag=3ID0IOCH07HU type=del size=2813670: (22) Invalid argument 2023-12-03T11:42:08.849 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.848+0000 7f8723d84780 1 > prepared operation key=931GNEXBHH35 tag=5CAL5QXJCSDA type=write size=259112 2023-12-03T11:42:08.850 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.849+0000 7f8723d84780 1 < completed part key=_multipart_5UYL15O31IHM.2~X304E479QUEL.0 size=702272 2023-12-03T11:42:08.853 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.851+0000 7f8723d84780 1 < completed multipart upload key=5UYL15O31IHM upload=X304E479QUEL tag=YM3R4S9LSUNL type=write size=1750848 2023-12-03T11:42:08.853 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.852+0000 7f8723d84780 1 > prepared operation key=HIU6L0NQ8Q95 tag=T8AUJBX7F4L5 type=del size=437695 2023-12-03T11:42:08.854 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.853+0000 7f8723d84780 1 < completed delete operation key=96RAVVSUKH0Y tag=BNW16L5INKO7 type=del 2023-12-03T11:42:08.855 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.855+0000 7f8723d84780 1 > prepared operation key=Y6S7QI60GCLE tag=DXT1HR25WRM0 type=write size=795740 2023-12-03T11:42:08.858 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.857+0000 7f8723d84780 1 < completed delete operation key=J33T5S893LMV tag=9XIA73D6OYAL type=del 2023-12-03T11:42:08.859 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.858+0000 7f8723d84780 1 > prepared operation key=LMVO6CVEPN3K tag=YRAJDOVS2ZP2 type=del size=1447942 2023-12-03T11:42:08.860 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.859+0000 7f8723d84780 1 < completed part key=_multipart_HIU6L0NQ8Q95.2~YZQ6AJODEIZV.0 size=667389 2023-12-03T11:42:08.863 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.861+0000 7f8723d84780 1 < completed multipart upload key=HIU6L0NQ8Q95 upload=YZQ6AJODEIZV tag=UY0H3UXJI6QD type=write size=1715965 2023-12-03T11:42:08.864 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.863+0000 7f8723d84780 1 > prepared part key=_multipart_EY9ZG5KOTBWM.2~1ICYNYQAOHBF.0 size=1048576 2023-12-03T11:42:08.865 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.864+0000 7f8723d84780 1 > prepared part key=_multipart_EY9ZG5KOTBWM.2~1ICYNYQAOHBF.1 size=219809 2023-12-03T11:42:08.865 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.864+0000 7f8723d84780 1 > prepared multipart upload key=EY9ZG5KOTBWM upload=1ICYNYQAOHBF tag=I2UTD95UL0OS type=write size=2316961 2023-12-03T11:42:08.867 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.866+0000 7f8723d84780 1 < suggested update operation key=4I8PWBZOLDUG tag=4AXKSCYFY4NU type=del size=2440149 2023-12-03T11:42:08.869 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.867+0000 7f8723d84780 1 > prepared operation key=VENJI0KD1XDW tag=629NRFZ3LX01 type=del size=2073976 2023-12-03T11:42:08.869 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.868+0000 7f8723d84780 1 < completed delete operation key=VENJI0KD1XDW tag=BMD0TDI5TMUW type=del 2023-12-03T11:42:08.871 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.870+0000 7f8723d84780 1 > prepared operation key=FCA2R3HR61S2 tag=0MH0L5VX294K type=del size=1860029 2023-12-03T11:42:08.872 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.871+0000 7f8723d84780 1 < completed delete operation key=12XG7YPYTN4U tag=LGPBUB1LDK2B type=del 2023-12-03T11:42:08.875 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.873+0000 7f8723d84780 1 > prepared part key=_multipart_G36T76K8O7A1.2~QRNU8AK1TIHJ.0 size=1048576 2023-12-03T11:42:08.876 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.874+0000 7f8723d84780 1 > prepared part key=_multipart_G36T76K8O7A1.2~QRNU8AK1TIHJ.1 size=666192 2023-12-03T11:42:08.876 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.874+0000 7f8723d84780 1 > prepared multipart upload key=G36T76K8O7A1 upload=QRNU8AK1TIHJ tag=46WUNL1GKQTO type=write size=2763344 2023-12-03T11:42:08.876 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.875+0000 7f8723d84780 1 < completed part key=_multipart_8NONX2I08YMJ.2~4YAD880UTIF4.0 size=1048576 2023-12-03T11:42:08.877 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.876+0000 7f8723d84780 1 < completed part key=_multipart_8NONX2I08YMJ.2~4YAD880UTIF4.1 size=1048576 2023-12-03T11:42:08.878 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.877+0000 7f8723d84780 1 < completed part key=_multipart_8NONX2I08YMJ.2~4YAD880UTIF4.2 size=336068 2023-12-03T11:42:08.880 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.879+0000 7f8723d84780 1 < completed multipart upload key=8NONX2I08YMJ upload=4YAD880UTIF4 tag=FF0LWW32AMJ7 type=write size=3481796 2023-12-03T11:42:08.883 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.881+0000 7f8723d84780 1 > prepared part key=_multipart_12XG7YPYTN4U.2~ENA39W8CV5N1.0 size=668010 2023-12-03T11:42:08.883 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.881+0000 7f8723d84780 1 > prepared multipart upload key=12XG7YPYTN4U upload=ENA39W8CV5N1 tag=MD4EOKXOAGYL type=write size=1716586 2023-12-03T11:42:08.884 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.883+0000 7f8723d84780 1 < canceled operation key=AB0SN0E49Z5F tag=P7QOBWHKX0IT type=del size=2062156 2023-12-03T11:42:08.885 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.884+0000 7f8723d84780 1 > prepared operation key=KS5J7E7KE2IJ tag=DIV1LGQUNWET type=del size=141387 2023-12-03T11:42:08.886 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.885+0000 7f8723d84780 1 < completed delete operation key=K83BTR5BOLZE tag=R2WO388ETLEH type=del 2023-12-03T11:42:08.888 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.888+0000 7f8723d84780 1 > prepared part key=_multipart_AB0SN0E49Z5F.2~LEOWTQQW054A.0 size=1048576 2023-12-03T11:42:08.890 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.888+0000 7f8723d84780 1 > prepared part key=_multipart_AB0SN0E49Z5F.2~LEOWTQQW054A.1 size=1048576 2023-12-03T11:42:08.890 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.889+0000 7f8723d84780 1 > prepared part key=_multipart_AB0SN0E49Z5F.2~LEOWTQQW054A.2 size=759899 2023-12-03T11:42:08.890 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.889+0000 7f8723d84780 1 > prepared multipart upload key=AB0SN0E49Z5F upload=LEOWTQQW054A tag=HZL8HBR5RV74 type=write size=3905627 2023-12-03T11:42:08.892 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.891+0000 7f8723d84780 1 < completed part key=_multipart_OPQPIDJ2PBVU.2~OQG7WZWR9KMD.0 size=774674 2023-12-03T11:42:08.894 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.893+0000 7f8723d84780 1 < completed multipart upload key=OPQPIDJ2PBVU upload=OQG7WZWR9KMD tag=4WTVAXM3SI4K type=write size=1823250 2023-12-03T11:42:08.896 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.895+0000 7f8723d84780 1 > prepared part key=_multipart_D3JEVEY0E29E.2~NMD8K8MIAL76.0 size=1048576 2023-12-03T11:42:08.897 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.896+0000 7f8723d84780 1 > prepared part key=_multipart_D3JEVEY0E29E.2~NMD8K8MIAL76.1 size=1048576 2023-12-03T11:42:08.898 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.897+0000 7f8723d84780 1 > prepared part key=_multipart_D3JEVEY0E29E.2~NMD8K8MIAL76.2 size=909247 2023-12-03T11:42:08.898 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.897+0000 7f8723d84780 1 > prepared multipart upload key=D3JEVEY0E29E upload=NMD8K8MIAL76 tag=KUBFTF6NEGZB type=write size=4054975 2023-12-03T11:42:08.899 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.898+0000 7f8723d84780 1 < completed write operation key=UWS266H06VDK tag=88VPLXHPSUB2 type=write size=802909 2023-12-03T11:42:08.900 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.899+0000 7f8723d84780 1 > prepared operation key=FCA2R3HR61S2 tag=QTHC5M559P66 type=write size=1039531 2023-12-03T11:42:08.901 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.900+0000 7f8723d84780 1 < completed part key=_multipart_K83BTR5BOLZE.2~IS4N2WHAJXN5.0 size=1048576 2023-12-03T11:42:08.901 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.900+0000 7f8723d84780 1 < canceled part key=_multipart_K83BTR5BOLZE.2~IS4N2WHAJXN5.1 size=955661 2023-12-03T11:42:08.903 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.902+0000 7f8723d84780 1 < canceled multipart upload key=K83BTR5BOLZE upload=IS4N2WHAJXN5 tag=TPORWS4YN69L type=write size=3052813 2023-12-03T11:42:08.904 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.903+0000 7f8723d84780 1 > prepared operation key=7THZZ1J5LOZK tag=HP77NOVT1ZYR type=del size=3197677 2023-12-03T11:42:08.906 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.905+0000 7f8723d84780 1 < completed delete operation key=G36T76K8O7A1 tag=Y15OJ4E83D81 type=del 2023-12-03T11:42:08.907 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.906+0000 7f8723d84780 1 > prepared operation key=KS5J7E7KE2IJ tag=TJ1XYW8CXWQI type=del size=3023751 2023-12-03T11:42:08.908 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.907+0000 7f8723d84780 1 < completed part key=_multipart_OGACI7CRPMT7.2~G2UBT50LG0OM.0 size=1048576 2023-12-03T11:42:08.909 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.908+0000 7f8723d84780 1 < completed part key=_multipart_OGACI7CRPMT7.2~G2UBT50LG0OM.1 size=978890 2023-12-03T11:42:08.911 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.910+0000 7f8723d84780 1 < completed multipart upload key=OGACI7CRPMT7 upload=G2UBT50LG0OM tag=JP3GZZMS8SHB type=write size=3076042 2023-12-03T11:42:08.913 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.912+0000 7f8723d84780 1 > prepared operation key=OPQPIDJ2PBVU tag=920R4W88N9O0 type=write size=874670 2023-12-03T11:42:08.914 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.913+0000 7f8723d84780 1 < canceled operation key=931GNEXBHH35 tag=5CAL5QXJCSDA type=write size=259112 2023-12-03T11:42:08.916 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.915+0000 7f8723d84780 1 > prepared part key=_multipart_OPQPIDJ2PBVU.2~SOKXC88HH3L4.0 size=1048576 2023-12-03T11:42:08.918 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.917+0000 7f8723d84780 1 > prepared part key=_multipart_OPQPIDJ2PBVU.2~SOKXC88HH3L4.1 size=1048576 2023-12-03T11:42:08.919 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.917+0000 7f8723d84780 1 > prepared part key=_multipart_OPQPIDJ2PBVU.2~SOKXC88HH3L4.2 size=505053 2023-12-03T11:42:08.919 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.917+0000 7f8723d84780 1 > prepared multipart upload key=OPQPIDJ2PBVU upload=SOKXC88HH3L4 tag=RS2IZGGDG592 type=write size=3650781 2023-12-03T11:42:08.920 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.919+0000 7f8723d84780 1 < completed delete operation key=HIU6L0NQ8Q95 tag=T8AUJBX7F4L5 type=del 2023-12-03T11:42:08.921 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.920+0000 7f8723d84780 1 > prepared operation key=8NONX2I08YMJ tag=PJZM3AIOEPW0 type=del size=491643 2023-12-03T11:42:08.924 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.923+0000 7f8723d84780 1 < suggested remove operation key=Y6S7QI60GCLE tag=DXT1HR25WRM0 type=write 2023-12-03T11:42:08.926 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.925+0000 7f8723d84780 1 > prepared part key=_multipart_Y6S7QI60GCLE.2~VWXL84VBCQWN.0 size=597784 2023-12-03T11:42:08.926 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.925+0000 7f8723d84780 1 > prepared multipart upload key=Y6S7QI60GCLE upload=VWXL84VBCQWN tag=40CWM3KLVOOF type=write size=1646360 2023-12-03T11:42:08.929 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.928+0000 7f8723d84780 1 < suggested remove operation key=LMVO6CVEPN3K tag=YRAJDOVS2ZP2 type=del 2023-12-03T11:42:08.931 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.930+0000 7f8723d84780 1 > prepared part key=_multipart_HIU6L0NQ8Q95.2~B3LFNDE5KWMM.0 size=1048576 2023-12-03T11:42:08.932 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.931+0000 7f8723d84780 1 > prepared part key=_multipart_HIU6L0NQ8Q95.2~B3LFNDE5KWMM.1 size=1048576 2023-12-03T11:42:08.933 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.932+0000 7f8723d84780 1 > prepared part key=_multipart_HIU6L0NQ8Q95.2~B3LFNDE5KWMM.2 size=506107 2023-12-03T11:42:08.933 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.932+0000 7f8723d84780 1 > prepared multipart upload key=HIU6L0NQ8Q95 upload=B3LFNDE5KWMM tag=G9CCZ9MBPL5R type=write size=3651835 2023-12-03T11:42:08.934 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.933+0000 7f8723d84780 1 < completed part key=_multipart_EY9ZG5KOTBWM.2~1ICYNYQAOHBF.0 size=1048576 2023-12-03T11:42:08.935 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.934+0000 7f8723d84780 1 < completed part key=_multipart_EY9ZG5KOTBWM.2~1ICYNYQAOHBF.1 size=219809 2023-12-03T11:42:08.937 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.936+0000 7f8723d84780 1 < completed multipart upload key=EY9ZG5KOTBWM upload=1ICYNYQAOHBF tag=I2UTD95UL0OS type=write size=2316961 2023-12-03T11:42:08.939 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.938+0000 7f8723d84780 1 > prepared operation key=OPQPIDJ2PBVU tag=PMLEPA7DO6EP type=del size=1096286 2023-12-03T11:42:08.940 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.939+0000 7f8723d84780 1 < completed delete operation key=VENJI0KD1XDW tag=629NRFZ3LX01 type=del 2023-12-03T11:42:08.941 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.940+0000 7f8723d84780 1 > prepared operation key=K83BTR5BOLZE tag=QC3V1366CR36 type=del size=3986274 2023-12-03T11:42:08.943 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.942+0000 7f8723d84780 1 < suggested remove operation key=FCA2R3HR61S2 tag=0MH0L5VX294K type=del 2023-12-03T11:42:08.944 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.943+0000 7f8723d84780 1 > prepared operation key=7VMTBKUWU59F tag=2A405ZXJNW6A type=del size=792210 2023-12-03T11:42:08.946 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.945+0000 7f8723d84780 1 < completed part key=_multipart_G36T76K8O7A1.2~QRNU8AK1TIHJ.0 size=1048576 2023-12-03T11:42:08.947 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.946+0000 7f8723d84780 1 < completed part key=_multipart_G36T76K8O7A1.2~QRNU8AK1TIHJ.1 size=666192 2023-12-03T11:42:08.949 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.948+0000 7f8723d84780 1 < completed multipart upload key=G36T76K8O7A1 upload=QRNU8AK1TIHJ tag=46WUNL1GKQTO type=write size=2763344 2023-12-03T11:42:08.951 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.950+0000 7f8723d84780 1 > prepared part key=_multipart_FCA2R3HR61S2.2~SOVLQ0HHXZIY.0 size=564576 2023-12-03T11:42:08.951 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.950+0000 7f8723d84780 1 > prepared multipart upload key=FCA2R3HR61S2 upload=SOVLQ0HHXZIY tag=BZ9LAGYG74EU type=write size=1613152 2023-12-03T11:42:08.952 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.951+0000 7f8723d84780 1 < completed part key=_multipart_12XG7YPYTN4U.2~ENA39W8CV5N1.0 size=668010 2023-12-03T11:42:08.955 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.954+0000 7f8723d84780 1 < completed multipart upload key=12XG7YPYTN4U upload=ENA39W8CV5N1 tag=MD4EOKXOAGYL type=write size=1716586 2023-12-03T11:42:08.956 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.955+0000 7f8723d84780 1 > prepared operation key=OGACI7CRPMT7 tag=VKYL0083CO1G type=del size=1853386 2023-12-03T11:42:08.958 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.957+0000 7f8723d84780 1 < suggested update operation key=KS5J7E7KE2IJ tag=DIV1LGQUNWET type=del size=141387 2023-12-03T11:42:08.960 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.958+0000 7f8723d84780 1 > prepared operation key=5UYL15O31IHM tag=3NU80DVC3WTG type=del size=3673414 2023-12-03T11:42:08.961 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.960+0000 7f8723d84780 1 < completed part key=_multipart_AB0SN0E49Z5F.2~LEOWTQQW054A.0 size=1048576 2023-12-03T11:42:08.961 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.960+0000 7f8723d84780 1 < canceled part key=_multipart_AB0SN0E49Z5F.2~LEOWTQQW054A.1 size=1048576 2023-12-03T11:42:08.962 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.961+0000 7f8723d84780 1 < completed part key=_multipart_AB0SN0E49Z5F.2~LEOWTQQW054A.2 size=759899 2023-12-03T11:42:08.964 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.963+0000 7f8723d84780 1 < canceled multipart upload key=AB0SN0E49Z5F upload=LEOWTQQW054A tag=HZL8HBR5RV74 type=write size=3905627 2023-12-03T11:42:08.965 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.964+0000 7f8723d84780 1 > prepared operation key=AB0SN0E49Z5F tag=KCNCZ5LEFIEB type=del size=1294915 2023-12-03T11:42:08.967 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.966+0000 7f8723d84780 1 < completed part key=_multipart_D3JEVEY0E29E.2~NMD8K8MIAL76.0 size=1048576 2023-12-03T11:42:08.968 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.967+0000 7f8723d84780 1 < completed part key=_multipart_D3JEVEY0E29E.2~NMD8K8MIAL76.1 size=1048576 2023-12-03T11:42:08.968 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.967+0000 7f8723d84780 1 < canceled part key=_multipart_D3JEVEY0E29E.2~NMD8K8MIAL76.2 size=909247 2023-12-03T11:42:08.970 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.969+0000 7f8723d84780 1 < canceled multipart upload key=D3JEVEY0E29E upload=NMD8K8MIAL76 tag=KUBFTF6NEGZB type=write size=4054975 2023-12-03T11:42:08.972 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.971+0000 7f8723d84780 1 > prepared operation key=W2704YS8KYQB tag=4MCDKWW10CAN type=del size=583098 2023-12-03T11:42:08.974 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.972+0000 7f8723d84780 -1 < failed to complete operation key=FCA2R3HR61S2 tag=QTHC5M559P66 type=write size=1039531: (22) Invalid argument 2023-12-03T11:42:08.975 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.974+0000 7f8723d84780 1 > prepared operation key=UWS266H06VDK tag=KERWNKIQWVWL type=del size=3198840 2023-12-03T11:42:08.976 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.975+0000 7f8723d84780 1 < canceled operation key=7THZZ1J5LOZK tag=HP77NOVT1ZYR type=del size=3197677 2023-12-03T11:42:08.977 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.976+0000 7f8723d84780 1 > prepared operation key=EY9ZG5KOTBWM tag=R9QF8J4XR5BJ type=write size=843011 2023-12-03T11:42:08.979 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.978+0000 7f8723d84780 -1 < failed to complete operation key=KS5J7E7KE2IJ tag=TJ1XYW8CXWQI type=del size=3023751: (22) Invalid argument 2023-12-03T11:42:08.981 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.980+0000 7f8723d84780 1 > prepared part key=_multipart_8NONX2I08YMJ.2~I6Y39DM80T04.0 size=1048576 2023-12-03T11:42:08.982 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.981+0000 7f8723d84780 1 > prepared part key=_multipart_8NONX2I08YMJ.2~I6Y39DM80T04.1 size=166849 2023-12-03T11:42:08.982 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.981+0000 7f8723d84780 1 > prepared multipart upload key=8NONX2I08YMJ upload=I6Y39DM80T04 tag=IP5VVFYSL8O0 type=write size=2264001 2023-12-03T11:42:08.983 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.982+0000 7f8723d84780 1 < completed write operation key=OPQPIDJ2PBVU tag=920R4W88N9O0 type=write size=874670 2023-12-03T11:42:08.985 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.984+0000 7f8723d84780 1 > prepared operation key=LCK58DDM5XU9 tag=ZRC4FLLH4VCM type=del size=684489 2023-12-03T11:42:08.986 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.985+0000 7f8723d84780 1 < completed part key=_multipart_OPQPIDJ2PBVU.2~SOKXC88HH3L4.0 size=1048576 2023-12-03T11:42:08.987 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.986+0000 7f8723d84780 1 < completed part key=_multipart_OPQPIDJ2PBVU.2~SOKXC88HH3L4.1 size=1048576 2023-12-03T11:42:08.988 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.987+0000 7f8723d84780 1 < completed part key=_multipart_OPQPIDJ2PBVU.2~SOKXC88HH3L4.2 size=505053 2023-12-03T11:42:08.991 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.989+0000 7f8723d84780 1 < completed multipart upload key=OPQPIDJ2PBVU upload=SOKXC88HH3L4 tag=RS2IZGGDG592 type=write size=3650781 2023-12-03T11:42:08.992 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.991+0000 7f8723d84780 1 > prepared part key=_multipart_12XG7YPYTN4U.2~X7QX5XAGPIRG.0 size=13826 2023-12-03T11:42:08.993 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.991+0000 7f8723d84780 1 > prepared multipart upload key=12XG7YPYTN4U upload=X7QX5XAGPIRG tag=UV1LOR1N9JMF type=write size=1062402 2023-12-03T11:42:08.994 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.993+0000 7f8723d84780 1 < completed delete operation key=8NONX2I08YMJ tag=PJZM3AIOEPW0 type=del 2023-12-03T11:42:08.996 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.995+0000 7f8723d84780 1 > prepared part key=_multipart_8NONX2I08YMJ.2~7Z920PPG6RTJ.0 size=1048576 2023-12-03T11:42:08.997 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.996+0000 7f8723d84780 1 > prepared part key=_multipart_8NONX2I08YMJ.2~7Z920PPG6RTJ.1 size=71338 2023-12-03T11:42:08.997 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.996+0000 7f8723d84780 1 > prepared multipart upload key=8NONX2I08YMJ upload=7Z920PPG6RTJ tag=PX1IVW0XG6CB type=write size=2168490 2023-12-03T11:42:08.998 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.997+0000 7f8723d84780 1 < completed part key=_multipart_Y6S7QI60GCLE.2~VWXL84VBCQWN.0 size=597784 2023-12-03T11:42:09.000 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:08.999+0000 7f8723d84780 1 < completed multipart upload key=Y6S7QI60GCLE upload=VWXL84VBCQWN tag=40CWM3KLVOOF type=write size=1646360 2023-12-03T11:42:09.001 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.000+0000 7f8723d84780 1 > prepared operation key=7THZZ1J5LOZK tag=24W14EOXI275 type=del size=4160853 2023-12-03T11:42:09.002 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.001+0000 7f8723d84780 1 < completed part key=_multipart_HIU6L0NQ8Q95.2~B3LFNDE5KWMM.0 size=1048576 2023-12-03T11:42:09.003 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.002+0000 7f8723d84780 1 < completed part key=_multipart_HIU6L0NQ8Q95.2~B3LFNDE5KWMM.1 size=1048576 2023-12-03T11:42:09.004 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.003+0000 7f8723d84780 1 < completed part key=_multipart_HIU6L0NQ8Q95.2~B3LFNDE5KWMM.2 size=506107 2023-12-03T11:42:09.006 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.005+0000 7f8723d84780 1 < completed multipart upload key=HIU6L0NQ8Q95 upload=B3LFNDE5KWMM tag=G9CCZ9MBPL5R type=write size=3651835 2023-12-03T11:42:09.007 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.006+0000 7f8723d84780 1 > prepared operation key=Y6S7QI60GCLE tag=L4VVTEM6XJLV type=del size=1466245 2023-12-03T11:42:09.008 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.007+0000 7f8723d84780 1 < completed delete operation key=OPQPIDJ2PBVU tag=PMLEPA7DO6EP type=del 2023-12-03T11:42:09.009 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.008+0000 7f8723d84780 1 > prepared operation key=5UYL15O31IHM tag=0B1WBOBZETEP type=del size=2308850 2023-12-03T11:42:09.010 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.009+0000 7f8723d84780 1 < completed delete operation key=K83BTR5BOLZE tag=QC3V1366CR36 type=del 2023-12-03T11:42:09.012 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.011+0000 7f8723d84780 1 > prepared part key=_multipart_O7VVHXLDSY57.2~CM8E1LMH16OZ.0 size=241309 2023-12-03T11:42:09.013 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.011+0000 7f8723d84780 1 > prepared multipart upload key=O7VVHXLDSY57 upload=CM8E1LMH16OZ tag=HT4IKXB70298 type=write size=1289885 2023-12-03T11:42:09.014 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.013+0000 7f8723d84780 1 < completed delete operation key=7VMTBKUWU59F tag=2A405ZXJNW6A type=del 2023-12-03T11:42:09.016 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.015+0000 7f8723d84780 1 > prepared part key=_multipart_7VMTBKUWU59F.2~MDFE1O4ECSQG.0 size=784146 2023-12-03T11:42:09.016 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.015+0000 7f8723d84780 1 > prepared multipart upload key=7VMTBKUWU59F upload=MDFE1O4ECSQG tag=UKWSR0SM4EA5 type=write size=1832722 2023-12-03T11:42:09.017 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.016+0000 7f8723d84780 1 < completed part key=_multipart_FCA2R3HR61S2.2~SOVLQ0HHXZIY.0 size=564576 2023-12-03T11:42:09.019 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.018+0000 7f8723d84780 1 < completed multipart upload key=FCA2R3HR61S2 upload=SOVLQ0HHXZIY tag=BZ9LAGYG74EU type=write size=1613152 2023-12-03T11:42:09.020 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.019+0000 7f8723d84780 1 > prepared operation key=Y6S7QI60GCLE tag=8ANI01WEWHHW type=del size=2320718 2023-12-03T11:42:09.024 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.023+0000 7f8723d84780 1 < suggested update operation key=OGACI7CRPMT7 tag=VKYL0083CO1G type=del size=1853386 2023-12-03T11:42:09.025 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.024+0000 7f8723d84780 1 > prepared operation key=OGACI7CRPMT7 tag=JDUL04N3M72I type=del size=2792862 2023-12-03T11:42:09.027 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.025+0000 7f8723d84780 1 < completed delete operation key=5UYL15O31IHM tag=3NU80DVC3WTG type=del 2023-12-03T11:42:09.028 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.027+0000 7f8723d84780 1 > prepared operation key=K83BTR5BOLZE tag=TZRJIKHHPRMC type=del size=1452906 2023-12-03T11:42:09.030 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.028+0000 7f8723d84780 1 < completed delete operation key=AB0SN0E49Z5F tag=KCNCZ5LEFIEB type=del 2023-12-03T11:42:09.030 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.029+0000 7f8723d84780 1 > prepared operation key=931GNEXBHH35 tag=E7SKICO3EV5N type=write size=895667 2023-12-03T11:42:09.031 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.030+0000 7f8723d84780 1 < canceled operation key=W2704YS8KYQB tag=4MCDKWW10CAN type=del size=583098 2023-12-03T11:42:09.033 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.032+0000 7f8723d84780 1 > prepared part key=_multipart_10JRIKOZ16FY.2~U3F5144HXF40.0 size=1048576 2023-12-03T11:42:09.034 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.033+0000 7f8723d84780 1 > prepared part key=_multipart_10JRIKOZ16FY.2~U3F5144HXF40.1 size=50358 2023-12-03T11:42:09.034 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.033+0000 7f8723d84780 1 > prepared multipart upload key=10JRIKOZ16FY upload=U3F5144HXF40 tag=0RPULV6BGMYG type=write size=2147510 2023-12-03T11:42:09.035 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.034+0000 7f8723d84780 1 < completed delete operation key=UWS266H06VDK tag=KERWNKIQWVWL type=del 2023-12-03T11:42:09.036 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.035+0000 7f8723d84780 1 > prepared operation key=8NONX2I08YMJ tag=3YWVY2ZI54BR type=del size=1171983 2023-12-03T11:42:09.038 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.037+0000 7f8723d84780 1 < canceled operation key=EY9ZG5KOTBWM tag=R9QF8J4XR5BJ type=write size=843011 2023-12-03T11:42:09.040 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.039+0000 7f8723d84780 1 > prepared part key=_multipart_O7VVHXLDSY57.2~ASDVU4VHPK26.0 size=509200 2023-12-03T11:42:09.040 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.039+0000 7f8723d84780 1 > prepared multipart upload key=O7VVHXLDSY57 upload=ASDVU4VHPK26 tag=0CGTDLTZAYPD type=write size=1557776 2023-12-03T11:42:09.042 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.040+0000 7f8723d84780 1 < completed part key=_multipart_8NONX2I08YMJ.2~I6Y39DM80T04.0 size=1048576 2023-12-03T11:42:09.043 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.042+0000 7f8723d84780 1 < completed part key=_multipart_8NONX2I08YMJ.2~I6Y39DM80T04.1 size=166849 2023-12-03T11:42:09.045 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.044+0000 7f8723d84780 1 < completed multipart upload key=8NONX2I08YMJ upload=I6Y39DM80T04 tag=IP5VVFYSL8O0 type=write size=2264001 2023-12-03T11:42:09.046 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.045+0000 7f8723d84780 1 > prepared operation key=7THZZ1J5LOZK tag=85LP73UFM9NE type=del size=4076881 2023-12-03T11:42:09.047 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.046+0000 7f8723d84780 1 < completed delete operation key=LCK58DDM5XU9 tag=ZRC4FLLH4VCM type=del 2023-12-03T11:42:09.049 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.048+0000 7f8723d84780 1 > prepared part key=_multipart_HIU6L0NQ8Q95.2~VZ4JXQW2A610.0 size=1048576 2023-12-03T11:42:09.050 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.049+0000 7f8723d84780 1 > prepared part key=_multipart_HIU6L0NQ8Q95.2~VZ4JXQW2A610.1 size=359424 2023-12-03T11:42:09.051 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.049+0000 7f8723d84780 1 > prepared multipart upload key=HIU6L0NQ8Q95 upload=VZ4JXQW2A610 tag=HGI6PFH30XRF type=write size=2456576 2023-12-03T11:42:09.052 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.051+0000 7f8723d84780 1 < completed part key=_multipart_12XG7YPYTN4U.2~X7QX5XAGPIRG.0 size=13826 2023-12-03T11:42:09.054 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.053+0000 7f8723d84780 1 < completed multipart upload key=12XG7YPYTN4U upload=X7QX5XAGPIRG tag=UV1LOR1N9JMF type=write size=1062402 2023-12-03T11:42:09.058 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.054+0000 7f8723d84780 1 > prepared operation key=8NONX2I08YMJ tag=ALK90J15W489 type=write size=570304 2023-12-03T11:42:09.059 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.055+0000 7f8723d84780 1 < completed part key=_multipart_8NONX2I08YMJ.2~7Z920PPG6RTJ.0 size=1048576 2023-12-03T11:42:09.059 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.056+0000 7f8723d84780 1 < completed part key=_multipart_8NONX2I08YMJ.2~7Z920PPG6RTJ.1 size=71338 2023-12-03T11:42:09.060 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.059+0000 7f8723d84780 1 < completed multipart upload key=8NONX2I08YMJ upload=7Z920PPG6RTJ tag=PX1IVW0XG6CB type=write size=2168490 2023-12-03T11:42:09.062 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.061+0000 7f8723d84780 1 > prepared part key=_multipart_8NONX2I08YMJ.2~4EJLDY456OZM.0 size=1048576 2023-12-03T11:42:09.063 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.062+0000 7f8723d84780 1 > prepared part key=_multipart_8NONX2I08YMJ.2~4EJLDY456OZM.1 size=1048576 2023-12-03T11:42:09.064 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.063+0000 7f8723d84780 1 > prepared part key=_multipart_8NONX2I08YMJ.2~4EJLDY456OZM.2 size=88671 2023-12-03T11:42:09.064 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.063+0000 7f8723d84780 1 > prepared multipart upload key=8NONX2I08YMJ upload=4EJLDY456OZM tag=2FZLWUS7U6DQ type=write size=3234399 2023-12-03T11:42:09.066 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.065+0000 7f8723d84780 1 < suggested remove operation key=7THZZ1J5LOZK tag=24W14EOXI275 type=del 2023-12-03T11:42:09.067 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.066+0000 7f8723d84780 1 > prepared operation key=AB0SN0E49Z5F tag=IF195K7F78XP type=del size=3863697 2023-12-03T11:42:09.068 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.068+0000 7f8723d84780 1 < completed delete operation key=Y6S7QI60GCLE tag=L4VVTEM6XJLV type=del 2023-12-03T11:42:09.070 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.069+0000 7f8723d84780 1 > prepared operation key=LMVO6CVEPN3K tag=KUY7NP25MQP9 type=del size=80739 2023-12-03T11:42:09.071 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.070+0000 7f8723d84780 1 < completed delete operation key=5UYL15O31IHM tag=0B1WBOBZETEP type=del 2023-12-03T11:42:09.073 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.072+0000 7f8723d84780 1 > prepared operation key=O7VVHXLDSY57 tag=VS16X30BVV8U type=write size=844360 2023-12-03T11:42:09.074 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.073+0000 7f8723d84780 1 < completed part key=_multipart_O7VVHXLDSY57.2~CM8E1LMH16OZ.0 size=241309 2023-12-03T11:42:09.076 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.075+0000 7f8723d84780 1 < completed multipart upload key=O7VVHXLDSY57 upload=CM8E1LMH16OZ tag=HT4IKXB70298 type=write size=1289885 2023-12-03T11:42:09.077 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.076+0000 7f8723d84780 1 > prepared operation key=EY9ZG5KOTBWM tag=V8Y9QDU9BVLQ type=write size=405689 2023-12-03T11:42:09.078 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.077+0000 7f8723d84780 1 < completed part key=_multipart_7VMTBKUWU59F.2~MDFE1O4ECSQG.0 size=784146 2023-12-03T11:42:09.081 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.080+0000 7f8723d84780 1 < completed multipart upload key=7VMTBKUWU59F upload=MDFE1O4ECSQG tag=UKWSR0SM4EA5 type=write size=1832722 2023-12-03T11:42:09.083 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.082+0000 7f8723d84780 1 > prepared part key=_multipart_TSTIBGVYUZZZ.2~Q0DOP5SFN7X7.0 size=1048576 2023-12-03T11:42:09.084 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.083+0000 7f8723d84780 1 > prepared part key=_multipart_TSTIBGVYUZZZ.2~Q0DOP5SFN7X7.1 size=1048576 2023-12-03T11:42:09.085 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.084+0000 7f8723d84780 1 > prepared part key=_multipart_TSTIBGVYUZZZ.2~Q0DOP5SFN7X7.2 size=688889 2023-12-03T11:42:09.085 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.084+0000 7f8723d84780 1 > prepared multipart upload key=TSTIBGVYUZZZ upload=Q0DOP5SFN7X7 tag=38YLC3QMAGWJ type=write size=3834617 2023-12-03T11:42:09.086 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.085+0000 7f8723d84780 1 < completed delete operation key=Y6S7QI60GCLE tag=8ANI01WEWHHW type=del 2023-12-03T11:42:09.088 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.087+0000 7f8723d84780 1 > prepared operation key=KS5J7E7KE2IJ tag=AQC7KTTWLESZ type=del size=2430334 2023-12-03T11:42:09.089 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.088+0000 7f8723d84780 1 < completed delete operation key=OGACI7CRPMT7 tag=JDUL04N3M72I type=del 2023-12-03T11:42:09.091 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.089+0000 7f8723d84780 1 > prepared operation key=K83BTR5BOLZE tag=UC72BB1VKP5H type=del size=2223738 2023-12-03T11:42:09.091 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.091+0000 7f8723d84780 1 < completed delete operation key=K83BTR5BOLZE tag=TZRJIKHHPRMC type=del 2023-12-03T11:42:09.093 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.092+0000 7f8723d84780 1 > prepared operation key=M4VKPN6INFNZ tag=VFC8XY3308B7 type=write size=230990 2023-12-03T11:42:09.095 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.094+0000 7f8723d84780 1 < completed write operation key=931GNEXBHH35 tag=E7SKICO3EV5N type=write size=895667 2023-12-03T11:42:09.096 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.095+0000 7f8723d84780 1 > prepared operation key=KS5J7E7KE2IJ tag=CK9GTTDETBT4 type=del size=1141550 2023-12-03T11:42:09.097 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.096+0000 7f8723d84780 1 < completed part key=_multipart_10JRIKOZ16FY.2~U3F5144HXF40.0 size=1048576 2023-12-03T11:42:09.099 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.097+0000 7f8723d84780 1 < completed part key=_multipart_10JRIKOZ16FY.2~U3F5144HXF40.1 size=50358 2023-12-03T11:42:09.101 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.100+0000 7f8723d84780 1 < completed multipart upload key=10JRIKOZ16FY upload=U3F5144HXF40 tag=0RPULV6BGMYG type=write size=2147510 2023-12-03T11:42:09.102 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.101+0000 7f8723d84780 1 > prepared operation key=KS5J7E7KE2IJ tag=U2VZB1T54ZMD type=del size=2378968 2023-12-03T11:42:09.105 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.104+0000 7f8723d84780 1 < suggested update operation key=8NONX2I08YMJ tag=3YWVY2ZI54BR type=del size=1171983 2023-12-03T11:42:09.106 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.105+0000 7f8723d84780 1 > prepared operation key=LMVO6CVEPN3K tag=C45NLZEEGNKF type=del size=2752361 2023-12-03T11:42:09.107 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.106+0000 7f8723d84780 1 < completed part key=_multipart_O7VVHXLDSY57.2~ASDVU4VHPK26.0 size=509200 2023-12-03T11:42:09.109 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.108+0000 7f8723d84780 1 < completed multipart upload key=O7VVHXLDSY57 upload=ASDVU4VHPK26 tag=0CGTDLTZAYPD type=write size=1557776 2023-12-03T11:42:09.111 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.110+0000 7f8723d84780 1 > prepared part key=_multipart_J33T5S893LMV.2~8FYS31L3VG1Q.0 size=1048576 2023-12-03T11:42:09.112 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.111+0000 7f8723d84780 1 > prepared part key=_multipart_J33T5S893LMV.2~8FYS31L3VG1Q.1 size=577904 2023-12-03T11:42:09.112 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.111+0000 7f8723d84780 1 > prepared multipart upload key=J33T5S893LMV upload=8FYS31L3VG1Q tag=RIN10CWPAHPT type=write size=2675056 2023-12-03T11:42:09.113 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.112+0000 7f8723d84780 -1 < no bi entry to suggest for operation key=7THZZ1J5LOZK tag=85LP73UFM9NE type=del size=4076881: (2) No such file or directory 2023-12-03T11:42:09.114 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.113+0000 7f8723d84780 1 > prepared operation key=J33T5S893LMV tag=4O8ZSA2H519Y type=del size=2256437 2023-12-03T11:42:09.115 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.114+0000 7f8723d84780 1 < completed part key=_multipart_HIU6L0NQ8Q95.2~VZ4JXQW2A610.0 size=1048576 2023-12-03T11:42:09.116 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.115+0000 7f8723d84780 1 < completed part key=_multipart_HIU6L0NQ8Q95.2~VZ4JXQW2A610.1 size=359424 2023-12-03T11:42:09.118 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.117+0000 7f8723d84780 1 < completed multipart upload key=HIU6L0NQ8Q95 upload=VZ4JXQW2A610 tag=HGI6PFH30XRF type=write size=2456576 2023-12-03T11:42:09.119 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.118+0000 7f8723d84780 1 > prepared operation key=W2704YS8KYQB tag=T1FK4JOTE5WK type=del size=1298748 2023-12-03T11:42:09.121 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.120+0000 7f8723d84780 -1 < failed to complete operation key=8NONX2I08YMJ tag=ALK90J15W489 type=write size=570304: (22) Invalid argument 2023-12-03T11:42:09.123 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.122+0000 7f8723d84780 1 > prepared part key=_multipart_12XG7YPYTN4U.2~QIVVCWGVYX8G.0 size=1048576 2023-12-03T11:42:09.124 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.123+0000 7f8723d84780 1 > prepared part key=_multipart_12XG7YPYTN4U.2~QIVVCWGVYX8G.1 size=1048576 2023-12-03T11:42:09.125 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.124+0000 7f8723d84780 1 > prepared part key=_multipart_12XG7YPYTN4U.2~QIVVCWGVYX8G.2 size=315851 2023-12-03T11:42:09.125 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.124+0000 7f8723d84780 1 > prepared multipart upload key=12XG7YPYTN4U upload=QIVVCWGVYX8G tag=5HDHRB8UQM4F type=write size=3461579 2023-12-03T11:42:09.126 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.125+0000 7f8723d84780 1 < completed part key=_multipart_8NONX2I08YMJ.2~4EJLDY456OZM.0 size=1048576 2023-12-03T11:42:09.128 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.126+0000 7f8723d84780 1 < completed part key=_multipart_8NONX2I08YMJ.2~4EJLDY456OZM.1 size=1048576 2023-12-03T11:42:09.128 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.127+0000 7f8723d84780 1 < completed part key=_multipart_8NONX2I08YMJ.2~4EJLDY456OZM.2 size=88671 2023-12-03T11:42:09.130 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.129+0000 7f8723d84780 1 < completed multipart upload key=8NONX2I08YMJ upload=4EJLDY456OZM tag=2FZLWUS7U6DQ type=write size=3234399 2023-12-03T11:42:09.131 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.130+0000 7f8723d84780 1 > prepared operation key=TSTIBGVYUZZZ tag=X13VKQY4M8GL type=del size=1361513 2023-12-03T11:42:09.133 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.132+0000 7f8723d84780 1 < canceled operation key=AB0SN0E49Z5F tag=IF195K7F78XP type=del size=3863697 2023-12-03T11:42:09.134 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.133+0000 7f8723d84780 1 > prepared operation key=HIU6L0NQ8Q95 tag=GC4H93619RZJ type=del size=3162412 2023-12-03T11:42:09.135 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.134+0000 7f8723d84780 1 < completed delete operation key=LMVO6CVEPN3K tag=KUY7NP25MQP9 type=del 2023-12-03T11:42:09.136 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.135+0000 7f8723d84780 1 > prepared operation key=VENJI0KD1XDW tag=2YD8FIAPNVQM type=del size=3331875 2023-12-03T11:42:09.138 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.137+0000 7f8723d84780 1 < canceled operation key=O7VVHXLDSY57 tag=VS16X30BVV8U type=write size=844360 2023-12-03T11:42:09.139 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.138+0000 7f8723d84780 1 > prepared operation key=12XG7YPYTN4U tag=1CKLZMSGPM2N type=del size=4004728 2023-12-03T11:42:09.141 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.139+0000 7f8723d84780 1 < canceled operation key=EY9ZG5KOTBWM tag=V8Y9QDU9BVLQ type=write size=405689 2023-12-03T11:42:09.142 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.141+0000 7f8723d84780 1 > prepared operation key=EITMJKL0LCYC tag=5AFO4W6QS1ID type=del size=1645974 2023-12-03T11:42:09.143 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.142+0000 7f8723d84780 1 < completed part key=_multipart_TSTIBGVYUZZZ.2~Q0DOP5SFN7X7.0 size=1048576 2023-12-03T11:42:09.144 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.143+0000 7f8723d84780 1 < completed part key=_multipart_TSTIBGVYUZZZ.2~Q0DOP5SFN7X7.1 size=1048576 2023-12-03T11:42:09.146 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.144+0000 7f8723d84780 1 < completed part key=_multipart_TSTIBGVYUZZZ.2~Q0DOP5SFN7X7.2 size=688889 2023-12-03T11:42:09.147 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.146+0000 7f8723d84780 1 < completed multipart upload key=TSTIBGVYUZZZ upload=Q0DOP5SFN7X7 tag=38YLC3QMAGWJ type=write size=3834617 2023-12-03T11:42:09.149 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.148+0000 7f8723d84780 1 > prepared operation key=DMQX2DGDLU7D tag=ACXW2GYW7389 type=del size=2921031 2023-12-03T11:42:09.150 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.149+0000 7f8723d84780 1 < canceled operation key=KS5J7E7KE2IJ tag=AQC7KTTWLESZ type=del size=2430334 2023-12-03T11:42:09.152 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.151+0000 7f8723d84780 1 > prepared part key=_multipart_G36T76K8O7A1.2~XFN4VA1HUU5H.0 size=1048576 2023-12-03T11:42:09.153 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.152+0000 7f8723d84780 1 > prepared part key=_multipart_G36T76K8O7A1.2~XFN4VA1HUU5H.1 size=1048576 2023-12-03T11:42:09.154 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.153+0000 7f8723d84780 1 > prepared part key=_multipart_G36T76K8O7A1.2~XFN4VA1HUU5H.2 size=351121 2023-12-03T11:42:09.154 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.153+0000 7f8723d84780 1 > prepared multipart upload key=G36T76K8O7A1 upload=XFN4VA1HUU5H tag=EJXQZ7CTY6LR type=write size=3496849 2023-12-03T11:42:09.155 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.154+0000 7f8723d84780 1 < completed delete operation key=K83BTR5BOLZE tag=UC72BB1VKP5H type=del 2023-12-03T11:42:09.157 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.156+0000 7f8723d84780 1 > prepared part key=_multipart_12XG7YPYTN4U.2~TV6J4DK1O67T.0 size=1048576 2023-12-03T11:42:09.158 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.157+0000 7f8723d84780 1 > prepared part key=_multipart_12XG7YPYTN4U.2~TV6J4DK1O67T.1 size=1048576 2023-12-03T11:42:09.159 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.158+0000 7f8723d84780 1 > prepared part key=_multipart_12XG7YPYTN4U.2~TV6J4DK1O67T.2 size=704465 2023-12-03T11:42:09.159 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.158+0000 7f8723d84780 1 > prepared multipart upload key=12XG7YPYTN4U upload=TV6J4DK1O67T tag=MVWVDYZ8BNST type=write size=3850193 2023-12-03T11:42:09.161 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.159+0000 7f8723d84780 1 < completed write operation key=M4VKPN6INFNZ tag=VFC8XY3308B7 type=write size=230990 2023-12-03T11:42:09.162 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.161+0000 7f8723d84780 1 > prepared part key=_multipart_5UYL15O31IHM.2~M9KQMSCY91HM.0 size=477945 2023-12-03T11:42:09.163 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.161+0000 7f8723d84780 1 > prepared multipart upload key=5UYL15O31IHM upload=M9KQMSCY91HM tag=SE27HAHH2DCK type=write size=1526521 2023-12-03T11:42:09.164 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.163+0000 7f8723d84780 1 < completed delete operation key=KS5J7E7KE2IJ tag=CK9GTTDETBT4 type=del 2023-12-03T11:42:09.166 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.165+0000 7f8723d84780 1 > prepared operation key=UWS266H06VDK tag=HP7KPKF7RGFZ type=del size=29709 2023-12-03T11:42:09.167 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.166+0000 7f8723d84780 1 < completed delete operation key=KS5J7E7KE2IJ tag=U2VZB1T54ZMD type=del 2023-12-03T11:42:09.169 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.168+0000 7f8723d84780 1 > prepared operation key=LMVO6CVEPN3K tag=593N0DRO3U12 type=del size=973420 2023-12-03T11:42:09.170 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.169+0000 7f8723d84780 1 < completed delete operation key=LMVO6CVEPN3K tag=C45NLZEEGNKF type=del 2023-12-03T11:42:09.171 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.170+0000 7f8723d84780 1 > prepared operation key=LMVO6CVEPN3K tag=LYUNBXAUS9ND type=del size=3205138 2023-12-03T11:42:09.172 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.171+0000 7f8723d84780 1 < completed part key=_multipart_J33T5S893LMV.2~8FYS31L3VG1Q.0 size=1048576 2023-12-03T11:42:09.173 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.172+0000 7f8723d84780 1 < completed part key=_multipart_J33T5S893LMV.2~8FYS31L3VG1Q.1 size=577904 2023-12-03T11:42:09.175 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.174+0000 7f8723d84780 1 < completed multipart upload key=J33T5S893LMV upload=8FYS31L3VG1Q tag=RIN10CWPAHPT type=write size=2675056 2023-12-03T11:42:09.177 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.176+0000 7f8723d84780 1 > prepared operation key=7THZZ1J5LOZK tag=J1N025TBG0MJ type=del size=1201150 2023-12-03T11:42:09.178 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.177+0000 7f8723d84780 1 < completed delete operation key=J33T5S893LMV tag=4O8ZSA2H519Y type=del 2023-12-03T11:42:09.180 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.179+0000 7f8723d84780 1 > prepared part key=_multipart_LMVO6CVEPN3K.2~GS8FNFIUPPVL.0 size=647496 2023-12-03T11:42:09.180 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.179+0000 7f8723d84780 1 > prepared multipart upload key=LMVO6CVEPN3K upload=GS8FNFIUPPVL tag=40B9NBWGM4XP type=write size=1696072 2023-12-03T11:42:09.181 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.180+0000 7f8723d84780 1 < canceled operation key=W2704YS8KYQB tag=T1FK4JOTE5WK type=del size=1298748 2023-12-03T11:42:09.184 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.183+0000 7f8723d84780 1 > prepared part key=_multipart_12XG7YPYTN4U.2~OL26X62A5JY7.0 size=1048576 2023-12-03T11:42:09.185 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.184+0000 7f8723d84780 1 > prepared part key=_multipart_12XG7YPYTN4U.2~OL26X62A5JY7.1 size=985140 2023-12-03T11:42:09.185 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.184+0000 7f8723d84780 1 > prepared multipart upload key=12XG7YPYTN4U upload=OL26X62A5JY7 tag=7L6XDJZ3W2YL type=write size=3082292 2023-12-03T11:42:09.186 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.185+0000 7f8723d84780 1 < completed part key=_multipart_12XG7YPYTN4U.2~QIVVCWGVYX8G.0 size=1048576 2023-12-03T11:42:09.187 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.186+0000 7f8723d84780 1 < completed part key=_multipart_12XG7YPYTN4U.2~QIVVCWGVYX8G.1 size=1048576 2023-12-03T11:42:09.188 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.187+0000 7f8723d84780 1 < completed part key=_multipart_12XG7YPYTN4U.2~QIVVCWGVYX8G.2 size=315851 2023-12-03T11:42:09.190 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.189+0000 7f8723d84780 1 < completed multipart upload key=12XG7YPYTN4U upload=QIVVCWGVYX8G tag=5HDHRB8UQM4F type=write size=3461579 2023-12-03T11:42:09.192 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.191+0000 7f8723d84780 1 > prepared part key=_multipart_AB0SN0E49Z5F.2~9HTW10B4WEV9.0 size=1048576 2023-12-03T11:42:09.193 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.192+0000 7f8723d84780 1 > prepared part key=_multipart_AB0SN0E49Z5F.2~9HTW10B4WEV9.1 size=924799 2023-12-03T11:42:09.193 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.192+0000 7f8723d84780 1 > prepared multipart upload key=AB0SN0E49Z5F upload=9HTW10B4WEV9 tag=KS75PUDI9JAT type=write size=3021951 2023-12-03T11:42:09.194 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.193+0000 7f8723d84780 1 < completed delete operation key=TSTIBGVYUZZZ tag=X13VKQY4M8GL type=del 2023-12-03T11:42:09.195 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.194+0000 7f8723d84780 1 > prepared operation key=EY9ZG5KOTBWM tag=912LH840ZGA2 type=del size=3291290 2023-12-03T11:42:09.197 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.196+0000 7f8723d84780 1 < completed delete operation key=HIU6L0NQ8Q95 tag=GC4H93619RZJ type=del 2023-12-03T11:42:09.201 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.198+0000 7f8723d84780 1 > prepared part key=_multipart_EITMJKL0LCYC.2~TG22EH1LNKJC.0 size=1048576 2023-12-03T11:42:09.201 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.199+0000 7f8723d84780 1 > prepared part key=_multipart_EITMJKL0LCYC.2~TG22EH1LNKJC.1 size=1048576 2023-12-03T11:42:09.201 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.200+0000 7f8723d84780 1 > prepared part key=_multipart_EITMJKL0LCYC.2~TG22EH1LNKJC.2 size=152168 2023-12-03T11:42:09.201 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.200+0000 7f8723d84780 1 > prepared multipart upload key=EITMJKL0LCYC upload=TG22EH1LNKJC tag=U0N13CWDX516 type=write size=3297896 2023-12-03T11:42:09.203 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.202+0000 7f8723d84780 1 < suggested update operation key=VENJI0KD1XDW tag=2YD8FIAPNVQM type=del size=3331875 2023-12-03T11:42:09.206 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.205+0000 7f8723d84780 1 > prepared operation key=EITMJKL0LCYC tag=WJ9BQCGJH3PI type=del size=2837826 2023-12-03T11:42:09.208 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.207+0000 7f8723d84780 1 < suggested remove operation key=12XG7YPYTN4U tag=1CKLZMSGPM2N type=del 2023-12-03T11:42:09.210 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.209+0000 7f8723d84780 1 > prepared part key=_multipart_HIU6L0NQ8Q95.2~I23BTGVCQ7VZ.0 size=745596 2023-12-03T11:42:09.210 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.209+0000 7f8723d84780 1 > prepared multipart upload key=HIU6L0NQ8Q95 upload=I23BTGVCQ7VZ tag=X8D5C1XW4JGG type=write size=1794172 2023-12-03T11:42:09.211 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.210+0000 7f8723d84780 1 < completed delete operation key=EITMJKL0LCYC tag=5AFO4W6QS1ID type=del 2023-12-03T11:42:09.213 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.212+0000 7f8723d84780 1 > prepared part key=_multipart_O7VVHXLDSY57.2~7LJDVPQWLMXR.0 size=1048576 2023-12-03T11:42:09.214 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.213+0000 7f8723d84780 1 > prepared part key=_multipart_O7VVHXLDSY57.2~7LJDVPQWLMXR.1 size=1048576 2023-12-03T11:42:09.215 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.214+0000 7f8723d84780 1 > prepared part key=_multipart_O7VVHXLDSY57.2~7LJDVPQWLMXR.2 size=269275 2023-12-03T11:42:09.215 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.214+0000 7f8723d84780 1 > prepared multipart upload key=O7VVHXLDSY57 upload=7LJDVPQWLMXR tag=S5X521K34NVJ type=write size=3415003 2023-12-03T11:42:09.216 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.215+0000 7f8723d84780 1 < completed delete operation key=DMQX2DGDLU7D tag=ACXW2GYW7389 type=del 2023-12-03T11:42:09.218 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.217+0000 7f8723d84780 1 > prepared part key=_multipart_OPQPIDJ2PBVU.2~WNZ107SARNNB.0 size=1019108 2023-12-03T11:42:09.218 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.217+0000 7f8723d84780 1 > prepared multipart upload key=OPQPIDJ2PBVU upload=WNZ107SARNNB tag=Z0H089NPOSAP type=write size=2067684 2023-12-03T11:42:09.219 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.218+0000 7f8723d84780 1 < completed part key=_multipart_G36T76K8O7A1.2~XFN4VA1HUU5H.0 size=1048576 2023-12-03T11:42:09.220 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.219+0000 7f8723d84780 1 < completed part key=_multipart_G36T76K8O7A1.2~XFN4VA1HUU5H.1 size=1048576 2023-12-03T11:42:09.221 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.220+0000 7f8723d84780 1 < completed part key=_multipart_G36T76K8O7A1.2~XFN4VA1HUU5H.2 size=351121 2023-12-03T11:42:09.223 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.222+0000 7f8723d84780 1 < completed multipart upload key=G36T76K8O7A1 upload=XFN4VA1HUU5H tag=EJXQZ7CTY6LR type=write size=3496849 2023-12-03T11:42:09.225 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.224+0000 7f8723d84780 1 > prepared part key=_multipart_G36T76K8O7A1.2~XNW1R04S8UJU.0 size=1048576 2023-12-03T11:42:09.226 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.225+0000 7f8723d84780 1 > prepared part key=_multipart_G36T76K8O7A1.2~XNW1R04S8UJU.1 size=341420 2023-12-03T11:42:09.226 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.225+0000 7f8723d84780 1 > prepared multipart upload key=G36T76K8O7A1 upload=XNW1R04S8UJU tag=99CPNEVHPC16 type=write size=2438572 2023-12-03T11:42:09.228 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.227+0000 7f8723d84780 1 < completed part key=_multipart_12XG7YPYTN4U.2~TV6J4DK1O67T.0 size=1048576 2023-12-03T11:42:09.229 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.228+0000 7f8723d84780 1 < completed part key=_multipart_12XG7YPYTN4U.2~TV6J4DK1O67T.1 size=1048576 2023-12-03T11:42:09.230 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.229+0000 7f8723d84780 1 < completed part key=_multipart_12XG7YPYTN4U.2~TV6J4DK1O67T.2 size=704465 2023-12-03T11:42:09.232 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.231+0000 7f8723d84780 1 < completed multipart upload key=12XG7YPYTN4U upload=TV6J4DK1O67T tag=MVWVDYZ8BNST type=write size=3850193 2023-12-03T11:42:09.233 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.232+0000 7f8723d84780 1 > prepared operation key=FCA2R3HR61S2 tag=10IHOOU8IJ1A type=write size=302459 2023-12-03T11:42:09.234 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.233+0000 7f8723d84780 1 < completed part key=_multipart_5UYL15O31IHM.2~M9KQMSCY91HM.0 size=477945 2023-12-03T11:42:09.236 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.235+0000 7f8723d84780 1 < completed multipart upload key=5UYL15O31IHM upload=M9KQMSCY91HM tag=SE27HAHH2DCK type=write size=1526521 2023-12-03T11:42:09.237 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.236+0000 7f8723d84780 1 > prepared operation key=TSTIBGVYUZZZ tag=JI2I8RTA0AU3 type=write size=160231 2023-12-03T11:42:09.238 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.237+0000 7f8723d84780 1 < completed delete operation key=UWS266H06VDK tag=HP7KPKF7RGFZ type=del 2023-12-03T11:42:09.240 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.238+0000 7f8723d84780 1 > prepared operation key=96RAVVSUKH0Y tag=BILMXFNJWKFM type=del size=1664695 2023-12-03T11:42:09.240 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.239+0000 7f8723d84780 1 < completed delete operation key=LMVO6CVEPN3K tag=593N0DRO3U12 type=del 2023-12-03T11:42:09.242 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.241+0000 7f8723d84780 1 > prepared operation key=FCA2R3HR61S2 tag=AQUC65FJ00U8 type=del size=3224227 2023-12-03T11:42:09.243 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.242+0000 7f8723d84780 1 < completed delete operation key=LMVO6CVEPN3K tag=LYUNBXAUS9ND type=del 2023-12-03T11:42:09.245 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.244+0000 7f8723d84780 1 > prepared part key=_multipart_10JRIKOZ16FY.2~CNW0XI8F2SY2.0 size=435054 2023-12-03T11:42:09.245 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.244+0000 7f8723d84780 1 > prepared multipart upload key=10JRIKOZ16FY upload=CNW0XI8F2SY2 tag=AAR5ZU85FEQU type=write size=1483630 2023-12-03T11:42:09.247 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.246+0000 7f8723d84780 1 < completed delete operation key=7THZZ1J5LOZK tag=J1N025TBG0MJ type=del 2023-12-03T11:42:09.249 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.248+0000 7f8723d84780 1 > prepared part key=_multipart_HIU6L0NQ8Q95.2~VT1M12N2GH7T.0 size=426014 2023-12-03T11:42:09.249 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.248+0000 7f8723d84780 1 > prepared multipart upload key=HIU6L0NQ8Q95 upload=VT1M12N2GH7T tag=ITASF1SCC12L type=write size=1474590 2023-12-03T11:42:09.251 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.250+0000 7f8723d84780 1 < completed part key=_multipart_LMVO6CVEPN3K.2~GS8FNFIUPPVL.0 size=647496 2023-12-03T11:42:09.253 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.252+0000 7f8723d84780 1 < completed multipart upload key=LMVO6CVEPN3K upload=GS8FNFIUPPVL tag=40B9NBWGM4XP type=write size=1696072 2023-12-03T11:42:09.254 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.253+0000 7f8723d84780 1 > prepared operation key=UWS266H06VDK tag=QETHXV7HM84E type=del size=187383 2023-12-03T11:42:09.255 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.254+0000 7f8723d84780 1 < completed part key=_multipart_12XG7YPYTN4U.2~OL26X62A5JY7.0 size=1048576 2023-12-03T11:42:09.255 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.254+0000 7f8723d84780 1 < canceled part key=_multipart_12XG7YPYTN4U.2~OL26X62A5JY7.1 size=985140 2023-12-03T11:42:09.257 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.256+0000 7f8723d84780 1 < canceled multipart upload key=12XG7YPYTN4U upload=OL26X62A5JY7 tag=7L6XDJZ3W2YL type=write size=3082292 2023-12-03T11:42:09.262 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.259+0000 7f8723d84780 1 > prepared part key=_multipart_LMVO6CVEPN3K.2~777UG2QS7WSW.0 size=755893 2023-12-03T11:42:09.262 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.259+0000 7f8723d84780 1 > prepared multipart upload key=LMVO6CVEPN3K upload=777UG2QS7WSW tag=9PYL20Z47POM type=write size=1804469 2023-12-03T11:42:09.262 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.260+0000 7f8723d84780 1 < completed part key=_multipart_AB0SN0E49Z5F.2~9HTW10B4WEV9.0 size=1048576 2023-12-03T11:42:09.262 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.261+0000 7f8723d84780 1 < completed part key=_multipart_AB0SN0E49Z5F.2~9HTW10B4WEV9.1 size=924799 2023-12-03T11:42:09.264 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.263+0000 7f8723d84780 1 < completed multipart upload key=AB0SN0E49Z5F upload=9HTW10B4WEV9 tag=KS75PUDI9JAT type=write size=3021951 2023-12-03T11:42:09.266 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.265+0000 7f8723d84780 1 > prepared part key=_multipart_OGACI7CRPMT7.2~W3GPE0N2NHI5.0 size=668545 2023-12-03T11:42:09.267 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.265+0000 7f8723d84780 1 > prepared multipart upload key=OGACI7CRPMT7 upload=W3GPE0N2NHI5 tag=ARUVT6S6WCFT type=write size=1717121 2023-12-03T11:42:09.269 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.268+0000 7f8723d84780 1 < suggested remove operation key=EY9ZG5KOTBWM tag=912LH840ZGA2 type=del 2023-12-03T11:42:09.270 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.269+0000 7f8723d84780 1 > prepared operation key=VENJI0KD1XDW tag=JWF1P1FY9IRX type=del size=549855 2023-12-03T11:42:09.270 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.269+0000 7f8723d84780 1 < canceled part key=_multipart_EITMJKL0LCYC.2~TG22EH1LNKJC.0 size=1048576 2023-12-03T11:42:09.272 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.271+0000 7f8723d84780 1 < completed part key=_multipart_EITMJKL0LCYC.2~TG22EH1LNKJC.1 size=1048576 2023-12-03T11:42:09.274 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.272+0000 7f8723d84780 1 < completed part key=_multipart_EITMJKL0LCYC.2~TG22EH1LNKJC.2 size=152168 2023-12-03T11:42:09.275 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.274+0000 7f8723d84780 1 < canceled multipart upload key=EITMJKL0LCYC upload=TG22EH1LNKJC tag=U0N13CWDX516 type=write size=3297896 2023-12-03T11:42:09.277 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.275+0000 7f8723d84780 1 > prepared operation key=Y6S7QI60GCLE tag=7R98EOX35E1Q type=del size=453728 2023-12-03T11:42:09.278 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.277+0000 7f8723d84780 1 < completed delete operation key=EITMJKL0LCYC tag=WJ9BQCGJH3PI type=del 2023-12-03T11:42:09.279 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.278+0000 7f8723d84780 1 > prepared operation key=UWS266H06VDK tag=KJ7P65S41EYO type=del size=1352810 2023-12-03T11:42:09.280 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.279+0000 7f8723d84780 1 < completed part key=_multipart_HIU6L0NQ8Q95.2~I23BTGVCQ7VZ.0 size=745596 2023-12-03T11:42:09.282 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.281+0000 7f8723d84780 1 < completed multipart upload key=HIU6L0NQ8Q95 upload=I23BTGVCQ7VZ tag=X8D5C1XW4JGG type=write size=1794172 2023-12-03T11:42:09.284 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.283+0000 7f8723d84780 1 > prepared part key=_multipart_12XG7YPYTN4U.2~E0P7OH01Q3NR.0 size=397079 2023-12-03T11:42:09.284 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.283+0000 7f8723d84780 1 > prepared multipart upload key=12XG7YPYTN4U upload=E0P7OH01Q3NR tag=SHBP8XF6SYB8 type=write size=1445655 2023-12-03T11:42:09.286 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.284+0000 7f8723d84780 1 < completed part key=_multipart_O7VVHXLDSY57.2~7LJDVPQWLMXR.0 size=1048576 2023-12-03T11:42:09.286 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.285+0000 7f8723d84780 1 < completed part key=_multipart_O7VVHXLDSY57.2~7LJDVPQWLMXR.1 size=1048576 2023-12-03T11:42:09.287 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.286+0000 7f8723d84780 1 < completed part key=_multipart_O7VVHXLDSY57.2~7LJDVPQWLMXR.2 size=269275 2023-12-03T11:42:09.290 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.289+0000 7f8723d84780 1 < completed multipart upload key=O7VVHXLDSY57 upload=7LJDVPQWLMXR tag=S5X521K34NVJ type=write size=3415003 2023-12-03T11:42:09.292 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.291+0000 7f8723d84780 1 > prepared operation key=OGACI7CRPMT7 tag=0QC8EHIJK65R type=write size=112978 2023-12-03T11:42:09.293 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.292+0000 7f8723d84780 1 < completed part key=_multipart_OPQPIDJ2PBVU.2~WNZ107SARNNB.0 size=1019108 2023-12-03T11:42:09.295 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.294+0000 7f8723d84780 1 < completed multipart upload key=OPQPIDJ2PBVU upload=WNZ107SARNNB tag=Z0H089NPOSAP type=write size=2067684 2023-12-03T11:42:09.297 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.296+0000 7f8723d84780 1 > prepared part key=_multipart_J33T5S893LMV.2~QWZ4FE3YASDA.0 size=1048576 2023-12-03T11:42:09.298 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.297+0000 7f8723d84780 1 > prepared part key=_multipart_J33T5S893LMV.2~QWZ4FE3YASDA.1 size=401127 2023-12-03T11:42:09.298 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.297+0000 7f8723d84780 1 > prepared multipart upload key=J33T5S893LMV upload=QWZ4FE3YASDA tag=FEMB4E31I0CV type=write size=2498279 2023-12-03T11:42:09.299 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.298+0000 7f8723d84780 1 < completed part key=_multipart_G36T76K8O7A1.2~XNW1R04S8UJU.0 size=1048576 2023-12-03T11:42:09.300 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.299+0000 7f8723d84780 1 < completed part key=_multipart_G36T76K8O7A1.2~XNW1R04S8UJU.1 size=341420 2023-12-03T11:42:09.302 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.301+0000 7f8723d84780 1 < completed multipart upload key=G36T76K8O7A1 upload=XNW1R04S8UJU tag=99CPNEVHPC16 type=write size=2438572 2023-12-03T11:42:09.305 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.303+0000 7f8723d84780 1 > prepared part key=_multipart_W2704YS8KYQB.2~C3TLS6JSW48B.0 size=38578 2023-12-03T11:42:09.305 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.303+0000 7f8723d84780 1 > prepared multipart upload key=W2704YS8KYQB upload=C3TLS6JSW48B tag=0NZRYMINRHCB type=write size=1087154 2023-12-03T11:42:09.306 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.305+0000 7f8723d84780 1 < completed write operation key=FCA2R3HR61S2 tag=10IHOOU8IJ1A type=write size=302459 2023-12-03T11:42:09.308 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.307+0000 7f8723d84780 1 > prepared part key=_multipart_96RAVVSUKH0Y.2~U6OXDH5V1LAQ.0 size=347832 2023-12-03T11:42:09.308 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.307+0000 7f8723d84780 1 > prepared multipart upload key=96RAVVSUKH0Y upload=U6OXDH5V1LAQ tag=0Z97XOE03VIK type=write size=1396408 2023-12-03T11:42:09.309 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.308+0000 7f8723d84780 1 < completed write operation key=TSTIBGVYUZZZ tag=JI2I8RTA0AU3 type=write size=160231 2023-12-03T11:42:09.310 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.309+0000 7f8723d84780 1 > prepared operation key=FCA2R3HR61S2 tag=NX0B4FSG5BII type=del size=1923826 2023-12-03T11:42:09.311 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.310+0000 7f8723d84780 1 < completed delete operation key=96RAVVSUKH0Y tag=BILMXFNJWKFM type=del 2023-12-03T11:42:09.313 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.312+0000 7f8723d84780 1 > prepared operation key=EITMJKL0LCYC tag=SQPTD0RWET56 type=del size=78201 2023-12-03T11:42:09.314 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.313+0000 7f8723d84780 1 < completed delete operation key=FCA2R3HR61S2 tag=AQUC65FJ00U8 type=del 2023-12-03T11:42:09.315 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.314+0000 7f8723d84780 1 > prepared operation key=96RAVVSUKH0Y tag=RPBOMBVHQYV3 type=del size=1904587 2023-12-03T11:42:09.316 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.315+0000 7f8723d84780 1 < completed part key=_multipart_10JRIKOZ16FY.2~CNW0XI8F2SY2.0 size=435054 2023-12-03T11:42:09.319 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.318+0000 7f8723d84780 1 < completed multipart upload key=10JRIKOZ16FY upload=CNW0XI8F2SY2 tag=AAR5ZU85FEQU type=write size=1483630 2023-12-03T11:42:09.321 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.320+0000 7f8723d84780 1 > prepared part key=_multipart_8NONX2I08YMJ.2~52TRJUSM14OG.0 size=1048576 2023-12-03T11:42:09.322 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.321+0000 7f8723d84780 1 > prepared part key=_multipart_8NONX2I08YMJ.2~52TRJUSM14OG.1 size=147495 2023-12-03T11:42:09.322 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.321+0000 7f8723d84780 1 > prepared multipart upload key=8NONX2I08YMJ upload=52TRJUSM14OG tag=ZBTT220JF7G2 type=write size=2244647 2023-12-03T11:42:09.323 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.322+0000 7f8723d84780 1 < completed part key=_multipart_HIU6L0NQ8Q95.2~VT1M12N2GH7T.0 size=426014 2023-12-03T11:42:09.325 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.324+0000 7f8723d84780 1 < completed multipart upload key=HIU6L0NQ8Q95 upload=VT1M12N2GH7T tag=ITASF1SCC12L type=write size=1474590 2023-12-03T11:42:09.327 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.326+0000 7f8723d84780 1 > prepared operation key=J33T5S893LMV tag=0PE9EH68OQON type=del size=1037646 2023-12-03T11:42:09.328 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.327+0000 7f8723d84780 1 < completed delete operation key=UWS266H06VDK tag=QETHXV7HM84E type=del 2023-12-03T11:42:09.329 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.328+0000 7f8723d84780 1 > prepared operation key=7VMTBKUWU59F tag=P442ZAAXTQM0 type=del size=3919822 2023-12-03T11:42:09.330 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.329+0000 7f8723d84780 1 < completed part key=_multipart_LMVO6CVEPN3K.2~777UG2QS7WSW.0 size=755893 2023-12-03T11:42:09.332 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.331+0000 7f8723d84780 1 < completed multipart upload key=LMVO6CVEPN3K upload=777UG2QS7WSW tag=9PYL20Z47POM type=write size=1804469 2023-12-03T11:42:09.335 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.334+0000 7f8723d84780 1 > prepared part key=_multipart_FCA2R3HR61S2.2~4U7MHE2900AK.0 size=1048576 2023-12-03T11:42:09.336 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.335+0000 7f8723d84780 1 > prepared part key=_multipart_FCA2R3HR61S2.2~4U7MHE2900AK.1 size=139994 2023-12-03T11:42:09.336 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.335+0000 7f8723d84780 1 > prepared multipart upload key=FCA2R3HR61S2 upload=4U7MHE2900AK tag=HRBI8QXMTLJN type=write size=2237146 2023-12-03T11:42:09.337 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.336+0000 7f8723d84780 1 < completed part key=_multipart_OGACI7CRPMT7.2~W3GPE0N2NHI5.0 size=668545 2023-12-03T11:42:09.339 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.338+0000 7f8723d84780 1 < completed multipart upload key=OGACI7CRPMT7 upload=W3GPE0N2NHI5 tag=ARUVT6S6WCFT type=write size=1717121 2023-12-03T11:42:09.342 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.340+0000 7f8723d84780 1 > prepared part key=_multipart_5UYL15O31IHM.2~3UNXGSSVT6RV.0 size=1048576 2023-12-03T11:42:09.342 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.341+0000 7f8723d84780 1 > prepared part key=_multipart_5UYL15O31IHM.2~3UNXGSSVT6RV.1 size=1048576 2023-12-03T11:42:09.343 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.342+0000 7f8723d84780 1 > prepared part key=_multipart_5UYL15O31IHM.2~3UNXGSSVT6RV.2 size=67669 2023-12-03T11:42:09.343 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.342+0000 7f8723d84780 1 > prepared multipart upload key=5UYL15O31IHM upload=3UNXGSSVT6RV tag=MTJQI4OIF296 type=write size=3213397 2023-12-03T11:42:09.345 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.344+0000 7f8723d84780 1 < suggested remove operation key=VENJI0KD1XDW tag=JWF1P1FY9IRX type=del 2023-12-03T11:42:09.347 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.345+0000 7f8723d84780 1 > prepared operation key=4I8PWBZOLDUG tag=OKGJ8HEK7ZIE type=del size=1884157 2023-12-03T11:42:09.349 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.348+0000 7f8723d84780 1 < suggested remove operation key=Y6S7QI60GCLE tag=7R98EOX35E1Q type=del 2023-12-03T11:42:09.350 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.349+0000 7f8723d84780 1 > prepared operation key=10JRIKOZ16FY tag=IW8TMK8NDR5J type=del size=3980719 2023-12-03T11:42:09.351 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.350+0000 7f8723d84780 1 < completed delete operation key=UWS266H06VDK tag=KJ7P65S41EYO type=del 2023-12-03T11:42:09.353 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.352+0000 7f8723d84780 1 > prepared part key=_multipart_7THZZ1J5LOZK.2~ME9QUMC5UZKI.0 size=753324 2023-12-03T11:42:09.354 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.352+0000 7f8723d84780 1 > prepared multipart upload key=7THZZ1J5LOZK upload=ME9QUMC5UZKI tag=ATRXA48J2SD3 type=write size=1801900 2023-12-03T11:42:09.355 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.353+0000 7f8723d84780 1 < completed part key=_multipart_12XG7YPYTN4U.2~E0P7OH01Q3NR.0 size=397079 2023-12-03T11:42:09.357 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.356+0000 7f8723d84780 1 < completed multipart upload key=12XG7YPYTN4U upload=E0P7OH01Q3NR tag=SHBP8XF6SYB8 type=write size=1445655 2023-12-03T11:42:09.359 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.358+0000 7f8723d84780 1 > prepared part key=_multipart_10JRIKOZ16FY.2~ZHS3WZPQYIEF.0 size=1048576 2023-12-03T11:42:09.360 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.359+0000 7f8723d84780 1 > prepared part key=_multipart_10JRIKOZ16FY.2~ZHS3WZPQYIEF.1 size=160371 2023-12-03T11:42:09.360 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.359+0000 7f8723d84780 1 > prepared multipart upload key=10JRIKOZ16FY upload=ZHS3WZPQYIEF tag=A3Q5QNY6SIVP type=write size=2257523 2023-12-03T11:42:09.361 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.360+0000 7f8723d84780 1 < completed write operation key=OGACI7CRPMT7 tag=0QC8EHIJK65R type=write size=112978 2023-12-03T11:42:09.362 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.361+0000 7f8723d84780 1 > prepared operation key=OGACI7CRPMT7 tag=KF0A7TX2VN4C type=del size=2968093 2023-12-03T11:42:09.363 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.362+0000 7f8723d84780 1 < completed part key=_multipart_J33T5S893LMV.2~QWZ4FE3YASDA.0 size=1048576 2023-12-03T11:42:09.366 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.365+0000 7f8723d84780 1 < completed part key=_multipart_J33T5S893LMV.2~QWZ4FE3YASDA.1 size=401127 2023-12-03T11:42:09.368 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.367+0000 7f8723d84780 1 < completed multipart upload key=J33T5S893LMV upload=QWZ4FE3YASDA tag=FEMB4E31I0CV type=write size=2498279 2023-12-03T11:42:09.370 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.369+0000 7f8723d84780 1 > prepared part key=_multipart_931GNEXBHH35.2~N2QIWV07X97X.0 size=1048576 2023-12-03T11:42:09.371 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.370+0000 7f8723d84780 1 > prepared part key=_multipart_931GNEXBHH35.2~N2QIWV07X97X.1 size=1048576 2023-12-03T11:42:09.372 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.371+0000 7f8723d84780 1 > prepared part key=_multipart_931GNEXBHH35.2~N2QIWV07X97X.2 size=266656 2023-12-03T11:42:09.372 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.371+0000 7f8723d84780 1 > prepared multipart upload key=931GNEXBHH35 upload=N2QIWV07X97X tag=Y1WDX6Z9F1EB type=write size=3412384 2023-12-03T11:42:09.372 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.371+0000 7f8723d84780 1 < canceled part key=_multipart_W2704YS8KYQB.2~C3TLS6JSW48B.0 size=38578 2023-12-03T11:42:09.374 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.373+0000 7f8723d84780 1 < canceled multipart upload key=W2704YS8KYQB upload=C3TLS6JSW48B tag=0NZRYMINRHCB type=write size=1087154 2023-12-03T11:42:09.375 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.374+0000 7f8723d84780 1 > prepared operation key=FCA2R3HR61S2 tag=PGHBDE6PPP4B type=write size=335701 2023-12-03T11:42:09.376 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.375+0000 7f8723d84780 1 < completed part key=_multipart_96RAVVSUKH0Y.2~U6OXDH5V1LAQ.0 size=347832 2023-12-03T11:42:09.378 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.377+0000 7f8723d84780 1 < completed multipart upload key=96RAVVSUKH0Y upload=U6OXDH5V1LAQ tag=0Z97XOE03VIK type=write size=1396408 2023-12-03T11:42:09.380 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.379+0000 7f8723d84780 1 > prepared part key=_multipart_8NONX2I08YMJ.2~PJBKWVQPIJKD.0 size=823885 2023-12-03T11:42:09.380 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.379+0000 7f8723d84780 1 > prepared multipart upload key=8NONX2I08YMJ upload=PJBKWVQPIJKD tag=S0Z6XBVS8TUB type=write size=1872461 2023-12-03T11:42:09.381 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.380+0000 7f8723d84780 1 < completed delete operation key=FCA2R3HR61S2 tag=NX0B4FSG5BII type=del 2023-12-03T11:42:09.382 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.381+0000 7f8723d84780 1 > prepared operation key=G36T76K8O7A1 tag=2UC41MQ8J19X type=write size=51329 2023-12-03T11:42:09.385 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.384+0000 7f8723d84780 1 < suggested remove operation key=EITMJKL0LCYC tag=SQPTD0RWET56 type=del 2023-12-03T11:42:09.387 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.386+0000 7f8723d84780 1 > prepared part key=_multipart_FCA2R3HR61S2.2~4RCAO8A65KY3.0 size=1048576 2023-12-03T11:42:09.388 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.387+0000 7f8723d84780 1 > prepared part key=_multipart_FCA2R3HR61S2.2~4RCAO8A65KY3.1 size=656714 2023-12-03T11:42:09.388 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.387+0000 7f8723d84780 1 > prepared multipart upload key=FCA2R3HR61S2 upload=4RCAO8A65KY3 tag=NCISCE704A11 type=write size=2753866 2023-12-03T11:42:09.389 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.388+0000 7f8723d84780 1 < completed delete operation key=96RAVVSUKH0Y tag=RPBOMBVHQYV3 type=del 2023-12-03T11:42:09.390 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.389+0000 7f8723d84780 1 > prepared operation key=OGACI7CRPMT7 tag=SOSXXH9AVG05 type=del size=988907 2023-12-03T11:42:09.391 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.390+0000 7f8723d84780 1 < completed part key=_multipart_8NONX2I08YMJ.2~52TRJUSM14OG.0 size=1048576 2023-12-03T11:42:09.392 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.391+0000 7f8723d84780 1 < completed part key=_multipart_8NONX2I08YMJ.2~52TRJUSM14OG.1 size=147495 2023-12-03T11:42:09.394 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.393+0000 7f8723d84780 1 < completed multipart upload key=8NONX2I08YMJ upload=52TRJUSM14OG tag=ZBTT220JF7G2 type=write size=2244647 2023-12-03T11:42:09.395 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.394+0000 7f8723d84780 1 > prepared operation key=LMVO6CVEPN3K tag=59ASP8WTNUG5 type=del size=1113721 2023-12-03T11:42:09.397 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.396+0000 7f8723d84780 1 < canceled operation key=J33T5S893LMV tag=0PE9EH68OQON type=del size=1037646 2023-12-03T11:42:09.398 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.397+0000 7f8723d84780 1 > prepared operation key=931GNEXBHH35 tag=MZ1JHNX3JJPW type=del size=2165140 2023-12-03T11:42:09.399 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.398+0000 7f8723d84780 1 < completed delete operation key=7VMTBKUWU59F tag=P442ZAAXTQM0 type=del 2023-12-03T11:42:09.401 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.400+0000 7f8723d84780 1 > prepared operation key=DMQX2DGDLU7D tag=AUVHM0QVY99U type=del size=1144023 2023-12-03T11:42:09.402 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.401+0000 7f8723d84780 1 < completed part key=_multipart_FCA2R3HR61S2.2~4U7MHE2900AK.0 size=1048576 2023-12-03T11:42:09.403 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.402+0000 7f8723d84780 1 < completed part key=_multipart_FCA2R3HR61S2.2~4U7MHE2900AK.1 size=139994 2023-12-03T11:42:09.405 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.404+0000 7f8723d84780 1 < completed multipart upload key=FCA2R3HR61S2 upload=4U7MHE2900AK tag=HRBI8QXMTLJN type=write size=2237146 2023-12-03T11:42:09.407 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.406+0000 7f8723d84780 1 > prepared part key=_multipart_UWS266H06VDK.2~TTKROYVTG6S6.0 size=1048576 2023-12-03T11:42:09.408 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.407+0000 7f8723d84780 1 > prepared part key=_multipart_UWS266H06VDK.2~TTKROYVTG6S6.1 size=1048576 2023-12-03T11:42:09.409 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.408+0000 7f8723d84780 1 > prepared part key=_multipart_UWS266H06VDK.2~TTKROYVTG6S6.2 size=306232 2023-12-03T11:42:09.409 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.408+0000 7f8723d84780 1 > prepared multipart upload key=UWS266H06VDK upload=TTKROYVTG6S6 tag=AZSVF2ZMWJOP type=write size=3451960 2023-12-03T11:42:09.410 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.409+0000 7f8723d84780 1 < completed part key=_multipart_5UYL15O31IHM.2~3UNXGSSVT6RV.0 size=1048576 2023-12-03T11:42:09.411 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.410+0000 7f8723d84780 1 < completed part key=_multipart_5UYL15O31IHM.2~3UNXGSSVT6RV.1 size=1048576 2023-12-03T11:42:09.412 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.411+0000 7f8723d84780 1 < completed part key=_multipart_5UYL15O31IHM.2~3UNXGSSVT6RV.2 size=67669 2023-12-03T11:42:09.414 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.413+0000 7f8723d84780 1 < completed multipart upload key=5UYL15O31IHM upload=3UNXGSSVT6RV tag=MTJQI4OIF296 type=write size=3213397 2023-12-03T11:42:09.415 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.414+0000 7f8723d84780 1 > prepared operation key=12XG7YPYTN4U tag=BP4H29C7LKPL type=write size=530161 2023-12-03T11:42:09.418 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.416+0000 7f8723d84780 1 < suggested remove operation key=4I8PWBZOLDUG tag=OKGJ8HEK7ZIE type=del 2023-12-03T11:42:09.420 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.419+0000 7f8723d84780 1 > prepared part key=_multipart_OGACI7CRPMT7.2~S9LF7P97SLU5.0 size=364436 2023-12-03T11:42:09.420 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.419+0000 7f8723d84780 1 > prepared multipart upload key=OGACI7CRPMT7 upload=S9LF7P97SLU5 tag=7KWQ21ISHUAC type=write size=1413012 2023-12-03T11:42:09.421 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.420+0000 7f8723d84780 1 < canceled operation key=10JRIKOZ16FY tag=IW8TMK8NDR5J type=del size=3980719 2023-12-03T11:42:09.422 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.421+0000 7f8723d84780 1 > prepared operation key=7THZZ1J5LOZK tag=S4F4IZ779KEL type=del size=1798351 2023-12-03T11:42:09.423 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.421+0000 7f8723d84780 1 < canceled part key=_multipart_7THZZ1J5LOZK.2~ME9QUMC5UZKI.0 size=753324 2023-12-03T11:42:09.424 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.423+0000 7f8723d84780 1 < canceled multipart upload key=7THZZ1J5LOZK upload=ME9QUMC5UZKI tag=ATRXA48J2SD3 type=write size=1801900 2023-12-03T11:42:09.426 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.425+0000 7f8723d84780 1 > prepared part key=_multipart_M4VKPN6INFNZ.2~SLT1IYCRYANR.0 size=1048576 2023-12-03T11:42:09.427 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.426+0000 7f8723d84780 1 > prepared part key=_multipart_M4VKPN6INFNZ.2~SLT1IYCRYANR.1 size=1048576 2023-12-03T11:42:09.428 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.427+0000 7f8723d84780 1 > prepared part key=_multipart_M4VKPN6INFNZ.2~SLT1IYCRYANR.2 size=793600 2023-12-03T11:42:09.428 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.427+0000 7f8723d84780 1 > prepared multipart upload key=M4VKPN6INFNZ upload=SLT1IYCRYANR tag=ITQXBQBU7XAP type=write size=3939328 2023-12-03T11:42:09.431 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.430+0000 7f8723d84780 1 < completed part key=_multipart_10JRIKOZ16FY.2~ZHS3WZPQYIEF.0 size=1048576 2023-12-03T11:42:09.432 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.431+0000 7f8723d84780 1 < completed part key=_multipart_10JRIKOZ16FY.2~ZHS3WZPQYIEF.1 size=160371 2023-12-03T11:42:09.434 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.433+0000 7f8723d84780 1 < completed multipart upload key=10JRIKOZ16FY upload=ZHS3WZPQYIEF tag=A3Q5QNY6SIVP type=write size=2257523 2023-12-03T11:42:09.435 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.434+0000 7f8723d84780 1 > prepared operation key=7VMTBKUWU59F tag=0PRKPZLEW7RL type=write size=360598 2023-12-03T11:42:09.438 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.437+0000 7f8723d84780 1 < suggested update operation key=OGACI7CRPMT7 tag=KF0A7TX2VN4C type=del size=2968093 2023-12-03T11:42:09.441 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.440+0000 7f8723d84780 1 > prepared part key=_multipart_4I8PWBZOLDUG.2~2QPP20XKSOIH.0 size=1048576 2023-12-03T11:42:09.442 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.441+0000 7f8723d84780 1 > prepared part key=_multipart_4I8PWBZOLDUG.2~2QPP20XKSOIH.1 size=1048576 2023-12-03T11:42:09.443 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.442+0000 7f8723d84780 1 > prepared part key=_multipart_4I8PWBZOLDUG.2~2QPP20XKSOIH.2 size=569042 2023-12-03T11:42:09.443 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.442+0000 7f8723d84780 1 > prepared multipart upload key=4I8PWBZOLDUG upload=2QPP20XKSOIH tag=19KC25K24K0C type=write size=3714770 2023-12-03T11:42:09.444 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.443+0000 7f8723d84780 1 < completed part key=_multipart_931GNEXBHH35.2~N2QIWV07X97X.0 size=1048576 2023-12-03T11:42:09.445 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.444+0000 7f8723d84780 1 < completed part key=_multipart_931GNEXBHH35.2~N2QIWV07X97X.1 size=1048576 2023-12-03T11:42:09.446 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.445+0000 7f8723d84780 1 < completed part key=_multipart_931GNEXBHH35.2~N2QIWV07X97X.2 size=266656 2023-12-03T11:42:09.449 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.448+0000 7f8723d84780 1 < completed multipart upload key=931GNEXBHH35 upload=N2QIWV07X97X tag=Y1WDX6Z9F1EB type=write size=3412384 2023-12-03T11:42:09.450 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.449+0000 7f8723d84780 1 > prepared operation key=5UYL15O31IHM tag=JE2JO54PXO9O type=del size=3433388 2023-12-03T11:42:09.451 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.450+0000 7f8723d84780 1 < canceled operation key=FCA2R3HR61S2 tag=PGHBDE6PPP4B type=write size=335701 2023-12-03T11:42:09.452 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.451+0000 7f8723d84780 1 > prepared operation key=10JRIKOZ16FY tag=14ZXHI2DUMSR type=del size=976656 2023-12-03T11:42:09.453 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.452+0000 7f8723d84780 1 < completed part key=_multipart_8NONX2I08YMJ.2~PJBKWVQPIJKD.0 size=823885 2023-12-03T11:42:09.455 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.454+0000 7f8723d84780 1 < completed multipart upload key=8NONX2I08YMJ upload=PJBKWVQPIJKD tag=S0Z6XBVS8TUB type=write size=1872461 2023-12-03T11:42:09.456 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.455+0000 7f8723d84780 1 > prepared operation key=LCK58DDM5XU9 tag=SNF8WNNCFG5I type=del size=551749 2023-12-03T11:42:09.458 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.457+0000 7f8723d84780 1 < completed write operation key=G36T76K8O7A1 tag=2UC41MQ8J19X type=write size=51329 2023-12-03T11:42:09.459 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.458+0000 7f8723d84780 1 > prepared operation key=LMVO6CVEPN3K tag=B1N21TV25SRE type=del size=964321 2023-12-03T11:42:09.460 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.459+0000 7f8723d84780 1 < completed part key=_multipart_FCA2R3HR61S2.2~4RCAO8A65KY3.0 size=1048576 2023-12-03T11:42:09.461 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.460+0000 7f8723d84780 1 < completed part key=_multipart_FCA2R3HR61S2.2~4RCAO8A65KY3.1 size=656714 2023-12-03T11:42:09.464 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.462+0000 7f8723d84780 1 < completed multipart upload key=FCA2R3HR61S2 upload=4RCAO8A65KY3 tag=NCISCE704A11 type=write size=2753866 2023-12-03T11:42:09.465 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.464+0000 7f8723d84780 1 > prepared operation key=KS5J7E7KE2IJ tag=7FF2E9RRF4MJ type=del size=2428578 2023-12-03T11:42:09.466 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.465+0000 7f8723d84780 -1 < failed to complete operation key=OGACI7CRPMT7 tag=SOSXXH9AVG05 type=del size=988907: (22) Invalid argument 2023-12-03T11:42:09.469 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.468+0000 7f8723d84780 1 > prepared part key=_multipart_5UYL15O31IHM.2~T55A0D28U70J.0 size=1048576 2023-12-03T11:42:09.470 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.469+0000 7f8723d84780 1 > prepared part key=_multipart_5UYL15O31IHM.2~T55A0D28U70J.1 size=1048576 2023-12-03T11:42:09.470 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.469+0000 7f8723d84780 1 > prepared part key=_multipart_5UYL15O31IHM.2~T55A0D28U70J.2 size=1017248 2023-12-03T11:42:09.471 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.469+0000 7f8723d84780 1 > prepared multipart upload key=5UYL15O31IHM upload=T55A0D28U70J tag=0RGHF5TXEBY6 type=write size=4162976 2023-12-03T11:42:09.472 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.471+0000 7f8723d84780 1 < completed delete operation key=LMVO6CVEPN3K tag=59ASP8WTNUG5 type=del 2023-12-03T11:42:09.474 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.473+0000 7f8723d84780 1 > prepared part key=_multipart_K83BTR5BOLZE.2~26QRAPZG3Y9E.0 size=1048576 2023-12-03T11:42:09.475 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.474+0000 7f8723d84780 1 > prepared part key=_multipart_K83BTR5BOLZE.2~26QRAPZG3Y9E.1 size=21181 2023-12-03T11:42:09.475 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.474+0000 7f8723d84780 1 > prepared multipart upload key=K83BTR5BOLZE upload=26QRAPZG3Y9E tag=1TL6SLJSR2KH type=write size=2118333 2023-12-03T11:42:09.476 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.475+0000 7f8723d84780 1 < completed delete operation key=931GNEXBHH35 tag=MZ1JHNX3JJPW type=del 2023-12-03T11:42:09.478 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.477+0000 7f8723d84780 1 > prepared part key=_multipart_OGACI7CRPMT7.2~QJWUA47I20OI.0 size=481660 2023-12-03T11:42:09.478 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.477+0000 7f8723d84780 1 > prepared multipart upload key=OGACI7CRPMT7 upload=QJWUA47I20OI tag=NT1EY7ZJYPAZ type=write size=1530236 2023-12-03T11:42:09.479 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.478+0000 7f8723d84780 1 < completed delete operation key=DMQX2DGDLU7D tag=AUVHM0QVY99U type=del 2023-12-03T11:42:09.480 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.479+0000 7f8723d84780 1 > prepared operation key=CKABTI1EOAWB tag=T6BZ61QTGRSX type=del size=332464 2023-12-03T11:42:09.482 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.481+0000 7f8723d84780 1 < completed part key=_multipart_UWS266H06VDK.2~TTKROYVTG6S6.0 size=1048576 2023-12-03T11:42:09.483 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.482+0000 7f8723d84780 1 < completed part key=_multipart_UWS266H06VDK.2~TTKROYVTG6S6.1 size=1048576 2023-12-03T11:42:09.484 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.483+0000 7f8723d84780 1 < completed part key=_multipart_UWS266H06VDK.2~TTKROYVTG6S6.2 size=306232 2023-12-03T11:42:09.486 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.485+0000 7f8723d84780 1 < completed multipart upload key=UWS266H06VDK upload=TTKROYVTG6S6 tag=AZSVF2ZMWJOP type=write size=3451960 2023-12-03T11:42:09.488 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.487+0000 7f8723d84780 1 > prepared part key=_multipart_931GNEXBHH35.2~6KN11KB8T1H7.0 size=551682 2023-12-03T11:42:09.488 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.487+0000 7f8723d84780 1 > prepared multipart upload key=931GNEXBHH35 upload=6KN11KB8T1H7 tag=C3MCMA76CX7Q type=write size=1600258 2023-12-03T11:42:09.489 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.488+0000 7f8723d84780 1 < completed write operation key=12XG7YPYTN4U tag=BP4H29C7LKPL type=write size=530161 2023-12-03T11:42:09.490 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.489+0000 7f8723d84780 1 > prepared operation key=5UYL15O31IHM tag=CJDEJTLATMMZ type=del size=3820289 2023-12-03T11:42:09.492 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.491+0000 7f8723d84780 1 < completed part key=_multipart_OGACI7CRPMT7.2~S9LF7P97SLU5.0 size=364436 2023-12-03T11:42:09.494 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.493+0000 7f8723d84780 1 < completed multipart upload key=OGACI7CRPMT7 upload=S9LF7P97SLU5 tag=7KWQ21ISHUAC type=write size=1413012 2023-12-03T11:42:09.495 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.494+0000 7f8723d84780 1 > prepared operation key=D3JEVEY0E29E tag=RUI1GVBY8D4W type=del size=3527758 2023-12-03T11:42:09.496 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.495+0000 7f8723d84780 1 < completed delete operation key=7THZZ1J5LOZK tag=S4F4IZ779KEL type=del 2023-12-03T11:42:09.499 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.497+0000 7f8723d84780 1 > prepared part key=_multipart_DMQX2DGDLU7D.2~9GCBUIUIBU06.0 size=573084 2023-12-03T11:42:09.499 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.497+0000 7f8723d84780 1 > prepared multipart upload key=DMQX2DGDLU7D upload=9GCBUIUIBU06 tag=U40YJJO1GQ4S type=write size=1621660 2023-12-03T11:42:09.500 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.499+0000 7f8723d84780 1 < completed part key=_multipart_M4VKPN6INFNZ.2~SLT1IYCRYANR.0 size=1048576 2023-12-03T11:42:09.501 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.500+0000 7f8723d84780 1 < completed part key=_multipart_M4VKPN6INFNZ.2~SLT1IYCRYANR.1 size=1048576 2023-12-03T11:42:09.502 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.501+0000 7f8723d84780 1 < completed part key=_multipart_M4VKPN6INFNZ.2~SLT1IYCRYANR.2 size=793600 2023-12-03T11:42:09.504 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.503+0000 7f8723d84780 1 < completed multipart upload key=M4VKPN6INFNZ upload=SLT1IYCRYANR tag=ITQXBQBU7XAP type=write size=3939328 2023-12-03T11:42:09.505 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.504+0000 7f8723d84780 1 > prepared operation key=TSTIBGVYUZZZ tag=0KPYJZ21K6IG type=del size=2923591 2023-12-03T11:42:09.508 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.507+0000 7f8723d84780 1 < suggested remove operation key=7VMTBKUWU59F tag=0PRKPZLEW7RL type=write 2023-12-03T11:42:09.509 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.508+0000 7f8723d84780 1 > prepared operation key=M4VKPN6INFNZ tag=TITY6V1VTTAZ type=write size=736128 2023-12-03T11:42:09.510 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.509+0000 7f8723d84780 1 < completed part key=_multipart_4I8PWBZOLDUG.2~2QPP20XKSOIH.0 size=1048576 2023-12-03T11:42:09.511 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.510+0000 7f8723d84780 1 < completed part key=_multipart_4I8PWBZOLDUG.2~2QPP20XKSOIH.1 size=1048576 2023-12-03T11:42:09.512 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.511+0000 7f8723d84780 1 < completed part key=_multipart_4I8PWBZOLDUG.2~2QPP20XKSOIH.2 size=569042 2023-12-03T11:42:09.514 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.513+0000 7f8723d84780 1 < completed multipart upload key=4I8PWBZOLDUG upload=2QPP20XKSOIH tag=19KC25K24K0C type=write size=3714770 2023-12-03T11:42:09.516 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.515+0000 7f8723d84780 1 > prepared part key=_multipart_O7VVHXLDSY57.2~DEGGU4DCF9GJ.0 size=1048576 2023-12-03T11:42:09.517 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.516+0000 7f8723d84780 1 > prepared part key=_multipart_O7VVHXLDSY57.2~DEGGU4DCF9GJ.1 size=769193 2023-12-03T11:42:09.517 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.516+0000 7f8723d84780 1 > prepared multipart upload key=O7VVHXLDSY57 upload=DEGGU4DCF9GJ tag=7IP17UZ5OV38 type=write size=2866345 2023-12-03T11:42:09.518 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.517+0000 7f8723d84780 1 < completed delete operation key=5UYL15O31IHM tag=JE2JO54PXO9O type=del 2023-12-03T11:42:09.519 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.518+0000 7f8723d84780 1 > prepared operation key=7VMTBKUWU59F tag=W0149TQEUAO0 type=del size=3109969 2023-12-03T11:42:09.521 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.520+0000 7f8723d84780 1 < completed delete operation key=10JRIKOZ16FY tag=14ZXHI2DUMSR type=del 2023-12-03T11:42:09.523 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.522+0000 7f8723d84780 1 > prepared part key=_multipart_FCA2R3HR61S2.2~R81TMP10VJGV.0 size=1048576 2023-12-03T11:42:09.524 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.523+0000 7f8723d84780 1 > prepared part key=_multipart_FCA2R3HR61S2.2~R81TMP10VJGV.1 size=1048576 2023-12-03T11:42:09.525 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.524+0000 7f8723d84780 1 > prepared part key=_multipart_FCA2R3HR61S2.2~R81TMP10VJGV.2 size=453843 2023-12-03T11:42:09.525 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.524+0000 7f8723d84780 1 > prepared multipart upload key=FCA2R3HR61S2 upload=R81TMP10VJGV tag=OB8687RH6WOI type=write size=3599571 2023-12-03T11:42:09.526 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.525+0000 7f8723d84780 1 < completed delete operation key=LCK58DDM5XU9 tag=SNF8WNNCFG5I type=del 2023-12-03T11:42:09.527 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.526+0000 7f8723d84780 1 > prepared operation key=EITMJKL0LCYC tag=EV6RXGEQMKIL type=del size=3367670 2023-12-03T11:42:09.530 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.529+0000 7f8723d84780 1 < suggested remove operation key=LMVO6CVEPN3K tag=B1N21TV25SRE type=del 2023-12-03T11:42:09.531 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.530+0000 7f8723d84780 1 > prepared operation key=HIU6L0NQ8Q95 tag=CQNWKIT13RUV type=write size=783988 2023-12-03T11:42:09.532 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.531+0000 7f8723d84780 1 < completed delete operation key=KS5J7E7KE2IJ tag=7FF2E9RRF4MJ type=del 2023-12-03T11:42:09.534 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.533+0000 7f8723d84780 1 > prepared operation key=Y6S7QI60GCLE tag=H054VSMDF8K6 type=write size=949106 2023-12-03T11:42:09.535 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.534+0000 7f8723d84780 1 < completed part key=_multipart_5UYL15O31IHM.2~T55A0D28U70J.0 size=1048576 2023-12-03T11:42:09.536 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.535+0000 7f8723d84780 1 < completed part key=_multipart_5UYL15O31IHM.2~T55A0D28U70J.1 size=1048576 2023-12-03T11:42:09.537 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.536+0000 7f8723d84780 1 < completed part key=_multipart_5UYL15O31IHM.2~T55A0D28U70J.2 size=1017248 2023-12-03T11:42:09.539 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.538+0000 7f8723d84780 1 < completed multipart upload key=5UYL15O31IHM upload=T55A0D28U70J tag=0RGHF5TXEBY6 type=write size=4162976 2023-12-03T11:42:09.540 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.539+0000 7f8723d84780 1 > prepared operation key=AB0SN0E49Z5F tag=69PU147D2NDZ type=del size=1006815 2023-12-03T11:42:09.542 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.541+0000 7f8723d84780 1 < completed part key=_multipart_K83BTR5BOLZE.2~26QRAPZG3Y9E.0 size=1048576 2023-12-03T11:42:09.543 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.542+0000 7f8723d84780 1 < completed part key=_multipart_K83BTR5BOLZE.2~26QRAPZG3Y9E.1 size=21181 2023-12-03T11:42:09.545 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.544+0000 7f8723d84780 1 < completed multipart upload key=K83BTR5BOLZE upload=26QRAPZG3Y9E tag=1TL6SLJSR2KH type=write size=2118333 2023-12-03T11:42:09.549 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.548+0000 7f8723d84780 1 > prepared part key=_multipart_UWS266H06VDK.2~ILA2IT7I580U.0 size=1048576 2023-12-03T11:42:09.551 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.549+0000 7f8723d84780 1 > prepared part key=_multipart_UWS266H06VDK.2~ILA2IT7I580U.1 size=329589 2023-12-03T11:42:09.551 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.549+0000 7f8723d84780 1 > prepared multipart upload key=UWS266H06VDK upload=ILA2IT7I580U tag=2LJN12EGD46D type=write size=2426741 2023-12-03T11:42:09.552 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.551+0000 7f8723d84780 1 < completed part key=_multipart_OGACI7CRPMT7.2~QJWUA47I20OI.0 size=481660 2023-12-03T11:42:09.554 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.553+0000 7f8723d84780 1 < completed multipart upload key=OGACI7CRPMT7 upload=QJWUA47I20OI tag=NT1EY7ZJYPAZ type=write size=1530236 2023-12-03T11:42:09.556 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.555+0000 7f8723d84780 1 > prepared part key=_multipart_M4VKPN6INFNZ.2~FCNZC4729E13.0 size=911052 2023-12-03T11:42:09.556 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.555+0000 7f8723d84780 1 > prepared multipart upload key=M4VKPN6INFNZ upload=FCNZC4729E13 tag=EYNIU4D760VF type=write size=1959628 2023-12-03T11:42:09.557 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.556+0000 7f8723d84780 1 < canceled operation key=CKABTI1EOAWB tag=T6BZ61QTGRSX type=del size=332464 2023-12-03T11:42:09.559 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.558+0000 7f8723d84780 1 > prepared operation key=O7VVHXLDSY57 tag=V3VJMZF0FTF3 type=write size=923275 2023-12-03T11:42:09.560 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.559+0000 7f8723d84780 1 < completed part key=_multipart_931GNEXBHH35.2~6KN11KB8T1H7.0 size=551682 2023-12-03T11:42:09.562 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.561+0000 7f8723d84780 1 < completed multipart upload key=931GNEXBHH35 upload=6KN11KB8T1H7 tag=C3MCMA76CX7Q type=write size=1600258 2023-12-03T11:42:09.563 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.562+0000 7f8723d84780 1 > prepared operation key=7VMTBKUWU59F tag=GB4TRBPGFRE8 type=del size=2618445 2023-12-03T11:42:09.564 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.563+0000 7f8723d84780 1 < completed delete operation key=5UYL15O31IHM tag=CJDEJTLATMMZ type=del 2023-12-03T11:42:09.565 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.564+0000 7f8723d84780 1 > prepared operation key=LMVO6CVEPN3K tag=DH2B2HIRCFEK type=del size=1297277 2023-12-03T11:42:09.568 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.567+0000 7f8723d84780 1 < suggested update operation key=D3JEVEY0E29E tag=RUI1GVBY8D4W type=del size=3527758 2023-12-03T11:42:09.569 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.568+0000 7f8723d84780 1 > prepared operation key=OPQPIDJ2PBVU tag=4DM2HDQ6OLNL type=del size=1672075 2023-12-03T11:42:09.569 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.568+0000 7f8723d84780 1 < canceled part key=_multipart_DMQX2DGDLU7D.2~9GCBUIUIBU06.0 size=573084 2023-12-03T11:42:09.571 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.570+0000 7f8723d84780 1 < canceled multipart upload key=DMQX2DGDLU7D upload=9GCBUIUIBU06 tag=U40YJJO1GQ4S type=write size=1621660 2023-12-03T11:42:09.573 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.572+0000 7f8723d84780 1 > prepared operation key=5UYL15O31IHM tag=UTGV52Y6TOWH type=del size=3358589 2023-12-03T11:42:09.574 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.573+0000 7f8723d84780 1 < completed delete operation key=TSTIBGVYUZZZ tag=0KPYJZ21K6IG type=del 2023-12-03T11:42:09.575 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.574+0000 7f8723d84780 1 > prepared operation key=CKABTI1EOAWB tag=KJ9EAQLYGOHY type=write size=452638 2023-12-03T11:42:09.577 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.576+0000 7f8723d84780 1 < suggested remove operation key=M4VKPN6INFNZ tag=TITY6V1VTTAZ type=write 2023-12-03T11:42:09.578 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.577+0000 7f8723d84780 1 > prepared operation key=G36T76K8O7A1 tag=3C7FVUEWWJBL type=del size=2853288 2023-12-03T11:42:09.579 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.578+0000 7f8723d84780 1 < canceled part key=_multipart_O7VVHXLDSY57.2~DEGGU4DCF9GJ.0 size=1048576 2023-12-03T11:42:09.579 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.578+0000 7f8723d84780 1 < completed part key=_multipart_O7VVHXLDSY57.2~DEGGU4DCF9GJ.1 size=769193 2023-12-03T11:42:09.581 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.580+0000 7f8723d84780 1 < canceled multipart upload key=O7VVHXLDSY57 upload=DEGGU4DCF9GJ tag=7IP17UZ5OV38 type=write size=2866345 2023-12-03T11:42:09.583 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.582+0000 7f8723d84780 1 > prepared operation key=4I8PWBZOLDUG tag=10M67N4Y5PYP type=del size=1541326 2023-12-03T11:42:09.585 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.584+0000 7f8723d84780 1 < suggested update operation key=7VMTBKUWU59F tag=W0149TQEUAO0 type=del size=3109969 2023-12-03T11:42:09.586 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.585+0000 7f8723d84780 1 > prepared operation key=K83BTR5BOLZE tag=2X6ITDUYOQXH type=del size=1523199 2023-12-03T11:42:09.587 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.586+0000 7f8723d84780 1 < completed part key=_multipart_FCA2R3HR61S2.2~R81TMP10VJGV.0 size=1048576 2023-12-03T11:42:09.588 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.587+0000 7f8723d84780 1 < completed part key=_multipart_FCA2R3HR61S2.2~R81TMP10VJGV.1 size=1048576 2023-12-03T11:42:09.589 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.588+0000 7f8723d84780 1 < completed part key=_multipart_FCA2R3HR61S2.2~R81TMP10VJGV.2 size=453843 2023-12-03T11:42:09.591 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.590+0000 7f8723d84780 1 < completed multipart upload key=FCA2R3HR61S2 upload=R81TMP10VJGV tag=OB8687RH6WOI type=write size=3599571 2023-12-03T11:42:09.593 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.592+0000 7f8723d84780 1 > prepared part key=_multipart_5UYL15O31IHM.2~ZEUEX1YK2RP9.0 size=1048576 2023-12-03T11:42:09.596 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.595+0000 7f8723d84780 1 > prepared part key=_multipart_5UYL15O31IHM.2~ZEUEX1YK2RP9.1 size=1048576 2023-12-03T11:42:09.597 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.596+0000 7f8723d84780 1 > prepared part key=_multipart_5UYL15O31IHM.2~ZEUEX1YK2RP9.2 size=153807 2023-12-03T11:42:09.597 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.596+0000 7f8723d84780 1 > prepared multipart upload key=5UYL15O31IHM upload=ZEUEX1YK2RP9 tag=8E0ARVGDM8MN type=write size=3299535 2023-12-03T11:42:09.599 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.597+0000 7f8723d84780 1 < completed delete operation key=EITMJKL0LCYC tag=EV6RXGEQMKIL type=del 2023-12-03T11:42:09.601 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.600+0000 7f8723d84780 1 > prepared part key=_multipart_4I8PWBZOLDUG.2~D8U3S62LYZBW.0 size=1048576 2023-12-03T11:42:09.602 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.601+0000 7f8723d84780 1 > prepared part key=_multipart_4I8PWBZOLDUG.2~D8U3S62LYZBW.1 size=408083 2023-12-03T11:42:09.602 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.601+0000 7f8723d84780 1 > prepared multipart upload key=4I8PWBZOLDUG upload=D8U3S62LYZBW tag=YSK43RPQP8TB type=write size=2505235 2023-12-03T11:42:09.604 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.603+0000 7f8723d84780 1 < suggested update operation key=HIU6L0NQ8Q95 tag=CQNWKIT13RUV type=write size=783988 2023-12-03T11:42:09.605 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.604+0000 7f8723d84780 1 > prepared operation key=10JRIKOZ16FY tag=DXE0ID4TXVZS type=write size=583743 2023-12-03T11:42:09.607 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.606+0000 7f8723d84780 1 < completed write operation key=Y6S7QI60GCLE tag=H054VSMDF8K6 type=write size=949106 2023-12-03T11:42:09.608 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.607+0000 7f8723d84780 1 > prepared operation key=LCK58DDM5XU9 tag=C8DIPQOH93ZR type=write size=265922 2023-12-03T11:42:09.609 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.608+0000 7f8723d84780 1 < completed delete operation key=AB0SN0E49Z5F tag=69PU147D2NDZ type=del 2023-12-03T11:42:09.610 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.609+0000 7f8723d84780 1 > prepared operation key=7VMTBKUWU59F tag=HCGLMFXZI1RY type=del size=1450246 2023-12-03T11:42:09.611 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.610+0000 7f8723d84780 1 < completed part key=_multipart_UWS266H06VDK.2~ILA2IT7I580U.0 size=1048576 2023-12-03T11:42:09.611 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.610+0000 7f8723d84780 1 < canceled part key=_multipart_UWS266H06VDK.2~ILA2IT7I580U.1 size=329589 2023-12-03T11:42:09.613 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.612+0000 7f8723d84780 1 < canceled multipart upload key=UWS266H06VDK upload=ILA2IT7I580U tag=2LJN12EGD46D type=write size=2426741 2023-12-03T11:42:09.616 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.614+0000 7f8723d84780 1 > prepared part key=_multipart_4I8PWBZOLDUG.2~WLJ6QF0BDRYN.0 size=1048576 2023-12-03T11:42:09.618 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.617+0000 7f8723d84780 1 > prepared part key=_multipart_4I8PWBZOLDUG.2~WLJ6QF0BDRYN.1 size=1048576 2023-12-03T11:42:09.619 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.618+0000 7f8723d84780 1 > prepared part key=_multipart_4I8PWBZOLDUG.2~WLJ6QF0BDRYN.2 size=278800 2023-12-03T11:42:09.619 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.618+0000 7f8723d84780 1 > prepared multipart upload key=4I8PWBZOLDUG upload=WLJ6QF0BDRYN tag=PRLGIH1P50UA type=write size=3424528 2023-12-03T11:42:09.620 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.619+0000 7f8723d84780 1 < completed part key=_multipart_M4VKPN6INFNZ.2~FCNZC4729E13.0 size=911052 2023-12-03T11:42:09.622 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.621+0000 7f8723d84780 1 < completed multipart upload key=M4VKPN6INFNZ upload=FCNZC4729E13 tag=EYNIU4D760VF type=write size=1959628 2023-12-03T11:42:09.624 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.623+0000 7f8723d84780 1 > prepared part key=_multipart_4I8PWBZOLDUG.2~CDR8UK51JC4V.0 size=470022 2023-12-03T11:42:09.624 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.623+0000 7f8723d84780 1 > prepared multipart upload key=4I8PWBZOLDUG upload=CDR8UK51JC4V tag=Q3WDDDCLZJX4 type=write size=1518598 2023-12-03T11:42:09.626 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.625+0000 7f8723d84780 1 < suggested remove operation key=O7VVHXLDSY57 tag=V3VJMZF0FTF3 type=write 2023-12-03T11:42:09.628 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.627+0000 7f8723d84780 1 > prepared operation key=Y6S7QI60GCLE tag=HE2ZTZXXOD63 type=del size=885954 2023-12-03T11:42:09.630 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.629+0000 7f8723d84780 1 < suggested update operation key=7VMTBKUWU59F tag=GB4TRBPGFRE8 type=del size=2618445 2023-12-03T11:42:09.632 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.631+0000 7f8723d84780 1 > prepared part key=_multipart_931GNEXBHH35.2~282YI03XCTXG.0 size=1048576 2023-12-03T11:42:09.633 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.632+0000 7f8723d84780 1 > prepared part key=_multipart_931GNEXBHH35.2~282YI03XCTXG.1 size=629007 2023-12-03T11:42:09.633 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.632+0000 7f8723d84780 1 > prepared multipart upload key=931GNEXBHH35 upload=282YI03XCTXG tag=6QIE3M9GLGXZ type=write size=2726159 2023-12-03T11:42:09.634 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.633+0000 7f8723d84780 1 < completed delete operation key=LMVO6CVEPN3K tag=DH2B2HIRCFEK type=del 2023-12-03T11:42:09.635 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.634+0000 7f8723d84780 1 > prepared operation key=K83BTR5BOLZE tag=PNSZLZ32CT4Q type=del size=1317341 2023-12-03T11:42:09.637 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.636+0000 7f8723d84780 1 < completed delete operation key=OPQPIDJ2PBVU tag=4DM2HDQ6OLNL type=del 2023-12-03T11:42:09.638 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.637+0000 7f8723d84780 1 > prepared operation key=EY9ZG5KOTBWM tag=A88JCIWNX43A type=write size=996414 2023-12-03T11:42:09.640 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.639+0000 7f8723d84780 1 < completed delete operation key=5UYL15O31IHM tag=UTGV52Y6TOWH type=del 2023-12-03T11:42:09.642 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.641+0000 7f8723d84780 1 > prepared part key=_multipart_FCA2R3HR61S2.2~RFBL1UF89WVG.0 size=371793 2023-12-03T11:42:09.643 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.641+0000 7f8723d84780 1 > prepared multipart upload key=FCA2R3HR61S2 upload=RFBL1UF89WVG tag=M2ZTUQMTYMM5 type=write size=1420369 2023-12-03T11:42:09.643 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.642+0000 7f8723d84780 1 < completed write operation key=CKABTI1EOAWB tag=KJ9EAQLYGOHY type=write size=452638 2023-12-03T11:42:09.646 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.644+0000 7f8723d84780 1 > prepared part key=_multipart_EITMJKL0LCYC.2~GJZ15QX5OB5Z.0 size=16137 2023-12-03T11:42:09.646 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.644+0000 7f8723d84780 1 > prepared multipart upload key=EITMJKL0LCYC upload=GJZ15QX5OB5Z tag=H61ZEV1AT0TH type=write size=1064713 2023-12-03T11:42:09.646 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.645+0000 7f8723d84780 1 < canceled operation key=G36T76K8O7A1 tag=3C7FVUEWWJBL type=del size=2853288 2023-12-03T11:42:09.648 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.647+0000 7f8723d84780 1 > prepared operation key=Y6S7QI60GCLE tag=IVYF20HZIV2W type=del size=4096860 2023-12-03T11:42:09.649 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.648+0000 7f8723d84780 1 < completed delete operation key=4I8PWBZOLDUG tag=10M67N4Y5PYP type=del 2023-12-03T11:42:09.650 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.649+0000 7f8723d84780 1 > prepared operation key=DMQX2DGDLU7D tag=9OJCST5C8L7E type=del size=2051269 2023-12-03T11:42:09.651 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.650+0000 7f8723d84780 1 < completed delete operation key=K83BTR5BOLZE tag=2X6ITDUYOQXH type=del 2023-12-03T11:42:09.654 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.652+0000 7f8723d84780 1 > prepared part key=_multipart_OPQPIDJ2PBVU.2~4UWOMBJYQY47.0 size=1048576 2023-12-03T11:42:09.656 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.653+0000 7f8723d84780 1 > prepared part key=_multipart_OPQPIDJ2PBVU.2~4UWOMBJYQY47.1 size=575186 2023-12-03T11:42:09.656 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.653+0000 7f8723d84780 1 > prepared multipart upload key=OPQPIDJ2PBVU upload=4UWOMBJYQY47 tag=SA8Q2KG43S0H type=write size=2672338 2023-12-03T11:42:09.656 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.654+0000 7f8723d84780 1 < completed part key=_multipart_5UYL15O31IHM.2~ZEUEX1YK2RP9.0 size=1048576 2023-12-03T11:42:09.658 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.655+0000 7f8723d84780 1 < completed part key=_multipart_5UYL15O31IHM.2~ZEUEX1YK2RP9.1 size=1048576 2023-12-03T11:42:09.658 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.656+0000 7f8723d84780 1 < completed part key=_multipart_5UYL15O31IHM.2~ZEUEX1YK2RP9.2 size=153807 2023-12-03T11:42:09.659 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.658+0000 7f8723d84780 1 < completed multipart upload key=5UYL15O31IHM upload=ZEUEX1YK2RP9 tag=8E0ARVGDM8MN type=write size=3299535 2023-12-03T11:42:09.661 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.660+0000 7f8723d84780 1 > prepared operation key=LMVO6CVEPN3K tag=FFQ4XOA1GTN0 type=del size=3158893 2023-12-03T11:42:09.662 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.661+0000 7f8723d84780 1 < completed part key=_multipart_4I8PWBZOLDUG.2~D8U3S62LYZBW.0 size=1048576 2023-12-03T11:42:09.664 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.663+0000 7f8723d84780 1 < completed part key=_multipart_4I8PWBZOLDUG.2~D8U3S62LYZBW.1 size=408083 2023-12-03T11:42:09.666 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.665+0000 7f8723d84780 1 < completed multipart upload key=4I8PWBZOLDUG upload=D8U3S62LYZBW tag=YSK43RPQP8TB type=write size=2505235 2023-12-03T11:42:09.668 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.667+0000 7f8723d84780 1 > prepared operation key=12XG7YPYTN4U tag=I0C5CXAH7YL3 type=del size=3328120 2023-12-03T11:42:09.669 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.668+0000 7f8723d84780 1 < canceled operation key=10JRIKOZ16FY tag=DXE0ID4TXVZS type=write size=583743 2023-12-03T11:42:09.671 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.670+0000 7f8723d84780 1 > prepared part key=_multipart_EITMJKL0LCYC.2~1W3RF68MB7TE.0 size=1048576 2023-12-03T11:42:09.674 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.671+0000 7f8723d84780 1 > prepared part key=_multipart_EITMJKL0LCYC.2~1W3RF68MB7TE.1 size=1048576 2023-12-03T11:42:09.674 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.672+0000 7f8723d84780 1 > prepared part key=_multipart_EITMJKL0LCYC.2~1W3RF68MB7TE.2 size=860751 2023-12-03T11:42:09.674 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.672+0000 7f8723d84780 1 > prepared multipart upload key=EITMJKL0LCYC upload=1W3RF68MB7TE tag=ZTVKYO64L2E3 type=write size=4006479 2023-12-03T11:42:09.674 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.673+0000 7f8723d84780 1 < canceled operation key=LCK58DDM5XU9 tag=C8DIPQOH93ZR type=write size=265922 2023-12-03T11:42:09.676 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.675+0000 7f8723d84780 1 > prepared part key=_multipart_CKABTI1EOAWB.2~55P5QZN4OJP3.0 size=1048576 2023-12-03T11:42:09.677 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.676+0000 7f8723d84780 1 > prepared part key=_multipart_CKABTI1EOAWB.2~55P5QZN4OJP3.1 size=130923 2023-12-03T11:42:09.677 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.676+0000 7f8723d84780 1 > prepared multipart upload key=CKABTI1EOAWB upload=55P5QZN4OJP3 tag=1QTYBDA12NFF type=write size=2228075 2023-12-03T11:42:09.678 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.677+0000 7f8723d84780 -1 < failed to complete operation key=7VMTBKUWU59F tag=HCGLMFXZI1RY type=del size=1450246: (22) Invalid argument 2023-12-03T11:42:09.680 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.679+0000 7f8723d84780 1 > prepared operation key=DMQX2DGDLU7D tag=VZW9C1S5OHQS type=del size=3713746 2023-12-03T11:42:09.681 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.680+0000 7f8723d84780 1 < completed part key=_multipart_4I8PWBZOLDUG.2~WLJ6QF0BDRYN.0 size=1048576 2023-12-03T11:42:09.682 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.681+0000 7f8723d84780 1 < completed part key=_multipart_4I8PWBZOLDUG.2~WLJ6QF0BDRYN.1 size=1048576 2023-12-03T11:42:09.683 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.682+0000 7f8723d84780 1 < completed part key=_multipart_4I8PWBZOLDUG.2~WLJ6QF0BDRYN.2 size=278800 2023-12-03T11:42:09.685 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.684+0000 7f8723d84780 1 < completed multipart upload key=4I8PWBZOLDUG upload=WLJ6QF0BDRYN tag=PRLGIH1P50UA type=write size=3424528 2023-12-03T11:42:09.688 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.687+0000 7f8723d84780 1 > prepared part key=_multipart_DMQX2DGDLU7D.2~BH0RYKIPJDV1.0 size=1048576 2023-12-03T11:42:09.689 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.688+0000 7f8723d84780 1 > prepared part key=_multipart_DMQX2DGDLU7D.2~BH0RYKIPJDV1.1 size=233881 2023-12-03T11:42:09.689 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.688+0000 7f8723d84780 1 > prepared multipart upload key=DMQX2DGDLU7D upload=BH0RYKIPJDV1 tag=UDNECFXHSH9S type=write size=2331033 2023-12-03T11:42:09.690 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.689+0000 7f8723d84780 1 < completed part key=_multipart_4I8PWBZOLDUG.2~CDR8UK51JC4V.0 size=470022 2023-12-03T11:42:09.693 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.692+0000 7f8723d84780 1 < completed multipart upload key=4I8PWBZOLDUG upload=CDR8UK51JC4V tag=Q3WDDDCLZJX4 type=write size=1518598 2023-12-03T11:42:09.695 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.694+0000 7f8723d84780 1 > prepared part key=_multipart_Y6S7QI60GCLE.2~OHUDNK4UI2LC.0 size=115710 2023-12-03T11:42:09.695 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.694+0000 7f8723d84780 1 > prepared multipart upload key=Y6S7QI60GCLE upload=OHUDNK4UI2LC tag=5JBIIU0Q6AYA type=write size=1164286 2023-12-03T11:42:09.698 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.697+0000 7f8723d84780 1 < suggested remove operation key=Y6S7QI60GCLE tag=HE2ZTZXXOD63 type=del 2023-12-03T11:42:09.700 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.699+0000 7f8723d84780 1 > prepared part key=_multipart_96RAVVSUKH0Y.2~JQ3P2RWUUNSB.0 size=1048576 2023-12-03T11:42:09.701 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.700+0000 7f8723d84780 1 > prepared part key=_multipart_96RAVVSUKH0Y.2~JQ3P2RWUUNSB.1 size=1048576 2023-12-03T11:42:09.702 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.701+0000 7f8723d84780 1 > prepared part key=_multipart_96RAVVSUKH0Y.2~JQ3P2RWUUNSB.2 size=750131 2023-12-03T11:42:09.702 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.701+0000 7f8723d84780 1 > prepared multipart upload key=96RAVVSUKH0Y upload=JQ3P2RWUUNSB tag=6Z43RME955BF type=write size=3895859 2023-12-03T11:42:09.704 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.702+0000 7f8723d84780 1 < completed part key=_multipart_931GNEXBHH35.2~282YI03XCTXG.0 size=1048576 2023-12-03T11:42:09.705 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.703+0000 7f8723d84780 1 < completed part key=_multipart_931GNEXBHH35.2~282YI03XCTXG.1 size=629007 2023-12-03T11:42:09.706 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.705+0000 7f8723d84780 1 < completed multipart upload key=931GNEXBHH35 upload=282YI03XCTXG tag=6QIE3M9GLGXZ type=write size=2726159 2023-12-03T11:42:09.707 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.706+0000 7f8723d84780 1 > prepared operation key=M4VKPN6INFNZ tag=47NHFQCXSY55 type=del size=956419 2023-12-03T11:42:09.709 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.708+0000 7f8723d84780 1 < completed delete operation key=K83BTR5BOLZE tag=PNSZLZ32CT4Q type=del 2023-12-03T11:42:09.710 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.709+0000 7f8723d84780 1 > prepared operation key=O7VVHXLDSY57 tag=EQ9VOCQCQO0G type=del size=521975 2023-12-03T11:42:09.711 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.710+0000 7f8723d84780 1 < completed write operation key=EY9ZG5KOTBWM tag=A88JCIWNX43A type=write size=996414 2023-12-03T11:42:09.712 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.711+0000 7f8723d84780 1 > prepared operation key=10JRIKOZ16FY tag=ZQY5G5MZYZI4 type=write size=824002 2023-12-03T11:42:09.713 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.712+0000 7f8723d84780 1 < completed part key=_multipart_FCA2R3HR61S2.2~RFBL1UF89WVG.0 size=371793 2023-12-03T11:42:09.715 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.714+0000 7f8723d84780 1 < completed multipart upload key=FCA2R3HR61S2 upload=RFBL1UF89WVG tag=M2ZTUQMTYMM5 type=write size=1420369 2023-12-03T11:42:09.717 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.716+0000 7f8723d84780 1 > prepared part key=_multipart_96RAVVSUKH0Y.2~KPI9JQC95C7U.0 size=407028 2023-12-03T11:42:09.717 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.716+0000 7f8723d84780 1 > prepared multipart upload key=96RAVVSUKH0Y upload=KPI9JQC95C7U tag=WR6XN2RJF8ZX type=write size=1455604 2023-12-03T11:42:09.718 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.717+0000 7f8723d84780 1 < completed part key=_multipart_EITMJKL0LCYC.2~GJZ15QX5OB5Z.0 size=16137 2023-12-03T11:42:09.720 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.719+0000 7f8723d84780 1 < completed multipart upload key=EITMJKL0LCYC upload=GJZ15QX5OB5Z tag=H61ZEV1AT0TH type=write size=1064713 2023-12-03T11:42:09.721 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.720+0000 7f8723d84780 1 > prepared operation key=W2704YS8KYQB tag=8B4GZHTB8R3J type=del size=185048 2023-12-03T11:42:09.722 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.721+0000 7f8723d84780 -1 < failed to complete operation key=Y6S7QI60GCLE tag=IVYF20HZIV2W type=del size=4096860: (22) Invalid argument 2023-12-03T11:42:09.726 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.724+0000 7f8723d84780 1 > prepared part key=_multipart_K83BTR5BOLZE.2~QOEM5MCOJIZH.0 size=996429 2023-12-03T11:42:09.726 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.724+0000 7f8723d84780 1 > prepared multipart upload key=K83BTR5BOLZE upload=QOEM5MCOJIZH tag=FXU8UAU7CG4G type=write size=2045005 2023-12-03T11:42:09.726 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.725+0000 7f8723d84780 1 < completed delete operation key=DMQX2DGDLU7D tag=9OJCST5C8L7E type=del 2023-12-03T11:42:09.730 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.726+0000 7f8723d84780 1 > prepared operation key=LMVO6CVEPN3K tag=MBW19HXAY8FK type=write size=796474 2023-12-03T11:42:09.730 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.728+0000 7f8723d84780 1 < completed part key=_multipart_OPQPIDJ2PBVU.2~4UWOMBJYQY47.0 size=1048576 2023-12-03T11:42:09.730 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.729+0000 7f8723d84780 1 < completed part key=_multipart_OPQPIDJ2PBVU.2~4UWOMBJYQY47.1 size=575186 2023-12-03T11:42:09.732 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.731+0000 7f8723d84780 1 < completed multipart upload key=OPQPIDJ2PBVU upload=4UWOMBJYQY47 tag=SA8Q2KG43S0H type=write size=2672338 2023-12-03T11:42:09.735 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.734+0000 7f8723d84780 1 > prepared part key=_multipart_Y6S7QI60GCLE.2~F3FR6QOK9ZYK.0 size=573530 2023-12-03T11:42:09.735 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.734+0000 7f8723d84780 1 > prepared multipart upload key=Y6S7QI60GCLE upload=F3FR6QOK9ZYK tag=C02ED2RBIGW5 type=write size=1622106 2023-12-03T11:42:09.737 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.736+0000 7f8723d84780 1 < suggested remove operation key=LMVO6CVEPN3K tag=FFQ4XOA1GTN0 type=del 2023-12-03T11:42:09.739 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.738+0000 7f8723d84780 1 > prepared operation key=OGACI7CRPMT7 tag=T9GLCFNUU66T type=del size=560775 2023-12-03T11:42:09.740 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.739+0000 7f8723d84780 1 < completed delete operation key=12XG7YPYTN4U tag=I0C5CXAH7YL3 type=del 2023-12-03T11:42:09.741 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.740+0000 7f8723d84780 1 > prepared operation key=M4VKPN6INFNZ tag=JL7SV79NHL59 type=del size=439645 2023-12-03T11:42:09.743 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.742+0000 7f8723d84780 1 < completed part key=_multipart_EITMJKL0LCYC.2~1W3RF68MB7TE.0 size=1048576 2023-12-03T11:42:09.743 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.742+0000 7f8723d84780 1 < completed part key=_multipart_EITMJKL0LCYC.2~1W3RF68MB7TE.1 size=1048576 2023-12-03T11:42:09.744 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.743+0000 7f8723d84780 1 < completed part key=_multipart_EITMJKL0LCYC.2~1W3RF68MB7TE.2 size=860751 2023-12-03T11:42:09.747 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.746+0000 7f8723d84780 1 < completed multipart upload key=EITMJKL0LCYC upload=1W3RF68MB7TE tag=ZTVKYO64L2E3 type=write size=4006479 2023-12-03T11:42:09.748 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.747+0000 7f8723d84780 1 > prepared operation key=OGACI7CRPMT7 tag=RH59X03UJT8H type=del size=3635326 2023-12-03T11:42:09.749 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.748+0000 7f8723d84780 1 < completed part key=_multipart_CKABTI1EOAWB.2~55P5QZN4OJP3.0 size=1048576 2023-12-03T11:42:09.750 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.749+0000 7f8723d84780 1 < completed part key=_multipart_CKABTI1EOAWB.2~55P5QZN4OJP3.1 size=130923 2023-12-03T11:42:09.752 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.751+0000 7f8723d84780 1 < completed multipart upload key=CKABTI1EOAWB upload=55P5QZN4OJP3 tag=1QTYBDA12NFF type=write size=2228075 2023-12-03T11:42:09.753 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.752+0000 7f8723d84780 1 > prepared operation key=DMQX2DGDLU7D tag=S6U5O332H7WU type=del size=2571050 2023-12-03T11:42:09.754 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.753+0000 7f8723d84780 1 < completed delete operation key=DMQX2DGDLU7D tag=VZW9C1S5OHQS type=del 2023-12-03T11:42:09.757 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.755+0000 7f8723d84780 1 > prepared part key=_multipart_10JRIKOZ16FY.2~3XRXFUOHJS2C.0 size=1048576 2023-12-03T11:42:09.757 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.756+0000 7f8723d84780 1 > prepared part key=_multipart_10JRIKOZ16FY.2~3XRXFUOHJS2C.1 size=390890 2023-12-03T11:42:09.757 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.756+0000 7f8723d84780 1 > prepared multipart upload key=10JRIKOZ16FY upload=3XRXFUOHJS2C tag=E1NSUG9R4PU3 type=write size=2488042 2023-12-03T11:42:09.758 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.757+0000 7f8723d84780 1 < completed part key=_multipart_DMQX2DGDLU7D.2~BH0RYKIPJDV1.0 size=1048576 2023-12-03T11:42:09.759 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.758+0000 7f8723d84780 1 < completed part key=_multipart_DMQX2DGDLU7D.2~BH0RYKIPJDV1.1 size=233881 2023-12-03T11:42:09.761 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.760+0000 7f8723d84780 1 < completed multipart upload key=DMQX2DGDLU7D upload=BH0RYKIPJDV1 tag=UDNECFXHSH9S type=write size=2331033 2023-12-03T11:42:09.763 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.762+0000 7f8723d84780 1 > prepared part key=_multipart_TSTIBGVYUZZZ.2~SQIH3YOOIFQA.0 size=1048576 2023-12-03T11:42:09.764 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.763+0000 7f8723d84780 1 > prepared part key=_multipart_TSTIBGVYUZZZ.2~SQIH3YOOIFQA.1 size=1048576 2023-12-03T11:42:09.765 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.764+0000 7f8723d84780 1 > prepared part key=_multipart_TSTIBGVYUZZZ.2~SQIH3YOOIFQA.2 size=582067 2023-12-03T11:42:09.765 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.764+0000 7f8723d84780 1 > prepared multipart upload key=TSTIBGVYUZZZ upload=SQIH3YOOIFQA tag=1FL3RYKGO8N4 type=write size=3727795 2023-12-03T11:42:09.766 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.765+0000 7f8723d84780 1 < completed part key=_multipart_Y6S7QI60GCLE.2~OHUDNK4UI2LC.0 size=115710 2023-12-03T11:42:09.768 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.767+0000 7f8723d84780 1 < completed multipart upload key=Y6S7QI60GCLE upload=OHUDNK4UI2LC tag=5JBIIU0Q6AYA type=write size=1164286 2023-12-03T11:42:09.769 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.768+0000 7f8723d84780 1 > prepared operation key=M4VKPN6INFNZ tag=FEIE631D07UZ type=del size=579083 2023-12-03T11:42:09.770 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.769+0000 7f8723d84780 1 < completed part key=_multipart_96RAVVSUKH0Y.2~JQ3P2RWUUNSB.0 size=1048576 2023-12-03T11:42:09.771 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.770+0000 7f8723d84780 1 < completed part key=_multipart_96RAVVSUKH0Y.2~JQ3P2RWUUNSB.1 size=1048576 2023-12-03T11:42:09.772 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.771+0000 7f8723d84780 1 < completed part key=_multipart_96RAVVSUKH0Y.2~JQ3P2RWUUNSB.2 size=750131 2023-12-03T11:42:09.774 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.773+0000 7f8723d84780 1 < completed multipart upload key=96RAVVSUKH0Y upload=JQ3P2RWUUNSB tag=6Z43RME955BF type=write size=3895859 2023-12-03T11:42:09.777 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.776+0000 7f8723d84780 1 > prepared part key=_multipart_12XG7YPYTN4U.2~2GDLVMF60MVH.0 size=552930 2023-12-03T11:42:09.777 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.776+0000 7f8723d84780 1 > prepared multipart upload key=12XG7YPYTN4U upload=2GDLVMF60MVH tag=GNMYC357VLE2 type=write size=1601506 2023-12-03T11:42:09.778 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.777+0000 7f8723d84780 1 < completed delete operation key=M4VKPN6INFNZ tag=47NHFQCXSY55 type=del 2023-12-03T11:42:09.779 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.778+0000 7f8723d84780 1 > prepared operation key=5UYL15O31IHM tag=OUCK0FPIGEJD type=write size=891874 2023-12-03T11:42:09.780 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.779+0000 7f8723d84780 1 < completed delete operation key=O7VVHXLDSY57 tag=EQ9VOCQCQO0G type=del 2023-12-03T11:42:09.782 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.781+0000 7f8723d84780 1 > prepared operation key=931GNEXBHH35 tag=NPMM61IRAGYB type=del size=1095533 2023-12-03T11:42:09.783 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.782+0000 7f8723d84780 1 < completed write operation key=10JRIKOZ16FY tag=ZQY5G5MZYZI4 type=write size=824002 2023-12-03T11:42:09.784 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.783+0000 7f8723d84780 1 > prepared operation key=G36T76K8O7A1 tag=B7LCV0LG44RD type=write size=824703 2023-12-03T11:42:09.785 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.784+0000 7f8723d84780 1 < completed part key=_multipart_96RAVVSUKH0Y.2~KPI9JQC95C7U.0 size=407028 2023-12-03T11:42:09.787 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.786+0000 7f8723d84780 1 < completed multipart upload key=96RAVVSUKH0Y upload=KPI9JQC95C7U tag=WR6XN2RJF8ZX type=write size=1455604 2023-12-03T11:42:09.789 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.788+0000 7f8723d84780 1 > prepared part key=_multipart_FCA2R3HR61S2.2~E6A0BEEYDCUR.0 size=1048576 2023-12-03T11:42:09.790 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.789+0000 7f8723d84780 1 > prepared part key=_multipart_FCA2R3HR61S2.2~E6A0BEEYDCUR.1 size=413409 2023-12-03T11:42:09.790 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.789+0000 7f8723d84780 1 > prepared multipart upload key=FCA2R3HR61S2 upload=E6A0BEEYDCUR tag=DSETPYWX78EU type=write size=2510561 2023-12-03T11:42:09.791 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.790+0000 7f8723d84780 1 < completed delete operation key=W2704YS8KYQB tag=8B4GZHTB8R3J type=del 2023-12-03T11:42:09.793 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.792+0000 7f8723d84780 1 > prepared part key=_multipart_G36T76K8O7A1.2~J54JZAJDJQLE.0 size=1048576 2023-12-03T11:42:09.794 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.793+0000 7f8723d84780 1 > prepared part key=_multipart_G36T76K8O7A1.2~J54JZAJDJQLE.1 size=1048576 2023-12-03T11:42:09.795 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.794+0000 7f8723d84780 1 > prepared part key=_multipart_G36T76K8O7A1.2~J54JZAJDJQLE.2 size=44181 2023-12-03T11:42:09.795 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.794+0000 7f8723d84780 1 > prepared multipart upload key=G36T76K8O7A1 upload=J54JZAJDJQLE tag=HCRWI96HYD97 type=write size=3189909 2023-12-03T11:42:09.796 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.795+0000 7f8723d84780 1 < completed part key=_multipart_K83BTR5BOLZE.2~QOEM5MCOJIZH.0 size=996429 2023-12-03T11:42:09.798 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.797+0000 7f8723d84780 1 < completed multipart upload key=K83BTR5BOLZE upload=QOEM5MCOJIZH tag=FXU8UAU7CG4G type=write size=2045005 2023-12-03T11:42:09.800 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.799+0000 7f8723d84780 1 > prepared part key=_multipart_O7VVHXLDSY57.2~GX5JZ2WY7C0M.0 size=1048576 2023-12-03T11:42:09.801 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.800+0000 7f8723d84780 1 > prepared part key=_multipart_O7VVHXLDSY57.2~GX5JZ2WY7C0M.1 size=1048576 2023-12-03T11:42:09.802 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.801+0000 7f8723d84780 1 > prepared part key=_multipart_O7VVHXLDSY57.2~GX5JZ2WY7C0M.2 size=135643 2023-12-03T11:42:09.802 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.801+0000 7f8723d84780 1 > prepared multipart upload key=O7VVHXLDSY57 upload=GX5JZ2WY7C0M tag=GL6CNDBYS9WM type=write size=3281371 2023-12-03T11:42:09.802 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.801+0000 7f8723d84780 -1 < no bi entry to suggest for operation key=LMVO6CVEPN3K tag=MBW19HXAY8FK type=write size=796474: (2) No such file or directory 2023-12-03T11:42:09.803 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.802+0000 7f8723d84780 1 > prepared operation key=UWS266H06VDK tag=OC0HNS96ZIHN type=write size=904127 2023-12-03T11:42:09.804 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.803+0000 7f8723d84780 1 < completed part key=_multipart_Y6S7QI60GCLE.2~F3FR6QOK9ZYK.0 size=573530 2023-12-03T11:42:09.806 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.805+0000 7f8723d84780 1 < completed multipart upload key=Y6S7QI60GCLE upload=F3FR6QOK9ZYK tag=C02ED2RBIGW5 type=write size=1622106 2023-12-03T11:42:09.808 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.807+0000 7f8723d84780 1 > prepared part key=_multipart_8NONX2I08YMJ.2~MFM53ZCEA8HE.0 size=1048576 2023-12-03T11:42:09.809 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.808+0000 7f8723d84780 1 > prepared part key=_multipart_8NONX2I08YMJ.2~MFM53ZCEA8HE.1 size=1048576 2023-12-03T11:42:09.810 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.809+0000 7f8723d84780 1 > prepared part key=_multipart_8NONX2I08YMJ.2~MFM53ZCEA8HE.2 size=305492 2023-12-03T11:42:09.810 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.809+0000 7f8723d84780 1 > prepared multipart upload key=8NONX2I08YMJ upload=MFM53ZCEA8HE tag=7R0311K01EDY type=write size=3451220 2023-12-03T11:42:09.811 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.810+0000 7f8723d84780 1 < completed delete operation key=OGACI7CRPMT7 tag=T9GLCFNUU66T type=del 2023-12-03T11:42:09.812 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.811+0000 7f8723d84780 1 > prepared operation key=K83BTR5BOLZE tag=ID0TBQLVTPW7 type=del size=4147261 2023-12-03T11:42:09.813 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.812+0000 7f8723d84780 1 < canceled operation key=M4VKPN6INFNZ tag=JL7SV79NHL59 type=del size=439645 2023-12-03T11:42:09.815 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.813+0000 7f8723d84780 1 > prepared operation key=10JRIKOZ16FY tag=W9GBR6YVP3L0 type=del size=3335072 2023-12-03T11:42:09.816 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.815+0000 7f8723d84780 1 < completed delete operation key=OGACI7CRPMT7 tag=RH59X03UJT8H type=del 2023-12-03T11:42:09.818 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.817+0000 7f8723d84780 1 > prepared part key=_multipart_FCA2R3HR61S2.2~VL3O2G3IAEA4.0 size=677068 2023-12-03T11:42:09.818 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.817+0000 7f8723d84780 1 > prepared multipart upload key=FCA2R3HR61S2 upload=VL3O2G3IAEA4 tag=DETZC5PC4KEU type=write size=1725644 2023-12-03T11:42:09.819 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.818+0000 7f8723d84780 1 < completed delete operation key=DMQX2DGDLU7D tag=S6U5O332H7WU type=del 2023-12-03T11:42:09.821 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.820+0000 7f8723d84780 1 > prepared part key=_multipart_96RAVVSUKH0Y.2~6KGKC3I3DZI2.0 size=869036 2023-12-03T11:42:09.821 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.820+0000 7f8723d84780 1 > prepared multipart upload key=96RAVVSUKH0Y upload=6KGKC3I3DZI2 tag=JGAICV9Z7Y5E type=write size=1917612 2023-12-03T11:42:09.822 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.820+0000 7f8723d84780 1 < canceled part key=_multipart_10JRIKOZ16FY.2~3XRXFUOHJS2C.0 size=1048576 2023-12-03T11:42:09.822 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.821+0000 7f8723d84780 1 < completed part key=_multipart_10JRIKOZ16FY.2~3XRXFUOHJS2C.1 size=390890 2023-12-03T11:42:09.825 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.824+0000 7f8723d84780 1 < canceled multipart upload key=10JRIKOZ16FY upload=3XRXFUOHJS2C tag=E1NSUG9R4PU3 type=write size=2488042 2023-12-03T11:42:09.826 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.825+0000 7f8723d84780 1 > prepared operation key=OPQPIDJ2PBVU tag=FSJVZEUABB3A type=write size=926243 2023-12-03T11:42:09.827 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.826+0000 7f8723d84780 1 < completed part key=_multipart_TSTIBGVYUZZZ.2~SQIH3YOOIFQA.0 size=1048576 2023-12-03T11:42:09.828 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.827+0000 7f8723d84780 1 < completed part key=_multipart_TSTIBGVYUZZZ.2~SQIH3YOOIFQA.1 size=1048576 2023-12-03T11:42:09.829 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.827+0000 7f8723d84780 1 < canceled part key=_multipart_TSTIBGVYUZZZ.2~SQIH3YOOIFQA.2 size=582067 2023-12-03T11:42:09.831 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.830+0000 7f8723d84780 1 < canceled multipart upload key=TSTIBGVYUZZZ upload=SQIH3YOOIFQA tag=1FL3RYKGO8N4 type=write size=3727795 2023-12-03T11:42:09.833 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.832+0000 7f8723d84780 1 > prepared part key=_multipart_Y6S7QI60GCLE.2~7O40CZCOXYAH.0 size=1048576 2023-12-03T11:42:09.834 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.833+0000 7f8723d84780 1 > prepared part key=_multipart_Y6S7QI60GCLE.2~7O40CZCOXYAH.1 size=1048576 2023-12-03T11:42:09.835 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.834+0000 7f8723d84780 1 > prepared part key=_multipart_Y6S7QI60GCLE.2~7O40CZCOXYAH.2 size=631427 2023-12-03T11:42:09.835 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.834+0000 7f8723d84780 1 > prepared multipart upload key=Y6S7QI60GCLE upload=7O40CZCOXYAH tag=I2EO5Z7FFVZ6 type=write size=3777155 2023-12-03T11:42:09.836 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.835+0000 7f8723d84780 1 < completed delete operation key=M4VKPN6INFNZ tag=FEIE631D07UZ type=del 2023-12-03T11:42:09.837 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.836+0000 7f8723d84780 1 > prepared operation key=LMVO6CVEPN3K tag=23B7GBRB3PTJ type=del size=3011608 2023-12-03T11:42:09.838 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.837+0000 7f8723d84780 1 < completed part key=_multipart_12XG7YPYTN4U.2~2GDLVMF60MVH.0 size=552930 2023-12-03T11:42:09.840 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.839+0000 7f8723d84780 1 < completed multipart upload key=12XG7YPYTN4U upload=2GDLVMF60MVH tag=GNMYC357VLE2 type=write size=1601506 2023-12-03T11:42:09.842 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.841+0000 7f8723d84780 1 > prepared operation key=EITMJKL0LCYC tag=3IT6HIQ4KAXO type=del size=1613657 2023-12-03T11:42:09.843 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.842+0000 7f8723d84780 1 < completed write operation key=5UYL15O31IHM tag=OUCK0FPIGEJD type=write size=891874 2023-12-03T11:42:09.844 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.843+0000 7f8723d84780 1 > prepared operation key=AB0SN0E49Z5F tag=WA0FDNLAG0T2 type=del size=3328258 2023-12-03T11:42:09.846 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.844+0000 7f8723d84780 1 < completed delete operation key=931GNEXBHH35 tag=NPMM61IRAGYB type=del 2023-12-03T11:42:09.848 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.846+0000 7f8723d84780 1 > prepared part key=_multipart_KS5J7E7KE2IJ.2~HXYN6H0W1OZM.0 size=1048576 2023-12-03T11:42:09.848 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.847+0000 7f8723d84780 1 > prepared part key=_multipart_KS5J7E7KE2IJ.2~HXYN6H0W1OZM.1 size=1048576 2023-12-03T11:42:09.849 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.848+0000 7f8723d84780 1 > prepared part key=_multipart_KS5J7E7KE2IJ.2~HXYN6H0W1OZM.2 size=765598 2023-12-03T11:42:09.850 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.848+0000 7f8723d84780 1 > prepared multipart upload key=KS5J7E7KE2IJ upload=HXYN6H0W1OZM tag=YU21VX0AZML4 type=write size=3911326 2023-12-03T11:42:09.851 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.850+0000 7f8723d84780 1 < completed write operation key=G36T76K8O7A1 tag=B7LCV0LG44RD type=write size=824703 2023-12-03T11:42:09.852 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.851+0000 7f8723d84780 1 > prepared operation key=HIU6L0NQ8Q95 tag=B861OHLGOJMU type=write size=790094 2023-12-03T11:42:09.853 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.852+0000 7f8723d84780 1 < completed part key=_multipart_FCA2R3HR61S2.2~E6A0BEEYDCUR.0 size=1048576 2023-12-03T11:42:09.854 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.853+0000 7f8723d84780 1 < completed part key=_multipart_FCA2R3HR61S2.2~E6A0BEEYDCUR.1 size=413409 2023-12-03T11:42:09.856 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.855+0000 7f8723d84780 1 < completed multipart upload key=FCA2R3HR61S2 upload=E6A0BEEYDCUR tag=DSETPYWX78EU type=write size=2510561 2023-12-03T11:42:09.858 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.857+0000 7f8723d84780 1 > prepared part key=_multipart_5UYL15O31IHM.2~GYYEVNOUNRZE.0 size=1048576 2023-12-03T11:42:09.859 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.858+0000 7f8723d84780 1 > prepared part key=_multipart_5UYL15O31IHM.2~GYYEVNOUNRZE.1 size=882018 2023-12-03T11:42:09.859 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.858+0000 7f8723d84780 1 > prepared multipart upload key=5UYL15O31IHM upload=GYYEVNOUNRZE tag=K62X0WUMQXZ3 type=write size=2979170 2023-12-03T11:42:09.861 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.859+0000 7f8723d84780 1 < completed part key=_multipart_G36T76K8O7A1.2~J54JZAJDJQLE.0 size=1048576 2023-12-03T11:42:09.862 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.861+0000 7f8723d84780 1 < completed part key=_multipart_G36T76K8O7A1.2~J54JZAJDJQLE.1 size=1048576 2023-12-03T11:42:09.863 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.862+0000 7f8723d84780 1 < completed part key=_multipart_G36T76K8O7A1.2~J54JZAJDJQLE.2 size=44181 2023-12-03T11:42:09.865 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.864+0000 7f8723d84780 1 < completed multipart upload key=G36T76K8O7A1 upload=J54JZAJDJQLE tag=HCRWI96HYD97 type=write size=3189909 2023-12-03T11:42:09.866 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.865+0000 7f8723d84780 1 > prepared operation key=G36T76K8O7A1 tag=EV9OJNB21T2F type=del size=415327 2023-12-03T11:42:09.867 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.865+0000 7f8723d84780 1 < canceled part key=_multipart_O7VVHXLDSY57.2~GX5JZ2WY7C0M.0 size=1048576 2023-12-03T11:42:09.867 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.866+0000 7f8723d84780 1 < completed part key=_multipart_O7VVHXLDSY57.2~GX5JZ2WY7C0M.1 size=1048576 2023-12-03T11:42:09.868 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.867+0000 7f8723d84780 1 < completed part key=_multipart_O7VVHXLDSY57.2~GX5JZ2WY7C0M.2 size=135643 2023-12-03T11:42:09.871 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.869+0000 7f8723d84780 1 < canceled multipart upload key=O7VVHXLDSY57 upload=GX5JZ2WY7C0M tag=GL6CNDBYS9WM type=write size=3281371 2023-12-03T11:42:09.872 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.871+0000 7f8723d84780 1 > prepared operation key=VENJI0KD1XDW tag=UO3UH8CQH5J5 type=del size=1517136 2023-12-03T11:42:09.873 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.872+0000 7f8723d84780 1 < completed write operation key=UWS266H06VDK tag=OC0HNS96ZIHN type=write size=904127 2023-12-03T11:42:09.874 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.873+0000 7f8723d84780 1 > prepared operation key=O7VVHXLDSY57 tag=BVKR3XLKNEWO type=write size=213755 2023-12-03T11:42:09.875 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.874+0000 7f8723d84780 1 < completed part key=_multipart_8NONX2I08YMJ.2~MFM53ZCEA8HE.0 size=1048576 2023-12-03T11:42:09.876 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.875+0000 7f8723d84780 1 < completed part key=_multipart_8NONX2I08YMJ.2~MFM53ZCEA8HE.1 size=1048576 2023-12-03T11:42:09.877 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.876+0000 7f8723d84780 1 < completed part key=_multipart_8NONX2I08YMJ.2~MFM53ZCEA8HE.2 size=305492 2023-12-03T11:42:09.879 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.878+0000 7f8723d84780 1 < completed multipart upload key=8NONX2I08YMJ upload=MFM53ZCEA8HE tag=7R0311K01EDY type=write size=3451220 2023-12-03T11:42:09.881 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.880+0000 7f8723d84780 1 > prepared operation key=7VMTBKUWU59F tag=G7DPOHXYKCXN type=del size=3587837 2023-12-03T11:42:09.882 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.881+0000 7f8723d84780 1 < completed delete operation key=K83BTR5BOLZE tag=ID0TBQLVTPW7 type=del 2023-12-03T11:42:09.884 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.883+0000 7f8723d84780 1 > prepared part key=_multipart_W2704YS8KYQB.2~6L8FWZO4QCMN.0 size=1048576 2023-12-03T11:42:09.886 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.885+0000 7f8723d84780 1 > prepared part key=_multipart_W2704YS8KYQB.2~6L8FWZO4QCMN.1 size=1048576 2023-12-03T11:42:09.887 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.886+0000 7f8723d84780 1 > prepared part key=_multipart_W2704YS8KYQB.2~6L8FWZO4QCMN.2 size=304050 2023-12-03T11:42:09.887 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.886+0000 7f8723d84780 1 > prepared multipart upload key=W2704YS8KYQB upload=6L8FWZO4QCMN tag=G4H9LF98LM0F type=write size=3449778 2023-12-03T11:42:09.889 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.888+0000 7f8723d84780 1 < completed delete operation key=10JRIKOZ16FY tag=W9GBR6YVP3L0 type=del 2023-12-03T11:42:09.890 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.889+0000 7f8723d84780 1 > prepared operation key=K83BTR5BOLZE tag=URWP6ORZKV6J type=write size=404545 2023-12-03T11:42:09.891 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.890+0000 7f8723d84780 1 < completed part key=_multipart_FCA2R3HR61S2.2~VL3O2G3IAEA4.0 size=677068 2023-12-03T11:42:09.893 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.892+0000 7f8723d84780 1 < completed multipart upload key=FCA2R3HR61S2 upload=VL3O2G3IAEA4 tag=DETZC5PC4KEU type=write size=1725644 2023-12-03T11:42:09.895 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.894+0000 7f8723d84780 1 > prepared part key=_multipart_CKABTI1EOAWB.2~FU3CKMDCXDOM.0 size=190483 2023-12-03T11:42:09.895 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.894+0000 7f8723d84780 1 > prepared multipart upload key=CKABTI1EOAWB upload=FU3CKMDCXDOM tag=VVKIPD57H0P1 type=write size=1239059 2023-12-03T11:42:09.896 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.895+0000 7f8723d84780 1 < completed part key=_multipart_96RAVVSUKH0Y.2~6KGKC3I3DZI2.0 size=869036 2023-12-03T11:42:09.898 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.897+0000 7f8723d84780 1 < completed multipart upload key=96RAVVSUKH0Y upload=6KGKC3I3DZI2 tag=JGAICV9Z7Y5E type=write size=1917612 2023-12-03T11:42:09.899 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.898+0000 7f8723d84780 1 > prepared operation key=AB0SN0E49Z5F tag=K4HP60LQ7LYZ type=del size=246509 2023-12-03T11:42:09.900 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.899+0000 7f8723d84780 1 < completed write operation key=OPQPIDJ2PBVU tag=FSJVZEUABB3A type=write size=926243 2023-12-03T11:42:09.901 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.900+0000 7f8723d84780 1 > prepared operation key=LCK58DDM5XU9 tag=3G61W975ILN0 type=del size=3566539 2023-12-03T11:42:09.902 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.901+0000 7f8723d84780 1 < completed part key=_multipart_Y6S7QI60GCLE.2~7O40CZCOXYAH.0 size=1048576 2023-12-03T11:42:09.904 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.902+0000 7f8723d84780 1 < completed part key=_multipart_Y6S7QI60GCLE.2~7O40CZCOXYAH.1 size=1048576 2023-12-03T11:42:09.904 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.903+0000 7f8723d84780 1 < completed part key=_multipart_Y6S7QI60GCLE.2~7O40CZCOXYAH.2 size=631427 2023-12-03T11:42:09.906 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.905+0000 7f8723d84780 1 < completed multipart upload key=Y6S7QI60GCLE upload=7O40CZCOXYAH tag=I2EO5Z7FFVZ6 type=write size=3777155 2023-12-03T11:42:09.908 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.907+0000 7f8723d84780 1 > prepared operation key=5UYL15O31IHM tag=039U4EDSAC9N type=del size=3582806 2023-12-03T11:42:09.909 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.908+0000 7f8723d84780 1 < completed delete operation key=LMVO6CVEPN3K tag=23B7GBRB3PTJ type=del 2023-12-03T11:42:09.910 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.909+0000 7f8723d84780 1 > prepared operation key=W2704YS8KYQB tag=63C7TZ0YHOZV type=write size=832625 2023-12-03T11:42:09.911 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.910+0000 7f8723d84780 1 < completed delete operation key=EITMJKL0LCYC tag=3IT6HIQ4KAXO type=del 2023-12-03T11:42:09.912 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.911+0000 7f8723d84780 1 > prepared operation key=LMVO6CVEPN3K tag=69URB9JYYT1B type=del size=2784954 2023-12-03T11:42:09.913 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.912+0000 7f8723d84780 1 < completed delete operation key=AB0SN0E49Z5F tag=WA0FDNLAG0T2 type=del 2023-12-03T11:42:09.915 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.914+0000 7f8723d84780 1 > prepared operation key=CKABTI1EOAWB tag=M1PR1LBL4EZ1 type=del size=4164776 2023-12-03T11:42:09.915 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.914+0000 7f8723d84780 1 < canceled part key=_multipart_KS5J7E7KE2IJ.2~HXYN6H0W1OZM.0 size=1048576 2023-12-03T11:42:09.915 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.914+0000 7f8723d84780 1 < canceled part key=_multipart_KS5J7E7KE2IJ.2~HXYN6H0W1OZM.1 size=1048576 2023-12-03T11:42:09.916 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.915+0000 7f8723d84780 1 < completed part key=_multipart_KS5J7E7KE2IJ.2~HXYN6H0W1OZM.2 size=765598 2023-12-03T11:42:09.918 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.917+0000 7f8723d84780 1 < canceled multipart upload key=KS5J7E7KE2IJ upload=HXYN6H0W1OZM tag=YU21VX0AZML4 type=write size=3911326 2023-12-03T11:42:09.919 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.918+0000 7f8723d84780 1 > prepared operation key=KS5J7E7KE2IJ tag=1E8PNGM1C096 type=del size=3251004 2023-12-03T11:42:09.920 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.919+0000 7f8723d84780 1 < completed write operation key=HIU6L0NQ8Q95 tag=B861OHLGOJMU type=write size=790094 2023-12-03T11:42:09.921 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.920+0000 7f8723d84780 1 > prepared operation key=96RAVVSUKH0Y tag=5KUX66BTD31S type=write size=712055 2023-12-03T11:42:09.922 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.921+0000 7f8723d84780 1 < completed part key=_multipart_5UYL15O31IHM.2~GYYEVNOUNRZE.0 size=1048576 2023-12-03T11:42:09.923 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.922+0000 7f8723d84780 1 < completed part key=_multipart_5UYL15O31IHM.2~GYYEVNOUNRZE.1 size=882018 2023-12-03T11:42:09.925 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.924+0000 7f8723d84780 1 < completed multipart upload key=5UYL15O31IHM upload=GYYEVNOUNRZE tag=K62X0WUMQXZ3 type=write size=2979170 2023-12-03T11:42:09.926 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.925+0000 7f8723d84780 1 > prepared operation key=96RAVVSUKH0Y tag=RFLF8KKMWW0W type=del size=3283901 2023-12-03T11:42:09.929 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.928+0000 7f8723d84780 1 < suggested remove operation key=G36T76K8O7A1 tag=EV9OJNB21T2F type=del 2023-12-03T11:42:09.931 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.930+0000 7f8723d84780 1 > prepared part key=_multipart_M4VKPN6INFNZ.2~A1AFYMM93HSJ.0 size=158517 2023-12-03T11:42:09.931 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.930+0000 7f8723d84780 1 > prepared multipart upload key=M4VKPN6INFNZ upload=A1AFYMM93HSJ tag=9JOWHBZ3XJI6 type=write size=1207093 2023-12-03T11:42:09.932 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.931+0000 7f8723d84780 1 < completed delete operation key=VENJI0KD1XDW tag=UO3UH8CQH5J5 type=del 2023-12-03T11:42:09.934 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.933+0000 7f8723d84780 1 > prepared part key=_multipart_7VMTBKUWU59F.2~TU3T04Z3BXOL.0 size=1048576 2023-12-03T11:42:09.935 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.934+0000 7f8723d84780 1 > prepared part key=_multipart_7VMTBKUWU59F.2~TU3T04Z3BXOL.1 size=320374 2023-12-03T11:42:09.935 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.934+0000 7f8723d84780 1 > prepared multipart upload key=7VMTBKUWU59F upload=TU3T04Z3BXOL tag=IM92JF2GTJUM type=write size=2417526 2023-12-03T11:42:09.936 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.935+0000 7f8723d84780 1 < completed write operation key=O7VVHXLDSY57 tag=BVKR3XLKNEWO type=write size=213755 2023-12-03T11:42:09.938 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.937+0000 7f8723d84780 1 > prepared part key=_multipart_HIU6L0NQ8Q95.2~Z3T2VNRM3LYS.0 size=1017957 2023-12-03T11:42:09.938 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.937+0000 7f8723d84780 1 > prepared multipart upload key=HIU6L0NQ8Q95 upload=Z3T2VNRM3LYS tag=U3MJT68FAX03 type=write size=2066533 2023-12-03T11:42:09.940 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.939+0000 7f8723d84780 1 < completed delete operation key=7VMTBKUWU59F tag=G7DPOHXYKCXN type=del 2023-12-03T11:42:09.941 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.940+0000 7f8723d84780 1 > prepared operation key=D3JEVEY0E29E tag=MIX1BH1BZ4W7 type=del size=1725525 2023-12-03T11:42:09.943 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.942+0000 7f8723d84780 1 < completed part key=_multipart_W2704YS8KYQB.2~6L8FWZO4QCMN.0 size=1048576 2023-12-03T11:42:09.944 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.943+0000 7f8723d84780 1 < completed part key=_multipart_W2704YS8KYQB.2~6L8FWZO4QCMN.1 size=1048576 2023-12-03T11:42:09.945 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.944+0000 7f8723d84780 1 < completed part key=_multipart_W2704YS8KYQB.2~6L8FWZO4QCMN.2 size=304050 2023-12-03T11:42:09.947 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.946+0000 7f8723d84780 1 < completed multipart upload key=W2704YS8KYQB upload=6L8FWZO4QCMN tag=G4H9LF98LM0F type=write size=3449778 2023-12-03T11:42:09.948 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.947+0000 7f8723d84780 1 > prepared operation key=CKABTI1EOAWB tag=H9D6AX55NWR3 type=del size=1924749 2023-12-03T11:42:09.949 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.948+0000 7f8723d84780 1 < completed write operation key=K83BTR5BOLZE tag=URWP6ORZKV6J type=write size=404545 2023-12-03T11:42:09.950 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.949+0000 7f8723d84780 1 > prepared operation key=OPQPIDJ2PBVU tag=466R5J4RTS9Y type=del size=1520755 2023-12-03T11:42:09.952 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.951+0000 7f8723d84780 1 < completed part key=_multipart_CKABTI1EOAWB.2~FU3CKMDCXDOM.0 size=190483 2023-12-03T11:42:09.953 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.952+0000 7f8723d84780 1 < completed multipart upload key=CKABTI1EOAWB upload=FU3CKMDCXDOM tag=VVKIPD57H0P1 type=write size=1239059 2023-12-03T11:42:09.956 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.955+0000 7f8723d84780 1 > prepared part key=_multipart_M4VKPN6INFNZ.2~IJSSNPMXCY48.0 size=1048576 2023-12-03T11:42:09.956 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.956+0000 7f8723d84780 1 > prepared part key=_multipart_M4VKPN6INFNZ.2~IJSSNPMXCY48.1 size=1048576 2023-12-03T11:42:09.957 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.957+0000 7f8723d84780 1 > prepared part key=_multipart_M4VKPN6INFNZ.2~IJSSNPMXCY48.2 size=500711 2023-12-03T11:42:09.958 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.957+0000 7f8723d84780 1 > prepared multipart upload key=M4VKPN6INFNZ upload=IJSSNPMXCY48 tag=H310IK9FOB0G type=write size=3646439 2023-12-03T11:42:09.960 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.959+0000 7f8723d84780 1 < suggested update operation key=AB0SN0E49Z5F tag=K4HP60LQ7LYZ type=del size=246509 2023-12-03T11:42:09.962 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.961+0000 7f8723d84780 1 > prepared part key=_multipart_FCA2R3HR61S2.2~RUXHLLZJ251P.0 size=1048576 2023-12-03T11:42:09.963 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.962+0000 7f8723d84780 1 > prepared part key=_multipart_FCA2R3HR61S2.2~RUXHLLZJ251P.1 size=1048576 2023-12-03T11:42:09.964 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.963+0000 7f8723d84780 1 > prepared part key=_multipart_FCA2R3HR61S2.2~RUXHLLZJ251P.2 size=622892 2023-12-03T11:42:09.964 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.963+0000 7f8723d84780 1 > prepared multipart upload key=FCA2R3HR61S2 upload=RUXHLLZJ251P tag=KJSR0C1EW802 type=write size=3768620 2023-12-03T11:42:09.965 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.964+0000 7f8723d84780 1 < completed delete operation key=LCK58DDM5XU9 tag=3G61W975ILN0 type=del 2023-12-03T11:42:09.967 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.965+0000 7f8723d84780 1 > prepared operation key=Y6S7QI60GCLE tag=ENFMDJYOCZ2D type=del size=4018247 2023-12-03T11:42:09.967 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.966+0000 7f8723d84780 1 < canceled operation key=5UYL15O31IHM tag=039U4EDSAC9N type=del size=3582806 2023-12-03T11:42:09.968 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.967+0000 7f8723d84780 1 > prepared operation key=LMVO6CVEPN3K tag=VPCLRH48NIR8 type=del size=1926043 2023-12-03T11:42:09.970 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.969+0000 7f8723d84780 1 < completed write operation key=W2704YS8KYQB tag=63C7TZ0YHOZV type=write size=832625 2023-12-03T11:42:09.971 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.970+0000 7f8723d84780 1 > prepared operation key=EY9ZG5KOTBWM tag=L711YRK3242K type=del size=3074799 2023-12-03T11:42:09.972 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.971+0000 7f8723d84780 1 < completed delete operation key=LMVO6CVEPN3K tag=69URB9JYYT1B type=del 2023-12-03T11:42:09.974 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.973+0000 7f8723d84780 1 > prepared part key=_multipart_7VMTBKUWU59F.2~U1NMGP025WNV.0 size=126886 2023-12-03T11:42:09.974 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.973+0000 7f8723d84780 1 > prepared multipart upload key=7VMTBKUWU59F upload=U1NMGP025WNV tag=6APWCIZKDISZ type=write size=1175462 2023-12-03T11:42:09.975 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.974+0000 7f8723d84780 1 < completed delete operation key=CKABTI1EOAWB tag=M1PR1LBL4EZ1 type=del 2023-12-03T11:42:09.976 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.975+0000 7f8723d84780 1 > prepared operation key=OPQPIDJ2PBVU tag=7U4CCROWDS77 type=write size=803478 2023-12-03T11:42:09.977 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.976+0000 7f8723d84780 1 < completed delete operation key=KS5J7E7KE2IJ tag=1E8PNGM1C096 type=del 2023-12-03T11:42:09.980 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.978+0000 7f8723d84780 1 > prepared part key=_multipart_FCA2R3HR61S2.2~LLV4MF6G12RL.0 size=1048576 2023-12-03T11:42:09.981 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.979+0000 7f8723d84780 1 > prepared part key=_multipart_FCA2R3HR61S2.2~LLV4MF6G12RL.1 size=1048576 2023-12-03T11:42:09.983 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.980+0000 7f8723d84780 1 > prepared part key=_multipart_FCA2R3HR61S2.2~LLV4MF6G12RL.2 size=249496 2023-12-03T11:42:09.983 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.980+0000 7f8723d84780 1 > prepared multipart upload key=FCA2R3HR61S2 upload=LLV4MF6G12RL tag=MC22Q1TQ3ES2 type=write size=3395224 2023-12-03T11:42:09.983 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.982+0000 7f8723d84780 1 < completed write operation key=96RAVVSUKH0Y tag=5KUX66BTD31S type=write size=712055 2023-12-03T11:42:09.985 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.984+0000 7f8723d84780 1 > prepared part key=_multipart_D3JEVEY0E29E.2~3ZD9G0IPIGCQ.0 size=468655 2023-12-03T11:42:09.985 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.984+0000 7f8723d84780 1 > prepared multipart upload key=D3JEVEY0E29E upload=3ZD9G0IPIGCQ tag=79GM3B85SMV8 type=write size=1517231 2023-12-03T11:42:09.986 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.985+0000 7f8723d84780 1 < completed delete operation key=96RAVVSUKH0Y tag=RFLF8KKMWW0W type=del 2023-12-03T11:42:09.988 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.987+0000 7f8723d84780 1 > prepared part key=_multipart_4I8PWBZOLDUG.2~3GCUKRJUW61E.0 size=169927 2023-12-03T11:42:09.988 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.987+0000 7f8723d84780 1 > prepared multipart upload key=4I8PWBZOLDUG upload=3GCUKRJUW61E tag=HZ4YRZ3C45HD type=write size=1218503 2023-12-03T11:42:09.990 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.989+0000 7f8723d84780 1 < completed part key=_multipart_M4VKPN6INFNZ.2~A1AFYMM93HSJ.0 size=158517 2023-12-03T11:42:09.992 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.991+0000 7f8723d84780 1 < completed multipart upload key=M4VKPN6INFNZ upload=A1AFYMM93HSJ tag=9JOWHBZ3XJI6 type=write size=1207093 2023-12-03T11:42:09.994 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.993+0000 7f8723d84780 1 > prepared part key=_multipart_M4VKPN6INFNZ.2~F405NJP9R4M0.0 size=584210 2023-12-03T11:42:09.994 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.993+0000 7f8723d84780 1 > prepared multipart upload key=M4VKPN6INFNZ upload=F405NJP9R4M0 tag=P5Z6Q337D8AK type=write size=1632786 2023-12-03T11:42:09.995 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.994+0000 7f8723d84780 1 < completed part key=_multipart_7VMTBKUWU59F.2~TU3T04Z3BXOL.0 size=1048576 2023-12-03T11:42:09.997 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.996+0000 7f8723d84780 1 < completed part key=_multipart_7VMTBKUWU59F.2~TU3T04Z3BXOL.1 size=320374 2023-12-03T11:42:09.999 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.998+0000 7f8723d84780 1 < completed multipart upload key=7VMTBKUWU59F upload=TU3T04Z3BXOL tag=IM92JF2GTJUM type=write size=2417526 2023-12-03T11:42:10.000 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:09.999+0000 7f8723d84780 1 > prepared operation key=AB0SN0E49Z5F tag=ELN1PYNCB1OL type=del size=328708 2023-12-03T11:42:10.001 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.001+0000 7f8723d84780 1 < completed part key=_multipart_HIU6L0NQ8Q95.2~Z3T2VNRM3LYS.0 size=1017957 2023-12-03T11:42:10.003 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.002+0000 7f8723d84780 1 < completed multipart upload key=HIU6L0NQ8Q95 upload=Z3T2VNRM3LYS tag=U3MJT68FAX03 type=write size=2066533 2023-12-03T11:42:10.005 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.003+0000 7f8723d84780 1 > prepared operation key=DMQX2DGDLU7D tag=C6SBQDGV7QXE type=del size=393439 2023-12-03T11:42:10.006 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.005+0000 7f8723d84780 1 < completed delete operation key=D3JEVEY0E29E tag=MIX1BH1BZ4W7 type=del 2023-12-03T11:42:10.008 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.007+0000 7f8723d84780 1 > prepared part key=_multipart_G36T76K8O7A1.2~L5LPMVYYT24D.0 size=741504 2023-12-03T11:42:10.008 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.007+0000 7f8723d84780 1 > prepared multipart upload key=G36T76K8O7A1 upload=L5LPMVYYT24D tag=49LCJDJ9N4ZA type=write size=1790080 2023-12-03T11:42:10.009 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.008+0000 7f8723d84780 1 < canceled operation key=CKABTI1EOAWB tag=H9D6AX55NWR3 type=del size=1924749 2023-12-03T11:42:10.010 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.009+0000 7f8723d84780 1 > prepared operation key=EY9ZG5KOTBWM tag=1KGBKWYQU52D type=del size=3742587 2023-12-03T11:42:10.011 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.010+0000 7f8723d84780 1 < completed delete operation key=OPQPIDJ2PBVU tag=466R5J4RTS9Y type=del 2023-12-03T11:42:10.012 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.011+0000 7f8723d84780 1 > prepared operation key=KS5J7E7KE2IJ tag=73JLKMD5AUO4 type=del size=2166044 2023-12-03T11:42:10.013 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.012+0000 7f8723d84780 1 < completed part key=_multipart_M4VKPN6INFNZ.2~IJSSNPMXCY48.0 size=1048576 2023-12-03T11:42:10.014 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.013+0000 7f8723d84780 1 < completed part key=_multipart_M4VKPN6INFNZ.2~IJSSNPMXCY48.1 size=1048576 2023-12-03T11:42:10.015 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.014+0000 7f8723d84780 1 < completed part key=_multipart_M4VKPN6INFNZ.2~IJSSNPMXCY48.2 size=500711 2023-12-03T11:42:10.017 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.016+0000 7f8723d84780 1 < completed multipart upload key=M4VKPN6INFNZ upload=IJSSNPMXCY48 tag=H310IK9FOB0G type=write size=3646439 2023-12-03T11:42:10.018 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.017+0000 7f8723d84780 1 > prepared operation key=EITMJKL0LCYC tag=IKZZ6LXLWFWY type=del size=2992263 2023-12-03T11:42:10.019 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.018+0000 7f8723d84780 1 < completed part key=_multipart_FCA2R3HR61S2.2~RUXHLLZJ251P.0 size=1048576 2023-12-03T11:42:10.020 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.019+0000 7f8723d84780 1 < completed part key=_multipart_FCA2R3HR61S2.2~RUXHLLZJ251P.1 size=1048576 2023-12-03T11:42:10.021 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.020+0000 7f8723d84780 1 < completed part key=_multipart_FCA2R3HR61S2.2~RUXHLLZJ251P.2 size=622892 2023-12-03T11:42:10.023 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.022+0000 7f8723d84780 1 < completed multipart upload key=FCA2R3HR61S2 upload=RUXHLLZJ251P tag=KJSR0C1EW802 type=write size=3768620 2023-12-03T11:42:10.025 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.024+0000 7f8723d84780 1 > prepared part key=_multipart_K83BTR5BOLZE.2~GWX42CSL1WVY.0 size=1048576 2023-12-03T11:42:10.026 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.025+0000 7f8723d84780 1 > prepared part key=_multipart_K83BTR5BOLZE.2~GWX42CSL1WVY.1 size=1048576 2023-12-03T11:42:10.027 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.026+0000 7f8723d84780 1 > prepared part key=_multipart_K83BTR5BOLZE.2~GWX42CSL1WVY.2 size=28961 2023-12-03T11:42:10.027 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.026+0000 7f8723d84780 1 > prepared multipart upload key=K83BTR5BOLZE upload=GWX42CSL1WVY tag=0AGG0DJGABNZ type=write size=3174689 2023-12-03T11:42:10.028 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.027+0000 7f8723d84780 1 < completed delete operation key=Y6S7QI60GCLE tag=ENFMDJYOCZ2D type=del 2023-12-03T11:42:10.030 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.029+0000 7f8723d84780 1 > prepared part key=_multipart_W2704YS8KYQB.2~7Y13Z84B14RF.0 size=1022798 2023-12-03T11:42:10.030 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.029+0000 7f8723d84780 1 > prepared multipart upload key=W2704YS8KYQB upload=7Y13Z84B14RF tag=F8HVPRDPDU3S type=write size=2071374 2023-12-03T11:42:10.032 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.031+0000 7f8723d84780 1 < completed delete operation key=LMVO6CVEPN3K tag=VPCLRH48NIR8 type=del 2023-12-03T11:42:10.034 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.033+0000 7f8723d84780 1 > prepared part key=_multipart_D3JEVEY0E29E.2~M7L1MVAK0ITY.0 size=1048576 2023-12-03T11:42:10.035 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.034+0000 7f8723d84780 1 > prepared part key=_multipart_D3JEVEY0E29E.2~M7L1MVAK0ITY.1 size=815104 2023-12-03T11:42:10.035 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.034+0000 7f8723d84780 1 > prepared multipart upload key=D3JEVEY0E29E upload=M7L1MVAK0ITY tag=55LVRY9PTJD4 type=write size=2912256 2023-12-03T11:42:10.036 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.035+0000 7f8723d84780 1 < completed delete operation key=EY9ZG5KOTBWM tag=L711YRK3242K type=del 2023-12-03T11:42:10.037 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.036+0000 7f8723d84780 1 > prepared operation key=96RAVVSUKH0Y tag=O17L0MBHAHSJ type=del size=3414996 2023-12-03T11:42:10.038 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.037+0000 7f8723d84780 1 < completed part key=_multipart_7VMTBKUWU59F.2~U1NMGP025WNV.0 size=126886 2023-12-03T11:42:10.041 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.039+0000 7f8723d84780 1 < completed multipart upload key=7VMTBKUWU59F upload=U1NMGP025WNV tag=6APWCIZKDISZ type=write size=1175462 2023-12-03T11:42:10.041 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.040+0000 7f8723d84780 1 > prepared operation key=CKABTI1EOAWB tag=GAGF6Q4KQU2E type=del size=2206347 2023-12-03T11:42:10.043 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.042+0000 7f8723d84780 1 < completed write operation key=OPQPIDJ2PBVU tag=7U4CCROWDS77 type=write size=803478 2023-12-03T11:42:10.044 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.043+0000 7f8723d84780 1 > prepared operation key=G36T76K8O7A1 tag=41KMA143DPSB type=del size=2414174 2023-12-03T11:42:10.045 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.044+0000 7f8723d84780 1 < completed part key=_multipart_FCA2R3HR61S2.2~LLV4MF6G12RL.0 size=1048576 2023-12-03T11:42:10.046 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.045+0000 7f8723d84780 1 < completed part key=_multipart_FCA2R3HR61S2.2~LLV4MF6G12RL.1 size=1048576 2023-12-03T11:42:10.047 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.046+0000 7f8723d84780 1 < completed part key=_multipart_FCA2R3HR61S2.2~LLV4MF6G12RL.2 size=249496 2023-12-03T11:42:10.049 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.048+0000 7f8723d84780 1 < completed multipart upload key=FCA2R3HR61S2 upload=LLV4MF6G12RL tag=MC22Q1TQ3ES2 type=write size=3395224 2023-12-03T11:42:10.050 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.049+0000 7f8723d84780 1 > prepared operation key=D3JEVEY0E29E tag=5COGA9R1ZRN5 type=del size=3192009 2023-12-03T11:42:10.051 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.050+0000 7f8723d84780 1 < completed part key=_multipart_D3JEVEY0E29E.2~3ZD9G0IPIGCQ.0 size=468655 2023-12-03T11:42:10.053 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.052+0000 7f8723d84780 1 < completed multipart upload key=D3JEVEY0E29E upload=3ZD9G0IPIGCQ tag=79GM3B85SMV8 type=write size=1517231 2023-12-03T11:42:10.055 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.054+0000 7f8723d84780 1 > prepared part key=_multipart_OPQPIDJ2PBVU.2~LDMP62JINUQJ.0 size=1048576 2023-12-03T11:42:10.056 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.055+0000 7f8723d84780 1 > prepared part key=_multipart_OPQPIDJ2PBVU.2~LDMP62JINUQJ.1 size=230647 2023-12-03T11:42:10.056 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.055+0000 7f8723d84780 1 > prepared multipart upload key=OPQPIDJ2PBVU upload=LDMP62JINUQJ tag=JGE2NSP0X34Q type=write size=2327799 2023-12-03T11:42:10.057 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.056+0000 7f8723d84780 1 < completed part key=_multipart_4I8PWBZOLDUG.2~3GCUKRJUW61E.0 size=169927 2023-12-03T11:42:10.059 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.058+0000 7f8723d84780 1 < completed multipart upload key=4I8PWBZOLDUG upload=3GCUKRJUW61E tag=HZ4YRZ3C45HD type=write size=1218503 2023-12-03T11:42:10.060 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.059+0000 7f8723d84780 1 > prepared operation key=12XG7YPYTN4U tag=EQHJ8Z2BKH1Q type=del size=2119754 2023-12-03T11:42:10.062 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.061+0000 7f8723d84780 1 < completed part key=_multipart_M4VKPN6INFNZ.2~F405NJP9R4M0.0 size=584210 2023-12-03T11:42:10.064 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.063+0000 7f8723d84780 1 < completed multipart upload key=M4VKPN6INFNZ upload=F405NJP9R4M0 tag=P5Z6Q337D8AK type=write size=1632786 2023-12-03T11:42:10.065 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.064+0000 7f8723d84780 1 > prepared operation key=KS5J7E7KE2IJ tag=GSOD7ANTPRNE type=del size=2553161 2023-12-03T11:42:10.066 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.065+0000 7f8723d84780 1 < completed delete operation key=AB0SN0E49Z5F tag=ELN1PYNCB1OL type=del 2023-12-03T11:42:10.067 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.066+0000 7f8723d84780 1 > prepared operation key=AB0SN0E49Z5F tag=IYTB8V3JMT9Q type=del size=2106977 2023-12-03T11:42:10.068 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.067+0000 7f8723d84780 1 < completed delete operation key=DMQX2DGDLU7D tag=C6SBQDGV7QXE type=del 2023-12-03T11:42:10.069 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.068+0000 7f8723d84780 1 > prepared operation key=D3JEVEY0E29E tag=969D5PYFTCZG type=del size=989864 2023-12-03T11:42:10.071 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.070+0000 7f8723d84780 1 < completed part key=_multipart_G36T76K8O7A1.2~L5LPMVYYT24D.0 size=741504 2023-12-03T11:42:10.073 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.072+0000 7f8723d84780 1 < completed multipart upload key=G36T76K8O7A1 upload=L5LPMVYYT24D tag=49LCJDJ9N4ZA type=write size=1790080 2023-12-03T11:42:10.074 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.073+0000 7f8723d84780 1 > prepared operation key=FCA2R3HR61S2 tag=LOPIDDYA3BF6 type=del size=860583 2023-12-03T11:42:10.075 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.074+0000 7f8723d84780 1 < completed delete operation key=EY9ZG5KOTBWM tag=1KGBKWYQU52D type=del 2023-12-03T11:42:10.076 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.075+0000 7f8723d84780 1 > prepared operation key=VENJI0KD1XDW tag=5RTI2AUID8U5 type=del size=914998 2023-12-03T11:42:10.077 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.076+0000 7f8723d84780 1 < completed delete operation key=KS5J7E7KE2IJ tag=73JLKMD5AUO4 type=del 2023-12-03T11:42:10.078 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.077+0000 7f8723d84780 1 > prepared operation key=O7VVHXLDSY57 tag=DMEG5W0P2GAA type=del size=75425 2023-12-03T11:42:10.079 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.078+0000 7f8723d84780 1 < completed delete operation key=EITMJKL0LCYC tag=IKZZ6LXLWFWY type=del 2023-12-03T11:42:10.081 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.080+0000 7f8723d84780 1 > prepared operation key=EY9ZG5KOTBWM tag=M2A4KN05KSLX type=write size=413858 2023-12-03T11:42:10.082 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.081+0000 7f8723d84780 1 < completed part key=_multipart_K83BTR5BOLZE.2~GWX42CSL1WVY.0 size=1048576 2023-12-03T11:42:10.086 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.082+0000 7f8723d84780 1 < completed part key=_multipart_K83BTR5BOLZE.2~GWX42CSL1WVY.1 size=1048576 2023-12-03T11:42:10.086 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.083+0000 7f8723d84780 1 < completed part key=_multipart_K83BTR5BOLZE.2~GWX42CSL1WVY.2 size=28961 2023-12-03T11:42:10.086 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.085+0000 7f8723d84780 1 < completed multipart upload key=K83BTR5BOLZE upload=GWX42CSL1WVY tag=0AGG0DJGABNZ type=write size=3174689 2023-12-03T11:42:10.087 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.086+0000 7f8723d84780 1 > prepared operation key=10JRIKOZ16FY tag=AH00HZLG836R type=del size=169619 2023-12-03T11:42:10.088 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.087+0000 7f8723d84780 1 < completed part key=_multipart_W2704YS8KYQB.2~7Y13Z84B14RF.0 size=1022798 2023-12-03T11:42:10.090 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.089+0000 7f8723d84780 1 < completed multipart upload key=W2704YS8KYQB upload=7Y13Z84B14RF tag=F8HVPRDPDU3S type=write size=2071374 2023-12-03T11:42:10.092 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.091+0000 7f8723d84780 1 > prepared operation key=G36T76K8O7A1 tag=CRA7IFRXU0B0 type=del size=1440322 2023-12-03T11:42:10.093 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.092+0000 7f8723d84780 1 < completed part key=_multipart_D3JEVEY0E29E.2~M7L1MVAK0ITY.0 size=1048576 2023-12-03T11:42:10.094 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.093+0000 7f8723d84780 1 < completed part key=_multipart_D3JEVEY0E29E.2~M7L1MVAK0ITY.1 size=815104 2023-12-03T11:42:10.096 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.095+0000 7f8723d84780 1 < completed multipart upload key=D3JEVEY0E29E upload=M7L1MVAK0ITY tag=55LVRY9PTJD4 type=write size=2912256 2023-12-03T11:42:10.097 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.096+0000 7f8723d84780 1 > prepared operation key=D3JEVEY0E29E tag=43H88DN8H1ML type=del size=1269205 2023-12-03T11:42:10.099 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.098+0000 7f8723d84780 1 < completed delete operation key=96RAVVSUKH0Y tag=O17L0MBHAHSJ type=del 2023-12-03T11:42:10.100 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.099+0000 7f8723d84780 1 > prepared operation key=Y6S7QI60GCLE tag=Z99QLEVNKLHH type=del size=2629305 2023-12-03T11:42:10.102 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.100+0000 7f8723d84780 1 < completed delete operation key=CKABTI1EOAWB tag=GAGF6Q4KQU2E type=del 2023-12-03T11:42:10.103 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.102+0000 7f8723d84780 1 > prepared operation key=Y6S7QI60GCLE tag=9SKO1G5T10FC type=del size=1410281 2023-12-03T11:42:10.104 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.103+0000 7f8723d84780 1 < canceled operation key=G36T76K8O7A1 tag=41KMA143DPSB type=del size=2414174 2023-12-03T11:42:10.105 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.104+0000 7f8723d84780 1 > prepared operation key=96RAVVSUKH0Y tag=OGTUWSXO38LV type=del size=2824751 2023-12-03T11:42:10.107 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.106+0000 7f8723d84780 1 < completed delete operation key=D3JEVEY0E29E tag=5COGA9R1ZRN5 type=del 2023-12-03T11:42:10.110 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.109+0000 7f8723d84780 1 > prepared operation key=O7VVHXLDSY57 tag=UAIS3Q7A9KUJ type=del size=346094 2023-12-03T11:42:10.111 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.110+0000 7f8723d84780 1 < completed part key=_multipart_OPQPIDJ2PBVU.2~LDMP62JINUQJ.0 size=1048576 2023-12-03T11:42:10.112 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.111+0000 7f8723d84780 1 < completed part key=_multipart_OPQPIDJ2PBVU.2~LDMP62JINUQJ.1 size=230647 2023-12-03T11:42:10.114 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.113+0000 7f8723d84780 1 < completed multipart upload key=OPQPIDJ2PBVU upload=LDMP62JINUQJ tag=JGE2NSP0X34Q type=write size=2327799 2023-12-03T11:42:10.115 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.114+0000 7f8723d84780 1 > prepared operation key=AB0SN0E49Z5F tag=OIHGD9L9SSJ3 type=del size=1674696 2023-12-03T11:42:10.116 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.116+0000 7f8723d84780 1 < completed delete operation key=12XG7YPYTN4U tag=EQHJ8Z2BKH1Q type=del 2023-12-03T11:42:10.118 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.117+0000 7f8723d84780 1 > prepared operation key=K83BTR5BOLZE tag=XL9V5VPPHJPX type=del size=2981200 2023-12-03T11:42:10.119 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.118+0000 7f8723d84780 1 < completed delete operation key=KS5J7E7KE2IJ tag=GSOD7ANTPRNE type=del 2023-12-03T11:42:10.121 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.120+0000 7f8723d84780 1 > prepared part key=_multipart_OGACI7CRPMT7.2~XIWZ15FYC13R.0 size=182510 2023-12-03T11:42:10.121 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.120+0000 7f8723d84780 1 > prepared multipart upload key=OGACI7CRPMT7 upload=XIWZ15FYC13R tag=0NFWOR27J2DC type=write size=1231086 2023-12-03T11:42:10.122 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.121+0000 7f8723d84780 1 < completed delete operation key=AB0SN0E49Z5F tag=IYTB8V3JMT9Q type=del 2023-12-03T11:42:10.123 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.122+0000 7f8723d84780 1 > prepared operation key=12XG7YPYTN4U tag=TM6YSGP7X7GG type=write size=947201 2023-12-03T11:42:10.126 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.125+0000 7f8723d84780 1 < suggested update operation key=D3JEVEY0E29E tag=969D5PYFTCZG type=del size=989864 2023-12-03T11:42:10.127 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.126+0000 7f8723d84780 1 > prepared operation key=K83BTR5BOLZE tag=36SXG1I7OHP7 type=del size=2255038 2023-12-03T11:42:10.128 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.127+0000 7f8723d84780 1 < completed delete operation key=FCA2R3HR61S2 tag=LOPIDDYA3BF6 type=del 2023-12-03T11:42:10.130 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.129+0000 7f8723d84780 1 > prepared part key=_multipart_7VMTBKUWU59F.2~X1V08XKUEFDE.0 size=666074 2023-12-03T11:42:10.131 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.129+0000 7f8723d84780 1 > prepared multipart upload key=7VMTBKUWU59F upload=X1V08XKUEFDE tag=P36RD0NTL7CB type=write size=1714650 2023-12-03T11:42:10.131 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.130+0000 7f8723d84780 1 < completed delete operation key=VENJI0KD1XDW tag=5RTI2AUID8U5 type=del 2023-12-03T11:42:10.133 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.132+0000 7f8723d84780 1 > prepared operation key=J33T5S893LMV tag=POJDLL116X49 type=write size=1044391 2023-12-03T11:42:10.134 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.133+0000 7f8723d84780 1 < completed delete operation key=O7VVHXLDSY57 tag=DMEG5W0P2GAA type=del 2023-12-03T11:42:10.136 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.135+0000 7f8723d84780 1 > prepared part key=_multipart_TSTIBGVYUZZZ.2~6RBICA0Y3VG3.0 size=1048576 2023-12-03T11:42:10.137 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.136+0000 7f8723d84780 1 > prepared part key=_multipart_TSTIBGVYUZZZ.2~6RBICA0Y3VG3.1 size=1048576 2023-12-03T11:42:10.138 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.137+0000 7f8723d84780 1 > prepared part key=_multipart_TSTIBGVYUZZZ.2~6RBICA0Y3VG3.2 size=598371 2023-12-03T11:42:10.138 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.137+0000 7f8723d84780 1 > prepared multipart upload key=TSTIBGVYUZZZ upload=6RBICA0Y3VG3 tag=LEQCCEWPF1HN type=write size=3744099 2023-12-03T11:42:10.139 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.138+0000 7f8723d84780 1 < completed write operation key=EY9ZG5KOTBWM tag=M2A4KN05KSLX type=write size=413858 2023-12-03T11:42:10.140 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.139+0000 7f8723d84780 1 > prepared operation key=DMQX2DGDLU7D tag=IJ5VZCX1CTCP type=del size=3684959 2023-12-03T11:42:10.142 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.141+0000 7f8723d84780 1 < suggested update operation key=10JRIKOZ16FY tag=AH00HZLG836R type=del size=169619 2023-12-03T11:42:10.143 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.142+0000 7f8723d84780 1 > prepared operation key=7THZZ1J5LOZK tag=EWRVC0XSKK2D type=del size=161557 2023-12-03T11:42:10.146 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.145+0000 7f8723d84780 1 < suggested update operation key=G36T76K8O7A1 tag=CRA7IFRXU0B0 type=del size=1440322 2023-12-03T11:42:10.147 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.146+0000 7f8723d84780 1 > prepared operation key=OPQPIDJ2PBVU tag=FNUE2I54BN8L type=del size=3520393 2023-12-03T11:42:10.148 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.147+0000 7f8723d84780 -1 < failed to complete operation key=D3JEVEY0E29E tag=43H88DN8H1ML type=del size=1269205: (22) Invalid argument 2023-12-03T11:42:10.150 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.149+0000 7f8723d84780 1 > prepared part key=_multipart_OGACI7CRPMT7.2~HHLGQ9COCUD6.0 size=1048576 2023-12-03T11:42:10.152 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.151+0000 7f8723d84780 1 > prepared part key=_multipart_OGACI7CRPMT7.2~HHLGQ9COCUD6.1 size=990151 2023-12-03T11:42:10.152 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.151+0000 7f8723d84780 1 > prepared multipart upload key=OGACI7CRPMT7 upload=HHLGQ9COCUD6 tag=QQ5U8Q8VNCZV type=write size=3087303 2023-12-03T11:42:10.153 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.152+0000 7f8723d84780 1 < completed delete operation key=Y6S7QI60GCLE tag=Z99QLEVNKLHH type=del 2023-12-03T11:42:10.155 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.154+0000 7f8723d84780 1 > prepared part key=_multipart_12XG7YPYTN4U.2~AYJHB7GWL8ZE.0 size=1048576 2023-12-03T11:42:10.156 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.155+0000 7f8723d84780 1 > prepared part key=_multipart_12XG7YPYTN4U.2~AYJHB7GWL8ZE.1 size=202174 2023-12-03T11:42:10.156 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.155+0000 7f8723d84780 1 > prepared multipart upload key=12XG7YPYTN4U upload=AYJHB7GWL8ZE tag=KFL1673IJD39 type=write size=2299326 2023-12-03T11:42:10.157 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.156+0000 7f8723d84780 1 < completed delete operation key=Y6S7QI60GCLE tag=9SKO1G5T10FC type=del 2023-12-03T11:42:10.158 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.157+0000 7f8723d84780 1 > prepared operation key=8NONX2I08YMJ tag=H2MT0XTX5TKI type=write size=392740 2023-12-03T11:42:10.160 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.159+0000 7f8723d84780 1 < completed delete operation key=96RAVVSUKH0Y tag=OGTUWSXO38LV type=del 2023-12-03T11:42:10.162 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.161+0000 7f8723d84780 1 > prepared part key=_multipart_10JRIKOZ16FY.2~PDOBJMA9VFU0.0 size=1048576 2023-12-03T11:42:10.163 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.162+0000 7f8723d84780 1 > prepared part key=_multipart_10JRIKOZ16FY.2~PDOBJMA9VFU0.1 size=1048576 2023-12-03T11:42:10.164 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.163+0000 7f8723d84780 1 > prepared part key=_multipart_10JRIKOZ16FY.2~PDOBJMA9VFU0.2 size=417439 2023-12-03T11:42:10.164 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.163+0000 7f8723d84780 1 > prepared multipart upload key=10JRIKOZ16FY upload=PDOBJMA9VFU0 tag=FNSD4J7LK4YD type=write size=3563167 2023-12-03T11:42:10.165 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.164+0000 7f8723d84780 1 < canceled operation key=O7VVHXLDSY57 tag=UAIS3Q7A9KUJ type=del size=346094 2023-12-03T11:42:10.166 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.165+0000 7f8723d84780 1 > prepared operation key=931GNEXBHH35 tag=GXJEVWRX20W5 type=del size=3860094 2023-12-03T11:42:10.168 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.167+0000 7f8723d84780 1 < completed delete operation key=AB0SN0E49Z5F tag=OIHGD9L9SSJ3 type=del 2023-12-03T11:42:10.169 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.168+0000 7f8723d84780 1 > prepared operation key=HIU6L0NQ8Q95 tag=K173WZA89V0I type=write size=149486 2023-12-03T11:42:10.170 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.169+0000 7f8723d84780 1 < completed delete operation key=K83BTR5BOLZE tag=XL9V5VPPHJPX type=del 2023-12-03T11:42:10.171 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.170+0000 7f8723d84780 1 > prepared operation key=UWS266H06VDK tag=4R030OYRMV7R type=write size=139238 2023-12-03T11:42:10.172 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.171+0000 7f8723d84780 1 < completed part key=_multipart_OGACI7CRPMT7.2~XIWZ15FYC13R.0 size=182510 2023-12-03T11:42:10.174 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.173+0000 7f8723d84780 1 < completed multipart upload key=OGACI7CRPMT7 upload=XIWZ15FYC13R tag=0NFWOR27J2DC type=write size=1231086 2023-12-03T11:42:10.176 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.175+0000 7f8723d84780 1 > prepared operation key=FCA2R3HR61S2 tag=KD28LDJNV5NT type=write size=193400 2023-12-03T11:42:10.177 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.176+0000 7f8723d84780 1 < completed write operation key=12XG7YPYTN4U tag=TM6YSGP7X7GG type=write size=947201 2023-12-03T11:42:10.179 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.178+0000 7f8723d84780 1 > prepared part key=_multipart_DMQX2DGDLU7D.2~46LVPDH5NK53.0 size=1048576 2023-12-03T11:42:10.180 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.179+0000 7f8723d84780 1 > prepared part key=_multipart_DMQX2DGDLU7D.2~46LVPDH5NK53.1 size=1048576 2023-12-03T11:42:10.181 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.180+0000 7f8723d84780 1 > prepared part key=_multipart_DMQX2DGDLU7D.2~46LVPDH5NK53.2 size=18756 2023-12-03T11:42:10.181 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.180+0000 7f8723d84780 1 > prepared multipart upload key=DMQX2DGDLU7D upload=46LVPDH5NK53 tag=L0CS5AFZ5PV4 type=write size=3164484 2023-12-03T11:42:10.182 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.181+0000 7f8723d84780 1 < completed delete operation key=K83BTR5BOLZE tag=36SXG1I7OHP7 type=del 2023-12-03T11:42:10.184 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.183+0000 7f8723d84780 1 > prepared part key=_multipart_12XG7YPYTN4U.2~DAYH2QVZR1Q1.0 size=1048576 2023-12-03T11:42:10.185 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.184+0000 7f8723d84780 1 > prepared part key=_multipart_12XG7YPYTN4U.2~DAYH2QVZR1Q1.1 size=670146 2023-12-03T11:42:10.185 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.184+0000 7f8723d84780 1 > prepared multipart upload key=12XG7YPYTN4U upload=DAYH2QVZR1Q1 tag=QQ64T20GSC0I type=write size=2767298 2023-12-03T11:42:10.186 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.185+0000 7f8723d84780 1 < completed part key=_multipart_7VMTBKUWU59F.2~X1V08XKUEFDE.0 size=666074 2023-12-03T11:42:10.188 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.187+0000 7f8723d84780 1 < completed multipart upload key=7VMTBKUWU59F upload=X1V08XKUEFDE tag=P36RD0NTL7CB type=write size=1714650 2023-12-03T11:42:10.191 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.190+0000 7f8723d84780 1 > prepared part key=_multipart_TSTIBGVYUZZZ.2~E0NN0OAHMYA0.0 size=1048576 2023-12-03T11:42:10.192 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.191+0000 7f8723d84780 1 > prepared part key=_multipart_TSTIBGVYUZZZ.2~E0NN0OAHMYA0.1 size=948385 2023-12-03T11:42:10.192 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.191+0000 7f8723d84780 1 > prepared multipart upload key=TSTIBGVYUZZZ upload=E0NN0OAHMYA0 tag=JHNK9MCM6XU8 type=write size=3045537 2023-12-03T11:42:10.193 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.192+0000 7f8723d84780 1 < completed write operation key=J33T5S893LMV tag=POJDLL116X49 type=write size=1044391 2023-12-03T11:42:10.194 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.193+0000 7f8723d84780 1 > prepared operation key=Y6S7QI60GCLE tag=ARJ9H9F61W2G type=del size=3731551 2023-12-03T11:42:10.196 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.194+0000 7f8723d84780 1 < completed part key=_multipart_TSTIBGVYUZZZ.2~6RBICA0Y3VG3.0 size=1048576 2023-12-03T11:42:10.196 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.195+0000 7f8723d84780 1 < completed part key=_multipart_TSTIBGVYUZZZ.2~6RBICA0Y3VG3.1 size=1048576 2023-12-03T11:42:10.198 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.196+0000 7f8723d84780 1 < completed part key=_multipart_TSTIBGVYUZZZ.2~6RBICA0Y3VG3.2 size=598371 2023-12-03T11:42:10.200 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.198+0000 7f8723d84780 1 < completed multipart upload key=TSTIBGVYUZZZ upload=6RBICA0Y3VG3 tag=LEQCCEWPF1HN type=write size=3744099 2023-12-03T11:42:10.201 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.199+0000 7f8723d84780 1 > prepared operation key=UWS266H06VDK tag=WB2GARHNJJY4 type=del size=409157 2023-12-03T11:42:10.202 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.201+0000 7f8723d84780 1 < completed delete operation key=DMQX2DGDLU7D tag=IJ5VZCX1CTCP type=del 2023-12-03T11:42:10.203 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.202+0000 7f8723d84780 1 > prepared operation key=VENJI0KD1XDW tag=O2HG86XSLO3K type=del size=818622 2023-12-03T11:42:10.204 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.203+0000 7f8723d84780 1 < completed delete operation key=7THZZ1J5LOZK tag=EWRVC0XSKK2D type=del 2023-12-03T11:42:10.206 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.205+0000 7f8723d84780 1 > prepared operation key=7THZZ1J5LOZK tag=EA0U3B2MCZYE type=del size=304324 2023-12-03T11:42:10.207 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.206+0000 7f8723d84780 1 < canceled operation key=OPQPIDJ2PBVU tag=FNUE2I54BN8L type=del size=3520393 2023-12-03T11:42:10.208 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.207+0000 7f8723d84780 1 > prepared operation key=G36T76K8O7A1 tag=UWHO2BZ51CXY type=del size=1287350 2023-12-03T11:42:10.209 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.208+0000 7f8723d84780 1 < completed part key=_multipart_OGACI7CRPMT7.2~HHLGQ9COCUD6.0 size=1048576 2023-12-03T11:42:10.210 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.209+0000 7f8723d84780 1 < completed part key=_multipart_OGACI7CRPMT7.2~HHLGQ9COCUD6.1 size=990151 2023-12-03T11:42:10.212 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.211+0000 7f8723d84780 1 < completed multipart upload key=OGACI7CRPMT7 upload=HHLGQ9COCUD6 tag=QQ5U8Q8VNCZV type=write size=3087303 2023-12-03T11:42:10.215 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.214+0000 7f8723d84780 1 > prepared part key=_multipart_OPQPIDJ2PBVU.2~HRSQZLCFMB4K.0 size=1048576 2023-12-03T11:42:10.215 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.214+0000 7f8723d84780 1 > prepared part key=_multipart_OPQPIDJ2PBVU.2~HRSQZLCFMB4K.1 size=995997 2023-12-03T11:42:10.216 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.214+0000 7f8723d84780 1 > prepared multipart upload key=OPQPIDJ2PBVU upload=HRSQZLCFMB4K tag=CNWTU8LXTV0F type=write size=3093149 2023-12-03T11:42:10.217 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.216+0000 7f8723d84780 1 < completed part key=_multipart_12XG7YPYTN4U.2~AYJHB7GWL8ZE.0 size=1048576 2023-12-03T11:42:10.218 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.217+0000 7f8723d84780 1 < completed part key=_multipart_12XG7YPYTN4U.2~AYJHB7GWL8ZE.1 size=202174 2023-12-03T11:42:10.220 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.219+0000 7f8723d84780 1 < completed multipart upload key=12XG7YPYTN4U upload=AYJHB7GWL8ZE tag=KFL1673IJD39 type=write size=2299326 2023-12-03T11:42:10.222 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.221+0000 7f8723d84780 1 > prepared operation key=OPQPIDJ2PBVU tag=MJXBZ27WIZOO type=del size=380465 2023-12-03T11:42:10.223 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.222+0000 7f8723d84780 1 < completed write operation key=8NONX2I08YMJ tag=H2MT0XTX5TKI type=write size=392740 2023-12-03T11:42:10.224 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.223+0000 7f8723d84780 1 > prepared operation key=DMQX2DGDLU7D tag=8KE2NP3IC6OU type=del size=3601102 2023-12-03T11:42:10.226 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.225+0000 7f8723d84780 1 < completed part key=_multipart_10JRIKOZ16FY.2~PDOBJMA9VFU0.0 size=1048576 2023-12-03T11:42:10.227 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.225+0000 7f8723d84780 1 < completed part key=_multipart_10JRIKOZ16FY.2~PDOBJMA9VFU0.1 size=1048576 2023-12-03T11:42:10.227 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.226+0000 7f8723d84780 1 < completed part key=_multipart_10JRIKOZ16FY.2~PDOBJMA9VFU0.2 size=417439 2023-12-03T11:42:10.230 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.228+0000 7f8723d84780 1 < completed multipart upload key=10JRIKOZ16FY upload=PDOBJMA9VFU0 tag=FNSD4J7LK4YD type=write size=3563167 2023-12-03T11:42:10.231 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.230+0000 7f8723d84780 1 > prepared operation key=EITMJKL0LCYC tag=PQNN6PQWUDT4 type=write size=870076 2023-12-03T11:42:10.232 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.231+0000 7f8723d84780 1 < completed delete operation key=931GNEXBHH35 tag=GXJEVWRX20W5 type=del 2023-12-03T11:42:10.233 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.232+0000 7f8723d84780 1 > prepared operation key=EY9ZG5KOTBWM tag=OTS4ATPERDG7 type=write size=1011040 2023-12-03T11:42:10.234 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.233+0000 7f8723d84780 1 < completed write operation key=HIU6L0NQ8Q95 tag=K173WZA89V0I type=write size=149486 2023-12-03T11:42:10.236 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.235+0000 7f8723d84780 1 > prepared operation key=UWS266H06VDK tag=W9YYGG1Z589N type=del size=423534 2023-12-03T11:42:10.237 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.236+0000 7f8723d84780 1 < completed write operation key=UWS266H06VDK tag=4R030OYRMV7R type=write size=139238 2023-12-03T11:42:10.239 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.238+0000 7f8723d84780 1 > prepared part key=_multipart_OPQPIDJ2PBVU.2~R5T13U0L4GRO.0 size=1048576 2023-12-03T11:42:10.240 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.239+0000 7f8723d84780 1 > prepared part key=_multipart_OPQPIDJ2PBVU.2~R5T13U0L4GRO.1 size=1048576 2023-12-03T11:42:10.241 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.240+0000 7f8723d84780 1 > prepared part key=_multipart_OPQPIDJ2PBVU.2~R5T13U0L4GRO.2 size=514224 2023-12-03T11:42:10.241 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.240+0000 7f8723d84780 1 > prepared multipart upload key=OPQPIDJ2PBVU upload=R5T13U0L4GRO tag=VZGFCXEV6W98 type=write size=3659952 2023-12-03T11:42:10.243 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.242+0000 7f8723d84780 1 < suggested update operation key=FCA2R3HR61S2 tag=KD28LDJNV5NT type=write size=193400 2023-12-03T11:42:10.244 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.243+0000 7f8723d84780 1 > prepared operation key=DMQX2DGDLU7D tag=V6S7NARBNL4M type=del size=2357692 2023-12-03T11:42:10.245 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.243+0000 7f8723d84780 1 < canceled part key=_multipart_DMQX2DGDLU7D.2~46LVPDH5NK53.0 size=1048576 2023-12-03T11:42:10.246 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.244+0000 7f8723d84780 1 < completed part key=_multipart_DMQX2DGDLU7D.2~46LVPDH5NK53.1 size=1048576 2023-12-03T11:42:10.246 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.245+0000 7f8723d84780 1 < completed part key=_multipart_DMQX2DGDLU7D.2~46LVPDH5NK53.2 size=18756 2023-12-03T11:42:10.248 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.247+0000 7f8723d84780 1 < canceled multipart upload key=DMQX2DGDLU7D upload=46LVPDH5NK53 tag=L0CS5AFZ5PV4 type=write size=3164484 2023-12-03T11:42:10.249 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.248+0000 7f8723d84780 1 > prepared operation key=7THZZ1J5LOZK tag=NY1TK8LHCRTW type=del size=2877305 2023-12-03T11:42:10.251 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.250+0000 7f8723d84780 1 < completed part key=_multipart_12XG7YPYTN4U.2~DAYH2QVZR1Q1.0 size=1048576 2023-12-03T11:42:10.252 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.251+0000 7f8723d84780 1 < completed part key=_multipart_12XG7YPYTN4U.2~DAYH2QVZR1Q1.1 size=670146 2023-12-03T11:42:10.253 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.252+0000 7f8723d84780 1 < completed multipart upload key=12XG7YPYTN4U upload=DAYH2QVZR1Q1 tag=QQ64T20GSC0I type=write size=2767298 2023-12-03T11:42:10.255 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.254+0000 7f8723d84780 1 > prepared operation key=8NONX2I08YMJ tag=8DTNSP79SDKS type=del size=88135 2023-12-03T11:42:10.256 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.255+0000 7f8723d84780 1 < completed part key=_multipart_TSTIBGVYUZZZ.2~E0NN0OAHMYA0.0 size=1048576 2023-12-03T11:42:10.257 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.256+0000 7f8723d84780 1 < completed part key=_multipart_TSTIBGVYUZZZ.2~E0NN0OAHMYA0.1 size=948385 2023-12-03T11:42:10.259 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.258+0000 7f8723d84780 1 < completed multipart upload key=TSTIBGVYUZZZ upload=E0NN0OAHMYA0 tag=JHNK9MCM6XU8 type=write size=3045537 2023-12-03T11:42:10.260 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.259+0000 7f8723d84780 1 > prepared operation key=4I8PWBZOLDUG tag=WZ80MS2W12YP type=del size=3537925 2023-12-03T11:42:10.262 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.261+0000 7f8723d84780 1 < suggested update operation key=Y6S7QI60GCLE tag=ARJ9H9F61W2G type=del size=3731551 2023-12-03T11:42:10.263 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.262+0000 7f8723d84780 1 > prepared operation key=7THZZ1J5LOZK tag=6H9701IF3E03 type=del size=2540291 2023-12-03T11:42:10.264 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.263+0000 7f8723d84780 1 < completed delete operation key=UWS266H06VDK tag=WB2GARHNJJY4 type=del 2023-12-03T11:42:10.266 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.265+0000 7f8723d84780 1 > prepared operation key=M4VKPN6INFNZ tag=6Y0XB90BXIVN type=del size=497505 2023-12-03T11:42:10.267 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.266+0000 7f8723d84780 1 < completed delete operation key=VENJI0KD1XDW tag=O2HG86XSLO3K type=del 2023-12-03T11:42:10.268 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.267+0000 7f8723d84780 1 > prepared operation key=7VMTBKUWU59F tag=1GTK3VHS1D7M type=del size=2517704 2023-12-03T11:42:10.269 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.268+0000 7f8723d84780 1 < completed delete operation key=7THZZ1J5LOZK tag=EA0U3B2MCZYE type=del 2023-12-03T11:42:10.270 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.269+0000 7f8723d84780 1 > prepared operation key=OGACI7CRPMT7 tag=EB8L769RA74C type=del size=3803412 2023-12-03T11:42:10.272 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.271+0000 7f8723d84780 1 < completed delete operation key=G36T76K8O7A1 tag=UWHO2BZ51CXY type=del 2023-12-03T11:42:10.273 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.272+0000 7f8723d84780 1 > prepared operation key=4I8PWBZOLDUG tag=U9H39FI7OSDG type=del size=2958180 2023-12-03T11:42:10.274 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.273+0000 7f8723d84780 1 < completed part key=_multipart_OPQPIDJ2PBVU.2~HRSQZLCFMB4K.0 size=1048576 2023-12-03T11:42:10.275 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.274+0000 7f8723d84780 1 < completed part key=_multipart_OPQPIDJ2PBVU.2~HRSQZLCFMB4K.1 size=995997 2023-12-03T11:42:10.277 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.276+0000 7f8723d84780 1 < completed multipart upload key=OPQPIDJ2PBVU upload=HRSQZLCFMB4K tag=CNWTU8LXTV0F type=write size=3093149 2023-12-03T11:42:10.278 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.277+0000 7f8723d84780 1 > prepared operation key=LMVO6CVEPN3K tag=3EV4XS6O5TJO type=del size=13207 2023-12-03T11:42:10.280 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.279+0000 7f8723d84780 1 < completed delete operation key=OPQPIDJ2PBVU tag=MJXBZ27WIZOO type=del 2023-12-03T11:42:10.281 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.280+0000 7f8723d84780 1 > prepared operation key=CKABTI1EOAWB tag=O6ZZOXS6RI7A type=del size=1749172 2023-12-03T11:42:10.282 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.281+0000 7f8723d84780 1 < completed delete operation key=DMQX2DGDLU7D tag=8KE2NP3IC6OU type=del 2023-12-03T11:42:10.283 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.282+0000 7f8723d84780 1 > prepared operation key=4I8PWBZOLDUG tag=96FXNQYGUQLV type=write size=503464 2023-12-03T11:42:10.284 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.283+0000 7f8723d84780 1 < completed write operation key=EITMJKL0LCYC tag=PQNN6PQWUDT4 type=write size=870076 2023-12-03T11:42:10.286 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.285+0000 7f8723d84780 1 > prepared operation key=12XG7YPYTN4U tag=C4CNVAH0UHJB type=del size=2318340 2023-12-03T11:42:10.287 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.286+0000 7f8723d84780 1 < completed write operation key=EY9ZG5KOTBWM tag=OTS4ATPERDG7 type=write size=1011040 2023-12-03T11:42:10.289 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.288+0000 7f8723d84780 1 > prepared part key=_multipart_TSTIBGVYUZZZ.2~H19F7SORVT7T.0 size=1048576 2023-12-03T11:42:10.290 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.289+0000 7f8723d84780 1 > prepared part key=_multipart_TSTIBGVYUZZZ.2~H19F7SORVT7T.1 size=655384 2023-12-03T11:42:10.290 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.289+0000 7f8723d84780 1 > prepared multipart upload key=TSTIBGVYUZZZ upload=H19F7SORVT7T tag=VYHJ5TC4GS15 type=write size=2752536 2023-12-03T11:42:10.293 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.291+0000 7f8723d84780 1 < suggested update operation key=UWS266H06VDK tag=W9YYGG1Z589N type=del size=423534 2023-12-03T11:42:10.294 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.293+0000 7f8723d84780 1 > prepared operation key=7VMTBKUWU59F tag=MXDMXDYL10WU type=del size=2605260 2023-12-03T11:42:10.295 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.294+0000 7f8723d84780 1 < completed part key=_multipart_OPQPIDJ2PBVU.2~R5T13U0L4GRO.0 size=1048576 2023-12-03T11:42:10.296 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.295+0000 7f8723d84780 1 < completed part key=_multipart_OPQPIDJ2PBVU.2~R5T13U0L4GRO.1 size=1048576 2023-12-03T11:42:10.297 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.296+0000 7f8723d84780 1 < completed part key=_multipart_OPQPIDJ2PBVU.2~R5T13U0L4GRO.2 size=514224 2023-12-03T11:42:10.299 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.298+0000 7f8723d84780 1 < completed multipart upload key=OPQPIDJ2PBVU upload=R5T13U0L4GRO tag=VZGFCXEV6W98 type=write size=3659952 2023-12-03T11:42:10.300 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.299+0000 7f8723d84780 1 > prepared operation key=KS5J7E7KE2IJ tag=HX26ACYP0SWF type=write size=78147 2023-12-03T11:42:10.301 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.300+0000 7f8723d84780 1 < completed delete operation key=DMQX2DGDLU7D tag=V6S7NARBNL4M type=del 2023-12-03T11:42:10.303 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.302+0000 7f8723d84780 1 > prepared operation key=D3JEVEY0E29E tag=LPLOFK65LANP type=write size=1022503 2023-12-03T11:42:10.305 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.304+0000 7f8723d84780 1 < suggested remove operation key=7THZZ1J5LOZK tag=NY1TK8LHCRTW type=del 2023-12-03T11:42:10.306 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.305+0000 7f8723d84780 1 > prepared operation key=OPQPIDJ2PBVU tag=2W94K5QOXD0L type=del size=3766782 2023-12-03T11:42:10.307 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.306+0000 7f8723d84780 1 < completed delete operation key=8NONX2I08YMJ tag=8DTNSP79SDKS type=del 2023-12-03T11:42:10.308 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.307+0000 7f8723d84780 1 > prepared operation key=LCK58DDM5XU9 tag=090B19RGZDZR type=del size=1553385 2023-12-03T11:42:10.310 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.309+0000 7f8723d84780 1 < completed delete operation key=4I8PWBZOLDUG tag=WZ80MS2W12YP type=del 2023-12-03T11:42:10.311 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.310+0000 7f8723d84780 1 > prepared operation key=OPQPIDJ2PBVU tag=UKXJ5MNWMPTA type=del size=4054971 2023-12-03T11:42:10.312 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.311+0000 7f8723d84780 -1 < failed to complete operation key=7THZZ1J5LOZK tag=6H9701IF3E03 type=del size=2540291: (22) Invalid argument 2023-12-03T11:42:10.313 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.312+0000 7f8723d84780 1 > prepared operation key=EITMJKL0LCYC tag=36LWHF7MBKPL type=write size=65240 2023-12-03T11:42:10.314 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.313+0000 7f8723d84780 1 < completed delete operation key=M4VKPN6INFNZ tag=6Y0XB90BXIVN type=del 2023-12-03T11:42:10.315 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.315+0000 7f8723d84780 1 > prepared operation key=M4VKPN6INFNZ tag=KYHYE07SW0BX type=del size=1918322 2023-12-03T11:42:10.317 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.316+0000 7f8723d84780 1 < completed delete operation key=7VMTBKUWU59F tag=1GTK3VHS1D7M type=del 2023-12-03T11:42:10.319 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.318+0000 7f8723d84780 1 > prepared part key=_multipart_J33T5S893LMV.2~5600ZQQAYKT5.0 size=1048576 2023-12-03T11:42:10.320 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.319+0000 7f8723d84780 1 > prepared part key=_multipart_J33T5S893LMV.2~5600ZQQAYKT5.1 size=1048576 2023-12-03T11:42:10.321 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.320+0000 7f8723d84780 1 > prepared part key=_multipart_J33T5S893LMV.2~5600ZQQAYKT5.2 size=792056 2023-12-03T11:42:10.321 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.320+0000 7f8723d84780 1 > prepared multipart upload key=J33T5S893LMV upload=5600ZQQAYKT5 tag=GVESAVXOYNVW type=write size=3937784 2023-12-03T11:42:10.323 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.322+0000 7f8723d84780 1 < suggested remove operation key=OGACI7CRPMT7 tag=EB8L769RA74C type=del 2023-12-03T11:42:10.324 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.323+0000 7f8723d84780 1 > prepared operation key=931GNEXBHH35 tag=F5P5U5AY34J0 type=del size=951354 2023-12-03T11:42:10.325 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.324+0000 7f8723d84780 1 < completed delete operation key=4I8PWBZOLDUG tag=U9H39FI7OSDG type=del 2023-12-03T11:42:10.327 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.327+0000 7f8723d84780 1 > prepared part key=_multipart_5UYL15O31IHM.2~78HA9DW9R773.0 size=1048576 2023-12-03T11:42:10.328 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.327+0000 7f8723d84780 1 > prepared part key=_multipart_5UYL15O31IHM.2~78HA9DW9R773.1 size=1048576 2023-12-03T11:42:10.330 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.328+0000 7f8723d84780 1 > prepared part key=_multipart_5UYL15O31IHM.2~78HA9DW9R773.2 size=881415 2023-12-03T11:42:10.330 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.328+0000 7f8723d84780 1 > prepared multipart upload key=5UYL15O31IHM upload=78HA9DW9R773 tag=QQWNBO9VJXZY type=write size=4027143 2023-12-03T11:42:10.331 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.330+0000 7f8723d84780 1 < completed delete operation key=LMVO6CVEPN3K tag=3EV4XS6O5TJO type=del 2023-12-03T11:42:10.332 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.331+0000 7f8723d84780 1 > prepared operation key=7THZZ1J5LOZK tag=OLI0Y1KQNARG type=del size=237044 2023-12-03T11:42:10.333 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.332+0000 7f8723d84780 1 < canceled operation key=CKABTI1EOAWB tag=O6ZZOXS6RI7A type=del size=1749172 2023-12-03T11:42:10.336 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.335+0000 7f8723d84780 1 > prepared part key=_multipart_TSTIBGVYUZZZ.2~VFGIG4HC2DT1.0 size=7620 2023-12-03T11:42:10.336 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.335+0000 7f8723d84780 1 > prepared multipart upload key=TSTIBGVYUZZZ upload=VFGIG4HC2DT1 tag=POJFMTGDMETD type=write size=1056196 2023-12-03T11:42:10.337 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.336+0000 7f8723d84780 1 < canceled operation key=4I8PWBZOLDUG tag=96FXNQYGUQLV type=write size=503464 2023-12-03T11:42:10.338 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.337+0000 7f8723d84780 1 > prepared operation key=DMQX2DGDLU7D tag=2VQUIPDG2Y29 type=write size=347363 2023-12-03T11:42:10.341 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.340+0000 7f8723d84780 1 < suggested update operation key=12XG7YPYTN4U tag=C4CNVAH0UHJB type=del size=2318340 2023-12-03T11:42:10.342 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.341+0000 7f8723d84780 1 > prepared operation key=OPQPIDJ2PBVU tag=ZX2IGIH6B9WV type=del size=363207 2023-12-03T11:42:10.343 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.342+0000 7f8723d84780 1 < completed part key=_multipart_TSTIBGVYUZZZ.2~H19F7SORVT7T.0 size=1048576 2023-12-03T11:42:10.344 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.343+0000 7f8723d84780 1 < completed part key=_multipart_TSTIBGVYUZZZ.2~H19F7SORVT7T.1 size=655384 2023-12-03T11:42:10.346 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.345+0000 7f8723d84780 1 < completed multipart upload key=TSTIBGVYUZZZ upload=H19F7SORVT7T tag=VYHJ5TC4GS15 type=write size=2752536 2023-12-03T11:42:10.347 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.346+0000 7f8723d84780 1 > prepared operation key=7VMTBKUWU59F tag=U993GEBHNO8O type=del size=1692990 2023-12-03T11:42:10.348 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.347+0000 7f8723d84780 1 < completed delete operation key=7VMTBKUWU59F tag=MXDMXDYL10WU type=del 2023-12-03T11:42:10.350 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.349+0000 7f8723d84780 1 > prepared part key=_multipart_VENJI0KD1XDW.2~0LNIYLG16YHM.0 size=1048576 2023-12-03T11:42:10.351 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.350+0000 7f8723d84780 1 > prepared part key=_multipart_VENJI0KD1XDW.2~0LNIYLG16YHM.1 size=1048576 2023-12-03T11:42:10.352 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.351+0000 7f8723d84780 1 > prepared part key=_multipart_VENJI0KD1XDW.2~0LNIYLG16YHM.2 size=932970 2023-12-03T11:42:10.352 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.351+0000 7f8723d84780 1 > prepared multipart upload key=VENJI0KD1XDW upload=0LNIYLG16YHM tag=YNIL35KGFGK0 type=write size=4078698 2023-12-03T11:42:10.353 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.352+0000 7f8723d84780 1 < completed write operation key=KS5J7E7KE2IJ tag=HX26ACYP0SWF type=write size=78147 2023-12-03T11:42:10.354 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.353+0000 7f8723d84780 1 > prepared operation key=O7VVHXLDSY57 tag=5XYYZQ7M0717 type=del size=2802848 2023-12-03T11:42:10.355 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.354+0000 7f8723d84780 1 < completed write operation key=D3JEVEY0E29E tag=LPLOFK65LANP type=write size=1022503 2023-12-03T11:42:10.356 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.355+0000 7f8723d84780 1 > prepared operation key=CKABTI1EOAWB tag=997LQA2XGZAC type=write size=1041837 2023-12-03T11:42:10.357 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.357+0000 7f8723d84780 1 < completed delete operation key=OPQPIDJ2PBVU tag=2W94K5QOXD0L type=del 2023-12-03T11:42:10.360 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.359+0000 7f8723d84780 1 > prepared part key=_multipart_AB0SN0E49Z5F.2~B21FO6QQRO70.0 size=2630 2023-12-03T11:42:10.360 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.359+0000 7f8723d84780 1 > prepared multipart upload key=AB0SN0E49Z5F upload=B21FO6QQRO70 tag=UHE3Q3TNMJGX type=write size=1051206 2023-12-03T11:42:10.361 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.360+0000 7f8723d84780 1 < canceled operation key=LCK58DDM5XU9 tag=090B19RGZDZR type=del size=1553385 2023-12-03T11:42:10.362 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.361+0000 7f8723d84780 1 > prepared operation key=96RAVVSUKH0Y tag=XYB24P1ZIAFP type=del size=367803 2023-12-03T11:42:10.363 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.362+0000 7f8723d84780 1 < completed delete operation key=OPQPIDJ2PBVU tag=UKXJ5MNWMPTA type=del 2023-12-03T11:42:10.364 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.363+0000 7f8723d84780 1 > prepared operation key=931GNEXBHH35 tag=IE7O7PCTEK30 type=del size=2053386 2023-12-03T11:42:10.366 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.365+0000 7f8723d84780 1 < canceled operation key=EITMJKL0LCYC tag=36LWHF7MBKPL type=write size=65240 2023-12-03T11:42:10.367 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.366+0000 7f8723d84780 1 > prepared operation key=FCA2R3HR61S2 tag=W9I9V64M1FRE type=del size=901664 2023-12-03T11:42:10.368 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.367+0000 7f8723d84780 1 < canceled operation key=M4VKPN6INFNZ tag=KYHYE07SW0BX type=del size=1918322 2023-12-03T11:42:10.369 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.368+0000 7f8723d84780 1 > prepared operation key=G36T76K8O7A1 tag=F2H0EWO7RPJV type=del size=2742325 2023-12-03T11:42:10.371 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.370+0000 7f8723d84780 1 < completed part key=_multipart_J33T5S893LMV.2~5600ZQQAYKT5.0 size=1048576 2023-12-03T11:42:10.372 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.371+0000 7f8723d84780 1 < completed part key=_multipart_J33T5S893LMV.2~5600ZQQAYKT5.1 size=1048576 2023-12-03T11:42:10.373 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.372+0000 7f8723d84780 1 < completed part key=_multipart_J33T5S893LMV.2~5600ZQQAYKT5.2 size=792056 2023-12-03T11:42:10.375 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.374+0000 7f8723d84780 1 < completed multipart upload key=J33T5S893LMV upload=5600ZQQAYKT5 tag=GVESAVXOYNVW type=write size=3937784 2023-12-03T11:42:10.377 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.376+0000 7f8723d84780 1 > prepared part key=_multipart_LMVO6CVEPN3K.2~ID197TR8CULN.0 size=1012087 2023-12-03T11:42:10.378 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.376+0000 7f8723d84780 1 > prepared multipart upload key=LMVO6CVEPN3K upload=ID197TR8CULN tag=9Y9SF6Y33VWL type=write size=2060663 2023-12-03T11:42:10.380 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.379+0000 7f8723d84780 1 < suggested update operation key=931GNEXBHH35 tag=F5P5U5AY34J0 type=del size=951354 2023-12-03T11:42:10.382 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.381+0000 7f8723d84780 1 > prepared part key=_multipart_G36T76K8O7A1.2~L7T51AN0CY4Z.0 size=1048576 2023-12-03T11:42:10.383 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.382+0000 7f8723d84780 1 > prepared part key=_multipart_G36T76K8O7A1.2~L7T51AN0CY4Z.1 size=1048576 2023-12-03T11:42:10.384 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.383+0000 7f8723d84780 1 > prepared part key=_multipart_G36T76K8O7A1.2~L7T51AN0CY4Z.2 size=206214 2023-12-03T11:42:10.384 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.383+0000 7f8723d84780 1 > prepared multipart upload key=G36T76K8O7A1 upload=L7T51AN0CY4Z tag=CKG0SP40PREX type=write size=3351942 2023-12-03T11:42:10.385 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.384+0000 7f8723d84780 1 < completed part key=_multipart_5UYL15O31IHM.2~78HA9DW9R773.0 size=1048576 2023-12-03T11:42:10.386 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.385+0000 7f8723d84780 1 < completed part key=_multipart_5UYL15O31IHM.2~78HA9DW9R773.1 size=1048576 2023-12-03T11:42:10.388 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.386+0000 7f8723d84780 1 < completed part key=_multipart_5UYL15O31IHM.2~78HA9DW9R773.2 size=881415 2023-12-03T11:42:10.390 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.389+0000 7f8723d84780 1 < completed multipart upload key=5UYL15O31IHM upload=78HA9DW9R773 tag=QQWNBO9VJXZY type=write size=4027143 2023-12-03T11:42:10.392 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.391+0000 7f8723d84780 1 > prepared part key=_multipart_KS5J7E7KE2IJ.2~7RHURCHFVDES.0 size=729119 2023-12-03T11:42:10.392 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.391+0000 7f8723d84780 1 > prepared multipart upload key=KS5J7E7KE2IJ upload=7RHURCHFVDES tag=Y5JGY8RTXW95 type=write size=1777695 2023-12-03T11:42:10.393 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.392+0000 7f8723d84780 1 < completed delete operation key=7THZZ1J5LOZK tag=OLI0Y1KQNARG type=del 2023-12-03T11:42:10.394 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.393+0000 7f8723d84780 1 > prepared operation key=931GNEXBHH35 tag=BZ2UWTX05N2R type=write size=650262 2023-12-03T11:42:10.397 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.395+0000 7f8723d84780 1 < completed part key=_multipart_TSTIBGVYUZZZ.2~VFGIG4HC2DT1.0 size=7620 2023-12-03T11:42:10.398 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.397+0000 7f8723d84780 1 < completed multipart upload key=TSTIBGVYUZZZ upload=VFGIG4HC2DT1 tag=POJFMTGDMETD type=write size=1056196 2023-12-03T11:42:10.401 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.399+0000 7f8723d84780 1 > prepared operation key=4I8PWBZOLDUG tag=U3NV652YOSVX type=del size=496406 2023-12-03T11:42:10.403 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.402+0000 7f8723d84780 1 < suggested remove operation key=DMQX2DGDLU7D tag=2VQUIPDG2Y29 type=write 2023-12-03T11:42:10.405 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.404+0000 7f8723d84780 1 > prepared operation key=FCA2R3HR61S2 tag=Q3529Z5N66V4 type=del size=635672 2023-12-03T11:42:10.407 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.406+0000 7f8723d84780 1 < suggested remove operation key=OPQPIDJ2PBVU tag=ZX2IGIH6B9WV type=del 2023-12-03T11:42:10.409 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.408+0000 7f8723d84780 1 > prepared operation key=OGACI7CRPMT7 tag=YGGB6VKBWUXB type=del size=1898097 2023-12-03T11:42:10.410 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.409+0000 7f8723d84780 1 < canceled operation key=7VMTBKUWU59F tag=U993GEBHNO8O type=del size=1692990 2023-12-03T11:42:10.412 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.411+0000 7f8723d84780 1 > prepared part key=_multipart_K83BTR5BOLZE.2~1YBDU4M0FXC7.0 size=862573 2023-12-03T11:42:10.412 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.411+0000 7f8723d84780 1 > prepared multipart upload key=K83BTR5BOLZE upload=1YBDU4M0FXC7 tag=7K3POVSAMKZE type=write size=1911149 2023-12-03T11:42:10.414 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.413+0000 7f8723d84780 1 < completed part key=_multipart_VENJI0KD1XDW.2~0LNIYLG16YHM.0 size=1048576 2023-12-03T11:42:10.415 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.414+0000 7f8723d84780 1 < completed part key=_multipart_VENJI0KD1XDW.2~0LNIYLG16YHM.1 size=1048576 2023-12-03T11:42:10.416 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.415+0000 7f8723d84780 1 < completed part key=_multipart_VENJI0KD1XDW.2~0LNIYLG16YHM.2 size=932970 2023-12-03T11:42:10.418 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.417+0000 7f8723d84780 1 < completed multipart upload key=VENJI0KD1XDW upload=0LNIYLG16YHM tag=YNIL35KGFGK0 type=write size=4078698 2023-12-03T11:42:10.421 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.420+0000 7f8723d84780 1 > prepared part key=_multipart_O7VVHXLDSY57.2~SCE8DRYIBUU3.0 size=1048576 2023-12-03T11:42:10.422 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.421+0000 7f8723d84780 1 > prepared part key=_multipart_O7VVHXLDSY57.2~SCE8DRYIBUU3.1 size=884166 2023-12-03T11:42:10.422 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.421+0000 7f8723d84780 1 > prepared multipart upload key=O7VVHXLDSY57 upload=SCE8DRYIBUU3 tag=DJATFWL5S7XV type=write size=2981318 2023-12-03T11:42:10.424 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.423+0000 7f8723d84780 1 < suggested update operation key=O7VVHXLDSY57 tag=5XYYZQ7M0717 type=del size=2802848 2023-12-03T11:42:10.426 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.425+0000 7f8723d84780 1 > prepared operation key=W2704YS8KYQB tag=JY049N1OAXG8 type=del size=133713 2023-12-03T11:42:10.427 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.426+0000 7f8723d84780 1 < completed write operation key=CKABTI1EOAWB tag=997LQA2XGZAC type=write size=1041837 2023-12-03T11:42:10.428 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.427+0000 7f8723d84780 1 > prepared operation key=EITMJKL0LCYC tag=RM6Z9TEJUS70 type=del size=1930464 2023-12-03T11:42:10.430 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.429+0000 7f8723d84780 1 < completed part key=_multipart_AB0SN0E49Z5F.2~B21FO6QQRO70.0 size=2630 2023-12-03T11:42:10.432 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.431+0000 7f8723d84780 1 < completed multipart upload key=AB0SN0E49Z5F upload=B21FO6QQRO70 tag=UHE3Q3TNMJGX type=write size=1051206 2023-12-03T11:42:10.434 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.433+0000 7f8723d84780 1 > prepared operation key=EITMJKL0LCYC tag=XMEX0IMG0TI7 type=del size=2382598 2023-12-03T11:42:10.435 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.434+0000 7f8723d84780 1 < completed delete operation key=96RAVVSUKH0Y tag=XYB24P1ZIAFP type=del 2023-12-03T11:42:10.437 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.436+0000 7f8723d84780 1 > prepared operation key=AB0SN0E49Z5F tag=J6XA0FZU143B type=del size=1092217 2023-12-03T11:42:10.438 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.437+0000 7f8723d84780 -1 < failed to complete operation key=931GNEXBHH35 tag=IE7O7PCTEK30 type=del size=2053386: (22) Invalid argument 2023-12-03T11:42:10.439 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.438+0000 7f8723d84780 1 > prepared operation key=O7VVHXLDSY57 tag=M3O7V0SLFJH6 type=del size=3913588 2023-12-03T11:42:10.441 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.440+0000 7f8723d84780 1 < completed delete operation key=FCA2R3HR61S2 tag=W9I9V64M1FRE type=del 2023-12-03T11:42:10.443 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.442+0000 7f8723d84780 1 > prepared part key=_multipart_5UYL15O31IHM.2~KGC7LMSZA96K.0 size=1048576 2023-12-03T11:42:10.444 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.443+0000 7f8723d84780 1 > prepared part key=_multipart_5UYL15O31IHM.2~KGC7LMSZA96K.1 size=693356 2023-12-03T11:42:10.444 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.443+0000 7f8723d84780 1 > prepared multipart upload key=5UYL15O31IHM upload=KGC7LMSZA96K tag=HO7U55H2JU83 type=write size=2790508 2023-12-03T11:42:10.445 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.444+0000 7f8723d84780 1 < canceled operation key=G36T76K8O7A1 tag=F2H0EWO7RPJV type=del size=2742325 2023-12-03T11:42:10.447 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.446+0000 7f8723d84780 1 > prepared operation key=VENJI0KD1XDW tag=TAFE45LT9QT5 type=del size=3113309 2023-12-03T11:42:10.448 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.447+0000 7f8723d84780 1 < completed part key=_multipart_LMVO6CVEPN3K.2~ID197TR8CULN.0 size=1012087 2023-12-03T11:42:10.450 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.449+0000 7f8723d84780 1 < completed multipart upload key=LMVO6CVEPN3K upload=ID197TR8CULN tag=9Y9SF6Y33VWL type=write size=2060663 2023-12-03T11:42:10.451 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.450+0000 7f8723d84780 1 > prepared operation key=HIU6L0NQ8Q95 tag=TP5UA9MN0AJ0 type=write size=441728 2023-12-03T11:42:10.452 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.451+0000 7f8723d84780 1 < completed part key=_multipart_G36T76K8O7A1.2~L7T51AN0CY4Z.0 size=1048576 2023-12-03T11:42:10.453 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.452+0000 7f8723d84780 1 < completed part key=_multipart_G36T76K8O7A1.2~L7T51AN0CY4Z.1 size=1048576 2023-12-03T11:42:10.456 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.455+0000 7f8723d84780 1 < completed part key=_multipart_G36T76K8O7A1.2~L7T51AN0CY4Z.2 size=206214 2023-12-03T11:42:10.458 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.457+0000 7f8723d84780 1 < completed multipart upload key=G36T76K8O7A1 upload=L7T51AN0CY4Z tag=CKG0SP40PREX type=write size=3351942 2023-12-03T11:42:10.459 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.458+0000 7f8723d84780 1 > prepared operation key=HIU6L0NQ8Q95 tag=78ADQK6XB0IN type=write size=551150 2023-12-03T11:42:10.460 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.459+0000 7f8723d84780 1 < completed part key=_multipart_KS5J7E7KE2IJ.2~7RHURCHFVDES.0 size=729119 2023-12-03T11:42:10.463 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.461+0000 7f8723d84780 1 < completed multipart upload key=KS5J7E7KE2IJ upload=7RHURCHFVDES tag=Y5JGY8RTXW95 type=write size=1777695 2023-12-03T11:42:10.465 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.464+0000 7f8723d84780 1 > prepared part key=_multipart_4I8PWBZOLDUG.2~O3IO6KZ0D4GX.0 size=1048576 2023-12-03T11:42:10.466 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.465+0000 7f8723d84780 1 > prepared part key=_multipart_4I8PWBZOLDUG.2~O3IO6KZ0D4GX.1 size=130424 2023-12-03T11:42:10.466 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.465+0000 7f8723d84780 1 > prepared multipart upload key=4I8PWBZOLDUG upload=O3IO6KZ0D4GX tag=40QT6TYBNZZB type=write size=2227576 2023-12-03T11:42:10.467 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.466+0000 7f8723d84780 1 < completed write operation key=931GNEXBHH35 tag=BZ2UWTX05N2R type=write size=650262 2023-12-03T11:42:10.469 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.468+0000 7f8723d84780 1 > prepared part key=_multipart_8NONX2I08YMJ.2~HK2A9S3LZTD1.0 size=1048576 2023-12-03T11:42:10.470 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.469+0000 7f8723d84780 1 > prepared part key=_multipart_8NONX2I08YMJ.2~HK2A9S3LZTD1.1 size=1048576 2023-12-03T11:42:10.471 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.470+0000 7f8723d84780 1 > prepared part key=_multipart_8NONX2I08YMJ.2~HK2A9S3LZTD1.2 size=997985 2023-12-03T11:42:10.471 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.470+0000 7f8723d84780 1 > prepared multipart upload key=8NONX2I08YMJ upload=HK2A9S3LZTD1 tag=9PHVHUYY9KC7 type=write size=4143713 2023-12-03T11:42:10.472 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.471+0000 7f8723d84780 1 < completed delete operation key=4I8PWBZOLDUG tag=U3NV652YOSVX type=del 2023-12-03T11:42:10.474 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.473+0000 7f8723d84780 1 > prepared part key=_multipart_96RAVVSUKH0Y.2~ZUUFMAC02DWN.0 size=1048576 2023-12-03T11:42:10.475 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.474+0000 7f8723d84780 1 > prepared part key=_multipart_96RAVVSUKH0Y.2~ZUUFMAC02DWN.1 size=301079 2023-12-03T11:42:10.475 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.474+0000 7f8723d84780 1 > prepared multipart upload key=96RAVVSUKH0Y upload=ZUUFMAC02DWN tag=2KWNRF5YSX5A type=write size=2398231 2023-12-03T11:42:10.478 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.477+0000 7f8723d84780 1 < suggested update operation key=FCA2R3HR61S2 tag=Q3529Z5N66V4 type=del size=635672 2023-12-03T11:42:10.480 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.479+0000 7f8723d84780 1 > prepared part key=_multipart_M4VKPN6INFNZ.2~ZNOJSE68Z05V.0 size=1048576 2023-12-03T11:42:10.481 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.480+0000 7f8723d84780 1 > prepared part key=_multipart_M4VKPN6INFNZ.2~ZNOJSE68Z05V.1 size=636824 2023-12-03T11:42:10.481 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.480+0000 7f8723d84780 1 > prepared multipart upload key=M4VKPN6INFNZ upload=ZNOJSE68Z05V tag=W5RZYENZEUWT type=write size=2733976 2023-12-03T11:42:10.482 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.481+0000 7f8723d84780 1 < completed delete operation key=OGACI7CRPMT7 tag=YGGB6VKBWUXB type=del 2023-12-03T11:42:10.484 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.483+0000 7f8723d84780 1 > prepared part key=_multipart_8NONX2I08YMJ.2~HEM72VZ6CKCR.0 size=1048576 2023-12-03T11:42:10.485 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.484+0000 7f8723d84780 1 > prepared part key=_multipart_8NONX2I08YMJ.2~HEM72VZ6CKCR.1 size=252689 2023-12-03T11:42:10.485 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.484+0000 7f8723d84780 1 > prepared multipart upload key=8NONX2I08YMJ upload=HEM72VZ6CKCR tag=YJOFFND2HLK8 type=write size=2349841 2023-12-03T11:42:10.486 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.485+0000 7f8723d84780 1 < completed part key=_multipart_K83BTR5BOLZE.2~1YBDU4M0FXC7.0 size=862573 2023-12-03T11:42:10.488 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.487+0000 7f8723d84780 1 < completed multipart upload key=K83BTR5BOLZE upload=1YBDU4M0FXC7 tag=7K3POVSAMKZE type=write size=1911149 2023-12-03T11:42:10.489 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.488+0000 7f8723d84780 1 > prepared operation key=K83BTR5BOLZE tag=UATSZQ9507YF type=del size=134316 2023-12-03T11:42:10.490 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.489+0000 7f8723d84780 1 < completed part key=_multipart_O7VVHXLDSY57.2~SCE8DRYIBUU3.0 size=1048576 2023-12-03T11:42:10.491 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.490+0000 7f8723d84780 1 < completed part key=_multipart_O7VVHXLDSY57.2~SCE8DRYIBUU3.1 size=884166 2023-12-03T11:42:10.494 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.493+0000 7f8723d84780 1 < completed multipart upload key=O7VVHXLDSY57 upload=SCE8DRYIBUU3 tag=DJATFWL5S7XV type=write size=2981318 2023-12-03T11:42:10.498 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.494+0000 7f8723d84780 1 > prepared operation key=931GNEXBHH35 tag=BGDWM5A9YFVN type=del size=811223 2023-12-03T11:42:10.498 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.495+0000 7f8723d84780 1 < completed delete operation key=W2704YS8KYQB tag=JY049N1OAXG8 type=del 2023-12-03T11:42:10.498 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.496+0000 7f8723d84780 1 > prepared operation key=LCK58DDM5XU9 tag=61FY67ROOC0N type=del size=3821516 2023-12-03T11:42:10.500 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.499+0000 7f8723d84780 1 < suggested remove operation key=EITMJKL0LCYC tag=RM6Z9TEJUS70 type=del 2023-12-03T11:42:10.503 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.500+0000 7f8723d84780 1 > prepared operation key=7THZZ1J5LOZK tag=GU0TH07KIUB4 type=del size=3380323 2023-12-03T11:42:10.503 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.501+0000 7f8723d84780 -1 < failed to complete operation key=EITMJKL0LCYC tag=XMEX0IMG0TI7 type=del size=2382598: (22) Invalid argument 2023-12-03T11:42:10.504 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.503+0000 7f8723d84780 1 > prepared part key=_multipart_5UYL15O31IHM.2~V9GNU1CF4ZBB.0 size=1048576 2023-12-03T11:42:10.505 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.504+0000 7f8723d84780 1 > prepared part key=_multipart_5UYL15O31IHM.2~V9GNU1CF4ZBB.1 size=1048576 2023-12-03T11:42:10.506 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.505+0000 7f8723d84780 1 > prepared part key=_multipart_5UYL15O31IHM.2~V9GNU1CF4ZBB.2 size=690402 2023-12-03T11:42:10.506 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.505+0000 7f8723d84780 1 > prepared multipart upload key=5UYL15O31IHM upload=V9GNU1CF4ZBB tag=HTQ03H2HOPER type=write size=3836130 2023-12-03T11:42:10.507 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.506+0000 7f8723d84780 1 < completed delete operation key=AB0SN0E49Z5F tag=J6XA0FZU143B type=del 2023-12-03T11:42:10.508 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.507+0000 7f8723d84780 1 > prepared operation key=KS5J7E7KE2IJ tag=8FZ2JEHJ2LFS type=write size=110002 2023-12-03T11:42:10.510 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.509+0000 7f8723d84780 1 < completed delete operation key=O7VVHXLDSY57 tag=M3O7V0SLFJH6 type=del 2023-12-03T11:42:10.511 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.510+0000 7f8723d84780 1 > prepared operation key=W2704YS8KYQB tag=EQOO0V0LXLQY type=del size=1268217 2023-12-03T11:42:10.512 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.511+0000 7f8723d84780 1 < completed part key=_multipart_5UYL15O31IHM.2~KGC7LMSZA96K.0 size=1048576 2023-12-03T11:42:10.513 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.512+0000 7f8723d84780 1 < completed part key=_multipart_5UYL15O31IHM.2~KGC7LMSZA96K.1 size=693356 2023-12-03T11:42:10.515 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.514+0000 7f8723d84780 1 < completed multipart upload key=5UYL15O31IHM upload=KGC7LMSZA96K tag=HO7U55H2JU83 type=write size=2790508 2023-12-03T11:42:10.516 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.515+0000 7f8723d84780 1 > prepared operation key=AB0SN0E49Z5F tag=28BE3BIV0CNL type=del size=1645750 2023-12-03T11:42:10.517 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.516+0000 7f8723d84780 1 < completed delete operation key=VENJI0KD1XDW tag=TAFE45LT9QT5 type=del 2023-12-03T11:42:10.518 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.517+0000 7f8723d84780 1 > prepared operation key=KS5J7E7KE2IJ tag=NQZ2LMTA9WL5 type=del size=2737461 2023-12-03T11:42:10.520 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.519+0000 7f8723d84780 1 < completed write operation key=HIU6L0NQ8Q95 tag=TP5UA9MN0AJ0 type=write size=441728 2023-12-03T11:42:10.521 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.520+0000 7f8723d84780 1 > prepared operation key=G36T76K8O7A1 tag=0W80GPU194X5 type=del size=2425790 2023-12-03T11:42:10.522 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.521+0000 7f8723d84780 1 < completed write operation key=HIU6L0NQ8Q95 tag=78ADQK6XB0IN type=write size=551150 2023-12-03T11:42:10.523 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.522+0000 7f8723d84780 1 > prepared operation key=D3JEVEY0E29E tag=KWN00TSCYJH8 type=write size=210976 2023-12-03T11:42:10.525 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.524+0000 7f8723d84780 1 < completed part key=_multipart_4I8PWBZOLDUG.2~O3IO6KZ0D4GX.0 size=1048576 2023-12-03T11:42:10.525 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.524+0000 7f8723d84780 1 < canceled part key=_multipart_4I8PWBZOLDUG.2~O3IO6KZ0D4GX.1 size=130424 2023-12-03T11:42:10.527 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.526+0000 7f8723d84780 1 < canceled multipart upload key=4I8PWBZOLDUG upload=O3IO6KZ0D4GX tag=40QT6TYBNZZB type=write size=2227576 2023-12-03T11:42:10.529 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.528+0000 7f8723d84780 1 > prepared part key=_multipart_LCK58DDM5XU9.2~VYU0RXUGL6J7.0 size=230502 2023-12-03T11:42:10.529 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.528+0000 7f8723d84780 1 > prepared multipart upload key=LCK58DDM5XU9 upload=VYU0RXUGL6J7 tag=ZRPBM6BVAUIS type=write size=1279078 2023-12-03T11:42:10.530 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.529+0000 7f8723d84780 1 < completed part key=_multipart_8NONX2I08YMJ.2~HK2A9S3LZTD1.0 size=1048576 2023-12-03T11:42:10.531 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.530+0000 7f8723d84780 1 < completed part key=_multipart_8NONX2I08YMJ.2~HK2A9S3LZTD1.1 size=1048576 2023-12-03T11:42:10.531 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.530+0000 7f8723d84780 1 < canceled part key=_multipart_8NONX2I08YMJ.2~HK2A9S3LZTD1.2 size=997985 2023-12-03T11:42:10.533 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.532+0000 7f8723d84780 1 < canceled multipart upload key=8NONX2I08YMJ upload=HK2A9S3LZTD1 tag=9PHVHUYY9KC7 type=write size=4143713 2023-12-03T11:42:10.535 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.534+0000 7f8723d84780 1 > prepared operation key=96RAVVSUKH0Y tag=K6NPDFSDI8H3 type=del size=2622800 2023-12-03T11:42:10.536 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.535+0000 7f8723d84780 1 < completed part key=_multipart_96RAVVSUKH0Y.2~ZUUFMAC02DWN.0 size=1048576 2023-12-03T11:42:10.537 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.536+0000 7f8723d84780 1 < completed part key=_multipart_96RAVVSUKH0Y.2~ZUUFMAC02DWN.1 size=301079 2023-12-03T11:42:10.539 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.538+0000 7f8723d84780 1 < completed multipart upload key=96RAVVSUKH0Y upload=ZUUFMAC02DWN tag=2KWNRF5YSX5A type=write size=2398231 2023-12-03T11:42:10.540 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.539+0000 7f8723d84780 1 > prepared operation key=OGACI7CRPMT7 tag=2KPSTSA1IXQM type=del size=3478745 2023-12-03T11:42:10.542 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.541+0000 7f8723d84780 1 < completed part key=_multipart_M4VKPN6INFNZ.2~ZNOJSE68Z05V.0 size=1048576 2023-12-03T11:42:10.542 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.541+0000 7f8723d84780 1 < canceled part key=_multipart_M4VKPN6INFNZ.2~ZNOJSE68Z05V.1 size=636824 2023-12-03T11:42:10.544 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.543+0000 7f8723d84780 1 < canceled multipart upload key=M4VKPN6INFNZ upload=ZNOJSE68Z05V tag=W5RZYENZEUWT type=write size=2733976 2023-12-03T11:42:10.545 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.544+0000 7f8723d84780 1 > prepared operation key=TSTIBGVYUZZZ tag=9VR1C22056RX type=del size=807227 2023-12-03T11:42:10.546 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.545+0000 7f8723d84780 1 < completed part key=_multipart_8NONX2I08YMJ.2~HEM72VZ6CKCR.0 size=1048576 2023-12-03T11:42:10.546 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.545+0000 7f8723d84780 1 < canceled part key=_multipart_8NONX2I08YMJ.2~HEM72VZ6CKCR.1 size=252689 2023-12-03T11:42:10.548 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.547+0000 7f8723d84780 1 < canceled multipart upload key=8NONX2I08YMJ upload=HEM72VZ6CKCR tag=YJOFFND2HLK8 type=write size=2349841 2023-12-03T11:42:10.550 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.549+0000 7f8723d84780 1 > prepared part key=_multipart_W2704YS8KYQB.2~RXTOKI1UM2UW.0 size=1048576 2023-12-03T11:42:10.551 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.550+0000 7f8723d84780 1 > prepared part key=_multipart_W2704YS8KYQB.2~RXTOKI1UM2UW.1 size=437453 2023-12-03T11:42:10.551 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.550+0000 7f8723d84780 1 > prepared multipart upload key=W2704YS8KYQB upload=RXTOKI1UM2UW tag=343IZPV2V0GM type=write size=2534605 2023-12-03T11:42:10.552 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.551+0000 7f8723d84780 1 < completed delete operation key=K83BTR5BOLZE tag=UATSZQ9507YF type=del 2023-12-03T11:42:10.555 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.554+0000 7f8723d84780 1 > prepared part key=_multipart_OPQPIDJ2PBVU.2~2S07L6ZUSEAU.0 size=1048576 2023-12-03T11:42:10.556 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.555+0000 7f8723d84780 1 > prepared part key=_multipart_OPQPIDJ2PBVU.2~2S07L6ZUSEAU.1 size=1048576 2023-12-03T11:42:10.556 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.556+0000 7f8723d84780 1 > prepared part key=_multipart_OPQPIDJ2PBVU.2~2S07L6ZUSEAU.2 size=311309 2023-12-03T11:42:10.557 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.556+0000 7f8723d84780 1 > prepared multipart upload key=OPQPIDJ2PBVU upload=2S07L6ZUSEAU tag=H2HYRTZANF2J type=write size=3457037 2023-12-03T11:42:10.558 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.557+0000 7f8723d84780 1 < completed delete operation key=931GNEXBHH35 tag=BGDWM5A9YFVN type=del 2023-12-03T11:42:10.560 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.559+0000 7f8723d84780 1 > prepared part key=_multipart_TSTIBGVYUZZZ.2~OP6DX334ZTQC.0 size=1048576 2023-12-03T11:42:10.561 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.560+0000 7f8723d84780 1 > prepared part key=_multipart_TSTIBGVYUZZZ.2~OP6DX334ZTQC.1 size=1048576 2023-12-03T11:42:10.562 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.561+0000 7f8723d84780 1 > prepared part key=_multipart_TSTIBGVYUZZZ.2~OP6DX334ZTQC.2 size=554219 2023-12-03T11:42:10.562 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.561+0000 7f8723d84780 1 > prepared multipart upload key=TSTIBGVYUZZZ upload=OP6DX334ZTQC tag=BKSJA8TBZPJS type=write size=3699947 2023-12-03T11:42:10.565 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.564+0000 7f8723d84780 1 < suggested update operation key=LCK58DDM5XU9 tag=61FY67ROOC0N type=del size=3821516 2023-12-03T11:42:10.568 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.567+0000 7f8723d84780 1 > prepared part key=_multipart_5UYL15O31IHM.2~WT5G69NQNGXK.0 size=1011002 2023-12-03T11:42:10.568 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.567+0000 7f8723d84780 1 > prepared multipart upload key=5UYL15O31IHM upload=WT5G69NQNGXK tag=YAJFOU2T8RW2 type=write size=2059578 2023-12-03T11:42:10.570 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.569+0000 7f8723d84780 1 < completed delete operation key=7THZZ1J5LOZK tag=GU0TH07KIUB4 type=del 2023-12-03T11:42:10.571 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.570+0000 7f8723d84780 1 > prepared operation key=7THZZ1J5LOZK tag=IDS5W6VHHH1F type=write size=912872 2023-12-03T11:42:10.572 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.571+0000 7f8723d84780 1 < completed part key=_multipart_5UYL15O31IHM.2~V9GNU1CF4ZBB.0 size=1048576 2023-12-03T11:42:10.572 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.571+0000 7f8723d84780 1 < canceled part key=_multipart_5UYL15O31IHM.2~V9GNU1CF4ZBB.1 size=1048576 2023-12-03T11:42:10.573 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.572+0000 7f8723d84780 1 < completed part key=_multipart_5UYL15O31IHM.2~V9GNU1CF4ZBB.2 size=690402 2023-12-03T11:42:10.575 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.574+0000 7f8723d84780 1 < canceled multipart upload key=5UYL15O31IHM upload=V9GNU1CF4ZBB tag=HTQ03H2HOPER type=write size=3836130 2023-12-03T11:42:10.577 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.576+0000 7f8723d84780 1 > prepared operation key=LMVO6CVEPN3K tag=00IXQXF374A9 type=del size=1663142 2023-12-03T11:42:10.578 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.577+0000 7f8723d84780 1 < completed write operation key=KS5J7E7KE2IJ tag=8FZ2JEHJ2LFS type=write size=110002 2023-12-03T11:42:10.580 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.579+0000 7f8723d84780 1 > prepared part key=_multipart_J33T5S893LMV.2~569L1HMXFEOQ.0 size=1048576 2023-12-03T11:42:10.581 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.580+0000 7f8723d84780 1 > prepared part key=_multipart_J33T5S893LMV.2~569L1HMXFEOQ.1 size=368374 2023-12-03T11:42:10.581 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.580+0000 7f8723d84780 1 > prepared multipart upload key=J33T5S893LMV upload=569L1HMXFEOQ tag=BPT5P1MWXEOD type=write size=2465526 2023-12-03T11:42:10.583 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.582+0000 7f8723d84780 1 < completed delete operation key=W2704YS8KYQB tag=EQOO0V0LXLQY type=del 2023-12-03T11:42:10.584 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.583+0000 7f8723d84780 1 > prepared operation key=D3JEVEY0E29E tag=696F2FS93MRJ type=del size=2156402 2023-12-03T11:42:10.585 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.584+0000 7f8723d84780 1 < canceled operation key=AB0SN0E49Z5F tag=28BE3BIV0CNL type=del size=1645750 2023-12-03T11:42:10.586 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.585+0000 7f8723d84780 1 > prepared operation key=FCA2R3HR61S2 tag=F5D674I70ZWA type=del size=1666600 2023-12-03T11:42:10.588 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.587+0000 7f8723d84780 1 < suggested update operation key=KS5J7E7KE2IJ tag=NQZ2LMTA9WL5 type=del size=2737461 2023-12-03T11:42:10.591 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.590+0000 7f8723d84780 1 > prepared part key=_multipart_W2704YS8KYQB.2~MSEU2MOW2PIB.0 size=1048576 2023-12-03T11:42:10.592 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.591+0000 7f8723d84780 1 > prepared part key=_multipart_W2704YS8KYQB.2~MSEU2MOW2PIB.1 size=339764 2023-12-03T11:42:10.592 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.591+0000 7f8723d84780 1 > prepared multipart upload key=W2704YS8KYQB upload=MSEU2MOW2PIB tag=TGXCIB9IBBYE type=write size=2436916 2023-12-03T11:42:10.593 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.592+0000 7f8723d84780 1 < completed delete operation key=G36T76K8O7A1 tag=0W80GPU194X5 type=del 2023-12-03T11:42:10.594 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.593+0000 7f8723d84780 1 > prepared operation key=LMVO6CVEPN3K tag=Q7GL9ORBE670 type=del size=3912010 2023-12-03T11:42:10.597 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.596+0000 7f8723d84780 1 < suggested remove operation key=D3JEVEY0E29E tag=KWN00TSCYJH8 type=write 2023-12-03T11:42:10.598 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.597+0000 7f8723d84780 1 > prepared operation key=10JRIKOZ16FY tag=ABCDX2VHZGPN type=del size=2855832 2023-12-03T11:42:10.600 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.599+0000 7f8723d84780 1 < completed part key=_multipart_LCK58DDM5XU9.2~VYU0RXUGL6J7.0 size=230502 2023-12-03T11:42:10.602 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.601+0000 7f8723d84780 1 < completed multipart upload key=LCK58DDM5XU9 upload=VYU0RXUGL6J7 tag=ZRPBM6BVAUIS type=write size=1279078 2023-12-03T11:42:10.603 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.602+0000 7f8723d84780 1 > prepared operation key=931GNEXBHH35 tag=92UVJMIGAAS1 type=write size=333133 2023-12-03T11:42:10.605 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.604+0000 7f8723d84780 1 < suggested remove operation key=96RAVVSUKH0Y tag=K6NPDFSDI8H3 type=del 2023-12-03T11:42:10.608 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.606+0000 7f8723d84780 1 > prepared part key=_multipart_D3JEVEY0E29E.2~29K1NLBB8I26.0 size=1048576 2023-12-03T11:42:10.608 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.607+0000 7f8723d84780 1 > prepared part key=_multipart_D3JEVEY0E29E.2~29K1NLBB8I26.1 size=1022993 2023-12-03T11:42:10.608 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.607+0000 7f8723d84780 1 > prepared multipart upload key=D3JEVEY0E29E upload=29K1NLBB8I26 tag=DCTTE75J10WN type=write size=3120145 2023-12-03T11:42:10.609 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.608+0000 7f8723d84780 1 < completed delete operation key=OGACI7CRPMT7 tag=2KPSTSA1IXQM type=del 2023-12-03T11:42:10.612 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.611+0000 7f8723d84780 1 > prepared part key=_multipart_O7VVHXLDSY57.2~U1EUJSMII67J.0 size=1048576 2023-12-03T11:42:10.612 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.611+0000 7f8723d84780 1 > prepared part key=_multipart_O7VVHXLDSY57.2~U1EUJSMII67J.1 size=973788 2023-12-03T11:42:10.613 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.611+0000 7f8723d84780 1 > prepared multipart upload key=O7VVHXLDSY57 upload=U1EUJSMII67J tag=1J4ZFR9SQJU2 type=write size=3070940 2023-12-03T11:42:10.614 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.613+0000 7f8723d84780 1 < completed delete operation key=TSTIBGVYUZZZ tag=9VR1C22056RX type=del 2023-12-03T11:42:10.615 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.614+0000 7f8723d84780 1 > prepared operation key=J33T5S893LMV tag=UC2528VOJNBP type=del size=2067060 2023-12-03T11:42:10.616 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.615+0000 7f8723d84780 1 < completed part key=_multipart_W2704YS8KYQB.2~RXTOKI1UM2UW.0 size=1048576 2023-12-03T11:42:10.617 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.616+0000 7f8723d84780 1 < completed part key=_multipart_W2704YS8KYQB.2~RXTOKI1UM2UW.1 size=437453 2023-12-03T11:42:10.619 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.618+0000 7f8723d84780 1 < completed multipart upload key=W2704YS8KYQB upload=RXTOKI1UM2UW tag=343IZPV2V0GM type=write size=2534605 2023-12-03T11:42:10.621 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.620+0000 7f8723d84780 1 > prepared operation key=EITMJKL0LCYC tag=8VGOLQ4X7GVF type=del size=2882565 2023-12-03T11:42:10.622 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.621+0000 7f8723d84780 1 < completed part key=_multipart_OPQPIDJ2PBVU.2~2S07L6ZUSEAU.0 size=1048576 2023-12-03T11:42:10.623 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.622+0000 7f8723d84780 1 < completed part key=_multipart_OPQPIDJ2PBVU.2~2S07L6ZUSEAU.1 size=1048576 2023-12-03T11:42:10.624 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.623+0000 7f8723d84780 1 < completed part key=_multipart_OPQPIDJ2PBVU.2~2S07L6ZUSEAU.2 size=311309 2023-12-03T11:42:10.626 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.625+0000 7f8723d84780 1 < completed multipart upload key=OPQPIDJ2PBVU upload=2S07L6ZUSEAU tag=H2HYRTZANF2J type=write size=3457037 2023-12-03T11:42:10.627 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.626+0000 7f8723d84780 1 > prepared operation key=KS5J7E7KE2IJ tag=41EQ4D2Q2Z73 type=del size=4170979 2023-12-03T11:42:10.628 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.627+0000 7f8723d84780 1 < completed part key=_multipart_TSTIBGVYUZZZ.2~OP6DX334ZTQC.0 size=1048576 2023-12-03T11:42:10.629 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.628+0000 7f8723d84780 1 < completed part key=_multipart_TSTIBGVYUZZZ.2~OP6DX334ZTQC.1 size=1048576 2023-12-03T11:42:10.630 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.628+0000 7f8723d84780 1 < canceled part key=_multipart_TSTIBGVYUZZZ.2~OP6DX334ZTQC.2 size=554219 2023-12-03T11:42:10.631 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.630+0000 7f8723d84780 1 < canceled multipart upload key=TSTIBGVYUZZZ upload=OP6DX334ZTQC tag=BKSJA8TBZPJS type=write size=3699947 2023-12-03T11:42:10.634 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.633+0000 7f8723d84780 1 > prepared part key=_multipart_K83BTR5BOLZE.2~5PX7NDI71SS5.0 size=1048576 2023-12-03T11:42:10.635 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.634+0000 7f8723d84780 1 > prepared part key=_multipart_K83BTR5BOLZE.2~5PX7NDI71SS5.1 size=1048576 2023-12-03T11:42:10.635 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.634+0000 7f8723d84780 1 > prepared part key=_multipart_K83BTR5BOLZE.2~5PX7NDI71SS5.2 size=704462 2023-12-03T11:42:10.636 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.634+0000 7f8723d84780 1 > prepared multipart upload key=K83BTR5BOLZE upload=5PX7NDI71SS5 tag=38VYRM3A5MWY type=write size=3850190 2023-12-03T11:42:10.637 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.636+0000 7f8723d84780 1 < completed part key=_multipart_5UYL15O31IHM.2~WT5G69NQNGXK.0 size=1011002 2023-12-03T11:42:10.639 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.638+0000 7f8723d84780 1 < completed multipart upload key=5UYL15O31IHM upload=WT5G69NQNGXK tag=YAJFOU2T8RW2 type=write size=2059578 2023-12-03T11:42:10.641 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.640+0000 7f8723d84780 1 > prepared part key=_multipart_7VMTBKUWU59F.2~W8CLM34NRTEW.0 size=292639 2023-12-03T11:42:10.641 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.640+0000 7f8723d84780 1 > prepared multipart upload key=7VMTBKUWU59F upload=W8CLM34NRTEW tag=ILQJYUBDUMU4 type=write size=1341215 2023-12-03T11:42:10.642 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.641+0000 7f8723d84780 1 < completed write operation key=7THZZ1J5LOZK tag=IDS5W6VHHH1F type=write size=912872 2023-12-03T11:42:10.643 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.642+0000 7f8723d84780 1 > prepared operation key=7THZZ1J5LOZK tag=FT907G8HGITN type=del size=3304048 2023-12-03T11:42:10.644 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.643+0000 7f8723d84780 1 < completed delete operation key=LMVO6CVEPN3K tag=00IXQXF374A9 type=del 2023-12-03T11:42:10.646 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.645+0000 7f8723d84780 1 > prepared operation key=TSTIBGVYUZZZ tag=SI9EALP9ZRV7 type=del size=3491263 2023-12-03T11:42:10.647 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.646+0000 7f8723d84780 1 < completed part key=_multipart_J33T5S893LMV.2~569L1HMXFEOQ.0 size=1048576 2023-12-03T11:42:10.648 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.647+0000 7f8723d84780 1 < completed part key=_multipart_J33T5S893LMV.2~569L1HMXFEOQ.1 size=368374 2023-12-03T11:42:10.650 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.649+0000 7f8723d84780 1 < completed multipart upload key=J33T5S893LMV upload=569L1HMXFEOQ tag=BPT5P1MWXEOD type=write size=2465526 2023-12-03T11:42:10.652 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.651+0000 7f8723d84780 1 > prepared part key=_multipart_96RAVVSUKH0Y.2~1UM01WRZK0OA.0 size=93015 2023-12-03T11:42:10.652 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.651+0000 7f8723d84780 1 > prepared multipart upload key=96RAVVSUKH0Y upload=1UM01WRZK0OA tag=1ZVIF82BW6PW type=write size=1141591 2023-12-03T11:42:10.653 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.652+0000 7f8723d84780 -1 < failed to complete operation key=D3JEVEY0E29E tag=696F2FS93MRJ type=del size=2156402: (22) Invalid argument 2023-12-03T11:42:10.655 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.654+0000 7f8723d84780 1 > prepared part key=_multipart_VENJI0KD1XDW.2~JOP2KIN9I2YR.0 size=440165 2023-12-03T11:42:10.655 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.654+0000 7f8723d84780 1 > prepared multipart upload key=VENJI0KD1XDW upload=JOP2KIN9I2YR tag=D51JW8IKVAGR type=write size=1488741 2023-12-03T11:42:10.656 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.655+0000 7f8723d84780 1 < completed delete operation key=FCA2R3HR61S2 tag=F5D674I70ZWA type=del 2023-12-03T11:42:10.658 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.657+0000 7f8723d84780 1 > prepared operation key=LMVO6CVEPN3K tag=2BHO08IA11JD type=del size=3534333 2023-12-03T11:42:10.659 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.658+0000 7f8723d84780 1 < completed part key=_multipart_W2704YS8KYQB.2~MSEU2MOW2PIB.0 size=1048576 2023-12-03T11:42:10.660 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.659+0000 7f8723d84780 1 < completed part key=_multipart_W2704YS8KYQB.2~MSEU2MOW2PIB.1 size=339764 2023-12-03T11:42:10.662 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.661+0000 7f8723d84780 1 < completed multipart upload key=W2704YS8KYQB upload=MSEU2MOW2PIB tag=TGXCIB9IBBYE type=write size=2436916 2023-12-03T11:42:10.663 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.662+0000 7f8723d84780 1 > prepared operation key=LCK58DDM5XU9 tag=6RHXLZD4MFHA type=del size=1807575 2023-12-03T11:42:10.665 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.664+0000 7f8723d84780 1 < completed delete operation key=LMVO6CVEPN3K tag=Q7GL9ORBE670 type=del 2023-12-03T11:42:10.667 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.666+0000 7f8723d84780 1 > prepared part key=_multipart_K83BTR5BOLZE.2~CSQSP2T99MMW.0 size=1048576 2023-12-03T11:42:10.668 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.667+0000 7f8723d84780 1 > prepared part key=_multipart_K83BTR5BOLZE.2~CSQSP2T99MMW.1 size=565757 2023-12-03T11:42:10.668 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.667+0000 7f8723d84780 1 > prepared multipart upload key=K83BTR5BOLZE upload=CSQSP2T99MMW tag=1JMFWSGMX3J0 type=write size=2662909 2023-12-03T11:42:10.671 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.668+0000 7f8723d84780 1 < completed delete operation key=10JRIKOZ16FY tag=ABCDX2VHZGPN type=del 2023-12-03T11:42:10.671 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.669+0000 7f8723d84780 1 > prepared operation key=AB0SN0E49Z5F tag=4LXL06C2BUZ4 type=del size=4179847 2023-12-03T11:42:10.672 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.671+0000 7f8723d84780 1 < completed write operation key=931GNEXBHH35 tag=92UVJMIGAAS1 type=write size=333133 2023-12-03T11:42:10.674 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.673+0000 7f8723d84780 1 > prepared part key=_multipart_7VMTBKUWU59F.2~7LO7OYF31ROB.0 size=559362 2023-12-03T11:42:10.674 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.673+0000 7f8723d84780 1 > prepared multipart upload key=7VMTBKUWU59F upload=7LO7OYF31ROB tag=RS3BH4JNU53J type=write size=1607938 2023-12-03T11:42:10.675 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.674+0000 7f8723d84780 1 < completed part key=_multipart_D3JEVEY0E29E.2~29K1NLBB8I26.0 size=1048576 2023-12-03T11:42:10.676 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.675+0000 7f8723d84780 1 < completed part key=_multipart_D3JEVEY0E29E.2~29K1NLBB8I26.1 size=1022993 2023-12-03T11:42:10.678 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.677+0000 7f8723d84780 1 < completed multipart upload key=D3JEVEY0E29E upload=29K1NLBB8I26 tag=DCTTE75J10WN type=write size=3120145 2023-12-03T11:42:10.679 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.678+0000 7f8723d84780 1 > prepared operation key=W2704YS8KYQB tag=DC5MHU8GK60C type=del size=3289202 2023-12-03T11:42:10.680 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.679+0000 7f8723d84780 1 < completed part key=_multipart_O7VVHXLDSY57.2~U1EUJSMII67J.0 size=1048576 2023-12-03T11:42:10.683 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.682+0000 7f8723d84780 1 < completed part key=_multipart_O7VVHXLDSY57.2~U1EUJSMII67J.1 size=973788 2023-12-03T11:42:10.685 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.684+0000 7f8723d84780 1 < completed multipart upload key=O7VVHXLDSY57 upload=U1EUJSMII67J tag=1J4ZFR9SQJU2 type=write size=3070940 2023-12-03T11:42:10.686 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.685+0000 7f8723d84780 1 > prepared operation key=OPQPIDJ2PBVU tag=SNOL7PJPV03C type=write size=243224 2023-12-03T11:42:10.687 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.686+0000 7f8723d84780 1 < completed delete operation key=J33T5S893LMV tag=UC2528VOJNBP type=del 2023-12-03T11:42:10.689 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.688+0000 7f8723d84780 1 > prepared operation key=TSTIBGVYUZZZ tag=6N04PZHE6P6M type=del size=2778659 2023-12-03T11:42:10.690 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.689+0000 7f8723d84780 1 < completed delete operation key=EITMJKL0LCYC tag=8VGOLQ4X7GVF type=del 2023-12-03T11:42:10.692 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.691+0000 7f8723d84780 1 > prepared part key=_multipart_7THZZ1J5LOZK.2~UGDS0XW8R3WQ.0 size=14028 2023-12-03T11:42:10.692 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.691+0000 7f8723d84780 1 > prepared multipart upload key=7THZZ1J5LOZK upload=UGDS0XW8R3WQ tag=UDOXIY21GUCP type=write size=1062604 2023-12-03T11:42:10.693 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.692+0000 7f8723d84780 1 < completed delete operation key=KS5J7E7KE2IJ tag=41EQ4D2Q2Z73 type=del 2023-12-03T11:42:10.695 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.694+0000 7f8723d84780 1 > prepared operation key=OGACI7CRPMT7 tag=8C84PAYDYW2T type=del size=2464767 2023-12-03T11:42:10.696 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.695+0000 7f8723d84780 1 < completed part key=_multipart_K83BTR5BOLZE.2~5PX7NDI71SS5.0 size=1048576 2023-12-03T11:42:10.697 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.696+0000 7f8723d84780 1 < completed part key=_multipart_K83BTR5BOLZE.2~5PX7NDI71SS5.1 size=1048576 2023-12-03T11:42:10.698 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.697+0000 7f8723d84780 1 < completed part key=_multipart_K83BTR5BOLZE.2~5PX7NDI71SS5.2 size=704462 2023-12-03T11:42:10.700 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.699+0000 7f8723d84780 1 < completed multipart upload key=K83BTR5BOLZE upload=5PX7NDI71SS5 tag=38VYRM3A5MWY type=write size=3850190 2023-12-03T11:42:10.701 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.700+0000 7f8723d84780 1 > prepared operation key=DMQX2DGDLU7D tag=9D2VTE6XY6C1 type=del size=2688554 2023-12-03T11:42:10.705 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.701+0000 7f8723d84780 1 < completed part key=_multipart_7VMTBKUWU59F.2~W8CLM34NRTEW.0 size=292639 2023-12-03T11:42:10.705 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.703+0000 7f8723d84780 1 < completed multipart upload key=7VMTBKUWU59F upload=W8CLM34NRTEW tag=ILQJYUBDUMU4 type=write size=1341215 2023-12-03T11:42:10.706 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.704+0000 7f8723d84780 1 > prepared operation key=LMVO6CVEPN3K tag=PSK6JAABGLCB type=del size=2061758 2023-12-03T11:42:10.706 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.705+0000 7f8723d84780 1 < completed delete operation key=7THZZ1J5LOZK tag=FT907G8HGITN type=del 2023-12-03T11:42:10.708 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.707+0000 7f8723d84780 1 > prepared operation key=D3JEVEY0E29E tag=1ZNTTD24FB0V type=del size=306895 2023-12-03T11:42:10.709 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.708+0000 7f8723d84780 1 < completed delete operation key=TSTIBGVYUZZZ tag=SI9EALP9ZRV7 type=del 2023-12-03T11:42:10.711 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.710+0000 7f8723d84780 1 > prepared part key=_multipart_DMQX2DGDLU7D.2~OG81G1YHDCY2.0 size=1048576 2023-12-03T11:42:10.713 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.711+0000 7f8723d84780 1 > prepared part key=_multipart_DMQX2DGDLU7D.2~OG81G1YHDCY2.1 size=1048576 2023-12-03T11:42:10.713 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.712+0000 7f8723d84780 1 > prepared part key=_multipart_DMQX2DGDLU7D.2~OG81G1YHDCY2.2 size=1026136 2023-12-03T11:42:10.713 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.712+0000 7f8723d84780 1 > prepared multipart upload key=DMQX2DGDLU7D upload=OG81G1YHDCY2 tag=FEQQR7WMRP62 type=write size=4171864 2023-12-03T11:42:10.714 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.713+0000 7f8723d84780 1 < completed part key=_multipart_96RAVVSUKH0Y.2~1UM01WRZK0OA.0 size=93015 2023-12-03T11:42:10.716 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.715+0000 7f8723d84780 1 < completed multipart upload key=96RAVVSUKH0Y upload=1UM01WRZK0OA tag=1ZVIF82BW6PW type=write size=1141591 2023-12-03T11:42:10.717 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.716+0000 7f8723d84780 1 > prepared operation key=G36T76K8O7A1 tag=4X8GVHWEMZYE type=write size=965694 2023-12-03T11:42:10.718 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.717+0000 7f8723d84780 1 < canceled part key=_multipart_VENJI0KD1XDW.2~JOP2KIN9I2YR.0 size=440165 2023-12-03T11:42:10.719 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.718+0000 7f8723d84780 1 < canceled multipart upload key=VENJI0KD1XDW upload=JOP2KIN9I2YR tag=D51JW8IKVAGR type=write size=1488741 2023-12-03T11:42:10.721 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.720+0000 7f8723d84780 1 > prepared operation key=931GNEXBHH35 tag=I2HHHFQKFO7W type=del size=175826 2023-12-03T11:42:10.723 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.722+0000 7f8723d84780 1 < suggested update operation key=LMVO6CVEPN3K tag=2BHO08IA11JD type=del size=3534333 2023-12-03T11:42:10.724 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.723+0000 7f8723d84780 1 > prepared operation key=J33T5S893LMV tag=85KY2G4FPR1E type=del size=3237356 2023-12-03T11:42:10.726 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.724+0000 7f8723d84780 1 < canceled operation key=LCK58DDM5XU9 tag=6RHXLZD4MFHA type=del size=1807575 2023-12-03T11:42:10.728 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.727+0000 7f8723d84780 1 > prepared part key=_multipart_KS5J7E7KE2IJ.2~SMWAWTVR5SIB.0 size=558020 2023-12-03T11:42:10.728 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.727+0000 7f8723d84780 1 > prepared multipart upload key=KS5J7E7KE2IJ upload=SMWAWTVR5SIB tag=IQ9KW6XJT3OO type=write size=1606596 2023-12-03T11:42:10.729 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.728+0000 7f8723d84780 1 < completed part key=_multipart_K83BTR5BOLZE.2~CSQSP2T99MMW.0 size=1048576 2023-12-03T11:42:10.730 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.729+0000 7f8723d84780 1 < completed part key=_multipart_K83BTR5BOLZE.2~CSQSP2T99MMW.1 size=565757 2023-12-03T11:42:10.732 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.731+0000 7f8723d84780 1 < completed multipart upload key=K83BTR5BOLZE upload=CSQSP2T99MMW tag=1JMFWSGMX3J0 type=write size=2662909 2023-12-03T11:42:10.733 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.732+0000 7f8723d84780 1 > prepared operation key=TSTIBGVYUZZZ tag=875KUICX8QY3 type=del size=4055859 2023-12-03T11:42:10.734 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.733+0000 7f8723d84780 1 < completed delete operation key=AB0SN0E49Z5F tag=4LXL06C2BUZ4 type=del 2023-12-03T11:42:10.736 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.735+0000 7f8723d84780 1 > prepared operation key=KS5J7E7KE2IJ tag=8XDCFU27CKRM type=write size=383752 2023-12-03T11:42:10.737 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.736+0000 7f8723d84780 1 < completed part key=_multipart_7VMTBKUWU59F.2~7LO7OYF31ROB.0 size=559362 2023-12-03T11:42:10.739 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.738+0000 7f8723d84780 1 < completed multipart upload key=7VMTBKUWU59F upload=7LO7OYF31ROB tag=RS3BH4JNU53J type=write size=1607938 2023-12-03T11:42:10.741 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.740+0000 7f8723d84780 1 > prepared part key=_multipart_FCA2R3HR61S2.2~U0B6WEVFBJ6P.0 size=1048576 2023-12-03T11:42:10.742 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.741+0000 7f8723d84780 1 > prepared part key=_multipart_FCA2R3HR61S2.2~U0B6WEVFBJ6P.1 size=124447 2023-12-03T11:42:10.742 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.741+0000 7f8723d84780 1 > prepared multipart upload key=FCA2R3HR61S2 upload=U0B6WEVFBJ6P tag=2LZ70986G9PX type=write size=2221599 2023-12-03T11:42:10.744 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.743+0000 7f8723d84780 1 < completed delete operation key=W2704YS8KYQB tag=DC5MHU8GK60C type=del 2023-12-03T11:42:10.745 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.744+0000 7f8723d84780 1 > prepared operation key=M4VKPN6INFNZ tag=9G7J65B358KQ type=del size=3200744 2023-12-03T11:42:10.746 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.745+0000 7f8723d84780 1 < completed write operation key=OPQPIDJ2PBVU tag=SNOL7PJPV03C type=write size=243224 2023-12-03T11:42:10.748 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.747+0000 7f8723d84780 1 > prepared part key=_multipart_931GNEXBHH35.2~AOF914GL8CR2.0 size=1048576 2023-12-03T11:42:10.749 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.748+0000 7f8723d84780 1 > prepared part key=_multipart_931GNEXBHH35.2~AOF914GL8CR2.1 size=1048576 2023-12-03T11:42:10.750 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.749+0000 7f8723d84780 1 > prepared part key=_multipart_931GNEXBHH35.2~AOF914GL8CR2.2 size=313674 2023-12-03T11:42:10.750 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.749+0000 7f8723d84780 1 > prepared multipart upload key=931GNEXBHH35 upload=AOF914GL8CR2 tag=ARPKTX8H194S type=write size=3459402 2023-12-03T11:42:10.751 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.750+0000 7f8723d84780 1 < canceled operation key=TSTIBGVYUZZZ tag=6N04PZHE6P6M type=del size=2778659 2023-12-03T11:42:10.753 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.752+0000 7f8723d84780 1 > prepared operation key=M4VKPN6INFNZ tag=UYCRGD8L5XAM type=del size=3352494 2023-12-03T11:42:10.754 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.753+0000 7f8723d84780 1 < completed part key=_multipart_7THZZ1J5LOZK.2~UGDS0XW8R3WQ.0 size=14028 2023-12-03T11:42:10.756 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.755+0000 7f8723d84780 1 < completed multipart upload key=7THZZ1J5LOZK upload=UGDS0XW8R3WQ tag=UDOXIY21GUCP type=write size=1062604 2023-12-03T11:42:10.758 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.757+0000 7f8723d84780 1 > prepared part key=_multipart_Y6S7QI60GCLE.2~7WH29AWO0IMO.0 size=1048576 2023-12-03T11:42:10.759 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.758+0000 7f8723d84780 1 > prepared part key=_multipart_Y6S7QI60GCLE.2~7WH29AWO0IMO.1 size=1048576 2023-12-03T11:42:10.760 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.759+0000 7f8723d84780 1 > prepared part key=_multipart_Y6S7QI60GCLE.2~7WH29AWO0IMO.2 size=391624 2023-12-03T11:42:10.760 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.759+0000 7f8723d84780 1 > prepared multipart upload key=Y6S7QI60GCLE upload=7WH29AWO0IMO tag=OUU4ZWRAEM31 type=write size=3537352 2023-12-03T11:42:10.762 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.761+0000 7f8723d84780 1 < completed delete operation key=OGACI7CRPMT7 tag=8C84PAYDYW2T type=del 2023-12-03T11:42:10.763 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.762+0000 7f8723d84780 1 > prepared operation key=UWS266H06VDK tag=SAXNT299S9SZ type=del size=3590545 2023-12-03T11:42:10.765 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.764+0000 7f8723d84780 1 < completed delete operation key=DMQX2DGDLU7D tag=9D2VTE6XY6C1 type=del 2023-12-03T11:42:10.767 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.766+0000 7f8723d84780 1 > prepared part key=_multipart_G36T76K8O7A1.2~FANMB8WP2L1S.0 size=632645 2023-12-03T11:42:10.767 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.766+0000 7f8723d84780 1 > prepared multipart upload key=G36T76K8O7A1 upload=FANMB8WP2L1S tag=70K9FLQ41MNW type=write size=1681221 2023-12-03T11:42:10.768 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.767+0000 7f8723d84780 -1 < failed to complete operation key=LMVO6CVEPN3K tag=PSK6JAABGLCB type=del size=2061758: (22) Invalid argument 2023-12-03T11:42:10.769 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.768+0000 7f8723d84780 1 > prepared operation key=EITMJKL0LCYC tag=X6QJ62VZISIM type=write size=487917 2023-12-03T11:42:10.770 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.769+0000 7f8723d84780 1 < completed delete operation key=D3JEVEY0E29E tag=1ZNTTD24FB0V type=del 2023-12-03T11:42:10.772 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.771+0000 7f8723d84780 1 > prepared operation key=LMVO6CVEPN3K tag=LTJLWBJKM50G type=del size=1266976 2023-12-03T11:42:10.774 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.772+0000 7f8723d84780 1 < completed part key=_multipart_DMQX2DGDLU7D.2~OG81G1YHDCY2.0 size=1048576 2023-12-03T11:42:10.774 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.773+0000 7f8723d84780 1 < completed part key=_multipart_DMQX2DGDLU7D.2~OG81G1YHDCY2.1 size=1048576 2023-12-03T11:42:10.775 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.774+0000 7f8723d84780 1 < completed part key=_multipart_DMQX2DGDLU7D.2~OG81G1YHDCY2.2 size=1026136 2023-12-03T11:42:10.776 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.776+0000 7f8723d84780 1 < completed multipart upload key=DMQX2DGDLU7D upload=OG81G1YHDCY2 tag=FEQQR7WMRP62 type=write size=4171864 2023-12-03T11:42:10.778 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.777+0000 7f8723d84780 1 > prepared operation key=7THZZ1J5LOZK tag=DTU2ES0KNYK7 type=del size=1536718 2023-12-03T11:42:10.779 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.778+0000 7f8723d84780 1 < completed write operation key=G36T76K8O7A1 tag=4X8GVHWEMZYE type=write size=965694 2023-12-03T11:42:10.780 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.779+0000 7f8723d84780 1 > prepared operation key=CKABTI1EOAWB tag=F00F55O6BWQJ type=del size=3704948 2023-12-03T11:42:10.783 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.782+0000 7f8723d84780 1 < suggested update operation key=931GNEXBHH35 tag=I2HHHFQKFO7W type=del size=175826 2023-12-03T11:42:10.784 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.783+0000 7f8723d84780 1 > prepared operation key=7THZZ1J5LOZK tag=760HI80SPR1R type=write size=659712 2023-12-03T11:42:10.785 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.784+0000 7f8723d84780 1 < completed delete operation key=J33T5S893LMV tag=85KY2G4FPR1E type=del 2023-12-03T11:42:10.786 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.785+0000 7f8723d84780 1 > prepared operation key=UWS266H06VDK tag=H5ME5LNYX3RF type=del size=2701071 2023-12-03T11:42:10.787 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.786+0000 7f8723d84780 1 < completed part key=_multipart_KS5J7E7KE2IJ.2~SMWAWTVR5SIB.0 size=558020 2023-12-03T11:42:10.789 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.788+0000 7f8723d84780 1 < completed multipart upload key=KS5J7E7KE2IJ upload=SMWAWTVR5SIB tag=IQ9KW6XJT3OO type=write size=1606596 2023-12-03T11:42:10.790 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.789+0000 7f8723d84780 1 > prepared operation key=LCK58DDM5XU9 tag=MW9C7OZNHKWK type=write size=183968 2023-12-03T11:42:10.792 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.790+0000 7f8723d84780 1 < completed delete operation key=TSTIBGVYUZZZ tag=875KUICX8QY3 type=del 2023-12-03T11:42:10.794 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.793+0000 7f8723d84780 1 > prepared part key=_multipart_HIU6L0NQ8Q95.2~AS0Y3SAJ00B7.0 size=464165 2023-12-03T11:42:10.794 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.793+0000 7f8723d84780 1 > prepared multipart upload key=HIU6L0NQ8Q95 upload=AS0Y3SAJ00B7 tag=RPL7WGKPLGEW type=write size=1512741 2023-12-03T11:42:10.795 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.794+0000 7f8723d84780 1 < completed write operation key=KS5J7E7KE2IJ tag=8XDCFU27CKRM type=write size=383752 2023-12-03T11:42:10.797 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.796+0000 7f8723d84780 1 > prepared operation key=M4VKPN6INFNZ tag=FBYWLW2INH3T type=del size=3371577 2023-12-03T11:42:10.798 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.797+0000 7f8723d84780 1 < completed part key=_multipart_FCA2R3HR61S2.2~U0B6WEVFBJ6P.0 size=1048576 2023-12-03T11:42:10.799 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.798+0000 7f8723d84780 1 < completed part key=_multipart_FCA2R3HR61S2.2~U0B6WEVFBJ6P.1 size=124447 2023-12-03T11:42:10.801 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.800+0000 7f8723d84780 1 < completed multipart upload key=FCA2R3HR61S2 upload=U0B6WEVFBJ6P tag=2LZ70986G9PX type=write size=2221599 2023-12-03T11:42:10.802 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.801+0000 7f8723d84780 1 > prepared operation key=96RAVVSUKH0Y tag=DH3M2ZCHWSTP type=del size=2652284 2023-12-03T11:42:10.804 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.803+0000 7f8723d84780 1 < suggested remove operation key=M4VKPN6INFNZ tag=9G7J65B358KQ type=del 2023-12-03T11:42:10.806 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.805+0000 7f8723d84780 1 > prepared part key=_multipart_7THZZ1J5LOZK.2~0PX2F0FNERB0.0 size=1048576 2023-12-03T11:42:10.807 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.806+0000 7f8723d84780 1 > prepared part key=_multipart_7THZZ1J5LOZK.2~0PX2F0FNERB0.1 size=610152 2023-12-03T11:42:10.807 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.806+0000 7f8723d84780 1 > prepared multipart upload key=7THZZ1J5LOZK upload=0PX2F0FNERB0 tag=XWWZWMMAKU1F type=write size=2707304 2023-12-03T11:42:10.808 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.807+0000 7f8723d84780 1 < completed part key=_multipart_931GNEXBHH35.2~AOF914GL8CR2.0 size=1048576 2023-12-03T11:42:10.808 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.807+0000 7f8723d84780 1 < canceled part key=_multipart_931GNEXBHH35.2~AOF914GL8CR2.1 size=1048576 2023-12-03T11:42:10.809 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.808+0000 7f8723d84780 1 < completed part key=_multipart_931GNEXBHH35.2~AOF914GL8CR2.2 size=313674 2023-12-03T11:42:10.811 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.810+0000 7f8723d84780 1 < canceled multipart upload key=931GNEXBHH35 upload=AOF914GL8CR2 tag=ARPKTX8H194S type=write size=3459402 2023-12-03T11:42:10.812 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.811+0000 7f8723d84780 1 > prepared operation key=EY9ZG5KOTBWM tag=1GND8V2W9V4J type=del size=3821360 2023-12-03T11:42:10.814 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.813+0000 7f8723d84780 -1 < failed to complete operation key=M4VKPN6INFNZ tag=UYCRGD8L5XAM type=del size=3352494: (22) Invalid argument 2023-12-03T11:42:10.816 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.815+0000 7f8723d84780 1 > prepared part key=_multipart_96RAVVSUKH0Y.2~79UOA1N0NZRH.0 size=1048576 2023-12-03T11:42:10.817 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.816+0000 7f8723d84780 1 > prepared part key=_multipart_96RAVVSUKH0Y.2~79UOA1N0NZRH.1 size=68369 2023-12-03T11:42:10.817 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.816+0000 7f8723d84780 1 > prepared multipart upload key=96RAVVSUKH0Y upload=79UOA1N0NZRH tag=P6IV9NKT1R0G type=write size=2165521 2023-12-03T11:42:10.818 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.817+0000 7f8723d84780 1 < completed part key=_multipart_Y6S7QI60GCLE.2~7WH29AWO0IMO.0 size=1048576 2023-12-03T11:42:10.818 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.817+0000 7f8723d84780 1 < canceled part key=_multipart_Y6S7QI60GCLE.2~7WH29AWO0IMO.1 size=1048576 2023-12-03T11:42:10.819 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.818+0000 7f8723d84780 1 < completed part key=_multipart_Y6S7QI60GCLE.2~7WH29AWO0IMO.2 size=391624 2023-12-03T11:42:10.821 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.820+0000 7f8723d84780 1 < canceled multipart upload key=Y6S7QI60GCLE upload=7WH29AWO0IMO tag=OUU4ZWRAEM31 type=write size=3537352 2023-12-03T11:42:10.822 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.821+0000 7f8723d84780 1 > prepared operation key=VENJI0KD1XDW tag=DR51QENS5S3O type=write size=770013 2023-12-03T11:42:10.823 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.822+0000 7f8723d84780 1 < completed delete operation key=UWS266H06VDK tag=SAXNT299S9SZ type=del 2023-12-03T11:42:10.825 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.824+0000 7f8723d84780 1 > prepared operation key=OPQPIDJ2PBVU tag=1NWAUIAC3IA7 type=write size=194748 2023-12-03T11:42:10.826 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.825+0000 7f8723d84780 1 < completed part key=_multipart_G36T76K8O7A1.2~FANMB8WP2L1S.0 size=632645 2023-12-03T11:42:10.828 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.827+0000 7f8723d84780 1 < completed multipart upload key=G36T76K8O7A1 upload=FANMB8WP2L1S tag=70K9FLQ41MNW type=write size=1681221 2023-12-03T11:42:10.829 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.828+0000 7f8723d84780 1 > prepared operation key=HIU6L0NQ8Q95 tag=GOKPDO94JACO type=del size=1681742 2023-12-03T11:42:10.830 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.829+0000 7f8723d84780 1 < completed write operation key=EITMJKL0LCYC tag=X6QJ62VZISIM type=write size=487917 2023-12-03T11:42:10.832 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.831+0000 7f8723d84780 1 > prepared part key=_multipart_4I8PWBZOLDUG.2~3UFYOBAYI0JM.0 size=1048576 2023-12-03T11:42:10.833 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.832+0000 7f8723d84780 1 > prepared part key=_multipart_4I8PWBZOLDUG.2~3UFYOBAYI0JM.1 size=1048576 2023-12-03T11:42:10.835 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.833+0000 7f8723d84780 1 > prepared part key=_multipart_4I8PWBZOLDUG.2~3UFYOBAYI0JM.2 size=69521 2023-12-03T11:42:10.835 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.833+0000 7f8723d84780 1 > prepared multipart upload key=4I8PWBZOLDUG upload=3UFYOBAYI0JM tag=YA01PS3ZMHIU type=write size=3215249 2023-12-03T11:42:10.836 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.835+0000 7f8723d84780 1 < completed delete operation key=LMVO6CVEPN3K tag=LTJLWBJKM50G type=del 2023-12-03T11:42:10.838 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.837+0000 7f8723d84780 1 > prepared part key=_multipart_10JRIKOZ16FY.2~7W3RA5VDVI3Z.0 size=1048576 2023-12-03T11:42:10.839 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.838+0000 7f8723d84780 1 > prepared part key=_multipart_10JRIKOZ16FY.2~7W3RA5VDVI3Z.1 size=1048576 2023-12-03T11:42:10.840 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.839+0000 7f8723d84780 1 > prepared part key=_multipart_10JRIKOZ16FY.2~7W3RA5VDVI3Z.2 size=744074 2023-12-03T11:42:10.840 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.839+0000 7f8723d84780 1 > prepared multipart upload key=10JRIKOZ16FY upload=7W3RA5VDVI3Z tag=TXYLP7P8S8ZN type=write size=3889802 2023-12-03T11:42:10.841 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.840+0000 7f8723d84780 1 < completed delete operation key=7THZZ1J5LOZK tag=DTU2ES0KNYK7 type=del 2023-12-03T11:42:10.842 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.841+0000 7f8723d84780 1 > prepared operation key=EITMJKL0LCYC tag=0LSULTBFSM2O type=write size=935121 2023-12-03T11:42:10.844 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.843+0000 7f8723d84780 1 < completed delete operation key=CKABTI1EOAWB tag=F00F55O6BWQJ type=del 2023-12-03T11:42:10.846 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.845+0000 7f8723d84780 1 > prepared part key=_multipart_G36T76K8O7A1.2~Q1XTAUMG02P9.0 size=1048576 2023-12-03T11:42:10.847 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.846+0000 7f8723d84780 1 > prepared part key=_multipart_G36T76K8O7A1.2~Q1XTAUMG02P9.1 size=497057 2023-12-03T11:42:10.847 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.846+0000 7f8723d84780 1 > prepared multipart upload key=G36T76K8O7A1 upload=Q1XTAUMG02P9 tag=7ZLN89CACH5M type=write size=2594209 2023-12-03T11:42:10.848 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.847+0000 7f8723d84780 1 < completed write operation key=7THZZ1J5LOZK tag=760HI80SPR1R type=write size=659712 2023-12-03T11:42:10.849 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.848+0000 7f8723d84780 1 > prepared operation key=VENJI0KD1XDW tag=L22CEB7ATXJW type=del size=367097 2023-12-03T11:42:10.853 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.852+0000 7f8723d84780 1 < suggested update operation key=UWS266H06VDK tag=H5ME5LNYX3RF type=del size=2701071 2023-12-03T11:42:10.855 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.854+0000 7f8723d84780 1 > prepared part key=_multipart_EY9ZG5KOTBWM.2~F6RN1X7LP5L5.0 size=1048576 2023-12-03T11:42:10.856 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.855+0000 7f8723d84780 1 > prepared part key=_multipart_EY9ZG5KOTBWM.2~F6RN1X7LP5L5.1 size=406034 2023-12-03T11:42:10.856 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.855+0000 7f8723d84780 1 > prepared multipart upload key=EY9ZG5KOTBWM upload=F6RN1X7LP5L5 tag=AXFGXK5N9EEZ type=write size=2503186 2023-12-03T11:42:10.857 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.856+0000 7f8723d84780 1 < completed write operation key=LCK58DDM5XU9 tag=MW9C7OZNHKWK type=write size=183968 2023-12-03T11:42:10.859 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.858+0000 7f8723d84780 1 > prepared operation key=12XG7YPYTN4U tag=BZ3RTTLGNVLS type=del size=3720137 2023-12-03T11:42:10.860 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.859+0000 7f8723d84780 1 < completed part key=_multipart_HIU6L0NQ8Q95.2~AS0Y3SAJ00B7.0 size=464165 2023-12-03T11:42:10.862 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.861+0000 7f8723d84780 1 < completed multipart upload key=HIU6L0NQ8Q95 upload=AS0Y3SAJ00B7 tag=RPL7WGKPLGEW type=write size=1512741 2023-12-03T11:42:10.864 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.863+0000 7f8723d84780 1 > prepared part key=_multipart_96RAVVSUKH0Y.2~6AKR8LV8FJ76.0 size=1048576 2023-12-03T11:42:10.865 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.864+0000 7f8723d84780 1 > prepared part key=_multipart_96RAVVSUKH0Y.2~6AKR8LV8FJ76.1 size=585307 2023-12-03T11:42:10.865 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.864+0000 7f8723d84780 1 > prepared multipart upload key=96RAVVSUKH0Y upload=6AKR8LV8FJ76 tag=YGVLNXOCKNMJ type=write size=2682459 2023-12-03T11:42:10.866 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.865+0000 7f8723d84780 -1 < failed to complete operation key=M4VKPN6INFNZ tag=FBYWLW2INH3T type=del size=3371577: (22) Invalid argument 2023-12-03T11:42:10.868 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.867+0000 7f8723d84780 1 > prepared operation key=10JRIKOZ16FY tag=7V2YETSR2Y0D type=del size=1167627 2023-12-03T11:42:10.869 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.868+0000 7f8723d84780 1 < completed delete operation key=96RAVVSUKH0Y tag=DH3M2ZCHWSTP type=del 2023-12-03T11:42:10.870 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.869+0000 7f8723d84780 1 > prepared operation key=CKABTI1EOAWB tag=29VC2WWSWP7T type=del size=1251220 2023-12-03T11:42:10.871 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.871+0000 7f8723d84780 1 < completed part key=_multipart_7THZZ1J5LOZK.2~0PX2F0FNERB0.0 size=1048576 2023-12-03T11:42:10.872 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.871+0000 7f8723d84780 1 < canceled part key=_multipart_7THZZ1J5LOZK.2~0PX2F0FNERB0.1 size=610152 2023-12-03T11:42:10.874 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.873+0000 7f8723d84780 1 < canceled multipart upload key=7THZZ1J5LOZK upload=0PX2F0FNERB0 tag=XWWZWMMAKU1F type=write size=2707304 2023-12-03T11:42:10.875 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.874+0000 7f8723d84780 1 > prepared operation key=FCA2R3HR61S2 tag=I5014G575EZN type=del size=1377119 2023-12-03T11:42:10.876 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.875+0000 7f8723d84780 1 < completed delete operation key=EY9ZG5KOTBWM tag=1GND8V2W9V4J type=del 2023-12-03T11:42:10.879 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.877+0000 7f8723d84780 1 > prepared part key=_multipart_5UYL15O31IHM.2~OZ5B893CIGKG.0 size=1048576 2023-12-03T11:42:10.880 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.878+0000 7f8723d84780 1 > prepared part key=_multipart_5UYL15O31IHM.2~OZ5B893CIGKG.1 size=1048576 2023-12-03T11:42:10.880 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.879+0000 7f8723d84780 1 > prepared part key=_multipart_5UYL15O31IHM.2~OZ5B893CIGKG.2 size=123886 2023-12-03T11:42:10.880 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.879+0000 7f8723d84780 1 > prepared multipart upload key=5UYL15O31IHM upload=OZ5B893CIGKG tag=F76K2POI8KDJ type=write size=3269614 2023-12-03T11:42:10.881 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.879+0000 7f8723d84780 1 < canceled part key=_multipart_96RAVVSUKH0Y.2~79UOA1N0NZRH.0 size=1048576 2023-12-03T11:42:10.881 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.880+0000 7f8723d84780 1 < completed part key=_multipart_96RAVVSUKH0Y.2~79UOA1N0NZRH.1 size=68369 2023-12-03T11:42:10.884 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.882+0000 7f8723d84780 1 < canceled multipart upload key=96RAVVSUKH0Y upload=79UOA1N0NZRH tag=P6IV9NKT1R0G type=write size=2165521 2023-12-03T11:42:10.885 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.884+0000 7f8723d84780 1 > prepared operation key=FCA2R3HR61S2 tag=1ZUYN252QA8V type=del size=2292250 2023-12-03T11:42:10.886 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.885+0000 7f8723d84780 1 < completed write operation key=VENJI0KD1XDW tag=DR51QENS5S3O type=write size=770013 2023-12-03T11:42:10.887 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.886+0000 7f8723d84780 1 > prepared operation key=OGACI7CRPMT7 tag=J0ZMRO6PHR99 type=del size=3156508 2023-12-03T11:42:10.888 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.887+0000 7f8723d84780 1 < completed write operation key=OPQPIDJ2PBVU tag=1NWAUIAC3IA7 type=write size=194748 2023-12-03T11:42:10.890 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.889+0000 7f8723d84780 1 > prepared part key=_multipart_HIU6L0NQ8Q95.2~5YV55T615S0P.0 size=1048576 2023-12-03T11:42:10.891 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.890+0000 7f8723d84780 1 > prepared part key=_multipart_HIU6L0NQ8Q95.2~5YV55T615S0P.1 size=584332 2023-12-03T11:42:10.892 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.891+0000 7f8723d84780 1 > prepared multipart upload key=HIU6L0NQ8Q95 upload=5YV55T615S0P tag=FG9M0XMLDR2B type=write size=2681484 2023-12-03T11:42:10.893 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.892+0000 7f8723d84780 1 < completed delete operation key=HIU6L0NQ8Q95 tag=GOKPDO94JACO type=del 2023-12-03T11:42:10.894 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.893+0000 7f8723d84780 1 > prepared operation key=J33T5S893LMV tag=MGHFLIZ0CH7C type=del size=2086415 2023-12-03T11:42:10.895 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.894+0000 7f8723d84780 1 < completed part key=_multipart_4I8PWBZOLDUG.2~3UFYOBAYI0JM.0 size=1048576 2023-12-03T11:42:10.896 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.895+0000 7f8723d84780 1 < completed part key=_multipart_4I8PWBZOLDUG.2~3UFYOBAYI0JM.1 size=1048576 2023-12-03T11:42:10.896 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.895+0000 7f8723d84780 1 < canceled part key=_multipart_4I8PWBZOLDUG.2~3UFYOBAYI0JM.2 size=69521 2023-12-03T11:42:10.898 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.897+0000 7f8723d84780 1 < canceled multipart upload key=4I8PWBZOLDUG upload=3UFYOBAYI0JM tag=YA01PS3ZMHIU type=write size=3215249 2023-12-03T11:42:10.901 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.899+0000 7f8723d84780 1 > prepared part key=_multipart_96RAVVSUKH0Y.2~INX7I85SV5OY.0 size=1048576 2023-12-03T11:42:10.901 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.900+0000 7f8723d84780 1 > prepared part key=_multipart_96RAVVSUKH0Y.2~INX7I85SV5OY.1 size=1048576 2023-12-03T11:42:10.903 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.901+0000 7f8723d84780 1 > prepared part key=_multipart_96RAVVSUKH0Y.2~INX7I85SV5OY.2 size=67222 2023-12-03T11:42:10.903 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.901+0000 7f8723d84780 1 > prepared multipart upload key=96RAVVSUKH0Y upload=INX7I85SV5OY tag=BRAA28V8BCAJ type=write size=3212950 2023-12-03T11:42:10.903 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.902+0000 7f8723d84780 1 < completed part key=_multipart_10JRIKOZ16FY.2~7W3RA5VDVI3Z.0 size=1048576 2023-12-03T11:42:10.904 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.903+0000 7f8723d84780 1 < completed part key=_multipart_10JRIKOZ16FY.2~7W3RA5VDVI3Z.1 size=1048576 2023-12-03T11:42:10.905 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.904+0000 7f8723d84780 1 < completed part key=_multipart_10JRIKOZ16FY.2~7W3RA5VDVI3Z.2 size=744074 2023-12-03T11:42:10.907 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.906+0000 7f8723d84780 1 < completed multipart upload key=10JRIKOZ16FY upload=7W3RA5VDVI3Z tag=TXYLP7P8S8ZN type=write size=3889802 2023-12-03T11:42:10.910 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.909+0000 7f8723d84780 1 > prepared operation key=4I8PWBZOLDUG tag=YN1XBIH6LPY6 type=del size=3850675 2023-12-03T11:42:10.913 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.910+0000 7f8723d84780 1 < completed write operation key=EITMJKL0LCYC tag=0LSULTBFSM2O type=write size=935121 2023-12-03T11:42:10.913 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.912+0000 7f8723d84780 1 > prepared part key=_multipart_LCK58DDM5XU9.2~V8QGLTBFXXSU.0 size=547519 2023-12-03T11:42:10.913 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.912+0000 7f8723d84780 1 > prepared multipart upload key=LCK58DDM5XU9 upload=V8QGLTBFXXSU tag=HZ53PMPPROX4 type=write size=1596095 2023-12-03T11:42:10.914 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.913+0000 7f8723d84780 1 < completed part key=_multipart_G36T76K8O7A1.2~Q1XTAUMG02P9.0 size=1048576 2023-12-03T11:42:10.915 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.914+0000 7f8723d84780 1 < completed part key=_multipart_G36T76K8O7A1.2~Q1XTAUMG02P9.1 size=497057 2023-12-03T11:42:10.917 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.916+0000 7f8723d84780 1 < completed multipart upload key=G36T76K8O7A1 upload=Q1XTAUMG02P9 tag=7ZLN89CACH5M type=write size=2594209 2023-12-03T11:42:10.919 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.918+0000 7f8723d84780 1 > prepared part key=_multipart_O7VVHXLDSY57.2~J5CGTBCLST6I.0 size=668197 2023-12-03T11:42:10.919 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.918+0000 7f8723d84780 1 > prepared multipart upload key=O7VVHXLDSY57 upload=J5CGTBCLST6I tag=KQD6BA5KBFMV type=write size=1716773 2023-12-03T11:42:10.921 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.920+0000 7f8723d84780 1 < completed delete operation key=VENJI0KD1XDW tag=L22CEB7ATXJW type=del 2023-12-03T11:42:10.922 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.921+0000 7f8723d84780 1 > prepared operation key=W2704YS8KYQB tag=I7HTTRZ94CTD type=del size=1432212 2023-12-03T11:42:10.923 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.922+0000 7f8723d84780 1 < completed part key=_multipart_EY9ZG5KOTBWM.2~F6RN1X7LP5L5.0 size=1048576 2023-12-03T11:42:10.924 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.923+0000 7f8723d84780 1 < completed part key=_multipart_EY9ZG5KOTBWM.2~F6RN1X7LP5L5.1 size=406034 2023-12-03T11:42:10.926 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.925+0000 7f8723d84780 1 < completed multipart upload key=EY9ZG5KOTBWM upload=F6RN1X7LP5L5 tag=AXFGXK5N9EEZ type=write size=2503186 2023-12-03T11:42:10.928 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.927+0000 7f8723d84780 1 > prepared part key=_multipart_4I8PWBZOLDUG.2~NZ0C3MVREONR.0 size=1048576 2023-12-03T11:42:10.929 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.928+0000 7f8723d84780 1 > prepared part key=_multipart_4I8PWBZOLDUG.2~NZ0C3MVREONR.1 size=330072 2023-12-03T11:42:10.929 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.928+0000 7f8723d84780 1 > prepared multipart upload key=4I8PWBZOLDUG upload=NZ0C3MVREONR tag=ZOW8JYRNSHE8 type=write size=2427224 2023-12-03T11:42:10.931 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.930+0000 7f8723d84780 1 < suggested update operation key=12XG7YPYTN4U tag=BZ3RTTLGNVLS type=del size=3720137 2023-12-03T11:42:10.932 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.931+0000 7f8723d84780 1 > prepared operation key=M4VKPN6INFNZ tag=2V3YQ3FG3TI2 type=del size=1941205 2023-12-03T11:42:10.933 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.932+0000 7f8723d84780 1 < completed part key=_multipart_96RAVVSUKH0Y.2~6AKR8LV8FJ76.0 size=1048576 2023-12-03T11:42:10.935 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.933+0000 7f8723d84780 1 < completed part key=_multipart_96RAVVSUKH0Y.2~6AKR8LV8FJ76.1 size=585307 2023-12-03T11:42:10.937 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.936+0000 7f8723d84780 1 < completed multipart upload key=96RAVVSUKH0Y upload=6AKR8LV8FJ76 tag=YGVLNXOCKNMJ type=write size=2682459 2023-12-03T11:42:10.938 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.937+0000 7f8723d84780 1 > prepared operation key=M4VKPN6INFNZ tag=H93WKDIKX5WF type=del size=2099067 2023-12-03T11:42:10.939 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.938+0000 7f8723d84780 1 < completed delete operation key=10JRIKOZ16FY tag=7V2YETSR2Y0D type=del 2023-12-03T11:42:10.941 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.940+0000 7f8723d84780 1 > prepared part key=_multipart_VENJI0KD1XDW.2~GLV99NVMMFQ3.0 size=1015726 2023-12-03T11:42:10.941 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.940+0000 7f8723d84780 1 > prepared multipart upload key=VENJI0KD1XDW upload=GLV99NVMMFQ3 tag=8U4OCZ4CIXCG type=write size=2064302 2023-12-03T11:42:10.942 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.941+0000 7f8723d84780 1 < completed delete operation key=CKABTI1EOAWB tag=29VC2WWSWP7T type=del 2023-12-03T11:42:10.944 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.943+0000 7f8723d84780 1 > prepared operation key=O7VVHXLDSY57 tag=43L9F2LDUX4J type=del size=366452 2023-12-03T11:42:10.945 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.944+0000 7f8723d84780 1 < completed delete operation key=FCA2R3HR61S2 tag=I5014G575EZN type=del 2023-12-03T11:42:10.946 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.945+0000 7f8723d84780 1 > prepared operation key=7THZZ1J5LOZK tag=PFU7KA6S5VKA type=del size=1772853 2023-12-03T11:42:10.947 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.946+0000 7f8723d84780 1 < completed part key=_multipart_5UYL15O31IHM.2~OZ5B893CIGKG.0 size=1048576 2023-12-03T11:42:10.948 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.947+0000 7f8723d84780 1 < completed part key=_multipart_5UYL15O31IHM.2~OZ5B893CIGKG.1 size=1048576 2023-12-03T11:42:10.949 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.948+0000 7f8723d84780 1 < completed part key=_multipart_5UYL15O31IHM.2~OZ5B893CIGKG.2 size=123886 2023-12-03T11:42:10.952 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.951+0000 7f8723d84780 1 < completed multipart upload key=5UYL15O31IHM upload=OZ5B893CIGKG tag=F76K2POI8KDJ type=write size=3269614 2023-12-03T11:42:10.953 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.952+0000 7f8723d84780 1 > prepared operation key=931GNEXBHH35 tag=F0GEKMC2UQ63 type=del size=1951750 2023-12-03T11:42:10.954 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.953+0000 7f8723d84780 1 < completed delete operation key=FCA2R3HR61S2 tag=1ZUYN252QA8V type=del 2023-12-03T11:42:10.956 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.955+0000 7f8723d84780 1 > prepared part key=_multipart_W2704YS8KYQB.2~1CESRTDQ5ILG.0 size=1048576 2023-12-03T11:42:10.957 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.956+0000 7f8723d84780 1 > prepared part key=_multipart_W2704YS8KYQB.2~1CESRTDQ5ILG.1 size=1048576 2023-12-03T11:42:10.958 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.957+0000 7f8723d84780 1 > prepared part key=_multipart_W2704YS8KYQB.2~1CESRTDQ5ILG.2 size=138268 2023-12-03T11:42:10.958 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.957+0000 7f8723d84780 1 > prepared multipart upload key=W2704YS8KYQB upload=1CESRTDQ5ILG tag=OP76E3XL4HQ3 type=write size=3283996 2023-12-03T11:42:10.959 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.958+0000 7f8723d84780 1 < completed delete operation key=OGACI7CRPMT7 tag=J0ZMRO6PHR99 type=del 2023-12-03T11:42:10.966 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.962+0000 7f8723d84780 1 > prepared part key=_multipart_DMQX2DGDLU7D.2~OY6INFO0L1BB.0 size=82778 2023-12-03T11:42:10.966 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.962+0000 7f8723d84780 1 > prepared multipart upload key=DMQX2DGDLU7D upload=OY6INFO0L1BB tag=G4ORO5J3O5H4 type=write size=1131354 2023-12-03T11:42:10.966 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.963+0000 7f8723d84780 1 < completed part key=_multipart_HIU6L0NQ8Q95.2~5YV55T615S0P.0 size=1048576 2023-12-03T11:42:10.967 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.964+0000 7f8723d84780 1 < completed part key=_multipart_HIU6L0NQ8Q95.2~5YV55T615S0P.1 size=584332 2023-12-03T11:42:10.967 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.966+0000 7f8723d84780 1 < completed multipart upload key=HIU6L0NQ8Q95 upload=5YV55T615S0P tag=FG9M0XMLDR2B type=write size=2681484 2023-12-03T11:42:10.968 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.967+0000 7f8723d84780 1 > prepared operation key=EY9ZG5KOTBWM tag=C1ZJ4382QYYV type=del size=1073605 2023-12-03T11:42:10.970 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.969+0000 7f8723d84780 1 < completed delete operation key=J33T5S893LMV tag=MGHFLIZ0CH7C type=del 2023-12-03T11:42:10.972 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.971+0000 7f8723d84780 1 > prepared part key=_multipart_K83BTR5BOLZE.2~Z2RZKUZJ5GIY.0 size=1048576 2023-12-03T11:42:10.973 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.972+0000 7f8723d84780 1 > prepared part key=_multipart_K83BTR5BOLZE.2~Z2RZKUZJ5GIY.1 size=1048576 2023-12-03T11:42:10.974 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.973+0000 7f8723d84780 1 > prepared part key=_multipart_K83BTR5BOLZE.2~Z2RZKUZJ5GIY.2 size=307252 2023-12-03T11:42:10.974 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.973+0000 7f8723d84780 1 > prepared multipart upload key=K83BTR5BOLZE upload=Z2RZKUZJ5GIY tag=PSPD9EYDUBXO type=write size=3452980 2023-12-03T11:42:10.975 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.974+0000 7f8723d84780 1 < completed part key=_multipart_96RAVVSUKH0Y.2~INX7I85SV5OY.0 size=1048576 2023-12-03T11:42:10.976 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.975+0000 7f8723d84780 1 < completed part key=_multipart_96RAVVSUKH0Y.2~INX7I85SV5OY.1 size=1048576 2023-12-03T11:42:10.977 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.976+0000 7f8723d84780 1 < completed part key=_multipart_96RAVVSUKH0Y.2~INX7I85SV5OY.2 size=67222 2023-12-03T11:42:10.979 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.978+0000 7f8723d84780 1 < completed multipart upload key=96RAVVSUKH0Y upload=INX7I85SV5OY tag=BRAA28V8BCAJ type=write size=3212950 2023-12-03T11:42:10.980 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.980+0000 7f8723d84780 1 > prepared operation key=J33T5S893LMV tag=JSC1MXNJ2R12 type=del size=2192447 2023-12-03T11:42:10.983 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.982+0000 7f8723d84780 1 < suggested update operation key=4I8PWBZOLDUG tag=YN1XBIH6LPY6 type=del size=3850675 2023-12-03T11:42:10.984 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.983+0000 7f8723d84780 1 > prepared operation key=UWS266H06VDK tag=MH3D4MFPEJ04 type=del size=362120 2023-12-03T11:42:10.985 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.985+0000 7f8723d84780 1 < completed part key=_multipart_LCK58DDM5XU9.2~V8QGLTBFXXSU.0 size=547519 2023-12-03T11:42:10.988 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.987+0000 7f8723d84780 1 < completed multipart upload key=LCK58DDM5XU9 upload=V8QGLTBFXXSU tag=HZ53PMPPROX4 type=write size=1596095 2023-12-03T11:42:10.990 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.989+0000 7f8723d84780 1 > prepared part key=_multipart_OGACI7CRPMT7.2~WEGJPL1CGZ1Y.0 size=1048576 2023-12-03T11:42:10.990 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.990+0000 7f8723d84780 1 > prepared part key=_multipart_OGACI7CRPMT7.2~WEGJPL1CGZ1Y.1 size=1048576 2023-12-03T11:42:10.991 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.990+0000 7f8723d84780 1 > prepared part key=_multipart_OGACI7CRPMT7.2~WEGJPL1CGZ1Y.2 size=488793 2023-12-03T11:42:10.992 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.990+0000 7f8723d84780 1 > prepared multipart upload key=OGACI7CRPMT7 upload=WEGJPL1CGZ1Y tag=LMLQ09SWF2AD type=write size=3634521 2023-12-03T11:42:10.993 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.992+0000 7f8723d84780 1 < completed part key=_multipart_O7VVHXLDSY57.2~J5CGTBCLST6I.0 size=668197 2023-12-03T11:42:10.995 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.994+0000 7f8723d84780 1 < completed multipart upload key=O7VVHXLDSY57 upload=J5CGTBCLST6I tag=KQD6BA5KBFMV type=write size=1716773 2023-12-03T11:42:10.996 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.995+0000 7f8723d84780 1 > prepared part key=_multipart_EITMJKL0LCYC.2~4BNT4CGTT5OU.0 size=1048576 2023-12-03T11:42:10.998 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.996+0000 7f8723d84780 1 > prepared part key=_multipart_EITMJKL0LCYC.2~4BNT4CGTT5OU.1 size=680010 2023-12-03T11:42:10.998 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.996+0000 7f8723d84780 1 > prepared multipart upload key=EITMJKL0LCYC upload=4BNT4CGTT5OU tag=S59V54HY4W0T type=write size=2777162 2023-12-03T11:42:10.999 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.998+0000 7f8723d84780 1 < completed delete operation key=W2704YS8KYQB tag=I7HTTRZ94CTD type=del 2023-12-03T11:42:11.000 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:10.999+0000 7f8723d84780 1 > prepared operation key=DMQX2DGDLU7D tag=2ZMJNHQ6DLLG type=del size=3728425 2023-12-03T11:42:11.002 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.000+0000 7f8723d84780 1 < completed part key=_multipart_4I8PWBZOLDUG.2~NZ0C3MVREONR.0 size=1048576 2023-12-03T11:42:11.002 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.001+0000 7f8723d84780 1 < completed part key=_multipart_4I8PWBZOLDUG.2~NZ0C3MVREONR.1 size=330072 2023-12-03T11:42:11.004 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.003+0000 7f8723d84780 1 < completed multipart upload key=4I8PWBZOLDUG upload=NZ0C3MVREONR tag=ZOW8JYRNSHE8 type=write size=2427224 2023-12-03T11:42:11.005 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.004+0000 7f8723d84780 1 > prepared operation key=HIU6L0NQ8Q95 tag=OW3NQXKASKP7 type=del size=1129340 2023-12-03T11:42:11.006 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.005+0000 7f8723d84780 1 < completed delete operation key=M4VKPN6INFNZ tag=2V3YQ3FG3TI2 type=del 2023-12-03T11:42:11.008 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.007+0000 7f8723d84780 1 > prepared part key=_multipart_HIU6L0NQ8Q95.2~4LWWIHI74VDC.0 size=1048576 2023-12-03T11:42:11.009 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.008+0000 7f8723d84780 1 > prepared part key=_multipart_HIU6L0NQ8Q95.2~4LWWIHI74VDC.1 size=658827 2023-12-03T11:42:11.009 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.008+0000 7f8723d84780 1 > prepared multipart upload key=HIU6L0NQ8Q95 upload=4LWWIHI74VDC tag=NFHMASWFFCRT type=write size=2755979 2023-12-03T11:42:11.010 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.009+0000 7f8723d84780 1 < completed delete operation key=M4VKPN6INFNZ tag=H93WKDIKX5WF type=del 2023-12-03T11:42:11.012 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.011+0000 7f8723d84780 1 > prepared operation key=7THZZ1J5LOZK tag=9S0ZT26RQK8M type=del size=2244916 2023-12-03T11:42:11.012 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.011+0000 7f8723d84780 1 < canceled part key=_multipart_VENJI0KD1XDW.2~GLV99NVMMFQ3.0 size=1015726 2023-12-03T11:42:11.014 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.013+0000 7f8723d84780 1 < canceled multipart upload key=VENJI0KD1XDW upload=GLV99NVMMFQ3 tag=8U4OCZ4CIXCG type=write size=2064302 2023-12-03T11:42:11.016 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.015+0000 7f8723d84780 1 > prepared part key=_multipart_931GNEXBHH35.2~XI06ZIIZ97SB.0 size=1048576 2023-12-03T11:42:11.017 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.016+0000 7f8723d84780 1 > prepared part key=_multipart_931GNEXBHH35.2~XI06ZIIZ97SB.1 size=650678 2023-12-03T11:42:11.017 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.016+0000 7f8723d84780 1 > prepared multipart upload key=931GNEXBHH35 upload=XI06ZIIZ97SB tag=CXUT93H1J7WA type=write size=2747830 2023-12-03T11:42:11.018 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.017+0000 7f8723d84780 1 < completed delete operation key=O7VVHXLDSY57 tag=43L9F2LDUX4J type=del 2023-12-03T11:42:11.019 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.018+0000 7f8723d84780 1 > prepared operation key=4I8PWBZOLDUG tag=ZDICSS2HJNLB type=del size=2310486 2023-12-03T11:42:11.023 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.022+0000 7f8723d84780 1 < suggested remove operation key=7THZZ1J5LOZK tag=PFU7KA6S5VKA type=del 2023-12-03T11:42:11.025 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.024+0000 7f8723d84780 1 > prepared part key=_multipart_K83BTR5BOLZE.2~1K3IOZ5O63NX.0 size=1048576 2023-12-03T11:42:11.026 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.025+0000 7f8723d84780 1 > prepared part key=_multipart_K83BTR5BOLZE.2~1K3IOZ5O63NX.1 size=1048576 2023-12-03T11:42:11.027 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.026+0000 7f8723d84780 1 > prepared part key=_multipart_K83BTR5BOLZE.2~1K3IOZ5O63NX.2 size=923767 2023-12-03T11:42:11.027 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.026+0000 7f8723d84780 1 > prepared multipart upload key=K83BTR5BOLZE upload=1K3IOZ5O63NX tag=08JYF2DHZL55 type=write size=4069495 2023-12-03T11:42:11.028 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.027+0000 7f8723d84780 1 < canceled operation key=931GNEXBHH35 tag=F0GEKMC2UQ63 type=del size=1951750 2023-12-03T11:42:11.030 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.029+0000 7f8723d84780 1 > prepared part key=_multipart_OGACI7CRPMT7.2~MTFENP128OC5.0 size=1048576 2023-12-03T11:42:11.031 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.030+0000 7f8723d84780 1 > prepared part key=_multipart_OGACI7CRPMT7.2~MTFENP128OC5.1 size=493499 2023-12-03T11:42:11.031 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.030+0000 7f8723d84780 1 > prepared multipart upload key=OGACI7CRPMT7 upload=MTFENP128OC5 tag=40A9P3AM24KA type=write size=2590651 2023-12-03T11:42:11.032 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.031+0000 7f8723d84780 1 < completed part key=_multipart_W2704YS8KYQB.2~1CESRTDQ5ILG.0 size=1048576 2023-12-03T11:42:11.032 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.031+0000 7f8723d84780 1 < canceled part key=_multipart_W2704YS8KYQB.2~1CESRTDQ5ILG.1 size=1048576 2023-12-03T11:42:11.033 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.032+0000 7f8723d84780 1 < completed part key=_multipart_W2704YS8KYQB.2~1CESRTDQ5ILG.2 size=138268 2023-12-03T11:42:11.035 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.034+0000 7f8723d84780 1 < canceled multipart upload key=W2704YS8KYQB upload=1CESRTDQ5ILG tag=OP76E3XL4HQ3 type=write size=3283996 2023-12-03T11:42:11.037 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.036+0000 7f8723d84780 1 > prepared part key=_multipart_96RAVVSUKH0Y.2~PJROUPQ8DE4R.0 size=1048576 2023-12-03T11:42:11.040 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.037+0000 7f8723d84780 1 > prepared part key=_multipart_96RAVVSUKH0Y.2~PJROUPQ8DE4R.1 size=902678 2023-12-03T11:42:11.040 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.037+0000 7f8723d84780 1 > prepared multipart upload key=96RAVVSUKH0Y upload=PJROUPQ8DE4R tag=BKWCFB81ZJI3 type=write size=2999830 2023-12-03T11:42:11.040 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.039+0000 7f8723d84780 1 < completed part key=_multipart_DMQX2DGDLU7D.2~OY6INFO0L1BB.0 size=82778 2023-12-03T11:42:11.042 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.041+0000 7f8723d84780 1 < completed multipart upload key=DMQX2DGDLU7D upload=OY6INFO0L1BB tag=G4ORO5J3O5H4 type=write size=1131354 2023-12-03T11:42:11.043 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.042+0000 7f8723d84780 1 > prepared operation key=M4VKPN6INFNZ tag=ECKVSOUN3BAC type=del size=1835130 2023-12-03T11:42:11.045 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.044+0000 7f8723d84780 1 < suggested update operation key=EY9ZG5KOTBWM tag=C1ZJ4382QYYV type=del size=1073605 2023-12-03T11:42:11.046 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.045+0000 7f8723d84780 1 > prepared operation key=CKABTI1EOAWB tag=45KE04Q3EWIJ type=write size=398007 2023-12-03T11:42:11.048 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.047+0000 7f8723d84780 1 < completed part key=_multipart_K83BTR5BOLZE.2~Z2RZKUZJ5GIY.0 size=1048576 2023-12-03T11:42:11.048 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.047+0000 7f8723d84780 1 < completed part key=_multipart_K83BTR5BOLZE.2~Z2RZKUZJ5GIY.1 size=1048576 2023-12-03T11:42:11.049 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.048+0000 7f8723d84780 1 < completed part key=_multipart_K83BTR5BOLZE.2~Z2RZKUZJ5GIY.2 size=307252 2023-12-03T11:42:11.052 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.050+0000 7f8723d84780 1 < completed multipart upload key=K83BTR5BOLZE upload=Z2RZKUZJ5GIY tag=PSPD9EYDUBXO type=write size=3452980 2023-12-03T11:42:11.053 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.052+0000 7f8723d84780 1 > prepared operation key=VENJI0KD1XDW tag=MC8VTB364XL8 type=del size=2950777 2023-12-03T11:42:11.054 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.053+0000 7f8723d84780 1 < completed delete operation key=J33T5S893LMV tag=JSC1MXNJ2R12 type=del 2023-12-03T11:42:11.055 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.054+0000 7f8723d84780 1 > prepared operation key=O7VVHXLDSY57 tag=4ISI6FJ94WA9 type=del size=3994212 2023-12-03T11:42:11.056 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.055+0000 7f8723d84780 1 < completed delete operation key=UWS266H06VDK tag=MH3D4MFPEJ04 type=del 2023-12-03T11:42:11.058 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.057+0000 7f8723d84780 1 > prepared part key=_multipart_HIU6L0NQ8Q95.2~C71R4EVGJ78L.0 size=741049 2023-12-03T11:42:11.058 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.057+0000 7f8723d84780 1 > prepared multipart upload key=HIU6L0NQ8Q95 upload=C71R4EVGJ78L tag=FDJ9Q7FHZ6FU type=write size=1789625 2023-12-03T11:42:11.059 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.058+0000 7f8723d84780 1 < completed part key=_multipart_OGACI7CRPMT7.2~WEGJPL1CGZ1Y.0 size=1048576 2023-12-03T11:42:11.060 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.059+0000 7f8723d84780 1 < completed part key=_multipart_OGACI7CRPMT7.2~WEGJPL1CGZ1Y.1 size=1048576 2023-12-03T11:42:11.060 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.059+0000 7f8723d84780 1 < canceled part key=_multipart_OGACI7CRPMT7.2~WEGJPL1CGZ1Y.2 size=488793 2023-12-03T11:42:11.062 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.061+0000 7f8723d84780 1 < canceled multipart upload key=OGACI7CRPMT7 upload=WEGJPL1CGZ1Y tag=LMLQ09SWF2AD type=write size=3634521 2023-12-03T11:42:11.064 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.063+0000 7f8723d84780 1 > prepared part key=_multipart_D3JEVEY0E29E.2~I03N9TZS3K8Z.0 size=1048576 2023-12-03T11:42:11.065 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.064+0000 7f8723d84780 1 > prepared part key=_multipart_D3JEVEY0E29E.2~I03N9TZS3K8Z.1 size=1048576 2023-12-03T11:42:11.069 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.065+0000 7f8723d84780 1 > prepared part key=_multipart_D3JEVEY0E29E.2~I03N9TZS3K8Z.2 size=518834 2023-12-03T11:42:11.069 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.065+0000 7f8723d84780 1 > prepared multipart upload key=D3JEVEY0E29E upload=I03N9TZS3K8Z tag=F7N3PL84DVQ0 type=write size=3664562 2023-12-03T11:42:11.070 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.066+0000 7f8723d84780 1 < completed part key=_multipart_EITMJKL0LCYC.2~4BNT4CGTT5OU.0 size=1048576 2023-12-03T11:42:11.070 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.067+0000 7f8723d84780 1 < completed part key=_multipart_EITMJKL0LCYC.2~4BNT4CGTT5OU.1 size=680010 2023-12-03T11:42:11.070 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.069+0000 7f8723d84780 1 < completed multipart upload key=EITMJKL0LCYC upload=4BNT4CGTT5OU tag=S59V54HY4W0T type=write size=2777162 2023-12-03T11:42:11.073 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.072+0000 7f8723d84780 1 > prepared part key=_multipart_UWS266H06VDK.2~5AT0TNYKQ4IS.0 size=1048576 2023-12-03T11:42:11.073 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.072+0000 7f8723d84780 1 > prepared part key=_multipart_UWS266H06VDK.2~5AT0TNYKQ4IS.1 size=1048576 2023-12-03T11:42:11.074 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.073+0000 7f8723d84780 1 > prepared part key=_multipart_UWS266H06VDK.2~5AT0TNYKQ4IS.2 size=7476 2023-12-03T11:42:11.075 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.073+0000 7f8723d84780 1 > prepared multipart upload key=UWS266H06VDK upload=5AT0TNYKQ4IS tag=3JYNYMCMA7ES type=write size=3153204 2023-12-03T11:42:11.076 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.075+0000 7f8723d84780 1 < completed delete operation key=DMQX2DGDLU7D tag=2ZMJNHQ6DLLG type=del 2023-12-03T11:42:11.078 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.077+0000 7f8723d84780 1 > prepared part key=_multipart_OGACI7CRPMT7.2~WWLMODYHNQ1Y.0 size=1048576 2023-12-03T11:42:11.079 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.078+0000 7f8723d84780 1 > prepared part key=_multipart_OGACI7CRPMT7.2~WWLMODYHNQ1Y.1 size=1048576 2023-12-03T11:42:11.080 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.079+0000 7f8723d84780 1 > prepared part key=_multipart_OGACI7CRPMT7.2~WWLMODYHNQ1Y.2 size=1037267 2023-12-03T11:42:11.080 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.079+0000 7f8723d84780 1 > prepared multipart upload key=OGACI7CRPMT7 upload=WWLMODYHNQ1Y tag=40ACNCK16NK8 type=write size=4182995 2023-12-03T11:42:11.081 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.080+0000 7f8723d84780 1 < completed delete operation key=HIU6L0NQ8Q95 tag=OW3NQXKASKP7 type=del 2023-12-03T11:42:11.082 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.081+0000 7f8723d84780 1 > prepared operation key=10JRIKOZ16FY tag=1K7Q2Q0FYLCS type=del size=2746590 2023-12-03T11:42:11.086 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.082+0000 7f8723d84780 1 < completed part key=_multipart_HIU6L0NQ8Q95.2~4LWWIHI74VDC.0 size=1048576 2023-12-03T11:42:11.086 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.084+0000 7f8723d84780 1 < completed part key=_multipart_HIU6L0NQ8Q95.2~4LWWIHI74VDC.1 size=658827 2023-12-03T11:42:11.087 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.085+0000 7f8723d84780 1 < completed multipart upload key=HIU6L0NQ8Q95 upload=4LWWIHI74VDC tag=NFHMASWFFCRT type=write size=2755979 2023-12-03T11:42:11.088 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.087+0000 7f8723d84780 1 > prepared operation key=7THZZ1J5LOZK tag=KJQRUAILS8T5 type=del size=290198 2023-12-03T11:42:11.089 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.088+0000 7f8723d84780 -1 < failed to complete operation key=7THZZ1J5LOZK tag=9S0ZT26RQK8M type=del size=2244916: (22) Invalid argument 2023-12-03T11:42:11.090 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.089+0000 7f8723d84780 1 > prepared operation key=931GNEXBHH35 tag=MU5AF47BLVPI type=write size=685733 2023-12-03T11:42:11.092 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.091+0000 7f8723d84780 1 < completed part key=_multipart_931GNEXBHH35.2~XI06ZIIZ97SB.0 size=1048576 2023-12-03T11:42:11.093 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.092+0000 7f8723d84780 1 < completed part key=_multipart_931GNEXBHH35.2~XI06ZIIZ97SB.1 size=650678 2023-12-03T11:42:11.095 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.094+0000 7f8723d84780 1 < completed multipart upload key=931GNEXBHH35 upload=XI06ZIIZ97SB tag=CXUT93H1J7WA type=write size=2747830 2023-12-03T11:42:11.096 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.095+0000 7f8723d84780 1 > prepared operation key=W2704YS8KYQB tag=KY30LTPSD0J3 type=del size=5278 2023-12-03T11:42:11.098 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.097+0000 7f8723d84780 1 < suggested update operation key=4I8PWBZOLDUG tag=ZDICSS2HJNLB type=del size=2310486 2023-12-03T11:42:11.101 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.100+0000 7f8723d84780 1 > prepared part key=_multipart_VENJI0KD1XDW.2~MF43AUQWF29A.0 size=1048576 2023-12-03T11:42:11.102 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.101+0000 7f8723d84780 1 > prepared part key=_multipart_VENJI0KD1XDW.2~MF43AUQWF29A.1 size=1048576 2023-12-03T11:42:11.103 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.102+0000 7f8723d84780 1 > prepared part key=_multipart_VENJI0KD1XDW.2~MF43AUQWF29A.2 size=1020491 2023-12-03T11:42:11.103 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.102+0000 7f8723d84780 1 > prepared multipart upload key=VENJI0KD1XDW upload=MF43AUQWF29A tag=QXLFOFN0Y815 type=write size=4166219 2023-12-03T11:42:11.104 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.103+0000 7f8723d84780 1 < completed part key=_multipart_K83BTR5BOLZE.2~1K3IOZ5O63NX.0 size=1048576 2023-12-03T11:42:11.105 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.104+0000 7f8723d84780 1 < completed part key=_multipart_K83BTR5BOLZE.2~1K3IOZ5O63NX.1 size=1048576 2023-12-03T11:42:11.106 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.105+0000 7f8723d84780 1 < completed part key=_multipart_K83BTR5BOLZE.2~1K3IOZ5O63NX.2 size=923767 2023-12-03T11:42:11.108 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.107+0000 7f8723d84780 1 < completed multipart upload key=K83BTR5BOLZE upload=1K3IOZ5O63NX tag=08JYF2DHZL55 type=write size=4069495 2023-12-03T11:42:11.109 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.108+0000 7f8723d84780 1 > prepared operation key=O7VVHXLDSY57 tag=PLV27UFXPZYZ type=del size=1928832 2023-12-03T11:42:11.110 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.109+0000 7f8723d84780 1 < completed part key=_multipart_OGACI7CRPMT7.2~MTFENP128OC5.0 size=1048576 2023-12-03T11:42:11.111 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.110+0000 7f8723d84780 1 < completed part key=_multipart_OGACI7CRPMT7.2~MTFENP128OC5.1 size=493499 2023-12-03T11:42:11.113 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.112+0000 7f8723d84780 1 < completed multipart upload key=OGACI7CRPMT7 upload=MTFENP128OC5 tag=40A9P3AM24KA type=write size=2590651 2023-12-03T11:42:11.116 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.115+0000 7f8723d84780 1 > prepared part key=_multipart_96RAVVSUKH0Y.2~NS4KK39NQTUR.0 size=395141 2023-12-03T11:42:11.116 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.115+0000 7f8723d84780 1 > prepared multipart upload key=96RAVVSUKH0Y upload=NS4KK39NQTUR tag=BXMPX7G48BQ8 type=write size=1443717 2023-12-03T11:42:11.117 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.116+0000 7f8723d84780 1 < completed part key=_multipart_96RAVVSUKH0Y.2~PJROUPQ8DE4R.0 size=1048576 2023-12-03T11:42:11.117 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.116+0000 7f8723d84780 1 < canceled part key=_multipart_96RAVVSUKH0Y.2~PJROUPQ8DE4R.1 size=902678 2023-12-03T11:42:11.121 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.118+0000 7f8723d84780 1 < canceled multipart upload key=96RAVVSUKH0Y upload=PJROUPQ8DE4R tag=BKWCFB81ZJI3 type=write size=2999830 2023-12-03T11:42:11.121 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.120+0000 7f8723d84780 1 > prepared operation key=D3JEVEY0E29E tag=69OCCDA1H9UC type=del size=1693507 2023-12-03T11:42:11.122 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.121+0000 7f8723d84780 1 < completed delete operation key=M4VKPN6INFNZ tag=ECKVSOUN3BAC type=del 2023-12-03T11:42:11.124 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.122+0000 7f8723d84780 1 > prepared operation key=OPQPIDJ2PBVU tag=5Q9225JPXXOR type=write size=145148 2023-12-03T11:42:11.125 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.124+0000 7f8723d84780 1 < completed write operation key=CKABTI1EOAWB tag=45KE04Q3EWIJ type=write size=398007 2023-12-03T11:42:11.126 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.125+0000 7f8723d84780 1 > prepared operation key=OGACI7CRPMT7 tag=CIVBEU08PKES type=del size=159972 2023-12-03T11:42:11.128 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.127+0000 7f8723d84780 1 < completed delete operation key=VENJI0KD1XDW tag=MC8VTB364XL8 type=del 2023-12-03T11:42:11.130 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.129+0000 7f8723d84780 1 > prepared part key=_multipart_10JRIKOZ16FY.2~5G5JEHMJQ72D.0 size=1048576 2023-12-03T11:42:11.131 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.130+0000 7f8723d84780 1 > prepared part key=_multipart_10JRIKOZ16FY.2~5G5JEHMJQ72D.1 size=1048576 2023-12-03T11:42:11.132 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.131+0000 7f8723d84780 1 > prepared part key=_multipart_10JRIKOZ16FY.2~5G5JEHMJQ72D.2 size=1016161 2023-12-03T11:42:11.133 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.131+0000 7f8723d84780 1 > prepared multipart upload key=10JRIKOZ16FY upload=5G5JEHMJQ72D tag=UFTNOTHURNU0 type=write size=4161889 2023-12-03T11:42:11.134 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.133+0000 7f8723d84780 1 < completed delete operation key=O7VVHXLDSY57 tag=4ISI6FJ94WA9 type=del 2023-12-03T11:42:11.136 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.135+0000 7f8723d84780 1 > prepared part key=_multipart_12XG7YPYTN4U.2~TBY1BUFGGZGS.0 size=1048576 2023-12-03T11:42:11.137 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.136+0000 7f8723d84780 1 > prepared part key=_multipart_12XG7YPYTN4U.2~TBY1BUFGGZGS.1 size=760182 2023-12-03T11:42:11.137 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.136+0000 7f8723d84780 1 > prepared multipart upload key=12XG7YPYTN4U upload=TBY1BUFGGZGS tag=DQOBEXSOKP12 type=write size=2857334 2023-12-03T11:42:11.138 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.137+0000 7f8723d84780 1 < completed part key=_multipart_HIU6L0NQ8Q95.2~C71R4EVGJ78L.0 size=741049 2023-12-03T11:42:11.140 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.139+0000 7f8723d84780 1 < completed multipart upload key=HIU6L0NQ8Q95 upload=C71R4EVGJ78L tag=FDJ9Q7FHZ6FU type=write size=1789625 2023-12-03T11:42:11.142 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.141+0000 7f8723d84780 1 > prepared part key=_multipart_DMQX2DGDLU7D.2~MM1DMAHUD56M.0 size=1048576 2023-12-03T11:42:11.143 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.142+0000 7f8723d84780 1 > prepared part key=_multipart_DMQX2DGDLU7D.2~MM1DMAHUD56M.1 size=1048576 2023-12-03T11:42:11.144 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.143+0000 7f8723d84780 1 > prepared part key=_multipart_DMQX2DGDLU7D.2~MM1DMAHUD56M.2 size=503092 2023-12-03T11:42:11.144 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.143+0000 7f8723d84780 1 > prepared multipart upload key=DMQX2DGDLU7D upload=MM1DMAHUD56M tag=ZQW1WXI0J9K6 type=write size=3648820 2023-12-03T11:42:11.145 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.144+0000 7f8723d84780 1 < completed part key=_multipart_D3JEVEY0E29E.2~I03N9TZS3K8Z.0 size=1048576 2023-12-03T11:42:11.146 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.145+0000 7f8723d84780 1 < completed part key=_multipart_D3JEVEY0E29E.2~I03N9TZS3K8Z.1 size=1048576 2023-12-03T11:42:11.146 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.145+0000 7f8723d84780 1 < canceled part key=_multipart_D3JEVEY0E29E.2~I03N9TZS3K8Z.2 size=518834 2023-12-03T11:42:11.148 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.147+0000 7f8723d84780 1 < canceled multipart upload key=D3JEVEY0E29E upload=I03N9TZS3K8Z tag=F7N3PL84DVQ0 type=write size=3664562 2023-12-03T11:42:11.150 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.149+0000 7f8723d84780 1 > prepared operation key=Y6S7QI60GCLE tag=OJ4RDL8I9J1S type=del size=919201 2023-12-03T11:42:11.151 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.150+0000 7f8723d84780 1 < completed part key=_multipart_UWS266H06VDK.2~5AT0TNYKQ4IS.0 size=1048576 2023-12-03T11:42:11.152 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.151+0000 7f8723d84780 1 < completed part key=_multipart_UWS266H06VDK.2~5AT0TNYKQ4IS.1 size=1048576 2023-12-03T11:42:11.153 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.152+0000 7f8723d84780 1 < completed part key=_multipart_UWS266H06VDK.2~5AT0TNYKQ4IS.2 size=7476 2023-12-03T11:42:11.155 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.154+0000 7f8723d84780 1 < completed multipart upload key=UWS266H06VDK upload=5AT0TNYKQ4IS tag=3JYNYMCMA7ES type=write size=3153204 2023-12-03T11:42:11.158 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.157+0000 7f8723d84780 1 > prepared part key=_multipart_Y6S7QI60GCLE.2~23XG8WMKKDD9.0 size=89825 2023-12-03T11:42:11.158 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.157+0000 7f8723d84780 1 > prepared multipart upload key=Y6S7QI60GCLE upload=23XG8WMKKDD9 tag=7PR7KF9G9B9K type=write size=1138401 2023-12-03T11:42:11.159 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.158+0000 7f8723d84780 1 < completed part key=_multipart_OGACI7CRPMT7.2~WWLMODYHNQ1Y.0 size=1048576 2023-12-03T11:42:11.160 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.159+0000 7f8723d84780 1 < completed part key=_multipart_OGACI7CRPMT7.2~WWLMODYHNQ1Y.1 size=1048576 2023-12-03T11:42:11.161 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.160+0000 7f8723d84780 1 < completed part key=_multipart_OGACI7CRPMT7.2~WWLMODYHNQ1Y.2 size=1037267 2023-12-03T11:42:11.163 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.162+0000 7f8723d84780 1 < completed multipart upload key=OGACI7CRPMT7 upload=WWLMODYHNQ1Y tag=40ACNCK16NK8 type=write size=4182995 2023-12-03T11:42:11.164 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.163+0000 7f8723d84780 1 > prepared operation key=4I8PWBZOLDUG tag=SY8Q0AST6W4O type=del size=860780 2023-12-03T11:42:11.165 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.164+0000 7f8723d84780 1 < completed delete operation key=10JRIKOZ16FY tag=1K7Q2Q0FYLCS type=del 2023-12-03T11:42:11.167 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.166+0000 7f8723d84780 1 > prepared operation key=5UYL15O31IHM tag=7B23IBJS1G13 type=del size=375132 2023-12-03T11:42:11.170 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.168+0000 7f8723d84780 1 < suggested remove operation key=7THZZ1J5LOZK tag=KJQRUAILS8T5 type=del 2023-12-03T11:42:11.171 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.170+0000 7f8723d84780 1 > prepared part key=_multipart_KS5J7E7KE2IJ.2~3FC7EET5ORBW.0 size=1048576 2023-12-03T11:42:11.172 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.171+0000 7f8723d84780 1 > prepared part key=_multipart_KS5J7E7KE2IJ.2~3FC7EET5ORBW.1 size=682253 2023-12-03T11:42:11.172 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.171+0000 7f8723d84780 1 > prepared multipart upload key=KS5J7E7KE2IJ upload=3FC7EET5ORBW tag=78FEL1UOF3F1 type=write size=2779405 2023-12-03T11:42:11.174 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.173+0000 7f8723d84780 1 < completed write operation key=931GNEXBHH35 tag=MU5AF47BLVPI type=write size=685733 2023-12-03T11:42:11.175 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.174+0000 7f8723d84780 1 > prepared operation key=M4VKPN6INFNZ tag=PA3T72PVVG5T type=del size=1580500 2023-12-03T11:42:11.176 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.175+0000 7f8723d84780 1 < completed delete operation key=W2704YS8KYQB tag=KY30LTPSD0J3 type=del 2023-12-03T11:42:11.177 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.176+0000 7f8723d84780 1 > prepared operation key=D3JEVEY0E29E tag=D6H3FYW70MBC type=del size=2957563 2023-12-03T11:42:11.179 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.178+0000 7f8723d84780 1 < completed part key=_multipart_VENJI0KD1XDW.2~MF43AUQWF29A.0 size=1048576 2023-12-03T11:42:11.180 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.179+0000 7f8723d84780 1 < completed part key=_multipart_VENJI0KD1XDW.2~MF43AUQWF29A.1 size=1048576 2023-12-03T11:42:11.180 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.179+0000 7f8723d84780 1 < canceled part key=_multipart_VENJI0KD1XDW.2~MF43AUQWF29A.2 size=1020491 2023-12-03T11:42:11.182 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.181+0000 7f8723d84780 1 < canceled multipart upload key=VENJI0KD1XDW upload=MF43AUQWF29A tag=QXLFOFN0Y815 type=write size=4166219 2023-12-03T11:42:11.185 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.184+0000 7f8723d84780 1 > prepared part key=_multipart_7THZZ1J5LOZK.2~GYU4S9TS9CP5.0 size=1011632 2023-12-03T11:42:11.185 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.184+0000 7f8723d84780 1 > prepared multipart upload key=7THZZ1J5LOZK upload=GYU4S9TS9CP5 tag=EE5FZG79NE7R type=write size=2060208 2023-12-03T11:42:11.186 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.185+0000 7f8723d84780 1 < completed delete operation key=O7VVHXLDSY57 tag=PLV27UFXPZYZ type=del 2023-12-03T11:42:11.189 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.188+0000 7f8723d84780 1 > prepared part key=_multipart_LMVO6CVEPN3K.2~G90FPS56CYKO.0 size=1048576 2023-12-03T11:42:11.190 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.189+0000 7f8723d84780 1 > prepared part key=_multipart_LMVO6CVEPN3K.2~G90FPS56CYKO.1 size=856195 2023-12-03T11:42:11.190 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.189+0000 7f8723d84780 1 > prepared multipart upload key=LMVO6CVEPN3K upload=G90FPS56CYKO tag=D7DDZZ1PPCYO type=write size=2953347 2023-12-03T11:42:11.192 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.191+0000 7f8723d84780 1 < completed part key=_multipart_96RAVVSUKH0Y.2~NS4KK39NQTUR.0 size=395141 2023-12-03T11:42:11.194 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.193+0000 7f8723d84780 1 < completed multipart upload key=96RAVVSUKH0Y upload=NS4KK39NQTUR tag=BXMPX7G48BQ8 type=write size=1443717 2023-12-03T11:42:11.199 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.195+0000 7f8723d84780 1 > prepared part key=_multipart_EY9ZG5KOTBWM.2~0LQJSXPN1IU6.0 size=860780 2023-12-03T11:42:11.199 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.195+0000 7f8723d84780 1 > prepared multipart upload key=EY9ZG5KOTBWM upload=0LQJSXPN1IU6 tag=DUG8LP6MID30 type=write size=1909356 2023-12-03T11:42:11.199 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.197+0000 7f8723d84780 1 < canceled operation key=D3JEVEY0E29E tag=69OCCDA1H9UC type=del size=1693507 2023-12-03T11:42:11.199 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.198+0000 7f8723d84780 1 > prepared operation key=96RAVVSUKH0Y tag=TYY76XDJ9DE7 type=del size=2353743 2023-12-03T11:42:11.202 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.201+0000 7f8723d84780 1 < suggested remove operation key=OPQPIDJ2PBVU tag=5Q9225JPXXOR type=write 2023-12-03T11:42:11.204 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.203+0000 7f8723d84780 1 > prepared part key=_multipart_CKABTI1EOAWB.2~7MAI1BL0QTVC.0 size=1048576 2023-12-03T11:42:11.205 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.204+0000 7f8723d84780 1 > prepared part key=_multipart_CKABTI1EOAWB.2~7MAI1BL0QTVC.1 size=829216 2023-12-03T11:42:11.206 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.205+0000 7f8723d84780 1 > prepared multipart upload key=CKABTI1EOAWB upload=7MAI1BL0QTVC tag=BN75JBP0ZD40 type=write size=2926368 2023-12-03T11:42:11.207 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.206+0000 7f8723d84780 1 < completed delete operation key=OGACI7CRPMT7 tag=CIVBEU08PKES type=del 2023-12-03T11:42:11.208 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.207+0000 7f8723d84780 1 > prepared operation key=CKABTI1EOAWB tag=4CL9F9OZBDZL type=del size=3938533 2023-12-03T11:42:11.209 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.208+0000 7f8723d84780 1 < completed part key=_multipart_10JRIKOZ16FY.2~5G5JEHMJQ72D.0 size=1048576 2023-12-03T11:42:11.210 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.209+0000 7f8723d84780 1 < completed part key=_multipart_10JRIKOZ16FY.2~5G5JEHMJQ72D.1 size=1048576 2023-12-03T11:42:11.211 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.210+0000 7f8723d84780 1 < completed part key=_multipart_10JRIKOZ16FY.2~5G5JEHMJQ72D.2 size=1016161 2023-12-03T11:42:11.213 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.212+0000 7f8723d84780 1 < completed multipart upload key=10JRIKOZ16FY upload=5G5JEHMJQ72D tag=UFTNOTHURNU0 type=write size=4161889 2023-12-03T11:42:11.215 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.214+0000 7f8723d84780 1 > prepared part key=_multipart_KS5J7E7KE2IJ.2~2VHHSN0SPT5Q.0 size=1048576 2023-12-03T11:42:11.217 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.215+0000 7f8723d84780 1 > prepared part key=_multipart_KS5J7E7KE2IJ.2~2VHHSN0SPT5Q.1 size=765575 2023-12-03T11:42:11.217 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.215+0000 7f8723d84780 1 > prepared multipart upload key=KS5J7E7KE2IJ upload=2VHHSN0SPT5Q tag=ZXW0DOGH9W5N type=write size=2862727 2023-12-03T11:42:11.218 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.217+0000 7f8723d84780 1 < completed part key=_multipart_12XG7YPYTN4U.2~TBY1BUFGGZGS.0 size=1048576 2023-12-03T11:42:11.219 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.218+0000 7f8723d84780 1 < completed part key=_multipart_12XG7YPYTN4U.2~TBY1BUFGGZGS.1 size=760182 2023-12-03T11:42:11.221 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.220+0000 7f8723d84780 1 < completed multipart upload key=12XG7YPYTN4U upload=TBY1BUFGGZGS tag=DQOBEXSOKP12 type=write size=2857334 2023-12-03T11:42:11.223 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.222+0000 7f8723d84780 1 > prepared part key=_multipart_M4VKPN6INFNZ.2~3MUPVBKVLEFA.0 size=620906 2023-12-03T11:42:11.223 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.222+0000 7f8723d84780 1 > prepared multipart upload key=M4VKPN6INFNZ upload=3MUPVBKVLEFA tag=IQQS4BX57DW1 type=write size=1669482 2023-12-03T11:42:11.224 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.223+0000 7f8723d84780 1 < completed part key=_multipart_DMQX2DGDLU7D.2~MM1DMAHUD56M.0 size=1048576 2023-12-03T11:42:11.225 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.224+0000 7f8723d84780 1 < completed part key=_multipart_DMQX2DGDLU7D.2~MM1DMAHUD56M.1 size=1048576 2023-12-03T11:42:11.226 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.225+0000 7f8723d84780 1 < completed part key=_multipart_DMQX2DGDLU7D.2~MM1DMAHUD56M.2 size=503092 2023-12-03T11:42:11.228 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.227+0000 7f8723d84780 1 < completed multipart upload key=DMQX2DGDLU7D upload=MM1DMAHUD56M tag=ZQW1WXI0J9K6 type=write size=3648820 2023-12-03T11:42:11.229 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.228+0000 7f8723d84780 1 > prepared operation key=W2704YS8KYQB tag=S1FYY4OK1LJQ type=write size=453175 2023-12-03T11:42:11.230 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.229+0000 7f8723d84780 1 < completed delete operation key=Y6S7QI60GCLE tag=OJ4RDL8I9J1S type=del 2023-12-03T11:42:11.231 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.230+0000 7f8723d84780 1 > prepared operation key=Y6S7QI60GCLE tag=FX1POTD45CMG type=del size=2708227 2023-12-03T11:42:11.232 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.231+0000 7f8723d84780 1 < completed part key=_multipart_Y6S7QI60GCLE.2~23XG8WMKKDD9.0 size=89825 2023-12-03T11:42:11.234 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.233+0000 7f8723d84780 1 < completed multipart upload key=Y6S7QI60GCLE upload=23XG8WMKKDD9 tag=7PR7KF9G9B9K type=write size=1138401 2023-12-03T11:42:11.235 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.234+0000 7f8723d84780 1 > prepared operation key=931GNEXBHH35 tag=SBNW6135T9Z1 type=del size=2000295 2023-12-03T11:42:11.236 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.235+0000 7f8723d84780 1 < completed delete operation key=4I8PWBZOLDUG tag=SY8Q0AST6W4O type=del 2023-12-03T11:42:11.239 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.238+0000 7f8723d84780 1 > prepared part key=_multipart_FCA2R3HR61S2.2~TNSMW2EVHIQJ.0 size=1048576 2023-12-03T11:42:11.240 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.239+0000 7f8723d84780 1 > prepared part key=_multipart_FCA2R3HR61S2.2~TNSMW2EVHIQJ.1 size=1048576 2023-12-03T11:42:11.241 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.240+0000 7f8723d84780 1 > prepared part key=_multipart_FCA2R3HR61S2.2~TNSMW2EVHIQJ.2 size=874962 2023-12-03T11:42:11.241 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.240+0000 7f8723d84780 1 > prepared multipart upload key=FCA2R3HR61S2 upload=TNSMW2EVHIQJ tag=Y3QG3X766VRM type=write size=4020690 2023-12-03T11:42:11.242 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.241+0000 7f8723d84780 1 < completed delete operation key=5UYL15O31IHM tag=7B23IBJS1G13 type=del 2023-12-03T11:42:11.243 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.242+0000 7f8723d84780 1 > prepared operation key=VENJI0KD1XDW tag=TJUJF21CUZIL type=write size=713958 2023-12-03T11:42:11.244 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.243+0000 7f8723d84780 1 < completed part key=_multipart_KS5J7E7KE2IJ.2~3FC7EET5ORBW.0 size=1048576 2023-12-03T11:42:11.245 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.244+0000 7f8723d84780 1 < completed part key=_multipart_KS5J7E7KE2IJ.2~3FC7EET5ORBW.1 size=682253 2023-12-03T11:42:11.248 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.247+0000 7f8723d84780 1 < completed multipart upload key=KS5J7E7KE2IJ upload=3FC7EET5ORBW tag=78FEL1UOF3F1 type=write size=2779405 2023-12-03T11:42:11.249 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.248+0000 7f8723d84780 1 > prepared operation key=LCK58DDM5XU9 tag=6SP8C5A511K7 type=del size=3116066 2023-12-03T11:42:11.250 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.249+0000 7f8723d84780 1 < canceled operation key=M4VKPN6INFNZ tag=PA3T72PVVG5T type=del size=1580500 2023-12-03T11:42:11.251 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.250+0000 7f8723d84780 1 > prepared operation key=TSTIBGVYUZZZ tag=2SSD2LSE32LX type=del size=85207 2023-12-03T11:42:11.253 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.252+0000 7f8723d84780 1 < completed delete operation key=D3JEVEY0E29E tag=D6H3FYW70MBC type=del 2023-12-03T11:42:11.254 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.253+0000 7f8723d84780 1 > prepared operation key=Y6S7QI60GCLE tag=R603ZFOKU00D type=write size=539753 2023-12-03T11:42:11.255 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.254+0000 7f8723d84780 1 < completed part key=_multipart_7THZZ1J5LOZK.2~GYU4S9TS9CP5.0 size=1011632 2023-12-03T11:42:11.257 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.256+0000 7f8723d84780 1 < completed multipart upload key=7THZZ1J5LOZK upload=GYU4S9TS9CP5 tag=EE5FZG79NE7R type=write size=2060208 2023-12-03T11:42:11.259 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.258+0000 7f8723d84780 1 > prepared part key=_multipart_931GNEXBHH35.2~REGOQBQJYDN7.0 size=1048576 2023-12-03T11:42:11.260 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.259+0000 7f8723d84780 1 > prepared part key=_multipart_931GNEXBHH35.2~REGOQBQJYDN7.1 size=759753 2023-12-03T11:42:11.260 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.259+0000 7f8723d84780 1 > prepared multipart upload key=931GNEXBHH35 upload=REGOQBQJYDN7 tag=3BBNXGZ1OWHN type=write size=2856905 2023-12-03T11:42:11.261 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.260+0000 7f8723d84780 1 < completed part key=_multipart_LMVO6CVEPN3K.2~G90FPS56CYKO.0 size=1048576 2023-12-03T11:42:11.262 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.261+0000 7f8723d84780 1 < completed part key=_multipart_LMVO6CVEPN3K.2~G90FPS56CYKO.1 size=856195 2023-12-03T11:42:11.265 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.264+0000 7f8723d84780 1 < completed multipart upload key=LMVO6CVEPN3K upload=G90FPS56CYKO tag=D7DDZZ1PPCYO type=write size=2953347 2023-12-03T11:42:11.267 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.266+0000 7f8723d84780 1 > prepared part key=_multipart_Y6S7QI60GCLE.2~VAN09P0S3D3A.0 size=1048576 2023-12-03T11:42:11.268 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.267+0000 7f8723d84780 1 > prepared part key=_multipart_Y6S7QI60GCLE.2~VAN09P0S3D3A.1 size=603294 2023-12-03T11:42:11.268 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.267+0000 7f8723d84780 1 > prepared multipart upload key=Y6S7QI60GCLE upload=VAN09P0S3D3A tag=YIF1N5HG9EQO type=write size=2700446 2023-12-03T11:42:11.269 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.268+0000 7f8723d84780 1 < completed part key=_multipart_EY9ZG5KOTBWM.2~0LQJSXPN1IU6.0 size=860780 2023-12-03T11:42:11.271 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.270+0000 7f8723d84780 1 < completed multipart upload key=EY9ZG5KOTBWM upload=0LQJSXPN1IU6 tag=DUG8LP6MID30 type=write size=1909356 2023-12-03T11:42:11.272 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.271+0000 7f8723d84780 1 > prepared operation key=7VMTBKUWU59F tag=HUQIW9XE3B99 type=del size=3485953 2023-12-03T11:42:11.275 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.274+0000 7f8723d84780 1 < suggested remove operation key=96RAVVSUKH0Y tag=TYY76XDJ9DE7 type=del 2023-12-03T11:42:11.276 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.275+0000 7f8723d84780 1 > prepared operation key=CKABTI1EOAWB tag=ECELOQPI5X4C type=del size=2737027 2023-12-03T11:42:11.277 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.276+0000 7f8723d84780 1 < completed part key=_multipart_CKABTI1EOAWB.2~7MAI1BL0QTVC.0 size=1048576 2023-12-03T11:42:11.278 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.277+0000 7f8723d84780 1 < completed part key=_multipart_CKABTI1EOAWB.2~7MAI1BL0QTVC.1 size=829216 2023-12-03T11:42:11.280 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.279+0000 7f8723d84780 1 < completed multipart upload key=CKABTI1EOAWB upload=7MAI1BL0QTVC tag=BN75JBP0ZD40 type=write size=2926368 2023-12-03T11:42:11.282 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.281+0000 7f8723d84780 1 > prepared part key=_multipart_G36T76K8O7A1.2~BA8ZPLUD6N5W.0 size=490526 2023-12-03T11:42:11.282 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.281+0000 7f8723d84780 1 > prepared multipart upload key=G36T76K8O7A1 upload=BA8ZPLUD6N5W tag=R2Z3WCHOMFEM type=write size=1539102 2023-12-03T11:42:11.285 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.284+0000 7f8723d84780 1 < suggested remove operation key=CKABTI1EOAWB tag=4CL9F9OZBDZL type=del 2023-12-03T11:42:11.286 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.285+0000 7f8723d84780 1 > prepared operation key=OPQPIDJ2PBVU tag=B565HYDMZRU3 type=del size=3912381 2023-12-03T11:42:11.288 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.287+0000 7f8723d84780 1 < completed part key=_multipart_KS5J7E7KE2IJ.2~2VHHSN0SPT5Q.0 size=1048576 2023-12-03T11:42:11.289 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.288+0000 7f8723d84780 1 < completed part key=_multipart_KS5J7E7KE2IJ.2~2VHHSN0SPT5Q.1 size=765575 2023-12-03T11:42:11.291 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.290+0000 7f8723d84780 1 < completed multipart upload key=KS5J7E7KE2IJ upload=2VHHSN0SPT5Q tag=ZXW0DOGH9W5N type=write size=2862727 2023-12-03T11:42:11.292 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.291+0000 7f8723d84780 1 > prepared operation key=EITMJKL0LCYC tag=V5K6F31VO1QC type=del size=3895051 2023-12-03T11:42:11.293 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.292+0000 7f8723d84780 1 < completed part key=_multipart_M4VKPN6INFNZ.2~3MUPVBKVLEFA.0 size=620906 2023-12-03T11:42:11.295 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.294+0000 7f8723d84780 1 < completed multipart upload key=M4VKPN6INFNZ upload=3MUPVBKVLEFA tag=IQQS4BX57DW1 type=write size=1669482 2023-12-03T11:42:11.297 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.296+0000 7f8723d84780 1 > prepared operation key=G36T76K8O7A1 tag=SY6CN22BO891 type=write size=588799 2023-12-03T11:42:11.298 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.297+0000 7f8723d84780 1 < completed write operation key=W2704YS8KYQB tag=S1FYY4OK1LJQ type=write size=453175 2023-12-03T11:42:11.301 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.299+0000 7f8723d84780 1 > prepared part key=_multipart_DMQX2DGDLU7D.2~TVD8ALXQJV1F.0 size=1048576 2023-12-03T11:42:11.301 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.300+0000 7f8723d84780 1 > prepared part key=_multipart_DMQX2DGDLU7D.2~TVD8ALXQJV1F.1 size=379245 2023-12-03T11:42:11.301 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.300+0000 7f8723d84780 1 > prepared multipart upload key=DMQX2DGDLU7D upload=TVD8ALXQJV1F tag=9AM5ZO6JENJ8 type=write size=2476397 2023-12-03T11:42:11.302 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.301+0000 7f8723d84780 1 < completed delete operation key=Y6S7QI60GCLE tag=FX1POTD45CMG type=del 2023-12-03T11:42:11.303 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.302+0000 7f8723d84780 1 > prepared operation key=12XG7YPYTN4U tag=KKJ0VCFGNFN5 type=del size=2921180 2023-12-03T11:42:11.304 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.303+0000 7f8723d84780 1 < completed delete operation key=931GNEXBHH35 tag=SBNW6135T9Z1 type=del 2023-12-03T11:42:11.306 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.305+0000 7f8723d84780 1 > prepared operation key=HIU6L0NQ8Q95 tag=TCCBTIOP1UTU type=write size=889668 2023-12-03T11:42:11.306 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.305+0000 7f8723d84780 1 < canceled part key=_multipart_FCA2R3HR61S2.2~TNSMW2EVHIQJ.0 size=1048576 2023-12-03T11:42:11.307 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.306+0000 7f8723d84780 1 < completed part key=_multipart_FCA2R3HR61S2.2~TNSMW2EVHIQJ.1 size=1048576 2023-12-03T11:42:11.308 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.307+0000 7f8723d84780 1 < completed part key=_multipart_FCA2R3HR61S2.2~TNSMW2EVHIQJ.2 size=874962 2023-12-03T11:42:11.310 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.309+0000 7f8723d84780 1 < canceled multipart upload key=FCA2R3HR61S2 upload=TNSMW2EVHIQJ tag=Y3QG3X766VRM type=write size=4020690 2023-12-03T11:42:11.312 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.311+0000 7f8723d84780 1 > prepared part key=_multipart_DMQX2DGDLU7D.2~XSYLI3MZJF43.0 size=657416 2023-12-03T11:42:11.312 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.311+0000 7f8723d84780 1 > prepared multipart upload key=DMQX2DGDLU7D upload=XSYLI3MZJF43 tag=EBQR9PEHD289 type=write size=1705992 2023-12-03T11:42:11.313 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.312+0000 7f8723d84780 1 < completed write operation key=VENJI0KD1XDW tag=TJUJF21CUZIL type=write size=713958 2023-12-03T11:42:11.314 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.313+0000 7f8723d84780 1 > prepared operation key=931GNEXBHH35 tag=Y3728RN95X19 type=del size=2957202 2023-12-03T11:42:11.316 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.315+0000 7f8723d84780 1 < completed delete operation key=LCK58DDM5XU9 tag=6SP8C5A511K7 type=del 2023-12-03T11:42:11.318 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.317+0000 7f8723d84780 1 > prepared operation key=O7VVHXLDSY57 tag=1SAIBUXYKBO9 type=del size=2703891 2023-12-03T11:42:11.319 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.318+0000 7f8723d84780 1 < completed delete operation key=TSTIBGVYUZZZ tag=2SSD2LSE32LX type=del 2023-12-03T11:42:11.320 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.319+0000 7f8723d84780 1 > prepared operation key=Y6S7QI60GCLE tag=YIOK4QGMPXVY type=del size=580692 2023-12-03T11:42:11.321 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.320+0000 7f8723d84780 1 < completed write operation key=Y6S7QI60GCLE tag=R603ZFOKU00D type=write size=539753 2023-12-03T11:42:11.322 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.321+0000 7f8723d84780 1 > prepared operation key=G36T76K8O7A1 tag=UPV1D4NBYHO7 type=del size=3233880 2023-12-03T11:42:11.325 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.323+0000 7f8723d84780 1 < completed part key=_multipart_931GNEXBHH35.2~REGOQBQJYDN7.0 size=1048576 2023-12-03T11:42:11.325 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.323+0000 7f8723d84780 1 < completed part key=_multipart_931GNEXBHH35.2~REGOQBQJYDN7.1 size=759753 2023-12-03T11:42:11.327 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.325+0000 7f8723d84780 1 < completed multipart upload key=931GNEXBHH35 upload=REGOQBQJYDN7 tag=3BBNXGZ1OWHN type=write size=2856905 2023-12-03T11:42:11.328 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.326+0000 7f8723d84780 1 > prepared operation key=4I8PWBZOLDUG tag=AW1FVNITLOY6 type=del size=1367773 2023-12-03T11:42:11.328 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.327+0000 7f8723d84780 1 < canceled part key=_multipart_Y6S7QI60GCLE.2~VAN09P0S3D3A.0 size=1048576 2023-12-03T11:42:11.329 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.328+0000 7f8723d84780 1 < completed part key=_multipart_Y6S7QI60GCLE.2~VAN09P0S3D3A.1 size=603294 2023-12-03T11:42:11.330 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.329+0000 7f8723d84780 1 < canceled multipart upload key=Y6S7QI60GCLE upload=VAN09P0S3D3A tag=YIF1N5HG9EQO type=write size=2700446 2023-12-03T11:42:11.333 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.332+0000 7f8723d84780 1 > prepared part key=_multipart_96RAVVSUKH0Y.2~PY59EMVNSXUF.0 size=475584 2023-12-03T11:42:11.333 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.332+0000 7f8723d84780 1 > prepared multipart upload key=96RAVVSUKH0Y upload=PY59EMVNSXUF tag=3THLTN3H7SH3 type=write size=1524160 2023-12-03T11:42:11.334 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.333+0000 7f8723d84780 1 < completed delete operation key=7VMTBKUWU59F tag=HUQIW9XE3B99 type=del 2023-12-03T11:42:11.335 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.334+0000 7f8723d84780 1 > prepared operation key=10JRIKOZ16FY tag=29SYYNZFXPCR type=del size=280791 2023-12-03T11:42:11.336 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.335+0000 7f8723d84780 -1 < failed to complete operation key=CKABTI1EOAWB tag=ECELOQPI5X4C type=del size=2737027: (22) Invalid argument 2023-12-03T11:42:11.337 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.336+0000 7f8723d84780 1 > prepared operation key=J33T5S893LMV tag=3MYG1Z0M21CP type=del size=1399824 2023-12-03T11:42:11.338 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.337+0000 7f8723d84780 1 < completed part key=_multipart_G36T76K8O7A1.2~BA8ZPLUD6N5W.0 size=490526 2023-12-03T11:42:11.340 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.339+0000 7f8723d84780 1 < completed multipart upload key=G36T76K8O7A1 upload=BA8ZPLUD6N5W tag=R2Z3WCHOMFEM type=write size=1539102 2023-12-03T11:42:11.342 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.341+0000 7f8723d84780 1 > prepared part key=_multipart_VENJI0KD1XDW.2~KXQ5N99QWU5D.0 size=1048576 2023-12-03T11:42:11.343 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.342+0000 7f8723d84780 1 > prepared part key=_multipart_VENJI0KD1XDW.2~KXQ5N99QWU5D.1 size=338540 2023-12-03T11:42:11.343 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.342+0000 7f8723d84780 1 > prepared multipart upload key=VENJI0KD1XDW upload=KXQ5N99QWU5D tag=1ZZA36TN982F type=write size=2435692 2023-12-03T11:42:11.344 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.343+0000 7f8723d84780 1 < completed delete operation key=OPQPIDJ2PBVU tag=B565HYDMZRU3 type=del 2023-12-03T11:42:11.345 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.344+0000 7f8723d84780 1 > prepared operation key=5UYL15O31IHM tag=HBZ3BW6G09EV type=del size=3965038 2023-12-03T11:42:11.348 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.347+0000 7f8723d84780 1 < suggested remove operation key=EITMJKL0LCYC tag=V5K6F31VO1QC type=del 2023-12-03T11:42:11.350 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.349+0000 7f8723d84780 1 > prepared part key=_multipart_10JRIKOZ16FY.2~3HTE0OBL3E5D.0 size=1048576 2023-12-03T11:42:11.351 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.350+0000 7f8723d84780 1 > prepared part key=_multipart_10JRIKOZ16FY.2~3HTE0OBL3E5D.1 size=1048576 2023-12-03T11:42:11.352 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.351+0000 7f8723d84780 1 > prepared part key=_multipart_10JRIKOZ16FY.2~3HTE0OBL3E5D.2 size=250258 2023-12-03T11:42:11.352 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.351+0000 7f8723d84780 1 > prepared multipart upload key=10JRIKOZ16FY upload=3HTE0OBL3E5D tag=7NWY6P914ZEI type=write size=3395986 2023-12-03T11:42:11.353 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.352+0000 7f8723d84780 1 < completed write operation key=G36T76K8O7A1 tag=SY6CN22BO891 type=write size=588799 2023-12-03T11:42:11.354 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.353+0000 7f8723d84780 1 > prepared operation key=Y6S7QI60GCLE tag=D47142INXMQG type=del size=1927388 2023-12-03T11:42:11.355 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.354+0000 7f8723d84780 1 < completed part key=_multipart_DMQX2DGDLU7D.2~TVD8ALXQJV1F.0 size=1048576 2023-12-03T11:42:11.356 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.355+0000 7f8723d84780 1 < completed part key=_multipart_DMQX2DGDLU7D.2~TVD8ALXQJV1F.1 size=379245 2023-12-03T11:42:11.360 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.359+0000 7f8723d84780 1 < completed multipart upload key=DMQX2DGDLU7D upload=TVD8ALXQJV1F tag=9AM5ZO6JENJ8 type=write size=2476397 2023-12-03T11:42:11.362 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.361+0000 7f8723d84780 1 > prepared part key=_multipart_DMQX2DGDLU7D.2~GUGCFS3UOFSV.0 size=87692 2023-12-03T11:42:11.362 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.361+0000 7f8723d84780 1 > prepared multipart upload key=DMQX2DGDLU7D upload=GUGCFS3UOFSV tag=XYC061T89EL5 type=write size=1136268 2023-12-03T11:42:11.364 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.363+0000 7f8723d84780 1 < suggested remove operation key=12XG7YPYTN4U tag=KKJ0VCFGNFN5 type=del 2023-12-03T11:42:11.366 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.365+0000 7f8723d84780 1 > prepared part key=_multipart_FCA2R3HR61S2.2~JEXAWNQXYQU2.0 size=827701 2023-12-03T11:42:11.367 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.365+0000 7f8723d84780 1 > prepared multipart upload key=FCA2R3HR61S2 upload=JEXAWNQXYQU2 tag=19F5GE8DGPBH type=write size=1876277 2023-12-03T11:42:11.368 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.367+0000 7f8723d84780 1 < completed write operation key=HIU6L0NQ8Q95 tag=TCCBTIOP1UTU type=write size=889668 2023-12-03T11:42:11.369 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.368+0000 7f8723d84780 1 > prepared operation key=4I8PWBZOLDUG tag=3ADTNZ8L3G53 type=write size=828880 2023-12-03T11:42:11.370 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.369+0000 7f8723d84780 1 < completed part key=_multipart_DMQX2DGDLU7D.2~XSYLI3MZJF43.0 size=657416 2023-12-03T11:42:11.372 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.371+0000 7f8723d84780 1 < completed multipart upload key=DMQX2DGDLU7D upload=XSYLI3MZJF43 tag=EBQR9PEHD289 type=write size=1705992 2023-12-03T11:42:11.373 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.372+0000 7f8723d84780 1 > prepared operation key=EY9ZG5KOTBWM tag=W8ESUVT9GMME type=del size=302700 2023-12-03T11:42:11.374 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.373+0000 7f8723d84780 1 < completed delete operation key=931GNEXBHH35 tag=Y3728RN95X19 type=del 2023-12-03T11:42:11.377 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.376+0000 7f8723d84780 1 > prepared part key=_multipart_D3JEVEY0E29E.2~4NQG3RN1TT2K.0 size=1048576 2023-12-03T11:42:11.378 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.376+0000 7f8723d84780 1 > prepared part key=_multipart_D3JEVEY0E29E.2~4NQG3RN1TT2K.1 size=987126 2023-12-03T11:42:11.378 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.376+0000 7f8723d84780 1 > prepared multipart upload key=D3JEVEY0E29E upload=4NQG3RN1TT2K tag=DFZ735ND7YJP type=write size=3084278 2023-12-03T11:42:11.379 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.378+0000 7f8723d84780 1 < completed delete operation key=O7VVHXLDSY57 tag=1SAIBUXYKBO9 type=del 2023-12-03T11:42:11.380 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.379+0000 7f8723d84780 1 > prepared operation key=DMQX2DGDLU7D tag=BQ59792WNLLG type=write size=1009569 2023-12-03T11:42:11.381 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.380+0000 7f8723d84780 1 < completed delete operation key=Y6S7QI60GCLE tag=YIOK4QGMPXVY type=del 2023-12-03T11:42:11.383 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.382+0000 7f8723d84780 1 > prepared part key=_multipart_96RAVVSUKH0Y.2~77FJF96RQ57J.0 size=1048576 2023-12-03T11:42:11.384 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.383+0000 7f8723d84780 1 > prepared part key=_multipart_96RAVVSUKH0Y.2~77FJF96RQ57J.1 size=1048576 2023-12-03T11:42:11.385 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.384+0000 7f8723d84780 1 > prepared part key=_multipart_96RAVVSUKH0Y.2~77FJF96RQ57J.2 size=140113 2023-12-03T11:42:11.385 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.384+0000 7f8723d84780 1 > prepared multipart upload key=96RAVVSUKH0Y upload=77FJF96RQ57J tag=KKS3I2TOAPK6 type=write size=3285841 2023-12-03T11:42:11.386 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.385+0000 7f8723d84780 1 < completed delete operation key=G36T76K8O7A1 tag=UPV1D4NBYHO7 type=del 2023-12-03T11:42:11.388 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.387+0000 7f8723d84780 1 > prepared operation key=OPQPIDJ2PBVU tag=VA5UXEMSCL94 type=del size=4062683 2023-12-03T11:42:11.389 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.388+0000 7f8723d84780 1 < completed delete operation key=4I8PWBZOLDUG tag=AW1FVNITLOY6 type=del 2023-12-03T11:42:11.390 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.389+0000 7f8723d84780 1 > prepared operation key=EITMJKL0LCYC tag=Y3LM4U5263B5 type=del size=1784083 2023-12-03T11:42:11.390 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.389+0000 7f8723d84780 1 < canceled part key=_multipart_96RAVVSUKH0Y.2~PY59EMVNSXUF.0 size=475584 2023-12-03T11:42:11.392 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.391+0000 7f8723d84780 1 < canceled multipart upload key=96RAVVSUKH0Y upload=PY59EMVNSXUF tag=3THLTN3H7SH3 type=write size=1524160 2023-12-03T11:42:11.393 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.392+0000 7f8723d84780 1 > prepared operation key=G36T76K8O7A1 tag=A8L4Y04VWDV7 type=write size=305459 2023-12-03T11:42:11.394 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.393+0000 7f8723d84780 1 < completed delete operation key=10JRIKOZ16FY tag=29SYYNZFXPCR type=del 2023-12-03T11:42:11.396 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.395+0000 7f8723d84780 1 > prepared operation key=G36T76K8O7A1 tag=NQWNXH7GNYSL type=write size=124829 2023-12-03T11:42:11.398 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.397+0000 7f8723d84780 1 < suggested remove operation key=J33T5S893LMV tag=3MYG1Z0M21CP type=del 2023-12-03T11:42:11.403 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.402+0000 7f8723d84780 1 > prepared part key=_multipart_LCK58DDM5XU9.2~0CVROLEGY1WO.0 size=829646 2023-12-03T11:42:11.403 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.402+0000 7f8723d84780 1 > prepared multipart upload key=LCK58DDM5XU9 upload=0CVROLEGY1WO tag=Q1N8QVRB6FSM type=write size=1878222 2023-12-03T11:42:11.406 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.404+0000 7f8723d84780 1 < completed part key=_multipart_VENJI0KD1XDW.2~KXQ5N99QWU5D.0 size=1048576 2023-12-03T11:42:11.408 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.407+0000 7f8723d84780 1 < completed part key=_multipart_VENJI0KD1XDW.2~KXQ5N99QWU5D.1 size=338540 2023-12-03T11:42:11.412 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.411+0000 7f8723d84780 1 < completed multipart upload key=VENJI0KD1XDW upload=KXQ5N99QWU5D tag=1ZZA36TN982F type=write size=2435692 2023-12-03T11:42:11.413 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.412+0000 7f8723d84780 1 > prepared operation key=12XG7YPYTN4U tag=CLGLY7VWAEED type=del size=3253415 2023-12-03T11:42:11.414 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.413+0000 7f8723d84780 1 < completed delete operation key=5UYL15O31IHM tag=HBZ3BW6G09EV type=del 2023-12-03T11:42:11.416 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.415+0000 7f8723d84780 1 > prepared part key=_multipart_OGACI7CRPMT7.2~QVB7AQK2GLCQ.0 size=1048576 2023-12-03T11:42:11.417 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.416+0000 7f8723d84780 1 > prepared part key=_multipart_OGACI7CRPMT7.2~QVB7AQK2GLCQ.1 size=892225 2023-12-03T11:42:11.417 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.416+0000 7f8723d84780 1 > prepared multipart upload key=OGACI7CRPMT7 upload=QVB7AQK2GLCQ tag=4N5XW9HGJLDE type=write size=2989377 2023-12-03T11:42:11.418 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.417+0000 7f8723d84780 1 < completed part key=_multipart_10JRIKOZ16FY.2~3HTE0OBL3E5D.0 size=1048576 2023-12-03T11:42:11.419 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.418+0000 7f8723d84780 1 < completed part key=_multipart_10JRIKOZ16FY.2~3HTE0OBL3E5D.1 size=1048576 2023-12-03T11:42:11.420 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.419+0000 7f8723d84780 1 < completed part key=_multipart_10JRIKOZ16FY.2~3HTE0OBL3E5D.2 size=250258 2023-12-03T11:42:11.422 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.421+0000 7f8723d84780 1 < completed multipart upload key=10JRIKOZ16FY upload=3HTE0OBL3E5D tag=7NWY6P914ZEI type=write size=3395986 2023-12-03T11:42:11.424 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.423+0000 7f8723d84780 1 > prepared operation key=OGACI7CRPMT7 tag=0KY5YUAIJQR9 type=del size=413219 2023-12-03T11:42:11.425 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.424+0000 7f8723d84780 1 < completed delete operation key=Y6S7QI60GCLE tag=D47142INXMQG type=del 2023-12-03T11:42:11.427 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.426+0000 7f8723d84780 1 > prepared part key=_multipart_HIU6L0NQ8Q95.2~KF0QQFPPF9DI.0 size=830355 2023-12-03T11:42:11.427 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.426+0000 7f8723d84780 1 > prepared multipart upload key=HIU6L0NQ8Q95 upload=KF0QQFPPF9DI tag=PITVZ7YKY4XE type=write size=1878931 2023-12-03T11:42:11.428 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.427+0000 7f8723d84780 1 < completed part key=_multipart_DMQX2DGDLU7D.2~GUGCFS3UOFSV.0 size=87692 2023-12-03T11:42:11.430 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.429+0000 7f8723d84780 1 < completed multipart upload key=DMQX2DGDLU7D upload=GUGCFS3UOFSV tag=XYC061T89EL5 type=write size=1136268 2023-12-03T11:42:11.432 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.431+0000 7f8723d84780 1 > prepared part key=_multipart_CKABTI1EOAWB.2~FTLMLO0RN1S9.0 size=764892 2023-12-03T11:42:11.432 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.431+0000 7f8723d84780 1 > prepared multipart upload key=CKABTI1EOAWB upload=FTLMLO0RN1S9 tag=ZOG0OC93WCF1 type=write size=1813468 2023-12-03T11:42:11.433 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.432+0000 7f8723d84780 1 < completed part key=_multipart_FCA2R3HR61S2.2~JEXAWNQXYQU2.0 size=827701 2023-12-03T11:42:11.436 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.434+0000 7f8723d84780 1 < completed multipart upload key=FCA2R3HR61S2 upload=JEXAWNQXYQU2 tag=19F5GE8DGPBH type=write size=1876277 2023-12-03T11:42:11.437 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.435+0000 7f8723d84780 1 > prepared operation key=7THZZ1J5LOZK tag=EF0MW79N7QDT type=del size=1431103 2023-12-03T11:42:11.438 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.437+0000 7f8723d84780 1 < completed write operation key=4I8PWBZOLDUG tag=3ADTNZ8L3G53 type=write size=828880 2023-12-03T11:42:11.439 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.438+0000 7f8723d84780 1 > prepared operation key=KS5J7E7KE2IJ tag=PBT0JWFB0TFB type=del size=3382663 2023-12-03T11:42:11.441 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.440+0000 7f8723d84780 1 < suggested update operation key=EY9ZG5KOTBWM tag=W8ESUVT9GMME type=del size=302700 2023-12-03T11:42:11.443 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.442+0000 7f8723d84780 1 > prepared part key=_multipart_12XG7YPYTN4U.2~YBMCSTFSQ6WM.0 size=1048576 2023-12-03T11:42:11.444 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.443+0000 7f8723d84780 1 > prepared part key=_multipart_12XG7YPYTN4U.2~YBMCSTFSQ6WM.1 size=1048576 2023-12-03T11:42:11.445 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.444+0000 7f8723d84780 1 > prepared part key=_multipart_12XG7YPYTN4U.2~YBMCSTFSQ6WM.2 size=488444 2023-12-03T11:42:11.445 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.444+0000 7f8723d84780 1 > prepared multipart upload key=12XG7YPYTN4U upload=YBMCSTFSQ6WM tag=38Q4FC8NQ00I type=write size=3634172 2023-12-03T11:42:11.445 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.444+0000 7f8723d84780 1 < canceled part key=_multipart_D3JEVEY0E29E.2~4NQG3RN1TT2K.0 size=1048576 2023-12-03T11:42:11.446 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.445+0000 7f8723d84780 1 < completed part key=_multipart_D3JEVEY0E29E.2~4NQG3RN1TT2K.1 size=987126 2023-12-03T11:42:11.448 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.447+0000 7f8723d84780 1 < canceled multipart upload key=D3JEVEY0E29E upload=4NQG3RN1TT2K tag=DFZ735ND7YJP type=write size=3084278 2023-12-03T11:42:11.449 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.448+0000 7f8723d84780 1 > prepared operation key=10JRIKOZ16FY tag=6BUBO99ZQ392 type=del size=3519274 2023-12-03T11:42:11.450 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.449+0000 7f8723d84780 1 < completed write operation key=DMQX2DGDLU7D tag=BQ59792WNLLG type=write size=1009569 2023-12-03T11:42:11.452 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.451+0000 7f8723d84780 1 > prepared operation key=M4VKPN6INFNZ tag=RAD1HIAZXFV3 type=del size=3614613 2023-12-03T11:42:11.453 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.452+0000 7f8723d84780 1 < completed part key=_multipart_96RAVVSUKH0Y.2~77FJF96RQ57J.0 size=1048576 2023-12-03T11:42:11.454 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.453+0000 7f8723d84780 1 < completed part key=_multipart_96RAVVSUKH0Y.2~77FJF96RQ57J.1 size=1048576 2023-12-03T11:42:11.455 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.454+0000 7f8723d84780 1 < completed part key=_multipart_96RAVVSUKH0Y.2~77FJF96RQ57J.2 size=140113 2023-12-03T11:42:11.457 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.456+0000 7f8723d84780 1 < completed multipart upload key=96RAVVSUKH0Y upload=77FJF96RQ57J tag=KKS3I2TOAPK6 type=write size=3285841 2023-12-03T11:42:11.458 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.457+0000 7f8723d84780 1 > prepared operation key=10JRIKOZ16FY tag=302ETVNIGNBF type=del size=1064254 2023-12-03T11:42:11.460 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.459+0000 7f8723d84780 1 < suggested remove operation key=OPQPIDJ2PBVU tag=VA5UXEMSCL94 type=del 2023-12-03T11:42:11.461 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.460+0000 7f8723d84780 1 > prepared operation key=TSTIBGVYUZZZ tag=DIE1GMZ0JT0V type=del size=1964976 2023-12-03T11:42:11.463 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.461+0000 7f8723d84780 1 < completed delete operation key=EITMJKL0LCYC tag=Y3LM4U5263B5 type=del 2023-12-03T11:42:11.465 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.464+0000 7f8723d84780 1 > prepared part key=_multipart_EITMJKL0LCYC.2~J0051V3T6GJ6.0 size=1048576 2023-12-03T11:42:11.466 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.465+0000 7f8723d84780 1 > prepared part key=_multipart_EITMJKL0LCYC.2~J0051V3T6GJ6.1 size=1048576 2023-12-03T11:42:11.467 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.465+0000 7f8723d84780 1 > prepared part key=_multipart_EITMJKL0LCYC.2~J0051V3T6GJ6.2 size=295107 2023-12-03T11:42:11.467 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.466+0000 7f8723d84780 1 > prepared multipart upload key=EITMJKL0LCYC upload=J0051V3T6GJ6 tag=ZZ568XR2KQ5P type=write size=3440835 2023-12-03T11:42:11.468 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.467+0000 7f8723d84780 1 < completed write operation key=G36T76K8O7A1 tag=A8L4Y04VWDV7 type=write size=305459 2023-12-03T11:42:11.469 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.468+0000 7f8723d84780 1 > prepared operation key=8NONX2I08YMJ tag=NG6ALKD5S5YC type=del size=2371057 2023-12-03T11:42:11.470 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.469+0000 7f8723d84780 1 < completed write operation key=G36T76K8O7A1 tag=NQWNXH7GNYSL type=write size=124829 2023-12-03T11:42:11.472 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.471+0000 7f8723d84780 1 > prepared part key=_multipart_HIU6L0NQ8Q95.2~90V4CPXKUS4Z.0 size=854670 2023-12-03T11:42:11.472 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.471+0000 7f8723d84780 1 > prepared multipart upload key=HIU6L0NQ8Q95 upload=90V4CPXKUS4Z tag=S5UWCQG7VU7B type=write size=1903246 2023-12-03T11:42:11.473 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.472+0000 7f8723d84780 1 < completed part key=_multipart_LCK58DDM5XU9.2~0CVROLEGY1WO.0 size=829646 2023-12-03T11:42:11.475 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.474+0000 7f8723d84780 1 < completed multipart upload key=LCK58DDM5XU9 upload=0CVROLEGY1WO tag=Q1N8QVRB6FSM type=write size=1878222 2023-12-03T11:42:11.478 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.477+0000 7f8723d84780 1 > prepared operation key=LMVO6CVEPN3K tag=2YDBSS14IA3N type=del size=1757101 2023-12-03T11:42:11.481 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.479+0000 7f8723d84780 1 < suggested update operation key=12XG7YPYTN4U tag=CLGLY7VWAEED type=del size=3253415 2023-12-03T11:42:11.483 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.482+0000 7f8723d84780 1 > prepared part key=_multipart_10JRIKOZ16FY.2~C6GXGX3S02JI.0 size=575247 2023-12-03T11:42:11.483 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.482+0000 7f8723d84780 1 > prepared multipart upload key=10JRIKOZ16FY upload=C6GXGX3S02JI tag=R0VME4P3HUEQ type=write size=1623823 2023-12-03T11:42:11.484 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.483+0000 7f8723d84780 1 < completed part key=_multipart_OGACI7CRPMT7.2~QVB7AQK2GLCQ.0 size=1048576 2023-12-03T11:42:11.484 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.483+0000 7f8723d84780 1 < canceled part key=_multipart_OGACI7CRPMT7.2~QVB7AQK2GLCQ.1 size=892225 2023-12-03T11:42:11.486 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.485+0000 7f8723d84780 1 < canceled multipart upload key=OGACI7CRPMT7 upload=QVB7AQK2GLCQ tag=4N5XW9HGJLDE type=write size=2989377 2023-12-03T11:42:11.488 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.487+0000 7f8723d84780 1 > prepared part key=_multipart_7THZZ1J5LOZK.2~FK4LFBQSN0KU.0 size=337706 2023-12-03T11:42:11.488 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.487+0000 7f8723d84780 1 > prepared multipart upload key=7THZZ1J5LOZK upload=FK4LFBQSN0KU tag=LBZW8FSC72GM type=write size=1386282 2023-12-03T11:42:11.490 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.489+0000 7f8723d84780 1 < suggested update operation key=OGACI7CRPMT7 tag=0KY5YUAIJQR9 type=del size=413219 2023-12-03T11:42:11.493 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.492+0000 7f8723d84780 1 > prepared operation key=12XG7YPYTN4U tag=EYSVUBDSQTRL type=del size=3179222 2023-12-03T11:42:11.494 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.493+0000 7f8723d84780 1 < completed part key=_multipart_HIU6L0NQ8Q95.2~KF0QQFPPF9DI.0 size=830355 2023-12-03T11:42:11.496 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.495+0000 7f8723d84780 1 < completed multipart upload key=HIU6L0NQ8Q95 upload=KF0QQFPPF9DI tag=PITVZ7YKY4XE type=write size=1878931 2023-12-03T11:42:11.497 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.496+0000 7f8723d84780 1 > prepared operation key=G36T76K8O7A1 tag=DT5I29EE7BX2 type=del size=3146757 2023-12-03T11:42:11.499 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.498+0000 7f8723d84780 1 < completed part key=_multipart_CKABTI1EOAWB.2~FTLMLO0RN1S9.0 size=764892 2023-12-03T11:42:11.501 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.500+0000 7f8723d84780 1 < completed multipart upload key=CKABTI1EOAWB upload=FTLMLO0RN1S9 tag=ZOG0OC93WCF1 type=write size=1813468 2023-12-03T11:42:11.503 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.502+0000 7f8723d84780 1 > prepared part key=_multipart_FCA2R3HR61S2.2~9KVQVG1QYSO2.0 size=1048576 2023-12-03T11:42:11.504 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.503+0000 7f8723d84780 1 > prepared part key=_multipart_FCA2R3HR61S2.2~9KVQVG1QYSO2.1 size=1048576 2023-12-03T11:42:11.505 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.504+0000 7f8723d84780 1 > prepared part key=_multipart_FCA2R3HR61S2.2~9KVQVG1QYSO2.2 size=460688 2023-12-03T11:42:11.505 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.504+0000 7f8723d84780 1 > prepared multipart upload key=FCA2R3HR61S2 upload=9KVQVG1QYSO2 tag=SXQU871WCEU7 type=write size=3606416 2023-12-03T11:42:11.506 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.505+0000 7f8723d84780 1 < canceled operation key=7THZZ1J5LOZK tag=EF0MW79N7QDT type=del size=1431103 2023-12-03T11:42:11.507 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.507+0000 7f8723d84780 1 > prepared operation key=LCK58DDM5XU9 tag=96RBMJ9MT242 type=del size=1361726 2023-12-03T11:42:11.509 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.508+0000 7f8723d84780 1 < completed delete operation key=KS5J7E7KE2IJ tag=PBT0JWFB0TFB type=del 2023-12-03T11:42:11.510 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.509+0000 7f8723d84780 1 > prepared operation key=O7VVHXLDSY57 tag=D6EIDNXRWIJI type=del size=2968035 2023-12-03T11:42:11.511 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.510+0000 7f8723d84780 1 < completed part key=_multipart_12XG7YPYTN4U.2~YBMCSTFSQ6WM.0 size=1048576 2023-12-03T11:42:11.512 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.511+0000 7f8723d84780 1 < completed part key=_multipart_12XG7YPYTN4U.2~YBMCSTFSQ6WM.1 size=1048576 2023-12-03T11:42:11.513 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.512+0000 7f8723d84780 1 < completed part key=_multipart_12XG7YPYTN4U.2~YBMCSTFSQ6WM.2 size=488444 2023-12-03T11:42:11.515 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.514+0000 7f8723d84780 1 < completed multipart upload key=12XG7YPYTN4U upload=YBMCSTFSQ6WM tag=38Q4FC8NQ00I type=write size=3634172 2023-12-03T11:42:11.516 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.515+0000 7f8723d84780 1 > prepared operation key=M4VKPN6INFNZ tag=WWW08YC5UPCK type=del size=478097 2023-12-03T11:42:11.518 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.516+0000 7f8723d84780 1 < canceled operation key=10JRIKOZ16FY tag=6BUBO99ZQ392 type=del size=3519274 2023-12-03T11:42:11.519 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.518+0000 7f8723d84780 1 > prepared operation key=G36T76K8O7A1 tag=MCC0CLECRKHC type=write size=724436 2023-12-03T11:42:11.521 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.520+0000 7f8723d84780 1 < suggested remove operation key=M4VKPN6INFNZ tag=RAD1HIAZXFV3 type=del 2023-12-03T11:42:11.523 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.522+0000 7f8723d84780 1 > prepared part key=_multipart_DMQX2DGDLU7D.2~MM275K9JMQ5K.0 size=1048576 2023-12-03T11:42:11.524 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.523+0000 7f8723d84780 1 > prepared part key=_multipart_DMQX2DGDLU7D.2~MM275K9JMQ5K.1 size=1048576 2023-12-03T11:42:11.525 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.524+0000 7f8723d84780 1 > prepared part key=_multipart_DMQX2DGDLU7D.2~MM275K9JMQ5K.2 size=523364 2023-12-03T11:42:11.525 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.524+0000 7f8723d84780 1 > prepared multipart upload key=DMQX2DGDLU7D upload=MM275K9JMQ5K tag=3OZH6RPL4CZG type=write size=3669092 2023-12-03T11:42:11.526 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.525+0000 7f8723d84780 1 < completed delete operation key=10JRIKOZ16FY tag=302ETVNIGNBF type=del 2023-12-03T11:42:11.527 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.526+0000 7f8723d84780 1 > prepared operation key=8NONX2I08YMJ tag=1M0DY6XH2BSJ type=del size=1463203 2023-12-03T11:42:11.530 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.529+0000 7f8723d84780 1 < completed delete operation key=TSTIBGVYUZZZ tag=DIE1GMZ0JT0V type=del 2023-12-03T11:42:11.533 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.530+0000 7f8723d84780 1 > prepared operation key=KS5J7E7KE2IJ tag=XHHJJNKEOSUO type=del size=2093778 2023-12-03T11:42:11.533 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.531+0000 7f8723d84780 1 < completed part key=_multipart_EITMJKL0LCYC.2~J0051V3T6GJ6.0 size=1048576 2023-12-03T11:42:11.533 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.532+0000 7f8723d84780 1 < completed part key=_multipart_EITMJKL0LCYC.2~J0051V3T6GJ6.1 size=1048576 2023-12-03T11:42:11.534 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.533+0000 7f8723d84780 1 < completed part key=_multipart_EITMJKL0LCYC.2~J0051V3T6GJ6.2 size=295107 2023-12-03T11:42:11.536 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.535+0000 7f8723d84780 1 < completed multipart upload key=EITMJKL0LCYC upload=J0051V3T6GJ6 tag=ZZ568XR2KQ5P type=write size=3440835 2023-12-03T11:42:11.538 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.537+0000 7f8723d84780 1 > prepared operation key=G36T76K8O7A1 tag=H5KMKFM3STJ5 type=del size=362998 2023-12-03T11:42:11.539 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.538+0000 7f8723d84780 1 < completed delete operation key=8NONX2I08YMJ tag=NG6ALKD5S5YC type=del 2023-12-03T11:42:11.541 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.540+0000 7f8723d84780 1 > prepared part key=_multipart_EY9ZG5KOTBWM.2~TWA8DL97XNMK.0 size=1048576 2023-12-03T11:42:11.542 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.541+0000 7f8723d84780 1 > prepared part key=_multipart_EY9ZG5KOTBWM.2~TWA8DL97XNMK.1 size=1048576 2023-12-03T11:42:11.543 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.542+0000 7f8723d84780 1 > prepared part key=_multipart_EY9ZG5KOTBWM.2~TWA8DL97XNMK.2 size=988260 2023-12-03T11:42:11.543 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.542+0000 7f8723d84780 1 > prepared multipart upload key=EY9ZG5KOTBWM upload=TWA8DL97XNMK tag=PSU608TQX48R type=write size=4133988 2023-12-03T11:42:11.544 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.543+0000 7f8723d84780 1 < completed part key=_multipart_HIU6L0NQ8Q95.2~90V4CPXKUS4Z.0 size=854670 2023-12-03T11:42:11.546 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.545+0000 7f8723d84780 1 < completed multipart upload key=HIU6L0NQ8Q95 upload=90V4CPXKUS4Z tag=S5UWCQG7VU7B type=write size=1903246 2023-12-03T11:42:11.547 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.546+0000 7f8723d84780 1 > prepared operation key=KS5J7E7KE2IJ tag=HLCOHL3N5PXV type=write size=389766 2023-12-03T11:42:11.549 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.548+0000 7f8723d84780 1 < completed delete operation key=LMVO6CVEPN3K tag=2YDBSS14IA3N type=del 2023-12-03T11:42:11.550 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.549+0000 7f8723d84780 1 > prepared operation key=5UYL15O31IHM tag=SUYJX4U3MXQK type=del size=1300290 2023-12-03T11:42:11.551 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.550+0000 7f8723d84780 1 < completed part key=_multipart_10JRIKOZ16FY.2~C6GXGX3S02JI.0 size=575247 2023-12-03T11:42:11.553 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.552+0000 7f8723d84780 1 < completed multipart upload key=10JRIKOZ16FY upload=C6GXGX3S02JI tag=R0VME4P3HUEQ type=write size=1623823 2023-12-03T11:42:11.555 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.554+0000 7f8723d84780 1 > prepared part key=_multipart_96RAVVSUKH0Y.2~93MT6QODQFWA.0 size=1048576 2023-12-03T11:42:11.556 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.555+0000 7f8723d84780 1 > prepared part key=_multipart_96RAVVSUKH0Y.2~93MT6QODQFWA.1 size=1048576 2023-12-03T11:42:11.557 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.556+0000 7f8723d84780 1 > prepared part key=_multipart_96RAVVSUKH0Y.2~93MT6QODQFWA.2 size=956145 2023-12-03T11:42:11.558 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.556+0000 7f8723d84780 1 > prepared multipart upload key=96RAVVSUKH0Y upload=93MT6QODQFWA tag=XJGTPSVAJQD6 type=write size=4101873 2023-12-03T11:42:11.559 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.558+0000 7f8723d84780 1 < completed part key=_multipart_7THZZ1J5LOZK.2~FK4LFBQSN0KU.0 size=337706 2023-12-03T11:42:11.561 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.559+0000 7f8723d84780 1 < completed multipart upload key=7THZZ1J5LOZK upload=FK4LFBQSN0KU tag=LBZW8FSC72GM type=write size=1386282 2023-12-03T11:42:11.563 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.562+0000 7f8723d84780 1 > prepared part key=_multipart_D3JEVEY0E29E.2~KUC7UJTLFNJU.0 size=1048576 2023-12-03T11:42:11.563 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.563+0000 7f8723d84780 1 > prepared part key=_multipart_D3JEVEY0E29E.2~KUC7UJTLFNJU.1 size=1048576 2023-12-03T11:42:11.564 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.563+0000 7f8723d84780 1 > prepared part key=_multipart_D3JEVEY0E29E.2~KUC7UJTLFNJU.2 size=727907 2023-12-03T11:42:11.564 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.563+0000 7f8723d84780 1 > prepared multipart upload key=D3JEVEY0E29E upload=KUC7UJTLFNJU tag=7YN8UI11WQ8C type=write size=3873635 2023-12-03T11:42:11.566 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.565+0000 7f8723d84780 1 < completed delete operation key=12XG7YPYTN4U tag=EYSVUBDSQTRL type=del 2023-12-03T11:42:11.567 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.566+0000 7f8723d84780 1 > prepared operation key=LCK58DDM5XU9 tag=RKJ7NN0TLFDX type=del size=3001372 2023-12-03T11:42:11.568 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.567+0000 7f8723d84780 1 < completed delete operation key=G36T76K8O7A1 tag=DT5I29EE7BX2 type=del 2023-12-03T11:42:11.569 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.568+0000 7f8723d84780 1 > prepared operation key=W2704YS8KYQB tag=I5JZ40GVYFBV type=del size=2796913 2023-12-03T11:42:11.570 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.569+0000 7f8723d84780 1 < completed part key=_multipart_FCA2R3HR61S2.2~9KVQVG1QYSO2.0 size=1048576 2023-12-03T11:42:11.571 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.570+0000 7f8723d84780 1 < completed part key=_multipart_FCA2R3HR61S2.2~9KVQVG1QYSO2.1 size=1048576 2023-12-03T11:42:11.572 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.571+0000 7f8723d84780 1 < completed part key=_multipart_FCA2R3HR61S2.2~9KVQVG1QYSO2.2 size=460688 2023-12-03T11:42:11.574 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.573+0000 7f8723d84780 1 < completed multipart upload key=FCA2R3HR61S2 upload=9KVQVG1QYSO2 tag=SXQU871WCEU7 type=write size=3606416 2023-12-03T11:42:11.576 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.574+0000 7f8723d84780 1 > prepared operation key=931GNEXBHH35 tag=TWTVOOAVBF5Z type=del size=2269968 2023-12-03T11:42:11.578 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.577+0000 7f8723d84780 1 < suggested remove operation key=LCK58DDM5XU9 tag=96RBMJ9MT242 type=del 2023-12-03T11:42:11.579 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.578+0000 7f8723d84780 1 > prepared operation key=O7VVHXLDSY57 tag=M1F7NK2XOAEX type=del size=1782355 2023-12-03T11:42:11.581 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.580+0000 7f8723d84780 1 < suggested update operation key=O7VVHXLDSY57 tag=D6EIDNXRWIJI type=del size=2968035 2023-12-03T11:42:11.583 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.582+0000 7f8723d84780 1 > prepared part key=_multipart_J33T5S893LMV.2~7QDSDSNQZXKP.0 size=301782 2023-12-03T11:42:11.583 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.582+0000 7f8723d84780 1 > prepared multipart upload key=J33T5S893LMV upload=7QDSDSNQZXKP tag=NUI1NI6XLJLJ type=write size=1350358 2023-12-03T11:42:11.584 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.583+0000 7f8723d84780 -1 < failed to complete operation key=M4VKPN6INFNZ tag=WWW08YC5UPCK type=del size=478097: (22) Invalid argument 2023-12-03T11:42:11.585 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.584+0000 7f8723d84780 1 > prepared operation key=7VMTBKUWU59F tag=V9AVAZLNVD66 type=del size=753414 2023-12-03T11:42:11.588 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.587+0000 7f8723d84780 1 < suggested update operation key=G36T76K8O7A1 tag=MCC0CLECRKHC type=write size=724436 2023-12-03T11:42:11.589 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.588+0000 7f8723d84780 1 > prepared operation key=10JRIKOZ16FY tag=6V3AQPKNVLL6 type=del size=2608491 2023-12-03T11:42:11.589 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.588+0000 7f8723d84780 1 < canceled part key=_multipart_DMQX2DGDLU7D.2~MM275K9JMQ5K.0 size=1048576 2023-12-03T11:42:11.589 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.588+0000 7f8723d84780 1 < canceled part key=_multipart_DMQX2DGDLU7D.2~MM275K9JMQ5K.1 size=1048576 2023-12-03T11:42:11.590 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.589+0000 7f8723d84780 1 < completed part key=_multipart_DMQX2DGDLU7D.2~MM275K9JMQ5K.2 size=523364 2023-12-03T11:42:11.594 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.593+0000 7f8723d84780 1 < canceled multipart upload key=DMQX2DGDLU7D upload=MM275K9JMQ5K tag=3OZH6RPL4CZG type=write size=3669092 2023-12-03T11:42:11.596 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.595+0000 7f8723d84780 1 > prepared part key=_multipart_KS5J7E7KE2IJ.2~QB3MHY5MY0QZ.0 size=408572 2023-12-03T11:42:11.596 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.595+0000 7f8723d84780 1 > prepared multipart upload key=KS5J7E7KE2IJ upload=QB3MHY5MY0QZ tag=VJ46VQUXUO1Z type=write size=1457148 2023-12-03T11:42:11.597 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.596+0000 7f8723d84780 1 < completed delete operation key=8NONX2I08YMJ tag=1M0DY6XH2BSJ type=del 2023-12-03T11:42:11.598 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.597+0000 7f8723d84780 1 > prepared operation key=96RAVVSUKH0Y tag=FDVDHNJ7VP0Z type=del size=970835 2023-12-03T11:42:11.600 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.599+0000 7f8723d84780 1 < completed delete operation key=KS5J7E7KE2IJ tag=XHHJJNKEOSUO type=del 2023-12-03T11:42:11.601 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.600+0000 7f8723d84780 1 > prepared operation key=TSTIBGVYUZZZ tag=53H1RESEJ6JT type=del size=376248 2023-12-03T11:42:11.602 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.601+0000 7f8723d84780 -1 < failed to complete operation key=G36T76K8O7A1 tag=H5KMKFM3STJ5 type=del size=362998: (22) Invalid argument 2023-12-03T11:42:11.603 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.602+0000 7f8723d84780 1 > prepared operation key=UWS266H06VDK tag=VGJNFXU0QK4L type=del size=2767778 2023-12-03T11:42:11.604 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.603+0000 7f8723d84780 1 < completed part key=_multipart_EY9ZG5KOTBWM.2~TWA8DL97XNMK.0 size=1048576 2023-12-03T11:42:11.606 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.604+0000 7f8723d84780 1 < completed part key=_multipart_EY9ZG5KOTBWM.2~TWA8DL97XNMK.1 size=1048576 2023-12-03T11:42:11.607 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.606+0000 7f8723d84780 1 < completed part key=_multipart_EY9ZG5KOTBWM.2~TWA8DL97XNMK.2 size=988260 2023-12-03T11:42:11.609 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.608+0000 7f8723d84780 1 < completed multipart upload key=EY9ZG5KOTBWM upload=TWA8DL97XNMK tag=PSU608TQX48R type=write size=4133988 2023-12-03T11:42:11.612 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.610+0000 7f8723d84780 1 > prepared part key=_multipart_O7VVHXLDSY57.2~88YWI7LKS6ND.0 size=1048576 2023-12-03T11:42:11.612 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.611+0000 7f8723d84780 1 > prepared part key=_multipart_O7VVHXLDSY57.2~88YWI7LKS6ND.1 size=834192 2023-12-03T11:42:11.612 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.611+0000 7f8723d84780 1 > prepared multipart upload key=O7VVHXLDSY57 upload=88YWI7LKS6ND tag=D10AWJ709626 type=write size=2931344 2023-12-03T11:42:11.614 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.613+0000 7f8723d84780 1 < suggested remove operation key=KS5J7E7KE2IJ tag=HLCOHL3N5PXV type=write 2023-12-03T11:42:11.616 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.616+0000 7f8723d84780 1 > prepared part key=_multipart_5UYL15O31IHM.2~S2UZ0D5PH1DM.0 size=106920 2023-12-03T11:42:11.617 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.616+0000 7f8723d84780 1 > prepared multipart upload key=5UYL15O31IHM upload=S2UZ0D5PH1DM tag=WYJII0KHN7BZ type=write size=1155496 2023-12-03T11:42:11.619 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.618+0000 7f8723d84780 1 < suggested update operation key=5UYL15O31IHM tag=SUYJX4U3MXQK type=del size=1300290 2023-12-03T11:42:11.621 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.620+0000 7f8723d84780 1 > prepared part key=_multipart_K83BTR5BOLZE.2~OYNV0IBR2233.0 size=1048576 2023-12-03T11:42:11.622 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.621+0000 7f8723d84780 1 > prepared part key=_multipart_K83BTR5BOLZE.2~OYNV0IBR2233.1 size=474218 2023-12-03T11:42:11.622 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.621+0000 7f8723d84780 1 > prepared multipart upload key=K83BTR5BOLZE upload=OYNV0IBR2233 tag=2XW9TXA32CNC type=write size=2571370 2023-12-03T11:42:11.623 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.622+0000 7f8723d84780 1 < completed part key=_multipart_96RAVVSUKH0Y.2~93MT6QODQFWA.0 size=1048576 2023-12-03T11:42:11.624 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.623+0000 7f8723d84780 1 < completed part key=_multipart_96RAVVSUKH0Y.2~93MT6QODQFWA.1 size=1048576 2023-12-03T11:42:11.624 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.623+0000 7f8723d84780 1 < canceled part key=_multipart_96RAVVSUKH0Y.2~93MT6QODQFWA.2 size=956145 2023-12-03T11:42:11.626 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.625+0000 7f8723d84780 1 < canceled multipart upload key=96RAVVSUKH0Y upload=93MT6QODQFWA tag=XJGTPSVAJQD6 type=write size=4101873 2023-12-03T11:42:11.627 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.626+0000 7f8723d84780 1 > prepared operation key=DMQX2DGDLU7D tag=9I602IU1O0J0 type=del size=3190353 2023-12-03T11:42:11.628 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.626+0000 7f8723d84780 1 < canceled part key=_multipart_D3JEVEY0E29E.2~KUC7UJTLFNJU.0 size=1048576 2023-12-03T11:42:11.628 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.627+0000 7f8723d84780 1 < completed part key=_multipart_D3JEVEY0E29E.2~KUC7UJTLFNJU.1 size=1048576 2023-12-03T11:42:11.629 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.628+0000 7f8723d84780 1 < completed part key=_multipart_D3JEVEY0E29E.2~KUC7UJTLFNJU.2 size=727907 2023-12-03T11:42:11.631 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.630+0000 7f8723d84780 1 < canceled multipart upload key=D3JEVEY0E29E upload=KUC7UJTLFNJU tag=7YN8UI11WQ8C type=write size=3873635 2023-12-03T11:42:11.633 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.632+0000 7f8723d84780 1 > prepared part key=_multipart_AB0SN0E49Z5F.2~CS7B0111OHLG.0 size=1048576 2023-12-03T11:42:11.634 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.633+0000 7f8723d84780 1 > prepared part key=_multipart_AB0SN0E49Z5F.2~CS7B0111OHLG.1 size=139761 2023-12-03T11:42:11.634 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.633+0000 7f8723d84780 1 > prepared multipart upload key=AB0SN0E49Z5F upload=CS7B0111OHLG tag=NWHHXM40177H type=write size=2236913 2023-12-03T11:42:11.635 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.634+0000 7f8723d84780 -1 < failed to complete operation key=LCK58DDM5XU9 tag=RKJ7NN0TLFDX type=del size=3001372: (22) Invalid argument 2023-12-03T11:42:11.636 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.636+0000 7f8723d84780 1 > prepared operation key=TSTIBGVYUZZZ tag=2VXYU0QAF2RL type=del size=3190610 2023-12-03T11:42:11.639 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.638+0000 7f8723d84780 1 < suggested update operation key=W2704YS8KYQB tag=I5JZ40GVYFBV type=del size=2796913 2023-12-03T11:42:11.640 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.639+0000 7f8723d84780 1 > prepared operation key=KS5J7E7KE2IJ tag=0H28T2PIXNP3 type=del size=2980059 2023-12-03T11:42:11.642 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.640+0000 7f8723d84780 1 < canceled operation key=931GNEXBHH35 tag=TWTVOOAVBF5Z type=del size=2269968 2023-12-03T11:42:11.642 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.641+0000 7f8723d84780 1 > prepared operation key=AB0SN0E49Z5F tag=SF74SA7YC6JE type=del size=3962269 2023-12-03T11:42:11.645 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.644+0000 7f8723d84780 1 < suggested update operation key=O7VVHXLDSY57 tag=M1F7NK2XOAEX type=del size=1782355 2023-12-03T11:42:11.646 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.645+0000 7f8723d84780 1 > prepared operation key=DMQX2DGDLU7D tag=D3FQ2TFH5JZA type=del size=3442387 2023-12-03T11:42:11.646 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.645+0000 7f8723d84780 1 < canceled part key=_multipart_J33T5S893LMV.2~7QDSDSNQZXKP.0 size=301782 2023-12-03T11:42:11.649 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.647+0000 7f8723d84780 1 < canceled multipart upload key=J33T5S893LMV upload=7QDSDSNQZXKP tag=NUI1NI6XLJLJ type=write size=1350358 2023-12-03T11:42:11.650 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.649+0000 7f8723d84780 1 > prepared part key=_multipart_D3JEVEY0E29E.2~5NID526RXL75.0 size=687066 2023-12-03T11:42:11.650 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.649+0000 7f8723d84780 1 > prepared multipart upload key=D3JEVEY0E29E upload=5NID526RXL75 tag=A0PYR1AV2VLH type=write size=1735642 2023-12-03T11:42:11.652 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.651+0000 7f8723d84780 1 < completed delete operation key=7VMTBKUWU59F tag=V9AVAZLNVD66 type=del 2023-12-03T11:42:11.653 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.652+0000 7f8723d84780 1 > prepared operation key=Y6S7QI60GCLE tag=3FVUXM943I9Q type=del size=612297 2023-12-03T11:42:11.654 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.653+0000 7f8723d84780 1 < completed delete operation key=10JRIKOZ16FY tag=6V3AQPKNVLL6 type=del 2023-12-03T11:42:11.656 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.655+0000 7f8723d84780 1 > prepared operation key=K83BTR5BOLZE tag=3SVGPAOR4SC2 type=del size=1525487 2023-12-03T11:42:11.657 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.656+0000 7f8723d84780 1 < completed part key=_multipart_KS5J7E7KE2IJ.2~QB3MHY5MY0QZ.0 size=408572 2023-12-03T11:42:11.659 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.658+0000 7f8723d84780 1 < completed multipart upload key=KS5J7E7KE2IJ upload=QB3MHY5MY0QZ tag=VJ46VQUXUO1Z type=write size=1457148 2023-12-03T11:42:11.660 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.659+0000 7f8723d84780 1 > prepared operation key=W2704YS8KYQB tag=NP6ULGL85TUU type=del size=792008 2023-12-03T11:42:11.661 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.660+0000 7f8723d84780 1 < completed delete operation key=96RAVVSUKH0Y tag=FDVDHNJ7VP0Z type=del 2023-12-03T11:42:11.662 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.661+0000 7f8723d84780 1 > prepared operation key=Y6S7QI60GCLE tag=IQ5S35D0RBQ8 type=write size=198498 2023-12-03T11:42:11.664 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.663+0000 7f8723d84780 1 < completed delete operation key=TSTIBGVYUZZZ tag=53H1RESEJ6JT type=del 2023-12-03T11:42:11.665 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.664+0000 7f8723d84780 1 > prepared operation key=LCK58DDM5XU9 tag=9MBW23WDS5IF type=del size=4083344 2023-12-03T11:42:11.666 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.665+0000 7f8723d84780 1 < completed delete operation key=UWS266H06VDK tag=VGJNFXU0QK4L type=del 2023-12-03T11:42:11.668 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.667+0000 7f8723d84780 1 > prepared operation key=J33T5S893LMV tag=BMIKC9XIGJCB type=del size=3308844 2023-12-03T11:42:11.669 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.668+0000 7f8723d84780 1 < completed part key=_multipart_O7VVHXLDSY57.2~88YWI7LKS6ND.0 size=1048576 2023-12-03T11:42:11.671 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.669+0000 7f8723d84780 1 < completed part key=_multipart_O7VVHXLDSY57.2~88YWI7LKS6ND.1 size=834192 2023-12-03T11:42:11.672 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.671+0000 7f8723d84780 1 < completed multipart upload key=O7VVHXLDSY57 upload=88YWI7LKS6ND tag=D10AWJ709626 type=write size=2931344 2023-12-03T11:42:11.673 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.673+0000 7f8723d84780 1 > prepared operation key=D3JEVEY0E29E tag=15A53KYGU54N type=del size=869475 2023-12-03T11:42:11.675 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.674+0000 7f8723d84780 1 < completed part key=_multipart_5UYL15O31IHM.2~S2UZ0D5PH1DM.0 size=106920 2023-12-03T11:42:11.677 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.676+0000 7f8723d84780 1 < completed multipart upload key=5UYL15O31IHM upload=S2UZ0D5PH1DM tag=WYJII0KHN7BZ type=write size=1155496 2023-12-03T11:42:11.678 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.677+0000 7f8723d84780 1 > prepared operation key=EY9ZG5KOTBWM tag=Z8HT5JER7Q8A type=write size=644722 2023-12-03T11:42:11.679 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.679+0000 7f8723d84780 1 < completed part key=_multipart_K83BTR5BOLZE.2~OYNV0IBR2233.0 size=1048576 2023-12-03T11:42:11.681 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.680+0000 7f8723d84780 1 < completed part key=_multipart_K83BTR5BOLZE.2~OYNV0IBR2233.1 size=474218 2023-12-03T11:42:11.682 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.682+0000 7f8723d84780 1 < completed multipart upload key=K83BTR5BOLZE upload=OYNV0IBR2233 tag=2XW9TXA32CNC type=write size=2571370 2023-12-03T11:42:11.686 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.684+0000 7f8723d84780 1 > prepared part key=_multipart_931GNEXBHH35.2~WJVBSKZP3YWV.0 size=1048576 2023-12-03T11:42:11.686 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.685+0000 7f8723d84780 1 > prepared part key=_multipart_931GNEXBHH35.2~WJVBSKZP3YWV.1 size=568428 2023-12-03T11:42:11.686 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.685+0000 7f8723d84780 1 > prepared multipart upload key=931GNEXBHH35 upload=WJVBSKZP3YWV tag=GV42TDYKW5PG type=write size=2665580 2023-12-03T11:42:11.687 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.686+0000 7f8723d84780 1 < completed delete operation key=DMQX2DGDLU7D tag=9I602IU1O0J0 type=del 2023-12-03T11:42:11.688 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.687+0000 7f8723d84780 1 > prepared operation key=10JRIKOZ16FY tag=25C7UO1KZNMK type=write size=1019840 2023-12-03T11:42:11.689 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.688+0000 7f8723d84780 1 < completed part key=_multipart_AB0SN0E49Z5F.2~CS7B0111OHLG.0 size=1048576 2023-12-03T11:42:11.691 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.689+0000 7f8723d84780 1 < completed part key=_multipart_AB0SN0E49Z5F.2~CS7B0111OHLG.1 size=139761 2023-12-03T11:42:11.692 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.691+0000 7f8723d84780 1 < completed multipart upload key=AB0SN0E49Z5F upload=CS7B0111OHLG tag=NWHHXM40177H type=write size=2236913 2023-12-03T11:42:11.694 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.693+0000 7f8723d84780 1 > prepared operation key=10JRIKOZ16FY tag=5Z7Z6D4U0XME type=del size=1056185 2023-12-03T11:42:11.695 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.694+0000 7f8723d84780 1 < completed delete operation key=TSTIBGVYUZZZ tag=2VXYU0QAF2RL type=del 2023-12-03T11:42:11.697 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.695+0000 7f8723d84780 1 > prepared operation key=OGACI7CRPMT7 tag=T0DVY4AAUOLW type=del size=1523286 2023-12-03T11:42:11.698 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.697+0000 7f8723d84780 1 < canceled operation key=KS5J7E7KE2IJ tag=0H28T2PIXNP3 type=del size=2980059 2023-12-03T11:42:11.700 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.699+0000 7f8723d84780 1 > prepared part key=_multipart_TSTIBGVYUZZZ.2~XSTTYGF7J4WB.0 size=1048576 2023-12-03T11:42:11.701 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.700+0000 7f8723d84780 1 > prepared part key=_multipart_TSTIBGVYUZZZ.2~XSTTYGF7J4WB.1 size=1048576 2023-12-03T11:42:11.702 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.701+0000 7f8723d84780 1 > prepared part key=_multipart_TSTIBGVYUZZZ.2~XSTTYGF7J4WB.2 size=82526 2023-12-03T11:42:11.702 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.701+0000 7f8723d84780 1 > prepared multipart upload key=TSTIBGVYUZZZ upload=XSTTYGF7J4WB tag=2BWWD6FZV96R type=write size=3228254 2023-12-03T11:42:11.703 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.702+0000 7f8723d84780 1 < completed delete operation key=AB0SN0E49Z5F tag=SF74SA7YC6JE type=del 2023-12-03T11:42:11.705 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.704+0000 7f8723d84780 1 > prepared part key=_multipart_EITMJKL0LCYC.2~VUPRL5F8YE5L.0 size=1048576 2023-12-03T11:42:11.707 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.706+0000 7f8723d84780 1 > prepared part key=_multipart_EITMJKL0LCYC.2~VUPRL5F8YE5L.1 size=1048576 2023-12-03T11:42:11.709 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.708+0000 7f8723d84780 1 > prepared part key=_multipart_EITMJKL0LCYC.2~VUPRL5F8YE5L.2 size=806783 2023-12-03T11:42:11.709 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.708+0000 7f8723d84780 1 > prepared multipart upload key=EITMJKL0LCYC upload=VUPRL5F8YE5L tag=VLZSN2JGP2UQ type=write size=3952511 2023-12-03T11:42:11.711 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.710+0000 7f8723d84780 1 < suggested update operation key=DMQX2DGDLU7D tag=D3FQ2TFH5JZA type=del size=3442387 2023-12-03T11:42:11.713 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.712+0000 7f8723d84780 1 > prepared part key=_multipart_Y6S7QI60GCLE.2~TYGFD8XRHOOP.0 size=295569 2023-12-03T11:42:11.714 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.713+0000 7f8723d84780 1 > prepared multipart upload key=Y6S7QI60GCLE upload=TYGFD8XRHOOP tag=TSZVGA12TNW1 type=write size=1344145 2023-12-03T11:42:11.715 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.714+0000 7f8723d84780 1 < completed part key=_multipart_D3JEVEY0E29E.2~5NID526RXL75.0 size=687066 2023-12-03T11:42:11.717 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.716+0000 7f8723d84780 1 < completed multipart upload key=D3JEVEY0E29E upload=5NID526RXL75 tag=A0PYR1AV2VLH type=write size=1735642 2023-12-03T11:42:11.718 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.717+0000 7f8723d84780 1 > prepared operation key=LCK58DDM5XU9 tag=3R5JTZDI1SE7 type=del size=3495164 2023-12-03T11:42:11.720 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.719+0000 7f8723d84780 1 < suggested update operation key=Y6S7QI60GCLE tag=3FVUXM943I9Q type=del size=612297 2023-12-03T11:42:11.722 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.720+0000 7f8723d84780 1 > prepared operation key=8NONX2I08YMJ tag=1P5P09GQYX8T type=del size=1809698 2023-12-03T11:42:11.723 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.721+0000 7f8723d84780 1 < completed delete operation key=K83BTR5BOLZE tag=3SVGPAOR4SC2 type=del 2023-12-03T11:42:11.724 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.723+0000 7f8723d84780 1 > prepared operation key=OPQPIDJ2PBVU tag=U4DCGUIAQD2W type=del size=2735136 2023-12-03T11:42:11.725 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.724+0000 7f8723d84780 1 < completed delete operation key=W2704YS8KYQB tag=NP6ULGL85TUU type=del 2023-12-03T11:42:11.726 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.725+0000 7f8723d84780 1 > prepared operation key=CKABTI1EOAWB tag=BMDTG7IFLXXC type=del size=738864 2023-12-03T11:42:11.728 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.726+0000 7f8723d84780 -1 < failed to complete operation key=Y6S7QI60GCLE tag=IQ5S35D0RBQ8 type=write size=198498: (22) Invalid argument 2023-12-03T11:42:11.730 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.728+0000 7f8723d84780 1 > prepared part key=_multipart_EITMJKL0LCYC.2~W4DJRU74381L.0 size=1048576 2023-12-03T11:42:11.730 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.729+0000 7f8723d84780 1 > prepared part key=_multipart_EITMJKL0LCYC.2~W4DJRU74381L.1 size=374170 2023-12-03T11:42:11.730 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.729+0000 7f8723d84780 1 > prepared multipart upload key=EITMJKL0LCYC upload=W4DJRU74381L tag=3RS21JQIGVVN type=write size=2471322 2023-12-03T11:42:11.731 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.730+0000 7f8723d84780 1 < completed delete operation key=LCK58DDM5XU9 tag=9MBW23WDS5IF type=del 2023-12-03T11:42:11.733 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.732+0000 7f8723d84780 1 > prepared part key=_multipart_HIU6L0NQ8Q95.2~QPIIEK2UB0II.0 size=1048576 2023-12-03T11:42:11.734 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.733+0000 7f8723d84780 1 > prepared part key=_multipart_HIU6L0NQ8Q95.2~QPIIEK2UB0II.1 size=936861 2023-12-03T11:42:11.734 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.733+0000 7f8723d84780 1 > prepared multipart upload key=HIU6L0NQ8Q95 upload=QPIIEK2UB0II tag=I4MT30G790KI type=write size=3034013 2023-12-03T11:42:11.738 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.734+0000 7f8723d84780 1 < completed delete operation key=J33T5S893LMV tag=BMIKC9XIGJCB type=del 2023-12-03T11:42:11.738 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.736+0000 7f8723d84780 1 > prepared part key=_multipart_FCA2R3HR61S2.2~9XRXS06CQ739.0 size=1048576 2023-12-03T11:42:11.738 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.737+0000 7f8723d84780 1 > prepared part key=_multipart_FCA2R3HR61S2.2~9XRXS06CQ739.1 size=1048576 2023-12-03T11:42:11.739 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.738+0000 7f8723d84780 1 > prepared part key=_multipart_FCA2R3HR61S2.2~9XRXS06CQ739.2 size=391966 2023-12-03T11:42:11.739 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.738+0000 7f8723d84780 1 > prepared multipart upload key=FCA2R3HR61S2 upload=9XRXS06CQ739 tag=7039MEU9ACOT type=write size=3537694 2023-12-03T11:42:11.742 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.741+0000 7f8723d84780 1 < suggested remove operation key=D3JEVEY0E29E tag=15A53KYGU54N type=del 2023-12-03T11:42:11.743 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.742+0000 7f8723d84780 1 > prepared operation key=M4VKPN6INFNZ tag=GBF8ZCH06Y26 type=del size=3673684 2023-12-03T11:42:11.744 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.743+0000 7f8723d84780 1 < canceled operation key=EY9ZG5KOTBWM tag=Z8HT5JER7Q8A type=write size=644722 2023-12-03T11:42:11.746 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.745+0000 7f8723d84780 1 > prepared part key=_multipart_96RAVVSUKH0Y.2~M75OPG6M2VOC.0 size=1048576 2023-12-03T11:42:11.747 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.746+0000 7f8723d84780 1 > prepared part key=_multipart_96RAVVSUKH0Y.2~M75OPG6M2VOC.1 size=1048576 2023-12-03T11:42:11.748 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.747+0000 7f8723d84780 1 > prepared part key=_multipart_96RAVVSUKH0Y.2~M75OPG6M2VOC.2 size=154476 2023-12-03T11:42:11.748 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.747+0000 7f8723d84780 1 > prepared multipart upload key=96RAVVSUKH0Y upload=M75OPG6M2VOC tag=385QMS73OPEU type=write size=3300204 2023-12-03T11:42:11.749 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.748+0000 7f8723d84780 1 < completed part key=_multipart_931GNEXBHH35.2~WJVBSKZP3YWV.0 size=1048576 2023-12-03T11:42:11.750 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.749+0000 7f8723d84780 1 < completed part key=_multipart_931GNEXBHH35.2~WJVBSKZP3YWV.1 size=568428 2023-12-03T11:42:11.752 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.751+0000 7f8723d84780 1 < completed multipart upload key=931GNEXBHH35 upload=WJVBSKZP3YWV tag=GV42TDYKW5PG type=write size=2665580 2023-12-03T11:42:11.753 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.752+0000 7f8723d84780 1 > prepared operation key=OGACI7CRPMT7 tag=CB6OE3NLNCXW type=del size=2975650 2023-12-03T11:42:11.754 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.754+0000 7f8723d84780 1 < completed write operation key=10JRIKOZ16FY tag=25C7UO1KZNMK type=write size=1019840 2023-12-03T11:42:11.757 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.756+0000 7f8723d84780 1 > prepared part key=_multipart_FCA2R3HR61S2.2~R3P7HAQDWC7Y.0 size=250798 2023-12-03T11:42:11.757 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.756+0000 7f8723d84780 1 > prepared multipart upload key=FCA2R3HR61S2 upload=R3P7HAQDWC7Y tag=IX875RERRMKP type=write size=1299374 2023-12-03T11:42:11.758 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.757+0000 7f8723d84780 1 < completed delete operation key=10JRIKOZ16FY tag=5Z7Z6D4U0XME type=del 2023-12-03T11:42:11.760 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.759+0000 7f8723d84780 1 > prepared part key=_multipart_K83BTR5BOLZE.2~R946776AJ06J.0 size=1048576 2023-12-03T11:42:11.761 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.760+0000 7f8723d84780 1 > prepared part key=_multipart_K83BTR5BOLZE.2~R946776AJ06J.1 size=904755 2023-12-03T11:42:11.761 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.760+0000 7f8723d84780 1 > prepared multipart upload key=K83BTR5BOLZE upload=R946776AJ06J tag=3GNG1GVA2WJL type=write size=3001907 2023-12-03T11:42:11.762 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.761+0000 7f8723d84780 1 < completed delete operation key=OGACI7CRPMT7 tag=T0DVY4AAUOLW type=del 2023-12-03T11:42:11.764 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.762+0000 7f8723d84780 1 > prepared operation key=931GNEXBHH35 tag=28TS3AJMK4KA type=write size=984432 2023-12-03T11:42:11.764 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.763+0000 7f8723d84780 1 < canceled part key=_multipart_TSTIBGVYUZZZ.2~XSTTYGF7J4WB.0 size=1048576 2023-12-03T11:42:11.764 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.763+0000 7f8723d84780 1 < completed part key=_multipart_TSTIBGVYUZZZ.2~XSTTYGF7J4WB.1 size=1048576 2023-12-03T11:42:11.765 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.764+0000 7f8723d84780 1 < completed part key=_multipart_TSTIBGVYUZZZ.2~XSTTYGF7J4WB.2 size=82526 2023-12-03T11:42:11.767 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.766+0000 7f8723d84780 1 < canceled multipart upload key=TSTIBGVYUZZZ upload=XSTTYGF7J4WB tag=2BWWD6FZV96R type=write size=3228254 2023-12-03T11:42:11.768 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.767+0000 7f8723d84780 1 > prepared operation key=HIU6L0NQ8Q95 tag=ICCY6VLG9GT5 type=del size=3493765 2023-12-03T11:42:11.770 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.769+0000 7f8723d84780 1 < completed part key=_multipart_EITMJKL0LCYC.2~VUPRL5F8YE5L.0 size=1048576 2023-12-03T11:42:11.771 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.770+0000 7f8723d84780 1 < completed part key=_multipart_EITMJKL0LCYC.2~VUPRL5F8YE5L.1 size=1048576 2023-12-03T11:42:11.772 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.770+0000 7f8723d84780 1 < completed part key=_multipart_EITMJKL0LCYC.2~VUPRL5F8YE5L.2 size=806783 2023-12-03T11:42:11.773 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.772+0000 7f8723d84780 1 < completed multipart upload key=EITMJKL0LCYC upload=VUPRL5F8YE5L tag=VLZSN2JGP2UQ type=write size=3952511 2023-12-03T11:42:11.776 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.775+0000 7f8723d84780 1 > prepared part key=_multipart_UWS266H06VDK.2~Q2CHI8DKNTFL.0 size=1048576 2023-12-03T11:42:11.777 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.776+0000 7f8723d84780 1 > prepared part key=_multipart_UWS266H06VDK.2~Q2CHI8DKNTFL.1 size=1048576 2023-12-03T11:42:11.778 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.777+0000 7f8723d84780 1 > prepared part key=_multipart_UWS266H06VDK.2~Q2CHI8DKNTFL.2 size=951399 2023-12-03T11:42:11.778 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.777+0000 7f8723d84780 1 > prepared multipart upload key=UWS266H06VDK upload=Q2CHI8DKNTFL tag=1E60Q4VWHAKI type=write size=4097127 2023-12-03T11:42:11.779 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.778+0000 7f8723d84780 1 < completed part key=_multipart_Y6S7QI60GCLE.2~TYGFD8XRHOOP.0 size=295569 2023-12-03T11:42:11.781 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.780+0000 7f8723d84780 1 < completed multipart upload key=Y6S7QI60GCLE upload=TYGFD8XRHOOP tag=TSZVGA12TNW1 type=write size=1344145 2023-12-03T11:42:11.782 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.781+0000 7f8723d84780 1 > prepared operation key=FCA2R3HR61S2 tag=K4W7D38HONE0 type=write size=272232 2023-12-03T11:42:11.784 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.783+0000 7f8723d84780 1 < completed delete operation key=LCK58DDM5XU9 tag=3R5JTZDI1SE7 type=del 2023-12-03T11:42:11.785 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.784+0000 7f8723d84780 1 > prepared operation key=CKABTI1EOAWB tag=YG36AXHX6YYU type=del size=3392214 2023-12-03T11:42:11.786 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.785+0000 7f8723d84780 1 < completed delete operation key=8NONX2I08YMJ tag=1P5P09GQYX8T type=del 2023-12-03T11:42:11.788 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.787+0000 7f8723d84780 1 > prepared part key=_multipart_K83BTR5BOLZE.2~6C9BC7FEKUXY.0 size=1048576 2023-12-03T11:42:11.789 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.788+0000 7f8723d84780 1 > prepared part key=_multipart_K83BTR5BOLZE.2~6C9BC7FEKUXY.1 size=361517 2023-12-03T11:42:11.789 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.788+0000 7f8723d84780 1 > prepared multipart upload key=K83BTR5BOLZE upload=6C9BC7FEKUXY tag=4M16CPDB0S36 type=write size=2458669 2023-12-03T11:42:11.790 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.789+0000 7f8723d84780 1 < completed delete operation key=OPQPIDJ2PBVU tag=U4DCGUIAQD2W type=del 2023-12-03T11:42:11.791 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.790+0000 7f8723d84780 1 > prepared operation key=96RAVVSUKH0Y tag=JGC91GZ71KAY type=del size=3728345 2023-12-03T11:42:11.792 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.791+0000 7f8723d84780 1 < completed delete operation key=CKABTI1EOAWB tag=BMDTG7IFLXXC type=del 2023-12-03T11:42:11.793 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.792+0000 7f8723d84780 1 > prepared operation key=10JRIKOZ16FY tag=VK7JAJJJ36I5 type=del size=2178070 2023-12-03T11:42:11.795 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.793+0000 7f8723d84780 1 < completed part key=_multipart_EITMJKL0LCYC.2~W4DJRU74381L.0 size=1048576 2023-12-03T11:42:11.796 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.794+0000 7f8723d84780 1 < completed part key=_multipart_EITMJKL0LCYC.2~W4DJRU74381L.1 size=374170 2023-12-03T11:42:11.797 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.796+0000 7f8723d84780 1 < completed multipart upload key=EITMJKL0LCYC upload=W4DJRU74381L tag=3RS21JQIGVVN type=write size=2471322 2023-12-03T11:42:11.798 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.797+0000 7f8723d84780 1 > prepared operation key=8NONX2I08YMJ tag=EIN0LXUWR7YP type=del size=3530591 2023-12-03T11:42:11.799 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.798+0000 7f8723d84780 1 < completed part key=_multipart_HIU6L0NQ8Q95.2~QPIIEK2UB0II.0 size=1048576 2023-12-03T11:42:11.800 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.799+0000 7f8723d84780 1 < completed part key=_multipart_HIU6L0NQ8Q95.2~QPIIEK2UB0II.1 size=936861 2023-12-03T11:42:11.802 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.801+0000 7f8723d84780 1 < completed multipart upload key=HIU6L0NQ8Q95 upload=QPIIEK2UB0II tag=I4MT30G790KI type=write size=3034013 2023-12-03T11:42:11.804 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.803+0000 7f8723d84780 1 > prepared part key=_multipart_4I8PWBZOLDUG.2~TF1SJ5K1GZAA.0 size=1048576 2023-12-03T11:42:11.805 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.804+0000 7f8723d84780 1 > prepared part key=_multipart_4I8PWBZOLDUG.2~TF1SJ5K1GZAA.1 size=152550 2023-12-03T11:42:11.805 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.804+0000 7f8723d84780 1 > prepared multipart upload key=4I8PWBZOLDUG upload=TF1SJ5K1GZAA tag=L908XBXN2VE3 type=write size=2249702 2023-12-03T11:42:11.806 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.805+0000 7f8723d84780 1 < completed part key=_multipart_FCA2R3HR61S2.2~9XRXS06CQ739.0 size=1048576 2023-12-03T11:42:11.807 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.806+0000 7f8723d84780 1 < completed part key=_multipart_FCA2R3HR61S2.2~9XRXS06CQ739.1 size=1048576 2023-12-03T11:42:11.808 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.807+0000 7f8723d84780 1 < completed part key=_multipart_FCA2R3HR61S2.2~9XRXS06CQ739.2 size=391966 2023-12-03T11:42:11.810 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.809+0000 7f8723d84780 1 < completed multipart upload key=FCA2R3HR61S2 upload=9XRXS06CQ739 tag=7039MEU9ACOT type=write size=3537694 2023-12-03T11:42:11.812 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.810+0000 7f8723d84780 1 > prepared operation key=931GNEXBHH35 tag=7BO8P4YF1U2W type=del size=1213713 2023-12-03T11:42:11.813 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.812+0000 7f8723d84780 1 < completed delete operation key=M4VKPN6INFNZ tag=GBF8ZCH06Y26 type=del 2023-12-03T11:42:11.814 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.813+0000 7f8723d84780 1 > prepared operation key=4I8PWBZOLDUG tag=YYP9FUH70GG7 type=del size=1015025 2023-12-03T11:42:11.817 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.815+0000 7f8723d84780 1 < completed part key=_multipart_96RAVVSUKH0Y.2~M75OPG6M2VOC.0 size=1048576 2023-12-03T11:42:11.817 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.816+0000 7f8723d84780 1 < completed part key=_multipart_96RAVVSUKH0Y.2~M75OPG6M2VOC.1 size=1048576 2023-12-03T11:42:11.820 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.819+0000 7f8723d84780 1 < completed part key=_multipart_96RAVVSUKH0Y.2~M75OPG6M2VOC.2 size=154476 2023-12-03T11:42:11.822 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.821+0000 7f8723d84780 1 < completed multipart upload key=96RAVVSUKH0Y upload=M75OPG6M2VOC tag=385QMS73OPEU type=write size=3300204 2023-12-03T11:42:11.823 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.822+0000 7f8723d84780 1 > prepared operation key=D3JEVEY0E29E tag=75ABRFCL9KD6 type=del size=783272 2023-12-03T11:42:11.824 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.823+0000 7f8723d84780 1 < completed delete operation key=OGACI7CRPMT7 tag=CB6OE3NLNCXW type=del 2023-12-03T11:42:11.825 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.824+0000 7f8723d84780 1 > prepared operation key=K83BTR5BOLZE tag=UR70M07CT19V type=write size=187708 2023-12-03T11:42:11.827 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.826+0000 7f8723d84780 1 < completed part key=_multipart_FCA2R3HR61S2.2~R3P7HAQDWC7Y.0 size=250798 2023-12-03T11:42:11.829 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.828+0000 7f8723d84780 1 < completed multipart upload key=FCA2R3HR61S2 upload=R3P7HAQDWC7Y tag=IX875RERRMKP type=write size=1299374 2023-12-03T11:42:11.830 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.829+0000 7f8723d84780 1 > prepared operation key=W2704YS8KYQB tag=A0IKX1DPU3JJ type=del size=3707939 2023-12-03T11:42:11.831 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.830+0000 7f8723d84780 1 < canceled part key=_multipart_K83BTR5BOLZE.2~R946776AJ06J.0 size=1048576 2023-12-03T11:42:11.832 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.831+0000 7f8723d84780 1 < completed part key=_multipart_K83BTR5BOLZE.2~R946776AJ06J.1 size=904755 2023-12-03T11:42:11.834 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.833+0000 7f8723d84780 1 < canceled multipart upload key=K83BTR5BOLZE upload=R946776AJ06J tag=3GNG1GVA2WJL type=write size=3001907 2023-12-03T11:42:11.835 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.834+0000 7f8723d84780 1 > prepared operation key=5UYL15O31IHM tag=M8Z25Y3ZZBJT type=write size=427069 2023-12-03T11:42:11.837 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.836+0000 7f8723d84780 1 < completed write operation key=931GNEXBHH35 tag=28TS3AJMK4KA type=write size=984432 2023-12-03T11:42:11.838 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.837+0000 7f8723d84780 1 > prepared operation key=10JRIKOZ16FY tag=T4B7AQCZ4IGP type=del size=3963218 2023-12-03T11:42:11.840 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.839+0000 7f8723d84780 1 < completed delete operation key=HIU6L0NQ8Q95 tag=ICCY6VLG9GT5 type=del 2023-12-03T11:42:11.841 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.840+0000 7f8723d84780 1 > prepared operation key=D3JEVEY0E29E tag=9FMBJLT68GPL type=write size=209880 2023-12-03T11:42:11.842 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.841+0000 7f8723d84780 1 < completed part key=_multipart_UWS266H06VDK.2~Q2CHI8DKNTFL.0 size=1048576 2023-12-03T11:42:11.843 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.842+0000 7f8723d84780 1 < completed part key=_multipart_UWS266H06VDK.2~Q2CHI8DKNTFL.1 size=1048576 2023-12-03T11:42:11.844 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.843+0000 7f8723d84780 1 < completed part key=_multipart_UWS266H06VDK.2~Q2CHI8DKNTFL.2 size=951399 2023-12-03T11:42:11.846 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.845+0000 7f8723d84780 1 < completed multipart upload key=UWS266H06VDK upload=Q2CHI8DKNTFL tag=1E60Q4VWHAKI type=write size=4097127 2023-12-03T11:42:11.848 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.847+0000 7f8723d84780 1 > prepared part key=_multipart_HIU6L0NQ8Q95.2~1ER0UEMESN8N.0 size=796972 2023-12-03T11:42:11.848 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.847+0000 7f8723d84780 1 > prepared multipart upload key=HIU6L0NQ8Q95 upload=1ER0UEMESN8N tag=F6LD4U8J1QQU type=write size=1845548 2023-12-03T11:42:11.849 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.848+0000 7f8723d84780 1 < completed write operation key=FCA2R3HR61S2 tag=K4W7D38HONE0 type=write size=272232 2023-12-03T11:42:11.850 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.850+0000 7f8723d84780 1 > prepared operation key=D3JEVEY0E29E tag=2N4XQZS6XJ2M type=write size=176743 2023-12-03T11:42:11.852 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.851+0000 7f8723d84780 1 < completed delete operation key=CKABTI1EOAWB tag=YG36AXHX6YYU type=del 2023-12-03T11:42:11.853 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.852+0000 7f8723d84780 1 > prepared operation key=W2704YS8KYQB tag=ODBIL29H0GQ8 type=write size=741906 2023-12-03T11:42:11.853 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.852+0000 7f8723d84780 1 < canceled part key=_multipart_K83BTR5BOLZE.2~6C9BC7FEKUXY.0 size=1048576 2023-12-03T11:42:11.854 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.853+0000 7f8723d84780 1 < completed part key=_multipart_K83BTR5BOLZE.2~6C9BC7FEKUXY.1 size=361517 2023-12-03T11:42:11.856 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.855+0000 7f8723d84780 1 < canceled multipart upload key=K83BTR5BOLZE upload=6C9BC7FEKUXY tag=4M16CPDB0S36 type=write size=2458669 2023-12-03T11:42:11.857 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.856+0000 7f8723d84780 1 > prepared operation key=DMQX2DGDLU7D tag=69GG1ZI2LLPA type=del size=2917495 2023-12-03T11:42:11.858 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.857+0000 7f8723d84780 1 < completed delete operation key=96RAVVSUKH0Y tag=JGC91GZ71KAY type=del 2023-12-03T11:42:11.861 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.860+0000 7f8723d84780 1 > prepared part key=_multipart_8NONX2I08YMJ.2~43O5FA1EZSEZ.0 size=1048576 2023-12-03T11:42:11.862 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.860+0000 7f8723d84780 1 > prepared part key=_multipart_8NONX2I08YMJ.2~43O5FA1EZSEZ.1 size=707108 2023-12-03T11:42:11.862 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.860+0000 7f8723d84780 1 > prepared multipart upload key=8NONX2I08YMJ upload=43O5FA1EZSEZ tag=KXYLGDWLSAP5 type=write size=2804260 2023-12-03T11:42:11.863 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.862+0000 7f8723d84780 1 < canceled operation key=10JRIKOZ16FY tag=VK7JAJJJ36I5 type=del size=2178070 2023-12-03T11:42:11.864 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.863+0000 7f8723d84780 1 > prepared operation key=G36T76K8O7A1 tag=333W5BOFUHPU type=write size=198284 2023-12-03T11:42:11.865 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.864+0000 7f8723d84780 1 < completed delete operation key=8NONX2I08YMJ tag=EIN0LXUWR7YP type=del 2023-12-03T11:42:11.866 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.865+0000 7f8723d84780 1 > prepared operation key=4I8PWBZOLDUG tag=Q7Z7SZ0F8DA4 type=del size=1421654 2023-12-03T11:42:11.867 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.866+0000 7f8723d84780 1 < completed part key=_multipart_4I8PWBZOLDUG.2~TF1SJ5K1GZAA.0 size=1048576 2023-12-03T11:42:11.867 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.866+0000 7f8723d84780 1 < canceled part key=_multipart_4I8PWBZOLDUG.2~TF1SJ5K1GZAA.1 size=152550 2023-12-03T11:42:11.869 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.868+0000 7f8723d84780 1 < canceled multipart upload key=4I8PWBZOLDUG upload=TF1SJ5K1GZAA tag=L908XBXN2VE3 type=write size=2249702 2023-12-03T11:42:11.871 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.869+0000 7f8723d84780 1 > prepared operation key=7VMTBKUWU59F tag=M4CS14ETDAIM type=del size=2515869 2023-12-03T11:42:11.871 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.870+0000 7f8723d84780 1 < completed delete operation key=931GNEXBHH35 tag=7BO8P4YF1U2W type=del 2023-12-03T11:42:11.872 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.871+0000 7f8723d84780 1 > prepared operation key=W2704YS8KYQB tag=YSI5G8SI5S21 type=write size=161692 2023-12-03T11:42:11.873 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.872+0000 7f8723d84780 1 < completed delete operation key=4I8PWBZOLDUG tag=YYP9FUH70GG7 type=del 2023-12-03T11:42:11.875 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.874+0000 7f8723d84780 1 > prepared part key=_multipart_CKABTI1EOAWB.2~FPVL84E4249V.0 size=1048576 2023-12-03T11:42:11.876 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.875+0000 7f8723d84780 1 > prepared part key=_multipart_CKABTI1EOAWB.2~FPVL84E4249V.1 size=327739 2023-12-03T11:42:11.876 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.875+0000 7f8723d84780 1 > prepared multipart upload key=CKABTI1EOAWB upload=FPVL84E4249V tag=ISEM3ZN03FLO type=write size=2424891 2023-12-03T11:42:11.877 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.876+0000 7f8723d84780 1 < completed delete operation key=D3JEVEY0E29E tag=75ABRFCL9KD6 type=del 2023-12-03T11:42:11.880 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.878+0000 7f8723d84780 1 > prepared part key=_multipart_G36T76K8O7A1.2~AZ6QYGOP7DAV.0 size=1048576 2023-12-03T11:42:11.880 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.879+0000 7f8723d84780 1 > prepared part key=_multipart_G36T76K8O7A1.2~AZ6QYGOP7DAV.1 size=1048576 2023-12-03T11:42:11.883 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.882+0000 7f8723d84780 1 > prepared part key=_multipart_G36T76K8O7A1.2~AZ6QYGOP7DAV.2 size=519177 2023-12-03T11:42:11.883 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.882+0000 7f8723d84780 1 > prepared multipart upload key=G36T76K8O7A1 upload=AZ6QYGOP7DAV tag=R3BVW3635K42 type=write size=3664905 2023-12-03T11:42:11.884 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.883+0000 7f8723d84780 1 < completed write operation key=K83BTR5BOLZE tag=UR70M07CT19V type=write size=187708 2023-12-03T11:42:11.885 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.884+0000 7f8723d84780 1 > prepared operation key=96RAVVSUKH0Y tag=S6ZTHYPP6456 type=del size=632172 2023-12-03T11:42:11.887 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.886+0000 7f8723d84780 1 < suggested remove operation key=W2704YS8KYQB tag=A0IKX1DPU3JJ type=del 2023-12-03T11:42:11.890 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.889+0000 7f8723d84780 1 > prepared part key=_multipart_UWS266H06VDK.2~MJX8YNPXC7AJ.0 size=1048576 2023-12-03T11:42:11.891 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.889+0000 7f8723d84780 1 > prepared part key=_multipart_UWS266H06VDK.2~MJX8YNPXC7AJ.1 size=1048576 2023-12-03T11:42:11.891 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.890+0000 7f8723d84780 1 > prepared part key=_multipart_UWS266H06VDK.2~MJX8YNPXC7AJ.2 size=226462 2023-12-03T11:42:11.891 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.890+0000 7f8723d84780 1 > prepared multipart upload key=UWS266H06VDK upload=MJX8YNPXC7AJ tag=IJ2JSJT0DU9S type=write size=3372190 2023-12-03T11:42:11.893 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.892+0000 7f8723d84780 1 < completed write operation key=5UYL15O31IHM tag=M8Z25Y3ZZBJT type=write size=427069 2023-12-03T11:42:11.894 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.893+0000 7f8723d84780 1 > prepared operation key=Y6S7QI60GCLE tag=061MKVI49NWE type=del size=3592752 2023-12-03T11:42:11.895 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.894+0000 7f8723d84780 1 < completed delete operation key=10JRIKOZ16FY tag=T4B7AQCZ4IGP type=del 2023-12-03T11:42:11.897 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.896+0000 7f8723d84780 1 > prepared part key=_multipart_TSTIBGVYUZZZ.2~DRJOR703KL6L.0 size=1048576 2023-12-03T11:42:11.898 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.897+0000 7f8723d84780 1 > prepared part key=_multipart_TSTIBGVYUZZZ.2~DRJOR703KL6L.1 size=1017994 2023-12-03T11:42:11.898 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.897+0000 7f8723d84780 1 > prepared multipart upload key=TSTIBGVYUZZZ upload=DRJOR703KL6L tag=BTDZXQVYE0EQ type=write size=3115146 2023-12-03T11:42:11.899 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.898+0000 7f8723d84780 1 < completed write operation key=D3JEVEY0E29E tag=9FMBJLT68GPL type=write size=209880 2023-12-03T11:42:11.900 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.899+0000 7f8723d84780 1 > prepared operation key=8NONX2I08YMJ tag=J8T503OZZ149 type=del size=941260 2023-12-03T11:42:11.902 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.901+0000 7f8723d84780 1 < completed part key=_multipart_HIU6L0NQ8Q95.2~1ER0UEMESN8N.0 size=796972 2023-12-03T11:42:11.903 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.902+0000 7f8723d84780 1 < completed multipart upload key=HIU6L0NQ8Q95 upload=1ER0UEMESN8N tag=F6LD4U8J1QQU type=write size=1845548 2023-12-03T11:42:11.905 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.904+0000 7f8723d84780 1 > prepared operation key=5UYL15O31IHM tag=I6K6EOT9CW61 type=del size=2114621 2023-12-03T11:42:11.906 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.905+0000 7f8723d84780 1 < completed write operation key=D3JEVEY0E29E tag=2N4XQZS6XJ2M type=write size=176743 2023-12-03T11:42:11.908 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.907+0000 7f8723d84780 1 > prepared part key=_multipart_LCK58DDM5XU9.2~IYAM4MP14P9E.0 size=1048576 2023-12-03T11:42:11.909 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.908+0000 7f8723d84780 1 > prepared part key=_multipart_LCK58DDM5XU9.2~IYAM4MP14P9E.1 size=1048576 2023-12-03T11:42:11.910 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.909+0000 7f8723d84780 1 > prepared part key=_multipart_LCK58DDM5XU9.2~IYAM4MP14P9E.2 size=158659 2023-12-03T11:42:11.910 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.909+0000 7f8723d84780 1 > prepared multipart upload key=LCK58DDM5XU9 upload=IYAM4MP14P9E tag=907HHK1AGYYU type=write size=3304387 2023-12-03T11:42:11.910 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.909+0000 7f8723d84780 -1 < no bi entry to suggest for operation key=W2704YS8KYQB tag=ODBIL29H0GQ8 type=write size=741906: (2) No such file or directory 2023-12-03T11:42:11.911 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.911+0000 7f8723d84780 1 > prepared operation key=VENJI0KD1XDW tag=OEVYJ1MKA2S4 type=write size=804368 2023-12-03T11:42:11.913 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.912+0000 7f8723d84780 1 < completed delete operation key=DMQX2DGDLU7D tag=69GG1ZI2LLPA type=del 2023-12-03T11:42:11.914 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.913+0000 7f8723d84780 1 > prepared operation key=OGACI7CRPMT7 tag=00SO48BRA5YH type=del size=2974387 2023-12-03T11:42:11.915 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.914+0000 7f8723d84780 1 < completed part key=_multipart_8NONX2I08YMJ.2~43O5FA1EZSEZ.0 size=1048576 2023-12-03T11:42:11.916 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.915+0000 7f8723d84780 1 < completed part key=_multipart_8NONX2I08YMJ.2~43O5FA1EZSEZ.1 size=707108 2023-12-03T11:42:11.918 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.917+0000 7f8723d84780 1 < completed multipart upload key=8NONX2I08YMJ upload=43O5FA1EZSEZ tag=KXYLGDWLSAP5 type=write size=2804260 2023-12-03T11:42:11.920 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.919+0000 7f8723d84780 1 > prepared part key=_multipart_UWS266H06VDK.2~9J9SNR85QDWZ.0 size=149843 2023-12-03T11:42:11.920 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.919+0000 7f8723d84780 1 > prepared multipart upload key=UWS266H06VDK upload=9J9SNR85QDWZ tag=SBRFBUWK04SI type=write size=1198419 2023-12-03T11:42:11.921 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.920+0000 7f8723d84780 1 < completed write operation key=G36T76K8O7A1 tag=333W5BOFUHPU type=write size=198284 2023-12-03T11:42:11.922 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.921+0000 7f8723d84780 1 > prepared operation key=O7VVHXLDSY57 tag=PPSL4794E3EC type=write size=513313 2023-12-03T11:42:11.924 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.923+0000 7f8723d84780 1 < completed delete operation key=4I8PWBZOLDUG tag=Q7Z7SZ0F8DA4 type=del 2023-12-03T11:42:11.926 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.925+0000 7f8723d84780 1 > prepared part key=_multipart_DMQX2DGDLU7D.2~6LMCVSLP5DXR.0 size=766062 2023-12-03T11:42:11.926 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.925+0000 7f8723d84780 1 > prepared multipart upload key=DMQX2DGDLU7D upload=6LMCVSLP5DXR tag=C13F90IMJOSC type=write size=1814638 2023-12-03T11:42:11.929 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.927+0000 7f8723d84780 1 < suggested remove operation key=7VMTBKUWU59F tag=M4CS14ETDAIM type=del 2023-12-03T11:42:11.930 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.929+0000 7f8723d84780 1 > prepared operation key=EITMJKL0LCYC tag=DJ0RBSPJN314 type=del size=3595889 2023-12-03T11:42:11.932 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.931+0000 7f8723d84780 -1 < failed to complete operation key=W2704YS8KYQB tag=YSI5G8SI5S21 type=write size=161692: (22) Invalid argument 2023-12-03T11:42:11.934 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.933+0000 7f8723d84780 1 > prepared operation key=DMQX2DGDLU7D tag=VKOMH0EY90ST type=write size=438223 2023-12-03T11:42:11.935 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.934+0000 7f8723d84780 1 < completed part key=_multipart_CKABTI1EOAWB.2~FPVL84E4249V.0 size=1048576 2023-12-03T11:42:11.936 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.935+0000 7f8723d84780 1 < completed part key=_multipart_CKABTI1EOAWB.2~FPVL84E4249V.1 size=327739 2023-12-03T11:42:11.939 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.938+0000 7f8723d84780 1 < completed multipart upload key=CKABTI1EOAWB upload=FPVL84E4249V tag=ISEM3ZN03FLO type=write size=2424891 2023-12-03T11:42:11.940 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.939+0000 7f8723d84780 1 > prepared operation key=G36T76K8O7A1 tag=KTADYDPEC21O type=del size=3813281 2023-12-03T11:42:11.941 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.940+0000 7f8723d84780 1 < completed part key=_multipart_G36T76K8O7A1.2~AZ6QYGOP7DAV.0 size=1048576 2023-12-03T11:42:11.942 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.941+0000 7f8723d84780 1 < completed part key=_multipart_G36T76K8O7A1.2~AZ6QYGOP7DAV.1 size=1048576 2023-12-03T11:42:11.945 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.942+0000 7f8723d84780 1 < completed part key=_multipart_G36T76K8O7A1.2~AZ6QYGOP7DAV.2 size=519177 2023-12-03T11:42:11.945 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.944+0000 7f8723d84780 1 < completed multipart upload key=G36T76K8O7A1 upload=AZ6QYGOP7DAV tag=R3BVW3635K42 type=write size=3664905 2023-12-03T11:42:11.947 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.945+0000 7f8723d84780 1 > prepared operation key=AB0SN0E49Z5F tag=MVDOCVFMS1WH type=del size=3573609 2023-12-03T11:42:11.947 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.946+0000 7f8723d84780 1 < completed delete operation key=96RAVVSUKH0Y tag=S6ZTHYPP6456 type=del 2023-12-03T11:42:11.948 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.947+0000 7f8723d84780 1 > prepared operation key=EY9ZG5KOTBWM tag=CZ5SNYPO14K8 type=del size=817522 2023-12-03T11:42:11.950 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.949+0000 7f8723d84780 1 < completed part key=_multipart_UWS266H06VDK.2~MJX8YNPXC7AJ.0 size=1048576 2023-12-03T11:42:11.951 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.950+0000 7f8723d84780 1 < completed part key=_multipart_UWS266H06VDK.2~MJX8YNPXC7AJ.1 size=1048576 2023-12-03T11:42:11.952 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.951+0000 7f8723d84780 1 < completed part key=_multipart_UWS266H06VDK.2~MJX8YNPXC7AJ.2 size=226462 2023-12-03T11:42:11.954 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.953+0000 7f8723d84780 1 < completed multipart upload key=UWS266H06VDK upload=MJX8YNPXC7AJ tag=IJ2JSJT0DU9S type=write size=3372190 2023-12-03T11:42:11.956 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.955+0000 7f8723d84780 1 > prepared part key=_multipart_KS5J7E7KE2IJ.2~QUL5SPYZ0BY3.0 size=1048576 2023-12-03T11:42:11.957 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.956+0000 7f8723d84780 1 > prepared part key=_multipart_KS5J7E7KE2IJ.2~QUL5SPYZ0BY3.1 size=1048576 2023-12-03T11:42:11.958 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.957+0000 7f8723d84780 1 > prepared part key=_multipart_KS5J7E7KE2IJ.2~QUL5SPYZ0BY3.2 size=673915 2023-12-03T11:42:11.958 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.957+0000 7f8723d84780 1 > prepared multipart upload key=KS5J7E7KE2IJ upload=QUL5SPYZ0BY3 tag=8E1V0CW1VG3B type=write size=3819643 2023-12-03T11:42:11.959 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.958+0000 7f8723d84780 1 < completed delete operation key=Y6S7QI60GCLE tag=061MKVI49NWE type=del 2023-12-03T11:42:11.960 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.959+0000 7f8723d84780 1 > prepared operation key=OGACI7CRPMT7 tag=VDYUBC0U7D2K type=del size=834060 2023-12-03T11:42:11.962 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.960+0000 7f8723d84780 1 < completed part key=_multipart_TSTIBGVYUZZZ.2~DRJOR703KL6L.0 size=1048576 2023-12-03T11:42:11.962 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.961+0000 7f8723d84780 1 < completed part key=_multipart_TSTIBGVYUZZZ.2~DRJOR703KL6L.1 size=1017994 2023-12-03T11:42:11.964 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.963+0000 7f8723d84780 1 < completed multipart upload key=TSTIBGVYUZZZ upload=DRJOR703KL6L tag=BTDZXQVYE0EQ type=write size=3115146 2023-12-03T11:42:11.966 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.965+0000 7f8723d84780 1 > prepared part key=_multipart_DMQX2DGDLU7D.2~AEMXRI1BZT37.0 size=1048576 2023-12-03T11:42:11.967 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.966+0000 7f8723d84780 1 > prepared part key=_multipart_DMQX2DGDLU7D.2~AEMXRI1BZT37.1 size=1039290 2023-12-03T11:42:11.967 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.966+0000 7f8723d84780 1 > prepared multipart upload key=DMQX2DGDLU7D upload=AEMXRI1BZT37 tag=E8OYSWR000FF type=write size=3136442 2023-12-03T11:42:11.968 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.967+0000 7f8723d84780 1 < completed delete operation key=8NONX2I08YMJ tag=J8T503OZZ149 type=del 2023-12-03T11:42:11.970 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.969+0000 7f8723d84780 1 > prepared operation key=K83BTR5BOLZE tag=0MT9S9YRW2P5 type=del size=2422667 2023-12-03T11:42:11.971 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.970+0000 7f8723d84780 1 < completed delete operation key=5UYL15O31IHM tag=I6K6EOT9CW61 type=del 2023-12-03T11:42:11.973 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.972+0000 7f8723d84780 1 > prepared part key=_multipart_UWS266H06VDK.2~SVZFN5EEQMEK.0 size=261773 2023-12-03T11:42:11.973 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.972+0000 7f8723d84780 1 > prepared multipart upload key=UWS266H06VDK upload=SVZFN5EEQMEK tag=TW9LOM04GQCS type=write size=1310349 2023-12-03T11:42:11.974 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.973+0000 7f8723d84780 1 < completed part key=_multipart_LCK58DDM5XU9.2~IYAM4MP14P9E.0 size=1048576 2023-12-03T11:42:11.975 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.974+0000 7f8723d84780 1 < completed part key=_multipart_LCK58DDM5XU9.2~IYAM4MP14P9E.1 size=1048576 2023-12-03T11:42:11.976 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.975+0000 7f8723d84780 1 < completed part key=_multipart_LCK58DDM5XU9.2~IYAM4MP14P9E.2 size=158659 2023-12-03T11:42:11.978 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.977+0000 7f8723d84780 1 < completed multipart upload key=LCK58DDM5XU9 upload=IYAM4MP14P9E tag=907HHK1AGYYU type=write size=3304387 2023-12-03T11:42:11.979 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.978+0000 7f8723d84780 1 > prepared operation key=96RAVVSUKH0Y tag=DIY4VFVSL5U7 type=write size=446978 2023-12-03T11:42:11.981 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.980+0000 7f8723d84780 1 < completed write operation key=VENJI0KD1XDW tag=OEVYJ1MKA2S4 type=write size=804368 2023-12-03T11:42:11.982 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.981+0000 7f8723d84780 1 > prepared operation key=Y6S7QI60GCLE tag=T66FLU41LK01 type=del size=2088473 2023-12-03T11:42:11.984 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.982+0000 7f8723d84780 1 < completed delete operation key=OGACI7CRPMT7 tag=00SO48BRA5YH type=del 2023-12-03T11:42:11.985 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.984+0000 7f8723d84780 1 > prepared part key=_multipart_OGACI7CRPMT7.2~HTS3S5B7D8J8.0 size=1048576 2023-12-03T11:42:11.986 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.985+0000 7f8723d84780 1 > prepared part key=_multipart_OGACI7CRPMT7.2~HTS3S5B7D8J8.1 size=532029 2023-12-03T11:42:11.986 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.985+0000 7f8723d84780 1 > prepared multipart upload key=OGACI7CRPMT7 upload=HTS3S5B7D8J8 tag=MMF5GRPPPKMN type=write size=2629181 2023-12-03T11:42:11.988 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.987+0000 7f8723d84780 1 < completed part key=_multipart_UWS266H06VDK.2~9J9SNR85QDWZ.0 size=149843 2023-12-03T11:42:11.990 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.989+0000 7f8723d84780 1 < completed multipart upload key=UWS266H06VDK upload=9J9SNR85QDWZ tag=SBRFBUWK04SI type=write size=1198419 2023-12-03T11:42:11.992 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.991+0000 7f8723d84780 1 > prepared part key=_multipart_OGACI7CRPMT7.2~15QH42X8XUCR.0 size=1048576 2023-12-03T11:42:11.993 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.992+0000 7f8723d84780 1 > prepared part key=_multipart_OGACI7CRPMT7.2~15QH42X8XUCR.1 size=495084 2023-12-03T11:42:11.993 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.992+0000 7f8723d84780 1 > prepared multipart upload key=OGACI7CRPMT7 upload=15QH42X8XUCR tag=RLQU84ZCXHPA type=write size=2592236 2023-12-03T11:42:11.995 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.993+0000 7f8723d84780 1 < canceled operation key=O7VVHXLDSY57 tag=PPSL4794E3EC type=write size=513313 2023-12-03T11:42:11.997 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.996+0000 7f8723d84780 1 > prepared part key=_multipart_UWS266H06VDK.2~7ELA82R0EUVI.0 size=6418 2023-12-03T11:42:11.997 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.996+0000 7f8723d84780 1 > prepared multipart upload key=UWS266H06VDK upload=7ELA82R0EUVI tag=7X3GGTJ9R5VB type=write size=1054994 2023-12-03T11:42:11.998 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.997+0000 7f8723d84780 1 < completed part key=_multipart_DMQX2DGDLU7D.2~6LMCVSLP5DXR.0 size=766062 2023-12-03T11:42:12.000 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:11.999+0000 7f8723d84780 1 < completed multipart upload key=DMQX2DGDLU7D upload=6LMCVSLP5DXR tag=C13F90IMJOSC type=write size=1814638 2023-12-03T11:42:12.001 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.000+0000 7f8723d84780 1 > prepared operation key=D3JEVEY0E29E tag=8LUKHAQKBUPO type=del size=435665 2023-12-03T11:42:12.002 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.001+0000 7f8723d84780 1 < completed delete operation key=EITMJKL0LCYC tag=DJ0RBSPJN314 type=del 2023-12-03T11:42:12.003 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.002+0000 7f8723d84780 1 > prepared operation key=4I8PWBZOLDUG tag=WUP7JY57X9HY type=del size=132606 2023-12-03T11:42:12.005 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.004+0000 7f8723d84780 1 < completed write operation key=DMQX2DGDLU7D tag=VKOMH0EY90ST type=write size=438223 2023-12-03T11:42:12.007 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.006+0000 7f8723d84780 1 > prepared part key=_multipart_4I8PWBZOLDUG.2~03FJS6RZ64PE.0 size=1048576 2023-12-03T11:42:12.008 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.007+0000 7f8723d84780 1 > prepared part key=_multipart_4I8PWBZOLDUG.2~03FJS6RZ64PE.1 size=1048576 2023-12-03T11:42:12.009 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.008+0000 7f8723d84780 1 > prepared part key=_multipart_4I8PWBZOLDUG.2~03FJS6RZ64PE.2 size=792616 2023-12-03T11:42:12.009 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.008+0000 7f8723d84780 1 > prepared multipart upload key=4I8PWBZOLDUG upload=03FJS6RZ64PE tag=KAGFY3BP6ICK type=write size=3938344 2023-12-03T11:42:12.013 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.009+0000 7f8723d84780 1 < completed delete operation key=G36T76K8O7A1 tag=KTADYDPEC21O type=del 2023-12-03T11:42:12.013 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.011+0000 7f8723d84780 1 > prepared part key=_multipart_7THZZ1J5LOZK.2~HSYIILQ224G2.0 size=591800 2023-12-03T11:42:12.013 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.011+0000 7f8723d84780 1 > prepared multipart upload key=7THZZ1J5LOZK upload=HSYIILQ224G2 tag=ANP7LJI0RDQ2 type=write size=1640376 2023-12-03T11:42:12.013 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.012+0000 7f8723d84780 1 < completed delete operation key=AB0SN0E49Z5F tag=MVDOCVFMS1WH type=del 2023-12-03T11:42:12.015 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.013+0000 7f8723d84780 1 > prepared operation key=8NONX2I08YMJ tag=Z40S1BN1TAZY type=del size=3756464 2023-12-03T11:42:12.017 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.016+0000 7f8723d84780 1 < suggested update operation key=EY9ZG5KOTBWM tag=CZ5SNYPO14K8 type=del size=817522 2023-12-03T11:42:12.022 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.018+0000 7f8723d84780 1 > prepared part key=_multipart_UWS266H06VDK.2~6VKFN89X662Z.0 size=1048576 2023-12-03T11:42:12.022 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.019+0000 7f8723d84780 1 > prepared part key=_multipart_UWS266H06VDK.2~6VKFN89X662Z.1 size=1048576 2023-12-03T11:42:12.022 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.020+0000 7f8723d84780 1 > prepared part key=_multipart_UWS266H06VDK.2~6VKFN89X662Z.2 size=170452 2023-12-03T11:42:12.022 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.020+0000 7f8723d84780 1 > prepared multipart upload key=UWS266H06VDK upload=6VKFN89X662Z tag=NLXJQ09WYPMC type=write size=3316180 2023-12-03T11:42:12.022 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.021+0000 7f8723d84780 1 < completed part key=_multipart_KS5J7E7KE2IJ.2~QUL5SPYZ0BY3.0 size=1048576 2023-12-03T11:42:12.023 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.022+0000 7f8723d84780 1 < completed part key=_multipart_KS5J7E7KE2IJ.2~QUL5SPYZ0BY3.1 size=1048576 2023-12-03T11:42:12.024 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.023+0000 7f8723d84780 1 < completed part key=_multipart_KS5J7E7KE2IJ.2~QUL5SPYZ0BY3.2 size=673915 2023-12-03T11:42:12.026 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.025+0000 7f8723d84780 1 < completed multipart upload key=KS5J7E7KE2IJ upload=QUL5SPYZ0BY3 tag=8E1V0CW1VG3B type=write size=3819643 2023-12-03T11:42:12.027 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.026+0000 7f8723d84780 1 > prepared operation key=TSTIBGVYUZZZ tag=XZKVMWSQBLWN type=del size=2505753 2023-12-03T11:42:12.030 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.029+0000 7f8723d84780 1 < suggested update operation key=OGACI7CRPMT7 tag=VDYUBC0U7D2K type=del size=834060 2023-12-03T11:42:12.031 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.030+0000 7f8723d84780 1 > prepared operation key=10JRIKOZ16FY tag=0JALWNQJSQC0 type=del size=1266122 2023-12-03T11:42:12.032 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.031+0000 7f8723d84780 1 < completed part key=_multipart_DMQX2DGDLU7D.2~AEMXRI1BZT37.0 size=1048576 2023-12-03T11:42:12.033 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.032+0000 7f8723d84780 1 < completed part key=_multipart_DMQX2DGDLU7D.2~AEMXRI1BZT37.1 size=1039290 2023-12-03T11:42:12.035 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.034+0000 7f8723d84780 1 < completed multipart upload key=DMQX2DGDLU7D upload=AEMXRI1BZT37 tag=E8OYSWR000FF type=write size=3136442 2023-12-03T11:42:12.036 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.035+0000 7f8723d84780 1 > prepared operation key=O7VVHXLDSY57 tag=1Q29B6VPKILJ type=del size=2094216 2023-12-03T11:42:12.037 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.036+0000 7f8723d84780 1 < completed delete operation key=K83BTR5BOLZE tag=0MT9S9YRW2P5 type=del 2023-12-03T11:42:12.040 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.038+0000 7f8723d84780 1 > prepared part key=_multipart_EY9ZG5KOTBWM.2~DL2PVCT9T6LI.0 size=1048576 2023-12-03T11:42:12.040 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.039+0000 7f8723d84780 1 > prepared part key=_multipart_EY9ZG5KOTBWM.2~DL2PVCT9T6LI.1 size=509358 2023-12-03T11:42:12.040 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.039+0000 7f8723d84780 1 > prepared multipart upload key=EY9ZG5KOTBWM upload=DL2PVCT9T6LI tag=NH0AFG1GH2LT type=write size=2606510 2023-12-03T11:42:12.041 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.040+0000 7f8723d84780 1 < completed part key=_multipart_UWS266H06VDK.2~SVZFN5EEQMEK.0 size=261773 2023-12-03T11:42:12.045 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.044+0000 7f8723d84780 1 < completed multipart upload key=UWS266H06VDK upload=SVZFN5EEQMEK tag=TW9LOM04GQCS type=write size=1310349 2023-12-03T11:42:12.047 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.045+0000 7f8723d84780 1 > prepared operation key=HIU6L0NQ8Q95 tag=I1IY3TMWJYS3 type=del size=649528 2023-12-03T11:42:12.048 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.047+0000 7f8723d84780 1 < completed write operation key=96RAVVSUKH0Y tag=DIY4VFVSL5U7 type=write size=446978 2023-12-03T11:42:12.049 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.048+0000 7f8723d84780 1 > prepared operation key=EITMJKL0LCYC tag=F4M8G1O938H3 type=del size=3272507 2023-12-03T11:42:12.050 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.049+0000 7f8723d84780 1 < completed delete operation key=Y6S7QI60GCLE tag=T66FLU41LK01 type=del 2023-12-03T11:42:12.051 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.050+0000 7f8723d84780 1 > prepared operation key=Y6S7QI60GCLE tag=V7DSUHSV1NC2 type=del size=1800025 2023-12-03T11:42:12.052 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.051+0000 7f8723d84780 1 < completed part key=_multipart_OGACI7CRPMT7.2~HTS3S5B7D8J8.0 size=1048576 2023-12-03T11:42:12.052 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.051+0000 7f8723d84780 1 < canceled part key=_multipart_OGACI7CRPMT7.2~HTS3S5B7D8J8.1 size=532029 2023-12-03T11:42:12.054 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.053+0000 7f8723d84780 1 < canceled multipart upload key=OGACI7CRPMT7 upload=HTS3S5B7D8J8 tag=MMF5GRPPPKMN type=write size=2629181 2023-12-03T11:42:12.056 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.055+0000 7f8723d84780 1 > prepared part key=_multipart_J33T5S893LMV.2~WKT382F3PQTV.0 size=594824 2023-12-03T11:42:12.056 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.055+0000 7f8723d84780 1 > prepared multipart upload key=J33T5S893LMV upload=WKT382F3PQTV tag=PEFZ0RRHW173 type=write size=1643400 2023-12-03T11:42:12.057 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.056+0000 7f8723d84780 1 < completed part key=_multipart_OGACI7CRPMT7.2~15QH42X8XUCR.0 size=1048576 2023-12-03T11:42:12.060 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.059+0000 7f8723d84780 1 < completed part key=_multipart_OGACI7CRPMT7.2~15QH42X8XUCR.1 size=495084 2023-12-03T11:42:12.062 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.061+0000 7f8723d84780 1 < completed multipart upload key=OGACI7CRPMT7 upload=15QH42X8XUCR tag=RLQU84ZCXHPA type=write size=2592236 2023-12-03T11:42:12.064 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.062+0000 7f8723d84780 1 > prepared operation key=CKABTI1EOAWB tag=00UW00L1QTFA type=del size=2850290 2023-12-03T11:42:12.064 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.062+0000 7f8723d84780 1 < canceled part key=_multipart_UWS266H06VDK.2~7ELA82R0EUVI.0 size=6418 2023-12-03T11:42:12.065 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.064+0000 7f8723d84780 1 < canceled multipart upload key=UWS266H06VDK upload=7ELA82R0EUVI tag=7X3GGTJ9R5VB type=write size=1054994 2023-12-03T11:42:12.067 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.066+0000 7f8723d84780 1 > prepared part key=_multipart_EITMJKL0LCYC.2~DEDWOC09A9V4.0 size=1048576 2023-12-03T11:42:12.068 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.067+0000 7f8723d84780 1 > prepared part key=_multipart_EITMJKL0LCYC.2~DEDWOC09A9V4.1 size=640209 2023-12-03T11:42:12.068 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.067+0000 7f8723d84780 1 > prepared multipart upload key=EITMJKL0LCYC upload=DEDWOC09A9V4 tag=1XSTMS7IED28 type=write size=2737361 2023-12-03T11:42:12.069 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.068+0000 7f8723d84780 1 < completed delete operation key=D3JEVEY0E29E tag=8LUKHAQKBUPO type=del 2023-12-03T11:42:12.075 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.070+0000 7f8723d84780 1 > prepared operation key=TSTIBGVYUZZZ tag=9V2QWP48TUD0 type=del size=2150567 2023-12-03T11:42:12.075 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.071+0000 7f8723d84780 1 < completed delete operation key=4I8PWBZOLDUG tag=WUP7JY57X9HY type=del 2023-12-03T11:42:12.075 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.072+0000 7f8723d84780 1 > prepared operation key=OPQPIDJ2PBVU tag=0X5ZNGL64C09 type=del size=1944421 2023-12-03T11:42:12.076 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.073+0000 7f8723d84780 1 < completed part key=_multipart_4I8PWBZOLDUG.2~03FJS6RZ64PE.0 size=1048576 2023-12-03T11:42:12.076 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.074+0000 7f8723d84780 1 < completed part key=_multipart_4I8PWBZOLDUG.2~03FJS6RZ64PE.1 size=1048576 2023-12-03T11:42:12.076 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.075+0000 7f8723d84780 1 < completed part key=_multipart_4I8PWBZOLDUG.2~03FJS6RZ64PE.2 size=792616 2023-12-03T11:42:12.078 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.077+0000 7f8723d84780 1 < completed multipart upload key=4I8PWBZOLDUG upload=03FJS6RZ64PE tag=KAGFY3BP6ICK type=write size=3938344 2023-12-03T11:42:12.079 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.078+0000 7f8723d84780 1 > prepared operation key=O7VVHXLDSY57 tag=RUTO4CFABIEO type=write size=670924 2023-12-03T11:42:12.080 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.079+0000 7f8723d84780 1 < completed part key=_multipart_7THZZ1J5LOZK.2~HSYIILQ224G2.0 size=591800 2023-12-03T11:42:12.082 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.081+0000 7f8723d84780 1 < completed multipart upload key=7THZZ1J5LOZK upload=HSYIILQ224G2 tag=ANP7LJI0RDQ2 type=write size=1640376 2023-12-03T11:42:12.084 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.083+0000 7f8723d84780 1 > prepared part key=_multipart_J33T5S893LMV.2~Z6G0QUASFLXM.0 size=1048576 2023-12-03T11:42:12.085 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.084+0000 7f8723d84780 1 > prepared part key=_multipart_J33T5S893LMV.2~Z6G0QUASFLXM.1 size=29697 2023-12-03T11:42:12.085 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.084+0000 7f8723d84780 1 > prepared multipart upload key=J33T5S893LMV upload=Z6G0QUASFLXM tag=Q9YINYUJVCK0 type=write size=2126849 2023-12-03T11:42:12.086 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.085+0000 7f8723d84780 1 < completed delete operation key=8NONX2I08YMJ tag=Z40S1BN1TAZY type=del 2023-12-03T11:42:12.087 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.086+0000 7f8723d84780 1 > prepared operation key=G36T76K8O7A1 tag=ASLN1EDO6GVE type=del size=1606657 2023-12-03T11:42:12.088 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.087+0000 7f8723d84780 1 < completed part key=_multipart_UWS266H06VDK.2~6VKFN89X662Z.0 size=1048576 2023-12-03T11:42:12.089 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.088+0000 7f8723d84780 1 < completed part key=_multipart_UWS266H06VDK.2~6VKFN89X662Z.1 size=1048576 2023-12-03T11:42:12.091 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.089+0000 7f8723d84780 1 < completed part key=_multipart_UWS266H06VDK.2~6VKFN89X662Z.2 size=170452 2023-12-03T11:42:12.092 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.091+0000 7f8723d84780 1 < completed multipart upload key=UWS266H06VDK upload=6VKFN89X662Z tag=NLXJQ09WYPMC type=write size=3316180 2023-12-03T11:42:12.093 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.092+0000 7f8723d84780 1 > prepared operation key=EY9ZG5KOTBWM tag=X5MU1K1SHDTC type=write size=118780 2023-12-03T11:42:12.094 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.093+0000 7f8723d84780 1 < canceled operation key=TSTIBGVYUZZZ tag=XZKVMWSQBLWN type=del size=2505753 2023-12-03T11:42:12.096 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.095+0000 7f8723d84780 1 > prepared operation key=UWS266H06VDK tag=B1DWFD7RH4JQ type=del size=11485 2023-12-03T11:42:12.097 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.096+0000 7f8723d84780 1 < completed delete operation key=10JRIKOZ16FY tag=0JALWNQJSQC0 type=del 2023-12-03T11:42:12.099 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.098+0000 7f8723d84780 1 > prepared part key=_multipart_W2704YS8KYQB.2~74Z73MT9LOLH.0 size=1048576 2023-12-03T11:42:12.100 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.099+0000 7f8723d84780 1 > prepared part key=_multipart_W2704YS8KYQB.2~74Z73MT9LOLH.1 size=1048576 2023-12-03T11:42:12.101 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.100+0000 7f8723d84780 1 > prepared part key=_multipart_W2704YS8KYQB.2~74Z73MT9LOLH.2 size=230831 2023-12-03T11:42:12.101 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.100+0000 7f8723d84780 1 > prepared multipart upload key=W2704YS8KYQB upload=74Z73MT9LOLH tag=8A9L7J7TNWDL type=write size=3376559 2023-12-03T11:42:12.102 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.101+0000 7f8723d84780 1 < completed delete operation key=O7VVHXLDSY57 tag=1Q29B6VPKILJ type=del 2023-12-03T11:42:12.103 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.102+0000 7f8723d84780 1 > prepared operation key=VENJI0KD1XDW tag=P423QT1QZG9P type=write size=110634 2023-12-03T11:42:12.105 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.103+0000 7f8723d84780 1 < completed part key=_multipart_EY9ZG5KOTBWM.2~DL2PVCT9T6LI.0 size=1048576 2023-12-03T11:42:12.105 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.104+0000 7f8723d84780 1 < completed part key=_multipart_EY9ZG5KOTBWM.2~DL2PVCT9T6LI.1 size=509358 2023-12-03T11:42:12.107 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.106+0000 7f8723d84780 1 < completed multipart upload key=EY9ZG5KOTBWM upload=DL2PVCT9T6LI tag=NH0AFG1GH2LT type=write size=2606510 2023-12-03T11:42:12.109 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.108+0000 7f8723d84780 1 > prepared part key=_multipart_UWS266H06VDK.2~XP62DSV2J2DY.0 size=1048576 2023-12-03T11:42:12.110 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.109+0000 7f8723d84780 1 > prepared part key=_multipart_UWS266H06VDK.2~XP62DSV2J2DY.1 size=523685 2023-12-03T11:42:12.110 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.109+0000 7f8723d84780 1 > prepared multipart upload key=UWS266H06VDK upload=XP62DSV2J2DY tag=JWGT2NNWPZ87 type=write size=2620837 2023-12-03T11:42:12.111 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.110+0000 7f8723d84780 1 < completed delete operation key=HIU6L0NQ8Q95 tag=I1IY3TMWJYS3 type=del 2023-12-03T11:42:12.113 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.112+0000 7f8723d84780 1 > prepared part key=_multipart_O7VVHXLDSY57.2~0M9UNJE2AL1F.0 size=956519 2023-12-03T11:42:12.113 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.112+0000 7f8723d84780 1 > prepared multipart upload key=O7VVHXLDSY57 upload=0M9UNJE2AL1F tag=VJH1TO0GW93O type=write size=2005095 2023-12-03T11:42:12.114 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.113+0000 7f8723d84780 1 < completed delete operation key=EITMJKL0LCYC tag=F4M8G1O938H3 type=del 2023-12-03T11:42:12.117 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.115+0000 7f8723d84780 1 > prepared part key=_multipart_LMVO6CVEPN3K.2~27CA5AXITTTG.0 size=1048576 2023-12-03T11:42:12.117 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.116+0000 7f8723d84780 1 > prepared part key=_multipart_LMVO6CVEPN3K.2~27CA5AXITTTG.1 size=1048576 2023-12-03T11:42:12.118 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.117+0000 7f8723d84780 1 > prepared part key=_multipart_LMVO6CVEPN3K.2~27CA5AXITTTG.2 size=958328 2023-12-03T11:42:12.118 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.117+0000 7f8723d84780 1 > prepared multipart upload key=LMVO6CVEPN3K upload=27CA5AXITTTG tag=G5ACWCU1O5HB type=write size=4104056 2023-12-03T11:42:12.120 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.119+0000 7f8723d84780 1 < suggested remove operation key=Y6S7QI60GCLE tag=V7DSUHSV1NC2 type=del 2023-12-03T11:42:12.122 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.121+0000 7f8723d84780 1 > prepared operation key=Y6S7QI60GCLE tag=RHGIHASJHQGU type=write size=383054 2023-12-03T11:42:12.123 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.122+0000 7f8723d84780 1 < completed part key=_multipart_J33T5S893LMV.2~WKT382F3PQTV.0 size=594824 2023-12-03T11:42:12.125 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.124+0000 7f8723d84780 1 < completed multipart upload key=J33T5S893LMV upload=WKT382F3PQTV tag=PEFZ0RRHW173 type=write size=1643400 2023-12-03T11:42:12.127 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.126+0000 7f8723d84780 1 > prepared part key=_multipart_4I8PWBZOLDUG.2~N8Y7E7Y7EXT6.0 size=1048576 2023-12-03T11:42:12.128 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.127+0000 7f8723d84780 1 > prepared part key=_multipart_4I8PWBZOLDUG.2~N8Y7E7Y7EXT6.1 size=195683 2023-12-03T11:42:12.128 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.127+0000 7f8723d84780 1 > prepared multipart upload key=4I8PWBZOLDUG upload=N8Y7E7Y7EXT6 tag=6MJZAJFQXFAK type=write size=2292835 2023-12-03T11:42:12.129 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.128+0000 7f8723d84780 1 < completed delete operation key=CKABTI1EOAWB tag=00UW00L1QTFA type=del 2023-12-03T11:42:12.130 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.129+0000 7f8723d84780 1 > prepared operation key=96RAVVSUKH0Y tag=LPAVNBVZNF7Q type=del size=1886938 2023-12-03T11:42:12.131 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.130+0000 7f8723d84780 1 < completed part key=_multipart_EITMJKL0LCYC.2~DEDWOC09A9V4.0 size=1048576 2023-12-03T11:42:12.132 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.131+0000 7f8723d84780 1 < completed part key=_multipart_EITMJKL0LCYC.2~DEDWOC09A9V4.1 size=640209 2023-12-03T11:42:12.134 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.133+0000 7f8723d84780 1 < completed multipart upload key=EITMJKL0LCYC upload=DEDWOC09A9V4 tag=1XSTMS7IED28 type=write size=2737361 2023-12-03T11:42:12.136 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.135+0000 7f8723d84780 1 > prepared part key=_multipart_931GNEXBHH35.2~BIPUW3H28H71.0 size=1048576 2023-12-03T11:42:12.137 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.136+0000 7f8723d84780 1 > prepared part key=_multipart_931GNEXBHH35.2~BIPUW3H28H71.1 size=492968 2023-12-03T11:42:12.137 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.136+0000 7f8723d84780 1 > prepared multipart upload key=931GNEXBHH35 upload=BIPUW3H28H71 tag=9VIOV5DT7OZ3 type=write size=2590120 2023-12-03T11:42:12.139 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.138+0000 7f8723d84780 1 < completed delete operation key=TSTIBGVYUZZZ tag=9V2QWP48TUD0 type=del 2023-12-03T11:42:12.140 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.139+0000 7f8723d84780 1 > prepared operation key=8NONX2I08YMJ tag=X3RDSLMTJ80I type=del size=3464716 2023-12-03T11:42:12.141 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.140+0000 7f8723d84780 1 < completed delete operation key=OPQPIDJ2PBVU tag=0X5ZNGL64C09 type=del 2023-12-03T11:42:12.143 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.142+0000 7f8723d84780 1 > prepared part key=_multipart_8NONX2I08YMJ.2~T9IGC8EBSJV5.0 size=1048576 2023-12-03T11:42:12.144 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.143+0000 7f8723d84780 1 > prepared part key=_multipart_8NONX2I08YMJ.2~T9IGC8EBSJV5.1 size=607321 2023-12-03T11:42:12.144 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.143+0000 7f8723d84780 1 > prepared multipart upload key=8NONX2I08YMJ upload=T9IGC8EBSJV5 tag=K04172FINQCW type=write size=2704473 2023-12-03T11:42:12.146 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.145+0000 7f8723d84780 1 < completed write operation key=O7VVHXLDSY57 tag=RUTO4CFABIEO type=write size=670924 2023-12-03T11:42:12.147 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.146+0000 7f8723d84780 1 > prepared operation key=TSTIBGVYUZZZ tag=K9MT7HKOI84E type=del size=2579155 2023-12-03T11:42:12.148 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.147+0000 7f8723d84780 1 < completed part key=_multipart_J33T5S893LMV.2~Z6G0QUASFLXM.0 size=1048576 2023-12-03T11:42:12.149 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.148+0000 7f8723d84780 1 < completed part key=_multipart_J33T5S893LMV.2~Z6G0QUASFLXM.1 size=29697 2023-12-03T11:42:12.153 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.150+0000 7f8723d84780 1 < completed multipart upload key=J33T5S893LMV upload=Z6G0QUASFLXM tag=Q9YINYUJVCK0 type=write size=2126849 2023-12-03T11:42:12.154 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.153+0000 7f8723d84780 1 > prepared operation key=VENJI0KD1XDW tag=TUKM6D0H7ODX type=del size=2624389 2023-12-03T11:42:12.156 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.155+0000 7f8723d84780 1 < completed delete operation key=G36T76K8O7A1 tag=ASLN1EDO6GVE type=del 2023-12-03T11:42:12.158 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.157+0000 7f8723d84780 1 > prepared part key=_multipart_96RAVVSUKH0Y.2~W0HB1KKSC9BJ.0 size=1048576 2023-12-03T11:42:12.159 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.158+0000 7f8723d84780 1 > prepared part key=_multipart_96RAVVSUKH0Y.2~W0HB1KKSC9BJ.1 size=338925 2023-12-03T11:42:12.159 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.158+0000 7f8723d84780 1 > prepared multipart upload key=96RAVVSUKH0Y upload=W0HB1KKSC9BJ tag=NUFP1M9Z0ALT type=write size=2436077 2023-12-03T11:42:12.160 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.159+0000 7f8723d84780 1 < completed write operation key=EY9ZG5KOTBWM tag=X5MU1K1SHDTC type=write size=118780 2023-12-03T11:42:12.162 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.161+0000 7f8723d84780 1 > prepared operation key=HIU6L0NQ8Q95 tag=P6PNSGVF6TWO type=del size=1054710 2023-12-03T11:42:12.163 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.162+0000 7f8723d84780 1 < canceled operation key=UWS266H06VDK tag=B1DWFD7RH4JQ type=del size=11485 2023-12-03T11:42:12.164 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.163+0000 7f8723d84780 1 > prepared operation key=4I8PWBZOLDUG tag=NRR3UX0K37KT type=del size=2654269 2023-12-03T11:42:12.165 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.164+0000 7f8723d84780 1 < completed part key=_multipart_W2704YS8KYQB.2~74Z73MT9LOLH.0 size=1048576 2023-12-03T11:42:12.166 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.165+0000 7f8723d84780 1 < completed part key=_multipart_W2704YS8KYQB.2~74Z73MT9LOLH.1 size=1048576 2023-12-03T11:42:12.167 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.166+0000 7f8723d84780 1 < completed part key=_multipart_W2704YS8KYQB.2~74Z73MT9LOLH.2 size=230831 2023-12-03T11:42:12.169 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.168+0000 7f8723d84780 1 < completed multipart upload key=W2704YS8KYQB upload=74Z73MT9LOLH tag=8A9L7J7TNWDL type=write size=3376559 2023-12-03T11:42:12.170 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.169+0000 7f8723d84780 1 > prepared operation key=OPQPIDJ2PBVU tag=P9GHWJUYYCH3 type=del size=3033591 2023-12-03T11:42:12.173 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.172+0000 7f8723d84780 1 < suggested update operation key=VENJI0KD1XDW tag=P423QT1QZG9P type=write size=110634 2023-12-03T11:42:12.174 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.173+0000 7f8723d84780 1 > prepared operation key=M4VKPN6INFNZ tag=L0BD4TBCJ54E type=del size=1265510 2023-12-03T11:42:12.175 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.174+0000 7f8723d84780 1 < completed part key=_multipart_UWS266H06VDK.2~XP62DSV2J2DY.0 size=1048576 2023-12-03T11:42:12.176 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.175+0000 7f8723d84780 1 < completed part key=_multipart_UWS266H06VDK.2~XP62DSV2J2DY.1 size=523685 2023-12-03T11:42:12.178 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.177+0000 7f8723d84780 1 < completed multipart upload key=UWS266H06VDK upload=XP62DSV2J2DY tag=JWGT2NNWPZ87 type=write size=2620837 2023-12-03T11:42:12.179 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.178+0000 7f8723d84780 1 > prepared operation key=D3JEVEY0E29E tag=ZFWAJDICV0IF type=del size=3717901 2023-12-03T11:42:12.180 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.179+0000 7f8723d84780 1 < completed part key=_multipart_O7VVHXLDSY57.2~0M9UNJE2AL1F.0 size=956519 2023-12-03T11:42:12.182 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.181+0000 7f8723d84780 1 < completed multipart upload key=O7VVHXLDSY57 upload=0M9UNJE2AL1F tag=VJH1TO0GW93O type=write size=2005095 2023-12-03T11:42:12.185 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.184+0000 7f8723d84780 1 > prepared part key=_multipart_CKABTI1EOAWB.2~WVZ3FY0WFICX.0 size=1048576 2023-12-03T11:42:12.186 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.185+0000 7f8723d84780 1 > prepared part key=_multipart_CKABTI1EOAWB.2~WVZ3FY0WFICX.1 size=1048576 2023-12-03T11:42:12.187 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.186+0000 7f8723d84780 1 > prepared part key=_multipart_CKABTI1EOAWB.2~WVZ3FY0WFICX.2 size=349485 2023-12-03T11:42:12.187 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.186+0000 7f8723d84780 1 > prepared multipart upload key=CKABTI1EOAWB upload=WVZ3FY0WFICX tag=A6USH8OAZ2U0 type=write size=3495213 2023-12-03T11:42:12.188 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.187+0000 7f8723d84780 1 < completed part key=_multipart_LMVO6CVEPN3K.2~27CA5AXITTTG.0 size=1048576 2023-12-03T11:42:12.188 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.188+0000 7f8723d84780 1 < completed part key=_multipart_LMVO6CVEPN3K.2~27CA5AXITTTG.1 size=1048576 2023-12-03T11:42:12.189 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.188+0000 7f8723d84780 1 < completed part key=_multipart_LMVO6CVEPN3K.2~27CA5AXITTTG.2 size=958328 2023-12-03T11:42:12.191 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.190+0000 7f8723d84780 1 < completed multipart upload key=LMVO6CVEPN3K upload=27CA5AXITTTG tag=G5ACWCU1O5HB type=write size=4104056 2023-12-03T11:42:12.193 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.192+0000 7f8723d84780 1 > prepared operation key=J33T5S893LMV tag=GUIVV3LBYLPB type=del size=346533 2023-12-03T11:42:12.194 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.193+0000 7f8723d84780 1 < completed write operation key=Y6S7QI60GCLE tag=RHGIHASJHQGU type=write size=383054 2023-12-03T11:42:12.195 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.194+0000 7f8723d84780 1 > prepared operation key=931GNEXBHH35 tag=Z4NHQRYKMP95 type=del size=1903034 2023-12-03T11:42:12.196 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.195+0000 7f8723d84780 1 < completed part key=_multipart_4I8PWBZOLDUG.2~N8Y7E7Y7EXT6.0 size=1048576 2023-12-03T11:42:12.197 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.196+0000 7f8723d84780 1 < completed part key=_multipart_4I8PWBZOLDUG.2~N8Y7E7Y7EXT6.1 size=195683 2023-12-03T11:42:12.200 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.198+0000 7f8723d84780 1 < completed multipart upload key=4I8PWBZOLDUG upload=N8Y7E7Y7EXT6 tag=6MJZAJFQXFAK type=write size=2292835 2023-12-03T11:42:12.201 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.199+0000 7f8723d84780 1 > prepared operation key=DMQX2DGDLU7D tag=K0X7G369Q8UX type=del size=1217453 2023-12-03T11:42:12.202 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.201+0000 7f8723d84780 1 < completed delete operation key=96RAVVSUKH0Y tag=LPAVNBVZNF7Q type=del 2023-12-03T11:42:12.203 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.202+0000 7f8723d84780 1 > prepared operation key=DMQX2DGDLU7D tag=0KXW2CB2EFA6 type=del size=4097030 2023-12-03T11:42:12.204 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.203+0000 7f8723d84780 1 < completed part key=_multipart_931GNEXBHH35.2~BIPUW3H28H71.0 size=1048576 2023-12-03T11:42:12.205 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.204+0000 7f8723d84780 1 < completed part key=_multipart_931GNEXBHH35.2~BIPUW3H28H71.1 size=492968 2023-12-03T11:42:12.207 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.206+0000 7f8723d84780 1 < completed multipart upload key=931GNEXBHH35 upload=BIPUW3H28H71 tag=9VIOV5DT7OZ3 type=write size=2590120 2023-12-03T11:42:12.209 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.208+0000 7f8723d84780 1 > prepared part key=_multipart_CKABTI1EOAWB.2~MKSH4D8Z1P1Y.0 size=1048576 2023-12-03T11:42:12.210 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.209+0000 7f8723d84780 1 > prepared part key=_multipart_CKABTI1EOAWB.2~MKSH4D8Z1P1Y.1 size=1048576 2023-12-03T11:42:12.211 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.210+0000 7f8723d84780 1 > prepared part key=_multipart_CKABTI1EOAWB.2~MKSH4D8Z1P1Y.2 size=460963 2023-12-03T11:42:12.211 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.210+0000 7f8723d84780 1 > prepared multipart upload key=CKABTI1EOAWB upload=MKSH4D8Z1P1Y tag=6Q2AVE4I3K4Q type=write size=3606691 2023-12-03T11:42:12.213 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.212+0000 7f8723d84780 1 < suggested update operation key=8NONX2I08YMJ tag=X3RDSLMTJ80I type=del size=3464716 2023-12-03T11:42:12.214 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.213+0000 7f8723d84780 1 > prepared operation key=FCA2R3HR61S2 tag=1S6MKBUU1O74 type=del size=278718 2023-12-03T11:42:12.216 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.214+0000 7f8723d84780 1 < completed part key=_multipart_8NONX2I08YMJ.2~T9IGC8EBSJV5.0 size=1048576 2023-12-03T11:42:12.216 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.215+0000 7f8723d84780 1 < completed part key=_multipart_8NONX2I08YMJ.2~T9IGC8EBSJV5.1 size=607321 2023-12-03T11:42:12.218 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.217+0000 7f8723d84780 1 < completed multipart upload key=8NONX2I08YMJ upload=T9IGC8EBSJV5 tag=K04172FINQCW type=write size=2704473 2023-12-03T11:42:12.220 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.219+0000 7f8723d84780 1 > prepared operation key=HIU6L0NQ8Q95 tag=SVLAKOW265X8 type=write size=329635 2023-12-03T11:42:12.222 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.221+0000 7f8723d84780 1 < suggested remove operation key=TSTIBGVYUZZZ tag=K9MT7HKOI84E type=del 2023-12-03T11:42:12.224 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.223+0000 7f8723d84780 1 > prepared part key=_multipart_LCK58DDM5XU9.2~T3C0TD0XW8LG.0 size=1048576 2023-12-03T11:42:12.225 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.224+0000 7f8723d84780 1 > prepared part key=_multipart_LCK58DDM5XU9.2~T3C0TD0XW8LG.1 size=395573 2023-12-03T11:42:12.225 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.224+0000 7f8723d84780 1 > prepared multipart upload key=LCK58DDM5XU9 upload=T3C0TD0XW8LG tag=LAP7I5RJJL5I type=write size=2492725 2023-12-03T11:42:12.226 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.225+0000 7f8723d84780 -1 < failed to complete operation key=VENJI0KD1XDW tag=TUKM6D0H7ODX type=del size=2624389: (22) Invalid argument 2023-12-03T11:42:12.229 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.228+0000 7f8723d84780 1 > prepared part key=_multipart_EY9ZG5KOTBWM.2~MKWO0GTWW1X2.0 size=197737 2023-12-03T11:42:12.229 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.228+0000 7f8723d84780 1 > prepared multipart upload key=EY9ZG5KOTBWM upload=MKWO0GTWW1X2 tag=31TV6995OCFY type=write size=1246313 2023-12-03T11:42:12.230 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.229+0000 7f8723d84780 1 < completed part key=_multipart_96RAVVSUKH0Y.2~W0HB1KKSC9BJ.0 size=1048576 2023-12-03T11:42:12.232 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.230+0000 7f8723d84780 1 < completed part key=_multipart_96RAVVSUKH0Y.2~W0HB1KKSC9BJ.1 size=338925 2023-12-03T11:42:12.233 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.232+0000 7f8723d84780 1 < completed multipart upload key=96RAVVSUKH0Y upload=W0HB1KKSC9BJ tag=NUFP1M9Z0ALT type=write size=2436077 2023-12-03T11:42:12.235 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.234+0000 7f8723d84780 1 > prepared part key=_multipart_Y6S7QI60GCLE.2~8UR5YLIAACFP.0 size=1048576 2023-12-03T11:42:12.236 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.235+0000 7f8723d84780 1 > prepared part key=_multipart_Y6S7QI60GCLE.2~8UR5YLIAACFP.1 size=1048576 2023-12-03T11:42:12.237 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.236+0000 7f8723d84780 1 > prepared part key=_multipart_Y6S7QI60GCLE.2~8UR5YLIAACFP.2 size=834518 2023-12-03T11:42:12.237 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.236+0000 7f8723d84780 1 > prepared multipart upload key=Y6S7QI60GCLE upload=8UR5YLIAACFP tag=MPACS3SNNXET type=write size=3980246 2023-12-03T11:42:12.239 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.237+0000 7f8723d84780 1 < canceled operation key=HIU6L0NQ8Q95 tag=P6PNSGVF6TWO type=del size=1054710 2023-12-03T11:42:12.240 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.239+0000 7f8723d84780 1 > prepared operation key=D3JEVEY0E29E tag=TXDHGZ9PL4XO type=del size=1517454 2023-12-03T11:42:12.241 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.240+0000 7f8723d84780 1 < completed delete operation key=4I8PWBZOLDUG tag=NRR3UX0K37KT type=del 2023-12-03T11:42:12.243 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.241+0000 7f8723d84780 1 > prepared operation key=Y6S7QI60GCLE tag=0T3029YVQD7Q type=del size=1538265 2023-12-03T11:42:12.244 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.243+0000 7f8723d84780 1 < completed delete operation key=OPQPIDJ2PBVU tag=P9GHWJUYYCH3 type=del 2023-12-03T11:42:12.246 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.245+0000 7f8723d84780 1 > prepared part key=_multipart_EITMJKL0LCYC.2~BOS18QTE26UH.0 size=1048576 2023-12-03T11:42:12.249 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.246+0000 7f8723d84780 1 > prepared part key=_multipart_EITMJKL0LCYC.2~BOS18QTE26UH.1 size=1048576 2023-12-03T11:42:12.249 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.247+0000 7f8723d84780 1 > prepared part key=_multipart_EITMJKL0LCYC.2~BOS18QTE26UH.2 size=739362 2023-12-03T11:42:12.249 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.247+0000 7f8723d84780 1 > prepared multipart upload key=EITMJKL0LCYC upload=BOS18QTE26UH tag=LRN5XOGLLNDZ type=write size=3885090 2023-12-03T11:42:12.249 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.248+0000 7f8723d84780 1 < completed delete operation key=M4VKPN6INFNZ tag=L0BD4TBCJ54E type=del 2023-12-03T11:42:12.250 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.249+0000 7f8723d84780 1 > prepared operation key=G36T76K8O7A1 tag=5Y683JMSL7J6 type=del size=3437468 2023-12-03T11:42:12.251 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.250+0000 7f8723d84780 1 < completed delete operation key=D3JEVEY0E29E tag=ZFWAJDICV0IF type=del 2023-12-03T11:42:12.253 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.252+0000 7f8723d84780 1 > prepared operation key=DMQX2DGDLU7D tag=CIVCC9DWBIDP type=write size=808412 2023-12-03T11:42:12.253 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.252+0000 7f8723d84780 1 < canceled part key=_multipart_CKABTI1EOAWB.2~WVZ3FY0WFICX.0 size=1048576 2023-12-03T11:42:12.253 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.252+0000 7f8723d84780 1 < canceled part key=_multipart_CKABTI1EOAWB.2~WVZ3FY0WFICX.1 size=1048576 2023-12-03T11:42:12.253 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.252+0000 7f8723d84780 1 < canceled part key=_multipart_CKABTI1EOAWB.2~WVZ3FY0WFICX.2 size=349485 2023-12-03T11:42:12.256 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.254+0000 7f8723d84780 1 < canceled multipart upload key=CKABTI1EOAWB upload=WVZ3FY0WFICX tag=A6USH8OAZ2U0 type=write size=3495213 2023-12-03T11:42:12.258 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.257+0000 7f8723d84780 1 > prepared operation key=4I8PWBZOLDUG tag=SOFOUA11DDK8 type=del size=58866 2023-12-03T11:42:12.261 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.260+0000 7f8723d84780 1 < completed delete operation key=J33T5S893LMV tag=GUIVV3LBYLPB type=del 2023-12-03T11:42:12.262 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.261+0000 7f8723d84780 1 > prepared operation key=LMVO6CVEPN3K tag=J9BJ6PSDK6AL type=write size=499755 2023-12-03T11:42:12.263 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.262+0000 7f8723d84780 1 < completed delete operation key=931GNEXBHH35 tag=Z4NHQRYKMP95 type=del 2023-12-03T11:42:12.264 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.263+0000 7f8723d84780 1 > prepared operation key=D3JEVEY0E29E tag=7V14GGQF3TRO type=del size=2821740 2023-12-03T11:42:12.265 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.265+0000 7f8723d84780 1 < completed delete operation key=DMQX2DGDLU7D tag=K0X7G369Q8UX type=del 2023-12-03T11:42:12.267 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.266+0000 7f8723d84780 1 > prepared operation key=OGACI7CRPMT7 tag=QCZPOYCU1VIL type=del size=2288395 2023-12-03T11:42:12.268 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.267+0000 7f8723d84780 1 < completed delete operation key=DMQX2DGDLU7D tag=0KXW2CB2EFA6 type=del 2023-12-03T11:42:12.273 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.272+0000 7f8723d84780 1 > prepared part key=_multipart_J33T5S893LMV.2~4EFQO7CJMXQ1.0 size=1048576 2023-12-03T11:42:12.274 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.273+0000 7f8723d84780 1 > prepared part key=_multipart_J33T5S893LMV.2~4EFQO7CJMXQ1.1 size=933857 2023-12-03T11:42:12.274 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.273+0000 7f8723d84780 1 > prepared multipart upload key=J33T5S893LMV upload=4EFQO7CJMXQ1 tag=F0LQ893VLQLT type=write size=3031009 2023-12-03T11:42:12.275 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.274+0000 7f8723d84780 1 < completed part key=_multipart_CKABTI1EOAWB.2~MKSH4D8Z1P1Y.0 size=1048576 2023-12-03T11:42:12.276 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.274+0000 7f8723d84780 1 < canceled part key=_multipart_CKABTI1EOAWB.2~MKSH4D8Z1P1Y.1 size=1048576 2023-12-03T11:42:12.276 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.275+0000 7f8723d84780 1 < completed part key=_multipart_CKABTI1EOAWB.2~MKSH4D8Z1P1Y.2 size=460963 2023-12-03T11:42:12.278 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.277+0000 7f8723d84780 1 < canceled multipart upload key=CKABTI1EOAWB upload=MKSH4D8Z1P1Y tag=6Q2AVE4I3K4Q type=write size=3606691 2023-12-03T11:42:12.280 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.278+0000 7f8723d84780 1 > prepared operation key=FCA2R3HR61S2 tag=0DY21KS6OE6N type=del size=3430904 2023-12-03T11:42:12.282 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.281+0000 7f8723d84780 1 < suggested update operation key=FCA2R3HR61S2 tag=1S6MKBUU1O74 type=del size=278718 2023-12-03T11:42:12.283 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.282+0000 7f8723d84780 1 > prepared operation key=931GNEXBHH35 tag=UKMGS7IGL850 type=del size=1307078 2023-12-03T11:42:12.284 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.283+0000 7f8723d84780 1 < completed write operation key=HIU6L0NQ8Q95 tag=SVLAKOW265X8 type=write size=329635 2023-12-03T11:42:12.290 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.285+0000 7f8723d84780 1 > prepared part key=_multipart_O7VVHXLDSY57.2~PMVH351Q35T8.0 size=1048576 2023-12-03T11:42:12.291 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.286+0000 7f8723d84780 1 > prepared part key=_multipart_O7VVHXLDSY57.2~PMVH351Q35T8.1 size=1048576 2023-12-03T11:42:12.291 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.287+0000 7f8723d84780 1 > prepared part key=_multipart_O7VVHXLDSY57.2~PMVH351Q35T8.2 size=541270 2023-12-03T11:42:12.291 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.287+0000 7f8723d84780 1 > prepared multipart upload key=O7VVHXLDSY57 upload=PMVH351Q35T8 tag=9KBOFRN86EZK type=write size=3686998 2023-12-03T11:42:12.291 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.288+0000 7f8723d84780 1 < completed part key=_multipart_LCK58DDM5XU9.2~T3C0TD0XW8LG.0 size=1048576 2023-12-03T11:42:12.291 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.289+0000 7f8723d84780 1 < completed part key=_multipart_LCK58DDM5XU9.2~T3C0TD0XW8LG.1 size=395573 2023-12-03T11:42:12.292 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.291+0000 7f8723d84780 1 < completed multipart upload key=LCK58DDM5XU9 upload=T3C0TD0XW8LG tag=LAP7I5RJJL5I type=write size=2492725 2023-12-03T11:42:12.294 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.293+0000 7f8723d84780 1 > prepared part key=_multipart_4I8PWBZOLDUG.2~X48T3Z8IGITZ.0 size=1048576 2023-12-03T11:42:12.295 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.294+0000 7f8723d84780 1 > prepared part key=_multipart_4I8PWBZOLDUG.2~X48T3Z8IGITZ.1 size=890668 2023-12-03T11:42:12.295 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.294+0000 7f8723d84780 1 > prepared multipart upload key=4I8PWBZOLDUG upload=X48T3Z8IGITZ tag=IV5FFDRPTJUW type=write size=2987820 2023-12-03T11:42:12.296 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.295+0000 7f8723d84780 1 < completed part key=_multipart_EY9ZG5KOTBWM.2~MKWO0GTWW1X2.0 size=197737 2023-12-03T11:42:12.298 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.297+0000 7f8723d84780 1 < completed multipart upload key=EY9ZG5KOTBWM upload=MKWO0GTWW1X2 tag=31TV6995OCFY type=write size=1246313 2023-12-03T11:42:12.299 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.298+0000 7f8723d84780 1 > prepared operation key=O7VVHXLDSY57 tag=10382FLXH3SW type=del size=3491836 2023-12-03T11:42:12.300 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.299+0000 7f8723d84780 1 < completed part key=_multipart_Y6S7QI60GCLE.2~8UR5YLIAACFP.0 size=1048576 2023-12-03T11:42:12.301 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.300+0000 7f8723d84780 1 < completed part key=_multipart_Y6S7QI60GCLE.2~8UR5YLIAACFP.1 size=1048576 2023-12-03T11:42:12.302 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.301+0000 7f8723d84780 1 < completed part key=_multipart_Y6S7QI60GCLE.2~8UR5YLIAACFP.2 size=834518 2023-12-03T11:42:12.304 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.303+0000 7f8723d84780 1 < completed multipart upload key=Y6S7QI60GCLE upload=8UR5YLIAACFP tag=MPACS3SNNXET type=write size=3980246 2023-12-03T11:42:12.305 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.304+0000 7f8723d84780 1 > prepared operation key=M4VKPN6INFNZ tag=O79QHJ0MWDFA type=del size=2107944 2023-12-03T11:42:12.307 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.306+0000 7f8723d84780 1 < suggested remove operation key=D3JEVEY0E29E tag=TXDHGZ9PL4XO type=del 2023-12-03T11:42:12.310 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.309+0000 7f8723d84780 1 > prepared part key=_multipart_5UYL15O31IHM.2~YY13FDI78IJP.0 size=1048576 2023-12-03T11:42:12.310 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.310+0000 7f8723d84780 1 > prepared part key=_multipart_5UYL15O31IHM.2~YY13FDI78IJP.1 size=1048576 2023-12-03T11:42:12.311 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.310+0000 7f8723d84780 1 > prepared part key=_multipart_5UYL15O31IHM.2~YY13FDI78IJP.2 size=593558 2023-12-03T11:42:12.312 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.310+0000 7f8723d84780 1 > prepared multipart upload key=5UYL15O31IHM upload=YY13FDI78IJP tag=G313Z3R1TQNR type=write size=3739286 2023-12-03T11:42:12.313 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.312+0000 7f8723d84780 1 < completed delete operation key=Y6S7QI60GCLE tag=0T3029YVQD7Q type=del 2023-12-03T11:42:12.314 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.313+0000 7f8723d84780 1 > prepared operation key=OGACI7CRPMT7 tag=UIZT74AGH0BF type=write size=944678 2023-12-03T11:42:12.315 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.313+0000 7f8723d84780 1 < canceled part key=_multipart_EITMJKL0LCYC.2~BOS18QTE26UH.0 size=1048576 2023-12-03T11:42:12.315 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.314+0000 7f8723d84780 1 < completed part key=_multipart_EITMJKL0LCYC.2~BOS18QTE26UH.1 size=1048576 2023-12-03T11:42:12.316 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.314+0000 7f8723d84780 1 < canceled part key=_multipart_EITMJKL0LCYC.2~BOS18QTE26UH.2 size=739362 2023-12-03T11:42:12.317 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.316+0000 7f8723d84780 1 < canceled multipart upload key=EITMJKL0LCYC upload=BOS18QTE26UH tag=LRN5XOGLLNDZ type=write size=3885090 2023-12-03T11:42:12.318 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.317+0000 7f8723d84780 1 > prepared operation key=4I8PWBZOLDUG tag=15WK2O5HS66K type=del size=1442732 2023-12-03T11:42:12.319 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.318+0000 7f8723d84780 1 < completed delete operation key=G36T76K8O7A1 tag=5Y683JMSL7J6 type=del 2023-12-03T11:42:12.320 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.320+0000 7f8723d84780 1 > prepared operation key=4I8PWBZOLDUG tag=6E7BQEI5NRX7 type=del size=361494 2023-12-03T11:42:12.322 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.321+0000 7f8723d84780 1 < completed write operation key=DMQX2DGDLU7D tag=CIVCC9DWBIDP type=write size=808412 2023-12-03T11:42:12.323 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.322+0000 7f8723d84780 1 > prepared operation key=12XG7YPYTN4U tag=1EA3RNMSDY0C type=del size=1407713 2023-12-03T11:42:12.324 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.323+0000 7f8723d84780 1 < completed delete operation key=4I8PWBZOLDUG tag=SOFOUA11DDK8 type=del 2023-12-03T11:42:12.326 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.325+0000 7f8723d84780 1 > prepared part key=_multipart_EY9ZG5KOTBWM.2~52QH4OTSMSLK.0 size=1048576 2023-12-03T11:42:12.327 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.326+0000 7f8723d84780 1 > prepared part key=_multipart_EY9ZG5KOTBWM.2~52QH4OTSMSLK.1 size=1048576 2023-12-03T11:42:12.328 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.327+0000 7f8723d84780 1 > prepared part key=_multipart_EY9ZG5KOTBWM.2~52QH4OTSMSLK.2 size=924743 2023-12-03T11:42:12.328 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.327+0000 7f8723d84780 1 > prepared multipart upload key=EY9ZG5KOTBWM upload=52QH4OTSMSLK tag=9TGKJM4WE3TB type=write size=4070471 2023-12-03T11:42:12.329 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.328+0000 7f8723d84780 1 < completed write operation key=LMVO6CVEPN3K tag=J9BJ6PSDK6AL type=write size=499755 2023-12-03T11:42:12.330 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.329+0000 7f8723d84780 1 > prepared operation key=LCK58DDM5XU9 tag=5FP4ZOD9DQJN type=del size=2151149 2023-12-03T11:42:12.331 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.330+0000 7f8723d84780 -1 < failed to complete operation key=D3JEVEY0E29E tag=7V14GGQF3TRO type=del size=2821740: (22) Invalid argument 2023-12-03T11:42:12.333 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.332+0000 7f8723d84780 1 > prepared part key=_multipart_EITMJKL0LCYC.2~YFCCKUZTLRVJ.0 size=1048576 2023-12-03T11:42:12.335 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.333+0000 7f8723d84780 1 > prepared part key=_multipart_EITMJKL0LCYC.2~YFCCKUZTLRVJ.1 size=799162 2023-12-03T11:42:12.335 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.333+0000 7f8723d84780 1 > prepared multipart upload key=EITMJKL0LCYC upload=YFCCKUZTLRVJ tag=LSU0967OB6LX type=write size=2896314 2023-12-03T11:42:12.336 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.335+0000 7f8723d84780 1 < suggested update operation key=OGACI7CRPMT7 tag=QCZPOYCU1VIL type=del size=2288395 2023-12-03T11:42:12.338 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.337+0000 7f8723d84780 1 > prepared operation key=DMQX2DGDLU7D tag=G4GIEDOV2CVB type=del size=3108120 2023-12-03T11:42:12.339 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.338+0000 7f8723d84780 1 < completed part key=_multipart_J33T5S893LMV.2~4EFQO7CJMXQ1.0 size=1048576 2023-12-03T11:42:12.339 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.338+0000 7f8723d84780 1 < canceled part key=_multipart_J33T5S893LMV.2~4EFQO7CJMXQ1.1 size=933857 2023-12-03T11:42:12.341 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.340+0000 7f8723d84780 1 < canceled multipart upload key=J33T5S893LMV upload=4EFQO7CJMXQ1 tag=F0LQ893VLQLT type=write size=3031009 2023-12-03T11:42:12.343 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.342+0000 7f8723d84780 1 > prepared part key=_multipart_OGACI7CRPMT7.2~9F9FM8A1D0CL.0 size=1048576 2023-12-03T11:42:12.344 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.343+0000 7f8723d84780 1 > prepared part key=_multipart_OGACI7CRPMT7.2~9F9FM8A1D0CL.1 size=725349 2023-12-03T11:42:12.344 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.343+0000 7f8723d84780 1 > prepared multipart upload key=OGACI7CRPMT7 upload=9F9FM8A1D0CL tag=XY3QVZ20A466 type=write size=2822501 2023-12-03T11:42:12.345 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.344+0000 7f8723d84780 -1 < failed to complete operation key=FCA2R3HR61S2 tag=0DY21KS6OE6N type=del size=3430904: (22) Invalid argument 2023-12-03T11:42:12.346 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.345+0000 7f8723d84780 1 > prepared operation key=KS5J7E7KE2IJ tag=ZVJ2V0S3SI65 type=del size=2065398 2023-12-03T11:42:12.347 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.346+0000 7f8723d84780 1 < canceled operation key=931GNEXBHH35 tag=UKMGS7IGL850 type=del size=1307078 2023-12-03T11:42:12.349 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.348+0000 7f8723d84780 1 > prepared part key=_multipart_UWS266H06VDK.2~OO323B7AQ05B.0 size=1048576 2023-12-03T11:42:12.350 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.349+0000 7f8723d84780 1 > prepared part key=_multipart_UWS266H06VDK.2~OO323B7AQ05B.1 size=1048576 2023-12-03T11:42:12.351 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.350+0000 7f8723d84780 1 > prepared part key=_multipart_UWS266H06VDK.2~OO323B7AQ05B.2 size=437411 2023-12-03T11:42:12.351 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.350+0000 7f8723d84780 1 > prepared multipart upload key=UWS266H06VDK upload=OO323B7AQ05B tag=HOUKQKWUAQJL type=write size=3583139 2023-12-03T11:42:12.353 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.352+0000 7f8723d84780 1 < completed part key=_multipart_O7VVHXLDSY57.2~PMVH351Q35T8.0 size=1048576 2023-12-03T11:42:12.354 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.353+0000 7f8723d84780 1 < completed part key=_multipart_O7VVHXLDSY57.2~PMVH351Q35T8.1 size=1048576 2023-12-03T11:42:12.357 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.354+0000 7f8723d84780 1 < completed part key=_multipart_O7VVHXLDSY57.2~PMVH351Q35T8.2 size=541270 2023-12-03T11:42:12.357 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.356+0000 7f8723d84780 1 < completed multipart upload key=O7VVHXLDSY57 upload=PMVH351Q35T8 tag=9KBOFRN86EZK type=write size=3686998 2023-12-03T11:42:12.359 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.358+0000 7f8723d84780 1 > prepared part key=_multipart_7THZZ1J5LOZK.2~NV7HLSVZ2FCS.0 size=404538 2023-12-03T11:42:12.359 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.358+0000 7f8723d84780 1 > prepared multipart upload key=7THZZ1J5LOZK upload=NV7HLSVZ2FCS tag=FATN21CHLZYR type=write size=1453114 2023-12-03T11:42:12.360 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.359+0000 7f8723d84780 1 < completed part key=_multipart_4I8PWBZOLDUG.2~X48T3Z8IGITZ.0 size=1048576 2023-12-03T11:42:12.361 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.360+0000 7f8723d84780 1 < completed part key=_multipart_4I8PWBZOLDUG.2~X48T3Z8IGITZ.1 size=890668 2023-12-03T11:42:12.364 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.363+0000 7f8723d84780 1 < completed multipart upload key=4I8PWBZOLDUG upload=X48T3Z8IGITZ tag=IV5FFDRPTJUW type=write size=2987820 2023-12-03T11:42:12.366 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.365+0000 7f8723d84780 1 > prepared part key=_multipart_O7VVHXLDSY57.2~M4VIZ5O4VUC7.0 size=57277 2023-12-03T11:42:12.366 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.365+0000 7f8723d84780 1 > prepared multipart upload key=O7VVHXLDSY57 upload=M4VIZ5O4VUC7 tag=CLADD4NX55SW type=write size=1105853 2023-12-03T11:42:12.367 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.366+0000 7f8723d84780 1 < completed delete operation key=O7VVHXLDSY57 tag=10382FLXH3SW type=del 2023-12-03T11:42:12.368 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.367+0000 7f8723d84780 1 > prepared operation key=10JRIKOZ16FY tag=KUZ4L6ZOLO0Y type=write size=184172 2023-12-03T11:42:12.370 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.369+0000 7f8723d84780 1 < completed delete operation key=M4VKPN6INFNZ tag=O79QHJ0MWDFA type=del 2023-12-03T11:42:12.371 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.370+0000 7f8723d84780 1 > prepared operation key=TSTIBGVYUZZZ tag=QZB2KTBGB5VU type=del size=1245664 2023-12-03T11:42:12.372 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.371+0000 7f8723d84780 1 < completed part key=_multipart_5UYL15O31IHM.2~YY13FDI78IJP.0 size=1048576 2023-12-03T11:42:12.372 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.371+0000 7f8723d84780 1 < canceled part key=_multipart_5UYL15O31IHM.2~YY13FDI78IJP.1 size=1048576 2023-12-03T11:42:12.373 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.372+0000 7f8723d84780 1 < completed part key=_multipart_5UYL15O31IHM.2~YY13FDI78IJP.2 size=593558 2023-12-03T11:42:12.375 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.374+0000 7f8723d84780 1 < canceled multipart upload key=5UYL15O31IHM upload=YY13FDI78IJP tag=G313Z3R1TQNR type=write size=3739286 2023-12-03T11:42:12.377 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.376+0000 7f8723d84780 1 > prepared operation key=VENJI0KD1XDW tag=0M051TA1GPI6 type=del size=2928213 2023-12-03T11:42:12.378 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.377+0000 7f8723d84780 -1 < failed to complete operation key=OGACI7CRPMT7 tag=UIZT74AGH0BF type=write size=944678: (22) Invalid argument 2023-12-03T11:42:12.382 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.378+0000 7f8723d84780 1 > prepared operation key=EITMJKL0LCYC tag=M4AXR99M2RR5 type=del size=18716 2023-12-03T11:42:12.382 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.380+0000 7f8723d84780 1 < completed delete operation key=4I8PWBZOLDUG tag=15WK2O5HS66K type=del 2023-12-03T11:42:12.384 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.383+0000 7f8723d84780 1 > prepared part key=_multipart_VENJI0KD1XDW.2~HJGG5WNLY244.0 size=1048576 2023-12-03T11:42:12.385 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.384+0000 7f8723d84780 1 > prepared part key=_multipart_VENJI0KD1XDW.2~HJGG5WNLY244.1 size=381793 2023-12-03T11:42:12.385 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.384+0000 7f8723d84780 1 > prepared multipart upload key=VENJI0KD1XDW upload=HJGG5WNLY244 tag=N19BY4VN8V39 type=write size=2478945 2023-12-03T11:42:12.386 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.385+0000 7f8723d84780 1 < completed delete operation key=4I8PWBZOLDUG tag=6E7BQEI5NRX7 type=del 2023-12-03T11:42:12.388 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.387+0000 7f8723d84780 1 > prepared part key=_multipart_8NONX2I08YMJ.2~J1LFFX2Z638P.0 size=1048576 2023-12-03T11:42:12.389 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.388+0000 7f8723d84780 1 > prepared part key=_multipart_8NONX2I08YMJ.2~J1LFFX2Z638P.1 size=1048576 2023-12-03T11:42:12.390 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.389+0000 7f8723d84780 1 > prepared part key=_multipart_8NONX2I08YMJ.2~J1LFFX2Z638P.2 size=86183 2023-12-03T11:42:12.390 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.389+0000 7f8723d84780 1 > prepared multipart upload key=8NONX2I08YMJ upload=J1LFFX2Z638P tag=Y7KRVUSHY17Q type=write size=3231911 2023-12-03T11:42:12.392 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.391+0000 7f8723d84780 1 < suggested remove operation key=12XG7YPYTN4U tag=1EA3RNMSDY0C type=del 2023-12-03T11:42:12.394 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.393+0000 7f8723d84780 1 > prepared operation key=UWS266H06VDK tag=VN1JCYA3QCW1 type=del size=3093984 2023-12-03T11:42:12.395 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.394+0000 7f8723d84780 1 < completed part key=_multipart_EY9ZG5KOTBWM.2~52QH4OTSMSLK.0 size=1048576 2023-12-03T11:42:12.396 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.395+0000 7f8723d84780 1 < completed part key=_multipart_EY9ZG5KOTBWM.2~52QH4OTSMSLK.1 size=1048576 2023-12-03T11:42:12.397 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.396+0000 7f8723d84780 1 < completed part key=_multipart_EY9ZG5KOTBWM.2~52QH4OTSMSLK.2 size=924743 2023-12-03T11:42:12.399 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.398+0000 7f8723d84780 1 < completed multipart upload key=EY9ZG5KOTBWM upload=52QH4OTSMSLK tag=9TGKJM4WE3TB type=write size=4070471 2023-12-03T11:42:12.400 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.399+0000 7f8723d84780 1 > prepared operation key=96RAVVSUKH0Y tag=U7C6MES8N6O2 type=del size=3770182 2023-12-03T11:42:12.401 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.400+0000 7f8723d84780 1 < completed delete operation key=LCK58DDM5XU9 tag=5FP4ZOD9DQJN type=del 2023-12-03T11:42:12.403 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.402+0000 7f8723d84780 1 > prepared operation key=8NONX2I08YMJ tag=XV8DXZOXE3CS type=write size=892930 2023-12-03T11:42:12.403 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.402+0000 7f8723d84780 1 < canceled part key=_multipart_EITMJKL0LCYC.2~YFCCKUZTLRVJ.0 size=1048576 2023-12-03T11:42:12.404 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.403+0000 7f8723d84780 1 < completed part key=_multipart_EITMJKL0LCYC.2~YFCCKUZTLRVJ.1 size=799162 2023-12-03T11:42:12.406 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.405+0000 7f8723d84780 1 < canceled multipart upload key=EITMJKL0LCYC upload=YFCCKUZTLRVJ tag=LSU0967OB6LX type=write size=2896314 2023-12-03T11:42:12.407 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.406+0000 7f8723d84780 1 > prepared operation key=OPQPIDJ2PBVU tag=ILAYVWBOSIHA type=del size=2869734 2023-12-03T11:42:12.408 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.407+0000 7f8723d84780 1 < completed delete operation key=DMQX2DGDLU7D tag=G4GIEDOV2CVB type=del 2023-12-03T11:42:12.410 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.409+0000 7f8723d84780 1 > prepared operation key=VENJI0KD1XDW tag=A7UYPZ9A9GDC type=write size=824901 2023-12-03T11:42:12.410 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.409+0000 7f8723d84780 1 < canceled part key=_multipart_OGACI7CRPMT7.2~9F9FM8A1D0CL.0 size=1048576 2023-12-03T11:42:12.411 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.410+0000 7f8723d84780 1 < completed part key=_multipart_OGACI7CRPMT7.2~9F9FM8A1D0CL.1 size=725349 2023-12-03T11:42:12.413 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.412+0000 7f8723d84780 1 < canceled multipart upload key=OGACI7CRPMT7 upload=9F9FM8A1D0CL tag=XY3QVZ20A466 type=write size=2822501 2023-12-03T11:42:12.415 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.414+0000 7f8723d84780 1 > prepared operation key=HIU6L0NQ8Q95 tag=YLDTOPGQBJJF type=del size=693183 2023-12-03T11:42:12.417 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.416+0000 7f8723d84780 1 < suggested remove operation key=KS5J7E7KE2IJ tag=ZVJ2V0S3SI65 type=del 2023-12-03T11:42:12.418 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.417+0000 7f8723d84780 1 > prepared operation key=CKABTI1EOAWB tag=T72I3X5P2FKQ type=del size=3170297 2023-12-03T11:42:12.419 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.418+0000 7f8723d84780 1 < completed part key=_multipart_UWS266H06VDK.2~OO323B7AQ05B.0 size=1048576 2023-12-03T11:42:12.420 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.419+0000 7f8723d84780 1 < completed part key=_multipart_UWS266H06VDK.2~OO323B7AQ05B.1 size=1048576 2023-12-03T11:42:12.421 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.420+0000 7f8723d84780 1 < completed part key=_multipart_UWS266H06VDK.2~OO323B7AQ05B.2 size=437411 2023-12-03T11:42:12.423 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.422+0000 7f8723d84780 1 < completed multipart upload key=UWS266H06VDK upload=OO323B7AQ05B tag=HOUKQKWUAQJL type=write size=3583139 2023-12-03T11:42:12.425 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.424+0000 7f8723d84780 1 > prepared part key=_multipart_TSTIBGVYUZZZ.2~C51PMU81QU08.0 size=1048576 2023-12-03T11:42:12.426 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.425+0000 7f8723d84780 1 > prepared part key=_multipart_TSTIBGVYUZZZ.2~C51PMU81QU08.1 size=646281 2023-12-03T11:42:12.426 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.425+0000 7f8723d84780 1 > prepared multipart upload key=TSTIBGVYUZZZ upload=C51PMU81QU08 tag=FNA3AUBF7NPO type=write size=2743433 2023-12-03T11:42:12.427 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.426+0000 7f8723d84780 1 < completed part key=_multipart_7THZZ1J5LOZK.2~NV7HLSVZ2FCS.0 size=404538 2023-12-03T11:42:12.429 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.428+0000 7f8723d84780 1 < completed multipart upload key=7THZZ1J5LOZK upload=NV7HLSVZ2FCS tag=FATN21CHLZYR type=write size=1453114 2023-12-03T11:42:12.431 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.429+0000 7f8723d84780 1 > prepared operation key=7VMTBKUWU59F tag=ET0SGG6WI1XH type=del size=3341251 2023-12-03T11:42:12.432 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.431+0000 7f8723d84780 1 < completed part key=_multipart_O7VVHXLDSY57.2~M4VIZ5O4VUC7.0 size=57277 2023-12-03T11:42:12.434 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.433+0000 7f8723d84780 1 < completed multipart upload key=O7VVHXLDSY57 upload=M4VIZ5O4VUC7 tag=CLADD4NX55SW type=write size=1105853 2023-12-03T11:42:12.435 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.434+0000 7f8723d84780 1 > prepared operation key=LCK58DDM5XU9 tag=96XK6OCHPKE8 type=del size=3158570 2023-12-03T11:42:12.437 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.436+0000 7f8723d84780 1 < completed write operation key=10JRIKOZ16FY tag=KUZ4L6ZOLO0Y type=write size=184172 2023-12-03T11:42:12.438 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.437+0000 7f8723d84780 1 > prepared operation key=W2704YS8KYQB tag=KYDWUVREO28L type=del size=2953143 2023-12-03T11:42:12.439 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.438+0000 7f8723d84780 1 < completed delete operation key=TSTIBGVYUZZZ tag=QZB2KTBGB5VU type=del 2023-12-03T11:42:12.441 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.440+0000 7f8723d84780 1 > prepared operation key=K83BTR5BOLZE tag=12XY18W4IH4L type=del size=1948837 2023-12-03T11:42:12.442 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.441+0000 7f8723d84780 1 < completed delete operation key=VENJI0KD1XDW tag=0M051TA1GPI6 type=del 2023-12-03T11:42:12.443 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.442+0000 7f8723d84780 1 > prepared operation key=931GNEXBHH35 tag=N6JX67D7CLJ0 type=del size=62689 2023-12-03T11:42:12.445 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.444+0000 7f8723d84780 1 < completed delete operation key=EITMJKL0LCYC tag=M4AXR99M2RR5 type=del 2023-12-03T11:42:12.446 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.445+0000 7f8723d84780 1 > prepared operation key=4I8PWBZOLDUG tag=L5785A7CELLC type=del size=2818367 2023-12-03T11:42:12.448 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.446+0000 7f8723d84780 1 < completed part key=_multipart_VENJI0KD1XDW.2~HJGG5WNLY244.0 size=1048576 2023-12-03T11:42:12.448 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.447+0000 7f8723d84780 1 < completed part key=_multipart_VENJI0KD1XDW.2~HJGG5WNLY244.1 size=381793 2023-12-03T11:42:12.450 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.449+0000 7f8723d84780 1 < completed multipart upload key=VENJI0KD1XDW upload=HJGG5WNLY244 tag=N19BY4VN8V39 type=write size=2478945 2023-12-03T11:42:12.452 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.451+0000 7f8723d84780 1 > prepared operation key=O7VVHXLDSY57 tag=0P9RYNPF3KSJ type=del size=828569 2023-12-03T11:42:12.453 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.452+0000 7f8723d84780 1 < completed part key=_multipart_8NONX2I08YMJ.2~J1LFFX2Z638P.0 size=1048576 2023-12-03T11:42:12.454 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.453+0000 7f8723d84780 1 < completed part key=_multipart_8NONX2I08YMJ.2~J1LFFX2Z638P.1 size=1048576 2023-12-03T11:42:12.455 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.454+0000 7f8723d84780 1 < completed part key=_multipart_8NONX2I08YMJ.2~J1LFFX2Z638P.2 size=86183 2023-12-03T11:42:12.457 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.456+0000 7f8723d84780 1 < completed multipart upload key=8NONX2I08YMJ upload=J1LFFX2Z638P tag=Y7KRVUSHY17Q type=write size=3231911 2023-12-03T11:42:12.459 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.458+0000 7f8723d84780 1 > prepared operation key=W2704YS8KYQB tag=HR4R8IIHC4EN type=del size=3464086 2023-12-03T11:42:12.460 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.459+0000 7f8723d84780 1 < completed delete operation key=UWS266H06VDK tag=VN1JCYA3QCW1 type=del 2023-12-03T11:42:12.461 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.460+0000 7f8723d84780 1 > prepared operation key=EY9ZG5KOTBWM tag=IU3ZZREMM3NJ type=del size=1303047 2023-12-03T11:42:12.463 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.462+0000 7f8723d84780 1 < suggested remove operation key=96RAVVSUKH0Y tag=U7C6MES8N6O2 type=del 2023-12-03T11:42:12.465 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.464+0000 7f8723d84780 1 > prepared operation key=Y6S7QI60GCLE tag=62J658KHSU7G type=del size=1406417 2023-12-03T11:42:12.466 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.465+0000 7f8723d84780 1 < completed write operation key=8NONX2I08YMJ tag=XV8DXZOXE3CS type=write size=892930 2023-12-03T11:42:12.470 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.469+0000 7f8723d84780 1 > prepared part key=_multipart_M4VKPN6INFNZ.2~XJ2EEPF189E9.0 size=191720 2023-12-03T11:42:12.470 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.469+0000 7f8723d84780 1 > prepared multipart upload key=M4VKPN6INFNZ upload=XJ2EEPF189E9 tag=C2LA8BR5Y4EB type=write size=1240296 2023-12-03T11:42:12.472 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.471+0000 7f8723d84780 1 < suggested remove operation key=OPQPIDJ2PBVU tag=ILAYVWBOSIHA type=del 2023-12-03T11:42:12.474 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.472+0000 7f8723d84780 1 > prepared operation key=D3JEVEY0E29E tag=G4I73AP66K6J type=del size=2852361 2023-12-03T11:42:12.474 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.473+0000 7f8723d84780 1 < completed write operation key=VENJI0KD1XDW tag=A7UYPZ9A9GDC type=write size=824901 2023-12-03T11:42:12.477 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.476+0000 7f8723d84780 1 > prepared part key=_multipart_LCK58DDM5XU9.2~4I5YWYKYYRAR.0 size=1048576 2023-12-03T11:42:12.478 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.477+0000 7f8723d84780 1 > prepared part key=_multipart_LCK58DDM5XU9.2~4I5YWYKYYRAR.1 size=1048576 2023-12-03T11:42:12.479 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.478+0000 7f8723d84780 1 > prepared part key=_multipart_LCK58DDM5XU9.2~4I5YWYKYYRAR.2 size=373502 2023-12-03T11:42:12.479 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.478+0000 7f8723d84780 1 > prepared multipart upload key=LCK58DDM5XU9 upload=4I5YWYKYYRAR tag=AOCQH2RNFU1S type=write size=3519230 2023-12-03T11:42:12.480 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.479+0000 7f8723d84780 1 < completed delete operation key=HIU6L0NQ8Q95 tag=YLDTOPGQBJJF type=del 2023-12-03T11:42:12.481 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.480+0000 7f8723d84780 1 > prepared operation key=CKABTI1EOAWB tag=1304Y9KX5C4N type=del size=3470335 2023-12-03T11:42:12.483 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.482+0000 7f8723d84780 1 < completed delete operation key=CKABTI1EOAWB tag=T72I3X5P2FKQ type=del 2023-12-03T11:42:12.485 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.484+0000 7f8723d84780 1 > prepared part key=_multipart_LCK58DDM5XU9.2~MH6ZFDMUGV4T.0 size=1048576 2023-12-03T11:42:12.486 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.485+0000 7f8723d84780 1 > prepared part key=_multipart_LCK58DDM5XU9.2~MH6ZFDMUGV4T.1 size=1048576 2023-12-03T11:42:12.487 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.486+0000 7f8723d84780 1 > prepared part key=_multipart_LCK58DDM5XU9.2~MH6ZFDMUGV4T.2 size=398506 2023-12-03T11:42:12.487 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.486+0000 7f8723d84780 1 > prepared multipart upload key=LCK58DDM5XU9 upload=MH6ZFDMUGV4T tag=96UNLV6SLH69 type=write size=3544234 2023-12-03T11:42:12.488 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.487+0000 7f8723d84780 1 < completed part key=_multipart_TSTIBGVYUZZZ.2~C51PMU81QU08.0 size=1048576 2023-12-03T11:42:12.489 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.488+0000 7f8723d84780 1 < completed part key=_multipart_TSTIBGVYUZZZ.2~C51PMU81QU08.1 size=646281 2023-12-03T11:42:12.491 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.490+0000 7f8723d84780 1 < completed multipart upload key=TSTIBGVYUZZZ upload=C51PMU81QU08 tag=FNA3AUBF7NPO type=write size=2743433 2023-12-03T11:42:12.493 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.492+0000 7f8723d84780 1 > prepared operation key=5UYL15O31IHM tag=C75ITM8S085K type=del size=2298460 2023-12-03T11:42:12.495 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.494+0000 7f8723d84780 1 < suggested update operation key=7VMTBKUWU59F tag=ET0SGG6WI1XH type=del size=3341251 2023-12-03T11:42:12.496 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.495+0000 7f8723d84780 1 > prepared operation key=4I8PWBZOLDUG tag=42257AELP7FA type=del size=3590863 2023-12-03T11:42:12.497 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.496+0000 7f8723d84780 1 < completed delete operation key=LCK58DDM5XU9 tag=96XK6OCHPKE8 type=del 2023-12-03T11:42:12.501 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.500+0000 7f8723d84780 1 > prepared part key=_multipart_OGACI7CRPMT7.2~P4U6L62H7QVI.0 size=1048576 2023-12-03T11:42:12.502 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.501+0000 7f8723d84780 1 > prepared part key=_multipart_OGACI7CRPMT7.2~P4U6L62H7QVI.1 size=1048576 2023-12-03T11:42:12.503 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.502+0000 7f8723d84780 1 > prepared part key=_multipart_OGACI7CRPMT7.2~P4U6L62H7QVI.2 size=560992 2023-12-03T11:42:12.503 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.502+0000 7f8723d84780 1 > prepared multipart upload key=OGACI7CRPMT7 upload=P4U6L62H7QVI tag=T9B0B642XNZH type=write size=3706720 2023-12-03T11:42:12.505 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.504+0000 7f8723d84780 1 < suggested update operation key=W2704YS8KYQB tag=KYDWUVREO28L type=del size=2953143 2023-12-03T11:42:12.509 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.508+0000 7f8723d84780 1 > prepared operation key=EITMJKL0LCYC tag=4GAK3X6PSYNZ type=del size=3891804 2023-12-03T11:42:12.511 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.509+0000 7f8723d84780 1 < completed delete operation key=K83BTR5BOLZE tag=12XY18W4IH4L type=del 2023-12-03T11:42:12.513 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.512+0000 7f8723d84780 1 > prepared part key=_multipart_4I8PWBZOLDUG.2~XGYIXG5L6FES.0 size=1048576 2023-12-03T11:42:12.513 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.513+0000 7f8723d84780 1 > prepared part key=_multipart_4I8PWBZOLDUG.2~XGYIXG5L6FES.1 size=862938 2023-12-03T11:42:12.514 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.513+0000 7f8723d84780 1 > prepared multipart upload key=4I8PWBZOLDUG upload=XGYIXG5L6FES tag=K5YZS7LKECWE type=write size=2960090 2023-12-03T11:42:12.516 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.515+0000 7f8723d84780 1 < suggested remove operation key=931GNEXBHH35 tag=N6JX67D7CLJ0 type=del 2023-12-03T11:42:12.517 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.516+0000 7f8723d84780 1 > prepared operation key=96RAVVSUKH0Y tag=VTCR1VM434L0 type=del size=4124682 2023-12-03T11:42:12.518 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.517+0000 7f8723d84780 1 < completed delete operation key=4I8PWBZOLDUG tag=L5785A7CELLC type=del 2023-12-03T11:42:12.520 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.519+0000 7f8723d84780 1 > prepared part key=_multipart_M4VKPN6INFNZ.2~IF8G3G10XWHW.0 size=1048576 2023-12-03T11:42:12.521 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.520+0000 7f8723d84780 1 > prepared part key=_multipart_M4VKPN6INFNZ.2~IF8G3G10XWHW.1 size=687833 2023-12-03T11:42:12.522 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.520+0000 7f8723d84780 1 > prepared multipart upload key=M4VKPN6INFNZ upload=IF8G3G10XWHW tag=ODD147A5YP0L type=write size=2784985 2023-12-03T11:42:12.523 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.522+0000 7f8723d84780 1 < completed delete operation key=O7VVHXLDSY57 tag=0P9RYNPF3KSJ type=del 2023-12-03T11:42:12.524 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.523+0000 7f8723d84780 1 > prepared operation key=J33T5S893LMV tag=EDH69NQQCCLP type=del size=3447883 2023-12-03T11:42:12.525 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.524+0000 7f8723d84780 -1 < failed to complete operation key=W2704YS8KYQB tag=HR4R8IIHC4EN type=del size=3464086: (22) Invalid argument 2023-12-03T11:42:12.527 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.526+0000 7f8723d84780 1 > prepared part key=_multipart_O7VVHXLDSY57.2~CYJGHRAILVRV.0 size=1048576 2023-12-03T11:42:12.528 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.527+0000 7f8723d84780 1 > prepared part key=_multipart_O7VVHXLDSY57.2~CYJGHRAILVRV.1 size=1048576 2023-12-03T11:42:12.529 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.528+0000 7f8723d84780 1 > prepared part key=_multipart_O7VVHXLDSY57.2~CYJGHRAILVRV.2 size=835297 2023-12-03T11:42:12.529 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.528+0000 7f8723d84780 1 > prepared multipart upload key=O7VVHXLDSY57 upload=CYJGHRAILVRV tag=0AL1VKOZYLHJ type=write size=3981025 2023-12-03T11:42:12.532 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.530+0000 7f8723d84780 1 < suggested remove operation key=EY9ZG5KOTBWM tag=IU3ZZREMM3NJ type=del 2023-12-03T11:42:12.534 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.533+0000 7f8723d84780 1 > prepared part key=_multipart_EY9ZG5KOTBWM.2~8JQ1KFZVF88F.0 size=1048576 2023-12-03T11:42:12.535 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.534+0000 7f8723d84780 1 > prepared part key=_multipart_EY9ZG5KOTBWM.2~8JQ1KFZVF88F.1 size=1048576 2023-12-03T11:42:12.535 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.534+0000 7f8723d84780 1 > prepared part key=_multipart_EY9ZG5KOTBWM.2~8JQ1KFZVF88F.2 size=900986 2023-12-03T11:42:12.536 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.534+0000 7f8723d84780 1 > prepared multipart upload key=EY9ZG5KOTBWM upload=8JQ1KFZVF88F tag=63T7TWBDTZZJ type=write size=4046714 2023-12-03T11:42:12.537 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.536+0000 7f8723d84780 1 < completed delete operation key=Y6S7QI60GCLE tag=62J658KHSU7G type=del 2023-12-03T11:42:12.538 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.537+0000 7f8723d84780 1 > prepared operation key=Y6S7QI60GCLE tag=WVATAFAX8W7V type=del size=2249631 2023-12-03T11:42:12.539 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.538+0000 7f8723d84780 1 < completed part key=_multipart_M4VKPN6INFNZ.2~XJ2EEPF189E9.0 size=191720 2023-12-03T11:42:12.541 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.540+0000 7f8723d84780 1 < completed multipart upload key=M4VKPN6INFNZ upload=XJ2EEPF189E9 tag=C2LA8BR5Y4EB type=write size=1240296 2023-12-03T11:42:12.543 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.542+0000 7f8723d84780 1 > prepared part key=_multipart_4I8PWBZOLDUG.2~WQX11LHSM6PE.0 size=1048576 2023-12-03T11:42:12.544 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.543+0000 7f8723d84780 1 > prepared part key=_multipart_4I8PWBZOLDUG.2~WQX11LHSM6PE.1 size=289141 2023-12-03T11:42:12.544 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.543+0000 7f8723d84780 1 > prepared multipart upload key=4I8PWBZOLDUG upload=WQX11LHSM6PE tag=J2WYXTH10FHX type=write size=2386293 2023-12-03T11:42:12.545 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.544+0000 7f8723d84780 1 < completed delete operation key=D3JEVEY0E29E tag=G4I73AP66K6J type=del 2023-12-03T11:42:12.547 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.546+0000 7f8723d84780 1 > prepared part key=_multipart_10JRIKOZ16FY.2~8RMCZHMH9RNA.0 size=1048576 2023-12-03T11:42:12.548 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.547+0000 7f8723d84780 1 > prepared part key=_multipart_10JRIKOZ16FY.2~8RMCZHMH9RNA.1 size=378914 2023-12-03T11:42:12.548 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.547+0000 7f8723d84780 1 > prepared multipart upload key=10JRIKOZ16FY upload=8RMCZHMH9RNA tag=Y9DNOQXP7EMN type=write size=2476066 2023-12-03T11:42:12.550 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.548+0000 7f8723d84780 1 < completed part key=_multipart_LCK58DDM5XU9.2~4I5YWYKYYRAR.0 size=1048576 2023-12-03T11:42:12.551 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.549+0000 7f8723d84780 1 < completed part key=_multipart_LCK58DDM5XU9.2~4I5YWYKYYRAR.1 size=1048576 2023-12-03T11:42:12.551 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.550+0000 7f8723d84780 1 < completed part key=_multipart_LCK58DDM5XU9.2~4I5YWYKYYRAR.2 size=373502 2023-12-03T11:42:12.553 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.552+0000 7f8723d84780 1 < completed multipart upload key=LCK58DDM5XU9 upload=4I5YWYKYYRAR tag=AOCQH2RNFU1S type=write size=3519230 2023-12-03T11:42:12.554 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.553+0000 7f8723d84780 1 > prepared operation key=LCK58DDM5XU9 tag=ULN9066R3QMM type=del size=750 2023-12-03T11:42:12.556 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.554+0000 7f8723d84780 1 < completed delete operation key=CKABTI1EOAWB tag=1304Y9KX5C4N type=del 2023-12-03T11:42:12.556 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.555+0000 7f8723d84780 1 > prepared operation key=12XG7YPYTN4U tag=H6MU1W4UZR95 type=del size=4144751 2023-12-03T11:42:12.558 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.557+0000 7f8723d84780 1 < completed part key=_multipart_LCK58DDM5XU9.2~MH6ZFDMUGV4T.0 size=1048576 2023-12-03T11:42:12.559 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.558+0000 7f8723d84780 1 < completed part key=_multipart_LCK58DDM5XU9.2~MH6ZFDMUGV4T.1 size=1048576 2023-12-03T11:42:12.561 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.559+0000 7f8723d84780 1 < completed part key=_multipart_LCK58DDM5XU9.2~MH6ZFDMUGV4T.2 size=398506 2023-12-03T11:42:12.562 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.561+0000 7f8723d84780 1 < completed multipart upload key=LCK58DDM5XU9 upload=MH6ZFDMUGV4T tag=96UNLV6SLH69 type=write size=3544234 2023-12-03T11:42:12.563 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.562+0000 7f8723d84780 1 > prepared operation key=KS5J7E7KE2IJ tag=UOZL8YYQNM9I type=del size=597584 2023-12-03T11:42:12.564 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.563+0000 7f8723d84780 1 < completed delete operation key=5UYL15O31IHM tag=C75ITM8S085K type=del 2023-12-03T11:42:12.565 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.564+0000 7f8723d84780 1 > prepared operation key=AB0SN0E49Z5F tag=MSGZZ6ZGHE73 type=del size=2752865 2023-12-03T11:42:12.567 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.566+0000 7f8723d84780 1 < completed delete operation key=4I8PWBZOLDUG tag=42257AELP7FA type=del 2023-12-03T11:42:12.568 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.567+0000 7f8723d84780 1 > prepared operation key=12XG7YPYTN4U tag=A28JWBJ06CCF type=del size=351009 2023-12-03T11:42:12.569 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.568+0000 7f8723d84780 1 < completed part key=_multipart_OGACI7CRPMT7.2~P4U6L62H7QVI.0 size=1048576 2023-12-03T11:42:12.570 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.569+0000 7f8723d84780 1 < completed part key=_multipart_OGACI7CRPMT7.2~P4U6L62H7QVI.1 size=1048576 2023-12-03T11:42:12.571 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.570+0000 7f8723d84780 1 < completed part key=_multipart_OGACI7CRPMT7.2~P4U6L62H7QVI.2 size=560992 2023-12-03T11:42:12.573 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.572+0000 7f8723d84780 1 < completed multipart upload key=OGACI7CRPMT7 upload=P4U6L62H7QVI tag=T9B0B642XNZH type=write size=3706720 2023-12-03T11:42:12.574 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.573+0000 7f8723d84780 1 > prepared operation key=7THZZ1J5LOZK tag=ZZSXKO38LF7G type=write size=53106 2023-12-03T11:42:12.575 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.574+0000 7f8723d84780 1 < completed delete operation key=EITMJKL0LCYC tag=4GAK3X6PSYNZ type=del 2023-12-03T11:42:12.577 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.576+0000 7f8723d84780 1 > prepared operation key=W2704YS8KYQB tag=4YXRK50DEM1J type=del size=2172255 2023-12-03T11:42:12.578 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.577+0000 7f8723d84780 1 < completed part key=_multipart_4I8PWBZOLDUG.2~XGYIXG5L6FES.0 size=1048576 2023-12-03T11:42:12.579 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.578+0000 7f8723d84780 1 < completed part key=_multipart_4I8PWBZOLDUG.2~XGYIXG5L6FES.1 size=862938 2023-12-03T11:42:12.581 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.580+0000 7f8723d84780 1 < completed multipart upload key=4I8PWBZOLDUG upload=XGYIXG5L6FES tag=K5YZS7LKECWE type=write size=2960090 2023-12-03T11:42:12.583 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.582+0000 7f8723d84780 1 > prepared part key=_multipart_LMVO6CVEPN3K.2~7LSR04FJQYKY.0 size=1048576 2023-12-03T11:42:12.584 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.583+0000 7f8723d84780 1 > prepared part key=_multipart_LMVO6CVEPN3K.2~7LSR04FJQYKY.1 size=892205 2023-12-03T11:42:12.584 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.583+0000 7f8723d84780 1 > prepared multipart upload key=LMVO6CVEPN3K upload=7LSR04FJQYKY tag=8B2SYX19HCOX type=write size=2989357 2023-12-03T11:42:12.586 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.585+0000 7f8723d84780 1 < suggested remove operation key=96RAVVSUKH0Y tag=VTCR1VM434L0 type=del 2023-12-03T11:42:12.589 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.588+0000 7f8723d84780 1 > prepared part key=_multipart_Y6S7QI60GCLE.2~BZ5L09J93TVP.0 size=996824 2023-12-03T11:42:12.589 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.588+0000 7f8723d84780 1 > prepared multipart upload key=Y6S7QI60GCLE upload=BZ5L09J93TVP tag=FBV18M69ZZ8I type=write size=2045400 2023-12-03T11:42:12.590 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.589+0000 7f8723d84780 1 < completed part key=_multipart_M4VKPN6INFNZ.2~IF8G3G10XWHW.0 size=1048576 2023-12-03T11:42:12.591 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.590+0000 7f8723d84780 1 < completed part key=_multipart_M4VKPN6INFNZ.2~IF8G3G10XWHW.1 size=687833 2023-12-03T11:42:12.593 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.592+0000 7f8723d84780 1 < completed multipart upload key=M4VKPN6INFNZ upload=IF8G3G10XWHW tag=ODD147A5YP0L type=write size=2784985 2023-12-03T11:42:12.594 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.593+0000 7f8723d84780 1 > prepared operation key=O7VVHXLDSY57 tag=DMFJRABH1JH2 type=del size=4015847 2023-12-03T11:42:12.595 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.594+0000 7f8723d84780 1 < completed delete operation key=J33T5S893LMV tag=EDH69NQQCCLP type=del 2023-12-03T11:42:12.597 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.596+0000 7f8723d84780 1 > prepared operation key=10JRIKOZ16FY tag=N80ZX52L007L type=del size=2263859 2023-12-03T11:42:12.598 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.597+0000 7f8723d84780 1 < completed part key=_multipart_O7VVHXLDSY57.2~CYJGHRAILVRV.0 size=1048576 2023-12-03T11:42:12.599 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.598+0000 7f8723d84780 1 < completed part key=_multipart_O7VVHXLDSY57.2~CYJGHRAILVRV.1 size=1048576 2023-12-03T11:42:12.600 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.599+0000 7f8723d84780 1 < completed part key=_multipart_O7VVHXLDSY57.2~CYJGHRAILVRV.2 size=835297 2023-12-03T11:42:12.602 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.601+0000 7f8723d84780 1 < completed multipart upload key=O7VVHXLDSY57 upload=CYJGHRAILVRV tag=0AL1VKOZYLHJ type=write size=3981025 2023-12-03T11:42:12.603 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.602+0000 7f8723d84780 1 > prepared operation key=AB0SN0E49Z5F tag=25DSF6YRU90K type=del size=1729425 2023-12-03T11:42:12.604 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.603+0000 7f8723d84780 1 < completed part key=_multipart_EY9ZG5KOTBWM.2~8JQ1KFZVF88F.0 size=1048576 2023-12-03T11:42:12.606 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.604+0000 7f8723d84780 1 < completed part key=_multipart_EY9ZG5KOTBWM.2~8JQ1KFZVF88F.1 size=1048576 2023-12-03T11:42:12.606 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.605+0000 7f8723d84780 1 < completed part key=_multipart_EY9ZG5KOTBWM.2~8JQ1KFZVF88F.2 size=900986 2023-12-03T11:42:12.608 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.607+0000 7f8723d84780 1 < completed multipart upload key=EY9ZG5KOTBWM upload=8JQ1KFZVF88F tag=63T7TWBDTZZJ type=write size=4046714 2023-12-03T11:42:12.609 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.608+0000 7f8723d84780 1 > prepared operation key=UWS266H06VDK tag=KRAK2YZQ92IA type=write size=196764 2023-12-03T11:42:12.610 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.609+0000 7f8723d84780 1 < completed delete operation key=Y6S7QI60GCLE tag=WVATAFAX8W7V type=del 2023-12-03T11:42:12.614 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.613+0000 7f8723d84780 1 > prepared part key=_multipart_LMVO6CVEPN3K.2~RMKF0R5871K5.0 size=21712 2023-12-03T11:42:12.614 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.613+0000 7f8723d84780 1 > prepared multipart upload key=LMVO6CVEPN3K upload=RMKF0R5871K5 tag=GPPUVAK5STHF type=write size=1070288 2023-12-03T11:42:12.615 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.614+0000 7f8723d84780 1 < completed part key=_multipart_4I8PWBZOLDUG.2~WQX11LHSM6PE.0 size=1048576 2023-12-03T11:42:12.616 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.615+0000 7f8723d84780 1 < completed part key=_multipart_4I8PWBZOLDUG.2~WQX11LHSM6PE.1 size=289141 2023-12-03T11:42:12.618 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.617+0000 7f8723d84780 1 < completed multipart upload key=4I8PWBZOLDUG upload=WQX11LHSM6PE tag=J2WYXTH10FHX type=write size=2386293 2023-12-03T11:42:12.619 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.618+0000 7f8723d84780 1 > prepared operation key=OGACI7CRPMT7 tag=VMZPI0V3BAZR type=del size=1537149 2023-12-03T11:42:12.620 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.619+0000 7f8723d84780 1 < completed part key=_multipart_10JRIKOZ16FY.2~8RMCZHMH9RNA.0 size=1048576 2023-12-03T11:42:12.621 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.620+0000 7f8723d84780 1 < completed part key=_multipart_10JRIKOZ16FY.2~8RMCZHMH9RNA.1 size=378914 2023-12-03T11:42:12.623 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.622+0000 7f8723d84780 1 < completed multipart upload key=10JRIKOZ16FY upload=8RMCZHMH9RNA tag=Y9DNOQXP7EMN type=write size=2476066 2023-12-03T11:42:12.624 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.623+0000 7f8723d84780 1 > prepared operation key=LCK58DDM5XU9 tag=WBJ559TK4QGO type=del size=780325 2023-12-03T11:42:12.625 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.624+0000 7f8723d84780 1 < completed delete operation key=LCK58DDM5XU9 tag=ULN9066R3QMM type=del 2023-12-03T11:42:12.627 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.626+0000 7f8723d84780 1 > prepared operation key=4I8PWBZOLDUG tag=D4LQ2J4NRRY0 type=del size=615 2023-12-03T11:42:12.628 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.627+0000 7f8723d84780 1 < completed delete operation key=12XG7YPYTN4U tag=H6MU1W4UZR95 type=del 2023-12-03T11:42:12.629 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.628+0000 7f8723d84780 1 > prepared operation key=TSTIBGVYUZZZ tag=UEI1OG30525T type=del size=1033810 2023-12-03T11:42:12.630 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.629+0000 7f8723d84780 1 < completed delete operation key=KS5J7E7KE2IJ tag=UOZL8YYQNM9I type=del 2023-12-03T11:42:12.632 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.630+0000 7f8723d84780 1 > prepared operation key=7VMTBKUWU59F tag=V8G8GRDZXMRL type=del size=1948336 2023-12-03T11:42:12.633 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.632+0000 7f8723d84780 1 < completed delete operation key=AB0SN0E49Z5F tag=MSGZZ6ZGHE73 type=del 2023-12-03T11:42:12.638 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.634+0000 7f8723d84780 1 > prepared part key=_multipart_O7VVHXLDSY57.2~SUU3MDXF1732.0 size=1048576 2023-12-03T11:42:12.639 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.635+0000 7f8723d84780 1 > prepared part key=_multipart_O7VVHXLDSY57.2~SUU3MDXF1732.1 size=1048576 2023-12-03T11:42:12.639 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.636+0000 7f8723d84780 1 > prepared part key=_multipart_O7VVHXLDSY57.2~SUU3MDXF1732.2 size=784548 2023-12-03T11:42:12.639 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.636+0000 7f8723d84780 1 > prepared multipart upload key=O7VVHXLDSY57 upload=SUU3MDXF1732 tag=N4GV8KVI1EB7 type=write size=3930276 2023-12-03T11:42:12.639 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.638+0000 7f8723d84780 1 < suggested remove operation key=12XG7YPYTN4U tag=A28JWBJ06CCF type=del 2023-12-03T11:42:12.642 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.639+0000 7f8723d84780 1 > prepared operation key=HIU6L0NQ8Q95 tag=A74IVC7BOJJN type=write size=165871 2023-12-03T11:42:12.642 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.640+0000 7f8723d84780 1 < completed write operation key=7THZZ1J5LOZK tag=ZZSXKO38LF7G type=write size=53106 2023-12-03T11:42:12.644 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.642+0000 7f8723d84780 1 > prepared part key=_multipart_VENJI0KD1XDW.2~RANU1E7A69SR.0 size=470642 2023-12-03T11:42:12.644 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.642+0000 7f8723d84780 1 > prepared multipart upload key=VENJI0KD1XDW upload=RANU1E7A69SR tag=N1QPQEDP2K9Z type=write size=1519218 2023-12-03T11:42:12.644 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.643+0000 7f8723d84780 1 < completed delete operation key=W2704YS8KYQB tag=4YXRK50DEM1J type=del 2023-12-03T11:42:12.647 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.646+0000 7f8723d84780 1 > prepared part key=_multipart_OGACI7CRPMT7.2~ZD7YCYSOUXE5.0 size=1048576 2023-12-03T11:42:12.648 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.647+0000 7f8723d84780 1 > prepared part key=_multipart_OGACI7CRPMT7.2~ZD7YCYSOUXE5.1 size=818516 2023-12-03T11:42:12.648 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.647+0000 7f8723d84780 1 > prepared multipart upload key=OGACI7CRPMT7 upload=ZD7YCYSOUXE5 tag=1A6520U3UJN0 type=write size=2915668 2023-12-03T11:42:12.649 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.648+0000 7f8723d84780 1 < completed part key=_multipart_LMVO6CVEPN3K.2~7LSR04FJQYKY.0 size=1048576 2023-12-03T11:42:12.650 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.649+0000 7f8723d84780 1 < completed part key=_multipart_LMVO6CVEPN3K.2~7LSR04FJQYKY.1 size=892205 2023-12-03T11:42:12.652 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.651+0000 7f8723d84780 1 < completed multipart upload key=LMVO6CVEPN3K upload=7LSR04FJQYKY tag=8B2SYX19HCOX type=write size=2989357 2023-12-03T11:42:12.655 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.653+0000 7f8723d84780 1 > prepared part key=_multipart_8NONX2I08YMJ.2~976XLYXMDFX1.0 size=53228 2023-12-03T11:42:12.655 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.653+0000 7f8723d84780 1 > prepared multipart upload key=8NONX2I08YMJ upload=976XLYXMDFX1 tag=A32765UB82OO type=write size=1101804 2023-12-03T11:42:12.655 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.654+0000 7f8723d84780 1 < completed part key=_multipart_Y6S7QI60GCLE.2~BZ5L09J93TVP.0 size=996824 2023-12-03T11:42:12.657 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.656+0000 7f8723d84780 1 < completed multipart upload key=Y6S7QI60GCLE upload=BZ5L09J93TVP tag=FBV18M69ZZ8I type=write size=2045400 2023-12-03T11:42:12.659 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.657+0000 7f8723d84780 1 > prepared operation key=LMVO6CVEPN3K tag=1K2LK7N1W0H0 type=del size=3358748 2023-12-03T11:42:12.660 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.659+0000 7f8723d84780 1 < completed delete operation key=O7VVHXLDSY57 tag=DMFJRABH1JH2 type=del 2023-12-03T11:42:12.662 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.661+0000 7f8723d84780 1 > prepared part key=_multipart_DMQX2DGDLU7D.2~UV0TIM5F0D6Q.0 size=1048576 2023-12-03T11:42:12.663 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.662+0000 7f8723d84780 1 > prepared part key=_multipart_DMQX2DGDLU7D.2~UV0TIM5F0D6Q.1 size=59399 2023-12-03T11:42:12.663 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.662+0000 7f8723d84780 1 > prepared multipart upload key=DMQX2DGDLU7D upload=UV0TIM5F0D6Q tag=V6I95J1KGSSG type=write size=2156551 2023-12-03T11:42:12.664 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.663+0000 7f8723d84780 1 < completed delete operation key=10JRIKOZ16FY tag=N80ZX52L007L type=del 2023-12-03T11:42:12.665 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.664+0000 7f8723d84780 1 > prepared operation key=5UYL15O31IHM tag=PLI7VD5MYTK7 type=del size=3321905 2023-12-03T11:42:12.668 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.667+0000 7f8723d84780 1 < suggested remove operation key=AB0SN0E49Z5F tag=25DSF6YRU90K type=del 2023-12-03T11:42:12.669 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.668+0000 7f8723d84780 1 > prepared operation key=VENJI0KD1XDW tag=BCQ06MAKY5Z4 type=write size=566633 2023-12-03T11:42:12.674 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.671+0000 7f8723d84780 1 < suggested update operation key=UWS266H06VDK tag=KRAK2YZQ92IA type=write size=196764 2023-12-03T11:42:12.674 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.672+0000 7f8723d84780 1 > prepared operation key=10JRIKOZ16FY tag=0BTOKZC074RY type=del size=2010526 2023-12-03T11:42:12.675 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.674+0000 7f8723d84780 1 < completed part key=_multipart_LMVO6CVEPN3K.2~RMKF0R5871K5.0 size=21712 2023-12-03T11:42:12.679 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.676+0000 7f8723d84780 1 < completed multipart upload key=LMVO6CVEPN3K upload=RMKF0R5871K5 tag=GPPUVAK5STHF type=write size=1070288 2023-12-03T11:42:12.680 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.679+0000 7f8723d84780 1 > prepared part key=_multipart_931GNEXBHH35.2~CVJ0VM40VIGQ.0 size=1048576 2023-12-03T11:42:12.681 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.680+0000 7f8723d84780 1 > prepared part key=_multipart_931GNEXBHH35.2~CVJ0VM40VIGQ.1 size=291498 2023-12-03T11:42:12.681 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.680+0000 7f8723d84780 1 > prepared multipart upload key=931GNEXBHH35 upload=CVJ0VM40VIGQ tag=OMUHTGZSI6SN type=write size=2388650 2023-12-03T11:42:12.682 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.681+0000 7f8723d84780 1 < completed delete operation key=OGACI7CRPMT7 tag=VMZPI0V3BAZR type=del 2023-12-03T11:42:12.684 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.683+0000 7f8723d84780 1 > prepared operation key=96RAVVSUKH0Y tag=50JE695FZ3W1 type=del size=423861 2023-12-03T11:42:12.686 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.685+0000 7f8723d84780 1 < suggested update operation key=LCK58DDM5XU9 tag=WBJ559TK4QGO type=del size=780325 2023-12-03T11:42:12.689 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.688+0000 7f8723d84780 1 > prepared part key=_multipart_931GNEXBHH35.2~9EV30QMIIIDI.0 size=1048576 2023-12-03T11:42:12.690 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.689+0000 7f8723d84780 1 > prepared part key=_multipart_931GNEXBHH35.2~9EV30QMIIIDI.1 size=1048576 2023-12-03T11:42:12.691 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.690+0000 7f8723d84780 1 > prepared part key=_multipart_931GNEXBHH35.2~9EV30QMIIIDI.2 size=43926 2023-12-03T11:42:12.691 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.690+0000 7f8723d84780 1 > prepared multipart upload key=931GNEXBHH35 upload=9EV30QMIIIDI tag=ALAP7I4CV05B type=write size=3189654 2023-12-03T11:42:12.692 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.692+0000 7f8723d84780 1 < completed delete operation key=4I8PWBZOLDUG tag=D4LQ2J4NRRY0 type=del 2023-12-03T11:42:12.694 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.693+0000 7f8723d84780 1 > prepared operation key=5UYL15O31IHM tag=PSYEF6BVKV2D type=del size=1014149 2023-12-03T11:42:12.696 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.694+0000 7f8723d84780 1 < completed delete operation key=TSTIBGVYUZZZ tag=UEI1OG30525T type=del 2023-12-03T11:42:12.697 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.696+0000 7f8723d84780 1 > prepared operation key=OPQPIDJ2PBVU tag=5BF415GJD1E2 type=write size=893851 2023-12-03T11:42:12.699 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.698+0000 7f8723d84780 1 < completed delete operation key=7VMTBKUWU59F tag=V8G8GRDZXMRL type=del 2023-12-03T11:42:12.701 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.700+0000 7f8723d84780 1 > prepared part key=_multipart_J33T5S893LMV.2~F4SFHUBIO9HT.0 size=536854 2023-12-03T11:42:12.701 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.700+0000 7f8723d84780 1 > prepared multipart upload key=J33T5S893LMV upload=F4SFHUBIO9HT tag=9YB7V73VBH63 type=write size=1585430 2023-12-03T11:42:12.703 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.702+0000 7f8723d84780 1 < completed part key=_multipart_O7VVHXLDSY57.2~SUU3MDXF1732.0 size=1048576 2023-12-03T11:42:12.704 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.703+0000 7f8723d84780 1 < completed part key=_multipart_O7VVHXLDSY57.2~SUU3MDXF1732.1 size=1048576 2023-12-03T11:42:12.705 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.704+0000 7f8723d84780 1 < completed part key=_multipart_O7VVHXLDSY57.2~SUU3MDXF1732.2 size=784548 2023-12-03T11:42:12.707 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.706+0000 7f8723d84780 1 < completed multipart upload key=O7VVHXLDSY57 upload=SUU3MDXF1732 tag=N4GV8KVI1EB7 type=write size=3930276 2023-12-03T11:42:12.708 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.707+0000 7f8723d84780 1 > prepared operation key=7VMTBKUWU59F tag=M3D2PUQFMS5N type=del size=930986 2023-12-03T11:42:12.711 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.710+0000 7f8723d84780 1 < suggested remove operation key=HIU6L0NQ8Q95 tag=A74IVC7BOJJN type=write 2023-12-03T11:42:12.713 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.712+0000 7f8723d84780 1 > prepared part key=_multipart_M4VKPN6INFNZ.2~QJEJDP8RPQR9.0 size=414447 2023-12-03T11:42:12.713 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.712+0000 7f8723d84780 1 > prepared multipart upload key=M4VKPN6INFNZ upload=QJEJDP8RPQR9 tag=23BUBM6LSKPH type=write size=1463023 2023-12-03T11:42:12.713 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.712+0000 7f8723d84780 1 < canceled part key=_multipart_VENJI0KD1XDW.2~RANU1E7A69SR.0 size=470642 2023-12-03T11:42:12.715 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.714+0000 7f8723d84780 1 < canceled multipart upload key=VENJI0KD1XDW upload=RANU1E7A69SR tag=N1QPQEDP2K9Z type=write size=1519218 2023-12-03T11:42:12.718 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.715+0000 7f8723d84780 1 > prepared operation key=EY9ZG5KOTBWM tag=H6UISVI1B57U type=write size=829948 2023-12-03T11:42:12.718 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.716+0000 7f8723d84780 1 < completed part key=_multipart_OGACI7CRPMT7.2~ZD7YCYSOUXE5.0 size=1048576 2023-12-03T11:42:12.718 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.717+0000 7f8723d84780 1 < completed part key=_multipart_OGACI7CRPMT7.2~ZD7YCYSOUXE5.1 size=818516 2023-12-03T11:42:12.720 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.719+0000 7f8723d84780 1 < completed multipart upload key=OGACI7CRPMT7 upload=ZD7YCYSOUXE5 tag=1A6520U3UJN0 type=write size=2915668 2023-12-03T11:42:12.721 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.720+0000 7f8723d84780 1 > prepared operation key=10JRIKOZ16FY tag=NNAW1GOIOD1N type=write size=66760 2023-12-03T11:42:12.723 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.722+0000 7f8723d84780 1 < completed part key=_multipart_8NONX2I08YMJ.2~976XLYXMDFX1.0 size=53228 2023-12-03T11:42:12.725 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.724+0000 7f8723d84780 1 < completed multipart upload key=8NONX2I08YMJ upload=976XLYXMDFX1 tag=A32765UB82OO type=write size=1101804 2023-12-03T11:42:12.726 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.725+0000 7f8723d84780 1 > prepared operation key=LMVO6CVEPN3K tag=M5H7OIESNXLY type=del size=1670452 2023-12-03T11:42:12.727 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.726+0000 7f8723d84780 1 < completed delete operation key=LMVO6CVEPN3K tag=1K2LK7N1W0H0 type=del 2023-12-03T11:42:12.728 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.727+0000 7f8723d84780 1 > prepared operation key=M4VKPN6INFNZ tag=9QR5Z7AYL7LI type=del size=2067410 2023-12-03T11:42:12.730 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.730+0000 7f8723d84780 1 < completed part key=_multipart_DMQX2DGDLU7D.2~UV0TIM5F0D6Q.0 size=1048576 2023-12-03T11:42:12.731 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.730+0000 7f8723d84780 1 < completed part key=_multipart_DMQX2DGDLU7D.2~UV0TIM5F0D6Q.1 size=59399 2023-12-03T11:42:12.733 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.732+0000 7f8723d84780 1 < completed multipart upload key=DMQX2DGDLU7D upload=UV0TIM5F0D6Q tag=V6I95J1KGSSG type=write size=2156551 2023-12-03T11:42:12.737 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.733+0000 7f8723d84780 1 > prepared operation key=M4VKPN6INFNZ tag=SUZLIRCPFAQP type=del size=3965861 2023-12-03T11:42:12.737 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.735+0000 7f8723d84780 1 < completed delete operation key=5UYL15O31IHM tag=PLI7VD5MYTK7 type=del 2023-12-03T11:42:12.738 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.737+0000 7f8723d84780 1 > prepared part key=_multipart_931GNEXBHH35.2~M15WKR31OYX2.0 size=1044068 2023-12-03T11:42:12.738 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.737+0000 7f8723d84780 1 > prepared multipart upload key=931GNEXBHH35 upload=M15WKR31OYX2 tag=IYMZ4DV2PMSU type=write size=2092644 2023-12-03T11:42:12.739 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.738+0000 7f8723d84780 1 < canceled operation key=VENJI0KD1XDW tag=BCQ06MAKY5Z4 type=write size=566633 2023-12-03T11:42:12.741 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.740+0000 7f8723d84780 1 > prepared part key=_multipart_OGACI7CRPMT7.2~00QX7U19M8WI.0 size=1048576 2023-12-03T11:42:12.742 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.741+0000 7f8723d84780 1 > prepared part key=_multipart_OGACI7CRPMT7.2~00QX7U19M8WI.1 size=550075 2023-12-03T11:42:12.742 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.741+0000 7f8723d84780 1 > prepared multipart upload key=OGACI7CRPMT7 upload=00QX7U19M8WI tag=6TS81WWWN82B type=write size=2647227 2023-12-03T11:42:12.743 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.742+0000 7f8723d84780 1 < completed delete operation key=10JRIKOZ16FY tag=0BTOKZC074RY type=del 2023-12-03T11:42:12.745 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.744+0000 7f8723d84780 1 > prepared part key=_multipart_OPQPIDJ2PBVU.2~B043IIHDJBRZ.0 size=1048576 2023-12-03T11:42:12.746 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.745+0000 7f8723d84780 1 > prepared part key=_multipart_OPQPIDJ2PBVU.2~B043IIHDJBRZ.1 size=792692 2023-12-03T11:42:12.746 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.745+0000 7f8723d84780 1 > prepared multipart upload key=OPQPIDJ2PBVU upload=B043IIHDJBRZ tag=Y735LY4GVP9D type=write size=2889844 2023-12-03T11:42:12.747 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.746+0000 7f8723d84780 1 < completed part key=_multipart_931GNEXBHH35.2~CVJ0VM40VIGQ.0 size=1048576 2023-12-03T11:42:12.748 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.747+0000 7f8723d84780 1 < completed part key=_multipart_931GNEXBHH35.2~CVJ0VM40VIGQ.1 size=291498 2023-12-03T11:42:12.750 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.749+0000 7f8723d84780 1 < completed multipart upload key=931GNEXBHH35 upload=CVJ0VM40VIGQ tag=OMUHTGZSI6SN type=write size=2388650 2023-12-03T11:42:12.752 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.751+0000 7f8723d84780 1 > prepared part key=_multipart_G36T76K8O7A1.2~N194TBLRGZTB.0 size=1048576 2023-12-03T11:42:12.753 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.752+0000 7f8723d84780 1 > prepared part key=_multipart_G36T76K8O7A1.2~N194TBLRGZTB.1 size=1048576 2023-12-03T11:42:12.754 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.753+0000 7f8723d84780 1 > prepared part key=_multipart_G36T76K8O7A1.2~N194TBLRGZTB.2 size=464749 2023-12-03T11:42:12.754 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.753+0000 7f8723d84780 1 > prepared multipart upload key=G36T76K8O7A1 upload=N194TBLRGZTB tag=MD8970H67PZ9 type=write size=3610477 2023-12-03T11:42:12.756 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.755+0000 7f8723d84780 1 < suggested remove operation key=96RAVVSUKH0Y tag=50JE695FZ3W1 type=del 2023-12-03T11:42:12.757 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.757+0000 7f8723d84780 1 > prepared operation key=J33T5S893LMV tag=RVHD0I9392NE type=del size=956155 2023-12-03T11:42:12.759 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.758+0000 7f8723d84780 1 < completed part key=_multipart_931GNEXBHH35.2~9EV30QMIIIDI.0 size=1048576 2023-12-03T11:42:12.760 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.759+0000 7f8723d84780 1 < completed part key=_multipart_931GNEXBHH35.2~9EV30QMIIIDI.1 size=1048576 2023-12-03T11:42:12.761 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.760+0000 7f8723d84780 1 < completed part key=_multipart_931GNEXBHH35.2~9EV30QMIIIDI.2 size=43926 2023-12-03T11:42:12.763 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.762+0000 7f8723d84780 1 < completed multipart upload key=931GNEXBHH35 upload=9EV30QMIIIDI tag=ALAP7I4CV05B type=write size=3189654 2023-12-03T11:42:12.765 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.764+0000 7f8723d84780 1 > prepared part key=_multipart_KS5J7E7KE2IJ.2~BWK7YQLWN1ZO.0 size=1048576 2023-12-03T11:42:12.766 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.765+0000 7f8723d84780 1 > prepared part key=_multipart_KS5J7E7KE2IJ.2~BWK7YQLWN1ZO.1 size=524760 2023-12-03T11:42:12.766 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.765+0000 7f8723d84780 1 > prepared multipart upload key=KS5J7E7KE2IJ upload=BWK7YQLWN1ZO tag=R5F8WG4OVB0A type=write size=2621912 2023-12-03T11:42:12.769 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.766+0000 7f8723d84780 1 < completed delete operation key=5UYL15O31IHM tag=PSYEF6BVKV2D type=del 2023-12-03T11:42:12.769 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.768+0000 7f8723d84780 1 > prepared part key=_multipart_KS5J7E7KE2IJ.2~2VJ0EGJ63RPX.0 size=1048576 2023-12-03T11:42:12.770 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.769+0000 7f8723d84780 1 > prepared part key=_multipart_KS5J7E7KE2IJ.2~2VJ0EGJ63RPX.1 size=1048576 2023-12-03T11:42:12.771 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.770+0000 7f8723d84780 1 > prepared part key=_multipart_KS5J7E7KE2IJ.2~2VJ0EGJ63RPX.2 size=55287 2023-12-03T11:42:12.771 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.770+0000 7f8723d84780 1 > prepared multipart upload key=KS5J7E7KE2IJ upload=2VJ0EGJ63RPX tag=LYCQ2F9QP0W6 type=write size=3201015 2023-12-03T11:42:12.772 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.771+0000 7f8723d84780 1 < completed write operation key=OPQPIDJ2PBVU tag=5BF415GJD1E2 type=write size=893851 2023-12-03T11:42:12.773 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.772+0000 7f8723d84780 1 > prepared operation key=DMQX2DGDLU7D tag=YW7OF5GOIQ87 type=del size=101880 2023-12-03T11:42:12.775 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.774+0000 7f8723d84780 1 < completed part key=_multipart_J33T5S893LMV.2~F4SFHUBIO9HT.0 size=536854 2023-12-03T11:42:12.777 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.776+0000 7f8723d84780 1 < completed multipart upload key=J33T5S893LMV upload=F4SFHUBIO9HT tag=9YB7V73VBH63 type=write size=1585430 2023-12-03T11:42:12.778 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.777+0000 7f8723d84780 1 > prepared operation key=K83BTR5BOLZE tag=O21CS6YJQ2AP type=del size=2323190 2023-12-03T11:42:12.779 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.778+0000 7f8723d84780 1 < canceled operation key=7VMTBKUWU59F tag=M3D2PUQFMS5N type=del size=930986 2023-12-03T11:42:12.781 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.780+0000 7f8723d84780 1 > prepared operation key=G36T76K8O7A1 tag=OB77S7KH48EC type=del size=1956674 2023-12-03T11:42:12.782 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.781+0000 7f8723d84780 1 < completed part key=_multipart_M4VKPN6INFNZ.2~QJEJDP8RPQR9.0 size=414447 2023-12-03T11:42:12.784 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.783+0000 7f8723d84780 1 < completed multipart upload key=M4VKPN6INFNZ upload=QJEJDP8RPQR9 tag=23BUBM6LSKPH type=write size=1463023 2023-12-03T11:42:12.785 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.784+0000 7f8723d84780 1 > prepared operation key=Y6S7QI60GCLE tag=ZOA5AP6HWPC8 type=del size=2099374 2023-12-03T11:42:12.786 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.785+0000 7f8723d84780 1 < completed write operation key=EY9ZG5KOTBWM tag=H6UISVI1B57U type=write size=829948 2023-12-03T11:42:12.788 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.787+0000 7f8723d84780 1 > prepared operation key=G36T76K8O7A1 tag=7I60HQ0SFJZ0 type=del size=749582 2023-12-03T11:42:12.789 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.788+0000 7f8723d84780 1 < completed write operation key=10JRIKOZ16FY tag=NNAW1GOIOD1N type=write size=66760 2023-12-03T11:42:12.798 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.796+0000 7f8723d84780 1 > prepared part key=_multipart_OGACI7CRPMT7.2~5FYJTAVW8L8D.0 size=1048576 2023-12-03T11:42:12.798 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.797+0000 7f8723d84780 1 > prepared part key=_multipart_OGACI7CRPMT7.2~5FYJTAVW8L8D.1 size=81427 2023-12-03T11:42:12.799 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.797+0000 7f8723d84780 1 > prepared multipart upload key=OGACI7CRPMT7 upload=5FYJTAVW8L8D tag=3N27SUZ0C3SZ type=write size=2178579 2023-12-03T11:42:12.800 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.799+0000 7f8723d84780 1 < completed delete operation key=LMVO6CVEPN3K tag=M5H7OIESNXLY type=del 2023-12-03T11:42:12.802 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.801+0000 7f8723d84780 1 > prepared part key=_multipart_OPQPIDJ2PBVU.2~M1AE5MM3K4MW.0 size=1048576 2023-12-03T11:42:12.803 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.802+0000 7f8723d84780 1 > prepared part key=_multipart_OPQPIDJ2PBVU.2~M1AE5MM3K4MW.1 size=1048576 2023-12-03T11:42:12.804 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.803+0000 7f8723d84780 1 > prepared part key=_multipart_OPQPIDJ2PBVU.2~M1AE5MM3K4MW.2 size=81919 2023-12-03T11:42:12.804 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.803+0000 7f8723d84780 1 > prepared multipart upload key=OPQPIDJ2PBVU upload=M1AE5MM3K4MW tag=CH3MARJEKAQ3 type=write size=3227647 2023-12-03T11:42:12.807 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.806+0000 7f8723d84780 1 < suggested remove operation key=M4VKPN6INFNZ tag=9QR5Z7AYL7LI type=del 2023-12-03T11:42:12.808 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.807+0000 7f8723d84780 1 > prepared operation key=CKABTI1EOAWB tag=75J5TQXNTV7P type=del size=3227371 2023-12-03T11:42:12.808 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.807+0000 7f8723d84780 -1 < no bi entry to suggest for operation key=M4VKPN6INFNZ tag=SUZLIRCPFAQP type=del size=3965861: (2) No such file or directory 2023-12-03T11:42:12.810 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.809+0000 7f8723d84780 1 > prepared operation key=HIU6L0NQ8Q95 tag=8L1NGHAM6SWM type=write size=6115 2023-12-03T11:42:12.811 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.810+0000 7f8723d84780 1 < completed part key=_multipart_931GNEXBHH35.2~M15WKR31OYX2.0 size=1044068 2023-12-03T11:42:12.813 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.812+0000 7f8723d84780 1 < completed multipart upload key=931GNEXBHH35 upload=M15WKR31OYX2 tag=IYMZ4DV2PMSU type=write size=2092644 2023-12-03T11:42:12.815 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.814+0000 7f8723d84780 1 > prepared part key=_multipart_UWS266H06VDK.2~BQ3CK323ENAS.0 size=1048576 2023-12-03T11:42:12.816 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.815+0000 7f8723d84780 1 > prepared part key=_multipart_UWS266H06VDK.2~BQ3CK323ENAS.1 size=1048576 2023-12-03T11:42:12.817 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.816+0000 7f8723d84780 1 > prepared part key=_multipart_UWS266H06VDK.2~BQ3CK323ENAS.2 size=420522 2023-12-03T11:42:12.817 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.816+0000 7f8723d84780 1 > prepared multipart upload key=UWS266H06VDK upload=BQ3CK323ENAS tag=3BXAOCSPLFTB type=write size=3566250 2023-12-03T11:42:12.818 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.817+0000 7f8723d84780 1 < completed part key=_multipart_OGACI7CRPMT7.2~00QX7U19M8WI.0 size=1048576 2023-12-03T11:42:12.819 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.818+0000 7f8723d84780 1 < completed part key=_multipart_OGACI7CRPMT7.2~00QX7U19M8WI.1 size=550075 2023-12-03T11:42:12.821 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.820+0000 7f8723d84780 1 < completed multipart upload key=OGACI7CRPMT7 upload=00QX7U19M8WI tag=6TS81WWWN82B type=write size=2647227 2023-12-03T11:42:12.823 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.822+0000 7f8723d84780 1 > prepared operation key=G36T76K8O7A1 tag=ZUA6SGB7F5SU type=write size=313958 2023-12-03T11:42:12.824 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.823+0000 7f8723d84780 1 < completed part key=_multipart_OPQPIDJ2PBVU.2~B043IIHDJBRZ.0 size=1048576 2023-12-03T11:42:12.824 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.823+0000 7f8723d84780 1 < canceled part key=_multipart_OPQPIDJ2PBVU.2~B043IIHDJBRZ.1 size=792692 2023-12-03T11:42:12.826 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.825+0000 7f8723d84780 1 < canceled multipart upload key=OPQPIDJ2PBVU upload=B043IIHDJBRZ tag=Y735LY4GVP9D type=write size=2889844 2023-12-03T11:42:12.828 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.827+0000 7f8723d84780 1 > prepared part key=_multipart_931GNEXBHH35.2~TAZZ3KVX16PG.0 size=1048576 2023-12-03T11:42:12.829 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.828+0000 7f8723d84780 1 > prepared part key=_multipart_931GNEXBHH35.2~TAZZ3KVX16PG.1 size=1048576 2023-12-03T11:42:12.830 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.829+0000 7f8723d84780 1 > prepared part key=_multipart_931GNEXBHH35.2~TAZZ3KVX16PG.2 size=232836 2023-12-03T11:42:12.830 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.829+0000 7f8723d84780 1 > prepared multipart upload key=931GNEXBHH35 upload=TAZZ3KVX16PG tag=A3LDUYRPNZA0 type=write size=3378564 2023-12-03T11:42:12.832 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.830+0000 7f8723d84780 1 < completed part key=_multipart_G36T76K8O7A1.2~N194TBLRGZTB.0 size=1048576 2023-12-03T11:42:12.832 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.831+0000 7f8723d84780 1 < completed part key=_multipart_G36T76K8O7A1.2~N194TBLRGZTB.1 size=1048576 2023-12-03T11:42:12.833 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.832+0000 7f8723d84780 1 < completed part key=_multipart_G36T76K8O7A1.2~N194TBLRGZTB.2 size=464749 2023-12-03T11:42:12.836 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.834+0000 7f8723d84780 1 < completed multipart upload key=G36T76K8O7A1 upload=N194TBLRGZTB tag=MD8970H67PZ9 type=write size=3610477 2023-12-03T11:42:12.838 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.837+0000 7f8723d84780 1 > prepared part key=_multipart_7VMTBKUWU59F.2~8BWLU3R6CYD2.0 size=1048576 2023-12-03T11:42:12.839 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.838+0000 7f8723d84780 1 > prepared part key=_multipart_7VMTBKUWU59F.2~8BWLU3R6CYD2.1 size=1048576 2023-12-03T11:42:12.840 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.839+0000 7f8723d84780 1 > prepared part key=_multipart_7VMTBKUWU59F.2~8BWLU3R6CYD2.2 size=962007 2023-12-03T11:42:12.840 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.839+0000 7f8723d84780 1 > prepared multipart upload key=7VMTBKUWU59F upload=8BWLU3R6CYD2 tag=PK3XSPZA4FMO type=write size=4107735 2023-12-03T11:42:12.841 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.840+0000 7f8723d84780 1 < completed delete operation key=J33T5S893LMV tag=RVHD0I9392NE type=del 2023-12-03T11:42:12.842 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.841+0000 7f8723d84780 1 > prepared operation key=TSTIBGVYUZZZ tag=RLRUX396FJRR type=del size=1359475 2023-12-03T11:42:12.843 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.842+0000 7f8723d84780 1 < completed part key=_multipart_KS5J7E7KE2IJ.2~BWK7YQLWN1ZO.0 size=1048576 2023-12-03T11:42:12.844 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.843+0000 7f8723d84780 1 < completed part key=_multipart_KS5J7E7KE2IJ.2~BWK7YQLWN1ZO.1 size=524760 2023-12-03T11:42:12.848 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.847+0000 7f8723d84780 1 < completed multipart upload key=KS5J7E7KE2IJ upload=BWK7YQLWN1ZO tag=R5F8WG4OVB0A type=write size=2621912 2023-12-03T11:42:12.850 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.849+0000 7f8723d84780 1 > prepared part key=_multipart_G36T76K8O7A1.2~PMHDM4UU7X43.0 size=1048576 2023-12-03T11:42:12.851 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.850+0000 7f8723d84780 1 > prepared part key=_multipart_G36T76K8O7A1.2~PMHDM4UU7X43.1 size=1048576 2023-12-03T11:42:12.852 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.851+0000 7f8723d84780 1 > prepared part key=_multipart_G36T76K8O7A1.2~PMHDM4UU7X43.2 size=915823 2023-12-03T11:42:12.852 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.851+0000 7f8723d84780 1 > prepared multipart upload key=G36T76K8O7A1 upload=PMHDM4UU7X43 tag=L23YBWYJSKKJ type=write size=4061551 2023-12-03T11:42:12.853 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.852+0000 7f8723d84780 1 < completed part key=_multipart_KS5J7E7KE2IJ.2~2VJ0EGJ63RPX.0 size=1048576 2023-12-03T11:42:12.854 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.853+0000 7f8723d84780 1 < completed part key=_multipart_KS5J7E7KE2IJ.2~2VJ0EGJ63RPX.1 size=1048576 2023-12-03T11:42:12.855 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.854+0000 7f8723d84780 1 < completed part key=_multipart_KS5J7E7KE2IJ.2~2VJ0EGJ63RPX.2 size=55287 2023-12-03T11:42:12.857 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.856+0000 7f8723d84780 1 < completed multipart upload key=KS5J7E7KE2IJ upload=2VJ0EGJ63RPX tag=LYCQ2F9QP0W6 type=write size=3201015 2023-12-03T11:42:12.858 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.857+0000 7f8723d84780 1 > prepared operation key=Y6S7QI60GCLE tag=LLV6LVHEMROB type=del size=1459679 2023-12-03T11:42:12.859 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.858+0000 7f8723d84780 1 < completed delete operation key=DMQX2DGDLU7D tag=YW7OF5GOIQ87 type=del 2023-12-03T11:42:12.860 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.859+0000 7f8723d84780 1 > prepared operation key=LCK58DDM5XU9 tag=951I918MH7HQ type=del size=4153961 2023-12-03T11:42:12.862 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.861+0000 7f8723d84780 1 < completed delete operation key=K83BTR5BOLZE tag=O21CS6YJQ2AP type=del 2023-12-03T11:42:12.863 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.862+0000 7f8723d84780 1 > prepared operation key=J33T5S893LMV tag=OO2OA0V52EUY type=del size=1840691 2023-12-03T11:42:12.864 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.863+0000 7f8723d84780 1 < completed delete operation key=G36T76K8O7A1 tag=OB77S7KH48EC type=del 2023-12-03T11:42:12.865 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.864+0000 7f8723d84780 1 > prepared operation key=EITMJKL0LCYC tag=TJJUS70U3P5U type=del size=1746385 2023-12-03T11:42:12.868 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.867+0000 7f8723d84780 1 < suggested remove operation key=Y6S7QI60GCLE tag=ZOA5AP6HWPC8 type=del 2023-12-03T11:42:12.870 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.869+0000 7f8723d84780 1 > prepared part key=_multipart_K83BTR5BOLZE.2~E4M29R4RJRDL.0 size=1048576 2023-12-03T11:42:12.871 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.870+0000 7f8723d84780 1 > prepared part key=_multipart_K83BTR5BOLZE.2~E4M29R4RJRDL.1 size=118775 2023-12-03T11:42:12.871 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.870+0000 7f8723d84780 1 > prepared multipart upload key=K83BTR5BOLZE upload=E4M29R4RJRDL tag=O1H0FV8MOY7I type=write size=2215927 2023-12-03T11:42:12.872 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.871+0000 7f8723d84780 1 < canceled operation key=G36T76K8O7A1 tag=7I60HQ0SFJZ0 type=del size=749582 2023-12-03T11:42:12.874 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.873+0000 7f8723d84780 1 > prepared part key=_multipart_CKABTI1EOAWB.2~EE3PHNUJGYP0.0 size=470135 2023-12-03T11:42:12.874 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.873+0000 7f8723d84780 1 > prepared multipart upload key=CKABTI1EOAWB upload=EE3PHNUJGYP0 tag=A7O4T5JFQLGQ type=write size=1518711 2023-12-03T11:42:12.876 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.875+0000 7f8723d84780 1 < completed part key=_multipart_OGACI7CRPMT7.2~5FYJTAVW8L8D.0 size=1048576 2023-12-03T11:42:12.876 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.875+0000 7f8723d84780 1 < canceled part key=_multipart_OGACI7CRPMT7.2~5FYJTAVW8L8D.1 size=81427 2023-12-03T11:42:12.878 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.877+0000 7f8723d84780 1 < canceled multipart upload key=OGACI7CRPMT7 upload=5FYJTAVW8L8D tag=3N27SUZ0C3SZ type=write size=2178579 2023-12-03T11:42:12.880 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.879+0000 7f8723d84780 1 > prepared part key=_multipart_M4VKPN6INFNZ.2~6KRQVL32VA4P.0 size=723785 2023-12-03T11:42:12.880 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.879+0000 7f8723d84780 1 > prepared multipart upload key=M4VKPN6INFNZ upload=6KRQVL32VA4P tag=LVUXNA93HOCU type=write size=1772361 2023-12-03T11:42:12.881 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.880+0000 7f8723d84780 1 < completed part key=_multipart_OPQPIDJ2PBVU.2~M1AE5MM3K4MW.0 size=1048576 2023-12-03T11:42:12.882 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.881+0000 7f8723d84780 1 < completed part key=_multipart_OPQPIDJ2PBVU.2~M1AE5MM3K4MW.1 size=1048576 2023-12-03T11:42:12.883 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.882+0000 7f8723d84780 1 < completed part key=_multipart_OPQPIDJ2PBVU.2~M1AE5MM3K4MW.2 size=81919 2023-12-03T11:42:12.885 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.884+0000 7f8723d84780 1 < completed multipart upload key=OPQPIDJ2PBVU upload=M1AE5MM3K4MW tag=CH3MARJEKAQ3 type=write size=3227647 2023-12-03T11:42:12.886 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.885+0000 7f8723d84780 1 > prepared operation key=FCA2R3HR61S2 tag=14PY4E8T0OYA type=del size=3930987 2023-12-03T11:42:12.887 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.886+0000 7f8723d84780 1 < canceled operation key=CKABTI1EOAWB tag=75J5TQXNTV7P type=del size=3227371 2023-12-03T11:42:12.889 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.888+0000 7f8723d84780 1 > prepared operation key=OPQPIDJ2PBVU tag=QZMMA02TZQ9U type=del size=2691574 2023-12-03T11:42:12.890 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.889+0000 7f8723d84780 1 < completed write operation key=HIU6L0NQ8Q95 tag=8L1NGHAM6SWM type=write size=6115 2023-12-03T11:42:12.893 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.891+0000 7f8723d84780 1 > prepared part key=_multipart_LCK58DDM5XU9.2~FPT0YA22QRJM.0 size=1031252 2023-12-03T11:42:12.893 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.891+0000 7f8723d84780 1 > prepared multipart upload key=LCK58DDM5XU9 upload=FPT0YA22QRJM tag=CSLIQ6IHXL2F type=write size=2079828 2023-12-03T11:42:12.893 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.892+0000 7f8723d84780 1 < completed part key=_multipart_UWS266H06VDK.2~BQ3CK323ENAS.0 size=1048576 2023-12-03T11:42:12.894 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.893+0000 7f8723d84780 1 < completed part key=_multipart_UWS266H06VDK.2~BQ3CK323ENAS.1 size=1048576 2023-12-03T11:42:12.895 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.894+0000 7f8723d84780 1 < completed part key=_multipart_UWS266H06VDK.2~BQ3CK323ENAS.2 size=420522 2023-12-03T11:42:12.897 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.896+0000 7f8723d84780 1 < completed multipart upload key=UWS266H06VDK upload=BQ3CK323ENAS tag=3BXAOCSPLFTB type=write size=3566250 2023-12-03T11:42:12.898 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.897+0000 7f8723d84780 1 > prepared operation key=OPQPIDJ2PBVU tag=D1YQ0THBRFJZ type=del size=3503625 2023-12-03T11:42:12.900 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.899+0000 7f8723d84780 1 < completed write operation key=G36T76K8O7A1 tag=ZUA6SGB7F5SU type=write size=313958 2023-12-03T11:42:12.903 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.902+0000 7f8723d84780 1 > prepared part key=_multipart_12XG7YPYTN4U.2~0GDOSRIYTJW8.0 size=518814 2023-12-03T11:42:12.903 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.902+0000 7f8723d84780 1 > prepared multipart upload key=12XG7YPYTN4U upload=0GDOSRIYTJW8 tag=1M78YBUQQLT7 type=write size=1567390 2023-12-03T11:42:12.904 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.903+0000 7f8723d84780 1 < completed part key=_multipart_931GNEXBHH35.2~TAZZ3KVX16PG.0 size=1048576 2023-12-03T11:42:12.904 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.903+0000 7f8723d84780 1 < canceled part key=_multipart_931GNEXBHH35.2~TAZZ3KVX16PG.1 size=1048576 2023-12-03T11:42:12.905 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.904+0000 7f8723d84780 1 < completed part key=_multipart_931GNEXBHH35.2~TAZZ3KVX16PG.2 size=232836 2023-12-03T11:42:12.907 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.906+0000 7f8723d84780 1 < canceled multipart upload key=931GNEXBHH35 upload=TAZZ3KVX16PG tag=A3LDUYRPNZA0 type=write size=3378564 2023-12-03T11:42:12.909 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.908+0000 7f8723d84780 1 > prepared part key=_multipart_J33T5S893LMV.2~P9C9K5JG42DA.0 size=1048576 2023-12-03T11:42:12.910 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.909+0000 7f8723d84780 1 > prepared part key=_multipart_J33T5S893LMV.2~P9C9K5JG42DA.1 size=1048576 2023-12-03T11:42:12.911 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.910+0000 7f8723d84780 1 > prepared part key=_multipart_J33T5S893LMV.2~P9C9K5JG42DA.2 size=511134 2023-12-03T11:42:12.911 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.910+0000 7f8723d84780 1 > prepared multipart upload key=J33T5S893LMV upload=P9C9K5JG42DA tag=QS68ER0Q53PG type=write size=3656862 2023-12-03T11:42:12.912 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.911+0000 7f8723d84780 1 < completed part key=_multipart_7VMTBKUWU59F.2~8BWLU3R6CYD2.0 size=1048576 2023-12-03T11:42:12.913 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.912+0000 7f8723d84780 1 < completed part key=_multipart_7VMTBKUWU59F.2~8BWLU3R6CYD2.1 size=1048576 2023-12-03T11:42:12.914 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.913+0000 7f8723d84780 1 < completed part key=_multipart_7VMTBKUWU59F.2~8BWLU3R6CYD2.2 size=962007 2023-12-03T11:42:12.916 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.915+0000 7f8723d84780 1 < completed multipart upload key=7VMTBKUWU59F upload=8BWLU3R6CYD2 tag=PK3XSPZA4FMO type=write size=4107735 2023-12-03T11:42:12.917 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.916+0000 7f8723d84780 1 > prepared operation key=KS5J7E7KE2IJ tag=HW2L2O2WUUN1 type=del size=3529691 2023-12-03T11:42:12.920 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.919+0000 7f8723d84780 1 < suggested remove operation key=TSTIBGVYUZZZ tag=RLRUX396FJRR type=del 2023-12-03T11:42:12.921 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.920+0000 7f8723d84780 1 > prepared operation key=4I8PWBZOLDUG tag=AQLC20HV6XB1 type=del size=1809482 2023-12-03T11:42:12.922 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.921+0000 7f8723d84780 1 < completed part key=_multipart_G36T76K8O7A1.2~PMHDM4UU7X43.0 size=1048576 2023-12-03T11:42:12.923 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.922+0000 7f8723d84780 1 < completed part key=_multipart_G36T76K8O7A1.2~PMHDM4UU7X43.1 size=1048576 2023-12-03T11:42:12.924 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.923+0000 7f8723d84780 1 < completed part key=_multipart_G36T76K8O7A1.2~PMHDM4UU7X43.2 size=915823 2023-12-03T11:42:12.926 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.925+0000 7f8723d84780 1 < completed multipart upload key=G36T76K8O7A1 upload=PMHDM4UU7X43 tag=L23YBWYJSKKJ type=write size=4061551 2023-12-03T11:42:12.928 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.926+0000 7f8723d84780 1 > prepared operation key=LMVO6CVEPN3K tag=TNFZ0IT6QFG2 type=del size=151423 2023-12-03T11:42:12.929 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.927+0000 7f8723d84780 -1 < failed to complete operation key=Y6S7QI60GCLE tag=LLV6LVHEMROB type=del size=1459679: (22) Invalid argument 2023-12-03T11:42:12.930 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.929+0000 7f8723d84780 1 > prepared operation key=12XG7YPYTN4U tag=BP1WGB0NQWJD type=del size=324581 2023-12-03T11:42:12.931 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.930+0000 7f8723d84780 1 < canceled operation key=LCK58DDM5XU9 tag=951I918MH7HQ type=del size=4153961 2023-12-03T11:42:12.933 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.932+0000 7f8723d84780 1 > prepared part key=_multipart_LMVO6CVEPN3K.2~815BOW1M8A76.0 size=325950 2023-12-03T11:42:12.933 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.932+0000 7f8723d84780 1 > prepared multipart upload key=LMVO6CVEPN3K upload=815BOW1M8A76 tag=36M6LWOT7F8Z type=write size=1374526 2023-12-03T11:42:12.935 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.935+0000 7f8723d84780 1 < suggested update operation key=J33T5S893LMV tag=OO2OA0V52EUY type=del size=1840691 2023-12-03T11:42:12.943 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.937+0000 7f8723d84780 1 > prepared part key=_multipart_TSTIBGVYUZZZ.2~7WHF029SNZZ4.0 size=1048576 2023-12-03T11:42:12.943 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.938+0000 7f8723d84780 1 > prepared part key=_multipart_TSTIBGVYUZZZ.2~7WHF029SNZZ4.1 size=1048576 2023-12-03T11:42:12.943 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.939+0000 7f8723d84780 1 > prepared part key=_multipart_TSTIBGVYUZZZ.2~7WHF029SNZZ4.2 size=78363 2023-12-03T11:42:12.943 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.939+0000 7f8723d84780 1 > prepared multipart upload key=TSTIBGVYUZZZ upload=7WHF029SNZZ4 tag=B7KLXMXUAY88 type=write size=3224091 2023-12-03T11:42:12.943 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.940+0000 7f8723d84780 1 < canceled operation key=EITMJKL0LCYC tag=TJJUS70U3P5U type=del size=1746385 2023-12-03T11:42:12.943 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.941+0000 7f8723d84780 1 > prepared operation key=7THZZ1J5LOZK tag=XFNER1O0WV2Y type=del size=2323512 2023-12-03T11:42:12.944 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.942+0000 7f8723d84780 1 < completed part key=_multipart_K83BTR5BOLZE.2~E4M29R4RJRDL.0 size=1048576 2023-12-03T11:42:12.944 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.943+0000 7f8723d84780 1 < completed part key=_multipart_K83BTR5BOLZE.2~E4M29R4RJRDL.1 size=118775 2023-12-03T11:42:12.946 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.945+0000 7f8723d84780 1 < completed multipart upload key=K83BTR5BOLZE upload=E4M29R4RJRDL tag=O1H0FV8MOY7I type=write size=2215927 2023-12-03T11:42:12.952 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.947+0000 7f8723d84780 1 > prepared operation key=8NONX2I08YMJ tag=JHTW03GT3EHN type=del size=3682405 2023-12-03T11:42:12.953 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.948+0000 7f8723d84780 1 < completed part key=_multipart_CKABTI1EOAWB.2~EE3PHNUJGYP0.0 size=470135 2023-12-03T11:42:12.953 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.950+0000 7f8723d84780 1 < completed multipart upload key=CKABTI1EOAWB upload=EE3PHNUJGYP0 tag=A7O4T5JFQLGQ type=write size=1518711 2023-12-03T11:42:12.954 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.951+0000 7f8723d84780 1 > prepared operation key=CKABTI1EOAWB tag=3KLWVLBWJVMB type=del size=1073905 2023-12-03T11:42:12.956 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.952+0000 7f8723d84780 1 < completed part key=_multipart_M4VKPN6INFNZ.2~6KRQVL32VA4P.0 size=723785 2023-12-03T11:42:12.956 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.954+0000 7f8723d84780 1 < completed multipart upload key=M4VKPN6INFNZ upload=6KRQVL32VA4P tag=LVUXNA93HOCU type=write size=1772361 2023-12-03T11:42:12.956 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.955+0000 7f8723d84780 1 > prepared operation key=4I8PWBZOLDUG tag=7LB0Q57MV04N type=del size=3912904 2023-12-03T11:42:12.957 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.956+0000 7f8723d84780 1 < completed delete operation key=FCA2R3HR61S2 tag=14PY4E8T0OYA type=del 2023-12-03T11:42:12.961 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.960+0000 7f8723d84780 1 > prepared part key=_multipart_HIU6L0NQ8Q95.2~O5JEJOUNJCKR.0 size=1048576 2023-12-03T11:42:12.962 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.961+0000 7f8723d84780 1 > prepared part key=_multipart_HIU6L0NQ8Q95.2~O5JEJOUNJCKR.1 size=1024562 2023-12-03T11:42:12.962 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.961+0000 7f8723d84780 1 > prepared multipart upload key=HIU6L0NQ8Q95 upload=O5JEJOUNJCKR tag=NEOTIBPZ1QS7 type=write size=3121714 2023-12-03T11:42:12.963 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.962+0000 7f8723d84780 1 < completed delete operation key=OPQPIDJ2PBVU tag=QZMMA02TZQ9U type=del 2023-12-03T11:42:12.965 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.964+0000 7f8723d84780 1 > prepared part key=_multipart_G36T76K8O7A1.2~ZDHTDTQRGOVI.0 size=1048576 2023-12-03T11:42:12.969 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.965+0000 7f8723d84780 1 > prepared part key=_multipart_G36T76K8O7A1.2~ZDHTDTQRGOVI.1 size=556052 2023-12-03T11:42:12.969 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.965+0000 7f8723d84780 1 > prepared multipart upload key=G36T76K8O7A1 upload=ZDHTDTQRGOVI tag=68Q8UH7CMI2P type=write size=2653204 2023-12-03T11:42:12.969 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.966+0000 7f8723d84780 1 < completed part key=_multipart_LCK58DDM5XU9.2~FPT0YA22QRJM.0 size=1031252 2023-12-03T11:42:12.969 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.968+0000 7f8723d84780 1 < completed multipart upload key=LCK58DDM5XU9 upload=FPT0YA22QRJM tag=CSLIQ6IHXL2F type=write size=2079828 2023-12-03T11:42:12.972 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.971+0000 7f8723d84780 1 > prepared part key=_multipart_KS5J7E7KE2IJ.2~I2DYESTPZF6Q.0 size=1048576 2023-12-03T11:42:12.973 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.972+0000 7f8723d84780 1 > prepared part key=_multipart_KS5J7E7KE2IJ.2~I2DYESTPZF6Q.1 size=1048576 2023-12-03T11:42:12.974 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.972+0000 7f8723d84780 1 > prepared part key=_multipart_KS5J7E7KE2IJ.2~I2DYESTPZF6Q.2 size=978586 2023-12-03T11:42:12.974 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.972+0000 7f8723d84780 1 > prepared multipart upload key=KS5J7E7KE2IJ upload=I2DYESTPZF6Q tag=2RTBDDFKAKUQ type=write size=4124314 2023-12-03T11:42:12.976 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.975+0000 7f8723d84780 1 < suggested remove operation key=OPQPIDJ2PBVU tag=D1YQ0THBRFJZ type=del 2023-12-03T11:42:12.977 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.976+0000 7f8723d84780 1 > prepared operation key=D3JEVEY0E29E tag=7O2DCO9SAEGN type=write size=386162 2023-12-03T11:42:12.979 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.977+0000 7f8723d84780 1 < completed part key=_multipart_12XG7YPYTN4U.2~0GDOSRIYTJW8.0 size=518814 2023-12-03T11:42:12.981 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.980+0000 7f8723d84780 1 < completed multipart upload key=12XG7YPYTN4U upload=0GDOSRIYTJW8 tag=1M78YBUQQLT7 type=write size=1567390 2023-12-03T11:42:12.982 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.981+0000 7f8723d84780 1 > prepared operation key=96RAVVSUKH0Y tag=CNSAKYALCVPK type=del size=416359 2023-12-03T11:42:12.984 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.982+0000 7f8723d84780 1 < completed part key=_multipart_J33T5S893LMV.2~P9C9K5JG42DA.0 size=1048576 2023-12-03T11:42:12.985 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.983+0000 7f8723d84780 1 < completed part key=_multipart_J33T5S893LMV.2~P9C9K5JG42DA.1 size=1048576 2023-12-03T11:42:12.986 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.985+0000 7f8723d84780 1 < completed part key=_multipart_J33T5S893LMV.2~P9C9K5JG42DA.2 size=511134 2023-12-03T11:42:12.988 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.987+0000 7f8723d84780 1 < completed multipart upload key=J33T5S893LMV upload=P9C9K5JG42DA tag=QS68ER0Q53PG type=write size=3656862 2023-12-03T11:42:12.990 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.989+0000 7f8723d84780 1 > prepared part key=_multipart_J33T5S893LMV.2~KH0YK7OPTZ6E.0 size=1036383 2023-12-03T11:42:12.990 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.989+0000 7f8723d84780 1 > prepared multipart upload key=J33T5S893LMV upload=KH0YK7OPTZ6E tag=0ZNDZ10NHQ3G type=write size=2084959 2023-12-03T11:42:12.991 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.990+0000 7f8723d84780 1 < completed delete operation key=KS5J7E7KE2IJ tag=HW2L2O2WUUN1 type=del 2023-12-03T11:42:12.992 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.991+0000 7f8723d84780 1 > prepared operation key=931GNEXBHH35 tag=ZI2MPXC235TX type=del size=1158788 2023-12-03T11:42:12.994 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.993+0000 7f8723d84780 1 < completed delete operation key=4I8PWBZOLDUG tag=AQLC20HV6XB1 type=del 2023-12-03T11:42:12.995 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.994+0000 7f8723d84780 1 > prepared operation key=10JRIKOZ16FY tag=C8Q0CQD3JG2D type=del size=2327885 2023-12-03T11:42:12.996 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.995+0000 7f8723d84780 1 < completed delete operation key=LMVO6CVEPN3K tag=TNFZ0IT6QFG2 type=del 2023-12-03T11:42:12.998 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.997+0000 7f8723d84780 1 > prepared part key=_multipart_4I8PWBZOLDUG.2~3LT5LGVBK501.0 size=1048576 2023-12-03T11:42:13.001 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.998+0000 7f8723d84780 1 > prepared part key=_multipart_4I8PWBZOLDUG.2~3LT5LGVBK501.1 size=1048576 2023-12-03T11:42:13.001 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.999+0000 7f8723d84780 1 > prepared part key=_multipart_4I8PWBZOLDUG.2~3LT5LGVBK501.2 size=321455 2023-12-03T11:42:13.001 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:12.999+0000 7f8723d84780 1 > prepared multipart upload key=4I8PWBZOLDUG upload=3LT5LGVBK501 tag=MM2QMAI0PD4B type=write size=3467183 2023-12-03T11:42:13.003 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.001+0000 7f8723d84780 1 < suggested remove operation key=12XG7YPYTN4U tag=BP1WGB0NQWJD type=del 2023-12-03T11:42:13.004 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.003+0000 7f8723d84780 1 > prepared operation key=7THZZ1J5LOZK tag=A56DGKSCIKE8 type=del size=3540664 2023-12-03T11:42:13.004 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.003+0000 7f8723d84780 1 < canceled part key=_multipart_LMVO6CVEPN3K.2~815BOW1M8A76.0 size=325950 2023-12-03T11:42:13.006 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.005+0000 7f8723d84780 1 < canceled multipart upload key=LMVO6CVEPN3K upload=815BOW1M8A76 tag=36M6LWOT7F8Z type=write size=1374526 2023-12-03T11:42:13.008 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.007+0000 7f8723d84780 1 > prepared part key=_multipart_7VMTBKUWU59F.2~T8ULZ5JYS14F.0 size=1048576 2023-12-03T11:42:13.009 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.008+0000 7f8723d84780 1 > prepared part key=_multipart_7VMTBKUWU59F.2~T8ULZ5JYS14F.1 size=1048576 2023-12-03T11:42:13.010 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.009+0000 7f8723d84780 1 > prepared part key=_multipart_7VMTBKUWU59F.2~T8ULZ5JYS14F.2 size=102902 2023-12-03T11:42:13.010 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.009+0000 7f8723d84780 1 > prepared multipart upload key=7VMTBKUWU59F upload=T8ULZ5JYS14F tag=UNIK9Z6P5KOP type=write size=3248630 2023-12-03T11:42:13.011 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.010+0000 7f8723d84780 1 < completed part key=_multipart_TSTIBGVYUZZZ.2~7WHF029SNZZ4.0 size=1048576 2023-12-03T11:42:13.012 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.011+0000 7f8723d84780 1 < completed part key=_multipart_TSTIBGVYUZZZ.2~7WHF029SNZZ4.1 size=1048576 2023-12-03T11:42:13.013 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.012+0000 7f8723d84780 1 < completed part key=_multipart_TSTIBGVYUZZZ.2~7WHF029SNZZ4.2 size=78363 2023-12-03T11:42:13.015 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.014+0000 7f8723d84780 1 < completed multipart upload key=TSTIBGVYUZZZ upload=7WHF029SNZZ4 tag=B7KLXMXUAY88 type=write size=3224091 2023-12-03T11:42:13.019 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.017+0000 7f8723d84780 1 > prepared part key=_multipart_UWS266H06VDK.2~OILR6J4TBF6J.0 size=1048576 2023-12-03T11:42:13.019 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.017+0000 7f8723d84780 1 > prepared part key=_multipart_UWS266H06VDK.2~OILR6J4TBF6J.1 size=1048576 2023-12-03T11:42:13.020 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.019+0000 7f8723d84780 1 > prepared part key=_multipart_UWS266H06VDK.2~OILR6J4TBF6J.2 size=291184 2023-12-03T11:42:13.020 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.019+0000 7f8723d84780 1 > prepared multipart upload key=UWS266H06VDK upload=OILR6J4TBF6J tag=YXF2YEI1VVQ2 type=write size=3436912 2023-12-03T11:42:13.022 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.021+0000 7f8723d84780 1 < suggested update operation key=7THZZ1J5LOZK tag=XFNER1O0WV2Y type=del size=2323512 2023-12-03T11:42:13.025 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.022+0000 7f8723d84780 1 > prepared operation key=EY9ZG5KOTBWM tag=5ADJ5HIE89G5 type=del size=466422 2023-12-03T11:42:13.025 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.024+0000 7f8723d84780 1 < completed delete operation key=8NONX2I08YMJ tag=JHTW03GT3EHN type=del 2023-12-03T11:42:13.027 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.026+0000 7f8723d84780 1 > prepared part key=_multipart_HIU6L0NQ8Q95.2~553O6UOJOALK.0 size=323943 2023-12-03T11:42:13.027 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.026+0000 7f8723d84780 1 > prepared multipart upload key=HIU6L0NQ8Q95 upload=553O6UOJOALK tag=EKD25K2JDNA1 type=write size=1372519 2023-12-03T11:42:13.028 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.027+0000 7f8723d84780 1 < canceled operation key=CKABTI1EOAWB tag=3KLWVLBWJVMB type=del size=1073905 2023-12-03T11:42:13.029 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.028+0000 7f8723d84780 1 > prepared operation key=HIU6L0NQ8Q95 tag=S3MOB8Q7SEY6 type=del size=1691226 2023-12-03T11:42:13.032 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.029+0000 7f8723d84780 1 < completed delete operation key=4I8PWBZOLDUG tag=7LB0Q57MV04N type=del 2023-12-03T11:42:13.032 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.030+0000 7f8723d84780 1 > prepared operation key=7THZZ1J5LOZK tag=SHBA64XD0D2D type=del size=2737177 2023-12-03T11:42:13.033 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.031+0000 7f8723d84780 1 < completed part key=_multipart_HIU6L0NQ8Q95.2~O5JEJOUNJCKR.0 size=1048576 2023-12-03T11:42:13.035 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.032+0000 7f8723d84780 1 < completed part key=_multipart_HIU6L0NQ8Q95.2~O5JEJOUNJCKR.1 size=1024562 2023-12-03T11:42:13.036 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.035+0000 7f8723d84780 1 < completed multipart upload key=HIU6L0NQ8Q95 upload=O5JEJOUNJCKR tag=NEOTIBPZ1QS7 type=write size=3121714 2023-12-03T11:42:13.039 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.037+0000 7f8723d84780 1 > prepared part key=_multipart_J33T5S893LMV.2~UEMXGX7XQNP7.0 size=1048576 2023-12-03T11:42:13.040 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.038+0000 7f8723d84780 1 > prepared part key=_multipart_J33T5S893LMV.2~UEMXGX7XQNP7.1 size=567340 2023-12-03T11:42:13.040 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.038+0000 7f8723d84780 1 > prepared multipart upload key=J33T5S893LMV upload=UEMXGX7XQNP7 tag=9FJXM9HIZCZH type=write size=2664492 2023-12-03T11:42:13.041 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.039+0000 7f8723d84780 1 < canceled part key=_multipart_G36T76K8O7A1.2~ZDHTDTQRGOVI.0 size=1048576 2023-12-03T11:42:13.041 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.040+0000 7f8723d84780 1 < completed part key=_multipart_G36T76K8O7A1.2~ZDHTDTQRGOVI.1 size=556052 2023-12-03T11:42:13.043 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.042+0000 7f8723d84780 1 < canceled multipart upload key=G36T76K8O7A1 upload=ZDHTDTQRGOVI tag=68Q8UH7CMI2P type=write size=2653204 2023-12-03T11:42:13.045 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.044+0000 7f8723d84780 1 > prepared part key=_multipart_J33T5S893LMV.2~1Q4ZUOX1Q8OC.0 size=1048576 2023-12-03T11:42:13.046 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.045+0000 7f8723d84780 1 > prepared part key=_multipart_J33T5S893LMV.2~1Q4ZUOX1Q8OC.1 size=561055 2023-12-03T11:42:13.046 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.045+0000 7f8723d84780 1 > prepared multipart upload key=J33T5S893LMV upload=1Q4ZUOX1Q8OC tag=3DM2G8UC28K8 type=write size=2658207 2023-12-03T11:42:13.047 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.046+0000 7f8723d84780 1 < completed part key=_multipart_KS5J7E7KE2IJ.2~I2DYESTPZF6Q.0 size=1048576 2023-12-03T11:42:13.049 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.048+0000 7f8723d84780 1 < completed part key=_multipart_KS5J7E7KE2IJ.2~I2DYESTPZF6Q.1 size=1048576 2023-12-03T11:42:13.050 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.049+0000 7f8723d84780 1 < completed part key=_multipart_KS5J7E7KE2IJ.2~I2DYESTPZF6Q.2 size=978586 2023-12-03T11:42:13.052 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.051+0000 7f8723d84780 1 < completed multipart upload key=KS5J7E7KE2IJ upload=I2DYESTPZF6Q tag=2RTBDDFKAKUQ type=write size=4124314 2023-12-03T11:42:13.054 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.052+0000 7f8723d84780 1 > prepared operation key=5UYL15O31IHM tag=RA91Q97S11RF type=del size=101245 2023-12-03T11:42:13.055 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.054+0000 7f8723d84780 1 < completed write operation key=D3JEVEY0E29E tag=7O2DCO9SAEGN type=write size=386162 2023-12-03T11:42:13.057 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.056+0000 7f8723d84780 1 > prepared part key=_multipart_K83BTR5BOLZE.2~0ISR1CC53YOI.0 size=1048576 2023-12-03T11:42:13.058 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.057+0000 7f8723d84780 1 > prepared part key=_multipart_K83BTR5BOLZE.2~0ISR1CC53YOI.1 size=267428 2023-12-03T11:42:13.058 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.057+0000 7f8723d84780 1 > prepared multipart upload key=K83BTR5BOLZE upload=0ISR1CC53YOI tag=WNBJO81V00EU type=write size=2364580 2023-12-03T11:42:13.059 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.058+0000 7f8723d84780 1 < completed delete operation key=96RAVVSUKH0Y tag=CNSAKYALCVPK type=del 2023-12-03T11:42:13.061 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.060+0000 7f8723d84780 1 > prepared operation key=VENJI0KD1XDW tag=UJVAXJXQNDFJ type=del size=1158718 2023-12-03T11:42:13.061 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.060+0000 7f8723d84780 1 < canceled part key=_multipart_J33T5S893LMV.2~KH0YK7OPTZ6E.0 size=1036383 2023-12-03T11:42:13.063 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.062+0000 7f8723d84780 1 < canceled multipart upload key=J33T5S893LMV upload=KH0YK7OPTZ6E tag=0ZNDZ10NHQ3G type=write size=2084959 2023-12-03T11:42:13.064 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.063+0000 7f8723d84780 1 > prepared operation key=LCK58DDM5XU9 tag=CDH0JMVNAO7V type=del size=2400537 2023-12-03T11:42:13.065 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.064+0000 7f8723d84780 1 < completed delete operation key=931GNEXBHH35 tag=ZI2MPXC235TX type=del 2023-12-03T11:42:13.066 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.065+0000 7f8723d84780 1 > prepared operation key=TSTIBGVYUZZZ tag=T7JB3FL0ACE2 type=del size=3266780 2023-12-03T11:42:13.068 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.066+0000 7f8723d84780 1 < completed delete operation key=10JRIKOZ16FY tag=C8Q0CQD3JG2D type=del 2023-12-03T11:42:13.070 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.069+0000 7f8723d84780 1 > prepared part key=_multipart_EY9ZG5KOTBWM.2~EZSV3Y04YYAR.0 size=168896 2023-12-03T11:42:13.070 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.069+0000 7f8723d84780 1 > prepared multipart upload key=EY9ZG5KOTBWM upload=EZSV3Y04YYAR tag=967FCXMMQH7F type=write size=1217472 2023-12-03T11:42:13.070 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.069+0000 7f8723d84780 1 < canceled part key=_multipart_4I8PWBZOLDUG.2~3LT5LGVBK501.0 size=1048576 2023-12-03T11:42:13.071 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.070+0000 7f8723d84780 1 < completed part key=_multipart_4I8PWBZOLDUG.2~3LT5LGVBK501.1 size=1048576 2023-12-03T11:42:13.072 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.071+0000 7f8723d84780 1 < completed part key=_multipart_4I8PWBZOLDUG.2~3LT5LGVBK501.2 size=321455 2023-12-03T11:42:13.076 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.075+0000 7f8723d84780 1 < canceled multipart upload key=4I8PWBZOLDUG upload=3LT5LGVBK501 tag=MM2QMAI0PD4B type=write size=3467183 2023-12-03T11:42:13.077 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.076+0000 7f8723d84780 1 > prepared operation key=J33T5S893LMV tag=A4CZ8LYL03TI type=del size=2122285 2023-12-03T11:42:13.079 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.078+0000 7f8723d84780 -1 < failed to complete operation key=7THZZ1J5LOZK tag=A56DGKSCIKE8 type=del size=3540664: (22) Invalid argument 2023-12-03T11:42:13.080 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.079+0000 7f8723d84780 1 > prepared operation key=8NONX2I08YMJ tag=55USQGK5QHXN type=del size=1246203 2023-12-03T11:42:13.081 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.080+0000 7f8723d84780 1 < completed part key=_multipart_7VMTBKUWU59F.2~T8ULZ5JYS14F.0 size=1048576 2023-12-03T11:42:13.082 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.081+0000 7f8723d84780 1 < completed part key=_multipart_7VMTBKUWU59F.2~T8ULZ5JYS14F.1 size=1048576 2023-12-03T11:42:13.083 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.082+0000 7f8723d84780 1 < completed part key=_multipart_7VMTBKUWU59F.2~T8ULZ5JYS14F.2 size=102902 2023-12-03T11:42:13.086 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.084+0000 7f8723d84780 1 < completed multipart upload key=7VMTBKUWU59F upload=T8ULZ5JYS14F tag=UNIK9Z6P5KOP type=write size=3248630 2023-12-03T11:42:13.087 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.086+0000 7f8723d84780 1 > prepared part key=_multipart_OPQPIDJ2PBVU.2~MXGF0UR854TW.0 size=1048576 2023-12-03T11:42:13.088 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.087+0000 7f8723d84780 1 > prepared part key=_multipart_OPQPIDJ2PBVU.2~MXGF0UR854TW.1 size=1048576 2023-12-03T11:42:13.089 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.088+0000 7f8723d84780 1 > prepared part key=_multipart_OPQPIDJ2PBVU.2~MXGF0UR854TW.2 size=487378 2023-12-03T11:42:13.089 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.088+0000 7f8723d84780 1 > prepared multipart upload key=OPQPIDJ2PBVU upload=MXGF0UR854TW tag=NRPSPI7J5GNH type=write size=3633106 2023-12-03T11:42:13.091 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.090+0000 7f8723d84780 1 < completed part key=_multipart_UWS266H06VDK.2~OILR6J4TBF6J.0 size=1048576 2023-12-03T11:42:13.091 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.090+0000 7f8723d84780 1 < completed part key=_multipart_UWS266H06VDK.2~OILR6J4TBF6J.1 size=1048576 2023-12-03T11:42:13.092 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.091+0000 7f8723d84780 1 < completed part key=_multipart_UWS266H06VDK.2~OILR6J4TBF6J.2 size=291184 2023-12-03T11:42:13.095 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.094+0000 7f8723d84780 1 < completed multipart upload key=UWS266H06VDK upload=OILR6J4TBF6J tag=YXF2YEI1VVQ2 type=write size=3436912 2023-12-03T11:42:13.097 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.096+0000 7f8723d84780 1 > prepared part key=_multipart_931GNEXBHH35.2~BH0U7CY39X0G.0 size=1048576 2023-12-03T11:42:13.098 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.097+0000 7f8723d84780 1 > prepared part key=_multipart_931GNEXBHH35.2~BH0U7CY39X0G.1 size=1048576 2023-12-03T11:42:13.099 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.098+0000 7f8723d84780 1 > prepared part key=_multipart_931GNEXBHH35.2~BH0U7CY39X0G.2 size=930719 2023-12-03T11:42:13.099 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.098+0000 7f8723d84780 1 > prepared multipart upload key=931GNEXBHH35 upload=BH0U7CY39X0G tag=B9GGWJRRKF98 type=write size=4076447 2023-12-03T11:42:13.100 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.099+0000 7f8723d84780 1 < completed delete operation key=EY9ZG5KOTBWM tag=5ADJ5HIE89G5 type=del 2023-12-03T11:42:13.103 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.102+0000 7f8723d84780 1 > prepared part key=_multipart_931GNEXBHH35.2~XPIGRYT7G6Y1.0 size=1048576 2023-12-03T11:42:13.104 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.103+0000 7f8723d84780 1 > prepared part key=_multipart_931GNEXBHH35.2~XPIGRYT7G6Y1.1 size=713325 2023-12-03T11:42:13.104 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.103+0000 7f8723d84780 1 > prepared multipart upload key=931GNEXBHH35 upload=XPIGRYT7G6Y1 tag=2EAC5KHBZ8VD type=write size=2810477 2023-12-03T11:42:13.105 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.104+0000 7f8723d84780 1 < completed part key=_multipart_HIU6L0NQ8Q95.2~553O6UOJOALK.0 size=323943 2023-12-03T11:42:13.108 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.106+0000 7f8723d84780 1 < completed multipart upload key=HIU6L0NQ8Q95 upload=553O6UOJOALK tag=EKD25K2JDNA1 type=write size=1372519 2023-12-03T11:42:13.109 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.107+0000 7f8723d84780 1 > prepared operation key=Y6S7QI60GCLE tag=UXI7GZQILQW1 type=del size=1596591 2023-12-03T11:42:13.111 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.110+0000 7f8723d84780 1 < suggested remove operation key=HIU6L0NQ8Q95 tag=S3MOB8Q7SEY6 type=del 2023-12-03T11:42:13.112 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.111+0000 7f8723d84780 1 > prepared operation key=KS5J7E7KE2IJ tag=DMQITOJ5Z1W9 type=del size=2366968 2023-12-03T11:42:13.115 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.114+0000 7f8723d84780 1 < suggested update operation key=7THZZ1J5LOZK tag=SHBA64XD0D2D type=del size=2737177 2023-12-03T11:42:13.116 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.115+0000 7f8723d84780 1 > prepared operation key=J33T5S893LMV tag=U9ANLNE601TU type=del size=954185 2023-12-03T11:42:13.116 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.115+0000 7f8723d84780 1 < canceled part key=_multipart_J33T5S893LMV.2~UEMXGX7XQNP7.0 size=1048576 2023-12-03T11:42:13.117 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.116+0000 7f8723d84780 1 < completed part key=_multipart_J33T5S893LMV.2~UEMXGX7XQNP7.1 size=567340 2023-12-03T11:42:13.119 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.118+0000 7f8723d84780 1 < canceled multipart upload key=J33T5S893LMV upload=UEMXGX7XQNP7 tag=9FJXM9HIZCZH type=write size=2664492 2023-12-03T11:42:13.122 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.121+0000 7f8723d84780 1 > prepared part key=_multipart_EITMJKL0LCYC.2~EN6MWQQXZIZY.0 size=1048576 2023-12-03T11:42:13.123 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.122+0000 7f8723d84780 1 > prepared part key=_multipart_EITMJKL0LCYC.2~EN6MWQQXZIZY.1 size=1048576 2023-12-03T11:42:13.124 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.122+0000 7f8723d84780 1 > prepared part key=_multipart_EITMJKL0LCYC.2~EN6MWQQXZIZY.2 size=880374 2023-12-03T11:42:13.124 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.122+0000 7f8723d84780 1 > prepared multipart upload key=EITMJKL0LCYC upload=EN6MWQQXZIZY tag=577GXMIUTJO7 type=write size=4026102 2023-12-03T11:42:13.125 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.124+0000 7f8723d84780 1 < completed part key=_multipart_J33T5S893LMV.2~1Q4ZUOX1Q8OC.0 size=1048576 2023-12-03T11:42:13.126 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.125+0000 7f8723d84780 1 < completed part key=_multipart_J33T5S893LMV.2~1Q4ZUOX1Q8OC.1 size=561055 2023-12-03T11:42:13.128 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.127+0000 7f8723d84780 1 < completed multipart upload key=J33T5S893LMV upload=1Q4ZUOX1Q8OC tag=3DM2G8UC28K8 type=write size=2658207 2023-12-03T11:42:13.129 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.128+0000 7f8723d84780 1 > prepared operation key=7VMTBKUWU59F tag=WL1NP9K1GGEU type=del size=1539353 2023-12-03T11:42:13.132 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.131+0000 7f8723d84780 1 < suggested remove operation key=5UYL15O31IHM tag=RA91Q97S11RF type=del 2023-12-03T11:42:13.133 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.132+0000 7f8723d84780 1 > prepared operation key=AB0SN0E49Z5F tag=R6LRL5LTWOL2 type=write size=565290 2023-12-03T11:42:13.134 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.133+0000 7f8723d84780 1 < completed part key=_multipart_K83BTR5BOLZE.2~0ISR1CC53YOI.0 size=1048576 2023-12-03T11:42:13.135 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.134+0000 7f8723d84780 1 < completed part key=_multipart_K83BTR5BOLZE.2~0ISR1CC53YOI.1 size=267428 2023-12-03T11:42:13.137 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.136+0000 7f8723d84780 1 < completed multipart upload key=K83BTR5BOLZE upload=0ISR1CC53YOI tag=WNBJO81V00EU type=write size=2364580 2023-12-03T11:42:13.140 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.139+0000 7f8723d84780 1 > prepared part key=_multipart_VENJI0KD1XDW.2~JD60UPR24QJV.0 size=1048576 2023-12-03T11:42:13.141 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.140+0000 7f8723d84780 1 > prepared part key=_multipart_VENJI0KD1XDW.2~JD60UPR24QJV.1 size=618706 2023-12-03T11:42:13.141 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.140+0000 7f8723d84780 1 > prepared multipart upload key=VENJI0KD1XDW upload=JD60UPR24QJV tag=8BJFH9KQ1WVP type=write size=2715858 2023-12-03T11:42:13.142 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.141+0000 7f8723d84780 1 < completed delete operation key=VENJI0KD1XDW tag=UJVAXJXQNDFJ type=del 2023-12-03T11:42:13.143 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.142+0000 7f8723d84780 1 > prepared operation key=5UYL15O31IHM tag=OCL05J3QXP0B type=del size=3747113 2023-12-03T11:42:13.144 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.143+0000 7f8723d84780 1 < completed delete operation key=LCK58DDM5XU9 tag=CDH0JMVNAO7V type=del 2023-12-03T11:42:13.146 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.145+0000 7f8723d84780 1 > prepared part key=_multipart_EY9ZG5KOTBWM.2~PFKBR1L174Y5.0 size=1048576 2023-12-03T11:42:13.147 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.146+0000 7f8723d84780 1 > prepared part key=_multipart_EY9ZG5KOTBWM.2~PFKBR1L174Y5.1 size=200486 2023-12-03T11:42:13.148 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.146+0000 7f8723d84780 1 > prepared multipart upload key=EY9ZG5KOTBWM upload=PFKBR1L174Y5 tag=GUC8D3GBA81O type=write size=2297638 2023-12-03T11:42:13.149 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.148+0000 7f8723d84780 1 < completed delete operation key=TSTIBGVYUZZZ tag=T7JB3FL0ACE2 type=del 2023-12-03T11:42:13.150 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.149+0000 7f8723d84780 1 > prepared operation key=EY9ZG5KOTBWM tag=H91U93YHOVBS type=del size=4047210 2023-12-03T11:42:13.151 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.150+0000 7f8723d84780 1 < completed part key=_multipart_EY9ZG5KOTBWM.2~EZSV3Y04YYAR.0 size=168896 2023-12-03T11:42:13.153 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.152+0000 7f8723d84780 1 < completed multipart upload key=EY9ZG5KOTBWM upload=EZSV3Y04YYAR tag=967FCXMMQH7F type=write size=1217472 2023-12-03T11:42:13.154 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.153+0000 7f8723d84780 1 > prepared operation key=FCA2R3HR61S2 tag=UWCE95E5HWJY type=del size=497826 2023-12-03T11:42:13.155 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.154+0000 7f8723d84780 1 < completed delete operation key=J33T5S893LMV tag=A4CZ8LYL03TI type=del 2023-12-03T11:42:13.157 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.156+0000 7f8723d84780 1 > prepared part key=_multipart_10JRIKOZ16FY.2~DRIZE9JYQBFT.0 size=1048576 2023-12-03T11:42:13.158 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.157+0000 7f8723d84780 1 > prepared part key=_multipart_10JRIKOZ16FY.2~DRIZE9JYQBFT.1 size=949667 2023-12-03T11:42:13.159 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.157+0000 7f8723d84780 1 > prepared multipart upload key=10JRIKOZ16FY upload=DRIZE9JYQBFT tag=871L7R63PC7H type=write size=3046819 2023-12-03T11:42:13.160 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.159+0000 7f8723d84780 1 < canceled operation key=8NONX2I08YMJ tag=55USQGK5QHXN type=del size=1246203 2023-12-03T11:42:13.161 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.160+0000 7f8723d84780 1 > prepared operation key=TSTIBGVYUZZZ tag=ET7ZE90LSMWA type=del size=647117 2023-12-03T11:42:13.162 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.161+0000 7f8723d84780 1 < completed part key=_multipart_OPQPIDJ2PBVU.2~MXGF0UR854TW.0 size=1048576 2023-12-03T11:42:13.163 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.162+0000 7f8723d84780 1 < completed part key=_multipart_OPQPIDJ2PBVU.2~MXGF0UR854TW.1 size=1048576 2023-12-03T11:42:13.164 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.163+0000 7f8723d84780 1 < completed part key=_multipart_OPQPIDJ2PBVU.2~MXGF0UR854TW.2 size=487378 2023-12-03T11:42:13.166 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.165+0000 7f8723d84780 1 < completed multipart upload key=OPQPIDJ2PBVU upload=MXGF0UR854TW tag=NRPSPI7J5GNH type=write size=3633106 2023-12-03T11:42:13.167 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.166+0000 7f8723d84780 1 > prepared operation key=4I8PWBZOLDUG tag=XMX8UOQPIOH4 type=write size=381763 2023-12-03T11:42:13.168 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.168+0000 7f8723d84780 1 < completed part key=_multipart_931GNEXBHH35.2~BH0U7CY39X0G.0 size=1048576 2023-12-03T11:42:13.169 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.168+0000 7f8723d84780 1 < completed part key=_multipart_931GNEXBHH35.2~BH0U7CY39X0G.1 size=1048576 2023-12-03T11:42:13.170 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.169+0000 7f8723d84780 1 < completed part key=_multipart_931GNEXBHH35.2~BH0U7CY39X0G.2 size=930719 2023-12-03T11:42:13.173 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.171+0000 7f8723d84780 1 < completed multipart upload key=931GNEXBHH35 upload=BH0U7CY39X0G tag=B9GGWJRRKF98 type=write size=4076447 2023-12-03T11:42:13.174 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.173+0000 7f8723d84780 1 > prepared operation key=EY9ZG5KOTBWM tag=7TAZ45JTRIZX type=del size=1373913 2023-12-03T11:42:13.175 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.174+0000 7f8723d84780 1 < completed part key=_multipart_931GNEXBHH35.2~XPIGRYT7G6Y1.0 size=1048576 2023-12-03T11:42:13.176 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.175+0000 7f8723d84780 1 < completed part key=_multipart_931GNEXBHH35.2~XPIGRYT7G6Y1.1 size=713325 2023-12-03T11:42:13.178 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.177+0000 7f8723d84780 1 < completed multipart upload key=931GNEXBHH35 upload=XPIGRYT7G6Y1 tag=2EAC5KHBZ8VD type=write size=2810477 2023-12-03T11:42:13.180 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.178+0000 7f8723d84780 1 > prepared operation key=J33T5S893LMV tag=3V8LCRU2OFXA type=del size=773444 2023-12-03T11:42:13.181 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.180+0000 7f8723d84780 1 < suggested remove operation key=Y6S7QI60GCLE tag=UXI7GZQILQW1 type=del 2023-12-03T11:42:13.183 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.182+0000 7f8723d84780 1 > prepared part key=_multipart_OPQPIDJ2PBVU.2~XL163ZG0414B.0 size=1048576 2023-12-03T11:42:13.184 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.183+0000 7f8723d84780 1 > prepared part key=_multipart_OPQPIDJ2PBVU.2~XL163ZG0414B.1 size=1048576 2023-12-03T11:42:13.185 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.184+0000 7f8723d84780 1 > prepared part key=_multipart_OPQPIDJ2PBVU.2~XL163ZG0414B.2 size=73758 2023-12-03T11:42:13.185 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.184+0000 7f8723d84780 1 > prepared multipart upload key=OPQPIDJ2PBVU upload=XL163ZG0414B tag=6LL5LI1Q9IZE type=write size=3219486 2023-12-03T11:42:13.188 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.187+0000 7f8723d84780 1 < completed delete operation key=KS5J7E7KE2IJ tag=DMQITOJ5Z1W9 type=del 2023-12-03T11:42:13.189 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.188+0000 7f8723d84780 1 > prepared operation key=AB0SN0E49Z5F tag=2ETUKG427YS3 type=write size=6803 2023-12-03T11:42:13.191 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.191+0000 7f8723d84780 1 < suggested remove operation key=J33T5S893LMV tag=U9ANLNE601TU type=del 2023-12-03T11:42:13.193 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.192+0000 7f8723d84780 1 > prepared operation key=EY9ZG5KOTBWM tag=JGQH5JKTIKN9 type=del size=326347 2023-12-03T11:42:13.194 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.193+0000 7f8723d84780 1 < completed part key=_multipart_EITMJKL0LCYC.2~EN6MWQQXZIZY.0 size=1048576 2023-12-03T11:42:13.195 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.194+0000 7f8723d84780 1 < completed part key=_multipart_EITMJKL0LCYC.2~EN6MWQQXZIZY.1 size=1048576 2023-12-03T11:42:13.195 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.194+0000 7f8723d84780 1 < canceled part key=_multipart_EITMJKL0LCYC.2~EN6MWQQXZIZY.2 size=880374 2023-12-03T11:42:13.197 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.196+0000 7f8723d84780 1 < canceled multipart upload key=EITMJKL0LCYC upload=EN6MWQQXZIZY tag=577GXMIUTJO7 type=write size=4026102 2023-12-03T11:42:13.198 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.197+0000 7f8723d84780 1 > prepared operation key=M4VKPN6INFNZ tag=GLT7XWJA62Z4 type=write size=462615 2023-12-03T11:42:13.200 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.199+0000 7f8723d84780 1 < suggested update operation key=7VMTBKUWU59F tag=WL1NP9K1GGEU type=del size=1539353 2023-12-03T11:42:13.202 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.201+0000 7f8723d84780 1 > prepared part key=_multipart_W2704YS8KYQB.2~7PD1WLYHOFZ5.0 size=1048576 2023-12-03T11:42:13.204 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.203+0000 7f8723d84780 1 > prepared part key=_multipart_W2704YS8KYQB.2~7PD1WLYHOFZ5.1 size=1048576 2023-12-03T11:42:13.205 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.204+0000 7f8723d84780 1 > prepared part key=_multipart_W2704YS8KYQB.2~7PD1WLYHOFZ5.2 size=737857 2023-12-03T11:42:13.205 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.204+0000 7f8723d84780 1 > prepared multipart upload key=W2704YS8KYQB upload=7PD1WLYHOFZ5 tag=41VO4QNWVFGQ type=write size=3883585 2023-12-03T11:42:13.206 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.205+0000 7f8723d84780 1 < completed write operation key=AB0SN0E49Z5F tag=R6LRL5LTWOL2 type=write size=565290 2023-12-03T11:42:13.208 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.207+0000 7f8723d84780 1 > prepared operation key=OPQPIDJ2PBVU tag=YP0EFIY8GMJ4 type=del size=763308 2023-12-03T11:42:13.209 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.208+0000 7f8723d84780 1 < completed part key=_multipart_VENJI0KD1XDW.2~JD60UPR24QJV.0 size=1048576 2023-12-03T11:42:13.210 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.209+0000 7f8723d84780 1 < completed part key=_multipart_VENJI0KD1XDW.2~JD60UPR24QJV.1 size=618706 2023-12-03T11:42:13.213 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.212+0000 7f8723d84780 1 < completed multipart upload key=VENJI0KD1XDW upload=JD60UPR24QJV tag=8BJFH9KQ1WVP type=write size=2715858 2023-12-03T11:42:13.216 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.215+0000 7f8723d84780 1 > prepared operation key=EITMJKL0LCYC tag=0XBVFW9FKUAZ type=del size=3095711 2023-12-03T11:42:13.217 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.216+0000 7f8723d84780 1 < completed delete operation key=5UYL15O31IHM tag=OCL05J3QXP0B type=del 2023-12-03T11:42:13.218 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.217+0000 7f8723d84780 1 > prepared operation key=EY9ZG5KOTBWM tag=V191POL8XI78 type=del size=1150841 2023-12-03T11:42:13.219 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.219+0000 7f8723d84780 1 < completed part key=_multipart_EY9ZG5KOTBWM.2~PFKBR1L174Y5.0 size=1048576 2023-12-03T11:42:13.221 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.220+0000 7f8723d84780 1 < completed part key=_multipart_EY9ZG5KOTBWM.2~PFKBR1L174Y5.1 size=200486 2023-12-03T11:42:13.223 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.222+0000 7f8723d84780 1 < completed multipart upload key=EY9ZG5KOTBWM upload=PFKBR1L174Y5 tag=GUC8D3GBA81O type=write size=2297638 2023-12-03T11:42:13.224 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.223+0000 7f8723d84780 1 > prepared operation key=CKABTI1EOAWB tag=ULJ2GC8BZQX3 type=del size=3188717 2023-12-03T11:42:13.225 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.224+0000 7f8723d84780 1 < completed delete operation key=EY9ZG5KOTBWM tag=H91U93YHOVBS type=del 2023-12-03T11:42:13.227 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.226+0000 7f8723d84780 1 > prepared part key=_multipart_VENJI0KD1XDW.2~WDYP2GEHL8QZ.0 size=1048576 2023-12-03T11:42:13.228 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.227+0000 7f8723d84780 1 > prepared part key=_multipart_VENJI0KD1XDW.2~WDYP2GEHL8QZ.1 size=657987 2023-12-03T11:42:13.228 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.227+0000 7f8723d84780 1 > prepared multipart upload key=VENJI0KD1XDW upload=WDYP2GEHL8QZ tag=KQAAVL2MEMAP type=write size=2755139 2023-12-03T11:42:13.230 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.229+0000 7f8723d84780 1 < completed delete operation key=FCA2R3HR61S2 tag=UWCE95E5HWJY type=del 2023-12-03T11:42:13.232 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.231+0000 7f8723d84780 1 > prepared part key=_multipart_10JRIKOZ16FY.2~BOSZ8AGE5PYM.0 size=1048576 2023-12-03T11:42:13.233 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.232+0000 7f8723d84780 1 > prepared part key=_multipart_10JRIKOZ16FY.2~BOSZ8AGE5PYM.1 size=949785 2023-12-03T11:42:13.234 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.232+0000 7f8723d84780 1 > prepared multipart upload key=10JRIKOZ16FY upload=BOSZ8AGE5PYM tag=IO7AM8XPB21Z type=write size=3046937 2023-12-03T11:42:13.234 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.233+0000 7f8723d84780 1 < completed part key=_multipart_10JRIKOZ16FY.2~DRIZE9JYQBFT.0 size=1048576 2023-12-03T11:42:13.235 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.234+0000 7f8723d84780 1 < completed part key=_multipart_10JRIKOZ16FY.2~DRIZE9JYQBFT.1 size=949667 2023-12-03T11:42:13.238 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.237+0000 7f8723d84780 1 < completed multipart upload key=10JRIKOZ16FY upload=DRIZE9JYQBFT tag=871L7R63PC7H type=write size=3046819 2023-12-03T11:42:13.239 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.238+0000 7f8723d84780 1 > prepared operation key=KS5J7E7KE2IJ tag=261LI7FZZYJV type=del size=280981 2023-12-03T11:42:13.240 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.239+0000 7f8723d84780 1 < completed delete operation key=TSTIBGVYUZZZ tag=ET7ZE90LSMWA type=del 2023-12-03T11:42:13.241 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.240+0000 7f8723d84780 1 > prepared operation key=J33T5S893LMV tag=KRGO8KTTK4WI type=del size=3527305 2023-12-03T11:42:13.242 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.241+0000 7f8723d84780 1 < completed write operation key=4I8PWBZOLDUG tag=XMX8UOQPIOH4 type=write size=381763 2023-12-03T11:42:13.244 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.243+0000 7f8723d84780 1 > prepared operation key=5UYL15O31IHM tag=J6QB51WT3II3 type=del size=2313376 2023-12-03T11:42:13.245 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.244+0000 7f8723d84780 1 < completed delete operation key=EY9ZG5KOTBWM tag=7TAZ45JTRIZX type=del 2023-12-03T11:42:13.247 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.246+0000 7f8723d84780 1 > prepared part key=_multipart_CKABTI1EOAWB.2~UJM5X30V2G7D.0 size=1048576 2023-12-03T11:42:13.248 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.247+0000 7f8723d84780 1 > prepared part key=_multipart_CKABTI1EOAWB.2~UJM5X30V2G7D.1 size=1048576 2023-12-03T11:42:13.248 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.247+0000 7f8723d84780 1 > prepared part key=_multipart_CKABTI1EOAWB.2~UJM5X30V2G7D.2 size=716437 2023-12-03T11:42:13.248 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.247+0000 7f8723d84780 1 > prepared multipart upload key=CKABTI1EOAWB upload=UJM5X30V2G7D tag=PY6S4WTB24HO type=write size=3862165 2023-12-03T11:42:13.250 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.249+0000 7f8723d84780 -1 < failed to complete operation key=J33T5S893LMV tag=3V8LCRU2OFXA type=del size=773444: (22) Invalid argument 2023-12-03T11:42:13.251 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.250+0000 7f8723d84780 1 > prepared operation key=M4VKPN6INFNZ tag=OLDOQZ51ASPI type=del size=3491990 2023-12-03T11:42:13.252 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.251+0000 7f8723d84780 1 < completed part key=_multipart_OPQPIDJ2PBVU.2~XL163ZG0414B.0 size=1048576 2023-12-03T11:42:13.253 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.252+0000 7f8723d84780 1 < completed part key=_multipart_OPQPIDJ2PBVU.2~XL163ZG0414B.1 size=1048576 2023-12-03T11:42:13.254 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.253+0000 7f8723d84780 1 < completed part key=_multipart_OPQPIDJ2PBVU.2~XL163ZG0414B.2 size=73758 2023-12-03T11:42:13.256 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.255+0000 7f8723d84780 1 < completed multipart upload key=OPQPIDJ2PBVU upload=XL163ZG0414B tag=6LL5LI1Q9IZE type=write size=3219486 2023-12-03T11:42:13.257 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.256+0000 7f8723d84780 1 > prepared operation key=OGACI7CRPMT7 tag=OLTI4DQFAMGO type=del size=1479391 2023-12-03T11:42:13.258 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.257+0000 7f8723d84780 1 < completed write operation key=AB0SN0E49Z5F tag=2ETUKG427YS3 type=write size=6803 2023-12-03T11:42:13.259 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.258+0000 7f8723d84780 1 > prepared operation key=OGACI7CRPMT7 tag=VS7P906OH2QZ type=del size=2401735 2023-12-03T11:42:13.261 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.260+0000 7f8723d84780 1 < suggested update operation key=EY9ZG5KOTBWM tag=JGQH5JKTIKN9 type=del size=326347 2023-12-03T11:42:13.262 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.261+0000 7f8723d84780 1 > prepared operation key=12XG7YPYTN4U tag=P9690O2GROOP type=del size=1157617 2023-12-03T11:42:13.264 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.263+0000 7f8723d84780 1 < completed write operation key=M4VKPN6INFNZ tag=GLT7XWJA62Z4 type=write size=462615 2023-12-03T11:42:13.265 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.264+0000 7f8723d84780 1 > prepared operation key=96RAVVSUKH0Y tag=185U97AW77C0 type=del size=3131257 2023-12-03T11:42:13.266 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.265+0000 7f8723d84780 1 < completed part key=_multipart_W2704YS8KYQB.2~7PD1WLYHOFZ5.0 size=1048576 2023-12-03T11:42:13.267 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.266+0000 7f8723d84780 1 < completed part key=_multipart_W2704YS8KYQB.2~7PD1WLYHOFZ5.1 size=1048576 2023-12-03T11:42:13.268 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.267+0000 7f8723d84780 1 < completed part key=_multipart_W2704YS8KYQB.2~7PD1WLYHOFZ5.2 size=737857 2023-12-03T11:42:13.269 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.268+0000 7f8723d84780 1 < completed multipart upload key=W2704YS8KYQB upload=7PD1WLYHOFZ5 tag=41VO4QNWVFGQ type=write size=3883585 2023-12-03T11:42:13.271 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.270+0000 7f8723d84780 1 > prepared part key=_multipart_Y6S7QI60GCLE.2~I62STYIJW9HZ.0 size=1048576 2023-12-03T11:42:13.272 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.271+0000 7f8723d84780 1 > prepared part key=_multipart_Y6S7QI60GCLE.2~I62STYIJW9HZ.1 size=1048576 2023-12-03T11:42:13.273 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.272+0000 7f8723d84780 1 > prepared part key=_multipart_Y6S7QI60GCLE.2~I62STYIJW9HZ.2 size=633932 2023-12-03T11:42:13.273 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.272+0000 7f8723d84780 1 > prepared multipart upload key=Y6S7QI60GCLE upload=I62STYIJW9HZ tag=2BK0KRG0FGW7 type=write size=3779660 2023-12-03T11:42:13.274 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.273+0000 7f8723d84780 1 < completed delete operation key=OPQPIDJ2PBVU tag=YP0EFIY8GMJ4 type=del 2023-12-03T11:42:13.275 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.274+0000 7f8723d84780 1 > prepared operation key=TSTIBGVYUZZZ tag=1TDTZEG1RETQ type=del size=1791806 2023-12-03T11:42:13.276 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.275+0000 7f8723d84780 1 < completed delete operation key=EITMJKL0LCYC tag=0XBVFW9FKUAZ type=del 2023-12-03T11:42:13.277 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.276+0000 7f8723d84780 1 > prepared operation key=7THZZ1J5LOZK tag=4AF9PVS81ABB type=del size=1066152 2023-12-03T11:42:13.278 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.277+0000 7f8723d84780 -1 < failed to complete operation key=EY9ZG5KOTBWM tag=V191POL8XI78 type=del size=1150841: (22) Invalid argument 2023-12-03T11:42:13.280 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.279+0000 7f8723d84780 1 > prepared operation key=O7VVHXLDSY57 tag=M43THKP2ZVK2 type=write size=615340 2023-12-03T11:42:13.281 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.280+0000 7f8723d84780 1 < completed delete operation key=CKABTI1EOAWB tag=ULJ2GC8BZQX3 type=del 2023-12-03T11:42:13.282 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.281+0000 7f8723d84780 1 > prepared operation key=Y6S7QI60GCLE tag=53WYDPTEGG8R type=write size=833588 2023-12-03T11:42:13.283 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.282+0000 7f8723d84780 1 < completed part key=_multipart_VENJI0KD1XDW.2~WDYP2GEHL8QZ.0 size=1048576 2023-12-03T11:42:13.284 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.283+0000 7f8723d84780 1 < completed part key=_multipart_VENJI0KD1XDW.2~WDYP2GEHL8QZ.1 size=657987 2023-12-03T11:42:13.286 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.285+0000 7f8723d84780 1 < completed multipart upload key=VENJI0KD1XDW upload=WDYP2GEHL8QZ tag=KQAAVL2MEMAP type=write size=2755139 2023-12-03T11:42:13.288 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.287+0000 7f8723d84780 1 > prepared part key=_multipart_D3JEVEY0E29E.2~3DLC1EOISVIP.0 size=1048576 2023-12-03T11:42:13.289 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.288+0000 7f8723d84780 1 > prepared part key=_multipart_D3JEVEY0E29E.2~3DLC1EOISVIP.1 size=1048576 2023-12-03T11:42:13.289 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.288+0000 7f8723d84780 1 > prepared part key=_multipart_D3JEVEY0E29E.2~3DLC1EOISVIP.2 size=653117 2023-12-03T11:42:13.289 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.288+0000 7f8723d84780 1 > prepared multipart upload key=D3JEVEY0E29E upload=3DLC1EOISVIP tag=QC192OWL2MOF type=write size=3798845 2023-12-03T11:42:13.291 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.290+0000 7f8723d84780 1 < completed part key=_multipart_10JRIKOZ16FY.2~BOSZ8AGE5PYM.0 size=1048576 2023-12-03T11:42:13.292 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.291+0000 7f8723d84780 1 < completed part key=_multipart_10JRIKOZ16FY.2~BOSZ8AGE5PYM.1 size=949785 2023-12-03T11:42:13.294 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.293+0000 7f8723d84780 1 < completed multipart upload key=10JRIKOZ16FY upload=BOSZ8AGE5PYM tag=IO7AM8XPB21Z type=write size=3046937 2023-12-03T11:42:13.295 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.294+0000 7f8723d84780 1 > prepared operation key=M4VKPN6INFNZ tag=QPRVK11VEVSU type=del size=3125692 2023-12-03T11:42:13.296 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.295+0000 7f8723d84780 1 < completed delete operation key=KS5J7E7KE2IJ tag=261LI7FZZYJV type=del 2023-12-03T11:42:13.298 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.297+0000 7f8723d84780 1 > prepared part key=_multipart_KS5J7E7KE2IJ.2~5OLJL9P0KHZ7.0 size=1048576 2023-12-03T11:42:13.301 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.300+0000 7f8723d84780 1 > prepared part key=_multipart_KS5J7E7KE2IJ.2~5OLJL9P0KHZ7.1 size=915840 2023-12-03T11:42:13.301 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.300+0000 7f8723d84780 1 > prepared multipart upload key=KS5J7E7KE2IJ upload=5OLJL9P0KHZ7 tag=RD9LCNL1JM56 type=write size=3012992 2023-12-03T11:42:13.302 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.301+0000 7f8723d84780 1 < completed delete operation key=J33T5S893LMV tag=KRGO8KTTK4WI type=del 2023-12-03T11:42:13.303 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.302+0000 7f8723d84780 1 > prepared operation key=O7VVHXLDSY57 tag=9UFKWT5L6DZC type=write size=490064 2023-12-03T11:42:13.304 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.303+0000 7f8723d84780 1 < completed delete operation key=5UYL15O31IHM tag=J6QB51WT3II3 type=del 2023-12-03T11:42:13.306 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.305+0000 7f8723d84780 1 > prepared operation key=EY9ZG5KOTBWM tag=5HVVVI4PSPLY type=del size=2117241 2023-12-03T11:42:13.307 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.306+0000 7f8723d84780 1 < completed part key=_multipart_CKABTI1EOAWB.2~UJM5X30V2G7D.0 size=1048576 2023-12-03T11:42:13.308 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.307+0000 7f8723d84780 1 < completed part key=_multipart_CKABTI1EOAWB.2~UJM5X30V2G7D.1 size=1048576 2023-12-03T11:42:13.309 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.308+0000 7f8723d84780 1 < completed part key=_multipart_CKABTI1EOAWB.2~UJM5X30V2G7D.2 size=716437 2023-12-03T11:42:13.311 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.310+0000 7f8723d84780 1 < completed multipart upload key=CKABTI1EOAWB upload=UJM5X30V2G7D tag=PY6S4WTB24HO type=write size=3862165 2023-12-03T11:42:13.313 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.312+0000 7f8723d84780 1 > prepared part key=_multipart_W2704YS8KYQB.2~PWKRWNTYKMNL.0 size=1048576 2023-12-03T11:42:13.314 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.313+0000 7f8723d84780 1 > prepared part key=_multipart_W2704YS8KYQB.2~PWKRWNTYKMNL.1 size=1048576 2023-12-03T11:42:13.315 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.314+0000 7f8723d84780 1 > prepared part key=_multipart_W2704YS8KYQB.2~PWKRWNTYKMNL.2 size=658147 2023-12-03T11:42:13.315 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.314+0000 7f8723d84780 1 > prepared multipart upload key=W2704YS8KYQB upload=PWKRWNTYKMNL tag=MWL7R322STGP type=write size=3803875 2023-12-03T11:42:13.317 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.315+0000 7f8723d84780 1 < completed delete operation key=M4VKPN6INFNZ tag=OLDOQZ51ASPI type=del 2023-12-03T11:42:13.318 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.317+0000 7f8723d84780 1 > prepared operation key=LCK58DDM5XU9 tag=BLNZNXTD69UP type=del size=1330441 2023-12-03T11:42:13.319 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.318+0000 7f8723d84780 1 < completed delete operation key=OGACI7CRPMT7 tag=OLTI4DQFAMGO type=del 2023-12-03T11:42:13.321 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.320+0000 7f8723d84780 1 > prepared part key=_multipart_5UYL15O31IHM.2~HXQR355GE8YT.0 size=10501 2023-12-03T11:42:13.321 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.320+0000 7f8723d84780 1 > prepared multipart upload key=5UYL15O31IHM upload=HXQR355GE8YT tag=J3SWFFE1UEE0 type=write size=1059077 2023-12-03T11:42:13.322 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.321+0000 7f8723d84780 1 < completed delete operation key=OGACI7CRPMT7 tag=VS7P906OH2QZ type=del 2023-12-03T11:42:13.325 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.323+0000 7f8723d84780 1 > prepared part key=_multipart_K83BTR5BOLZE.2~SPT0ZX7CVKEU.0 size=1048576 2023-12-03T11:42:13.325 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.324+0000 7f8723d84780 1 > prepared part key=_multipart_K83BTR5BOLZE.2~SPT0ZX7CVKEU.1 size=1048576 2023-12-03T11:42:13.326 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.325+0000 7f8723d84780 1 > prepared part key=_multipart_K83BTR5BOLZE.2~SPT0ZX7CVKEU.2 size=177334 2023-12-03T11:42:13.326 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.325+0000 7f8723d84780 1 > prepared multipart upload key=K83BTR5BOLZE upload=SPT0ZX7CVKEU tag=H1QBQFDVVU96 type=write size=3323062 2023-12-03T11:42:13.328 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.326+0000 7f8723d84780 1 < completed delete operation key=12XG7YPYTN4U tag=P9690O2GROOP type=del 2023-12-03T11:42:13.329 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.328+0000 7f8723d84780 1 > prepared operation key=931GNEXBHH35 tag=TCK6F9WH9RYQ type=del size=2349534 2023-12-03T11:42:13.330 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.329+0000 7f8723d84780 1 < completed delete operation key=96RAVVSUKH0Y tag=185U97AW77C0 type=del 2023-12-03T11:42:13.332 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.331+0000 7f8723d84780 1 > prepared operation key=12XG7YPYTN4U tag=K06W455P83AG type=del size=1137372 2023-12-03T11:42:13.333 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.332+0000 7f8723d84780 1 < completed part key=_multipart_Y6S7QI60GCLE.2~I62STYIJW9HZ.0 size=1048576 2023-12-03T11:42:13.334 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.333+0000 7f8723d84780 1 < completed part key=_multipart_Y6S7QI60GCLE.2~I62STYIJW9HZ.1 size=1048576 2023-12-03T11:42:13.335 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.334+0000 7f8723d84780 1 < completed part key=_multipart_Y6S7QI60GCLE.2~I62STYIJW9HZ.2 size=633932 2023-12-03T11:42:13.337 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.336+0000 7f8723d84780 1 < completed multipart upload key=Y6S7QI60GCLE upload=I62STYIJW9HZ tag=2BK0KRG0FGW7 type=write size=3779660 2023-12-03T11:42:13.341 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.340+0000 7f8723d84780 1 > prepared part key=_multipart_10JRIKOZ16FY.2~FD6KVE0EUILT.0 size=1048576 2023-12-03T11:42:13.342 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.341+0000 7f8723d84780 1 > prepared part key=_multipart_10JRIKOZ16FY.2~FD6KVE0EUILT.1 size=775740 2023-12-03T11:42:13.342 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.341+0000 7f8723d84780 1 > prepared multipart upload key=10JRIKOZ16FY upload=FD6KVE0EUILT tag=IZX2NFUV4IHK type=write size=2872892 2023-12-03T11:42:13.344 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.343+0000 7f8723d84780 1 < completed delete operation key=TSTIBGVYUZZZ tag=1TDTZEG1RETQ type=del 2023-12-03T11:42:13.346 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.345+0000 7f8723d84780 1 > prepared part key=_multipart_K83BTR5BOLZE.2~TVYMKBX0AS46.0 size=1048576 2023-12-03T11:42:13.347 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.346+0000 7f8723d84780 1 > prepared part key=_multipart_K83BTR5BOLZE.2~TVYMKBX0AS46.1 size=1041 2023-12-03T11:42:13.347 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.346+0000 7f8723d84780 1 > prepared multipart upload key=K83BTR5BOLZE upload=TVYMKBX0AS46 tag=341SHLSD6Y07 type=write size=2098193 2023-12-03T11:42:13.349 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.348+0000 7f8723d84780 1 < suggested remove operation key=7THZZ1J5LOZK tag=4AF9PVS81ABB type=del 2023-12-03T11:42:13.352 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.351+0000 7f8723d84780 1 > prepared part key=_multipart_UWS266H06VDK.2~UPI7PO792HH4.0 size=1048576 2023-12-03T11:42:13.352 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.351+0000 7f8723d84780 1 > prepared part key=_multipart_UWS266H06VDK.2~UPI7PO792HH4.1 size=761499 2023-12-03T11:42:13.352 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.351+0000 7f8723d84780 1 > prepared multipart upload key=UWS266H06VDK upload=UPI7PO792HH4 tag=XFR9CKHWNE2L type=write size=2858651 2023-12-03T11:42:13.353 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.352+0000 7f8723d84780 1 < completed write operation key=O7VVHXLDSY57 tag=M43THKP2ZVK2 type=write size=615340 2023-12-03T11:42:13.355 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.354+0000 7f8723d84780 1 > prepared operation key=UWS266H06VDK tag=EBGHLKOMU71R type=del size=2847089 2023-12-03T11:42:13.357 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.356+0000 7f8723d84780 1 < suggested remove operation key=Y6S7QI60GCLE tag=53WYDPTEGG8R type=write 2023-12-03T11:42:13.358 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.357+0000 7f8723d84780 1 > prepared operation key=DMQX2DGDLU7D tag=JKM1SHV7Y9SO type=del size=1253922 2023-12-03T11:42:13.359 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.359+0000 7f8723d84780 1 < completed part key=_multipart_D3JEVEY0E29E.2~3DLC1EOISVIP.0 size=1048576 2023-12-03T11:42:13.360 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.359+0000 7f8723d84780 1 < completed part key=_multipart_D3JEVEY0E29E.2~3DLC1EOISVIP.1 size=1048576 2023-12-03T11:42:13.361 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.360+0000 7f8723d84780 1 < completed part key=_multipart_D3JEVEY0E29E.2~3DLC1EOISVIP.2 size=653117 2023-12-03T11:42:13.364 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.362+0000 7f8723d84780 1 < completed multipart upload key=D3JEVEY0E29E upload=3DLC1EOISVIP tag=QC192OWL2MOF type=write size=3798845 2023-12-03T11:42:13.364 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.363+0000 7f8723d84780 1 > prepared operation key=D3JEVEY0E29E tag=G0AXBJ27F9R8 type=del size=2327245 2023-12-03T11:42:13.367 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.366+0000 7f8723d84780 1 < suggested remove operation key=M4VKPN6INFNZ tag=QPRVK11VEVSU type=del 2023-12-03T11:42:13.369 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.368+0000 7f8723d84780 1 > prepared part key=_multipart_OGACI7CRPMT7.2~QJT3HOHBVY6C.0 size=1048576 2023-12-03T11:42:13.370 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.369+0000 7f8723d84780 1 > prepared part key=_multipart_OGACI7CRPMT7.2~QJT3HOHBVY6C.1 size=994589 2023-12-03T11:42:13.370 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.369+0000 7f8723d84780 1 > prepared multipart upload key=OGACI7CRPMT7 upload=QJT3HOHBVY6C tag=G77153PJLBL5 type=write size=3091741 2023-12-03T11:42:13.371 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.370+0000 7f8723d84780 1 < completed part key=_multipart_KS5J7E7KE2IJ.2~5OLJL9P0KHZ7.0 size=1048576 2023-12-03T11:42:13.372 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.371+0000 7f8723d84780 1 < completed part key=_multipart_KS5J7E7KE2IJ.2~5OLJL9P0KHZ7.1 size=915840 2023-12-03T11:42:13.374 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.373+0000 7f8723d84780 1 < completed multipart upload key=KS5J7E7KE2IJ upload=5OLJL9P0KHZ7 tag=RD9LCNL1JM56 type=write size=3012992 2023-12-03T11:42:13.377 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.375+0000 7f8723d84780 1 > prepared part key=_multipart_FCA2R3HR61S2.2~O1Y3WW9236B9.0 size=262889 2023-12-03T11:42:13.377 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.375+0000 7f8723d84780 1 > prepared multipart upload key=FCA2R3HR61S2 upload=O1Y3WW9236B9 tag=PE4GXBIUYR7M type=write size=1311465 2023-12-03T11:42:13.377 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.376+0000 7f8723d84780 1 < completed write operation key=O7VVHXLDSY57 tag=9UFKWT5L6DZC type=write size=490064 2023-12-03T11:42:13.378 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.377+0000 7f8723d84780 1 > prepared operation key=EY9ZG5KOTBWM tag=SL57FPUY1RZC type=del size=1954310 2023-12-03T11:42:13.379 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.378+0000 7f8723d84780 1 < completed delete operation key=EY9ZG5KOTBWM tag=5HVVVI4PSPLY type=del 2023-12-03T11:42:13.381 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.380+0000 7f8723d84780 1 > prepared operation key=J33T5S893LMV tag=WLSGP8KQTY74 type=del size=2229056 2023-12-03T11:42:13.382 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.381+0000 7f8723d84780 1 < completed part key=_multipart_W2704YS8KYQB.2~PWKRWNTYKMNL.0 size=1048576 2023-12-03T11:42:13.382 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.381+0000 7f8723d84780 1 < completed part key=_multipart_W2704YS8KYQB.2~PWKRWNTYKMNL.1 size=1048576 2023-12-03T11:42:13.383 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.382+0000 7f8723d84780 1 < completed part key=_multipart_W2704YS8KYQB.2~PWKRWNTYKMNL.2 size=658147 2023-12-03T11:42:13.385 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.384+0000 7f8723d84780 1 < completed multipart upload key=W2704YS8KYQB upload=PWKRWNTYKMNL tag=MWL7R322STGP type=write size=3803875 2023-12-03T11:42:13.386 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.385+0000 7f8723d84780 1 > prepared operation key=12XG7YPYTN4U tag=PW2TQ7R01V35 type=del size=217860 2023-12-03T11:42:13.389 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.388+0000 7f8723d84780 1 < suggested remove operation key=LCK58DDM5XU9 tag=BLNZNXTD69UP type=del 2023-12-03T11:42:13.390 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.389+0000 7f8723d84780 1 > prepared operation key=HIU6L0NQ8Q95 tag=5ADQRN97LVQM type=del size=2786304 2023-12-03T11:42:13.391 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.390+0000 7f8723d84780 1 < completed part key=_multipart_5UYL15O31IHM.2~HXQR355GE8YT.0 size=10501 2023-12-03T11:42:13.393 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.392+0000 7f8723d84780 1 < completed multipart upload key=5UYL15O31IHM upload=HXQR355GE8YT tag=J3SWFFE1UEE0 type=write size=1059077 2023-12-03T11:42:13.395 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.394+0000 7f8723d84780 1 > prepared part key=_multipart_D3JEVEY0E29E.2~EHJ1I04MHZNE.0 size=1048576 2023-12-03T11:42:13.395 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.394+0000 7f8723d84780 1 > prepared part key=_multipart_D3JEVEY0E29E.2~EHJ1I04MHZNE.1 size=788385 2023-12-03T11:42:13.395 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.394+0000 7f8723d84780 1 > prepared multipart upload key=D3JEVEY0E29E upload=EHJ1I04MHZNE tag=66DQI54LH3SX type=write size=2885537 2023-12-03T11:42:13.397 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.395+0000 7f8723d84780 1 < canceled part key=_multipart_K83BTR5BOLZE.2~SPT0ZX7CVKEU.0 size=1048576 2023-12-03T11:42:13.397 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.396+0000 7f8723d84780 1 < completed part key=_multipart_K83BTR5BOLZE.2~SPT0ZX7CVKEU.1 size=1048576 2023-12-03T11:42:13.397 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.396+0000 7f8723d84780 1 < completed part key=_multipart_K83BTR5BOLZE.2~SPT0ZX7CVKEU.2 size=177334 2023-12-03T11:42:13.399 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.398+0000 7f8723d84780 1 < canceled multipart upload key=K83BTR5BOLZE upload=SPT0ZX7CVKEU tag=H1QBQFDVVU96 type=write size=3323062 2023-12-03T11:42:13.401 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.401+0000 7f8723d84780 1 > prepared part key=_multipart_CKABTI1EOAWB.2~MK9C3ANP18H0.0 size=1048576 2023-12-03T11:42:13.403 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.402+0000 7f8723d84780 1 > prepared part key=_multipart_CKABTI1EOAWB.2~MK9C3ANP18H0.1 size=726842 2023-12-03T11:42:13.403 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.402+0000 7f8723d84780 1 > prepared multipart upload key=CKABTI1EOAWB upload=MK9C3ANP18H0 tag=R0ZU0T2AQF35 type=write size=2823994 2023-12-03T11:42:13.404 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.403+0000 7f8723d84780 1 < completed delete operation key=931GNEXBHH35 tag=TCK6F9WH9RYQ type=del 2023-12-03T11:42:13.406 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.404+0000 7f8723d84780 1 > prepared operation key=4I8PWBZOLDUG tag=POT11HF54SBD type=del size=628552 2023-12-03T11:42:13.407 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.406+0000 7f8723d84780 1 < completed delete operation key=12XG7YPYTN4U tag=K06W455P83AG type=del 2023-12-03T11:42:13.408 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.407+0000 7f8723d84780 1 > prepared operation key=HIU6L0NQ8Q95 tag=ZORACEC8LB5E type=write size=598717 2023-12-03T11:42:13.409 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.408+0000 7f8723d84780 1 < completed part key=_multipart_10JRIKOZ16FY.2~FD6KVE0EUILT.0 size=1048576 2023-12-03T11:42:13.410 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.409+0000 7f8723d84780 1 < completed part key=_multipart_10JRIKOZ16FY.2~FD6KVE0EUILT.1 size=775740 2023-12-03T11:42:13.413 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.412+0000 7f8723d84780 1 < completed multipart upload key=10JRIKOZ16FY upload=FD6KVE0EUILT tag=IZX2NFUV4IHK type=write size=2872892 2023-12-03T11:42:13.414 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.413+0000 7f8723d84780 1 > prepared operation key=HIU6L0NQ8Q95 tag=TIXSTVDES66A type=del size=3073635 2023-12-03T11:42:13.416 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.415+0000 7f8723d84780 1 < completed part key=_multipart_K83BTR5BOLZE.2~TVYMKBX0AS46.0 size=1048576 2023-12-03T11:42:13.417 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.416+0000 7f8723d84780 1 < completed part key=_multipart_K83BTR5BOLZE.2~TVYMKBX0AS46.1 size=1041 2023-12-03T11:42:13.419 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.418+0000 7f8723d84780 1 < completed multipart upload key=K83BTR5BOLZE upload=TVYMKBX0AS46 tag=341SHLSD6Y07 type=write size=2098193 2023-12-03T11:42:13.421 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.420+0000 7f8723d84780 1 > prepared part key=_multipart_7THZZ1J5LOZK.2~5JBZLK8DJ9II.0 size=68844 2023-12-03T11:42:13.421 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.420+0000 7f8723d84780 1 > prepared multipart upload key=7THZZ1J5LOZK upload=5JBZLK8DJ9II tag=KZ4S0K7HI3FG type=write size=1117420 2023-12-03T11:42:13.422 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.421+0000 7f8723d84780 1 < completed part key=_multipart_UWS266H06VDK.2~UPI7PO792HH4.0 size=1048576 2023-12-03T11:42:13.423 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.422+0000 7f8723d84780 1 < completed part key=_multipart_UWS266H06VDK.2~UPI7PO792HH4.1 size=761499 2023-12-03T11:42:13.425 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.424+0000 7f8723d84780 1 < completed multipart upload key=UWS266H06VDK upload=UPI7PO792HH4 tag=XFR9CKHWNE2L type=write size=2858651 2023-12-03T11:42:13.426 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.425+0000 7f8723d84780 1 > prepared operation key=DMQX2DGDLU7D tag=MJ4NSHGQ17NX type=del size=768365 2023-12-03T11:42:13.427 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.426+0000 7f8723d84780 1 < completed delete operation key=UWS266H06VDK tag=EBGHLKOMU71R type=del 2023-12-03T11:42:13.429 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.428+0000 7f8723d84780 1 > prepared operation key=12XG7YPYTN4U tag=S3U95T56YVV7 type=write size=520508 2023-12-03T11:42:13.430 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.429+0000 7f8723d84780 1 < completed delete operation key=DMQX2DGDLU7D tag=JKM1SHV7Y9SO type=del 2023-12-03T11:42:13.431 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.430+0000 7f8723d84780 1 > prepared operation key=LMVO6CVEPN3K tag=82M51RW225C8 type=del size=3653842 2023-12-03T11:42:13.432 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.432+0000 7f8723d84780 1 < completed delete operation key=D3JEVEY0E29E tag=G0AXBJ27F9R8 type=del 2023-12-03T11:42:13.434 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.433+0000 7f8723d84780 1 > prepared operation key=EITMJKL0LCYC tag=ESIXU1EQIFVG type=del size=2020599 2023-12-03T11:42:13.435 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.434+0000 7f8723d84780 1 < completed part key=_multipart_OGACI7CRPMT7.2~QJT3HOHBVY6C.0 size=1048576 2023-12-03T11:42:13.436 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.435+0000 7f8723d84780 1 < completed part key=_multipart_OGACI7CRPMT7.2~QJT3HOHBVY6C.1 size=994589 2023-12-03T11:42:13.438 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.437+0000 7f8723d84780 1 < completed multipart upload key=OGACI7CRPMT7 upload=QJT3HOHBVY6C tag=G77153PJLBL5 type=write size=3091741 2023-12-03T11:42:13.441 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.439+0000 7f8723d84780 1 > prepared part key=_multipart_7THZZ1J5LOZK.2~QQUODMHJ2WB7.0 size=816786 2023-12-03T11:42:13.441 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.439+0000 7f8723d84780 1 > prepared multipart upload key=7THZZ1J5LOZK upload=QQUODMHJ2WB7 tag=KX77IICBQE5I type=write size=1865362 2023-12-03T11:42:13.441 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.440+0000 7f8723d84780 1 < canceled part key=_multipart_FCA2R3HR61S2.2~O1Y3WW9236B9.0 size=262889 2023-12-03T11:42:13.443 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.442+0000 7f8723d84780 1 < canceled multipart upload key=FCA2R3HR61S2 upload=O1Y3WW9236B9 tag=PE4GXBIUYR7M type=write size=1311465 2023-12-03T11:42:13.444 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.443+0000 7f8723d84780 1 > prepared operation key=AB0SN0E49Z5F tag=9BBIEMN5VSM9 type=del size=2448509 2023-12-03T11:42:13.446 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.445+0000 7f8723d84780 1 < suggested remove operation key=EY9ZG5KOTBWM tag=SL57FPUY1RZC type=del 2023-12-03T11:42:13.448 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.447+0000 7f8723d84780 1 > prepared operation key=FCA2R3HR61S2 tag=2X9V9UIP3C89 type=del size=4065168 2023-12-03T11:42:13.449 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.448+0000 7f8723d84780 1 < completed delete operation key=J33T5S893LMV tag=WLSGP8KQTY74 type=del 2023-12-03T11:42:13.450 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.449+0000 7f8723d84780 1 > prepared operation key=OPQPIDJ2PBVU tag=46A9Z4F4RN1C type=del size=2881694 2023-12-03T11:42:13.451 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.450+0000 7f8723d84780 1 < completed delete operation key=12XG7YPYTN4U tag=PW2TQ7R01V35 type=del 2023-12-03T11:42:13.453 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.452+0000 7f8723d84780 1 > prepared operation key=K83BTR5BOLZE tag=KPAJHX41Q440 type=write size=233242 2023-12-03T11:42:13.454 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.453+0000 7f8723d84780 1 < completed delete operation key=HIU6L0NQ8Q95 tag=5ADQRN97LVQM type=del 2023-12-03T11:42:13.455 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.454+0000 7f8723d84780 1 > prepared operation key=D3JEVEY0E29E tag=4D1SPUM88XCH type=del size=1681042 2023-12-03T11:42:13.456 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.455+0000 7f8723d84780 1 < completed part key=_multipart_D3JEVEY0E29E.2~EHJ1I04MHZNE.0 size=1048576 2023-12-03T11:42:13.457 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.456+0000 7f8723d84780 1 < completed part key=_multipart_D3JEVEY0E29E.2~EHJ1I04MHZNE.1 size=788385 2023-12-03T11:42:13.460 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.459+0000 7f8723d84780 1 < completed multipart upload key=D3JEVEY0E29E upload=EHJ1I04MHZNE tag=66DQI54LH3SX type=write size=2885537 2023-12-03T11:42:13.462 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.461+0000 7f8723d84780 1 > prepared part key=_multipart_LMVO6CVEPN3K.2~YV2YWNZ1OFPP.0 size=1048576 2023-12-03T11:42:13.463 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.462+0000 7f8723d84780 1 > prepared part key=_multipart_LMVO6CVEPN3K.2~YV2YWNZ1OFPP.1 size=1048576 2023-12-03T11:42:13.464 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.462+0000 7f8723d84780 1 > prepared part key=_multipart_LMVO6CVEPN3K.2~YV2YWNZ1OFPP.2 size=203044 2023-12-03T11:42:13.464 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.462+0000 7f8723d84780 1 > prepared multipart upload key=LMVO6CVEPN3K upload=YV2YWNZ1OFPP tag=EGRNTH9ERK67 type=write size=3348772 2023-12-03T11:42:13.464 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.463+0000 7f8723d84780 1 < completed part key=_multipart_CKABTI1EOAWB.2~MK9C3ANP18H0.0 size=1048576 2023-12-03T11:42:13.465 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.464+0000 7f8723d84780 1 < completed part key=_multipart_CKABTI1EOAWB.2~MK9C3ANP18H0.1 size=726842 2023-12-03T11:42:13.467 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.466+0000 7f8723d84780 1 < completed multipart upload key=CKABTI1EOAWB upload=MK9C3ANP18H0 tag=R0ZU0T2AQF35 type=write size=2823994 2023-12-03T11:42:13.469 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.468+0000 7f8723d84780 1 > prepared operation key=W2704YS8KYQB tag=MYWJNIILD2WQ type=del size=2749761 2023-12-03T11:42:13.470 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.469+0000 7f8723d84780 1 < canceled operation key=4I8PWBZOLDUG tag=POT11HF54SBD type=del size=628552 2023-12-03T11:42:13.471 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.470+0000 7f8723d84780 1 > prepared operation key=O7VVHXLDSY57 tag=CJCDT71W7G4J type=del size=3015956 2023-12-03T11:42:13.472 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.471+0000 7f8723d84780 1 < completed write operation key=HIU6L0NQ8Q95 tag=ZORACEC8LB5E type=write size=598717 2023-12-03T11:42:13.474 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.473+0000 7f8723d84780 1 > prepared part key=_multipart_AB0SN0E49Z5F.2~NX0KUE8HGDTA.0 size=744858 2023-12-03T11:42:13.474 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.473+0000 7f8723d84780 1 > prepared multipart upload key=AB0SN0E49Z5F upload=NX0KUE8HGDTA tag=0VK8S9301QZ5 type=write size=1793434 2023-12-03T11:42:13.475 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.474+0000 7f8723d84780 1 < completed delete operation key=HIU6L0NQ8Q95 tag=TIXSTVDES66A type=del 2023-12-03T11:42:13.477 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.476+0000 7f8723d84780 1 > prepared part key=_multipart_12XG7YPYTN4U.2~BXR72C9V58DI.0 size=1048576 2023-12-03T11:42:13.478 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.477+0000 7f8723d84780 1 > prepared part key=_multipart_12XG7YPYTN4U.2~BXR72C9V58DI.1 size=894783 2023-12-03T11:42:13.478 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.477+0000 7f8723d84780 1 > prepared multipart upload key=12XG7YPYTN4U upload=BXR72C9V58DI tag=5BLKX88EN9RZ type=write size=2991935 2023-12-03T11:42:13.479 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.478+0000 7f8723d84780 1 < completed part key=_multipart_7THZZ1J5LOZK.2~5JBZLK8DJ9II.0 size=68844 2023-12-03T11:42:13.481 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.480+0000 7f8723d84780 1 < completed multipart upload key=7THZZ1J5LOZK upload=5JBZLK8DJ9II tag=KZ4S0K7HI3FG type=write size=1117420 2023-12-03T11:42:13.483 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.482+0000 7f8723d84780 1 > prepared part key=_multipart_LMVO6CVEPN3K.2~G5R1HT5T5XT4.0 size=1048576 2023-12-03T11:42:13.485 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.484+0000 7f8723d84780 1 > prepared part key=_multipart_LMVO6CVEPN3K.2~G5R1HT5T5XT4.1 size=1048576 2023-12-03T11:42:13.486 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.485+0000 7f8723d84780 1 > prepared part key=_multipart_LMVO6CVEPN3K.2~G5R1HT5T5XT4.2 size=702670 2023-12-03T11:42:13.486 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.485+0000 7f8723d84780 1 > prepared multipart upload key=LMVO6CVEPN3K upload=G5R1HT5T5XT4 tag=BRWOTEVZPVOF type=write size=3848398 2023-12-03T11:42:13.487 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.486+0000 7f8723d84780 1 < completed delete operation key=DMQX2DGDLU7D tag=MJ4NSHGQ17NX type=del 2023-12-03T11:42:13.488 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.487+0000 7f8723d84780 1 > prepared operation key=5UYL15O31IHM tag=W32JTGI3U63X type=del size=2034496 2023-12-03T11:42:13.489 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.488+0000 7f8723d84780 1 < completed write operation key=12XG7YPYTN4U tag=S3U95T56YVV7 type=write size=520508 2023-12-03T11:42:13.491 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.490+0000 7f8723d84780 1 > prepared part key=_multipart_AB0SN0E49Z5F.2~B44YSPQKTJD1.0 size=1048576 2023-12-03T11:42:13.492 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.491+0000 7f8723d84780 1 > prepared part key=_multipart_AB0SN0E49Z5F.2~B44YSPQKTJD1.1 size=378139 2023-12-03T11:42:13.492 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.491+0000 7f8723d84780 1 > prepared multipart upload key=AB0SN0E49Z5F upload=B44YSPQKTJD1 tag=691HTPV7I0BJ type=write size=2475291 2023-12-03T11:42:13.494 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.493+0000 7f8723d84780 1 < completed delete operation key=LMVO6CVEPN3K tag=82M51RW225C8 type=del 2023-12-03T11:42:13.496 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.495+0000 7f8723d84780 1 > prepared part key=_multipart_7THZZ1J5LOZK.2~5SA8EJHBO8MM.0 size=1048576 2023-12-03T11:42:13.497 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.496+0000 7f8723d84780 1 > prepared part key=_multipart_7THZZ1J5LOZK.2~5SA8EJHBO8MM.1 size=1048576 2023-12-03T11:42:13.498 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.497+0000 7f8723d84780 1 > prepared part key=_multipart_7THZZ1J5LOZK.2~5SA8EJHBO8MM.2 size=83445 2023-12-03T11:42:13.498 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.497+0000 7f8723d84780 1 > prepared multipart upload key=7THZZ1J5LOZK upload=5SA8EJHBO8MM tag=LRI8RMAL97C4 type=write size=3229173 2023-12-03T11:42:13.499 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.498+0000 7f8723d84780 1 < completed delete operation key=EITMJKL0LCYC tag=ESIXU1EQIFVG type=del 2023-12-03T11:42:13.501 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.500+0000 7f8723d84780 1 > prepared part key=_multipart_K83BTR5BOLZE.2~BEH1EXH2Y708.0 size=1048576 2023-12-03T11:42:13.502 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.501+0000 7f8723d84780 1 > prepared part key=_multipart_K83BTR5BOLZE.2~BEH1EXH2Y708.1 size=1048576 2023-12-03T11:42:13.503 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.502+0000 7f8723d84780 1 > prepared part key=_multipart_K83BTR5BOLZE.2~BEH1EXH2Y708.2 size=987474 2023-12-03T11:42:13.503 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.502+0000 7f8723d84780 1 > prepared multipart upload key=K83BTR5BOLZE upload=BEH1EXH2Y708 tag=RLQ97S532AW8 type=write size=4133202 2023-12-03T11:42:13.504 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.503+0000 7f8723d84780 1 < completed part key=_multipart_7THZZ1J5LOZK.2~QQUODMHJ2WB7.0 size=816786 2023-12-03T11:42:13.506 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.505+0000 7f8723d84780 1 < completed multipart upload key=7THZZ1J5LOZK upload=QQUODMHJ2WB7 tag=KX77IICBQE5I type=write size=1865362 2023-12-03T11:42:13.507 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.506+0000 7f8723d84780 1 > prepared operation key=5UYL15O31IHM tag=47OS006JUQWM type=write size=20544 2023-12-03T11:42:13.510 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.509+0000 7f8723d84780 1 < suggested update operation key=AB0SN0E49Z5F tag=9BBIEMN5VSM9 type=del size=2448509 2023-12-03T11:42:13.511 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.510+0000 7f8723d84780 1 > prepared operation key=UWS266H06VDK tag=DNVP3BDRRG07 type=del size=1519520 2023-12-03T11:42:13.512 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.511+0000 7f8723d84780 1 < completed delete operation key=FCA2R3HR61S2 tag=2X9V9UIP3C89 type=del 2023-12-03T11:42:13.513 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.512+0000 7f8723d84780 1 > prepared operation key=CKABTI1EOAWB tag=5FMZAZE81H3F type=del size=3107669 2023-12-03T11:42:13.514 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.513+0000 7f8723d84780 1 < completed delete operation key=OPQPIDJ2PBVU tag=46A9Z4F4RN1C type=del 2023-12-03T11:42:13.517 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.516+0000 7f8723d84780 1 > prepared part key=_multipart_J33T5S893LMV.2~F56FIH868CG9.0 size=1018779 2023-12-03T11:42:13.517 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.516+0000 7f8723d84780 1 > prepared multipart upload key=J33T5S893LMV upload=F56FIH868CG9 tag=8SIU2HTGSBXB type=write size=2067355 2023-12-03T11:42:13.518 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.517+0000 7f8723d84780 1 < completed write operation key=K83BTR5BOLZE tag=KPAJHX41Q440 type=write size=233242 2023-12-03T11:42:13.519 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.518+0000 7f8723d84780 1 > prepared operation key=VENJI0KD1XDW tag=QP6HLC9Q1WVS type=del size=2110280 2023-12-03T11:42:13.520 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.519+0000 7f8723d84780 1 < completed delete operation key=D3JEVEY0E29E tag=4D1SPUM88XCH type=del 2023-12-03T11:42:13.523 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.522+0000 7f8723d84780 1 > prepared part key=_multipart_931GNEXBHH35.2~CTTSZW81INMO.0 size=65934 2023-12-03T11:42:13.523 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.522+0000 7f8723d84780 1 > prepared multipart upload key=931GNEXBHH35 upload=CTTSZW81INMO tag=K17D2328P4ZZ type=write size=1114510 2023-12-03T11:42:13.524 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.523+0000 7f8723d84780 1 < completed part key=_multipart_LMVO6CVEPN3K.2~YV2YWNZ1OFPP.0 size=1048576 2023-12-03T11:42:13.526 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.525+0000 7f8723d84780 1 < completed part key=_multipart_LMVO6CVEPN3K.2~YV2YWNZ1OFPP.1 size=1048576 2023-12-03T11:42:13.527 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.526+0000 7f8723d84780 1 < completed part key=_multipart_LMVO6CVEPN3K.2~YV2YWNZ1OFPP.2 size=203044 2023-12-03T11:42:13.531 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.530+0000 7f8723d84780 1 < completed multipart upload key=LMVO6CVEPN3K upload=YV2YWNZ1OFPP tag=EGRNTH9ERK67 type=write size=3348772 2023-12-03T11:42:13.534 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.532+0000 7f8723d84780 1 > prepared part key=_multipart_TSTIBGVYUZZZ.2~20AI1SKN8FZL.0 size=651676 2023-12-03T11:42:13.534 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.532+0000 7f8723d84780 1 > prepared multipart upload key=TSTIBGVYUZZZ upload=20AI1SKN8FZL tag=VCVMLROYNAJO type=write size=1700252 2023-12-03T11:42:13.534 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.533+0000 7f8723d84780 1 < completed delete operation key=W2704YS8KYQB tag=MYWJNIILD2WQ type=del 2023-12-03T11:42:13.536 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.535+0000 7f8723d84780 1 > prepared part key=_multipart_EITMJKL0LCYC.2~U3LF0NLOPPKA.0 size=1048576 2023-12-03T11:42:13.537 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.536+0000 7f8723d84780 1 > prepared part key=_multipart_EITMJKL0LCYC.2~U3LF0NLOPPKA.1 size=1048576 2023-12-03T11:42:13.538 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.537+0000 7f8723d84780 1 > prepared part key=_multipart_EITMJKL0LCYC.2~U3LF0NLOPPKA.2 size=780414 2023-12-03T11:42:13.538 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.537+0000 7f8723d84780 1 > prepared multipart upload key=EITMJKL0LCYC upload=U3LF0NLOPPKA tag=B0K4CTQFVXAX type=write size=3926142 2023-12-03T11:42:13.539 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.538+0000 7f8723d84780 1 < completed delete operation key=O7VVHXLDSY57 tag=CJCDT71W7G4J type=del 2023-12-03T11:42:13.541 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.540+0000 7f8723d84780 1 > prepared operation key=931GNEXBHH35 tag=PWC9ZXAOPLSK type=del size=2040690 2023-12-03T11:42:13.542 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.541+0000 7f8723d84780 1 < completed part key=_multipart_AB0SN0E49Z5F.2~NX0KUE8HGDTA.0 size=744858 2023-12-03T11:42:13.544 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.543+0000 7f8723d84780 1 < completed multipart upload key=AB0SN0E49Z5F upload=NX0KUE8HGDTA tag=0VK8S9301QZ5 type=write size=1793434 2023-12-03T11:42:13.547 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.545+0000 7f8723d84780 1 > prepared part key=_multipart_Y6S7QI60GCLE.2~H4KEDHESYD9U.0 size=1048576 2023-12-03T11:42:13.548 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.547+0000 7f8723d84780 1 > prepared part key=_multipart_Y6S7QI60GCLE.2~H4KEDHESYD9U.1 size=1048576 2023-12-03T11:42:13.549 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.548+0000 7f8723d84780 1 > prepared part key=_multipart_Y6S7QI60GCLE.2~H4KEDHESYD9U.2 size=838604 2023-12-03T11:42:13.549 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.548+0000 7f8723d84780 1 > prepared multipart upload key=Y6S7QI60GCLE upload=H4KEDHESYD9U tag=HWUER2ABTV6Z type=write size=3984332 2023-12-03T11:42:13.550 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.549+0000 7f8723d84780 1 < completed part key=_multipart_12XG7YPYTN4U.2~BXR72C9V58DI.0 size=1048576 2023-12-03T11:42:13.551 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.550+0000 7f8723d84780 1 < completed part key=_multipart_12XG7YPYTN4U.2~BXR72C9V58DI.1 size=894783 2023-12-03T11:42:13.554 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.553+0000 7f8723d84780 1 < completed multipart upload key=12XG7YPYTN4U upload=BXR72C9V58DI tag=5BLKX88EN9RZ type=write size=2991935 2023-12-03T11:42:13.555 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.554+0000 7f8723d84780 1 > prepared operation key=OGACI7CRPMT7 tag=WTQJOOMB88OP type=del size=1981253 2023-12-03T11:42:13.557 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.555+0000 7f8723d84780 1 < completed part key=_multipart_LMVO6CVEPN3K.2~G5R1HT5T5XT4.0 size=1048576 2023-12-03T11:42:13.557 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.555+0000 7f8723d84780 1 < canceled part key=_multipart_LMVO6CVEPN3K.2~G5R1HT5T5XT4.1 size=1048576 2023-12-03T11:42:13.557 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.556+0000 7f8723d84780 1 < completed part key=_multipart_LMVO6CVEPN3K.2~G5R1HT5T5XT4.2 size=702670 2023-12-03T11:42:13.559 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.558+0000 7f8723d84780 1 < canceled multipart upload key=LMVO6CVEPN3K upload=G5R1HT5T5XT4 tag=BRWOTEVZPVOF type=write size=3848398 2023-12-03T11:42:13.561 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.560+0000 7f8723d84780 1 > prepared part key=_multipart_TSTIBGVYUZZZ.2~B14WLLMSLNRL.0 size=1048576 2023-12-03T11:42:13.563 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.561+0000 7f8723d84780 1 > prepared part key=_multipart_TSTIBGVYUZZZ.2~B14WLLMSLNRL.1 size=816387 2023-12-03T11:42:13.563 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.561+0000 7f8723d84780 1 > prepared multipart upload key=TSTIBGVYUZZZ upload=B14WLLMSLNRL tag=X97O5E57UB5Q type=write size=2913539 2023-12-03T11:42:13.564 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.562+0000 7f8723d84780 1 < canceled operation key=5UYL15O31IHM tag=W32JTGI3U63X type=del size=2034496 2023-12-03T11:42:13.565 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.564+0000 7f8723d84780 1 > prepared operation key=M4VKPN6INFNZ tag=JCACTKUCEMYZ type=del size=3817818 2023-12-03T11:42:13.566 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.565+0000 7f8723d84780 1 < completed part key=_multipart_AB0SN0E49Z5F.2~B44YSPQKTJD1.0 size=1048576 2023-12-03T11:42:13.567 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.566+0000 7f8723d84780 1 < completed part key=_multipart_AB0SN0E49Z5F.2~B44YSPQKTJD1.1 size=378139 2023-12-03T11:42:13.569 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.568+0000 7f8723d84780 1 < completed multipart upload key=AB0SN0E49Z5F upload=B44YSPQKTJD1 tag=691HTPV7I0BJ type=write size=2475291 2023-12-03T11:42:13.571 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.570+0000 7f8723d84780 1 > prepared part key=_multipart_LCK58DDM5XU9.2~L2ZVUNZZRUV1.0 size=1048576 2023-12-03T11:42:13.572 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.571+0000 7f8723d84780 1 > prepared part key=_multipart_LCK58DDM5XU9.2~L2ZVUNZZRUV1.1 size=1048576 2023-12-03T11:42:13.573 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.572+0000 7f8723d84780 1 > prepared part key=_multipart_LCK58DDM5XU9.2~L2ZVUNZZRUV1.2 size=771678 2023-12-03T11:42:13.573 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.572+0000 7f8723d84780 1 > prepared multipart upload key=LCK58DDM5XU9 upload=L2ZVUNZZRUV1 tag=YL6T57ADFUBH type=write size=3917406 2023-12-03T11:42:13.574 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.573+0000 7f8723d84780 1 < completed part key=_multipart_7THZZ1J5LOZK.2~5SA8EJHBO8MM.0 size=1048576 2023-12-03T11:42:13.575 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.574+0000 7f8723d84780 1 < completed part key=_multipart_7THZZ1J5LOZK.2~5SA8EJHBO8MM.1 size=1048576 2023-12-03T11:42:13.576 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.575+0000 7f8723d84780 1 < completed part key=_multipart_7THZZ1J5LOZK.2~5SA8EJHBO8MM.2 size=83445 2023-12-03T11:42:13.578 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.577+0000 7f8723d84780 1 < completed multipart upload key=7THZZ1J5LOZK upload=5SA8EJHBO8MM tag=LRI8RMAL97C4 type=write size=3229173 2023-12-03T11:42:13.579 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.578+0000 7f8723d84780 1 > prepared operation key=O7VVHXLDSY57 tag=RU29TYP6YQHE type=del size=3377812 2023-12-03T11:42:13.580 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.579+0000 7f8723d84780 1 < completed part key=_multipart_K83BTR5BOLZE.2~BEH1EXH2Y708.0 size=1048576 2023-12-03T11:42:13.581 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.580+0000 7f8723d84780 1 < completed part key=_multipart_K83BTR5BOLZE.2~BEH1EXH2Y708.1 size=1048576 2023-12-03T11:42:13.585 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.581+0000 7f8723d84780 1 < completed part key=_multipart_K83BTR5BOLZE.2~BEH1EXH2Y708.2 size=987474 2023-12-03T11:42:13.585 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.583+0000 7f8723d84780 1 < completed multipart upload key=K83BTR5BOLZE upload=BEH1EXH2Y708 tag=RLQ97S532AW8 type=write size=4133202 2023-12-03T11:42:13.585 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.584+0000 7f8723d84780 1 > prepared operation key=Y6S7QI60GCLE tag=3K9ZYJ21LS2C type=write size=817341 2023-12-03T11:42:13.586 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.585+0000 7f8723d84780 1 < completed write operation key=5UYL15O31IHM tag=47OS006JUQWM type=write size=20544 2023-12-03T11:42:13.589 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.588+0000 7f8723d84780 1 > prepared part key=_multipart_5UYL15O31IHM.2~APG3G7KGEE2C.0 size=1048576 2023-12-03T11:42:13.590 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.588+0000 7f8723d84780 1 > prepared part key=_multipart_5UYL15O31IHM.2~APG3G7KGEE2C.1 size=418552 2023-12-03T11:42:13.590 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.588+0000 7f8723d84780 1 > prepared multipart upload key=5UYL15O31IHM upload=APG3G7KGEE2C tag=5PLQFRP02WS3 type=write size=2515704 2023-12-03T11:42:13.591 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.590+0000 7f8723d84780 1 < completed delete operation key=UWS266H06VDK tag=DNVP3BDRRG07 type=del 2023-12-03T11:42:13.592 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.591+0000 7f8723d84780 1 > prepared operation key=LCK58DDM5XU9 tag=7EVW7XOANKFX type=del size=2201684 2023-12-03T11:42:13.594 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.593+0000 7f8723d84780 1 < suggested update operation key=CKABTI1EOAWB tag=5FMZAZE81H3F type=del size=3107669 2023-12-03T11:42:13.596 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.595+0000 7f8723d84780 1 > prepared part key=_multipart_J33T5S893LMV.2~E2PIDQ12Q2MM.0 size=218683 2023-12-03T11:42:13.596 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.595+0000 7f8723d84780 1 > prepared multipart upload key=J33T5S893LMV upload=E2PIDQ12Q2MM tag=TK5KXJQ55V3K type=write size=1267259 2023-12-03T11:42:13.597 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.596+0000 7f8723d84780 1 < completed part key=_multipart_J33T5S893LMV.2~F56FIH868CG9.0 size=1018779 2023-12-03T11:42:13.599 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.598+0000 7f8723d84780 1 < completed multipart upload key=J33T5S893LMV upload=F56FIH868CG9 tag=8SIU2HTGSBXB type=write size=2067355 2023-12-03T11:42:13.600 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.599+0000 7f8723d84780 1 > prepared operation key=DMQX2DGDLU7D tag=ACBBOZC8FFHQ type=del size=2281299 2023-12-03T11:42:13.603 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.600+0000 7f8723d84780 1 < completed delete operation key=VENJI0KD1XDW tag=QP6HLC9Q1WVS type=del 2023-12-03T11:42:13.603 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.602+0000 7f8723d84780 1 > prepared part key=_multipart_10JRIKOZ16FY.2~BA8V0F4JRHWM.0 size=422382 2023-12-03T11:42:13.604 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.602+0000 7f8723d84780 1 > prepared multipart upload key=10JRIKOZ16FY upload=BA8V0F4JRHWM tag=NJBDN0RCKFQC type=write size=1470958 2023-12-03T11:42:13.605 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.604+0000 7f8723d84780 1 < completed part key=_multipart_931GNEXBHH35.2~CTTSZW81INMO.0 size=65934 2023-12-03T11:42:13.607 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.606+0000 7f8723d84780 1 < completed multipart upload key=931GNEXBHH35 upload=CTTSZW81INMO tag=K17D2328P4ZZ type=write size=1114510 2023-12-03T11:42:13.608 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.607+0000 7f8723d84780 1 > prepared operation key=OPQPIDJ2PBVU tag=LOAYG31051ES type=del size=1929630 2023-12-03T11:42:13.610 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.608+0000 7f8723d84780 1 < completed part key=_multipart_TSTIBGVYUZZZ.2~20AI1SKN8FZL.0 size=651676 2023-12-03T11:42:13.611 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.610+0000 7f8723d84780 1 < completed multipart upload key=TSTIBGVYUZZZ upload=20AI1SKN8FZL tag=VCVMLROYNAJO type=write size=1700252 2023-12-03T11:42:13.612 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.611+0000 7f8723d84780 1 > prepared operation key=5UYL15O31IHM tag=PK41O9IEX8XE type=del size=3131990 2023-12-03T11:42:13.613 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.612+0000 7f8723d84780 1 < completed part key=_multipart_EITMJKL0LCYC.2~U3LF0NLOPPKA.0 size=1048576 2023-12-03T11:42:13.613 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.612+0000 7f8723d84780 1 < canceled part key=_multipart_EITMJKL0LCYC.2~U3LF0NLOPPKA.1 size=1048576 2023-12-03T11:42:13.614 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.613+0000 7f8723d84780 1 < completed part key=_multipart_EITMJKL0LCYC.2~U3LF0NLOPPKA.2 size=780414 2023-12-03T11:42:13.616 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.615+0000 7f8723d84780 1 < canceled multipart upload key=EITMJKL0LCYC upload=U3LF0NLOPPKA tag=B0K4CTQFVXAX type=write size=3926142 2023-12-03T11:42:13.618 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.617+0000 7f8723d84780 1 > prepared operation key=AB0SN0E49Z5F tag=0LIBJ5P39X4C type=del size=1744161 2023-12-03T11:42:13.620 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.618+0000 7f8723d84780 1 < completed delete operation key=931GNEXBHH35 tag=PWC9ZXAOPLSK type=del 2023-12-03T11:42:13.620 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.619+0000 7f8723d84780 1 > prepared operation key=UWS266H06VDK tag=LNYH612ZR3DE type=del size=2957338 2023-12-03T11:42:13.622 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.621+0000 7f8723d84780 1 < completed part key=_multipart_Y6S7QI60GCLE.2~H4KEDHESYD9U.0 size=1048576 2023-12-03T11:42:13.623 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.622+0000 7f8723d84780 1 < completed part key=_multipart_Y6S7QI60GCLE.2~H4KEDHESYD9U.1 size=1048576 2023-12-03T11:42:13.624 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.623+0000 7f8723d84780 1 < completed part key=_multipart_Y6S7QI60GCLE.2~H4KEDHESYD9U.2 size=838604 2023-12-03T11:42:13.625 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.624+0000 7f8723d84780 1 < completed multipart upload key=Y6S7QI60GCLE upload=H4KEDHESYD9U tag=HWUER2ABTV6Z type=write size=3984332 2023-12-03T11:42:13.628 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.627+0000 7f8723d84780 1 > prepared part key=_multipart_10JRIKOZ16FY.2~3574D0S8Q7C4.0 size=520628 2023-12-03T11:42:13.628 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.627+0000 7f8723d84780 1 > prepared multipart upload key=10JRIKOZ16FY upload=3574D0S8Q7C4 tag=CTSI8P9P8C59 type=write size=1569204 2023-12-03T11:42:13.629 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.628+0000 7f8723d84780 1 < completed delete operation key=OGACI7CRPMT7 tag=WTQJOOMB88OP type=del 2023-12-03T11:42:13.630 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.629+0000 7f8723d84780 1 > prepared operation key=7THZZ1J5LOZK tag=1RPZ37W6F76R type=del size=1540865 2023-12-03T11:42:13.631 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.630+0000 7f8723d84780 1 < completed part key=_multipart_TSTIBGVYUZZZ.2~B14WLLMSLNRL.0 size=1048576 2023-12-03T11:42:13.632 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.631+0000 7f8723d84780 1 < completed part key=_multipart_TSTIBGVYUZZZ.2~B14WLLMSLNRL.1 size=816387 2023-12-03T11:42:13.634 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.633+0000 7f8723d84780 1 < completed multipart upload key=TSTIBGVYUZZZ upload=B14WLLMSLNRL tag=X97O5E57UB5Q type=write size=2913539 2023-12-03T11:42:13.637 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.636+0000 7f8723d84780 1 > prepared part key=_multipart_LMVO6CVEPN3K.2~Q7W1CPD5WK43.0 size=989684 2023-12-03T11:42:13.637 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.636+0000 7f8723d84780 1 > prepared multipart upload key=LMVO6CVEPN3K upload=Q7W1CPD5WK43 tag=P2RJCJ7TD0KG type=write size=2038260 2023-12-03T11:42:13.639 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.638+0000 7f8723d84780 1 < completed delete operation key=M4VKPN6INFNZ tag=JCACTKUCEMYZ type=del 2023-12-03T11:42:13.641 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.640+0000 7f8723d84780 1 > prepared part key=_multipart_EY9ZG5KOTBWM.2~0Z3FI39NGJW4.0 size=205299 2023-12-03T11:42:13.641 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.640+0000 7f8723d84780 1 > prepared multipart upload key=EY9ZG5KOTBWM upload=0Z3FI39NGJW4 tag=R6NC6YHGI9OS type=write size=1253875 2023-12-03T11:42:13.642 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.641+0000 7f8723d84780 1 < completed part key=_multipart_LCK58DDM5XU9.2~L2ZVUNZZRUV1.0 size=1048576 2023-12-03T11:42:13.643 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.642+0000 7f8723d84780 1 < completed part key=_multipart_LCK58DDM5XU9.2~L2ZVUNZZRUV1.1 size=1048576 2023-12-03T11:42:13.644 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.643+0000 7f8723d84780 1 < completed part key=_multipart_LCK58DDM5XU9.2~L2ZVUNZZRUV1.2 size=771678 2023-12-03T11:42:13.646 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.645+0000 7f8723d84780 1 < completed multipart upload key=LCK58DDM5XU9 upload=L2ZVUNZZRUV1 tag=YL6T57ADFUBH type=write size=3917406 2023-12-03T11:42:13.648 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.647+0000 7f8723d84780 1 > prepared operation key=FCA2R3HR61S2 tag=BH4V9V9MBCY7 type=del size=30605 2023-12-03T11:42:13.649 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.648+0000 7f8723d84780 1 < completed delete operation key=O7VVHXLDSY57 tag=RU29TYP6YQHE type=del 2023-12-03T11:42:13.651 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.650+0000 7f8723d84780 1 > prepared part key=_multipart_EITMJKL0LCYC.2~C22KKV3NKH8Z.0 size=941350 2023-12-03T11:42:13.651 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.650+0000 7f8723d84780 1 > prepared multipart upload key=EITMJKL0LCYC upload=C22KKV3NKH8Z tag=76IFV9QBQOXJ type=write size=1989926 2023-12-03T11:42:13.653 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.652+0000 7f8723d84780 1 < suggested remove operation key=Y6S7QI60GCLE tag=3K9ZYJ21LS2C type=write 2023-12-03T11:42:13.654 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.653+0000 7f8723d84780 1 > prepared operation key=12XG7YPYTN4U tag=6T0M04MJE914 type=del size=1513417 2023-12-03T11:42:13.656 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.655+0000 7f8723d84780 1 < completed part key=_multipart_5UYL15O31IHM.2~APG3G7KGEE2C.0 size=1048576 2023-12-03T11:42:13.657 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.656+0000 7f8723d84780 1 < completed part key=_multipart_5UYL15O31IHM.2~APG3G7KGEE2C.1 size=418552 2023-12-03T11:42:13.659 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.658+0000 7f8723d84780 1 < completed multipart upload key=5UYL15O31IHM upload=APG3G7KGEE2C tag=5PLQFRP02WS3 type=write size=2515704 2023-12-03T11:42:13.660 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.659+0000 7f8723d84780 1 > prepared operation key=G36T76K8O7A1 tag=SS7SWSXIR68X type=write size=314377 2023-12-03T11:42:13.662 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.661+0000 7f8723d84780 1 < suggested remove operation key=LCK58DDM5XU9 tag=7EVW7XOANKFX type=del 2023-12-03T11:42:13.664 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.663+0000 7f8723d84780 1 > prepared operation key=7THZZ1J5LOZK tag=92S5U1G65UTM type=del size=3426719 2023-12-03T11:42:13.665 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.664+0000 7f8723d84780 1 < completed part key=_multipart_J33T5S893LMV.2~E2PIDQ12Q2MM.0 size=218683 2023-12-03T11:42:13.667 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.666+0000 7f8723d84780 1 < completed multipart upload key=J33T5S893LMV upload=E2PIDQ12Q2MM tag=TK5KXJQ55V3K type=write size=1267259 2023-12-03T11:42:13.668 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.667+0000 7f8723d84780 1 > prepared operation key=LCK58DDM5XU9 tag=QSO9JSLXS3NR type=del size=3304092 2023-12-03T11:42:13.669 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.668+0000 7f8723d84780 1 < completed delete operation key=DMQX2DGDLU7D tag=ACBBOZC8FFHQ type=del 2023-12-03T11:42:13.672 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.671+0000 7f8723d84780 1 > prepared part key=_multipart_DMQX2DGDLU7D.2~592NWI6YVBIL.0 size=1048576 2023-12-03T11:42:13.673 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.672+0000 7f8723d84780 1 > prepared part key=_multipart_DMQX2DGDLU7D.2~592NWI6YVBIL.1 size=1048576 2023-12-03T11:42:13.674 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.673+0000 7f8723d84780 1 > prepared part key=_multipart_DMQX2DGDLU7D.2~592NWI6YVBIL.2 size=739537 2023-12-03T11:42:13.674 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.673+0000 7f8723d84780 1 > prepared multipart upload key=DMQX2DGDLU7D upload=592NWI6YVBIL tag=7G5KAWGSSK87 type=write size=3885265 2023-12-03T11:42:13.675 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.674+0000 7f8723d84780 1 < completed part key=_multipart_10JRIKOZ16FY.2~BA8V0F4JRHWM.0 size=422382 2023-12-03T11:42:13.677 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.676+0000 7f8723d84780 1 < completed multipart upload key=10JRIKOZ16FY upload=BA8V0F4JRHWM tag=NJBDN0RCKFQC type=write size=1470958 2023-12-03T11:42:13.679 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.678+0000 7f8723d84780 1 > prepared part key=_multipart_O7VVHXLDSY57.2~GAHTCXNE5S4Q.0 size=992814 2023-12-03T11:42:13.679 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.678+0000 7f8723d84780 1 > prepared multipart upload key=O7VVHXLDSY57 upload=GAHTCXNE5S4Q tag=AMGE15YHGNH0 type=write size=2041390 2023-12-03T11:42:13.684 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.679+0000 7f8723d84780 1 < canceled operation key=OPQPIDJ2PBVU tag=LOAYG31051ES type=del size=1929630 2023-12-03T11:42:13.684 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.681+0000 7f8723d84780 1 > prepared part key=_multipart_KS5J7E7KE2IJ.2~NACVS5TEP7NJ.0 size=1048576 2023-12-03T11:42:13.684 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.682+0000 7f8723d84780 1 > prepared part key=_multipart_KS5J7E7KE2IJ.2~NACVS5TEP7NJ.1 size=1048576 2023-12-03T11:42:13.684 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.683+0000 7f8723d84780 1 > prepared part key=_multipart_KS5J7E7KE2IJ.2~NACVS5TEP7NJ.2 size=437505 2023-12-03T11:42:13.684 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.683+0000 7f8723d84780 1 > prepared multipart upload key=KS5J7E7KE2IJ upload=NACVS5TEP7NJ tag=CLU1J621CMKC type=write size=3583233 2023-12-03T11:42:13.685 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.684+0000 7f8723d84780 1 < completed delete operation key=5UYL15O31IHM tag=PK41O9IEX8XE type=del 2023-12-03T11:42:13.688 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.686+0000 7f8723d84780 1 > prepared part key=_multipart_OGACI7CRPMT7.2~SUR9JCN51WT2.0 size=1048576 2023-12-03T11:42:13.688 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.687+0000 7f8723d84780 1 > prepared part key=_multipart_OGACI7CRPMT7.2~SUR9JCN51WT2.1 size=1048576 2023-12-03T11:42:13.689 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.688+0000 7f8723d84780 1 > prepared part key=_multipart_OGACI7CRPMT7.2~SUR9JCN51WT2.2 size=589754 2023-12-03T11:42:13.689 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.688+0000 7f8723d84780 1 > prepared multipart upload key=OGACI7CRPMT7 upload=SUR9JCN51WT2 tag=XUYIDKQIFRKX type=write size=3735482 2023-12-03T11:42:13.691 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.690+0000 7f8723d84780 1 < suggested remove operation key=AB0SN0E49Z5F tag=0LIBJ5P39X4C type=del 2023-12-03T11:42:13.693 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.692+0000 7f8723d84780 1 > prepared part key=_multipart_931GNEXBHH35.2~GTT46KC6UY20.0 size=1048576 2023-12-03T11:42:13.694 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.693+0000 7f8723d84780 1 > prepared part key=_multipart_931GNEXBHH35.2~GTT46KC6UY20.1 size=874862 2023-12-03T11:42:13.694 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.693+0000 7f8723d84780 1 > prepared multipart upload key=931GNEXBHH35 upload=GTT46KC6UY20 tag=WNE80AUU5P0E type=write size=2972014 2023-12-03T11:42:13.695 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.694+0000 7f8723d84780 1 < completed delete operation key=UWS266H06VDK tag=LNYH612ZR3DE type=del 2023-12-03T11:42:13.697 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.696+0000 7f8723d84780 1 > prepared part key=_multipart_12XG7YPYTN4U.2~CC5D3ILEC56W.0 size=759205 2023-12-03T11:42:13.698 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.696+0000 7f8723d84780 1 > prepared multipart upload key=12XG7YPYTN4U upload=CC5D3ILEC56W tag=MF84DDEFER6A type=write size=1807781 2023-12-03T11:42:13.699 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.698+0000 7f8723d84780 1 < completed part key=_multipart_10JRIKOZ16FY.2~3574D0S8Q7C4.0 size=520628 2023-12-03T11:42:13.701 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.699+0000 7f8723d84780 1 < completed multipart upload key=10JRIKOZ16FY upload=3574D0S8Q7C4 tag=CTSI8P9P8C59 type=write size=1569204 2023-12-03T11:42:13.702 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.701+0000 7f8723d84780 1 > prepared operation key=G36T76K8O7A1 tag=Y1PEI2YJH16R type=del size=1093129 2023-12-03T11:42:13.703 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.702+0000 7f8723d84780 1 < completed delete operation key=7THZZ1J5LOZK tag=1RPZ37W6F76R type=del 2023-12-03T11:42:13.705 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.704+0000 7f8723d84780 1 > prepared part key=_multipart_D3JEVEY0E29E.2~68R4F224O9DD.0 size=619801 2023-12-03T11:42:13.705 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.704+0000 7f8723d84780 1 > prepared multipart upload key=D3JEVEY0E29E upload=68R4F224O9DD tag=8N4RMJY700MC type=write size=1668377 2023-12-03T11:42:13.706 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.705+0000 7f8723d84780 1 < completed part key=_multipart_LMVO6CVEPN3K.2~Q7W1CPD5WK43.0 size=989684 2023-12-03T11:42:13.708 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.707+0000 7f8723d84780 1 < completed multipart upload key=LMVO6CVEPN3K upload=Q7W1CPD5WK43 tag=P2RJCJ7TD0KG type=write size=2038260 2023-12-03T11:42:13.709 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.708+0000 7f8723d84780 1 > prepared operation key=OPQPIDJ2PBVU tag=G6X8ICG601MW type=del size=241451 2023-12-03T11:42:13.711 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.710+0000 7f8723d84780 1 < completed part key=_multipart_EY9ZG5KOTBWM.2~0Z3FI39NGJW4.0 size=205299 2023-12-03T11:42:13.713 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.712+0000 7f8723d84780 1 < completed multipart upload key=EY9ZG5KOTBWM upload=0Z3FI39NGJW4 tag=R6NC6YHGI9OS type=write size=1253875 2023-12-03T11:42:13.714 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.713+0000 7f8723d84780 1 > prepared operation key=931GNEXBHH35 tag=10A6DEH4E0DF type=write size=359645 2023-12-03T11:42:13.715 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.714+0000 7f8723d84780 1 < completed delete operation key=FCA2R3HR61S2 tag=BH4V9V9MBCY7 type=del 2023-12-03T11:42:13.716 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.715+0000 7f8723d84780 1 > prepared operation key=5UYL15O31IHM tag=ZD3Q0AVB01O7 type=del size=847784 2023-12-03T11:42:13.717 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.716+0000 7f8723d84780 1 < completed part key=_multipart_EITMJKL0LCYC.2~C22KKV3NKH8Z.0 size=941350 2023-12-03T11:42:13.719 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.718+0000 7f8723d84780 1 < completed multipart upload key=EITMJKL0LCYC upload=C22KKV3NKH8Z tag=76IFV9QBQOXJ type=write size=1989926 2023-12-03T11:42:13.720 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.719+0000 7f8723d84780 1 > prepared operation key=12XG7YPYTN4U tag=XUEG1TX7QK7E type=write size=97553 2023-12-03T11:42:13.722 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.721+0000 7f8723d84780 1 < suggested update operation key=12XG7YPYTN4U tag=6T0M04MJE914 type=del size=1513417 2023-12-03T11:42:13.723 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.722+0000 7f8723d84780 1 > prepared operation key=96RAVVSUKH0Y tag=3AJMTCVG0SK1 type=del size=2616197 2023-12-03T11:42:13.725 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.724+0000 7f8723d84780 1 < completed write operation key=G36T76K8O7A1 tag=SS7SWSXIR68X type=write size=314377 2023-12-03T11:42:13.726 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.725+0000 7f8723d84780 1 > prepared operation key=VENJI0KD1XDW tag=Y576FXXMEW7R type=del size=66107 2023-12-03T11:42:13.727 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.726+0000 7f8723d84780 1 < completed delete operation key=7THZZ1J5LOZK tag=92S5U1G65UTM type=del 2023-12-03T11:42:13.729 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.728+0000 7f8723d84780 1 > prepared part key=_multipart_5UYL15O31IHM.2~3RFK1OGJJYSN.0 size=1048576 2023-12-03T11:42:13.730 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.729+0000 7f8723d84780 1 > prepared part key=_multipart_5UYL15O31IHM.2~3RFK1OGJJYSN.1 size=423932 2023-12-03T11:42:13.730 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.729+0000 7f8723d84780 1 > prepared multipart upload key=5UYL15O31IHM upload=3RFK1OGJJYSN tag=I4YT88NMWM4K type=write size=2521084 2023-12-03T11:42:13.731 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.730+0000 7f8723d84780 1 < completed delete operation key=LCK58DDM5XU9 tag=QSO9JSLXS3NR type=del 2023-12-03T11:42:13.732 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.731+0000 7f8723d84780 1 > prepared operation key=FCA2R3HR61S2 tag=1P66WG2L7M9G type=write size=504756 2023-12-03T11:42:13.733 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.732+0000 7f8723d84780 1 < completed part key=_multipart_DMQX2DGDLU7D.2~592NWI6YVBIL.0 size=1048576 2023-12-03T11:42:13.734 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.733+0000 7f8723d84780 1 < completed part key=_multipart_DMQX2DGDLU7D.2~592NWI6YVBIL.1 size=1048576 2023-12-03T11:42:13.734 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.733+0000 7f8723d84780 1 < canceled part key=_multipart_DMQX2DGDLU7D.2~592NWI6YVBIL.2 size=739537 2023-12-03T11:42:13.736 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.735+0000 7f8723d84780 1 < canceled multipart upload key=DMQX2DGDLU7D upload=592NWI6YVBIL tag=7G5KAWGSSK87 type=write size=3885265 2023-12-03T11:42:13.738 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.737+0000 7f8723d84780 1 > prepared part key=_multipart_VENJI0KD1XDW.2~BY5WLO9YN5R8.0 size=894324 2023-12-03T11:42:13.738 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.737+0000 7f8723d84780 1 > prepared multipart upload key=VENJI0KD1XDW upload=BY5WLO9YN5R8 tag=9B6FVCNZ7FJ3 type=write size=1942900 2023-12-03T11:42:13.739 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.738+0000 7f8723d84780 1 < completed part key=_multipart_O7VVHXLDSY57.2~GAHTCXNE5S4Q.0 size=992814 2023-12-03T11:42:13.741 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.740+0000 7f8723d84780 1 < completed multipart upload key=O7VVHXLDSY57 upload=GAHTCXNE5S4Q tag=AMGE15YHGNH0 type=write size=2041390 2023-12-03T11:42:13.743 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.742+0000 7f8723d84780 1 > prepared operation key=KS5J7E7KE2IJ tag=3CXYPB8ICR1J type=del size=810530 2023-12-03T11:42:13.744 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.743+0000 7f8723d84780 1 < completed part key=_multipart_KS5J7E7KE2IJ.2~NACVS5TEP7NJ.0 size=1048576 2023-12-03T11:42:13.745 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.744+0000 7f8723d84780 1 < completed part key=_multipart_KS5J7E7KE2IJ.2~NACVS5TEP7NJ.1 size=1048576 2023-12-03T11:42:13.747 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.746+0000 7f8723d84780 1 < completed part key=_multipart_KS5J7E7KE2IJ.2~NACVS5TEP7NJ.2 size=437505 2023-12-03T11:42:13.749 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.748+0000 7f8723d84780 1 < completed multipart upload key=KS5J7E7KE2IJ upload=NACVS5TEP7NJ tag=CLU1J621CMKC type=write size=3583233 2023-12-03T11:42:13.750 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.749+0000 7f8723d84780 1 > prepared operation key=AB0SN0E49Z5F tag=PZV4VURAEFEE type=del size=2415772 2023-12-03T11:42:13.751 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.750+0000 7f8723d84780 1 < completed part key=_multipart_OGACI7CRPMT7.2~SUR9JCN51WT2.0 size=1048576 2023-12-03T11:42:13.752 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.751+0000 7f8723d84780 1 < completed part key=_multipart_OGACI7CRPMT7.2~SUR9JCN51WT2.1 size=1048576 2023-12-03T11:42:13.753 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.752+0000 7f8723d84780 1 < completed part key=_multipart_OGACI7CRPMT7.2~SUR9JCN51WT2.2 size=589754 2023-12-03T11:42:13.755 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.754+0000 7f8723d84780 1 < completed multipart upload key=OGACI7CRPMT7 upload=SUR9JCN51WT2 tag=XUYIDKQIFRKX type=write size=3735482 2023-12-03T11:42:13.757 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.756+0000 7f8723d84780 1 > prepared part key=_multipart_96RAVVSUKH0Y.2~2CSJ2XOYUVCW.0 size=1048576 2023-12-03T11:42:13.759 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.757+0000 7f8723d84780 1 > prepared part key=_multipart_96RAVVSUKH0Y.2~2CSJ2XOYUVCW.1 size=31638 2023-12-03T11:42:13.759 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.757+0000 7f8723d84780 1 > prepared multipart upload key=96RAVVSUKH0Y upload=2CSJ2XOYUVCW tag=QDD2WK0S6CF6 type=write size=2128790 2023-12-03T11:42:13.759 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.758+0000 7f8723d84780 1 < completed part key=_multipart_931GNEXBHH35.2~GTT46KC6UY20.0 size=1048576 2023-12-03T11:42:13.761 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.760+0000 7f8723d84780 1 < completed part key=_multipart_931GNEXBHH35.2~GTT46KC6UY20.1 size=874862 2023-12-03T11:42:13.763 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.762+0000 7f8723d84780 1 < completed multipart upload key=931GNEXBHH35 upload=GTT46KC6UY20 tag=WNE80AUU5P0E type=write size=2972014 2023-12-03T11:42:13.765 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.764+0000 7f8723d84780 1 > prepared part key=_multipart_LCK58DDM5XU9.2~KLHJAOXPXDTB.0 size=1048576 2023-12-03T11:42:13.766 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.765+0000 7f8723d84780 1 > prepared part key=_multipart_LCK58DDM5XU9.2~KLHJAOXPXDTB.1 size=1048576 2023-12-03T11:42:13.767 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.766+0000 7f8723d84780 1 > prepared part key=_multipart_LCK58DDM5XU9.2~KLHJAOXPXDTB.2 size=707352 2023-12-03T11:42:13.767 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.766+0000 7f8723d84780 1 > prepared multipart upload key=LCK58DDM5XU9 upload=KLHJAOXPXDTB tag=G6L3JRICK0FM type=write size=3853080 2023-12-03T11:42:13.768 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.767+0000 7f8723d84780 1 < completed part key=_multipart_12XG7YPYTN4U.2~CC5D3ILEC56W.0 size=759205 2023-12-03T11:42:13.770 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.769+0000 7f8723d84780 1 < completed multipart upload key=12XG7YPYTN4U upload=CC5D3ILEC56W tag=MF84DDEFER6A type=write size=1807781 2023-12-03T11:42:13.771 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.770+0000 7f8723d84780 1 > prepared operation key=OGACI7CRPMT7 tag=S8ZW9QKD3BM6 type=del size=758316 2023-12-03T11:42:13.772 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.771+0000 7f8723d84780 1 < completed delete operation key=G36T76K8O7A1 tag=Y1PEI2YJH16R type=del 2023-12-03T11:42:13.774 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.773+0000 7f8723d84780 1 > prepared part key=_multipart_5UYL15O31IHM.2~EMVK461JOG0S.0 size=1048576 2023-12-03T11:42:13.776 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.775+0000 7f8723d84780 1 > prepared part key=_multipart_5UYL15O31IHM.2~EMVK461JOG0S.1 size=607900 2023-12-03T11:42:13.776 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.775+0000 7f8723d84780 1 > prepared multipart upload key=5UYL15O31IHM upload=EMVK461JOG0S tag=SHM48N5ZC9WI type=write size=2705052 2023-12-03T11:42:13.777 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.776+0000 7f8723d84780 1 < completed part key=_multipart_D3JEVEY0E29E.2~68R4F224O9DD.0 size=619801 2023-12-03T11:42:13.779 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.778+0000 7f8723d84780 1 < completed multipart upload key=D3JEVEY0E29E upload=68R4F224O9DD tag=8N4RMJY700MC type=write size=1668377 2023-12-03T11:42:13.780 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.779+0000 7f8723d84780 1 > prepared operation key=EITMJKL0LCYC tag=7NA0V109PS8I type=del size=3311825 2023-12-03T11:42:13.781 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.780+0000 7f8723d84780 1 < completed delete operation key=OPQPIDJ2PBVU tag=G6X8ICG601MW type=del 2023-12-03T11:42:13.782 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.781+0000 7f8723d84780 1 > prepared operation key=5UYL15O31IHM tag=ROE2392VPJ5Q type=write size=969374 2023-12-03T11:42:13.784 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.783+0000 7f8723d84780 1 < completed write operation key=931GNEXBHH35 tag=10A6DEH4E0DF type=write size=359645 2023-12-03T11:42:13.789 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.785+0000 7f8723d84780 1 > prepared part key=_multipart_UWS266H06VDK.2~O6QA2I1S3GJT.0 size=49590 2023-12-03T11:42:13.789 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.785+0000 7f8723d84780 1 > prepared multipart upload key=UWS266H06VDK upload=O6QA2I1S3GJT tag=DOAI9DH1XKBN type=write size=1098166 2023-12-03T11:42:13.790 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.786+0000 7f8723d84780 1 < completed delete operation key=5UYL15O31IHM tag=ZD3Q0AVB01O7 type=del 2023-12-03T11:42:13.790 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.787+0000 7f8723d84780 1 > prepared operation key=12XG7YPYTN4U tag=5SA8JZ7EKH2P type=del size=1777946 2023-12-03T11:42:13.790 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.788+0000 7f8723d84780 -1 < failed to complete operation key=12XG7YPYTN4U tag=XUEG1TX7QK7E type=write size=97553: (22) Invalid argument 2023-12-03T11:42:13.791 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.791+0000 7f8723d84780 1 > prepared part key=_multipart_LMVO6CVEPN3K.2~PBE4UABGF0SK.0 size=1048576 2023-12-03T11:42:13.792 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.791+0000 7f8723d84780 1 > prepared part key=_multipart_LMVO6CVEPN3K.2~PBE4UABGF0SK.1 size=539169 2023-12-03T11:42:13.792 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.791+0000 7f8723d84780 1 > prepared multipart upload key=LMVO6CVEPN3K upload=PBE4UABGF0SK tag=DG6VBWDWQ1CE type=write size=2636321 2023-12-03T11:42:13.793 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.792+0000 7f8723d84780 1 < completed delete operation key=96RAVVSUKH0Y tag=3AJMTCVG0SK1 type=del 2023-12-03T11:42:13.795 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.794+0000 7f8723d84780 1 > prepared operation key=OGACI7CRPMT7 tag=X6SY8AU5V7F9 type=write size=90124 2023-12-03T11:42:13.796 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.795+0000 7f8723d84780 1 < completed delete operation key=VENJI0KD1XDW tag=Y576FXXMEW7R type=del 2023-12-03T11:42:13.797 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.796+0000 7f8723d84780 1 > prepared operation key=DMQX2DGDLU7D tag=Y37WTF2UCOWO type=del size=3346794 2023-12-03T11:42:13.798 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.797+0000 7f8723d84780 1 < completed part key=_multipart_5UYL15O31IHM.2~3RFK1OGJJYSN.0 size=1048576 2023-12-03T11:42:13.799 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.798+0000 7f8723d84780 1 < completed part key=_multipart_5UYL15O31IHM.2~3RFK1OGJJYSN.1 size=423932 2023-12-03T11:42:13.801 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.800+0000 7f8723d84780 1 < completed multipart upload key=5UYL15O31IHM upload=3RFK1OGJJYSN tag=I4YT88NMWM4K type=write size=2521084 2023-12-03T11:42:13.803 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.801+0000 7f8723d84780 1 > prepared operation key=Y6S7QI60GCLE tag=YHEIOFT5WFHT type=del size=889068 2023-12-03T11:42:13.804 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.803+0000 7f8723d84780 1 < completed write operation key=FCA2R3HR61S2 tag=1P66WG2L7M9G type=write size=504756 2023-12-03T11:42:13.806 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.805+0000 7f8723d84780 1 > prepared part key=_multipart_5UYL15O31IHM.2~KD4UNERETUM5.0 size=1048576 2023-12-03T11:42:13.807 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.806+0000 7f8723d84780 1 > prepared part key=_multipart_5UYL15O31IHM.2~KD4UNERETUM5.1 size=1048576 2023-12-03T11:42:13.808 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.807+0000 7f8723d84780 1 > prepared part key=_multipart_5UYL15O31IHM.2~KD4UNERETUM5.2 size=755152 2023-12-03T11:42:13.808 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.807+0000 7f8723d84780 1 > prepared multipart upload key=5UYL15O31IHM upload=KD4UNERETUM5 tag=MOYAEFJU9G0S type=write size=3900880 2023-12-03T11:42:13.809 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.808+0000 7f8723d84780 1 < completed part key=_multipart_VENJI0KD1XDW.2~BY5WLO9YN5R8.0 size=894324 2023-12-03T11:42:13.811 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.810+0000 7f8723d84780 1 < completed multipart upload key=VENJI0KD1XDW upload=BY5WLO9YN5R8 tag=9B6FVCNZ7FJ3 type=write size=1942900 2023-12-03T11:42:13.814 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.813+0000 7f8723d84780 1 > prepared operation key=OPQPIDJ2PBVU tag=MO4H6017UUW2 type=del size=3701441 2023-12-03T11:42:13.815 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.814+0000 7f8723d84780 1 < canceled operation key=KS5J7E7KE2IJ tag=3CXYPB8ICR1J type=del size=810530 2023-12-03T11:42:13.816 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.815+0000 7f8723d84780 1 > prepared operation key=7VMTBKUWU59F tag=QND3SCJ2C4UN type=del size=570616 2023-12-03T11:42:13.817 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.816+0000 7f8723d84780 1 < canceled operation key=AB0SN0E49Z5F tag=PZV4VURAEFEE type=del size=2415772 2023-12-03T11:42:13.819 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.819+0000 7f8723d84780 1 > prepared part key=_multipart_OPQPIDJ2PBVU.2~XUY4MC1PW8T6.0 size=1048576 2023-12-03T11:42:13.821 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.820+0000 7f8723d84780 1 > prepared part key=_multipart_OPQPIDJ2PBVU.2~XUY4MC1PW8T6.1 size=658041 2023-12-03T11:42:13.821 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.820+0000 7f8723d84780 1 > prepared multipart upload key=OPQPIDJ2PBVU upload=XUY4MC1PW8T6 tag=ANQMAT04E2FJ type=write size=2755193 2023-12-03T11:42:13.822 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.821+0000 7f8723d84780 1 < completed part key=_multipart_96RAVVSUKH0Y.2~2CSJ2XOYUVCW.0 size=1048576 2023-12-03T11:42:13.823 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.822+0000 7f8723d84780 1 < completed part key=_multipart_96RAVVSUKH0Y.2~2CSJ2XOYUVCW.1 size=31638 2023-12-03T11:42:13.825 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.824+0000 7f8723d84780 1 < completed multipart upload key=96RAVVSUKH0Y upload=2CSJ2XOYUVCW tag=QDD2WK0S6CF6 type=write size=2128790 2023-12-03T11:42:13.826 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.825+0000 7f8723d84780 1 > prepared operation key=931GNEXBHH35 tag=XBLB9ZBT337R type=del size=3044875 2023-12-03T11:42:13.828 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.827+0000 7f8723d84780 1 < completed part key=_multipart_LCK58DDM5XU9.2~KLHJAOXPXDTB.0 size=1048576 2023-12-03T11:42:13.829 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.828+0000 7f8723d84780 1 < completed part key=_multipart_LCK58DDM5XU9.2~KLHJAOXPXDTB.1 size=1048576 2023-12-03T11:42:13.829 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.828+0000 7f8723d84780 1 < canceled part key=_multipart_LCK58DDM5XU9.2~KLHJAOXPXDTB.2 size=707352 2023-12-03T11:42:13.831 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.830+0000 7f8723d84780 1 < canceled multipart upload key=LCK58DDM5XU9 upload=KLHJAOXPXDTB tag=G6L3JRICK0FM type=write size=3853080 2023-12-03T11:42:13.832 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.831+0000 7f8723d84780 1 > prepared operation key=M4VKPN6INFNZ tag=XWKMH29WFAE3 type=del size=2014796 2023-12-03T11:42:13.833 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.832+0000 7f8723d84780 1 < completed delete operation key=OGACI7CRPMT7 tag=S8ZW9QKD3BM6 type=del 2023-12-03T11:42:13.835 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.834+0000 7f8723d84780 1 > prepared part key=_multipart_D3JEVEY0E29E.2~ZPUU2CC62P0K.0 size=1048576 2023-12-03T11:42:13.836 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.835+0000 7f8723d84780 1 > prepared part key=_multipart_D3JEVEY0E29E.2~ZPUU2CC62P0K.1 size=1048576 2023-12-03T11:42:13.838 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.836+0000 7f8723d84780 1 > prepared part key=_multipart_D3JEVEY0E29E.2~ZPUU2CC62P0K.2 size=700746 2023-12-03T11:42:13.838 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.836+0000 7f8723d84780 1 > prepared multipart upload key=D3JEVEY0E29E upload=ZPUU2CC62P0K tag=63UHDLGK3CUP type=write size=3846474 2023-12-03T11:42:13.838 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.837+0000 7f8723d84780 1 < completed part key=_multipart_5UYL15O31IHM.2~EMVK461JOG0S.0 size=1048576 2023-12-03T11:42:13.839 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.838+0000 7f8723d84780 1 < completed part key=_multipart_5UYL15O31IHM.2~EMVK461JOG0S.1 size=607900 2023-12-03T11:42:13.841 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.840+0000 7f8723d84780 1 < completed multipart upload key=5UYL15O31IHM upload=EMVK461JOG0S tag=SHM48N5ZC9WI type=write size=2705052 2023-12-03T11:42:13.843 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.842+0000 7f8723d84780 1 > prepared operation key=931GNEXBHH35 tag=7QBZ9FACPLBS type=del size=3880395 2023-12-03T11:42:13.844 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.843+0000 7f8723d84780 1 < completed delete operation key=EITMJKL0LCYC tag=7NA0V109PS8I type=del 2023-12-03T11:42:13.845 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.844+0000 7f8723d84780 1 > prepared operation key=O7VVHXLDSY57 tag=JCAEYAX4YZQ7 type=del size=412892 2023-12-03T11:42:13.847 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.846+0000 7f8723d84780 1 < suggested remove operation key=5UYL15O31IHM tag=ROE2392VPJ5Q type=write 2023-12-03T11:42:13.849 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.848+0000 7f8723d84780 1 > prepared operation key=G36T76K8O7A1 tag=6VNLKQS2PPS7 type=del size=2888489 2023-12-03T11:42:13.850 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.849+0000 7f8723d84780 1 < completed part key=_multipart_UWS266H06VDK.2~O6QA2I1S3GJT.0 size=49590 2023-12-03T11:42:13.852 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.851+0000 7f8723d84780 1 < completed multipart upload key=UWS266H06VDK upload=O6QA2I1S3GJT tag=DOAI9DH1XKBN type=write size=1098166 2023-12-03T11:42:13.853 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.852+0000 7f8723d84780 1 > prepared operation key=96RAVVSUKH0Y tag=2DZOZQ0U53OG type=write size=630417 2023-12-03T11:42:13.855 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.854+0000 7f8723d84780 1 < suggested remove operation key=12XG7YPYTN4U tag=5SA8JZ7EKH2P type=del 2023-12-03T11:42:13.856 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.855+0000 7f8723d84780 1 > prepared operation key=AB0SN0E49Z5F tag=V317S3X4KD15 type=del size=2388976 2023-12-03T11:42:13.858 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.857+0000 7f8723d84780 1 < completed part key=_multipart_LMVO6CVEPN3K.2~PBE4UABGF0SK.0 size=1048576 2023-12-03T11:42:13.860 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.859+0000 7f8723d84780 1 < completed part key=_multipart_LMVO6CVEPN3K.2~PBE4UABGF0SK.1 size=539169 2023-12-03T11:42:13.862 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.861+0000 7f8723d84780 1 < completed multipart upload key=LMVO6CVEPN3K upload=PBE4UABGF0SK tag=DG6VBWDWQ1CE type=write size=2636321 2023-12-03T11:42:13.864 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.863+0000 7f8723d84780 1 > prepared part key=_multipart_K83BTR5BOLZE.2~6XMS6PFK77X2.0 size=1048576 2023-12-03T11:42:13.865 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.864+0000 7f8723d84780 1 > prepared part key=_multipart_K83BTR5BOLZE.2~6XMS6PFK77X2.1 size=1048576 2023-12-03T11:42:13.866 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.865+0000 7f8723d84780 1 > prepared part key=_multipart_K83BTR5BOLZE.2~6XMS6PFK77X2.2 size=535579 2023-12-03T11:42:13.866 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.865+0000 7f8723d84780 1 > prepared multipart upload key=K83BTR5BOLZE upload=6XMS6PFK77X2 tag=RMZTAVN05LGC type=write size=3681307 2023-12-03T11:42:13.867 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.866+0000 7f8723d84780 1 < completed write operation key=OGACI7CRPMT7 tag=X6SY8AU5V7F9 type=write size=90124 2023-12-03T11:42:13.868 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.868+0000 7f8723d84780 1 > prepared operation key=LCK58DDM5XU9 tag=OJ8WNH6SHLBM type=del size=118493 2023-12-03T11:42:13.870 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.869+0000 7f8723d84780 1 < completed delete operation key=DMQX2DGDLU7D tag=Y37WTF2UCOWO type=del 2023-12-03T11:42:13.872 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.871+0000 7f8723d84780 1 > prepared part key=_multipart_AB0SN0E49Z5F.2~FO25M8O71ODE.0 size=1048576 2023-12-03T11:42:13.872 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.872+0000 7f8723d84780 1 > prepared part key=_multipart_AB0SN0E49Z5F.2~FO25M8O71ODE.1 size=1048576 2023-12-03T11:42:13.873 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.872+0000 7f8723d84780 1 > prepared part key=_multipart_AB0SN0E49Z5F.2~FO25M8O71ODE.2 size=920431 2023-12-03T11:42:13.873 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.872+0000 7f8723d84780 1 > prepared multipart upload key=AB0SN0E49Z5F upload=FO25M8O71ODE tag=RM2JAB4NDYPL type=write size=4066159 2023-12-03T11:42:13.876 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.874+0000 7f8723d84780 1 < completed delete operation key=Y6S7QI60GCLE tag=YHEIOFT5WFHT type=del 2023-12-03T11:42:13.876 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.875+0000 7f8723d84780 1 > prepared operation key=EITMJKL0LCYC tag=X1VKCQG152DP type=del size=31400 2023-12-03T11:42:13.877 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.876+0000 7f8723d84780 1 < completed part key=_multipart_5UYL15O31IHM.2~KD4UNERETUM5.0 size=1048576 2023-12-03T11:42:13.878 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.877+0000 7f8723d84780 1 < completed part key=_multipart_5UYL15O31IHM.2~KD4UNERETUM5.1 size=1048576 2023-12-03T11:42:13.879 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.878+0000 7f8723d84780 1 < completed part key=_multipart_5UYL15O31IHM.2~KD4UNERETUM5.2 size=755152 2023-12-03T11:42:13.881 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.880+0000 7f8723d84780 1 < completed multipart upload key=5UYL15O31IHM upload=KD4UNERETUM5 tag=MOYAEFJU9G0S type=write size=3900880 2023-12-03T11:42:13.883 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.882+0000 7f8723d84780 1 > prepared part key=_multipart_FCA2R3HR61S2.2~YHSFJ4069H7I.0 size=732613 2023-12-03T11:42:13.883 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.882+0000 7f8723d84780 1 > prepared multipart upload key=FCA2R3HR61S2 upload=YHSFJ4069H7I tag=ERPCFV9QM8AO type=write size=1781189 2023-12-03T11:42:13.884 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.883+0000 7f8723d84780 1 < completed delete operation key=OPQPIDJ2PBVU tag=MO4H6017UUW2 type=del 2023-12-03T11:42:13.886 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.885+0000 7f8723d84780 1 > prepared part key=_multipart_W2704YS8KYQB.2~VP72VJC34VXX.0 size=1048576 2023-12-03T11:42:13.887 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.886+0000 7f8723d84780 1 > prepared part key=_multipart_W2704YS8KYQB.2~VP72VJC34VXX.1 size=599254 2023-12-03T11:42:13.887 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.886+0000 7f8723d84780 1 > prepared multipart upload key=W2704YS8KYQB upload=VP72VJC34VXX tag=2D7C8H8UTRQ5 type=write size=2696406 2023-12-03T11:42:13.888 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.887+0000 7f8723d84780 1 < completed delete operation key=7VMTBKUWU59F tag=QND3SCJ2C4UN type=del 2023-12-03T11:42:13.890 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.889+0000 7f8723d84780 1 > prepared part key=_multipart_96RAVVSUKH0Y.2~Y040NW727WE8.0 size=1048576 2023-12-03T11:42:13.891 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.890+0000 7f8723d84780 1 > prepared part key=_multipart_96RAVVSUKH0Y.2~Y040NW727WE8.1 size=24079 2023-12-03T11:42:13.891 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.890+0000 7f8723d84780 1 > prepared multipart upload key=96RAVVSUKH0Y upload=Y040NW727WE8 tag=WKB6T1S6BT68 type=write size=2121231 2023-12-03T11:42:13.892 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.891+0000 7f8723d84780 1 < completed part key=_multipart_OPQPIDJ2PBVU.2~XUY4MC1PW8T6.0 size=1048576 2023-12-03T11:42:13.893 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.892+0000 7f8723d84780 1 < completed part key=_multipart_OPQPIDJ2PBVU.2~XUY4MC1PW8T6.1 size=658041 2023-12-03T11:42:13.895 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.894+0000 7f8723d84780 1 < completed multipart upload key=OPQPIDJ2PBVU upload=XUY4MC1PW8T6 tag=ANQMAT04E2FJ type=write size=2755193 2023-12-03T11:42:13.896 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.895+0000 7f8723d84780 1 > prepared operation key=Y6S7QI60GCLE tag=WNJQRQEJUJV7 type=del size=3880959 2023-12-03T11:42:13.897 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.896+0000 7f8723d84780 1 < canceled operation key=931GNEXBHH35 tag=XBLB9ZBT337R type=del size=3044875 2023-12-03T11:42:13.898 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.897+0000 7f8723d84780 1 > prepared operation key=K83BTR5BOLZE tag=95GEVHTVAUDF type=del size=1886456 2023-12-03T11:42:13.899 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.898+0000 7f8723d84780 1 < completed delete operation key=M4VKPN6INFNZ tag=XWKMH29WFAE3 type=del 2023-12-03T11:42:13.900 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.899+0000 7f8723d84780 1 > prepared operation key=4I8PWBZOLDUG tag=1QTV8895XUX3 type=del size=1050874 2023-12-03T11:42:13.902 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.901+0000 7f8723d84780 1 < completed part key=_multipart_D3JEVEY0E29E.2~ZPUU2CC62P0K.0 size=1048576 2023-12-03T11:42:13.902 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.902+0000 7f8723d84780 1 < completed part key=_multipart_D3JEVEY0E29E.2~ZPUU2CC62P0K.1 size=1048576 2023-12-03T11:42:13.903 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.902+0000 7f8723d84780 1 < completed part key=_multipart_D3JEVEY0E29E.2~ZPUU2CC62P0K.2 size=700746 2023-12-03T11:42:13.905 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.904+0000 7f8723d84780 1 < completed multipart upload key=D3JEVEY0E29E upload=ZPUU2CC62P0K tag=63UHDLGK3CUP type=write size=3846474 2023-12-03T11:42:13.907 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.906+0000 7f8723d84780 1 > prepared operation key=96RAVVSUKH0Y tag=EJPTMRRLQKWN type=del size=555811 2023-12-03T11:42:13.908 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.907+0000 7f8723d84780 1 < completed delete operation key=931GNEXBHH35 tag=7QBZ9FACPLBS type=del 2023-12-03T11:42:13.910 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.909+0000 7f8723d84780 1 > prepared part key=_multipart_W2704YS8KYQB.2~C95O1THPBOX2.0 size=1048576 2023-12-03T11:42:13.911 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.910+0000 7f8723d84780 1 > prepared part key=_multipart_W2704YS8KYQB.2~C95O1THPBOX2.1 size=652560 2023-12-03T11:42:13.911 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.910+0000 7f8723d84780 1 > prepared multipart upload key=W2704YS8KYQB upload=C95O1THPBOX2 tag=NSR28SHJLRLE type=write size=2749712 2023-12-03T11:42:13.912 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.911+0000 7f8723d84780 1 < completed delete operation key=O7VVHXLDSY57 tag=JCAEYAX4YZQ7 type=del 2023-12-03T11:42:13.913 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.912+0000 7f8723d84780 1 > prepared operation key=7VMTBKUWU59F tag=QIKCJOI8W8OZ type=del size=1318314 2023-12-03T11:42:13.915 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.914+0000 7f8723d84780 1 < suggested remove operation key=G36T76K8O7A1 tag=6VNLKQS2PPS7 type=del 2023-12-03T11:42:13.917 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.916+0000 7f8723d84780 1 > prepared part key=_multipart_LCK58DDM5XU9.2~KRQYS22C2EFP.0 size=1048576 2023-12-03T11:42:13.918 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.917+0000 7f8723d84780 1 > prepared part key=_multipart_LCK58DDM5XU9.2~KRQYS22C2EFP.1 size=1048576 2023-12-03T11:42:13.919 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.918+0000 7f8723d84780 1 > prepared part key=_multipart_LCK58DDM5XU9.2~KRQYS22C2EFP.2 size=303647 2023-12-03T11:42:13.919 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.918+0000 7f8723d84780 1 > prepared multipart upload key=LCK58DDM5XU9 upload=KRQYS22C2EFP tag=1G7WX3VFLO70 type=write size=3449375 2023-12-03T11:42:13.920 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.919+0000 7f8723d84780 1 < completed write operation key=96RAVVSUKH0Y tag=2DZOZQ0U53OG type=write size=630417 2023-12-03T11:42:13.921 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.920+0000 7f8723d84780 1 > prepared operation key=G36T76K8O7A1 tag=6CV9ZOUZRKW2 type=del size=966207 2023-12-03T11:42:13.924 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.923+0000 7f8723d84780 1 < suggested update operation key=AB0SN0E49Z5F tag=V317S3X4KD15 type=del size=2388976 2023-12-03T11:42:13.926 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.925+0000 7f8723d84780 1 > prepared part key=_multipart_EITMJKL0LCYC.2~MY1K7O12IUO5.0 size=1048576 2023-12-03T11:42:13.927 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.926+0000 7f8723d84780 1 > prepared part key=_multipart_EITMJKL0LCYC.2~MY1K7O12IUO5.1 size=25909 2023-12-03T11:42:13.927 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.926+0000 7f8723d84780 1 > prepared multipart upload key=EITMJKL0LCYC upload=MY1K7O12IUO5 tag=R18KC1XOOQF3 type=write size=2123061 2023-12-03T11:42:13.928 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.928+0000 7f8723d84780 1 < completed part key=_multipart_K83BTR5BOLZE.2~6XMS6PFK77X2.0 size=1048576 2023-12-03T11:42:13.930 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.929+0000 7f8723d84780 1 < completed part key=_multipart_K83BTR5BOLZE.2~6XMS6PFK77X2.1 size=1048576 2023-12-03T11:42:13.931 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.930+0000 7f8723d84780 1 < completed part key=_multipart_K83BTR5BOLZE.2~6XMS6PFK77X2.2 size=535579 2023-12-03T11:42:13.933 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.932+0000 7f8723d84780 1 < completed multipart upload key=K83BTR5BOLZE upload=6XMS6PFK77X2 tag=RMZTAVN05LGC type=write size=3681307 2023-12-03T11:42:13.935 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.934+0000 7f8723d84780 1 > prepared operation key=OGACI7CRPMT7 tag=OQQ2IUDL7WH6 type=del size=3160358 2023-12-03T11:42:13.938 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.936+0000 7f8723d84780 1 < suggested update operation key=LCK58DDM5XU9 tag=OJ8WNH6SHLBM type=del size=118493 2023-12-03T11:42:13.939 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.938+0000 7f8723d84780 1 > prepared operation key=4I8PWBZOLDUG tag=J09OKX56FOFH type=del size=3215019 2023-12-03T11:42:13.940 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.939+0000 7f8723d84780 1 < completed part key=_multipart_AB0SN0E49Z5F.2~FO25M8O71ODE.0 size=1048576 2023-12-03T11:42:13.941 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.940+0000 7f8723d84780 1 < completed part key=_multipart_AB0SN0E49Z5F.2~FO25M8O71ODE.1 size=1048576 2023-12-03T11:42:13.943 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.941+0000 7f8723d84780 1 < completed part key=_multipart_AB0SN0E49Z5F.2~FO25M8O71ODE.2 size=920431 2023-12-03T11:42:13.944 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.943+0000 7f8723d84780 1 < completed multipart upload key=AB0SN0E49Z5F upload=FO25M8O71ODE tag=RM2JAB4NDYPL type=write size=4066159 2023-12-03T11:42:13.945 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.944+0000 7f8723d84780 1 > prepared operation key=UWS266H06VDK tag=8Z2HRNL25Q6J type=del size=1237531 2023-12-03T11:42:13.948 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.947+0000 7f8723d84780 1 < suggested remove operation key=EITMJKL0LCYC tag=X1VKCQG152DP type=del 2023-12-03T11:42:13.949 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.948+0000 7f8723d84780 1 > prepared operation key=D3JEVEY0E29E tag=FVUWHCA1GZ82 type=del size=2362916 2023-12-03T11:42:13.950 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.950+0000 7f8723d84780 1 < completed part key=_multipart_FCA2R3HR61S2.2~YHSFJ4069H7I.0 size=732613 2023-12-03T11:42:13.953 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.951+0000 7f8723d84780 1 < completed multipart upload key=FCA2R3HR61S2 upload=YHSFJ4069H7I tag=ERPCFV9QM8AO type=write size=1781189 2023-12-03T11:42:13.955 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.954+0000 7f8723d84780 1 > prepared part key=_multipart_OGACI7CRPMT7.2~2IZKO43UPYUK.0 size=222153 2023-12-03T11:42:13.955 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.954+0000 7f8723d84780 1 > prepared multipart upload key=OGACI7CRPMT7 upload=2IZKO43UPYUK tag=ZY1MSTZV5X3M type=write size=1270729 2023-12-03T11:42:13.956 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.955+0000 7f8723d84780 1 < completed part key=_multipart_W2704YS8KYQB.2~VP72VJC34VXX.0 size=1048576 2023-12-03T11:42:13.957 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.956+0000 7f8723d84780 1 < completed part key=_multipart_W2704YS8KYQB.2~VP72VJC34VXX.1 size=599254 2023-12-03T11:42:13.959 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.958+0000 7f8723d84780 1 < completed multipart upload key=W2704YS8KYQB upload=VP72VJC34VXX tag=2D7C8H8UTRQ5 type=write size=2696406 2023-12-03T11:42:13.960 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.959+0000 7f8723d84780 1 > prepared operation key=UWS266H06VDK tag=9KEGG8E2YVF6 type=del size=2866483 2023-12-03T11:42:13.961 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.960+0000 7f8723d84780 1 < completed part key=_multipart_96RAVVSUKH0Y.2~Y040NW727WE8.0 size=1048576 2023-12-03T11:42:13.962 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.961+0000 7f8723d84780 1 < completed part key=_multipart_96RAVVSUKH0Y.2~Y040NW727WE8.1 size=24079 2023-12-03T11:42:13.964 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.963+0000 7f8723d84780 1 < completed multipart upload key=96RAVVSUKH0Y upload=Y040NW727WE8 tag=WKB6T1S6BT68 type=write size=2121231 2023-12-03T11:42:13.966 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.965+0000 7f8723d84780 1 > prepared operation key=931GNEXBHH35 tag=1ZT77C51L7W4 type=write size=424367 2023-12-03T11:42:13.968 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.967+0000 7f8723d84780 1 < suggested update operation key=Y6S7QI60GCLE tag=WNJQRQEJUJV7 type=del size=3880959 2023-12-03T11:42:13.971 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.970+0000 7f8723d84780 1 > prepared operation key=10JRIKOZ16FY tag=14OJMN3II2SD type=del size=915243 2023-12-03T11:42:13.972 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.971+0000 7f8723d84780 1 < completed delete operation key=K83BTR5BOLZE tag=95GEVHTVAUDF type=del 2023-12-03T11:42:13.973 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.972+0000 7f8723d84780 1 > prepared operation key=K83BTR5BOLZE tag=1DSVLW4H7JXH type=del size=1107356 2023-12-03T11:42:13.974 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.973+0000 7f8723d84780 1 < completed delete operation key=4I8PWBZOLDUG tag=1QTV8895XUX3 type=del 2023-12-03T11:42:13.976 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.975+0000 7f8723d84780 1 > prepared part key=_multipart_D3JEVEY0E29E.2~A89B2CB0ED3U.0 size=909193 2023-12-03T11:42:13.976 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.975+0000 7f8723d84780 1 > prepared multipart upload key=D3JEVEY0E29E upload=A89B2CB0ED3U tag=4EYZ3GZM56DK type=write size=1957769 2023-12-03T11:42:13.978 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.976+0000 7f8723d84780 1 < completed delete operation key=96RAVVSUKH0Y tag=EJPTMRRLQKWN type=del 2023-12-03T11:42:13.980 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.978+0000 7f8723d84780 1 > prepared part key=_multipart_W2704YS8KYQB.2~ZJE5DSA36KX2.0 size=1048576 2023-12-03T11:42:13.980 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.979+0000 7f8723d84780 1 > prepared part key=_multipart_W2704YS8KYQB.2~ZJE5DSA36KX2.1 size=25120 2023-12-03T11:42:13.980 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.979+0000 7f8723d84780 1 > prepared multipart upload key=W2704YS8KYQB upload=ZJE5DSA36KX2 tag=9IBHVT271QA9 type=write size=2122272 2023-12-03T11:42:13.982 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.980+0000 7f8723d84780 1 < completed part key=_multipart_W2704YS8KYQB.2~C95O1THPBOX2.0 size=1048576 2023-12-03T11:42:13.983 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.981+0000 7f8723d84780 1 < completed part key=_multipart_W2704YS8KYQB.2~C95O1THPBOX2.1 size=652560 2023-12-03T11:42:13.984 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.983+0000 7f8723d84780 1 < completed multipart upload key=W2704YS8KYQB upload=C95O1THPBOX2 tag=NSR28SHJLRLE type=write size=2749712 2023-12-03T11:42:13.985 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.984+0000 7f8723d84780 1 > prepared operation key=12XG7YPYTN4U tag=EIXHE5ACLYNO type=del size=174571 2023-12-03T11:42:13.988 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.987+0000 7f8723d84780 1 < suggested update operation key=7VMTBKUWU59F tag=QIKCJOI8W8OZ type=del size=1318314 2023-12-03T11:42:13.990 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.989+0000 7f8723d84780 1 > prepared part key=_multipart_W2704YS8KYQB.2~NKPPHUQCR0BS.0 size=1048576 2023-12-03T11:42:13.990 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.990+0000 7f8723d84780 1 > prepared part key=_multipart_W2704YS8KYQB.2~NKPPHUQCR0BS.1 size=1048576 2023-12-03T11:42:13.991 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.990+0000 7f8723d84780 1 > prepared part key=_multipart_W2704YS8KYQB.2~NKPPHUQCR0BS.2 size=386193 2023-12-03T11:42:13.992 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.990+0000 7f8723d84780 1 > prepared multipart upload key=W2704YS8KYQB upload=NKPPHUQCR0BS tag=08YA83FCYYMA type=write size=3531921 2023-12-03T11:42:13.993 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.992+0000 7f8723d84780 1 < completed part key=_multipart_LCK58DDM5XU9.2~KRQYS22C2EFP.0 size=1048576 2023-12-03T11:42:13.994 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.993+0000 7f8723d84780 1 < completed part key=_multipart_LCK58DDM5XU9.2~KRQYS22C2EFP.1 size=1048576 2023-12-03T11:42:13.994 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.993+0000 7f8723d84780 1 < completed part key=_multipart_LCK58DDM5XU9.2~KRQYS22C2EFP.2 size=303647 2023-12-03T11:42:13.997 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.995+0000 7f8723d84780 1 < completed multipart upload key=LCK58DDM5XU9 upload=KRQYS22C2EFP tag=1G7WX3VFLO70 type=write size=3449375 2023-12-03T11:42:13.998 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.997+0000 7f8723d84780 1 > prepared part key=_multipart_FCA2R3HR61S2.2~F0VOY33R7E2B.0 size=1048576 2023-12-03T11:42:13.999 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.998+0000 7f8723d84780 1 > prepared part key=_multipart_FCA2R3HR61S2.2~F0VOY33R7E2B.1 size=175756 2023-12-03T11:42:14.000 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:13.998+0000 7f8723d84780 1 > prepared multipart upload key=FCA2R3HR61S2 upload=F0VOY33R7E2B tag=3SBRAX6EGMZL type=write size=2272908 2023-12-03T11:42:14.001 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.000+0000 7f8723d84780 1 < completed delete operation key=G36T76K8O7A1 tag=6CV9ZOUZRKW2 type=del 2023-12-03T11:42:14.002 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.001+0000 7f8723d84780 1 > prepared operation key=K83BTR5BOLZE tag=RUKS7J74ZA5Y type=write size=785759 2023-12-03T11:42:14.004 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.002+0000 7f8723d84780 1 < completed part key=_multipart_EITMJKL0LCYC.2~MY1K7O12IUO5.0 size=1048576 2023-12-03T11:42:14.004 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.003+0000 7f8723d84780 1 < completed part key=_multipart_EITMJKL0LCYC.2~MY1K7O12IUO5.1 size=25909 2023-12-03T11:42:14.006 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.005+0000 7f8723d84780 1 < completed multipart upload key=EITMJKL0LCYC upload=MY1K7O12IUO5 tag=R18KC1XOOQF3 type=write size=2123061 2023-12-03T11:42:14.007 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.006+0000 7f8723d84780 1 > prepared operation key=HIU6L0NQ8Q95 tag=VTITXL8DDXW1 type=del size=928718 2023-12-03T11:42:14.010 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.009+0000 7f8723d84780 1 < suggested update operation key=OGACI7CRPMT7 tag=OQQ2IUDL7WH6 type=del size=3160358 2023-12-03T11:42:14.011 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.010+0000 7f8723d84780 1 > prepared operation key=931GNEXBHH35 tag=RT1L9C1GUK7X type=del size=2161908 2023-12-03T11:42:14.012 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.011+0000 7f8723d84780 1 < canceled operation key=4I8PWBZOLDUG tag=J09OKX56FOFH type=del size=3215019 2023-12-03T11:42:14.013 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.012+0000 7f8723d84780 1 > prepared operation key=5UYL15O31IHM tag=W6IZWSJ7WJAN type=del size=1771593 2023-12-03T11:42:14.014 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.013+0000 7f8723d84780 1 < canceled operation key=UWS266H06VDK tag=8Z2HRNL25Q6J type=del size=1237531 2023-12-03T11:42:14.016 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.015+0000 7f8723d84780 1 > prepared operation key=4I8PWBZOLDUG tag=N3KPS8KT5UT1 type=del size=276257 2023-12-03T11:42:14.017 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.016+0000 7f8723d84780 1 < completed delete operation key=D3JEVEY0E29E tag=FVUWHCA1GZ82 type=del 2023-12-03T11:42:14.018 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.017+0000 7f8723d84780 1 > prepared operation key=OPQPIDJ2PBVU tag=V3XUNC55CEON type=del size=2186055 2023-12-03T11:42:14.019 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.018+0000 7f8723d84780 1 < completed part key=_multipart_OGACI7CRPMT7.2~2IZKO43UPYUK.0 size=222153 2023-12-03T11:42:14.021 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.020+0000 7f8723d84780 1 < completed multipart upload key=OGACI7CRPMT7 upload=2IZKO43UPYUK tag=ZY1MSTZV5X3M type=write size=1270729 2023-12-03T11:42:14.022 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.021+0000 7f8723d84780 1 > prepared operation key=DMQX2DGDLU7D tag=BZLV07OJDBHI type=del size=919314 2023-12-03T11:42:14.024 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.023+0000 7f8723d84780 1 < completed delete operation key=UWS266H06VDK tag=9KEGG8E2YVF6 type=del 2023-12-03T11:42:14.026 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.025+0000 7f8723d84780 1 > prepared part key=_multipart_D3JEVEY0E29E.2~MSAPOWPLHRYV.0 size=1048576 2023-12-03T11:42:14.027 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.026+0000 7f8723d84780 1 > prepared part key=_multipart_D3JEVEY0E29E.2~MSAPOWPLHRYV.1 size=1048576 2023-12-03T11:42:14.028 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.027+0000 7f8723d84780 1 > prepared part key=_multipart_D3JEVEY0E29E.2~MSAPOWPLHRYV.2 size=792559 2023-12-03T11:42:14.028 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.027+0000 7f8723d84780 1 > prepared multipart upload key=D3JEVEY0E29E upload=MSAPOWPLHRYV tag=QMSFQQ64XMJ4 type=write size=3938287 2023-12-03T11:42:14.030 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.029+0000 7f8723d84780 1 < suggested remove operation key=931GNEXBHH35 tag=1ZT77C51L7W4 type=write 2023-12-03T11:42:14.031 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.030+0000 7f8723d84780 1 > prepared operation key=AB0SN0E49Z5F tag=DWXTINW8X1UU type=del size=1180083 2023-12-03T11:42:14.032 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.031+0000 7f8723d84780 1 < completed delete operation key=10JRIKOZ16FY tag=14OJMN3II2SD type=del 2023-12-03T11:42:14.034 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.033+0000 7f8723d84780 1 > prepared part key=_multipart_OPQPIDJ2PBVU.2~X83RS0BWKYU9.0 size=1048576 2023-12-03T11:42:14.035 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.034+0000 7f8723d84780 1 > prepared part key=_multipart_OPQPIDJ2PBVU.2~X83RS0BWKYU9.1 size=413881 2023-12-03T11:42:14.036 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.034+0000 7f8723d84780 1 > prepared multipart upload key=OPQPIDJ2PBVU upload=X83RS0BWKYU9 tag=A5KBMYE9WXCQ type=write size=2511033 2023-12-03T11:42:14.037 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.036+0000 7f8723d84780 1 < completed delete operation key=K83BTR5BOLZE tag=1DSVLW4H7JXH type=del 2023-12-03T11:42:14.038 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.037+0000 7f8723d84780 1 > prepared operation key=12XG7YPYTN4U tag=TP3FBJVNPUXL type=del size=1533118 2023-12-03T11:42:14.039 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.038+0000 7f8723d84780 1 < completed part key=_multipart_D3JEVEY0E29E.2~A89B2CB0ED3U.0 size=909193 2023-12-03T11:42:14.041 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.040+0000 7f8723d84780 1 < completed multipart upload key=D3JEVEY0E29E upload=A89B2CB0ED3U tag=4EYZ3GZM56DK type=write size=1957769 2023-12-03T11:42:14.042 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.041+0000 7f8723d84780 1 > prepared operation key=LCK58DDM5XU9 tag=4C1JJNUQ0V3K type=del size=1050817 2023-12-03T11:42:14.044 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.043+0000 7f8723d84780 1 < completed part key=_multipart_W2704YS8KYQB.2~ZJE5DSA36KX2.0 size=1048576 2023-12-03T11:42:14.045 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.044+0000 7f8723d84780 1 < completed part key=_multipart_W2704YS8KYQB.2~ZJE5DSA36KX2.1 size=25120 2023-12-03T11:42:14.047 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.046+0000 7f8723d84780 1 < completed multipart upload key=W2704YS8KYQB upload=ZJE5DSA36KX2 tag=9IBHVT271QA9 type=write size=2122272 2023-12-03T11:42:14.049 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.048+0000 7f8723d84780 1 > prepared operation key=EITMJKL0LCYC tag=68871T69V031 type=del size=282434 2023-12-03T11:42:14.051 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.050+0000 7f8723d84780 1 < completed delete operation key=12XG7YPYTN4U tag=EIXHE5ACLYNO type=del 2023-12-03T11:42:14.054 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.052+0000 7f8723d84780 1 > prepared part key=_multipart_12XG7YPYTN4U.2~57S4P450V0ID.0 size=213786 2023-12-03T11:42:14.054 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.052+0000 7f8723d84780 1 > prepared multipart upload key=12XG7YPYTN4U upload=57S4P450V0ID tag=7J9S0G2WEME6 type=write size=1262362 2023-12-03T11:42:14.054 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.053+0000 7f8723d84780 1 < completed part key=_multipart_W2704YS8KYQB.2~NKPPHUQCR0BS.0 size=1048576 2023-12-03T11:42:14.056 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.054+0000 7f8723d84780 1 < completed part key=_multipart_W2704YS8KYQB.2~NKPPHUQCR0BS.1 size=1048576 2023-12-03T11:42:14.056 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.055+0000 7f8723d84780 1 < completed part key=_multipart_W2704YS8KYQB.2~NKPPHUQCR0BS.2 size=386193 2023-12-03T11:42:14.058 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.057+0000 7f8723d84780 1 < completed multipart upload key=W2704YS8KYQB upload=NKPPHUQCR0BS tag=08YA83FCYYMA type=write size=3531921 2023-12-03T11:42:14.060 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.059+0000 7f8723d84780 1 > prepared operation key=8NONX2I08YMJ tag=QHQ910X5A0OD type=del size=3909880 2023-12-03T11:42:14.061 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.060+0000 7f8723d84780 1 < completed part key=_multipart_FCA2R3HR61S2.2~F0VOY33R7E2B.0 size=1048576 2023-12-03T11:42:14.061 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.060+0000 7f8723d84780 1 < canceled part key=_multipart_FCA2R3HR61S2.2~F0VOY33R7E2B.1 size=175756 2023-12-03T11:42:14.063 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.062+0000 7f8723d84780 1 < canceled multipart upload key=FCA2R3HR61S2 upload=F0VOY33R7E2B tag=3SBRAX6EGMZL type=write size=2272908 2023-12-03T11:42:14.065 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.063+0000 7f8723d84780 1 > prepared operation key=7VMTBKUWU59F tag=LNA71WX0YCKB type=del size=3950299 2023-12-03T11:42:14.066 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.065+0000 7f8723d84780 1 < completed write operation key=K83BTR5BOLZE tag=RUKS7J74ZA5Y type=write size=785759 2023-12-03T11:42:14.067 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.066+0000 7f8723d84780 1 > prepared operation key=DMQX2DGDLU7D tag=DQ5H6D843IGB type=del size=1077255 2023-12-03T11:42:14.070 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.068+0000 7f8723d84780 1 < suggested remove operation key=HIU6L0NQ8Q95 tag=VTITXL8DDXW1 type=del 2023-12-03T11:42:14.072 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.071+0000 7f8723d84780 1 > prepared part key=_multipart_D3JEVEY0E29E.2~TQJKNW86D9B7.0 size=1048576 2023-12-03T11:42:14.073 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.072+0000 7f8723d84780 1 > prepared part key=_multipart_D3JEVEY0E29E.2~TQJKNW86D9B7.1 size=1048576 2023-12-03T11:42:14.074 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.073+0000 7f8723d84780 1 > prepared part key=_multipart_D3JEVEY0E29E.2~TQJKNW86D9B7.2 size=688038 2023-12-03T11:42:14.074 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.073+0000 7f8723d84780 1 > prepared multipart upload key=D3JEVEY0E29E upload=TQJKNW86D9B7 tag=FSUFI3BNRWTP type=write size=3833766 2023-12-03T11:42:14.075 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.073+0000 7f8723d84780 -1 < no bi entry to suggest for operation key=931GNEXBHH35 tag=RT1L9C1GUK7X type=del size=2161908: (2) No such file or directory 2023-12-03T11:42:14.077 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.076+0000 7f8723d84780 1 > prepared part key=_multipart_7THZZ1J5LOZK.2~2KPW1QR071UY.0 size=1048576 2023-12-03T11:42:14.078 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.076+0000 7f8723d84780 1 > prepared part key=_multipart_7THZZ1J5LOZK.2~2KPW1QR071UY.1 size=1048576 2023-12-03T11:42:14.079 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.077+0000 7f8723d84780 1 > prepared part key=_multipart_7THZZ1J5LOZK.2~2KPW1QR071UY.2 size=886981 2023-12-03T11:42:14.079 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.077+0000 7f8723d84780 1 > prepared multipart upload key=7THZZ1J5LOZK upload=2KPW1QR071UY tag=HNCSHPMO0EA9 type=write size=4032709 2023-12-03T11:42:14.080 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.079+0000 7f8723d84780 1 < completed delete operation key=5UYL15O31IHM tag=W6IZWSJ7WJAN type=del 2023-12-03T11:42:14.081 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.080+0000 7f8723d84780 1 > prepared operation key=HIU6L0NQ8Q95 tag=HJXTOSQAL8W9 type=del size=3484367 2023-12-03T11:42:14.082 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.081+0000 7f8723d84780 1 < completed delete operation key=4I8PWBZOLDUG tag=N3KPS8KT5UT1 type=del 2023-12-03T11:42:14.086 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.085+0000 7f8723d84780 1 > prepared part key=_multipart_HIU6L0NQ8Q95.2~YUA1KC1GZDT2.0 size=362653 2023-12-03T11:42:14.086 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.085+0000 7f8723d84780 1 > prepared multipart upload key=HIU6L0NQ8Q95 upload=YUA1KC1GZDT2 tag=HUFZH00D7VYW type=write size=1411229 2023-12-03T11:42:14.089 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.086+0000 7f8723d84780 1 < completed delete operation key=OPQPIDJ2PBVU tag=V3XUNC55CEON type=del 2023-12-03T11:42:14.089 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.087+0000 7f8723d84780 1 > prepared operation key=7VMTBKUWU59F tag=HQX27CX0UU70 type=del size=660942 2023-12-03T11:42:14.091 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.090+0000 7f8723d84780 1 < suggested remove operation key=DMQX2DGDLU7D tag=BZLV07OJDBHI type=del 2023-12-03T11:42:14.093 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.092+0000 7f8723d84780 1 > prepared part key=_multipart_DMQX2DGDLU7D.2~AAOHJ30I1RD6.0 size=1048576 2023-12-03T11:42:14.094 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.093+0000 7f8723d84780 1 > prepared part key=_multipart_DMQX2DGDLU7D.2~AAOHJ30I1RD6.1 size=1048576 2023-12-03T11:42:14.095 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.094+0000 7f8723d84780 1 > prepared part key=_multipart_DMQX2DGDLU7D.2~AAOHJ30I1RD6.2 size=599972 2023-12-03T11:42:14.095 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.094+0000 7f8723d84780 1 > prepared multipart upload key=DMQX2DGDLU7D upload=AAOHJ30I1RD6 tag=8PTCCCVADE1J type=write size=3745700 2023-12-03T11:42:14.095 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.094+0000 7f8723d84780 1 < canceled part key=_multipart_D3JEVEY0E29E.2~MSAPOWPLHRYV.0 size=1048576 2023-12-03T11:42:14.095 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.094+0000 7f8723d84780 1 < canceled part key=_multipart_D3JEVEY0E29E.2~MSAPOWPLHRYV.1 size=1048576 2023-12-03T11:42:14.096 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.095+0000 7f8723d84780 1 < completed part key=_multipart_D3JEVEY0E29E.2~MSAPOWPLHRYV.2 size=792559 2023-12-03T11:42:14.099 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.098+0000 7f8723d84780 1 < canceled multipart upload key=D3JEVEY0E29E upload=MSAPOWPLHRYV tag=QMSFQQ64XMJ4 type=write size=3938287 2023-12-03T11:42:14.101 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.100+0000 7f8723d84780 1 > prepared part key=_multipart_FCA2R3HR61S2.2~SV7JX4SNYE50.0 size=376343 2023-12-03T11:42:14.101 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.100+0000 7f8723d84780 1 > prepared multipart upload key=FCA2R3HR61S2 upload=SV7JX4SNYE50 tag=98K1MBEXFYX8 type=write size=1424919 2023-12-03T11:42:14.102 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.101+0000 7f8723d84780 1 < completed delete operation key=AB0SN0E49Z5F tag=DWXTINW8X1UU type=del 2023-12-03T11:42:14.105 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.104+0000 7f8723d84780 1 > prepared operation key=KS5J7E7KE2IJ tag=1R5W8WOJK9XA type=del size=1319064 2023-12-03T11:42:14.106 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.105+0000 7f8723d84780 1 < completed part key=_multipart_OPQPIDJ2PBVU.2~X83RS0BWKYU9.0 size=1048576 2023-12-03T11:42:14.107 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.106+0000 7f8723d84780 1 < completed part key=_multipart_OPQPIDJ2PBVU.2~X83RS0BWKYU9.1 size=413881 2023-12-03T11:42:14.109 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.108+0000 7f8723d84780 1 < completed multipart upload key=OPQPIDJ2PBVU upload=X83RS0BWKYU9 tag=A5KBMYE9WXCQ type=write size=2511033 2023-12-03T11:42:14.110 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.109+0000 7f8723d84780 1 > prepared operation key=EITMJKL0LCYC tag=WY4H8X4IHN1X type=del size=3199997 2023-12-03T11:42:14.111 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.110+0000 7f8723d84780 1 < completed delete operation key=12XG7YPYTN4U tag=TP3FBJVNPUXL type=del 2023-12-03T11:42:14.112 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.111+0000 7f8723d84780 1 > prepared operation key=FCA2R3HR61S2 tag=SJHJ83PEWBLA type=del size=4141943 2023-12-03T11:42:14.114 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.113+0000 7f8723d84780 1 < completed delete operation key=LCK58DDM5XU9 tag=4C1JJNUQ0V3K type=del 2023-12-03T11:42:14.115 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.114+0000 7f8723d84780 1 > prepared operation key=EITMJKL0LCYC tag=PWYVWGDGXQ6I type=del size=3286548 2023-12-03T11:42:14.116 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.115+0000 7f8723d84780 1 < completed delete operation key=EITMJKL0LCYC tag=68871T69V031 type=del 2023-12-03T11:42:14.118 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.117+0000 7f8723d84780 1 > prepared part key=_multipart_VENJI0KD1XDW.2~SSPUZKQGE1XI.0 size=1048576 2023-12-03T11:42:14.119 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.118+0000 7f8723d84780 1 > prepared part key=_multipart_VENJI0KD1XDW.2~SSPUZKQGE1XI.1 size=986295 2023-12-03T11:42:14.120 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.118+0000 7f8723d84780 1 > prepared multipart upload key=VENJI0KD1XDW upload=SSPUZKQGE1XI tag=45HWCQGF3PK2 type=write size=3083447 2023-12-03T11:42:14.121 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.120+0000 7f8723d84780 1 < completed part key=_multipart_12XG7YPYTN4U.2~57S4P450V0ID.0 size=213786 2023-12-03T11:42:14.123 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.122+0000 7f8723d84780 1 < completed multipart upload key=12XG7YPYTN4U upload=57S4P450V0ID tag=7J9S0G2WEME6 type=write size=1262362 2023-12-03T11:42:14.124 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.123+0000 7f8723d84780 1 > prepared operation key=D3JEVEY0E29E tag=1QZZ5XA9L52A type=del size=3362475 2023-12-03T11:42:14.126 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.125+0000 7f8723d84780 1 < completed delete operation key=8NONX2I08YMJ tag=QHQ910X5A0OD type=del 2023-12-03T11:42:14.128 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.127+0000 7f8723d84780 1 > prepared part key=_multipart_7VMTBKUWU59F.2~SU3MQ5EP71Y3.0 size=1048576 2023-12-03T11:42:14.129 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.128+0000 7f8723d84780 1 > prepared part key=_multipart_7VMTBKUWU59F.2~SU3MQ5EP71Y3.1 size=1019821 2023-12-03T11:42:14.129 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.128+0000 7f8723d84780 1 > prepared multipart upload key=7VMTBKUWU59F upload=SU3MQ5EP71Y3 tag=QXWSRZ9Q4NDG type=write size=3116973 2023-12-03T11:42:14.130 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.129+0000 7f8723d84780 1 < completed delete operation key=7VMTBKUWU59F tag=LNA71WX0YCKB type=del 2023-12-03T11:42:14.132 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.131+0000 7f8723d84780 1 > prepared operation key=96RAVVSUKH0Y tag=K8E5OUYPYHV6 type=del size=483249 2023-12-03T11:42:14.133 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.132+0000 7f8723d84780 -1 < failed to complete operation key=DMQX2DGDLU7D tag=DQ5H6D843IGB type=del size=1077255: (22) Invalid argument 2023-12-03T11:42:14.136 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.135+0000 7f8723d84780 1 > prepared part key=_multipart_VENJI0KD1XDW.2~GN2G8UW8OP3I.0 size=1048576 2023-12-03T11:42:14.137 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.136+0000 7f8723d84780 1 > prepared part key=_multipart_VENJI0KD1XDW.2~GN2G8UW8OP3I.1 size=897689 2023-12-03T11:42:14.137 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.136+0000 7f8723d84780 1 > prepared multipart upload key=VENJI0KD1XDW upload=GN2G8UW8OP3I tag=929LEX3ZVDXH type=write size=2994841 2023-12-03T11:42:14.138 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.137+0000 7f8723d84780 1 < completed part key=_multipart_D3JEVEY0E29E.2~TQJKNW86D9B7.0 size=1048576 2023-12-03T11:42:14.139 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.138+0000 7f8723d84780 1 < completed part key=_multipart_D3JEVEY0E29E.2~TQJKNW86D9B7.1 size=1048576 2023-12-03T11:42:14.139 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.138+0000 7f8723d84780 1 < canceled part key=_multipart_D3JEVEY0E29E.2~TQJKNW86D9B7.2 size=688038 2023-12-03T11:42:14.141 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.140+0000 7f8723d84780 1 < canceled multipart upload key=D3JEVEY0E29E upload=TQJKNW86D9B7 tag=FSUFI3BNRWTP type=write size=3833766 2023-12-03T11:42:14.142 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.141+0000 7f8723d84780 1 > prepared operation key=W2704YS8KYQB tag=8SRER5PIW6ZY type=del size=2389101 2023-12-03T11:42:14.143 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.142+0000 7f8723d84780 1 < completed part key=_multipart_7THZZ1J5LOZK.2~2KPW1QR071UY.0 size=1048576 2023-12-03T11:42:14.144 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.142+0000 7f8723d84780 1 < canceled part key=_multipart_7THZZ1J5LOZK.2~2KPW1QR071UY.1 size=1048576 2023-12-03T11:42:14.144 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.143+0000 7f8723d84780 1 < completed part key=_multipart_7THZZ1J5LOZK.2~2KPW1QR071UY.2 size=886981 2023-12-03T11:42:14.146 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.145+0000 7f8723d84780 1 < canceled multipart upload key=7THZZ1J5LOZK upload=2KPW1QR071UY tag=HNCSHPMO0EA9 type=write size=4032709 2023-12-03T11:42:14.148 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.147+0000 7f8723d84780 1 > prepared operation key=K83BTR5BOLZE tag=YBS214LW8F0R type=del size=934183 2023-12-03T11:42:14.149 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.148+0000 7f8723d84780 1 < canceled operation key=HIU6L0NQ8Q95 tag=HJXTOSQAL8W9 type=del size=3484367 2023-12-03T11:42:14.151 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.150+0000 7f8723d84780 1 > prepared part key=_multipart_O7VVHXLDSY57.2~MC5R88KHHEC4.0 size=374510 2023-12-03T11:42:14.151 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.150+0000 7f8723d84780 1 > prepared multipart upload key=O7VVHXLDSY57 upload=MC5R88KHHEC4 tag=G4H12UCFU5IX type=write size=1423086 2023-12-03T11:42:14.152 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.151+0000 7f8723d84780 1 < completed part key=_multipart_HIU6L0NQ8Q95.2~YUA1KC1GZDT2.0 size=362653 2023-12-03T11:42:14.154 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.153+0000 7f8723d84780 1 < completed multipart upload key=HIU6L0NQ8Q95 upload=YUA1KC1GZDT2 tag=HUFZH00D7VYW type=write size=1411229 2023-12-03T11:42:14.155 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.154+0000 7f8723d84780 1 > prepared operation key=7VMTBKUWU59F tag=12W0ZSR1220R type=del size=2994260 2023-12-03T11:42:14.157 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.156+0000 7f8723d84780 1 < completed delete operation key=7VMTBKUWU59F tag=HQX27CX0UU70 type=del 2023-12-03T11:42:14.158 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.157+0000 7f8723d84780 1 > prepared operation key=VENJI0KD1XDW tag=JUHBR2QHE2VS type=write size=543826 2023-12-03T11:42:14.159 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.158+0000 7f8723d84780 1 < completed part key=_multipart_DMQX2DGDLU7D.2~AAOHJ30I1RD6.0 size=1048576 2023-12-03T11:42:14.160 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.159+0000 7f8723d84780 1 < completed part key=_multipart_DMQX2DGDLU7D.2~AAOHJ30I1RD6.1 size=1048576 2023-12-03T11:42:14.161 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.160+0000 7f8723d84780 1 < completed part key=_multipart_DMQX2DGDLU7D.2~AAOHJ30I1RD6.2 size=599972 2023-12-03T11:42:14.164 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.163+0000 7f8723d84780 1 < completed multipart upload key=DMQX2DGDLU7D upload=AAOHJ30I1RD6 tag=8PTCCCVADE1J type=write size=3745700 2023-12-03T11:42:14.165 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.164+0000 7f8723d84780 1 > prepared operation key=TSTIBGVYUZZZ tag=DJ3RQ2NNN9HB type=del size=2442911 2023-12-03T11:42:14.166 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.165+0000 7f8723d84780 1 < completed part key=_multipart_FCA2R3HR61S2.2~SV7JX4SNYE50.0 size=376343 2023-12-03T11:42:14.169 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.168+0000 7f8723d84780 1 < completed multipart upload key=FCA2R3HR61S2 upload=SV7JX4SNYE50 tag=98K1MBEXFYX8 type=write size=1424919 2023-12-03T11:42:14.170 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.169+0000 7f8723d84780 1 > prepared operation key=12XG7YPYTN4U tag=LJM0OKI6EPWW type=del size=1522949 2023-12-03T11:42:14.171 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.170+0000 7f8723d84780 1 < completed delete operation key=KS5J7E7KE2IJ tag=1R5W8WOJK9XA type=del 2023-12-03T11:42:14.173 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.172+0000 7f8723d84780 1 > prepared operation key=M4VKPN6INFNZ tag=9PWAX0LBI0O4 type=del size=428132 2023-12-03T11:42:14.175 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.174+0000 7f8723d84780 1 < suggested remove operation key=EITMJKL0LCYC tag=WY4H8X4IHN1X type=del 2023-12-03T11:42:14.178 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.177+0000 7f8723d84780 1 > prepared part key=_multipart_CKABTI1EOAWB.2~2NO8X9DO5OGK.0 size=354962 2023-12-03T11:42:14.178 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.177+0000 7f8723d84780 1 > prepared multipart upload key=CKABTI1EOAWB upload=2NO8X9DO5OGK tag=X6MN8I7HH3DS type=write size=1403538 2023-12-03T11:42:14.180 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.179+0000 7f8723d84780 1 < suggested update operation key=FCA2R3HR61S2 tag=SJHJ83PEWBLA type=del size=4141943 2023-12-03T11:42:14.183 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.182+0000 7f8723d84780 1 > prepared part key=_multipart_10JRIKOZ16FY.2~AMQ4LBX5OMC3.0 size=1048576 2023-12-03T11:42:14.184 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.183+0000 7f8723d84780 1 > prepared part key=_multipart_10JRIKOZ16FY.2~AMQ4LBX5OMC3.1 size=1048576 2023-12-03T11:42:14.184 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.183+0000 7f8723d84780 1 > prepared part key=_multipart_10JRIKOZ16FY.2~AMQ4LBX5OMC3.2 size=691404 2023-12-03T11:42:14.185 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.183+0000 7f8723d84780 1 > prepared multipart upload key=10JRIKOZ16FY upload=AMQ4LBX5OMC3 tag=YE99SFEH86PO type=write size=3837132 2023-12-03T11:42:14.186 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.185+0000 7f8723d84780 -1 < failed to complete operation key=EITMJKL0LCYC tag=PWYVWGDGXQ6I type=del size=3286548: (22) Invalid argument 2023-12-03T11:42:14.187 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.186+0000 7f8723d84780 1 > prepared operation key=Y6S7QI60GCLE tag=2K95GING56R4 type=write size=909627 2023-12-03T11:42:14.188 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.187+0000 7f8723d84780 1 < completed part key=_multipart_VENJI0KD1XDW.2~SSPUZKQGE1XI.0 size=1048576 2023-12-03T11:42:14.189 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.188+0000 7f8723d84780 1 < completed part key=_multipart_VENJI0KD1XDW.2~SSPUZKQGE1XI.1 size=986295 2023-12-03T11:42:14.191 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.190+0000 7f8723d84780 1 < completed multipart upload key=VENJI0KD1XDW upload=SSPUZKQGE1XI tag=45HWCQGF3PK2 type=write size=3083447 2023-12-03T11:42:14.194 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.193+0000 7f8723d84780 1 > prepared part key=_multipart_G36T76K8O7A1.2~E76G4OLL0XBE.0 size=1048576 2023-12-03T11:42:14.195 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.194+0000 7f8723d84780 1 > prepared part key=_multipart_G36T76K8O7A1.2~E76G4OLL0XBE.1 size=524335 2023-12-03T11:42:14.195 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.194+0000 7f8723d84780 1 > prepared multipart upload key=G36T76K8O7A1 upload=E76G4OLL0XBE tag=U52UKBHA8SD2 type=write size=2621487 2023-12-03T11:42:14.196 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.195+0000 7f8723d84780 1 < canceled operation key=D3JEVEY0E29E tag=1QZZ5XA9L52A type=del size=3362475 2023-12-03T11:42:14.201 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.197+0000 7f8723d84780 1 > prepared part key=_multipart_5UYL15O31IHM.2~OBUOAM316GBE.0 size=1048576 2023-12-03T11:42:14.201 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.198+0000 7f8723d84780 1 > prepared part key=_multipart_5UYL15O31IHM.2~OBUOAM316GBE.1 size=170264 2023-12-03T11:42:14.201 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.198+0000 7f8723d84780 1 > prepared multipart upload key=5UYL15O31IHM upload=OBUOAM316GBE tag=6GONZV1YV106 type=write size=2267416 2023-12-03T11:42:14.202 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.198+0000 7f8723d84780 1 < canceled part key=_multipart_7VMTBKUWU59F.2~SU3MQ5EP71Y3.0 size=1048576 2023-12-03T11:42:14.202 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.199+0000 7f8723d84780 1 < completed part key=_multipart_7VMTBKUWU59F.2~SU3MQ5EP71Y3.1 size=1019821 2023-12-03T11:42:14.203 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.202+0000 7f8723d84780 1 < canceled multipart upload key=7VMTBKUWU59F upload=SU3MQ5EP71Y3 tag=QXWSRZ9Q4NDG type=write size=3116973 2023-12-03T11:42:14.205 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.204+0000 7f8723d84780 1 > prepared operation key=J33T5S893LMV tag=BY0H4MR0U8M3 type=write size=234833 2023-12-03T11:42:14.207 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.206+0000 7f8723d84780 1 < suggested update operation key=96RAVVSUKH0Y tag=K8E5OUYPYHV6 type=del size=483249 2023-12-03T11:42:14.208 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.207+0000 7f8723d84780 1 > prepared operation key=TSTIBGVYUZZZ tag=S37DRXY9ZZ3R type=del size=2980268 2023-12-03T11:42:14.210 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.209+0000 7f8723d84780 1 < completed part key=_multipart_VENJI0KD1XDW.2~GN2G8UW8OP3I.0 size=1048576 2023-12-03T11:42:14.211 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.210+0000 7f8723d84780 1 < completed part key=_multipart_VENJI0KD1XDW.2~GN2G8UW8OP3I.1 size=897689 2023-12-03T11:42:14.212 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.211+0000 7f8723d84780 1 < completed multipart upload key=VENJI0KD1XDW upload=GN2G8UW8OP3I tag=929LEX3ZVDXH type=write size=2994841 2023-12-03T11:42:14.214 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.213+0000 7f8723d84780 1 > prepared part key=_multipart_J33T5S893LMV.2~4X81YR1L23R7.0 size=1048576 2023-12-03T11:42:14.215 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.214+0000 7f8723d84780 1 > prepared part key=_multipart_J33T5S893LMV.2~4X81YR1L23R7.1 size=1048576 2023-12-03T11:42:14.216 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.215+0000 7f8723d84780 1 > prepared part key=_multipart_J33T5S893LMV.2~4X81YR1L23R7.2 size=428818 2023-12-03T11:42:14.217 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.215+0000 7f8723d84780 1 > prepared multipart upload key=J33T5S893LMV upload=4X81YR1L23R7 tag=0H36YWLW4WRF type=write size=3574546 2023-12-03T11:42:14.220 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.217+0000 7f8723d84780 1 < completed delete operation key=W2704YS8KYQB tag=8SRER5PIW6ZY type=del 2023-12-03T11:42:14.225 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.219+0000 7f8723d84780 1 > prepared part key=_multipart_D3JEVEY0E29E.2~9VAQNRD9TTK1.0 size=812259 2023-12-03T11:42:14.225 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.219+0000 7f8723d84780 1 > prepared multipart upload key=D3JEVEY0E29E upload=9VAQNRD9TTK1 tag=LC8ZRHG5BVF4 type=write size=1860835 2023-12-03T11:42:14.225 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.220+0000 7f8723d84780 1 < completed delete operation key=K83BTR5BOLZE tag=YBS214LW8F0R type=del 2023-12-03T11:42:14.226 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.221+0000 7f8723d84780 1 > prepared operation key=7THZZ1J5LOZK tag=XSDIIJ4OBJHU type=del size=1546128 2023-12-03T11:42:14.226 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.222+0000 7f8723d84780 1 < completed part key=_multipart_O7VVHXLDSY57.2~MC5R88KHHEC4.0 size=374510 2023-12-03T11:42:14.226 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.224+0000 7f8723d84780 1 < completed multipart upload key=O7VVHXLDSY57 upload=MC5R88KHHEC4 tag=G4H12UCFU5IX type=write size=1423086 2023-12-03T11:42:14.226 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.225+0000 7f8723d84780 1 > prepared operation key=HIU6L0NQ8Q95 tag=9IE2DTXAG5IV type=del size=2606914 2023-12-03T11:42:14.227 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.226+0000 7f8723d84780 1 < completed delete operation key=7VMTBKUWU59F tag=12W0ZSR1220R type=del 2023-12-03T11:42:14.229 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.228+0000 7f8723d84780 1 > prepared part key=_multipart_LCK58DDM5XU9.2~9O5JV4OQNY8J.0 size=1048576 2023-12-03T11:42:14.230 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.229+0000 7f8723d84780 1 > prepared part key=_multipart_LCK58DDM5XU9.2~9O5JV4OQNY8J.1 size=1048576 2023-12-03T11:42:14.231 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.230+0000 7f8723d84780 1 > prepared part key=_multipart_LCK58DDM5XU9.2~9O5JV4OQNY8J.2 size=774976 2023-12-03T11:42:14.231 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.230+0000 7f8723d84780 1 > prepared multipart upload key=LCK58DDM5XU9 upload=9O5JV4OQNY8J tag=LASKTE84LFHP type=write size=3920704 2023-12-03T11:42:14.232 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.231+0000 7f8723d84780 1 < completed write operation key=VENJI0KD1XDW tag=JUHBR2QHE2VS type=write size=543826 2023-12-03T11:42:14.233 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.232+0000 7f8723d84780 1 > prepared operation key=W2704YS8KYQB tag=MZJ3CUKSPEPQ type=write size=329329 2023-12-03T11:42:14.234 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.233+0000 7f8723d84780 1 < canceled operation key=TSTIBGVYUZZZ tag=DJ3RQ2NNN9HB type=del size=2442911 2023-12-03T11:42:14.240 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.235+0000 7f8723d84780 1 > prepared part key=_multipart_K83BTR5BOLZE.2~H27018BJJOXS.0 size=875128 2023-12-03T11:42:14.240 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.235+0000 7f8723d84780 1 > prepared multipart upload key=K83BTR5BOLZE upload=H27018BJJOXS tag=O84345A1QVO3 type=write size=1923704 2023-12-03T11:42:14.240 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.236+0000 7f8723d84780 1 < completed delete operation key=12XG7YPYTN4U tag=LJM0OKI6EPWW type=del 2023-12-03T11:42:14.240 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.238+0000 7f8723d84780 1 > prepared operation key=5UYL15O31IHM tag=1W57L2OLIVZY type=write size=896376 2023-12-03T11:42:14.240 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.239+0000 7f8723d84780 1 < completed delete operation key=M4VKPN6INFNZ tag=9PWAX0LBI0O4 type=del 2023-12-03T11:42:14.242 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.241+0000 7f8723d84780 1 > prepared part key=_multipart_AB0SN0E49Z5F.2~LFHT8KGTW0YE.0 size=670748 2023-12-03T11:42:14.242 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.241+0000 7f8723d84780 1 > prepared multipart upload key=AB0SN0E49Z5F upload=LFHT8KGTW0YE tag=CMTXF77381QZ type=write size=1719324 2023-12-03T11:42:14.242 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.241+0000 7f8723d84780 1 < canceled part key=_multipart_CKABTI1EOAWB.2~2NO8X9DO5OGK.0 size=354962 2023-12-03T11:42:14.244 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.243+0000 7f8723d84780 1 < canceled multipart upload key=CKABTI1EOAWB upload=2NO8X9DO5OGK tag=X6MN8I7HH3DS type=write size=1403538 2023-12-03T11:42:14.245 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.244+0000 7f8723d84780 1 > prepared operation key=W2704YS8KYQB tag=2TH4MRSQ9B9A type=del size=3308611 2023-12-03T11:42:14.245 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.244+0000 7f8723d84780 1 < canceled part key=_multipart_10JRIKOZ16FY.2~AMQ4LBX5OMC3.0 size=1048576 2023-12-03T11:42:14.246 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.245+0000 7f8723d84780 1 < completed part key=_multipart_10JRIKOZ16FY.2~AMQ4LBX5OMC3.1 size=1048576 2023-12-03T11:42:14.248 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.246+0000 7f8723d84780 1 < completed part key=_multipart_10JRIKOZ16FY.2~AMQ4LBX5OMC3.2 size=691404 2023-12-03T11:42:14.249 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.248+0000 7f8723d84780 1 < canceled multipart upload key=10JRIKOZ16FY upload=AMQ4LBX5OMC3 tag=YE99SFEH86PO type=write size=3837132 2023-12-03T11:42:14.250 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.249+0000 7f8723d84780 1 > prepared operation key=4I8PWBZOLDUG tag=7E2Z7OJKMKI1 type=write size=46847 2023-12-03T11:42:14.252 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.251+0000 7f8723d84780 1 < completed write operation key=Y6S7QI60GCLE tag=2K95GING56R4 type=write size=909627 2023-12-03T11:42:14.254 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.253+0000 7f8723d84780 1 > prepared part key=_multipart_VENJI0KD1XDW.2~3RVJ5V26NF4X.0 size=1048576 2023-12-03T11:42:14.255 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.254+0000 7f8723d84780 1 > prepared part key=_multipart_VENJI0KD1XDW.2~3RVJ5V26NF4X.1 size=252052 2023-12-03T11:42:14.255 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.254+0000 7f8723d84780 1 > prepared multipart upload key=VENJI0KD1XDW upload=3RVJ5V26NF4X tag=LJA46SWLE2IH type=write size=2349204 2023-12-03T11:42:14.256 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.255+0000 7f8723d84780 1 < completed part key=_multipart_G36T76K8O7A1.2~E76G4OLL0XBE.0 size=1048576 2023-12-03T11:42:14.257 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.256+0000 7f8723d84780 1 < completed part key=_multipart_G36T76K8O7A1.2~E76G4OLL0XBE.1 size=524335 2023-12-03T11:42:14.259 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.258+0000 7f8723d84780 1 < completed multipart upload key=G36T76K8O7A1 upload=E76G4OLL0XBE tag=U52UKBHA8SD2 type=write size=2621487 2023-12-03T11:42:14.260 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.259+0000 7f8723d84780 1 > prepared operation key=7THZZ1J5LOZK tag=G5XFX2T1DC3R type=write size=205961 2023-12-03T11:42:14.261 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.260+0000 7f8723d84780 1 < completed part key=_multipart_5UYL15O31IHM.2~OBUOAM316GBE.0 size=1048576 2023-12-03T11:42:14.263 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.262+0000 7f8723d84780 1 < completed part key=_multipart_5UYL15O31IHM.2~OBUOAM316GBE.1 size=170264 2023-12-03T11:42:14.264 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.263+0000 7f8723d84780 1 < completed multipart upload key=5UYL15O31IHM upload=OBUOAM316GBE tag=6GONZV1YV106 type=write size=2267416 2023-12-03T11:42:14.267 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.266+0000 7f8723d84780 1 > prepared part key=_multipart_M4VKPN6INFNZ.2~DWI0N2JCMEV4.0 size=1048576 2023-12-03T11:42:14.268 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.267+0000 7f8723d84780 1 > prepared part key=_multipart_M4VKPN6INFNZ.2~DWI0N2JCMEV4.1 size=304912 2023-12-03T11:42:14.268 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.267+0000 7f8723d84780 1 > prepared multipart upload key=M4VKPN6INFNZ upload=DWI0N2JCMEV4 tag=G5SA1JZUFSSW type=write size=2402064 2023-12-03T11:42:14.269 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.268+0000 7f8723d84780 1 < completed write operation key=J33T5S893LMV tag=BY0H4MR0U8M3 type=write size=234833 2023-12-03T11:42:14.270 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.269+0000 7f8723d84780 1 > prepared operation key=7THZZ1J5LOZK tag=3BMMKJQRX5YO type=del size=225718 2023-12-03T11:42:14.272 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.271+0000 7f8723d84780 1 < completed delete operation key=TSTIBGVYUZZZ tag=S37DRXY9ZZ3R type=del 2023-12-03T11:42:14.274 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.273+0000 7f8723d84780 1 > prepared part key=_multipart_K83BTR5BOLZE.2~Q5UQ0Z0Q7N1L.0 size=1048576 2023-12-03T11:42:14.275 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.274+0000 7f8723d84780 1 > prepared part key=_multipart_K83BTR5BOLZE.2~Q5UQ0Z0Q7N1L.1 size=572115 2023-12-03T11:42:14.275 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.274+0000 7f8723d84780 1 > prepared multipart upload key=K83BTR5BOLZE upload=Q5UQ0Z0Q7N1L tag=XW9RJQOHVQGR type=write size=2669267 2023-12-03T11:42:14.276 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.275+0000 7f8723d84780 1 < completed part key=_multipart_J33T5S893LMV.2~4X81YR1L23R7.0 size=1048576 2023-12-03T11:42:14.278 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.277+0000 7f8723d84780 1 < completed part key=_multipart_J33T5S893LMV.2~4X81YR1L23R7.1 size=1048576 2023-12-03T11:42:14.278 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.277+0000 7f8723d84780 1 < completed part key=_multipart_J33T5S893LMV.2~4X81YR1L23R7.2 size=428818 2023-12-03T11:42:14.281 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.280+0000 7f8723d84780 1 < completed multipart upload key=J33T5S893LMV upload=4X81YR1L23R7 tag=0H36YWLW4WRF type=write size=3574546 2023-12-03T11:42:14.282 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.281+0000 7f8723d84780 1 > prepared operation key=K83BTR5BOLZE tag=MJE8H08C7Y1S type=del size=171245 2023-12-03T11:42:14.283 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.282+0000 7f8723d84780 1 < completed part key=_multipart_D3JEVEY0E29E.2~9VAQNRD9TTK1.0 size=812259 2023-12-03T11:42:14.286 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.284+0000 7f8723d84780 1 < completed multipart upload key=D3JEVEY0E29E upload=9VAQNRD9TTK1 tag=LC8ZRHG5BVF4 type=write size=1860835 2023-12-03T11:42:14.287 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.286+0000 7f8723d84780 1 > prepared operation key=931GNEXBHH35 tag=P0RELOXWCSMQ type=del size=250490 2023-12-03T11:42:14.288 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.287+0000 7f8723d84780 1 < completed delete operation key=7THZZ1J5LOZK tag=XSDIIJ4OBJHU type=del 2023-12-03T11:42:14.289 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.288+0000 7f8723d84780 1 > prepared operation key=M4VKPN6INFNZ tag=L5EK3DOAYDSN type=write size=29070 2023-12-03T11:42:14.292 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.291+0000 7f8723d84780 1 < suggested remove operation key=HIU6L0NQ8Q95 tag=9IE2DTXAG5IV type=del 2023-12-03T11:42:14.294 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.293+0000 7f8723d84780 1 > prepared part key=_multipart_7THZZ1J5LOZK.2~ESN5818UFG0C.0 size=1048576 2023-12-03T11:42:14.295 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.294+0000 7f8723d84780 1 > prepared part key=_multipart_7THZZ1J5LOZK.2~ESN5818UFG0C.1 size=1048576 2023-12-03T11:42:14.296 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.295+0000 7f8723d84780 1 > prepared part key=_multipart_7THZZ1J5LOZK.2~ESN5818UFG0C.2 size=490208 2023-12-03T11:42:14.296 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.295+0000 7f8723d84780 1 > prepared multipart upload key=7THZZ1J5LOZK upload=ESN5818UFG0C tag=LRTADFBI0T39 type=write size=3635936 2023-12-03T11:42:14.297 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.296+0000 7f8723d84780 1 < completed part key=_multipart_LCK58DDM5XU9.2~9O5JV4OQNY8J.0 size=1048576 2023-12-03T11:42:14.298 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.297+0000 7f8723d84780 1 < completed part key=_multipart_LCK58DDM5XU9.2~9O5JV4OQNY8J.1 size=1048576 2023-12-03T11:42:14.299 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.298+0000 7f8723d84780 1 < completed part key=_multipart_LCK58DDM5XU9.2~9O5JV4OQNY8J.2 size=774976 2023-12-03T11:42:14.301 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.300+0000 7f8723d84780 1 < completed multipart upload key=LCK58DDM5XU9 upload=9O5JV4OQNY8J tag=LASKTE84LFHP type=write size=3920704 2023-12-03T11:42:14.303 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.302+0000 7f8723d84780 1 > prepared operation key=FCA2R3HR61S2 tag=RHRYQ7TIUYSU type=write size=954072 2023-12-03T11:42:14.304 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.303+0000 7f8723d84780 1 < completed write operation key=W2704YS8KYQB tag=MZJ3CUKSPEPQ type=write size=329329 2023-12-03T11:42:14.306 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.305+0000 7f8723d84780 1 > prepared part key=_multipart_7VMTBKUWU59F.2~8JHTJEYLKQ5P.0 size=1048576 2023-12-03T11:42:14.307 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.306+0000 7f8723d84780 1 > prepared part key=_multipart_7VMTBKUWU59F.2~8JHTJEYLKQ5P.1 size=1027050 2023-12-03T11:42:14.308 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.306+0000 7f8723d84780 1 > prepared multipart upload key=7VMTBKUWU59F upload=8JHTJEYLKQ5P tag=OGAC5388F1KH type=write size=3124202 2023-12-03T11:42:14.309 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.308+0000 7f8723d84780 1 < completed part key=_multipart_K83BTR5BOLZE.2~H27018BJJOXS.0 size=875128 2023-12-03T11:42:14.312 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.311+0000 7f8723d84780 1 < completed multipart upload key=K83BTR5BOLZE upload=H27018BJJOXS tag=O84345A1QVO3 type=write size=1923704 2023-12-03T11:42:14.313 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.312+0000 7f8723d84780 1 > prepared operation key=4I8PWBZOLDUG tag=81BRCAA3TRPL type=del size=930115 2023-12-03T11:42:14.315 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.314+0000 7f8723d84780 1 < completed write operation key=5UYL15O31IHM tag=1W57L2OLIVZY type=write size=896376 2023-12-03T11:42:14.317 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.316+0000 7f8723d84780 1 > prepared operation key=K83BTR5BOLZE tag=54937AVMO45Q type=del size=2978008 2023-12-03T11:42:14.319 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.318+0000 7f8723d84780 1 < completed part key=_multipart_AB0SN0E49Z5F.2~LFHT8KGTW0YE.0 size=670748 2023-12-03T11:42:14.322 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.321+0000 7f8723d84780 1 < completed multipart upload key=AB0SN0E49Z5F upload=LFHT8KGTW0YE tag=CMTXF77381QZ type=write size=1719324 2023-12-03T11:42:14.323 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.322+0000 7f8723d84780 1 > prepared operation key=LMVO6CVEPN3K tag=RTYQM2KG8556 type=del size=3485563 2023-12-03T11:42:14.324 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.323+0000 7f8723d84780 1 < completed delete operation key=W2704YS8KYQB tag=2TH4MRSQ9B9A type=del 2023-12-03T11:42:14.326 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.325+0000 7f8723d84780 1 > prepared part key=_multipart_OGACI7CRPMT7.2~R5F6IINO1L5E.0 size=444966 2023-12-03T11:42:14.326 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.325+0000 7f8723d84780 1 > prepared multipart upload key=OGACI7CRPMT7 upload=R5F6IINO1L5E tag=226JGM30O12Y type=write size=1493542 2023-12-03T11:42:14.327 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.326+0000 7f8723d84780 1 < canceled operation key=4I8PWBZOLDUG tag=7E2Z7OJKMKI1 type=write size=46847 2023-12-03T11:42:14.330 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.329+0000 7f8723d84780 1 > prepared part key=_multipart_7THZZ1J5LOZK.2~KWKVHP8D55UG.0 size=877096 2023-12-03T11:42:14.330 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.329+0000 7f8723d84780 1 > prepared multipart upload key=7THZZ1J5LOZK upload=KWKVHP8D55UG tag=IKFBJ6QYW77B type=write size=1925672 2023-12-03T11:42:14.331 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.330+0000 7f8723d84780 1 < completed part key=_multipart_VENJI0KD1XDW.2~3RVJ5V26NF4X.0 size=1048576 2023-12-03T11:42:14.332 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.331+0000 7f8723d84780 1 < completed part key=_multipart_VENJI0KD1XDW.2~3RVJ5V26NF4X.1 size=252052 2023-12-03T11:42:14.334 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.333+0000 7f8723d84780 1 < completed multipart upload key=VENJI0KD1XDW upload=3RVJ5V26NF4X tag=LJA46SWLE2IH type=write size=2349204 2023-12-03T11:42:14.335 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.334+0000 7f8723d84780 1 > prepared operation key=10JRIKOZ16FY tag=8V4KKBHNDDC0 type=del size=2408881 2023-12-03T11:42:14.336 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.335+0000 7f8723d84780 1 < completed write operation key=7THZZ1J5LOZK tag=G5XFX2T1DC3R type=write size=205961 2023-12-03T11:42:14.337 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.336+0000 7f8723d84780 1 > prepared operation key=DMQX2DGDLU7D tag=D8B0VNAC1GZG type=del size=1890557 2023-12-03T11:42:14.338 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.337+0000 7f8723d84780 1 < completed part key=_multipart_M4VKPN6INFNZ.2~DWI0N2JCMEV4.0 size=1048576 2023-12-03T11:42:14.339 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.338+0000 7f8723d84780 1 < completed part key=_multipart_M4VKPN6INFNZ.2~DWI0N2JCMEV4.1 size=304912 2023-12-03T11:42:14.341 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.340+0000 7f8723d84780 1 < completed multipart upload key=M4VKPN6INFNZ upload=DWI0N2JCMEV4 tag=G5SA1JZUFSSW type=write size=2402064 2023-12-03T11:42:14.343 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.342+0000 7f8723d84780 1 > prepared part key=_multipart_EY9ZG5KOTBWM.2~GLULKRCQD71U.0 size=182540 2023-12-03T11:42:14.343 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.342+0000 7f8723d84780 1 > prepared multipart upload key=EY9ZG5KOTBWM upload=GLULKRCQD71U tag=CL5R1IPYXDW0 type=write size=1231116 2023-12-03T11:42:14.344 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.343+0000 7f8723d84780 1 < completed delete operation key=7THZZ1J5LOZK tag=3BMMKJQRX5YO type=del 2023-12-03T11:42:14.345 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.344+0000 7f8723d84780 1 > prepared operation key=LCK58DDM5XU9 tag=WUUR63HADEYE type=del size=1265089 2023-12-03T11:42:14.346 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.345+0000 7f8723d84780 1 < completed part key=_multipart_K83BTR5BOLZE.2~Q5UQ0Z0Q7N1L.0 size=1048576 2023-12-03T11:42:14.347 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.346+0000 7f8723d84780 1 < completed part key=_multipart_K83BTR5BOLZE.2~Q5UQ0Z0Q7N1L.1 size=572115 2023-12-03T11:42:14.350 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.349+0000 7f8723d84780 1 < completed multipart upload key=K83BTR5BOLZE upload=Q5UQ0Z0Q7N1L tag=XW9RJQOHVQGR type=write size=2669267 2023-12-03T11:42:14.352 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.351+0000 7f8723d84780 1 > prepared part key=_multipart_4I8PWBZOLDUG.2~T72UOLGO1WZU.0 size=1048576 2023-12-03T11:42:14.353 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.352+0000 7f8723d84780 1 > prepared part key=_multipart_4I8PWBZOLDUG.2~T72UOLGO1WZU.1 size=290297 2023-12-03T11:42:14.353 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.352+0000 7f8723d84780 1 > prepared multipart upload key=4I8PWBZOLDUG upload=T72UOLGO1WZU tag=AZB47VQ83KQU type=write size=2387449 2023-12-03T11:42:14.354 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.353+0000 7f8723d84780 1 < canceled operation key=K83BTR5BOLZE tag=MJE8H08C7Y1S type=del size=171245 2023-12-03T11:42:14.357 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.355+0000 7f8723d84780 1 > prepared part key=_multipart_7VMTBKUWU59F.2~SM0MU5N0055N.0 size=1048576 2023-12-03T11:42:14.358 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.356+0000 7f8723d84780 1 > prepared part key=_multipart_7VMTBKUWU59F.2~SM0MU5N0055N.1 size=1048576 2023-12-03T11:42:14.358 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.357+0000 7f8723d84780 1 > prepared part key=_multipart_7VMTBKUWU59F.2~SM0MU5N0055N.2 size=56845 2023-12-03T11:42:14.359 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.357+0000 7f8723d84780 1 > prepared multipart upload key=7VMTBKUWU59F upload=SM0MU5N0055N tag=RJESZN2JUJA7 type=write size=3202573 2023-12-03T11:42:14.360 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.359+0000 7f8723d84780 1 < completed delete operation key=931GNEXBHH35 tag=P0RELOXWCSMQ type=del 2023-12-03T11:42:14.362 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.361+0000 7f8723d84780 1 > prepared part key=_multipart_LMVO6CVEPN3K.2~KK2G0LKPYYIL.0 size=1048576 2023-12-03T11:42:14.363 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.362+0000 7f8723d84780 1 > prepared part key=_multipart_LMVO6CVEPN3K.2~KK2G0LKPYYIL.1 size=1048576 2023-12-03T11:42:14.364 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.363+0000 7f8723d84780 1 > prepared part key=_multipart_LMVO6CVEPN3K.2~KK2G0LKPYYIL.2 size=346738 2023-12-03T11:42:14.364 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.363+0000 7f8723d84780 1 > prepared multipart upload key=LMVO6CVEPN3K upload=KK2G0LKPYYIL tag=D6FMTIYGGFJW type=write size=3492466 2023-12-03T11:42:14.365 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.364+0000 7f8723d84780 1 < completed write operation key=M4VKPN6INFNZ tag=L5EK3DOAYDSN type=write size=29070 2023-12-03T11:42:14.367 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.366+0000 7f8723d84780 1 > prepared operation key=OPQPIDJ2PBVU tag=IMKFFCUQVL78 type=write size=556953 2023-12-03T11:42:14.368 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.367+0000 7f8723d84780 1 < completed part key=_multipart_7THZZ1J5LOZK.2~ESN5818UFG0C.0 size=1048576 2023-12-03T11:42:14.369 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.368+0000 7f8723d84780 1 < completed part key=_multipart_7THZZ1J5LOZK.2~ESN5818UFG0C.1 size=1048576 2023-12-03T11:42:14.370 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.369+0000 7f8723d84780 1 < completed part key=_multipart_7THZZ1J5LOZK.2~ESN5818UFG0C.2 size=490208 2023-12-03T11:42:14.372 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.371+0000 7f8723d84780 1 < completed multipart upload key=7THZZ1J5LOZK upload=ESN5818UFG0C tag=LRTADFBI0T39 type=write size=3635936 2023-12-03T11:42:14.373 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.372+0000 7f8723d84780 1 > prepared operation key=931GNEXBHH35 tag=G3IYPBWARXAU type=del size=1758286 2023-12-03T11:42:14.374 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.373+0000 7f8723d84780 1 < completed write operation key=FCA2R3HR61S2 tag=RHRYQ7TIUYSU type=write size=954072 2023-12-03T11:42:14.376 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.375+0000 7f8723d84780 1 > prepared operation key=K83BTR5BOLZE tag=C54GQE0YZM9V type=del size=2670182 2023-12-03T11:42:14.377 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.376+0000 7f8723d84780 1 < completed part key=_multipart_7VMTBKUWU59F.2~8JHTJEYLKQ5P.0 size=1048576 2023-12-03T11:42:14.378 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.377+0000 7f8723d84780 1 < completed part key=_multipart_7VMTBKUWU59F.2~8JHTJEYLKQ5P.1 size=1027050 2023-12-03T11:42:14.380 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.379+0000 7f8723d84780 1 < completed multipart upload key=7VMTBKUWU59F upload=8JHTJEYLKQ5P tag=OGAC5388F1KH type=write size=3124202 2023-12-03T11:42:14.382 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.381+0000 7f8723d84780 1 > prepared operation key=CKABTI1EOAWB tag=R5JNWO7E7WYQ type=del size=1679667 2023-12-03T11:42:14.383 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.382+0000 7f8723d84780 1 < completed delete operation key=4I8PWBZOLDUG tag=81BRCAA3TRPL type=del 2023-12-03T11:42:14.384 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.383+0000 7f8723d84780 1 > prepared operation key=OPQPIDJ2PBVU tag=BBKGID8D2QIT type=del size=2212194 2023-12-03T11:42:14.387 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.385+0000 7f8723d84780 1 < suggested update operation key=K83BTR5BOLZE tag=54937AVMO45Q type=del size=2978008 2023-12-03T11:42:14.389 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.388+0000 7f8723d84780 1 > prepared part key=_multipart_DMQX2DGDLU7D.2~EID9NT2WPSUO.0 size=1048576 2023-12-03T11:42:14.390 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.389+0000 7f8723d84780 1 > prepared part key=_multipart_DMQX2DGDLU7D.2~EID9NT2WPSUO.1 size=87809 2023-12-03T11:42:14.390 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.389+0000 7f8723d84780 1 > prepared multipart upload key=DMQX2DGDLU7D upload=EID9NT2WPSUO tag=6UT51SFAPSOE type=write size=2184961 2023-12-03T11:42:14.392 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.391+0000 7f8723d84780 1 < suggested remove operation key=LMVO6CVEPN3K tag=RTYQM2KG8556 type=del 2023-12-03T11:42:14.394 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.393+0000 7f8723d84780 1 > prepared operation key=931GNEXBHH35 tag=J50WQDI1L9RZ type=del size=3404937 2023-12-03T11:42:14.395 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.394+0000 7f8723d84780 1 < completed part key=_multipart_OGACI7CRPMT7.2~R5F6IINO1L5E.0 size=444966 2023-12-03T11:42:14.397 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.396+0000 7f8723d84780 1 < completed multipart upload key=OGACI7CRPMT7 upload=R5F6IINO1L5E tag=226JGM30O12Y type=write size=1493542 2023-12-03T11:42:14.398 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.397+0000 7f8723d84780 1 > prepared operation key=M4VKPN6INFNZ tag=ISLZ6ER2D2CI type=write size=613163 2023-12-03T11:42:14.399 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.398+0000 7f8723d84780 1 < completed part key=_multipart_7THZZ1J5LOZK.2~KWKVHP8D55UG.0 size=877096 2023-12-03T11:42:14.401 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.400+0000 7f8723d84780 1 < completed multipart upload key=7THZZ1J5LOZK upload=KWKVHP8D55UG tag=IKFBJ6QYW77B type=write size=1925672 2023-12-03T11:42:14.405 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.404+0000 7f8723d84780 1 > prepared operation key=EITMJKL0LCYC tag=4T3SAGB6JC6Q type=del size=1936535 2023-12-03T11:42:14.411 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.405+0000 7f8723d84780 1 < completed delete operation key=10JRIKOZ16FY tag=8V4KKBHNDDC0 type=del 2023-12-03T11:42:14.411 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.407+0000 7f8723d84780 1 > prepared part key=_multipart_D3JEVEY0E29E.2~JEXFY224842M.0 size=1048576 2023-12-03T11:42:14.411 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.408+0000 7f8723d84780 1 > prepared part key=_multipart_D3JEVEY0E29E.2~JEXFY224842M.1 size=487571 2023-12-03T11:42:14.411 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.408+0000 7f8723d84780 1 > prepared multipart upload key=D3JEVEY0E29E upload=JEXFY224842M tag=IWVJJRSHD51T type=write size=2584723 2023-12-03T11:42:14.412 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.409+0000 7f8723d84780 1 < canceled operation key=DMQX2DGDLU7D tag=D8B0VNAC1GZG type=del size=1890557 2023-12-03T11:42:14.413 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.412+0000 7f8723d84780 1 > prepared part key=_multipart_VENJI0KD1XDW.2~B58LMDSWO2JF.0 size=1048576 2023-12-03T11:42:14.414 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.413+0000 7f8723d84780 1 > prepared part key=_multipart_VENJI0KD1XDW.2~B58LMDSWO2JF.1 size=1048576 2023-12-03T11:42:14.415 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.413+0000 7f8723d84780 1 > prepared part key=_multipart_VENJI0KD1XDW.2~B58LMDSWO2JF.2 size=58538 2023-12-03T11:42:14.415 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.413+0000 7f8723d84780 1 > prepared multipart upload key=VENJI0KD1XDW upload=B58LMDSWO2JF tag=EU7AKAVM74UT type=write size=3204266 2023-12-03T11:42:14.416 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.415+0000 7f8723d84780 1 < completed part key=_multipart_EY9ZG5KOTBWM.2~GLULKRCQD71U.0 size=182540 2023-12-03T11:42:14.418 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.417+0000 7f8723d84780 1 < completed multipart upload key=EY9ZG5KOTBWM upload=GLULKRCQD71U tag=CL5R1IPYXDW0 type=write size=1231116 2023-12-03T11:42:14.421 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.419+0000 7f8723d84780 1 > prepared part key=_multipart_OGACI7CRPMT7.2~ECBXDBS2DRUX.0 size=1048576 2023-12-03T11:42:14.421 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.420+0000 7f8723d84780 1 > prepared part key=_multipart_OGACI7CRPMT7.2~ECBXDBS2DRUX.1 size=1048576 2023-12-03T11:42:14.422 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.421+0000 7f8723d84780 1 > prepared part key=_multipart_OGACI7CRPMT7.2~ECBXDBS2DRUX.2 size=680423 2023-12-03T11:42:14.422 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.421+0000 7f8723d84780 1 > prepared multipart upload key=OGACI7CRPMT7 upload=ECBXDBS2DRUX tag=XPASI65MKSIF type=write size=3826151 2023-12-03T11:42:14.423 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.422+0000 7f8723d84780 1 < completed delete operation key=LCK58DDM5XU9 tag=WUUR63HADEYE type=del 2023-12-03T11:42:14.425 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.424+0000 7f8723d84780 1 > prepared part key=_multipart_LMVO6CVEPN3K.2~1Z2MEAI4783K.0 size=1048576 2023-12-03T11:42:14.426 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.425+0000 7f8723d84780 1 > prepared part key=_multipart_LMVO6CVEPN3K.2~1Z2MEAI4783K.1 size=378396 2023-12-03T11:42:14.426 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.425+0000 7f8723d84780 1 > prepared multipart upload key=LMVO6CVEPN3K upload=1Z2MEAI4783K tag=IROF0KMDGYJ2 type=write size=2475548 2023-12-03T11:42:14.427 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.426+0000 7f8723d84780 1 < completed part key=_multipart_4I8PWBZOLDUG.2~T72UOLGO1WZU.0 size=1048576 2023-12-03T11:42:14.428 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.427+0000 7f8723d84780 1 < completed part key=_multipart_4I8PWBZOLDUG.2~T72UOLGO1WZU.1 size=290297 2023-12-03T11:42:14.430 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.429+0000 7f8723d84780 1 < completed multipart upload key=4I8PWBZOLDUG upload=T72UOLGO1WZU tag=AZB47VQ83KQU type=write size=2387449 2023-12-03T11:42:14.434 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.433+0000 7f8723d84780 1 > prepared part key=_multipart_LCK58DDM5XU9.2~H33BFEAZUSB0.0 size=1048576 2023-12-03T11:42:14.436 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.435+0000 7f8723d84780 1 > prepared part key=_multipart_LCK58DDM5XU9.2~H33BFEAZUSB0.1 size=738149 2023-12-03T11:42:14.436 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.435+0000 7f8723d84780 1 > prepared multipart upload key=LCK58DDM5XU9 upload=H33BFEAZUSB0 tag=86GHCUHV2XV0 type=write size=2835301 2023-12-03T11:42:14.437 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.436+0000 7f8723d84780 1 < completed part key=_multipart_7VMTBKUWU59F.2~SM0MU5N0055N.0 size=1048576 2023-12-03T11:42:14.438 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.437+0000 7f8723d84780 1 < completed part key=_multipart_7VMTBKUWU59F.2~SM0MU5N0055N.1 size=1048576 2023-12-03T11:42:14.439 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.438+0000 7f8723d84780 1 < completed part key=_multipart_7VMTBKUWU59F.2~SM0MU5N0055N.2 size=56845 2023-12-03T11:42:14.441 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.440+0000 7f8723d84780 1 < completed multipart upload key=7VMTBKUWU59F upload=SM0MU5N0055N tag=RJESZN2JUJA7 type=write size=3202573 2023-12-03T11:42:14.442 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.441+0000 7f8723d84780 1 > prepared operation key=O7VVHXLDSY57 tag=OJE8FZ3WGQVD type=del size=2528435 2023-12-03T11:42:14.444 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.443+0000 7f8723d84780 1 < completed part key=_multipart_LMVO6CVEPN3K.2~KK2G0LKPYYIL.0 size=1048576 2023-12-03T11:42:14.445 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.444+0000 7f8723d84780 1 < completed part key=_multipart_LMVO6CVEPN3K.2~KK2G0LKPYYIL.1 size=1048576 2023-12-03T11:42:14.446 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.445+0000 7f8723d84780 1 < completed part key=_multipart_LMVO6CVEPN3K.2~KK2G0LKPYYIL.2 size=346738 2023-12-03T11:42:14.448 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.447+0000 7f8723d84780 1 < completed multipart upload key=LMVO6CVEPN3K upload=KK2G0LKPYYIL tag=D6FMTIYGGFJW type=write size=3492466 2023-12-03T11:42:14.450 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.449+0000 7f8723d84780 1 > prepared part key=_multipart_D3JEVEY0E29E.2~IJOYQSYQLXCO.0 size=1048576 2023-12-03T11:42:14.451 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.450+0000 7f8723d84780 1 > prepared part key=_multipart_D3JEVEY0E29E.2~IJOYQSYQLXCO.1 size=916276 2023-12-03T11:42:14.451 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.450+0000 7f8723d84780 1 > prepared multipart upload key=D3JEVEY0E29E upload=IJOYQSYQLXCO tag=QQXL3TCXT2S1 type=write size=3013428 2023-12-03T11:42:14.452 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.451+0000 7f8723d84780 1 < completed write operation key=OPQPIDJ2PBVU tag=IMKFFCUQVL78 type=write size=556953 2023-12-03T11:42:14.454 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.453+0000 7f8723d84780 1 > prepared part key=_multipart_O7VVHXLDSY57.2~4MW9QP3XM5XR.0 size=871027 2023-12-03T11:42:14.455 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.453+0000 7f8723d84780 1 > prepared multipart upload key=O7VVHXLDSY57 upload=4MW9QP3XM5XR tag=XZ7T28BPMW3Y type=write size=1919603 2023-12-03T11:42:14.456 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.455+0000 7f8723d84780 1 < canceled operation key=931GNEXBHH35 tag=G3IYPBWARXAU type=del size=1758286 2023-12-03T11:42:14.457 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.456+0000 7f8723d84780 1 > prepared operation key=5UYL15O31IHM tag=QK47NXJ4Y506 type=del size=3306340 2023-12-03T11:42:14.458 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.457+0000 7f8723d84780 -1 < failed to complete operation key=K83BTR5BOLZE tag=C54GQE0YZM9V type=del size=2670182: (22) Invalid argument 2023-12-03T11:42:14.459 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.458+0000 7f8723d84780 1 > prepared operation key=EY9ZG5KOTBWM tag=0T306OK31TWM type=write size=190808 2023-12-03T11:42:14.461 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.460+0000 7f8723d84780 1 < canceled operation key=CKABTI1EOAWB tag=R5JNWO7E7WYQ type=del size=1679667 2023-12-03T11:42:14.463 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.462+0000 7f8723d84780 1 > prepared part key=_multipart_FCA2R3HR61S2.2~51VSE67QJS0V.0 size=146832 2023-12-03T11:42:14.463 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.462+0000 7f8723d84780 1 > prepared multipart upload key=FCA2R3HR61S2 upload=51VSE67QJS0V tag=8K3ENKXJO6R2 type=write size=1195408 2023-12-03T11:42:14.464 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.463+0000 7f8723d84780 1 < completed delete operation key=OPQPIDJ2PBVU tag=BBKGID8D2QIT type=del 2023-12-03T11:42:14.466 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.465+0000 7f8723d84780 1 > prepared part key=_multipart_7THZZ1J5LOZK.2~I4GXVQ0I1CBN.0 size=246412 2023-12-03T11:42:14.466 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.465+0000 7f8723d84780 1 > prepared multipart upload key=7THZZ1J5LOZK upload=I4GXVQ0I1CBN tag=UA2U0DHY3ROU type=write size=1294988 2023-12-03T11:42:14.467 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.465+0000 7f8723d84780 1 < canceled part key=_multipart_DMQX2DGDLU7D.2~EID9NT2WPSUO.0 size=1048576 2023-12-03T11:42:14.467 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.466+0000 7f8723d84780 1 < completed part key=_multipart_DMQX2DGDLU7D.2~EID9NT2WPSUO.1 size=87809 2023-12-03T11:42:14.470 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.468+0000 7f8723d84780 1 < canceled multipart upload key=DMQX2DGDLU7D upload=EID9NT2WPSUO tag=6UT51SFAPSOE type=write size=2184961 2023-12-03T11:42:14.471 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.470+0000 7f8723d84780 1 > prepared operation key=Y6S7QI60GCLE tag=4ZW3FR9MTO4D type=del size=1123503 2023-12-03T11:42:14.473 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.472+0000 7f8723d84780 1 < suggested update operation key=931GNEXBHH35 tag=J50WQDI1L9RZ type=del size=3404937 2023-12-03T11:42:14.474 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:42:14.473+0000 7f8723d84780 1 > prepared operation key=HIU6L0NQ8Q95 tag=3BA6YOVEB3TA type=del size=4066615 2023-12-03T11:42:14.475 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] cls_rgw_stats.simulate (9075 ms) 2023-12-03T11:42:14.475 INFO:tasks.workunit.client.0.smithi003.stdout:[----------] 1 test from cls_rgw_stats (9075 ms total) 2023-12-03T11:42:14.475 INFO:tasks.workunit.client.0.smithi003.stdout: 2023-12-03T11:42:14.475 INFO:tasks.workunit.client.0.smithi003.stdout:[----------] Global test environment tear-down 2023-12-03T11:42:15.414 INFO:tasks.workunit.client.0.smithi003.stdout:[==========] 1 test from 1 test suite ran. (11869 ms total) 2023-12-03T11:42:15.414 INFO:tasks.workunit.client.0.smithi003.stdout:[ PASSED ] 1 test. 2023-12-03T11:42:15.417 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-12-03T11:42:15.418 DEBUG:teuthology.orchestra.run.smithi003:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-12-03T11:42:15.523 INFO:tasks.workunit:Running workunits matching cls/test_cls_cmpomap.sh on client.0... 2023-12-03T11:42:15.524 INFO:tasks.workunit:Running workunit cls/test_cls_cmpomap.sh... 2023-12-03T11:42:15.525 DEBUG:teuthology.orchestra.run.smithi003:workunit test cls/test_cls_cmpomap.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bcbf278cf395873c2a482f5a7b2345faf2160319 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_cmpomap.sh 2023-12-03T11:42:15.557 INFO:tasks.workunit.client.0.smithi003.stdout:Running main() from gmock_main.cc 2023-12-03T11:42:15.557 INFO:tasks.workunit.client.0.smithi003.stdout:[==========] Running 31 tests from 1 test suite. 2023-12-03T11:42:15.558 INFO:tasks.workunit.client.0.smithi003.stdout:[----------] Global test environment set-up. 2023-12-03T11:42:17.434 INFO:tasks.workunit.client.0.smithi003.stdout:[----------] 31 tests from CmpOmap 2023-12-03T11:42:17.434 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_str 2023-12-03T11:42:17.450 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] CmpOmap.cmp_vals_noexist_str (17 ms) 2023-12-03T11:42:17.450 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_str_default 2023-12-03T11:42:17.458 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] CmpOmap.cmp_vals_noexist_str_default (8 ms) 2023-12-03T11:42:17.459 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_u64 2023-12-03T11:42:17.461 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] CmpOmap.cmp_vals_noexist_u64 (3 ms) 2023-12-03T11:42:17.462 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_u64_default 2023-12-03T11:42:17.465 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] CmpOmap.cmp_vals_noexist_u64_default (4 ms) 2023-12-03T11:42:17.465 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] CmpOmap.cmp_vals_str 2023-12-03T11:42:17.471 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] CmpOmap.cmp_vals_str (6 ms) 2023-12-03T11:42:17.471 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] CmpOmap.cmp_vals_u64 2023-12-03T11:42:17.478 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] CmpOmap.cmp_vals_u64 (7 ms) 2023-12-03T11:42:17.478 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_input 2023-12-03T11:42:17.482 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_input (4 ms) 2023-12-03T11:42:17.482 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_default 2023-12-03T11:42:17.486 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_default (4 ms) 2023-12-03T11:42:17.486 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] CmpOmap.cmp_vals_u64_empty_default 2023-12-03T11:42:17.490 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] CmpOmap.cmp_vals_u64_empty_default (4 ms) 2023-12-03T11:42:17.490 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_value 2023-12-03T11:42:17.495 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_value (5 ms) 2023-12-03T11:42:17.495 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] CmpOmap.cmp_vals_at_max_keys 2023-12-03T11:42:17.496 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] CmpOmap.cmp_vals_at_max_keys (1 ms) 2023-12-03T11:42:17.496 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] CmpOmap.cmp_vals_over_max_keys 2023-12-03T11:42:17.496 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] CmpOmap.cmp_vals_over_max_keys (0 ms) 2023-12-03T11:42:17.496 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_str 2023-12-03T11:42:17.504 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_str (8 ms) 2023-12-03T11:42:17.504 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_str_default 2023-12-03T11:42:17.512 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_str_default (8 ms) 2023-12-03T11:42:17.512 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_u64 2023-12-03T11:42:17.521 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_u64 (7 ms) 2023-12-03T11:42:17.521 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_u64_default 2023-12-03T11:42:17.525 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_u64_default (6 ms) 2023-12-03T11:42:17.526 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] CmpOmap.cmp_set_vals_str 2023-12-03T11:42:17.535 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] CmpOmap.cmp_set_vals_str (9 ms) 2023-12-03T11:42:17.535 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64 2023-12-03T11:42:17.543 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] CmpOmap.cmp_set_vals_u64 (9 ms) 2023-12-03T11:42:17.543 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64_einval 2023-12-03T11:42:17.546 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] CmpOmap.cmp_set_vals_u64_einval (3 ms) 2023-12-03T11:42:17.546 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64_eio 2023-12-03T11:42:17.549 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] CmpOmap.cmp_set_vals_u64_eio (3 ms) 2023-12-03T11:42:17.549 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] CmpOmap.cmp_set_vals_at_max_keys 2023-12-03T11:42:17.550 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] CmpOmap.cmp_set_vals_at_max_keys (1 ms) 2023-12-03T11:42:17.550 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] CmpOmap.cmp_set_vals_over_max_keys 2023-12-03T11:42:17.550 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] CmpOmap.cmp_set_vals_over_max_keys (0 ms) 2023-12-03T11:42:17.550 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] CmpOmap.cmp_rm_keys_noexist_str 2023-12-03T11:42:17.557 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] CmpOmap.cmp_rm_keys_noexist_str (7 ms) 2023-12-03T11:42:17.557 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] CmpOmap.cmp_rm_keys_noexist_u64 2023-12-03T11:42:17.563 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] CmpOmap.cmp_rm_keys_noexist_u64 (6 ms) 2023-12-03T11:42:17.563 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] CmpOmap.cmp_rm_keys_str 2023-12-03T11:42:17.570 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] CmpOmap.cmp_rm_keys_str (7 ms) 2023-12-03T11:42:17.570 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64 2023-12-03T11:42:17.579 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64 (9 ms) 2023-12-03T11:42:17.579 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_einval 2023-12-03T11:42:17.582 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_einval (3 ms) 2023-12-03T11:42:17.582 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_eio 2023-12-03T11:42:17.584 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_eio (2 ms) 2023-12-03T11:42:17.585 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] CmpOmap.cmp_rm_keys_at_max_keys 2023-12-03T11:42:17.586 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] CmpOmap.cmp_rm_keys_at_max_keys (2 ms) 2023-12-03T11:42:17.586 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] CmpOmap.cmp_rm_keys_over_max_keys 2023-12-03T11:42:17.586 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] CmpOmap.cmp_rm_keys_over_max_keys (0 ms) 2023-12-03T11:42:17.586 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_empty 2023-12-03T11:42:17.593 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_empty (7 ms) 2023-12-03T11:42:17.593 INFO:tasks.workunit.client.0.smithi003.stdout:[----------] 31 tests from CmpOmap (160 ms total) 2023-12-03T11:42:17.594 INFO:tasks.workunit.client.0.smithi003.stdout: 2023-12-03T11:42:17.594 INFO:tasks.workunit.client.0.smithi003.stdout:[----------] Global test environment tear-down 2023-12-03T11:42:18.447 INFO:tasks.workunit.client.0.smithi003.stdout:[==========] 31 tests from 1 test suite ran. (2889 ms total) 2023-12-03T11:42:18.447 INFO:tasks.workunit.client.0.smithi003.stdout:[ PASSED ] 31 tests. 2023-12-03T11:42:18.449 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-12-03T11:42:18.450 DEBUG:teuthology.orchestra.run.smithi003:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-12-03T11:42:18.526 INFO:tasks.workunit:Running workunits matching cls/test_cls_2pc_queue.sh on client.0... 2023-12-03T11:42:18.528 INFO:tasks.workunit:Running workunit cls/test_cls_2pc_queue.sh... 2023-12-03T11:42:18.529 DEBUG:teuthology.orchestra.run.smithi003:workunit test cls/test_cls_2pc_queue.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bcbf278cf395873c2a482f5a7b2345faf2160319 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_2pc_queue.sh 2023-12-03T11:42:18.603 INFO:tasks.workunit.client.0.smithi003.stdout:Running main() from gmock_main.cc 2023-12-03T11:42:18.603 INFO:tasks.workunit.client.0.smithi003.stdout:[==========] Running 24 tests from 1 test suite. 2023-12-03T11:42:18.603 INFO:tasks.workunit.client.0.smithi003.stdout:[----------] Global test environment set-up. 2023-12-03T11:42:18.603 INFO:tasks.workunit.client.0.smithi003.stdout:[----------] 24 tests from TestCls2PCQueue 2023-12-03T11:42:18.603 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] TestCls2PCQueue.GetCapacity 2023-12-03T11:42:21.456 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] TestCls2PCQueue.GetCapacity (2852 ms) 2023-12-03T11:42:21.456 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] TestCls2PCQueue.AsyncGetCapacity 2023-12-03T11:42:24.477 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] TestCls2PCQueue.AsyncGetCapacity (3021 ms) 2023-12-03T11:42:24.477 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] TestCls2PCQueue.Reserve 2023-12-03T11:42:27.483 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] TestCls2PCQueue.Reserve (3007 ms) 2023-12-03T11:42:27.483 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] TestCls2PCQueue.AsyncReserve 2023-12-03T11:42:30.515 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] TestCls2PCQueue.AsyncReserve (3030 ms) 2023-12-03T11:42:30.515 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] TestCls2PCQueue.Commit 2023-12-03T11:42:34.549 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] TestCls2PCQueue.Commit (4035 ms) 2023-12-03T11:42:34.549 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] TestCls2PCQueue.Stats 2023-12-03T11:42:37.555 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] TestCls2PCQueue.Stats (3006 ms) 2023-12-03T11:42:37.556 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] TestCls2PCQueue.UpgradeFromReef 2023-12-03T11:42:41.594 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] TestCls2PCQueue.UpgradeFromReef (4038 ms) 2023-12-03T11:42:41.594 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] TestCls2PCQueue.Abort 2023-12-03T11:42:44.625 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] TestCls2PCQueue.Abort (3031 ms) 2023-12-03T11:42:44.625 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] TestCls2PCQueue.ReserveError 2023-12-03T11:42:47.635 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] TestCls2PCQueue.ReserveError (3011 ms) 2023-12-03T11:42:47.635 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] TestCls2PCQueue.CommitError 2023-12-03T11:42:50.666 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] TestCls2PCQueue.CommitError (3030 ms) 2023-12-03T11:42:50.666 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] TestCls2PCQueue.AbortError 2023-12-03T11:42:53.667 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] TestCls2PCQueue.AbortError (3002 ms) 2023-12-03T11:42:53.667 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] TestCls2PCQueue.MultiReserve 2023-12-03T11:42:56.710 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] TestCls2PCQueue.MultiReserve (3042 ms) 2023-12-03T11:42:56.710 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] TestCls2PCQueue.MultiCommit 2023-12-03T11:42:59.735 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] TestCls2PCQueue.MultiCommit (3025 ms) 2023-12-03T11:42:59.735 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] TestCls2PCQueue.MultiAbort 2023-12-03T11:43:02.753 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] TestCls2PCQueue.MultiAbort (3016 ms) 2023-12-03T11:43:02.754 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] TestCls2PCQueue.ReserveCommit 2023-12-03T11:43:05.760 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] TestCls2PCQueue.ReserveCommit (3009 ms) 2023-12-03T11:43:05.760 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] TestCls2PCQueue.ReserveAbort 2023-12-03T11:43:08.781 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] TestCls2PCQueue.ReserveAbort (3021 ms) 2023-12-03T11:43:08.781 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] TestCls2PCQueue.ManualCleanup 2023-12-03T11:43:11.796 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] TestCls2PCQueue.ManualCleanup (3014 ms) 2023-12-03T11:43:11.796 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] TestCls2PCQueue.Cleanup 2023-12-03T11:43:14.820 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] TestCls2PCQueue.Cleanup (3024 ms) 2023-12-03T11:43:14.820 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] TestCls2PCQueue.MultiProducer 2023-12-03T11:43:25.283 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] TestCls2PCQueue.MultiProducer (10464 ms) 2023-12-03T11:43:25.283 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] TestCls2PCQueue.AsyncConsumer 2023-12-03T11:43:28.301 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] TestCls2PCQueue.AsyncConsumer (3018 ms) 2023-12-03T11:43:28.301 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] TestCls2PCQueue.MultiProducerConsumer 2023-12-03T11:43:41.350 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] TestCls2PCQueue.MultiProducerConsumer (13048 ms) 2023-12-03T11:43:41.350 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] TestCls2PCQueue.ReserveSpillover 2023-12-03T11:43:45.387 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] TestCls2PCQueue.ReserveSpillover (4038 ms) 2023-12-03T11:43:45.387 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] TestCls2PCQueue.CommitSpillover 2023-12-03T11:43:51.416 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] TestCls2PCQueue.CommitSpillover (6029 ms) 2023-12-03T11:43:51.417 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] TestCls2PCQueue.AbortSpillover 2023-12-03T11:43:57.452 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] TestCls2PCQueue.AbortSpillover (6036 ms) 2023-12-03T11:43:57.453 INFO:tasks.workunit.client.0.smithi003.stdout:[----------] 24 tests from TestCls2PCQueue (98849 ms total) 2023-12-03T11:43:57.453 INFO:tasks.workunit.client.0.smithi003.stdout: 2023-12-03T11:43:57.453 INFO:tasks.workunit.client.0.smithi003.stdout:[----------] Global test environment tear-down 2023-12-03T11:43:57.453 INFO:tasks.workunit.client.0.smithi003.stdout:[==========] 24 tests from 1 test suite ran. (98849 ms total) 2023-12-03T11:43:57.453 INFO:tasks.workunit.client.0.smithi003.stdout:[ PASSED ] 24 tests. 2023-12-03T11:43:57.455 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-12-03T11:43:57.456 DEBUG:teuthology.orchestra.run.smithi003:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-12-03T11:43:57.532 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_gc_log.sh on client.0... 2023-12-03T11:43:57.533 INFO:tasks.workunit:Running workunit rgw/test_rgw_gc_log.sh... 2023-12-03T11:43:57.533 DEBUG:teuthology.orchestra.run.smithi003:workunit test rgw/test_rgw_gc_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bcbf278cf395873c2a482f5a7b2345faf2160319 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_gc_log.sh 2023-12-03T11:43:57.614 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:43:57.614 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:43:57.614 INFO:tasks.workunit.client.0.smithi003.stdout:[==========] Running 6 tests from 1 test suite. 2023-12-03T11:43:57.615 INFO:tasks.workunit.client.0.smithi003.stdout:[----------] Global test environment set-up. 2023-12-03T11:43:59.473 INFO:tasks.workunit.client.0.smithi003.stdout:[----------] 6 tests from rgw_gc_log 2023-12-03T11:43:59.474 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] rgw_gc_log.init_existing_queue 2023-12-03T11:43:59.570 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] rgw_gc_log.init_existing_queue (97 ms) 2023-12-03T11:43:59.570 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] rgw_gc_log.init_existing_omap 2023-12-03T11:43:59.574 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] rgw_gc_log.init_existing_omap (4 ms) 2023-12-03T11:43:59.574 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] rgw_gc_log.enqueue1_after_init 2023-12-03T11:43:59.577 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] rgw_gc_log.enqueue1_after_init (3 ms) 2023-12-03T11:43:59.577 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] rgw_gc_log.enqueue2_before_init 2023-12-03T11:43:59.581 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] rgw_gc_log.enqueue2_before_init (2 ms) 2023-12-03T11:43:59.581 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] rgw_gc_log.defer1_after_init 2023-12-03T11:43:59.582 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] rgw_gc_log.defer1_after_init (3 ms) 2023-12-03T11:43:59.582 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] rgw_gc_log.defer2_before_init 2023-12-03T11:43:59.583 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] rgw_gc_log.defer2_before_init (1 ms) 2023-12-03T11:43:59.583 INFO:tasks.workunit.client.0.smithi003.stdout:[----------] 6 tests from rgw_gc_log (110 ms total) 2023-12-03T11:43:59.583 INFO:tasks.workunit.client.0.smithi003.stdout: 2023-12-03T11:43:59.584 INFO:tasks.workunit.client.0.smithi003.stdout:[----------] Global test environment tear-down 2023-12-03T11:44:00.493 INFO:tasks.workunit.client.0.smithi003.stdout:[==========] 6 tests from 1 test suite ran. (2878 ms total) 2023-12-03T11:44:00.493 INFO:tasks.workunit.client.0.smithi003.stdout:[ PASSED ] 6 tests. 2023-12-03T11:44:00.496 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-12-03T11:44:00.497 DEBUG:teuthology.orchestra.run.smithi003:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-12-03T11:44:00.573 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_obj.sh on client.0... 2023-12-03T11:44:00.574 INFO:tasks.workunit:Running workunit rgw/test_rgw_obj.sh... 2023-12-03T11:44:00.575 DEBUG:teuthology.orchestra.run.smithi003:workunit test rgw/test_rgw_obj.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bcbf278cf395873c2a482f5a7b2345faf2160319 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_obj.sh 2023-12-03T11:44:00.660 INFO:tasks.workunit.client.0.smithi003.stdout:Running main() from gmock_main.cc 2023-12-03T11:44:00.660 INFO:tasks.workunit.client.0.smithi003.stdout:[==========] Running 4 tests from 1 test suite. 2023-12-03T11:44:00.660 INFO:tasks.workunit.client.0.smithi003.stdout:[----------] Global test environment set-up. 2023-12-03T11:44:00.660 INFO:tasks.workunit.client.0.smithi003.stdout:[----------] 4 tests from TestRGWObj 2023-12-03T11:44:00.660 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] TestRGWObj.underscore 2023-12-03T11:44:00.660 INFO:tasks.workunit.client.0.smithi003.stdout:parsed: _obj 2023-12-03T11:44:00.660 INFO:tasks.workunit.client.0.smithi003.stdout:parsed: _obj 2023-12-03T11:44:00.660 INFO:tasks.workunit.client.0.smithi003.stdout:stripped: _obj ns= i= 2023-12-03T11:44:00.660 INFO:tasks.workunit.client.0.smithi003.stdout:parsed: _obj 2023-12-03T11:44:00.660 INFO:tasks.workunit.client.0.smithi003.stdout:parsed: _obj 2023-12-03T11:44:00.660 INFO:tasks.workunit.client.0.smithi003.stdout:stripped: _obj ns= i= 2023-12-03T11:44:00.661 INFO:tasks.workunit.client.0.smithi003.stdout:parsed: _obj 2023-12-03T11:44:00.661 INFO:tasks.workunit.client.0.smithi003.stdout:parsed: _obj 2023-12-03T11:44:00.661 INFO:tasks.workunit.client.0.smithi003.stdout:stripped: _obj ns= i= 2023-12-03T11:44:00.661 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.661 INFO:tasks.workunit.client.0.smithi003.stdout: "obj1": { 2023-12-03T11:44:00.661 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket": { 2023-12-03T11:44:00.661 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "test", 2023-12-03T11:44:00.661 INFO:tasks.workunit.client.0.smithi003.stdout: "marker": "marker", 2023-12-03T11:44:00.661 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket_id": "bucket-id", 2023-12-03T11:44:00.661 INFO:tasks.workunit.client.0.smithi003.stdout: "tenant": "", 2023-12-03T11:44:00.661 INFO:tasks.workunit.client.0.smithi003.stdout: "explicit_placement": { 2023-12-03T11:44:00.661 INFO:tasks.workunit.client.0.smithi003.stdout: "data_pool": "", 2023-12-03T11:44:00.661 INFO:tasks.workunit.client.0.smithi003.stdout: "data_extra_pool": "", 2023-12-03T11:44:00.661 INFO:tasks.workunit.client.0.smithi003.stdout: "index_pool": "" 2023-12-03T11:44:00.661 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.662 INFO:tasks.workunit.client.0.smithi003.stdout: }, 2023-12-03T11:44:00.662 INFO:tasks.workunit.client.0.smithi003.stdout: "key": { 2023-12-03T11:44:00.662 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "_obj", 2023-12-03T11:44:00.662 INFO:tasks.workunit.client.0.smithi003.stdout: "instance": "", 2023-12-03T11:44:00.662 INFO:tasks.workunit.client.0.smithi003.stdout: "ns": "" 2023-12-03T11:44:00.662 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.662 INFO:tasks.workunit.client.0.smithi003.stdout: }, 2023-12-03T11:44:00.662 INFO:tasks.workunit.client.0.smithi003.stdout: "obj2": { 2023-12-03T11:44:00.662 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket": { 2023-12-03T11:44:00.662 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "test", 2023-12-03T11:44:00.662 INFO:tasks.workunit.client.0.smithi003.stdout: "marker": "marker", 2023-12-03T11:44:00.662 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket_id": "bucket-id", 2023-12-03T11:44:00.662 INFO:tasks.workunit.client.0.smithi003.stdout: "tenant": "", 2023-12-03T11:44:00.662 INFO:tasks.workunit.client.0.smithi003.stdout: "explicit_placement": { 2023-12-03T11:44:00.663 INFO:tasks.workunit.client.0.smithi003.stdout: "data_pool": "", 2023-12-03T11:44:00.663 INFO:tasks.workunit.client.0.smithi003.stdout: "data_extra_pool": "", 2023-12-03T11:44:00.663 INFO:tasks.workunit.client.0.smithi003.stdout: "index_pool": "" 2023-12-03T11:44:00.663 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.663 INFO:tasks.workunit.client.0.smithi003.stdout: }, 2023-12-03T11:44:00.663 INFO:tasks.workunit.client.0.smithi003.stdout: "key": { 2023-12-03T11:44:00.663 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "_obj", 2023-12-03T11:44:00.663 INFO:tasks.workunit.client.0.smithi003.stdout: "instance": "", 2023-12-03T11:44:00.663 INFO:tasks.workunit.client.0.smithi003.stdout: "ns": "" 2023-12-03T11:44:00.663 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.664 INFO:tasks.workunit.client.0.smithi003.stdout: }, 2023-12-03T11:44:00.664 INFO:tasks.workunit.client.0.smithi003.stdout: "obj3": { 2023-12-03T11:44:00.664 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket": { 2023-12-03T11:44:00.664 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "test", 2023-12-03T11:44:00.664 INFO:tasks.workunit.client.0.smithi003.stdout: "marker": "marker", 2023-12-03T11:44:00.664 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket_id": "bucket-id", 2023-12-03T11:44:00.665 INFO:tasks.workunit.client.0.smithi003.stdout: "tenant": "", 2023-12-03T11:44:00.665 INFO:tasks.workunit.client.0.smithi003.stdout: "explicit_placement": { 2023-12-03T11:44:00.665 INFO:tasks.workunit.client.0.smithi003.stdout: "data_pool": "", 2023-12-03T11:44:00.665 INFO:tasks.workunit.client.0.smithi003.stdout: "data_extra_pool": "", 2023-12-03T11:44:00.665 INFO:tasks.workunit.client.0.smithi003.stdout: "index_pool": "" 2023-12-03T11:44:00.665 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.665 INFO:tasks.workunit.client.0.smithi003.stdout: }, 2023-12-03T11:44:00.665 INFO:tasks.workunit.client.0.smithi003.stdout: "key": { 2023-12-03T11:44:00.665 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "_obj", 2023-12-03T11:44:00.665 INFO:tasks.workunit.client.0.smithi003.stdout: "instance": "", 2023-12-03T11:44:00.665 INFO:tasks.workunit.client.0.smithi003.stdout: "ns": "" 2023-12-03T11:44:00.665 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.665 INFO:tasks.workunit.client.0.smithi003.stdout: }, 2023-12-03T11:44:00.665 INFO:tasks.workunit.client.0.smithi003.stdout: "obj3-2": { 2023-12-03T11:44:00.665 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket": { 2023-12-03T11:44:00.666 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "test", 2023-12-03T11:44:00.666 INFO:tasks.workunit.client.0.smithi003.stdout: "marker": "marker", 2023-12-03T11:44:00.666 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket_id": "bucket-id", 2023-12-03T11:44:00.666 INFO:tasks.workunit.client.0.smithi003.stdout: "tenant": "", 2023-12-03T11:44:00.666 INFO:tasks.workunit.client.0.smithi003.stdout: "explicit_placement": { 2023-12-03T11:44:00.666 INFO:tasks.workunit.client.0.smithi003.stdout: "data_pool": "", 2023-12-03T11:44:00.666 INFO:tasks.workunit.client.0.smithi003.stdout: "data_extra_pool": "", 2023-12-03T11:44:00.666 INFO:tasks.workunit.client.0.smithi003.stdout: "index_pool": "" 2023-12-03T11:44:00.666 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.666 INFO:tasks.workunit.client.0.smithi003.stdout: }, 2023-12-03T11:44:00.667 INFO:tasks.workunit.client.0.smithi003.stdout: "key": { 2023-12-03T11:44:00.667 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "_obj", 2023-12-03T11:44:00.667 INFO:tasks.workunit.client.0.smithi003.stdout: "instance": "", 2023-12-03T11:44:00.667 INFO:tasks.workunit.client.0.smithi003.stdout: "ns": "" 2023-12-03T11:44:00.667 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.667 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.667 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.667 INFO:tasks.workunit.client.0.smithi003.stdout:parsed: _obj 2023-12-03T11:44:00.667 INFO:tasks.workunit.client.0.smithi003.stdout:parsed: _obj 2023-12-03T11:44:00.667 INFO:tasks.workunit.client.0.smithi003.stdout:stripped: _obj ns=ns i= 2023-12-03T11:44:00.667 INFO:tasks.workunit.client.0.smithi003.stdout:parsed: _obj 2023-12-03T11:44:00.667 INFO:tasks.workunit.client.0.smithi003.stdout:parsed: _obj 2023-12-03T11:44:00.667 INFO:tasks.workunit.client.0.smithi003.stdout:stripped: _obj ns=ns i= 2023-12-03T11:44:00.667 INFO:tasks.workunit.client.0.smithi003.stdout:parsed: _obj 2023-12-03T11:44:00.667 INFO:tasks.workunit.client.0.smithi003.stdout:parsed: _obj 2023-12-03T11:44:00.668 INFO:tasks.workunit.client.0.smithi003.stdout:stripped: _obj ns=ns i= 2023-12-03T11:44:00.668 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.668 INFO:tasks.workunit.client.0.smithi003.stdout: "obj1": { 2023-12-03T11:44:00.668 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket": { 2023-12-03T11:44:00.668 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "test", 2023-12-03T11:44:00.668 INFO:tasks.workunit.client.0.smithi003.stdout: "marker": "marker", 2023-12-03T11:44:00.668 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket_id": "bucket-id", 2023-12-03T11:44:00.668 INFO:tasks.workunit.client.0.smithi003.stdout: "tenant": "", 2023-12-03T11:44:00.668 INFO:tasks.workunit.client.0.smithi003.stdout: "explicit_placement": { 2023-12-03T11:44:00.668 INFO:tasks.workunit.client.0.smithi003.stdout: "data_pool": "", 2023-12-03T11:44:00.668 INFO:tasks.workunit.client.0.smithi003.stdout: "data_extra_pool": "", 2023-12-03T11:44:00.668 INFO:tasks.workunit.client.0.smithi003.stdout: "index_pool": "" 2023-12-03T11:44:00.668 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.668 INFO:tasks.workunit.client.0.smithi003.stdout: }, 2023-12-03T11:44:00.668 INFO:tasks.workunit.client.0.smithi003.stdout: "key": { 2023-12-03T11:44:00.669 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "_obj", 2023-12-03T11:44:00.669 INFO:tasks.workunit.client.0.smithi003.stdout: "instance": "", 2023-12-03T11:44:00.669 INFO:tasks.workunit.client.0.smithi003.stdout: "ns": "ns" 2023-12-03T11:44:00.669 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.669 INFO:tasks.workunit.client.0.smithi003.stdout: }, 2023-12-03T11:44:00.669 INFO:tasks.workunit.client.0.smithi003.stdout: "obj2": { 2023-12-03T11:44:00.669 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket": { 2023-12-03T11:44:00.669 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "test", 2023-12-03T11:44:00.669 INFO:tasks.workunit.client.0.smithi003.stdout: "marker": "marker", 2023-12-03T11:44:00.669 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket_id": "bucket-id", 2023-12-03T11:44:00.669 INFO:tasks.workunit.client.0.smithi003.stdout: "tenant": "", 2023-12-03T11:44:00.669 INFO:tasks.workunit.client.0.smithi003.stdout: "explicit_placement": { 2023-12-03T11:44:00.669 INFO:tasks.workunit.client.0.smithi003.stdout: "data_pool": "", 2023-12-03T11:44:00.669 INFO:tasks.workunit.client.0.smithi003.stdout: "data_extra_pool": "", 2023-12-03T11:44:00.669 INFO:tasks.workunit.client.0.smithi003.stdout: "index_pool": "" 2023-12-03T11:44:00.670 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.670 INFO:tasks.workunit.client.0.smithi003.stdout: }, 2023-12-03T11:44:00.670 INFO:tasks.workunit.client.0.smithi003.stdout: "key": { 2023-12-03T11:44:00.670 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "_obj", 2023-12-03T11:44:00.670 INFO:tasks.workunit.client.0.smithi003.stdout: "instance": "", 2023-12-03T11:44:00.670 INFO:tasks.workunit.client.0.smithi003.stdout: "ns": "ns" 2023-12-03T11:44:00.670 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.670 INFO:tasks.workunit.client.0.smithi003.stdout: }, 2023-12-03T11:44:00.670 INFO:tasks.workunit.client.0.smithi003.stdout: "obj3": { 2023-12-03T11:44:00.671 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket": { 2023-12-03T11:44:00.671 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "test", 2023-12-03T11:44:00.671 INFO:tasks.workunit.client.0.smithi003.stdout: "marker": "marker", 2023-12-03T11:44:00.671 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket_id": "bucket-id", 2023-12-03T11:44:00.671 INFO:tasks.workunit.client.0.smithi003.stdout: "tenant": "", 2023-12-03T11:44:00.671 INFO:tasks.workunit.client.0.smithi003.stdout: "explicit_placement": { 2023-12-03T11:44:00.671 INFO:tasks.workunit.client.0.smithi003.stdout: "data_pool": "", 2023-12-03T11:44:00.671 INFO:tasks.workunit.client.0.smithi003.stdout: "data_extra_pool": "", 2023-12-03T11:44:00.671 INFO:tasks.workunit.client.0.smithi003.stdout: "index_pool": "" 2023-12-03T11:44:00.671 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.671 INFO:tasks.workunit.client.0.smithi003.stdout: }, 2023-12-03T11:44:00.671 INFO:tasks.workunit.client.0.smithi003.stdout: "key": { 2023-12-03T11:44:00.671 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "_obj", 2023-12-03T11:44:00.671 INFO:tasks.workunit.client.0.smithi003.stdout: "instance": "", 2023-12-03T11:44:00.672 INFO:tasks.workunit.client.0.smithi003.stdout: "ns": "" 2023-12-03T11:44:00.672 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.672 INFO:tasks.workunit.client.0.smithi003.stdout: }, 2023-12-03T11:44:00.672 INFO:tasks.workunit.client.0.smithi003.stdout: "obj3-2": { 2023-12-03T11:44:00.672 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket": { 2023-12-03T11:44:00.672 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "test", 2023-12-03T11:44:00.672 INFO:tasks.workunit.client.0.smithi003.stdout: "marker": "marker", 2023-12-03T11:44:00.672 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket_id": "bucket-id", 2023-12-03T11:44:00.672 INFO:tasks.workunit.client.0.smithi003.stdout: "tenant": "", 2023-12-03T11:44:00.672 INFO:tasks.workunit.client.0.smithi003.stdout: "explicit_placement": { 2023-12-03T11:44:00.672 INFO:tasks.workunit.client.0.smithi003.stdout: "data_pool": "", 2023-12-03T11:44:00.672 INFO:tasks.workunit.client.0.smithi003.stdout: "data_extra_pool": "", 2023-12-03T11:44:00.672 INFO:tasks.workunit.client.0.smithi003.stdout: "index_pool": "" 2023-12-03T11:44:00.672 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.672 INFO:tasks.workunit.client.0.smithi003.stdout: }, 2023-12-03T11:44:00.672 INFO:tasks.workunit.client.0.smithi003.stdout: "key": { 2023-12-03T11:44:00.673 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "_obj", 2023-12-03T11:44:00.673 INFO:tasks.workunit.client.0.smithi003.stdout: "instance": "", 2023-12-03T11:44:00.673 INFO:tasks.workunit.client.0.smithi003.stdout: "ns": "ns" 2023-12-03T11:44:00.673 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.673 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.673 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.673 INFO:tasks.workunit.client.0.smithi003.stdout:parsed: _obj[v1] 2023-12-03T11:44:00.673 INFO:tasks.workunit.client.0.smithi003.stdout:parsed: _obj[v1] 2023-12-03T11:44:00.673 INFO:tasks.workunit.client.0.smithi003.stdout:stripped: _obj ns= i=v1 2023-12-03T11:44:00.673 INFO:tasks.workunit.client.0.smithi003.stdout:parsed: _obj[v1] 2023-12-03T11:44:00.673 INFO:tasks.workunit.client.0.smithi003.stdout:parsed: _obj[v1] 2023-12-03T11:44:00.673 INFO:tasks.workunit.client.0.smithi003.stdout:stripped: _obj ns= i=v1 2023-12-03T11:44:00.673 INFO:tasks.workunit.client.0.smithi003.stdout:parsed: _obj[v1] 2023-12-03T11:44:00.673 INFO:tasks.workunit.client.0.smithi003.stdout:parsed: _obj[v1] 2023-12-03T11:44:00.674 INFO:tasks.workunit.client.0.smithi003.stdout:stripped: _obj ns= i=v1 2023-12-03T11:44:00.674 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.674 INFO:tasks.workunit.client.0.smithi003.stdout: "obj1": { 2023-12-03T11:44:00.674 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket": { 2023-12-03T11:44:00.674 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "test", 2023-12-03T11:44:00.674 INFO:tasks.workunit.client.0.smithi003.stdout: "marker": "marker", 2023-12-03T11:44:00.674 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket_id": "bucket-id", 2023-12-03T11:44:00.674 INFO:tasks.workunit.client.0.smithi003.stdout: "tenant": "", 2023-12-03T11:44:00.674 INFO:tasks.workunit.client.0.smithi003.stdout: "explicit_placement": { 2023-12-03T11:44:00.674 INFO:tasks.workunit.client.0.smithi003.stdout: "data_pool": "", 2023-12-03T11:44:00.674 INFO:tasks.workunit.client.0.smithi003.stdout: "data_extra_pool": "", 2023-12-03T11:44:00.674 INFO:tasks.workunit.client.0.smithi003.stdout: "index_pool": "" 2023-12-03T11:44:00.674 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.674 INFO:tasks.workunit.client.0.smithi003.stdout: }, 2023-12-03T11:44:00.674 INFO:tasks.workunit.client.0.smithi003.stdout: "key": { 2023-12-03T11:44:00.675 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "_obj", 2023-12-03T11:44:00.675 INFO:tasks.workunit.client.0.smithi003.stdout: "instance": "v1", 2023-12-03T11:44:00.675 INFO:tasks.workunit.client.0.smithi003.stdout: "ns": "" 2023-12-03T11:44:00.675 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.675 INFO:tasks.workunit.client.0.smithi003.stdout: }, 2023-12-03T11:44:00.675 INFO:tasks.workunit.client.0.smithi003.stdout: "obj2": { 2023-12-03T11:44:00.675 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket": { 2023-12-03T11:44:00.675 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "test", 2023-12-03T11:44:00.675 INFO:tasks.workunit.client.0.smithi003.stdout: "marker": "marker", 2023-12-03T11:44:00.675 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket_id": "bucket-id", 2023-12-03T11:44:00.675 INFO:tasks.workunit.client.0.smithi003.stdout: "tenant": "", 2023-12-03T11:44:00.675 INFO:tasks.workunit.client.0.smithi003.stdout: "explicit_placement": { 2023-12-03T11:44:00.675 INFO:tasks.workunit.client.0.smithi003.stdout: "data_pool": "", 2023-12-03T11:44:00.675 INFO:tasks.workunit.client.0.smithi003.stdout: "data_extra_pool": "", 2023-12-03T11:44:00.675 INFO:tasks.workunit.client.0.smithi003.stdout: "index_pool": "" 2023-12-03T11:44:00.676 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.676 INFO:tasks.workunit.client.0.smithi003.stdout: }, 2023-12-03T11:44:00.676 INFO:tasks.workunit.client.0.smithi003.stdout: "key": { 2023-12-03T11:44:00.676 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "_obj", 2023-12-03T11:44:00.676 INFO:tasks.workunit.client.0.smithi003.stdout: "instance": "v1", 2023-12-03T11:44:00.676 INFO:tasks.workunit.client.0.smithi003.stdout: "ns": "" 2023-12-03T11:44:00.676 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.676 INFO:tasks.workunit.client.0.smithi003.stdout: }, 2023-12-03T11:44:00.676 INFO:tasks.workunit.client.0.smithi003.stdout: "obj3": { 2023-12-03T11:44:00.676 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket": { 2023-12-03T11:44:00.676 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "test", 2023-12-03T11:44:00.676 INFO:tasks.workunit.client.0.smithi003.stdout: "marker": "marker", 2023-12-03T11:44:00.676 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket_id": "bucket-id", 2023-12-03T11:44:00.676 INFO:tasks.workunit.client.0.smithi003.stdout: "tenant": "", 2023-12-03T11:44:00.676 INFO:tasks.workunit.client.0.smithi003.stdout: "explicit_placement": { 2023-12-03T11:44:00.677 INFO:tasks.workunit.client.0.smithi003.stdout: "data_pool": "", 2023-12-03T11:44:00.677 INFO:tasks.workunit.client.0.smithi003.stdout: "data_extra_pool": "", 2023-12-03T11:44:00.677 INFO:tasks.workunit.client.0.smithi003.stdout: "index_pool": "" 2023-12-03T11:44:00.677 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.677 INFO:tasks.workunit.client.0.smithi003.stdout: }, 2023-12-03T11:44:00.677 INFO:tasks.workunit.client.0.smithi003.stdout: "key": { 2023-12-03T11:44:00.677 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "_obj", 2023-12-03T11:44:00.677 INFO:tasks.workunit.client.0.smithi003.stdout: "instance": "", 2023-12-03T11:44:00.677 INFO:tasks.workunit.client.0.smithi003.stdout: "ns": "" 2023-12-03T11:44:00.677 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.677 INFO:tasks.workunit.client.0.smithi003.stdout: }, 2023-12-03T11:44:00.677 INFO:tasks.workunit.client.0.smithi003.stdout: "obj3-2": { 2023-12-03T11:44:00.677 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket": { 2023-12-03T11:44:00.677 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "test", 2023-12-03T11:44:00.677 INFO:tasks.workunit.client.0.smithi003.stdout: "marker": "marker", 2023-12-03T11:44:00.678 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket_id": "bucket-id", 2023-12-03T11:44:00.678 INFO:tasks.workunit.client.0.smithi003.stdout: "tenant": "", 2023-12-03T11:44:00.678 INFO:tasks.workunit.client.0.smithi003.stdout: "explicit_placement": { 2023-12-03T11:44:00.678 INFO:tasks.workunit.client.0.smithi003.stdout: "data_pool": "", 2023-12-03T11:44:00.678 INFO:tasks.workunit.client.0.smithi003.stdout: "data_extra_pool": "", 2023-12-03T11:44:00.678 INFO:tasks.workunit.client.0.smithi003.stdout: "index_pool": "" 2023-12-03T11:44:00.678 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.678 INFO:tasks.workunit.client.0.smithi003.stdout: }, 2023-12-03T11:44:00.678 INFO:tasks.workunit.client.0.smithi003.stdout: "key": { 2023-12-03T11:44:00.678 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "_obj", 2023-12-03T11:44:00.678 INFO:tasks.workunit.client.0.smithi003.stdout: "instance": "v1", 2023-12-03T11:44:00.678 INFO:tasks.workunit.client.0.smithi003.stdout: "ns": "" 2023-12-03T11:44:00.678 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.678 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.678 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.679 INFO:tasks.workunit.client.0.smithi003.stdout:parsed: _obj[v1] 2023-12-03T11:44:00.679 INFO:tasks.workunit.client.0.smithi003.stdout:parsed: _obj[v1] 2023-12-03T11:44:00.679 INFO:tasks.workunit.client.0.smithi003.stdout:stripped: _obj ns=ns i=v1 2023-12-03T11:44:00.679 INFO:tasks.workunit.client.0.smithi003.stdout:parsed: _obj[v1] 2023-12-03T11:44:00.679 INFO:tasks.workunit.client.0.smithi003.stdout:parsed: _obj[v1] 2023-12-03T11:44:00.679 INFO:tasks.workunit.client.0.smithi003.stdout:stripped: _obj ns=ns i=v1 2023-12-03T11:44:00.679 INFO:tasks.workunit.client.0.smithi003.stdout:parsed: _obj[v1] 2023-12-03T11:44:00.679 INFO:tasks.workunit.client.0.smithi003.stdout:parsed: _obj[v1] 2023-12-03T11:44:00.679 INFO:tasks.workunit.client.0.smithi003.stdout:stripped: _obj ns=ns i=v1 2023-12-03T11:44:00.679 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.679 INFO:tasks.workunit.client.0.smithi003.stdout: "obj1": { 2023-12-03T11:44:00.679 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket": { 2023-12-03T11:44:00.679 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "test", 2023-12-03T11:44:00.679 INFO:tasks.workunit.client.0.smithi003.stdout: "marker": "marker", 2023-12-03T11:44:00.679 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket_id": "bucket-id", 2023-12-03T11:44:00.680 INFO:tasks.workunit.client.0.smithi003.stdout: "tenant": "", 2023-12-03T11:44:00.680 INFO:tasks.workunit.client.0.smithi003.stdout: "explicit_placement": { 2023-12-03T11:44:00.680 INFO:tasks.workunit.client.0.smithi003.stdout: "data_pool": "", 2023-12-03T11:44:00.680 INFO:tasks.workunit.client.0.smithi003.stdout: "data_extra_pool": "", 2023-12-03T11:44:00.680 INFO:tasks.workunit.client.0.smithi003.stdout: "index_pool": "" 2023-12-03T11:44:00.680 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.680 INFO:tasks.workunit.client.0.smithi003.stdout: }, 2023-12-03T11:44:00.680 INFO:tasks.workunit.client.0.smithi003.stdout: "key": { 2023-12-03T11:44:00.680 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "_obj", 2023-12-03T11:44:00.680 INFO:tasks.workunit.client.0.smithi003.stdout: "instance": "v1", 2023-12-03T11:44:00.680 INFO:tasks.workunit.client.0.smithi003.stdout: "ns": "ns" 2023-12-03T11:44:00.680 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.680 INFO:tasks.workunit.client.0.smithi003.stdout: }, 2023-12-03T11:44:00.680 INFO:tasks.workunit.client.0.smithi003.stdout: "obj2": { 2023-12-03T11:44:00.680 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket": { 2023-12-03T11:44:00.681 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "test", 2023-12-03T11:44:00.681 INFO:tasks.workunit.client.0.smithi003.stdout: "marker": "marker", 2023-12-03T11:44:00.681 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket_id": "bucket-id", 2023-12-03T11:44:00.681 INFO:tasks.workunit.client.0.smithi003.stdout: "tenant": "", 2023-12-03T11:44:00.681 INFO:tasks.workunit.client.0.smithi003.stdout: "explicit_placement": { 2023-12-03T11:44:00.681 INFO:tasks.workunit.client.0.smithi003.stdout: "data_pool": "", 2023-12-03T11:44:00.681 INFO:tasks.workunit.client.0.smithi003.stdout: "data_extra_pool": "", 2023-12-03T11:44:00.681 INFO:tasks.workunit.client.0.smithi003.stdout: "index_pool": "" 2023-12-03T11:44:00.681 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.681 INFO:tasks.workunit.client.0.smithi003.stdout: }, 2023-12-03T11:44:00.681 INFO:tasks.workunit.client.0.smithi003.stdout: "key": { 2023-12-03T11:44:00.681 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "_obj", 2023-12-03T11:44:00.681 INFO:tasks.workunit.client.0.smithi003.stdout: "instance": "v1", 2023-12-03T11:44:00.681 INFO:tasks.workunit.client.0.smithi003.stdout: "ns": "ns" 2023-12-03T11:44:00.681 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.681 INFO:tasks.workunit.client.0.smithi003.stdout: }, 2023-12-03T11:44:00.682 INFO:tasks.workunit.client.0.smithi003.stdout: "obj3": { 2023-12-03T11:44:00.682 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket": { 2023-12-03T11:44:00.682 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "test", 2023-12-03T11:44:00.682 INFO:tasks.workunit.client.0.smithi003.stdout: "marker": "marker", 2023-12-03T11:44:00.682 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket_id": "bucket-id", 2023-12-03T11:44:00.682 INFO:tasks.workunit.client.0.smithi003.stdout: "tenant": "", 2023-12-03T11:44:00.682 INFO:tasks.workunit.client.0.smithi003.stdout: "explicit_placement": { 2023-12-03T11:44:00.682 INFO:tasks.workunit.client.0.smithi003.stdout: "data_pool": "", 2023-12-03T11:44:00.682 INFO:tasks.workunit.client.0.smithi003.stdout: "data_extra_pool": "", 2023-12-03T11:44:00.682 INFO:tasks.workunit.client.0.smithi003.stdout: "index_pool": "" 2023-12-03T11:44:00.682 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.682 INFO:tasks.workunit.client.0.smithi003.stdout: }, 2023-12-03T11:44:00.682 INFO:tasks.workunit.client.0.smithi003.stdout: "key": { 2023-12-03T11:44:00.682 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "_obj", 2023-12-03T11:44:00.683 INFO:tasks.workunit.client.0.smithi003.stdout: "instance": "", 2023-12-03T11:44:00.683 INFO:tasks.workunit.client.0.smithi003.stdout: "ns": "" 2023-12-03T11:44:00.683 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.683 INFO:tasks.workunit.client.0.smithi003.stdout: }, 2023-12-03T11:44:00.683 INFO:tasks.workunit.client.0.smithi003.stdout: "obj3-2": { 2023-12-03T11:44:00.683 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket": { 2023-12-03T11:44:00.683 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "test", 2023-12-03T11:44:00.683 INFO:tasks.workunit.client.0.smithi003.stdout: "marker": "marker", 2023-12-03T11:44:00.683 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket_id": "bucket-id", 2023-12-03T11:44:00.683 INFO:tasks.workunit.client.0.smithi003.stdout: "tenant": "", 2023-12-03T11:44:00.683 INFO:tasks.workunit.client.0.smithi003.stdout: "explicit_placement": { 2023-12-03T11:44:00.683 INFO:tasks.workunit.client.0.smithi003.stdout: "data_pool": "", 2023-12-03T11:44:00.683 INFO:tasks.workunit.client.0.smithi003.stdout: "data_extra_pool": "", 2023-12-03T11:44:00.683 INFO:tasks.workunit.client.0.smithi003.stdout: "index_pool": "" 2023-12-03T11:44:00.684 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.684 INFO:tasks.workunit.client.0.smithi003.stdout: }, 2023-12-03T11:44:00.684 INFO:tasks.workunit.client.0.smithi003.stdout: "key": { 2023-12-03T11:44:00.684 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "_obj", 2023-12-03T11:44:00.684 INFO:tasks.workunit.client.0.smithi003.stdout: "instance": "v1", 2023-12-03T11:44:00.684 INFO:tasks.workunit.client.0.smithi003.stdout: "ns": "ns" 2023-12-03T11:44:00.684 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.684 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.684 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.684 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] TestRGWObj.underscore (0 ms) 2023-12-03T11:44:00.684 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] TestRGWObj.no_underscore 2023-12-03T11:44:00.684 INFO:tasks.workunit.client.0.smithi003.stdout:parsed: obj 2023-12-03T11:44:00.684 INFO:tasks.workunit.client.0.smithi003.stdout:parsed: obj 2023-12-03T11:44:00.684 INFO:tasks.workunit.client.0.smithi003.stdout:stripped: obj ns= i= 2023-12-03T11:44:00.684 INFO:tasks.workunit.client.0.smithi003.stdout:parsed: obj 2023-12-03T11:44:00.685 INFO:tasks.workunit.client.0.smithi003.stdout:parsed: obj 2023-12-03T11:44:00.685 INFO:tasks.workunit.client.0.smithi003.stdout:stripped: obj ns= i= 2023-12-03T11:44:00.685 INFO:tasks.workunit.client.0.smithi003.stdout:parsed: obj 2023-12-03T11:44:00.685 INFO:tasks.workunit.client.0.smithi003.stdout:parsed: obj 2023-12-03T11:44:00.685 INFO:tasks.workunit.client.0.smithi003.stdout:stripped: obj ns= i= 2023-12-03T11:44:00.685 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.685 INFO:tasks.workunit.client.0.smithi003.stdout: "obj1": { 2023-12-03T11:44:00.685 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket": { 2023-12-03T11:44:00.685 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "test", 2023-12-03T11:44:00.685 INFO:tasks.workunit.client.0.smithi003.stdout: "marker": "marker", 2023-12-03T11:44:00.685 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket_id": "bucket-id", 2023-12-03T11:44:00.685 INFO:tasks.workunit.client.0.smithi003.stdout: "tenant": "", 2023-12-03T11:44:00.685 INFO:tasks.workunit.client.0.smithi003.stdout: "explicit_placement": { 2023-12-03T11:44:00.685 INFO:tasks.workunit.client.0.smithi003.stdout: "data_pool": "", 2023-12-03T11:44:00.686 INFO:tasks.workunit.client.0.smithi003.stdout: "data_extra_pool": "", 2023-12-03T11:44:00.686 INFO:tasks.workunit.client.0.smithi003.stdout: "index_pool": "" 2023-12-03T11:44:00.686 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.686 INFO:tasks.workunit.client.0.smithi003.stdout: }, 2023-12-03T11:44:00.686 INFO:tasks.workunit.client.0.smithi003.stdout: "key": { 2023-12-03T11:44:00.686 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "obj", 2023-12-03T11:44:00.686 INFO:tasks.workunit.client.0.smithi003.stdout: "instance": "", 2023-12-03T11:44:00.686 INFO:tasks.workunit.client.0.smithi003.stdout: "ns": "" 2023-12-03T11:44:00.686 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.686 INFO:tasks.workunit.client.0.smithi003.stdout: }, 2023-12-03T11:44:00.686 INFO:tasks.workunit.client.0.smithi003.stdout: "obj2": { 2023-12-03T11:44:00.686 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket": { 2023-12-03T11:44:00.686 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "test", 2023-12-03T11:44:00.686 INFO:tasks.workunit.client.0.smithi003.stdout: "marker": "marker", 2023-12-03T11:44:00.687 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket_id": "bucket-id", 2023-12-03T11:44:00.687 INFO:tasks.workunit.client.0.smithi003.stdout: "tenant": "", 2023-12-03T11:44:00.687 INFO:tasks.workunit.client.0.smithi003.stdout: "explicit_placement": { 2023-12-03T11:44:00.687 INFO:tasks.workunit.client.0.smithi003.stdout: "data_pool": "", 2023-12-03T11:44:00.687 INFO:tasks.workunit.client.0.smithi003.stdout: "data_extra_pool": "", 2023-12-03T11:44:00.687 INFO:tasks.workunit.client.0.smithi003.stdout: "index_pool": "" 2023-12-03T11:44:00.687 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.687 INFO:tasks.workunit.client.0.smithi003.stdout: }, 2023-12-03T11:44:00.687 INFO:tasks.workunit.client.0.smithi003.stdout: "key": { 2023-12-03T11:44:00.687 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "obj", 2023-12-03T11:44:00.687 INFO:tasks.workunit.client.0.smithi003.stdout: "instance": "", 2023-12-03T11:44:00.687 INFO:tasks.workunit.client.0.smithi003.stdout: "ns": "" 2023-12-03T11:44:00.687 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.687 INFO:tasks.workunit.client.0.smithi003.stdout: }, 2023-12-03T11:44:00.687 INFO:tasks.workunit.client.0.smithi003.stdout: "obj3": { 2023-12-03T11:44:00.688 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket": { 2023-12-03T11:44:00.688 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "test", 2023-12-03T11:44:00.688 INFO:tasks.workunit.client.0.smithi003.stdout: "marker": "marker", 2023-12-03T11:44:00.688 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket_id": "bucket-id", 2023-12-03T11:44:00.688 INFO:tasks.workunit.client.0.smithi003.stdout: "tenant": "", 2023-12-03T11:44:00.688 INFO:tasks.workunit.client.0.smithi003.stdout: "explicit_placement": { 2023-12-03T11:44:00.688 INFO:tasks.workunit.client.0.smithi003.stdout: "data_pool": "", 2023-12-03T11:44:00.688 INFO:tasks.workunit.client.0.smithi003.stdout: "data_extra_pool": "", 2023-12-03T11:44:00.688 INFO:tasks.workunit.client.0.smithi003.stdout: "index_pool": "" 2023-12-03T11:44:00.688 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.688 INFO:tasks.workunit.client.0.smithi003.stdout: }, 2023-12-03T11:44:00.688 INFO:tasks.workunit.client.0.smithi003.stdout: "key": { 2023-12-03T11:44:00.688 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "obj", 2023-12-03T11:44:00.688 INFO:tasks.workunit.client.0.smithi003.stdout: "instance": "", 2023-12-03T11:44:00.689 INFO:tasks.workunit.client.0.smithi003.stdout: "ns": "" 2023-12-03T11:44:00.689 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.689 INFO:tasks.workunit.client.0.smithi003.stdout: }, 2023-12-03T11:44:00.689 INFO:tasks.workunit.client.0.smithi003.stdout: "obj3-2": { 2023-12-03T11:44:00.689 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket": { 2023-12-03T11:44:00.689 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "test", 2023-12-03T11:44:00.689 INFO:tasks.workunit.client.0.smithi003.stdout: "marker": "marker", 2023-12-03T11:44:00.689 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket_id": "bucket-id", 2023-12-03T11:44:00.689 INFO:tasks.workunit.client.0.smithi003.stdout: "tenant": "", 2023-12-03T11:44:00.689 INFO:tasks.workunit.client.0.smithi003.stdout: "explicit_placement": { 2023-12-03T11:44:00.689 INFO:tasks.workunit.client.0.smithi003.stdout: "data_pool": "", 2023-12-03T11:44:00.689 INFO:tasks.workunit.client.0.smithi003.stdout: "data_extra_pool": "", 2023-12-03T11:44:00.689 INFO:tasks.workunit.client.0.smithi003.stdout: "index_pool": "" 2023-12-03T11:44:00.689 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.689 INFO:tasks.workunit.client.0.smithi003.stdout: }, 2023-12-03T11:44:00.690 INFO:tasks.workunit.client.0.smithi003.stdout: "key": { 2023-12-03T11:44:00.690 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "obj", 2023-12-03T11:44:00.690 INFO:tasks.workunit.client.0.smithi003.stdout: "instance": "", 2023-12-03T11:44:00.690 INFO:tasks.workunit.client.0.smithi003.stdout: "ns": "" 2023-12-03T11:44:00.690 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.690 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.690 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.690 INFO:tasks.workunit.client.0.smithi003.stdout:parsed: obj 2023-12-03T11:44:00.690 INFO:tasks.workunit.client.0.smithi003.stdout:parsed: obj 2023-12-03T11:44:00.690 INFO:tasks.workunit.client.0.smithi003.stdout:stripped: obj ns=ns i= 2023-12-03T11:44:00.690 INFO:tasks.workunit.client.0.smithi003.stdout:parsed: obj 2023-12-03T11:44:00.690 INFO:tasks.workunit.client.0.smithi003.stdout:parsed: obj 2023-12-03T11:44:00.690 INFO:tasks.workunit.client.0.smithi003.stdout:stripped: obj ns=ns i= 2023-12-03T11:44:00.690 INFO:tasks.workunit.client.0.smithi003.stdout:parsed: obj 2023-12-03T11:44:00.691 INFO:tasks.workunit.client.0.smithi003.stdout:parsed: obj 2023-12-03T11:44:00.691 INFO:tasks.workunit.client.0.smithi003.stdout:stripped: obj ns=ns i= 2023-12-03T11:44:00.691 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.691 INFO:tasks.workunit.client.0.smithi003.stdout: "obj1": { 2023-12-03T11:44:00.691 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket": { 2023-12-03T11:44:00.691 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "test", 2023-12-03T11:44:00.691 INFO:tasks.workunit.client.0.smithi003.stdout: "marker": "marker", 2023-12-03T11:44:00.691 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket_id": "bucket-id", 2023-12-03T11:44:00.691 INFO:tasks.workunit.client.0.smithi003.stdout: "tenant": "", 2023-12-03T11:44:00.691 INFO:tasks.workunit.client.0.smithi003.stdout: "explicit_placement": { 2023-12-03T11:44:00.691 INFO:tasks.workunit.client.0.smithi003.stdout: "data_pool": "", 2023-12-03T11:44:00.691 INFO:tasks.workunit.client.0.smithi003.stdout: "data_extra_pool": "", 2023-12-03T11:44:00.691 INFO:tasks.workunit.client.0.smithi003.stdout: "index_pool": "" 2023-12-03T11:44:00.691 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.692 INFO:tasks.workunit.client.0.smithi003.stdout: }, 2023-12-03T11:44:00.692 INFO:tasks.workunit.client.0.smithi003.stdout: "key": { 2023-12-03T11:44:00.692 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "obj", 2023-12-03T11:44:00.692 INFO:tasks.workunit.client.0.smithi003.stdout: "instance": "", 2023-12-03T11:44:00.692 INFO:tasks.workunit.client.0.smithi003.stdout: "ns": "ns" 2023-12-03T11:44:00.692 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.692 INFO:tasks.workunit.client.0.smithi003.stdout: }, 2023-12-03T11:44:00.692 INFO:tasks.workunit.client.0.smithi003.stdout: "obj2": { 2023-12-03T11:44:00.692 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket": { 2023-12-03T11:44:00.692 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "test", 2023-12-03T11:44:00.692 INFO:tasks.workunit.client.0.smithi003.stdout: "marker": "marker", 2023-12-03T11:44:00.692 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket_id": "bucket-id", 2023-12-03T11:44:00.692 INFO:tasks.workunit.client.0.smithi003.stdout: "tenant": "", 2023-12-03T11:44:00.692 INFO:tasks.workunit.client.0.smithi003.stdout: "explicit_placement": { 2023-12-03T11:44:00.692 INFO:tasks.workunit.client.0.smithi003.stdout: "data_pool": "", 2023-12-03T11:44:00.693 INFO:tasks.workunit.client.0.smithi003.stdout: "data_extra_pool": "", 2023-12-03T11:44:00.693 INFO:tasks.workunit.client.0.smithi003.stdout: "index_pool": "" 2023-12-03T11:44:00.693 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.693 INFO:tasks.workunit.client.0.smithi003.stdout: }, 2023-12-03T11:44:00.693 INFO:tasks.workunit.client.0.smithi003.stdout: "key": { 2023-12-03T11:44:00.693 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "obj", 2023-12-03T11:44:00.693 INFO:tasks.workunit.client.0.smithi003.stdout: "instance": "", 2023-12-03T11:44:00.694 INFO:tasks.workunit.client.0.smithi003.stdout: "ns": "ns" 2023-12-03T11:44:00.694 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.694 INFO:tasks.workunit.client.0.smithi003.stdout: }, 2023-12-03T11:44:00.694 INFO:tasks.workunit.client.0.smithi003.stdout: "obj3": { 2023-12-03T11:44:00.694 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket": { 2023-12-03T11:44:00.694 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "test", 2023-12-03T11:44:00.694 INFO:tasks.workunit.client.0.smithi003.stdout: "marker": "marker", 2023-12-03T11:44:00.694 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket_id": "bucket-id", 2023-12-03T11:44:00.694 INFO:tasks.workunit.client.0.smithi003.stdout: "tenant": "", 2023-12-03T11:44:00.694 INFO:tasks.workunit.client.0.smithi003.stdout: "explicit_placement": { 2023-12-03T11:44:00.694 INFO:tasks.workunit.client.0.smithi003.stdout: "data_pool": "", 2023-12-03T11:44:00.694 INFO:tasks.workunit.client.0.smithi003.stdout: "data_extra_pool": "", 2023-12-03T11:44:00.694 INFO:tasks.workunit.client.0.smithi003.stdout: "index_pool": "" 2023-12-03T11:44:00.694 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.694 INFO:tasks.workunit.client.0.smithi003.stdout: }, 2023-12-03T11:44:00.695 INFO:tasks.workunit.client.0.smithi003.stdout: "key": { 2023-12-03T11:44:00.695 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "obj", 2023-12-03T11:44:00.695 INFO:tasks.workunit.client.0.smithi003.stdout: "instance": "", 2023-12-03T11:44:00.695 INFO:tasks.workunit.client.0.smithi003.stdout: "ns": "" 2023-12-03T11:44:00.695 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.695 INFO:tasks.workunit.client.0.smithi003.stdout: }, 2023-12-03T11:44:00.695 INFO:tasks.workunit.client.0.smithi003.stdout: "obj3-2": { 2023-12-03T11:44:00.695 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket": { 2023-12-03T11:44:00.695 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "test", 2023-12-03T11:44:00.695 INFO:tasks.workunit.client.0.smithi003.stdout: "marker": "marker", 2023-12-03T11:44:00.695 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket_id": "bucket-id", 2023-12-03T11:44:00.695 INFO:tasks.workunit.client.0.smithi003.stdout: "tenant": "", 2023-12-03T11:44:00.696 INFO:tasks.workunit.client.0.smithi003.stdout: "explicit_placement": { 2023-12-03T11:44:00.696 INFO:tasks.workunit.client.0.smithi003.stdout: "data_pool": "", 2023-12-03T11:44:00.696 INFO:tasks.workunit.client.0.smithi003.stdout: "data_extra_pool": "", 2023-12-03T11:44:00.696 INFO:tasks.workunit.client.0.smithi003.stdout: "index_pool": "" 2023-12-03T11:44:00.696 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.696 INFO:tasks.workunit.client.0.smithi003.stdout: }, 2023-12-03T11:44:00.696 INFO:tasks.workunit.client.0.smithi003.stdout: "key": { 2023-12-03T11:44:00.696 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "obj", 2023-12-03T11:44:00.696 INFO:tasks.workunit.client.0.smithi003.stdout: "instance": "", 2023-12-03T11:44:00.696 INFO:tasks.workunit.client.0.smithi003.stdout: "ns": "ns" 2023-12-03T11:44:00.696 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.696 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.696 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.696 INFO:tasks.workunit.client.0.smithi003.stdout:parsed: obj[v1] 2023-12-03T11:44:00.696 INFO:tasks.workunit.client.0.smithi003.stdout:parsed: obj[v1] 2023-12-03T11:44:00.697 INFO:tasks.workunit.client.0.smithi003.stdout:stripped: obj ns= i=v1 2023-12-03T11:44:00.697 INFO:tasks.workunit.client.0.smithi003.stdout:parsed: obj[v1] 2023-12-03T11:44:00.697 INFO:tasks.workunit.client.0.smithi003.stdout:parsed: obj[v1] 2023-12-03T11:44:00.697 INFO:tasks.workunit.client.0.smithi003.stdout:stripped: obj ns= i=v1 2023-12-03T11:44:00.697 INFO:tasks.workunit.client.0.smithi003.stdout:parsed: obj[v1] 2023-12-03T11:44:00.697 INFO:tasks.workunit.client.0.smithi003.stdout:parsed: obj[v1] 2023-12-03T11:44:00.697 INFO:tasks.workunit.client.0.smithi003.stdout:stripped: obj ns= i=v1 2023-12-03T11:44:00.697 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.697 INFO:tasks.workunit.client.0.smithi003.stdout: "obj1": { 2023-12-03T11:44:00.697 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket": { 2023-12-03T11:44:00.697 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "test", 2023-12-03T11:44:00.697 INFO:tasks.workunit.client.0.smithi003.stdout: "marker": "marker", 2023-12-03T11:44:00.697 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket_id": "bucket-id", 2023-12-03T11:44:00.697 INFO:tasks.workunit.client.0.smithi003.stdout: "tenant": "", 2023-12-03T11:44:00.697 INFO:tasks.workunit.client.0.smithi003.stdout: "explicit_placement": { 2023-12-03T11:44:00.698 INFO:tasks.workunit.client.0.smithi003.stdout: "data_pool": "", 2023-12-03T11:44:00.698 INFO:tasks.workunit.client.0.smithi003.stdout: "data_extra_pool": "", 2023-12-03T11:44:00.698 INFO:tasks.workunit.client.0.smithi003.stdout: "index_pool": "" 2023-12-03T11:44:00.698 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.698 INFO:tasks.workunit.client.0.smithi003.stdout: }, 2023-12-03T11:44:00.698 INFO:tasks.workunit.client.0.smithi003.stdout: "key": { 2023-12-03T11:44:00.698 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "obj", 2023-12-03T11:44:00.698 INFO:tasks.workunit.client.0.smithi003.stdout: "instance": "v1", 2023-12-03T11:44:00.698 INFO:tasks.workunit.client.0.smithi003.stdout: "ns": "" 2023-12-03T11:44:00.698 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.698 INFO:tasks.workunit.client.0.smithi003.stdout: }, 2023-12-03T11:44:00.698 INFO:tasks.workunit.client.0.smithi003.stdout: "obj2": { 2023-12-03T11:44:00.698 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket": { 2023-12-03T11:44:00.698 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "test", 2023-12-03T11:44:00.699 INFO:tasks.workunit.client.0.smithi003.stdout: "marker": "marker", 2023-12-03T11:44:00.699 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket_id": "bucket-id", 2023-12-03T11:44:00.699 INFO:tasks.workunit.client.0.smithi003.stdout: "tenant": "", 2023-12-03T11:44:00.699 INFO:tasks.workunit.client.0.smithi003.stdout: "explicit_placement": { 2023-12-03T11:44:00.699 INFO:tasks.workunit.client.0.smithi003.stdout: "data_pool": "", 2023-12-03T11:44:00.699 INFO:tasks.workunit.client.0.smithi003.stdout: "data_extra_pool": "", 2023-12-03T11:44:00.699 INFO:tasks.workunit.client.0.smithi003.stdout: "index_pool": "" 2023-12-03T11:44:00.699 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.699 INFO:tasks.workunit.client.0.smithi003.stdout: }, 2023-12-03T11:44:00.699 INFO:tasks.workunit.client.0.smithi003.stdout: "key": { 2023-12-03T11:44:00.699 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "obj", 2023-12-03T11:44:00.699 INFO:tasks.workunit.client.0.smithi003.stdout: "instance": "v1", 2023-12-03T11:44:00.699 INFO:tasks.workunit.client.0.smithi003.stdout: "ns": "" 2023-12-03T11:44:00.699 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.699 INFO:tasks.workunit.client.0.smithi003.stdout: }, 2023-12-03T11:44:00.700 INFO:tasks.workunit.client.0.smithi003.stdout: "obj3": { 2023-12-03T11:44:00.700 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket": { 2023-12-03T11:44:00.700 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "test", 2023-12-03T11:44:00.700 INFO:tasks.workunit.client.0.smithi003.stdout: "marker": "marker", 2023-12-03T11:44:00.700 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket_id": "bucket-id", 2023-12-03T11:44:00.700 INFO:tasks.workunit.client.0.smithi003.stdout: "tenant": "", 2023-12-03T11:44:00.700 INFO:tasks.workunit.client.0.smithi003.stdout: "explicit_placement": { 2023-12-03T11:44:00.700 INFO:tasks.workunit.client.0.smithi003.stdout: "data_pool": "", 2023-12-03T11:44:00.700 INFO:tasks.workunit.client.0.smithi003.stdout: "data_extra_pool": "", 2023-12-03T11:44:00.700 INFO:tasks.workunit.client.0.smithi003.stdout: "index_pool": "" 2023-12-03T11:44:00.700 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.700 INFO:tasks.workunit.client.0.smithi003.stdout: }, 2023-12-03T11:44:00.700 INFO:tasks.workunit.client.0.smithi003.stdout: "key": { 2023-12-03T11:44:00.700 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "obj", 2023-12-03T11:44:00.700 INFO:tasks.workunit.client.0.smithi003.stdout: "instance": "", 2023-12-03T11:44:00.701 INFO:tasks.workunit.client.0.smithi003.stdout: "ns": "" 2023-12-03T11:44:00.701 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.701 INFO:tasks.workunit.client.0.smithi003.stdout: }, 2023-12-03T11:44:00.701 INFO:tasks.workunit.client.0.smithi003.stdout: "obj3-2": { 2023-12-03T11:44:00.701 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket": { 2023-12-03T11:44:00.701 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "test", 2023-12-03T11:44:00.701 INFO:tasks.workunit.client.0.smithi003.stdout: "marker": "marker", 2023-12-03T11:44:00.701 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket_id": "bucket-id", 2023-12-03T11:44:00.701 INFO:tasks.workunit.client.0.smithi003.stdout: "tenant": "", 2023-12-03T11:44:00.701 INFO:tasks.workunit.client.0.smithi003.stdout: "explicit_placement": { 2023-12-03T11:44:00.701 INFO:tasks.workunit.client.0.smithi003.stdout: "data_pool": "", 2023-12-03T11:44:00.701 INFO:tasks.workunit.client.0.smithi003.stdout: "data_extra_pool": "", 2023-12-03T11:44:00.701 INFO:tasks.workunit.client.0.smithi003.stdout: "index_pool": "" 2023-12-03T11:44:00.701 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.701 INFO:tasks.workunit.client.0.smithi003.stdout: }, 2023-12-03T11:44:00.702 INFO:tasks.workunit.client.0.smithi003.stdout: "key": { 2023-12-03T11:44:00.702 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "obj", 2023-12-03T11:44:00.702 INFO:tasks.workunit.client.0.smithi003.stdout: "instance": "v1", 2023-12-03T11:44:00.702 INFO:tasks.workunit.client.0.smithi003.stdout: "ns": "" 2023-12-03T11:44:00.702 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.702 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.702 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.702 INFO:tasks.workunit.client.0.smithi003.stdout:parsed: obj[v1] 2023-12-03T11:44:00.702 INFO:tasks.workunit.client.0.smithi003.stdout:parsed: obj[v1] 2023-12-03T11:44:00.702 INFO:tasks.workunit.client.0.smithi003.stdout:stripped: obj ns=ns i=v1 2023-12-03T11:44:00.702 INFO:tasks.workunit.client.0.smithi003.stdout:parsed: obj[v1] 2023-12-03T11:44:00.702 INFO:tasks.workunit.client.0.smithi003.stdout:parsed: obj[v1] 2023-12-03T11:44:00.702 INFO:tasks.workunit.client.0.smithi003.stdout:stripped: obj ns=ns i=v1 2023-12-03T11:44:00.702 INFO:tasks.workunit.client.0.smithi003.stdout:parsed: obj[v1] 2023-12-03T11:44:00.702 INFO:tasks.workunit.client.0.smithi003.stdout:parsed: obj[v1] 2023-12-03T11:44:00.703 INFO:tasks.workunit.client.0.smithi003.stdout:stripped: obj ns=ns i=v1 2023-12-03T11:44:00.703 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.703 INFO:tasks.workunit.client.0.smithi003.stdout: "obj1": { 2023-12-03T11:44:00.703 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket": { 2023-12-03T11:44:00.703 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "test", 2023-12-03T11:44:00.703 INFO:tasks.workunit.client.0.smithi003.stdout: "marker": "marker", 2023-12-03T11:44:00.703 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket_id": "bucket-id", 2023-12-03T11:44:00.703 INFO:tasks.workunit.client.0.smithi003.stdout: "tenant": "", 2023-12-03T11:44:00.703 INFO:tasks.workunit.client.0.smithi003.stdout: "explicit_placement": { 2023-12-03T11:44:00.703 INFO:tasks.workunit.client.0.smithi003.stdout: "data_pool": "", 2023-12-03T11:44:00.703 INFO:tasks.workunit.client.0.smithi003.stdout: "data_extra_pool": "", 2023-12-03T11:44:00.703 INFO:tasks.workunit.client.0.smithi003.stdout: "index_pool": "" 2023-12-03T11:44:00.703 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.703 INFO:tasks.workunit.client.0.smithi003.stdout: }, 2023-12-03T11:44:00.703 INFO:tasks.workunit.client.0.smithi003.stdout: "key": { 2023-12-03T11:44:00.704 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "obj", 2023-12-03T11:44:00.704 INFO:tasks.workunit.client.0.smithi003.stdout: "instance": "v1", 2023-12-03T11:44:00.704 INFO:tasks.workunit.client.0.smithi003.stdout: "ns": "ns" 2023-12-03T11:44:00.704 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.704 INFO:tasks.workunit.client.0.smithi003.stdout: }, 2023-12-03T11:44:00.704 INFO:tasks.workunit.client.0.smithi003.stdout: "obj2": { 2023-12-03T11:44:00.704 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket": { 2023-12-03T11:44:00.704 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "test", 2023-12-03T11:44:00.704 INFO:tasks.workunit.client.0.smithi003.stdout: "marker": "marker", 2023-12-03T11:44:00.704 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket_id": "bucket-id", 2023-12-03T11:44:00.704 INFO:tasks.workunit.client.0.smithi003.stdout: "tenant": "", 2023-12-03T11:44:00.704 INFO:tasks.workunit.client.0.smithi003.stdout: "explicit_placement": { 2023-12-03T11:44:00.704 INFO:tasks.workunit.client.0.smithi003.stdout: "data_pool": "", 2023-12-03T11:44:00.704 INFO:tasks.workunit.client.0.smithi003.stdout: "data_extra_pool": "", 2023-12-03T11:44:00.705 INFO:tasks.workunit.client.0.smithi003.stdout: "index_pool": "" 2023-12-03T11:44:00.705 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.705 INFO:tasks.workunit.client.0.smithi003.stdout: }, 2023-12-03T11:44:00.705 INFO:tasks.workunit.client.0.smithi003.stdout: "key": { 2023-12-03T11:44:00.705 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "obj", 2023-12-03T11:44:00.705 INFO:tasks.workunit.client.0.smithi003.stdout: "instance": "v1", 2023-12-03T11:44:00.705 INFO:tasks.workunit.client.0.smithi003.stdout: "ns": "ns" 2023-12-03T11:44:00.705 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.705 INFO:tasks.workunit.client.0.smithi003.stdout: }, 2023-12-03T11:44:00.705 INFO:tasks.workunit.client.0.smithi003.stdout: "obj3": { 2023-12-03T11:44:00.705 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket": { 2023-12-03T11:44:00.705 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "test", 2023-12-03T11:44:00.705 INFO:tasks.workunit.client.0.smithi003.stdout: "marker": "marker", 2023-12-03T11:44:00.705 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket_id": "bucket-id", 2023-12-03T11:44:00.705 INFO:tasks.workunit.client.0.smithi003.stdout: "tenant": "", 2023-12-03T11:44:00.706 INFO:tasks.workunit.client.0.smithi003.stdout: "explicit_placement": { 2023-12-03T11:44:00.706 INFO:tasks.workunit.client.0.smithi003.stdout: "data_pool": "", 2023-12-03T11:44:00.706 INFO:tasks.workunit.client.0.smithi003.stdout: "data_extra_pool": "", 2023-12-03T11:44:00.706 INFO:tasks.workunit.client.0.smithi003.stdout: "index_pool": "" 2023-12-03T11:44:00.706 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.706 INFO:tasks.workunit.client.0.smithi003.stdout: }, 2023-12-03T11:44:00.706 INFO:tasks.workunit.client.0.smithi003.stdout: "key": { 2023-12-03T11:44:00.706 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "obj", 2023-12-03T11:44:00.706 INFO:tasks.workunit.client.0.smithi003.stdout: "instance": "", 2023-12-03T11:44:00.706 INFO:tasks.workunit.client.0.smithi003.stdout: "ns": "" 2023-12-03T11:44:00.706 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.706 INFO:tasks.workunit.client.0.smithi003.stdout: }, 2023-12-03T11:44:00.706 INFO:tasks.workunit.client.0.smithi003.stdout: "obj3-2": { 2023-12-03T11:44:00.706 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket": { 2023-12-03T11:44:00.706 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "test", 2023-12-03T11:44:00.707 INFO:tasks.workunit.client.0.smithi003.stdout: "marker": "marker", 2023-12-03T11:44:00.707 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket_id": "bucket-id", 2023-12-03T11:44:00.707 INFO:tasks.workunit.client.0.smithi003.stdout: "tenant": "", 2023-12-03T11:44:00.707 INFO:tasks.workunit.client.0.smithi003.stdout: "explicit_placement": { 2023-12-03T11:44:00.707 INFO:tasks.workunit.client.0.smithi003.stdout: "data_pool": "", 2023-12-03T11:44:00.707 INFO:tasks.workunit.client.0.smithi003.stdout: "data_extra_pool": "", 2023-12-03T11:44:00.707 INFO:tasks.workunit.client.0.smithi003.stdout: "index_pool": "" 2023-12-03T11:44:00.707 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.707 INFO:tasks.workunit.client.0.smithi003.stdout: }, 2023-12-03T11:44:00.707 INFO:tasks.workunit.client.0.smithi003.stdout: "key": { 2023-12-03T11:44:00.707 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "obj", 2023-12-03T11:44:00.707 INFO:tasks.workunit.client.0.smithi003.stdout: "instance": "v1", 2023-12-03T11:44:00.707 INFO:tasks.workunit.client.0.smithi003.stdout: "ns": "ns" 2023-12-03T11:44:00.707 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.707 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.708 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.708 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] TestRGWObj.no_underscore (0 ms) 2023-12-03T11:44:00.708 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] TestRGWObj.obj_to_raw 2023-12-03T11:44:00.708 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.708 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket": { 2023-12-03T11:44:00.708 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "test", 2023-12-03T11:44:00.708 INFO:tasks.workunit.client.0.smithi003.stdout: "marker": "marker", 2023-12-03T11:44:00.708 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket_id": "bucket-id", 2023-12-03T11:44:00.708 INFO:tasks.workunit.client.0.smithi003.stdout: "tenant": "", 2023-12-03T11:44:00.708 INFO:tasks.workunit.client.0.smithi003.stdout: "explicit_placement": { 2023-12-03T11:44:00.708 INFO:tasks.workunit.client.0.smithi003.stdout: "data_pool": "", 2023-12-03T11:44:00.708 INFO:tasks.workunit.client.0.smithi003.stdout: "data_extra_pool": "", 2023-12-03T11:44:00.708 INFO:tasks.workunit.client.0.smithi003.stdout: "index_pool": "" 2023-12-03T11:44:00.708 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.708 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.709 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.709 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.709 INFO:tasks.workunit.client.0.smithi003.stdout: "obj": { 2023-12-03T11:44:00.709 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket": { 2023-12-03T11:44:00.709 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "test", 2023-12-03T11:44:00.709 INFO:tasks.workunit.client.0.smithi003.stdout: "marker": "marker", 2023-12-03T11:44:00.709 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket_id": "bucket-id", 2023-12-03T11:44:00.709 INFO:tasks.workunit.client.0.smithi003.stdout: "tenant": "", 2023-12-03T11:44:00.709 INFO:tasks.workunit.client.0.smithi003.stdout: "explicit_placement": { 2023-12-03T11:44:00.709 INFO:tasks.workunit.client.0.smithi003.stdout: "data_pool": "", 2023-12-03T11:44:00.709 INFO:tasks.workunit.client.0.smithi003.stdout: "data_extra_pool": "", 2023-12-03T11:44:00.709 INFO:tasks.workunit.client.0.smithi003.stdout: "index_pool": "" 2023-12-03T11:44:00.710 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.710 INFO:tasks.workunit.client.0.smithi003.stdout: }, 2023-12-03T11:44:00.710 INFO:tasks.workunit.client.0.smithi003.stdout: "key": { 2023-12-03T11:44:00.710 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "myobj", 2023-12-03T11:44:00.710 INFO:tasks.workunit.client.0.smithi003.stdout: "instance": "", 2023-12-03T11:44:00.710 INFO:tasks.workunit.client.0.smithi003.stdout: "ns": "" 2023-12-03T11:44:00.710 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.710 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.710 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.710 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.711 INFO:tasks.workunit.client.0.smithi003.stdout: "raw_obj": { 2023-12-03T11:44:00.711 INFO:tasks.workunit.client.0.smithi003.stdout: "pool": "default-placement.data", 2023-12-03T11:44:00.711 INFO:tasks.workunit.client.0.smithi003.stdout: "oid": "marker_myobj", 2023-12-03T11:44:00.711 INFO:tasks.workunit.client.0.smithi003.stdout: "loc": "" 2023-12-03T11:44:00.711 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.711 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.711 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.711 INFO:tasks.workunit.client.0.smithi003.stdout: "new_obj": { 2023-12-03T11:44:00.711 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket": { 2023-12-03T11:44:00.711 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "test", 2023-12-03T11:44:00.711 INFO:tasks.workunit.client.0.smithi003.stdout: "marker": "marker", 2023-12-03T11:44:00.711 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket_id": "bucket-id", 2023-12-03T11:44:00.711 INFO:tasks.workunit.client.0.smithi003.stdout: "tenant": "", 2023-12-03T11:44:00.711 INFO:tasks.workunit.client.0.smithi003.stdout: "explicit_placement": { 2023-12-03T11:44:00.711 INFO:tasks.workunit.client.0.smithi003.stdout: "data_pool": "", 2023-12-03T11:44:00.712 INFO:tasks.workunit.client.0.smithi003.stdout: "data_extra_pool": "", 2023-12-03T11:44:00.712 INFO:tasks.workunit.client.0.smithi003.stdout: "index_pool": "" 2023-12-03T11:44:00.712 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.712 INFO:tasks.workunit.client.0.smithi003.stdout: }, 2023-12-03T11:44:00.712 INFO:tasks.workunit.client.0.smithi003.stdout: "key": { 2023-12-03T11:44:00.712 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "myobj", 2023-12-03T11:44:00.712 INFO:tasks.workunit.client.0.smithi003.stdout: "instance": "", 2023-12-03T11:44:00.712 INFO:tasks.workunit.client.0.smithi003.stdout: "ns": "" 2023-12-03T11:44:00.712 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.712 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.712 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.712 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.712 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket": { 2023-12-03T11:44:00.712 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "ebtest", 2023-12-03T11:44:00.712 INFO:tasks.workunit.client.0.smithi003.stdout: "marker": "marker", 2023-12-03T11:44:00.713 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket_id": "bucket-id", 2023-12-03T11:44:00.713 INFO:tasks.workunit.client.0.smithi003.stdout: "tenant": "", 2023-12-03T11:44:00.713 INFO:tasks.workunit.client.0.smithi003.stdout: "explicit_placement": { 2023-12-03T11:44:00.713 INFO:tasks.workunit.client.0.smithi003.stdout: "data_pool": ".data-pool", 2023-12-03T11:44:00.713 INFO:tasks.workunit.client.0.smithi003.stdout: "data_extra_pool": "", 2023-12-03T11:44:00.713 INFO:tasks.workunit.client.0.smithi003.stdout: "index_pool": ".index-pool" 2023-12-03T11:44:00.713 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.713 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.713 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.713 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.713 INFO:tasks.workunit.client.0.smithi003.stdout: "obj": { 2023-12-03T11:44:00.713 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket": { 2023-12-03T11:44:00.713 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "ebtest", 2023-12-03T11:44:00.713 INFO:tasks.workunit.client.0.smithi003.stdout: "marker": "marker", 2023-12-03T11:44:00.714 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket_id": "bucket-id", 2023-12-03T11:44:00.714 INFO:tasks.workunit.client.0.smithi003.stdout: "tenant": "", 2023-12-03T11:44:00.714 INFO:tasks.workunit.client.0.smithi003.stdout: "explicit_placement": { 2023-12-03T11:44:00.714 INFO:tasks.workunit.client.0.smithi003.stdout: "data_pool": ".data-pool", 2023-12-03T11:44:00.714 INFO:tasks.workunit.client.0.smithi003.stdout: "data_extra_pool": "", 2023-12-03T11:44:00.714 INFO:tasks.workunit.client.0.smithi003.stdout: "index_pool": ".index-pool" 2023-12-03T11:44:00.714 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.714 INFO:tasks.workunit.client.0.smithi003.stdout: }, 2023-12-03T11:44:00.714 INFO:tasks.workunit.client.0.smithi003.stdout: "key": { 2023-12-03T11:44:00.714 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "myobj", 2023-12-03T11:44:00.714 INFO:tasks.workunit.client.0.smithi003.stdout: "instance": "", 2023-12-03T11:44:00.714 INFO:tasks.workunit.client.0.smithi003.stdout: "ns": "" 2023-12-03T11:44:00.714 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.714 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.714 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.715 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.715 INFO:tasks.workunit.client.0.smithi003.stdout: "raw_obj": { 2023-12-03T11:44:00.715 INFO:tasks.workunit.client.0.smithi003.stdout: "pool": ".data-pool", 2023-12-03T11:44:00.715 INFO:tasks.workunit.client.0.smithi003.stdout: "oid": "marker_myobj", 2023-12-03T11:44:00.715 INFO:tasks.workunit.client.0.smithi003.stdout: "loc": "" 2023-12-03T11:44:00.715 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.715 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.715 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.715 INFO:tasks.workunit.client.0.smithi003.stdout: "new_obj": { 2023-12-03T11:44:00.715 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket": { 2023-12-03T11:44:00.715 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "ebtest", 2023-12-03T11:44:00.715 INFO:tasks.workunit.client.0.smithi003.stdout: "marker": "marker", 2023-12-03T11:44:00.715 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket_id": "bucket-id", 2023-12-03T11:44:00.715 INFO:tasks.workunit.client.0.smithi003.stdout: "tenant": "", 2023-12-03T11:44:00.715 INFO:tasks.workunit.client.0.smithi003.stdout: "explicit_placement": { 2023-12-03T11:44:00.716 INFO:tasks.workunit.client.0.smithi003.stdout: "data_pool": ".data-pool", 2023-12-03T11:44:00.716 INFO:tasks.workunit.client.0.smithi003.stdout: "data_extra_pool": "", 2023-12-03T11:44:00.716 INFO:tasks.workunit.client.0.smithi003.stdout: "index_pool": ".index-pool" 2023-12-03T11:44:00.716 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.716 INFO:tasks.workunit.client.0.smithi003.stdout: }, 2023-12-03T11:44:00.716 INFO:tasks.workunit.client.0.smithi003.stdout: "key": { 2023-12-03T11:44:00.716 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "myobj", 2023-12-03T11:44:00.716 INFO:tasks.workunit.client.0.smithi003.stdout: "instance": "", 2023-12-03T11:44:00.716 INFO:tasks.workunit.client.0.smithi003.stdout: "ns": "" 2023-12-03T11:44:00.716 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.716 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.716 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.716 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.716 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket": { 2023-12-03T11:44:00.716 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "test", 2023-12-03T11:44:00.717 INFO:tasks.workunit.client.0.smithi003.stdout: "marker": "marker", 2023-12-03T11:44:00.717 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket_id": "bucket-id", 2023-12-03T11:44:00.717 INFO:tasks.workunit.client.0.smithi003.stdout: "tenant": "", 2023-12-03T11:44:00.717 INFO:tasks.workunit.client.0.smithi003.stdout: "explicit_placement": { 2023-12-03T11:44:00.717 INFO:tasks.workunit.client.0.smithi003.stdout: "data_pool": "", 2023-12-03T11:44:00.717 INFO:tasks.workunit.client.0.smithi003.stdout: "data_extra_pool": "", 2023-12-03T11:44:00.717 INFO:tasks.workunit.client.0.smithi003.stdout: "index_pool": "" 2023-12-03T11:44:00.717 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.717 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.717 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.717 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.717 INFO:tasks.workunit.client.0.smithi003.stdout: "obj": { 2023-12-03T11:44:00.717 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket": { 2023-12-03T11:44:00.717 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "test", 2023-12-03T11:44:00.718 INFO:tasks.workunit.client.0.smithi003.stdout: "marker": "marker", 2023-12-03T11:44:00.718 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket_id": "bucket-id", 2023-12-03T11:44:00.718 INFO:tasks.workunit.client.0.smithi003.stdout: "tenant": "", 2023-12-03T11:44:00.718 INFO:tasks.workunit.client.0.smithi003.stdout: "explicit_placement": { 2023-12-03T11:44:00.718 INFO:tasks.workunit.client.0.smithi003.stdout: "data_pool": "", 2023-12-03T11:44:00.718 INFO:tasks.workunit.client.0.smithi003.stdout: "data_extra_pool": "", 2023-12-03T11:44:00.718 INFO:tasks.workunit.client.0.smithi003.stdout: "index_pool": "" 2023-12-03T11:44:00.718 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.718 INFO:tasks.workunit.client.0.smithi003.stdout: }, 2023-12-03T11:44:00.718 INFO:tasks.workunit.client.0.smithi003.stdout: "key": { 2023-12-03T11:44:00.718 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "myobj", 2023-12-03T11:44:00.718 INFO:tasks.workunit.client.0.smithi003.stdout: "instance": "", 2023-12-03T11:44:00.718 INFO:tasks.workunit.client.0.smithi003.stdout: "ns": "ns" 2023-12-03T11:44:00.718 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.718 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.719 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.719 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.719 INFO:tasks.workunit.client.0.smithi003.stdout: "raw_obj": { 2023-12-03T11:44:00.719 INFO:tasks.workunit.client.0.smithi003.stdout: "pool": "default-placement.data", 2023-12-03T11:44:00.719 INFO:tasks.workunit.client.0.smithi003.stdout: "oid": "marker__ns_myobj", 2023-12-03T11:44:00.719 INFO:tasks.workunit.client.0.smithi003.stdout: "loc": "" 2023-12-03T11:44:00.719 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.719 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.719 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.719 INFO:tasks.workunit.client.0.smithi003.stdout: "new_obj": { 2023-12-03T11:44:00.719 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket": { 2023-12-03T11:44:00.719 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "test", 2023-12-03T11:44:00.719 INFO:tasks.workunit.client.0.smithi003.stdout: "marker": "marker", 2023-12-03T11:44:00.719 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket_id": "bucket-id", 2023-12-03T11:44:00.719 INFO:tasks.workunit.client.0.smithi003.stdout: "tenant": "", 2023-12-03T11:44:00.720 INFO:tasks.workunit.client.0.smithi003.stdout: "explicit_placement": { 2023-12-03T11:44:00.720 INFO:tasks.workunit.client.0.smithi003.stdout: "data_pool": "", 2023-12-03T11:44:00.720 INFO:tasks.workunit.client.0.smithi003.stdout: "data_extra_pool": "", 2023-12-03T11:44:00.720 INFO:tasks.workunit.client.0.smithi003.stdout: "index_pool": "" 2023-12-03T11:44:00.720 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.720 INFO:tasks.workunit.client.0.smithi003.stdout: }, 2023-12-03T11:44:00.720 INFO:tasks.workunit.client.0.smithi003.stdout: "key": { 2023-12-03T11:44:00.720 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "myobj", 2023-12-03T11:44:00.720 INFO:tasks.workunit.client.0.smithi003.stdout: "instance": "", 2023-12-03T11:44:00.720 INFO:tasks.workunit.client.0.smithi003.stdout: "ns": "ns" 2023-12-03T11:44:00.720 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.720 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.720 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.720 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.720 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket": { 2023-12-03T11:44:00.721 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "ebtest", 2023-12-03T11:44:00.721 INFO:tasks.workunit.client.0.smithi003.stdout: "marker": "marker", 2023-12-03T11:44:00.721 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket_id": "bucket-id", 2023-12-03T11:44:00.721 INFO:tasks.workunit.client.0.smithi003.stdout: "tenant": "", 2023-12-03T11:44:00.721 INFO:tasks.workunit.client.0.smithi003.stdout: "explicit_placement": { 2023-12-03T11:44:00.721 INFO:tasks.workunit.client.0.smithi003.stdout: "data_pool": ".data-pool", 2023-12-03T11:44:00.721 INFO:tasks.workunit.client.0.smithi003.stdout: "data_extra_pool": "", 2023-12-03T11:44:00.721 INFO:tasks.workunit.client.0.smithi003.stdout: "index_pool": ".index-pool" 2023-12-03T11:44:00.721 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.721 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.721 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.721 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.721 INFO:tasks.workunit.client.0.smithi003.stdout: "obj": { 2023-12-03T11:44:00.721 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket": { 2023-12-03T11:44:00.721 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "ebtest", 2023-12-03T11:44:00.722 INFO:tasks.workunit.client.0.smithi003.stdout: "marker": "marker", 2023-12-03T11:44:00.722 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket_id": "bucket-id", 2023-12-03T11:44:00.722 INFO:tasks.workunit.client.0.smithi003.stdout: "tenant": "", 2023-12-03T11:44:00.722 INFO:tasks.workunit.client.0.smithi003.stdout: "explicit_placement": { 2023-12-03T11:44:00.722 INFO:tasks.workunit.client.0.smithi003.stdout: "data_pool": ".data-pool", 2023-12-03T11:44:00.722 INFO:tasks.workunit.client.0.smithi003.stdout: "data_extra_pool": "", 2023-12-03T11:44:00.722 INFO:tasks.workunit.client.0.smithi003.stdout: "index_pool": ".index-pool" 2023-12-03T11:44:00.722 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.722 INFO:tasks.workunit.client.0.smithi003.stdout: }, 2023-12-03T11:44:00.722 INFO:tasks.workunit.client.0.smithi003.stdout: "key": { 2023-12-03T11:44:00.722 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "myobj", 2023-12-03T11:44:00.722 INFO:tasks.workunit.client.0.smithi003.stdout: "instance": "", 2023-12-03T11:44:00.722 INFO:tasks.workunit.client.0.smithi003.stdout: "ns": "ns" 2023-12-03T11:44:00.722 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.723 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.723 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.723 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.723 INFO:tasks.workunit.client.0.smithi003.stdout: "raw_obj": { 2023-12-03T11:44:00.723 INFO:tasks.workunit.client.0.smithi003.stdout: "pool": ".data-pool", 2023-12-03T11:44:00.723 INFO:tasks.workunit.client.0.smithi003.stdout: "oid": "marker__ns_myobj", 2023-12-03T11:44:00.723 INFO:tasks.workunit.client.0.smithi003.stdout: "loc": "" 2023-12-03T11:44:00.723 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.723 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.723 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.723 INFO:tasks.workunit.client.0.smithi003.stdout: "new_obj": { 2023-12-03T11:44:00.723 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket": { 2023-12-03T11:44:00.723 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "ebtest", 2023-12-03T11:44:00.723 INFO:tasks.workunit.client.0.smithi003.stdout: "marker": "marker", 2023-12-03T11:44:00.723 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket_id": "bucket-id", 2023-12-03T11:44:00.724 INFO:tasks.workunit.client.0.smithi003.stdout: "tenant": "", 2023-12-03T11:44:00.724 INFO:tasks.workunit.client.0.smithi003.stdout: "explicit_placement": { 2023-12-03T11:44:00.724 INFO:tasks.workunit.client.0.smithi003.stdout: "data_pool": ".data-pool", 2023-12-03T11:44:00.724 INFO:tasks.workunit.client.0.smithi003.stdout: "data_extra_pool": "", 2023-12-03T11:44:00.724 INFO:tasks.workunit.client.0.smithi003.stdout: "index_pool": ".index-pool" 2023-12-03T11:44:00.724 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.724 INFO:tasks.workunit.client.0.smithi003.stdout: }, 2023-12-03T11:44:00.724 INFO:tasks.workunit.client.0.smithi003.stdout: "key": { 2023-12-03T11:44:00.724 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "myobj", 2023-12-03T11:44:00.724 INFO:tasks.workunit.client.0.smithi003.stdout: "instance": "", 2023-12-03T11:44:00.724 INFO:tasks.workunit.client.0.smithi003.stdout: "ns": "ns" 2023-12-03T11:44:00.724 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.724 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.724 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.724 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.725 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket": { 2023-12-03T11:44:00.725 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "test", 2023-12-03T11:44:00.725 INFO:tasks.workunit.client.0.smithi003.stdout: "marker": "marker", 2023-12-03T11:44:00.725 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket_id": "bucket-id", 2023-12-03T11:44:00.725 INFO:tasks.workunit.client.0.smithi003.stdout: "tenant": "", 2023-12-03T11:44:00.725 INFO:tasks.workunit.client.0.smithi003.stdout: "explicit_placement": { 2023-12-03T11:44:00.725 INFO:tasks.workunit.client.0.smithi003.stdout: "data_pool": "", 2023-12-03T11:44:00.725 INFO:tasks.workunit.client.0.smithi003.stdout: "data_extra_pool": "", 2023-12-03T11:44:00.725 INFO:tasks.workunit.client.0.smithi003.stdout: "index_pool": "" 2023-12-03T11:44:00.725 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.725 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.725 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.725 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.725 INFO:tasks.workunit.client.0.smithi003.stdout: "obj": { 2023-12-03T11:44:00.726 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket": { 2023-12-03T11:44:00.726 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "test", 2023-12-03T11:44:00.726 INFO:tasks.workunit.client.0.smithi003.stdout: "marker": "marker", 2023-12-03T11:44:00.726 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket_id": "bucket-id", 2023-12-03T11:44:00.726 INFO:tasks.workunit.client.0.smithi003.stdout: "tenant": "", 2023-12-03T11:44:00.726 INFO:tasks.workunit.client.0.smithi003.stdout: "explicit_placement": { 2023-12-03T11:44:00.726 INFO:tasks.workunit.client.0.smithi003.stdout: "data_pool": "", 2023-12-03T11:44:00.726 INFO:tasks.workunit.client.0.smithi003.stdout: "data_extra_pool": "", 2023-12-03T11:44:00.726 INFO:tasks.workunit.client.0.smithi003.stdout: "index_pool": "" 2023-12-03T11:44:00.726 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.726 INFO:tasks.workunit.client.0.smithi003.stdout: }, 2023-12-03T11:44:00.726 INFO:tasks.workunit.client.0.smithi003.stdout: "key": { 2023-12-03T11:44:00.726 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "myobj", 2023-12-03T11:44:00.726 INFO:tasks.workunit.client.0.smithi003.stdout: "instance": "inst", 2023-12-03T11:44:00.726 INFO:tasks.workunit.client.0.smithi003.stdout: "ns": "" 2023-12-03T11:44:00.727 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.727 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.727 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.727 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.727 INFO:tasks.workunit.client.0.smithi003.stdout: "raw_obj": { 2023-12-03T11:44:00.727 INFO:tasks.workunit.client.0.smithi003.stdout: "pool": "default-placement.data", 2023-12-03T11:44:00.727 INFO:tasks.workunit.client.0.smithi003.stdout: "oid": "marker__:inst_myobj", 2023-12-03T11:44:00.727 INFO:tasks.workunit.client.0.smithi003.stdout: "loc": "" 2023-12-03T11:44:00.727 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.727 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.727 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.727 INFO:tasks.workunit.client.0.smithi003.stdout: "new_obj": { 2023-12-03T11:44:00.727 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket": { 2023-12-03T11:44:00.727 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "test", 2023-12-03T11:44:00.727 INFO:tasks.workunit.client.0.smithi003.stdout: "marker": "marker", 2023-12-03T11:44:00.728 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket_id": "bucket-id", 2023-12-03T11:44:00.728 INFO:tasks.workunit.client.0.smithi003.stdout: "tenant": "", 2023-12-03T11:44:00.728 INFO:tasks.workunit.client.0.smithi003.stdout: "explicit_placement": { 2023-12-03T11:44:00.728 INFO:tasks.workunit.client.0.smithi003.stdout: "data_pool": "", 2023-12-03T11:44:00.728 INFO:tasks.workunit.client.0.smithi003.stdout: "data_extra_pool": "", 2023-12-03T11:44:00.728 INFO:tasks.workunit.client.0.smithi003.stdout: "index_pool": "" 2023-12-03T11:44:00.728 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.728 INFO:tasks.workunit.client.0.smithi003.stdout: }, 2023-12-03T11:44:00.728 INFO:tasks.workunit.client.0.smithi003.stdout: "key": { 2023-12-03T11:44:00.728 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "myobj", 2023-12-03T11:44:00.728 INFO:tasks.workunit.client.0.smithi003.stdout: "instance": "inst", 2023-12-03T11:44:00.728 INFO:tasks.workunit.client.0.smithi003.stdout: "ns": "" 2023-12-03T11:44:00.728 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.728 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.728 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.729 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.729 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket": { 2023-12-03T11:44:00.729 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "ebtest", 2023-12-03T11:44:00.729 INFO:tasks.workunit.client.0.smithi003.stdout: "marker": "marker", 2023-12-03T11:44:00.729 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket_id": "bucket-id", 2023-12-03T11:44:00.729 INFO:tasks.workunit.client.0.smithi003.stdout: "tenant": "", 2023-12-03T11:44:00.729 INFO:tasks.workunit.client.0.smithi003.stdout: "explicit_placement": { 2023-12-03T11:44:00.729 INFO:tasks.workunit.client.0.smithi003.stdout: "data_pool": ".data-pool", 2023-12-03T11:44:00.729 INFO:tasks.workunit.client.0.smithi003.stdout: "data_extra_pool": "", 2023-12-03T11:44:00.729 INFO:tasks.workunit.client.0.smithi003.stdout: "index_pool": ".index-pool" 2023-12-03T11:44:00.729 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.729 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.729 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.729 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.729 INFO:tasks.workunit.client.0.smithi003.stdout: "obj": { 2023-12-03T11:44:00.730 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket": { 2023-12-03T11:44:00.730 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "ebtest", 2023-12-03T11:44:00.730 INFO:tasks.workunit.client.0.smithi003.stdout: "marker": "marker", 2023-12-03T11:44:00.730 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket_id": "bucket-id", 2023-12-03T11:44:00.730 INFO:tasks.workunit.client.0.smithi003.stdout: "tenant": "", 2023-12-03T11:44:00.730 INFO:tasks.workunit.client.0.smithi003.stdout: "explicit_placement": { 2023-12-03T11:44:00.730 INFO:tasks.workunit.client.0.smithi003.stdout: "data_pool": ".data-pool", 2023-12-03T11:44:00.730 INFO:tasks.workunit.client.0.smithi003.stdout: "data_extra_pool": "", 2023-12-03T11:44:00.730 INFO:tasks.workunit.client.0.smithi003.stdout: "index_pool": ".index-pool" 2023-12-03T11:44:00.730 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.730 INFO:tasks.workunit.client.0.smithi003.stdout: }, 2023-12-03T11:44:00.730 INFO:tasks.workunit.client.0.smithi003.stdout: "key": { 2023-12-03T11:44:00.730 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "myobj", 2023-12-03T11:44:00.730 INFO:tasks.workunit.client.0.smithi003.stdout: "instance": "inst", 2023-12-03T11:44:00.730 INFO:tasks.workunit.client.0.smithi003.stdout: "ns": "" 2023-12-03T11:44:00.731 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.731 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.731 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.731 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.731 INFO:tasks.workunit.client.0.smithi003.stdout: "raw_obj": { 2023-12-03T11:44:00.731 INFO:tasks.workunit.client.0.smithi003.stdout: "pool": ".data-pool", 2023-12-03T11:44:00.731 INFO:tasks.workunit.client.0.smithi003.stdout: "oid": "marker__:inst_myobj", 2023-12-03T11:44:00.731 INFO:tasks.workunit.client.0.smithi003.stdout: "loc": "" 2023-12-03T11:44:00.731 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.731 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.731 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.731 INFO:tasks.workunit.client.0.smithi003.stdout: "new_obj": { 2023-12-03T11:44:00.731 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket": { 2023-12-03T11:44:00.731 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "ebtest", 2023-12-03T11:44:00.731 INFO:tasks.workunit.client.0.smithi003.stdout: "marker": "marker", 2023-12-03T11:44:00.732 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket_id": "bucket-id", 2023-12-03T11:44:00.732 INFO:tasks.workunit.client.0.smithi003.stdout: "tenant": "", 2023-12-03T11:44:00.732 INFO:tasks.workunit.client.0.smithi003.stdout: "explicit_placement": { 2023-12-03T11:44:00.732 INFO:tasks.workunit.client.0.smithi003.stdout: "data_pool": ".data-pool", 2023-12-03T11:44:00.732 INFO:tasks.workunit.client.0.smithi003.stdout: "data_extra_pool": "", 2023-12-03T11:44:00.732 INFO:tasks.workunit.client.0.smithi003.stdout: "index_pool": ".index-pool" 2023-12-03T11:44:00.732 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.732 INFO:tasks.workunit.client.0.smithi003.stdout: }, 2023-12-03T11:44:00.732 INFO:tasks.workunit.client.0.smithi003.stdout: "key": { 2023-12-03T11:44:00.732 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "myobj", 2023-12-03T11:44:00.732 INFO:tasks.workunit.client.0.smithi003.stdout: "instance": "inst", 2023-12-03T11:44:00.732 INFO:tasks.workunit.client.0.smithi003.stdout: "ns": "" 2023-12-03T11:44:00.732 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.732 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.733 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.733 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.733 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket": { 2023-12-03T11:44:00.733 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "test", 2023-12-03T11:44:00.733 INFO:tasks.workunit.client.0.smithi003.stdout: "marker": "marker", 2023-12-03T11:44:00.733 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket_id": "bucket-id", 2023-12-03T11:44:00.733 INFO:tasks.workunit.client.0.smithi003.stdout: "tenant": "", 2023-12-03T11:44:00.733 INFO:tasks.workunit.client.0.smithi003.stdout: "explicit_placement": { 2023-12-03T11:44:00.733 INFO:tasks.workunit.client.0.smithi003.stdout: "data_pool": "", 2023-12-03T11:44:00.733 INFO:tasks.workunit.client.0.smithi003.stdout: "data_extra_pool": "", 2023-12-03T11:44:00.733 INFO:tasks.workunit.client.0.smithi003.stdout: "index_pool": "" 2023-12-03T11:44:00.734 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.734 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.734 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.734 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.734 INFO:tasks.workunit.client.0.smithi003.stdout: "obj": { 2023-12-03T11:44:00.734 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket": { 2023-12-03T11:44:00.734 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "test", 2023-12-03T11:44:00.734 INFO:tasks.workunit.client.0.smithi003.stdout: "marker": "marker", 2023-12-03T11:44:00.734 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket_id": "bucket-id", 2023-12-03T11:44:00.734 INFO:tasks.workunit.client.0.smithi003.stdout: "tenant": "", 2023-12-03T11:44:00.734 INFO:tasks.workunit.client.0.smithi003.stdout: "explicit_placement": { 2023-12-03T11:44:00.734 INFO:tasks.workunit.client.0.smithi003.stdout: "data_pool": "", 2023-12-03T11:44:00.734 INFO:tasks.workunit.client.0.smithi003.stdout: "data_extra_pool": "", 2023-12-03T11:44:00.734 INFO:tasks.workunit.client.0.smithi003.stdout: "index_pool": "" 2023-12-03T11:44:00.735 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.735 INFO:tasks.workunit.client.0.smithi003.stdout: }, 2023-12-03T11:44:00.735 INFO:tasks.workunit.client.0.smithi003.stdout: "key": { 2023-12-03T11:44:00.735 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "myobj", 2023-12-03T11:44:00.735 INFO:tasks.workunit.client.0.smithi003.stdout: "instance": "inst", 2023-12-03T11:44:00.735 INFO:tasks.workunit.client.0.smithi003.stdout: "ns": "ns" 2023-12-03T11:44:00.735 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.735 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.735 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.735 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.735 INFO:tasks.workunit.client.0.smithi003.stdout: "raw_obj": { 2023-12-03T11:44:00.735 INFO:tasks.workunit.client.0.smithi003.stdout: "pool": "default-placement.data", 2023-12-03T11:44:00.735 INFO:tasks.workunit.client.0.smithi003.stdout: "oid": "marker__ns:inst_myobj", 2023-12-03T11:44:00.735 INFO:tasks.workunit.client.0.smithi003.stdout: "loc": "" 2023-12-03T11:44:00.735 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.736 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.736 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.736 INFO:tasks.workunit.client.0.smithi003.stdout: "new_obj": { 2023-12-03T11:44:00.736 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket": { 2023-12-03T11:44:00.736 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "test", 2023-12-03T11:44:00.736 INFO:tasks.workunit.client.0.smithi003.stdout: "marker": "marker", 2023-12-03T11:44:00.736 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket_id": "bucket-id", 2023-12-03T11:44:00.736 INFO:tasks.workunit.client.0.smithi003.stdout: "tenant": "", 2023-12-03T11:44:00.736 INFO:tasks.workunit.client.0.smithi003.stdout: "explicit_placement": { 2023-12-03T11:44:00.736 INFO:tasks.workunit.client.0.smithi003.stdout: "data_pool": "", 2023-12-03T11:44:00.736 INFO:tasks.workunit.client.0.smithi003.stdout: "data_extra_pool": "", 2023-12-03T11:44:00.736 INFO:tasks.workunit.client.0.smithi003.stdout: "index_pool": "" 2023-12-03T11:44:00.736 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.736 INFO:tasks.workunit.client.0.smithi003.stdout: }, 2023-12-03T11:44:00.737 INFO:tasks.workunit.client.0.smithi003.stdout: "key": { 2023-12-03T11:44:00.737 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "myobj", 2023-12-03T11:44:00.737 INFO:tasks.workunit.client.0.smithi003.stdout: "instance": "inst", 2023-12-03T11:44:00.737 INFO:tasks.workunit.client.0.smithi003.stdout: "ns": "ns" 2023-12-03T11:44:00.737 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.737 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.737 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.737 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.737 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket": { 2023-12-03T11:44:00.737 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "ebtest", 2023-12-03T11:44:00.737 INFO:tasks.workunit.client.0.smithi003.stdout: "marker": "marker", 2023-12-03T11:44:00.737 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket_id": "bucket-id", 2023-12-03T11:44:00.737 INFO:tasks.workunit.client.0.smithi003.stdout: "tenant": "", 2023-12-03T11:44:00.737 INFO:tasks.workunit.client.0.smithi003.stdout: "explicit_placement": { 2023-12-03T11:44:00.738 INFO:tasks.workunit.client.0.smithi003.stdout: "data_pool": ".data-pool", 2023-12-03T11:44:00.738 INFO:tasks.workunit.client.0.smithi003.stdout: "data_extra_pool": "", 2023-12-03T11:44:00.738 INFO:tasks.workunit.client.0.smithi003.stdout: "index_pool": ".index-pool" 2023-12-03T11:44:00.738 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.738 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.738 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.738 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.738 INFO:tasks.workunit.client.0.smithi003.stdout: "obj": { 2023-12-03T11:44:00.738 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket": { 2023-12-03T11:44:00.738 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "ebtest", 2023-12-03T11:44:00.738 INFO:tasks.workunit.client.0.smithi003.stdout: "marker": "marker", 2023-12-03T11:44:00.738 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket_id": "bucket-id", 2023-12-03T11:44:00.738 INFO:tasks.workunit.client.0.smithi003.stdout: "tenant": "", 2023-12-03T11:44:00.738 INFO:tasks.workunit.client.0.smithi003.stdout: "explicit_placement": { 2023-12-03T11:44:00.739 INFO:tasks.workunit.client.0.smithi003.stdout: "data_pool": ".data-pool", 2023-12-03T11:44:00.739 INFO:tasks.workunit.client.0.smithi003.stdout: "data_extra_pool": "", 2023-12-03T11:44:00.739 INFO:tasks.workunit.client.0.smithi003.stdout: "index_pool": ".index-pool" 2023-12-03T11:44:00.739 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.739 INFO:tasks.workunit.client.0.smithi003.stdout: }, 2023-12-03T11:44:00.739 INFO:tasks.workunit.client.0.smithi003.stdout: "key": { 2023-12-03T11:44:00.739 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "myobj", 2023-12-03T11:44:00.739 INFO:tasks.workunit.client.0.smithi003.stdout: "instance": "inst", 2023-12-03T11:44:00.739 INFO:tasks.workunit.client.0.smithi003.stdout: "ns": "ns" 2023-12-03T11:44:00.739 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.739 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.739 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.739 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.739 INFO:tasks.workunit.client.0.smithi003.stdout: "raw_obj": { 2023-12-03T11:44:00.739 INFO:tasks.workunit.client.0.smithi003.stdout: "pool": ".data-pool", 2023-12-03T11:44:00.740 INFO:tasks.workunit.client.0.smithi003.stdout: "oid": "marker__ns:inst_myobj", 2023-12-03T11:44:00.740 INFO:tasks.workunit.client.0.smithi003.stdout: "loc": "" 2023-12-03T11:44:00.740 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.740 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.740 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.740 INFO:tasks.workunit.client.0.smithi003.stdout: "new_obj": { 2023-12-03T11:44:00.740 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket": { 2023-12-03T11:44:00.740 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "ebtest", 2023-12-03T11:44:00.740 INFO:tasks.workunit.client.0.smithi003.stdout: "marker": "marker", 2023-12-03T11:44:00.740 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket_id": "bucket-id", 2023-12-03T11:44:00.740 INFO:tasks.workunit.client.0.smithi003.stdout: "tenant": "", 2023-12-03T11:44:00.740 INFO:tasks.workunit.client.0.smithi003.stdout: "explicit_placement": { 2023-12-03T11:44:00.740 INFO:tasks.workunit.client.0.smithi003.stdout: "data_pool": ".data-pool", 2023-12-03T11:44:00.740 INFO:tasks.workunit.client.0.smithi003.stdout: "data_extra_pool": "", 2023-12-03T11:44:00.740 INFO:tasks.workunit.client.0.smithi003.stdout: "index_pool": ".index-pool" 2023-12-03T11:44:00.741 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.741 INFO:tasks.workunit.client.0.smithi003.stdout: }, 2023-12-03T11:44:00.741 INFO:tasks.workunit.client.0.smithi003.stdout: "key": { 2023-12-03T11:44:00.741 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "myobj", 2023-12-03T11:44:00.741 INFO:tasks.workunit.client.0.smithi003.stdout: "instance": "inst", 2023-12-03T11:44:00.741 INFO:tasks.workunit.client.0.smithi003.stdout: "ns": "ns" 2023-12-03T11:44:00.741 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.741 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.741 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.741 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.741 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket": { 2023-12-03T11:44:00.741 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "test", 2023-12-03T11:44:00.741 INFO:tasks.workunit.client.0.smithi003.stdout: "marker": "marker", 2023-12-03T11:44:00.741 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket_id": "bucket-id", 2023-12-03T11:44:00.741 INFO:tasks.workunit.client.0.smithi003.stdout: "tenant": "", 2023-12-03T11:44:00.742 INFO:tasks.workunit.client.0.smithi003.stdout: "explicit_placement": { 2023-12-03T11:44:00.742 INFO:tasks.workunit.client.0.smithi003.stdout: "data_pool": "", 2023-12-03T11:44:00.742 INFO:tasks.workunit.client.0.smithi003.stdout: "data_extra_pool": "", 2023-12-03T11:44:00.742 INFO:tasks.workunit.client.0.smithi003.stdout: "index_pool": "" 2023-12-03T11:44:00.742 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.742 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.742 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.742 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.742 INFO:tasks.workunit.client.0.smithi003.stdout: "obj": { 2023-12-03T11:44:00.742 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket": { 2023-12-03T11:44:00.742 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "test", 2023-12-03T11:44:00.742 INFO:tasks.workunit.client.0.smithi003.stdout: "marker": "marker", 2023-12-03T11:44:00.742 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket_id": "bucket-id", 2023-12-03T11:44:00.742 INFO:tasks.workunit.client.0.smithi003.stdout: "tenant": "", 2023-12-03T11:44:00.743 INFO:tasks.workunit.client.0.smithi003.stdout: "explicit_placement": { 2023-12-03T11:44:00.743 INFO:tasks.workunit.client.0.smithi003.stdout: "data_pool": "", 2023-12-03T11:44:00.743 INFO:tasks.workunit.client.0.smithi003.stdout: "data_extra_pool": "", 2023-12-03T11:44:00.743 INFO:tasks.workunit.client.0.smithi003.stdout: "index_pool": "" 2023-12-03T11:44:00.743 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.743 INFO:tasks.workunit.client.0.smithi003.stdout: }, 2023-12-03T11:44:00.743 INFO:tasks.workunit.client.0.smithi003.stdout: "key": { 2023-12-03T11:44:00.743 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "_myobj", 2023-12-03T11:44:00.743 INFO:tasks.workunit.client.0.smithi003.stdout: "instance": "", 2023-12-03T11:44:00.743 INFO:tasks.workunit.client.0.smithi003.stdout: "ns": "" 2023-12-03T11:44:00.743 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.743 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.743 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.743 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.743 INFO:tasks.workunit.client.0.smithi003.stdout: "raw_obj": { 2023-12-03T11:44:00.744 INFO:tasks.workunit.client.0.smithi003.stdout: "pool": "default-placement.data", 2023-12-03T11:44:00.744 INFO:tasks.workunit.client.0.smithi003.stdout: "oid": "marker___myobj", 2023-12-03T11:44:00.744 INFO:tasks.workunit.client.0.smithi003.stdout: "loc": "marker__myobj" 2023-12-03T11:44:00.744 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.744 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.744 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.744 INFO:tasks.workunit.client.0.smithi003.stdout: "new_obj": { 2023-12-03T11:44:00.744 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket": { 2023-12-03T11:44:00.744 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "test", 2023-12-03T11:44:00.744 INFO:tasks.workunit.client.0.smithi003.stdout: "marker": "marker", 2023-12-03T11:44:00.744 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket_id": "bucket-id", 2023-12-03T11:44:00.744 INFO:tasks.workunit.client.0.smithi003.stdout: "tenant": "", 2023-12-03T11:44:00.744 INFO:tasks.workunit.client.0.smithi003.stdout: "explicit_placement": { 2023-12-03T11:44:00.744 INFO:tasks.workunit.client.0.smithi003.stdout: "data_pool": "", 2023-12-03T11:44:00.744 INFO:tasks.workunit.client.0.smithi003.stdout: "data_extra_pool": "", 2023-12-03T11:44:00.745 INFO:tasks.workunit.client.0.smithi003.stdout: "index_pool": "" 2023-12-03T11:44:00.745 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.745 INFO:tasks.workunit.client.0.smithi003.stdout: }, 2023-12-03T11:44:00.745 INFO:tasks.workunit.client.0.smithi003.stdout: "key": { 2023-12-03T11:44:00.745 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "_myobj", 2023-12-03T11:44:00.745 INFO:tasks.workunit.client.0.smithi003.stdout: "instance": "", 2023-12-03T11:44:00.745 INFO:tasks.workunit.client.0.smithi003.stdout: "ns": "" 2023-12-03T11:44:00.745 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.745 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.745 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.745 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.745 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket": { 2023-12-03T11:44:00.745 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "ebtest", 2023-12-03T11:44:00.745 INFO:tasks.workunit.client.0.smithi003.stdout: "marker": "marker", 2023-12-03T11:44:00.745 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket_id": "bucket-id", 2023-12-03T11:44:00.746 INFO:tasks.workunit.client.0.smithi003.stdout: "tenant": "", 2023-12-03T11:44:00.746 INFO:tasks.workunit.client.0.smithi003.stdout: "explicit_placement": { 2023-12-03T11:44:00.746 INFO:tasks.workunit.client.0.smithi003.stdout: "data_pool": ".data-pool", 2023-12-03T11:44:00.746 INFO:tasks.workunit.client.0.smithi003.stdout: "data_extra_pool": "", 2023-12-03T11:44:00.746 INFO:tasks.workunit.client.0.smithi003.stdout: "index_pool": ".index-pool" 2023-12-03T11:44:00.746 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.746 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.746 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.746 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.746 INFO:tasks.workunit.client.0.smithi003.stdout: "obj": { 2023-12-03T11:44:00.746 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket": { 2023-12-03T11:44:00.746 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "ebtest", 2023-12-03T11:44:00.746 INFO:tasks.workunit.client.0.smithi003.stdout: "marker": "marker", 2023-12-03T11:44:00.746 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket_id": "bucket-id", 2023-12-03T11:44:00.746 INFO:tasks.workunit.client.0.smithi003.stdout: "tenant": "", 2023-12-03T11:44:00.747 INFO:tasks.workunit.client.0.smithi003.stdout: "explicit_placement": { 2023-12-03T11:44:00.747 INFO:tasks.workunit.client.0.smithi003.stdout: "data_pool": ".data-pool", 2023-12-03T11:44:00.747 INFO:tasks.workunit.client.0.smithi003.stdout: "data_extra_pool": "", 2023-12-03T11:44:00.747 INFO:tasks.workunit.client.0.smithi003.stdout: "index_pool": ".index-pool" 2023-12-03T11:44:00.747 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.747 INFO:tasks.workunit.client.0.smithi003.stdout: }, 2023-12-03T11:44:00.747 INFO:tasks.workunit.client.0.smithi003.stdout: "key": { 2023-12-03T11:44:00.747 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "_myobj", 2023-12-03T11:44:00.747 INFO:tasks.workunit.client.0.smithi003.stdout: "instance": "", 2023-12-03T11:44:00.747 INFO:tasks.workunit.client.0.smithi003.stdout: "ns": "" 2023-12-03T11:44:00.747 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.747 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.747 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.747 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.747 INFO:tasks.workunit.client.0.smithi003.stdout: "raw_obj": { 2023-12-03T11:44:00.748 INFO:tasks.workunit.client.0.smithi003.stdout: "pool": ".data-pool", 2023-12-03T11:44:00.748 INFO:tasks.workunit.client.0.smithi003.stdout: "oid": "marker___myobj", 2023-12-03T11:44:00.748 INFO:tasks.workunit.client.0.smithi003.stdout: "loc": "marker__myobj" 2023-12-03T11:44:00.748 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.748 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.748 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.748 INFO:tasks.workunit.client.0.smithi003.stdout: "new_obj": { 2023-12-03T11:44:00.748 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket": { 2023-12-03T11:44:00.748 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "ebtest", 2023-12-03T11:44:00.748 INFO:tasks.workunit.client.0.smithi003.stdout: "marker": "marker", 2023-12-03T11:44:00.748 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket_id": "bucket-id", 2023-12-03T11:44:00.748 INFO:tasks.workunit.client.0.smithi003.stdout: "tenant": "", 2023-12-03T11:44:00.748 INFO:tasks.workunit.client.0.smithi003.stdout: "explicit_placement": { 2023-12-03T11:44:00.748 INFO:tasks.workunit.client.0.smithi003.stdout: "data_pool": ".data-pool", 2023-12-03T11:44:00.748 INFO:tasks.workunit.client.0.smithi003.stdout: "data_extra_pool": "", 2023-12-03T11:44:00.749 INFO:tasks.workunit.client.0.smithi003.stdout: "index_pool": ".index-pool" 2023-12-03T11:44:00.749 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.749 INFO:tasks.workunit.client.0.smithi003.stdout: }, 2023-12-03T11:44:00.749 INFO:tasks.workunit.client.0.smithi003.stdout: "key": { 2023-12-03T11:44:00.749 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "_myobj", 2023-12-03T11:44:00.749 INFO:tasks.workunit.client.0.smithi003.stdout: "instance": "", 2023-12-03T11:44:00.749 INFO:tasks.workunit.client.0.smithi003.stdout: "ns": "" 2023-12-03T11:44:00.749 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.749 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.749 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.749 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.749 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket": { 2023-12-03T11:44:00.749 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "test", 2023-12-03T11:44:00.749 INFO:tasks.workunit.client.0.smithi003.stdout: "marker": "marker", 2023-12-03T11:44:00.749 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket_id": "bucket-id", 2023-12-03T11:44:00.750 INFO:tasks.workunit.client.0.smithi003.stdout: "tenant": "", 2023-12-03T11:44:00.750 INFO:tasks.workunit.client.0.smithi003.stdout: "explicit_placement": { 2023-12-03T11:44:00.750 INFO:tasks.workunit.client.0.smithi003.stdout: "data_pool": "", 2023-12-03T11:44:00.750 INFO:tasks.workunit.client.0.smithi003.stdout: "data_extra_pool": "", 2023-12-03T11:44:00.750 INFO:tasks.workunit.client.0.smithi003.stdout: "index_pool": "" 2023-12-03T11:44:00.750 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.750 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.750 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.750 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.750 INFO:tasks.workunit.client.0.smithi003.stdout: "obj": { 2023-12-03T11:44:00.750 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket": { 2023-12-03T11:44:00.750 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "test", 2023-12-03T11:44:00.750 INFO:tasks.workunit.client.0.smithi003.stdout: "marker": "marker", 2023-12-03T11:44:00.750 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket_id": "bucket-id", 2023-12-03T11:44:00.751 INFO:tasks.workunit.client.0.smithi003.stdout: "tenant": "", 2023-12-03T11:44:00.751 INFO:tasks.workunit.client.0.smithi003.stdout: "explicit_placement": { 2023-12-03T11:44:00.751 INFO:tasks.workunit.client.0.smithi003.stdout: "data_pool": "", 2023-12-03T11:44:00.751 INFO:tasks.workunit.client.0.smithi003.stdout: "data_extra_pool": "", 2023-12-03T11:44:00.751 INFO:tasks.workunit.client.0.smithi003.stdout: "index_pool": "" 2023-12-03T11:44:00.751 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.751 INFO:tasks.workunit.client.0.smithi003.stdout: }, 2023-12-03T11:44:00.751 INFO:tasks.workunit.client.0.smithi003.stdout: "key": { 2023-12-03T11:44:00.751 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "_myobj", 2023-12-03T11:44:00.751 INFO:tasks.workunit.client.0.smithi003.stdout: "instance": "", 2023-12-03T11:44:00.751 INFO:tasks.workunit.client.0.smithi003.stdout: "ns": "ns" 2023-12-03T11:44:00.751 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.751 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.751 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.752 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.752 INFO:tasks.workunit.client.0.smithi003.stdout: "raw_obj": { 2023-12-03T11:44:00.752 INFO:tasks.workunit.client.0.smithi003.stdout: "pool": "default-placement.data", 2023-12-03T11:44:00.752 INFO:tasks.workunit.client.0.smithi003.stdout: "oid": "marker__ns__myobj", 2023-12-03T11:44:00.752 INFO:tasks.workunit.client.0.smithi003.stdout: "loc": "" 2023-12-03T11:44:00.752 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.752 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.752 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.752 INFO:tasks.workunit.client.0.smithi003.stdout: "new_obj": { 2023-12-03T11:44:00.752 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket": { 2023-12-03T11:44:00.752 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "test", 2023-12-03T11:44:00.752 INFO:tasks.workunit.client.0.smithi003.stdout: "marker": "marker", 2023-12-03T11:44:00.752 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket_id": "bucket-id", 2023-12-03T11:44:00.752 INFO:tasks.workunit.client.0.smithi003.stdout: "tenant": "", 2023-12-03T11:44:00.752 INFO:tasks.workunit.client.0.smithi003.stdout: "explicit_placement": { 2023-12-03T11:44:00.753 INFO:tasks.workunit.client.0.smithi003.stdout: "data_pool": "", 2023-12-03T11:44:00.753 INFO:tasks.workunit.client.0.smithi003.stdout: "data_extra_pool": "", 2023-12-03T11:44:00.753 INFO:tasks.workunit.client.0.smithi003.stdout: "index_pool": "" 2023-12-03T11:44:00.753 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.753 INFO:tasks.workunit.client.0.smithi003.stdout: }, 2023-12-03T11:44:00.753 INFO:tasks.workunit.client.0.smithi003.stdout: "key": { 2023-12-03T11:44:00.753 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "_myobj", 2023-12-03T11:44:00.753 INFO:tasks.workunit.client.0.smithi003.stdout: "instance": "", 2023-12-03T11:44:00.753 INFO:tasks.workunit.client.0.smithi003.stdout: "ns": "ns" 2023-12-03T11:44:00.753 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.753 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.753 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.753 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.753 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket": { 2023-12-03T11:44:00.754 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "ebtest", 2023-12-03T11:44:00.754 INFO:tasks.workunit.client.0.smithi003.stdout: "marker": "marker", 2023-12-03T11:44:00.754 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket_id": "bucket-id", 2023-12-03T11:44:00.754 INFO:tasks.workunit.client.0.smithi003.stdout: "tenant": "", 2023-12-03T11:44:00.754 INFO:tasks.workunit.client.0.smithi003.stdout: "explicit_placement": { 2023-12-03T11:44:00.754 INFO:tasks.workunit.client.0.smithi003.stdout: "data_pool": ".data-pool", 2023-12-03T11:44:00.754 INFO:tasks.workunit.client.0.smithi003.stdout: "data_extra_pool": "", 2023-12-03T11:44:00.754 INFO:tasks.workunit.client.0.smithi003.stdout: "index_pool": ".index-pool" 2023-12-03T11:44:00.754 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.754 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.754 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.754 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.754 INFO:tasks.workunit.client.0.smithi003.stdout: "obj": { 2023-12-03T11:44:00.754 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket": { 2023-12-03T11:44:00.754 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "ebtest", 2023-12-03T11:44:00.755 INFO:tasks.workunit.client.0.smithi003.stdout: "marker": "marker", 2023-12-03T11:44:00.755 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket_id": "bucket-id", 2023-12-03T11:44:00.755 INFO:tasks.workunit.client.0.smithi003.stdout: "tenant": "", 2023-12-03T11:44:00.755 INFO:tasks.workunit.client.0.smithi003.stdout: "explicit_placement": { 2023-12-03T11:44:00.755 INFO:tasks.workunit.client.0.smithi003.stdout: "data_pool": ".data-pool", 2023-12-03T11:44:00.755 INFO:tasks.workunit.client.0.smithi003.stdout: "data_extra_pool": "", 2023-12-03T11:44:00.755 INFO:tasks.workunit.client.0.smithi003.stdout: "index_pool": ".index-pool" 2023-12-03T11:44:00.755 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.755 INFO:tasks.workunit.client.0.smithi003.stdout: }, 2023-12-03T11:44:00.755 INFO:tasks.workunit.client.0.smithi003.stdout: "key": { 2023-12-03T11:44:00.755 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "_myobj", 2023-12-03T11:44:00.755 INFO:tasks.workunit.client.0.smithi003.stdout: "instance": "", 2023-12-03T11:44:00.755 INFO:tasks.workunit.client.0.smithi003.stdout: "ns": "ns" 2023-12-03T11:44:00.755 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.756 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.756 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.756 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.756 INFO:tasks.workunit.client.0.smithi003.stdout: "raw_obj": { 2023-12-03T11:44:00.756 INFO:tasks.workunit.client.0.smithi003.stdout: "pool": ".data-pool", 2023-12-03T11:44:00.756 INFO:tasks.workunit.client.0.smithi003.stdout: "oid": "marker__ns__myobj", 2023-12-03T11:44:00.756 INFO:tasks.workunit.client.0.smithi003.stdout: "loc": "" 2023-12-03T11:44:00.756 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.756 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.756 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.756 INFO:tasks.workunit.client.0.smithi003.stdout: "new_obj": { 2023-12-03T11:44:00.756 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket": { 2023-12-03T11:44:00.756 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "ebtest", 2023-12-03T11:44:00.756 INFO:tasks.workunit.client.0.smithi003.stdout: "marker": "marker", 2023-12-03T11:44:00.756 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket_id": "bucket-id", 2023-12-03T11:44:00.757 INFO:tasks.workunit.client.0.smithi003.stdout: "tenant": "", 2023-12-03T11:44:00.757 INFO:tasks.workunit.client.0.smithi003.stdout: "explicit_placement": { 2023-12-03T11:44:00.757 INFO:tasks.workunit.client.0.smithi003.stdout: "data_pool": ".data-pool", 2023-12-03T11:44:00.757 INFO:tasks.workunit.client.0.smithi003.stdout: "data_extra_pool": "", 2023-12-03T11:44:00.757 INFO:tasks.workunit.client.0.smithi003.stdout: "index_pool": ".index-pool" 2023-12-03T11:44:00.757 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.757 INFO:tasks.workunit.client.0.smithi003.stdout: }, 2023-12-03T11:44:00.757 INFO:tasks.workunit.client.0.smithi003.stdout: "key": { 2023-12-03T11:44:00.757 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "_myobj", 2023-12-03T11:44:00.757 INFO:tasks.workunit.client.0.smithi003.stdout: "instance": "", 2023-12-03T11:44:00.757 INFO:tasks.workunit.client.0.smithi003.stdout: "ns": "ns" 2023-12-03T11:44:00.757 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.757 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.757 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.757 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.757 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket": { 2023-12-03T11:44:00.758 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "test", 2023-12-03T11:44:00.758 INFO:tasks.workunit.client.0.smithi003.stdout: "marker": "marker", 2023-12-03T11:44:00.758 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket_id": "bucket-id", 2023-12-03T11:44:00.758 INFO:tasks.workunit.client.0.smithi003.stdout: "tenant": "", 2023-12-03T11:44:00.758 INFO:tasks.workunit.client.0.smithi003.stdout: "explicit_placement": { 2023-12-03T11:44:00.758 INFO:tasks.workunit.client.0.smithi003.stdout: "data_pool": "", 2023-12-03T11:44:00.758 INFO:tasks.workunit.client.0.smithi003.stdout: "data_extra_pool": "", 2023-12-03T11:44:00.758 INFO:tasks.workunit.client.0.smithi003.stdout: "index_pool": "" 2023-12-03T11:44:00.758 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.758 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.758 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.758 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.758 INFO:tasks.workunit.client.0.smithi003.stdout: "obj": { 2023-12-03T11:44:00.758 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket": { 2023-12-03T11:44:00.758 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "test", 2023-12-03T11:44:00.759 INFO:tasks.workunit.client.0.smithi003.stdout: "marker": "marker", 2023-12-03T11:44:00.759 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket_id": "bucket-id", 2023-12-03T11:44:00.759 INFO:tasks.workunit.client.0.smithi003.stdout: "tenant": "", 2023-12-03T11:44:00.759 INFO:tasks.workunit.client.0.smithi003.stdout: "explicit_placement": { 2023-12-03T11:44:00.759 INFO:tasks.workunit.client.0.smithi003.stdout: "data_pool": "", 2023-12-03T11:44:00.759 INFO:tasks.workunit.client.0.smithi003.stdout: "data_extra_pool": "", 2023-12-03T11:44:00.759 INFO:tasks.workunit.client.0.smithi003.stdout: "index_pool": "" 2023-12-03T11:44:00.759 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.759 INFO:tasks.workunit.client.0.smithi003.stdout: }, 2023-12-03T11:44:00.759 INFO:tasks.workunit.client.0.smithi003.stdout: "key": { 2023-12-03T11:44:00.759 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "_myobj", 2023-12-03T11:44:00.759 INFO:tasks.workunit.client.0.smithi003.stdout: "instance": "inst", 2023-12-03T11:44:00.759 INFO:tasks.workunit.client.0.smithi003.stdout: "ns": "" 2023-12-03T11:44:00.759 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.759 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.760 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.760 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.760 INFO:tasks.workunit.client.0.smithi003.stdout: "raw_obj": { 2023-12-03T11:44:00.760 INFO:tasks.workunit.client.0.smithi003.stdout: "pool": "default-placement.data", 2023-12-03T11:44:00.760 INFO:tasks.workunit.client.0.smithi003.stdout: "oid": "marker__:inst__myobj", 2023-12-03T11:44:00.760 INFO:tasks.workunit.client.0.smithi003.stdout: "loc": "marker__myobj" 2023-12-03T11:44:00.760 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.760 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.760 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.760 INFO:tasks.workunit.client.0.smithi003.stdout: "new_obj": { 2023-12-03T11:44:00.760 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket": { 2023-12-03T11:44:00.760 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "test", 2023-12-03T11:44:00.760 INFO:tasks.workunit.client.0.smithi003.stdout: "marker": "marker", 2023-12-03T11:44:00.760 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket_id": "bucket-id", 2023-12-03T11:44:00.760 INFO:tasks.workunit.client.0.smithi003.stdout: "tenant": "", 2023-12-03T11:44:00.761 INFO:tasks.workunit.client.0.smithi003.stdout: "explicit_placement": { 2023-12-03T11:44:00.761 INFO:tasks.workunit.client.0.smithi003.stdout: "data_pool": "", 2023-12-03T11:44:00.761 INFO:tasks.workunit.client.0.smithi003.stdout: "data_extra_pool": "", 2023-12-03T11:44:00.761 INFO:tasks.workunit.client.0.smithi003.stdout: "index_pool": "" 2023-12-03T11:44:00.761 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.761 INFO:tasks.workunit.client.0.smithi003.stdout: }, 2023-12-03T11:44:00.761 INFO:tasks.workunit.client.0.smithi003.stdout: "key": { 2023-12-03T11:44:00.761 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "_myobj", 2023-12-03T11:44:00.761 INFO:tasks.workunit.client.0.smithi003.stdout: "instance": "inst", 2023-12-03T11:44:00.761 INFO:tasks.workunit.client.0.smithi003.stdout: "ns": "" 2023-12-03T11:44:00.761 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.761 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.761 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.761 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.761 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket": { 2023-12-03T11:44:00.762 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "ebtest", 2023-12-03T11:44:00.762 INFO:tasks.workunit.client.0.smithi003.stdout: "marker": "marker", 2023-12-03T11:44:00.762 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket_id": "bucket-id", 2023-12-03T11:44:00.762 INFO:tasks.workunit.client.0.smithi003.stdout: "tenant": "", 2023-12-03T11:44:00.762 INFO:tasks.workunit.client.0.smithi003.stdout: "explicit_placement": { 2023-12-03T11:44:00.762 INFO:tasks.workunit.client.0.smithi003.stdout: "data_pool": ".data-pool", 2023-12-03T11:44:00.762 INFO:tasks.workunit.client.0.smithi003.stdout: "data_extra_pool": "", 2023-12-03T11:44:00.762 INFO:tasks.workunit.client.0.smithi003.stdout: "index_pool": ".index-pool" 2023-12-03T11:44:00.762 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.762 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.762 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.762 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.762 INFO:tasks.workunit.client.0.smithi003.stdout: "obj": { 2023-12-03T11:44:00.762 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket": { 2023-12-03T11:44:00.763 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "ebtest", 2023-12-03T11:44:00.763 INFO:tasks.workunit.client.0.smithi003.stdout: "marker": "marker", 2023-12-03T11:44:00.763 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket_id": "bucket-id", 2023-12-03T11:44:00.763 INFO:tasks.workunit.client.0.smithi003.stdout: "tenant": "", 2023-12-03T11:44:00.763 INFO:tasks.workunit.client.0.smithi003.stdout: "explicit_placement": { 2023-12-03T11:44:00.763 INFO:tasks.workunit.client.0.smithi003.stdout: "data_pool": ".data-pool", 2023-12-03T11:44:00.763 INFO:tasks.workunit.client.0.smithi003.stdout: "data_extra_pool": "", 2023-12-03T11:44:00.763 INFO:tasks.workunit.client.0.smithi003.stdout: "index_pool": ".index-pool" 2023-12-03T11:44:00.763 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.763 INFO:tasks.workunit.client.0.smithi003.stdout: }, 2023-12-03T11:44:00.763 INFO:tasks.workunit.client.0.smithi003.stdout: "key": { 2023-12-03T11:44:00.763 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "_myobj", 2023-12-03T11:44:00.763 INFO:tasks.workunit.client.0.smithi003.stdout: "instance": "inst", 2023-12-03T11:44:00.763 INFO:tasks.workunit.client.0.smithi003.stdout: "ns": "" 2023-12-03T11:44:00.763 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.764 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.764 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.764 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.764 INFO:tasks.workunit.client.0.smithi003.stdout: "raw_obj": { 2023-12-03T11:44:00.764 INFO:tasks.workunit.client.0.smithi003.stdout: "pool": ".data-pool", 2023-12-03T11:44:00.764 INFO:tasks.workunit.client.0.smithi003.stdout: "oid": "marker__:inst__myobj", 2023-12-03T11:44:00.764 INFO:tasks.workunit.client.0.smithi003.stdout: "loc": "marker__myobj" 2023-12-03T11:44:00.764 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.764 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.764 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.764 INFO:tasks.workunit.client.0.smithi003.stdout: "new_obj": { 2023-12-03T11:44:00.765 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket": { 2023-12-03T11:44:00.765 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "ebtest", 2023-12-03T11:44:00.765 INFO:tasks.workunit.client.0.smithi003.stdout: "marker": "marker", 2023-12-03T11:44:00.765 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket_id": "bucket-id", 2023-12-03T11:44:00.765 INFO:tasks.workunit.client.0.smithi003.stdout: "tenant": "", 2023-12-03T11:44:00.765 INFO:tasks.workunit.client.0.smithi003.stdout: "explicit_placement": { 2023-12-03T11:44:00.765 INFO:tasks.workunit.client.0.smithi003.stdout: "data_pool": ".data-pool", 2023-12-03T11:44:00.765 INFO:tasks.workunit.client.0.smithi003.stdout: "data_extra_pool": "", 2023-12-03T11:44:00.765 INFO:tasks.workunit.client.0.smithi003.stdout: "index_pool": ".index-pool" 2023-12-03T11:44:00.765 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.765 INFO:tasks.workunit.client.0.smithi003.stdout: }, 2023-12-03T11:44:00.765 INFO:tasks.workunit.client.0.smithi003.stdout: "key": { 2023-12-03T11:44:00.766 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "_myobj", 2023-12-03T11:44:00.766 INFO:tasks.workunit.client.0.smithi003.stdout: "instance": "inst", 2023-12-03T11:44:00.766 INFO:tasks.workunit.client.0.smithi003.stdout: "ns": "" 2023-12-03T11:44:00.766 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.766 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.766 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.766 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.766 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket": { 2023-12-03T11:44:00.766 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "test", 2023-12-03T11:44:00.766 INFO:tasks.workunit.client.0.smithi003.stdout: "marker": "marker", 2023-12-03T11:44:00.766 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket_id": "bucket-id", 2023-12-03T11:44:00.766 INFO:tasks.workunit.client.0.smithi003.stdout: "tenant": "", 2023-12-03T11:44:00.766 INFO:tasks.workunit.client.0.smithi003.stdout: "explicit_placement": { 2023-12-03T11:44:00.766 INFO:tasks.workunit.client.0.smithi003.stdout: "data_pool": "", 2023-12-03T11:44:00.766 INFO:tasks.workunit.client.0.smithi003.stdout: "data_extra_pool": "", 2023-12-03T11:44:00.767 INFO:tasks.workunit.client.0.smithi003.stdout: "index_pool": "" 2023-12-03T11:44:00.767 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.767 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.767 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.767 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.767 INFO:tasks.workunit.client.0.smithi003.stdout: "obj": { 2023-12-03T11:44:00.767 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket": { 2023-12-03T11:44:00.767 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "test", 2023-12-03T11:44:00.767 INFO:tasks.workunit.client.0.smithi003.stdout: "marker": "marker", 2023-12-03T11:44:00.767 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket_id": "bucket-id", 2023-12-03T11:44:00.767 INFO:tasks.workunit.client.0.smithi003.stdout: "tenant": "", 2023-12-03T11:44:00.767 INFO:tasks.workunit.client.0.smithi003.stdout: "explicit_placement": { 2023-12-03T11:44:00.767 INFO:tasks.workunit.client.0.smithi003.stdout: "data_pool": "", 2023-12-03T11:44:00.767 INFO:tasks.workunit.client.0.smithi003.stdout: "data_extra_pool": "", 2023-12-03T11:44:00.768 INFO:tasks.workunit.client.0.smithi003.stdout: "index_pool": "" 2023-12-03T11:44:00.768 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.768 INFO:tasks.workunit.client.0.smithi003.stdout: }, 2023-12-03T11:44:00.768 INFO:tasks.workunit.client.0.smithi003.stdout: "key": { 2023-12-03T11:44:00.768 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "_myobj", 2023-12-03T11:44:00.768 INFO:tasks.workunit.client.0.smithi003.stdout: "instance": "inst", 2023-12-03T11:44:00.768 INFO:tasks.workunit.client.0.smithi003.stdout: "ns": "ns" 2023-12-03T11:44:00.768 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.768 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.768 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.768 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.768 INFO:tasks.workunit.client.0.smithi003.stdout: "raw_obj": { 2023-12-03T11:44:00.768 INFO:tasks.workunit.client.0.smithi003.stdout: "pool": "default-placement.data", 2023-12-03T11:44:00.768 INFO:tasks.workunit.client.0.smithi003.stdout: "oid": "marker__ns:inst__myobj", 2023-12-03T11:44:00.768 INFO:tasks.workunit.client.0.smithi003.stdout: "loc": "" 2023-12-03T11:44:00.769 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.769 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.769 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.769 INFO:tasks.workunit.client.0.smithi003.stdout: "new_obj": { 2023-12-03T11:44:00.769 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket": { 2023-12-03T11:44:00.769 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "test", 2023-12-03T11:44:00.769 INFO:tasks.workunit.client.0.smithi003.stdout: "marker": "marker", 2023-12-03T11:44:00.769 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket_id": "bucket-id", 2023-12-03T11:44:00.769 INFO:tasks.workunit.client.0.smithi003.stdout: "tenant": "", 2023-12-03T11:44:00.769 INFO:tasks.workunit.client.0.smithi003.stdout: "explicit_placement": { 2023-12-03T11:44:00.769 INFO:tasks.workunit.client.0.smithi003.stdout: "data_pool": "", 2023-12-03T11:44:00.769 INFO:tasks.workunit.client.0.smithi003.stdout: "data_extra_pool": "", 2023-12-03T11:44:00.769 INFO:tasks.workunit.client.0.smithi003.stdout: "index_pool": "" 2023-12-03T11:44:00.769 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.769 INFO:tasks.workunit.client.0.smithi003.stdout: }, 2023-12-03T11:44:00.770 INFO:tasks.workunit.client.0.smithi003.stdout: "key": { 2023-12-03T11:44:00.770 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "_myobj", 2023-12-03T11:44:00.770 INFO:tasks.workunit.client.0.smithi003.stdout: "instance": "inst", 2023-12-03T11:44:00.770 INFO:tasks.workunit.client.0.smithi003.stdout: "ns": "ns" 2023-12-03T11:44:00.770 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.770 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.770 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.770 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.770 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket": { 2023-12-03T11:44:00.770 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "ebtest", 2023-12-03T11:44:00.770 INFO:tasks.workunit.client.0.smithi003.stdout: "marker": "marker", 2023-12-03T11:44:00.770 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket_id": "bucket-id", 2023-12-03T11:44:00.770 INFO:tasks.workunit.client.0.smithi003.stdout: "tenant": "", 2023-12-03T11:44:00.770 INFO:tasks.workunit.client.0.smithi003.stdout: "explicit_placement": { 2023-12-03T11:44:00.770 INFO:tasks.workunit.client.0.smithi003.stdout: "data_pool": ".data-pool", 2023-12-03T11:44:00.771 INFO:tasks.workunit.client.0.smithi003.stdout: "data_extra_pool": "", 2023-12-03T11:44:00.771 INFO:tasks.workunit.client.0.smithi003.stdout: "index_pool": ".index-pool" 2023-12-03T11:44:00.771 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.771 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.771 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.771 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.771 INFO:tasks.workunit.client.0.smithi003.stdout: "obj": { 2023-12-03T11:44:00.771 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket": { 2023-12-03T11:44:00.771 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "ebtest", 2023-12-03T11:44:00.771 INFO:tasks.workunit.client.0.smithi003.stdout: "marker": "marker", 2023-12-03T11:44:00.771 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket_id": "bucket-id", 2023-12-03T11:44:00.771 INFO:tasks.workunit.client.0.smithi003.stdout: "tenant": "", 2023-12-03T11:44:00.771 INFO:tasks.workunit.client.0.smithi003.stdout: "explicit_placement": { 2023-12-03T11:44:00.771 INFO:tasks.workunit.client.0.smithi003.stdout: "data_pool": ".data-pool", 2023-12-03T11:44:00.771 INFO:tasks.workunit.client.0.smithi003.stdout: "data_extra_pool": "", 2023-12-03T11:44:00.772 INFO:tasks.workunit.client.0.smithi003.stdout: "index_pool": ".index-pool" 2023-12-03T11:44:00.772 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.772 INFO:tasks.workunit.client.0.smithi003.stdout: }, 2023-12-03T11:44:00.772 INFO:tasks.workunit.client.0.smithi003.stdout: "key": { 2023-12-03T11:44:00.772 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "_myobj", 2023-12-03T11:44:00.772 INFO:tasks.workunit.client.0.smithi003.stdout: "instance": "inst", 2023-12-03T11:44:00.772 INFO:tasks.workunit.client.0.smithi003.stdout: "ns": "ns" 2023-12-03T11:44:00.772 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.772 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.772 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.772 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.772 INFO:tasks.workunit.client.0.smithi003.stdout: "raw_obj": { 2023-12-03T11:44:00.772 INFO:tasks.workunit.client.0.smithi003.stdout: "pool": ".data-pool", 2023-12-03T11:44:00.772 INFO:tasks.workunit.client.0.smithi003.stdout: "oid": "marker__ns:inst__myobj", 2023-12-03T11:44:00.772 INFO:tasks.workunit.client.0.smithi003.stdout: "loc": "" 2023-12-03T11:44:00.773 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.773 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.773 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.773 INFO:tasks.workunit.client.0.smithi003.stdout: "new_obj": { 2023-12-03T11:44:00.773 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket": { 2023-12-03T11:44:00.773 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "ebtest", 2023-12-03T11:44:00.773 INFO:tasks.workunit.client.0.smithi003.stdout: "marker": "marker", 2023-12-03T11:44:00.773 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket_id": "bucket-id", 2023-12-03T11:44:00.773 INFO:tasks.workunit.client.0.smithi003.stdout: "tenant": "", 2023-12-03T11:44:00.773 INFO:tasks.workunit.client.0.smithi003.stdout: "explicit_placement": { 2023-12-03T11:44:00.773 INFO:tasks.workunit.client.0.smithi003.stdout: "data_pool": ".data-pool", 2023-12-03T11:44:00.773 INFO:tasks.workunit.client.0.smithi003.stdout: "data_extra_pool": "", 2023-12-03T11:44:00.773 INFO:tasks.workunit.client.0.smithi003.stdout: "index_pool": ".index-pool" 2023-12-03T11:44:00.773 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.773 INFO:tasks.workunit.client.0.smithi003.stdout: }, 2023-12-03T11:44:00.774 INFO:tasks.workunit.client.0.smithi003.stdout: "key": { 2023-12-03T11:44:00.774 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "_myobj", 2023-12-03T11:44:00.774 INFO:tasks.workunit.client.0.smithi003.stdout: "instance": "inst", 2023-12-03T11:44:00.774 INFO:tasks.workunit.client.0.smithi003.stdout: "ns": "ns" 2023-12-03T11:44:00.774 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.774 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.774 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.774 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.774 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket": { 2023-12-03T11:44:00.774 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "test", 2023-12-03T11:44:00.774 INFO:tasks.workunit.client.0.smithi003.stdout: "marker": "marker", 2023-12-03T11:44:00.774 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket_id": "bucket-id", 2023-12-03T11:44:00.774 INFO:tasks.workunit.client.0.smithi003.stdout: "tenant": "", 2023-12-03T11:44:00.774 INFO:tasks.workunit.client.0.smithi003.stdout: "explicit_placement": { 2023-12-03T11:44:00.775 INFO:tasks.workunit.client.0.smithi003.stdout: "data_pool": "", 2023-12-03T11:44:00.775 INFO:tasks.workunit.client.0.smithi003.stdout: "data_extra_pool": "", 2023-12-03T11:44:00.775 INFO:tasks.workunit.client.0.smithi003.stdout: "index_pool": "" 2023-12-03T11:44:00.775 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.775 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.775 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.775 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.775 INFO:tasks.workunit.client.0.smithi003.stdout: "obj": { 2023-12-03T11:44:00.775 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket": { 2023-12-03T11:44:00.775 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "test", 2023-12-03T11:44:00.775 INFO:tasks.workunit.client.0.smithi003.stdout: "marker": "marker", 2023-12-03T11:44:00.775 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket_id": "bucket-id", 2023-12-03T11:44:00.775 INFO:tasks.workunit.client.0.smithi003.stdout: "tenant": "", 2023-12-03T11:44:00.775 INFO:tasks.workunit.client.0.smithi003.stdout: "explicit_placement": { 2023-12-03T11:44:00.775 INFO:tasks.workunit.client.0.smithi003.stdout: "data_pool": "", 2023-12-03T11:44:00.776 INFO:tasks.workunit.client.0.smithi003.stdout: "data_extra_pool": "", 2023-12-03T11:44:00.776 INFO:tasks.workunit.client.0.smithi003.stdout: "index_pool": "" 2023-12-03T11:44:00.776 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.776 INFO:tasks.workunit.client.0.smithi003.stdout: }, 2023-12-03T11:44:00.776 INFO:tasks.workunit.client.0.smithi003.stdout: "key": { 2023-12-03T11:44:00.776 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "_myobj_", 2023-12-03T11:44:00.776 INFO:tasks.workunit.client.0.smithi003.stdout: "instance": "", 2023-12-03T11:44:00.776 INFO:tasks.workunit.client.0.smithi003.stdout: "ns": "" 2023-12-03T11:44:00.776 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.776 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.776 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.776 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.776 INFO:tasks.workunit.client.0.smithi003.stdout: "raw_obj": { 2023-12-03T11:44:00.776 INFO:tasks.workunit.client.0.smithi003.stdout: "pool": "default-placement.data", 2023-12-03T11:44:00.776 INFO:tasks.workunit.client.0.smithi003.stdout: "oid": "marker___myobj_", 2023-12-03T11:44:00.776 INFO:tasks.workunit.client.0.smithi003.stdout: "loc": "marker__myobj_" 2023-12-03T11:44:00.777 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.777 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.777 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.777 INFO:tasks.workunit.client.0.smithi003.stdout: "new_obj": { 2023-12-03T11:44:00.777 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket": { 2023-12-03T11:44:00.777 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "test", 2023-12-03T11:44:00.777 INFO:tasks.workunit.client.0.smithi003.stdout: "marker": "marker", 2023-12-03T11:44:00.777 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket_id": "bucket-id", 2023-12-03T11:44:00.777 INFO:tasks.workunit.client.0.smithi003.stdout: "tenant": "", 2023-12-03T11:44:00.777 INFO:tasks.workunit.client.0.smithi003.stdout: "explicit_placement": { 2023-12-03T11:44:00.777 INFO:tasks.workunit.client.0.smithi003.stdout: "data_pool": "", 2023-12-03T11:44:00.777 INFO:tasks.workunit.client.0.smithi003.stdout: "data_extra_pool": "", 2023-12-03T11:44:00.777 INFO:tasks.workunit.client.0.smithi003.stdout: "index_pool": "" 2023-12-03T11:44:00.777 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.777 INFO:tasks.workunit.client.0.smithi003.stdout: }, 2023-12-03T11:44:00.778 INFO:tasks.workunit.client.0.smithi003.stdout: "key": { 2023-12-03T11:44:00.778 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "_myobj_", 2023-12-03T11:44:00.778 INFO:tasks.workunit.client.0.smithi003.stdout: "instance": "", 2023-12-03T11:44:00.778 INFO:tasks.workunit.client.0.smithi003.stdout: "ns": "" 2023-12-03T11:44:00.778 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.778 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.778 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.778 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.778 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket": { 2023-12-03T11:44:00.778 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "ebtest", 2023-12-03T11:44:00.778 INFO:tasks.workunit.client.0.smithi003.stdout: "marker": "marker", 2023-12-03T11:44:00.778 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket_id": "bucket-id", 2023-12-03T11:44:00.778 INFO:tasks.workunit.client.0.smithi003.stdout: "tenant": "", 2023-12-03T11:44:00.778 INFO:tasks.workunit.client.0.smithi003.stdout: "explicit_placement": { 2023-12-03T11:44:00.779 INFO:tasks.workunit.client.0.smithi003.stdout: "data_pool": ".data-pool", 2023-12-03T11:44:00.779 INFO:tasks.workunit.client.0.smithi003.stdout: "data_extra_pool": "", 2023-12-03T11:44:00.779 INFO:tasks.workunit.client.0.smithi003.stdout: "index_pool": ".index-pool" 2023-12-03T11:44:00.779 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.779 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.779 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.779 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.779 INFO:tasks.workunit.client.0.smithi003.stdout: "obj": { 2023-12-03T11:44:00.779 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket": { 2023-12-03T11:44:00.779 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "ebtest", 2023-12-03T11:44:00.779 INFO:tasks.workunit.client.0.smithi003.stdout: "marker": "marker", 2023-12-03T11:44:00.779 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket_id": "bucket-id", 2023-12-03T11:44:00.779 INFO:tasks.workunit.client.0.smithi003.stdout: "tenant": "", 2023-12-03T11:44:00.779 INFO:tasks.workunit.client.0.smithi003.stdout: "explicit_placement": { 2023-12-03T11:44:00.779 INFO:tasks.workunit.client.0.smithi003.stdout: "data_pool": ".data-pool", 2023-12-03T11:44:00.780 INFO:tasks.workunit.client.0.smithi003.stdout: "data_extra_pool": "", 2023-12-03T11:44:00.780 INFO:tasks.workunit.client.0.smithi003.stdout: "index_pool": ".index-pool" 2023-12-03T11:44:00.780 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.780 INFO:tasks.workunit.client.0.smithi003.stdout: }, 2023-12-03T11:44:00.780 INFO:tasks.workunit.client.0.smithi003.stdout: "key": { 2023-12-03T11:44:00.780 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "_myobj_", 2023-12-03T11:44:00.780 INFO:tasks.workunit.client.0.smithi003.stdout: "instance": "", 2023-12-03T11:44:00.780 INFO:tasks.workunit.client.0.smithi003.stdout: "ns": "" 2023-12-03T11:44:00.780 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.780 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.780 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.780 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.780 INFO:tasks.workunit.client.0.smithi003.stdout: "raw_obj": { 2023-12-03T11:44:00.780 INFO:tasks.workunit.client.0.smithi003.stdout: "pool": ".data-pool", 2023-12-03T11:44:00.780 INFO:tasks.workunit.client.0.smithi003.stdout: "oid": "marker___myobj_", 2023-12-03T11:44:00.780 INFO:tasks.workunit.client.0.smithi003.stdout: "loc": "marker__myobj_" 2023-12-03T11:44:00.781 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.781 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.781 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.781 INFO:tasks.workunit.client.0.smithi003.stdout: "new_obj": { 2023-12-03T11:44:00.781 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket": { 2023-12-03T11:44:00.781 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "ebtest", 2023-12-03T11:44:00.781 INFO:tasks.workunit.client.0.smithi003.stdout: "marker": "marker", 2023-12-03T11:44:00.781 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket_id": "bucket-id", 2023-12-03T11:44:00.781 INFO:tasks.workunit.client.0.smithi003.stdout: "tenant": "", 2023-12-03T11:44:00.781 INFO:tasks.workunit.client.0.smithi003.stdout: "explicit_placement": { 2023-12-03T11:44:00.781 INFO:tasks.workunit.client.0.smithi003.stdout: "data_pool": ".data-pool", 2023-12-03T11:44:00.781 INFO:tasks.workunit.client.0.smithi003.stdout: "data_extra_pool": "", 2023-12-03T11:44:00.781 INFO:tasks.workunit.client.0.smithi003.stdout: "index_pool": ".index-pool" 2023-12-03T11:44:00.781 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.781 INFO:tasks.workunit.client.0.smithi003.stdout: }, 2023-12-03T11:44:00.782 INFO:tasks.workunit.client.0.smithi003.stdout: "key": { 2023-12-03T11:44:00.782 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "_myobj_", 2023-12-03T11:44:00.782 INFO:tasks.workunit.client.0.smithi003.stdout: "instance": "", 2023-12-03T11:44:00.782 INFO:tasks.workunit.client.0.smithi003.stdout: "ns": "" 2023-12-03T11:44:00.782 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.782 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.782 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.782 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.782 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket": { 2023-12-03T11:44:00.782 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "test", 2023-12-03T11:44:00.782 INFO:tasks.workunit.client.0.smithi003.stdout: "marker": "marker", 2023-12-03T11:44:00.782 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket_id": "bucket-id", 2023-12-03T11:44:00.782 INFO:tasks.workunit.client.0.smithi003.stdout: "tenant": "", 2023-12-03T11:44:00.782 INFO:tasks.workunit.client.0.smithi003.stdout: "explicit_placement": { 2023-12-03T11:44:00.783 INFO:tasks.workunit.client.0.smithi003.stdout: "data_pool": "", 2023-12-03T11:44:00.783 INFO:tasks.workunit.client.0.smithi003.stdout: "data_extra_pool": "", 2023-12-03T11:44:00.783 INFO:tasks.workunit.client.0.smithi003.stdout: "index_pool": "" 2023-12-03T11:44:00.783 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.783 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.783 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.783 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.783 INFO:tasks.workunit.client.0.smithi003.stdout: "obj": { 2023-12-03T11:44:00.783 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket": { 2023-12-03T11:44:00.783 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "test", 2023-12-03T11:44:00.783 INFO:tasks.workunit.client.0.smithi003.stdout: "marker": "marker", 2023-12-03T11:44:00.783 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket_id": "bucket-id", 2023-12-03T11:44:00.783 INFO:tasks.workunit.client.0.smithi003.stdout: "tenant": "", 2023-12-03T11:44:00.783 INFO:tasks.workunit.client.0.smithi003.stdout: "explicit_placement": { 2023-12-03T11:44:00.783 INFO:tasks.workunit.client.0.smithi003.stdout: "data_pool": "", 2023-12-03T11:44:00.783 INFO:tasks.workunit.client.0.smithi003.stdout: "data_extra_pool": "", 2023-12-03T11:44:00.784 INFO:tasks.workunit.client.0.smithi003.stdout: "index_pool": "" 2023-12-03T11:44:00.784 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.784 INFO:tasks.workunit.client.0.smithi003.stdout: }, 2023-12-03T11:44:00.784 INFO:tasks.workunit.client.0.smithi003.stdout: "key": { 2023-12-03T11:44:00.784 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "_myobj_", 2023-12-03T11:44:00.784 INFO:tasks.workunit.client.0.smithi003.stdout: "instance": "", 2023-12-03T11:44:00.784 INFO:tasks.workunit.client.0.smithi003.stdout: "ns": "ns" 2023-12-03T11:44:00.784 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.784 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.784 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.784 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.784 INFO:tasks.workunit.client.0.smithi003.stdout: "raw_obj": { 2023-12-03T11:44:00.784 INFO:tasks.workunit.client.0.smithi003.stdout: "pool": "default-placement.data", 2023-12-03T11:44:00.784 INFO:tasks.workunit.client.0.smithi003.stdout: "oid": "marker__ns__myobj_", 2023-12-03T11:44:00.784 INFO:tasks.workunit.client.0.smithi003.stdout: "loc": "" 2023-12-03T11:44:00.785 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.785 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.785 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.785 INFO:tasks.workunit.client.0.smithi003.stdout: "new_obj": { 2023-12-03T11:44:00.785 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket": { 2023-12-03T11:44:00.785 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "test", 2023-12-03T11:44:00.785 INFO:tasks.workunit.client.0.smithi003.stdout: "marker": "marker", 2023-12-03T11:44:00.785 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket_id": "bucket-id", 2023-12-03T11:44:00.785 INFO:tasks.workunit.client.0.smithi003.stdout: "tenant": "", 2023-12-03T11:44:00.785 INFO:tasks.workunit.client.0.smithi003.stdout: "explicit_placement": { 2023-12-03T11:44:00.785 INFO:tasks.workunit.client.0.smithi003.stdout: "data_pool": "", 2023-12-03T11:44:00.785 INFO:tasks.workunit.client.0.smithi003.stdout: "data_extra_pool": "", 2023-12-03T11:44:00.785 INFO:tasks.workunit.client.0.smithi003.stdout: "index_pool": "" 2023-12-03T11:44:00.785 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.785 INFO:tasks.workunit.client.0.smithi003.stdout: }, 2023-12-03T11:44:00.786 INFO:tasks.workunit.client.0.smithi003.stdout: "key": { 2023-12-03T11:44:00.786 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "_myobj_", 2023-12-03T11:44:00.786 INFO:tasks.workunit.client.0.smithi003.stdout: "instance": "", 2023-12-03T11:44:00.786 INFO:tasks.workunit.client.0.smithi003.stdout: "ns": "ns" 2023-12-03T11:44:00.786 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.786 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.786 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.786 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.786 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket": { 2023-12-03T11:44:00.786 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "ebtest", 2023-12-03T11:44:00.786 INFO:tasks.workunit.client.0.smithi003.stdout: "marker": "marker", 2023-12-03T11:44:00.786 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket_id": "bucket-id", 2023-12-03T11:44:00.786 INFO:tasks.workunit.client.0.smithi003.stdout: "tenant": "", 2023-12-03T11:44:00.786 INFO:tasks.workunit.client.0.smithi003.stdout: "explicit_placement": { 2023-12-03T11:44:00.787 INFO:tasks.workunit.client.0.smithi003.stdout: "data_pool": ".data-pool", 2023-12-03T11:44:00.787 INFO:tasks.workunit.client.0.smithi003.stdout: "data_extra_pool": "", 2023-12-03T11:44:00.787 INFO:tasks.workunit.client.0.smithi003.stdout: "index_pool": ".index-pool" 2023-12-03T11:44:00.787 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.787 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.787 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.787 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.787 INFO:tasks.workunit.client.0.smithi003.stdout: "obj": { 2023-12-03T11:44:00.787 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket": { 2023-12-03T11:44:00.787 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "ebtest", 2023-12-03T11:44:00.787 INFO:tasks.workunit.client.0.smithi003.stdout: "marker": "marker", 2023-12-03T11:44:00.787 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket_id": "bucket-id", 2023-12-03T11:44:00.787 INFO:tasks.workunit.client.0.smithi003.stdout: "tenant": "", 2023-12-03T11:44:00.787 INFO:tasks.workunit.client.0.smithi003.stdout: "explicit_placement": { 2023-12-03T11:44:00.787 INFO:tasks.workunit.client.0.smithi003.stdout: "data_pool": ".data-pool", 2023-12-03T11:44:00.788 INFO:tasks.workunit.client.0.smithi003.stdout: "data_extra_pool": "", 2023-12-03T11:44:00.788 INFO:tasks.workunit.client.0.smithi003.stdout: "index_pool": ".index-pool" 2023-12-03T11:44:00.788 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.788 INFO:tasks.workunit.client.0.smithi003.stdout: }, 2023-12-03T11:44:00.788 INFO:tasks.workunit.client.0.smithi003.stdout: "key": { 2023-12-03T11:44:00.788 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "_myobj_", 2023-12-03T11:44:00.788 INFO:tasks.workunit.client.0.smithi003.stdout: "instance": "", 2023-12-03T11:44:00.788 INFO:tasks.workunit.client.0.smithi003.stdout: "ns": "ns" 2023-12-03T11:44:00.788 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.788 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.788 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.788 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.788 INFO:tasks.workunit.client.0.smithi003.stdout: "raw_obj": { 2023-12-03T11:44:00.788 INFO:tasks.workunit.client.0.smithi003.stdout: "pool": ".data-pool", 2023-12-03T11:44:00.788 INFO:tasks.workunit.client.0.smithi003.stdout: "oid": "marker__ns__myobj_", 2023-12-03T11:44:00.789 INFO:tasks.workunit.client.0.smithi003.stdout: "loc": "" 2023-12-03T11:44:00.789 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.789 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.789 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.789 INFO:tasks.workunit.client.0.smithi003.stdout: "new_obj": { 2023-12-03T11:44:00.789 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket": { 2023-12-03T11:44:00.789 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "ebtest", 2023-12-03T11:44:00.789 INFO:tasks.workunit.client.0.smithi003.stdout: "marker": "marker", 2023-12-03T11:44:00.789 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket_id": "bucket-id", 2023-12-03T11:44:00.789 INFO:tasks.workunit.client.0.smithi003.stdout: "tenant": "", 2023-12-03T11:44:00.789 INFO:tasks.workunit.client.0.smithi003.stdout: "explicit_placement": { 2023-12-03T11:44:00.789 INFO:tasks.workunit.client.0.smithi003.stdout: "data_pool": ".data-pool", 2023-12-03T11:44:00.789 INFO:tasks.workunit.client.0.smithi003.stdout: "data_extra_pool": "", 2023-12-03T11:44:00.789 INFO:tasks.workunit.client.0.smithi003.stdout: "index_pool": ".index-pool" 2023-12-03T11:44:00.789 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.790 INFO:tasks.workunit.client.0.smithi003.stdout: }, 2023-12-03T11:44:00.790 INFO:tasks.workunit.client.0.smithi003.stdout: "key": { 2023-12-03T11:44:00.790 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "_myobj_", 2023-12-03T11:44:00.790 INFO:tasks.workunit.client.0.smithi003.stdout: "instance": "", 2023-12-03T11:44:00.790 INFO:tasks.workunit.client.0.smithi003.stdout: "ns": "ns" 2023-12-03T11:44:00.790 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.790 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.790 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.790 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.790 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket": { 2023-12-03T11:44:00.790 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "test", 2023-12-03T11:44:00.790 INFO:tasks.workunit.client.0.smithi003.stdout: "marker": "marker", 2023-12-03T11:44:00.790 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket_id": "bucket-id", 2023-12-03T11:44:00.790 INFO:tasks.workunit.client.0.smithi003.stdout: "tenant": "", 2023-12-03T11:44:00.790 INFO:tasks.workunit.client.0.smithi003.stdout: "explicit_placement": { 2023-12-03T11:44:00.791 INFO:tasks.workunit.client.0.smithi003.stdout: "data_pool": "", 2023-12-03T11:44:00.791 INFO:tasks.workunit.client.0.smithi003.stdout: "data_extra_pool": "", 2023-12-03T11:44:00.791 INFO:tasks.workunit.client.0.smithi003.stdout: "index_pool": "" 2023-12-03T11:44:00.791 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.791 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.791 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.791 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.791 INFO:tasks.workunit.client.0.smithi003.stdout: "obj": { 2023-12-03T11:44:00.791 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket": { 2023-12-03T11:44:00.791 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "test", 2023-12-03T11:44:00.791 INFO:tasks.workunit.client.0.smithi003.stdout: "marker": "marker", 2023-12-03T11:44:00.791 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket_id": "bucket-id", 2023-12-03T11:44:00.791 INFO:tasks.workunit.client.0.smithi003.stdout: "tenant": "", 2023-12-03T11:44:00.791 INFO:tasks.workunit.client.0.smithi003.stdout: "explicit_placement": { 2023-12-03T11:44:00.791 INFO:tasks.workunit.client.0.smithi003.stdout: "data_pool": "", 2023-12-03T11:44:00.792 INFO:tasks.workunit.client.0.smithi003.stdout: "data_extra_pool": "", 2023-12-03T11:44:00.792 INFO:tasks.workunit.client.0.smithi003.stdout: "index_pool": "" 2023-12-03T11:44:00.792 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.792 INFO:tasks.workunit.client.0.smithi003.stdout: }, 2023-12-03T11:44:00.792 INFO:tasks.workunit.client.0.smithi003.stdout: "key": { 2023-12-03T11:44:00.792 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "_myobj_", 2023-12-03T11:44:00.792 INFO:tasks.workunit.client.0.smithi003.stdout: "instance": "inst", 2023-12-03T11:44:00.792 INFO:tasks.workunit.client.0.smithi003.stdout: "ns": "" 2023-12-03T11:44:00.792 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.792 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.792 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.792 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.792 INFO:tasks.workunit.client.0.smithi003.stdout: "raw_obj": { 2023-12-03T11:44:00.792 INFO:tasks.workunit.client.0.smithi003.stdout: "pool": "default-placement.data", 2023-12-03T11:44:00.792 INFO:tasks.workunit.client.0.smithi003.stdout: "oid": "marker__:inst__myobj_", 2023-12-03T11:44:00.793 INFO:tasks.workunit.client.0.smithi003.stdout: "loc": "marker__myobj_" 2023-12-03T11:44:00.793 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.793 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.793 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.793 INFO:tasks.workunit.client.0.smithi003.stdout: "new_obj": { 2023-12-03T11:44:00.793 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket": { 2023-12-03T11:44:00.793 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "test", 2023-12-03T11:44:00.793 INFO:tasks.workunit.client.0.smithi003.stdout: "marker": "marker", 2023-12-03T11:44:00.793 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket_id": "bucket-id", 2023-12-03T11:44:00.793 INFO:tasks.workunit.client.0.smithi003.stdout: "tenant": "", 2023-12-03T11:44:00.793 INFO:tasks.workunit.client.0.smithi003.stdout: "explicit_placement": { 2023-12-03T11:44:00.793 INFO:tasks.workunit.client.0.smithi003.stdout: "data_pool": "", 2023-12-03T11:44:00.793 INFO:tasks.workunit.client.0.smithi003.stdout: "data_extra_pool": "", 2023-12-03T11:44:00.794 INFO:tasks.workunit.client.0.smithi003.stdout: "index_pool": "" 2023-12-03T11:44:00.794 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.794 INFO:tasks.workunit.client.0.smithi003.stdout: }, 2023-12-03T11:44:00.794 INFO:tasks.workunit.client.0.smithi003.stdout: "key": { 2023-12-03T11:44:00.794 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "_myobj_", 2023-12-03T11:44:00.794 INFO:tasks.workunit.client.0.smithi003.stdout: "instance": "inst", 2023-12-03T11:44:00.794 INFO:tasks.workunit.client.0.smithi003.stdout: "ns": "" 2023-12-03T11:44:00.794 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.794 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.794 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.794 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.794 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket": { 2023-12-03T11:44:00.795 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "ebtest", 2023-12-03T11:44:00.795 INFO:tasks.workunit.client.0.smithi003.stdout: "marker": "marker", 2023-12-03T11:44:00.795 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket_id": "bucket-id", 2023-12-03T11:44:00.795 INFO:tasks.workunit.client.0.smithi003.stdout: "tenant": "", 2023-12-03T11:44:00.795 INFO:tasks.workunit.client.0.smithi003.stdout: "explicit_placement": { 2023-12-03T11:44:00.795 INFO:tasks.workunit.client.0.smithi003.stdout: "data_pool": ".data-pool", 2023-12-03T11:44:00.795 INFO:tasks.workunit.client.0.smithi003.stdout: "data_extra_pool": "", 2023-12-03T11:44:00.795 INFO:tasks.workunit.client.0.smithi003.stdout: "index_pool": ".index-pool" 2023-12-03T11:44:00.795 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.795 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.795 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.795 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.796 INFO:tasks.workunit.client.0.smithi003.stdout: "obj": { 2023-12-03T11:44:00.796 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket": { 2023-12-03T11:44:00.796 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "ebtest", 2023-12-03T11:44:00.796 INFO:tasks.workunit.client.0.smithi003.stdout: "marker": "marker", 2023-12-03T11:44:00.796 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket_id": "bucket-id", 2023-12-03T11:44:00.796 INFO:tasks.workunit.client.0.smithi003.stdout: "tenant": "", 2023-12-03T11:44:00.796 INFO:tasks.workunit.client.0.smithi003.stdout: "explicit_placement": { 2023-12-03T11:44:00.796 INFO:tasks.workunit.client.0.smithi003.stdout: "data_pool": ".data-pool", 2023-12-03T11:44:00.796 INFO:tasks.workunit.client.0.smithi003.stdout: "data_extra_pool": "", 2023-12-03T11:44:00.796 INFO:tasks.workunit.client.0.smithi003.stdout: "index_pool": ".index-pool" 2023-12-03T11:44:00.796 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.796 INFO:tasks.workunit.client.0.smithi003.stdout: }, 2023-12-03T11:44:00.796 INFO:tasks.workunit.client.0.smithi003.stdout: "key": { 2023-12-03T11:44:00.796 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "_myobj_", 2023-12-03T11:44:00.796 INFO:tasks.workunit.client.0.smithi003.stdout: "instance": "inst", 2023-12-03T11:44:00.797 INFO:tasks.workunit.client.0.smithi003.stdout: "ns": "" 2023-12-03T11:44:00.797 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.797 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.797 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.797 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.797 INFO:tasks.workunit.client.0.smithi003.stdout: "raw_obj": { 2023-12-03T11:44:00.797 INFO:tasks.workunit.client.0.smithi003.stdout: "pool": ".data-pool", 2023-12-03T11:44:00.797 INFO:tasks.workunit.client.0.smithi003.stdout: "oid": "marker__:inst__myobj_", 2023-12-03T11:44:00.797 INFO:tasks.workunit.client.0.smithi003.stdout: "loc": "marker__myobj_" 2023-12-03T11:44:00.797 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.797 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.797 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.797 INFO:tasks.workunit.client.0.smithi003.stdout: "new_obj": { 2023-12-03T11:44:00.797 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket": { 2023-12-03T11:44:00.797 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "ebtest", 2023-12-03T11:44:00.798 INFO:tasks.workunit.client.0.smithi003.stdout: "marker": "marker", 2023-12-03T11:44:00.798 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket_id": "bucket-id", 2023-12-03T11:44:00.798 INFO:tasks.workunit.client.0.smithi003.stdout: "tenant": "", 2023-12-03T11:44:00.798 INFO:tasks.workunit.client.0.smithi003.stdout: "explicit_placement": { 2023-12-03T11:44:00.798 INFO:tasks.workunit.client.0.smithi003.stdout: "data_pool": ".data-pool", 2023-12-03T11:44:00.798 INFO:tasks.workunit.client.0.smithi003.stdout: "data_extra_pool": "", 2023-12-03T11:44:00.798 INFO:tasks.workunit.client.0.smithi003.stdout: "index_pool": ".index-pool" 2023-12-03T11:44:00.798 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.798 INFO:tasks.workunit.client.0.smithi003.stdout: }, 2023-12-03T11:44:00.798 INFO:tasks.workunit.client.0.smithi003.stdout: "key": { 2023-12-03T11:44:00.798 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "_myobj_", 2023-12-03T11:44:00.798 INFO:tasks.workunit.client.0.smithi003.stdout: "instance": "inst", 2023-12-03T11:44:00.798 INFO:tasks.workunit.client.0.smithi003.stdout: "ns": "" 2023-12-03T11:44:00.798 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.798 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.799 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.799 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.799 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket": { 2023-12-03T11:44:00.799 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "test", 2023-12-03T11:44:00.799 INFO:tasks.workunit.client.0.smithi003.stdout: "marker": "marker", 2023-12-03T11:44:00.799 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket_id": "bucket-id", 2023-12-03T11:44:00.799 INFO:tasks.workunit.client.0.smithi003.stdout: "tenant": "", 2023-12-03T11:44:00.799 INFO:tasks.workunit.client.0.smithi003.stdout: "explicit_placement": { 2023-12-03T11:44:00.799 INFO:tasks.workunit.client.0.smithi003.stdout: "data_pool": "", 2023-12-03T11:44:00.799 INFO:tasks.workunit.client.0.smithi003.stdout: "data_extra_pool": "", 2023-12-03T11:44:00.799 INFO:tasks.workunit.client.0.smithi003.stdout: "index_pool": "" 2023-12-03T11:44:00.799 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.799 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.799 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.799 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.800 INFO:tasks.workunit.client.0.smithi003.stdout: "obj": { 2023-12-03T11:44:00.800 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket": { 2023-12-03T11:44:00.800 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "test", 2023-12-03T11:44:00.800 INFO:tasks.workunit.client.0.smithi003.stdout: "marker": "marker", 2023-12-03T11:44:00.800 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket_id": "bucket-id", 2023-12-03T11:44:00.800 INFO:tasks.workunit.client.0.smithi003.stdout: "tenant": "", 2023-12-03T11:44:00.800 INFO:tasks.workunit.client.0.smithi003.stdout: "explicit_placement": { 2023-12-03T11:44:00.800 INFO:tasks.workunit.client.0.smithi003.stdout: "data_pool": "", 2023-12-03T11:44:00.800 INFO:tasks.workunit.client.0.smithi003.stdout: "data_extra_pool": "", 2023-12-03T11:44:00.800 INFO:tasks.workunit.client.0.smithi003.stdout: "index_pool": "" 2023-12-03T11:44:00.800 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.800 INFO:tasks.workunit.client.0.smithi003.stdout: }, 2023-12-03T11:44:00.800 INFO:tasks.workunit.client.0.smithi003.stdout: "key": { 2023-12-03T11:44:00.800 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "_myobj_", 2023-12-03T11:44:00.801 INFO:tasks.workunit.client.0.smithi003.stdout: "instance": "inst", 2023-12-03T11:44:00.801 INFO:tasks.workunit.client.0.smithi003.stdout: "ns": "ns" 2023-12-03T11:44:00.801 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.801 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.801 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.801 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.801 INFO:tasks.workunit.client.0.smithi003.stdout: "raw_obj": { 2023-12-03T11:44:00.801 INFO:tasks.workunit.client.0.smithi003.stdout: "pool": "default-placement.data", 2023-12-03T11:44:00.801 INFO:tasks.workunit.client.0.smithi003.stdout: "oid": "marker__ns:inst__myobj_", 2023-12-03T11:44:00.801 INFO:tasks.workunit.client.0.smithi003.stdout: "loc": "" 2023-12-03T11:44:00.801 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.801 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.801 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.801 INFO:tasks.workunit.client.0.smithi003.stdout: "new_obj": { 2023-12-03T11:44:00.801 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket": { 2023-12-03T11:44:00.801 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "test", 2023-12-03T11:44:00.802 INFO:tasks.workunit.client.0.smithi003.stdout: "marker": "marker", 2023-12-03T11:44:00.802 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket_id": "bucket-id", 2023-12-03T11:44:00.802 INFO:tasks.workunit.client.0.smithi003.stdout: "tenant": "", 2023-12-03T11:44:00.802 INFO:tasks.workunit.client.0.smithi003.stdout: "explicit_placement": { 2023-12-03T11:44:00.802 INFO:tasks.workunit.client.0.smithi003.stdout: "data_pool": "", 2023-12-03T11:44:00.802 INFO:tasks.workunit.client.0.smithi003.stdout: "data_extra_pool": "", 2023-12-03T11:44:00.802 INFO:tasks.workunit.client.0.smithi003.stdout: "index_pool": "" 2023-12-03T11:44:00.802 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.802 INFO:tasks.workunit.client.0.smithi003.stdout: }, 2023-12-03T11:44:00.802 INFO:tasks.workunit.client.0.smithi003.stdout: "key": { 2023-12-03T11:44:00.802 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "_myobj_", 2023-12-03T11:44:00.802 INFO:tasks.workunit.client.0.smithi003.stdout: "instance": "inst", 2023-12-03T11:44:00.802 INFO:tasks.workunit.client.0.smithi003.stdout: "ns": "ns" 2023-12-03T11:44:00.802 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.803 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.803 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.803 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.803 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket": { 2023-12-03T11:44:00.803 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "ebtest", 2023-12-03T11:44:00.803 INFO:tasks.workunit.client.0.smithi003.stdout: "marker": "marker", 2023-12-03T11:44:00.803 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket_id": "bucket-id", 2023-12-03T11:44:00.803 INFO:tasks.workunit.client.0.smithi003.stdout: "tenant": "", 2023-12-03T11:44:00.803 INFO:tasks.workunit.client.0.smithi003.stdout: "explicit_placement": { 2023-12-03T11:44:00.803 INFO:tasks.workunit.client.0.smithi003.stdout: "data_pool": ".data-pool", 2023-12-03T11:44:00.803 INFO:tasks.workunit.client.0.smithi003.stdout: "data_extra_pool": "", 2023-12-03T11:44:00.803 INFO:tasks.workunit.client.0.smithi003.stdout: "index_pool": ".index-pool" 2023-12-03T11:44:00.803 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.803 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.803 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.804 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.804 INFO:tasks.workunit.client.0.smithi003.stdout: "obj": { 2023-12-03T11:44:00.804 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket": { 2023-12-03T11:44:00.804 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "ebtest", 2023-12-03T11:44:00.804 INFO:tasks.workunit.client.0.smithi003.stdout: "marker": "marker", 2023-12-03T11:44:00.804 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket_id": "bucket-id", 2023-12-03T11:44:00.804 INFO:tasks.workunit.client.0.smithi003.stdout: "tenant": "", 2023-12-03T11:44:00.804 INFO:tasks.workunit.client.0.smithi003.stdout: "explicit_placement": { 2023-12-03T11:44:00.804 INFO:tasks.workunit.client.0.smithi003.stdout: "data_pool": ".data-pool", 2023-12-03T11:44:00.804 INFO:tasks.workunit.client.0.smithi003.stdout: "data_extra_pool": "", 2023-12-03T11:44:00.804 INFO:tasks.workunit.client.0.smithi003.stdout: "index_pool": ".index-pool" 2023-12-03T11:44:00.804 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.804 INFO:tasks.workunit.client.0.smithi003.stdout: }, 2023-12-03T11:44:00.804 INFO:tasks.workunit.client.0.smithi003.stdout: "key": { 2023-12-03T11:44:00.804 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "_myobj_", 2023-12-03T11:44:00.804 INFO:tasks.workunit.client.0.smithi003.stdout: "instance": "inst", 2023-12-03T11:44:00.805 INFO:tasks.workunit.client.0.smithi003.stdout: "ns": "ns" 2023-12-03T11:44:00.805 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.805 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.805 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.805 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.805 INFO:tasks.workunit.client.0.smithi003.stdout: "raw_obj": { 2023-12-03T11:44:00.805 INFO:tasks.workunit.client.0.smithi003.stdout: "pool": ".data-pool", 2023-12-03T11:44:00.805 INFO:tasks.workunit.client.0.smithi003.stdout: "oid": "marker__ns:inst__myobj_", 2023-12-03T11:44:00.805 INFO:tasks.workunit.client.0.smithi003.stdout: "loc": "" 2023-12-03T11:44:00.805 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.805 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.805 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.805 INFO:tasks.workunit.client.0.smithi003.stdout: "new_obj": { 2023-12-03T11:44:00.805 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket": { 2023-12-03T11:44:00.805 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "ebtest", 2023-12-03T11:44:00.806 INFO:tasks.workunit.client.0.smithi003.stdout: "marker": "marker", 2023-12-03T11:44:00.806 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket_id": "bucket-id", 2023-12-03T11:44:00.806 INFO:tasks.workunit.client.0.smithi003.stdout: "tenant": "", 2023-12-03T11:44:00.806 INFO:tasks.workunit.client.0.smithi003.stdout: "explicit_placement": { 2023-12-03T11:44:00.806 INFO:tasks.workunit.client.0.smithi003.stdout: "data_pool": ".data-pool", 2023-12-03T11:44:00.806 INFO:tasks.workunit.client.0.smithi003.stdout: "data_extra_pool": "", 2023-12-03T11:44:00.806 INFO:tasks.workunit.client.0.smithi003.stdout: "index_pool": ".index-pool" 2023-12-03T11:44:00.806 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.806 INFO:tasks.workunit.client.0.smithi003.stdout: }, 2023-12-03T11:44:00.806 INFO:tasks.workunit.client.0.smithi003.stdout: "key": { 2023-12-03T11:44:00.806 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "_myobj_", 2023-12-03T11:44:00.806 INFO:tasks.workunit.client.0.smithi003.stdout: "instance": "inst", 2023-12-03T11:44:00.806 INFO:tasks.workunit.client.0.smithi003.stdout: "ns": "ns" 2023-12-03T11:44:00.806 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.807 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.807 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.807 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] TestRGWObj.obj_to_raw (1 ms) 2023-12-03T11:44:00.807 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] TestRGWObj.old_to_raw 2023-12-03T11:44:00.807 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.807 INFO:tasks.workunit.client.0.smithi003.stdout: "raw_obj": { 2023-12-03T11:44:00.807 INFO:tasks.workunit.client.0.smithi003.stdout: "pool": ".data-pool", 2023-12-03T11:44:00.807 INFO:tasks.workunit.client.0.smithi003.stdout: "oid": "marker_myobj", 2023-12-03T11:44:00.807 INFO:tasks.workunit.client.0.smithi003.stdout: "loc": "" 2023-12-03T11:44:00.807 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.807 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.807 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.807 INFO:tasks.workunit.client.0.smithi003.stdout: "new_obj": { 2023-12-03T11:44:00.807 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket": { 2023-12-03T11:44:00.808 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "ebtest", 2023-12-03T11:44:00.808 INFO:tasks.workunit.client.0.smithi003.stdout: "marker": "marker", 2023-12-03T11:44:00.808 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket_id": "bucket-id", 2023-12-03T11:44:00.808 INFO:tasks.workunit.client.0.smithi003.stdout: "tenant": "", 2023-12-03T11:44:00.808 INFO:tasks.workunit.client.0.smithi003.stdout: "explicit_placement": { 2023-12-03T11:44:00.808 INFO:tasks.workunit.client.0.smithi003.stdout: "data_pool": ".data-pool", 2023-12-03T11:44:00.808 INFO:tasks.workunit.client.0.smithi003.stdout: "data_extra_pool": "", 2023-12-03T11:44:00.808 INFO:tasks.workunit.client.0.smithi003.stdout: "index_pool": ".index-pool" 2023-12-03T11:44:00.808 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.808 INFO:tasks.workunit.client.0.smithi003.stdout: }, 2023-12-03T11:44:00.808 INFO:tasks.workunit.client.0.smithi003.stdout: "key": { 2023-12-03T11:44:00.808 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "myobj", 2023-12-03T11:44:00.808 INFO:tasks.workunit.client.0.smithi003.stdout: "instance": "", 2023-12-03T11:44:00.808 INFO:tasks.workunit.client.0.smithi003.stdout: "ns": "" 2023-12-03T11:44:00.808 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.809 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.809 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.809 INFO:tasks.workunit.client.0.smithi003.stdout:raw=.data-pool:marker_myobj 2023-12-03T11:44:00.809 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.809 INFO:tasks.workunit.client.0.smithi003.stdout: "raw_obj2": { 2023-12-03T11:44:00.809 INFO:tasks.workunit.client.0.smithi003.stdout: "pool": ".data-pool", 2023-12-03T11:44:00.809 INFO:tasks.workunit.client.0.smithi003.stdout: "oid": "marker_myobj", 2023-12-03T11:44:00.809 INFO:tasks.workunit.client.0.smithi003.stdout: "loc": "" 2023-12-03T11:44:00.809 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.809 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.809 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.809 INFO:tasks.workunit.client.0.smithi003.stdout: "new_obj2": { 2023-12-03T11:44:00.810 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket": { 2023-12-03T11:44:00.810 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "ebtest", 2023-12-03T11:44:00.810 INFO:tasks.workunit.client.0.smithi003.stdout: "marker": "marker", 2023-12-03T11:44:00.810 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket_id": "bucket-id", 2023-12-03T11:44:00.810 INFO:tasks.workunit.client.0.smithi003.stdout: "tenant": "", 2023-12-03T11:44:00.810 INFO:tasks.workunit.client.0.smithi003.stdout: "explicit_placement": { 2023-12-03T11:44:00.810 INFO:tasks.workunit.client.0.smithi003.stdout: "data_pool": ".data-pool", 2023-12-03T11:44:00.810 INFO:tasks.workunit.client.0.smithi003.stdout: "data_extra_pool": "", 2023-12-03T11:44:00.810 INFO:tasks.workunit.client.0.smithi003.stdout: "index_pool": ".index-pool" 2023-12-03T11:44:00.810 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.810 INFO:tasks.workunit.client.0.smithi003.stdout: }, 2023-12-03T11:44:00.811 INFO:tasks.workunit.client.0.smithi003.stdout: "key": { 2023-12-03T11:44:00.811 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "myobj", 2023-12-03T11:44:00.811 INFO:tasks.workunit.client.0.smithi003.stdout: "instance": "", 2023-12-03T11:44:00.811 INFO:tasks.workunit.client.0.smithi003.stdout: "ns": "" 2023-12-03T11:44:00.811 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.811 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.811 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.811 INFO:tasks.workunit.client.0.smithi003.stdout:raw2=.data-pool:marker_myobj 2023-12-03T11:44:00.811 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.811 INFO:tasks.workunit.client.0.smithi003.stdout: "raw_obj": { 2023-12-03T11:44:00.811 INFO:tasks.workunit.client.0.smithi003.stdout: "pool": ".data-pool", 2023-12-03T11:44:00.811 INFO:tasks.workunit.client.0.smithi003.stdout: "oid": "marker__ns_myobj", 2023-12-03T11:44:00.812 INFO:tasks.workunit.client.0.smithi003.stdout: "loc": "" 2023-12-03T11:44:00.812 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.812 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.812 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.812 INFO:tasks.workunit.client.0.smithi003.stdout: "new_obj": { 2023-12-03T11:44:00.812 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket": { 2023-12-03T11:44:00.812 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "ebtest", 2023-12-03T11:44:00.812 INFO:tasks.workunit.client.0.smithi003.stdout: "marker": "marker", 2023-12-03T11:44:00.812 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket_id": "bucket-id", 2023-12-03T11:44:00.812 INFO:tasks.workunit.client.0.smithi003.stdout: "tenant": "", 2023-12-03T11:44:00.812 INFO:tasks.workunit.client.0.smithi003.stdout: "explicit_placement": { 2023-12-03T11:44:00.812 INFO:tasks.workunit.client.0.smithi003.stdout: "data_pool": ".data-pool", 2023-12-03T11:44:00.812 INFO:tasks.workunit.client.0.smithi003.stdout: "data_extra_pool": "", 2023-12-03T11:44:00.812 INFO:tasks.workunit.client.0.smithi003.stdout: "index_pool": ".index-pool" 2023-12-03T11:44:00.812 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.813 INFO:tasks.workunit.client.0.smithi003.stdout: }, 2023-12-03T11:44:00.813 INFO:tasks.workunit.client.0.smithi003.stdout: "key": { 2023-12-03T11:44:00.813 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "myobj", 2023-12-03T11:44:00.813 INFO:tasks.workunit.client.0.smithi003.stdout: "instance": "", 2023-12-03T11:44:00.813 INFO:tasks.workunit.client.0.smithi003.stdout: "ns": "ns" 2023-12-03T11:44:00.813 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.813 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.813 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.813 INFO:tasks.workunit.client.0.smithi003.stdout:raw=.data-pool:marker__ns_myobj 2023-12-03T11:44:00.813 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.813 INFO:tasks.workunit.client.0.smithi003.stdout: "raw_obj2": { 2023-12-03T11:44:00.813 INFO:tasks.workunit.client.0.smithi003.stdout: "pool": ".data-pool", 2023-12-03T11:44:00.813 INFO:tasks.workunit.client.0.smithi003.stdout: "oid": "marker__ns_myobj", 2023-12-03T11:44:00.813 INFO:tasks.workunit.client.0.smithi003.stdout: "loc": "" 2023-12-03T11:44:00.813 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.813 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.814 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.814 INFO:tasks.workunit.client.0.smithi003.stdout: "new_obj2": { 2023-12-03T11:44:00.814 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket": { 2023-12-03T11:44:00.814 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "ebtest", 2023-12-03T11:44:00.814 INFO:tasks.workunit.client.0.smithi003.stdout: "marker": "marker", 2023-12-03T11:44:00.814 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket_id": "bucket-id", 2023-12-03T11:44:00.814 INFO:tasks.workunit.client.0.smithi003.stdout: "tenant": "", 2023-12-03T11:44:00.814 INFO:tasks.workunit.client.0.smithi003.stdout: "explicit_placement": { 2023-12-03T11:44:00.814 INFO:tasks.workunit.client.0.smithi003.stdout: "data_pool": ".data-pool", 2023-12-03T11:44:00.814 INFO:tasks.workunit.client.0.smithi003.stdout: "data_extra_pool": "", 2023-12-03T11:44:00.814 INFO:tasks.workunit.client.0.smithi003.stdout: "index_pool": ".index-pool" 2023-12-03T11:44:00.814 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.814 INFO:tasks.workunit.client.0.smithi003.stdout: }, 2023-12-03T11:44:00.815 INFO:tasks.workunit.client.0.smithi003.stdout: "key": { 2023-12-03T11:44:00.815 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "myobj", 2023-12-03T11:44:00.815 INFO:tasks.workunit.client.0.smithi003.stdout: "instance": "", 2023-12-03T11:44:00.815 INFO:tasks.workunit.client.0.smithi003.stdout: "ns": "ns" 2023-12-03T11:44:00.817 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.817 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.817 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.817 INFO:tasks.workunit.client.0.smithi003.stdout:raw2=.data-pool:marker__ns_myobj 2023-12-03T11:44:00.817 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.817 INFO:tasks.workunit.client.0.smithi003.stdout: "raw_obj": { 2023-12-03T11:44:00.817 INFO:tasks.workunit.client.0.smithi003.stdout: "pool": ".data-pool", 2023-12-03T11:44:00.817 INFO:tasks.workunit.client.0.smithi003.stdout: "oid": "marker__:inst_myobj", 2023-12-03T11:44:00.817 INFO:tasks.workunit.client.0.smithi003.stdout: "loc": "" 2023-12-03T11:44:00.817 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.817 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.818 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.818 INFO:tasks.workunit.client.0.smithi003.stdout: "new_obj": { 2023-12-03T11:44:00.818 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket": { 2023-12-03T11:44:00.818 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "ebtest", 2023-12-03T11:44:00.818 INFO:tasks.workunit.client.0.smithi003.stdout: "marker": "marker", 2023-12-03T11:44:00.818 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket_id": "bucket-id", 2023-12-03T11:44:00.818 INFO:tasks.workunit.client.0.smithi003.stdout: "tenant": "", 2023-12-03T11:44:00.818 INFO:tasks.workunit.client.0.smithi003.stdout: "explicit_placement": { 2023-12-03T11:44:00.818 INFO:tasks.workunit.client.0.smithi003.stdout: "data_pool": ".data-pool", 2023-12-03T11:44:00.818 INFO:tasks.workunit.client.0.smithi003.stdout: "data_extra_pool": "", 2023-12-03T11:44:00.818 INFO:tasks.workunit.client.0.smithi003.stdout: "index_pool": ".index-pool" 2023-12-03T11:44:00.818 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.818 INFO:tasks.workunit.client.0.smithi003.stdout: }, 2023-12-03T11:44:00.818 INFO:tasks.workunit.client.0.smithi003.stdout: "key": { 2023-12-03T11:44:00.819 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "myobj", 2023-12-03T11:44:00.819 INFO:tasks.workunit.client.0.smithi003.stdout: "instance": "inst", 2023-12-03T11:44:00.819 INFO:tasks.workunit.client.0.smithi003.stdout: "ns": "" 2023-12-03T11:44:00.819 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.819 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.819 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.819 INFO:tasks.workunit.client.0.smithi003.stdout:raw=.data-pool:marker__:inst_myobj 2023-12-03T11:44:00.819 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.819 INFO:tasks.workunit.client.0.smithi003.stdout: "raw_obj2": { 2023-12-03T11:44:00.819 INFO:tasks.workunit.client.0.smithi003.stdout: "pool": ".data-pool", 2023-12-03T11:44:00.819 INFO:tasks.workunit.client.0.smithi003.stdout: "oid": "marker__:inst_myobj", 2023-12-03T11:44:00.819 INFO:tasks.workunit.client.0.smithi003.stdout: "loc": "" 2023-12-03T11:44:00.819 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.819 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.819 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.820 INFO:tasks.workunit.client.0.smithi003.stdout: "new_obj2": { 2023-12-03T11:44:00.820 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket": { 2023-12-03T11:44:00.820 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "ebtest", 2023-12-03T11:44:00.820 INFO:tasks.workunit.client.0.smithi003.stdout: "marker": "marker", 2023-12-03T11:44:00.820 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket_id": "bucket-id", 2023-12-03T11:44:00.820 INFO:tasks.workunit.client.0.smithi003.stdout: "tenant": "", 2023-12-03T11:44:00.820 INFO:tasks.workunit.client.0.smithi003.stdout: "explicit_placement": { 2023-12-03T11:44:00.820 INFO:tasks.workunit.client.0.smithi003.stdout: "data_pool": ".data-pool", 2023-12-03T11:44:00.820 INFO:tasks.workunit.client.0.smithi003.stdout: "data_extra_pool": "", 2023-12-03T11:44:00.820 INFO:tasks.workunit.client.0.smithi003.stdout: "index_pool": ".index-pool" 2023-12-03T11:44:00.820 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.820 INFO:tasks.workunit.client.0.smithi003.stdout: }, 2023-12-03T11:44:00.820 INFO:tasks.workunit.client.0.smithi003.stdout: "key": { 2023-12-03T11:44:00.820 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "myobj", 2023-12-03T11:44:00.820 INFO:tasks.workunit.client.0.smithi003.stdout: "instance": "inst", 2023-12-03T11:44:00.821 INFO:tasks.workunit.client.0.smithi003.stdout: "ns": "" 2023-12-03T11:44:00.821 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.821 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.821 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.821 INFO:tasks.workunit.client.0.smithi003.stdout:raw2=.data-pool:marker__:inst_myobj 2023-12-03T11:44:00.821 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.821 INFO:tasks.workunit.client.0.smithi003.stdout: "raw_obj": { 2023-12-03T11:44:00.821 INFO:tasks.workunit.client.0.smithi003.stdout: "pool": ".data-pool", 2023-12-03T11:44:00.821 INFO:tasks.workunit.client.0.smithi003.stdout: "oid": "marker__ns:inst_myobj", 2023-12-03T11:44:00.821 INFO:tasks.workunit.client.0.smithi003.stdout: "loc": "" 2023-12-03T11:44:00.822 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.822 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.822 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.822 INFO:tasks.workunit.client.0.smithi003.stdout: "new_obj": { 2023-12-03T11:44:00.822 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket": { 2023-12-03T11:44:00.822 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "ebtest", 2023-12-03T11:44:00.822 INFO:tasks.workunit.client.0.smithi003.stdout: "marker": "marker", 2023-12-03T11:44:00.822 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket_id": "bucket-id", 2023-12-03T11:44:00.822 INFO:tasks.workunit.client.0.smithi003.stdout: "tenant": "", 2023-12-03T11:44:00.822 INFO:tasks.workunit.client.0.smithi003.stdout: "explicit_placement": { 2023-12-03T11:44:00.822 INFO:tasks.workunit.client.0.smithi003.stdout: "data_pool": ".data-pool", 2023-12-03T11:44:00.822 INFO:tasks.workunit.client.0.smithi003.stdout: "data_extra_pool": "", 2023-12-03T11:44:00.822 INFO:tasks.workunit.client.0.smithi003.stdout: "index_pool": ".index-pool" 2023-12-03T11:44:00.822 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.822 INFO:tasks.workunit.client.0.smithi003.stdout: }, 2023-12-03T11:44:00.823 INFO:tasks.workunit.client.0.smithi003.stdout: "key": { 2023-12-03T11:44:00.823 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "myobj", 2023-12-03T11:44:00.823 INFO:tasks.workunit.client.0.smithi003.stdout: "instance": "inst", 2023-12-03T11:44:00.823 INFO:tasks.workunit.client.0.smithi003.stdout: "ns": "ns" 2023-12-03T11:44:00.823 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.823 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.823 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.823 INFO:tasks.workunit.client.0.smithi003.stdout:raw=.data-pool:marker__ns:inst_myobj 2023-12-03T11:44:00.823 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.823 INFO:tasks.workunit.client.0.smithi003.stdout: "raw_obj2": { 2023-12-03T11:44:00.823 INFO:tasks.workunit.client.0.smithi003.stdout: "pool": ".data-pool", 2023-12-03T11:44:00.823 INFO:tasks.workunit.client.0.smithi003.stdout: "oid": "marker__ns:inst_myobj", 2023-12-03T11:44:00.823 INFO:tasks.workunit.client.0.smithi003.stdout: "loc": "" 2023-12-03T11:44:00.823 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.824 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.824 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.824 INFO:tasks.workunit.client.0.smithi003.stdout: "new_obj2": { 2023-12-03T11:44:00.824 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket": { 2023-12-03T11:44:00.824 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "ebtest", 2023-12-03T11:44:00.824 INFO:tasks.workunit.client.0.smithi003.stdout: "marker": "marker", 2023-12-03T11:44:00.824 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket_id": "bucket-id", 2023-12-03T11:44:00.824 INFO:tasks.workunit.client.0.smithi003.stdout: "tenant": "", 2023-12-03T11:44:00.824 INFO:tasks.workunit.client.0.smithi003.stdout: "explicit_placement": { 2023-12-03T11:44:00.824 INFO:tasks.workunit.client.0.smithi003.stdout: "data_pool": ".data-pool", 2023-12-03T11:44:00.824 INFO:tasks.workunit.client.0.smithi003.stdout: "data_extra_pool": "", 2023-12-03T11:44:00.824 INFO:tasks.workunit.client.0.smithi003.stdout: "index_pool": ".index-pool" 2023-12-03T11:44:00.824 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.824 INFO:tasks.workunit.client.0.smithi003.stdout: }, 2023-12-03T11:44:00.824 INFO:tasks.workunit.client.0.smithi003.stdout: "key": { 2023-12-03T11:44:00.824 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "myobj", 2023-12-03T11:44:00.825 INFO:tasks.workunit.client.0.smithi003.stdout: "instance": "inst", 2023-12-03T11:44:00.825 INFO:tasks.workunit.client.0.smithi003.stdout: "ns": "ns" 2023-12-03T11:44:00.825 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.825 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.825 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.825 INFO:tasks.workunit.client.0.smithi003.stdout:raw2=.data-pool:marker__ns:inst_myobj 2023-12-03T11:44:00.825 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.825 INFO:tasks.workunit.client.0.smithi003.stdout: "raw_obj": { 2023-12-03T11:44:00.825 INFO:tasks.workunit.client.0.smithi003.stdout: "pool": ".data-pool", 2023-12-03T11:44:00.825 INFO:tasks.workunit.client.0.smithi003.stdout: "oid": "marker___myobj", 2023-12-03T11:44:00.825 INFO:tasks.workunit.client.0.smithi003.stdout: "loc": "marker__myobj" 2023-12-03T11:44:00.825 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.825 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.825 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.825 INFO:tasks.workunit.client.0.smithi003.stdout: "new_obj": { 2023-12-03T11:44:00.826 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket": { 2023-12-03T11:44:00.826 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "ebtest", 2023-12-03T11:44:00.826 INFO:tasks.workunit.client.0.smithi003.stdout: "marker": "marker", 2023-12-03T11:44:00.826 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket_id": "bucket-id", 2023-12-03T11:44:00.826 INFO:tasks.workunit.client.0.smithi003.stdout: "tenant": "", 2023-12-03T11:44:00.826 INFO:tasks.workunit.client.0.smithi003.stdout: "explicit_placement": { 2023-12-03T11:44:00.826 INFO:tasks.workunit.client.0.smithi003.stdout: "data_pool": ".data-pool", 2023-12-03T11:44:00.826 INFO:tasks.workunit.client.0.smithi003.stdout: "data_extra_pool": "", 2023-12-03T11:44:00.826 INFO:tasks.workunit.client.0.smithi003.stdout: "index_pool": ".index-pool" 2023-12-03T11:44:00.826 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.826 INFO:tasks.workunit.client.0.smithi003.stdout: }, 2023-12-03T11:44:00.826 INFO:tasks.workunit.client.0.smithi003.stdout: "key": { 2023-12-03T11:44:00.826 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "_myobj", 2023-12-03T11:44:00.826 INFO:tasks.workunit.client.0.smithi003.stdout: "instance": "", 2023-12-03T11:44:00.826 INFO:tasks.workunit.client.0.smithi003.stdout: "ns": "" 2023-12-03T11:44:00.827 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.827 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.827 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.827 INFO:tasks.workunit.client.0.smithi003.stdout:raw=.data-pool:marker___myobj 2023-12-03T11:44:00.827 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.827 INFO:tasks.workunit.client.0.smithi003.stdout: "raw_obj2": { 2023-12-03T11:44:00.827 INFO:tasks.workunit.client.0.smithi003.stdout: "pool": ".data-pool", 2023-12-03T11:44:00.827 INFO:tasks.workunit.client.0.smithi003.stdout: "oid": "marker___myobj", 2023-12-03T11:44:00.827 INFO:tasks.workunit.client.0.smithi003.stdout: "loc": "marker__myobj" 2023-12-03T11:44:00.827 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.827 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.827 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.827 INFO:tasks.workunit.client.0.smithi003.stdout: "new_obj2": { 2023-12-03T11:44:00.827 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket": { 2023-12-03T11:44:00.827 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "ebtest", 2023-12-03T11:44:00.828 INFO:tasks.workunit.client.0.smithi003.stdout: "marker": "marker", 2023-12-03T11:44:00.828 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket_id": "bucket-id", 2023-12-03T11:44:00.828 INFO:tasks.workunit.client.0.smithi003.stdout: "tenant": "", 2023-12-03T11:44:00.828 INFO:tasks.workunit.client.0.smithi003.stdout: "explicit_placement": { 2023-12-03T11:44:00.828 INFO:tasks.workunit.client.0.smithi003.stdout: "data_pool": ".data-pool", 2023-12-03T11:44:00.828 INFO:tasks.workunit.client.0.smithi003.stdout: "data_extra_pool": "", 2023-12-03T11:44:00.828 INFO:tasks.workunit.client.0.smithi003.stdout: "index_pool": ".index-pool" 2023-12-03T11:44:00.828 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.828 INFO:tasks.workunit.client.0.smithi003.stdout: }, 2023-12-03T11:44:00.828 INFO:tasks.workunit.client.0.smithi003.stdout: "key": { 2023-12-03T11:44:00.828 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "_myobj", 2023-12-03T11:44:00.828 INFO:tasks.workunit.client.0.smithi003.stdout: "instance": "", 2023-12-03T11:44:00.828 INFO:tasks.workunit.client.0.smithi003.stdout: "ns": "" 2023-12-03T11:44:00.828 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.828 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.829 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.829 INFO:tasks.workunit.client.0.smithi003.stdout:raw2=.data-pool:marker___myobj 2023-12-03T11:44:00.829 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.829 INFO:tasks.workunit.client.0.smithi003.stdout: "raw_obj": { 2023-12-03T11:44:00.829 INFO:tasks.workunit.client.0.smithi003.stdout: "pool": ".data-pool", 2023-12-03T11:44:00.829 INFO:tasks.workunit.client.0.smithi003.stdout: "oid": "marker__ns__myobj", 2023-12-03T11:44:00.829 INFO:tasks.workunit.client.0.smithi003.stdout: "loc": "" 2023-12-03T11:44:00.829 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.829 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.829 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.829 INFO:tasks.workunit.client.0.smithi003.stdout: "new_obj": { 2023-12-03T11:44:00.829 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket": { 2023-12-03T11:44:00.829 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "ebtest", 2023-12-03T11:44:00.829 INFO:tasks.workunit.client.0.smithi003.stdout: "marker": "marker", 2023-12-03T11:44:00.829 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket_id": "bucket-id", 2023-12-03T11:44:00.830 INFO:tasks.workunit.client.0.smithi003.stdout: "tenant": "", 2023-12-03T11:44:00.830 INFO:tasks.workunit.client.0.smithi003.stdout: "explicit_placement": { 2023-12-03T11:44:00.830 INFO:tasks.workunit.client.0.smithi003.stdout: "data_pool": ".data-pool", 2023-12-03T11:44:00.830 INFO:tasks.workunit.client.0.smithi003.stdout: "data_extra_pool": "", 2023-12-03T11:44:00.830 INFO:tasks.workunit.client.0.smithi003.stdout: "index_pool": ".index-pool" 2023-12-03T11:44:00.830 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.830 INFO:tasks.workunit.client.0.smithi003.stdout: }, 2023-12-03T11:44:00.830 INFO:tasks.workunit.client.0.smithi003.stdout: "key": { 2023-12-03T11:44:00.830 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "_myobj", 2023-12-03T11:44:00.830 INFO:tasks.workunit.client.0.smithi003.stdout: "instance": "", 2023-12-03T11:44:00.830 INFO:tasks.workunit.client.0.smithi003.stdout: "ns": "ns" 2023-12-03T11:44:00.830 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.830 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.830 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.830 INFO:tasks.workunit.client.0.smithi003.stdout:raw=.data-pool:marker__ns__myobj 2023-12-03T11:44:00.831 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.831 INFO:tasks.workunit.client.0.smithi003.stdout: "raw_obj2": { 2023-12-03T11:44:00.831 INFO:tasks.workunit.client.0.smithi003.stdout: "pool": ".data-pool", 2023-12-03T11:44:00.831 INFO:tasks.workunit.client.0.smithi003.stdout: "oid": "marker__ns__myobj", 2023-12-03T11:44:00.831 INFO:tasks.workunit.client.0.smithi003.stdout: "loc": "" 2023-12-03T11:44:00.831 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.831 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.831 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.831 INFO:tasks.workunit.client.0.smithi003.stdout: "new_obj2": { 2023-12-03T11:44:00.831 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket": { 2023-12-03T11:44:00.831 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "ebtest", 2023-12-03T11:44:00.831 INFO:tasks.workunit.client.0.smithi003.stdout: "marker": "marker", 2023-12-03T11:44:00.831 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket_id": "bucket-id", 2023-12-03T11:44:00.831 INFO:tasks.workunit.client.0.smithi003.stdout: "tenant": "", 2023-12-03T11:44:00.831 INFO:tasks.workunit.client.0.smithi003.stdout: "explicit_placement": { 2023-12-03T11:44:00.832 INFO:tasks.workunit.client.0.smithi003.stdout: "data_pool": ".data-pool", 2023-12-03T11:44:00.832 INFO:tasks.workunit.client.0.smithi003.stdout: "data_extra_pool": "", 2023-12-03T11:44:00.832 INFO:tasks.workunit.client.0.smithi003.stdout: "index_pool": ".index-pool" 2023-12-03T11:44:00.832 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.832 INFO:tasks.workunit.client.0.smithi003.stdout: }, 2023-12-03T11:44:00.832 INFO:tasks.workunit.client.0.smithi003.stdout: "key": { 2023-12-03T11:44:00.832 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "_myobj", 2023-12-03T11:44:00.832 INFO:tasks.workunit.client.0.smithi003.stdout: "instance": "", 2023-12-03T11:44:00.832 INFO:tasks.workunit.client.0.smithi003.stdout: "ns": "ns" 2023-12-03T11:44:00.832 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.832 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.832 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.832 INFO:tasks.workunit.client.0.smithi003.stdout:raw2=.data-pool:marker__ns__myobj 2023-12-03T11:44:00.832 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.832 INFO:tasks.workunit.client.0.smithi003.stdout: "raw_obj": { 2023-12-03T11:44:00.833 INFO:tasks.workunit.client.0.smithi003.stdout: "pool": ".data-pool", 2023-12-03T11:44:00.833 INFO:tasks.workunit.client.0.smithi003.stdout: "oid": "marker__:inst__myobj", 2023-12-03T11:44:00.833 INFO:tasks.workunit.client.0.smithi003.stdout: "loc": "marker__myobj" 2023-12-03T11:44:00.833 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.833 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.833 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.833 INFO:tasks.workunit.client.0.smithi003.stdout: "new_obj": { 2023-12-03T11:44:00.833 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket": { 2023-12-03T11:44:00.833 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "ebtest", 2023-12-03T11:44:00.833 INFO:tasks.workunit.client.0.smithi003.stdout: "marker": "marker", 2023-12-03T11:44:00.833 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket_id": "bucket-id", 2023-12-03T11:44:00.834 INFO:tasks.workunit.client.0.smithi003.stdout: "tenant": "", 2023-12-03T11:44:00.834 INFO:tasks.workunit.client.0.smithi003.stdout: "explicit_placement": { 2023-12-03T11:44:00.834 INFO:tasks.workunit.client.0.smithi003.stdout: "data_pool": ".data-pool", 2023-12-03T11:44:00.834 INFO:tasks.workunit.client.0.smithi003.stdout: "data_extra_pool": "", 2023-12-03T11:44:00.834 INFO:tasks.workunit.client.0.smithi003.stdout: "index_pool": ".index-pool" 2023-12-03T11:44:00.834 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.834 INFO:tasks.workunit.client.0.smithi003.stdout: }, 2023-12-03T11:44:00.834 INFO:tasks.workunit.client.0.smithi003.stdout: "key": { 2023-12-03T11:44:00.834 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "_myobj", 2023-12-03T11:44:00.834 INFO:tasks.workunit.client.0.smithi003.stdout: "instance": "inst", 2023-12-03T11:44:00.834 INFO:tasks.workunit.client.0.smithi003.stdout: "ns": "" 2023-12-03T11:44:00.834 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.834 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.834 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.835 INFO:tasks.workunit.client.0.smithi003.stdout:raw=.data-pool:marker__:inst__myobj 2023-12-03T11:44:00.835 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.835 INFO:tasks.workunit.client.0.smithi003.stdout: "raw_obj2": { 2023-12-03T11:44:00.835 INFO:tasks.workunit.client.0.smithi003.stdout: "pool": ".data-pool", 2023-12-03T11:44:00.835 INFO:tasks.workunit.client.0.smithi003.stdout: "oid": "marker__:inst__myobj", 2023-12-03T11:44:00.835 INFO:tasks.workunit.client.0.smithi003.stdout: "loc": "marker__myobj" 2023-12-03T11:44:00.835 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.835 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.835 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.835 INFO:tasks.workunit.client.0.smithi003.stdout: "new_obj2": { 2023-12-03T11:44:00.835 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket": { 2023-12-03T11:44:00.835 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "ebtest", 2023-12-03T11:44:00.835 INFO:tasks.workunit.client.0.smithi003.stdout: "marker": "marker", 2023-12-03T11:44:00.836 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket_id": "bucket-id", 2023-12-03T11:44:00.836 INFO:tasks.workunit.client.0.smithi003.stdout: "tenant": "", 2023-12-03T11:44:00.836 INFO:tasks.workunit.client.0.smithi003.stdout: "explicit_placement": { 2023-12-03T11:44:00.836 INFO:tasks.workunit.client.0.smithi003.stdout: "data_pool": ".data-pool", 2023-12-03T11:44:00.836 INFO:tasks.workunit.client.0.smithi003.stdout: "data_extra_pool": "", 2023-12-03T11:44:00.836 INFO:tasks.workunit.client.0.smithi003.stdout: "index_pool": ".index-pool" 2023-12-03T11:44:00.836 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.836 INFO:tasks.workunit.client.0.smithi003.stdout: }, 2023-12-03T11:44:00.836 INFO:tasks.workunit.client.0.smithi003.stdout: "key": { 2023-12-03T11:44:00.836 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "_myobj", 2023-12-03T11:44:00.836 INFO:tasks.workunit.client.0.smithi003.stdout: "instance": "inst", 2023-12-03T11:44:00.836 INFO:tasks.workunit.client.0.smithi003.stdout: "ns": "" 2023-12-03T11:44:00.836 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.836 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.836 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.837 INFO:tasks.workunit.client.0.smithi003.stdout:raw2=.data-pool:marker__:inst__myobj 2023-12-03T11:44:00.837 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.837 INFO:tasks.workunit.client.0.smithi003.stdout: "raw_obj": { 2023-12-03T11:44:00.837 INFO:tasks.workunit.client.0.smithi003.stdout: "pool": ".data-pool", 2023-12-03T11:44:00.837 INFO:tasks.workunit.client.0.smithi003.stdout: "oid": "marker__ns:inst__myobj", 2023-12-03T11:44:00.837 INFO:tasks.workunit.client.0.smithi003.stdout: "loc": "" 2023-12-03T11:44:00.837 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.837 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.837 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.837 INFO:tasks.workunit.client.0.smithi003.stdout: "new_obj": { 2023-12-03T11:44:00.837 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket": { 2023-12-03T11:44:00.837 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "ebtest", 2023-12-03T11:44:00.837 INFO:tasks.workunit.client.0.smithi003.stdout: "marker": "marker", 2023-12-03T11:44:00.837 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket_id": "bucket-id", 2023-12-03T11:44:00.838 INFO:tasks.workunit.client.0.smithi003.stdout: "tenant": "", 2023-12-03T11:44:00.838 INFO:tasks.workunit.client.0.smithi003.stdout: "explicit_placement": { 2023-12-03T11:44:00.838 INFO:tasks.workunit.client.0.smithi003.stdout: "data_pool": ".data-pool", 2023-12-03T11:44:00.838 INFO:tasks.workunit.client.0.smithi003.stdout: "data_extra_pool": "", 2023-12-03T11:44:00.838 INFO:tasks.workunit.client.0.smithi003.stdout: "index_pool": ".index-pool" 2023-12-03T11:44:00.838 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.838 INFO:tasks.workunit.client.0.smithi003.stdout: }, 2023-12-03T11:44:00.838 INFO:tasks.workunit.client.0.smithi003.stdout: "key": { 2023-12-03T11:44:00.838 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "_myobj", 2023-12-03T11:44:00.838 INFO:tasks.workunit.client.0.smithi003.stdout: "instance": "inst", 2023-12-03T11:44:00.838 INFO:tasks.workunit.client.0.smithi003.stdout: "ns": "ns" 2023-12-03T11:44:00.838 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.838 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.838 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.838 INFO:tasks.workunit.client.0.smithi003.stdout:raw=.data-pool:marker__ns:inst__myobj 2023-12-03T11:44:00.839 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.839 INFO:tasks.workunit.client.0.smithi003.stdout: "raw_obj2": { 2023-12-03T11:44:00.839 INFO:tasks.workunit.client.0.smithi003.stdout: "pool": ".data-pool", 2023-12-03T11:44:00.839 INFO:tasks.workunit.client.0.smithi003.stdout: "oid": "marker__ns:inst__myobj", 2023-12-03T11:44:00.839 INFO:tasks.workunit.client.0.smithi003.stdout: "loc": "" 2023-12-03T11:44:00.839 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.839 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.839 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.839 INFO:tasks.workunit.client.0.smithi003.stdout: "new_obj2": { 2023-12-03T11:44:00.839 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket": { 2023-12-03T11:44:00.839 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "ebtest", 2023-12-03T11:44:00.839 INFO:tasks.workunit.client.0.smithi003.stdout: "marker": "marker", 2023-12-03T11:44:00.839 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket_id": "bucket-id", 2023-12-03T11:44:00.839 INFO:tasks.workunit.client.0.smithi003.stdout: "tenant": "", 2023-12-03T11:44:00.840 INFO:tasks.workunit.client.0.smithi003.stdout: "explicit_placement": { 2023-12-03T11:44:00.840 INFO:tasks.workunit.client.0.smithi003.stdout: "data_pool": ".data-pool", 2023-12-03T11:44:00.840 INFO:tasks.workunit.client.0.smithi003.stdout: "data_extra_pool": "", 2023-12-03T11:44:00.840 INFO:tasks.workunit.client.0.smithi003.stdout: "index_pool": ".index-pool" 2023-12-03T11:44:00.840 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.840 INFO:tasks.workunit.client.0.smithi003.stdout: }, 2023-12-03T11:44:00.840 INFO:tasks.workunit.client.0.smithi003.stdout: "key": { 2023-12-03T11:44:00.840 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "_myobj", 2023-12-03T11:44:00.840 INFO:tasks.workunit.client.0.smithi003.stdout: "instance": "inst", 2023-12-03T11:44:00.840 INFO:tasks.workunit.client.0.smithi003.stdout: "ns": "ns" 2023-12-03T11:44:00.840 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.840 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.840 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.840 INFO:tasks.workunit.client.0.smithi003.stdout:raw2=.data-pool:marker__ns:inst__myobj 2023-12-03T11:44:00.840 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.841 INFO:tasks.workunit.client.0.smithi003.stdout: "raw_obj": { 2023-12-03T11:44:00.841 INFO:tasks.workunit.client.0.smithi003.stdout: "pool": ".data-pool", 2023-12-03T11:44:00.841 INFO:tasks.workunit.client.0.smithi003.stdout: "oid": "marker___myobj_", 2023-12-03T11:44:00.841 INFO:tasks.workunit.client.0.smithi003.stdout: "loc": "marker__myobj_" 2023-12-03T11:44:00.841 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.841 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.841 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.841 INFO:tasks.workunit.client.0.smithi003.stdout: "new_obj": { 2023-12-03T11:44:00.841 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket": { 2023-12-03T11:44:00.841 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "ebtest", 2023-12-03T11:44:00.841 INFO:tasks.workunit.client.0.smithi003.stdout: "marker": "marker", 2023-12-03T11:44:00.841 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket_id": "bucket-id", 2023-12-03T11:44:00.841 INFO:tasks.workunit.client.0.smithi003.stdout: "tenant": "", 2023-12-03T11:44:00.841 INFO:tasks.workunit.client.0.smithi003.stdout: "explicit_placement": { 2023-12-03T11:44:00.841 INFO:tasks.workunit.client.0.smithi003.stdout: "data_pool": ".data-pool", 2023-12-03T11:44:00.842 INFO:tasks.workunit.client.0.smithi003.stdout: "data_extra_pool": "", 2023-12-03T11:44:00.842 INFO:tasks.workunit.client.0.smithi003.stdout: "index_pool": ".index-pool" 2023-12-03T11:44:00.842 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.842 INFO:tasks.workunit.client.0.smithi003.stdout: }, 2023-12-03T11:44:00.842 INFO:tasks.workunit.client.0.smithi003.stdout: "key": { 2023-12-03T11:44:00.842 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "_myobj_", 2023-12-03T11:44:00.842 INFO:tasks.workunit.client.0.smithi003.stdout: "instance": "", 2023-12-03T11:44:00.842 INFO:tasks.workunit.client.0.smithi003.stdout: "ns": "" 2023-12-03T11:44:00.842 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.842 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.842 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.842 INFO:tasks.workunit.client.0.smithi003.stdout:raw=.data-pool:marker___myobj_ 2023-12-03T11:44:00.842 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.842 INFO:tasks.workunit.client.0.smithi003.stdout: "raw_obj2": { 2023-12-03T11:44:00.843 INFO:tasks.workunit.client.0.smithi003.stdout: "pool": ".data-pool", 2023-12-03T11:44:00.843 INFO:tasks.workunit.client.0.smithi003.stdout: "oid": "marker___myobj_", 2023-12-03T11:44:00.843 INFO:tasks.workunit.client.0.smithi003.stdout: "loc": "marker__myobj_" 2023-12-03T11:44:00.843 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.843 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.843 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.843 INFO:tasks.workunit.client.0.smithi003.stdout: "new_obj2": { 2023-12-03T11:44:00.843 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket": { 2023-12-03T11:44:00.843 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "ebtest", 2023-12-03T11:44:00.843 INFO:tasks.workunit.client.0.smithi003.stdout: "marker": "marker", 2023-12-03T11:44:00.843 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket_id": "bucket-id", 2023-12-03T11:44:00.843 INFO:tasks.workunit.client.0.smithi003.stdout: "tenant": "", 2023-12-03T11:44:00.843 INFO:tasks.workunit.client.0.smithi003.stdout: "explicit_placement": { 2023-12-03T11:44:00.843 INFO:tasks.workunit.client.0.smithi003.stdout: "data_pool": ".data-pool", 2023-12-03T11:44:00.843 INFO:tasks.workunit.client.0.smithi003.stdout: "data_extra_pool": "", 2023-12-03T11:44:00.844 INFO:tasks.workunit.client.0.smithi003.stdout: "index_pool": ".index-pool" 2023-12-03T11:44:00.844 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.844 INFO:tasks.workunit.client.0.smithi003.stdout: }, 2023-12-03T11:44:00.844 INFO:tasks.workunit.client.0.smithi003.stdout: "key": { 2023-12-03T11:44:00.844 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "_myobj_", 2023-12-03T11:44:00.844 INFO:tasks.workunit.client.0.smithi003.stdout: "instance": "", 2023-12-03T11:44:00.844 INFO:tasks.workunit.client.0.smithi003.stdout: "ns": "" 2023-12-03T11:44:00.844 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.844 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.844 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.844 INFO:tasks.workunit.client.0.smithi003.stdout:raw2=.data-pool:marker___myobj_ 2023-12-03T11:44:00.844 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.844 INFO:tasks.workunit.client.0.smithi003.stdout: "raw_obj": { 2023-12-03T11:44:00.844 INFO:tasks.workunit.client.0.smithi003.stdout: "pool": ".data-pool", 2023-12-03T11:44:00.844 INFO:tasks.workunit.client.0.smithi003.stdout: "oid": "marker__ns__myobj_", 2023-12-03T11:44:00.845 INFO:tasks.workunit.client.0.smithi003.stdout: "loc": "" 2023-12-03T11:44:00.845 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.845 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.845 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.845 INFO:tasks.workunit.client.0.smithi003.stdout: "new_obj": { 2023-12-03T11:44:00.845 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket": { 2023-12-03T11:44:00.845 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "ebtest", 2023-12-03T11:44:00.845 INFO:tasks.workunit.client.0.smithi003.stdout: "marker": "marker", 2023-12-03T11:44:00.845 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket_id": "bucket-id", 2023-12-03T11:44:00.845 INFO:tasks.workunit.client.0.smithi003.stdout: "tenant": "", 2023-12-03T11:44:00.845 INFO:tasks.workunit.client.0.smithi003.stdout: "explicit_placement": { 2023-12-03T11:44:00.845 INFO:tasks.workunit.client.0.smithi003.stdout: "data_pool": ".data-pool", 2023-12-03T11:44:00.845 INFO:tasks.workunit.client.0.smithi003.stdout: "data_extra_pool": "", 2023-12-03T11:44:00.845 INFO:tasks.workunit.client.0.smithi003.stdout: "index_pool": ".index-pool" 2023-12-03T11:44:00.845 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.846 INFO:tasks.workunit.client.0.smithi003.stdout: }, 2023-12-03T11:44:00.846 INFO:tasks.workunit.client.0.smithi003.stdout: "key": { 2023-12-03T11:44:00.846 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "_myobj_", 2023-12-03T11:44:00.846 INFO:tasks.workunit.client.0.smithi003.stdout: "instance": "", 2023-12-03T11:44:00.846 INFO:tasks.workunit.client.0.smithi003.stdout: "ns": "ns" 2023-12-03T11:44:00.846 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.846 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.846 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.846 INFO:tasks.workunit.client.0.smithi003.stdout:raw=.data-pool:marker__ns__myobj_ 2023-12-03T11:44:00.846 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.846 INFO:tasks.workunit.client.0.smithi003.stdout: "raw_obj2": { 2023-12-03T11:44:00.846 INFO:tasks.workunit.client.0.smithi003.stdout: "pool": ".data-pool", 2023-12-03T11:44:00.846 INFO:tasks.workunit.client.0.smithi003.stdout: "oid": "marker__ns__myobj_", 2023-12-03T11:44:00.846 INFO:tasks.workunit.client.0.smithi003.stdout: "loc": "" 2023-12-03T11:44:00.846 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.847 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.847 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.847 INFO:tasks.workunit.client.0.smithi003.stdout: "new_obj2": { 2023-12-03T11:44:00.847 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket": { 2023-12-03T11:44:00.847 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "ebtest", 2023-12-03T11:44:00.847 INFO:tasks.workunit.client.0.smithi003.stdout: "marker": "marker", 2023-12-03T11:44:00.847 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket_id": "bucket-id", 2023-12-03T11:44:00.847 INFO:tasks.workunit.client.0.smithi003.stdout: "tenant": "", 2023-12-03T11:44:00.847 INFO:tasks.workunit.client.0.smithi003.stdout: "explicit_placement": { 2023-12-03T11:44:00.847 INFO:tasks.workunit.client.0.smithi003.stdout: "data_pool": ".data-pool", 2023-12-03T11:44:00.847 INFO:tasks.workunit.client.0.smithi003.stdout: "data_extra_pool": "", 2023-12-03T11:44:00.847 INFO:tasks.workunit.client.0.smithi003.stdout: "index_pool": ".index-pool" 2023-12-03T11:44:00.847 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.847 INFO:tasks.workunit.client.0.smithi003.stdout: }, 2023-12-03T11:44:00.847 INFO:tasks.workunit.client.0.smithi003.stdout: "key": { 2023-12-03T11:44:00.848 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "_myobj_", 2023-12-03T11:44:00.848 INFO:tasks.workunit.client.0.smithi003.stdout: "instance": "", 2023-12-03T11:44:00.848 INFO:tasks.workunit.client.0.smithi003.stdout: "ns": "ns" 2023-12-03T11:44:00.848 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.848 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.848 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.848 INFO:tasks.workunit.client.0.smithi003.stdout:raw2=.data-pool:marker__ns__myobj_ 2023-12-03T11:44:00.848 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.848 INFO:tasks.workunit.client.0.smithi003.stdout: "raw_obj": { 2023-12-03T11:44:00.848 INFO:tasks.workunit.client.0.smithi003.stdout: "pool": ".data-pool", 2023-12-03T11:44:00.848 INFO:tasks.workunit.client.0.smithi003.stdout: "oid": "marker__:inst__myobj_", 2023-12-03T11:44:00.848 INFO:tasks.workunit.client.0.smithi003.stdout: "loc": "marker__myobj_" 2023-12-03T11:44:00.848 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.848 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.848 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.848 INFO:tasks.workunit.client.0.smithi003.stdout: "new_obj": { 2023-12-03T11:44:00.849 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket": { 2023-12-03T11:44:00.849 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "ebtest", 2023-12-03T11:44:00.849 INFO:tasks.workunit.client.0.smithi003.stdout: "marker": "marker", 2023-12-03T11:44:00.849 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket_id": "bucket-id", 2023-12-03T11:44:00.849 INFO:tasks.workunit.client.0.smithi003.stdout: "tenant": "", 2023-12-03T11:44:00.849 INFO:tasks.workunit.client.0.smithi003.stdout: "explicit_placement": { 2023-12-03T11:44:00.849 INFO:tasks.workunit.client.0.smithi003.stdout: "data_pool": ".data-pool", 2023-12-03T11:44:00.849 INFO:tasks.workunit.client.0.smithi003.stdout: "data_extra_pool": "", 2023-12-03T11:44:00.849 INFO:tasks.workunit.client.0.smithi003.stdout: "index_pool": ".index-pool" 2023-12-03T11:44:00.849 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.849 INFO:tasks.workunit.client.0.smithi003.stdout: }, 2023-12-03T11:44:00.849 INFO:tasks.workunit.client.0.smithi003.stdout: "key": { 2023-12-03T11:44:00.849 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "_myobj_", 2023-12-03T11:44:00.849 INFO:tasks.workunit.client.0.smithi003.stdout: "instance": "inst", 2023-12-03T11:44:00.849 INFO:tasks.workunit.client.0.smithi003.stdout: "ns": "" 2023-12-03T11:44:00.850 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.850 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.850 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.850 INFO:tasks.workunit.client.0.smithi003.stdout:raw=.data-pool:marker__:inst__myobj_ 2023-12-03T11:44:00.850 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.850 INFO:tasks.workunit.client.0.smithi003.stdout: "raw_obj2": { 2023-12-03T11:44:00.850 INFO:tasks.workunit.client.0.smithi003.stdout: "pool": ".data-pool", 2023-12-03T11:44:00.850 INFO:tasks.workunit.client.0.smithi003.stdout: "oid": "marker__:inst__myobj_", 2023-12-03T11:44:00.850 INFO:tasks.workunit.client.0.smithi003.stdout: "loc": "marker__myobj_" 2023-12-03T11:44:00.850 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.850 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.850 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.850 INFO:tasks.workunit.client.0.smithi003.stdout: "new_obj2": { 2023-12-03T11:44:00.850 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket": { 2023-12-03T11:44:00.851 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "ebtest", 2023-12-03T11:44:00.851 INFO:tasks.workunit.client.0.smithi003.stdout: "marker": "marker", 2023-12-03T11:44:00.851 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket_id": "bucket-id", 2023-12-03T11:44:00.851 INFO:tasks.workunit.client.0.smithi003.stdout: "tenant": "", 2023-12-03T11:44:00.851 INFO:tasks.workunit.client.0.smithi003.stdout: "explicit_placement": { 2023-12-03T11:44:00.851 INFO:tasks.workunit.client.0.smithi003.stdout: "data_pool": ".data-pool", 2023-12-03T11:44:00.851 INFO:tasks.workunit.client.0.smithi003.stdout: "data_extra_pool": "", 2023-12-03T11:44:00.851 INFO:tasks.workunit.client.0.smithi003.stdout: "index_pool": ".index-pool" 2023-12-03T11:44:00.851 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.851 INFO:tasks.workunit.client.0.smithi003.stdout: }, 2023-12-03T11:44:00.851 INFO:tasks.workunit.client.0.smithi003.stdout: "key": { 2023-12-03T11:44:00.851 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "_myobj_", 2023-12-03T11:44:00.851 INFO:tasks.workunit.client.0.smithi003.stdout: "instance": "inst", 2023-12-03T11:44:00.851 INFO:tasks.workunit.client.0.smithi003.stdout: "ns": "" 2023-12-03T11:44:00.851 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.851 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.852 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.852 INFO:tasks.workunit.client.0.smithi003.stdout:raw2=.data-pool:marker__:inst__myobj_ 2023-12-03T11:44:00.852 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.852 INFO:tasks.workunit.client.0.smithi003.stdout: "raw_obj": { 2023-12-03T11:44:00.852 INFO:tasks.workunit.client.0.smithi003.stdout: "pool": ".data-pool", 2023-12-03T11:44:00.852 INFO:tasks.workunit.client.0.smithi003.stdout: "oid": "marker__ns:inst__myobj_", 2023-12-03T11:44:00.852 INFO:tasks.workunit.client.0.smithi003.stdout: "loc": "" 2023-12-03T11:44:00.852 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.852 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.852 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.852 INFO:tasks.workunit.client.0.smithi003.stdout: "new_obj": { 2023-12-03T11:44:00.852 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket": { 2023-12-03T11:44:00.852 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "ebtest", 2023-12-03T11:44:00.852 INFO:tasks.workunit.client.0.smithi003.stdout: "marker": "marker", 2023-12-03T11:44:00.852 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket_id": "bucket-id", 2023-12-03T11:44:00.853 INFO:tasks.workunit.client.0.smithi003.stdout: "tenant": "", 2023-12-03T11:44:00.853 INFO:tasks.workunit.client.0.smithi003.stdout: "explicit_placement": { 2023-12-03T11:44:00.853 INFO:tasks.workunit.client.0.smithi003.stdout: "data_pool": ".data-pool", 2023-12-03T11:44:00.853 INFO:tasks.workunit.client.0.smithi003.stdout: "data_extra_pool": "", 2023-12-03T11:44:00.853 INFO:tasks.workunit.client.0.smithi003.stdout: "index_pool": ".index-pool" 2023-12-03T11:44:00.853 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.853 INFO:tasks.workunit.client.0.smithi003.stdout: }, 2023-12-03T11:44:00.853 INFO:tasks.workunit.client.0.smithi003.stdout: "key": { 2023-12-03T11:44:00.853 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "_myobj_", 2023-12-03T11:44:00.853 INFO:tasks.workunit.client.0.smithi003.stdout: "instance": "inst", 2023-12-03T11:44:00.853 INFO:tasks.workunit.client.0.smithi003.stdout: "ns": "ns" 2023-12-03T11:44:00.853 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.853 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.853 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.853 INFO:tasks.workunit.client.0.smithi003.stdout:raw=.data-pool:marker__ns:inst__myobj_ 2023-12-03T11:44:00.854 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.854 INFO:tasks.workunit.client.0.smithi003.stdout: "raw_obj2": { 2023-12-03T11:44:00.854 INFO:tasks.workunit.client.0.smithi003.stdout: "pool": ".data-pool", 2023-12-03T11:44:00.854 INFO:tasks.workunit.client.0.smithi003.stdout: "oid": "marker__ns:inst__myobj_", 2023-12-03T11:44:00.854 INFO:tasks.workunit.client.0.smithi003.stdout: "loc": "" 2023-12-03T11:44:00.854 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.854 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.854 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:00.854 INFO:tasks.workunit.client.0.smithi003.stdout: "new_obj2": { 2023-12-03T11:44:00.854 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket": { 2023-12-03T11:44:00.854 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "ebtest", 2023-12-03T11:44:00.854 INFO:tasks.workunit.client.0.smithi003.stdout: "marker": "marker", 2023-12-03T11:44:00.854 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket_id": "bucket-id", 2023-12-03T11:44:00.854 INFO:tasks.workunit.client.0.smithi003.stdout: "tenant": "", 2023-12-03T11:44:00.854 INFO:tasks.workunit.client.0.smithi003.stdout: "explicit_placement": { 2023-12-03T11:44:00.855 INFO:tasks.workunit.client.0.smithi003.stdout: "data_pool": ".data-pool", 2023-12-03T11:44:00.855 INFO:tasks.workunit.client.0.smithi003.stdout: "data_extra_pool": "", 2023-12-03T11:44:00.855 INFO:tasks.workunit.client.0.smithi003.stdout: "index_pool": ".index-pool" 2023-12-03T11:44:00.855 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.855 INFO:tasks.workunit.client.0.smithi003.stdout: }, 2023-12-03T11:44:00.855 INFO:tasks.workunit.client.0.smithi003.stdout: "key": { 2023-12-03T11:44:00.855 INFO:tasks.workunit.client.0.smithi003.stdout: "name": "_myobj_", 2023-12-03T11:44:00.855 INFO:tasks.workunit.client.0.smithi003.stdout: "instance": "inst", 2023-12-03T11:44:00.855 INFO:tasks.workunit.client.0.smithi003.stdout: "ns": "ns" 2023-12-03T11:44:00.855 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.855 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:00.855 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:00.855 INFO:tasks.workunit.client.0.smithi003.stdout:raw2=.data-pool:marker__ns:inst__myobj_ 2023-12-03T11:44:00.855 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] TestRGWObj.old_to_raw (0 ms) 2023-12-03T11:44:00.855 INFO:tasks.workunit.client.0.smithi003.stdout:[----------] 4 tests from TestRGWObj (1 ms total) 2023-12-03T11:44:00.856 INFO:tasks.workunit.client.0.smithi003.stdout: 2023-12-03T11:44:00.856 INFO:tasks.workunit.client.0.smithi003.stdout:[----------] Global test environment tear-down 2023-12-03T11:44:00.856 INFO:tasks.workunit.client.0.smithi003.stdout:[==========] 4 tests from 1 test suite ran. (1 ms total) 2023-12-03T11:44:00.856 INFO:tasks.workunit.client.0.smithi003.stdout:[ PASSED ] 4 tests. 2023-12-03T11:44:00.856 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-12-03T11:44:00.856 DEBUG:teuthology.orchestra.run.smithi003:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-12-03T11:44:00.891 INFO:tasks.workunit:Running workunits matching rgw/test_librgw_file.sh on client.0... 2023-12-03T11:44:00.893 INFO:tasks.workunit:Running workunit rgw/test_librgw_file.sh... 2023-12-03T11:44:00.893 DEBUG:teuthology.orchestra.run.smithi003:workunit test rgw/test_librgw_file.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bcbf278cf395873c2a482f5a7b2345faf2160319 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_librgw_file.sh 2023-12-03T11:44:01.023 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:44:01.023 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:44:01.037 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:44:01.035+0000 7f39a7b2c800 20 rados->read ofs=0 len=0 2023-12-03T11:44:01.039 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:44:01.037+0000 7f39a7b2c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:44:01.039 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:44:01.037+0000 7f39a7b2c800 20 realm 2023-12-03T11:44:01.039 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:44:01.037+0000 7f39a7b2c800 20 rados->read ofs=0 len=0 2023-12-03T11:44:01.039 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:44:01.037+0000 7f39a7b2c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:44:01.039 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:44:01.037+0000 7f39a7b2c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:44:01.039 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:44:01.037+0000 7f39a7b2c800 20 rados->read ofs=0 len=0 2023-12-03T11:44:01.039 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:44:01.038+0000 7f39a7b2c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:44:01.039 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:44:01.038+0000 7f39a7b2c800 20 rados->read ofs=0 len=0 2023-12-03T11:44:01.040 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:44:01.039+0000 7f39a7b2c800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:44:01.040 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:44:01.039+0000 7f39a7b2c800 20 rados->read ofs=0 len=0 2023-12-03T11:44:01.040 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:44:01.039+0000 7f39a7b2c800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:44:01.040 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:44:01.039+0000 7f39a7b2c800 20 searching for the correct realm 2023-12-03T11:44:01.052 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:44:01.051+0000 7f39a38c3640 0 -- 172.21.15.3:0/2920440915 >> [v2:172.21.15.37:6805/1692844418,v1:172.21.15.37:6807/1692844418] conn(0x5637a4b30870 msgr2=0x5637a4b32cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:44:01.054 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:44:01.053+0000 7f39a7b2c800 20 RGWRados::pool_iterate: got zone_info.83aabb46-04b5-4c96-9933-c6bfb1173a73 2023-12-03T11:44:01.055 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:44:01.053+0000 7f39a7b2c800 20 RGWRados::pool_iterate: got zonegroup_info.6a811aad-435d-4fdd-93c9-b7e0b50de429 2023-12-03T11:44:01.055 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:44:01.053+0000 7f39a7b2c800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:44:01.055 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:44:01.053+0000 7f39a7b2c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:44:01.055 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:44:01.053+0000 7f39a7b2c800 20 rados->read ofs=0 len=0 2023-12-03T11:44:01.055 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:44:01.053+0000 7f39a7b2c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:44:01.055 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:44:01.053+0000 7f39a7b2c800 20 rados->read ofs=0 len=0 2023-12-03T11:44:01.056 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:44:01.054+0000 7f39a7b2c800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:44:01.056 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:44:01.054+0000 7f39a7b2c800 20 rados->read ofs=0 len=0 2023-12-03T11:44:01.057 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:44:01.054+0000 7f39a7b2c800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:44:01.057 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:44:01.054+0000 7f39a7b2c800 20 zone default found 2023-12-03T11:44:01.057 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:44:01.054+0000 7f39a7b2c800 4 Realm: () 2023-12-03T11:44:01.057 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:44:01.054+0000 7f39a7b2c800 4 ZoneGroup: default (6a811aad-435d-4fdd-93c9-b7e0b50de429) 2023-12-03T11:44:01.057 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:44:01.054+0000 7f39a7b2c800 4 Zone: default (83aabb46-04b5-4c96-9933-c6bfb1173a73) 2023-12-03T11:44:01.057 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:44:01.054+0000 7f39a7b2c800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:44:01.057 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:44:01.054+0000 7f39a7b2c800 20 zonegroup default 2023-12-03T11:44:01.057 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:44:01.054+0000 7f39a7b2c800 20 rados->read ofs=0 len=0 2023-12-03T11:44:01.057 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:44:01.054+0000 7f39a7b2c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:44:01.057 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:44:01.054+0000 7f39a7b2c800 20 rados->read ofs=0 len=0 2023-12-03T11:44:01.057 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:44:01.055+0000 7f39a7b2c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:44:01.057 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:44:01.055+0000 7f39a7b2c800 20 rados->read ofs=0 len=0 2023-12-03T11:44:01.057 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:44:01.055+0000 7f39a7b2c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:44:01.057 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:44:01.055+0000 7f39a7b2c800 20 started sync module instance, tier type = 2023-12-03T11:44:01.057 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:44:01.055+0000 7f39a7b2c800 20 started zone id=83aabb46-04b5-4c96-9933-c6bfb1173a73 (name=default) with tier type = 2023-12-03T11:44:01.064 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:44:01.063+0000 7f39a40c4640 0 -- 172.21.15.3:0/2920440915 >> [v2:172.21.15.37:6816/3770469300,v1:172.21.15.37:6818/3770469300] conn(0x7f399809c2a0 msgr2=0x7f39980cc980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:44:01.067 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:44:01.065+0000 7f39a7b2c800 20 add_watcher() i=0 2023-12-03T11:44:01.067 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:44:01.065+0000 7f39a7b2c800 20 add_watcher() i=1 2023-12-03T11:44:01.067 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:44:01.065+0000 7f39a7b2c800 20 add_watcher() i=2 2023-12-03T11:44:01.067 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:44:01.065+0000 7f39a7b2c800 20 add_watcher() i=3 2023-12-03T11:44:01.067 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:44:01.065+0000 7f39a7b2c800 20 add_watcher() i=4 2023-12-03T11:44:01.067 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:44:01.065+0000 7f39a7b2c800 20 add_watcher() i=5 2023-12-03T11:44:01.067 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:44:01.065+0000 7f39a7b2c800 20 add_watcher() i=6 2023-12-03T11:44:01.067 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:44:01.066+0000 7f39a7b2c800 20 add_watcher() i=7 2023-12-03T11:44:01.067 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:44:01.066+0000 7f39a7b2c800 2 all 8 watchers are set, enabling cache 2023-12-03T11:44:01.069 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:44:01.068+0000 7f3969fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:44:01.070 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:44:01.069+0000 7f39a7b2c800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:44:01.070 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:44:01.069+0000 7f39a7b2c800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:44:01.076 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:44:01.075+0000 7f39a7b2c800 5 note: GC not initialized 2023-12-03T11:44:01.077 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:44:01.075+0000 7f38e0ff9640 20 reqs_thread_entry: start 2023-12-03T11:44:01.077 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:44:01.076+0000 7f39a7b2c800 20 init_complete bucket index max shards: 11 2023-12-03T11:44:01.077 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:44:01.076+0000 7f39a7b2c800 20 Filter name: none 2023-12-03T11:44:01.077 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:44:01.076+0000 7f38d67fc640 20 reqs_thread_entry: start 2023-12-03T11:44:01.077 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:44:01.076+0000 7f39a7b2c800 10 cache get: name=default.rgw.meta+users.uid+ceph-test-librgw-file : miss 2023-12-03T11:44:01.077 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:44:01.076+0000 7f39a7b2c800 20 rados->read ofs=0 len=0 2023-12-03T11:44:01.078 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:44:01.076+0000 7f39a7b2c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:44:01.078 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:44:01.076+0000 7f39a7b2c800 10 cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x0 2023-12-03T11:44:01.079 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:44:01.076+0000 7f39a7b2c800 10 adding default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2023-12-03T11:44:01.079 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:44:01.076+0000 7f39a7b2c800 10 cache get: name=default.rgw.meta+users.email+librgw@example.com : miss 2023-12-03T11:44:01.079 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:44:01.076+0000 7f39a7b2c800 20 rados->read ofs=0 len=0 2023-12-03T11:44:01.079 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:44:01.076+0000 7f39a7b2c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:44:01.079 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:44:01.077+0000 7f39a7b2c800 10 cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x0 2023-12-03T11:44:01.079 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:44:01.077+0000 7f39a7b2c800 10 adding default.rgw.meta+users.email+librgw@example.com to cache LRU end 2023-12-03T11:44:01.079 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:44:01.077+0000 7f39a7b2c800 10 cache get: name=default.rgw.meta+users.keys+wxaQRotovxi5+Q175qlqVVvi1hA= : miss 2023-12-03T11:44:01.079 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:44:01.077+0000 7f39a7b2c800 20 rados->read ofs=0 len=0 2023-12-03T11:44:01.079 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:44:01.077+0000 7f39a7b2c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:44:01.079 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:44:01.077+0000 7f39a7b2c800 10 cache put: name=default.rgw.meta+users.keys+wxaQRotovxi5+Q175qlqVVvi1hA= info.flags=0x0 2023-12-03T11:44:01.079 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:44:01.077+0000 7f39a7b2c800 10 adding default.rgw.meta+users.keys+wxaQRotovxi5+Q175qlqVVvi1hA= to cache LRU end 2023-12-03T11:44:01.079 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:44:01.077+0000 7f39a7b2c800 10 cache get: name=default.rgw.meta+users.keys+wxaQRotovxi5+Q175qlqVVvi1hA= : hit (negative entry) 2023-12-03T11:44:01.079 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:44:01.077+0000 7f39a7b2c800 10 cache get: name=default.rgw.meta+users.keys+wxaQRotovxi5+Q175qlqVVvi1hA= : hit (negative entry) 2023-12-03T11:44:01.080 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:44:01.078+0000 7f39a7b2c800 10 cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x17 2023-12-03T11:44:01.080 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:44:01.078+0000 7f39a7b2c800 10 moving default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2023-12-03T11:44:01.080 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:44:01.078+0000 7f39a7b2c800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:ceph-test-librgw-file, ofs0, ns] 2023-12-03T11:44:01.080 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:44:01.079+0000 7f398a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1056561954818 cookie 94796986394960 notifier 5384 bl.length()=663 2023-12-03T11:44:01.080 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:44:01.079+0000 7f398a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x17 2023-12-03T11:44:01.080 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:44:01.079+0000 7f398a7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2023-12-03T11:44:01.083 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:44:01.082+0000 7f39a7b2c800 10 cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x7 2023-12-03T11:44:01.083 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:44:01.082+0000 7f39a7b2c800 10 moving default.rgw.meta+users.email+librgw@example.com to cache LRU end 2023-12-03T11:44:01.083 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:44:01.082+0000 7f39a7b2c800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.email:librgw@example.com, ofs0, ns] 2023-12-03T11:44:01.084 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:44:01.082+0000 7f398a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1056561954816 cookie 94796986422624 notifier 5384 bl.length()=194 2023-12-03T11:44:01.084 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:44:01.082+0000 7f398a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x7 2023-12-03T11:44:01.084 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:44:01.083+0000 7f398a7fc640 10 rgw watcher librados: moving default.rgw.meta+users.email+librgw@example.com to cache LRU end 2023-12-03T11:44:01.091 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:44:01.090+0000 7f39a7b2c800 10 cache put: name=default.rgw.meta+users.keys+wxaQRotovxi5+Q175qlqVVvi1hA= info.flags=0x7 2023-12-03T11:44:01.092 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:44:01.090+0000 7f39a7b2c800 10 moving default.rgw.meta+users.keys+wxaQRotovxi5+Q175qlqVVvi1hA= to cache LRU end 2023-12-03T11:44:01.092 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:44:01.090+0000 7f39a7b2c800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.keys:wxaQRotovxi5+Q175qlqVVvi1hA=, ofs0, ns] 2023-12-03T11:44:01.092 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:44:01.090+0000 7f398a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1056561954818 cookie 139885340442624 notifier 5384 bl.length()=203 2023-12-03T11:44:01.092 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:44:01.090+0000 7f398a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+wxaQRotovxi5+Q175qlqVVvi1hA= info.flags=0x7 2023-12-03T11:44:01.092 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:44:01.090+0000 7f398a7fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+wxaQRotovxi5+Q175qlqVVvi1hA= to cache LRU end 2023-12-03T11:44:01.093 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:44:01.093 INFO:tasks.workunit.client.0.smithi003.stdout: "user_id": "ceph-test-librgw-file", 2023-12-03T11:44:01.093 INFO:tasks.workunit.client.0.smithi003.stdout: "display_name": "librgw test user", 2023-12-03T11:44:01.093 INFO:tasks.workunit.client.0.smithi003.stdout: "email": "librgw@example.com", 2023-12-03T11:44:01.094 INFO:tasks.workunit.client.0.smithi003.stdout: "suspended": 0, 2023-12-03T11:44:01.094 INFO:tasks.workunit.client.0.smithi003.stdout: "max_buckets": 1000, 2023-12-03T11:44:01.094 INFO:tasks.workunit.client.0.smithi003.stdout: "subusers": [], 2023-12-03T11:44:01.094 INFO:tasks.workunit.client.0.smithi003.stdout: "keys": [ 2023-12-03T11:44:01.094 INFO:tasks.workunit.client.0.smithi003.stdout: { 2023-12-03T11:44:01.094 INFO:tasks.workunit.client.0.smithi003.stdout: "user": "ceph-test-librgw-file", 2023-12-03T11:44:01.094 INFO:tasks.workunit.client.0.smithi003.stdout: "access_key": "wxaQRotovxi5+Q175qlqVVvi1hA=", 2023-12-03T11:44:01.094 INFO:tasks.workunit.client.0.smithi003.stdout: "secret_key": "PTlSNpMwuE5ctR7B+cb5F9BKxfkaXvQbZoI3ziG3v1Xsgo8ciVvuhA==" 2023-12-03T11:44:01.094 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:44:01.094 INFO:tasks.workunit.client.0.smithi003.stdout: ], 2023-12-03T11:44:01.094 INFO:tasks.workunit.client.0.smithi003.stdout: "swift_keys": [], 2023-12-03T11:44:01.094 INFO:tasks.workunit.client.0.smithi003.stdout: "caps": [], 2023-12-03T11:44:01.094 INFO:tasks.workunit.client.0.smithi003.stdout: "op_mask": "read, write, delete", 2023-12-03T11:44:01.095 INFO:tasks.workunit.client.0.smithi003.stdout: "default_placement": "", 2023-12-03T11:44:01.095 INFO:tasks.workunit.client.0.smithi003.stdout: "default_storage_class": "", 2023-12-03T11:44:01.095 INFO:tasks.workunit.client.0.smithi003.stdout: "placement_tags": [], 2023-12-03T11:44:01.095 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket_quota": { 2023-12-03T11:44:01.095 INFO:tasks.workunit.client.0.smithi003.stdout: "enabled": false, 2023-12-03T11:44:01.095 INFO:tasks.workunit.client.0.smithi003.stdout: "check_on_raw": false, 2023-12-03T11:44:01.095 INFO:tasks.workunit.client.0.smithi003.stdout: "max_size": -1, 2023-12-03T11:44:01.095 INFO:tasks.workunit.client.0.smithi003.stdout: "max_size_kb": 0, 2023-12-03T11:44:01.095 INFO:tasks.workunit.client.0.smithi003.stdout: "max_objects": -1 2023-12-03T11:44:01.095 INFO:tasks.workunit.client.0.smithi003.stdout: }, 2023-12-03T11:44:01.095 INFO:tasks.workunit.client.0.smithi003.stdout: "user_quota": { 2023-12-03T11:44:01.095 INFO:tasks.workunit.client.0.smithi003.stdout: "enabled": false, 2023-12-03T11:44:01.095 INFO:tasks.workunit.client.0.smithi003.stdout: "check_on_raw": false, 2023-12-03T11:44:01.095 INFO:tasks.workunit.client.0.smithi003.stdout: "max_size": -1, 2023-12-03T11:44:01.095 INFO:tasks.workunit.client.0.smithi003.stdout: "max_size_kb": 0, 2023-12-03T11:44:01.096 INFO:tasks.workunit.client.0.smithi003.stdout: "max_objects": -1 2023-12-03T11:44:01.096 INFO:tasks.workunit.client.0.smithi003.stdout: }, 2023-12-03T11:44:01.096 INFO:tasks.workunit.client.0.smithi003.stdout: "temp_url_keys": [], 2023-12-03T11:44:01.096 INFO:tasks.workunit.client.0.smithi003.stdout: "type": "rgw", 2023-12-03T11:44:01.096 INFO:tasks.workunit.client.0.smithi003.stdout: "mfa_ids": [] 2023-12-03T11:44:01.096 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:44:01.096 INFO:tasks.workunit.client.0.smithi003.stdout: 2023-12-03T11:44:01.097 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:44:01.093+0000 7f3969fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:44:01.097 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:44:01.095+0000 7f39a7b2c800 20 remove_watcher() i=0 2023-12-03T11:44:01.097 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:44:01.095+0000 7f39a7b2c800 2 removed watcher, disabling cache 2023-12-03T11:44:01.098 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:44:01.097+0000 7f39a7b2c800 20 remove_watcher() i=1 2023-12-03T11:44:01.099 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:44:01.098+0000 7f39a7b2c800 20 remove_watcher() i=2 2023-12-03T11:44:01.100 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:44:01.099+0000 7f39a7b2c800 20 remove_watcher() i=3 2023-12-03T11:44:01.101 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:44:01.100+0000 7f39a7b2c800 20 remove_watcher() i=4 2023-12-03T11:44:01.102 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:44:01.101+0000 7f39a7b2c800 20 remove_watcher() i=5 2023-12-03T11:44:01.103 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:44:01.102+0000 7f39a7b2c800 20 remove_watcher() i=6 2023-12-03T11:44:01.104 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:44:01.103+0000 7f39a7b2c800 20 remove_watcher() i=7 2023-12-03T11:44:01.109 INFO:tasks.workunit.client.0.smithi003.stdout:phase 1.1 2023-12-03T11:44:01.129 INFO:tasks.workunit.client.0.smithi003.stdout:[==========] Running 24 tests from 1 test suite. 2023-12-03T11:44:01.129 INFO:tasks.workunit.client.0.smithi003.stdout:[----------] Global test environment set-up. 2023-12-03T11:44:01.129 INFO:tasks.workunit.client.0.smithi003.stdout:[----------] 24 tests from LibRGW 2023-12-03T11:44:01.129 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.INIT 2023-12-03T11:44:01.140 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:44:01.140 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:44:01.309 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.INIT (179 ms) 2023-12-03T11:44:01.309 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2023-12-03T11:44:01.310 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.MOUNT_NOROOT (2 ms) 2023-12-03T11:44:01.310 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.MOUNT 2023-12-03T11:44:01.310 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2023-12-03T11:44:01.310 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.SETUP_HIER1 2023-12-03T11:44:01.329 INFO:tasks.workunit.client.0.smithi003.stdout:creating: nfsroot:foo/bar/baz/quux 2023-12-03T11:44:01.333 INFO:tasks.workunit.client.0.smithi003.stdout:creating: nfsroot:foo/f1 2023-12-03T11:44:01.336 INFO:tasks.workunit.client.0.smithi003.stdout:creating: nfsroot:foo/f2 2023-12-03T11:44:01.341 INFO:tasks.workunit.client.0.smithi003.stdout:creating: nfsroot:foo/bar/f1 2023-12-03T11:44:01.342 INFO:tasks.workunit.client.0.smithi003.stdout:creating: nfsroot:foo/bar/d1/ 2023-12-03T11:44:01.347 INFO:tasks.workunit.client.0.smithi003.stdout:creating: nfsroot:foo/bar/baz/hungry 2023-12-03T11:44:01.349 INFO:tasks.workunit.client.0.smithi003.stdout:creating: nfsroot:foo/bar/baz/hungry/ 2023-12-03T11:44:01.352 INFO:tasks.workunit.client.0.smithi003.stdout:creating: nfsroot:foo/bar/baz/momma 2023-12-03T11:44:01.355 INFO:tasks.workunit.client.0.smithi003.stdout:creating: nfsroot:foo/bar/baz/bear/ 2023-12-03T11:44:01.357 INFO:tasks.workunit.client.0.smithi003.stdout:creating: nfsroot:foo/bar/baz/sasquatch 2023-12-03T11:44:01.361 INFO:tasks.workunit.client.0.smithi003.stdout:creating: nfsroot:foo/bar/baz/sasquatch/ 2023-12-03T11:44:01.363 INFO:tasks.workunit.client.0.smithi003.stdout:creating: nfsroot:foo/bar/baz/frobozz 2023-12-03T11:44:01.366 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.SETUP_HIER1 (56 ms) 2023-12-03T11:44:01.366 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2023-12-03T11:44:01.472 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.SETUP_DIRS1 (105 ms) 2023-12-03T11:44:01.472 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.SETATTR 2023-12-03T11:44:01.472 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2023-12-03T11:44:01.472 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2023-12-03T11:44:01.491 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (20 ms) 2023-12-03T11:44:01.491 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2023-12-03T11:44:01.538 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (47 ms) 2023-12-03T11:44:01.538 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2023-12-03T11:44:01.538 INFO:tasks.workunit.client.0.smithi003.stdout:rename file rfile_0 to rfile_r0 (bucket brename0) 2023-12-03T11:44:01.544 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (6 ms) 2023-12-03T11:44:01.544 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2023-12-03T11:44:01.544 INFO:tasks.workunit.client.0.smithi003.stdout:rename file rfile_1 (bucket brename0) to rfile_rhilldog (bucket brename1) 2023-12-03T11:44:01.552 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (8 ms) 2023-12-03T11:44:01.552 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2023-12-03T11:44:01.553 INFO:tasks.workunit.client.0.smithi003.stdout:scanning objects in /bdirs1/dir_0 2023-12-03T11:44:01.553 INFO:tasks.workunit.client.0.smithi003.stdout: /bdirs1/dir_0/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2023-12-03T11:44:01.553 INFO:tasks.workunit.client.0.smithi003.stdout: /bdirs1/dir_0/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2023-12-03T11:44:01.553 INFO:tasks.workunit.client.0.smithi003.stdout: /bdirs1/dir_0/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2023-12-03T11:44:01.553 INFO:tasks.workunit.client.0.smithi003.stdout: /bdirs1/dir_0/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2023-12-03T11:44:01.553 INFO:tasks.workunit.client.0.smithi003.stdout:scanning objects in /bdirs1/dir_1 2023-12-03T11:44:01.553 INFO:tasks.workunit.client.0.smithi003.stdout: /bdirs1/dir_1/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2023-12-03T11:44:01.553 INFO:tasks.workunit.client.0.smithi003.stdout: /bdirs1/dir_1/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2023-12-03T11:44:01.553 INFO:tasks.workunit.client.0.smithi003.stdout: /bdirs1/dir_1/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2023-12-03T11:44:01.553 INFO:tasks.workunit.client.0.smithi003.stdout: /bdirs1/dir_1/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2023-12-03T11:44:01.553 INFO:tasks.workunit.client.0.smithi003.stdout:scanning objects in /bdirs1/dir_2 2023-12-03T11:44:01.553 INFO:tasks.workunit.client.0.smithi003.stdout: /bdirs1/dir_2/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2023-12-03T11:44:01.553 INFO:tasks.workunit.client.0.smithi003.stdout: /bdirs1/dir_2/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2023-12-03T11:44:01.553 INFO:tasks.workunit.client.0.smithi003.stdout: /bdirs1/dir_2/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2023-12-03T11:44:01.553 INFO:tasks.workunit.client.0.smithi003.stdout: /bdirs1/dir_2/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2023-12-03T11:44:01.554 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2023-12-03T11:44:01.554 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.READ_DIRS1 2023-12-03T11:44:01.554 INFO:tasks.workunit.client.0.smithi003.stdout:read back objects in /bdirs1/dir_0 2023-12-03T11:44:01.554 INFO:tasks.workunit.client.0.smithi003.stdout:reading 0,256 dir_0/sfile_0 2023-12-03T11:44:01.554 INFO:tasks.workunit.client.0.smithi003.stdout: read back from sfile_0 : "data for sfile_0" 2023-12-03T11:44:01.554 INFO:tasks.workunit.client.0.smithi003.stdout:reading 0,256 dir_0/sfile_1 2023-12-03T11:44:01.555 INFO:tasks.workunit.client.0.smithi003.stdout: read back from sfile_1 : "data for sfile_1" 2023-12-03T11:44:01.555 INFO:tasks.workunit.client.0.smithi003.stdout:read back objects in /bdirs1/dir_1 2023-12-03T11:44:01.555 INFO:tasks.workunit.client.0.smithi003.stdout:reading 0,256 dir_1/sfile_0 2023-12-03T11:44:01.556 INFO:tasks.workunit.client.0.smithi003.stdout: read back from sfile_0 : "data for sfile_0" 2023-12-03T11:44:01.557 INFO:tasks.workunit.client.0.smithi003.stdout:reading 0,256 dir_1/sfile_1 2023-12-03T11:44:01.558 INFO:tasks.workunit.client.0.smithi003.stdout: read back from sfile_1 : "data for sfile_1" 2023-12-03T11:44:01.558 INFO:tasks.workunit.client.0.smithi003.stdout:read back objects in /bdirs1/dir_2 2023-12-03T11:44:01.558 INFO:tasks.workunit.client.0.smithi003.stdout:reading 0,256 dir_2/sfile_0 2023-12-03T11:44:01.559 INFO:tasks.workunit.client.0.smithi003.stdout: read back from sfile_0 : "data for sfile_0" 2023-12-03T11:44:01.559 INFO:tasks.workunit.client.0.smithi003.stdout:reading 0,256 dir_2/sfile_1 2023-12-03T11:44:01.561 INFO:tasks.workunit.client.0.smithi003.stdout: read back from sfile_1 : "data for sfile_1" 2023-12-03T11:44:01.561 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.READ_DIRS1 (9 ms) 2023-12-03T11:44:01.561 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.READF_SETUP1 2023-12-03T11:44:01.741 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.READF_SETUP1 (180 ms) 2023-12-03T11:44:01.741 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.READF_DIRS1 2023-12-03T11:44:01.742 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2023-12-03T11:44:01.742 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2023-12-03T11:44:01.742 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2023-12-03T11:44:01.742 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2023-12-03T11:44:01.742 INFO:tasks.workunit.client.0.smithi003.stdout:release sdir_0 type: DIR refs: 2 2023-12-03T11:44:01.742 INFO:tasks.workunit.client.0.smithi003.stdout:release sfile_0 type: FILE refs: 2 2023-12-03T11:44:01.742 INFO:tasks.workunit.client.0.smithi003.stdout:release sdir_1 type: DIR refs: 2 2023-12-03T11:44:01.742 INFO:tasks.workunit.client.0.smithi003.stdout:release sfile_1 type: FILE refs: 2 2023-12-03T11:44:01.742 INFO:tasks.workunit.client.0.smithi003.stdout:release sdir_0 type: DIR refs: 2 2023-12-03T11:44:01.742 INFO:tasks.workunit.client.0.smithi003.stdout:release sfile_0 type: FILE refs: 2 2023-12-03T11:44:01.742 INFO:tasks.workunit.client.0.smithi003.stdout:release sdir_1 type: DIR refs: 2 2023-12-03T11:44:01.742 INFO:tasks.workunit.client.0.smithi003.stdout:release sfile_1 type: FILE refs: 2 2023-12-03T11:44:01.742 INFO:tasks.workunit.client.0.smithi003.stdout:release sdir_0 type: DIR refs: 2 2023-12-03T11:44:01.743 INFO:tasks.workunit.client.0.smithi003.stdout:release sfile_0 type: FILE refs: 2 2023-12-03T11:44:01.743 INFO:tasks.workunit.client.0.smithi003.stdout:release sdir_1 type: DIR refs: 2 2023-12-03T11:44:01.743 INFO:tasks.workunit.client.0.smithi003.stdout:release sfile_1 type: FILE refs: 2 2023-12-03T11:44:01.743 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2023-12-03T11:44:01.743 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.HIER1 2023-12-03T11:44:01.752 INFO:tasks.workunit.client.0.smithi003.stdout:/nfsroot/foo/f2 (f2): FILE 2023-12-03T11:44:01.752 INFO:tasks.workunit.client.0.smithi003.stdout:/nfsroot/foo/f1 (f1): FILE 2023-12-03T11:44:01.754 INFO:tasks.workunit.client.0.smithi003.stdout:/nfsroot/foo/bar/f1 (f1): FILE 2023-12-03T11:44:01.756 INFO:tasks.workunit.client.0.smithi003.stdout:/nfsroot/foo/bar/d1 (d1): DIR 2023-12-03T11:44:01.759 INFO:tasks.workunit.client.0.smithi003.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2023-12-03T11:44:01.759 INFO:tasks.workunit.client.0.smithi003.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2023-12-03T11:44:01.760 INFO:tasks.workunit.client.0.smithi003.stdout:/nfsroot/foo/bar/baz/quux (quux): FILE 2023-12-03T11:44:01.760 INFO:tasks.workunit.client.0.smithi003.stdout:/nfsroot/foo/bar/baz/momma (momma): FILE 2023-12-03T11:44:01.761 INFO:tasks.workunit.client.0.smithi003.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2023-12-03T11:44:01.761 INFO:tasks.workunit.client.0.smithi003.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2023-12-03T11:44:01.762 INFO:tasks.workunit.client.0.smithi003.stdout:/nfsroot/foo/bar/baz/frobozz (frobozz): FILE 2023-12-03T11:44:01.764 INFO:tasks.workunit.client.0.smithi003.stdout:/nfsroot/foo/bar/baz/bear (bear): DIR 2023-12-03T11:44:01.764 INFO:tasks.workunit.client.0.smithi003.stdout:/nfsroot/foo/bar/baz (baz): DIR 2023-12-03T11:44:01.765 INFO:tasks.workunit.client.0.smithi003.stdout:/nfsroot/foo/bar (bar): DIR 2023-12-03T11:44:01.765 INFO:tasks.workunit.client.0.smithi003.stdout:/nfsroot/foo (foo): DIR 2023-12-03T11:44:01.765 INFO:tasks.workunit.client.0.smithi003.stdout:/nfsroot (nfsroot): DIR 2023-12-03T11:44:01.765 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.HIER1 (23 ms) 2023-12-03T11:44:01.765 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2023-12-03T11:44:01.765 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2023-12-03T11:44:01.765 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2023-12-03T11:44:01.765 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2023-12-03T11:44:01.765 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2023-12-03T11:44:01.765 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2023-12-03T11:44:01.765 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2023-12-03T11:44:01.765 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2023-12-03T11:44:01.766 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.CLEANUP 2023-12-03T11:44:01.766 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2023-12-03T11:44:01.766 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.UMOUNT 2023-12-03T11:44:01.766 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2023-12-03T11:44:01.766 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.SHUTDOWN 2023-12-03T11:44:01.766 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:44:01.763+0000 7f03776c88c0 -1 shutting down 2023-12-03T11:44:01.766 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:44:01.764+0000 7f0350187640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 97691, si_uid : 1000, si_addr0x3e800017d9b, si_status0 2023-12-03T11:44:01.868 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.SHUTDOWN (104 ms) 2023-12-03T11:44:01.869 INFO:tasks.workunit.client.0.smithi003.stdout:[----------] 24 tests from LibRGW (739 ms total) 2023-12-03T11:44:01.869 INFO:tasks.workunit.client.0.smithi003.stdout: 2023-12-03T11:44:01.869 INFO:tasks.workunit.client.0.smithi003.stdout:[----------] Global test environment tear-down 2023-12-03T11:44:01.869 INFO:tasks.workunit.client.0.smithi003.stdout:[==========] 24 tests from 1 test suite ran. (739 ms total) 2023-12-03T11:44:01.869 INFO:tasks.workunit.client.0.smithi003.stdout:[ PASSED ] 24 tests. 2023-12-03T11:44:01.875 INFO:tasks.workunit.client.0.smithi003.stdout:phase 1.2 2023-12-03T11:44:01.895 INFO:tasks.workunit.client.0.smithi003.stdout:[==========] Running 24 tests from 1 test suite. 2023-12-03T11:44:01.895 INFO:tasks.workunit.client.0.smithi003.stdout:[----------] Global test environment set-up. 2023-12-03T11:44:01.895 INFO:tasks.workunit.client.0.smithi003.stdout:[----------] 24 tests from LibRGW 2023-12-03T11:44:01.895 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.INIT 2023-12-03T11:44:01.903 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:44:01.903 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:44:02.257 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.INIT (363 ms) 2023-12-03T11:44:02.257 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2023-12-03T11:44:02.258 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.MOUNT_NOROOT (0 ms) 2023-12-03T11:44:02.258 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.MOUNT 2023-12-03T11:44:02.258 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2023-12-03T11:44:02.258 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.SETUP_HIER1 2023-12-03T11:44:02.258 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.SETUP_HIER1 (0 ms) 2023-12-03T11:44:02.259 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2023-12-03T11:44:02.259 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.SETUP_DIRS1 (0 ms) 2023-12-03T11:44:02.259 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.SETATTR 2023-12-03T11:44:02.259 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2023-12-03T11:44:02.259 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2023-12-03T11:44:02.259 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (0 ms) 2023-12-03T11:44:02.259 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2023-12-03T11:44:02.259 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (0 ms) 2023-12-03T11:44:02.259 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2023-12-03T11:44:02.259 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (0 ms) 2023-12-03T11:44:02.259 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2023-12-03T11:44:02.259 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (0 ms) 2023-12-03T11:44:02.259 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2023-12-03T11:44:02.259 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2023-12-03T11:44:02.259 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.READ_DIRS1 2023-12-03T11:44:02.260 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.READ_DIRS1 (0 ms) 2023-12-03T11:44:02.260 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.READF_SETUP1 2023-12-03T11:44:02.260 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.READF_SETUP1 (0 ms) 2023-12-03T11:44:02.260 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.READF_DIRS1 2023-12-03T11:44:02.260 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2023-12-03T11:44:02.260 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2023-12-03T11:44:02.260 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2023-12-03T11:44:02.260 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2023-12-03T11:44:02.260 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2023-12-03T11:44:02.260 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.HIER1 2023-12-03T11:44:02.260 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.HIER1 (0 ms) 2023-12-03T11:44:02.260 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2023-12-03T11:44:02.260 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2023-12-03T11:44:02.260 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2023-12-03T11:44:02.260 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2023-12-03T11:44:02.261 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2023-12-03T11:44:02.261 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2023-12-03T11:44:02.261 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2023-12-03T11:44:02.261 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2023-12-03T11:44:02.261 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.CLEANUP 2023-12-03T11:44:02.261 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2023-12-03T11:44:02.261 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.UMOUNT 2023-12-03T11:44:02.261 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2023-12-03T11:44:02.261 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.SHUTDOWN 2023-12-03T11:44:02.261 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:44:02.257+0000 7fcfc86c08c0 -1 shutting down 2023-12-03T11:44:02.262 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:44:02.258+0000 7fcfa12f9640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 97801, si_uid : 1000, si_addr0x3e800017e09, si_status0 2023-12-03T11:44:02.322 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.SHUTDOWN (63 ms) 2023-12-03T11:44:02.322 INFO:tasks.workunit.client.0.smithi003.stdout:[----------] 24 tests from LibRGW (427 ms total) 2023-12-03T11:44:02.322 INFO:tasks.workunit.client.0.smithi003.stdout: 2023-12-03T11:44:02.322 INFO:tasks.workunit.client.0.smithi003.stdout:[----------] Global test environment tear-down 2023-12-03T11:44:02.322 INFO:tasks.workunit.client.0.smithi003.stdout:[==========] 24 tests from 1 test suite ran. (427 ms total) 2023-12-03T11:44:02.322 INFO:tasks.workunit.client.0.smithi003.stdout:[ PASSED ] 24 tests. 2023-12-03T11:44:02.327 INFO:tasks.workunit.client.0.smithi003.stdout:phase 1.3 2023-12-03T11:44:02.346 INFO:tasks.workunit.client.0.smithi003.stdout:[==========] Running 24 tests from 1 test suite. 2023-12-03T11:44:02.347 INFO:tasks.workunit.client.0.smithi003.stdout:[----------] Global test environment set-up. 2023-12-03T11:44:02.347 INFO:tasks.workunit.client.0.smithi003.stdout:[----------] 24 tests from LibRGW 2023-12-03T11:44:02.347 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.INIT 2023-12-03T11:44:02.357 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:44:02.357 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:44:02.719 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.INIT (373 ms) 2023-12-03T11:44:02.719 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2023-12-03T11:44:02.720 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.MOUNT_NOROOT (1 ms) 2023-12-03T11:44:02.720 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.MOUNT 2023-12-03T11:44:02.720 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2023-12-03T11:44:02.720 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.SETUP_HIER1 2023-12-03T11:44:02.727 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.SETUP_HIER1 (7 ms) 2023-12-03T11:44:02.727 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2023-12-03T11:44:02.788 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.SETUP_DIRS1 (61 ms) 2023-12-03T11:44:02.788 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.SETATTR 2023-12-03T11:44:02.788 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2023-12-03T11:44:02.788 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2023-12-03T11:44:02.788 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (0 ms) 2023-12-03T11:44:02.789 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2023-12-03T11:44:02.789 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (0 ms) 2023-12-03T11:44:02.789 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2023-12-03T11:44:02.789 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (0 ms) 2023-12-03T11:44:02.789 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2023-12-03T11:44:02.789 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (0 ms) 2023-12-03T11:44:02.789 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2023-12-03T11:44:02.789 INFO:tasks.workunit.client.0.smithi003.stdout:scanning objects in /bdirs1/dir_0 2023-12-03T11:44:02.789 INFO:tasks.workunit.client.0.smithi003.stdout: /bdirs1/dir_0/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2023-12-03T11:44:02.789 INFO:tasks.workunit.client.0.smithi003.stdout: /bdirs1/dir_0/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2023-12-03T11:44:02.789 INFO:tasks.workunit.client.0.smithi003.stdout: /bdirs1/dir_0/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2023-12-03T11:44:02.789 INFO:tasks.workunit.client.0.smithi003.stdout: /bdirs1/dir_0/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2023-12-03T11:44:02.789 INFO:tasks.workunit.client.0.smithi003.stdout:scanning objects in /bdirs1/dir_1 2023-12-03T11:44:02.789 INFO:tasks.workunit.client.0.smithi003.stdout: /bdirs1/dir_1/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2023-12-03T11:44:02.789 INFO:tasks.workunit.client.0.smithi003.stdout: /bdirs1/dir_1/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2023-12-03T11:44:02.790 INFO:tasks.workunit.client.0.smithi003.stdout: /bdirs1/dir_1/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2023-12-03T11:44:02.790 INFO:tasks.workunit.client.0.smithi003.stdout: /bdirs1/dir_1/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2023-12-03T11:44:02.790 INFO:tasks.workunit.client.0.smithi003.stdout:scanning objects in /bdirs1/dir_2 2023-12-03T11:44:02.790 INFO:tasks.workunit.client.0.smithi003.stdout: /bdirs1/dir_2/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2023-12-03T11:44:02.790 INFO:tasks.workunit.client.0.smithi003.stdout: /bdirs1/dir_2/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2023-12-03T11:44:02.790 INFO:tasks.workunit.client.0.smithi003.stdout: /bdirs1/dir_2/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2023-12-03T11:44:02.790 INFO:tasks.workunit.client.0.smithi003.stdout: /bdirs1/dir_2/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2023-12-03T11:44:02.790 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2023-12-03T11:44:02.790 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.READ_DIRS1 2023-12-03T11:44:02.790 INFO:tasks.workunit.client.0.smithi003.stdout:read back objects in /bdirs1/dir_0 2023-12-03T11:44:02.790 INFO:tasks.workunit.client.0.smithi003.stdout:reading 0,256 dir_0/sfile_0 2023-12-03T11:44:02.791 INFO:tasks.workunit.client.0.smithi003.stdout: read back from sfile_0 : "data for sfile_0" 2023-12-03T11:44:02.791 INFO:tasks.workunit.client.0.smithi003.stdout:reading 0,256 dir_0/sfile_1 2023-12-03T11:44:02.791 INFO:tasks.workunit.client.0.smithi003.stdout: read back from sfile_1 : "data for sfile_1" 2023-12-03T11:44:02.791 INFO:tasks.workunit.client.0.smithi003.stdout:read back objects in /bdirs1/dir_1 2023-12-03T11:44:02.791 INFO:tasks.workunit.client.0.smithi003.stdout:reading 0,256 dir_1/sfile_0 2023-12-03T11:44:02.793 INFO:tasks.workunit.client.0.smithi003.stdout: read back from sfile_0 : "data for sfile_0" 2023-12-03T11:44:02.793 INFO:tasks.workunit.client.0.smithi003.stdout:reading 0,256 dir_1/sfile_1 2023-12-03T11:44:02.794 INFO:tasks.workunit.client.0.smithi003.stdout: read back from sfile_1 : "data for sfile_1" 2023-12-03T11:44:02.794 INFO:tasks.workunit.client.0.smithi003.stdout:read back objects in /bdirs1/dir_2 2023-12-03T11:44:02.794 INFO:tasks.workunit.client.0.smithi003.stdout:reading 0,256 dir_2/sfile_0 2023-12-03T11:44:02.795 INFO:tasks.workunit.client.0.smithi003.stdout: read back from sfile_0 : "data for sfile_0" 2023-12-03T11:44:02.795 INFO:tasks.workunit.client.0.smithi003.stdout:reading 0,256 dir_2/sfile_1 2023-12-03T11:44:02.797 INFO:tasks.workunit.client.0.smithi003.stdout: read back from sfile_1 : "data for sfile_1" 2023-12-03T11:44:02.797 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.READ_DIRS1 (8 ms) 2023-12-03T11:44:02.797 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.READF_SETUP1 2023-12-03T11:44:02.797 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.READF_SETUP1 (0 ms) 2023-12-03T11:44:02.797 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.READF_DIRS1 2023-12-03T11:44:02.797 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2023-12-03T11:44:02.797 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2023-12-03T11:44:02.797 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2023-12-03T11:44:02.797 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2023-12-03T11:44:02.797 INFO:tasks.workunit.client.0.smithi003.stdout:release sdir_0 type: DIR refs: 2 2023-12-03T11:44:02.797 INFO:tasks.workunit.client.0.smithi003.stdout:release sfile_0 type: FILE refs: 2 2023-12-03T11:44:02.798 INFO:tasks.workunit.client.0.smithi003.stdout:release sdir_1 type: DIR refs: 2 2023-12-03T11:44:02.798 INFO:tasks.workunit.client.0.smithi003.stdout:release sfile_1 type: FILE refs: 2 2023-12-03T11:44:02.798 INFO:tasks.workunit.client.0.smithi003.stdout:release sdir_0 type: DIR refs: 2 2023-12-03T11:44:02.798 INFO:tasks.workunit.client.0.smithi003.stdout:release sfile_0 type: FILE refs: 2 2023-12-03T11:44:02.798 INFO:tasks.workunit.client.0.smithi003.stdout:release sdir_1 type: DIR refs: 2 2023-12-03T11:44:02.798 INFO:tasks.workunit.client.0.smithi003.stdout:release sfile_1 type: FILE refs: 2 2023-12-03T11:44:02.798 INFO:tasks.workunit.client.0.smithi003.stdout:release sdir_0 type: DIR refs: 2 2023-12-03T11:44:02.798 INFO:tasks.workunit.client.0.smithi003.stdout:release sfile_0 type: FILE refs: 2 2023-12-03T11:44:02.798 INFO:tasks.workunit.client.0.smithi003.stdout:release sdir_1 type: DIR refs: 2 2023-12-03T11:44:02.798 INFO:tasks.workunit.client.0.smithi003.stdout:release sfile_1 type: FILE refs: 2 2023-12-03T11:44:02.798 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2023-12-03T11:44:02.798 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.HIER1 2023-12-03T11:44:02.805 INFO:tasks.workunit.client.0.smithi003.stdout:/nfsroot/foo/f2 (f2): FILE 2023-12-03T11:44:02.805 INFO:tasks.workunit.client.0.smithi003.stdout:/nfsroot/foo/f1 (f1): FILE 2023-12-03T11:44:02.808 INFO:tasks.workunit.client.0.smithi003.stdout:/nfsroot/foo/bar/f1 (f1): FILE 2023-12-03T11:44:02.810 INFO:tasks.workunit.client.0.smithi003.stdout:/nfsroot/foo/bar/d1 (d1): DIR 2023-12-03T11:44:02.813 INFO:tasks.workunit.client.0.smithi003.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2023-12-03T11:44:02.813 INFO:tasks.workunit.client.0.smithi003.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2023-12-03T11:44:02.814 INFO:tasks.workunit.client.0.smithi003.stdout:/nfsroot/foo/bar/baz/quux (quux): FILE 2023-12-03T11:44:02.815 INFO:tasks.workunit.client.0.smithi003.stdout:/nfsroot/foo/bar/baz/momma (momma): FILE 2023-12-03T11:44:02.815 INFO:tasks.workunit.client.0.smithi003.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2023-12-03T11:44:02.815 INFO:tasks.workunit.client.0.smithi003.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2023-12-03T11:44:02.816 INFO:tasks.workunit.client.0.smithi003.stdout:/nfsroot/foo/bar/baz/frobozz (frobozz): FILE 2023-12-03T11:44:02.818 INFO:tasks.workunit.client.0.smithi003.stdout:/nfsroot/foo/bar/baz/bear (bear): DIR 2023-12-03T11:44:02.819 INFO:tasks.workunit.client.0.smithi003.stdout:/nfsroot/foo/bar/baz (baz): DIR 2023-12-03T11:44:02.819 INFO:tasks.workunit.client.0.smithi003.stdout:/nfsroot/foo/bar (bar): DIR 2023-12-03T11:44:02.819 INFO:tasks.workunit.client.0.smithi003.stdout:/nfsroot/foo (foo): DIR 2023-12-03T11:44:02.819 INFO:tasks.workunit.client.0.smithi003.stdout:/nfsroot (nfsroot): DIR 2023-12-03T11:44:02.819 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.HIER1 (22 ms) 2023-12-03T11:44:02.819 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2023-12-03T11:44:02.819 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2023-12-03T11:44:02.819 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2023-12-03T11:44:02.819 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2023-12-03T11:44:02.819 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2023-12-03T11:44:02.819 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2023-12-03T11:44:02.819 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2023-12-03T11:44:02.819 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2023-12-03T11:44:02.819 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.CLEANUP 2023-12-03T11:44:02.819 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2023-12-03T11:44:02.820 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.UMOUNT 2023-12-03T11:44:02.820 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2023-12-03T11:44:02.820 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.SHUTDOWN 2023-12-03T11:44:02.820 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:44:02.817+0000 7f17a532c8c0 -1 shutting down 2023-12-03T11:44:02.820 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:44:02.818+0000 7f177e3e0640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 97911, si_uid : 1000, si_addr0x3e800017e77, si_status0 2023-12-03T11:44:02.884 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.SHUTDOWN (66 ms) 2023-12-03T11:44:02.885 INFO:tasks.workunit.client.0.smithi003.stdout:[----------] 24 tests from LibRGW (538 ms total) 2023-12-03T11:44:02.885 INFO:tasks.workunit.client.0.smithi003.stdout: 2023-12-03T11:44:02.885 INFO:tasks.workunit.client.0.smithi003.stdout:[----------] Global test environment tear-down 2023-12-03T11:44:02.885 INFO:tasks.workunit.client.0.smithi003.stdout:[==========] 24 tests from 1 test suite ran. (538 ms total) 2023-12-03T11:44:02.885 INFO:tasks.workunit.client.0.smithi003.stdout:[ PASSED ] 24 tests. 2023-12-03T11:44:02.890 INFO:tasks.workunit.client.0.smithi003.stdout:phase 2.1 2023-12-03T11:44:02.911 INFO:tasks.workunit.client.0.smithi003.stdout:[==========] Running 9 tests from 1 test suite. 2023-12-03T11:44:02.911 INFO:tasks.workunit.client.0.smithi003.stdout:[----------] Global test environment set-up. 2023-12-03T11:44:02.912 INFO:tasks.workunit.client.0.smithi003.stdout:[----------] 9 tests from LibRGW 2023-12-03T11:44:02.912 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.INIT 2023-12-03T11:44:02.920 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:44:02.920 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:44:03.282 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.INIT (371 ms) 2023-12-03T11:44:03.283 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.MOUNT 2023-12-03T11:44:03.283 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2023-12-03T11:44:03.283 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2023-12-03T11:44:03.297 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.CREATE_BUCKET (13 ms) 2023-12-03T11:44:03.297 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2023-12-03T11:44:03.297 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2023-12-03T11:44:03.297 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.CREATE_BUCKET_MULTI 2023-12-03T11:44:03.310 INFO:tasks.workunit.client.0.smithi003.stdout:created: sorrydave0 2023-12-03T11:44:03.325 INFO:tasks.workunit.client.0.smithi003.stdout:created: sorrydave1 2023-12-03T11:44:03.336 INFO:tasks.workunit.client.0.smithi003.stdout:created: sorrydave2 2023-12-03T11:44:03.347 INFO:tasks.workunit.client.0.smithi003.stdout:created: sorrydave3 2023-12-03T11:44:03.357 INFO:tasks.workunit.client.0.smithi003.stdout:created: sorrydave4 2023-12-03T11:44:03.368 INFO:tasks.workunit.client.0.smithi003.stdout:created: sorrydave5 2023-12-03T11:44:03.378 INFO:tasks.workunit.client.0.smithi003.stdout:created: sorrydave6 2023-12-03T11:44:03.388 INFO:tasks.workunit.client.0.smithi003.stdout:created: sorrydave7 2023-12-03T11:44:03.399 INFO:tasks.workunit.client.0.smithi003.stdout:created: sorrydave8 2023-12-03T11:44:03.410 INFO:tasks.workunit.client.0.smithi003.stdout:created: sorrydave9 2023-12-03T11:44:03.411 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.CREATE_BUCKET_MULTI (114 ms) 2023-12-03T11:44:03.411 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.DELETE_BUCKET_MULTI 2023-12-03T11:44:03.736 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.DELETE_BUCKET_MULTI (326 ms) 2023-12-03T11:44:03.737 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.CLEANUP 2023-12-03T11:44:03.737 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2023-12-03T11:44:03.737 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.UMOUNT 2023-12-03T11:44:03.737 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2023-12-03T11:44:03.737 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.SHUTDOWN 2023-12-03T11:44:03.737 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:44:03.735+0000 7feada3268c0 -1 shutting down 2023-12-03T11:44:03.737 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:44:03.736+0000 7feab34cd640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 98021, si_uid : 1000, si_addr0x3e800017ee5, si_status0 2023-12-03T11:44:03.847 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.SHUTDOWN (111 ms) 2023-12-03T11:44:03.848 INFO:tasks.workunit.client.0.smithi003.stdout:[----------] 9 tests from LibRGW (936 ms total) 2023-12-03T11:44:03.848 INFO:tasks.workunit.client.0.smithi003.stdout: 2023-12-03T11:44:03.848 INFO:tasks.workunit.client.0.smithi003.stdout:[----------] Global test environment tear-down 2023-12-03T11:44:03.848 INFO:tasks.workunit.client.0.smithi003.stdout:[==========] 9 tests from 1 test suite ran. (936 ms total) 2023-12-03T11:44:03.848 INFO:tasks.workunit.client.0.smithi003.stdout:[ PASSED ] 9 tests. 2023-12-03T11:44:03.853 INFO:tasks.workunit.client.0.smithi003.stdout:phase 2.2 2023-12-03T11:44:03.877 INFO:tasks.workunit.client.0.smithi003.stdout:[==========] Running 9 tests from 1 test suite. 2023-12-03T11:44:03.877 INFO:tasks.workunit.client.0.smithi003.stdout:[----------] Global test environment set-up. 2023-12-03T11:44:03.877 INFO:tasks.workunit.client.0.smithi003.stdout:[----------] 9 tests from LibRGW 2023-12-03T11:44:03.877 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.INIT 2023-12-03T11:44:03.886 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:44:03.886 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:44:04.046 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.INIT (170 ms) 2023-12-03T11:44:04.047 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.MOUNT 2023-12-03T11:44:04.047 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2023-12-03T11:44:04.048 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2023-12-03T11:44:04.048 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2023-12-03T11:44:04.048 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2023-12-03T11:44:04.081 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.DELETE_BUCKET (34 ms) 2023-12-03T11:44:04.081 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.CREATE_BUCKET_MULTI 2023-12-03T11:44:04.091 INFO:tasks.workunit.client.0.smithi003.stdout:created: sorrydave0 2023-12-03T11:44:04.102 INFO:tasks.workunit.client.0.smithi003.stdout:created: sorrydave1 2023-12-03T11:44:04.114 INFO:tasks.workunit.client.0.smithi003.stdout:created: sorrydave2 2023-12-03T11:44:04.125 INFO:tasks.workunit.client.0.smithi003.stdout:created: sorrydave3 2023-12-03T11:44:04.137 INFO:tasks.workunit.client.0.smithi003.stdout:created: sorrydave4 2023-12-03T11:44:04.151 INFO:tasks.workunit.client.0.smithi003.stdout:created: sorrydave5 2023-12-03T11:44:04.161 INFO:tasks.workunit.client.0.smithi003.stdout:created: sorrydave6 2023-12-03T11:44:04.171 INFO:tasks.workunit.client.0.smithi003.stdout:created: sorrydave7 2023-12-03T11:44:04.181 INFO:tasks.workunit.client.0.smithi003.stdout:created: sorrydave8 2023-12-03T11:44:04.192 INFO:tasks.workunit.client.0.smithi003.stdout:created: sorrydave9 2023-12-03T11:44:04.192 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.CREATE_BUCKET_MULTI (111 ms) 2023-12-03T11:44:04.192 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.DELETE_BUCKET_MULTI 2023-12-03T11:44:04.514 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.DELETE_BUCKET_MULTI (322 ms) 2023-12-03T11:44:04.514 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.CLEANUP 2023-12-03T11:44:04.514 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2023-12-03T11:44:04.514 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.UMOUNT 2023-12-03T11:44:04.514 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2023-12-03T11:44:04.515 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.SHUTDOWN 2023-12-03T11:44:04.515 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:44:04.513+0000 7f44334578c0 -1 shutting down 2023-12-03T11:44:04.515 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:44:04.514+0000 7f440e338640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 98131, si_uid : 1000, si_addr0x3e800017f53, si_status0 2023-12-03T11:44:04.612 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.SHUTDOWN (98 ms) 2023-12-03T11:44:04.613 INFO:tasks.workunit.client.0.smithi003.stdout:[----------] 9 tests from LibRGW (736 ms total) 2023-12-03T11:44:04.613 INFO:tasks.workunit.client.0.smithi003.stdout: 2023-12-03T11:44:04.613 INFO:tasks.workunit.client.0.smithi003.stdout:[----------] Global test environment tear-down 2023-12-03T11:44:04.613 INFO:tasks.workunit.client.0.smithi003.stdout:[==========] 9 tests from 1 test suite ran. (736 ms total) 2023-12-03T11:44:04.613 INFO:tasks.workunit.client.0.smithi003.stdout:[ PASSED ] 9 tests. 2023-12-03T11:44:04.618 INFO:tasks.workunit.client.0.smithi003.stdout:phase 3.1 2023-12-03T11:44:04.942 INFO:tasks.workunit.client.0.smithi003.stdout:[==========] Running 13 tests from 1 test suite. 2023-12-03T11:44:04.942 INFO:tasks.workunit.client.0.smithi003.stdout:[----------] Global test environment set-up. 2023-12-03T11:44:04.942 INFO:tasks.workunit.client.0.smithi003.stdout:[----------] 13 tests from LibRGW 2023-12-03T11:44:04.943 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.INIT 2023-12-03T11:44:04.952 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:44:04.952 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:44:05.116 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.INIT (174 ms) 2023-12-03T11:44:05.116 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.MOUNT 2023-12-03T11:44:05.117 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2023-12-03T11:44:05.117 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2023-12-03T11:44:05.129 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.CREATE_BUCKET (11 ms) 2023-12-03T11:44:05.129 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2023-12-03T11:44:05.132 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (4 ms) 2023-12-03T11:44:05.133 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2023-12-03T11:44:05.134 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (2 ms) 2023-12-03T11:44:05.135 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.LARGE1 2023-12-03T11:44:05.204 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.LARGE1 (70 ms) 2023-12-03T11:44:05.204 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.LARGE2 2023-12-03T11:44:05.245 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.LARGE2 (40 ms) 2023-12-03T11:44:05.245 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.STAT_OBJECT 2023-12-03T11:44:05.245 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2023-12-03T11:44:05.245 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2023-12-03T11:44:05.245 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.DELETE_OBJECT (0 ms) 2023-12-03T11:44:05.245 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2023-12-03T11:44:05.245 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2023-12-03T11:44:05.245 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.CLEANUP 2023-12-03T11:44:05.245 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2023-12-03T11:44:05.245 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.UMOUNT 2023-12-03T11:44:05.245 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2023-12-03T11:44:05.245 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.SHUTDOWN 2023-12-03T11:44:05.246 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:44:05.243+0000 7f002dc688c0 -1 shutting down 2023-12-03T11:44:05.246 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:44:05.245+0000 7f0008b47640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 98241, si_uid : 1000, si_addr0x3e800017fc1, si_status0 2023-12-03T11:44:05.281 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.SHUTDOWN (37 ms) 2023-12-03T11:44:05.281 INFO:tasks.workunit.client.0.smithi003.stdout:[----------] 13 tests from LibRGW (339 ms total) 2023-12-03T11:44:05.281 INFO:tasks.workunit.client.0.smithi003.stdout: 2023-12-03T11:44:05.281 INFO:tasks.workunit.client.0.smithi003.stdout:[----------] Global test environment tear-down 2023-12-03T11:44:05.281 INFO:tasks.workunit.client.0.smithi003.stdout:[==========] 13 tests from 1 test suite ran. (339 ms total) 2023-12-03T11:44:05.281 INFO:tasks.workunit.client.0.smithi003.stdout:[ PASSED ] 13 tests. 2023-12-03T11:44:05.288 INFO:tasks.workunit.client.0.smithi003.stdout:phase 3.2 2023-12-03T11:44:05.609 INFO:tasks.workunit.client.0.smithi003.stdout:[==========] Running 13 tests from 1 test suite. 2023-12-03T11:44:05.609 INFO:tasks.workunit.client.0.smithi003.stdout:[----------] Global test environment set-up. 2023-12-03T11:44:05.609 INFO:tasks.workunit.client.0.smithi003.stdout:[----------] 13 tests from LibRGW 2023-12-03T11:44:05.609 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.INIT 2023-12-03T11:44:05.617 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:44:05.617 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:44:05.975 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.INIT (367 ms) 2023-12-03T11:44:05.975 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.MOUNT 2023-12-03T11:44:05.976 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2023-12-03T11:44:05.976 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2023-12-03T11:44:05.976 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2023-12-03T11:44:05.976 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2023-12-03T11:44:05.985 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (6 ms) 2023-12-03T11:44:05.986 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2023-12-03T11:44:05.987 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (4 ms) 2023-12-03T11:44:05.987 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.LARGE1 2023-12-03T11:44:06.070 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.LARGE1 (83 ms) 2023-12-03T11:44:06.070 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.LARGE2 2023-12-03T11:44:06.070 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.LARGE2 (0 ms) 2023-12-03T11:44:06.070 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.STAT_OBJECT 2023-12-03T11:44:06.070 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2023-12-03T11:44:06.070 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2023-12-03T11:44:06.075 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.DELETE_OBJECT (5 ms) 2023-12-03T11:44:06.075 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2023-12-03T11:44:06.108 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.DELETE_BUCKET (32 ms) 2023-12-03T11:44:06.108 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.CLEANUP 2023-12-03T11:44:06.108 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2023-12-03T11:44:06.108 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.UMOUNT 2023-12-03T11:44:06.108 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2023-12-03T11:44:06.108 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.SHUTDOWN 2023-12-03T11:44:06.108 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:44:06.106+0000 7f99dd92e8c0 -1 shutting down 2023-12-03T11:44:06.109 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:44:06.107+0000 7f99b880f640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 98351, si_uid : 1000, si_addr0x3e80001802f, si_status0 2023-12-03T11:44:06.139 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.SHUTDOWN (32 ms) 2023-12-03T11:44:06.139 INFO:tasks.workunit.client.0.smithi003.stdout:[----------] 13 tests from LibRGW (531 ms total) 2023-12-03T11:44:06.139 INFO:tasks.workunit.client.0.smithi003.stdout: 2023-12-03T11:44:06.139 INFO:tasks.workunit.client.0.smithi003.stdout:[----------] Global test environment tear-down 2023-12-03T11:44:06.139 INFO:tasks.workunit.client.0.smithi003.stdout:[==========] 13 tests from 1 test suite ran. (531 ms total) 2023-12-03T11:44:06.139 INFO:tasks.workunit.client.0.smithi003.stdout:[ PASSED ] 13 tests. 2023-12-03T11:44:06.146 INFO:tasks.workunit.client.0.smithi003.stdout:phase 4.1 2023-12-03T11:44:06.166 INFO:tasks.workunit.client.0.smithi003.stdout:[==========] Running 11 tests from 1 test suite. 2023-12-03T11:44:06.166 INFO:tasks.workunit.client.0.smithi003.stdout:[----------] Global test environment set-up. 2023-12-03T11:44:06.166 INFO:tasks.workunit.client.0.smithi003.stdout:[----------] 11 tests from LibRGW 2023-12-03T11:44:06.166 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.TVAR 2023-12-03T11:44:06.166 INFO:tasks.workunit.client.0.smithi003.stdout:read i1: 64001 2023-12-03T11:44:06.167 INFO:tasks.workunit.client.0.smithi003.stdout:read s1: blunderbuss 2023-12-03T11:44:06.167 INFO:tasks.workunit.client.0.smithi003.stdout:read s3: [ OK ] LibRGW.TVAR (0 ms) 2023-12-03T11:44:06.167 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.INIT 2023-12-03T11:44:06.177 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:44:06.177 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:44:06.337 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.INIT (171 ms) 2023-12-03T11:44:06.337 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.MOUNT 2023-12-03T11:44:06.338 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2023-12-03T11:44:06.338 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2023-12-03T11:44:06.357 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (19 ms) 2023-12-03T11:44:06.357 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2023-12-03T11:44:06.819 INFO:tasks.workunit.client.0.smithi003.stdout:created: dmarker:f_0 2023-12-03T11:44:06.820 INFO:tasks.workunit.client.0.smithi003.stdout:created: dmarker:f_1 2023-12-03T11:44:06.820 INFO:tasks.workunit.client.0.smithi003.stdout:created: dmarker:f_2 2023-12-03T11:44:06.820 INFO:tasks.workunit.client.0.smithi003.stdout:created: dmarker:f_3 2023-12-03T11:44:06.820 INFO:tasks.workunit.client.0.smithi003.stdout:created: dmarker:f_4 2023-12-03T11:44:06.820 INFO:tasks.workunit.client.0.smithi003.stdout:created: dmarker:f_5 2023-12-03T11:44:06.820 INFO:tasks.workunit.client.0.smithi003.stdout:created: dmarker:f_6 2023-12-03T11:44:06.820 INFO:tasks.workunit.client.0.smithi003.stdout:created: dmarker:f_7 2023-12-03T11:44:06.820 INFO:tasks.workunit.client.0.smithi003.stdout:created: dmarker:f_8 2023-12-03T11:44:06.820 INFO:tasks.workunit.client.0.smithi003.stdout:created: dmarker:f_9 2023-12-03T11:44:06.820 INFO:tasks.workunit.client.0.smithi003.stdout:created: dmarker:f_10 2023-12-03T11:44:06.820 INFO:tasks.workunit.client.0.smithi003.stdout:created: dmarker:f_11 2023-12-03T11:44:06.820 INFO:tasks.workunit.client.0.smithi003.stdout:created: dmarker:f_12 2023-12-03T11:44:06.820 INFO:tasks.workunit.client.0.smithi003.stdout:created: dmarker:f_13 2023-12-03T11:44:06.821 INFO:tasks.workunit.client.0.smithi003.stdout:created: dmarker:f_14 2023-12-03T11:44:06.821 INFO:tasks.workunit.client.0.smithi003.stdout:created: dmarker:f_15 2023-12-03T11:44:06.821 INFO:tasks.workunit.client.0.smithi003.stdout:created: dmarker:f_16 2023-12-03T11:44:06.821 INFO:tasks.workunit.client.0.smithi003.stdout:created: dmarker:f_17 2023-12-03T11:44:06.821 INFO:tasks.workunit.client.0.smithi003.stdout:created: dmarker:f_18 2023-12-03T11:44:06.821 INFO:tasks.workunit.client.0.smithi003.stdout:created: dmarker:f_19 2023-12-03T11:44:06.821 INFO:tasks.workunit.client.0.smithi003.stdout:created: dmarker:f_20 2023-12-03T11:44:06.821 INFO:tasks.workunit.client.0.smithi003.stdout:created: dmarker:f_21 2023-12-03T11:44:06.821 INFO:tasks.workunit.client.0.smithi003.stdout:created: dmarker:f_22 2023-12-03T11:44:06.821 INFO:tasks.workunit.client.0.smithi003.stdout:created: dmarker:f_23 2023-12-03T11:44:06.821 INFO:tasks.workunit.client.0.smithi003.stdout:created: dmarker:f_24 2023-12-03T11:44:06.821 INFO:tasks.workunit.client.0.smithi003.stdout:created: dmarker:f_25 2023-12-03T11:44:06.821 INFO:tasks.workunit.client.0.smithi003.stdout:created: dmarker:f_26 2023-12-03T11:44:06.821 INFO:tasks.workunit.client.0.smithi003.stdout:created: dmarker:f_27 2023-12-03T11:44:06.821 INFO:tasks.workunit.client.0.smithi003.stdout:created: dmarker:f_28 2023-12-03T11:44:06.822 INFO:tasks.workunit.client.0.smithi003.stdout:created: dmarker:f_29 2023-12-03T11:44:06.822 INFO:tasks.workunit.client.0.smithi003.stdout:created: dmarker:f_30 2023-12-03T11:44:06.822 INFO:tasks.workunit.client.0.smithi003.stdout:created: dmarker:f_31 2023-12-03T11:44:06.822 INFO:tasks.workunit.client.0.smithi003.stdout:created: dmarker:f_32 2023-12-03T11:44:06.822 INFO:tasks.workunit.client.0.smithi003.stdout:created: dmarker:f_33 2023-12-03T11:44:06.822 INFO:tasks.workunit.client.0.smithi003.stdout:created: dmarker:f_34 2023-12-03T11:44:06.822 INFO:tasks.workunit.client.0.smithi003.stdout:created: dmarker:f_35 2023-12-03T11:44:06.822 INFO:tasks.workunit.client.0.smithi003.stdout:created: dmarker:f_36 2023-12-03T11:44:06.822 INFO:tasks.workunit.client.0.smithi003.stdout:created: dmarker:f_37 2023-12-03T11:44:06.822 INFO:tasks.workunit.client.0.smithi003.stdout:created: dmarker:f_38 2023-12-03T11:44:06.822 INFO:tasks.workunit.client.0.smithi003.stdout:created: dmarker:f_39 2023-12-03T11:44:06.822 INFO:tasks.workunit.client.0.smithi003.stdout:created: dmarker:f_40 2023-12-03T11:44:06.822 INFO:tasks.workunit.client.0.smithi003.stdout:created: dmarker:f_41 2023-12-03T11:44:06.822 INFO:tasks.workunit.client.0.smithi003.stdout:created: dmarker:f_42 2023-12-03T11:44:06.822 INFO:tasks.workunit.client.0.smithi003.stdout:created: dmarker:f_43 2023-12-03T11:44:06.823 INFO:tasks.workunit.client.0.smithi003.stdout:created: dmarker:f_44 2023-12-03T11:44:06.823 INFO:tasks.workunit.client.0.smithi003.stdout:created: dmarker:f_45 2023-12-03T11:44:06.823 INFO:tasks.workunit.client.0.smithi003.stdout:created: dmarker:f_46 2023-12-03T11:44:06.823 INFO:tasks.workunit.client.0.smithi003.stdout:created: dmarker:f_47 2023-12-03T11:44:06.823 INFO:tasks.workunit.client.0.smithi003.stdout:created: dmarker:f_48 2023-12-03T11:44:06.823 INFO:tasks.workunit.client.0.smithi003.stdout:created: dmarker:f_49 2023-12-03T11:44:06.823 INFO:tasks.workunit.client.0.smithi003.stdout:created: dmarker:f_50 2023-12-03T11:44:06.823 INFO:tasks.workunit.client.0.smithi003.stdout:created: dmarker:f_51 2023-12-03T11:44:06.823 INFO:tasks.workunit.client.0.smithi003.stdout:created: dmarker:f_52 2023-12-03T11:44:06.823 INFO:tasks.workunit.client.0.smithi003.stdout:created: dmarker:f_53 2023-12-03T11:44:06.823 INFO:tasks.workunit.client.0.smithi003.stdout:created: dmarker:f_54 2023-12-03T11:44:06.823 INFO:tasks.workunit.client.0.smithi003.stdout:created: dmarker:f_55 2023-12-03T11:44:06.823 INFO:tasks.workunit.client.0.smithi003.stdout:created: dmarker:f_56 2023-12-03T11:44:06.823 INFO:tasks.workunit.client.0.smithi003.stdout:created: dmarker:f_57 2023-12-03T11:44:06.823 INFO:tasks.workunit.client.0.smithi003.stdout:created: dmarker:f_58 2023-12-03T11:44:06.824 INFO:tasks.workunit.client.0.smithi003.stdout:created: dmarker:f_59 2023-12-03T11:44:06.824 INFO:tasks.workunit.client.0.smithi003.stdout:created: dmarker:f_60 2023-12-03T11:44:06.824 INFO:tasks.workunit.client.0.smithi003.stdout:created: dmarker:f_61 2023-12-03T11:44:06.824 INFO:tasks.workunit.client.0.smithi003.stdout:created: dmarker:f_62 2023-12-03T11:44:06.824 INFO:tasks.workunit.client.0.smithi003.stdout:created: dmarker:f_63 2023-12-03T11:44:06.824 INFO:tasks.workunit.client.0.smithi003.stdout:created: dmarker:f_64 2023-12-03T11:44:06.824 INFO:tasks.workunit.client.0.smithi003.stdout:created: dmarker:f_65 2023-12-03T11:44:06.824 INFO:tasks.workunit.client.0.smithi003.stdout:created: dmarker:f_66 2023-12-03T11:44:06.824 INFO:tasks.workunit.client.0.smithi003.stdout:created: dmarker:f_67 2023-12-03T11:44:06.824 INFO:tasks.workunit.client.0.smithi003.stdout:created: dmarker:f_68 2023-12-03T11:44:06.824 INFO:tasks.workunit.client.0.smithi003.stdout:created: dmarker:f_69 2023-12-03T11:44:06.824 INFO:tasks.workunit.client.0.smithi003.stdout:created: dmarker:f_70 2023-12-03T11:44:06.824 INFO:tasks.workunit.client.0.smithi003.stdout:created: dmarker:f_71 2023-12-03T11:44:06.824 INFO:tasks.workunit.client.0.smithi003.stdout:created: dmarker:f_72 2023-12-03T11:44:06.824 INFO:tasks.workunit.client.0.smithi003.stdout:created: dmarker:f_73 2023-12-03T11:44:06.825 INFO:tasks.workunit.client.0.smithi003.stdout:created: dmarker:f_74 2023-12-03T11:44:06.825 INFO:tasks.workunit.client.0.smithi003.stdout:created: dmarker:f_75 2023-12-03T11:44:06.825 INFO:tasks.workunit.client.0.smithi003.stdout:created: dmarker:f_76 2023-12-03T11:44:06.825 INFO:tasks.workunit.client.0.smithi003.stdout:created: dmarker:f_77 2023-12-03T11:44:06.825 INFO:tasks.workunit.client.0.smithi003.stdout:created: dmarker:f_78 2023-12-03T11:44:06.825 INFO:tasks.workunit.client.0.smithi003.stdout:created: dmarker:f_79 2023-12-03T11:44:06.825 INFO:tasks.workunit.client.0.smithi003.stdout:created: dmarker:f_80 2023-12-03T11:44:06.825 INFO:tasks.workunit.client.0.smithi003.stdout:created: dmarker:f_81 2023-12-03T11:44:06.826 INFO:tasks.workunit.client.0.smithi003.stdout:created: dmarker:f_82 2023-12-03T11:44:06.826 INFO:tasks.workunit.client.0.smithi003.stdout:created: dmarker:f_83 2023-12-03T11:44:06.826 INFO:tasks.workunit.client.0.smithi003.stdout:created: dmarker:f_84 2023-12-03T11:44:06.826 INFO:tasks.workunit.client.0.smithi003.stdout:created: dmarker:f_85 2023-12-03T11:44:06.826 INFO:tasks.workunit.client.0.smithi003.stdout:created: dmarker:f_86 2023-12-03T11:44:06.826 INFO:tasks.workunit.client.0.smithi003.stdout:created: dmarker:f_87 2023-12-03T11:44:06.826 INFO:tasks.workunit.client.0.smithi003.stdout:created: dmarker:f_88 2023-12-03T11:44:06.826 INFO:tasks.workunit.client.0.smithi003.stdout:created: dmarker:f_89 2023-12-03T11:44:06.826 INFO:tasks.workunit.client.0.smithi003.stdout:created: dmarker:f_90 2023-12-03T11:44:06.826 INFO:tasks.workunit.client.0.smithi003.stdout:created: dmarker:f_91 2023-12-03T11:44:06.826 INFO:tasks.workunit.client.0.smithi003.stdout:created: dmarker:f_92 2023-12-03T11:44:06.826 INFO:tasks.workunit.client.0.smithi003.stdout:created: dmarker:f_93 2023-12-03T11:44:06.826 INFO:tasks.workunit.client.0.smithi003.stdout:created: dmarker:f_94 2023-12-03T11:44:06.826 INFO:tasks.workunit.client.0.smithi003.stdout:created: dmarker:f_95 2023-12-03T11:44:06.827 INFO:tasks.workunit.client.0.smithi003.stdout:created: dmarker:f_96 2023-12-03T11:44:06.827 INFO:tasks.workunit.client.0.smithi003.stdout:created: dmarker:f_97 2023-12-03T11:44:06.827 INFO:tasks.workunit.client.0.smithi003.stdout:created: dmarker:f_98 2023-12-03T11:44:06.827 INFO:tasks.workunit.client.0.smithi003.stdout:created: dmarker:f_99 2023-12-03T11:44:06.827 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (462 ms) 2023-12-03T11:44:06.827 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2023-12-03T11:44:06.829 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=. flags=4 2023-12-03T11:44:06.829 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=.. flags=4 2023-12-03T11:44:06.829 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2023-12-03T11:44:06.829 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2023-12-03T11:44:06.829 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2023-12-03T11:44:06.829 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2023-12-03T11:44:06.829 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2023-12-03T11:44:06.829 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2023-12-03T11:44:06.830 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2023-12-03T11:44:06.830 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2023-12-03T11:44:06.830 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2023-12-03T11:44:06.830 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2023-12-03T11:44:06.830 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2023-12-03T11:44:06.830 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2023-12-03T11:44:06.830 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2023-12-03T11:44:06.830 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2023-12-03T11:44:06.830 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2023-12-03T11:44:06.830 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2023-12-03T11:44:06.830 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2023-12-03T11:44:06.830 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2023-12-03T11:44:06.831 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2023-12-03T11:44:06.831 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2023-12-03T11:44:06.831 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2023-12-03T11:44:06.831 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2023-12-03T11:44:06.831 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2023-12-03T11:44:06.831 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2023-12-03T11:44:06.831 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2023-12-03T11:44:06.831 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2023-12-03T11:44:06.831 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2023-12-03T11:44:06.831 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2023-12-03T11:44:06.831 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2023-12-03T11:44:06.831 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2023-12-03T11:44:06.831 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2023-12-03T11:44:06.831 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2023-12-03T11:44:06.831 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2023-12-03T11:44:06.832 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2023-12-03T11:44:06.832 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2023-12-03T11:44:06.832 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2023-12-03T11:44:06.832 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2023-12-03T11:44:06.832 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2023-12-03T11:44:06.832 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2023-12-03T11:44:06.832 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2023-12-03T11:44:06.832 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2023-12-03T11:44:06.832 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2023-12-03T11:44:06.832 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2023-12-03T11:44:06.832 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2023-12-03T11:44:06.832 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2023-12-03T11:44:06.832 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2023-12-03T11:44:06.832 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2023-12-03T11:44:06.832 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2023-12-03T11:44:06.833 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2023-12-03T11:44:06.833 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2023-12-03T11:44:06.833 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2023-12-03T11:44:06.833 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2023-12-03T11:44:06.833 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2023-12-03T11:44:06.833 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2023-12-03T11:44:06.833 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2023-12-03T11:44:06.833 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2023-12-03T11:44:06.833 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2023-12-03T11:44:06.833 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2023-12-03T11:44:06.833 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2023-12-03T11:44:06.833 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2023-12-03T11:44:06.833 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2023-12-03T11:44:06.833 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2023-12-03T11:44:06.833 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2023-12-03T11:44:06.834 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2023-12-03T11:44:06.834 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2023-12-03T11:44:06.834 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2023-12-03T11:44:06.834 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2023-12-03T11:44:06.834 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2023-12-03T11:44:06.834 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2023-12-03T11:44:06.834 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2023-12-03T11:44:06.834 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2023-12-03T11:44:06.834 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2023-12-03T11:44:06.834 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2023-12-03T11:44:06.834 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2023-12-03T11:44:06.834 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2023-12-03T11:44:06.834 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2023-12-03T11:44:06.834 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2023-12-03T11:44:06.834 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2023-12-03T11:44:06.835 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2023-12-03T11:44:06.835 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2023-12-03T11:44:06.835 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2023-12-03T11:44:06.835 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2023-12-03T11:44:06.835 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2023-12-03T11:44:06.835 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2023-12-03T11:44:06.835 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2023-12-03T11:44:06.835 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2023-12-03T11:44:06.835 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2023-12-03T11:44:06.835 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2023-12-03T11:44:06.835 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2023-12-03T11:44:06.835 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2023-12-03T11:44:06.835 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2023-12-03T11:44:06.835 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2023-12-03T11:44:06.835 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2023-12-03T11:44:06.836 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2023-12-03T11:44:06.836 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2023-12-03T11:44:06.836 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2023-12-03T11:44:06.836 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2023-12-03T11:44:06.836 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2023-12-03T11:44:06.836 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2023-12-03T11:44:06.836 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2023-12-03T11:44:06.836 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.MARKER1_READDIR (3 ms) 2023-12-03T11:44:06.836 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.MARKER2_READDIR 2023-12-03T11:44:06.836 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2023-12-03T11:44:06.836 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2023-12-03T11:44:06.836 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2023-12-03T11:44:06.836 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2023-12-03T11:44:06.836 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2023-12-03T11:44:06.837 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2023-12-03T11:44:06.837 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2023-12-03T11:44:06.837 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2023-12-03T11:44:06.837 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2023-12-03T11:44:06.837 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2023-12-03T11:44:06.837 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2023-12-03T11:44:06.837 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2023-12-03T11:44:06.837 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2023-12-03T11:44:06.837 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2023-12-03T11:44:06.837 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2023-12-03T11:44:06.837 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2023-12-03T11:44:06.837 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2023-12-03T11:44:06.837 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2023-12-03T11:44:06.837 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2023-12-03T11:44:06.837 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2023-12-03T11:44:06.838 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2023-12-03T11:44:06.838 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2023-12-03T11:44:06.838 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2023-12-03T11:44:06.838 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2023-12-03T11:44:06.838 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2023-12-03T11:44:06.838 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2023-12-03T11:44:06.838 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2023-12-03T11:44:06.838 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2023-12-03T11:44:06.839 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2023-12-03T11:44:06.839 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2023-12-03T11:44:06.839 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2023-12-03T11:44:06.839 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2023-12-03T11:44:06.839 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2023-12-03T11:44:06.839 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2023-12-03T11:44:06.839 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2023-12-03T11:44:06.839 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2023-12-03T11:44:06.839 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2023-12-03T11:44:06.839 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2023-12-03T11:44:06.839 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2023-12-03T11:44:06.839 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2023-12-03T11:44:06.839 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2023-12-03T11:44:06.839 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2023-12-03T11:44:06.840 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2023-12-03T11:44:06.840 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2023-12-03T11:44:06.840 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2023-12-03T11:44:06.840 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2023-12-03T11:44:06.841 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2023-12-03T11:44:06.841 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2023-12-03T11:44:06.841 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2023-12-03T11:44:06.841 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2023-12-03T11:44:06.841 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2023-12-03T11:44:06.841 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2023-12-03T11:44:06.841 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2023-12-03T11:44:06.841 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2023-12-03T11:44:06.841 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2023-12-03T11:44:06.841 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2023-12-03T11:44:06.841 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2023-12-03T11:44:06.841 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2023-12-03T11:44:06.841 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2023-12-03T11:44:06.841 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2023-12-03T11:44:06.841 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2023-12-03T11:44:06.842 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2023-12-03T11:44:06.842 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2023-12-03T11:44:06.842 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2023-12-03T11:44:06.842 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2023-12-03T11:44:06.842 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2023-12-03T11:44:06.842 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2023-12-03T11:44:06.842 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2023-12-03T11:44:06.842 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2023-12-03T11:44:06.842 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2023-12-03T11:44:06.842 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2023-12-03T11:44:06.842 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2023-12-03T11:44:06.842 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2023-12-03T11:44:06.842 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2023-12-03T11:44:06.842 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2023-12-03T11:44:06.843 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2023-12-03T11:44:06.843 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2023-12-03T11:44:06.843 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2023-12-03T11:44:06.843 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2023-12-03T11:44:06.843 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2023-12-03T11:44:06.843 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2023-12-03T11:44:06.843 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2023-12-03T11:44:06.843 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2023-12-03T11:44:06.843 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2023-12-03T11:44:06.843 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2023-12-03T11:44:06.843 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2023-12-03T11:44:06.843 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2023-12-03T11:44:06.843 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2023-12-03T11:44:06.843 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2023-12-03T11:44:06.843 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2023-12-03T11:44:06.843 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2023-12-03T11:44:06.844 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2023-12-03T11:44:06.844 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2023-12-03T11:44:06.844 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2023-12-03T11:44:06.844 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2023-12-03T11:44:06.844 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2023-12-03T11:44:06.844 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2023-12-03T11:44:06.844 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2023-12-03T11:44:06.844 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2023-12-03T11:44:06.844 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2023-12-03T11:44:06.844 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.MARKER2_READDIR (2 ms) 2023-12-03T11:44:06.844 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2023-12-03T11:44:06.844 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2023-12-03T11:44:06.844 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.CLEANUP 2023-12-03T11:44:06.844 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2023-12-03T11:44:06.845 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.UMOUNT 2023-12-03T11:44:06.845 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.UMOUNT (1 ms) 2023-12-03T11:44:06.845 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.SHUTDOWN 2023-12-03T11:44:06.845 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:44:06.824+0000 7f502a4c18c0 -1 shutting down 2023-12-03T11:44:06.845 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:44:06.825+0000 7f5002f0b640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 98461, si_uid : 1000, si_addr0x3e80001809d, si_status0 2023-12-03T11:44:06.903 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.SHUTDOWN (77 ms) 2023-12-03T11:44:06.903 INFO:tasks.workunit.client.0.smithi003.stdout:[----------] 11 tests from LibRGW (736 ms total) 2023-12-03T11:44:06.903 INFO:tasks.workunit.client.0.smithi003.stdout: 2023-12-03T11:44:06.903 INFO:tasks.workunit.client.0.smithi003.stdout:[----------] Global test environment tear-down 2023-12-03T11:44:06.903 INFO:tasks.workunit.client.0.smithi003.stdout:[==========] 11 tests from 1 test suite ran. (736 ms total) 2023-12-03T11:44:06.903 INFO:tasks.workunit.client.0.smithi003.stdout:[ PASSED ] 11 tests. 2023-12-03T11:44:06.908 INFO:tasks.workunit.client.0.smithi003.stdout:phase 4.2 2023-12-03T11:44:06.928 INFO:tasks.workunit.client.0.smithi003.stdout:[==========] Running 11 tests from 1 test suite. 2023-12-03T11:44:06.928 INFO:tasks.workunit.client.0.smithi003.stdout:[----------] Global test environment set-up. 2023-12-03T11:44:06.928 INFO:tasks.workunit.client.0.smithi003.stdout:[----------] 11 tests from LibRGW 2023-12-03T11:44:06.928 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.TVAR 2023-12-03T11:44:06.928 INFO:tasks.workunit.client.0.smithi003.stdout:read i1: 64001 2023-12-03T11:44:06.929 INFO:tasks.workunit.client.0.smithi003.stdout:read s1: blunderbuss 2023-12-03T11:44:06.929 INFO:tasks.workunit.client.0.smithi003.stdout:read s3: [ OK ] LibRGW.TVAR (0 ms) 2023-12-03T11:44:06.929 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.INIT 2023-12-03T11:44:06.936 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:44:06.936 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:44:07.098 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.INIT (170 ms) 2023-12-03T11:44:07.098 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.MOUNT 2023-12-03T11:44:07.099 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2023-12-03T11:44:07.099 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2023-12-03T11:44:07.109 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (10 ms) 2023-12-03T11:44:07.110 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2023-12-03T11:44:07.110 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2023-12-03T11:44:07.110 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2023-12-03T11:44:07.110 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2023-12-03T11:44:07.110 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.MARKER2_READDIR 2023-12-03T11:44:07.112 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2023-12-03T11:44:07.112 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2023-12-03T11:44:07.112 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2023-12-03T11:44:07.112 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2023-12-03T11:44:07.112 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2023-12-03T11:44:07.112 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2023-12-03T11:44:07.113 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2023-12-03T11:44:07.113 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2023-12-03T11:44:07.113 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2023-12-03T11:44:07.113 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2023-12-03T11:44:07.113 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2023-12-03T11:44:07.113 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2023-12-03T11:44:07.113 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2023-12-03T11:44:07.113 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2023-12-03T11:44:07.113 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2023-12-03T11:44:07.113 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2023-12-03T11:44:07.113 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2023-12-03T11:44:07.113 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2023-12-03T11:44:07.113 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2023-12-03T11:44:07.113 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2023-12-03T11:44:07.114 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2023-12-03T11:44:07.114 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2023-12-03T11:44:07.114 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2023-12-03T11:44:07.114 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2023-12-03T11:44:07.114 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2023-12-03T11:44:07.114 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2023-12-03T11:44:07.114 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2023-12-03T11:44:07.114 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2023-12-03T11:44:07.114 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2023-12-03T11:44:07.114 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2023-12-03T11:44:07.114 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2023-12-03T11:44:07.114 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2023-12-03T11:44:07.114 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2023-12-03T11:44:07.114 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2023-12-03T11:44:07.114 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2023-12-03T11:44:07.115 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2023-12-03T11:44:07.115 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2023-12-03T11:44:07.115 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2023-12-03T11:44:07.115 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2023-12-03T11:44:07.115 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2023-12-03T11:44:07.115 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2023-12-03T11:44:07.115 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2023-12-03T11:44:07.115 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2023-12-03T11:44:07.115 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2023-12-03T11:44:07.115 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2023-12-03T11:44:07.115 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2023-12-03T11:44:07.115 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2023-12-03T11:44:07.115 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2023-12-03T11:44:07.115 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2023-12-03T11:44:07.115 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2023-12-03T11:44:07.115 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2023-12-03T11:44:07.116 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2023-12-03T11:44:07.116 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2023-12-03T11:44:07.116 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2023-12-03T11:44:07.116 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2023-12-03T11:44:07.116 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2023-12-03T11:44:07.116 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2023-12-03T11:44:07.116 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2023-12-03T11:44:07.116 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2023-12-03T11:44:07.116 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2023-12-03T11:44:07.116 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2023-12-03T11:44:07.116 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2023-12-03T11:44:07.116 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2023-12-03T11:44:07.116 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2023-12-03T11:44:07.116 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2023-12-03T11:44:07.116 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2023-12-03T11:44:07.117 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2023-12-03T11:44:07.117 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2023-12-03T11:44:07.117 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2023-12-03T11:44:07.117 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2023-12-03T11:44:07.117 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2023-12-03T11:44:07.117 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2023-12-03T11:44:07.117 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2023-12-03T11:44:07.117 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2023-12-03T11:44:07.117 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2023-12-03T11:44:07.117 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2023-12-03T11:44:07.117 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2023-12-03T11:44:07.117 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2023-12-03T11:44:07.117 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2023-12-03T11:44:07.117 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2023-12-03T11:44:07.117 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2023-12-03T11:44:07.117 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2023-12-03T11:44:07.118 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2023-12-03T11:44:07.118 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2023-12-03T11:44:07.118 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2023-12-03T11:44:07.118 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2023-12-03T11:44:07.118 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2023-12-03T11:44:07.118 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2023-12-03T11:44:07.118 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2023-12-03T11:44:07.118 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2023-12-03T11:44:07.118 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2023-12-03T11:44:07.118 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2023-12-03T11:44:07.118 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2023-12-03T11:44:07.118 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2023-12-03T11:44:07.118 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2023-12-03T11:44:07.118 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2023-12-03T11:44:07.118 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2023-12-03T11:44:07.119 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2023-12-03T11:44:07.119 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2023-12-03T11:44:07.119 INFO:tasks.workunit.client.0.smithi003.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2023-12-03T11:44:07.119 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.MARKER2_READDIR (3 ms) 2023-12-03T11:44:07.119 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2023-12-03T11:44:07.119 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2023-12-03T11:44:07.119 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.CLEANUP 2023-12-03T11:44:07.119 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2023-12-03T11:44:07.119 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.UMOUNT 2023-12-03T11:44:07.119 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2023-12-03T11:44:07.119 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.SHUTDOWN 2023-12-03T11:44:07.120 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:44:07.111+0000 7ff9400c28c0 -1 shutting down 2023-12-03T11:44:07.120 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:44:07.112+0000 7ff918cdb640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 98571, si_uid : 1000, si_addr0x3e80001810b, si_status0 2023-12-03T11:44:07.164 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.SHUTDOWN (51 ms) 2023-12-03T11:44:07.164 INFO:tasks.workunit.client.0.smithi003.stdout:[----------] 11 tests from LibRGW (235 ms total) 2023-12-03T11:44:07.164 INFO:tasks.workunit.client.0.smithi003.stdout: 2023-12-03T11:44:07.164 INFO:tasks.workunit.client.0.smithi003.stdout:[----------] Global test environment tear-down 2023-12-03T11:44:07.164 INFO:tasks.workunit.client.0.smithi003.stdout:[==========] 11 tests from 1 test suite ran. (235 ms total) 2023-12-03T11:44:07.164 INFO:tasks.workunit.client.0.smithi003.stdout:[ PASSED ] 11 tests. 2023-12-03T11:44:07.169 INFO:tasks.workunit.client.0.smithi003.stdout:phase 5.1 2023-12-03T11:44:07.199 INFO:tasks.workunit.client.0.smithi003.stdout:[==========] Running 19 tests from 1 test suite. 2023-12-03T11:44:07.199 INFO:tasks.workunit.client.0.smithi003.stdout:[----------] Global test environment set-up. 2023-12-03T11:44:07.199 INFO:tasks.workunit.client.0.smithi003.stdout:[----------] 19 tests from LibRGW 2023-12-03T11:44:07.199 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.INIT 2023-12-03T11:44:07.209 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:44:07.209 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:44:07.775 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.INIT (576 ms) 2023-12-03T11:44:07.775 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.MOUNT 2023-12-03T11:44:07.775 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2023-12-03T11:44:07.776 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2023-12-03T11:44:07.786 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.CREATE_BUCKET (10 ms) 2023-12-03T11:44:07.786 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2023-12-03T11:44:07.791 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (5 ms) 2023-12-03T11:44:07.791 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.LIST_OBJECTS 2023-12-03T11:44:07.791 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.LIST_OBJECTS (0 ms) 2023-12-03T11:44:07.791 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2023-12-03T11:44:07.792 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (1 ms) 2023-12-03T11:44:07.792 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.OBJ_OPEN 2023-12-03T11:44:07.792 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.OBJ_OPEN (0 ms) 2023-12-03T11:44:07.793 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.PUT_OBJECT 2023-12-03T11:44:07.797 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.PUT_OBJECT (4 ms) 2023-12-03T11:44:07.797 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.GET_OBJECT 2023-12-03T11:44:07.798 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.GET_OBJECT (2 ms) 2023-12-03T11:44:07.798 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.STAT_OBJECT 2023-12-03T11:44:07.799 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2023-12-03T11:44:07.799 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.WRITE_READ_VERIFY 2023-12-03T11:44:07.799 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.WRITE_READ_VERIFY (0 ms) 2023-12-03T11:44:07.799 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.WRITEV 2023-12-03T11:44:07.799 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.WRITEV (0 ms) 2023-12-03T11:44:07.799 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.READV 2023-12-03T11:44:07.799 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.READV (0 ms) 2023-12-03T11:44:07.799 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.READV_AFTER_WRITEV 2023-12-03T11:44:07.799 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.READV_AFTER_WRITEV (0 ms) 2023-12-03T11:44:07.799 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2023-12-03T11:44:07.799 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.DELETE_OBJECT (0 ms) 2023-12-03T11:44:07.799 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2023-12-03T11:44:07.799 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2023-12-03T11:44:07.799 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.CLEANUP 2023-12-03T11:44:07.800 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2023-12-03T11:44:07.800 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.UMOUNT 2023-12-03T11:44:07.800 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2023-12-03T11:44:07.800 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.SHUTDOWN 2023-12-03T11:44:07.800 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:44:07.797+0000 7f622032c8c0 -1 shutting down 2023-12-03T11:44:07.800 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:44:07.798+0000 7f61f93e0640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 98681, si_uid : 1000, si_addr0x3e800018179, si_status0 2023-12-03T11:44:07.841 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.SHUTDOWN (43 ms) 2023-12-03T11:44:07.841 INFO:tasks.workunit.client.0.smithi003.stdout:[----------] 19 tests from LibRGW (642 ms total) 2023-12-03T11:44:07.841 INFO:tasks.workunit.client.0.smithi003.stdout: 2023-12-03T11:44:07.841 INFO:tasks.workunit.client.0.smithi003.stdout:[----------] Global test environment tear-down 2023-12-03T11:44:07.841 INFO:tasks.workunit.client.0.smithi003.stdout:[==========] 19 tests from 1 test suite ran. (642 ms total) 2023-12-03T11:44:07.841 INFO:tasks.workunit.client.0.smithi003.stdout:[ PASSED ] 19 tests. 2023-12-03T11:44:07.846 INFO:tasks.workunit.client.0.smithi003.stdout:phase 5.2 2023-12-03T11:44:07.876 INFO:tasks.workunit.client.0.smithi003.stdout:[==========] Running 19 tests from 1 test suite. 2023-12-03T11:44:07.876 INFO:tasks.workunit.client.0.smithi003.stdout:[----------] Global test environment set-up. 2023-12-03T11:44:07.876 INFO:tasks.workunit.client.0.smithi003.stdout:[----------] 19 tests from LibRGW 2023-12-03T11:44:07.876 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.INIT 2023-12-03T11:44:07.883 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:44:07.883 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:44:08.031 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.INIT (156 ms) 2023-12-03T11:44:08.031 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.MOUNT 2023-12-03T11:44:08.032 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2023-12-03T11:44:08.032 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2023-12-03T11:44:08.032 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2023-12-03T11:44:08.032 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2023-12-03T11:44:08.038 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (7 ms) 2023-12-03T11:44:08.039 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.LIST_OBJECTS 2023-12-03T11:44:08.039 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.LIST_OBJECTS (0 ms) 2023-12-03T11:44:08.039 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2023-12-03T11:44:08.039 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (0 ms) 2023-12-03T11:44:08.039 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.OBJ_OPEN 2023-12-03T11:44:08.039 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.OBJ_OPEN (0 ms) 2023-12-03T11:44:08.039 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.PUT_OBJECT 2023-12-03T11:44:08.039 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.PUT_OBJECT (0 ms) 2023-12-03T11:44:08.039 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.GET_OBJECT 2023-12-03T11:44:08.039 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.GET_OBJECT (0 ms) 2023-12-03T11:44:08.039 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.STAT_OBJECT 2023-12-03T11:44:08.039 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2023-12-03T11:44:08.039 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.WRITE_READ_VERIFY 2023-12-03T11:44:08.039 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.WRITE_READ_VERIFY (0 ms) 2023-12-03T11:44:08.040 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.WRITEV 2023-12-03T11:44:08.040 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.WRITEV (0 ms) 2023-12-03T11:44:08.040 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.READV 2023-12-03T11:44:08.040 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.READV (0 ms) 2023-12-03T11:44:08.040 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.READV_AFTER_WRITEV 2023-12-03T11:44:08.040 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.READV_AFTER_WRITEV (0 ms) 2023-12-03T11:44:08.040 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2023-12-03T11:44:08.042 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.DELETE_OBJECT (4 ms) 2023-12-03T11:44:08.042 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2023-12-03T11:44:08.077 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.DELETE_BUCKET (35 ms) 2023-12-03T11:44:08.077 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.CLEANUP 2023-12-03T11:44:08.077 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2023-12-03T11:44:08.077 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.UMOUNT 2023-12-03T11:44:08.077 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2023-12-03T11:44:08.078 INFO:tasks.workunit.client.0.smithi003.stdout:[ RUN ] LibRGW.SHUTDOWN 2023-12-03T11:44:08.078 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:44:08.076+0000 7f5721c128c0 -1 shutting down 2023-12-03T11:44:08.078 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:44:08.077+0000 7f56f8a5f640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 98791, si_uid : 1000, si_addr0x3e8000181e7, si_status0 2023-12-03T11:44:08.196 INFO:tasks.workunit.client.0.smithi003.stdout:[ OK ] LibRGW.SHUTDOWN (118 ms) 2023-12-03T11:44:08.196 INFO:tasks.workunit.client.0.smithi003.stdout:[----------] 19 tests from LibRGW (320 ms total) 2023-12-03T11:44:08.196 INFO:tasks.workunit.client.0.smithi003.stdout: 2023-12-03T11:44:08.196 INFO:tasks.workunit.client.0.smithi003.stdout:[----------] Global test environment tear-down 2023-12-03T11:44:08.196 INFO:tasks.workunit.client.0.smithi003.stdout:[==========] 19 tests from 1 test suite ran. (320 ms total) 2023-12-03T11:44:08.196 INFO:tasks.workunit.client.0.smithi003.stdout:[ PASSED ] 19 tests. 2023-12-03T11:44:08.202 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-12-03T11:44:08.202 DEBUG:teuthology.orchestra.run.smithi003:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-12-03T11:44:08.234 INFO:tasks.workunit:Stopping ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'cls/test_cls_rgw_gc.sh', 'cls/test_cls_rgw_stats.sh', 'cls/test_cls_cmpomap.sh', 'cls/test_cls_2pc_queue.sh', 'rgw/test_rgw_gc_log.sh', 'rgw/test_rgw_obj.sh', 'rgw/test_librgw_file.sh'] on client.0... 2023-12-03T11:44:08.234 DEBUG:teuthology.orchestra.run.smithi003:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2023-12-03T11:44:08.555 DEBUG:teuthology.parallel:result is None 2023-12-03T11:44:08.555 DEBUG:teuthology.orchestra.run.smithi003:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2023-12-03T11:44:08.586 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2023-12-03T11:44:08.586 DEBUG:teuthology.orchestra.run.smithi003:> rmdir -- /home/ubuntu/cephtest/mnt.0 2023-12-03T11:44:08.641 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2023-12-03T11:44:08.641 INFO:teuthology.run_tasks:Running task workunit... 2023-12-03T11:44:08.654 INFO:tasks.workunit:Pulling workunits from ref bcbf278cf395873c2a482f5a7b2345faf2160319 2023-12-03T11:44:08.655 INFO:tasks.workunit:Making a separate scratch dir for every client... 2023-12-03T11:44:08.655 DEBUG:teuthology.orchestra.run.smithi003:> stat -- /home/ubuntu/cephtest/mnt.0 2023-12-03T11:44:08.696 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-03T11:44:08.697 INFO:teuthology.orchestra.run.smithi003.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2023-12-03T11:44:08.697 DEBUG:teuthology.orchestra.run.smithi003:> mkdir -- /home/ubuntu/cephtest/mnt.0 2023-12-03T11:44:08.752 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2023-12-03T11:44:08.753 DEBUG:teuthology.orchestra.run.smithi003:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2023-12-03T11:44:08.807 INFO:tasks.workunit:timeout=3h 2023-12-03T11:44:08.807 INFO:tasks.workunit:cleanup=True 2023-12-03T11:44:08.808 DEBUG:teuthology.orchestra.run.smithi003:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout bcbf278cf395873c2a482f5a7b2345faf2160319 2023-12-03T11:44:08.863 INFO:tasks.workunit.client.0.smithi003.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2023-12-03T11:45:13.873 INFO:tasks.workunit.client.0.smithi003.stderr:Updating files: 97% (11870/12123) Updating files: 98% (11881/12123) Updating files: 99% (12002/12123) Updating files: 100% (12123/12123) Updating files: 100% (12123/12123), done. 2023-12-03T11:45:14.527 INFO:tasks.workunit.client.0.smithi003.stderr:Note: switching to 'bcbf278cf395873c2a482f5a7b2345faf2160319'. 2023-12-03T11:45:14.527 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:45:14.527 INFO:tasks.workunit.client.0.smithi003.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-12-03T11:45:14.527 INFO:tasks.workunit.client.0.smithi003.stderr:changes and commit them, and you can discard any commits you make in this 2023-12-03T11:45:14.527 INFO:tasks.workunit.client.0.smithi003.stderr:state without impacting any branches by switching back to a branch. 2023-12-03T11:45:14.527 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:45:14.528 INFO:tasks.workunit.client.0.smithi003.stderr:If you want to create a new branch to retain commits you create, you may 2023-12-03T11:45:14.528 INFO:tasks.workunit.client.0.smithi003.stderr:do so (now or later) by using -c with the switch command. Example: 2023-12-03T11:45:14.528 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:45:14.528 INFO:tasks.workunit.client.0.smithi003.stderr: git switch -c 2023-12-03T11:45:14.528 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:45:14.528 INFO:tasks.workunit.client.0.smithi003.stderr:Or undo this operation with: 2023-12-03T11:45:14.528 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:45:14.528 INFO:tasks.workunit.client.0.smithi003.stderr: git switch - 2023-12-03T11:45:14.528 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:45:14.528 INFO:tasks.workunit.client.0.smithi003.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-12-03T11:45:14.528 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:45:14.528 INFO:tasks.workunit.client.0.smithi003.stderr:HEAD is now at bcbf278cf39 RGW:pubsub publish commit with etag populated 2023-12-03T11:45:14.530 DEBUG:teuthology.orchestra.run.smithi003:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2023-12-03T11:45:14.586 INFO:tasks.workunit.client.0.smithi003.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2023-12-03T11:45:14.588 INFO:tasks.workunit.client.0.smithi003.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-12-03T11:45:14.588 INFO:tasks.workunit.client.0.smithi003.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2023-12-03T11:45:14.638 INFO:tasks.workunit.client.0.smithi003.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2023-12-03T11:45:14.688 INFO:tasks.workunit.client.0.smithi003.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2023-12-03T11:45:14.729 INFO:tasks.workunit.client.0.smithi003.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-12-03T11:45:14.730 INFO:tasks.workunit.client.0.smithi003.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-12-03T11:45:14.730 INFO:tasks.workunit.client.0.smithi003.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2023-12-03T11:45:14.770 INFO:tasks.workunit.client.0.smithi003.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-12-03T11:45:14.773 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-12-03T11:45:14.773 DEBUG:teuthology.orchestra.run.smithi003:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2023-12-03T11:45:14.829 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_s3_mp_reupload.sh on client.0... 2023-12-03T11:45:14.830 INFO:tasks.workunit:Running workunit rgw/test_rgw_s3_mp_reupload.sh... 2023-12-03T11:45:14.830 DEBUG:teuthology.orchestra.run.smithi003:workunit test rgw/test_rgw_s3_mp_reupload.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bcbf278cf395873c2a482f5a7b2345faf2160319 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_s3_mp_reupload.sh 2023-12-03T11:45:14.891 INFO:tasks.workunit.client.0.smithi003.stdout:INFO: fully qualified domain name: smithi003.front.sepia.ceph.com 2023-12-03T11:45:14.891 INFO:tasks.workunit.client.0.smithi003.stdout:== TESTING *ABORTING* MULTIPART UPLOAD WITH RE-UPLOADS == 2023-12-03T11:45:14.891 INFO:tasks.workunit.client.0.smithi003.stdout:== TESTING VERSIONED BUCKET == 2023-12-03T11:45:17.579 INFO:tasks.workunit.client.0.smithi003.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.2.3) 2023-12-03T11:45:18.074 INFO:tasks.workunit.client.0.smithi003.stdout:Collecting pip 2023-12-03T11:45:18.080 INFO:tasks.workunit.client.0.smithi003.stdout: Using cached pip-23.3.1-py3-none-any.whl (2.1 MB) 2023-12-03T11:45:18.129 INFO:tasks.workunit.client.0.smithi003.stdout:Installing collected packages: pip 2023-12-03T11:45:18.129 INFO:tasks.workunit.client.0.smithi003.stdout: Attempting uninstall: pip 2023-12-03T11:45:18.130 INFO:tasks.workunit.client.0.smithi003.stdout: Found existing installation: pip 21.2.3 2023-12-03T11:45:18.289 INFO:tasks.workunit.client.0.smithi003.stdout: Uninstalling pip-21.2.3: 2023-12-03T11:45:18.295 INFO:tasks.workunit.client.0.smithi003.stdout: Successfully uninstalled pip-21.2.3 2023-12-03T11:45:19.299 INFO:tasks.workunit.client.0.smithi003.stdout:Successfully installed pip-23.3.1 2023-12-03T11:45:20.218 INFO:tasks.workunit.client.0.smithi003.stdout:Collecting boto3 2023-12-03T11:45:20.219 INFO:tasks.workunit.client.0.smithi003.stdout: Using cached boto3-1.33.6-py3-none-any.whl.metadata (6.7 kB) 2023-12-03T11:45:20.780 INFO:tasks.workunit.client.0.smithi003.stdout:Collecting botocore<1.34.0,>=1.33.6 (from boto3) 2023-12-03T11:45:20.782 INFO:tasks.workunit.client.0.smithi003.stdout: Using cached botocore-1.33.6-py3-none-any.whl.metadata (6.1 kB) 2023-12-03T11:45:20.866 INFO:tasks.workunit.client.0.smithi003.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2023-12-03T11:45:20.867 INFO:tasks.workunit.client.0.smithi003.stdout: Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2023-12-03T11:45:20.954 INFO:tasks.workunit.client.0.smithi003.stdout:Collecting s3transfer<0.9.0,>=0.8.2 (from boto3) 2023-12-03T11:45:20.955 INFO:tasks.workunit.client.0.smithi003.stdout: Using cached s3transfer-0.8.2-py3-none-any.whl.metadata (1.8 kB) 2023-12-03T11:45:21.054 INFO:tasks.workunit.client.0.smithi003.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.34.0,>=1.33.6->boto3) 2023-12-03T11:45:21.055 INFO:tasks.workunit.client.0.smithi003.stdout: Using cached python_dateutil-2.8.2-py2.py3-none-any.whl (247 kB) 2023-12-03T11:45:21.146 INFO:tasks.workunit.client.0.smithi003.stdout:Collecting urllib3<1.27,>=1.25.4 (from botocore<1.34.0,>=1.33.6->boto3) 2023-12-03T11:45:21.147 INFO:tasks.workunit.client.0.smithi003.stdout: Using cached urllib3-1.26.18-py2.py3-none-any.whl.metadata (48 kB) 2023-12-03T11:45:21.369 INFO:tasks.workunit.client.0.smithi003.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.34.0,>=1.33.6->boto3) 2023-12-03T11:45:21.370 INFO:tasks.workunit.client.0.smithi003.stdout: Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2023-12-03T11:45:21.393 INFO:tasks.workunit.client.0.smithi003.stdout:Using cached boto3-1.33.6-py3-none-any.whl (139 kB) 2023-12-03T11:45:21.395 INFO:tasks.workunit.client.0.smithi003.stdout:Using cached botocore-1.33.6-py3-none-any.whl (11.8 MB) 2023-12-03T11:45:21.416 INFO:tasks.workunit.client.0.smithi003.stdout:Using cached s3transfer-0.8.2-py3-none-any.whl (82 kB) 2023-12-03T11:45:21.417 INFO:tasks.workunit.client.0.smithi003.stdout:Using cached urllib3-1.26.18-py2.py3-none-any.whl (143 kB) 2023-12-03T11:45:21.520 INFO:tasks.workunit.client.0.smithi003.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2023-12-03T11:45:22.628 INFO:tasks.workunit.client.0.smithi003.stdout:Successfully installed boto3-1.33.6 botocore-1.33.6 jmespath-1.0.1 python-dateutil-2.8.2 s3transfer-0.8.2 six-1.16.0 urllib3-1.26.18 2023-12-03T11:45:23.050 INFO:tasks.workunit.client.0.smithi003.stdout:INFO: creating user 2023-12-03T11:45:23.149 INFO:tasks.workunit.client.0.smithi003.stdout:{ 2023-12-03T11:45:23.150 INFO:tasks.workunit.client.0.smithi003.stdout: "user_id": "testid", 2023-12-03T11:45:23.150 INFO:tasks.workunit.client.0.smithi003.stdout: "display_name": "M. Tester", 2023-12-03T11:45:23.150 INFO:tasks.workunit.client.0.smithi003.stdout: "email": "tester@ceph.com", 2023-12-03T11:45:23.150 INFO:tasks.workunit.client.0.smithi003.stdout: "suspended": 0, 2023-12-03T11:45:23.150 INFO:tasks.workunit.client.0.smithi003.stdout: "max_buckets": 1000, 2023-12-03T11:45:23.150 INFO:tasks.workunit.client.0.smithi003.stdout: "subusers": [], 2023-12-03T11:45:23.150 INFO:tasks.workunit.client.0.smithi003.stdout: "keys": [ 2023-12-03T11:45:23.151 INFO:tasks.workunit.client.0.smithi003.stdout: { 2023-12-03T11:45:23.151 INFO:tasks.workunit.client.0.smithi003.stdout: "user": "testid", 2023-12-03T11:45:23.151 INFO:tasks.workunit.client.0.smithi003.stdout: "access_key": "0555b35654ad1656d804", 2023-12-03T11:45:23.151 INFO:tasks.workunit.client.0.smithi003.stdout: "secret_key": "h7GhxuBLTrlhVUyxSPUKUV8r/2EI4ngqJxD7iBdBYLhwluN30JaT3Q==" 2023-12-03T11:45:23.151 INFO:tasks.workunit.client.0.smithi003.stdout: } 2023-12-03T11:45:23.151 INFO:tasks.workunit.client.0.smithi003.stdout: ], 2023-12-03T11:45:23.151 INFO:tasks.workunit.client.0.smithi003.stdout: "swift_keys": [], 2023-12-03T11:45:23.151 INFO:tasks.workunit.client.0.smithi003.stdout: "caps": [], 2023-12-03T11:45:23.151 INFO:tasks.workunit.client.0.smithi003.stdout: "op_mask": "read, write, delete", 2023-12-03T11:45:23.151 INFO:tasks.workunit.client.0.smithi003.stdout: "default_placement": "", 2023-12-03T11:45:23.151 INFO:tasks.workunit.client.0.smithi003.stdout: "default_storage_class": "", 2023-12-03T11:45:23.152 INFO:tasks.workunit.client.0.smithi003.stdout: "placement_tags": [], 2023-12-03T11:45:23.152 INFO:tasks.workunit.client.0.smithi003.stdout: "bucket_quota": { 2023-12-03T11:45:23.152 INFO:tasks.workunit.client.0.smithi003.stdout: "enabled": false, 2023-12-03T11:45:23.152 INFO:tasks.workunit.client.0.smithi003.stdout: "check_on_raw": false, 2023-12-03T11:45:23.152 INFO:tasks.workunit.client.0.smithi003.stdout: "max_size": -1, 2023-12-03T11:45:23.152 INFO:tasks.workunit.client.0.smithi003.stdout: "max_size_kb": 0, 2023-12-03T11:45:23.152 INFO:tasks.workunit.client.0.smithi003.stdout: "max_objects": -1 2023-12-03T11:45:23.152 INFO:tasks.workunit.client.0.smithi003.stdout: }, 2023-12-03T11:45:23.152 INFO:tasks.workunit.client.0.smithi003.stdout: "user_quota": { 2023-12-03T11:45:23.152 INFO:tasks.workunit.client.0.smithi003.stdout: "enabled": false, 2023-12-03T11:45:23.152 INFO:tasks.workunit.client.0.smithi003.stdout: "check_on_raw": false, 2023-12-03T11:45:23.152 INFO:tasks.workunit.client.0.smithi003.stdout: "max_size": -1, 2023-12-03T11:45:23.152 INFO:tasks.workunit.client.0.smithi003.stdout: "max_size_kb": 0, 2023-12-03T11:45:23.152 INFO:tasks.workunit.client.0.smithi003.stdout: "max_objects": -1 2023-12-03T11:45:23.153 INFO:tasks.workunit.client.0.smithi003.stdout: }, 2023-12-03T11:45:23.153 INFO:tasks.workunit.client.0.smithi003.stdout: "temp_url_keys": [], 2023-12-03T11:45:23.153 INFO:tasks.workunit.client.0.smithi003.stdout: "type": "rgw", 2023-12-03T11:45:23.153 INFO:tasks.workunit.client.0.smithi003.stdout: "mfa_ids": [] 2023-12-03T11:45:23.153 INFO:tasks.workunit.client.0.smithi003.stdout:} 2023-12-03T11:45:23.153 INFO:tasks.workunit.client.0.smithi003.stdout: 2023-12-03T11:45:23.461 INFO:tasks.workunit.client.0.smithi003.stderr:5+0 records in 2023-12-03T11:45:23.461 INFO:tasks.workunit.client.0.smithi003.stderr:5+0 records out 2023-12-03T11:45:23.461 INFO:tasks.workunit.client.0.smithi003.stderr:5242880 bytes (5.2 MB, 5.0 MiB) copied, 0.0141235 s, 371 MB/s 2023-12-03T11:45:36.433 INFO:tasks.workunit.client.0.smithi003.stdout:bucket nams is reupload-bkt-108019 2023-12-03T11:45:36.433 INFO:tasks.workunit.client.0.smithi003.stdout:endpoint is http://smithi003.front.sepia.ceph.com:80 2023-12-03T11:45:36.433 INFO:tasks.workunit.client.0.smithi003.stdout:start UploadId=2~pv5BDI0PFq95dM2seu0tWn0cUH0GRsX 2023-12-03T11:45:36.433 INFO:tasks.workunit.client.0.smithi003.stdout:phase 1 uploaded part {'ETag': '"78a62bce87a8cb26a9e0c2e99377a2ed"', 'PartNumber': 1} 2023-12-03T11:45:36.433 INFO:tasks.workunit.client.0.smithi003.stdout:phase 1 uploaded part {'ETag': '"78a62bce87a8cb26a9e0c2e99377a2ed"', 'PartNumber': 2} 2023-12-03T11:45:36.434 INFO:tasks.workunit.client.0.smithi003.stdout:phase 2 uploaded part {'ETag': '"78a62bce87a8cb26a9e0c2e99377a2ed"', 'PartNumber': 1} 2023-12-03T11:45:36.434 INFO:tasks.workunit.client.0.smithi003.stdout:phase 2 uploaded part {'ETag': '"78a62bce87a8cb26a9e0c2e99377a2ed"', 'PartNumber': 1} 2023-12-03T11:45:36.434 INFO:tasks.workunit.client.0.smithi003.stdout:phase 2 uploaded part {'ETag': '"78a62bce87a8cb26a9e0c2e99377a2ed"', 'PartNumber': 1} 2023-12-03T11:45:36.434 INFO:tasks.workunit.client.0.smithi003.stdout:phase 2 uploaded part {'ETag': '"78a62bce87a8cb26a9e0c2e99377a2ed"', 'PartNumber': 1} 2023-12-03T11:45:36.434 INFO:tasks.workunit.client.0.smithi003.stdout:phase 2 uploaded part {'ETag': '"78a62bce87a8cb26a9e0c2e99377a2ed"', 'PartNumber': 1} 2023-12-03T11:45:36.434 INFO:tasks.workunit.client.0.smithi003.stdout:phase 2 uploaded part {'ETag': '"78a62bce87a8cb26a9e0c2e99377a2ed"', 'PartNumber': 1} 2023-12-03T11:45:36.434 INFO:tasks.workunit.client.0.smithi003.stdout:phase 2 uploaded part {'ETag': '"78a62bce87a8cb26a9e0c2e99377a2ed"', 'PartNumber': 1} 2023-12-03T11:45:36.434 INFO:tasks.workunit.client.0.smithi003.stdout:phase 2 uploaded part {'ETag': '"78a62bce87a8cb26a9e0c2e99377a2ed"', 'PartNumber': 1} 2023-12-03T11:45:36.434 INFO:tasks.workunit.client.0.smithi003.stdout:phase 2 uploaded part {'ETag': '"78a62bce87a8cb26a9e0c2e99377a2ed"', 'PartNumber': 1} 2023-12-03T11:45:36.434 INFO:tasks.workunit.client.0.smithi003.stdout:phase 2 uploaded part {'ETag': '"78a62bce87a8cb26a9e0c2e99377a2ed"', 'PartNumber': 1} 2023-12-03T11:45:36.434 INFO:tasks.workunit.client.0.smithi003.stdout:phase 2 uploaded part {'ETag': '"78a62bce87a8cb26a9e0c2e99377a2ed"', 'PartNumber': 1} 2023-12-03T11:45:36.434 INFO:tasks.workunit.client.0.smithi003.stdout:aborting multipart upload, parts=[{'ETag': '"78a62bce87a8cb26a9e0c2e99377a2ed"', 'PartNumber': 1}, {'ETag': '"78a62bce87a8cb26a9e0c2e99377a2ed"', 'PartNumber': 2}] 2023-12-03T11:45:36.932 INFO:tasks.workunit.client.0.smithi003.stdout:radosgw-admin bucket radoslist: 2023-12-03T11:45:36.989 INFO:tasks.workunit.client.0.smithi003.stdout:rados ls: 2023-12-03T11:45:36.993 INFO:tasks.workunit.client.0.smithi003.stdout:== PASSED == 2023-12-03T11:45:36.993 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-12-03T11:45:36.994 DEBUG:teuthology.orchestra.run.smithi003:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-12-03T11:45:37.065 INFO:tasks.workunit:Stopping ['rgw/test_rgw_s3_mp_reupload.sh'] on client.0... 2023-12-03T11:45:37.065 DEBUG:teuthology.orchestra.run.smithi003:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2023-12-03T11:45:37.423 DEBUG:teuthology.parallel:result is None 2023-12-03T11:45:37.423 DEBUG:teuthology.orchestra.run.smithi003:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2023-12-03T11:45:37.454 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2023-12-03T11:45:37.455 DEBUG:teuthology.orchestra.run.smithi003:> rmdir -- /home/ubuntu/cephtest/mnt.0 2023-12-03T11:45:37.510 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2023-12-03T11:45:37.510 INFO:teuthology.run_tasks:Running task ragweed... 2023-12-03T11:45:37.529 DEBUG:tasks.ragweed:ragweed config is {'client.0': {'default-branch': 'ceph-master', 'rgw_server': 'client.0', 'stages': 'prepare,check'}} 2023-12-03T11:45:37.529 INFO:tasks.ragweed:Downloading ragweed... 2023-12-03T11:45:37.529 INFO:tasks.ragweed:Using branch 'wip-alimasa-multi-pubsub-etag' for ragweed 2023-12-03T11:45:37.530 DEBUG:teuthology.orchestra.run.smithi003:> git clone -b wip-alimasa-multi-pubsub-etag https://git.ceph.com/ragweed.git /home/ubuntu/cephtest/ragweed.client.0 2023-12-03T11:45:37.565 INFO:teuthology.orchestra.run.smithi003.stderr:Cloning into '/home/ubuntu/cephtest/ragweed.client.0'... 2023-12-03T11:45:37.610 INFO:teuthology.orchestra.run.smithi003.stderr:fatal: Remote branch wip-alimasa-multi-pubsub-etag not found in upstream origin 2023-12-03T11:45:37.610 DEBUG:teuthology.orchestra.run:got remote process result: 128 2023-12-03T11:45:37.611 INFO:tasks.ragweed:Using branch 'ceph-master' for ragweed 2023-12-03T11:45:37.612 DEBUG:teuthology.orchestra.run.smithi003:> git clone -b ceph-master https://git.ceph.com/ragweed.git /home/ubuntu/cephtest/ragweed.client.0 2023-12-03T11:45:37.666 INFO:teuthology.orchestra.run.smithi003.stderr:Cloning into '/home/ubuntu/cephtest/ragweed.client.0'... 2023-12-03T11:45:37.819 INFO:tasks.ragweed:Creating rgw users... 2023-12-03T11:45:37.820 DEBUG:tasks.ragweed:Creating user ragweed.client.0 on client.0 2023-12-03T11:45:37.820 DEBUG:teuthology.orchestra.run.smithi003:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid ragweed.client.0 --display-name 'Mr. ragweed.client.0' --access-key LOLHJEVUGVZYNXIEKPQP --secret Ge9pd2uWWdTxWapwM5Wx29v3llHi7MUpyKvbDoWCMkn6EZVFTOiHjw== --email ragweed.client.0+test@test.test --system false 2023-12-03T11:45:37.913 INFO:teuthology.orchestra.run.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:45:37.913 INFO:teuthology.orchestra.run.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:45:37.924 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:37.923+0000 7fc5bcd21800 20 rados->read ofs=0 len=0 2023-12-03T11:45:37.927 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:37.925+0000 7fc5bcd21800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:45:37.927 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:37.925+0000 7fc5bcd21800 20 realm 2023-12-03T11:45:37.927 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:37.925+0000 7fc5bcd21800 20 rados->read ofs=0 len=0 2023-12-03T11:45:37.927 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:37.925+0000 7fc5bcd21800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:45:37.927 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:37.925+0000 7fc5bcd21800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:45:37.927 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:37.925+0000 7fc5bcd21800 20 rados->read ofs=0 len=0 2023-12-03T11:45:37.927 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:37.925+0000 7fc5bcd21800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:45:37.927 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:37.925+0000 7fc5bcd21800 20 rados->read ofs=0 len=0 2023-12-03T11:45:37.928 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:37.926+0000 7fc5bcd21800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:45:37.928 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:37.926+0000 7fc5bcd21800 20 rados->read ofs=0 len=0 2023-12-03T11:45:37.928 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:37.926+0000 7fc5bcd21800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:45:37.928 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:37.927+0000 7fc5bcd21800 20 searching for the correct realm 2023-12-03T11:45:37.940 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:37.939+0000 7fc5bcd21800 20 RGWRados::pool_iterate: got zone_info.83aabb46-04b5-4c96-9933-c6bfb1173a73 2023-12-03T11:45:37.941 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:37.939+0000 7fc5bcd21800 20 RGWRados::pool_iterate: got zonegroup_info.6a811aad-435d-4fdd-93c9-b7e0b50de429 2023-12-03T11:45:37.941 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:37.939+0000 7fc5bcd21800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:45:37.941 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:37.939+0000 7fc5bcd21800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:45:37.941 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:37.939+0000 7fc5bcd21800 20 rados->read ofs=0 len=0 2023-12-03T11:45:37.941 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:37.939+0000 7fc5b92e6640 0 -- 172.21.15.3:0/884598458 >> [v2:172.21.15.3:6816/2638197404,v1:172.21.15.3:6818/2638197404] conn(0x55d70ae8e440 msgr2=0x55d70ae90830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:45:37.941 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:37.939+0000 7fc5bcd21800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:45:37.941 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:37.939+0000 7fc5bcd21800 20 rados->read ofs=0 len=0 2023-12-03T11:45:37.942 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:37.940+0000 7fc5bcd21800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:45:37.943 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:37.940+0000 7fc5bcd21800 20 rados->read ofs=0 len=0 2023-12-03T11:45:37.943 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:37.940+0000 7fc5bcd21800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:45:37.943 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:37.940+0000 7fc5bcd21800 20 zone default found 2023-12-03T11:45:37.943 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:37.940+0000 7fc5bcd21800 4 Realm: () 2023-12-03T11:45:37.943 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:37.940+0000 7fc5bcd21800 4 ZoneGroup: default (6a811aad-435d-4fdd-93c9-b7e0b50de429) 2023-12-03T11:45:37.943 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:37.940+0000 7fc5bcd21800 4 Zone: default (83aabb46-04b5-4c96-9933-c6bfb1173a73) 2023-12-03T11:45:37.943 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:37.940+0000 7fc5bcd21800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:45:37.943 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:37.940+0000 7fc5bcd21800 20 zonegroup default 2023-12-03T11:45:37.943 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:37.940+0000 7fc5bcd21800 20 rados->read ofs=0 len=0 2023-12-03T11:45:37.943 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:37.940+0000 7fc5bcd21800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:45:37.943 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:37.940+0000 7fc5bcd21800 20 rados->read ofs=0 len=0 2023-12-03T11:45:37.943 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:37.941+0000 7fc5bcd21800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:45:37.944 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:37.941+0000 7fc5bcd21800 20 rados->read ofs=0 len=0 2023-12-03T11:45:37.944 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:37.941+0000 7fc5bcd21800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:45:37.944 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:37.941+0000 7fc5bcd21800 20 started sync module instance, tier type = 2023-12-03T11:45:37.944 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:37.941+0000 7fc5bcd21800 20 started zone id=83aabb46-04b5-4c96-9933-c6bfb1173a73 (name=default) with tier type = 2023-12-03T11:45:37.953 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:37.952+0000 7fc5b8ae5640 0 -- 172.21.15.3:0/884598458 >> [v2:172.21.15.3:6808/263125788,v1:172.21.15.3:6809/263125788] conn(0x7fc5a002c8b0 msgr2=0x7fc5a001b3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:45:37.953 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:37.952+0000 7fc5bcd21800 20 add_watcher() i=0 2023-12-03T11:45:37.953 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:37.952+0000 7fc5bcd21800 20 add_watcher() i=1 2023-12-03T11:45:37.953 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:37.952+0000 7fc5bcd21800 20 add_watcher() i=2 2023-12-03T11:45:37.953 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:37.952+0000 7fc5bcd21800 20 add_watcher() i=3 2023-12-03T11:45:37.953 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:37.952+0000 7fc5bcd21800 20 add_watcher() i=4 2023-12-03T11:45:37.954 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:37.952+0000 7fc5bcd21800 20 add_watcher() i=5 2023-12-03T11:45:37.954 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:37.952+0000 7fc5bcd21800 20 add_watcher() i=6 2023-12-03T11:45:37.954 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:37.953+0000 7fc5bcd21800 20 add_watcher() i=7 2023-12-03T11:45:37.954 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:37.953+0000 7fc5bcd21800 2 all 8 watchers are set, enabling cache 2023-12-03T11:45:37.956 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:37.955+0000 7fc57f7de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:45:37.956 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:37.955+0000 7fc5bcd21800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:45:37.956 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:37.955+0000 7fc5bcd21800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:45:37.961 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:37.960+0000 7fc5bcd21800 5 note: GC not initialized 2023-12-03T11:45:37.961 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:37.960+0000 7fc4ee7fc640 20 reqs_thread_entry: start 2023-12-03T11:45:37.962 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:37.960+0000 7fc5bcd21800 20 init_complete bucket index max shards: 11 2023-12-03T11:45:37.962 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:37.960+0000 7fc5bcd21800 20 Filter name: none 2023-12-03T11:45:37.962 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:37.960+0000 7fc4dffff640 20 reqs_thread_entry: start 2023-12-03T11:45:37.962 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:37.960+0000 7fc5bcd21800 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2023-12-03T11:45:37.962 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:37.960+0000 7fc5bcd21800 20 rados->read ofs=0 len=0 2023-12-03T11:45:37.963 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:37.961+0000 7fc5bcd21800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:45:37.963 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:37.961+0000 7fc5bcd21800 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x0 2023-12-03T11:45:37.963 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:37.961+0000 7fc5bcd21800 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2023-12-03T11:45:37.963 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:37.961+0000 7fc5bcd21800 10 cache get: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test : miss 2023-12-03T11:45:37.963 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:37.961+0000 7fc5bcd21800 20 rados->read ofs=0 len=0 2023-12-03T11:45:37.963 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:37.961+0000 7fc5bcd21800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:45:37.963 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:37.961+0000 7fc5bcd21800 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x0 2023-12-03T11:45:37.963 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:37.961+0000 7fc5bcd21800 10 adding default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2023-12-03T11:45:37.963 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:37.961+0000 7fc5bcd21800 10 cache get: name=default.rgw.meta+users.keys+LOLHJEVUGVZYNXIEKPQP : miss 2023-12-03T11:45:37.963 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:37.961+0000 7fc5bcd21800 20 rados->read ofs=0 len=0 2023-12-03T11:45:37.963 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:37.962+0000 7fc5bcd21800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:45:37.963 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:37.962+0000 7fc5bcd21800 10 cache put: name=default.rgw.meta+users.keys+LOLHJEVUGVZYNXIEKPQP info.flags=0x0 2023-12-03T11:45:37.963 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:37.962+0000 7fc5bcd21800 10 adding default.rgw.meta+users.keys+LOLHJEVUGVZYNXIEKPQP to cache LRU end 2023-12-03T11:45:37.963 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:37.962+0000 7fc5bcd21800 10 cache get: name=default.rgw.meta+users.keys+LOLHJEVUGVZYNXIEKPQP : hit (negative entry) 2023-12-03T11:45:37.964 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:37.962+0000 7fc5bcd21800 10 cache get: name=default.rgw.meta+users.keys+LOLHJEVUGVZYNXIEKPQP : hit (negative entry) 2023-12-03T11:45:37.964 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:37.963+0000 7fc5bcd21800 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2023-12-03T11:45:37.964 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:37.963+0000 7fc5bcd21800 10 moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2023-12-03T11:45:37.964 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:37.963+0000 7fc5bcd21800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ragweed.client.0, ofs0, ns] 2023-12-03T11:45:37.965 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:37.963+0000 7fc5aeae1640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1069446856743 cookie 94382089416528 notifier 6015 bl.length()=641 2023-12-03T11:45:37.965 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:37.963+0000 7fc5aeae1640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2023-12-03T11:45:37.965 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:37.963+0000 7fc5aeae1640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2023-12-03T11:45:37.967 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:37.966+0000 7fc5bcd21800 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2023-12-03T11:45:37.968 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:37.966+0000 7fc5bcd21800 10 moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2023-12-03T11:45:37.968 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:37.966+0000 7fc5bcd21800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.email:ragweed.client.0+test@test.test, ofs0, ns] 2023-12-03T11:45:37.968 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:37.967+0000 7fc5aeae1640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1069446856711 cookie 94382089419504 notifier 6015 bl.length()=202 2023-12-03T11:45:37.968 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:37.967+0000 7fc5aeae1640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2023-12-03T11:45:37.968 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:37.967+0000 7fc5aeae1640 10 rgw watcher librados: moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2023-12-03T11:45:37.970 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:37.969+0000 7fc5bcd21800 10 cache put: name=default.rgw.meta+users.keys+LOLHJEVUGVZYNXIEKPQP info.flags=0x7 2023-12-03T11:45:37.971 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:37.969+0000 7fc5bcd21800 10 moving default.rgw.meta+users.keys+LOLHJEVUGVZYNXIEKPQP to cache LRU end 2023-12-03T11:45:37.971 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:37.969+0000 7fc5bcd21800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:LOLHJEVUGVZYNXIEKPQP, ofs0, ns] 2023-12-03T11:45:37.971 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:37.970+0000 7fc5aeae1640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1069446856712 cookie 94382089419504 notifier 6015 bl.length()=190 2023-12-03T11:45:37.971 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:37.970+0000 7fc5aeae1640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+LOLHJEVUGVZYNXIEKPQP info.flags=0x7 2023-12-03T11:45:37.971 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:37.970+0000 7fc5aeae1640 10 rgw watcher librados: moving default.rgw.meta+users.keys+LOLHJEVUGVZYNXIEKPQP to cache LRU end 2023-12-03T11:45:37.973 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2023-12-03T11:45:37.973 INFO:teuthology.orchestra.run.smithi003.stdout: "user_id": "ragweed.client.0", 2023-12-03T11:45:37.973 INFO:teuthology.orchestra.run.smithi003.stdout: "display_name": "Mr. ragweed.client.0", 2023-12-03T11:45:37.973 INFO:teuthology.orchestra.run.smithi003.stdout: "email": "ragweed.client.0+test@test.test", 2023-12-03T11:45:37.973 INFO:teuthology.orchestra.run.smithi003.stdout: "suspended": 0, 2023-12-03T11:45:37.973 INFO:teuthology.orchestra.run.smithi003.stdout: "max_buckets": 1000, 2023-12-03T11:45:37.973 INFO:teuthology.orchestra.run.smithi003.stdout: "subusers": [], 2023-12-03T11:45:37.973 INFO:teuthology.orchestra.run.smithi003.stdout: "keys": [ 2023-12-03T11:45:37.973 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-12-03T11:45:37.973 INFO:teuthology.orchestra.run.smithi003.stdout: "user": "ragweed.client.0", 2023-12-03T11:45:37.973 INFO:teuthology.orchestra.run.smithi003.stdout: "access_key": "LOLHJEVUGVZYNXIEKPQP", 2023-12-03T11:45:37.973 INFO:teuthology.orchestra.run.smithi003.stdout: "secret_key": "Ge9pd2uWWdTxWapwM5Wx29v3llHi7MUpyKvbDoWCMkn6EZVFTOiHjw==" 2023-12-03T11:45:37.973 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-12-03T11:45:37.974 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2023-12-03T11:45:37.974 INFO:teuthology.orchestra.run.smithi003.stdout: "swift_keys": [], 2023-12-03T11:45:37.974 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": [], 2023-12-03T11:45:37.974 INFO:teuthology.orchestra.run.smithi003.stdout: "op_mask": "read, write, delete", 2023-12-03T11:45:37.974 INFO:teuthology.orchestra.run.smithi003.stdout: "default_placement": "", 2023-12-03T11:45:37.974 INFO:teuthology.orchestra.run.smithi003.stdout: "default_storage_class": "", 2023-12-03T11:45:37.974 INFO:teuthology.orchestra.run.smithi003.stdout: "placement_tags": [], 2023-12-03T11:45:37.974 INFO:teuthology.orchestra.run.smithi003.stdout: "bucket_quota": { 2023-12-03T11:45:37.974 INFO:teuthology.orchestra.run.smithi003.stdout: "enabled": false, 2023-12-03T11:45:37.974 INFO:teuthology.orchestra.run.smithi003.stdout: "check_on_raw": false, 2023-12-03T11:45:37.974 INFO:teuthology.orchestra.run.smithi003.stdout: "max_size": -1, 2023-12-03T11:45:37.974 INFO:teuthology.orchestra.run.smithi003.stdout: "max_size_kb": 0, 2023-12-03T11:45:37.974 INFO:teuthology.orchestra.run.smithi003.stdout: "max_objects": -1 2023-12-03T11:45:37.974 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-12-03T11:45:37.974 INFO:teuthology.orchestra.run.smithi003.stdout: "user_quota": { 2023-12-03T11:45:37.975 INFO:teuthology.orchestra.run.smithi003.stdout: "enabled": false, 2023-12-03T11:45:37.975 INFO:teuthology.orchestra.run.smithi003.stdout: "check_on_raw": false, 2023-12-03T11:45:37.975 INFO:teuthology.orchestra.run.smithi003.stdout: "max_size": -1, 2023-12-03T11:45:37.975 INFO:teuthology.orchestra.run.smithi003.stdout: "max_size_kb": 0, 2023-12-03T11:45:37.975 INFO:teuthology.orchestra.run.smithi003.stdout: "max_objects": -1 2023-12-03T11:45:37.975 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-12-03T11:45:37.975 INFO:teuthology.orchestra.run.smithi003.stdout: "temp_url_keys": [], 2023-12-03T11:45:37.975 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "rgw", 2023-12-03T11:45:37.975 INFO:teuthology.orchestra.run.smithi003.stdout: "mfa_ids": [] 2023-12-03T11:45:37.975 INFO:teuthology.orchestra.run.smithi003.stdout:} 2023-12-03T11:45:37.975 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:45:37.975 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:37.972+0000 7fc57f7de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:45:37.976 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:37.975+0000 7fc5bcd21800 20 remove_watcher() i=0 2023-12-03T11:45:37.976 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:37.975+0000 7fc5bcd21800 2 removed watcher, disabling cache 2023-12-03T11:45:37.977 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:37.976+0000 7fc5bcd21800 20 remove_watcher() i=1 2023-12-03T11:45:37.978 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:37.977+0000 7fc5bcd21800 20 remove_watcher() i=2 2023-12-03T11:45:37.979 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:37.978+0000 7fc5bcd21800 20 remove_watcher() i=3 2023-12-03T11:45:37.981 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:37.980+0000 7fc5bcd21800 20 remove_watcher() i=4 2023-12-03T11:45:37.982 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:37.981+0000 7fc5bcd21800 20 remove_watcher() i=5 2023-12-03T11:45:37.983 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:37.982+0000 7fc5bcd21800 20 remove_watcher() i=6 2023-12-03T11:45:37.984 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:37.983+0000 7fc5bcd21800 20 remove_watcher() i=7 2023-12-03T11:45:37.989 DEBUG:tasks.ragweed:Creating user sysuser.client.0 on client.0 2023-12-03T11:45:37.989 DEBUG:teuthology.orchestra.run.smithi003:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid sysuser.client.0 --display-name 'Mr. sysuser.client.0' --access-key GMTHDBPYWYYZQNKEGYFQ --secret KjUjLFQHc6/b96PH28VCE8JKkRCKvIq2KichO5p+lEkrl4UnumF0pw== --email sysuser.client.0+test@test.test --system true 2023-12-03T11:45:38.041 INFO:teuthology.orchestra.run.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:45:38.042 INFO:teuthology.orchestra.run.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:45:38.052 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:38.051+0000 7f5f5b726800 20 rados->read ofs=0 len=0 2023-12-03T11:45:38.055 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:38.053+0000 7f5f5b726800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:45:38.055 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:38.053+0000 7f5f5b726800 20 realm 2023-12-03T11:45:38.055 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:38.053+0000 7f5f5b726800 20 rados->read ofs=0 len=0 2023-12-03T11:45:38.055 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:38.053+0000 7f5f5b726800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:45:38.055 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:38.053+0000 7f5f5b726800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:45:38.055 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:38.053+0000 7f5f5b726800 20 rados->read ofs=0 len=0 2023-12-03T11:45:38.056 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:38.054+0000 7f5f5b726800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:45:38.056 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:38.054+0000 7f5f5b726800 20 rados->read ofs=0 len=0 2023-12-03T11:45:38.056 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:38.054+0000 7f5f5b726800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:45:38.057 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:38.054+0000 7f5f5b726800 20 rados->read ofs=0 len=0 2023-12-03T11:45:38.057 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:38.055+0000 7f5f5b726800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:45:38.057 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:38.055+0000 7f5f5b726800 20 searching for the correct realm 2023-12-03T11:45:38.069 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:38.067+0000 7f5f5b726800 20 RGWRados::pool_iterate: got zone_info.83aabb46-04b5-4c96-9933-c6bfb1173a73 2023-12-03T11:45:38.069 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:38.067+0000 7f5f5b726800 20 RGWRados::pool_iterate: got zonegroup_info.6a811aad-435d-4fdd-93c9-b7e0b50de429 2023-12-03T11:45:38.069 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:38.067+0000 7f5f5b726800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:45:38.069 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:38.067+0000 7f5f5b726800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:45:38.069 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:38.067+0000 7f5f5b726800 20 rados->read ofs=0 len=0 2023-12-03T11:45:38.070 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:38.067+0000 7f5f5b726800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:45:38.070 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:38.067+0000 7f5f5b726800 20 rados->read ofs=0 len=0 2023-12-03T11:45:38.070 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:38.068+0000 7f5f57323640 0 -- 172.21.15.3:0/2354371290 >> [v2:172.21.15.37:6805/1692844418,v1:172.21.15.37:6807/1692844418] conn(0x55b3bd555920 msgr2=0x55b3bd557d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:45:38.070 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:38.068+0000 7f5f5b726800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:45:38.070 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:38.068+0000 7f5f5b726800 20 rados->read ofs=0 len=0 2023-12-03T11:45:38.071 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:38.069+0000 7f5f5b726800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:45:38.071 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:38.069+0000 7f5f5b726800 20 zone default found 2023-12-03T11:45:38.071 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:38.069+0000 7f5f5b726800 4 Realm: () 2023-12-03T11:45:38.071 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:38.069+0000 7f5f5b726800 4 ZoneGroup: default (6a811aad-435d-4fdd-93c9-b7e0b50de429) 2023-12-03T11:45:38.071 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:38.069+0000 7f5f5b726800 4 Zone: default (83aabb46-04b5-4c96-9933-c6bfb1173a73) 2023-12-03T11:45:38.071 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:38.069+0000 7f5f5b726800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:45:38.071 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:38.069+0000 7f5f5b726800 20 zonegroup default 2023-12-03T11:45:38.071 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:38.069+0000 7f5f5b726800 20 rados->read ofs=0 len=0 2023-12-03T11:45:38.071 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:38.069+0000 7f5f5b726800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:45:38.072 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:38.069+0000 7f5f5b726800 20 rados->read ofs=0 len=0 2023-12-03T11:45:38.072 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:38.069+0000 7f5f5b726800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:45:38.072 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:38.069+0000 7f5f5b726800 20 rados->read ofs=0 len=0 2023-12-03T11:45:38.072 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:38.070+0000 7f5f5b726800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:45:38.072 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:38.070+0000 7f5f5b726800 20 started sync module instance, tier type = 2023-12-03T11:45:38.072 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:38.070+0000 7f5f5b726800 20 started zone id=83aabb46-04b5-4c96-9933-c6bfb1173a73 (name=default) with tier type = 2023-12-03T11:45:38.081 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:38.080+0000 7f5f5b726800 20 add_watcher() i=0 2023-12-03T11:45:38.081 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:38.080+0000 7f5f5b726800 20 add_watcher() i=1 2023-12-03T11:45:38.081 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:38.080+0000 7f5f5b726800 20 add_watcher() i=2 2023-12-03T11:45:38.081 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:38.080+0000 7f5f5b726800 20 add_watcher() i=3 2023-12-03T11:45:38.081 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:38.080+0000 7f5f5b726800 20 add_watcher() i=4 2023-12-03T11:45:38.081 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:38.080+0000 7f5f5b726800 20 add_watcher() i=5 2023-12-03T11:45:38.081 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:38.080+0000 7f5f5b726800 20 add_watcher() i=6 2023-12-03T11:45:38.082 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:38.081+0000 7f5f57323640 0 -- 172.21.15.3:0/2354371290 >> [v2:172.21.15.3:6808/263125788,v1:172.21.15.3:6809/263125788] conn(0x7f5f4c09a3e0 msgr2=0x7f5f4c0b9210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:45:38.082 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:38.081+0000 7f5f5b726800 20 add_watcher() i=7 2023-12-03T11:45:38.082 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:38.081+0000 7f5f5b726800 2 all 8 watchers are set, enabling cache 2023-12-03T11:45:38.084 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:38.082+0000 7f5f1d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:45:38.084 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:38.083+0000 7f5f5b726800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:45:38.084 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:38.083+0000 7f5f5b726800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:45:38.089 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:38.088+0000 7f5f5b726800 5 note: GC not initialized 2023-12-03T11:45:38.089 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:38.088+0000 7f5e8bfff640 20 reqs_thread_entry: start 2023-12-03T11:45:38.089 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:38.088+0000 7f5f5b726800 20 init_complete bucket index max shards: 11 2023-12-03T11:45:38.089 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:38.088+0000 7f5f5b726800 20 Filter name: none 2023-12-03T11:45:38.089 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:38.088+0000 7f5e89ffb640 20 reqs_thread_entry: start 2023-12-03T11:45:38.089 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:38.088+0000 7f5f5b726800 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2023-12-03T11:45:38.090 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:38.088+0000 7f5f5b726800 20 rados->read ofs=0 len=0 2023-12-03T11:45:38.090 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:38.088+0000 7f5f5b726800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:45:38.091 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:38.088+0000 7f5f5b726800 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x0 2023-12-03T11:45:38.091 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:38.088+0000 7f5f5b726800 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2023-12-03T11:45:38.091 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:38.088+0000 7f5f5b726800 10 cache get: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test : miss 2023-12-03T11:45:38.091 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:38.088+0000 7f5f5b726800 20 rados->read ofs=0 len=0 2023-12-03T11:45:38.091 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:38.089+0000 7f5f5b726800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:45:38.091 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:38.089+0000 7f5f5b726800 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x0 2023-12-03T11:45:38.091 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:38.089+0000 7f5f5b726800 10 adding default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2023-12-03T11:45:38.091 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:38.089+0000 7f5f5b726800 10 cache get: name=default.rgw.meta+users.keys+GMTHDBPYWYYZQNKEGYFQ : miss 2023-12-03T11:45:38.091 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:38.089+0000 7f5f5b726800 20 rados->read ofs=0 len=0 2023-12-03T11:45:38.091 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:38.089+0000 7f5f5b726800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:45:38.091 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:38.089+0000 7f5f5b726800 10 cache put: name=default.rgw.meta+users.keys+GMTHDBPYWYYZQNKEGYFQ info.flags=0x0 2023-12-03T11:45:38.091 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:38.089+0000 7f5f5b726800 10 adding default.rgw.meta+users.keys+GMTHDBPYWYYZQNKEGYFQ to cache LRU end 2023-12-03T11:45:38.091 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:38.089+0000 7f5f5b726800 10 cache get: name=default.rgw.meta+users.keys+GMTHDBPYWYYZQNKEGYFQ : hit (negative entry) 2023-12-03T11:45:38.092 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:38.089+0000 7f5f5b726800 10 cache get: name=default.rgw.meta+users.keys+GMTHDBPYWYYZQNKEGYFQ : hit (negative entry) 2023-12-03T11:45:38.092 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:38.090+0000 7f5f5b726800 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2023-12-03T11:45:38.092 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:38.091+0000 7f5f5b726800 10 moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2023-12-03T11:45:38.092 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:38.091+0000 7f5f5b726800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:sysuser.client.0, ofs0, ns] 2023-12-03T11:45:38.092 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:38.091+0000 7f5f3d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1069446856713 cookie 94230464030432 notifier 6036 bl.length()=641 2023-12-03T11:45:38.092 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:38.091+0000 7f5f3d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2023-12-03T11:45:38.092 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:38.091+0000 7f5f3d7fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2023-12-03T11:45:38.095 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:38.094+0000 7f5f5b726800 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2023-12-03T11:45:38.095 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:38.094+0000 7f5f5b726800 10 moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2023-12-03T11:45:38.096 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:38.094+0000 7f5f5b726800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.email:sysuser.client.0+test@test.test, ofs0, ns] 2023-12-03T11:45:38.096 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:38.094+0000 7f5f3d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1069446856744 cookie 94230464038784 notifier 6036 bl.length()=202 2023-12-03T11:45:38.096 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:38.094+0000 7f5f3d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2023-12-03T11:45:38.096 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:38.094+0000 7f5f3d7fa640 10 rgw watcher librados: moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2023-12-03T11:45:38.098 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:38.097+0000 7f5f5b726800 10 cache put: name=default.rgw.meta+users.keys+GMTHDBPYWYYZQNKEGYFQ info.flags=0x7 2023-12-03T11:45:38.099 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:38.097+0000 7f5f5b726800 10 moving default.rgw.meta+users.keys+GMTHDBPYWYYZQNKEGYFQ to cache LRU end 2023-12-03T11:45:38.099 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:38.097+0000 7f5f5b726800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.keys:GMTHDBPYWYYZQNKEGYFQ, ofs0, ns] 2023-12-03T11:45:38.100 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:38.097+0000 7f5f3d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1069446856752 cookie 94230461550416 notifier 6036 bl.length()=190 2023-12-03T11:45:38.100 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:38.097+0000 7f5f3d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+GMTHDBPYWYYZQNKEGYFQ info.flags=0x7 2023-12-03T11:45:38.100 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:38.097+0000 7f5f3d7fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+GMTHDBPYWYYZQNKEGYFQ to cache LRU end 2023-12-03T11:45:38.100 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2023-12-03T11:45:38.100 INFO:teuthology.orchestra.run.smithi003.stdout: "user_id": "sysuser.client.0", 2023-12-03T11:45:38.100 INFO:teuthology.orchestra.run.smithi003.stdout: "display_name": "Mr. sysuser.client.0", 2023-12-03T11:45:38.100 INFO:teuthology.orchestra.run.smithi003.stdout: "email": "sysuser.client.0+test@test.test", 2023-12-03T11:45:38.101 INFO:teuthology.orchestra.run.smithi003.stdout: "suspended": 0, 2023-12-03T11:45:38.101 INFO:teuthology.orchestra.run.smithi003.stdout: "max_buckets": 1000, 2023-12-03T11:45:38.101 INFO:teuthology.orchestra.run.smithi003.stdout: "subusers": [], 2023-12-03T11:45:38.101 INFO:teuthology.orchestra.run.smithi003.stdout: "keys": [ 2023-12-03T11:45:38.101 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-12-03T11:45:38.101 INFO:teuthology.orchestra.run.smithi003.stdout: "user": "sysuser.client.0", 2023-12-03T11:45:38.101 INFO:teuthology.orchestra.run.smithi003.stdout: "access_key": "GMTHDBPYWYYZQNKEGYFQ", 2023-12-03T11:45:38.101 INFO:teuthology.orchestra.run.smithi003.stdout: "secret_key": "KjUjLFQHc6/b96PH28VCE8JKkRCKvIq2KichO5p+lEkrl4UnumF0pw==" 2023-12-03T11:45:38.101 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-12-03T11:45:38.101 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2023-12-03T11:45:38.101 INFO:teuthology.orchestra.run.smithi003.stdout: "swift_keys": [], 2023-12-03T11:45:38.101 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": [], 2023-12-03T11:45:38.101 INFO:teuthology.orchestra.run.smithi003.stdout: "op_mask": "read, write, delete", 2023-12-03T11:45:38.102 INFO:teuthology.orchestra.run.smithi003.stdout: "system": true, 2023-12-03T11:45:38.102 INFO:teuthology.orchestra.run.smithi003.stdout: "default_placement": "", 2023-12-03T11:45:38.102 INFO:teuthology.orchestra.run.smithi003.stdout: "default_storage_class": "", 2023-12-03T11:45:38.102 INFO:teuthology.orchestra.run.smithi003.stdout: "placement_tags": [], 2023-12-03T11:45:38.102 INFO:teuthology.orchestra.run.smithi003.stdout: "bucket_quota": { 2023-12-03T11:45:38.102 INFO:teuthology.orchestra.run.smithi003.stdout: "enabled": false, 2023-12-03T11:45:38.102 INFO:teuthology.orchestra.run.smithi003.stdout: "check_on_raw": false, 2023-12-03T11:45:38.102 INFO:teuthology.orchestra.run.smithi003.stdout: "max_size": -1, 2023-12-03T11:45:38.102 INFO:teuthology.orchestra.run.smithi003.stdout: "max_size_kb": 0, 2023-12-03T11:45:38.102 INFO:teuthology.orchestra.run.smithi003.stdout: "max_objects": -1 2023-12-03T11:45:38.102 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-12-03T11:45:38.102 INFO:teuthology.orchestra.run.smithi003.stdout: "user_quota": { 2023-12-03T11:45:38.102 INFO:teuthology.orchestra.run.smithi003.stdout: "enabled": false, 2023-12-03T11:45:38.103 INFO:teuthology.orchestra.run.smithi003.stdout: "check_on_raw": false, 2023-12-03T11:45:38.103 INFO:teuthology.orchestra.run.smithi003.stdout: "max_size": -1, 2023-12-03T11:45:38.103 INFO:teuthology.orchestra.run.smithi003.stdout: "max_size_kb": 0, 2023-12-03T11:45:38.103 INFO:teuthology.orchestra.run.smithi003.stdout: "max_objects": -1 2023-12-03T11:45:38.103 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-12-03T11:45:38.103 INFO:teuthology.orchestra.run.smithi003.stdout: "temp_url_keys": [], 2023-12-03T11:45:38.103 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "rgw", 2023-12-03T11:45:38.103 INFO:teuthology.orchestra.run.smithi003.stdout: "mfa_ids": [] 2023-12-03T11:45:38.103 INFO:teuthology.orchestra.run.smithi003.stdout:} 2023-12-03T11:45:38.103 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:45:38.104 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:38.100+0000 7f5f1d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:45:38.104 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:38.102+0000 7f5f5b726800 20 remove_watcher() i=0 2023-12-03T11:45:38.104 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:38.102+0000 7f5f5b726800 2 removed watcher, disabling cache 2023-12-03T11:45:38.105 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:38.104+0000 7f5f5b726800 20 remove_watcher() i=1 2023-12-03T11:45:38.106 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:38.105+0000 7f5f5b726800 20 remove_watcher() i=2 2023-12-03T11:45:38.107 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:38.106+0000 7f5f5b726800 20 remove_watcher() i=3 2023-12-03T11:45:38.108 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:38.107+0000 7f5f5b726800 20 remove_watcher() i=4 2023-12-03T11:45:38.109 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:38.108+0000 7f5f5b726800 20 remove_watcher() i=5 2023-12-03T11:45:38.110 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:38.109+0000 7f5f5b726800 20 remove_watcher() i=6 2023-12-03T11:45:38.111 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:45:38.110+0000 7f5f5b726800 20 remove_watcher() i=7 2023-12-03T11:45:38.116 INFO:tasks.ragweed:Configuring ragweed... 2023-12-03T11:45:38.117 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-12-03T11:45:38.117 DEBUG:teuthology.orchestra.run.smithi003:> dd of=/home/ubuntu/cephtest/archive/ragweed.client.0.conf 2023-12-03T11:45:38.133 INFO:tasks.ragweed:Configuring boto... 2023-12-03T11:45:38.133 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-12-03T11:45:38.133 DEBUG:teuthology.orchestra.run.smithi003:> dd of=/home/ubuntu/cephtest/boto.cfg 2023-12-03T11:45:38.187 DEBUG:teuthology.orchestra.run.smithi003:ragweed tests against rgw> source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/ragweed.client.0 && RAGWEED_CONF=/home/ubuntu/cephtest/archive/ragweed.client.0.conf RAGWEED_STAGES=prepare,check BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg tox --sitepackages -- -v -m 'not fails_on_rgw' 2023-12-03T11:45:38.355 INFO:teuthology.orchestra.run.smithi003.stdout:GLOB sdist-make: /home/ubuntu/cephtest/ragweed.client.0/setup.py 2023-12-03T11:45:38.533 INFO:teuthology.orchestra.run.smithi003.stdout:py create: /home/ubuntu/cephtest/ragweed.client.0/.tox/py 2023-12-03T11:45:39.015 INFO:teuthology.orchestra.run.smithi003.stdout:py installdeps: -rrequirements.txt 2023-12-03T11:45:48.859 INFO:teuthology.orchestra.run.smithi003.stdout:py inst: /home/ubuntu/cephtest/ragweed.client.0/.tox/.tmp/package/1/ragweed-0.0.1.zip 2023-12-03T11:45:51.442 INFO:teuthology.orchestra.run.smithi003.stdout:py installed: asyncssh==2.13.2,Babel==2.9.1,bcrypt==3.2.2,boto==2.49.0,cachetools==4.2.4,ceph==1.0.0,ceph-volume==1.0.0,cephfs==2.0.0,certifi==2021.10.8,cffi==1.14.5,chardet==4.0.0,cheroot==8.6.0,CherryPy==18.6.1,cockpit @ file:///builddir/build/BUILD/cockpit-299/tmp/wheel/cockpit-299-py3-none-any.whl,cryptography==36.0.1,dasbus==1.4,dbus-python==1.2.18,distro==1.5.0,docopt==0.6.2,exceptiongroup==1.2.0,execnet==2.0.2,file-magic==0.4.0,gevent==23.9.1,google-auth==2.23.4,gpg==1.15.1,greenlet==3.0.1,httplib2==0.22.0,idna==2.10,iniconfig==2.0.0,isodate==0.6.1,jaraco.classes==3.2.1,jaraco.collections==3.0.0,jaraco.functools==3.5.0,jaraco.text==3.2.0,Jinja2==2.11.3,jsonpatch==1.21,jsonpointer==2.0,kubernetes==26.1.0,libcomps==0.1.18,logutils==0.3.5,lxml==4.6.5,Mako==1.1.4.dev0,MarkupSafe==1.1.1,more-itertools==8.12.0,munch==4.0.0,natsort==7.1.1,nftables==0.1,numpy==1.20.1,oauthlib==3.1.1,packaging==23.2,pecan==1.4.2,perf==0.1,pexpect==4.8.0,pluggy==1.3.0,ply==3.11,portend==3.1.0,prettytable==0.7.2,psutil==5.8.0,ptyprocess==0.6.0,pyasn1==0.4.8,pyasn1-modules==0.2.8,pycparser==2.20,PyGObject==3.40.1,PyJWT==2.4.0,pyOpenSSL==21.0.0,pyparsing==2.4.7,PySocks==1.7.1,pytest==7.4.3,python-dateutil==2.8.1,python-linux-procfs==0.7.0,pytz==2021.1,pyudev==0.22.0,PyYAML==5.4.1,rados==2.0.0,ragweed @ file:///home/ubuntu/cephtest/ragweed.client.0/.tox/.tmp/package/1/ragweed-0.0.1.zip#sha256=539d00f7d4641d15ad55856594029fd1d176e44398a070342cd970a3f1feb7a1,rbd==2.0.0,registries-conf-ctl==1.0,remoto==1.2.1,repoze.lru==0.7,requests==2.25.1,requests-oauthlib==1.3.0,rgw==2.0.0,Routes==2.5.1,rpm==4.16.1.3,rsa==4.9,s3cmd==2.3.0,scipy==1.6.2,selinux==3.5,sepolicy==3.5,setools==4.4.3,setroubleshoot @ file:///builddir/build/BUILD/setroubleshoot-3.3.32/src,six==1.15.0,sos==4.3,systemd-python==234,tempora==5.0.0,toml==0.10.2,tomli==2.0.1,typing_extensions==4.4.0,urllib3==1.26.5,WebOb==1.8.7,websocket-client==1.2.3,Werkzeug==2.0.3,zc.lockfile==2.0,zope.event==5.0,zope.interface==6.1 2023-12-03T11:45:51.443 INFO:teuthology.orchestra.run.smithi003.stdout:py run-test-pre: PYTHONHASHSEED='4012939888' 2023-12-03T11:45:51.443 INFO:teuthology.orchestra.run.smithi003.stdout:py run-test: commands[0] | python -m pytest -v -m 'not fails_on_rgw' 2023-12-03T11:45:51.652 INFO:teuthology.orchestra.run.smithi003.stdout:============================= test session starts ============================== 2023-12-03T11:45:51.652 INFO:teuthology.orchestra.run.smithi003.stdout:platform linux -- Python 3.9.17, pytest-7.4.3, pluggy-1.3.0 -- /home/ubuntu/cephtest/ragweed.client.0/.tox/py/bin/python 2023-12-03T11:45:51.652 INFO:teuthology.orchestra.run.smithi003.stdout:cachedir: .tox/py/.pytest_cache 2023-12-03T11:45:51.652 INFO:teuthology.orchestra.run.smithi003.stdout:rootdir: /home/ubuntu/cephtest/ragweed.client.0 2023-12-03T11:45:51.653 INFO:teuthology.orchestra.run.smithi003.stdout:configfile: pytest.ini 2023-12-03T11:45:51.756 INFO:teuthology.orchestra.run.smithi003.stdout:collecting ... collected 9 items 2023-12-03T11:45:51.756 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:45:53.853 INFO:teuthology.orchestra.run.smithi003.stdout:ragweed/tests/tests.py::r_test_small_obj_data::test PASSED [ 11%] 2023-12-03T11:45:56.341 INFO:teuthology.orchestra.run.smithi003.stdout:ragweed/tests/tests.py::r_test_multipart_simple::test PASSED [ 22%] 2023-12-03T11:45:58.254 INFO:teuthology.orchestra.run.smithi003.stdout:ragweed/tests/tests.py::r_test_multipart_index_versioning::test PASSED [ 33%] 2023-12-03T11:46:02.031 INFO:teuthology.orchestra.run.smithi003.stdout:ragweed/tests/tests.py::r_test_multipart_defer_complete::test PASSED [ 44%] 2023-12-03T11:46:04.530 INFO:teuthology.orchestra.run.smithi003.stdout:ragweed/tests/tests.py::r_test_multipart_defer_update_complete::test PASSED [ 55%] 2023-12-03T11:46:12.897 INFO:teuthology.orchestra.run.smithi003.stdout:ragweed/tests/tests.py::r_test_obj_storage_class::test PASSED [ 66%] 2023-12-03T11:46:17.686 INFO:teuthology.orchestra.run.smithi003.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_multipart::test PASSED [ 77%] 2023-12-03T11:46:22.626 INFO:teuthology.orchestra.run.smithi003.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_copy::test PASSED [ 88%] 2023-12-03T11:46:32.027 INFO:teuthology.orchestra.run.smithi003.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_multipart_copy::test PASSED [100%] 2023-12-03T11:46:32.027 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:46:32.027 INFO:teuthology.orchestra.run.smithi003.stdout:=============================== warnings summary =============================== 2023-12-03T11:46:32.027 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/boto/plugin.py:40 2023-12-03T11:46:32.028 INFO:teuthology.orchestra.run.smithi003.stdout: /home/ubuntu/cephtest/ragweed.client.0/.tox/py/lib/python3.9/site-packages/boto/plugin.py:40: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses 2023-12-03T11:46:32.028 INFO:teuthology.orchestra.run.smithi003.stdout: import imp 2023-12-03T11:46:32.028 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:46:32.028 INFO:teuthology.orchestra.run.smithi003.stdout:-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html 2023-12-03T11:46:32.028 INFO:teuthology.orchestra.run.smithi003.stdout:======================== 9 passed, 1 warning in 40.38s ========================= 2023-12-03T11:46:32.060 INFO:teuthology.orchestra.run.smithi003.stdout:___________________________________ summary ____________________________________ 2023-12-03T11:46:32.061 INFO:teuthology.orchestra.run.smithi003.stdout: py: commands succeeded 2023-12-03T11:46:32.061 INFO:teuthology.orchestra.run.smithi003.stdout: congratulations :) 2023-12-03T11:46:32.075 INFO:tasks.ragweed:Cleaning up boto... 2023-12-03T11:46:32.076 DEBUG:teuthology.orchestra.run.smithi003:> rm -f /home/ubuntu/cephtest/boto.cfg 2023-12-03T11:46:32.091 DEBUG:teuthology.orchestra.run.smithi003:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid ragweed.client.0 --purge-data 2023-12-03T11:46:32.173 INFO:teuthology.orchestra.run.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:46:32.174 INFO:teuthology.orchestra.run.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:46:32.185 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.183+0000 7f175351e800 20 rados->read ofs=0 len=0 2023-12-03T11:46:32.186 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.185+0000 7f175351e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:46:32.187 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.185+0000 7f175351e800 20 realm 2023-12-03T11:46:32.187 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.185+0000 7f175351e800 20 rados->read ofs=0 len=0 2023-12-03T11:46:32.187 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.185+0000 7f175351e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:46:32.187 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.185+0000 7f175351e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:46:32.187 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.185+0000 7f175351e800 20 rados->read ofs=0 len=0 2023-12-03T11:46:32.187 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.185+0000 7f175351e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:46:32.187 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.185+0000 7f175351e800 20 rados->read ofs=0 len=0 2023-12-03T11:46:32.188 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.186+0000 7f175351e800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:46:32.188 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.186+0000 7f175351e800 20 rados->read ofs=0 len=0 2023-12-03T11:46:32.188 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.187+0000 7f175351e800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:46:32.188 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.187+0000 7f175351e800 20 searching for the correct realm 2023-12-03T11:46:32.200 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.199+0000 7f1751826640 0 -- 172.21.15.3:0/2023763910 >> [v2:172.21.15.37:6816/3770469300,v1:172.21.15.37:6818/3770469300] conn(0x7f1748067410 msgr2=0x7f1748067870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-03T11:46:32.201 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.199+0000 7f175351e800 20 RGWRados::pool_iterate: got zone_info.83aabb46-04b5-4c96-9933-c6bfb1173a73 2023-12-03T11:46:32.201 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.199+0000 7f175351e800 20 RGWRados::pool_iterate: got zonegroup_info.6a811aad-435d-4fdd-93c9-b7e0b50de429 2023-12-03T11:46:32.201 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.199+0000 7f175351e800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:46:32.201 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.199+0000 7f175351e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:46:32.201 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.199+0000 7f175351e800 20 rados->read ofs=0 len=0 2023-12-03T11:46:32.201 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.200+0000 7f175351e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:46:32.201 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.200+0000 7f175351e800 20 rados->read ofs=0 len=0 2023-12-03T11:46:32.202 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.200+0000 7f175351e800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:46:32.203 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.200+0000 7f175351e800 20 rados->read ofs=0 len=0 2023-12-03T11:46:32.203 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.200+0000 7f175351e800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:46:32.203 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.200+0000 7f175351e800 20 zone default found 2023-12-03T11:46:32.203 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.200+0000 7f175351e800 4 Realm: () 2023-12-03T11:46:32.203 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.200+0000 7f175351e800 4 ZoneGroup: default (6a811aad-435d-4fdd-93c9-b7e0b50de429) 2023-12-03T11:46:32.203 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.200+0000 7f175351e800 4 Zone: default (83aabb46-04b5-4c96-9933-c6bfb1173a73) 2023-12-03T11:46:32.203 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.200+0000 7f175351e800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:46:32.203 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.200+0000 7f175351e800 20 zonegroup default 2023-12-03T11:46:32.203 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.200+0000 7f175351e800 20 rados->read ofs=0 len=0 2023-12-03T11:46:32.203 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.201+0000 7f175351e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:46:32.203 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.201+0000 7f175351e800 20 rados->read ofs=0 len=0 2023-12-03T11:46:32.203 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.201+0000 7f175351e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:46:32.203 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.201+0000 7f175351e800 20 rados->read ofs=0 len=0 2023-12-03T11:46:32.203 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.201+0000 7f175351e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:46:32.204 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.201+0000 7f175351e800 20 started sync module instance, tier type = 2023-12-03T11:46:32.204 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.201+0000 7f175351e800 20 started zone id=83aabb46-04b5-4c96-9933-c6bfb1173a73 (name=default) with tier type = 2023-12-03T11:46:32.212 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.210+0000 7f1750824640 0 -- 172.21.15.3:0/2023763910 >> [v2:172.21.15.3:6817/3356208405,v1:172.21.15.3:6819/3356208405] conn(0x556f9b3c68b0 msgr2=0x556f9b3c8ca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:46:32.213 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.212+0000 7f175351e800 20 add_watcher() i=0 2023-12-03T11:46:32.213 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.212+0000 7f175351e800 20 add_watcher() i=1 2023-12-03T11:46:32.213 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.212+0000 7f175351e800 20 add_watcher() i=2 2023-12-03T11:46:32.214 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.212+0000 7f175351e800 20 add_watcher() i=3 2023-12-03T11:46:32.214 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.212+0000 7f175351e800 20 add_watcher() i=4 2023-12-03T11:46:32.214 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.212+0000 7f175351e800 20 add_watcher() i=5 2023-12-03T11:46:32.214 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.212+0000 7f175351e800 20 add_watcher() i=6 2023-12-03T11:46:32.214 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.212+0000 7f175351e800 20 add_watcher() i=7 2023-12-03T11:46:32.214 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.212+0000 7f175351e800 2 all 8 watchers are set, enabling cache 2023-12-03T11:46:32.216 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.215+0000 7f1716fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:46:32.216 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.215+0000 7f175351e800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:46:32.216 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.215+0000 7f175351e800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:46:32.262 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.259+0000 7f1685ffb640 20 reqs_thread_entry: start 2023-12-03T11:46:32.262 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.259+0000 7f175351e800 20 init_complete bucket index max shards: 11 2023-12-03T11:46:32.262 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.259+0000 7f175351e800 20 Filter name: none 2023-12-03T11:46:32.262 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.260+0000 7f16777fe640 20 reqs_thread_entry: start 2023-12-03T11:46:32.262 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.260+0000 7f175351e800 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2023-12-03T11:46:32.262 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.260+0000 7f175351e800 20 rados->read ofs=0 len=0 2023-12-03T11:46:32.262 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.260+0000 7f175351e800 20 rados_obj.operate() r=0 bl.length=452 2023-12-03T11:46:32.262 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.260+0000 7f175351e800 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x13 2023-12-03T11:46:32.262 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.260+0000 7f175351e800 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2023-12-03T11:46:32.262 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.260+0000 7f175351e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:46:32.263 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.261+0000 7f175351e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.4 : miss 2023-12-03T11:46:32.263 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.261+0000 7f175351e800 20 rados->read ofs=0 len=0 2023-12-03T11:46:32.263 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.262+0000 7f175351e800 20 rados_obj.operate() r=0 bl.length=378 2023-12-03T11:46:32.263 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.262+0000 7f175351e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.4 info.flags=0x17 2023-12-03T11:46:32.263 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.262+0000 7f175351e800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-conf:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.4 to cache LRU end 2023-12-03T11:46:32.263 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.262+0000 7f175351e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:46:32.263 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.262+0000 7f175351e800 10 updating xattr: name=user.rgw.acl bl.length()=209 2023-12-03T11:46:32.263 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.262+0000 7f175351e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-conf:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.4 2023-12-03T11:46:32.264 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.263+0000 7f175351e800 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart_copy 2023-12-03T11:46:32.264 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.263+0000 7f175351e800 10 cls_bucket_list_unordered: got tests/r_test_multipart_index_versioning 2023-12-03T11:46:32.264 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.263+0000 7f175351e800 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_copy 2023-12-03T11:46:32.264 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.263+0000 7f175351e800 10 cls_bucket_list_unordered: got tests/r_test_multipart_defer_update_complete 2023-12-03T11:46:32.265 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.264+0000 7f175351e800 10 cls_bucket_list_unordered: got tests/r_test_multipart_defer_complete 2023-12-03T11:46:32.265 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.264+0000 7f175351e800 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class 2023-12-03T11:46:32.265 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.264+0000 7f175351e800 10 cls_bucket_list_unordered: got tests/r_test_multipart_simple 2023-12-03T11:46:32.266 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.265+0000 7f175351e800 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart 2023-12-03T11:46:32.267 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.266+0000 7f175351e800 10 cls_bucket_list_unordered: got tests/r_test_small_obj_data 2023-12-03T11:46:32.267 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.266+0000 7f175351e800 20 get_obj_state: octx=0x7f174c01a710 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x556f9b4b91f8 s->prefetch_data=0 2023-12-03T11:46:32.268 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.267+0000 7f175351e800 10 manifest: total_size = 5252 2023-12-03T11:46:32.268 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.267+0000 7f175351e800 20 get_obj_state: setting s->obj_tag to 83aabb46-04b5-4c96-9933-c6bfb1173a73.4653.5072687279948154747 2023-12-03T11:46:32.268 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.267+0000 7f175351e800 20 get_obj_state: octx=0x7f174c01a710 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x556f9b4b91f8 s->prefetch_data=0 2023-12-03T11:46:32.268 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.267+0000 7f175351e800 20 prepare_atomic_modification: state is not atomic. state=0x556f9b4b91f8 2023-12-03T11:46:32.268 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.267+0000 7f175351e800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.4.1 2023-12-03T11:46:32.271 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.270+0000 7f175351e800 20 get_obj_state: octx=0x7f174c01a710 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x556f9b4b91f8 s->prefetch_data=0 2023-12-03T11:46:32.271 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.270+0000 7f175351e800 10 manifest: total_size = 7336 2023-12-03T11:46:32.272 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.270+0000 7f175351e800 20 get_obj_state: setting s->obj_tag to 83aabb46-04b5-4c96-9933-c6bfb1173a73.4653.11990019440854026184 2023-12-03T11:46:32.272 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.270+0000 7f175351e800 20 get_obj_state: octx=0x7f174c01a710 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x556f9b4b91f8 s->prefetch_data=0 2023-12-03T11:46:32.272 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.270+0000 7f175351e800 20 prepare_atomic_modification: state is not atomic. state=0x556f9b4b91f8 2023-12-03T11:46:32.272 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.270+0000 7f175351e800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.4.2 2023-12-03T11:46:32.272 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.271+0000 7f17337fe640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_multipart_copy 2023-12-03T11:46:32.274 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.273+0000 7f175351e800 20 get_obj_state: octx=0x7f174c01a710 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x556f9b4b91f8 s->prefetch_data=0 2023-12-03T11:46:32.274 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.273+0000 7f175351e800 10 manifest: total_size = 5214 2023-12-03T11:46:32.275 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.273+0000 7f175351e800 20 get_obj_state: setting s->obj_tag to 83aabb46-04b5-4c96-9933-c6bfb1173a73.4653.2576765882088324930 2023-12-03T11:46:32.275 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.273+0000 7f175351e800 20 get_obj_state: octx=0x7f174c01a710 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x556f9b4b91f8 s->prefetch_data=0 2023-12-03T11:46:32.275 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.273+0000 7f175351e800 20 prepare_atomic_modification: state is not atomic. state=0x556f9b4b91f8 2023-12-03T11:46:32.275 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.273+0000 7f175351e800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.4.2 2023-12-03T11:46:32.276 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.274+0000 7f1732ffd640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_index_versioning 2023-12-03T11:46:32.277 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.276+0000 7f175351e800 20 get_obj_state: octx=0x7f1744057e00 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x556f9b4b91f8 s->prefetch_data=0 2023-12-03T11:46:32.278 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.277+0000 7f175351e800 10 manifest: total_size = 12884 2023-12-03T11:46:32.278 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.277+0000 7f175351e800 20 get_obj_state: setting s->obj_tag to 83aabb46-04b5-4c96-9933-c6bfb1173a73.4653.4628267200141163056 2023-12-03T11:46:32.278 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.277+0000 7f175351e800 20 get_obj_state: octx=0x7f1744057e00 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x556f9b4b91f8 s->prefetch_data=0 2023-12-03T11:46:32.278 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.277+0000 7f175351e800 20 prepare_atomic_modification: state is not atomic. state=0x556f9b4b91f8 2023-12-03T11:46:32.278 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.277+0000 7f175351e800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.4.3 2023-12-03T11:46:32.279 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.277+0000 7f17337fe640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_copy 2023-12-03T11:46:32.280 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.279+0000 7f175351e800 20 get_obj_state: octx=0x556f9b4430e0 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x556f9b4b91f8 s->prefetch_data=0 2023-12-03T11:46:32.281 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.280+0000 7f175351e800 10 manifest: total_size = 7553 2023-12-03T11:46:32.281 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.280+0000 7f175351e800 20 get_obj_state: setting s->obj_tag to 83aabb46-04b5-4c96-9933-c6bfb1173a73.4653.6550242788578500499 2023-12-03T11:46:32.281 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.280+0000 7f175351e800 20 get_obj_state: octx=0x556f9b4430e0 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x556f9b4b91f8 s->prefetch_data=0 2023-12-03T11:46:32.281 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.280+0000 7f175351e800 20 prepare_atomic_modification: state is not atomic. state=0x556f9b4b91f8 2023-12-03T11:46:32.281 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.280+0000 7f175351e800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.4.4 2023-12-03T11:46:32.281 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.280+0000 7f1732ffd640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_defer_update_complete 2023-12-03T11:46:32.283 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.282+0000 7f175351e800 20 get_obj_state: octx=0x7f1744057e00 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x556f9b4b91f8 s->prefetch_data=0 2023-12-03T11:46:32.284 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.283+0000 7f175351e800 10 manifest: total_size = 7449 2023-12-03T11:46:32.284 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.283+0000 7f175351e800 20 get_obj_state: setting s->obj_tag to 83aabb46-04b5-4c96-9933-c6bfb1173a73.4653.11393233385699684570 2023-12-03T11:46:32.284 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.283+0000 7f175351e800 20 get_obj_state: octx=0x7f1744057e00 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x556f9b4b91f8 s->prefetch_data=0 2023-12-03T11:46:32.284 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.283+0000 7f175351e800 20 prepare_atomic_modification: state is not atomic. state=0x556f9b4b91f8 2023-12-03T11:46:32.284 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.283+0000 7f175351e800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.4.4 2023-12-03T11:46:32.285 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.284+0000 7f17337fe640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_defer_complete 2023-12-03T11:46:32.286 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.285+0000 7f175351e800 20 get_obj_state: octx=0x7f174c01a710 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x556f9b4b91f8 s->prefetch_data=0 2023-12-03T11:46:32.287 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.286+0000 7f175351e800 10 manifest: total_size = 4806 2023-12-03T11:46:32.287 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.286+0000 7f175351e800 20 get_obj_state: setting s->obj_tag to 83aabb46-04b5-4c96-9933-c6bfb1173a73.4653.5814677067871085019 2023-12-03T11:46:32.287 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.286+0000 7f175351e800 20 get_obj_state: octx=0x7f174c01a710 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x556f9b4b91f8 s->prefetch_data=0 2023-12-03T11:46:32.287 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.286+0000 7f175351e800 20 prepare_atomic_modification: state is not atomic. state=0x556f9b4b91f8 2023-12-03T11:46:32.287 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.286+0000 7f175351e800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.4.5 2023-12-03T11:46:32.288 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.286+0000 7f1732ffd640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class 2023-12-03T11:46:32.290 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.289+0000 7f175351e800 20 get_obj_state: octx=0x7f1744057e00 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x556f9b4b91f8 s->prefetch_data=0 2023-12-03T11:46:32.291 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.289+0000 7f175351e800 10 manifest: total_size = 5351 2023-12-03T11:46:32.291 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.289+0000 7f175351e800 20 get_obj_state: setting s->obj_tag to 83aabb46-04b5-4c96-9933-c6bfb1173a73.4653.12492097975077189435 2023-12-03T11:46:32.291 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.289+0000 7f175351e800 20 get_obj_state: octx=0x7f1744057e00 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x556f9b4b91f8 s->prefetch_data=0 2023-12-03T11:46:32.291 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.289+0000 7f175351e800 20 prepare_atomic_modification: state is not atomic. state=0x556f9b4b91f8 2023-12-03T11:46:32.291 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.289+0000 7f175351e800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.4.7 2023-12-03T11:46:32.291 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.290+0000 7f17337fe640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_simple 2023-12-03T11:46:32.293 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.291+0000 7f175351e800 20 get_obj_state: octx=0x7f174808ce60 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x556f9b4b91f8 s->prefetch_data=0 2023-12-03T11:46:32.293 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.292+0000 7f175351e800 10 manifest: total_size = 7661 2023-12-03T11:46:32.293 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.292+0000 7f175351e800 20 get_obj_state: setting s->obj_tag to 83aabb46-04b5-4c96-9933-c6bfb1173a73.4653.6881921497649091831 2023-12-03T11:46:32.294 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.292+0000 7f175351e800 20 get_obj_state: octx=0x7f174808ce60 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x556f9b4b91f8 s->prefetch_data=0 2023-12-03T11:46:32.294 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.292+0000 7f175351e800 20 prepare_atomic_modification: state is not atomic. state=0x556f9b4b91f8 2023-12-03T11:46:32.294 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.292+0000 7f175351e800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.4.8 2023-12-03T11:46:32.294 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.293+0000 7f1732ffd640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_multipart 2023-12-03T11:46:32.296 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.295+0000 7f175351e800 20 list_objects_ordered: starting attempt 1 2023-12-03T11:46:32.296 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.295+0000 7f175351e800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2023-12-03T11:46:32.297 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.296+0000 7f17337fe640 20 handle_completion(): completion ok for obj=tests/r_test_small_obj_data 2023-12-03T11:46:32.297 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.296+0000 7f175351e800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2023-12-03T11:46:32.297 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.296+0000 7f175351e800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2023-12-03T11:46:32.298 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.296+0000 7f175351e800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2023-12-03T11:46:32.298 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.296+0000 7f175351e800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2023-12-03T11:46:32.298 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.296+0000 7f175351e800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-conf[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.4])"; uploads.size()=0; is_truncated=0 2023-12-03T11:46:32.300 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.298+0000 7f175351e800 10 cache get: name=default.rgw.meta+root+test-client.0-conf : miss 2023-12-03T11:46:32.300 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.298+0000 7f175351e800 20 rados->read ofs=0 len=0 2023-12-03T11:46:32.300 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.298+0000 7f175351e800 20 rados_obj.operate() r=0 bl.length=204 2023-12-03T11:46:32.300 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.298+0000 7f175351e800 10 cache put: name=default.rgw.meta+root+test-client.0-conf info.flags=0x11 2023-12-03T11:46:32.300 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.298+0000 7f175351e800 10 adding default.rgw.meta+root+test-client.0-conf to cache LRU end 2023-12-03T11:46:32.300 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.298+0000 7f175351e800 10 removing default.rgw.meta+root+test-client.0-conf from cache 2023-12-03T11:46:32.300 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.298+0000 7f175351e800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-conf, ofs0, ns] 2023-12-03T11:46:32.300 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.299+0000 7f17337fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660528 cookie 139738036248576 notifier 6069 bl.length()=162 2023-12-03T11:46:32.302 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.301+0000 7f175351e800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-conf:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.4 from cache 2023-12-03T11:46:32.302 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.301+0000 7f175351e800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-conf:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.4, ofs0, ns] 2023-12-03T11:46:32.303 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.302+0000 7f17337fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660529 cookie 93937834190112 notifier 6069 bl.length()=219 2023-12-03T11:46:32.310 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.307+0000 7f175351e800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-conf/83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.4 : miss 2023-12-03T11:46:32.310 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.307+0000 7f175351e800 20 rados->read ofs=0 len=0 2023-12-03T11:46:32.310 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.308+0000 7f175351e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:46:32.310 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.308+0000 7f175351e800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-conf/83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.4 info.flags=0x0 2023-12-03T11:46:32.310 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.308+0000 7f175351e800 10 adding default.rgw.log++pubsub..bucket.test-client.0-conf/83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.4 to cache LRU end 2023-12-03T11:46:32.310 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.308+0000 7f175351e800 10 removing default.rgw.log++pubsub..bucket.test-client.0-conf/83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.4 from cache 2023-12-03T11:46:32.310 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.308+0000 7f175351e800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.log:pubsub..bucket.test-client.0-conf/83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.4, ofs0, ns] 2023-12-03T11:46:32.310 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.308+0000 7f1732ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660488 cookie 93937834185504 notifier 6069 bl.length()=216 2023-12-03T11:46:32.313 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.312+0000 7f175351e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.11 : miss 2023-12-03T11:46:32.313 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.312+0000 7f175351e800 20 rados->read ofs=0 len=0 2023-12-03T11:46:32.314 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.312+0000 7f175351e800 20 rados_obj.operate() r=0 bl.length=409 2023-12-03T11:46:32.314 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.312+0000 7f175351e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.11 info.flags=0x17 2023-12-03T11:46:32.314 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.312+0000 7f175351e800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.11 to cache LRU end 2023-12-03T11:46:32.314 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.312+0000 7f175351e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:46:32.314 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.312+0000 7f175351e800 10 updating xattr: name=user.rgw.acl bl.length()=209 2023-12-03T11:46:32.314 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.312+0000 7f175351e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.11 2023-12-03T11:46:32.317 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.316+0000 7f175351e800 10 cls_bucket_list_unordered: got foo 2023-12-03T11:46:32.318 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.316+0000 7f175351e800 20 get_obj_state: octx=0x7f174804fe40 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x556f9b4417a8 s->prefetch_data=0 2023-12-03T11:46:32.318 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.316+0000 7f175351e800 10 manifest: total_size = 26078 2023-12-03T11:46:32.318 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.316+0000 7f175351e800 20 get_obj_state: setting s->obj_tag to 83aabb46-04b5-4c96-9933-c6bfb1173a73.4653.6330433953757923101 2023-12-03T11:46:32.318 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.316+0000 7f175351e800 20 get_obj_state: octx=0x7f174804fe40 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x556f9b4417a8 s->prefetch_data=0 2023-12-03T11:46:32.318 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.316+0000 7f175351e800 20 prepare_atomic_modification: state is not atomic. state=0x556f9b4417a8 2023-12-03T11:46:32.318 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.316+0000 7f175351e800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.11.10 2023-12-03T11:46:32.320 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.319+0000 7f175351e800 20 RGWObjManifest::operator++(): rule->part_size=7672 rules.size()=4 2023-12-03T11:46:32.320 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.319+0000 7f175351e800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=7672 2023-12-03T11:46:32.320 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.319+0000 7f175351e800 20 RGWObjManifest::operator++(): result: ofs=7672 stripe_ofs=7672 part_ofs=7672 rule->part_size=7670 2023-12-03T11:46:32.321 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.319+0000 7f175351e800 20 RGWObjManifest::operator++(): rule->part_size=7670 rules.size()=4 2023-12-03T11:46:32.321 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.319+0000 7f175351e800 20 RGWObjManifest::operator++(): stripe_ofs=6299128 part_ofs=7672 rule->part_size=7670 2023-12-03T11:46:32.321 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.319+0000 7f175351e800 20 RGWObjManifest::operator++(): result: ofs=15342 stripe_ofs=15342 part_ofs=15342 rule->part_size=7669 2023-12-03T11:46:32.321 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.319+0000 7f175351e800 20 RGWObjManifest::operator++(): rule->part_size=7669 rules.size()=4 2023-12-03T11:46:32.321 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.319+0000 7f175351e800 20 RGWObjManifest::operator++(): stripe_ofs=6306798 part_ofs=15342 rule->part_size=7669 2023-12-03T11:46:32.321 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.319+0000 7f175351e800 20 RGWObjManifest::operator++(): result: ofs=23011 stripe_ofs=23011 part_ofs=23011 rule->part_size=3067 2023-12-03T11:46:32.321 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.319+0000 7f175351e800 20 RGWObjManifest::operator++(): rule->part_size=3067 rules.size()=4 2023-12-03T11:46:32.321 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.319+0000 7f175351e800 20 RGWObjManifest::operator++(): stripe_ofs=6314467 part_ofs=23011 rule->part_size=3067 2023-12-03T11:46:32.321 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.319+0000 7f175351e800 20 RGWObjManifest::operator++(): result: ofs=26078 stripe_ofs=26078 part_ofs=26078 rule->part_size=3067 2023-12-03T11:46:32.321 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.319+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - tag is: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4653.6330433953757923101 2023-12-03T11:46:32.321 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.319+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-12-03T11:46:32.321 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.319+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.11__multipart_foo.2~qkA7ZYfxuexf4tghDkAqIXQJJhybeS-.1 2023-12-03T11:46:32.321 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.319+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 346 2023-12-03T11:46:32.321 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.319+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.11__multipart_foo.2~qkA7ZYfxuexf4tghDkAqIXQJJhybeS-.2 2023-12-03T11:46:32.321 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.319+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 592 2023-12-03T11:46:32.322 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.319+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.11__multipart_foo.2~qkA7ZYfxuexf4tghDkAqIXQJJhybeS-.3 2023-12-03T11:46:32.322 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.319+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 838 2023-12-03T11:46:32.322 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.319+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.11__multipart_foo.2~qkA7ZYfxuexf4tghDkAqIXQJJhybeS-.4 2023-12-03T11:46:32.322 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.319+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1084 2023-12-03T11:46:32.322 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.319+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-12-03T11:46:32.322 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.319+0000 7f175351e800 20 garbage collection: RGWGC::send_chain - on object name: gc.22tag is: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4653.6330433953757923101 2023-12-03T11:46:32.323 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.322+0000 7f1732ffd640 20 handle_completion(): completion ok for obj=foo 2023-12-03T11:46:32.323 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.322+0000 7f175351e800 20 list_objects_ordered: starting attempt 1 2023-12-03T11:46:32.323 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.322+0000 7f175351e800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2023-12-03T11:46:32.324 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.323+0000 7f175351e800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2023-12-03T11:46:32.324 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.323+0000 7f175351e800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2023-12-03T11:46:32.324 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.323+0000 7f175351e800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2023-12-03T11:46:32.324 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.323+0000 7f175351e800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2023-12-03T11:46:32.324 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.323+0000 7f175351e800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-complete.1[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.11])"; uploads.size()=0; is_truncated=0 2023-12-03T11:46:32.326 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.325+0000 7f175351e800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 : miss 2023-12-03T11:46:32.326 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.325+0000 7f175351e800 20 rados->read ofs=0 len=0 2023-12-03T11:46:32.326 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.325+0000 7f175351e800 20 rados_obj.operate() r=0 bl.length=235 2023-12-03T11:46:32.326 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.325+0000 7f175351e800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 info.flags=0x11 2023-12-03T11:46:32.326 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.325+0000 7f175351e800 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 to cache LRU end 2023-12-03T11:46:32.326 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.325+0000 7f175351e800 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 from cache 2023-12-03T11:46:32.326 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.325+0000 7f175351e800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-defer-complete.1, ofs0, ns] 2023-12-03T11:46:32.327 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.325+0000 7f17337fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660536 cookie 93937831694160 notifier 6069 bl.length()=191 2023-12-03T11:46:32.329 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.328+0000 7f175351e800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.11 from cache 2023-12-03T11:46:32.329 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.328+0000 7f175351e800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.11, ofs0, ns] 2023-12-03T11:46:32.330 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.328+0000 7f1732ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660551 cookie 93937834199328 notifier 6069 bl.length()=249 2023-12-03T11:46:32.335 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.333+0000 7f175351e800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.11 : miss 2023-12-03T11:46:32.335 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.333+0000 7f175351e800 20 rados->read ofs=0 len=0 2023-12-03T11:46:32.335 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.333+0000 7f175351e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:46:32.335 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.333+0000 7f175351e800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.11 info.flags=0x0 2023-12-03T11:46:32.335 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.333+0000 7f175351e800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.11 to cache LRU end 2023-12-03T11:46:32.335 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.333+0000 7f175351e800 10 removing default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.11 from cache 2023-12-03T11:46:32.336 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.333+0000 7f175351e800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.log:pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.11, ofs0, ns] 2023-12-03T11:46:32.336 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.334+0000 7f1732ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660489 cookie 93937834185504 notifier 6069 bl.length()=246 2023-12-03T11:46:32.338 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.337+0000 7f175351e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.12 : miss 2023-12-03T11:46:32.338 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.337+0000 7f175351e800 20 rados->read ofs=0 len=0 2023-12-03T11:46:32.339 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.337+0000 7f175351e800 20 rados_obj.operate() r=0 bl.length=416 2023-12-03T11:46:32.339 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.337+0000 7f175351e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.12 info.flags=0x17 2023-12-03T11:46:32.339 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.337+0000 7f175351e800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.12 to cache LRU end 2023-12-03T11:46:32.339 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.337+0000 7f175351e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:46:32.339 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.337+0000 7f175351e800 10 updating xattr: name=user.rgw.acl bl.length()=209 2023-12-03T11:46:32.339 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.337+0000 7f175351e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.12 2023-12-03T11:46:32.343 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.341+0000 7f175351e800 10 cls_bucket_list_unordered: got foo 2023-12-03T11:46:32.343 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.341+0000 7f175351e800 20 get_obj_state: octx=0x556f9b43b300 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x556f9b43a448 s->prefetch_data=0 2023-12-03T11:46:32.343 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.342+0000 7f175351e800 10 manifest: total_size = 886297 2023-12-03T11:46:32.343 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.342+0000 7f175351e800 20 get_obj_state: setting s->obj_tag to 83aabb46-04b5-4c96-9933-c6bfb1173a73.4653.17268635285228956561 2023-12-03T11:46:32.343 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.342+0000 7f175351e800 20 get_obj_state: octx=0x556f9b43b300 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x556f9b43a448 s->prefetch_data=0 2023-12-03T11:46:32.344 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.342+0000 7f175351e800 20 prepare_atomic_modification: state is not atomic. state=0x556f9b43a448 2023-12-03T11:46:32.344 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.342+0000 7f175351e800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.12.10 2023-12-03T11:46:32.345 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.344+0000 7f175351e800 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2023-12-03T11:46:32.345 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.344+0000 7f175351e800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=246247 2023-12-03T11:46:32.346 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.344+0000 7f175351e800 20 RGWObjManifest::operator++(): result: ofs=246247 stripe_ofs=246247 part_ofs=246247 rule->part_size=246247 2023-12-03T11:46:32.346 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.344+0000 7f175351e800 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2023-12-03T11:46:32.346 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.344+0000 7f175351e800 20 RGWObjManifest::operator++(): stripe_ofs=6537703 part_ofs=246247 rule->part_size=246247 2023-12-03T11:46:32.346 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.344+0000 7f175351e800 20 RGWObjManifest::operator++(): result: ofs=492494 stripe_ofs=492494 part_ofs=492494 rule->part_size=246247 2023-12-03T11:46:32.346 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.344+0000 7f175351e800 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2023-12-03T11:46:32.346 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.344+0000 7f175351e800 20 RGWObjManifest::operator++(): stripe_ofs=6783950 part_ofs=492494 rule->part_size=246247 2023-12-03T11:46:32.346 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.344+0000 7f175351e800 20 RGWObjManifest::operator++(): result: ofs=738741 stripe_ofs=738741 part_ofs=738741 rule->part_size=147556 2023-12-03T11:46:32.346 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.344+0000 7f175351e800 20 RGWObjManifest::operator++(): rule->part_size=147556 rules.size()=2 2023-12-03T11:46:32.346 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.344+0000 7f175351e800 20 RGWObjManifest::operator++(): stripe_ofs=7030197 part_ofs=738741 rule->part_size=147556 2023-12-03T11:46:32.346 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.344+0000 7f175351e800 20 RGWObjManifest::operator++(): result: ofs=886297 stripe_ofs=886297 part_ofs=886297 rule->part_size=147556 2023-12-03T11:46:32.346 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.344+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - tag is: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4653.17268635285228956561 2023-12-03T11:46:32.346 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.344+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-12-03T11:46:32.346 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.344+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.12__multipart_foo.2~nlK--PqpLNd0NMA58-FcbLIIj1h6WMl.1 2023-12-03T11:46:32.347 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.344+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 347 2023-12-03T11:46:32.347 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.344+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.12__multipart_foo.2~nlK--PqpLNd0NMA58-FcbLIIj1h6WMl.2 2023-12-03T11:46:32.347 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.344+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 593 2023-12-03T11:46:32.347 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.344+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.12__multipart_foo.2~nlK--PqpLNd0NMA58-FcbLIIj1h6WMl.3 2023-12-03T11:46:32.347 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.344+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 839 2023-12-03T11:46:32.347 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.344+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.12__multipart_foo.2~nlK--PqpLNd0NMA58-FcbLIIj1h6WMl.4 2023-12-03T11:46:32.347 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.344+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1085 2023-12-03T11:46:32.347 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.344+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-12-03T11:46:32.347 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.344+0000 7f175351e800 20 garbage collection: RGWGC::send_chain - on object name: gc.20tag is: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4653.17268635285228956561 2023-12-03T11:46:32.348 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.345+0000 7f17337fe640 20 handle_completion(): completion ok for obj=foo 2023-12-03T11:46:32.348 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.346+0000 7f175351e800 20 list_objects_ordered: starting attempt 1 2023-12-03T11:46:32.348 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.346+0000 7f175351e800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2023-12-03T11:46:32.348 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.346+0000 7f175351e800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2023-12-03T11:46:32.348 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.346+0000 7f175351e800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2023-12-03T11:46:32.348 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.346+0000 7f175351e800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2023-12-03T11:46:32.349 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.346+0000 7f175351e800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2023-12-03T11:46:32.349 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.346+0000 7f175351e800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-update-complete.1[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.12])"; uploads.size()=0; is_truncated=0 2023-12-03T11:46:32.349 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.348+0000 7f175351e800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 : miss 2023-12-03T11:46:32.349 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.348+0000 7f175351e800 20 rados->read ofs=0 len=0 2023-12-03T11:46:32.350 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.348+0000 7f175351e800 20 rados_obj.operate() r=0 bl.length=242 2023-12-03T11:46:32.350 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.348+0000 7f175351e800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 info.flags=0x11 2023-12-03T11:46:32.350 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.348+0000 7f175351e800 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 to cache LRU end 2023-12-03T11:46:32.350 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.348+0000 7f175351e800 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 from cache 2023-12-03T11:46:32.351 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.348+0000 7f175351e800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-defer-update-complete.1, ofs0, ns] 2023-12-03T11:46:32.351 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.349+0000 7f1732ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660495 cookie 93937834184464 notifier 6069 bl.length()=198 2023-12-03T11:46:32.353 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.352+0000 7f175351e800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.12 from cache 2023-12-03T11:46:32.354 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.352+0000 7f175351e800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.12, ofs0, ns] 2023-12-03T11:46:32.354 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.352+0000 7f17337fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660490 cookie 93937834185504 notifier 6069 bl.length()=256 2023-12-03T11:46:32.358 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.357+0000 7f175351e800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.12 : miss 2023-12-03T11:46:32.358 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.357+0000 7f175351e800 20 rados->read ofs=0 len=0 2023-12-03T11:46:32.358 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.357+0000 7f175351e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:46:32.359 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.357+0000 7f175351e800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.12 info.flags=0x0 2023-12-03T11:46:32.359 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.357+0000 7f175351e800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.12 to cache LRU end 2023-12-03T11:46:32.359 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.357+0000 7f175351e800 10 removing default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.12 from cache 2023-12-03T11:46:32.359 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.357+0000 7f175351e800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.log:pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.12, ofs0, ns] 2023-12-03T11:46:32.359 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.357+0000 7f17337fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660530 cookie 139738036248576 notifier 6069 bl.length()=253 2023-12-03T11:46:32.362 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.361+0000 7f175351e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.10 : miss 2023-12-03T11:46:32.362 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.361+0000 7f175351e800 20 rados->read ofs=0 len=0 2023-12-03T11:46:32.363 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.362+0000 7f175351e800 20 rados_obj.operate() r=0 bl.length=411 2023-12-03T11:46:32.363 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.362+0000 7f175351e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.10 info.flags=0x17 2023-12-03T11:46:32.363 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.362+0000 7f175351e800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.10 to cache LRU end 2023-12-03T11:46:32.363 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.362+0000 7f175351e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:46:32.364 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.362+0000 7f175351e800 10 updating xattr: name=user.rgw.acl bl.length()=209 2023-12-03T11:46:32.364 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.362+0000 7f175351e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.10 2023-12-03T11:46:32.367 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.366+0000 7f175351e800 10 cls_bucket_list_unordered: got foo[tG1X29-i3SOIsNP2cX9TRVyNX1cXcaf] 2023-12-03T11:46:32.368 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.366+0000 7f175351e800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.10.10 2023-12-03T11:46:32.368 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.366+0000 7f175351e800 20 get_obj_state: octx=0x556f9b4baa60 obj=test-client.0-r-test-multipart-index-versioning.1:foo state=0x556f9b44eb08 s->prefetch_data=0 2023-12-03T11:46:32.368 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.367+0000 7f175351e800 20 get_obj_state: setting s->obj_tag to sy4wsh5s7g79lfxhut3gmdgnh0fgvl62 2023-12-03T11:46:32.368 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.367+0000 7f175351e800 20 get_obj_state_impl: setting s->olh_tag to al0sm5dyxfhma9eqst2r56fbwo4qihn3 2023-12-03T11:46:32.368 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.367+0000 7f175351e800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=al0sm5dyxfhma9eqst2r56fbwo4qihn3 2023-12-03T11:46:32.370 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.368+0000 7f175351e800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.10.10 2023-12-03T11:46:32.371 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.369+0000 7f175351e800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.10.10 2023-12-03T11:46:32.371 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.370+0000 7f175351e800 20 olh_log_entry: epoch=3 op=2 key=foo[] 2023-12-03T11:46:32.371 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.370+0000 7f175351e800 20 olh_log_entry: epoch=3 op=3 key=foo[tG1X29-i3SOIsNP2cX9TRVyNX1cXcaf] 2023-12-03T11:46:32.372 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.370+0000 7f175351e800 20 get_obj_state: octx=0x556f9b4baa60 obj=test-client.0-r-test-multipart-index-versioning.1:_:tG1X29-i3SOIsNP2cX9TRVyNX1cXcaf_foo state=0x556f9b457e58 s->prefetch_data=0 2023-12-03T11:46:32.372 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.370+0000 7f175351e800 10 manifest: total_size = 74198 2023-12-03T11:46:32.372 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.370+0000 7f175351e800 20 get_obj_state: setting s->obj_tag to 83aabb46-04b5-4c96-9933-c6bfb1173a73.4653.11781301567546197555 2023-12-03T11:46:32.372 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.370+0000 7f175351e800 20 get_obj_state: octx=0x556f9b4baa60 obj=test-client.0-r-test-multipart-index-versioning.1:_:tG1X29-i3SOIsNP2cX9TRVyNX1cXcaf_foo state=0x556f9b457e58 s->prefetch_data=0 2023-12-03T11:46:32.372 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.370+0000 7f175351e800 20 prepare_atomic_modification: state is not atomic. state=0x556f9b457e58 2023-12-03T11:46:32.372 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.370+0000 7f175351e800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.10.10 2023-12-03T11:46:32.374 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.372+0000 7f175351e800 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2023-12-03T11:46:32.374 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.372+0000 7f175351e800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=20613 2023-12-03T11:46:32.374 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.372+0000 7f175351e800 20 RGWObjManifest::operator++(): result: ofs=20613 stripe_ofs=20613 part_ofs=20613 rule->part_size=20613 2023-12-03T11:46:32.374 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.372+0000 7f175351e800 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2023-12-03T11:46:32.374 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.372+0000 7f175351e800 20 RGWObjManifest::operator++(): stripe_ofs=6312069 part_ofs=20613 rule->part_size=20613 2023-12-03T11:46:32.374 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.372+0000 7f175351e800 20 RGWObjManifest::operator++(): result: ofs=41226 stripe_ofs=41226 part_ofs=41226 rule->part_size=20613 2023-12-03T11:46:32.374 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.372+0000 7f175351e800 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2023-12-03T11:46:32.375 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.372+0000 7f175351e800 20 RGWObjManifest::operator++(): stripe_ofs=6332682 part_ofs=41226 rule->part_size=20613 2023-12-03T11:46:32.375 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.372+0000 7f175351e800 20 RGWObjManifest::operator++(): result: ofs=61839 stripe_ofs=61839 part_ofs=61839 rule->part_size=12359 2023-12-03T11:46:32.375 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.372+0000 7f175351e800 20 RGWObjManifest::operator++(): rule->part_size=12359 rules.size()=2 2023-12-03T11:46:32.375 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.372+0000 7f175351e800 20 RGWObjManifest::operator++(): stripe_ofs=6353295 part_ofs=61839 rule->part_size=12359 2023-12-03T11:46:32.375 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.372+0000 7f175351e800 20 RGWObjManifest::operator++(): result: ofs=74198 stripe_ofs=74198 part_ofs=74198 rule->part_size=12359 2023-12-03T11:46:32.375 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.372+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - tag is: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4653.11781301567546197555 2023-12-03T11:46:32.375 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.372+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-12-03T11:46:32.375 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.372+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.10__multipart_foo.2~T1VF383YWvBksFoytEV8A3pXaA-SYRt.1 2023-12-03T11:46:32.375 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.372+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 347 2023-12-03T11:46:32.375 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.372+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.10__multipart_foo.2~T1VF383YWvBksFoytEV8A3pXaA-SYRt.2 2023-12-03T11:46:32.375 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.372+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 593 2023-12-03T11:46:32.375 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.372+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.10__multipart_foo.2~T1VF383YWvBksFoytEV8A3pXaA-SYRt.3 2023-12-03T11:46:32.375 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.372+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 839 2023-12-03T11:46:32.375 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.372+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.10__multipart_foo.2~T1VF383YWvBksFoytEV8A3pXaA-SYRt.4 2023-12-03T11:46:32.376 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.372+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1085 2023-12-03T11:46:32.376 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.372+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-12-03T11:46:32.376 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.372+0000 7f175351e800 20 garbage collection: RGWGC::send_chain - on object name: gc.25tag is: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4653.11781301567546197555 2023-12-03T11:46:32.376 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.373+0000 7f1732ffd640 20 handle_completion(): completion ok for obj=foo[tG1X29-i3SOIsNP2cX9TRVyNX1cXcaf] 2023-12-03T11:46:32.376 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.375+0000 7f175351e800 20 get_obj_state: octx=0x556f9b4baa60 obj=test-client.0-r-test-multipart-index-versioning.1:foo state=0x556f9b44eb08 s->prefetch_data=0 2023-12-03T11:46:32.377 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.376+0000 7f175351e800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.10.10 2023-12-03T11:46:32.380 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.377+0000 7f175351e800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.10.10 2023-12-03T11:46:32.380 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.377+0000 7f175351e800 20 list_objects_ordered: starting attempt 1 2023-12-03T11:46:32.380 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.377+0000 7f175351e800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2023-12-03T11:46:32.380 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.378+0000 7f175351e800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2023-12-03T11:46:32.380 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.378+0000 7f175351e800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2023-12-03T11:46:32.380 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.378+0000 7f175351e800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2023-12-03T11:46:32.380 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.378+0000 7f175351e800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2023-12-03T11:46:32.380 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.378+0000 7f175351e800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-index-versioning.1[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.10])"; uploads.size()=0; is_truncated=0 2023-12-03T11:46:32.381 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.380+0000 7f175351e800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 : miss 2023-12-03T11:46:32.381 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.380+0000 7f175351e800 20 rados->read ofs=0 len=0 2023-12-03T11:46:32.381 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.380+0000 7f175351e800 20 rados_obj.operate() r=0 bl.length=237 2023-12-03T11:46:32.381 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.380+0000 7f175351e800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 info.flags=0x11 2023-12-03T11:46:32.381 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.380+0000 7f175351e800 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 to cache LRU end 2023-12-03T11:46:32.381 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.380+0000 7f175351e800 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 from cache 2023-12-03T11:46:32.381 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.380+0000 7f175351e800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-index-versioning.1, ofs0, ns] 2023-12-03T11:46:32.382 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.381+0000 7f1732ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660496 cookie 93937834184464 notifier 6069 bl.length()=193 2023-12-03T11:46:32.384 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.383+0000 7f175351e800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.10 from cache 2023-12-03T11:46:32.385 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.383+0000 7f175351e800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.10, ofs0, ns] 2023-12-03T11:46:32.385 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.383+0000 7f1732ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660537 cookie 93937831694160 notifier 6069 bl.length()=251 2023-12-03T11:46:32.391 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.390+0000 7f175351e800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.10 : miss 2023-12-03T11:46:32.392 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.390+0000 7f175351e800 20 rados->read ofs=0 len=0 2023-12-03T11:46:32.392 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.390+0000 7f175351e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:46:32.392 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.390+0000 7f175351e800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.10 info.flags=0x0 2023-12-03T11:46:32.392 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.390+0000 7f175351e800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.10 to cache LRU end 2023-12-03T11:46:32.392 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.390+0000 7f175351e800 10 removing default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.10 from cache 2023-12-03T11:46:32.392 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.390+0000 7f175351e800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.log:pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.10, ofs0, ns] 2023-12-03T11:46:32.392 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.390+0000 7f17337fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660552 cookie 93937834199328 notifier 6069 bl.length()=248 2023-12-03T11:46:32.394 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.393+0000 7f175351e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.9 : miss 2023-12-03T11:46:32.394 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.393+0000 7f175351e800 20 rados->read ofs=0 len=0 2023-12-03T11:46:32.395 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.394+0000 7f175351e800 20 rados_obj.operate() r=0 bl.length=399 2023-12-03T11:46:32.395 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.394+0000 7f175351e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.9 info.flags=0x17 2023-12-03T11:46:32.396 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.394+0000 7f175351e800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.9 to cache LRU end 2023-12-03T11:46:32.396 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.394+0000 7f175351e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:46:32.396 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.394+0000 7f175351e800 10 updating xattr: name=user.rgw.acl bl.length()=209 2023-12-03T11:46:32.396 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.394+0000 7f175351e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.9 2023-12-03T11:46:32.400 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.398+0000 7f175351e800 10 cls_bucket_list_unordered: got foo 2023-12-03T11:46:32.400 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.398+0000 7f175351e800 20 get_obj_state: octx=0x556f9b43d3c0 obj=test-client.0-r-test-multipart-simple.1:foo state=0x556f9b2e5a08 s->prefetch_data=0 2023-12-03T11:46:32.400 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.399+0000 7f175351e800 10 manifest: total_size = 18874368 2023-12-03T11:46:32.401 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.399+0000 7f175351e800 20 get_obj_state: setting s->obj_tag to 83aabb46-04b5-4c96-9933-c6bfb1173a73.4653.15240308958836163988 2023-12-03T11:46:32.401 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.399+0000 7f175351e800 20 get_obj_state: octx=0x556f9b43d3c0 obj=test-client.0-r-test-multipart-simple.1:foo state=0x556f9b2e5a08 s->prefetch_data=0 2023-12-03T11:46:32.401 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.399+0000 7f175351e800 20 prepare_atomic_modification: state is not atomic. state=0x556f9b2e5a08 2023-12-03T11:46:32.401 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.399+0000 7f175351e800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.9.10 2023-12-03T11:46:32.402 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.401+0000 7f175351e800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2023-12-03T11:46:32.403 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.401+0000 7f175351e800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2023-12-03T11:46:32.403 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.401+0000 7f175351e800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2023-12-03T11:46:32.403 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.401+0000 7f175351e800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2023-12-03T11:46:32.403 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.401+0000 7f175351e800 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2023-12-03T11:46:32.403 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.401+0000 7f175351e800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=5242880 2023-12-03T11:46:32.403 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.401+0000 7f175351e800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2023-12-03T11:46:32.403 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.401+0000 7f175351e800 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=5242880 2023-12-03T11:46:32.403 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.401+0000 7f175351e800 20 RGWObjManifest::operator++(): result: ofs=15728640 stripe_ofs=15728640 part_ofs=15728640 rule->part_size=3145728 2023-12-03T11:46:32.403 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.401+0000 7f175351e800 20 RGWObjManifest::operator++(): rule->part_size=3145728 rules.size()=2 2023-12-03T11:46:32.403 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.401+0000 7f175351e800 20 RGWObjManifest::operator++(): stripe_ofs=22020096 part_ofs=15728640 rule->part_size=3145728 2023-12-03T11:46:32.403 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.401+0000 7f175351e800 20 RGWObjManifest::operator++(): result: ofs=18874368 stripe_ofs=18874368 part_ofs=18874368 rule->part_size=3145728 2023-12-03T11:46:32.404 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.401+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - tag is: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4653.15240308958836163988 2023-12-03T11:46:32.404 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.401+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-12-03T11:46:32.404 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.401+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.9__multipart_foo.2~7rzTQBaOhtghlRd7cKB1m_lvWefNEyu.1 2023-12-03T11:46:32.404 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.401+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 345 2023-12-03T11:46:32.404 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.401+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.9__multipart_foo.2~7rzTQBaOhtghlRd7cKB1m_lvWefNEyu.2 2023-12-03T11:46:32.404 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.401+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 589 2023-12-03T11:46:32.404 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.401+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.9__multipart_foo.2~7rzTQBaOhtghlRd7cKB1m_lvWefNEyu.3 2023-12-03T11:46:32.404 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.401+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 833 2023-12-03T11:46:32.404 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.401+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.9__multipart_foo.2~7rzTQBaOhtghlRd7cKB1m_lvWefNEyu.4 2023-12-03T11:46:32.404 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.401+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1077 2023-12-03T11:46:32.404 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.401+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-12-03T11:46:32.405 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.401+0000 7f175351e800 20 garbage collection: RGWGC::send_chain - on object name: gc.16tag is: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4653.15240308958836163988 2023-12-03T11:46:32.405 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.403+0000 7f175351e800 20 list_objects_ordered: starting attempt 1 2023-12-03T11:46:32.405 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.403+0000 7f175351e800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2023-12-03T11:46:32.405 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.404+0000 7f17337fe640 20 handle_completion(): completion ok for obj=foo 2023-12-03T11:46:32.405 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.404+0000 7f175351e800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2023-12-03T11:46:32.406 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.404+0000 7f175351e800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2023-12-03T11:46:32.406 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.404+0000 7f175351e800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2023-12-03T11:46:32.406 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.404+0000 7f175351e800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2023-12-03T11:46:32.406 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.404+0000 7f175351e800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-simple.1[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.9])"; uploads.size()=0; is_truncated=0 2023-12-03T11:46:32.407 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.406+0000 7f175351e800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 : miss 2023-12-03T11:46:32.407 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.406+0000 7f175351e800 20 rados->read ofs=0 len=0 2023-12-03T11:46:32.408 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.406+0000 7f175351e800 20 rados_obj.operate() r=0 bl.length=225 2023-12-03T11:46:32.408 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.406+0000 7f175351e800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 info.flags=0x11 2023-12-03T11:46:32.408 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.406+0000 7f175351e800 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 to cache LRU end 2023-12-03T11:46:32.408 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.406+0000 7f175351e800 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 from cache 2023-12-03T11:46:32.408 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.406+0000 7f175351e800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-simple.1, ofs0, ns] 2023-12-03T11:46:32.408 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.406+0000 7f1732ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660531 cookie 93937834190112 notifier 6069 bl.length()=183 2023-12-03T11:46:32.410 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.409+0000 7f175351e800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.9 from cache 2023-12-03T11:46:32.410 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.409+0000 7f175351e800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-simple.1:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.9, ofs0, ns] 2023-12-03T11:46:32.411 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.409+0000 7f1732ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660497 cookie 93937834184464 notifier 6069 bl.length()=240 2023-12-03T11:46:32.415 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.414+0000 7f175351e800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.9 : miss 2023-12-03T11:46:32.416 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.414+0000 7f175351e800 20 rados->read ofs=0 len=0 2023-12-03T11:46:32.416 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.414+0000 7f175351e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:46:32.416 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.414+0000 7f175351e800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.9 info.flags=0x0 2023-12-03T11:46:32.416 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.414+0000 7f175351e800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.9 to cache LRU end 2023-12-03T11:46:32.416 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.414+0000 7f175351e800 10 removing default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.9 from cache 2023-12-03T11:46:32.416 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.414+0000 7f175351e800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.log:pubsub..bucket.test-client.0-r-test-multipart-simple.1/83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.9, ofs0, ns] 2023-12-03T11:46:32.416 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.415+0000 7f17337fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660538 cookie 93937831694160 notifier 6069 bl.length()=237 2023-12-03T11:46:32.419 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.418+0000 7f175351e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.15 : miss 2023-12-03T11:46:32.419 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.418+0000 7f175351e800 20 rados->read ofs=0 len=0 2023-12-03T11:46:32.420 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.419+0000 7f175351e800 20 rados_obj.operate() r=0 bl.length=407 2023-12-03T11:46:32.420 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.419+0000 7f175351e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.15 info.flags=0x17 2023-12-03T11:46:32.420 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.419+0000 7f175351e800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.15 to cache LRU end 2023-12-03T11:46:32.420 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.419+0000 7f175351e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:46:32.420 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.419+0000 7f175351e800 10 updating xattr: name=user.rgw.acl bl.length()=209 2023-12-03T11:46:32.420 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.419+0000 7f175351e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.15 2023-12-03T11:46:32.420 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.419+0000 7f175351e800 10 cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM 2023-12-03T11:46:32.421 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.420+0000 7f175351e800 10 cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD 2023-12-03T11:46:32.421 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.420+0000 7f175351e800 10 cls_bucket_list_unordered: got foo-FROZEN 2023-12-03T11:46:32.422 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.421+0000 7f175351e800 10 cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM 2023-12-03T11:46:32.422 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.421+0000 7f175351e800 10 cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN 2023-12-03T11:46:32.422 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.421+0000 7f175351e800 10 cls_bucket_list_unordered: got foo-STANDARD 2023-12-03T11:46:32.423 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.422+0000 7f175351e800 10 cls_bucket_list_unordered: got foo-FROZEN-STANDARD 2023-12-03T11:46:32.423 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.422+0000 7f175351e800 10 cls_bucket_list_unordered: got foo-LUKEWARM 2023-12-03T11:46:32.423 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.422+0000 7f175351e800 10 cls_bucket_list_unordered: got foo-STANDARD-STANDARD 2023-12-03T11:46:32.424 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.423+0000 7f175351e800 10 cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM 2023-12-03T11:46:32.424 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.423+0000 7f175351e800 10 cls_bucket_list_unordered: got foo-STANDARD-FROZEN 2023-12-03T11:46:32.424 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.423+0000 7f175351e800 10 cls_bucket_list_unordered: got foo-FROZEN-FROZEN 2023-12-03T11:46:32.425 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.424+0000 7f175351e800 20 get_obj_state: octx=0x7f174c032ba0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x556f9b448bb8 s->prefetch_data=0 2023-12-03T11:46:32.425 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.424+0000 7f175351e800 10 manifest: total_size = 27196 2023-12-03T11:46:32.425 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.424+0000 7f175351e800 20 get_obj_state: setting s->obj_tag to _m6AtA0gPXXzrczVkBGfY2tS3jG2TSeD 2023-12-03T11:46:32.425 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.424+0000 7f175351e800 20 get_obj_state: octx=0x7f174c032ba0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x556f9b448bb8 s->prefetch_data=0 2023-12-03T11:46:32.425 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.424+0000 7f175351e800 20 prepare_atomic_modification: state is not atomic. state=0x556f9b448bb8 2023-12-03T11:46:32.425 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.424+0000 7f175351e800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.15.0 2023-12-03T11:46:32.428 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.426+0000 7f175351e800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-12-03T11:46:32.428 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.426+0000 7f175351e800 20 RGWObjManifest::operator++(): result: ofs=27196 stripe_ofs=27196 part_ofs=0 rule->part_size=0 2023-12-03T11:46:32.428 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.426+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - tag is: _m6AtA0gPXXzrczVkBGfY2tS3jG2TSeD 2023-12-03T11:46:32.428 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.426+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-12-03T11:46:32.428 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.426+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.15__shadow_.lQ6eXKE7ecAN9NQibyzAxLa62XAr7aI_0 2023-12-03T11:46:32.428 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.426+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2023-12-03T11:46:32.428 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.426+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-12-03T11:46:32.428 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.426+0000 7f175351e800 20 garbage collection: RGWGC::send_chain - on object name: gc.25tag is: _m6AtA0gPXXzrczVkBGfY2tS3jG2TSeD 2023-12-03T11:46:32.429 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.428+0000 7f1732ffd640 20 handle_completion(): completion ok for obj=foo-STANDARD-LUKEWARM 2023-12-03T11:46:32.429 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.428+0000 7f175351e800 20 get_obj_state: octx=0x7f174c01d260 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x556f9b448bb8 s->prefetch_data=0 2023-12-03T11:46:32.430 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.428+0000 7f175351e800 10 manifest: total_size = 5242880 2023-12-03T11:46:32.430 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.428+0000 7f175351e800 20 get_obj_state: setting s->obj_tag to __g-KcSc18YYgk86go9OtdJIdNMNcock 2023-12-03T11:46:32.430 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.428+0000 7f175351e800 20 get_obj_state: octx=0x7f174c01d260 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x556f9b448bb8 s->prefetch_data=0 2023-12-03T11:46:32.430 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.428+0000 7f175351e800 20 prepare_atomic_modification: state is not atomic. state=0x556f9b448bb8 2023-12-03T11:46:32.430 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.428+0000 7f175351e800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.15.2 2023-12-03T11:46:32.432 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.431+0000 7f175351e800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-12-03T11:46:32.432 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.431+0000 7f175351e800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2023-12-03T11:46:32.432 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.431+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - tag is: __g-KcSc18YYgk86go9OtdJIdNMNcock 2023-12-03T11:46:32.432 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.431+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-12-03T11:46:32.432 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.431+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.15__shadow_.31fDp1Ykjr_lpatxJakGMfhtx4TG67e_1 2023-12-03T11:46:32.432 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.431+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2023-12-03T11:46:32.432 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.431+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-12-03T11:46:32.432 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.431+0000 7f175351e800 20 garbage collection: RGWGC::send_chain - on object name: gc.19tag is: __g-KcSc18YYgk86go9OtdJIdNMNcock 2023-12-03T11:46:32.433 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.432+0000 7f17337fe640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-STANDARD 2023-12-03T11:46:32.433 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.432+0000 7f175351e800 20 get_obj_state: octx=0x7f174c032ba0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x556f9b448bb8 s->prefetch_data=0 2023-12-03T11:46:32.434 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.433+0000 7f175351e800 10 manifest: total_size = 5242880 2023-12-03T11:46:32.434 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.433+0000 7f175351e800 20 get_obj_state: setting s->obj_tag to 83aabb46-04b5-4c96-9933-c6bfb1173a73.4653.6909795222448070732 2023-12-03T11:46:32.434 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.433+0000 7f175351e800 20 get_obj_state: octx=0x7f174c032ba0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x556f9b448bb8 s->prefetch_data=0 2023-12-03T11:46:32.434 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.433+0000 7f175351e800 20 prepare_atomic_modification: state is not atomic. state=0x556f9b448bb8 2023-12-03T11:46:32.434 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.433+0000 7f175351e800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.15.3 2023-12-03T11:46:32.436 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.435+0000 7f175351e800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-12-03T11:46:32.437 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.435+0000 7f175351e800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2023-12-03T11:46:32.437 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.435+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - tag is: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4653.6909795222448070732 2023-12-03T11:46:32.437 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.435+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-12-03T11:46:32.437 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.435+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.15__shadow_.kcB8drP1wqEJuBSTA2t-8Db6AtCrSv0_0 2023-12-03T11:46:32.437 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.435+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 337 2023-12-03T11:46:32.437 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.435+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-12-03T11:46:32.437 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.435+0000 7f175351e800 20 garbage collection: RGWGC::send_chain - on object name: gc.19tag is: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4653.6909795222448070732 2023-12-03T11:46:32.437 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.436+0000 7f1732ffd640 20 handle_completion(): completion ok for obj=foo-FROZEN 2023-12-03T11:46:32.438 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.436+0000 7f175351e800 20 get_obj_state: octx=0x7f174c01d260 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x556f9b448bb8 s->prefetch_data=0 2023-12-03T11:46:32.438 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.437+0000 7f175351e800 10 manifest: total_size = 5242880 2023-12-03T11:46:32.438 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.437+0000 7f175351e800 20 get_obj_state: setting s->obj_tag to _YWN7L_Kved_4JzNBzeeeI4rQKVsNV2c 2023-12-03T11:46:32.438 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.437+0000 7f175351e800 20 get_obj_state: octx=0x7f174c01d260 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x556f9b448bb8 s->prefetch_data=0 2023-12-03T11:46:32.438 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.437+0000 7f175351e800 20 prepare_atomic_modification: state is not atomic. state=0x556f9b448bb8 2023-12-03T11:46:32.438 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.437+0000 7f175351e800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.15.5 2023-12-03T11:46:32.440 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.439+0000 7f175351e800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-12-03T11:46:32.441 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.439+0000 7f175351e800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2023-12-03T11:46:32.441 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.439+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - tag is: _YWN7L_Kved_4JzNBzeeeI4rQKVsNV2c 2023-12-03T11:46:32.441 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.439+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-12-03T11:46:32.441 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.439+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.15__shadow_.oe9f8h1X-qpqdIMqG4dP3rQmLo4Juce_0 2023-12-03T11:46:32.441 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.439+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2023-12-03T11:46:32.441 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.439+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-12-03T11:46:32.441 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.439+0000 7f175351e800 20 garbage collection: RGWGC::send_chain - on object name: gc.21tag is: _YWN7L_Kved_4JzNBzeeeI4rQKVsNV2c 2023-12-03T11:46:32.442 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.440+0000 7f17337fe640 20 handle_completion(): completion ok for obj=foo-FROZEN-LUKEWARM 2023-12-03T11:46:32.442 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.441+0000 7f175351e800 20 get_obj_state: octx=0x556f9b4b8f60 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x556f9b448bb8 s->prefetch_data=0 2023-12-03T11:46:32.443 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.441+0000 7f175351e800 10 manifest: total_size = 5242880 2023-12-03T11:46:32.443 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.441+0000 7f175351e800 20 get_obj_state: setting s->obj_tag to _CqmJJfGSpjLnbu0BqX2ax1A1nz05w3M 2023-12-03T11:46:32.443 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.441+0000 7f175351e800 20 get_obj_state: octx=0x556f9b4b8f60 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x556f9b448bb8 s->prefetch_data=0 2023-12-03T11:46:32.443 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.441+0000 7f175351e800 20 prepare_atomic_modification: state is not atomic. state=0x556f9b448bb8 2023-12-03T11:46:32.443 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.441+0000 7f175351e800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.15.5 2023-12-03T11:46:32.445 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.444+0000 7f175351e800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-12-03T11:46:32.445 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.444+0000 7f175351e800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2023-12-03T11:46:32.445 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.444+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - tag is: _CqmJJfGSpjLnbu0BqX2ax1A1nz05w3M 2023-12-03T11:46:32.445 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.444+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-12-03T11:46:32.445 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.444+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.15__shadow_.dooXJV_735oTUNsY35MS0uQT2C5zKcx_0 2023-12-03T11:46:32.445 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.444+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2023-12-03T11:46:32.445 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.444+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-12-03T11:46:32.445 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.444+0000 7f175351e800 20 garbage collection: RGWGC::send_chain - on object name: gc.12tag is: _CqmJJfGSpjLnbu0BqX2ax1A1nz05w3M 2023-12-03T11:46:32.446 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.445+0000 7f1732ffd640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-FROZEN 2023-12-03T11:46:32.446 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.445+0000 7f175351e800 20 get_obj_state: octx=0x7f174c032ba0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x556f9b448bb8 s->prefetch_data=0 2023-12-03T11:46:32.447 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.445+0000 7f175351e800 10 manifest: total_size = 27196 2023-12-03T11:46:32.447 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.445+0000 7f175351e800 20 get_obj_state: setting s->obj_tag to 83aabb46-04b5-4c96-9933-c6bfb1173a73.4653.9229228904103244623 2023-12-03T11:46:32.447 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.445+0000 7f175351e800 20 get_obj_state: octx=0x7f174c032ba0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x556f9b448bb8 s->prefetch_data=0 2023-12-03T11:46:32.447 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.445+0000 7f175351e800 20 prepare_atomic_modification: state is not atomic. state=0x556f9b448bb8 2023-12-03T11:46:32.447 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.445+0000 7f175351e800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.15.5 2023-12-03T11:46:32.449 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.448+0000 7f175351e800 20 get_obj_state: octx=0x7f174c09c4e0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x556f9b448bb8 s->prefetch_data=0 2023-12-03T11:46:32.449 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.448+0000 7f175351e800 10 manifest: total_size = 5242880 2023-12-03T11:46:32.450 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.448+0000 7f175351e800 20 get_obj_state: setting s->obj_tag to _9czDo8zmzPzZwh5QvQYVbZz1MKQSasi 2023-12-03T11:46:32.450 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.448+0000 7f175351e800 20 get_obj_state: octx=0x7f174c09c4e0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x556f9b448bb8 s->prefetch_data=0 2023-12-03T11:46:32.450 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.448+0000 7f175351e800 20 prepare_atomic_modification: state is not atomic. state=0x556f9b448bb8 2023-12-03T11:46:32.450 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.448+0000 7f175351e800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.15.7 2023-12-03T11:46:32.450 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.449+0000 7f17337fe640 20 handle_completion(): completion ok for obj=foo-STANDARD 2023-12-03T11:46:32.453 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.451+0000 7f175351e800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-12-03T11:46:32.453 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.451+0000 7f175351e800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2023-12-03T11:46:32.453 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.451+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - tag is: _9czDo8zmzPzZwh5QvQYVbZz1MKQSasi 2023-12-03T11:46:32.453 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.451+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-12-03T11:46:32.453 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.451+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.15__shadow_.eMgj45jLXPlQ0q4YzdGl5G-yExrgB4z_1 2023-12-03T11:46:32.453 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.451+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2023-12-03T11:46:32.453 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.451+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-12-03T11:46:32.453 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.451+0000 7f175351e800 20 garbage collection: RGWGC::send_chain - on object name: gc.2tag is: _9czDo8zmzPzZwh5QvQYVbZz1MKQSasi 2023-12-03T11:46:32.455 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.454+0000 7f1732ffd640 20 handle_completion(): completion ok for obj=foo-FROZEN-STANDARD 2023-12-03T11:46:32.455 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.454+0000 7f175351e800 20 get_obj_state: octx=0x7f1748079860 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x556f9b448bb8 s->prefetch_data=0 2023-12-03T11:46:32.456 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.454+0000 7f175351e800 10 manifest: total_size = 5242880 2023-12-03T11:46:32.456 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.454+0000 7f175351e800 20 get_obj_state: setting s->obj_tag to 83aabb46-04b5-4c96-9933-c6bfb1173a73.4653.15542755290438594238 2023-12-03T11:46:32.456 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.454+0000 7f175351e800 20 get_obj_state: octx=0x7f1748079860 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x556f9b448bb8 s->prefetch_data=0 2023-12-03T11:46:32.456 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.454+0000 7f175351e800 20 prepare_atomic_modification: state is not atomic. state=0x556f9b448bb8 2023-12-03T11:46:32.456 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.455+0000 7f175351e800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.15.7 2023-12-03T11:46:32.458 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.457+0000 7f175351e800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-12-03T11:46:32.458 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.457+0000 7f175351e800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2023-12-03T11:46:32.458 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.457+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - tag is: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4653.15542755290438594238 2023-12-03T11:46:32.458 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.457+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-12-03T11:46:32.458 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.457+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.15__shadow_.88BgYbQ6UQ_BiDcPq7CdPYxSdGA-0bD_0 2023-12-03T11:46:32.458 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.457+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 340 2023-12-03T11:46:32.459 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.457+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-12-03T11:46:32.459 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.457+0000 7f175351e800 20 garbage collection: RGWGC::send_chain - on object name: gc.30tag is: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4653.15542755290438594238 2023-12-03T11:46:32.460 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.458+0000 7f17337fe640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2023-12-03T11:46:32.460 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.459+0000 7f175351e800 20 get_obj_state: octx=0x7f1748079860 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x556f9b448bb8 s->prefetch_data=0 2023-12-03T11:46:32.460 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.459+0000 7f175351e800 10 manifest: total_size = 27196 2023-12-03T11:46:32.460 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.459+0000 7f175351e800 20 get_obj_state: setting s->obj_tag to _z1YIIHRoezbNJKDasORr7VWVTohx0bx 2023-12-03T11:46:32.460 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.459+0000 7f175351e800 20 get_obj_state: octx=0x7f1748079860 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x556f9b448bb8 s->prefetch_data=0 2023-12-03T11:46:32.460 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.459+0000 7f175351e800 20 prepare_atomic_modification: state is not atomic. state=0x556f9b448bb8 2023-12-03T11:46:32.460 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.459+0000 7f175351e800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.15.7 2023-12-03T11:46:32.463 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.461+0000 7f175351e800 20 get_obj_state: octx=0x7f17440711d0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x556f9b448bb8 s->prefetch_data=0 2023-12-03T11:46:32.463 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.462+0000 7f175351e800 10 manifest: total_size = 5242880 2023-12-03T11:46:32.463 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.462+0000 7f175351e800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-12-03T11:46:32.463 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.462+0000 7f175351e800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2023-12-03T11:46:32.463 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.462+0000 7f175351e800 10 generate_fake_tag new tag=83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.15__shadow_.88BgYbQ6UQ_BiDcPq7CdPYxSdGA-0bD_1_d359be3642d7c9dee3007f1e14ed5453 2023-12-03T11:46:32.463 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.462+0000 7f175351e800 20 get_obj_state: setting s->obj_tag to 83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.15__shadow_.88BgYbQ6UQ_BiDcPq7CdPYxSdGA-0bD_1_d359be3642d7c9dee3007f1e14ed5453 2023-12-03T11:46:32.463 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.462+0000 7f175351e800 20 get_obj_state: octx=0x7f17440711d0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x556f9b448bb8 s->prefetch_data=0 2023-12-03T11:46:32.463 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.462+0000 7f175351e800 20 prepare_atomic_modification: state is not atomic. state=0x556f9b448bb8 2023-12-03T11:46:32.463 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.462+0000 7f175351e800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.15.8 2023-12-03T11:46:32.464 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.463+0000 7f1732ffd640 20 handle_completion(): completion ok for obj=foo-STANDARD-STANDARD 2023-12-03T11:46:32.465 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.464+0000 7f175351e800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-12-03T11:46:32.466 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.464+0000 7f175351e800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2023-12-03T11:46:32.466 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.464+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - tag is: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.15__shadow_.88BgYbQ6UQ_BiDcPq7CdPYxSdGA-0bD_1_d359be3642d7c9dee3007f1e14ed5453 2023-12-03T11:46:32.466 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.464+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-12-03T11:46:32.466 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.464+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.15__shadow_.88BgYbQ6UQ_BiDcPq7CdPYxSdGA-0bD_0 2023-12-03T11:46:32.466 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.464+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 398 2023-12-03T11:46:32.466 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.464+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-12-03T11:46:32.466 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.464+0000 7f175351e800 20 garbage collection: RGWGC::send_chain - on object name: gc.23tag is: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.15__shadow_.88BgYbQ6UQ_BiDcPq7CdPYxSdGA-0bD_1_d359be3642d7c9dee3007f1e14ed5453 2023-12-03T11:46:32.466 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.465+0000 7f17337fe640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-LUKEWARM 2023-12-03T11:46:32.467 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.466+0000 7f175351e800 20 get_obj_state: octx=0x7f174c032ba0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x556f9b448bb8 s->prefetch_data=0 2023-12-03T11:46:32.467 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.466+0000 7f175351e800 10 manifest: total_size = 27196 2023-12-03T11:46:32.467 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.466+0000 7f175351e800 20 get_obj_state: setting s->obj_tag to _-Kq_IhC4mAP7-uOUARWgq-yjV33U9Nd 2023-12-03T11:46:32.467 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.466+0000 7f175351e800 20 get_obj_state: octx=0x7f174c032ba0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x556f9b448bb8 s->prefetch_data=0 2023-12-03T11:46:32.467 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.466+0000 7f175351e800 20 prepare_atomic_modification: state is not atomic. state=0x556f9b448bb8 2023-12-03T11:46:32.468 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.466+0000 7f175351e800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.15.8 2023-12-03T11:46:32.470 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.469+0000 7f175351e800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-12-03T11:46:32.470 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.469+0000 7f175351e800 20 RGWObjManifest::operator++(): result: ofs=27196 stripe_ofs=27196 part_ofs=0 rule->part_size=0 2023-12-03T11:46:32.470 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.469+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - tag is: _-Kq_IhC4mAP7-uOUARWgq-yjV33U9Nd 2023-12-03T11:46:32.470 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.469+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-12-03T11:46:32.470 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.469+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.15__shadow_.Qw7ms5MkyD2bfYN6TaugXp34AI7piY9_0 2023-12-03T11:46:32.471 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.469+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2023-12-03T11:46:32.471 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.469+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-12-03T11:46:32.471 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.469+0000 7f175351e800 20 garbage collection: RGWGC::send_chain - on object name: gc.31tag is: _-Kq_IhC4mAP7-uOUARWgq-yjV33U9Nd 2023-12-03T11:46:32.471 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.470+0000 7f1732ffd640 20 handle_completion(): completion ok for obj=foo-STANDARD-FROZEN 2023-12-03T11:46:32.471 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.470+0000 7f175351e800 20 get_obj_state: octx=0x7f1748079860 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x556f9b448bb8 s->prefetch_data=0 2023-12-03T11:46:32.472 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.470+0000 7f175351e800 10 manifest: total_size = 5242880 2023-12-03T11:46:32.472 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.470+0000 7f175351e800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-12-03T11:46:32.472 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.470+0000 7f175351e800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2023-12-03T11:46:32.472 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.470+0000 7f175351e800 10 generate_fake_tag new tag=83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.15__shadow_.kcB8drP1wqEJuBSTA2t-8Db6AtCrSv0_1_215c4051a72749bf632217fe75338324 2023-12-03T11:46:32.472 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.470+0000 7f175351e800 20 get_obj_state: setting s->obj_tag to 83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.15__shadow_.kcB8drP1wqEJuBSTA2t-8Db6AtCrSv0_1_215c4051a72749bf632217fe75338324 2023-12-03T11:46:32.472 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.470+0000 7f175351e800 20 get_obj_state: octx=0x7f1748079860 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x556f9b448bb8 s->prefetch_data=0 2023-12-03T11:46:32.472 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.470+0000 7f175351e800 20 prepare_atomic_modification: state is not atomic. state=0x556f9b448bb8 2023-12-03T11:46:32.473 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.470+0000 7f175351e800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.15.9 2023-12-03T11:46:32.474 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.473+0000 7f175351e800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-12-03T11:46:32.474 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.473+0000 7f175351e800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2023-12-03T11:46:32.474 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.473+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - tag is: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.15__shadow_.kcB8drP1wqEJuBSTA2t-8Db6AtCrSv0_1_215c4051a72749bf632217fe75338324 2023-12-03T11:46:32.474 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.473+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-12-03T11:46:32.475 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.473+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.15__shadow_.kcB8drP1wqEJuBSTA2t-8Db6AtCrSv0_0 2023-12-03T11:46:32.475 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.473+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 396 2023-12-03T11:46:32.475 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.473+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-12-03T11:46:32.475 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.473+0000 7f175351e800 20 garbage collection: RGWGC::send_chain - on object name: gc.11tag is: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.15__shadow_.kcB8drP1wqEJuBSTA2t-8Db6AtCrSv0_1_215c4051a72749bf632217fe75338324 2023-12-03T11:46:32.475 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.474+0000 7f175351e800 20 list_objects_ordered: starting attempt 1 2023-12-03T11:46:32.475 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.474+0000 7f175351e800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2023-12-03T11:46:32.475 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.474+0000 7f17337fe640 20 handle_completion(): completion ok for obj=foo-FROZEN-FROZEN 2023-12-03T11:46:32.476 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.475+0000 7f175351e800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2023-12-03T11:46:32.477 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.475+0000 7f175351e800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2023-12-03T11:46:32.477 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.475+0000 7f175351e800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2023-12-03T11:46:32.477 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.475+0000 7f175351e800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2023-12-03T11:46:32.477 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.475+0000 7f175351e800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-copy.1[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.15])"; uploads.size()=0; is_truncated=0 2023-12-03T11:46:32.478 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.477+0000 7f175351e800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 : miss 2023-12-03T11:46:32.478 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.477+0000 7f175351e800 20 rados->read ofs=0 len=0 2023-12-03T11:46:32.479 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.478+0000 7f175351e800 20 rados_obj.operate() r=0 bl.length=233 2023-12-03T11:46:32.479 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.478+0000 7f175351e800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x11 2023-12-03T11:46:32.479 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.478+0000 7f175351e800 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2023-12-03T11:46:32.479 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.478+0000 7f175351e800 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 from cache 2023-12-03T11:46:32.479 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.478+0000 7f175351e800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-copy.1, ofs0, ns] 2023-12-03T11:46:32.479 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.478+0000 7f17337fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660498 cookie 93937834184464 notifier 6069 bl.length()=189 2023-12-03T11:46:32.482 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.481+0000 7f175351e800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.15 from cache 2023-12-03T11:46:32.482 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.481+0000 7f175351e800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.15, ofs0, ns] 2023-12-03T11:46:32.483 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.481+0000 7f1732ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660539 cookie 93937831694160 notifier 6069 bl.length()=247 2023-12-03T11:46:32.491 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.490+0000 7f175351e800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.15 : miss 2023-12-03T11:46:32.491 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.490+0000 7f175351e800 20 rados->read ofs=0 len=0 2023-12-03T11:46:32.491 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.490+0000 7f175351e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:46:32.491 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.490+0000 7f175351e800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.15 info.flags=0x0 2023-12-03T11:46:32.491 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.490+0000 7f175351e800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.15 to cache LRU end 2023-12-03T11:46:32.491 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.490+0000 7f175351e800 10 removing default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.15 from cache 2023-12-03T11:46:32.491 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.490+0000 7f175351e800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.log:pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.15, ofs0, ns] 2023-12-03T11:46:32.492 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.490+0000 7f1732ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660553 cookie 93937834199328 notifier 6069 bl.length()=244 2023-12-03T11:46:32.495 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.494+0000 7f175351e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.16 : miss 2023-12-03T11:46:32.495 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.494+0000 7f175351e800 20 rados->read ofs=0 len=0 2023-12-03T11:46:32.496 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.494+0000 7f175351e800 20 rados_obj.operate() r=0 bl.length=417 2023-12-03T11:46:32.496 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.494+0000 7f175351e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.16 info.flags=0x17 2023-12-03T11:46:32.496 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.494+0000 7f175351e800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.16 to cache LRU end 2023-12-03T11:46:32.496 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.494+0000 7f175351e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:46:32.496 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.494+0000 7f175351e800 10 updating xattr: name=user.rgw.acl bl.length()=209 2023-12-03T11:46:32.496 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.494+0000 7f175351e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.16 2023-12-03T11:46:32.496 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.495+0000 7f175351e800 10 cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM 2023-12-03T11:46:32.497 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.495+0000 7f175351e800 10 cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD 2023-12-03T11:46:32.497 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.496+0000 7f175351e800 10 cls_bucket_list_unordered: got foo-FROZEN 2023-12-03T11:46:32.498 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.497+0000 7f175351e800 10 cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM 2023-12-03T11:46:32.498 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.497+0000 7f175351e800 10 cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN 2023-12-03T11:46:32.498 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.497+0000 7f175351e800 10 cls_bucket_list_unordered: got foo-STANDARD 2023-12-03T11:46:32.498 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.497+0000 7f175351e800 10 cls_bucket_list_unordered: got foo-FROZEN-STANDARD 2023-12-03T11:46:32.498 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.497+0000 7f175351e800 10 cls_bucket_list_unordered: got foo-LUKEWARM 2023-12-03T11:46:32.498 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.497+0000 7f175351e800 10 cls_bucket_list_unordered: got foo-STANDARD-STANDARD 2023-12-03T11:46:32.499 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.498+0000 7f175351e800 10 cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM 2023-12-03T11:46:32.499 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.498+0000 7f175351e800 10 cls_bucket_list_unordered: got foo-STANDARD-FROZEN 2023-12-03T11:46:32.499 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.498+0000 7f175351e800 10 cls_bucket_list_unordered: got foo-FROZEN-FROZEN 2023-12-03T11:46:32.499 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.498+0000 7f175351e800 20 get_obj_state: octx=0x556f9b4ba970 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x556f9b448bb8 s->prefetch_data=0 2023-12-03T11:46:32.500 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.499+0000 7f175351e800 10 manifest: total_size = 11534336 2023-12-03T11:46:32.500 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.499+0000 7f175351e800 20 get_obj_state: setting s->obj_tag to _bIY5FFSoMTKfdAyKbaj-gn8bE3T3JVE 2023-12-03T11:46:32.500 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.499+0000 7f175351e800 20 get_obj_state: octx=0x556f9b4ba970 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x556f9b448bb8 s->prefetch_data=0 2023-12-03T11:46:32.500 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.499+0000 7f175351e800 20 prepare_atomic_modification: state is not atomic. state=0x556f9b448bb8 2023-12-03T11:46:32.500 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.499+0000 7f175351e800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.16.0 2023-12-03T11:46:32.503 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.501+0000 7f175351e800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-12-03T11:46:32.503 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.501+0000 7f175351e800 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2023-12-03T11:46:32.503 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.501+0000 7f175351e800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-12-03T11:46:32.503 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.501+0000 7f175351e800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2023-12-03T11:46:32.503 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.501+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - tag is: _bIY5FFSoMTKfdAyKbaj-gn8bE3T3JVE 2023-12-03T11:46:32.503 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.501+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-12-03T11:46:32.503 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.501+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.16__shadow_.yDoU2E57SFkkktBg-1vxB4btnujEJb7_0 2023-12-03T11:46:32.503 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.501+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2023-12-03T11:46:32.503 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.501+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.16__shadow_.yDoU2E57SFkkktBg-1vxB4btnujEJb7_1 2023-12-03T11:46:32.503 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.501+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 549 2023-12-03T11:46:32.503 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.501+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-12-03T11:46:32.503 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.501+0000 7f175351e800 20 garbage collection: RGWGC::send_chain - on object name: gc.6tag is: _bIY5FFSoMTKfdAyKbaj-gn8bE3T3JVE 2023-12-03T11:46:32.504 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.502+0000 7f1732ffd640 20 handle_completion(): completion ok for obj=foo-STANDARD-LUKEWARM 2023-12-03T11:46:32.504 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.503+0000 7f175351e800 20 get_obj_state: octx=0x7f1744002ba0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x556f9b448bb8 s->prefetch_data=0 2023-12-03T11:46:32.504 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.503+0000 7f175351e800 10 manifest: total_size = 11534336 2023-12-03T11:46:32.506 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.503+0000 7f175351e800 20 get_obj_state: setting s->obj_tag to _-6cey1NMooOW2eGaN_R-U0dN1cWY1hb 2023-12-03T11:46:32.506 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.503+0000 7f175351e800 20 get_obj_state: octx=0x7f1744002ba0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x556f9b448bb8 s->prefetch_data=0 2023-12-03T11:46:32.506 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.503+0000 7f175351e800 20 prepare_atomic_modification: state is not atomic. state=0x556f9b448bb8 2023-12-03T11:46:32.506 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.503+0000 7f175351e800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.16.2 2023-12-03T11:46:32.507 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.506+0000 7f175351e800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-12-03T11:46:32.508 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.506+0000 7f175351e800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2023-12-03T11:46:32.508 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.506+0000 7f175351e800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-12-03T11:46:32.508 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.506+0000 7f175351e800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2023-12-03T11:46:32.508 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.506+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - tag is: _-6cey1NMooOW2eGaN_R-U0dN1cWY1hb 2023-12-03T11:46:32.508 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.506+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-12-03T11:46:32.508 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.506+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.16__shadow_.r_pOPT4rgk-NKJ66OI34ySYs74BkZgl_1 2023-12-03T11:46:32.508 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.506+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2023-12-03T11:46:32.509 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.506+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.16__shadow_.r_pOPT4rgk-NKJ66OI34ySYs74BkZgl_2 2023-12-03T11:46:32.509 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.506+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2023-12-03T11:46:32.509 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.506+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-12-03T11:46:32.509 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.506+0000 7f175351e800 20 garbage collection: RGWGC::send_chain - on object name: gc.16tag is: _-6cey1NMooOW2eGaN_R-U0dN1cWY1hb 2023-12-03T11:46:32.510 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.507+0000 7f17337fe640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-STANDARD 2023-12-03T11:46:32.510 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.507+0000 7f175351e800 20 get_obj_state: octx=0x7f174808ce60 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x556f9b448bb8 s->prefetch_data=0 2023-12-03T11:46:32.510 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.508+0000 7f175351e800 10 manifest: total_size = 11534336 2023-12-03T11:46:32.510 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.508+0000 7f175351e800 20 get_obj_state: setting s->obj_tag to 83aabb46-04b5-4c96-9933-c6bfb1173a73.4653.10348991387330289336 2023-12-03T11:46:32.511 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.508+0000 7f175351e800 20 get_obj_state: octx=0x7f174808ce60 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x556f9b448bb8 s->prefetch_data=0 2023-12-03T11:46:32.511 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.508+0000 7f175351e800 20 prepare_atomic_modification: state is not atomic. state=0x556f9b448bb8 2023-12-03T11:46:32.511 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.508+0000 7f175351e800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.16.3 2023-12-03T11:46:32.512 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.510+0000 7f175351e800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2023-12-03T11:46:32.512 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.510+0000 7f175351e800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2023-12-03T11:46:32.512 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.510+0000 7f175351e800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2023-12-03T11:46:32.512 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.510+0000 7f175351e800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2023-12-03T11:46:32.512 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.510+0000 7f175351e800 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2023-12-03T11:46:32.513 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.510+0000 7f175351e800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2023-12-03T11:46:32.513 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.510+0000 7f175351e800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2023-12-03T11:46:32.513 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.510+0000 7f175351e800 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2023-12-03T11:46:32.513 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.510+0000 7f175351e800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2023-12-03T11:46:32.513 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.510+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - tag is: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4653.10348991387330289336 2023-12-03T11:46:32.513 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.510+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-12-03T11:46:32.513 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.510+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.16__multipart_foo-FROZEN.2~4YRdtSB53jf2C5eZb9-7M90nDB43zQo.1 2023-12-03T11:46:32.513 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.510+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 368 2023-12-03T11:46:32.513 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.510+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.16__multipart_foo-FROZEN.2~4YRdtSB53jf2C5eZb9-7M90nDB43zQo.2 2023-12-03T11:46:32.514 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.510+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 635 2023-12-03T11:46:32.514 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.510+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.16__multipart_foo-FROZEN.2~4YRdtSB53jf2C5eZb9-7M90nDB43zQo.3 2023-12-03T11:46:32.514 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.510+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 902 2023-12-03T11:46:32.514 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.510+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-12-03T11:46:32.514 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.510+0000 7f175351e800 20 garbage collection: RGWGC::send_chain - on object name: gc.24tag is: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4653.10348991387330289336 2023-12-03T11:46:32.514 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.511+0000 7f1732ffd640 20 handle_completion(): completion ok for obj=foo-FROZEN 2023-12-03T11:46:32.515 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.511+0000 7f175351e800 20 get_obj_state: octx=0x7f174c032ba0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x556f9b448328 s->prefetch_data=0 2023-12-03T11:46:32.515 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.512+0000 7f175351e800 10 manifest: total_size = 11534336 2023-12-03T11:46:32.515 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.512+0000 7f175351e800 20 get_obj_state: setting s->obj_tag to _TtupqrtLLmtNsbRquMblFbiM5RCdUzZ 2023-12-03T11:46:32.515 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.512+0000 7f175351e800 20 get_obj_state: octx=0x7f174c032ba0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x556f9b448328 s->prefetch_data=0 2023-12-03T11:46:32.515 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.512+0000 7f175351e800 20 prepare_atomic_modification: state is not atomic. state=0x556f9b448328 2023-12-03T11:46:32.515 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.512+0000 7f175351e800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.16.5 2023-12-03T11:46:32.515 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.514+0000 7f175351e800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-12-03T11:46:32.516 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.514+0000 7f175351e800 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2023-12-03T11:46:32.516 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.514+0000 7f175351e800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-12-03T11:46:32.516 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.514+0000 7f175351e800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2023-12-03T11:46:32.516 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.514+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - tag is: _TtupqrtLLmtNsbRquMblFbiM5RCdUzZ 2023-12-03T11:46:32.516 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.514+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-12-03T11:46:32.516 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.514+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.16__shadow_.KQrimPKg2RCkQ84Dfsi2Za1UXa34og1_0 2023-12-03T11:46:32.516 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.514+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2023-12-03T11:46:32.516 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.514+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.16__shadow_.KQrimPKg2RCkQ84Dfsi2Za1UXa34og1_1 2023-12-03T11:46:32.516 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.514+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 549 2023-12-03T11:46:32.516 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.514+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-12-03T11:46:32.516 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.514+0000 7f175351e800 20 garbage collection: RGWGC::send_chain - on object name: gc.31tag is: _TtupqrtLLmtNsbRquMblFbiM5RCdUzZ 2023-12-03T11:46:32.517 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.515+0000 7f17337fe640 20 handle_completion(): completion ok for obj=foo-FROZEN-LUKEWARM 2023-12-03T11:46:32.517 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.515+0000 7f175351e800 20 get_obj_state: octx=0x7f1744059230 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x556f9b4574c8 s->prefetch_data=0 2023-12-03T11:46:32.517 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.516+0000 7f175351e800 10 manifest: total_size = 11534336 2023-12-03T11:46:32.517 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.516+0000 7f175351e800 20 get_obj_state: setting s->obj_tag to _En7bxfrO2DjvBMmU2O1vyyhm0KbZEMU 2023-12-03T11:46:32.518 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.516+0000 7f175351e800 20 get_obj_state: octx=0x7f1744059230 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x556f9b4574c8 s->prefetch_data=0 2023-12-03T11:46:32.518 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.516+0000 7f175351e800 20 prepare_atomic_modification: state is not atomic. state=0x556f9b4574c8 2023-12-03T11:46:32.518 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.516+0000 7f175351e800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.16.5 2023-12-03T11:46:32.520 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.518+0000 7f175351e800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-12-03T11:46:32.520 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.518+0000 7f175351e800 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2023-12-03T11:46:32.520 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.518+0000 7f175351e800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-12-03T11:46:32.520 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.518+0000 7f175351e800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2023-12-03T11:46:32.520 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.518+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - tag is: _En7bxfrO2DjvBMmU2O1vyyhm0KbZEMU 2023-12-03T11:46:32.520 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.518+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-12-03T11:46:32.520 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.518+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.16__shadow_.I_kGVcyvhVsNw_xrTwns71lEG02DXbl_0 2023-12-03T11:46:32.520 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.518+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2023-12-03T11:46:32.520 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.518+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.16__shadow_.I_kGVcyvhVsNw_xrTwns71lEG02DXbl_1 2023-12-03T11:46:32.521 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.518+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 545 2023-12-03T11:46:32.521 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.518+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-12-03T11:46:32.521 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.518+0000 7f175351e800 20 garbage collection: RGWGC::send_chain - on object name: gc.26tag is: _En7bxfrO2DjvBMmU2O1vyyhm0KbZEMU 2023-12-03T11:46:32.521 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.520+0000 7f1732ffd640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-FROZEN 2023-12-03T11:46:32.521 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.520+0000 7f175351e800 20 get_obj_state: octx=0x7f174408af80 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x556f9b4574c8 s->prefetch_data=0 2023-12-03T11:46:32.522 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.520+0000 7f175351e800 10 manifest: total_size = 11534336 2023-12-03T11:46:32.522 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.520+0000 7f175351e800 20 get_obj_state: setting s->obj_tag to 83aabb46-04b5-4c96-9933-c6bfb1173a73.4653.15534283890781091536 2023-12-03T11:46:32.522 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.520+0000 7f175351e800 20 get_obj_state: octx=0x7f174408af80 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x556f9b4574c8 s->prefetch_data=0 2023-12-03T11:46:32.522 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.520+0000 7f175351e800 20 prepare_atomic_modification: state is not atomic. state=0x556f9b4574c8 2023-12-03T11:46:32.522 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.520+0000 7f175351e800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.16.5 2023-12-03T11:46:32.524 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.523+0000 7f175351e800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2023-12-03T11:46:32.524 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.523+0000 7f175351e800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2023-12-03T11:46:32.524 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.523+0000 7f175351e800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2023-12-03T11:46:32.524 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.523+0000 7f175351e800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2023-12-03T11:46:32.524 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.523+0000 7f175351e800 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2023-12-03T11:46:32.524 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.523+0000 7f175351e800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2023-12-03T11:46:32.524 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.523+0000 7f175351e800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2023-12-03T11:46:32.525 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.523+0000 7f175351e800 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2023-12-03T11:46:32.525 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.523+0000 7f175351e800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2023-12-03T11:46:32.525 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.523+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - tag is: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4653.15534283890781091536 2023-12-03T11:46:32.525 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.523+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-12-03T11:46:32.525 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.523+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.16__multipart_foo-STANDARD.2~vlfDWI-vv3RhE217kuvJVo_qOJBj_Sx.1 2023-12-03T11:46:32.525 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.523+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 365 2023-12-03T11:46:32.525 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.523+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.16__multipart_foo-STANDARD.2~vlfDWI-vv3RhE217kuvJVo_qOJBj_Sx.2 2023-12-03T11:46:32.525 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.523+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 629 2023-12-03T11:46:32.525 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.523+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.16__multipart_foo-STANDARD.2~vlfDWI-vv3RhE217kuvJVo_qOJBj_Sx.3 2023-12-03T11:46:32.525 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.523+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 893 2023-12-03T11:46:32.525 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.523+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-12-03T11:46:32.525 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.523+0000 7f175351e800 20 garbage collection: RGWGC::send_chain - on object name: gc.19tag is: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4653.15534283890781091536 2023-12-03T11:46:32.526 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.524+0000 7f17337fe640 20 handle_completion(): completion ok for obj=foo-STANDARD 2023-12-03T11:46:32.527 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.526+0000 7f175351e800 20 get_obj_state: octx=0x556f9b45fd70 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x556f9b4574c8 s->prefetch_data=0 2023-12-03T11:46:32.528 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.527+0000 7f175351e800 10 manifest: total_size = 11534336 2023-12-03T11:46:32.528 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.527+0000 7f175351e800 20 get_obj_state: setting s->obj_tag to _ZClSMph25bCqPWF1VPVRYK_4PK4e3LQ 2023-12-03T11:46:32.528 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.527+0000 7f175351e800 20 get_obj_state: octx=0x556f9b45fd70 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x556f9b4574c8 s->prefetch_data=0 2023-12-03T11:46:32.528 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.527+0000 7f175351e800 20 prepare_atomic_modification: state is not atomic. state=0x556f9b4574c8 2023-12-03T11:46:32.528 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.527+0000 7f175351e800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.16.7 2023-12-03T11:46:32.531 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.529+0000 7f175351e800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-12-03T11:46:32.531 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.529+0000 7f175351e800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2023-12-03T11:46:32.531 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.529+0000 7f175351e800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-12-03T11:46:32.531 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.529+0000 7f175351e800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2023-12-03T11:46:32.531 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.529+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - tag is: _ZClSMph25bCqPWF1VPVRYK_4PK4e3LQ 2023-12-03T11:46:32.531 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.529+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-12-03T11:46:32.531 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.529+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.16__shadow_.YBxNTAk9JU6gqA86xR-FBEy7ZFza5Ph_1 2023-12-03T11:46:32.531 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.529+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2023-12-03T11:46:32.531 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.529+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.16__shadow_.YBxNTAk9JU6gqA86xR-FBEy7ZFza5Ph_2 2023-12-03T11:46:32.531 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.529+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2023-12-03T11:46:32.531 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.529+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-12-03T11:46:32.531 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.529+0000 7f175351e800 20 garbage collection: RGWGC::send_chain - on object name: gc.27tag is: _ZClSMph25bCqPWF1VPVRYK_4PK4e3LQ 2023-12-03T11:46:32.532 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.530+0000 7f1732ffd640 20 handle_completion(): completion ok for obj=foo-FROZEN-STANDARD 2023-12-03T11:46:32.533 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.532+0000 7f175351e800 20 get_obj_state: octx=0x7f174408af80 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x556f9b448328 s->prefetch_data=0 2023-12-03T11:46:32.534 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.533+0000 7f175351e800 10 manifest: total_size = 11534336 2023-12-03T11:46:32.534 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.533+0000 7f175351e800 20 get_obj_state: setting s->obj_tag to 83aabb46-04b5-4c96-9933-c6bfb1173a73.4653.5391387683847757900 2023-12-03T11:46:32.534 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.533+0000 7f175351e800 20 get_obj_state: octx=0x7f174408af80 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x556f9b448328 s->prefetch_data=0 2023-12-03T11:46:32.534 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.533+0000 7f175351e800 20 prepare_atomic_modification: state is not atomic. state=0x556f9b448328 2023-12-03T11:46:32.534 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.533+0000 7f175351e800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.16.7 2023-12-03T11:46:32.536 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.535+0000 7f175351e800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2023-12-03T11:46:32.536 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.535+0000 7f175351e800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2023-12-03T11:46:32.536 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.535+0000 7f175351e800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2023-12-03T11:46:32.536 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.535+0000 7f175351e800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2023-12-03T11:46:32.537 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.535+0000 7f175351e800 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2023-12-03T11:46:32.537 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.535+0000 7f175351e800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2023-12-03T11:46:32.537 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.535+0000 7f175351e800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2023-12-03T11:46:32.537 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.535+0000 7f175351e800 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2023-12-03T11:46:32.537 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.535+0000 7f175351e800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2023-12-03T11:46:32.537 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.535+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - tag is: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4653.5391387683847757900 2023-12-03T11:46:32.537 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.535+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-12-03T11:46:32.537 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.535+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.16__multipart_foo-LUKEWARM.2~bfCD-t6umQHlMAUwQttXrJXmQJk63il.1 2023-12-03T11:46:32.537 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.535+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 373 2023-12-03T11:46:32.537 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.535+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.16__multipart_foo-LUKEWARM.2~bfCD-t6umQHlMAUwQttXrJXmQJk63il.2 2023-12-03T11:46:32.537 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.535+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 646 2023-12-03T11:46:32.537 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.535+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.16__multipart_foo-LUKEWARM.2~bfCD-t6umQHlMAUwQttXrJXmQJk63il.3 2023-12-03T11:46:32.537 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.535+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 919 2023-12-03T11:46:32.537 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.535+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-12-03T11:46:32.538 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.535+0000 7f175351e800 20 garbage collection: RGWGC::send_chain - on object name: gc.30tag is: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4653.5391387683847757900 2023-12-03T11:46:32.538 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.536+0000 7f17337fe640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2023-12-03T11:46:32.538 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.536+0000 7f175351e800 20 get_obj_state: octx=0x7f17440711d0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x556f9b4574c8 s->prefetch_data=0 2023-12-03T11:46:32.539 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.537+0000 7f175351e800 10 manifest: total_size = 11534336 2023-12-03T11:46:32.539 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.537+0000 7f175351e800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2023-12-03T11:46:32.539 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.537+0000 7f175351e800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2023-12-03T11:46:32.539 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.537+0000 7f175351e800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2023-12-03T11:46:32.539 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.537+0000 7f175351e800 10 generate_fake_tag new tag=83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.16__multipart_foo-STANDARD.2~vlfDWI-vv3RhE217kuvJVo_qOJBj_Sx.2_42d279f30963775c303ba66607dd32af 2023-12-03T11:46:32.539 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.537+0000 7f175351e800 20 get_obj_state: setting s->obj_tag to 83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.16__multipart_foo-STANDARD.2~vlfDWI-vv3RhE217kuvJVo_qOJBj_Sx.2_42d279f30963775c303ba66607dd32af 2023-12-03T11:46:32.539 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.537+0000 7f175351e800 20 get_obj_state: octx=0x7f17440711d0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x556f9b4574c8 s->prefetch_data=0 2023-12-03T11:46:32.539 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.537+0000 7f175351e800 20 prepare_atomic_modification: state is not atomic. state=0x556f9b4574c8 2023-12-03T11:46:32.539 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.537+0000 7f175351e800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.16.7 2023-12-03T11:46:32.540 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.539+0000 7f175351e800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2023-12-03T11:46:32.540 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.539+0000 7f175351e800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2023-12-03T11:46:32.541 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.539+0000 7f175351e800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2023-12-03T11:46:32.541 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.539+0000 7f175351e800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2023-12-03T11:46:32.541 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.539+0000 7f175351e800 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2023-12-03T11:46:32.541 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.539+0000 7f175351e800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2023-12-03T11:46:32.541 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.539+0000 7f175351e800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2023-12-03T11:46:32.541 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.539+0000 7f175351e800 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2023-12-03T11:46:32.541 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.539+0000 7f175351e800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2023-12-03T11:46:32.541 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.539+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - tag is: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.16__multipart_foo-STANDARD.2~vlfDWI-vv3RhE217kuvJVo_qOJBj_Sx.2_42d279f30963775c303ba66607dd32af 2023-12-03T11:46:32.541 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.539+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-12-03T11:46:32.541 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.539+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.16__multipart_foo-STANDARD.2~vlfDWI-vv3RhE217kuvJVo_qOJBj_Sx.1 2023-12-03T11:46:32.541 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.539+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 440 2023-12-03T11:46:32.541 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.539+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.16__multipart_foo-STANDARD.2~vlfDWI-vv3RhE217kuvJVo_qOJBj_Sx.2 2023-12-03T11:46:32.541 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.539+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 704 2023-12-03T11:46:32.541 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.539+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.16__multipart_foo-STANDARD.2~vlfDWI-vv3RhE217kuvJVo_qOJBj_Sx.3 2023-12-03T11:46:32.541 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.539+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 968 2023-12-03T11:46:32.542 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.539+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-12-03T11:46:32.542 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.539+0000 7f175351e800 20 garbage collection: RGWGC::send_chain - on object name: gc.27tag is: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.16__multipart_foo-STANDARD.2~vlfDWI-vv3RhE217kuvJVo_qOJBj_Sx.2_42d279f30963775c303ba66607dd32af 2023-12-03T11:46:32.542 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.540+0000 7f1732ffd640 20 handle_completion(): completion ok for obj=foo-STANDARD-STANDARD 2023-12-03T11:46:32.542 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.541+0000 7f175351e800 20 get_obj_state: octx=0x7f17440714f0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x556f9b4574c8 s->prefetch_data=0 2023-12-03T11:46:32.542 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.541+0000 7f175351e800 10 manifest: total_size = 11534336 2023-12-03T11:46:32.542 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.541+0000 7f175351e800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2023-12-03T11:46:32.543 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.541+0000 7f175351e800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2023-12-03T11:46:32.543 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.541+0000 7f175351e800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2023-12-03T11:46:32.543 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.541+0000 7f175351e800 10 generate_fake_tag new tag=83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.16__multipart_foo-LUKEWARM.2~bfCD-t6umQHlMAUwQttXrJXmQJk63il.2_cefc65d840a588c26ffb10b6ad8398bb 2023-12-03T11:46:32.543 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.541+0000 7f175351e800 20 get_obj_state: setting s->obj_tag to 83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.16__multipart_foo-LUKEWARM.2~bfCD-t6umQHlMAUwQttXrJXmQJk63il.2_cefc65d840a588c26ffb10b6ad8398bb 2023-12-03T11:46:32.543 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.541+0000 7f175351e800 20 get_obj_state: octx=0x7f17440714f0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x556f9b4574c8 s->prefetch_data=0 2023-12-03T11:46:32.543 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.541+0000 7f175351e800 20 prepare_atomic_modification: state is not atomic. state=0x556f9b4574c8 2023-12-03T11:46:32.543 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.541+0000 7f175351e800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.16.8 2023-12-03T11:46:32.545 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.543+0000 7f175351e800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2023-12-03T11:46:32.545 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.543+0000 7f175351e800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2023-12-03T11:46:32.545 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.543+0000 7f175351e800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2023-12-03T11:46:32.545 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.543+0000 7f175351e800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2023-12-03T11:46:32.545 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.543+0000 7f175351e800 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2023-12-03T11:46:32.545 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.543+0000 7f175351e800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2023-12-03T11:46:32.545 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.543+0000 7f175351e800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2023-12-03T11:46:32.545 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.543+0000 7f175351e800 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2023-12-03T11:46:32.545 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.543+0000 7f175351e800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2023-12-03T11:46:32.545 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.543+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - tag is: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.16__multipart_foo-LUKEWARM.2~bfCD-t6umQHlMAUwQttXrJXmQJk63il.2_cefc65d840a588c26ffb10b6ad8398bb 2023-12-03T11:46:32.545 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.543+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-12-03T11:46:32.545 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.543+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.16__multipart_foo-LUKEWARM.2~bfCD-t6umQHlMAUwQttXrJXmQJk63il.1 2023-12-03T11:46:32.545 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.543+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 449 2023-12-03T11:46:32.546 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.543+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.16__multipart_foo-LUKEWARM.2~bfCD-t6umQHlMAUwQttXrJXmQJk63il.2 2023-12-03T11:46:32.546 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.543+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 722 2023-12-03T11:46:32.546 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.543+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.16__multipart_foo-LUKEWARM.2~bfCD-t6umQHlMAUwQttXrJXmQJk63il.3 2023-12-03T11:46:32.546 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.543+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 995 2023-12-03T11:46:32.546 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.543+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-12-03T11:46:32.546 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.543+0000 7f175351e800 20 garbage collection: RGWGC::send_chain - on object name: gc.13tag is: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.16__multipart_foo-LUKEWARM.2~bfCD-t6umQHlMAUwQttXrJXmQJk63il.2_cefc65d840a588c26ffb10b6ad8398bb 2023-12-03T11:46:32.547 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.545+0000 7f17337fe640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-LUKEWARM 2023-12-03T11:46:32.547 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.545+0000 7f175351e800 20 get_obj_state: octx=0x556f9b44aaf0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x556f9b4574c8 s->prefetch_data=0 2023-12-03T11:46:32.547 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.545+0000 7f175351e800 10 manifest: total_size = 11534336 2023-12-03T11:46:32.547 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.545+0000 7f175351e800 20 get_obj_state: setting s->obj_tag to _EznIcEmKEi_9b9BmqGSoNfXkTnHU4RI 2023-12-03T11:46:32.547 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.545+0000 7f175351e800 20 get_obj_state: octx=0x556f9b44aaf0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x556f9b4574c8 s->prefetch_data=0 2023-12-03T11:46:32.547 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.545+0000 7f175351e800 20 prepare_atomic_modification: state is not atomic. state=0x556f9b4574c8 2023-12-03T11:46:32.547 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.545+0000 7f175351e800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.16.8 2023-12-03T11:46:32.549 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.547+0000 7f175351e800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-12-03T11:46:32.549 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.547+0000 7f175351e800 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2023-12-03T11:46:32.549 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.547+0000 7f175351e800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-12-03T11:46:32.549 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.547+0000 7f175351e800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2023-12-03T11:46:32.549 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.547+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - tag is: _EznIcEmKEi_9b9BmqGSoNfXkTnHU4RI 2023-12-03T11:46:32.549 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.547+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-12-03T11:46:32.549 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.547+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.16__shadow_.LZUr_X3eG0ewdLGaPQ5F_0uxPVDoylo_0 2023-12-03T11:46:32.550 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.547+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2023-12-03T11:46:32.550 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.547+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.16__shadow_.LZUr_X3eG0ewdLGaPQ5F_0uxPVDoylo_1 2023-12-03T11:46:32.550 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.547+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 545 2023-12-03T11:46:32.550 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.547+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-12-03T11:46:32.550 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.547+0000 7f175351e800 20 garbage collection: RGWGC::send_chain - on object name: gc.19tag is: _EznIcEmKEi_9b9BmqGSoNfXkTnHU4RI 2023-12-03T11:46:32.551 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.549+0000 7f175351e800 20 get_obj_state: octx=0x7f174804fe40 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x556f9b4574c8 s->prefetch_data=0 2023-12-03T11:46:32.551 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.549+0000 7f1732ffd640 20 handle_completion(): completion ok for obj=foo-STANDARD-FROZEN 2023-12-03T11:46:32.551 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.549+0000 7f175351e800 10 manifest: total_size = 11534336 2023-12-03T11:46:32.551 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.549+0000 7f175351e800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2023-12-03T11:46:32.551 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.549+0000 7f175351e800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2023-12-03T11:46:32.551 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.549+0000 7f175351e800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2023-12-03T11:46:32.551 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.549+0000 7f175351e800 10 generate_fake_tag new tag=83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.16__multipart_foo-FROZEN.2~4YRdtSB53jf2C5eZb9-7M90nDB43zQo.2_2809218652f117a86fcca578839e03dd 2023-12-03T11:46:32.551 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.549+0000 7f175351e800 20 get_obj_state: setting s->obj_tag to 83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.16__multipart_foo-FROZEN.2~4YRdtSB53jf2C5eZb9-7M90nDB43zQo.2_2809218652f117a86fcca578839e03dd 2023-12-03T11:46:32.551 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.549+0000 7f175351e800 20 get_obj_state: octx=0x7f174804fe40 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x556f9b4574c8 s->prefetch_data=0 2023-12-03T11:46:32.551 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.549+0000 7f175351e800 20 prepare_atomic_modification: state is not atomic. state=0x556f9b4574c8 2023-12-03T11:46:32.551 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.549+0000 7f175351e800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.16.9 2023-12-03T11:46:32.553 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.552+0000 7f175351e800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2023-12-03T11:46:32.553 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.552+0000 7f175351e800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2023-12-03T11:46:32.553 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.552+0000 7f175351e800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2023-12-03T11:46:32.553 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.552+0000 7f175351e800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2023-12-03T11:46:32.553 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.552+0000 7f175351e800 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2023-12-03T11:46:32.553 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.552+0000 7f175351e800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2023-12-03T11:46:32.553 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.552+0000 7f175351e800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2023-12-03T11:46:32.554 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.552+0000 7f175351e800 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2023-12-03T11:46:32.554 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.552+0000 7f175351e800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2023-12-03T11:46:32.554 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.552+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - tag is: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.16__multipart_foo-FROZEN.2~4YRdtSB53jf2C5eZb9-7M90nDB43zQo.2_2809218652f117a86fcca578839e03dd 2023-12-03T11:46:32.554 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.552+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-12-03T11:46:32.554 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.552+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.16__multipart_foo-FROZEN.2~4YRdtSB53jf2C5eZb9-7M90nDB43zQo.1 2023-12-03T11:46:32.554 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.552+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 441 2023-12-03T11:46:32.554 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.552+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.16__multipart_foo-FROZEN.2~4YRdtSB53jf2C5eZb9-7M90nDB43zQo.2 2023-12-03T11:46:32.554 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.552+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 708 2023-12-03T11:46:32.554 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.552+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.16__multipart_foo-FROZEN.2~4YRdtSB53jf2C5eZb9-7M90nDB43zQo.3 2023-12-03T11:46:32.554 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.552+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 975 2023-12-03T11:46:32.554 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.552+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-12-03T11:46:32.554 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.552+0000 7f175351e800 20 garbage collection: RGWGC::send_chain - on object name: gc.3tag is: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.16__multipart_foo-FROZEN.2~4YRdtSB53jf2C5eZb9-7M90nDB43zQo.2_2809218652f117a86fcca578839e03dd 2023-12-03T11:46:32.555 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.553+0000 7f17337fe640 20 handle_completion(): completion ok for obj=foo-FROZEN-FROZEN 2023-12-03T11:46:32.555 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.553+0000 7f175351e800 20 list_objects_ordered: starting attempt 1 2023-12-03T11:46:32.555 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.553+0000 7f175351e800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2023-12-03T11:46:32.555 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.554+0000 7f175351e800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2023-12-03T11:46:32.555 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.554+0000 7f175351e800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2023-12-03T11:46:32.556 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.554+0000 7f175351e800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2023-12-03T11:46:32.556 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.554+0000 7f175351e800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2023-12-03T11:46:32.556 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.554+0000 7f175351e800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart-copy.1[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.16])"; uploads.size()=0; is_truncated=0 2023-12-03T11:46:32.557 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.556+0000 7f175351e800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 : miss 2023-12-03T11:46:32.557 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.556+0000 7f175351e800 20 rados->read ofs=0 len=0 2023-12-03T11:46:32.558 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.556+0000 7f175351e800 20 rados_obj.operate() r=0 bl.length=243 2023-12-03T11:46:32.558 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.556+0000 7f175351e800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x11 2023-12-03T11:46:32.558 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.556+0000 7f175351e800 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2023-12-03T11:46:32.558 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.556+0000 7f175351e800 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 from cache 2023-12-03T11:46:32.558 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.556+0000 7f175351e800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart-copy.1, ofs0, ns] 2023-12-03T11:46:32.558 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.557+0000 7f1732ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660491 cookie 93937834185504 notifier 6069 bl.length()=199 2023-12-03T11:46:32.560 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.559+0000 7f175351e800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.16 from cache 2023-12-03T11:46:32.560 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.559+0000 7f175351e800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.16, ofs0, ns] 2023-12-03T11:46:32.561 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.560+0000 7f1732ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660532 cookie 93937834190112 notifier 6069 bl.length()=257 2023-12-03T11:46:32.566 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.565+0000 7f175351e800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.16 : miss 2023-12-03T11:46:32.567 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.565+0000 7f175351e800 20 rados->read ofs=0 len=0 2023-12-03T11:46:32.567 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.565+0000 7f175351e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:46:32.567 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.565+0000 7f175351e800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.16 info.flags=0x0 2023-12-03T11:46:32.567 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.565+0000 7f175351e800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.16 to cache LRU end 2023-12-03T11:46:32.567 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.565+0000 7f175351e800 10 removing default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.16 from cache 2023-12-03T11:46:32.567 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.565+0000 7f175351e800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.log:pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.16, ofs0, ns] 2023-12-03T11:46:32.567 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.565+0000 7f17337fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660540 cookie 93937831694160 notifier 6069 bl.length()=254 2023-12-03T11:46:32.570 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.569+0000 7f175351e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.14 : miss 2023-12-03T11:46:32.570 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.569+0000 7f175351e800 20 rados->read ofs=0 len=0 2023-12-03T11:46:32.570 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.569+0000 7f175351e800 20 rados_obj.operate() r=0 bl.length=412 2023-12-03T11:46:32.570 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.569+0000 7f175351e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.14 info.flags=0x17 2023-12-03T11:46:32.571 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.569+0000 7f175351e800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.14 to cache LRU end 2023-12-03T11:46:32.571 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.569+0000 7f175351e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:46:32.571 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.569+0000 7f175351e800 10 updating xattr: name=user.rgw.acl bl.length()=209 2023-12-03T11:46:32.571 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.569+0000 7f175351e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.14 2023-12-03T11:46:32.572 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.571+0000 7f175351e800 10 cls_bucket_list_unordered: got foo-FROZEN 2023-12-03T11:46:32.573 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.572+0000 7f175351e800 10 cls_bucket_list_unordered: got foo-STANDARD 2023-12-03T11:46:32.574 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.572+0000 7f175351e800 10 cls_bucket_list_unordered: got foo-LUKEWARM 2023-12-03T11:46:32.575 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.574+0000 7f175351e800 20 get_obj_state: octx=0x556f9b444970 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x556f9b2e5a08 s->prefetch_data=0 2023-12-03T11:46:32.575 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.574+0000 7f175351e800 10 manifest: total_size = 11534336 2023-12-03T11:46:32.576 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.574+0000 7f175351e800 20 get_obj_state: setting s->obj_tag to 83aabb46-04b5-4c96-9933-c6bfb1173a73.4653.2929520179933456401 2023-12-03T11:46:32.576 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.574+0000 7f175351e800 20 get_obj_state: octx=0x556f9b444970 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x556f9b2e5a08 s->prefetch_data=0 2023-12-03T11:46:32.576 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.574+0000 7f175351e800 20 prepare_atomic_modification: state is not atomic. state=0x556f9b2e5a08 2023-12-03T11:46:32.576 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.574+0000 7f175351e800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.14.3 2023-12-03T11:46:32.578 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.577+0000 7f175351e800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2023-12-03T11:46:32.578 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.577+0000 7f175351e800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2023-12-03T11:46:32.578 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.577+0000 7f175351e800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2023-12-03T11:46:32.578 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.577+0000 7f175351e800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2023-12-03T11:46:32.578 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.577+0000 7f175351e800 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2023-12-03T11:46:32.578 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.577+0000 7f175351e800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2023-12-03T11:46:32.578 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.577+0000 7f175351e800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2023-12-03T11:46:32.578 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.577+0000 7f175351e800 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2023-12-03T11:46:32.579 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.577+0000 7f175351e800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2023-12-03T11:46:32.579 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.577+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - tag is: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4653.2929520179933456401 2023-12-03T11:46:32.579 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.577+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-12-03T11:46:32.579 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.577+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.14__multipart_foo-FROZEN.2~MTDqLPi4VuwT2h1ItzjWXaJqcnW9pPj.1 2023-12-03T11:46:32.579 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.577+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 367 2023-12-03T11:46:32.579 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.577+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.14__multipart_foo-FROZEN.2~MTDqLPi4VuwT2h1ItzjWXaJqcnW9pPj.2 2023-12-03T11:46:32.579 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.577+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 634 2023-12-03T11:46:32.579 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.577+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.14__multipart_foo-FROZEN.2~MTDqLPi4VuwT2h1ItzjWXaJqcnW9pPj.3 2023-12-03T11:46:32.579 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.577+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 901 2023-12-03T11:46:32.579 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.577+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-12-03T11:46:32.579 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.577+0000 7f175351e800 20 garbage collection: RGWGC::send_chain - on object name: gc.24tag is: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4653.2929520179933456401 2023-12-03T11:46:32.580 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.578+0000 7f17337fe640 20 handle_completion(): completion ok for obj=foo-FROZEN 2023-12-03T11:46:32.580 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.578+0000 7f175351e800 20 get_obj_state: octx=0x7f174808ce60 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x556f9b2e5a08 s->prefetch_data=0 2023-12-03T11:46:32.580 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.578+0000 7f175351e800 10 manifest: total_size = 541681 2023-12-03T11:46:32.580 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.578+0000 7f175351e800 20 get_obj_state: setting s->obj_tag to 83aabb46-04b5-4c96-9933-c6bfb1173a73.4653.3001255035959802219 2023-12-03T11:46:32.580 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.578+0000 7f175351e800 20 get_obj_state: octx=0x7f174808ce60 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x556f9b2e5a08 s->prefetch_data=0 2023-12-03T11:46:32.580 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.578+0000 7f175351e800 20 prepare_atomic_modification: state is not atomic. state=0x556f9b2e5a08 2023-12-03T11:46:32.580 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.578+0000 7f175351e800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.14.5 2023-12-03T11:46:32.582 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.581+0000 7f175351e800 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2023-12-03T11:46:32.582 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.581+0000 7f175351e800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=246247 2023-12-03T11:46:32.582 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.581+0000 7f175351e800 20 RGWObjManifest::operator++(): result: ofs=246247 stripe_ofs=246247 part_ofs=246247 rule->part_size=246247 2023-12-03T11:46:32.582 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.581+0000 7f175351e800 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2023-12-03T11:46:32.582 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.581+0000 7f175351e800 20 RGWObjManifest::operator++(): stripe_ofs=6537703 part_ofs=246247 rule->part_size=246247 2023-12-03T11:46:32.582 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.581+0000 7f175351e800 20 RGWObjManifest::operator++(): result: ofs=492494 stripe_ofs=492494 part_ofs=492494 rule->part_size=49187 2023-12-03T11:46:32.583 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.581+0000 7f175351e800 20 RGWObjManifest::operator++(): rule->part_size=49187 rules.size()=2 2023-12-03T11:46:32.583 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.581+0000 7f175351e800 20 RGWObjManifest::operator++(): stripe_ofs=6783950 part_ofs=492494 rule->part_size=49187 2023-12-03T11:46:32.583 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.581+0000 7f175351e800 20 RGWObjManifest::operator++(): result: ofs=541681 stripe_ofs=541681 part_ofs=541681 rule->part_size=49187 2023-12-03T11:46:32.583 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.581+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - tag is: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4653.3001255035959802219 2023-12-03T11:46:32.583 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.581+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-12-03T11:46:32.583 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.581+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.14__multipart_foo-STANDARD.2~Tqa8fEyRuSlugOfa9nyU97QwxRbtdc4.1 2023-12-03T11:46:32.583 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.581+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 364 2023-12-03T11:46:32.583 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.581+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.14__multipart_foo-STANDARD.2~Tqa8fEyRuSlugOfa9nyU97QwxRbtdc4.2 2023-12-03T11:46:32.583 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.581+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 628 2023-12-03T11:46:32.583 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.581+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.14__multipart_foo-STANDARD.2~Tqa8fEyRuSlugOfa9nyU97QwxRbtdc4.3 2023-12-03T11:46:32.583 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.581+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 892 2023-12-03T11:46:32.583 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.581+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-12-03T11:46:32.583 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.581+0000 7f175351e800 20 garbage collection: RGWGC::send_chain - on object name: gc.18tag is: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4653.3001255035959802219 2023-12-03T11:46:32.584 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.582+0000 7f1732ffd640 20 handle_completion(): completion ok for obj=foo-STANDARD 2023-12-03T11:46:32.584 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.582+0000 7f175351e800 20 get_obj_state: octx=0x7f1744002ba0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x556f9b2e5a08 s->prefetch_data=0 2023-12-03T11:46:32.584 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.583+0000 7f175351e800 10 manifest: total_size = 11534336 2023-12-03T11:46:32.584 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.583+0000 7f175351e800 20 get_obj_state: setting s->obj_tag to 83aabb46-04b5-4c96-9933-c6bfb1173a73.4653.6196592974454432604 2023-12-03T11:46:32.584 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.583+0000 7f175351e800 20 get_obj_state: octx=0x7f1744002ba0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x556f9b2e5a08 s->prefetch_data=0 2023-12-03T11:46:32.584 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.583+0000 7f175351e800 20 prepare_atomic_modification: state is not atomic. state=0x556f9b2e5a08 2023-12-03T11:46:32.585 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.583+0000 7f175351e800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.14.7 2023-12-03T11:46:32.586 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.585+0000 7f175351e800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2023-12-03T11:46:32.586 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.585+0000 7f175351e800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2023-12-03T11:46:32.587 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.585+0000 7f175351e800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2023-12-03T11:46:32.587 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.585+0000 7f175351e800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2023-12-03T11:46:32.587 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.585+0000 7f175351e800 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2023-12-03T11:46:32.587 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.585+0000 7f175351e800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2023-12-03T11:46:32.587 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.585+0000 7f175351e800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2023-12-03T11:46:32.587 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.585+0000 7f175351e800 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2023-12-03T11:46:32.587 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.585+0000 7f175351e800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2023-12-03T11:46:32.587 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.585+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - tag is: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4653.6196592974454432604 2023-12-03T11:46:32.587 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.585+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-12-03T11:46:32.587 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.585+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.14__multipart_foo-LUKEWARM.2~eij8Msx5VSJfUd9vH0jneBhTaOIhCxb.1 2023-12-03T11:46:32.587 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.585+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 373 2023-12-03T11:46:32.587 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.585+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.14__multipart_foo-LUKEWARM.2~eij8Msx5VSJfUd9vH0jneBhTaOIhCxb.2 2023-12-03T11:46:32.587 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.585+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 646 2023-12-03T11:46:32.587 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.585+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.14__multipart_foo-LUKEWARM.2~eij8Msx5VSJfUd9vH0jneBhTaOIhCxb.3 2023-12-03T11:46:32.588 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.585+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 919 2023-12-03T11:46:32.588 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.585+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-12-03T11:46:32.588 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.585+0000 7f175351e800 20 garbage collection: RGWGC::send_chain - on object name: gc.20tag is: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4653.6196592974454432604 2023-12-03T11:46:32.588 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.586+0000 7f17337fe640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2023-12-03T11:46:32.588 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.587+0000 7f175351e800 20 list_objects_ordered: starting attempt 1 2023-12-03T11:46:32.588 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.587+0000 7f175351e800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2023-12-03T11:46:32.589 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.587+0000 7f175351e800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2023-12-03T11:46:32.589 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.587+0000 7f175351e800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2023-12-03T11:46:32.589 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.587+0000 7f175351e800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2023-12-03T11:46:32.589 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.587+0000 7f175351e800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2023-12-03T11:46:32.589 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.587+0000 7f175351e800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart.1[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.14])"; uploads.size()=0; is_truncated=0 2023-12-03T11:46:32.592 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.589+0000 7f175351e800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 : miss 2023-12-03T11:46:32.592 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.589+0000 7f175351e800 20 rados->read ofs=0 len=0 2023-12-03T11:46:32.592 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.590+0000 7f175351e800 20 rados_obj.operate() r=0 bl.length=238 2023-12-03T11:46:32.592 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.590+0000 7f175351e800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 info.flags=0x11 2023-12-03T11:46:32.593 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.590+0000 7f175351e800 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 to cache LRU end 2023-12-03T11:46:32.593 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.590+0000 7f175351e800 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 from cache 2023-12-03T11:46:32.593 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.590+0000 7f175351e800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart.1, ofs0, ns] 2023-12-03T11:46:32.593 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.590+0000 7f1732ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660554 cookie 93937834194304 notifier 6069 bl.length()=194 2023-12-03T11:46:32.594 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.593+0000 7f175351e800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.14 from cache 2023-12-03T11:46:32.594 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.593+0000 7f175351e800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.14, ofs0, ns] 2023-12-03T11:46:32.594 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.593+0000 7f17337fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660533 cookie 93937834190112 notifier 6069 bl.length()=252 2023-12-03T11:46:32.600 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.598+0000 7f175351e800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.14 : miss 2023-12-03T11:46:32.600 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.598+0000 7f175351e800 20 rados->read ofs=0 len=0 2023-12-03T11:46:32.600 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.599+0000 7f175351e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:46:32.600 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.599+0000 7f175351e800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.14 info.flags=0x0 2023-12-03T11:46:32.600 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.599+0000 7f175351e800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.14 to cache LRU end 2023-12-03T11:46:32.600 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.599+0000 7f175351e800 10 removing default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.14 from cache 2023-12-03T11:46:32.600 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.599+0000 7f175351e800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.log:pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.14, ofs0, ns] 2023-12-03T11:46:32.601 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.599+0000 7f17337fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660541 cookie 93937831694160 notifier 6069 bl.length()=249 2023-12-03T11:46:32.604 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.602+0000 7f175351e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.13 : miss 2023-12-03T11:46:32.604 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.602+0000 7f175351e800 20 rados->read ofs=0 len=0 2023-12-03T11:46:32.604 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.603+0000 7f175351e800 20 rados_obj.operate() r=0 bl.length=402 2023-12-03T11:46:32.604 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.603+0000 7f175351e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.13 info.flags=0x17 2023-12-03T11:46:32.604 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.603+0000 7f175351e800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.13 to cache LRU end 2023-12-03T11:46:32.605 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.603+0000 7f175351e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:46:32.605 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.603+0000 7f175351e800 10 updating xattr: name=user.rgw.acl bl.length()=209 2023-12-03T11:46:32.605 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.603+0000 7f175351e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.13 2023-12-03T11:46:32.606 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.604+0000 7f175351e800 10 cls_bucket_list_unordered: got foo-FROZEN 2023-12-03T11:46:32.606 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.605+0000 7f175351e800 10 cls_bucket_list_unordered: got foo-STANDARD 2023-12-03T11:46:32.607 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.606+0000 7f175351e800 10 cls_bucket_list_unordered: got foo-LUKEWARM 2023-12-03T11:46:32.608 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.607+0000 7f175351e800 20 get_obj_state: octx=0x556f9b45fd70 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x556f9b454a28 s->prefetch_data=0 2023-12-03T11:46:32.609 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.607+0000 7f175351e800 10 manifest: total_size = 10485760 2023-12-03T11:46:32.609 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.607+0000 7f175351e800 20 get_obj_state: setting s->obj_tag to 83aabb46-04b5-4c96-9933-c6bfb1173a73.4653.3661947526298669191 2023-12-03T11:46:32.609 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.607+0000 7f175351e800 20 get_obj_state: octx=0x556f9b45fd70 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x556f9b454a28 s->prefetch_data=0 2023-12-03T11:46:32.609 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.607+0000 7f175351e800 20 prepare_atomic_modification: state is not atomic. state=0x556f9b454a28 2023-12-03T11:46:32.609 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.607+0000 7f175351e800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.13.3 2023-12-03T11:46:32.611 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.610+0000 7f175351e800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-12-03T11:46:32.611 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.610+0000 7f175351e800 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2023-12-03T11:46:32.611 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.610+0000 7f175351e800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-12-03T11:46:32.611 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.610+0000 7f175351e800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2023-12-03T11:46:32.611 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.610+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - tag is: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4653.3661947526298669191 2023-12-03T11:46:32.612 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.610+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-12-03T11:46:32.612 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.610+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.13__shadow_.cSalt2bVl9tMrElFsaOam8DkIJpA2y4_0 2023-12-03T11:46:32.612 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.610+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 337 2023-12-03T11:46:32.612 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.610+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.13__shadow_.cSalt2bVl9tMrElFsaOam8DkIJpA2y4_1 2023-12-03T11:46:32.612 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.610+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 574 2023-12-03T11:46:32.612 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.610+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-12-03T11:46:32.612 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.610+0000 7f175351e800 20 garbage collection: RGWGC::send_chain - on object name: gc.1tag is: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4653.3661947526298669191 2023-12-03T11:46:32.612 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.611+0000 7f17337fe640 20 handle_completion(): completion ok for obj=foo-FROZEN 2023-12-03T11:46:32.613 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.611+0000 7f175351e800 20 get_obj_state: octx=0x7f1748079860 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x556f9b454a28 s->prefetch_data=0 2023-12-03T11:46:32.613 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.612+0000 7f175351e800 10 manifest: total_size = 3300 2023-12-03T11:46:32.613 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.612+0000 7f175351e800 20 get_obj_state: setting s->obj_tag to 83aabb46-04b5-4c96-9933-c6bfb1173a73.4653.10055708794498939429 2023-12-03T11:46:32.613 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.612+0000 7f175351e800 20 get_obj_state: octx=0x7f1748079860 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x556f9b454a28 s->prefetch_data=0 2023-12-03T11:46:32.613 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.612+0000 7f175351e800 20 prepare_atomic_modification: state is not atomic. state=0x556f9b454a28 2023-12-03T11:46:32.613 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.612+0000 7f175351e800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.13.5 2023-12-03T11:46:32.615 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.614+0000 7f175351e800 20 get_obj_state: octx=0x7f1744057e00 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x556f9b454a28 s->prefetch_data=0 2023-12-03T11:46:32.616 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.614+0000 7f175351e800 10 manifest: total_size = 10485760 2023-12-03T11:46:32.616 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.614+0000 7f175351e800 20 get_obj_state: setting s->obj_tag to 83aabb46-04b5-4c96-9933-c6bfb1173a73.4653.18377131291731228815 2023-12-03T11:46:32.616 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.614+0000 7f175351e800 20 get_obj_state: octx=0x7f1744057e00 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x556f9b454a28 s->prefetch_data=0 2023-12-03T11:46:32.616 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.614+0000 7f175351e800 20 prepare_atomic_modification: state is not atomic. state=0x556f9b454a28 2023-12-03T11:46:32.616 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.614+0000 7f175351e800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.13.7 2023-12-03T11:46:32.616 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.615+0000 7f1732ffd640 20 handle_completion(): completion ok for obj=foo-STANDARD 2023-12-03T11:46:32.618 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.617+0000 7f175351e800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-12-03T11:46:32.618 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.617+0000 7f175351e800 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2023-12-03T11:46:32.618 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.617+0000 7f175351e800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-12-03T11:46:32.618 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.617+0000 7f175351e800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2023-12-03T11:46:32.618 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.617+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - tag is: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4653.18377131291731228815 2023-12-03T11:46:32.618 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.617+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-12-03T11:46:32.619 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.617+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.13__shadow_.ik8QhLSFaKVGUyYl7ip2DOf7bSU7olg_0 2023-12-03T11:46:32.619 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.617+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 340 2023-12-03T11:46:32.619 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.617+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.13__shadow_.ik8QhLSFaKVGUyYl7ip2DOf7bSU7olg_1 2023-12-03T11:46:32.619 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.617+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 579 2023-12-03T11:46:32.619 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.617+0000 7f175351e800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-12-03T11:46:32.619 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.617+0000 7f175351e800 20 garbage collection: RGWGC::send_chain - on object name: gc.15tag is: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4653.18377131291731228815 2023-12-03T11:46:32.621 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.618+0000 7f17337fe640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2023-12-03T11:46:32.622 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.618+0000 7f175351e800 20 list_objects_ordered: starting attempt 1 2023-12-03T11:46:32.622 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.618+0000 7f175351e800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2023-12-03T11:46:32.622 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.619+0000 7f175351e800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2023-12-03T11:46:32.622 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.619+0000 7f175351e800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2023-12-03T11:46:32.622 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.619+0000 7f175351e800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2023-12-03T11:46:32.622 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.619+0000 7f175351e800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2023-12-03T11:46:32.622 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.619+0000 7f175351e800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class.1[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.13])"; uploads.size()=0; is_truncated=0 2023-12-03T11:46:32.623 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.621+0000 7f175351e800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 : miss 2023-12-03T11:46:32.623 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.621+0000 7f175351e800 20 rados->read ofs=0 len=0 2023-12-03T11:46:32.623 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.621+0000 7f175351e800 20 rados_obj.operate() r=0 bl.length=228 2023-12-03T11:46:32.623 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.621+0000 7f175351e800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 info.flags=0x11 2023-12-03T11:46:32.623 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.621+0000 7f175351e800 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 to cache LRU end 2023-12-03T11:46:32.623 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.621+0000 7f175351e800 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 from cache 2023-12-03T11:46:32.623 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.621+0000 7f175351e800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class.1, ofs0, ns] 2023-12-03T11:46:32.623 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.622+0000 7f1732ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660499 cookie 93937834184464 notifier 6069 bl.length()=184 2023-12-03T11:46:32.625 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.624+0000 7f175351e800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.13 from cache 2023-12-03T11:46:32.626 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.624+0000 7f175351e800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class.1:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.13, ofs0, ns] 2023-12-03T11:46:32.626 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.625+0000 7f1732ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660492 cookie 93937834185504 notifier 6069 bl.length()=242 2023-12-03T11:46:32.632 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.629+0000 7f175351e800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.13 : miss 2023-12-03T11:46:32.632 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.629+0000 7f175351e800 20 rados->read ofs=0 len=0 2023-12-03T11:46:32.632 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.630+0000 7f175351e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:46:32.632 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.630+0000 7f175351e800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.13 info.flags=0x0 2023-12-03T11:46:32.632 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.630+0000 7f175351e800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.13 to cache LRU end 2023-12-03T11:46:32.632 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.630+0000 7f175351e800 10 removing default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.13 from cache 2023-12-03T11:46:32.632 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.630+0000 7f175351e800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.log:pubsub..bucket.test-client.0-r-test-obj-storage-class.1/83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.13, ofs0, ns] 2023-12-03T11:46:32.632 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.630+0000 7f17337fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660534 cookie 139738036248576 notifier 6069 bl.length()=239 2023-12-03T11:46:32.634 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.633+0000 7f175351e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.6 : miss 2023-12-03T11:46:32.635 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.633+0000 7f175351e800 20 rados->read ofs=0 len=0 2023-12-03T11:46:32.635 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.634+0000 7f175351e800 20 rados_obj.operate() r=0 bl.length=397 2023-12-03T11:46:32.635 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.634+0000 7f175351e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.6 info.flags=0x17 2023-12-03T11:46:32.635 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.634+0000 7f175351e800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.6 to cache LRU end 2023-12-03T11:46:32.635 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.634+0000 7f175351e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:46:32.635 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.634+0000 7f175351e800 10 updating xattr: name=user.rgw.acl bl.length()=209 2023-12-03T11:46:32.635 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.634+0000 7f175351e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.6 2023-12-03T11:46:32.636 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.635+0000 7f175351e800 10 cls_bucket_list_unordered: got ___ 2023-12-03T11:46:32.636 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.635+0000 7f175351e800 10 cls_bucket_list_unordered: got __ _ 2023-12-03T11:46:32.638 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.637+0000 7f175351e800 10 cls_bucket_list_unordered: got __ 2023-12-03T11:46:32.639 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.638+0000 7f175351e800 10 cls_bucket_list_unordered: got obj 2023-12-03T11:46:32.639 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.638+0000 7f175351e800 20 get_obj_state: octx=0x556f9b440c20 obj=test-client.0-r-test-small-obj-data.1:___ state=0x556f9b46a228 s->prefetch_data=0 2023-12-03T11:46:32.640 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.638+0000 7f175351e800 10 manifest: total_size = 0 2023-12-03T11:46:32.640 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.638+0000 7f175351e800 20 get_obj_state: setting s->obj_tag to 83aabb46-04b5-4c96-9933-c6bfb1173a73.4653.15690861765209680614 2023-12-03T11:46:32.640 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.638+0000 7f175351e800 20 get_obj_state: octx=0x556f9b440c20 obj=test-client.0-r-test-small-obj-data.1:___ state=0x556f9b46a228 s->prefetch_data=0 2023-12-03T11:46:32.640 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.638+0000 7f175351e800 20 prepare_atomic_modification: state is not atomic. state=0x556f9b46a228 2023-12-03T11:46:32.640 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.639+0000 7f175351e800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.6.2 2023-12-03T11:46:32.643 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.642+0000 7f175351e800 20 get_obj_state: octx=0x7f17440714f0 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x556f9b46a228 s->prefetch_data=0 2023-12-03T11:46:32.643 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.642+0000 7f175351e800 10 manifest: total_size = 0 2023-12-03T11:46:32.643 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.642+0000 7f175351e800 20 get_obj_state: setting s->obj_tag to 83aabb46-04b5-4c96-9933-c6bfb1173a73.4653.16655881069545269911 2023-12-03T11:46:32.643 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.642+0000 7f175351e800 20 get_obj_state: octx=0x7f17440714f0 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x556f9b46a228 s->prefetch_data=0 2023-12-03T11:46:32.643 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.642+0000 7f175351e800 20 prepare_atomic_modification: state is not atomic. state=0x556f9b46a228 2023-12-03T11:46:32.643 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.642+0000 7f175351e800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.6.3 2023-12-03T11:46:32.644 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.643+0000 7f17337fe640 20 handle_completion(): completion ok for obj=___ 2023-12-03T11:46:32.646 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.644+0000 7f175351e800 20 get_obj_state: octx=0x7f1744059230 obj=test-client.0-r-test-small-obj-data.1:__ state=0x556f9b46a228 s->prefetch_data=0 2023-12-03T11:46:32.646 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.645+0000 7f175351e800 10 manifest: total_size = 0 2023-12-03T11:46:32.646 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.645+0000 7f175351e800 20 get_obj_state: setting s->obj_tag to 83aabb46-04b5-4c96-9933-c6bfb1173a73.4653.1385832375521404520 2023-12-03T11:46:32.646 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.645+0000 7f175351e800 20 get_obj_state: octx=0x7f1744059230 obj=test-client.0-r-test-small-obj-data.1:__ state=0x556f9b46a228 s->prefetch_data=0 2023-12-03T11:46:32.647 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.645+0000 7f175351e800 20 prepare_atomic_modification: state is not atomic. state=0x556f9b46a228 2023-12-03T11:46:32.647 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.645+0000 7f175351e800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.6.6 2023-12-03T11:46:32.647 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.646+0000 7f1732ffd640 20 handle_completion(): completion ok for obj=__ _ 2023-12-03T11:46:32.649 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.647+0000 7f175351e800 20 get_obj_state: octx=0x7f17440714f0 obj=test-client.0-r-test-small-obj-data.1:obj state=0x556f9b46a228 s->prefetch_data=0 2023-12-03T11:46:32.649 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.648+0000 7f175351e800 10 manifest: total_size = 0 2023-12-03T11:46:32.649 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.648+0000 7f175351e800 20 get_obj_state: setting s->obj_tag to 83aabb46-04b5-4c96-9933-c6bfb1173a73.4653.9828834552190027442 2023-12-03T11:46:32.649 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.648+0000 7f175351e800 20 get_obj_state: octx=0x7f17440714f0 obj=test-client.0-r-test-small-obj-data.1:obj state=0x556f9b46a228 s->prefetch_data=0 2023-12-03T11:46:32.649 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.648+0000 7f175351e800 20 prepare_atomic_modification: state is not atomic. state=0x556f9b46a228 2023-12-03T11:46:32.649 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.648+0000 7f175351e800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.6.8 2023-12-03T11:46:32.650 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.649+0000 7f17337fe640 20 handle_completion(): completion ok for obj=__ 2023-12-03T11:46:32.653 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.650+0000 7f175351e800 20 list_objects_ordered: starting attempt 1 2023-12-03T11:46:32.653 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.650+0000 7f175351e800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2023-12-03T11:46:32.653 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.652+0000 7f1732ffd640 20 handle_completion(): completion ok for obj=obj 2023-12-03T11:46:32.654 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.652+0000 7f175351e800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2023-12-03T11:46:32.654 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.652+0000 7f175351e800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2023-12-03T11:46:32.654 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.652+0000 7f175351e800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2023-12-03T11:46:32.654 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.652+0000 7f175351e800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2023-12-03T11:46:32.654 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.652+0000 7f175351e800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.1[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.6])"; uploads.size()=0; is_truncated=0 2023-12-03T11:46:32.655 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.654+0000 7f175351e800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 : miss 2023-12-03T11:46:32.655 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.654+0000 7f175351e800 20 rados->read ofs=0 len=0 2023-12-03T11:46:32.656 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.654+0000 7f175351e800 20 rados_obj.operate() r=0 bl.length=223 2023-12-03T11:46:32.656 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.654+0000 7f175351e800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 info.flags=0x11 2023-12-03T11:46:32.656 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.654+0000 7f175351e800 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 to cache LRU end 2023-12-03T11:46:32.656 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.654+0000 7f175351e800 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 from cache 2023-12-03T11:46:32.656 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.654+0000 7f175351e800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.1, ofs0, ns] 2023-12-03T11:46:32.656 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.655+0000 7f17337fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660542 cookie 93937831694160 notifier 6069 bl.length()=181 2023-12-03T11:46:32.659 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.658+0000 7f175351e800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.6 from cache 2023-12-03T11:46:32.659 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.658+0000 7f175351e800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.1:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.6, ofs0, ns] 2023-12-03T11:46:32.659 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.658+0000 7f17337fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660494 cookie 93937834191664 notifier 6069 bl.length()=238 2023-12-03T11:46:32.667 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.665+0000 7f175351e800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.6 : miss 2023-12-03T11:46:32.667 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.665+0000 7f175351e800 20 rados->read ofs=0 len=0 2023-12-03T11:46:32.667 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.665+0000 7f175351e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:46:32.667 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.665+0000 7f175351e800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.6 info.flags=0x0 2023-12-03T11:46:32.667 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.665+0000 7f175351e800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.6 to cache LRU end 2023-12-03T11:46:32.667 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.665+0000 7f175351e800 10 removing default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.6 from cache 2023-12-03T11:46:32.667 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.665+0000 7f175351e800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.log:pubsub..bucket.test-client.0-r-test-small-obj-data.1/83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.6, ofs0, ns] 2023-12-03T11:46:32.667 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.665+0000 7f1732ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660555 cookie 93937834199328 notifier 6069 bl.length()=235 2023-12-03T11:46:32.670 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.669+0000 7f175351e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.7 : miss 2023-12-03T11:46:32.670 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.669+0000 7f175351e800 20 rados->read ofs=0 len=0 2023-12-03T11:46:32.670 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.669+0000 7f175351e800 20 rados_obj.operate() r=0 bl.length=397 2023-12-03T11:46:32.671 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.669+0000 7f175351e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.7 info.flags=0x17 2023-12-03T11:46:32.671 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.669+0000 7f175351e800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.7 to cache LRU end 2023-12-03T11:46:32.671 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.669+0000 7f175351e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:46:32.671 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.669+0000 7f175351e800 10 updating xattr: name=user.rgw.acl bl.length()=209 2023-12-03T11:46:32.671 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.669+0000 7f175351e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.7 2023-12-03T11:46:32.671 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.670+0000 7f175351e800 10 cls_bucket_list_unordered: got ___ 2023-12-03T11:46:32.672 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.671+0000 7f175351e800 10 cls_bucket_list_unordered: got __ _ 2023-12-03T11:46:32.673 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.672+0000 7f175351e800 10 cls_bucket_list_unordered: got __ 2023-12-03T11:46:32.673 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.672+0000 7f175351e800 10 cls_bucket_list_unordered: got obj 2023-12-03T11:46:32.674 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.673+0000 7f175351e800 20 get_obj_state: octx=0x556f9b458940 obj=test-client.0-r-test-small-obj-data.2:___ state=0x556f9b44be98 s->prefetch_data=0 2023-12-03T11:46:32.674 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.673+0000 7f175351e800 10 manifest: total_size = 2078 2023-12-03T11:46:32.675 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.673+0000 7f175351e800 20 get_obj_state: setting s->obj_tag to 83aabb46-04b5-4c96-9933-c6bfb1173a73.4653.4732394476257443416 2023-12-03T11:46:32.675 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.673+0000 7f175351e800 20 get_obj_state: octx=0x556f9b458940 obj=test-client.0-r-test-small-obj-data.2:___ state=0x556f9b44be98 s->prefetch_data=0 2023-12-03T11:46:32.675 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.673+0000 7f175351e800 20 prepare_atomic_modification: state is not atomic. state=0x556f9b44be98 2023-12-03T11:46:32.675 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.673+0000 7f175351e800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.7.2 2023-12-03T11:46:32.677 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.676+0000 7f175351e800 20 get_obj_state: octx=0x7f174c01d260 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x556f9b44be98 s->prefetch_data=0 2023-12-03T11:46:32.677 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.676+0000 7f175351e800 10 manifest: total_size = 2078 2023-12-03T11:46:32.678 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.676+0000 7f175351e800 20 get_obj_state: setting s->obj_tag to 83aabb46-04b5-4c96-9933-c6bfb1173a73.4653.15095319434942761174 2023-12-03T11:46:32.678 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.676+0000 7f175351e800 20 get_obj_state: octx=0x7f174c01d260 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x556f9b44be98 s->prefetch_data=0 2023-12-03T11:46:32.678 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.676+0000 7f175351e800 20 prepare_atomic_modification: state is not atomic. state=0x556f9b44be98 2023-12-03T11:46:32.678 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.676+0000 7f175351e800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.7.3 2023-12-03T11:46:32.678 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.677+0000 7f17337fe640 20 handle_completion(): completion ok for obj=___ 2023-12-03T11:46:32.680 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.679+0000 7f175351e800 20 get_obj_state: octx=0x7f17440714f0 obj=test-client.0-r-test-small-obj-data.2:__ state=0x556f9b44be98 s->prefetch_data=0 2023-12-03T11:46:32.681 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.679+0000 7f175351e800 10 manifest: total_size = 38 2023-12-03T11:46:32.681 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.679+0000 7f175351e800 20 get_obj_state: setting s->obj_tag to 83aabb46-04b5-4c96-9933-c6bfb1173a73.4653.5115339793625505134 2023-12-03T11:46:32.681 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.679+0000 7f175351e800 20 get_obj_state: octx=0x7f17440714f0 obj=test-client.0-r-test-small-obj-data.2:__ state=0x556f9b44be98 s->prefetch_data=0 2023-12-03T11:46:32.681 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.679+0000 7f175351e800 20 prepare_atomic_modification: state is not atomic. state=0x556f9b44be98 2023-12-03T11:46:32.681 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.679+0000 7f175351e800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.7.6 2023-12-03T11:46:32.681 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.680+0000 7f1732ffd640 20 handle_completion(): completion ok for obj=__ _ 2023-12-03T11:46:32.684 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.683+0000 7f175351e800 20 get_obj_state: octx=0x7f174808a8c0 obj=test-client.0-r-test-small-obj-data.2:obj state=0x556f9b44be98 s->prefetch_data=0 2023-12-03T11:46:32.684 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.683+0000 7f175351e800 10 manifest: total_size = 24595 2023-12-03T11:46:32.684 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.683+0000 7f175351e800 20 get_obj_state: setting s->obj_tag to 83aabb46-04b5-4c96-9933-c6bfb1173a73.4653.10877971891659879499 2023-12-03T11:46:32.684 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.683+0000 7f175351e800 20 get_obj_state: octx=0x7f174808a8c0 obj=test-client.0-r-test-small-obj-data.2:obj state=0x556f9b44be98 s->prefetch_data=0 2023-12-03T11:46:32.684 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.683+0000 7f175351e800 20 prepare_atomic_modification: state is not atomic. state=0x556f9b44be98 2023-12-03T11:46:32.684 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.683+0000 7f175351e800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.7.8 2023-12-03T11:46:32.685 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.684+0000 7f17337fe640 20 handle_completion(): completion ok for obj=__ 2023-12-03T11:46:32.686 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.685+0000 7f175351e800 20 list_objects_ordered: starting attempt 1 2023-12-03T11:46:32.687 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.685+0000 7f175351e800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2023-12-03T11:46:32.688 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.687+0000 7f1732ffd640 20 handle_completion(): completion ok for obj=obj 2023-12-03T11:46:32.688 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.687+0000 7f175351e800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2023-12-03T11:46:32.688 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.687+0000 7f175351e800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2023-12-03T11:46:32.688 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.687+0000 7f175351e800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2023-12-03T11:46:32.689 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.687+0000 7f175351e800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2023-12-03T11:46:32.689 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.687+0000 7f175351e800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.2[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.7])"; uploads.size()=0; is_truncated=0 2023-12-03T11:46:32.690 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.689+0000 7f175351e800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 : miss 2023-12-03T11:46:32.690 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.689+0000 7f175351e800 20 rados->read ofs=0 len=0 2023-12-03T11:46:32.690 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.689+0000 7f175351e800 20 rados_obj.operate() r=0 bl.length=223 2023-12-03T11:46:32.690 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.689+0000 7f175351e800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 info.flags=0x11 2023-12-03T11:46:32.691 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.689+0000 7f175351e800 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 to cache LRU end 2023-12-03T11:46:32.691 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.689+0000 7f175351e800 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 from cache 2023-12-03T11:46:32.691 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.689+0000 7f175351e800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.2, ofs0, ns] 2023-12-03T11:46:32.691 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.689+0000 7f1732ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660543 cookie 93937831694160 notifier 6069 bl.length()=181 2023-12-03T11:46:32.694 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.692+0000 7f175351e800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.7 from cache 2023-12-03T11:46:32.694 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.692+0000 7f175351e800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.2:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.7, ofs0, ns] 2023-12-03T11:46:32.694 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.692+0000 7f17337fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660495 cookie 93937834191664 notifier 6069 bl.length()=238 2023-12-03T11:46:32.699 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.697+0000 7f175351e800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.7 : miss 2023-12-03T11:46:32.699 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.697+0000 7f175351e800 20 rados->read ofs=0 len=0 2023-12-03T11:46:32.699 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.697+0000 7f175351e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:46:32.699 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.697+0000 7f175351e800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.7 info.flags=0x0 2023-12-03T11:46:32.699 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.697+0000 7f175351e800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.7 to cache LRU end 2023-12-03T11:46:32.699 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.697+0000 7f175351e800 10 removing default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.7 from cache 2023-12-03T11:46:32.699 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.697+0000 7f175351e800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.log:pubsub..bucket.test-client.0-r-test-small-obj-data.2/83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.7, ofs0, ns] 2023-12-03T11:46:32.699 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.698+0000 7f1732ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660556 cookie 93937834199328 notifier 6069 bl.length()=235 2023-12-03T11:46:32.702 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.701+0000 7f175351e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.8 : miss 2023-12-03T11:46:32.702 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.701+0000 7f175351e800 20 rados->read ofs=0 len=0 2023-12-03T11:46:32.703 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.702+0000 7f175351e800 20 rados_obj.operate() r=0 bl.length=397 2023-12-03T11:46:32.703 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.702+0000 7f175351e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.8 info.flags=0x17 2023-12-03T11:46:32.703 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.702+0000 7f175351e800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.8 to cache LRU end 2023-12-03T11:46:32.703 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.702+0000 7f175351e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:46:32.703 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.702+0000 7f175351e800 10 updating xattr: name=user.rgw.acl bl.length()=209 2023-12-03T11:46:32.703 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.702+0000 7f175351e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.8 2023-12-03T11:46:32.704 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.703+0000 7f175351e800 10 cls_bucket_list_unordered: got ___ 2023-12-03T11:46:32.704 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.703+0000 7f175351e800 10 cls_bucket_list_unordered: got __ _ 2023-12-03T11:46:32.705 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.704+0000 7f175351e800 10 cls_bucket_list_unordered: got __ 2023-12-03T11:46:32.706 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.705+0000 7f175351e800 10 cls_bucket_list_unordered: got obj 2023-12-03T11:46:32.706 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.705+0000 7f175351e800 20 get_obj_state: octx=0x7f1744057e00 obj=test-client.0-r-test-small-obj-data.3:___ state=0x556f9b44c778 s->prefetch_data=0 2023-12-03T11:46:32.707 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.706+0000 7f175351e800 10 manifest: total_size = 49187 2023-12-03T11:46:32.707 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.706+0000 7f175351e800 20 get_obj_state: setting s->obj_tag to 83aabb46-04b5-4c96-9933-c6bfb1173a73.4653.3120308610613103794 2023-12-03T11:46:32.707 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.706+0000 7f175351e800 20 get_obj_state: octx=0x7f1744057e00 obj=test-client.0-r-test-small-obj-data.3:___ state=0x556f9b44c778 s->prefetch_data=0 2023-12-03T11:46:32.707 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.706+0000 7f175351e800 20 prepare_atomic_modification: state is not atomic. state=0x556f9b44c778 2023-12-03T11:46:32.707 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.706+0000 7f175351e800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.8.2 2023-12-03T11:46:32.710 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.709+0000 7f175351e800 20 get_obj_state: octx=0x7f1748079860 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x556f9b44c778 s->prefetch_data=0 2023-12-03T11:46:32.710 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.709+0000 7f175351e800 10 manifest: total_size = 55 2023-12-03T11:46:32.711 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.709+0000 7f175351e800 20 get_obj_state: setting s->obj_tag to 83aabb46-04b5-4c96-9933-c6bfb1173a73.4653.5402617449052286324 2023-12-03T11:46:32.711 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.709+0000 7f175351e800 20 get_obj_state: octx=0x7f1748079860 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x556f9b44c778 s->prefetch_data=0 2023-12-03T11:46:32.711 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.709+0000 7f175351e800 20 prepare_atomic_modification: state is not atomic. state=0x556f9b44c778 2023-12-03T11:46:32.711 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.709+0000 7f175351e800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.8.3 2023-12-03T11:46:32.711 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.710+0000 7f1732ffd640 20 handle_completion(): completion ok for obj=___ 2023-12-03T11:46:32.713 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.712+0000 7f175351e800 20 get_obj_state: octx=0x7f174c01d260 obj=test-client.0-r-test-small-obj-data.3:__ state=0x556f9b44c778 s->prefetch_data=0 2023-12-03T11:46:32.713 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.712+0000 7f175351e800 10 manifest: total_size = 55 2023-12-03T11:46:32.714 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.712+0000 7f175351e800 20 get_obj_state: setting s->obj_tag to 83aabb46-04b5-4c96-9933-c6bfb1173a73.4653.9764823553060945061 2023-12-03T11:46:32.714 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.712+0000 7f175351e800 20 get_obj_state: octx=0x7f174c01d260 obj=test-client.0-r-test-small-obj-data.3:__ state=0x556f9b44c778 s->prefetch_data=0 2023-12-03T11:46:32.714 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.712+0000 7f175351e800 20 prepare_atomic_modification: state is not atomic. state=0x556f9b44c778 2023-12-03T11:46:32.714 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.712+0000 7f175351e800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.8.6 2023-12-03T11:46:32.714 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.713+0000 7f17337fe640 20 handle_completion(): completion ok for obj=__ _ 2023-12-03T11:46:32.716 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.715+0000 7f175351e800 20 get_obj_state: octx=0x7f174406d4a0 obj=test-client.0-r-test-small-obj-data.3:obj state=0x556f9b44c778 s->prefetch_data=0 2023-12-03T11:46:32.716 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.715+0000 7f175351e800 10 manifest: total_size = 1048576 2023-12-03T11:46:32.717 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.715+0000 7f175351e800 20 get_obj_state: setting s->obj_tag to 83aabb46-04b5-4c96-9933-c6bfb1173a73.4653.4058819068422726424 2023-12-03T11:46:32.717 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.715+0000 7f175351e800 20 get_obj_state: octx=0x7f174406d4a0 obj=test-client.0-r-test-small-obj-data.3:obj state=0x556f9b44c778 s->prefetch_data=0 2023-12-03T11:46:32.717 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.715+0000 7f175351e800 20 prepare_atomic_modification: state is not atomic. state=0x556f9b44c778 2023-12-03T11:46:32.717 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.715+0000 7f175351e800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.8.8 2023-12-03T11:46:32.717 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.716+0000 7f1732ffd640 20 handle_completion(): completion ok for obj=__ 2023-12-03T11:46:32.719 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.718+0000 7f175351e800 20 list_objects_ordered: starting attempt 1 2023-12-03T11:46:32.719 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.718+0000 7f175351e800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2023-12-03T11:46:32.720 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.719+0000 7f17337fe640 20 handle_completion(): completion ok for obj=obj 2023-12-03T11:46:32.720 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.719+0000 7f175351e800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2023-12-03T11:46:32.720 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.719+0000 7f175351e800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2023-12-03T11:46:32.721 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.719+0000 7f175351e800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2023-12-03T11:46:32.721 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.719+0000 7f175351e800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2023-12-03T11:46:32.721 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.719+0000 7f175351e800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.3[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.8])"; uploads.size()=0; is_truncated=0 2023-12-03T11:46:32.722 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.721+0000 7f175351e800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 : miss 2023-12-03T11:46:32.722 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.721+0000 7f175351e800 20 rados->read ofs=0 len=0 2023-12-03T11:46:32.723 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.721+0000 7f175351e800 20 rados_obj.operate() r=0 bl.length=223 2023-12-03T11:46:32.723 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.721+0000 7f175351e800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 info.flags=0x11 2023-12-03T11:46:32.723 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.721+0000 7f175351e800 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 to cache LRU end 2023-12-03T11:46:32.724 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.721+0000 7f175351e800 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 from cache 2023-12-03T11:46:32.724 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.721+0000 7f175351e800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.3, ofs0, ns] 2023-12-03T11:46:32.724 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.722+0000 7f1732ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660544 cookie 93937831694160 notifier 6069 bl.length()=181 2023-12-03T11:46:32.726 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.725+0000 7f175351e800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.8 from cache 2023-12-03T11:46:32.726 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.725+0000 7f175351e800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.3:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.8, ofs0, ns] 2023-12-03T11:46:32.726 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.725+0000 7f17337fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660496 cookie 93937834191664 notifier 6069 bl.length()=238 2023-12-03T11:46:32.732 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.730+0000 7f175351e800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.8 : miss 2023-12-03T11:46:32.732 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.730+0000 7f175351e800 20 rados->read ofs=0 len=0 2023-12-03T11:46:32.732 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.730+0000 7f175351e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:46:32.732 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.730+0000 7f175351e800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.8 info.flags=0x0 2023-12-03T11:46:32.732 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.730+0000 7f175351e800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.8 to cache LRU end 2023-12-03T11:46:32.732 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.730+0000 7f175351e800 10 removing default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.8 from cache 2023-12-03T11:46:32.732 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.730+0000 7f175351e800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.log:pubsub..bucket.test-client.0-r-test-small-obj-data.3/83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.8, ofs0, ns] 2023-12-03T11:46:32.732 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.731+0000 7f1732ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660557 cookie 93937834199328 notifier 6069 bl.length()=235 2023-12-03T11:46:32.735 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.734+0000 7f175351e800 10 removing key index: LOLHJEVUGVZYNXIEKPQP 2023-12-03T11:46:32.736 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.734+0000 7f175351e800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:LOLHJEVUGVZYNXIEKPQP, ofs0, ns] 2023-12-03T11:46:32.736 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.735+0000 7f17337fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660500 cookie 93937834184464 notifier 6069 bl.length()=170 2023-12-03T11:46:32.738 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.737+0000 7f175351e800 10 removing email index: ragweed.client.0+test@test.test 2023-12-03T11:46:32.739 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.737+0000 7f175351e800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.email:ragweed.client.0+test@test.test, ofs0, ns] 2023-12-03T11:46:32.739 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.738+0000 7f1732ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660501 cookie 93937834184464 notifier 6069 bl.length()=182 2023-12-03T11:46:32.741 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.740+0000 7f175351e800 10 removing user buckets index 2023-12-03T11:46:32.741 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.740+0000 7f175351e800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:ragweed.client.0.buckets, ofs0, ns] 2023-12-03T11:46:32.742 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.740+0000 7f1732ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660558 cookie 93937834194304 notifier 6069 bl.length()=173 2023-12-03T11:46:32.744 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.742+0000 7f175351e800 10 removing user index: ragweed.client.0 2023-12-03T11:46:32.744 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.742+0000 7f175351e800 10 removing default.rgw.meta+users.uid+ragweed.client.0 from cache 2023-12-03T11:46:32.744 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.742+0000 7f175351e800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:ragweed.client.0, ofs0, ns] 2023-12-03T11:46:32.744 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.743+0000 7f1732ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660535 cookie 93937834190112 notifier 6069 bl.length()=165 2023-12-03T11:46:32.748 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.747+0000 7f1716fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:46:32.751 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.750+0000 7f175351e800 20 remove_watcher() i=0 2023-12-03T11:46:32.751 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.750+0000 7f175351e800 2 removed watcher, disabling cache 2023-12-03T11:46:32.752 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.751+0000 7f175351e800 20 remove_watcher() i=1 2023-12-03T11:46:32.753 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.752+0000 7f175351e800 20 remove_watcher() i=2 2023-12-03T11:46:32.754 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.753+0000 7f175351e800 20 remove_watcher() i=3 2023-12-03T11:46:32.755 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.754+0000 7f175351e800 20 remove_watcher() i=4 2023-12-03T11:46:32.756 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.755+0000 7f175351e800 20 remove_watcher() i=5 2023-12-03T11:46:32.757 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.756+0000 7f175351e800 20 remove_watcher() i=6 2023-12-03T11:46:32.758 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.757+0000 7f175351e800 20 remove_watcher() i=7 2023-12-03T11:46:32.764 DEBUG:teuthology.orchestra.run.smithi003:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid sysuser.client.0 --purge-data 2023-12-03T11:46:32.848 INFO:teuthology.orchestra.run.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:46:32.848 INFO:teuthology.orchestra.run.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:46:32.860 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.858+0000 7fb223b1e800 20 rados->read ofs=0 len=0 2023-12-03T11:46:32.862 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.860+0000 7fb223b1e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:46:32.862 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.860+0000 7fb223b1e800 20 realm 2023-12-03T11:46:32.862 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.860+0000 7fb223b1e800 20 rados->read ofs=0 len=0 2023-12-03T11:46:32.862 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.860+0000 7fb223b1e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:46:32.862 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.860+0000 7fb223b1e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:46:32.862 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.860+0000 7fb223b1e800 20 rados->read ofs=0 len=0 2023-12-03T11:46:32.862 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.861+0000 7fb223b1e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:46:32.862 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.861+0000 7fb223b1e800 20 rados->read ofs=0 len=0 2023-12-03T11:46:32.863 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.861+0000 7fb223b1e800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:46:32.863 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.861+0000 7fb223b1e800 20 rados->read ofs=0 len=0 2023-12-03T11:46:32.863 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.862+0000 7fb223b1e800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:46:32.863 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.862+0000 7fb223b1e800 20 searching for the correct realm 2023-12-03T11:46:32.873 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.872+0000 7fb221625640 0 -- 172.21.15.3:0/2649329631 >> [v2:172.21.15.37:6805/1692844418,v1:172.21.15.37:6807/1692844418] conn(0x55f07014d810 msgr2=0x55f07014fc40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:46:32.874 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.873+0000 7fb223b1e800 20 RGWRados::pool_iterate: got zone_info.83aabb46-04b5-4c96-9933-c6bfb1173a73 2023-12-03T11:46:32.874 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.873+0000 7fb223b1e800 20 RGWRados::pool_iterate: got zonegroup_info.6a811aad-435d-4fdd-93c9-b7e0b50de429 2023-12-03T11:46:32.875 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.873+0000 7fb223b1e800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:46:32.875 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.873+0000 7fb223b1e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:46:32.875 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.873+0000 7fb223b1e800 20 rados->read ofs=0 len=0 2023-12-03T11:46:32.875 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.873+0000 7fb223b1e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:46:32.875 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.873+0000 7fb223b1e800 20 rados->read ofs=0 len=0 2023-12-03T11:46:32.875 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.874+0000 7fb223b1e800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:46:32.875 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.874+0000 7fb223b1e800 20 rados->read ofs=0 len=0 2023-12-03T11:46:32.876 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.875+0000 7fb223b1e800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:46:32.876 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.875+0000 7fb223b1e800 20 zone default found 2023-12-03T11:46:32.876 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.875+0000 7fb223b1e800 4 Realm: () 2023-12-03T11:46:32.877 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.875+0000 7fb223b1e800 4 ZoneGroup: default (6a811aad-435d-4fdd-93c9-b7e0b50de429) 2023-12-03T11:46:32.877 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.875+0000 7fb223b1e800 4 Zone: default (83aabb46-04b5-4c96-9933-c6bfb1173a73) 2023-12-03T11:46:32.877 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.875+0000 7fb223b1e800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:46:32.877 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.875+0000 7fb223b1e800 20 zonegroup default 2023-12-03T11:46:32.877 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.875+0000 7fb223b1e800 20 rados->read ofs=0 len=0 2023-12-03T11:46:32.877 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.875+0000 7fb223b1e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:46:32.877 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.875+0000 7fb223b1e800 20 rados->read ofs=0 len=0 2023-12-03T11:46:32.877 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.875+0000 7fb223b1e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:46:32.877 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.875+0000 7fb223b1e800 20 rados->read ofs=0 len=0 2023-12-03T11:46:32.877 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.875+0000 7fb223b1e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:46:32.878 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.875+0000 7fb223b1e800 20 started sync module instance, tier type = 2023-12-03T11:46:32.878 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.875+0000 7fb223b1e800 20 started zone id=83aabb46-04b5-4c96-9933-c6bfb1173a73 (name=default) with tier type = 2023-12-03T11:46:32.883 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.882+0000 7fb220e24640 0 -- 172.21.15.3:0/2649329631 >> [v2:172.21.15.3:6817/3356208405,v1:172.21.15.3:6819/3356208405] conn(0x55f0701528d0 msgr2=0x55f070154cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:46:32.886 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.884+0000 7fb223b1e800 20 add_watcher() i=0 2023-12-03T11:46:32.886 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.884+0000 7fb223b1e800 20 add_watcher() i=1 2023-12-03T11:46:32.886 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.884+0000 7fb223b1e800 20 add_watcher() i=2 2023-12-03T11:46:32.886 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.884+0000 7fb223b1e800 20 add_watcher() i=3 2023-12-03T11:46:32.886 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.884+0000 7fb223b1e800 20 add_watcher() i=4 2023-12-03T11:46:32.886 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.884+0000 7fb223b1e800 20 add_watcher() i=5 2023-12-03T11:46:32.886 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.884+0000 7fb223b1e800 20 add_watcher() i=6 2023-12-03T11:46:32.886 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.885+0000 7fb223b1e800 20 add_watcher() i=7 2023-12-03T11:46:32.887 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.885+0000 7fb223b1e800 2 all 8 watchers are set, enabling cache 2023-12-03T11:46:32.888 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.887+0000 7fb1e6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:46:32.888 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.887+0000 7fb223b1e800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:46:32.888 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.887+0000 7fb223b1e800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:46:32.930 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.928+0000 7fb155ffb640 20 reqs_thread_entry: start 2023-12-03T11:46:32.930 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.929+0000 7fb223b1e800 20 init_complete bucket index max shards: 11 2023-12-03T11:46:32.931 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.929+0000 7fb223b1e800 20 Filter name: none 2023-12-03T11:46:32.931 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.929+0000 7fb1477fe640 20 reqs_thread_entry: start 2023-12-03T11:46:32.931 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.929+0000 7fb223b1e800 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2023-12-03T11:46:32.931 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.929+0000 7fb223b1e800 20 rados->read ofs=0 len=0 2023-12-03T11:46:32.931 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.930+0000 7fb223b1e800 20 rados_obj.operate() r=0 bl.length=452 2023-12-03T11:46:32.932 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.930+0000 7fb223b1e800 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x13 2023-12-03T11:46:32.932 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.930+0000 7fb223b1e800 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2023-12-03T11:46:32.932 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.930+0000 7fb223b1e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:46:32.932 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.930+0000 7fb223b1e800 10 removing key index: GMTHDBPYWYYZQNKEGYFQ 2023-12-03T11:46:32.932 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.930+0000 7fb223b1e800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:users.keys:GMTHDBPYWYYZQNKEGYFQ, ofs0, ns] 2023-12-03T11:46:32.932 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.930+0000 7fb202ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660545 cookie 94491158482768 notifier 6090 bl.length()=170 2023-12-03T11:46:32.934 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.933+0000 7fb223b1e800 10 removing email index: sysuser.client.0+test@test.test 2023-12-03T11:46:32.934 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.933+0000 7fb223b1e800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.email:sysuser.client.0+test@test.test, ofs0, ns] 2023-12-03T11:46:32.935 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.933+0000 7fb202ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660536 cookie 94491160971424 notifier 6090 bl.length()=182 2023-12-03T11:46:32.937 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.936+0000 7fb223b1e800 10 removing user buckets index 2023-12-03T11:46:32.937 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.936+0000 7fb223b1e800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.uid:sysuser.client.0.buckets, ofs0, ns] 2023-12-03T11:46:32.938 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.936+0000 7fb202ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660493 cookie 94491160967968 notifier 6090 bl.length()=173 2023-12-03T11:46:32.940 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.939+0000 7fb223b1e800 10 removing user index: sysuser.client.0 2023-12-03T11:46:32.940 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.939+0000 7fb223b1e800 10 removing default.rgw.meta+users.uid+sysuser.client.0 from cache 2023-12-03T11:46:32.940 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.939+0000 7fb223b1e800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.uid:sysuser.client.0, ofs0, ns] 2023-12-03T11:46:32.940 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.939+0000 7fb202ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660502 cookie 94491160961872 notifier 6090 bl.length()=165 2023-12-03T11:46:32.944 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.942+0000 7fb1e6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:46:32.945 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.944+0000 7fb223b1e800 20 remove_watcher() i=0 2023-12-03T11:46:32.945 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.944+0000 7fb223b1e800 2 removed watcher, disabling cache 2023-12-03T11:46:32.946 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.945+0000 7fb223b1e800 20 remove_watcher() i=1 2023-12-03T11:46:32.947 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.946+0000 7fb223b1e800 20 remove_watcher() i=2 2023-12-03T11:46:32.949 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.947+0000 7fb223b1e800 20 remove_watcher() i=3 2023-12-03T11:46:32.950 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.948+0000 7fb223b1e800 20 remove_watcher() i=4 2023-12-03T11:46:32.951 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.949+0000 7fb223b1e800 20 remove_watcher() i=5 2023-12-03T11:46:32.952 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.950+0000 7fb223b1e800 20 remove_watcher() i=6 2023-12-03T11:46:32.953 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:46:32.951+0000 7fb223b1e800 20 remove_watcher() i=7 2023-12-03T11:46:32.958 INFO:tasks.ragweed:Removing ragweed... 2023-12-03T11:46:32.958 DEBUG:teuthology.orchestra.run.smithi003:> rm -rf /home/ubuntu/cephtest/ragweed.client.0 2023-12-03T11:46:33.027 INFO:teuthology.run_tasks:Running task workunit... 2023-12-03T11:46:33.044 INFO:tasks.workunit:Pulling workunits from ref bcbf278cf395873c2a482f5a7b2345faf2160319 2023-12-03T11:46:33.044 INFO:tasks.workunit:Making a separate scratch dir for every client... 2023-12-03T11:46:33.045 DEBUG:teuthology.orchestra.run.smithi003:> stat -- /home/ubuntu/cephtest/mnt.0 2023-12-03T11:46:33.060 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-03T11:46:33.060 INFO:teuthology.orchestra.run.smithi003.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2023-12-03T11:46:33.061 DEBUG:teuthology.orchestra.run.smithi003:> mkdir -- /home/ubuntu/cephtest/mnt.0 2023-12-03T11:46:33.116 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2023-12-03T11:46:33.116 DEBUG:teuthology.orchestra.run.smithi003:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2023-12-03T11:46:33.171 INFO:tasks.workunit:timeout=3h 2023-12-03T11:46:33.171 INFO:tasks.workunit:cleanup=True 2023-12-03T11:46:33.171 DEBUG:teuthology.orchestra.run.smithi003:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout bcbf278cf395873c2a482f5a7b2345faf2160319 2023-12-03T11:46:33.227 INFO:tasks.workunit.client.0.smithi003.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2023-12-03T11:47:40.937 INFO:tasks.workunit.client.0.smithi003.stderr:Updating files: 99% (12075/12123) Updating files: 100% (12123/12123) Updating files: 100% (12123/12123), done. 2023-12-03T11:47:41.638 INFO:tasks.workunit.client.0.smithi003.stderr:Note: switching to 'bcbf278cf395873c2a482f5a7b2345faf2160319'. 2023-12-03T11:47:41.638 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:47:41.638 INFO:tasks.workunit.client.0.smithi003.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-12-03T11:47:41.638 INFO:tasks.workunit.client.0.smithi003.stderr:changes and commit them, and you can discard any commits you make in this 2023-12-03T11:47:41.638 INFO:tasks.workunit.client.0.smithi003.stderr:state without impacting any branches by switching back to a branch. 2023-12-03T11:47:41.638 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:47:41.638 INFO:tasks.workunit.client.0.smithi003.stderr:If you want to create a new branch to retain commits you create, you may 2023-12-03T11:47:41.638 INFO:tasks.workunit.client.0.smithi003.stderr:do so (now or later) by using -c with the switch command. Example: 2023-12-03T11:47:41.638 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:47:41.638 INFO:tasks.workunit.client.0.smithi003.stderr: git switch -c 2023-12-03T11:47:41.638 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:47:41.639 INFO:tasks.workunit.client.0.smithi003.stderr:Or undo this operation with: 2023-12-03T11:47:41.639 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:47:41.639 INFO:tasks.workunit.client.0.smithi003.stderr: git switch - 2023-12-03T11:47:41.639 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:47:41.639 INFO:tasks.workunit.client.0.smithi003.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-12-03T11:47:41.639 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:47:41.639 INFO:tasks.workunit.client.0.smithi003.stderr:HEAD is now at bcbf278cf39 RGW:pubsub publish commit with etag populated 2023-12-03T11:47:41.641 DEBUG:teuthology.orchestra.run.smithi003:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2023-12-03T11:47:41.697 INFO:tasks.workunit.client.0.smithi003.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2023-12-03T11:47:41.699 INFO:tasks.workunit.client.0.smithi003.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-12-03T11:47:41.699 INFO:tasks.workunit.client.0.smithi003.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2023-12-03T11:47:41.750 INFO:tasks.workunit.client.0.smithi003.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2023-12-03T11:47:41.800 INFO:tasks.workunit.client.0.smithi003.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2023-12-03T11:47:41.841 INFO:tasks.workunit.client.0.smithi003.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-12-03T11:47:41.842 INFO:tasks.workunit.client.0.smithi003.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-12-03T11:47:41.842 INFO:tasks.workunit.client.0.smithi003.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2023-12-03T11:47:41.882 INFO:tasks.workunit.client.0.smithi003.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-12-03T11:47:41.885 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-12-03T11:47:41.885 DEBUG:teuthology.orchestra.run.smithi003:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2023-12-03T11:47:41.941 INFO:tasks.workunit:Running workunits matching rgw/run-reshard.sh on client.0... 2023-12-03T11:47:41.942 INFO:tasks.workunit:Running workunit rgw/run-reshard.sh... 2023-12-03T11:47:41.942 DEBUG:teuthology.orchestra.run.smithi003:workunit test rgw/run-reshard.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bcbf278cf395873c2a482f5a7b2345faf2160319 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh 2023-12-03T11:47:42.001 INFO:tasks.workunit.client.0.smithi003.stderr:+ ulimit -c 0 2023-12-03T11:47:42.001 INFO:tasks.workunit.client.0.smithi003.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh 2023-12-03T11:47:42.002 INFO:tasks.workunit.client.0.smithi003.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2023-12-03T11:47:42.002 INFO:tasks.workunit.client.0.smithi003.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2023-12-03T11:47:44.448 INFO:tasks.workunit.client.0.smithi003.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2023-12-03T11:47:44.449 INFO:tasks.workunit.client.0.smithi003.stderr:++ deactivate nondestructive 2023-12-03T11:47:44.449 INFO:tasks.workunit.client.0.smithi003.stderr:++ '[' -n '' ']' 2023-12-03T11:47:44.449 INFO:tasks.workunit.client.0.smithi003.stderr:++ '[' -n '' ']' 2023-12-03T11:47:44.449 INFO:tasks.workunit.client.0.smithi003.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2023-12-03T11:47:44.449 INFO:tasks.workunit.client.0.smithi003.stderr:++ hash -r 2023-12-03T11:47:44.449 INFO:tasks.workunit.client.0.smithi003.stderr:++ '[' -n '' ']' 2023-12-03T11:47:44.449 INFO:tasks.workunit.client.0.smithi003.stderr:++ unset VIRTUAL_ENV 2023-12-03T11:47:44.449 INFO:tasks.workunit.client.0.smithi003.stderr:++ '[' '!' nondestructive = nondestructive ']' 2023-12-03T11:47:44.449 INFO:tasks.workunit.client.0.smithi003.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2023-12-03T11:47:44.449 INFO:tasks.workunit.client.0.smithi003.stderr:++ export VIRTUAL_ENV 2023-12-03T11:47:44.449 INFO:tasks.workunit.client.0.smithi003.stderr:++ _OLD_VIRTUAL_PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2023-12-03T11:47:44.450 INFO:tasks.workunit.client.0.smithi003.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2023-12-03T11:47:44.450 INFO:tasks.workunit.client.0.smithi003.stderr:++ export PATH 2023-12-03T11:47:44.450 INFO:tasks.workunit.client.0.smithi003.stderr:++ '[' -n '' ']' 2023-12-03T11:47:44.451 INFO:tasks.workunit.client.0.smithi003.stderr:++ '[' -z '' ']' 2023-12-03T11:47:44.451 INFO:tasks.workunit.client.0.smithi003.stderr:++ _OLD_VIRTUAL_PS1= 2023-12-03T11:47:44.451 INFO:tasks.workunit.client.0.smithi003.stderr:++ PS1='(rgw) ' 2023-12-03T11:47:44.451 INFO:tasks.workunit.client.0.smithi003.stderr:++ export PS1 2023-12-03T11:47:44.451 INFO:tasks.workunit.client.0.smithi003.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2023-12-03T11:47:44.451 INFO:tasks.workunit.client.0.smithi003.stderr:++ hash -r 2023-12-03T11:47:44.451 INFO:tasks.workunit.client.0.smithi003.stderr:+ pip install pip --upgrade 2023-12-03T11:47:44.691 INFO:tasks.workunit.client.0.smithi003.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.2.3) 2023-12-03T11:47:45.177 INFO:tasks.workunit.client.0.smithi003.stdout:Collecting pip 2023-12-03T11:47:45.183 INFO:tasks.workunit.client.0.smithi003.stdout: Using cached pip-23.3.1-py3-none-any.whl (2.1 MB) 2023-12-03T11:47:45.233 INFO:tasks.workunit.client.0.smithi003.stdout:Installing collected packages: pip 2023-12-03T11:47:45.233 INFO:tasks.workunit.client.0.smithi003.stdout: Attempting uninstall: pip 2023-12-03T11:47:45.233 INFO:tasks.workunit.client.0.smithi003.stdout: Found existing installation: pip 21.2.3 2023-12-03T11:47:45.401 INFO:tasks.workunit.client.0.smithi003.stdout: Uninstalling pip-21.2.3: 2023-12-03T11:47:45.406 INFO:tasks.workunit.client.0.smithi003.stdout: Successfully uninstalled pip-21.2.3 2023-12-03T11:47:46.419 INFO:tasks.workunit.client.0.smithi003.stdout:Successfully installed pip-23.3.1 2023-12-03T11:47:46.473 INFO:tasks.workunit.client.0.smithi003.stderr:+ pip install boto3 2023-12-03T11:47:47.455 INFO:tasks.workunit.client.0.smithi003.stdout:Collecting boto3 2023-12-03T11:47:47.457 INFO:tasks.workunit.client.0.smithi003.stdout: Using cached boto3-1.33.6-py3-none-any.whl.metadata (6.7 kB) 2023-12-03T11:47:48.079 INFO:tasks.workunit.client.0.smithi003.stdout:Collecting botocore<1.34.0,>=1.33.6 (from boto3) 2023-12-03T11:47:48.081 INFO:tasks.workunit.client.0.smithi003.stdout: Using cached botocore-1.33.6-py3-none-any.whl.metadata (6.1 kB) 2023-12-03T11:47:48.177 INFO:tasks.workunit.client.0.smithi003.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2023-12-03T11:47:48.178 INFO:tasks.workunit.client.0.smithi003.stdout: Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2023-12-03T11:47:48.280 INFO:tasks.workunit.client.0.smithi003.stdout:Collecting s3transfer<0.9.0,>=0.8.2 (from boto3) 2023-12-03T11:47:48.281 INFO:tasks.workunit.client.0.smithi003.stdout: Using cached s3transfer-0.8.2-py3-none-any.whl.metadata (1.8 kB) 2023-12-03T11:47:48.398 INFO:tasks.workunit.client.0.smithi003.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.34.0,>=1.33.6->boto3) 2023-12-03T11:47:48.399 INFO:tasks.workunit.client.0.smithi003.stdout: Using cached python_dateutil-2.8.2-py2.py3-none-any.whl (247 kB) 2023-12-03T11:47:48.541 INFO:tasks.workunit.client.0.smithi003.stdout:Collecting urllib3<1.27,>=1.25.4 (from botocore<1.34.0,>=1.33.6->boto3) 2023-12-03T11:47:48.542 INFO:tasks.workunit.client.0.smithi003.stdout: Using cached urllib3-1.26.18-py2.py3-none-any.whl.metadata (48 kB) 2023-12-03T11:47:48.880 INFO:tasks.workunit.client.0.smithi003.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.34.0,>=1.33.6->boto3) 2023-12-03T11:47:48.881 INFO:tasks.workunit.client.0.smithi003.stdout: Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2023-12-03T11:47:48.905 INFO:tasks.workunit.client.0.smithi003.stdout:Using cached boto3-1.33.6-py3-none-any.whl (139 kB) 2023-12-03T11:47:48.906 INFO:tasks.workunit.client.0.smithi003.stdout:Using cached botocore-1.33.6-py3-none-any.whl (11.8 MB) 2023-12-03T11:47:48.930 INFO:tasks.workunit.client.0.smithi003.stdout:Using cached s3transfer-0.8.2-py3-none-any.whl (82 kB) 2023-12-03T11:47:48.930 INFO:tasks.workunit.client.0.smithi003.stdout:Using cached urllib3-1.26.18-py2.py3-none-any.whl (143 kB) 2023-12-03T11:47:49.034 INFO:tasks.workunit.client.0.smithi003.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2023-12-03T11:47:50.157 INFO:tasks.workunit.client.0.smithi003.stdout:Successfully installed boto3-1.33.6 botocore-1.33.6 jmespath-1.0.1 python-dateutil-2.8.2 s3transfer-0.8.2 six-1.16.0 urllib3-1.26.18 2023-12-03T11:47:50.281 INFO:tasks.workunit.client.0.smithi003.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_reshard.py 2023-12-03T11:47:50.410 INFO:tasks.workunit.client.0.smithi003.stderr:radosgw-admin user create --uid tester --display-name "Testing" --access-key NX5QOQKC6BH2IDN8HC7A --secret LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn 2023-12-03T11:47:50.444 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:47:50.444 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:47:50.459 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.458+0000 7f0288924800 20 rados->read ofs=0 len=0 2023-12-03T11:47:50.461 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.459+0000 7f0288924800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:47:50.461 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.459+0000 7f0288924800 20 realm 2023-12-03T11:47:50.461 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.459+0000 7f0288924800 20 rados->read ofs=0 len=0 2023-12-03T11:47:50.461 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.459+0000 7f0288924800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:47:50.461 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.459+0000 7f0288924800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:47:50.461 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.459+0000 7f0288924800 20 rados->read ofs=0 len=0 2023-12-03T11:47:50.461 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.459+0000 7f0288924800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:47:50.461 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.460+0000 7f0288924800 20 rados->read ofs=0 len=0 2023-12-03T11:47:50.462 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.460+0000 7f0288924800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:47:50.462 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.460+0000 7f0288924800 20 rados->read ofs=0 len=0 2023-12-03T11:47:50.462 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.461+0000 7f0288924800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:47:50.462 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.461+0000 7f0288924800 20 searching for the correct realm 2023-12-03T11:47:50.474 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.472+0000 7f0283d6f640 0 -- 172.21.15.3:0/3329440933 >> [v2:172.21.15.3:6817/3356208405,v1:172.21.15.3:6819/3356208405] conn(0x55872979ef70 msgr2=0x5587297a1360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:47:50.474 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.473+0000 7f0288924800 20 RGWRados::pool_iterate: got zone_info.83aabb46-04b5-4c96-9933-c6bfb1173a73 2023-12-03T11:47:50.475 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.473+0000 7f0288924800 20 RGWRados::pool_iterate: got zonegroup_info.6a811aad-435d-4fdd-93c9-b7e0b50de429 2023-12-03T11:47:50.475 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.473+0000 7f0288924800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:47:50.475 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.473+0000 7f0288924800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:47:50.475 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.473+0000 7f0288924800 20 rados->read ofs=0 len=0 2023-12-03T11:47:50.475 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.473+0000 7f0288924800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:47:50.475 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.473+0000 7f0288924800 20 rados->read ofs=0 len=0 2023-12-03T11:47:50.476 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.474+0000 7f0288924800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:47:50.476 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.474+0000 7f0288924800 20 rados->read ofs=0 len=0 2023-12-03T11:47:50.476 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.474+0000 7f0288924800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:47:50.476 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.474+0000 7f0288924800 20 zone default found 2023-12-03T11:47:50.477 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.474+0000 7f0288924800 4 Realm: () 2023-12-03T11:47:50.477 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.474+0000 7f0288924800 4 ZoneGroup: default (6a811aad-435d-4fdd-93c9-b7e0b50de429) 2023-12-03T11:47:50.477 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.474+0000 7f0288924800 4 Zone: default (83aabb46-04b5-4c96-9933-c6bfb1173a73) 2023-12-03T11:47:50.477 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.474+0000 7f0288924800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:47:50.477 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.474+0000 7f0288924800 20 zonegroup default 2023-12-03T11:47:50.477 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.474+0000 7f0288924800 20 rados->read ofs=0 len=0 2023-12-03T11:47:50.477 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.474+0000 7f0288924800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:47:50.477 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.474+0000 7f0288924800 20 rados->read ofs=0 len=0 2023-12-03T11:47:50.477 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.475+0000 7f0288924800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:47:50.477 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.475+0000 7f0288924800 20 rados->read ofs=0 len=0 2023-12-03T11:47:50.477 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.475+0000 7f0288924800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:47:50.477 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.475+0000 7f0288924800 20 started sync module instance, tier type = 2023-12-03T11:47:50.477 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.475+0000 7f0288924800 20 started zone id=83aabb46-04b5-4c96-9933-c6bfb1173a73 (name=default) with tier type = 2023-12-03T11:47:50.485 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.483+0000 7f0283d6f640 0 -- 172.21.15.3:0/3329440933 >> [v2:172.21.15.3:6817/3356208405,v1:172.21.15.3:6819/3356208405] conn(0x7f0260079e10 msgr2=0x7f026007c240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:47:50.486 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.485+0000 7f0288924800 20 add_watcher() i=0 2023-12-03T11:47:50.487 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.485+0000 7f0288924800 20 add_watcher() i=1 2023-12-03T11:47:50.487 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.485+0000 7f0288924800 20 add_watcher() i=2 2023-12-03T11:47:50.487 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.485+0000 7f0288924800 20 add_watcher() i=3 2023-12-03T11:47:50.487 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.485+0000 7f0288924800 20 add_watcher() i=4 2023-12-03T11:47:50.487 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.485+0000 7f0288924800 20 add_watcher() i=5 2023-12-03T11:47:50.487 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.485+0000 7f0288924800 20 add_watcher() i=6 2023-12-03T11:47:50.487 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.486+0000 7f0288924800 20 add_watcher() i=7 2023-12-03T11:47:50.487 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.486+0000 7f0288924800 2 all 8 watchers are set, enabling cache 2023-12-03T11:47:50.489 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.488+0000 7f024a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:47:50.489 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.488+0000 7f0288924800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:47:50.489 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.488+0000 7f0288924800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:47:50.495 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.494+0000 7f0288924800 5 note: GC not initialized 2023-12-03T11:47:50.496 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.494+0000 7f01b97fa640 20 reqs_thread_entry: start 2023-12-03T11:47:50.496 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.494+0000 7f0288924800 20 init_complete bucket index max shards: 11 2023-12-03T11:47:50.496 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.494+0000 7f0288924800 20 Filter name: none 2023-12-03T11:47:50.497 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.495+0000 7f01b2ffd640 20 reqs_thread_entry: start 2023-12-03T11:47:50.497 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.495+0000 7f0288924800 10 cache get: name=default.rgw.meta+users.uid+tester : miss 2023-12-03T11:47:50.497 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.495+0000 7f0288924800 20 rados->read ofs=0 len=0 2023-12-03T11:47:50.497 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.495+0000 7f0288924800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:47:50.497 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.495+0000 7f0288924800 10 cache put: name=default.rgw.meta+users.uid+tester info.flags=0x0 2023-12-03T11:47:50.497 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.495+0000 7f0288924800 10 adding default.rgw.meta+users.uid+tester to cache LRU end 2023-12-03T11:47:50.497 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.495+0000 7f0288924800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : miss 2023-12-03T11:47:50.497 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.495+0000 7f0288924800 20 rados->read ofs=0 len=0 2023-12-03T11:47:50.497 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.495+0000 7f0288924800 20 rados_obj.operate() r=0 bl.length=22 2023-12-03T11:47:50.497 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.495+0000 7f0288924800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x5 2023-12-03T11:47:50.497 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.495+0000 7f0288924800 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2023-12-03T11:47:50.497 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.495+0000 7f0288924800 10 cache get: name=default.rgw.meta+users.uid+rgw_datacache_user : miss 2023-12-03T11:47:50.498 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.495+0000 7f0288924800 20 rados->read ofs=0 len=0 2023-12-03T11:47:50.498 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.496+0000 7f0288924800 20 rados_obj.operate() r=0 bl.length=386 2023-12-03T11:47:50.498 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.496+0000 7f0288924800 10 cache put: name=default.rgw.meta+users.uid+rgw_datacache_user info.flags=0x11 2023-12-03T11:47:50.498 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.496+0000 7f0288924800 10 adding default.rgw.meta+users.uid+rgw_datacache_user to cache LRU end 2023-12-03T11:47:50.498 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.496+0000 7f0288924800 10 chain_cache_entry: cache_locator=default.rgw.meta+users.uid+rgw_datacache_user 2023-12-03T11:47:50.499 INFO:tasks.workunit.client.0.smithi003.stderr:could not create user: unable to parse parameters, duplicate key provided 2023-12-03T11:47:50.499 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.497+0000 7f024a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:47:50.500 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.499+0000 7f0288924800 20 remove_watcher() i=0 2023-12-03T11:47:50.500 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.499+0000 7f0288924800 2 removed watcher, disabling cache 2023-12-03T11:47:50.502 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.501+0000 7f0288924800 20 remove_watcher() i=1 2023-12-03T11:47:50.503 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.502+0000 7f0288924800 20 remove_watcher() i=2 2023-12-03T11:47:50.504 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.503+0000 7f0288924800 20 remove_watcher() i=3 2023-12-03T11:47:50.505 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.504+0000 7f0288924800 20 remove_watcher() i=4 2023-12-03T11:47:50.506 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.505+0000 7f0288924800 20 remove_watcher() i=5 2023-12-03T11:47:50.507 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.506+0000 7f0288924800 20 remove_watcher() i=6 2023-12-03T11:47:50.508 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.507+0000 7f0288924800 20 remove_watcher() i=7 2023-12-03T11:47:50.865 INFO:tasks.workunit.client.0.smithi003.stderr:TEST: reshard add 2023-12-03T11:47:50.865 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:47:50.867 INFO:tasks.workunit.client.0.smithi003.stderr:radosgw-admin bucket stats --bucket a-bucket 2023-12-03T11:47:50.894 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:47:50.895 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:47:50.909 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.908+0000 7f35aedad800 20 rados->read ofs=0 len=0 2023-12-03T11:47:50.911 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.910+0000 7f35aedad800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:47:50.912 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.910+0000 7f35aedad800 20 realm 2023-12-03T11:47:50.912 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.910+0000 7f35aedad800 20 rados->read ofs=0 len=0 2023-12-03T11:47:50.912 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.910+0000 7f35aedad800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:47:50.912 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.910+0000 7f35aedad800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:47:50.912 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.910+0000 7f35aedad800 20 rados->read ofs=0 len=0 2023-12-03T11:47:50.912 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.910+0000 7f35aedad800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:47:50.913 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.910+0000 7f35aedad800 20 rados->read ofs=0 len=0 2023-12-03T11:47:50.913 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.911+0000 7f35aedad800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:47:50.914 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.911+0000 7f35aedad800 20 rados->read ofs=0 len=0 2023-12-03T11:47:50.914 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.911+0000 7f35aedad800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:47:50.914 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.911+0000 7f35aedad800 20 searching for the correct realm 2023-12-03T11:47:50.921 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.920+0000 7f35ac8ad640 0 -- 172.21.15.3:0/2576863625 >> [v2:172.21.15.37:6805/1692844418,v1:172.21.15.37:6807/1692844418] conn(0x559b1b87e1b0 msgr2=0x559b1b8805a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:47:50.924 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.923+0000 7f35aedad800 20 RGWRados::pool_iterate: got zone_info.83aabb46-04b5-4c96-9933-c6bfb1173a73 2023-12-03T11:47:50.924 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.923+0000 7f35aedad800 20 RGWRados::pool_iterate: got zonegroup_info.6a811aad-435d-4fdd-93c9-b7e0b50de429 2023-12-03T11:47:50.924 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.923+0000 7f35aedad800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:47:50.924 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.923+0000 7f35aedad800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:47:50.924 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.923+0000 7f35aedad800 20 rados->read ofs=0 len=0 2023-12-03T11:47:50.925 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.923+0000 7f35aedad800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:47:50.925 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.923+0000 7f35aedad800 20 rados->read ofs=0 len=0 2023-12-03T11:47:50.925 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.923+0000 7f35aedad800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:47:50.925 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.923+0000 7f35aedad800 20 rados->read ofs=0 len=0 2023-12-03T11:47:50.926 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.924+0000 7f35aedad800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:47:50.926 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.924+0000 7f35aedad800 20 zone default found 2023-12-03T11:47:50.926 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.924+0000 7f35aedad800 4 Realm: () 2023-12-03T11:47:50.926 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.924+0000 7f35aedad800 4 ZoneGroup: default (6a811aad-435d-4fdd-93c9-b7e0b50de429) 2023-12-03T11:47:50.926 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.924+0000 7f35aedad800 4 Zone: default (83aabb46-04b5-4c96-9933-c6bfb1173a73) 2023-12-03T11:47:50.926 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.924+0000 7f35aedad800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:47:50.926 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.924+0000 7f35aedad800 20 zonegroup default 2023-12-03T11:47:50.926 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.924+0000 7f35aedad800 20 rados->read ofs=0 len=0 2023-12-03T11:47:50.926 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.924+0000 7f35aedad800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:47:50.926 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.924+0000 7f35aedad800 20 rados->read ofs=0 len=0 2023-12-03T11:47:50.926 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.924+0000 7f35aedad800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:47:50.926 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.924+0000 7f35aedad800 20 rados->read ofs=0 len=0 2023-12-03T11:47:50.927 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.925+0000 7f35aedad800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:47:50.927 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.925+0000 7f35aedad800 20 started sync module instance, tier type = 2023-12-03T11:47:50.927 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.925+0000 7f35aedad800 20 started zone id=83aabb46-04b5-4c96-9933-c6bfb1173a73 (name=default) with tier type = 2023-12-03T11:47:50.928 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.927+0000 7f35ac8ad640 0 -- 172.21.15.3:0/2576863625 >> [v2:172.21.15.37:6805/1692844418,v1:172.21.15.37:6807/1692844418] conn(0x7f3584079dc0 msgr2=0x7f358407c1f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:47:50.935 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.934+0000 7f35aedad800 20 add_watcher() i=0 2023-12-03T11:47:50.936 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.934+0000 7f35aedad800 20 add_watcher() i=1 2023-12-03T11:47:50.936 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.934+0000 7f35aedad800 20 add_watcher() i=2 2023-12-03T11:47:50.936 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.934+0000 7f35aedad800 20 add_watcher() i=3 2023-12-03T11:47:50.936 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.934+0000 7f35aedad800 20 add_watcher() i=4 2023-12-03T11:47:50.936 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.934+0000 7f35aedad800 20 add_watcher() i=5 2023-12-03T11:47:50.936 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.934+0000 7f35aedad800 20 add_watcher() i=6 2023-12-03T11:47:50.936 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.935+0000 7f35aedad800 20 add_watcher() i=7 2023-12-03T11:47:50.936 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.935+0000 7f35aedad800 2 all 8 watchers are set, enabling cache 2023-12-03T11:47:50.938 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.937+0000 7f3572fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:47:50.938 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.937+0000 7f35aedad800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:47:50.938 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.937+0000 7f35aedad800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:47:50.945 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.943+0000 7f35aedad800 5 note: GC not initialized 2023-12-03T11:47:50.945 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.943+0000 7f34e1ffb640 20 reqs_thread_entry: start 2023-12-03T11:47:50.945 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.943+0000 7f35aedad800 20 init_complete bucket index max shards: 11 2023-12-03T11:47:50.945 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.944+0000 7f35aedad800 20 Filter name: none 2023-12-03T11:47:50.945 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.944+0000 7f34d37fe640 20 reqs_thread_entry: start 2023-12-03T11:47:50.945 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.944+0000 7f35aedad800 20 rados->read ofs=0 len=0 2023-12-03T11:47:50.946 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.944+0000 7f35aedad800 20 rados_obj.operate() r=0 bl.length=200 2023-12-03T11:47:50.946 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.944+0000 7f35aedad800 20 rados->read ofs=0 len=0 2023-12-03T11:47:50.948 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.945+0000 7f35aedad800 20 rados_obj.operate() r=0 bl.length=372 2023-12-03T11:47:50.948 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.945+0000 7f35aedad800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:47:50.948 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.945+0000 7f35aedad800 20 rados->read ofs=0 len=0 2023-12-03T11:47:50.948 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.945+0000 7f35aedad800 20 rados_obj.operate() r=0 bl.length=200 2023-12-03T11:47:50.948 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.945+0000 7f35aedad800 20 rados->read ofs=0 len=0 2023-12-03T11:47:50.948 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.946+0000 7f35aedad800 20 rados_obj.operate() r=0 bl.length=372 2023-12-03T11:47:50.948 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.946+0000 7f35aedad800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:47:50.948 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.946+0000 7f35aedad800 20 rados->read ofs=0 len=0 2023-12-03T11:47:50.949 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.947+0000 7f35aedad800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:47:50.949 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.947+0000 7f3572fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:47:50.951 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.950+0000 7f35aedad800 20 remove_watcher() i=0 2023-12-03T11:47:50.951 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.950+0000 7f35aedad800 2 removed watcher, disabling cache 2023-12-03T11:47:50.953 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.951+0000 7f35aedad800 20 remove_watcher() i=1 2023-12-03T11:47:50.954 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.953+0000 7f35aedad800 20 remove_watcher() i=2 2023-12-03T11:47:50.955 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.954+0000 7f35aedad800 20 remove_watcher() i=3 2023-12-03T11:47:50.956 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.955+0000 7f35aedad800 20 remove_watcher() i=4 2023-12-03T11:47:50.957 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.956+0000 7f35aedad800 20 remove_watcher() i=5 2023-12-03T11:47:50.958 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.957+0000 7f35aedad800 20 remove_watcher() i=6 2023-12-03T11:47:50.959 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:50.958+0000 7f35aedad800 20 remove_watcher() i=7 2023-12-03T11:47:50.964 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:47:50.964 INFO:tasks.workunit.client.0.smithi003.stderr:BUCKET_STATS: 2023-12-03T11:47:50.964 INFO:tasks.workunit.client.0.smithi003.stderr:bucket: a-bucket id: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17 num_objects: 0 size_kb: 0 num_shards: 11 2023-12-03T11:47:50.964 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:47:50.965 INFO:tasks.workunit.client.0.smithi003.stderr:radosgw-admin reshard add --bucket a-bucket --num-shards 12 2023-12-03T11:47:50.995 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:47:50.995 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:47:51.009 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.008+0000 7f4a11faf800 20 rados->read ofs=0 len=0 2023-12-03T11:47:51.011 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.009+0000 7f4a11faf800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:47:51.011 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.009+0000 7f4a11faf800 20 realm 2023-12-03T11:47:51.011 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.009+0000 7f4a11faf800 20 rados->read ofs=0 len=0 2023-12-03T11:47:51.011 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.010+0000 7f4a11faf800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:47:51.011 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.010+0000 7f4a11faf800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:47:51.011 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.010+0000 7f4a11faf800 20 rados->read ofs=0 len=0 2023-12-03T11:47:51.011 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.010+0000 7f4a11faf800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:47:51.011 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.010+0000 7f4a11faf800 20 rados->read ofs=0 len=0 2023-12-03T11:47:51.012 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.011+0000 7f4a11faf800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:47:51.012 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.011+0000 7f4a11faf800 20 rados->read ofs=0 len=0 2023-12-03T11:47:51.013 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.011+0000 7f4a11faf800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:47:51.013 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.011+0000 7f4a11faf800 20 searching for the correct realm 2023-12-03T11:47:51.024 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.022+0000 7f4a0faaf640 0 -- 172.21.15.3:0/2716718372 >> [v2:172.21.15.37:6805/1692844418,v1:172.21.15.37:6807/1692844418] conn(0x557adab2c670 msgr2=0x557adab2eac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:47:51.024 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.023+0000 7f4a11faf800 20 RGWRados::pool_iterate: got zone_info.83aabb46-04b5-4c96-9933-c6bfb1173a73 2023-12-03T11:47:51.024 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.023+0000 7f4a11faf800 20 RGWRados::pool_iterate: got zonegroup_info.6a811aad-435d-4fdd-93c9-b7e0b50de429 2023-12-03T11:47:51.024 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.023+0000 7f4a11faf800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:47:51.024 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.023+0000 7f4a11faf800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:47:51.025 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.023+0000 7f4a11faf800 20 rados->read ofs=0 len=0 2023-12-03T11:47:51.025 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.023+0000 7f4a11faf800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:47:51.025 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.023+0000 7f4a11faf800 20 rados->read ofs=0 len=0 2023-12-03T11:47:51.026 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.023+0000 7f4a11faf800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:47:51.026 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.023+0000 7f4a11faf800 20 rados->read ofs=0 len=0 2023-12-03T11:47:51.026 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.024+0000 7f4a11faf800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:47:51.026 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.024+0000 7f4a11faf800 20 zone default found 2023-12-03T11:47:51.026 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.024+0000 7f4a11faf800 4 Realm: () 2023-12-03T11:47:51.026 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.024+0000 7f4a11faf800 4 ZoneGroup: default (6a811aad-435d-4fdd-93c9-b7e0b50de429) 2023-12-03T11:47:51.026 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.024+0000 7f4a11faf800 4 Zone: default (83aabb46-04b5-4c96-9933-c6bfb1173a73) 2023-12-03T11:47:51.027 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.024+0000 7f4a11faf800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:47:51.027 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.024+0000 7f4a11faf800 20 zonegroup default 2023-12-03T11:47:51.027 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.024+0000 7f4a11faf800 20 rados->read ofs=0 len=0 2023-12-03T11:47:51.027 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.024+0000 7f4a11faf800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:47:51.027 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.024+0000 7f4a11faf800 20 rados->read ofs=0 len=0 2023-12-03T11:47:51.027 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.024+0000 7f4a11faf800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:47:51.027 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.024+0000 7f4a11faf800 20 rados->read ofs=0 len=0 2023-12-03T11:47:51.027 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.025+0000 7f4a11faf800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:47:51.027 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.025+0000 7f4a11faf800 20 started sync module instance, tier type = 2023-12-03T11:47:51.027 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.025+0000 7f4a11faf800 20 started zone id=83aabb46-04b5-4c96-9933-c6bfb1173a73 (name=default) with tier type = 2023-12-03T11:47:51.034 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.033+0000 7f4a0f2ae640 0 -- 172.21.15.3:0/2716718372 >> [v2:172.21.15.3:6817/3356208405,v1:172.21.15.3:6819/3356208405] conn(0x557adab316b0 msgr2=0x557adab33aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:47:51.035 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.034+0000 7f4a11faf800 20 add_watcher() i=0 2023-12-03T11:47:51.035 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.034+0000 7f4a11faf800 20 add_watcher() i=1 2023-12-03T11:47:51.035 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.034+0000 7f4a11faf800 20 add_watcher() i=2 2023-12-03T11:47:51.035 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.034+0000 7f4a11faf800 20 add_watcher() i=3 2023-12-03T11:47:51.035 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.034+0000 7f4a11faf800 20 add_watcher() i=4 2023-12-03T11:47:51.036 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.034+0000 7f4a11faf800 20 add_watcher() i=5 2023-12-03T11:47:51.036 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.035+0000 7f4a11faf800 20 add_watcher() i=6 2023-12-03T11:47:51.036 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.035+0000 7f4a11faf800 20 add_watcher() i=7 2023-12-03T11:47:51.037 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.035+0000 7f4a11faf800 2 all 8 watchers are set, enabling cache 2023-12-03T11:47:51.038 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.037+0000 7f49d5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:47:51.038 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.037+0000 7f4a11faf800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:47:51.039 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.037+0000 7f4a11faf800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:47:51.045 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.043+0000 7f4a11faf800 5 note: GC not initialized 2023-12-03T11:47:51.045 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.043+0000 7f494cff9640 20 reqs_thread_entry: start 2023-12-03T11:47:51.045 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.043+0000 7f4a11faf800 20 init_complete bucket index max shards: 11 2023-12-03T11:47:51.045 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.043+0000 7f4a11faf800 20 Filter name: none 2023-12-03T11:47:51.045 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.043+0000 7f49427fc640 20 reqs_thread_entry: start 2023-12-03T11:47:51.045 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.043+0000 7f4a11faf800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2023-12-03T11:47:51.045 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.043+0000 7f4a11faf800 20 rados->read ofs=0 len=0 2023-12-03T11:47:51.045 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.044+0000 7f4a11faf800 20 rados_obj.operate() r=0 bl.length=200 2023-12-03T11:47:51.046 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.044+0000 7f4a11faf800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2023-12-03T11:47:51.046 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.044+0000 7f4a11faf800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2023-12-03T11:47:51.046 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.044+0000 7f4a11faf800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17 : miss 2023-12-03T11:47:51.046 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.044+0000 7f4a11faf800 20 rados->read ofs=0 len=0 2023-12-03T11:47:51.047 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.044+0000 7f4a11faf800 20 rados_obj.operate() r=0 bl.length=372 2023-12-03T11:47:51.047 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.044+0000 7f4a11faf800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17 info.flags=0x17 2023-12-03T11:47:51.047 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.044+0000 7f4a11faf800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17 to cache LRU end 2023-12-03T11:47:51.047 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.044+0000 7f4a11faf800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:47:51.047 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.044+0000 7f4a11faf800 10 updating xattr: name=user.rgw.acl bl.length()=203 2023-12-03T11:47:51.047 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.044+0000 7f4a11faf800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17 2023-12-03T11:47:51.048 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.047+0000 7f49d5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:47:51.050 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.049+0000 7f4a11faf800 20 remove_watcher() i=0 2023-12-03T11:47:51.050 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.049+0000 7f4a11faf800 2 removed watcher, disabling cache 2023-12-03T11:47:51.051 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.050+0000 7f4a11faf800 20 remove_watcher() i=1 2023-12-03T11:47:51.052 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.051+0000 7f4a11faf800 20 remove_watcher() i=2 2023-12-03T11:47:51.054 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.053+0000 7f4a11faf800 20 remove_watcher() i=3 2023-12-03T11:47:51.055 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.054+0000 7f4a11faf800 20 remove_watcher() i=4 2023-12-03T11:47:51.056 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.055+0000 7f4a11faf800 20 remove_watcher() i=5 2023-12-03T11:47:51.057 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.056+0000 7f4a11faf800 20 remove_watcher() i=6 2023-12-03T11:47:51.058 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.057+0000 7f4a11faf800 20 remove_watcher() i=7 2023-12-03T11:47:51.064 INFO:tasks.workunit.client.0.smithi003.stderr:radosgw-admin reshard list 2023-12-03T11:47:51.090 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:47:51.090 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:47:51.104 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.103+0000 7fe095922800 20 rados->read ofs=0 len=0 2023-12-03T11:47:51.106 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.105+0000 7fe095922800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:47:51.107 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.105+0000 7fe095922800 20 realm 2023-12-03T11:47:51.107 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.105+0000 7fe095922800 20 rados->read ofs=0 len=0 2023-12-03T11:47:51.107 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.105+0000 7fe095922800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:47:51.107 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.105+0000 7fe095922800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:47:51.107 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.105+0000 7fe095922800 20 rados->read ofs=0 len=0 2023-12-03T11:47:51.107 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.105+0000 7fe095922800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:47:51.107 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.105+0000 7fe095922800 20 rados->read ofs=0 len=0 2023-12-03T11:47:51.108 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.106+0000 7fe095922800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:47:51.108 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.106+0000 7fe095922800 20 rados->read ofs=0 len=0 2023-12-03T11:47:51.108 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.107+0000 7fe095922800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:47:51.108 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.107+0000 7fe095922800 20 searching for the correct realm 2023-12-03T11:47:51.118 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.116+0000 7fe090da5640 0 -- 172.21.15.3:0/2988429612 >> [v2:172.21.15.3:6817/3356208405,v1:172.21.15.3:6819/3356208405] conn(0x55956388a890 msgr2=0x55956388cc80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:47:51.120 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.119+0000 7fe095922800 20 RGWRados::pool_iterate: got zone_info.83aabb46-04b5-4c96-9933-c6bfb1173a73 2023-12-03T11:47:51.120 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.119+0000 7fe095922800 20 RGWRados::pool_iterate: got zonegroup_info.6a811aad-435d-4fdd-93c9-b7e0b50de429 2023-12-03T11:47:51.120 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.119+0000 7fe095922800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:47:51.120 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.119+0000 7fe095922800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:47:51.120 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.119+0000 7fe095922800 20 rados->read ofs=0 len=0 2023-12-03T11:47:51.120 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.119+0000 7fe095922800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:47:51.120 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.119+0000 7fe095922800 20 rados->read ofs=0 len=0 2023-12-03T11:47:51.121 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.119+0000 7fe095922800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:47:51.121 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.119+0000 7fe095922800 20 rados->read ofs=0 len=0 2023-12-03T11:47:51.121 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.119+0000 7fe095922800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:47:51.122 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.119+0000 7fe095922800 20 zone default found 2023-12-03T11:47:51.122 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.119+0000 7fe095922800 4 Realm: () 2023-12-03T11:47:51.122 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.119+0000 7fe095922800 4 ZoneGroup: default (6a811aad-435d-4fdd-93c9-b7e0b50de429) 2023-12-03T11:47:51.122 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.119+0000 7fe095922800 4 Zone: default (83aabb46-04b5-4c96-9933-c6bfb1173a73) 2023-12-03T11:47:51.122 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.119+0000 7fe095922800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:47:51.122 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.119+0000 7fe095922800 20 zonegroup default 2023-12-03T11:47:51.122 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.119+0000 7fe095922800 20 rados->read ofs=0 len=0 2023-12-03T11:47:51.122 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.120+0000 7fe095922800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:47:51.122 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.120+0000 7fe095922800 20 rados->read ofs=0 len=0 2023-12-03T11:47:51.122 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.120+0000 7fe095922800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:47:51.122 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.120+0000 7fe095922800 20 rados->read ofs=0 len=0 2023-12-03T11:47:51.122 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.120+0000 7fe095922800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:47:51.122 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.120+0000 7fe095922800 20 started sync module instance, tier type = 2023-12-03T11:47:51.122 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.120+0000 7fe095922800 20 started zone id=83aabb46-04b5-4c96-9933-c6bfb1173a73 (name=default) with tier type = 2023-12-03T11:47:51.126 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.125+0000 7fe091da7640 0 -- 172.21.15.3:0/2988429612 >> [v2:172.21.15.37:6817/511039327,v1:172.21.15.37:6819/511039327] conn(0x7fe088020930 msgr2=0x7fe08803b410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:47:51.131 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.129+0000 7fe095922800 20 add_watcher() i=0 2023-12-03T11:47:51.131 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.129+0000 7fe095922800 20 add_watcher() i=1 2023-12-03T11:47:51.131 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.129+0000 7fe095922800 20 add_watcher() i=2 2023-12-03T11:47:51.131 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.129+0000 7fe095922800 20 add_watcher() i=3 2023-12-03T11:47:51.131 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.129+0000 7fe095922800 20 add_watcher() i=4 2023-12-03T11:47:51.131 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.129+0000 7fe095922800 20 add_watcher() i=5 2023-12-03T11:47:51.132 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.130+0000 7fe095922800 20 add_watcher() i=6 2023-12-03T11:47:51.132 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.130+0000 7fe095922800 20 add_watcher() i=7 2023-12-03T11:47:51.132 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.130+0000 7fe095922800 2 all 8 watchers are set, enabling cache 2023-12-03T11:47:51.133 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.132+0000 7fe056fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:47:51.134 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.133+0000 7fe095922800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:47:51.134 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.133+0000 7fe095922800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:47:51.141 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.139+0000 7fe095922800 5 note: GC not initialized 2023-12-03T11:47:51.141 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.139+0000 7fdfc5ffb640 20 reqs_thread_entry: start 2023-12-03T11:47:51.141 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.139+0000 7fe095922800 20 init_complete bucket index max shards: 11 2023-12-03T11:47:51.141 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.139+0000 7fe095922800 20 Filter name: none 2023-12-03T11:47:51.141 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.139+0000 7fdfb77fe640 20 reqs_thread_entry: start 2023-12-03T11:47:51.150 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.148+0000 7fe056fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:47:51.152 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.150+0000 7fe095922800 20 remove_watcher() i=0 2023-12-03T11:47:51.152 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.150+0000 7fe095922800 2 removed watcher, disabling cache 2023-12-03T11:47:51.153 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.152+0000 7fe095922800 20 remove_watcher() i=1 2023-12-03T11:47:51.154 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.153+0000 7fe095922800 20 remove_watcher() i=2 2023-12-03T11:47:51.155 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.154+0000 7fe095922800 20 remove_watcher() i=3 2023-12-03T11:47:51.156 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.155+0000 7fe095922800 20 remove_watcher() i=4 2023-12-03T11:47:51.157 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.156+0000 7fe095922800 20 remove_watcher() i=5 2023-12-03T11:47:51.158 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.157+0000 7fe095922800 20 remove_watcher() i=6 2023-12-03T11:47:51.159 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.158+0000 7fe095922800 20 remove_watcher() i=7 2023-12-03T11:47:51.164 INFO:tasks.workunit.client.0.smithi003.stderr:bucket name a-bucket 2023-12-03T11:47:51.164 INFO:tasks.workunit.client.0.smithi003.stderr:TEST: reshard process 2023-12-03T11:47:51.164 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:47:51.165 INFO:tasks.workunit.client.0.smithi003.stderr:radosgw-admin reshard process 2023-12-03T11:47:51.191 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:47:51.191 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:47:51.205 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.204+0000 7f1947725800 20 rados->read ofs=0 len=0 2023-12-03T11:47:51.206 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.205+0000 7f1947725800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:47:51.206 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.205+0000 7f1947725800 20 realm 2023-12-03T11:47:51.207 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.205+0000 7f1947725800 20 rados->read ofs=0 len=0 2023-12-03T11:47:51.207 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.206+0000 7f1947725800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:47:51.207 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.206+0000 7f1947725800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:47:51.207 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.206+0000 7f1947725800 20 rados->read ofs=0 len=0 2023-12-03T11:47:51.207 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.206+0000 7f1947725800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:47:51.208 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.206+0000 7f1947725800 20 rados->read ofs=0 len=0 2023-12-03T11:47:51.208 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.207+0000 7f1947725800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:47:51.208 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.207+0000 7f1947725800 20 rados->read ofs=0 len=0 2023-12-03T11:47:51.208 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.207+0000 7f1947725800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:47:51.208 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.207+0000 7f1947725800 20 searching for the correct realm 2023-12-03T11:47:51.218 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.217+0000 7f19434e5640 0 -- 172.21.15.3:0/280828357 >> [v2:172.21.15.37:6805/1692844418,v1:172.21.15.37:6807/1692844418] conn(0x563388f8b410 msgr2=0x563388f8d800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:47:51.220 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.219+0000 7f1947725800 20 RGWRados::pool_iterate: got zone_info.83aabb46-04b5-4c96-9933-c6bfb1173a73 2023-12-03T11:47:51.220 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.219+0000 7f1947725800 20 RGWRados::pool_iterate: got zonegroup_info.6a811aad-435d-4fdd-93c9-b7e0b50de429 2023-12-03T11:47:51.220 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.219+0000 7f1947725800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:47:51.220 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.219+0000 7f1947725800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:47:51.221 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.219+0000 7f1947725800 20 rados->read ofs=0 len=0 2023-12-03T11:47:51.221 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.219+0000 7f1947725800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:47:51.221 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.219+0000 7f1947725800 20 rados->read ofs=0 len=0 2023-12-03T11:47:51.222 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.219+0000 7f1947725800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:47:51.222 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.219+0000 7f1947725800 20 rados->read ofs=0 len=0 2023-12-03T11:47:51.222 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.220+0000 7f1947725800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:47:51.222 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.220+0000 7f1947725800 20 zone default found 2023-12-03T11:47:51.222 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.220+0000 7f1947725800 4 Realm: () 2023-12-03T11:47:51.222 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.220+0000 7f1947725800 4 ZoneGroup: default (6a811aad-435d-4fdd-93c9-b7e0b50de429) 2023-12-03T11:47:51.222 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.220+0000 7f1947725800 4 Zone: default (83aabb46-04b5-4c96-9933-c6bfb1173a73) 2023-12-03T11:47:51.222 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.220+0000 7f1947725800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:47:51.222 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.220+0000 7f1947725800 20 zonegroup default 2023-12-03T11:47:51.222 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.220+0000 7f1947725800 20 rados->read ofs=0 len=0 2023-12-03T11:47:51.223 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.220+0000 7f1947725800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:47:51.223 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.220+0000 7f1947725800 20 rados->read ofs=0 len=0 2023-12-03T11:47:51.223 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.220+0000 7f1947725800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:47:51.223 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.220+0000 7f1947725800 20 rados->read ofs=0 len=0 2023-12-03T11:47:51.223 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.221+0000 7f1947725800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:47:51.223 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.221+0000 7f1947725800 20 started sync module instance, tier type = 2023-12-03T11:47:51.223 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.221+0000 7f1947725800 20 started zone id=83aabb46-04b5-4c96-9933-c6bfb1173a73 (name=default) with tier type = 2023-12-03T11:47:51.228 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.227+0000 7f1943ce6640 0 -- 172.21.15.3:0/280828357 >> [v2:172.21.15.37:6816/3770469300,v1:172.21.15.37:6818/3770469300] conn(0x7f193801b410 msgr2=0x7f193801b890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:47:51.231 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.230+0000 7f1947725800 20 add_watcher() i=0 2023-12-03T11:47:51.232 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.230+0000 7f1947725800 20 add_watcher() i=1 2023-12-03T11:47:51.232 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.230+0000 7f1947725800 20 add_watcher() i=2 2023-12-03T11:47:51.232 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.230+0000 7f1947725800 20 add_watcher() i=3 2023-12-03T11:47:51.232 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.230+0000 7f1947725800 20 add_watcher() i=4 2023-12-03T11:47:51.232 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.230+0000 7f1947725800 20 add_watcher() i=5 2023-12-03T11:47:51.232 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.230+0000 7f1947725800 20 add_watcher() i=6 2023-12-03T11:47:51.232 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.231+0000 7f1947725800 20 add_watcher() i=7 2023-12-03T11:47:51.232 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.231+0000 7f1947725800 2 all 8 watchers are set, enabling cache 2023-12-03T11:47:51.234 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.233+0000 7f19097e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:47:51.234 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.233+0000 7f1947725800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:47:51.235 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.233+0000 7f1947725800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:47:51.241 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.239+0000 7f1947725800 5 note: GC not initialized 2023-12-03T11:47:51.241 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.240+0000 7f1877fff640 20 reqs_thread_entry: start 2023-12-03T11:47:51.242 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.240+0000 7f1947725800 20 init_complete bucket index max shards: 11 2023-12-03T11:47:51.242 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.240+0000 7f1947725800 20 Filter name: none 2023-12-03T11:47:51.242 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.240+0000 7f1875ffb640 20 reqs_thread_entry: start 2023-12-03T11:47:51.242 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.240+0000 7f1947725800 20 processing logshard = reshard.0000000000 2023-12-03T11:47:51.244 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.243+0000 7f1947725800 20 finish processing logshard = reshard.0000000000 , ret = 0 2023-12-03T11:47:51.244 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.243+0000 7f1947725800 20 processing logshard = reshard.0000000001 2023-12-03T11:47:51.246 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.245+0000 7f1947725800 20 finish processing logshard = reshard.0000000001 , ret = 0 2023-12-03T11:47:51.247 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.245+0000 7f1947725800 20 processing logshard = reshard.0000000002 2023-12-03T11:47:51.249 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.248+0000 7f1947725800 20 finish processing logshard = reshard.0000000002 , ret = 0 2023-12-03T11:47:51.249 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.248+0000 7f1947725800 20 processing logshard = reshard.0000000003 2023-12-03T11:47:51.252 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.250+0000 7f1947725800 20 finish processing logshard = reshard.0000000003 , ret = 0 2023-12-03T11:47:51.252 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.250+0000 7f1947725800 20 processing logshard = reshard.0000000004 2023-12-03T11:47:51.254 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.253+0000 7f1947725800 20 finish processing logshard = reshard.0000000004 , ret = 0 2023-12-03T11:47:51.255 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.253+0000 7f1947725800 20 processing logshard = reshard.0000000005 2023-12-03T11:47:51.257 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.256+0000 7f1947725800 20 finish processing logshard = reshard.0000000005 , ret = 0 2023-12-03T11:47:51.257 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.256+0000 7f1947725800 20 processing logshard = reshard.0000000006 2023-12-03T11:47:51.259 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.258+0000 7f1947725800 20 process_entry resharding a-bucket 2023-12-03T11:47:51.259 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.258+0000 7f1947725800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2023-12-03T11:47:51.259 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.258+0000 7f1947725800 20 rados->read ofs=0 len=0 2023-12-03T11:47:51.259 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.258+0000 7f1947725800 20 rados_obj.operate() r=0 bl.length=200 2023-12-03T11:47:51.259 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.258+0000 7f1947725800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x1 2023-12-03T11:47:51.259 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.258+0000 7f1947725800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2023-12-03T11:47:51.260 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.258+0000 7f1947725800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17 : miss 2023-12-03T11:47:51.260 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.258+0000 7f1947725800 20 rados->read ofs=0 len=0 2023-12-03T11:47:51.260 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.258+0000 7f1947725800 20 rados_obj.operate() r=0 bl.length=372 2023-12-03T11:47:51.261 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.258+0000 7f1947725800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17 info.flags=0x17 2023-12-03T11:47:51.261 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.258+0000 7f1947725800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17 to cache LRU end 2023-12-03T11:47:51.261 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.258+0000 7f1947725800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:47:51.261 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.258+0000 7f1947725800 10 updating xattr: name=user.rgw.acl bl.length()=203 2023-12-03T11:47:51.261 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.258+0000 7f1947725800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17 2023-12-03T11:47:51.267 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.266+0000 7f1947725800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17 info.flags=0x17 2023-12-03T11:47:51.267 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.266+0000 7f1947725800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17 to cache LRU end 2023-12-03T11:47:51.267 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.266+0000 7f1947725800 10 updating xattr: name=user.rgw.acl bl.length()=203 2023-12-03T11:47:51.267 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.266+0000 7f1947725800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17, ofs0, ns] 2023-12-03T11:47:51.268 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.266+0000 7f1929ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660560 cookie 94779341367504 notifier 6189 bl.length()=861 2023-12-03T11:47:51.268 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.266+0000 7f1929ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17 info.flags=0x17 2023-12-03T11:47:51.268 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.266+0000 7f1929ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17 to cache LRU end 2023-12-03T11:47:51.268 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.266+0000 7f1929ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2023-12-03T11:47:51.269 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.268+0000 7f1947725800 20 handle_bi_update(): bucket=:a-bucket[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17]): orig_sources= new_sources= 2023-12-03T11:47:51.269 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.268+0000 7f1947725800 20 handle_bi_update(): bucket=:a-bucket[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17]): potential sources added=[] removed=[] 2023-12-03T11:47:51.269 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.268+0000 7f1947725800 20 handle_bi_update(): bucket=:a-bucket[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17]): orig_dests= new_dests= 2023-12-03T11:47:51.270 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.268+0000 7f1947725800 20 handle_bi_update(): bucket=:a-bucket[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17]): potential dests added=[] removed=[] 2023-12-03T11:47:51.272 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.271+0000 7f1947725800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.1.0 2023-12-03T11:47:51.272 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.271+0000 7f1947725800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.1.0 2023-12-03T11:47:51.272 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.271+0000 7f1947725800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.1.1 2023-12-03T11:47:51.273 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.271+0000 7f1947725800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.1.1 2023-12-03T11:47:51.273 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.271+0000 7f1947725800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.1.2 2023-12-03T11:47:51.273 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.271+0000 7f1947725800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.1.2 2023-12-03T11:47:51.273 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.271+0000 7f1947725800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.1.3 2023-12-03T11:47:51.273 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.271+0000 7f1947725800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.1.3 2023-12-03T11:47:51.273 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.271+0000 7f1947725800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.1.4 2023-12-03T11:47:51.274 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.271+0000 7f1947725800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.1.4 2023-12-03T11:47:51.274 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.271+0000 7f1947725800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.1.5 2023-12-03T11:47:51.274 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.271+0000 7f1947725800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.1.5 2023-12-03T11:47:51.274 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.271+0000 7f1947725800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.1.6 2023-12-03T11:47:51.274 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.271+0000 7f1947725800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.1.6 2023-12-03T11:47:51.274 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.271+0000 7f1947725800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.1.7 2023-12-03T11:47:51.274 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.271+0000 7f1947725800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.1.7 2023-12-03T11:47:51.274 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.271+0000 7f1947725800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.1.8 2023-12-03T11:47:51.274 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.271+0000 7f1947725800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.1.8 2023-12-03T11:47:51.274 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.271+0000 7f1947725800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.1.9 2023-12-03T11:47:51.274 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.271+0000 7f1947725800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.1.9 2023-12-03T11:47:51.274 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.271+0000 7f1947725800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.1.10 2023-12-03T11:47:51.274 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.271+0000 7f1947725800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.1.10 2023-12-03T11:47:51.274 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.271+0000 7f1947725800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.1.11 2023-12-03T11:47:51.275 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.271+0000 7f1947725800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.1.11 2023-12-03T11:47:51.275 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.271+0000 7f1947725800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.0 2023-12-03T11:47:51.275 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.271+0000 7f1947725800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.1 2023-12-03T11:47:51.276 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.271+0000 7f1947725800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.2 2023-12-03T11:47:51.276 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.272+0000 7f1947725800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.3 2023-12-03T11:47:51.276 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.272+0000 7f1947725800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.4 2023-12-03T11:47:51.276 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.273+0000 7f1947725800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.5 2023-12-03T11:47:51.276 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.273+0000 7f1947725800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.6 2023-12-03T11:47:51.276 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.274+0000 7f1947725800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.7 2023-12-03T11:47:51.276 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.274+0000 7f1947725800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.8 2023-12-03T11:47:51.276 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.274+0000 7f1947725800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.9 2023-12-03T11:47:51.276 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.275+0000 7f1947725800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.10 2023-12-03T11:47:51.277 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.275+0000 7f1947725800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17 : hit (requested=0x17, cached=0x17) 2023-12-03T11:47:51.277 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.275+0000 7f1947725800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17 2023-12-03T11:47:51.278 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.276+0000 7f1947725800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17 info.flags=0x17 2023-12-03T11:47:51.278 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.276+0000 7f1947725800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17 to cache LRU end 2023-12-03T11:47:51.278 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.276+0000 7f1947725800 10 updating xattr: name=user.rgw.acl bl.length()=203 2023-12-03T11:47:51.278 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.276+0000 7f1947725800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17, ofs0, ns] 2023-12-03T11:47:51.278 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.277+0000 7f19297fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660561 cookie 94779341367504 notifier 6189 bl.length()=829 2023-12-03T11:47:51.278 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.277+0000 7f19297fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17 info.flags=0x17 2023-12-03T11:47:51.278 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.277+0000 7f19297fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17 to cache LRU end 2023-12-03T11:47:51.278 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.277+0000 7f19297fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2023-12-03T11:47:51.279 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.278+0000 7f1947725800 20 handle_bi_update(): bucket=:a-bucket[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17]): orig_sources= new_sources= 2023-12-03T11:47:51.279 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.278+0000 7f1947725800 20 handle_bi_update(): bucket=:a-bucket[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17]): potential sources added=[] removed=[] 2023-12-03T11:47:51.280 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.278+0000 7f1947725800 20 handle_bi_update(): bucket=:a-bucket[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17]): orig_dests= new_dests= 2023-12-03T11:47:51.280 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.278+0000 7f1947725800 20 handle_bi_update(): bucket=:a-bucket[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17]): potential dests added=[] removed=[] 2023-12-03T11:47:51.282 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.281+0000 7f1947725800 1 execute INFO: reshard of bucket "a-bucket" completed successfully 2023-12-03T11:47:51.283 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.282+0000 7f1947725800 20 process_entry removing reshard queue entry for bucket a-bucket 2023-12-03T11:47:51.285 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.284+0000 7f1947725800 20 finish processing logshard = reshard.0000000006 , ret = 0 2023-12-03T11:47:51.285 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.284+0000 7f1947725800 20 processing logshard = reshard.0000000007 2023-12-03T11:47:51.287 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.286+0000 7f1947725800 20 finish processing logshard = reshard.0000000007 , ret = 0 2023-12-03T11:47:51.287 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.286+0000 7f1947725800 20 processing logshard = reshard.0000000008 2023-12-03T11:47:51.290 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.288+0000 7f1947725800 20 finish processing logshard = reshard.0000000008 , ret = 0 2023-12-03T11:47:51.290 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.288+0000 7f1947725800 20 processing logshard = reshard.0000000009 2023-12-03T11:47:51.292 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.291+0000 7f1947725800 20 finish processing logshard = reshard.0000000009 , ret = 0 2023-12-03T11:47:51.293 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.291+0000 7f1947725800 20 processing logshard = reshard.0000000010 2023-12-03T11:47:51.295 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.294+0000 7f1947725800 20 finish processing logshard = reshard.0000000010 , ret = 0 2023-12-03T11:47:51.295 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.294+0000 7f1947725800 20 processing logshard = reshard.0000000011 2023-12-03T11:47:51.297 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.296+0000 7f1947725800 20 finish processing logshard = reshard.0000000011 , ret = 0 2023-12-03T11:47:51.297 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.296+0000 7f1947725800 20 processing logshard = reshard.0000000012 2023-12-03T11:47:51.300 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.299+0000 7f1947725800 20 finish processing logshard = reshard.0000000012 , ret = 0 2023-12-03T11:47:51.300 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.299+0000 7f1947725800 20 processing logshard = reshard.0000000013 2023-12-03T11:47:51.303 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.301+0000 7f1947725800 20 finish processing logshard = reshard.0000000013 , ret = 0 2023-12-03T11:47:51.303 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.301+0000 7f1947725800 20 processing logshard = reshard.0000000014 2023-12-03T11:47:51.305 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.304+0000 7f1947725800 20 finish processing logshard = reshard.0000000014 , ret = 0 2023-12-03T11:47:51.305 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.304+0000 7f1947725800 20 processing logshard = reshard.0000000015 2023-12-03T11:47:51.307 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.306+0000 7f1947725800 20 finish processing logshard = reshard.0000000015 , ret = 0 2023-12-03T11:47:51.308 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.307+0000 7f19097e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:47:51.310 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.309+0000 7f1947725800 20 remove_watcher() i=0 2023-12-03T11:47:51.310 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.309+0000 7f1947725800 2 removed watcher, disabling cache 2023-12-03T11:47:51.311 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.310+0000 7f1947725800 20 remove_watcher() i=1 2023-12-03T11:47:51.312 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.311+0000 7f1947725800 20 remove_watcher() i=2 2023-12-03T11:47:51.314 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.312+0000 7f1947725800 20 remove_watcher() i=3 2023-12-03T11:47:51.315 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.314+0000 7f1947725800 20 remove_watcher() i=4 2023-12-03T11:47:51.316 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.314+0000 7f1947725800 20 remove_watcher() i=5 2023-12-03T11:47:51.316 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.315+0000 7f1947725800 20 remove_watcher() i=6 2023-12-03T11:47:51.317 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:51.316+0000 7f1947725800 20 remove_watcher() i=7 2023-12-03T11:47:56.330 INFO:tasks.workunit.client.0.smithi003.stderr:radosgw-admin bucket stats --bucket a-bucket 2023-12-03T11:47:56.361 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:47:56.362 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:47:56.378 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.377+0000 7f87b3f27800 20 rados->read ofs=0 len=0 2023-12-03T11:47:56.381 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.380+0000 7f87b3f27800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:47:56.381 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.380+0000 7f87b3f27800 20 realm 2023-12-03T11:47:56.381 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.380+0000 7f87b3f27800 20 rados->read ofs=0 len=0 2023-12-03T11:47:56.381 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.380+0000 7f87b3f27800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:47:56.382 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.380+0000 7f87b3f27800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:47:56.382 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.380+0000 7f87b3f27800 20 rados->read ofs=0 len=0 2023-12-03T11:47:56.382 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.380+0000 7f87b3f27800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:47:56.382 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.380+0000 7f87b3f27800 20 rados->read ofs=0 len=0 2023-12-03T11:47:56.382 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.381+0000 7f87b3f27800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:47:56.382 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.381+0000 7f87b3f27800 20 rados->read ofs=0 len=0 2023-12-03T11:47:56.383 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.382+0000 7f87b3f27800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:47:56.383 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.382+0000 7f87b3f27800 20 searching for the correct realm 2023-12-03T11:47:56.395 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.394+0000 7f87afcbf640 0 -- 172.21.15.3:0/2011107402 >> [v2:172.21.15.37:6805/1692844418,v1:172.21.15.37:6807/1692844418] conn(0x5570b2a243f0 msgr2=0x5570b2a267e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:47:56.398 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.396+0000 7f87b3f27800 20 RGWRados::pool_iterate: got zone_info.83aabb46-04b5-4c96-9933-c6bfb1173a73 2023-12-03T11:47:56.398 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.396+0000 7f87b3f27800 20 RGWRados::pool_iterate: got zonegroup_info.6a811aad-435d-4fdd-93c9-b7e0b50de429 2023-12-03T11:47:56.398 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.396+0000 7f87b3f27800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:47:56.398 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.396+0000 7f87b3f27800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:47:56.398 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.396+0000 7f87b3f27800 20 rados->read ofs=0 len=0 2023-12-03T11:47:56.398 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.396+0000 7f87b3f27800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:47:56.398 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.396+0000 7f87b3f27800 20 rados->read ofs=0 len=0 2023-12-03T11:47:56.398 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.397+0000 7f87b3f27800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:47:56.398 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.397+0000 7f87b3f27800 20 rados->read ofs=0 len=0 2023-12-03T11:47:56.399 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.397+0000 7f87b3f27800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:47:56.400 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.397+0000 7f87b3f27800 20 zone default found 2023-12-03T11:47:56.400 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.397+0000 7f87b3f27800 4 Realm: () 2023-12-03T11:47:56.400 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.397+0000 7f87b3f27800 4 ZoneGroup: default (6a811aad-435d-4fdd-93c9-b7e0b50de429) 2023-12-03T11:47:56.400 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.397+0000 7f87b3f27800 4 Zone: default (83aabb46-04b5-4c96-9933-c6bfb1173a73) 2023-12-03T11:47:56.401 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.397+0000 7f87b3f27800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:47:56.401 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.397+0000 7f87b3f27800 20 zonegroup default 2023-12-03T11:47:56.401 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.397+0000 7f87b3f27800 20 rados->read ofs=0 len=0 2023-12-03T11:47:56.401 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.397+0000 7f87b3f27800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:47:56.401 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.397+0000 7f87b3f27800 20 rados->read ofs=0 len=0 2023-12-03T11:47:56.401 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.398+0000 7f87b3f27800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:47:56.401 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.398+0000 7f87b3f27800 20 rados->read ofs=0 len=0 2023-12-03T11:47:56.401 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.398+0000 7f87b3f27800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:47:56.401 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.398+0000 7f87b3f27800 20 started sync module instance, tier type = 2023-12-03T11:47:56.401 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.398+0000 7f87b3f27800 20 started zone id=83aabb46-04b5-4c96-9933-c6bfb1173a73 (name=default) with tier type = 2023-12-03T11:47:56.406 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.405+0000 7f87b04c0640 0 -- 172.21.15.3:0/2011107402 >> [v2:172.21.15.37:6816/3770469300,v1:172.21.15.37:6818/3770469300] conn(0x7f87a405b750 msgr2=0x7f87a408b270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:47:56.410 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.409+0000 7f87b3f27800 20 add_watcher() i=0 2023-12-03T11:47:56.410 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.409+0000 7f87b3f27800 20 add_watcher() i=1 2023-12-03T11:47:56.410 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.409+0000 7f87b3f27800 20 add_watcher() i=2 2023-12-03T11:47:56.410 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.409+0000 7f87b3f27800 20 add_watcher() i=3 2023-12-03T11:47:56.410 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.409+0000 7f87b3f27800 20 add_watcher() i=4 2023-12-03T11:47:56.411 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.409+0000 7f87b3f27800 20 add_watcher() i=5 2023-12-03T11:47:56.411 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.409+0000 7f87b3f27800 20 add_watcher() i=6 2023-12-03T11:47:56.411 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.410+0000 7f87b3f27800 20 add_watcher() i=7 2023-12-03T11:47:56.411 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.410+0000 7f87b3f27800 2 all 8 watchers are set, enabling cache 2023-12-03T11:47:56.413 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.412+0000 7f8775fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:47:56.413 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.412+0000 7f87b3f27800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:47:56.413 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.412+0000 7f87b3f27800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:47:56.420 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.419+0000 7f87b3f27800 5 note: GC not initialized 2023-12-03T11:47:56.421 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.419+0000 7f86ecff9640 20 reqs_thread_entry: start 2023-12-03T11:47:56.421 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.419+0000 7f87b3f27800 20 init_complete bucket index max shards: 11 2023-12-03T11:47:56.421 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.419+0000 7f87b3f27800 20 Filter name: none 2023-12-03T11:47:56.421 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.419+0000 7f86e27fc640 20 reqs_thread_entry: start 2023-12-03T11:47:56.421 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.419+0000 7f87b3f27800 20 rados->read ofs=0 len=0 2023-12-03T11:47:56.421 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.420+0000 7f87b3f27800 20 rados_obj.operate() r=0 bl.length=200 2023-12-03T11:47:56.421 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.420+0000 7f87b3f27800 20 rados->read ofs=0 len=0 2023-12-03T11:47:56.422 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.421+0000 7f87b3f27800 20 rados_obj.operate() r=0 bl.length=372 2023-12-03T11:47:56.422 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.421+0000 7f87b3f27800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:47:56.422 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.421+0000 7f87b3f27800 20 rados->read ofs=0 len=0 2023-12-03T11:47:56.422 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.421+0000 7f87b3f27800 20 rados_obj.operate() r=0 bl.length=200 2023-12-03T11:47:56.423 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.421+0000 7f87b3f27800 20 rados->read ofs=0 len=0 2023-12-03T11:47:56.423 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.421+0000 7f87b3f27800 20 rados_obj.operate() r=0 bl.length=372 2023-12-03T11:47:56.423 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.421+0000 7f87b3f27800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:47:56.424 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.422+0000 7f87b3f27800 20 rados->read ofs=0 len=0 2023-12-03T11:47:56.424 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.423+0000 7f87b3f27800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:47:56.425 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.424+0000 7f8775fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:47:56.427 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.426+0000 7f87b3f27800 20 remove_watcher() i=0 2023-12-03T11:47:56.428 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.426+0000 7f87b3f27800 2 removed watcher, disabling cache 2023-12-03T11:47:56.429 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.428+0000 7f87b3f27800 20 remove_watcher() i=1 2023-12-03T11:47:56.430 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.429+0000 7f87b3f27800 20 remove_watcher() i=2 2023-12-03T11:47:56.431 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.430+0000 7f87b3f27800 20 remove_watcher() i=3 2023-12-03T11:47:56.432 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.431+0000 7f87b3f27800 20 remove_watcher() i=4 2023-12-03T11:47:56.434 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.432+0000 7f87b3f27800 20 remove_watcher() i=5 2023-12-03T11:47:56.435 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.433+0000 7f87b3f27800 20 remove_watcher() i=6 2023-12-03T11:47:56.436 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.435+0000 7f87b3f27800 20 remove_watcher() i=7 2023-12-03T11:47:56.441 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:47:56.441 INFO:tasks.workunit.client.0.smithi003.stderr:BUCKET_STATS: 2023-12-03T11:47:56.441 INFO:tasks.workunit.client.0.smithi003.stderr:bucket: a-bucket id: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17 num_objects: 0 size_kb: 0 num_shards: 12 2023-12-03T11:47:56.441 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:47:56.442 INFO:tasks.workunit.client.0.smithi003.stderr:TEST: reshard add non empty bucket 2023-12-03T11:47:56.442 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:47:56.688 INFO:tasks.workunit.client.0.smithi003.stderr:radosgw-admin bucket stats --bucket a-bucket 2023-12-03T11:47:56.716 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:47:56.716 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:47:56.730 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.729+0000 7f45bfa2d800 20 rados->read ofs=0 len=0 2023-12-03T11:47:56.732 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.730+0000 7f45bfa2d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:47:56.732 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.730+0000 7f45bfa2d800 20 realm 2023-12-03T11:47:56.732 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.730+0000 7f45bfa2d800 20 rados->read ofs=0 len=0 2023-12-03T11:47:56.732 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.731+0000 7f45bfa2d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:47:56.732 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.731+0000 7f45bfa2d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:47:56.732 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.731+0000 7f45bfa2d800 20 rados->read ofs=0 len=0 2023-12-03T11:47:56.732 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.731+0000 7f45bfa2d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:47:56.733 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.731+0000 7f45bfa2d800 20 rados->read ofs=0 len=0 2023-12-03T11:47:56.733 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.732+0000 7f45bfa2d800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:47:56.733 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.732+0000 7f45bfa2d800 20 rados->read ofs=0 len=0 2023-12-03T11:47:56.733 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.732+0000 7f45bfa2d800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:47:56.733 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.732+0000 7f45bfa2d800 20 searching for the correct realm 2023-12-03T11:47:56.745 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.743+0000 7f45bac2e640 0 -- 172.21.15.3:0/2114071496 >> [v2:172.21.15.37:6805/1692844418,v1:172.21.15.37:6807/1692844418] conn(0x56136c4c8f90 msgr2=0x56136c4cb380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:47:56.746 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.744+0000 7f45bfa2d800 20 RGWRados::pool_iterate: got zone_info.83aabb46-04b5-4c96-9933-c6bfb1173a73 2023-12-03T11:47:56.746 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.744+0000 7f45bfa2d800 20 RGWRados::pool_iterate: got zonegroup_info.6a811aad-435d-4fdd-93c9-b7e0b50de429 2023-12-03T11:47:56.746 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.744+0000 7f45bfa2d800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:47:56.746 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.744+0000 7f45bfa2d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:47:56.746 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.744+0000 7f45bfa2d800 20 rados->read ofs=0 len=0 2023-12-03T11:47:56.746 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.744+0000 7f45bfa2d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:47:56.746 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.744+0000 7f45bfa2d800 20 rados->read ofs=0 len=0 2023-12-03T11:47:56.746 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.744+0000 7f45bfa2d800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:47:56.746 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.744+0000 7f45bfa2d800 20 rados->read ofs=0 len=0 2023-12-03T11:47:56.747 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.745+0000 7f45bfa2d800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:47:56.747 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.745+0000 7f45bfa2d800 20 zone default found 2023-12-03T11:47:56.747 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.745+0000 7f45bfa2d800 4 Realm: () 2023-12-03T11:47:56.747 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.745+0000 7f45bfa2d800 4 ZoneGroup: default (6a811aad-435d-4fdd-93c9-b7e0b50de429) 2023-12-03T11:47:56.747 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.745+0000 7f45bfa2d800 4 Zone: default (83aabb46-04b5-4c96-9933-c6bfb1173a73) 2023-12-03T11:47:56.748 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.745+0000 7f45bfa2d800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:47:56.748 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.745+0000 7f45bfa2d800 20 zonegroup default 2023-12-03T11:47:56.748 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.745+0000 7f45bfa2d800 20 rados->read ofs=0 len=0 2023-12-03T11:47:56.748 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.745+0000 7f45bfa2d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:47:56.748 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.745+0000 7f45bfa2d800 20 rados->read ofs=0 len=0 2023-12-03T11:47:56.748 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.745+0000 7f45bfa2d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:47:56.748 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.745+0000 7f45bfa2d800 20 rados->read ofs=0 len=0 2023-12-03T11:47:56.748 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.745+0000 7f45bfa2d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:47:56.748 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.745+0000 7f45bfa2d800 20 started sync module instance, tier type = 2023-12-03T11:47:56.748 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.745+0000 7f45bfa2d800 20 started zone id=83aabb46-04b5-4c96-9933-c6bfb1173a73 (name=default) with tier type = 2023-12-03T11:47:56.755 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.754+0000 7f45ba42d640 0 -- 172.21.15.3:0/2114071496 >> [v2:172.21.15.3:6817/3356208405,v1:172.21.15.3:6819/3356208405] conn(0x56136c4cdfa0 msgr2=0x56136c4d0390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:47:56.756 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.755+0000 7f45bfa2d800 20 add_watcher() i=0 2023-12-03T11:47:56.757 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.755+0000 7f45bfa2d800 20 add_watcher() i=1 2023-12-03T11:47:56.757 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.755+0000 7f45bfa2d800 20 add_watcher() i=2 2023-12-03T11:47:56.757 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.755+0000 7f45bfa2d800 20 add_watcher() i=3 2023-12-03T11:47:56.757 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.755+0000 7f45bfa2d800 20 add_watcher() i=4 2023-12-03T11:47:56.757 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.755+0000 7f45bfa2d800 20 add_watcher() i=5 2023-12-03T11:47:56.757 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.756+0000 7f45bfa2d800 20 add_watcher() i=6 2023-12-03T11:47:56.757 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.756+0000 7f45bfa2d800 20 add_watcher() i=7 2023-12-03T11:47:56.758 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.756+0000 7f45bfa2d800 2 all 8 watchers are set, enabling cache 2023-12-03T11:47:56.759 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.758+0000 7f44fbfff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:47:56.759 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.758+0000 7f45bfa2d800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:47:56.759 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.758+0000 7f45bfa2d800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:47:56.766 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.764+0000 7f45bfa2d800 5 note: GC not initialized 2023-12-03T11:47:56.766 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.765+0000 7f44f2ffd640 20 reqs_thread_entry: start 2023-12-03T11:47:56.766 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.765+0000 7f45bfa2d800 20 init_complete bucket index max shards: 11 2023-12-03T11:47:56.766 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.765+0000 7f45bfa2d800 20 Filter name: none 2023-12-03T11:47:56.766 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.765+0000 7f44f0ff9640 20 reqs_thread_entry: start 2023-12-03T11:47:56.766 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.765+0000 7f45bfa2d800 20 rados->read ofs=0 len=0 2023-12-03T11:47:56.767 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.765+0000 7f45bfa2d800 20 rados_obj.operate() r=0 bl.length=200 2023-12-03T11:47:56.768 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.765+0000 7f45bfa2d800 20 rados->read ofs=0 len=0 2023-12-03T11:47:56.768 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.766+0000 7f45bfa2d800 20 rados_obj.operate() r=0 bl.length=372 2023-12-03T11:47:56.768 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.766+0000 7f45bfa2d800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:47:56.768 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.766+0000 7f45bfa2d800 20 rados->read ofs=0 len=0 2023-12-03T11:47:56.768 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.766+0000 7f45bfa2d800 20 rados_obj.operate() r=0 bl.length=200 2023-12-03T11:47:56.768 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.766+0000 7f45bfa2d800 20 rados->read ofs=0 len=0 2023-12-03T11:47:56.768 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.766+0000 7f45bfa2d800 20 rados_obj.operate() r=0 bl.length=372 2023-12-03T11:47:56.768 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.766+0000 7f45bfa2d800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:47:56.769 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.767+0000 7f45bfa2d800 20 rados->read ofs=0 len=0 2023-12-03T11:47:56.769 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.768+0000 7f45bfa2d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:47:56.769 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.768+0000 7f44fbfff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:47:56.772 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.771+0000 7f45bfa2d800 20 remove_watcher() i=0 2023-12-03T11:47:56.772 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.771+0000 7f45bfa2d800 2 removed watcher, disabling cache 2023-12-03T11:47:56.773 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.772+0000 7f45bfa2d800 20 remove_watcher() i=1 2023-12-03T11:47:56.774 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.773+0000 7f45bfa2d800 20 remove_watcher() i=2 2023-12-03T11:47:56.775 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.774+0000 7f45bfa2d800 20 remove_watcher() i=3 2023-12-03T11:47:56.776 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.775+0000 7f45bfa2d800 20 remove_watcher() i=4 2023-12-03T11:47:56.777 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.776+0000 7f45bfa2d800 20 remove_watcher() i=5 2023-12-03T11:47:56.778 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.777+0000 7f45bfa2d800 20 remove_watcher() i=6 2023-12-03T11:47:56.779 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.778+0000 7f45bfa2d800 20 remove_watcher() i=7 2023-12-03T11:47:56.784 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:47:56.784 INFO:tasks.workunit.client.0.smithi003.stderr:BUCKET_STATS: 2023-12-03T11:47:56.784 INFO:tasks.workunit.client.0.smithi003.stderr:bucket: a-bucket id: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17 num_objects: 8 size_kb: 1 num_shards: 12 2023-12-03T11:47:56.784 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:47:56.785 INFO:tasks.workunit.client.0.smithi003.stderr:radosgw-admin reshard add --bucket a-bucket --num-shards 13 2023-12-03T11:47:56.814 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:47:56.815 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:47:56.829 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.828+0000 7f52694e4800 20 rados->read ofs=0 len=0 2023-12-03T11:47:56.831 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.830+0000 7f52694e4800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:47:56.831 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.830+0000 7f52694e4800 20 realm 2023-12-03T11:47:56.831 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.830+0000 7f52694e4800 20 rados->read ofs=0 len=0 2023-12-03T11:47:56.832 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.830+0000 7f52694e4800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:47:56.832 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.830+0000 7f52694e4800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:47:56.832 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.830+0000 7f52694e4800 20 rados->read ofs=0 len=0 2023-12-03T11:47:56.832 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.830+0000 7f52694e4800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:47:56.832 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.830+0000 7f52694e4800 20 rados->read ofs=0 len=0 2023-12-03T11:47:56.832 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.831+0000 7f52694e4800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:47:56.833 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.831+0000 7f52694e4800 20 rados->read ofs=0 len=0 2023-12-03T11:47:56.833 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.831+0000 7f52694e4800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:47:56.833 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.831+0000 7f52694e4800 20 searching for the correct realm 2023-12-03T11:47:56.843 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.841+0000 7f5266fe4640 0 -- 172.21.15.3:0/1492792467 >> [v2:172.21.15.37:6805/1692844418,v1:172.21.15.37:6807/1692844418] conn(0x55ad0f959bc0 msgr2=0x55ad0f95bff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-03T11:47:56.844 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.843+0000 7f52694e4800 20 RGWRados::pool_iterate: got zone_info.83aabb46-04b5-4c96-9933-c6bfb1173a73 2023-12-03T11:47:56.844 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.843+0000 7f52694e4800 20 RGWRados::pool_iterate: got zonegroup_info.6a811aad-435d-4fdd-93c9-b7e0b50de429 2023-12-03T11:47:56.844 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.843+0000 7f52694e4800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:47:56.845 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.843+0000 7f52694e4800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:47:56.845 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.843+0000 7f52694e4800 20 rados->read ofs=0 len=0 2023-12-03T11:47:56.845 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.843+0000 7f52694e4800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:47:56.845 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.843+0000 7f52694e4800 20 rados->read ofs=0 len=0 2023-12-03T11:47:56.846 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.844+0000 7f52694e4800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:47:56.846 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.844+0000 7f52694e4800 20 rados->read ofs=0 len=0 2023-12-03T11:47:56.846 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.844+0000 7f52694e4800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:47:56.846 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.844+0000 7f52694e4800 20 zone default found 2023-12-03T11:47:56.846 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.844+0000 7f52694e4800 4 Realm: () 2023-12-03T11:47:56.846 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.844+0000 7f52694e4800 4 ZoneGroup: default (6a811aad-435d-4fdd-93c9-b7e0b50de429) 2023-12-03T11:47:56.846 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.844+0000 7f52694e4800 4 Zone: default (83aabb46-04b5-4c96-9933-c6bfb1173a73) 2023-12-03T11:47:56.846 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.844+0000 7f52694e4800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:47:56.846 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.844+0000 7f52694e4800 20 zonegroup default 2023-12-03T11:47:56.846 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.844+0000 7f52694e4800 20 rados->read ofs=0 len=0 2023-12-03T11:47:56.846 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.844+0000 7f52694e4800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:47:56.846 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.844+0000 7f52694e4800 20 rados->read ofs=0 len=0 2023-12-03T11:47:56.846 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.845+0000 7f52694e4800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:47:56.847 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.845+0000 7f52694e4800 20 rados->read ofs=0 len=0 2023-12-03T11:47:56.847 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.845+0000 7f52694e4800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:47:56.847 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.845+0000 7f52694e4800 20 started sync module instance, tier type = 2023-12-03T11:47:56.847 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.845+0000 7f52694e4800 20 started zone id=83aabb46-04b5-4c96-9933-c6bfb1173a73 (name=default) with tier type = 2023-12-03T11:47:56.853 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.852+0000 7f52667e3640 0 -- 172.21.15.3:0/1492792467 >> [v2:172.21.15.3:6817/3356208405,v1:172.21.15.3:6819/3356208405] conn(0x55ad0f95ebe0 msgr2=0x55ad0f960fd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:47:56.856 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.855+0000 7f52694e4800 20 add_watcher() i=0 2023-12-03T11:47:56.856 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.855+0000 7f52694e4800 20 add_watcher() i=1 2023-12-03T11:47:56.856 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.855+0000 7f52694e4800 20 add_watcher() i=2 2023-12-03T11:47:56.856 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.855+0000 7f52694e4800 20 add_watcher() i=3 2023-12-03T11:47:56.856 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.855+0000 7f52694e4800 20 add_watcher() i=4 2023-12-03T11:47:56.856 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.855+0000 7f52694e4800 20 add_watcher() i=5 2023-12-03T11:47:56.856 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.855+0000 7f52694e4800 20 add_watcher() i=6 2023-12-03T11:47:56.857 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.855+0000 7f52694e4800 20 add_watcher() i=7 2023-12-03T11:47:56.857 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.855+0000 7f52694e4800 2 all 8 watchers are set, enabling cache 2023-12-03T11:47:56.858 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.857+0000 7f51a7fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:47:56.859 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.858+0000 7f52694e4800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:47:56.859 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.858+0000 7f52694e4800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:47:56.865 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.864+0000 7f52694e4800 5 note: GC not initialized 2023-12-03T11:47:56.865 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.864+0000 7f5196ffd640 20 reqs_thread_entry: start 2023-12-03T11:47:56.866 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.864+0000 7f52694e4800 20 init_complete bucket index max shards: 11 2023-12-03T11:47:56.866 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.864+0000 7f52694e4800 20 Filter name: none 2023-12-03T11:47:56.866 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.864+0000 7f5194ff9640 20 reqs_thread_entry: start 2023-12-03T11:47:56.866 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.864+0000 7f52694e4800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2023-12-03T11:47:56.866 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.864+0000 7f52694e4800 20 rados->read ofs=0 len=0 2023-12-03T11:47:56.867 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.865+0000 7f52694e4800 20 rados_obj.operate() r=0 bl.length=200 2023-12-03T11:47:56.867 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.865+0000 7f52694e4800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2023-12-03T11:47:56.867 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.865+0000 7f52694e4800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2023-12-03T11:47:56.867 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.865+0000 7f52694e4800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17 : miss 2023-12-03T11:47:56.867 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.865+0000 7f52694e4800 20 rados->read ofs=0 len=0 2023-12-03T11:47:56.867 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.865+0000 7f52694e4800 20 rados_obj.operate() r=0 bl.length=372 2023-12-03T11:47:56.867 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.865+0000 7f52694e4800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17 info.flags=0x17 2023-12-03T11:47:56.867 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.865+0000 7f52694e4800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17 to cache LRU end 2023-12-03T11:47:56.867 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.865+0000 7f52694e4800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:47:56.867 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.865+0000 7f52694e4800 10 updating xattr: name=user.rgw.acl bl.length()=203 2023-12-03T11:47:56.867 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.865+0000 7f52694e4800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17 2023-12-03T11:47:56.869 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.868+0000 7f51a7fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:47:56.871 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.870+0000 7f52694e4800 20 remove_watcher() i=0 2023-12-03T11:47:56.871 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.870+0000 7f52694e4800 2 removed watcher, disabling cache 2023-12-03T11:47:56.872 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.871+0000 7f52694e4800 20 remove_watcher() i=1 2023-12-03T11:47:56.874 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.872+0000 7f52694e4800 20 remove_watcher() i=2 2023-12-03T11:47:56.877 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.873+0000 7f52694e4800 20 remove_watcher() i=3 2023-12-03T11:47:56.877 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.875+0000 7f52694e4800 20 remove_watcher() i=4 2023-12-03T11:47:56.877 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.876+0000 7f52694e4800 20 remove_watcher() i=5 2023-12-03T11:47:56.878 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.877+0000 7f52694e4800 20 remove_watcher() i=6 2023-12-03T11:47:56.879 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.878+0000 7f52694e4800 20 remove_watcher() i=7 2023-12-03T11:47:56.885 INFO:tasks.workunit.client.0.smithi003.stderr:radosgw-admin reshard list 2023-12-03T11:47:56.911 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:47:56.911 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:47:56.925 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.923+0000 7fc7caf3d800 20 rados->read ofs=0 len=0 2023-12-03T11:47:56.927 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.925+0000 7fc7caf3d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:47:56.927 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.925+0000 7fc7caf3d800 20 realm 2023-12-03T11:47:56.927 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.925+0000 7fc7caf3d800 20 rados->read ofs=0 len=0 2023-12-03T11:47:56.927 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.925+0000 7fc7caf3d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:47:56.927 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.925+0000 7fc7caf3d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:47:56.927 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.925+0000 7fc7caf3d800 20 rados->read ofs=0 len=0 2023-12-03T11:47:56.927 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.926+0000 7fc7caf3d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:47:56.927 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.926+0000 7fc7caf3d800 20 rados->read ofs=0 len=0 2023-12-03T11:47:56.928 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.926+0000 7fc7caf3d800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:47:56.928 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.926+0000 7fc7caf3d800 20 rados->read ofs=0 len=0 2023-12-03T11:47:56.928 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.927+0000 7fc7caf3d800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:47:56.928 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.927+0000 7fc7caf3d800 20 searching for the correct realm 2023-12-03T11:47:56.938 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.937+0000 7fc7c6ca3640 0 -- 172.21.15.3:0/478028965 >> [v2:172.21.15.37:6805/1692844418,v1:172.21.15.37:6807/1692844418] conn(0x55d6d8e711f0 msgr2=0x55d6d8e735e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:47:56.940 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.938+0000 7fc7caf3d800 20 RGWRados::pool_iterate: got zone_info.83aabb46-04b5-4c96-9933-c6bfb1173a73 2023-12-03T11:47:56.940 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.938+0000 7fc7caf3d800 20 RGWRados::pool_iterate: got zonegroup_info.6a811aad-435d-4fdd-93c9-b7e0b50de429 2023-12-03T11:47:56.940 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.938+0000 7fc7caf3d800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:47:56.940 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.938+0000 7fc7caf3d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:47:56.940 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.938+0000 7fc7caf3d800 20 rados->read ofs=0 len=0 2023-12-03T11:47:56.940 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.939+0000 7fc7caf3d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:47:56.940 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.939+0000 7fc7caf3d800 20 rados->read ofs=0 len=0 2023-12-03T11:47:56.940 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.939+0000 7fc7caf3d800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:47:56.940 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.939+0000 7fc7caf3d800 20 rados->read ofs=0 len=0 2023-12-03T11:47:56.941 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.939+0000 7fc7caf3d800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:47:56.941 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.939+0000 7fc7caf3d800 20 zone default found 2023-12-03T11:47:56.942 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.939+0000 7fc7caf3d800 4 Realm: () 2023-12-03T11:47:56.942 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.939+0000 7fc7caf3d800 4 ZoneGroup: default (6a811aad-435d-4fdd-93c9-b7e0b50de429) 2023-12-03T11:47:56.942 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.939+0000 7fc7caf3d800 4 Zone: default (83aabb46-04b5-4c96-9933-c6bfb1173a73) 2023-12-03T11:47:56.942 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.939+0000 7fc7caf3d800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:47:56.942 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.939+0000 7fc7caf3d800 20 zonegroup default 2023-12-03T11:47:56.942 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.939+0000 7fc7caf3d800 20 rados->read ofs=0 len=0 2023-12-03T11:47:56.942 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.939+0000 7fc7caf3d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:47:56.942 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.939+0000 7fc7caf3d800 20 rados->read ofs=0 len=0 2023-12-03T11:47:56.942 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.940+0000 7fc7caf3d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:47:56.942 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.940+0000 7fc7caf3d800 20 rados->read ofs=0 len=0 2023-12-03T11:47:56.942 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.940+0000 7fc7caf3d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:47:56.942 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.940+0000 7fc7caf3d800 20 started sync module instance, tier type = 2023-12-03T11:47:56.942 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.940+0000 7fc7caf3d800 20 started zone id=83aabb46-04b5-4c96-9933-c6bfb1173a73 (name=default) with tier type = 2023-12-03T11:47:56.948 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.946+0000 7fc7c64a2640 0 -- 172.21.15.3:0/478028965 >> [v2:172.21.15.3:6817/3356208405,v1:172.21.15.3:6819/3356208405] conn(0x55d6d8e75dc0 msgr2=0x55d6d8e78230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:47:56.950 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.949+0000 7fc7caf3d800 20 add_watcher() i=0 2023-12-03T11:47:56.951 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.949+0000 7fc7caf3d800 20 add_watcher() i=1 2023-12-03T11:47:56.951 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.949+0000 7fc7caf3d800 20 add_watcher() i=2 2023-12-03T11:47:56.951 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.949+0000 7fc7caf3d800 20 add_watcher() i=3 2023-12-03T11:47:56.951 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.949+0000 7fc7caf3d800 20 add_watcher() i=4 2023-12-03T11:47:56.951 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.949+0000 7fc7caf3d800 20 add_watcher() i=5 2023-12-03T11:47:56.951 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.949+0000 7fc7caf3d800 20 add_watcher() i=6 2023-12-03T11:47:56.951 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.950+0000 7fc7caf3d800 20 add_watcher() i=7 2023-12-03T11:47:56.951 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.950+0000 7fc7caf3d800 2 all 8 watchers are set, enabling cache 2023-12-03T11:47:56.953 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.952+0000 7fc707fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:47:56.953 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.952+0000 7fc7caf3d800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:47:56.954 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.952+0000 7fc7caf3d800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:47:56.960 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.958+0000 7fc7caf3d800 5 note: GC not initialized 2023-12-03T11:47:56.960 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.958+0000 7fc6f6ffd640 20 reqs_thread_entry: start 2023-12-03T11:47:56.960 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.959+0000 7fc7caf3d800 20 init_complete bucket index max shards: 11 2023-12-03T11:47:56.961 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.959+0000 7fc7caf3d800 20 Filter name: none 2023-12-03T11:47:56.961 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.959+0000 7fc6f4ff9640 20 reqs_thread_entry: start 2023-12-03T11:47:56.969 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.968+0000 7fc707fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:47:56.972 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.971+0000 7fc7caf3d800 20 remove_watcher() i=0 2023-12-03T11:47:56.972 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.971+0000 7fc7caf3d800 2 removed watcher, disabling cache 2023-12-03T11:47:56.973 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.972+0000 7fc7caf3d800 20 remove_watcher() i=1 2023-12-03T11:47:56.974 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.973+0000 7fc7caf3d800 20 remove_watcher() i=2 2023-12-03T11:47:56.976 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.975+0000 7fc7caf3d800 20 remove_watcher() i=3 2023-12-03T11:47:56.977 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.976+0000 7fc7caf3d800 20 remove_watcher() i=4 2023-12-03T11:47:56.978 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.977+0000 7fc7caf3d800 20 remove_watcher() i=5 2023-12-03T11:47:56.979 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.978+0000 7fc7caf3d800 20 remove_watcher() i=6 2023-12-03T11:47:56.980 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:56.979+0000 7fc7caf3d800 20 remove_watcher() i=7 2023-12-03T11:47:56.985 INFO:tasks.workunit.client.0.smithi003.stderr:TEST: reshard process non empty bucket 2023-12-03T11:47:56.985 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:47:56.987 INFO:tasks.workunit.client.0.smithi003.stderr:radosgw-admin reshard process 2023-12-03T11:47:57.013 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:47:57.013 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:47:57.028 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.026+0000 7f31ea11f800 20 rados->read ofs=0 len=0 2023-12-03T11:47:57.030 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.028+0000 7f31ea11f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:47:57.030 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.028+0000 7f31ea11f800 20 realm 2023-12-03T11:47:57.030 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.028+0000 7f31ea11f800 20 rados->read ofs=0 len=0 2023-12-03T11:47:57.030 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.028+0000 7f31ea11f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:47:57.030 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.028+0000 7f31ea11f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:47:57.031 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.028+0000 7f31ea11f800 20 rados->read ofs=0 len=0 2023-12-03T11:47:57.031 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.028+0000 7f31ea11f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:47:57.031 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.028+0000 7f31ea11f800 20 rados->read ofs=0 len=0 2023-12-03T11:47:57.031 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.029+0000 7f31ea11f800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:47:57.031 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.029+0000 7f31ea11f800 20 rados->read ofs=0 len=0 2023-12-03T11:47:57.031 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.029+0000 7f31ea11f800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:47:57.031 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.029+0000 7f31ea11f800 20 searching for the correct realm 2023-12-03T11:47:57.041 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.039+0000 7f31e5d4d640 0 -- 172.21.15.3:0/1569241099 >> [v2:172.21.15.37:6805/1692844418,v1:172.21.15.37:6807/1692844418] conn(0x56065ae053e0 msgr2=0x56065ae077d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:47:57.042 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.040+0000 7f31ea11f800 20 RGWRados::pool_iterate: got zone_info.83aabb46-04b5-4c96-9933-c6bfb1173a73 2023-12-03T11:47:57.042 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.040+0000 7f31ea11f800 20 RGWRados::pool_iterate: got zonegroup_info.6a811aad-435d-4fdd-93c9-b7e0b50de429 2023-12-03T11:47:57.042 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.040+0000 7f31ea11f800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:47:57.042 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.040+0000 7f31ea11f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:47:57.042 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.040+0000 7f31ea11f800 20 rados->read ofs=0 len=0 2023-12-03T11:47:57.042 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.041+0000 7f31ea11f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:47:57.042 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.041+0000 7f31ea11f800 20 rados->read ofs=0 len=0 2023-12-03T11:47:57.043 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.041+0000 7f31ea11f800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:47:57.043 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.041+0000 7f31ea11f800 20 rados->read ofs=0 len=0 2023-12-03T11:47:57.043 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.041+0000 7f31ea11f800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:47:57.044 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.041+0000 7f31ea11f800 20 zone default found 2023-12-03T11:47:57.044 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.041+0000 7f31ea11f800 4 Realm: () 2023-12-03T11:47:57.044 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.041+0000 7f31ea11f800 4 ZoneGroup: default (6a811aad-435d-4fdd-93c9-b7e0b50de429) 2023-12-03T11:47:57.044 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.041+0000 7f31ea11f800 4 Zone: default (83aabb46-04b5-4c96-9933-c6bfb1173a73) 2023-12-03T11:47:57.044 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.041+0000 7f31ea11f800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:47:57.044 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.041+0000 7f31ea11f800 20 zonegroup default 2023-12-03T11:47:57.044 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.041+0000 7f31ea11f800 20 rados->read ofs=0 len=0 2023-12-03T11:47:57.044 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.042+0000 7f31ea11f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:47:57.044 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.042+0000 7f31ea11f800 20 rados->read ofs=0 len=0 2023-12-03T11:47:57.044 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.042+0000 7f31ea11f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:47:57.044 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.042+0000 7f31ea11f800 20 rados->read ofs=0 len=0 2023-12-03T11:47:57.044 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.042+0000 7f31ea11f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:47:57.044 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.042+0000 7f31ea11f800 20 started sync module instance, tier type = 2023-12-03T11:47:57.044 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.042+0000 7f31ea11f800 20 started zone id=83aabb46-04b5-4c96-9933-c6bfb1173a73 (name=default) with tier type = 2023-12-03T11:47:57.050 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.049+0000 7f31e554c640 0 -- 172.21.15.3:0/1569241099 >> [v2:172.21.15.3:6817/3356208405,v1:172.21.15.3:6819/3356208405] conn(0x56065ae0a230 msgr2=0x56065ae0c620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-03T11:47:57.053 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.052+0000 7f31ea11f800 20 add_watcher() i=0 2023-12-03T11:47:57.053 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.052+0000 7f31ea11f800 20 add_watcher() i=1 2023-12-03T11:47:57.053 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.052+0000 7f31ea11f800 20 add_watcher() i=2 2023-12-03T11:47:57.053 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.052+0000 7f31ea11f800 20 add_watcher() i=3 2023-12-03T11:47:57.053 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.052+0000 7f31ea11f800 20 add_watcher() i=4 2023-12-03T11:47:57.053 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.052+0000 7f31ea11f800 20 add_watcher() i=5 2023-12-03T11:47:57.054 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.052+0000 7f31ea11f800 20 add_watcher() i=6 2023-12-03T11:47:57.054 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.053+0000 7f31ea11f800 20 add_watcher() i=7 2023-12-03T11:47:57.054 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.053+0000 7f31ea11f800 2 all 8 watchers are set, enabling cache 2023-12-03T11:47:57.056 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.055+0000 7f31ab7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:47:57.056 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.055+0000 7f31ea11f800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:47:57.056 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.055+0000 7f31ea11f800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:47:57.062 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.061+0000 7f31ea11f800 5 note: GC not initialized 2023-12-03T11:47:57.063 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.061+0000 7f311a7fc640 20 reqs_thread_entry: start 2023-12-03T11:47:57.063 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.061+0000 7f31ea11f800 20 init_complete bucket index max shards: 11 2023-12-03T11:47:57.063 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.061+0000 7f31ea11f800 20 Filter name: none 2023-12-03T11:47:57.063 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.061+0000 7f310bfff640 20 reqs_thread_entry: start 2023-12-03T11:47:57.063 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.061+0000 7f31ea11f800 20 processing logshard = reshard.0000000000 2023-12-03T11:47:57.065 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.064+0000 7f31ea11f800 20 finish processing logshard = reshard.0000000000 , ret = 0 2023-12-03T11:47:57.065 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.064+0000 7f31ea11f800 20 processing logshard = reshard.0000000001 2023-12-03T11:47:57.068 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.067+0000 7f31ea11f800 20 finish processing logshard = reshard.0000000001 , ret = 0 2023-12-03T11:47:57.068 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.067+0000 7f31ea11f800 20 processing logshard = reshard.0000000002 2023-12-03T11:47:57.071 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.070+0000 7f31ea11f800 20 finish processing logshard = reshard.0000000002 , ret = 0 2023-12-03T11:47:57.071 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.070+0000 7f31ea11f800 20 processing logshard = reshard.0000000003 2023-12-03T11:47:57.073 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.072+0000 7f31ea11f800 20 finish processing logshard = reshard.0000000003 , ret = 0 2023-12-03T11:47:57.073 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.072+0000 7f31ea11f800 20 processing logshard = reshard.0000000004 2023-12-03T11:47:57.076 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.075+0000 7f31ea11f800 20 finish processing logshard = reshard.0000000004 , ret = 0 2023-12-03T11:47:57.076 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.075+0000 7f31ea11f800 20 processing logshard = reshard.0000000005 2023-12-03T11:47:57.079 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.077+0000 7f31ea11f800 20 finish processing logshard = reshard.0000000005 , ret = 0 2023-12-03T11:47:57.079 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.077+0000 7f31ea11f800 20 processing logshard = reshard.0000000006 2023-12-03T11:47:57.080 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.079+0000 7f31ea11f800 20 process_entry resharding a-bucket 2023-12-03T11:47:57.080 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.079+0000 7f31ea11f800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2023-12-03T11:47:57.081 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.079+0000 7f31ea11f800 20 rados->read ofs=0 len=0 2023-12-03T11:47:57.081 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.079+0000 7f31ea11f800 20 rados_obj.operate() r=0 bl.length=200 2023-12-03T11:47:57.081 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.079+0000 7f31ea11f800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x1 2023-12-03T11:47:57.081 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.079+0000 7f31ea11f800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2023-12-03T11:47:57.081 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.079+0000 7f31ea11f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17 : miss 2023-12-03T11:47:57.081 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.079+0000 7f31ea11f800 20 rados->read ofs=0 len=0 2023-12-03T11:47:57.081 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.080+0000 7f31ea11f800 20 rados_obj.operate() r=0 bl.length=372 2023-12-03T11:47:57.081 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.080+0000 7f31ea11f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17 info.flags=0x17 2023-12-03T11:47:57.081 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.080+0000 7f31ea11f800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17 to cache LRU end 2023-12-03T11:47:57.082 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.080+0000 7f31ea11f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:47:57.082 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.080+0000 7f31ea11f800 10 updating xattr: name=user.rgw.acl bl.length()=203 2023-12-03T11:47:57.082 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.080+0000 7f31ea11f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17 2023-12-03T11:47:57.088 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.086+0000 7f31ea11f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17 info.flags=0x17 2023-12-03T11:47:57.088 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.086+0000 7f31ea11f800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17 to cache LRU end 2023-12-03T11:47:57.088 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.086+0000 7f31ea11f800 10 updating xattr: name=user.rgw.acl bl.length()=203 2023-12-03T11:47:57.088 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.086+0000 7f31ea11f800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17, ofs0, ns] 2023-12-03T11:47:57.088 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.086+0000 7f31c7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660562 cookie 94585294493072 notifier 5978 bl.length()=861 2023-12-03T11:47:57.088 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.086+0000 7f31c7fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17 info.flags=0x17 2023-12-03T11:47:57.088 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.086+0000 7f31c7fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17 to cache LRU end 2023-12-03T11:47:57.089 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.086+0000 7f31c7fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2023-12-03T11:47:57.089 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.088+0000 7f31ea11f800 20 handle_bi_update(): bucket=:a-bucket[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17]): orig_sources= new_sources= 2023-12-03T11:47:57.089 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.088+0000 7f31ea11f800 20 handle_bi_update(): bucket=:a-bucket[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17]): potential sources added=[] removed=[] 2023-12-03T11:47:57.089 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.088+0000 7f31ea11f800 20 handle_bi_update(): bucket=:a-bucket[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17]): orig_dests= new_dests= 2023-12-03T11:47:57.090 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.088+0000 7f31ea11f800 20 handle_bi_update(): bucket=:a-bucket[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17]): potential dests added=[] removed=[] 2023-12-03T11:47:57.093 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.091+0000 7f31ea11f800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.2.0 2023-12-03T11:47:57.093 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.091+0000 7f31ea11f800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.2.0 2023-12-03T11:47:57.093 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.091+0000 7f31ea11f800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.2.1 2023-12-03T11:47:57.093 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.091+0000 7f31ea11f800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.2.1 2023-12-03T11:47:57.093 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.091+0000 7f31ea11f800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.2.2 2023-12-03T11:47:57.093 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.091+0000 7f31ea11f800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.2.2 2023-12-03T11:47:57.093 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.091+0000 7f31ea11f800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.2.3 2023-12-03T11:47:57.093 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.091+0000 7f31ea11f800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.2.3 2023-12-03T11:47:57.093 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.091+0000 7f31ea11f800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.2.4 2023-12-03T11:47:57.093 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.091+0000 7f31ea11f800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.2.4 2023-12-03T11:47:57.093 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.091+0000 7f31ea11f800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.2.5 2023-12-03T11:47:57.093 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.091+0000 7f31ea11f800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.2.5 2023-12-03T11:47:57.093 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.091+0000 7f31ea11f800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.2.6 2023-12-03T11:47:57.094 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.091+0000 7f31ea11f800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.2.6 2023-12-03T11:47:57.094 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.091+0000 7f31ea11f800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.2.7 2023-12-03T11:47:57.094 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.091+0000 7f31ea11f800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.2.7 2023-12-03T11:47:57.094 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.091+0000 7f31ea11f800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.2.8 2023-12-03T11:47:57.094 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.091+0000 7f31ea11f800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.2.8 2023-12-03T11:47:57.094 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.091+0000 7f31ea11f800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.2.9 2023-12-03T11:47:57.094 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.091+0000 7f31ea11f800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.2.9 2023-12-03T11:47:57.094 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.091+0000 7f31ea11f800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.2.10 2023-12-03T11:47:57.094 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.091+0000 7f31ea11f800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.2.10 2023-12-03T11:47:57.094 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.091+0000 7f31ea11f800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.2.11 2023-12-03T11:47:57.094 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.091+0000 7f31ea11f800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.2.11 2023-12-03T11:47:57.094 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.091+0000 7f31ea11f800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.2.12 2023-12-03T11:47:57.094 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.091+0000 7f31ea11f800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.2.12 2023-12-03T11:47:57.094 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.091+0000 7f31ea11f800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.1.0 2023-12-03T11:47:57.095 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.091+0000 7f31ea11f800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.1.0 2023-12-03T11:47:57.095 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.092+0000 7f31ea11f800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.1.1 2023-12-03T11:47:57.095 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.092+0000 7f31ea11f800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.1.1 2023-12-03T11:47:57.096 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.092+0000 7f31ea11f800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.1.2 2023-12-03T11:47:57.096 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.092+0000 7f31ea11f800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.1.2 2023-12-03T11:47:57.096 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.092+0000 7f31ea11f800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.1.3 2023-12-03T11:47:57.096 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.092+0000 7f31ea11f800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.1.3 2023-12-03T11:47:57.096 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.093+0000 7f31ea11f800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.1.4 2023-12-03T11:47:57.096 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.093+0000 7f31ea11f800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.1.4 2023-12-03T11:47:57.096 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.093+0000 7f31ea11f800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.1.5 2023-12-03T11:47:57.096 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.093+0000 7f31ea11f800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.1.5 2023-12-03T11:47:57.096 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.094+0000 7f31ea11f800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.1.6 2023-12-03T11:47:57.096 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.094+0000 7f31ea11f800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.1.6 2023-12-03T11:47:57.096 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.094+0000 7f31ea11f800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.1.7 2023-12-03T11:47:57.096 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.094+0000 7f31ea11f800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.1.7 2023-12-03T11:47:57.097 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.095+0000 7f31ea11f800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.1.8 2023-12-03T11:47:57.097 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.095+0000 7f31ea11f800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.1.8 2023-12-03T11:47:57.097 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.095+0000 7f31ea11f800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.1.9 2023-12-03T11:47:57.097 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.095+0000 7f31ea11f800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.1.9 2023-12-03T11:47:57.097 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.095+0000 7f31ea11f800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.1.10 2023-12-03T11:47:57.097 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.095+0000 7f31ea11f800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.1.10 2023-12-03T11:47:57.097 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.096+0000 7f31ea11f800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.1.11 2023-12-03T11:47:57.097 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.096+0000 7f31ea11f800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.1.11 2023-12-03T11:47:57.099 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.098+0000 7f31ea11f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17 : hit (requested=0x17, cached=0x17) 2023-12-03T11:47:57.099 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.098+0000 7f31ea11f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17 2023-12-03T11:47:57.101 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.099+0000 7f31ea11f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17 info.flags=0x17 2023-12-03T11:47:57.101 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.099+0000 7f31ea11f800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17 to cache LRU end 2023-12-03T11:47:57.101 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.099+0000 7f31ea11f800 10 updating xattr: name=user.rgw.acl bl.length()=203 2023-12-03T11:47:57.101 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.099+0000 7f31ea11f800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17, ofs0, ns] 2023-12-03T11:47:57.101 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.099+0000 7f31c7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660563 cookie 94585294493072 notifier 5978 bl.length()=829 2023-12-03T11:47:57.102 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.099+0000 7f31c7fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17 info.flags=0x17 2023-12-03T11:47:57.102 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.099+0000 7f31c7fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17 to cache LRU end 2023-12-03T11:47:57.102 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.099+0000 7f31c7fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2023-12-03T11:47:57.102 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.101+0000 7f31ea11f800 20 handle_bi_update(): bucket=:a-bucket[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17]): orig_sources= new_sources= 2023-12-03T11:47:57.103 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.101+0000 7f31ea11f800 20 handle_bi_update(): bucket=:a-bucket[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17]): potential sources added=[] removed=[] 2023-12-03T11:47:57.103 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.101+0000 7f31ea11f800 20 handle_bi_update(): bucket=:a-bucket[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17]): orig_dests= new_dests= 2023-12-03T11:47:57.103 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.101+0000 7f31ea11f800 20 handle_bi_update(): bucket=:a-bucket[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17]): potential dests added=[] removed=[] 2023-12-03T11:47:57.105 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.104+0000 7f31ea11f800 1 execute INFO: reshard of bucket "a-bucket" completed successfully 2023-12-03T11:47:57.106 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.105+0000 7f31ea11f800 20 process_entry removing reshard queue entry for bucket a-bucket 2023-12-03T11:47:57.108 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.107+0000 7f31ea11f800 20 finish processing logshard = reshard.0000000006 , ret = 0 2023-12-03T11:47:57.108 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.107+0000 7f31ea11f800 20 processing logshard = reshard.0000000007 2023-12-03T11:47:57.110 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.109+0000 7f31ea11f800 20 finish processing logshard = reshard.0000000007 , ret = 0 2023-12-03T11:47:57.110 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.109+0000 7f31ea11f800 20 processing logshard = reshard.0000000008 2023-12-03T11:47:57.113 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.112+0000 7f31ea11f800 20 finish processing logshard = reshard.0000000008 , ret = 0 2023-12-03T11:47:57.113 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.112+0000 7f31ea11f800 20 processing logshard = reshard.0000000009 2023-12-03T11:47:57.116 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.114+0000 7f31ea11f800 20 finish processing logshard = reshard.0000000009 , ret = 0 2023-12-03T11:47:57.116 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.114+0000 7f31ea11f800 20 processing logshard = reshard.0000000010 2023-12-03T11:47:57.118 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.117+0000 7f31ea11f800 20 finish processing logshard = reshard.0000000010 , ret = 0 2023-12-03T11:47:57.118 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.117+0000 7f31ea11f800 20 processing logshard = reshard.0000000011 2023-12-03T11:47:57.120 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.119+0000 7f31ea11f800 20 finish processing logshard = reshard.0000000011 , ret = 0 2023-12-03T11:47:57.120 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.119+0000 7f31ea11f800 20 processing logshard = reshard.0000000012 2023-12-03T11:47:57.123 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.122+0000 7f31ea11f800 20 finish processing logshard = reshard.0000000012 , ret = 0 2023-12-03T11:47:57.123 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.122+0000 7f31ea11f800 20 processing logshard = reshard.0000000013 2023-12-03T11:47:57.126 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.125+0000 7f31ea11f800 20 finish processing logshard = reshard.0000000013 , ret = 0 2023-12-03T11:47:57.126 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.125+0000 7f31ea11f800 20 processing logshard = reshard.0000000014 2023-12-03T11:47:57.129 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.127+0000 7f31ea11f800 20 finish processing logshard = reshard.0000000014 , ret = 0 2023-12-03T11:47:57.129 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.127+0000 7f31ea11f800 20 processing logshard = reshard.0000000015 2023-12-03T11:47:57.130 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.129+0000 7f31ea11f800 20 finish processing logshard = reshard.0000000015 , ret = 0 2023-12-03T11:47:57.131 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.130+0000 7f31ab7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:47:57.133 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.132+0000 7f31ea11f800 20 remove_watcher() i=0 2023-12-03T11:47:57.133 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.132+0000 7f31ea11f800 2 removed watcher, disabling cache 2023-12-03T11:47:57.135 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.133+0000 7f31ea11f800 20 remove_watcher() i=1 2023-12-03T11:47:57.136 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.135+0000 7f31ea11f800 20 remove_watcher() i=2 2023-12-03T11:47:57.137 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.136+0000 7f31ea11f800 20 remove_watcher() i=3 2023-12-03T11:47:57.138 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.137+0000 7f31ea11f800 20 remove_watcher() i=4 2023-12-03T11:47:57.139 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.138+0000 7f31ea11f800 20 remove_watcher() i=5 2023-12-03T11:47:57.140 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.139+0000 7f31ea11f800 20 remove_watcher() i=6 2023-12-03T11:47:57.141 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.140+0000 7f31ea11f800 20 remove_watcher() i=7 2023-12-03T11:47:57.147 INFO:tasks.workunit.client.0.smithi003.stderr:radosgw-admin bucket stats --bucket a-bucket 2023-12-03T11:47:57.175 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:47:57.175 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:47:57.189 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.188+0000 7ff3cf8c0800 20 rados->read ofs=0 len=0 2023-12-03T11:47:57.192 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.190+0000 7ff3cf8c0800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:47:57.192 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.190+0000 7ff3cf8c0800 20 realm 2023-12-03T11:47:57.192 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.190+0000 7ff3cf8c0800 20 rados->read ofs=0 len=0 2023-12-03T11:47:57.192 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.190+0000 7ff3cf8c0800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:47:57.192 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.190+0000 7ff3cf8c0800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:47:57.192 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.190+0000 7ff3cf8c0800 20 rados->read ofs=0 len=0 2023-12-03T11:47:57.192 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.191+0000 7ff3cf8c0800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:47:57.192 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.191+0000 7ff3cf8c0800 20 rados->read ofs=0 len=0 2023-12-03T11:47:57.193 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.191+0000 7ff3cf8c0800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:47:57.193 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.191+0000 7ff3cf8c0800 20 rados->read ofs=0 len=0 2023-12-03T11:47:57.193 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.192+0000 7ff3cf8c0800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:47:57.193 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.192+0000 7ff3cf8c0800 20 searching for the correct realm 2023-12-03T11:47:57.202 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.201+0000 7ff3cd3c0640 0 -- 172.21.15.3:0/4202480342 >> [v2:172.21.15.37:6805/1692844418,v1:172.21.15.37:6807/1692844418] conn(0x55638a095930 msgr2=0x55638a097d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:47:57.204 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.203+0000 7ff3cf8c0800 20 RGWRados::pool_iterate: got zone_info.83aabb46-04b5-4c96-9933-c6bfb1173a73 2023-12-03T11:47:57.204 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.203+0000 7ff3cf8c0800 20 RGWRados::pool_iterate: got zonegroup_info.6a811aad-435d-4fdd-93c9-b7e0b50de429 2023-12-03T11:47:57.205 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.203+0000 7ff3cf8c0800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:47:57.205 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.203+0000 7ff3cf8c0800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:47:57.205 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.203+0000 7ff3cf8c0800 20 rados->read ofs=0 len=0 2023-12-03T11:47:57.205 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.203+0000 7ff3cf8c0800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:47:57.205 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.203+0000 7ff3cf8c0800 20 rados->read ofs=0 len=0 2023-12-03T11:47:57.206 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.204+0000 7ff3cf8c0800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:47:57.206 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.204+0000 7ff3cf8c0800 20 rados->read ofs=0 len=0 2023-12-03T11:47:57.206 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.204+0000 7ff3cf8c0800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:47:57.206 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.204+0000 7ff3cf8c0800 20 zone default found 2023-12-03T11:47:57.206 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.204+0000 7ff3cf8c0800 4 Realm: () 2023-12-03T11:47:57.206 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.204+0000 7ff3cf8c0800 4 ZoneGroup: default (6a811aad-435d-4fdd-93c9-b7e0b50de429) 2023-12-03T11:47:57.206 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.204+0000 7ff3cf8c0800 4 Zone: default (83aabb46-04b5-4c96-9933-c6bfb1173a73) 2023-12-03T11:47:57.207 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.204+0000 7ff3cf8c0800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:47:57.207 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.204+0000 7ff3cf8c0800 20 zonegroup default 2023-12-03T11:47:57.207 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.204+0000 7ff3cf8c0800 20 rados->read ofs=0 len=0 2023-12-03T11:47:57.207 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.204+0000 7ff3cf8c0800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:47:57.207 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.204+0000 7ff3cf8c0800 20 rados->read ofs=0 len=0 2023-12-03T11:47:57.207 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.204+0000 7ff3cf8c0800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:47:57.207 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.204+0000 7ff3cf8c0800 20 rados->read ofs=0 len=0 2023-12-03T11:47:57.207 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.205+0000 7ff3cf8c0800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:47:57.207 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.205+0000 7ff3cf8c0800 20 started sync module instance, tier type = 2023-12-03T11:47:57.207 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.205+0000 7ff3cf8c0800 20 started zone id=83aabb46-04b5-4c96-9933-c6bfb1173a73 (name=default) with tier type = 2023-12-03T11:47:57.211 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.210+0000 7ff3cdbc1640 0 -- 172.21.15.3:0/4202480342 >> [v2:172.21.15.37:6816/3770469300,v1:172.21.15.37:6818/3770469300] conn(0x7ff3c4076950 msgr2=0x7ff3c4056410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:47:57.215 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.214+0000 7ff3cf8c0800 20 add_watcher() i=0 2023-12-03T11:47:57.215 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.214+0000 7ff3cf8c0800 20 add_watcher() i=1 2023-12-03T11:47:57.215 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.214+0000 7ff3cf8c0800 20 add_watcher() i=2 2023-12-03T11:47:57.215 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.214+0000 7ff3cf8c0800 20 add_watcher() i=3 2023-12-03T11:47:57.215 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.214+0000 7ff3cf8c0800 20 add_watcher() i=4 2023-12-03T11:47:57.215 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.214+0000 7ff3cf8c0800 20 add_watcher() i=5 2023-12-03T11:47:57.215 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.214+0000 7ff3cf8c0800 20 add_watcher() i=6 2023-12-03T11:47:57.216 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.214+0000 7ff3cf8c0800 20 add_watcher() i=7 2023-12-03T11:47:57.216 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.214+0000 7ff3cf8c0800 2 all 8 watchers are set, enabling cache 2023-12-03T11:47:57.217 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.216+0000 7ff392fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:47:57.218 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.217+0000 7ff3cf8c0800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:47:57.218 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.217+0000 7ff3cf8c0800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:47:57.224 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.222+0000 7ff3cf8c0800 5 note: GC not initialized 2023-12-03T11:47:57.224 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.223+0000 7ff301ffb640 20 reqs_thread_entry: start 2023-12-03T11:47:57.224 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.223+0000 7ff3cf8c0800 20 init_complete bucket index max shards: 11 2023-12-03T11:47:57.224 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.223+0000 7ff3cf8c0800 20 Filter name: none 2023-12-03T11:47:57.224 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.223+0000 7ff2f37fe640 20 reqs_thread_entry: start 2023-12-03T11:47:57.224 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.223+0000 7ff3cf8c0800 20 rados->read ofs=0 len=0 2023-12-03T11:47:57.225 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.223+0000 7ff3cf8c0800 20 rados_obj.operate() r=0 bl.length=200 2023-12-03T11:47:57.225 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.223+0000 7ff3cf8c0800 20 rados->read ofs=0 len=0 2023-12-03T11:47:57.226 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.224+0000 7ff3cf8c0800 20 rados_obj.operate() r=0 bl.length=372 2023-12-03T11:47:57.226 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.224+0000 7ff3cf8c0800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:47:57.226 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.224+0000 7ff3cf8c0800 20 rados->read ofs=0 len=0 2023-12-03T11:47:57.226 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.224+0000 7ff3cf8c0800 20 rados_obj.operate() r=0 bl.length=200 2023-12-03T11:47:57.226 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.224+0000 7ff3cf8c0800 20 rados->read ofs=0 len=0 2023-12-03T11:47:57.226 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.225+0000 7ff3cf8c0800 20 rados_obj.operate() r=0 bl.length=372 2023-12-03T11:47:57.226 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.225+0000 7ff3cf8c0800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:47:57.227 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.225+0000 7ff3cf8c0800 20 rados->read ofs=0 len=0 2023-12-03T11:47:57.227 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.226+0000 7ff3cf8c0800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:47:57.227 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.226+0000 7ff392fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:47:57.230 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.228+0000 7ff3cf8c0800 20 remove_watcher() i=0 2023-12-03T11:47:57.230 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.228+0000 7ff3cf8c0800 2 removed watcher, disabling cache 2023-12-03T11:47:57.231 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.230+0000 7ff3cf8c0800 20 remove_watcher() i=1 2023-12-03T11:47:57.232 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.231+0000 7ff3cf8c0800 20 remove_watcher() i=2 2023-12-03T11:47:57.233 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.232+0000 7ff3cf8c0800 20 remove_watcher() i=3 2023-12-03T11:47:57.234 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.233+0000 7ff3cf8c0800 20 remove_watcher() i=4 2023-12-03T11:47:57.235 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.234+0000 7ff3cf8c0800 20 remove_watcher() i=5 2023-12-03T11:47:57.236 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.235+0000 7ff3cf8c0800 20 remove_watcher() i=6 2023-12-03T11:47:57.237 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:57.236+0000 7ff3cf8c0800 20 remove_watcher() i=7 2023-12-03T11:47:57.242 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:47:57.242 INFO:tasks.workunit.client.0.smithi003.stderr:BUCKET_STATS: 2023-12-03T11:47:57.242 INFO:tasks.workunit.client.0.smithi003.stderr:bucket: a-bucket id: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17 num_objects: 8 size_kb: 1 num_shards: 13 2023-12-03T11:47:57.242 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:47:57.242 INFO:tasks.workunit.client.0.smithi003.stderr:TEST: reshard bucket with EIO injected at set_target_layout 2023-12-03T11:47:57.242 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:47:57.975 INFO:tasks.workunit.client.0.smithi003.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2023-12-03T11:47:58.001 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:47:58.001 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:47:58.016 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.015+0000 7fdcdcf26800 20 rados->read ofs=0 len=0 2023-12-03T11:47:58.018 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.016+0000 7fdcdcf26800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:47:58.018 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.016+0000 7fdcdcf26800 20 realm 2023-12-03T11:47:58.018 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.016+0000 7fdcdcf26800 20 rados->read ofs=0 len=0 2023-12-03T11:47:58.018 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.016+0000 7fdcdcf26800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:47:58.018 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.016+0000 7fdcdcf26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:47:58.018 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.016+0000 7fdcdcf26800 20 rados->read ofs=0 len=0 2023-12-03T11:47:58.018 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.017+0000 7fdcdcf26800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:47:58.018 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.017+0000 7fdcdcf26800 20 rados->read ofs=0 len=0 2023-12-03T11:47:58.019 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.017+0000 7fdcdcf26800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:47:58.019 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.018+0000 7fdcdcf26800 20 rados->read ofs=0 len=0 2023-12-03T11:47:58.019 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.018+0000 7fdcdcf26800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:47:58.019 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.018+0000 7fdcdcf26800 20 searching for the correct realm 2023-12-03T11:47:58.029 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.028+0000 7fdcd8322640 0 -- 172.21.15.3:0/3116053845 >> [v2:172.21.15.3:6817/3356208405,v1:172.21.15.3:6819/3356208405] conn(0x564eee359000 msgr2=0x564eee35b410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:47:58.031 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.030+0000 7fdcdcf26800 20 RGWRados::pool_iterate: got zone_info.83aabb46-04b5-4c96-9933-c6bfb1173a73 2023-12-03T11:47:58.031 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.030+0000 7fdcdcf26800 20 RGWRados::pool_iterate: got zonegroup_info.6a811aad-435d-4fdd-93c9-b7e0b50de429 2023-12-03T11:47:58.031 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.030+0000 7fdcdcf26800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:47:58.031 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.030+0000 7fdcdcf26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:47:58.031 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.030+0000 7fdcdcf26800 20 rados->read ofs=0 len=0 2023-12-03T11:47:58.031 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.030+0000 7fdcdcf26800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:47:58.031 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.030+0000 7fdcdcf26800 20 rados->read ofs=0 len=0 2023-12-03T11:47:58.033 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.030+0000 7fdcdcf26800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:47:58.033 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.030+0000 7fdcdcf26800 20 rados->read ofs=0 len=0 2023-12-03T11:47:58.033 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.031+0000 7fdcdcf26800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:47:58.033 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.031+0000 7fdcdcf26800 20 zone default found 2023-12-03T11:47:58.033 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.031+0000 7fdcdcf26800 4 Realm: () 2023-12-03T11:47:58.033 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.031+0000 7fdcdcf26800 4 ZoneGroup: default (6a811aad-435d-4fdd-93c9-b7e0b50de429) 2023-12-03T11:47:58.033 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.031+0000 7fdcdcf26800 4 Zone: default (83aabb46-04b5-4c96-9933-c6bfb1173a73) 2023-12-03T11:47:58.033 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.031+0000 7fdcdcf26800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:47:58.034 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.031+0000 7fdcdcf26800 20 zonegroup default 2023-12-03T11:47:58.034 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.031+0000 7fdcdcf26800 20 rados->read ofs=0 len=0 2023-12-03T11:47:58.034 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.031+0000 7fdcdcf26800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:47:58.034 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.031+0000 7fdcdcf26800 20 rados->read ofs=0 len=0 2023-12-03T11:47:58.034 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.031+0000 7fdcdcf26800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:47:58.034 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.031+0000 7fdcdcf26800 20 rados->read ofs=0 len=0 2023-12-03T11:47:58.035 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.032+0000 7fdcdcf26800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:47:58.035 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.032+0000 7fdcdcf26800 20 started sync module instance, tier type = 2023-12-03T11:47:58.035 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.032+0000 7fdcdcf26800 20 started zone id=83aabb46-04b5-4c96-9933-c6bfb1173a73 (name=default) with tier type = 2023-12-03T11:47:58.038 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.037+0000 7fdcd9324640 0 -- 172.21.15.3:0/3116053845 >> [v2:172.21.15.37:6817/511039327,v1:172.21.15.37:6819/511039327] conn(0x7fdccc0709e0 msgr2=0x7fdccc06d080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:47:58.043 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.041+0000 7fdcdcf26800 20 add_watcher() i=0 2023-12-03T11:47:58.043 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.041+0000 7fdcdcf26800 20 add_watcher() i=1 2023-12-03T11:47:58.043 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.041+0000 7fdcdcf26800 20 add_watcher() i=2 2023-12-03T11:47:58.044 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.041+0000 7fdcdcf26800 20 add_watcher() i=3 2023-12-03T11:47:58.044 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.041+0000 7fdcdcf26800 20 add_watcher() i=4 2023-12-03T11:47:58.044 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.041+0000 7fdcdcf26800 20 add_watcher() i=5 2023-12-03T11:47:58.044 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.041+0000 7fdcdcf26800 20 add_watcher() i=6 2023-12-03T11:47:58.045 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.042+0000 7fdcdcf26800 20 add_watcher() i=7 2023-12-03T11:47:58.045 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.042+0000 7fdcdcf26800 2 all 8 watchers are set, enabling cache 2023-12-03T11:47:58.046 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.044+0000 7fdc9efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:47:58.046 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.045+0000 7fdcdcf26800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:47:58.046 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.045+0000 7fdcdcf26800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:47:58.053 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.051+0000 7fdcdcf26800 5 note: GC not initialized 2023-12-03T11:47:58.053 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.051+0000 7fdc0dffb640 20 reqs_thread_entry: start 2023-12-03T11:47:58.053 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.051+0000 7fdcdcf26800 20 init_complete bucket index max shards: 11 2023-12-03T11:47:58.053 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.051+0000 7fdcdcf26800 20 Filter name: none 2023-12-03T11:47:58.054 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.051+0000 7fdbff7fe640 20 reqs_thread_entry: start 2023-12-03T11:47:58.054 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.051+0000 7fdcdcf26800 20 rados->read ofs=0 len=0 2023-12-03T11:47:58.054 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.052+0000 7fdcdcf26800 20 rados_obj.operate() r=0 bl.length=218 2023-12-03T11:47:58.054 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.052+0000 7fdcdcf26800 20 rados->read ofs=0 len=0 2023-12-03T11:47:58.056 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.052+0000 7fdcdcf26800 20 rados_obj.operate() r=0 bl.length=390 2023-12-03T11:47:58.056 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.052+0000 7fdcdcf26800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:47:58.056 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.052+0000 7fdcdcf26800 20 rados->read ofs=0 len=0 2023-12-03T11:47:58.056 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.053+0000 7fdcdcf26800 20 rados_obj.operate() r=0 bl.length=218 2023-12-03T11:47:58.056 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.053+0000 7fdcdcf26800 20 rados->read ofs=0 len=0 2023-12-03T11:47:58.056 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.053+0000 7fdcdcf26800 20 rados_obj.operate() r=0 bl.length=390 2023-12-03T11:47:58.057 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.053+0000 7fdcdcf26800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:47:58.057 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.054+0000 7fdcdcf26800 20 rados->read ofs=0 len=0 2023-12-03T11:47:58.057 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.054+0000 7fdcdcf26800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:47:58.058 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.055+0000 7fdc9efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:47:58.059 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.057+0000 7fdcdcf26800 20 remove_watcher() i=0 2023-12-03T11:47:58.059 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.057+0000 7fdcdcf26800 2 removed watcher, disabling cache 2023-12-03T11:47:58.060 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.058+0000 7fdcdcf26800 20 remove_watcher() i=1 2023-12-03T11:47:58.061 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.060+0000 7fdcdcf26800 20 remove_watcher() i=2 2023-12-03T11:47:58.062 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.061+0000 7fdcdcf26800 20 remove_watcher() i=3 2023-12-03T11:47:58.063 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.062+0000 7fdcdcf26800 20 remove_watcher() i=4 2023-12-03T11:47:58.064 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.063+0000 7fdcdcf26800 20 remove_watcher() i=5 2023-12-03T11:47:58.065 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.064+0000 7fdcdcf26800 20 remove_watcher() i=6 2023-12-03T11:47:58.066 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.065+0000 7fdcdcf26800 20 remove_watcher() i=7 2023-12-03T11:47:58.071 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:47:58.071 INFO:tasks.workunit.client.0.smithi003.stderr:BUCKET_STATS: 2023-12-03T11:47:58.071 INFO:tasks.workunit.client.0.smithi003.stderr:bucket: error-at-set-target-layout id: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.19 num_objects: 20 size_kb: 1 num_shards: 11 2023-12-03T11:47:58.071 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:47:58.072 INFO:tasks.workunit.client.0.smithi003.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at set_target_layout 2023-12-03T11:47:58.106 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:47:58.106 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:47:58.120 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.119+0000 7f249f33a800 20 rados->read ofs=0 len=0 2023-12-03T11:47:58.122 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.121+0000 7f249f33a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:47:58.122 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.121+0000 7f249f33a800 20 realm 2023-12-03T11:47:58.122 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.121+0000 7f249f33a800 20 rados->read ofs=0 len=0 2023-12-03T11:47:58.122 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.121+0000 7f249f33a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:47:58.122 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.121+0000 7f249f33a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:47:58.122 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.121+0000 7f249f33a800 20 rados->read ofs=0 len=0 2023-12-03T11:47:58.123 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.121+0000 7f249f33a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:47:58.123 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.121+0000 7f249f33a800 20 rados->read ofs=0 len=0 2023-12-03T11:47:58.124 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.122+0000 7f249f33a800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:47:58.124 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.122+0000 7f249f33a800 20 rados->read ofs=0 len=0 2023-12-03T11:47:58.124 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.122+0000 7f249f33a800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:47:58.124 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.122+0000 7f249f33a800 20 searching for the correct realm 2023-12-03T11:47:58.134 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.132+0000 7f249b00d640 0 -- 172.21.15.3:0/735958401 >> [v2:172.21.15.37:6805/1692844418,v1:172.21.15.37:6807/1692844418] conn(0x5586757d49f0 msgr2=0x5586757d6e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:47:58.137 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.134+0000 7f249f33a800 20 RGWRados::pool_iterate: got zone_info.83aabb46-04b5-4c96-9933-c6bfb1173a73 2023-12-03T11:47:58.137 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.134+0000 7f249f33a800 20 RGWRados::pool_iterate: got zonegroup_info.6a811aad-435d-4fdd-93c9-b7e0b50de429 2023-12-03T11:47:58.137 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.134+0000 7f249f33a800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:47:58.137 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.134+0000 7f249f33a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:47:58.137 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.134+0000 7f249f33a800 20 rados->read ofs=0 len=0 2023-12-03T11:47:58.137 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.134+0000 7f249f33a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:47:58.137 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.134+0000 7f249f33a800 20 rados->read ofs=0 len=0 2023-12-03T11:47:58.137 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.135+0000 7f249f33a800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:47:58.138 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.135+0000 7f249f33a800 20 rados->read ofs=0 len=0 2023-12-03T11:47:58.138 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.135+0000 7f249f33a800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:47:58.138 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.135+0000 7f249f33a800 20 zone default found 2023-12-03T11:47:58.138 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.135+0000 7f249f33a800 4 Realm: () 2023-12-03T11:47:58.138 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.135+0000 7f249f33a800 4 ZoneGroup: default (6a811aad-435d-4fdd-93c9-b7e0b50de429) 2023-12-03T11:47:58.138 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.135+0000 7f249f33a800 4 Zone: default (83aabb46-04b5-4c96-9933-c6bfb1173a73) 2023-12-03T11:47:58.138 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.135+0000 7f249f33a800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:47:58.138 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.135+0000 7f249f33a800 20 zonegroup default 2023-12-03T11:47:58.138 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.135+0000 7f249f33a800 20 rados->read ofs=0 len=0 2023-12-03T11:47:58.138 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.135+0000 7f249f33a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:47:58.138 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.135+0000 7f249f33a800 20 rados->read ofs=0 len=0 2023-12-03T11:47:58.138 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.136+0000 7f249f33a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:47:58.138 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.136+0000 7f249f33a800 20 rados->read ofs=0 len=0 2023-12-03T11:47:58.138 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.136+0000 7f249f33a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:47:58.138 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.136+0000 7f249f33a800 20 started sync module instance, tier type = 2023-12-03T11:47:58.139 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.136+0000 7f249f33a800 20 started zone id=83aabb46-04b5-4c96-9933-c6bfb1173a73 (name=default) with tier type = 2023-12-03T11:47:58.144 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.142+0000 7f249b80e640 0 -- 172.21.15.3:0/735958401 >> [v2:172.21.15.37:6816/3770469300,v1:172.21.15.37:6818/3770469300] conn(0x7f2490090960 msgr2=0x7f249005f400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:47:58.146 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.145+0000 7f249f33a800 20 add_watcher() i=0 2023-12-03T11:47:58.146 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.145+0000 7f249f33a800 20 add_watcher() i=1 2023-12-03T11:47:58.146 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.145+0000 7f249f33a800 20 add_watcher() i=2 2023-12-03T11:47:58.146 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.145+0000 7f249f33a800 20 add_watcher() i=3 2023-12-03T11:47:58.146 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.145+0000 7f249f33a800 20 add_watcher() i=4 2023-12-03T11:47:58.147 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.145+0000 7f249f33a800 20 add_watcher() i=5 2023-12-03T11:47:58.147 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.145+0000 7f249f33a800 20 add_watcher() i=6 2023-12-03T11:47:58.147 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.146+0000 7f249f33a800 20 add_watcher() i=7 2023-12-03T11:47:58.147 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.146+0000 7f249f33a800 2 all 8 watchers are set, enabling cache 2023-12-03T11:47:58.149 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.147+0000 7f24617e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:47:58.149 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.148+0000 7f249f33a800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:47:58.149 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.148+0000 7f249f33a800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:47:58.155 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.154+0000 7f249f33a800 5 note: GC not initialized 2023-12-03T11:47:58.155 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.154+0000 7f23cffff640 20 reqs_thread_entry: start 2023-12-03T11:47:58.155 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.154+0000 7f249f33a800 20 init_complete bucket index max shards: 11 2023-12-03T11:47:58.156 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.154+0000 7f249f33a800 20 Filter name: none 2023-12-03T11:47:58.156 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.154+0000 7f23cdffb640 20 reqs_thread_entry: start 2023-12-03T11:47:58.156 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.154+0000 7f249f33a800 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2023-12-03T11:47:58.156 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.154+0000 7f249f33a800 20 rados->read ofs=0 len=0 2023-12-03T11:47:58.157 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.155+0000 7f249f33a800 20 rados_obj.operate() r=0 bl.length=218 2023-12-03T11:47:58.157 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.155+0000 7f249f33a800 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2023-12-03T11:47:58.157 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.155+0000 7f249f33a800 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2023-12-03T11:47:58.157 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.155+0000 7f249f33a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.19 : miss 2023-12-03T11:47:58.157 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.155+0000 7f249f33a800 20 rados->read ofs=0 len=0 2023-12-03T11:47:58.157 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.155+0000 7f249f33a800 20 rados_obj.operate() r=0 bl.length=390 2023-12-03T11:47:58.157 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.155+0000 7f249f33a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.19 info.flags=0x17 2023-12-03T11:47:58.157 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.155+0000 7f249f33a800 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.19 to cache LRU end 2023-12-03T11:47:58.157 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.155+0000 7f249f33a800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:47:58.157 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.155+0000 7f249f33a800 10 updating xattr: name=user.rgw.acl bl.length()=265 2023-12-03T11:47:58.157 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.155+0000 7f249f33a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.19 2023-12-03T11:47:58.164 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.163+0000 7f249f33a800 -1 Injecting error=-5 at location=set_target_layout 2023-12-03T11:47:58.164 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.163+0000 7f249f33a800 0 ERROR: init_target_layout failed to write target index layout to bucket info: (5) Input/output error 2023-12-03T11:47:58.168 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.167+0000 7f24617e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:47:58.173 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.169+0000 7f249f33a800 20 remove_watcher() i=0 2023-12-03T11:47:58.173 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.169+0000 7f249f33a800 2 removed watcher, disabling cache 2023-12-03T11:47:58.174 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.171+0000 7f249f33a800 20 remove_watcher() i=1 2023-12-03T11:47:58.174 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.172+0000 7f249f33a800 20 remove_watcher() i=2 2023-12-03T11:47:58.174 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.173+0000 7f249f33a800 20 remove_watcher() i=3 2023-12-03T11:47:58.175 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.174+0000 7f249f33a800 20 remove_watcher() i=4 2023-12-03T11:47:58.177 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.175+0000 7f249f33a800 20 remove_watcher() i=5 2023-12-03T11:47:58.177 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.176+0000 7f249f33a800 20 remove_watcher() i=6 2023-12-03T11:47:58.178 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.177+0000 7f249f33a800 20 remove_watcher() i=7 2023-12-03T11:47:58.184 INFO:tasks.workunit.client.0.smithi003.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2023-12-03T11:47:58.212 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:47:58.212 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:47:58.226 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.225+0000 7f86f8b22800 20 rados->read ofs=0 len=0 2023-12-03T11:47:58.229 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.227+0000 7f86f8b22800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:47:58.229 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.227+0000 7f86f8b22800 20 realm 2023-12-03T11:47:58.229 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.227+0000 7f86f8b22800 20 rados->read ofs=0 len=0 2023-12-03T11:47:58.229 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.227+0000 7f86f8b22800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:47:58.230 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.227+0000 7f86f8b22800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:47:58.230 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.227+0000 7f86f8b22800 20 rados->read ofs=0 len=0 2023-12-03T11:47:58.230 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.227+0000 7f86f8b22800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:47:58.230 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.227+0000 7f86f8b22800 20 rados->read ofs=0 len=0 2023-12-03T11:47:58.230 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.228+0000 7f86f8b22800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:47:58.230 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.228+0000 7f86f8b22800 20 rados->read ofs=0 len=0 2023-12-03T11:47:58.230 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.228+0000 7f86f8b22800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:47:58.231 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.228+0000 7f86f8b22800 20 searching for the correct realm 2023-12-03T11:47:58.240 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.239+0000 7f86f47a6640 0 -- 172.21.15.3:0/577449606 >> [v2:172.21.15.37:6805/1692844418,v1:172.21.15.37:6807/1692844418] conn(0x557f1fc2a690 msgr2=0x557f1fc2ca80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:47:58.242 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.240+0000 7f86f8b22800 20 RGWRados::pool_iterate: got zone_info.83aabb46-04b5-4c96-9933-c6bfb1173a73 2023-12-03T11:47:58.242 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.240+0000 7f86f8b22800 20 RGWRados::pool_iterate: got zonegroup_info.6a811aad-435d-4fdd-93c9-b7e0b50de429 2023-12-03T11:47:58.242 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.240+0000 7f86f8b22800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:47:58.242 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.240+0000 7f86f8b22800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:47:58.242 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.240+0000 7f86f8b22800 20 rados->read ofs=0 len=0 2023-12-03T11:47:58.242 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.241+0000 7f86f8b22800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:47:58.242 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.241+0000 7f86f8b22800 20 rados->read ofs=0 len=0 2023-12-03T11:47:58.243 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.241+0000 7f86f8b22800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:47:58.243 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.241+0000 7f86f8b22800 20 rados->read ofs=0 len=0 2023-12-03T11:47:58.243 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.241+0000 7f86f8b22800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:47:58.244 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.241+0000 7f86f8b22800 20 zone default found 2023-12-03T11:47:58.244 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.241+0000 7f86f8b22800 4 Realm: () 2023-12-03T11:47:58.244 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.241+0000 7f86f8b22800 4 ZoneGroup: default (6a811aad-435d-4fdd-93c9-b7e0b50de429) 2023-12-03T11:47:58.244 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.241+0000 7f86f8b22800 4 Zone: default (83aabb46-04b5-4c96-9933-c6bfb1173a73) 2023-12-03T11:47:58.244 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.241+0000 7f86f8b22800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:47:58.244 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.241+0000 7f86f8b22800 20 zonegroup default 2023-12-03T11:47:58.244 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.241+0000 7f86f8b22800 20 rados->read ofs=0 len=0 2023-12-03T11:47:58.244 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.241+0000 7f86f8b22800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:47:58.244 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.241+0000 7f86f8b22800 20 rados->read ofs=0 len=0 2023-12-03T11:47:58.244 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.242+0000 7f86f8b22800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:47:58.244 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.242+0000 7f86f8b22800 20 rados->read ofs=0 len=0 2023-12-03T11:47:58.244 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.242+0000 7f86f8b22800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:47:58.244 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.242+0000 7f86f8b22800 20 started sync module instance, tier type = 2023-12-03T11:47:58.244 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.242+0000 7f86f8b22800 20 started zone id=83aabb46-04b5-4c96-9933-c6bfb1173a73 (name=default) with tier type = 2023-12-03T11:47:58.251 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.249+0000 7f86f4fa7640 0 -- 172.21.15.3:0/577449606 >> [v2:172.21.15.37:6816/3770469300,v1:172.21.15.37:6818/3770469300] conn(0x7f86dc05e760 msgr2=0x7f86dc052030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:47:58.253 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.252+0000 7f86f8b22800 20 add_watcher() i=0 2023-12-03T11:47:58.253 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.252+0000 7f86f8b22800 20 add_watcher() i=1 2023-12-03T11:47:58.253 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.252+0000 7f86f8b22800 20 add_watcher() i=2 2023-12-03T11:47:58.253 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.252+0000 7f86f8b22800 20 add_watcher() i=3 2023-12-03T11:47:58.254 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.252+0000 7f86f8b22800 20 add_watcher() i=4 2023-12-03T11:47:58.254 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.252+0000 7f86f8b22800 20 add_watcher() i=5 2023-12-03T11:47:58.254 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.252+0000 7f86f8b22800 20 add_watcher() i=6 2023-12-03T11:47:58.254 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.253+0000 7f86f8b22800 20 add_watcher() i=7 2023-12-03T11:47:58.254 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.253+0000 7f86f8b22800 2 all 8 watchers are set, enabling cache 2023-12-03T11:47:58.256 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.254+0000 7f86ba7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:47:58.256 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.255+0000 7f86f8b22800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:47:58.256 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.255+0000 7f86f8b22800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:47:58.262 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.261+0000 7f86f8b22800 5 note: GC not initialized 2023-12-03T11:47:58.262 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.261+0000 7f86297fa640 20 reqs_thread_entry: start 2023-12-03T11:47:58.263 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.261+0000 7f86f8b22800 20 init_complete bucket index max shards: 11 2023-12-03T11:47:58.263 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.261+0000 7f86f8b22800 20 Filter name: none 2023-12-03T11:47:58.263 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.261+0000 7f8622ffd640 20 reqs_thread_entry: start 2023-12-03T11:47:58.263 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.261+0000 7f86f8b22800 20 rados->read ofs=0 len=0 2023-12-03T11:47:58.264 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.262+0000 7f86f8b22800 20 rados_obj.operate() r=0 bl.length=218 2023-12-03T11:47:58.264 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.262+0000 7f86f8b22800 20 rados->read ofs=0 len=0 2023-12-03T11:47:58.264 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.262+0000 7f86f8b22800 20 rados_obj.operate() r=0 bl.length=390 2023-12-03T11:47:58.264 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.262+0000 7f86f8b22800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:47:58.264 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.262+0000 7f86f8b22800 20 rados->read ofs=0 len=0 2023-12-03T11:47:58.264 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.262+0000 7f86f8b22800 20 rados_obj.operate() r=0 bl.length=218 2023-12-03T11:47:58.264 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.262+0000 7f86f8b22800 20 rados->read ofs=0 len=0 2023-12-03T11:47:58.264 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.263+0000 7f86f8b22800 20 rados_obj.operate() r=0 bl.length=390 2023-12-03T11:47:58.264 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.263+0000 7f86f8b22800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:47:58.265 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.264+0000 7f86f8b22800 20 rados->read ofs=0 len=0 2023-12-03T11:47:58.265 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.264+0000 7f86f8b22800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:47:58.266 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.265+0000 7f86ba7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:47:58.269 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.268+0000 7f86f8b22800 20 remove_watcher() i=0 2023-12-03T11:47:58.269 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.268+0000 7f86f8b22800 2 removed watcher, disabling cache 2023-12-03T11:47:58.270 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.269+0000 7f86f8b22800 20 remove_watcher() i=1 2023-12-03T11:47:58.271 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.270+0000 7f86f8b22800 20 remove_watcher() i=2 2023-12-03T11:47:58.272 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.271+0000 7f86f8b22800 20 remove_watcher() i=3 2023-12-03T11:47:58.273 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.272+0000 7f86f8b22800 20 remove_watcher() i=4 2023-12-03T11:47:58.274 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.273+0000 7f86f8b22800 20 remove_watcher() i=5 2023-12-03T11:47:58.275 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.274+0000 7f86f8b22800 20 remove_watcher() i=6 2023-12-03T11:47:58.276 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.275+0000 7f86f8b22800 20 remove_watcher() i=7 2023-12-03T11:47:58.281 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:47:58.281 INFO:tasks.workunit.client.0.smithi003.stderr:BUCKET_STATS: 2023-12-03T11:47:58.281 INFO:tasks.workunit.client.0.smithi003.stderr:bucket: error-at-set-target-layout id: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.19 num_objects: 20 size_kb: 1 num_shards: 11 2023-12-03T11:47:58.281 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:47:58.366 INFO:tasks.workunit.client.0.smithi003.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2023-12-03T11:47:58.397 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:47:58.398 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:47:58.412 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.410+0000 7f2ec8720800 20 rados->read ofs=0 len=0 2023-12-03T11:47:58.413 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.412+0000 7f2ec8720800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:47:58.414 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.412+0000 7f2ec8720800 20 realm 2023-12-03T11:47:58.414 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.412+0000 7f2ec8720800 20 rados->read ofs=0 len=0 2023-12-03T11:47:58.414 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.412+0000 7f2ec8720800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:47:58.414 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.412+0000 7f2ec8720800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:47:58.414 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.412+0000 7f2ec8720800 20 rados->read ofs=0 len=0 2023-12-03T11:47:58.414 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.412+0000 7f2ec8720800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:47:58.414 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.412+0000 7f2ec8720800 20 rados->read ofs=0 len=0 2023-12-03T11:47:58.415 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.413+0000 7f2ec8720800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:47:58.415 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.413+0000 7f2ec8720800 20 rados->read ofs=0 len=0 2023-12-03T11:47:58.415 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.414+0000 7f2ec8720800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:47:58.415 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.414+0000 7f2ec8720800 20 searching for the correct realm 2023-12-03T11:47:58.425 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.423+0000 7f2ec43c9640 0 -- 172.21.15.3:0/3025361242 >> [v2:172.21.15.37:6805/1692844418,v1:172.21.15.37:6807/1692844418] conn(0x5622976af880 msgr2=0x5622976b1c70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:47:58.426 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.425+0000 7f2ec8720800 20 RGWRados::pool_iterate: got zone_info.83aabb46-04b5-4c96-9933-c6bfb1173a73 2023-12-03T11:47:58.426 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.425+0000 7f2ec8720800 20 RGWRados::pool_iterate: got zonegroup_info.6a811aad-435d-4fdd-93c9-b7e0b50de429 2023-12-03T11:47:58.426 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.425+0000 7f2ec8720800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:47:58.426 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.425+0000 7f2ec8720800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:47:58.426 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.425+0000 7f2ec8720800 20 rados->read ofs=0 len=0 2023-12-03T11:47:58.427 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.425+0000 7f2ec8720800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:47:58.427 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.425+0000 7f2ec8720800 20 rados->read ofs=0 len=0 2023-12-03T11:47:58.427 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.425+0000 7f2ec8720800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:47:58.427 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.425+0000 7f2ec8720800 20 rados->read ofs=0 len=0 2023-12-03T11:47:58.428 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.425+0000 7f2ec8720800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:47:58.428 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.425+0000 7f2ec8720800 20 zone default found 2023-12-03T11:47:58.428 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.425+0000 7f2ec8720800 4 Realm: () 2023-12-03T11:47:58.428 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.425+0000 7f2ec8720800 4 ZoneGroup: default (6a811aad-435d-4fdd-93c9-b7e0b50de429) 2023-12-03T11:47:58.428 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.425+0000 7f2ec8720800 4 Zone: default (83aabb46-04b5-4c96-9933-c6bfb1173a73) 2023-12-03T11:47:58.428 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.425+0000 7f2ec8720800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:47:58.428 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.425+0000 7f2ec8720800 20 zonegroup default 2023-12-03T11:47:58.428 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.425+0000 7f2ec8720800 20 rados->read ofs=0 len=0 2023-12-03T11:47:58.428 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.426+0000 7f2ec8720800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:47:58.428 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.426+0000 7f2ec8720800 20 rados->read ofs=0 len=0 2023-12-03T11:47:58.429 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.426+0000 7f2ec8720800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:47:58.429 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.426+0000 7f2ec8720800 20 rados->read ofs=0 len=0 2023-12-03T11:47:58.429 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.426+0000 7f2ec8720800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:47:58.429 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.426+0000 7f2ec8720800 20 started sync module instance, tier type = 2023-12-03T11:47:58.429 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.426+0000 7f2ec8720800 20 started zone id=83aabb46-04b5-4c96-9933-c6bfb1173a73 (name=default) with tier type = 2023-12-03T11:47:58.434 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.433+0000 7f2ec4bca640 0 -- 172.21.15.3:0/3025361242 >> [v2:172.21.15.37:6816/3770469300,v1:172.21.15.37:6818/3770469300] conn(0x7f2eac0c4960 msgr2=0x7f2eac094930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:47:58.437 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.436+0000 7f2ec8720800 20 add_watcher() i=0 2023-12-03T11:47:58.437 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.436+0000 7f2ec8720800 20 add_watcher() i=1 2023-12-03T11:47:58.437 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.436+0000 7f2ec8720800 20 add_watcher() i=2 2023-12-03T11:47:58.437 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.436+0000 7f2ec8720800 20 add_watcher() i=3 2023-12-03T11:47:58.437 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.436+0000 7f2ec8720800 20 add_watcher() i=4 2023-12-03T11:47:58.437 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.436+0000 7f2ec8720800 20 add_watcher() i=5 2023-12-03T11:47:58.437 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.436+0000 7f2ec8720800 20 add_watcher() i=6 2023-12-03T11:47:58.438 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.436+0000 7f2ec8720800 20 add_watcher() i=7 2023-12-03T11:47:58.438 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.436+0000 7f2ec8720800 2 all 8 watchers are set, enabling cache 2023-12-03T11:47:58.439 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.438+0000 7f2e8a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:47:58.441 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.438+0000 7f2ec8720800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:47:58.441 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.438+0000 7f2ec8720800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:47:58.446 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.444+0000 7f2ec8720800 5 note: GC not initialized 2023-12-03T11:47:58.446 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.445+0000 7f2df97fa640 20 reqs_thread_entry: start 2023-12-03T11:47:58.446 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.445+0000 7f2ec8720800 20 init_complete bucket index max shards: 11 2023-12-03T11:47:58.446 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.445+0000 7f2ec8720800 20 Filter name: none 2023-12-03T11:47:58.446 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.445+0000 7f2df2ffd640 20 reqs_thread_entry: start 2023-12-03T11:47:58.446 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.445+0000 7f2ec8720800 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2023-12-03T11:47:58.447 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.445+0000 7f2ec8720800 20 rados->read ofs=0 len=0 2023-12-03T11:47:58.448 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.445+0000 7f2ec8720800 20 rados_obj.operate() r=0 bl.length=218 2023-12-03T11:47:58.448 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.445+0000 7f2ec8720800 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2023-12-03T11:47:58.448 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.445+0000 7f2ec8720800 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2023-12-03T11:47:58.448 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.445+0000 7f2ec8720800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.19 : miss 2023-12-03T11:47:58.448 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.445+0000 7f2ec8720800 20 rados->read ofs=0 len=0 2023-12-03T11:47:58.448 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.446+0000 7f2ec8720800 20 rados_obj.operate() r=0 bl.length=390 2023-12-03T11:47:58.448 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.446+0000 7f2ec8720800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.19 info.flags=0x17 2023-12-03T11:47:58.448 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.446+0000 7f2ec8720800 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.19 to cache LRU end 2023-12-03T11:47:58.448 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.446+0000 7f2ec8720800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:47:58.449 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.446+0000 7f2ec8720800 10 updating xattr: name=user.rgw.acl bl.length()=265 2023-12-03T11:47:58.449 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.446+0000 7f2ec8720800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.19 2023-12-03T11:47:58.453 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.452+0000 7f2ec8720800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.19 info.flags=0x17 2023-12-03T11:47:58.453 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.452+0000 7f2ec8720800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.19 to cache LRU end 2023-12-03T11:47:58.453 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.452+0000 7f2ec8720800 10 updating xattr: name=user.rgw.acl bl.length()=265 2023-12-03T11:47:58.453 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.452+0000 7f2ec8720800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.19, ofs0, ns] 2023-12-03T11:47:58.454 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.452+0000 7f2ebaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660565 cookie 94706569291920 notifier 6411 bl.length()=959 2023-12-03T11:47:58.454 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.452+0000 7f2ebaffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.19 info.flags=0x17 2023-12-03T11:47:58.454 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.452+0000 7f2ebaffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.19 to cache LRU end 2023-12-03T11:47:58.454 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.452+0000 7f2ebaffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2023-12-03T11:47:58.455 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.454+0000 7f2ec8720800 20 handle_bi_update(): bucket=:error-at-set-target-layout[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.19]): orig_sources= new_sources= 2023-12-03T11:47:58.455 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.454+0000 7f2ec8720800 20 handle_bi_update(): bucket=:error-at-set-target-layout[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.19]): potential sources added=[] removed=[] 2023-12-03T11:47:58.455 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.454+0000 7f2ec8720800 20 handle_bi_update(): bucket=:error-at-set-target-layout[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.19]): orig_dests= new_dests= 2023-12-03T11:47:58.455 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.454+0000 7f2ec8720800 20 handle_bi_update(): bucket=:error-at-set-target-layout[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.19]): potential dests added=[] removed=[] 2023-12-03T11:47:58.458 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.457+0000 7f2ec8720800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.19.1.0 2023-12-03T11:47:58.458 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.457+0000 7f2ec8720800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.19.1.0 2023-12-03T11:47:58.459 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.457+0000 7f2ec8720800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.19.1.1 2023-12-03T11:47:58.459 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.457+0000 7f2ec8720800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.19.1.1 2023-12-03T11:47:58.459 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.457+0000 7f2ec8720800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.19.1.2 2023-12-03T11:47:58.459 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.457+0000 7f2ec8720800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.19.1.2 2023-12-03T11:47:58.459 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.457+0000 7f2ec8720800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.19.1.3 2023-12-03T11:47:58.459 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.457+0000 7f2ec8720800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.19.1.3 2023-12-03T11:47:58.459 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.457+0000 7f2ec8720800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.19.1.4 2023-12-03T11:47:58.459 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.457+0000 7f2ec8720800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.19.1.4 2023-12-03T11:47:58.459 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.457+0000 7f2ec8720800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.19.1.5 2023-12-03T11:47:58.459 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.457+0000 7f2ec8720800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.19.1.5 2023-12-03T11:47:58.459 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.457+0000 7f2ec8720800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.19.1.6 2023-12-03T11:47:58.459 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.457+0000 7f2ec8720800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.19.1.6 2023-12-03T11:47:58.459 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.457+0000 7f2ec8720800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.19.1.7 2023-12-03T11:47:58.459 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.457+0000 7f2ec8720800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.19.1.7 2023-12-03T11:47:58.460 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.457+0000 7f2ec8720800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.19.1.8 2023-12-03T11:47:58.460 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.457+0000 7f2ec8720800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.19.1.8 2023-12-03T11:47:58.460 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.457+0000 7f2ec8720800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.19.1.9 2023-12-03T11:47:58.460 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.457+0000 7f2ec8720800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.19.1.9 2023-12-03T11:47:58.460 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.457+0000 7f2ec8720800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.19.1.10 2023-12-03T11:47:58.460 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.457+0000 7f2ec8720800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.19.1.10 2023-12-03T11:47:58.460 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.457+0000 7f2ec8720800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.19.1.11 2023-12-03T11:47:58.460 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.457+0000 7f2ec8720800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.19.1.11 2023-12-03T11:47:58.460 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.457+0000 7f2ec8720800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.19.0 2023-12-03T11:47:58.460 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.457+0000 7f2ec8720800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.19.1 2023-12-03T11:47:58.461 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.458+0000 7f2ec8720800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.19.2 2023-12-03T11:47:58.461 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.458+0000 7f2ec8720800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.19.3 2023-12-03T11:47:58.462 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.459+0000 7f2ec8720800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.19.4 2023-12-03T11:47:58.462 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.459+0000 7f2ec8720800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.19.5 2023-12-03T11:47:58.462 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.460+0000 7f2ec8720800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.19.6 2023-12-03T11:47:58.462 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.460+0000 7f2ec8720800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.19.7 2023-12-03T11:47:58.462 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.461+0000 7f2ec8720800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.19.8 2023-12-03T11:47:58.462 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.461+0000 7f2ec8720800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.19.9 2023-12-03T11:47:58.463 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.461+0000 7f2ec8720800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.19.10 2023-12-03T11:47:58.466 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.465+0000 7f2ec8720800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.19 : hit (requested=0x17, cached=0x17) 2023-12-03T11:47:58.466 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.465+0000 7f2ec8720800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.19 2023-12-03T11:47:58.467 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.466+0000 7f2ec8720800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.19 info.flags=0x17 2023-12-03T11:47:58.467 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.466+0000 7f2ec8720800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.19 to cache LRU end 2023-12-03T11:47:58.467 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.466+0000 7f2ec8720800 10 updating xattr: name=user.rgw.acl bl.length()=265 2023-12-03T11:47:58.467 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.466+0000 7f2ec8720800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.19, ofs0, ns] 2023-12-03T11:47:58.468 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.466+0000 7f2eba7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660566 cookie 94706569291920 notifier 6411 bl.length()=927 2023-12-03T11:47:58.468 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.466+0000 7f2eba7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.19 info.flags=0x17 2023-12-03T11:47:58.468 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.466+0000 7f2eba7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.19 to cache LRU end 2023-12-03T11:47:58.468 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.466+0000 7f2eba7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2023-12-03T11:47:58.469 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.468+0000 7f2ec8720800 20 handle_bi_update(): bucket=:error-at-set-target-layout[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.19]): orig_sources= new_sources= 2023-12-03T11:47:58.469 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.468+0000 7f2ec8720800 20 handle_bi_update(): bucket=:error-at-set-target-layout[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.19]): potential sources added=[] removed=[] 2023-12-03T11:47:58.469 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.468+0000 7f2ec8720800 20 handle_bi_update(): bucket=:error-at-set-target-layout[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.19]): orig_dests= new_dests= 2023-12-03T11:47:58.469 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.468+0000 7f2ec8720800 20 handle_bi_update(): bucket=:error-at-set-target-layout[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.19]): potential dests added=[] removed=[] 2023-12-03T11:47:58.472 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.471+0000 7f2ec8720800 1 execute INFO: reshard of bucket "error-at-set-target-layout" completed successfully 2023-12-03T11:47:58.474 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.473+0000 7f2e8a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:47:58.476 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.475+0000 7f2ec8720800 20 remove_watcher() i=0 2023-12-03T11:47:58.476 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.475+0000 7f2ec8720800 2 removed watcher, disabling cache 2023-12-03T11:47:58.477 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.476+0000 7f2ec8720800 20 remove_watcher() i=1 2023-12-03T11:47:58.478 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.477+0000 7f2ec8720800 20 remove_watcher() i=2 2023-12-03T11:47:58.479 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.478+0000 7f2ec8720800 20 remove_watcher() i=3 2023-12-03T11:47:58.480 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.479+0000 7f2ec8720800 20 remove_watcher() i=4 2023-12-03T11:47:58.482 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.480+0000 7f2ec8720800 20 remove_watcher() i=5 2023-12-03T11:47:58.483 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.481+0000 7f2ec8720800 20 remove_watcher() i=6 2023-12-03T11:47:58.484 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.483+0000 7f2ec8720800 20 remove_watcher() i=7 2023-12-03T11:47:58.490 INFO:tasks.workunit.client.0.smithi003.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2023-12-03T11:47:58.517 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:47:58.518 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:47:58.532 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.531+0000 7fa055720800 20 rados->read ofs=0 len=0 2023-12-03T11:47:58.534 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.532+0000 7fa055720800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:47:58.534 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.532+0000 7fa055720800 20 realm 2023-12-03T11:47:58.534 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.532+0000 7fa055720800 20 rados->read ofs=0 len=0 2023-12-03T11:47:58.534 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.533+0000 7fa055720800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:47:58.534 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.533+0000 7fa055720800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:47:58.534 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.533+0000 7fa055720800 20 rados->read ofs=0 len=0 2023-12-03T11:47:58.534 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.533+0000 7fa055720800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:47:58.534 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.533+0000 7fa055720800 20 rados->read ofs=0 len=0 2023-12-03T11:47:58.535 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.534+0000 7fa055720800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:47:58.535 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.534+0000 7fa055720800 20 rados->read ofs=0 len=0 2023-12-03T11:47:58.535 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.534+0000 7fa055720800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:47:58.535 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.534+0000 7fa055720800 20 searching for the correct realm 2023-12-03T11:47:58.544 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.543+0000 7fa050bec640 0 -- 172.21.15.3:0/4207591414 >> [v2:172.21.15.3:6817/3356208405,v1:172.21.15.3:6819/3356208405] conn(0x55d4190bcd80 msgr2=0x55d4190bf170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:47:58.546 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.545+0000 7fa055720800 20 RGWRados::pool_iterate: got zone_info.83aabb46-04b5-4c96-9933-c6bfb1173a73 2023-12-03T11:47:58.546 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.545+0000 7fa055720800 20 RGWRados::pool_iterate: got zonegroup_info.6a811aad-435d-4fdd-93c9-b7e0b50de429 2023-12-03T11:47:58.546 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.545+0000 7fa055720800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:47:58.546 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.545+0000 7fa055720800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:47:58.547 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.545+0000 7fa055720800 20 rados->read ofs=0 len=0 2023-12-03T11:47:58.547 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.545+0000 7fa055720800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:47:58.547 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.545+0000 7fa055720800 20 rados->read ofs=0 len=0 2023-12-03T11:47:58.547 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.545+0000 7fa055720800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:47:58.547 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.545+0000 7fa055720800 20 rados->read ofs=0 len=0 2023-12-03T11:47:58.548 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.545+0000 7fa055720800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:47:58.548 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.545+0000 7fa055720800 20 zone default found 2023-12-03T11:47:58.548 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.545+0000 7fa055720800 4 Realm: () 2023-12-03T11:47:58.548 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.545+0000 7fa055720800 4 ZoneGroup: default (6a811aad-435d-4fdd-93c9-b7e0b50de429) 2023-12-03T11:47:58.548 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.545+0000 7fa055720800 4 Zone: default (83aabb46-04b5-4c96-9933-c6bfb1173a73) 2023-12-03T11:47:58.548 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.545+0000 7fa055720800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:47:58.548 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.545+0000 7fa055720800 20 zonegroup default 2023-12-03T11:47:58.548 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.545+0000 7fa055720800 20 rados->read ofs=0 len=0 2023-12-03T11:47:58.548 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.546+0000 7fa055720800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:47:58.549 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.546+0000 7fa055720800 20 rados->read ofs=0 len=0 2023-12-03T11:47:58.549 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.546+0000 7fa055720800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:47:58.549 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.546+0000 7fa055720800 20 rados->read ofs=0 len=0 2023-12-03T11:47:58.549 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.546+0000 7fa055720800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:47:58.549 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.546+0000 7fa055720800 20 started sync module instance, tier type = 2023-12-03T11:47:58.549 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.546+0000 7fa055720800 20 started zone id=83aabb46-04b5-4c96-9933-c6bfb1173a73 (name=default) with tier type = 2023-12-03T11:47:58.552 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.551+0000 7fa0513ed640 0 -- 172.21.15.3:0/4207591414 >> [v2:172.21.15.3:6800/2373485412,v1:172.21.15.3:6801/2373485412] conn(0x7fa04c076c20 msgr2=0x7fa04c0a8110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:47:58.557 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.555+0000 7fa055720800 20 add_watcher() i=0 2023-12-03T11:47:58.557 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.555+0000 7fa055720800 20 add_watcher() i=1 2023-12-03T11:47:58.557 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.555+0000 7fa055720800 20 add_watcher() i=2 2023-12-03T11:47:58.557 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.555+0000 7fa055720800 20 add_watcher() i=3 2023-12-03T11:47:58.557 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.555+0000 7fa055720800 20 add_watcher() i=4 2023-12-03T11:47:58.557 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.555+0000 7fa055720800 20 add_watcher() i=5 2023-12-03T11:47:58.557 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.555+0000 7fa055720800 20 add_watcher() i=6 2023-12-03T11:47:58.557 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.556+0000 7fa055720800 20 add_watcher() i=7 2023-12-03T11:47:58.558 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.556+0000 7fa055720800 2 all 8 watchers are set, enabling cache 2023-12-03T11:47:58.559 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.558+0000 7fa016fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:47:58.559 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.558+0000 7fa055720800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:47:58.559 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.558+0000 7fa055720800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:47:58.565 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.564+0000 7fa055720800 5 note: GC not initialized 2023-12-03T11:47:58.566 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.564+0000 7f9f85ffb640 20 reqs_thread_entry: start 2023-12-03T11:47:58.566 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.564+0000 7fa055720800 20 init_complete bucket index max shards: 11 2023-12-03T11:47:58.566 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.564+0000 7fa055720800 20 Filter name: none 2023-12-03T11:47:58.566 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.565+0000 7f9f777fe640 20 reqs_thread_entry: start 2023-12-03T11:47:58.566 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.565+0000 7fa055720800 20 rados->read ofs=0 len=0 2023-12-03T11:47:58.567 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.565+0000 7fa055720800 20 rados_obj.operate() r=0 bl.length=218 2023-12-03T11:47:58.567 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.565+0000 7fa055720800 20 rados->read ofs=0 len=0 2023-12-03T11:47:58.567 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.565+0000 7fa055720800 20 rados_obj.operate() r=0 bl.length=390 2023-12-03T11:47:58.567 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.565+0000 7fa055720800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:47:58.567 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.565+0000 7fa055720800 20 rados->read ofs=0 len=0 2023-12-03T11:47:58.567 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.566+0000 7fa055720800 20 rados_obj.operate() r=0 bl.length=218 2023-12-03T11:47:58.567 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.566+0000 7fa055720800 20 rados->read ofs=0 len=0 2023-12-03T11:47:58.567 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.566+0000 7fa055720800 20 rados_obj.operate() r=0 bl.length=390 2023-12-03T11:47:58.568 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.566+0000 7fa055720800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:47:58.568 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.567+0000 7fa055720800 20 rados->read ofs=0 len=0 2023-12-03T11:47:58.568 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.567+0000 7fa055720800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:47:58.569 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.568+0000 7fa016fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:47:58.571 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.570+0000 7fa055720800 20 remove_watcher() i=0 2023-12-03T11:47:58.571 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.570+0000 7fa055720800 2 removed watcher, disabling cache 2023-12-03T11:47:58.572 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.571+0000 7fa055720800 20 remove_watcher() i=1 2023-12-03T11:47:58.573 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.572+0000 7fa055720800 20 remove_watcher() i=2 2023-12-03T11:47:58.575 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.573+0000 7fa055720800 20 remove_watcher() i=3 2023-12-03T11:47:58.576 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.575+0000 7fa055720800 20 remove_watcher() i=4 2023-12-03T11:47:58.577 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.576+0000 7fa055720800 20 remove_watcher() i=5 2023-12-03T11:47:58.578 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.577+0000 7fa055720800 20 remove_watcher() i=6 2023-12-03T11:47:58.580 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:58.578+0000 7fa055720800 20 remove_watcher() i=7 2023-12-03T11:47:58.584 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:47:58.584 INFO:tasks.workunit.client.0.smithi003.stderr:BUCKET_STATS: 2023-12-03T11:47:58.584 INFO:tasks.workunit.client.0.smithi003.stderr:bucket: error-at-set-target-layout id: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.19 num_objects: 19 size_kb: 1 num_shards: 12 2023-12-03T11:47:58.584 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:47:58.895 INFO:tasks.workunit.client.0.smithi003.stderr:TEST: reshard bucket with ECANCELED injected at set_target_layout 2023-12-03T11:47:58.895 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:47:59.602 INFO:tasks.workunit.client.0.smithi003.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2023-12-03T11:47:59.630 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:47:59.630 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:47:59.644 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.643+0000 7f04ae932800 20 rados->read ofs=0 len=0 2023-12-03T11:47:59.646 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.644+0000 7f04ae932800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:47:59.646 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.644+0000 7f04ae932800 20 realm 2023-12-03T11:47:59.646 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.644+0000 7f04ae932800 20 rados->read ofs=0 len=0 2023-12-03T11:47:59.646 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.644+0000 7f04ae932800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:47:59.646 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.645+0000 7f04ae932800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:47:59.646 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.645+0000 7f04ae932800 20 rados->read ofs=0 len=0 2023-12-03T11:47:59.646 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.645+0000 7f04ae932800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:47:59.646 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.645+0000 7f04ae932800 20 rados->read ofs=0 len=0 2023-12-03T11:47:59.647 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.646+0000 7f04ae932800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:47:59.647 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.646+0000 7f04ae932800 20 rados->read ofs=0 len=0 2023-12-03T11:47:59.647 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.646+0000 7f04ae932800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:47:59.647 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.646+0000 7f04ae932800 20 searching for the correct realm 2023-12-03T11:47:59.859 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.858+0000 7f04aa562640 0 -- 172.21.15.3:0/1122287350 >> [v2:172.21.15.3:6800/2373485412,v1:172.21.15.3:6801/2373485412] conn(0x7f04a4019070 msgr2=0x7f04a400a440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-03T11:47:59.861 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.860+0000 7f04ae932800 20 RGWRados::pool_iterate: got zone_info.83aabb46-04b5-4c96-9933-c6bfb1173a73 2023-12-03T11:47:59.861 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.860+0000 7f04ae932800 20 RGWRados::pool_iterate: got zonegroup_info.6a811aad-435d-4fdd-93c9-b7e0b50de429 2023-12-03T11:47:59.861 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.860+0000 7f04ae932800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:47:59.861 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.860+0000 7f04ae932800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:47:59.861 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.860+0000 7f04ae932800 20 rados->read ofs=0 len=0 2023-12-03T11:47:59.862 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.860+0000 7f04ae932800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:47:59.862 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.860+0000 7f04ae932800 20 rados->read ofs=0 len=0 2023-12-03T11:47:59.863 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.860+0000 7f04ae932800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:47:59.863 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.860+0000 7f04ae932800 20 rados->read ofs=0 len=0 2023-12-03T11:47:59.863 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.861+0000 7f04ae932800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:47:59.863 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.861+0000 7f04ae932800 20 zone default found 2023-12-03T11:47:59.863 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.861+0000 7f04ae932800 4 Realm: () 2023-12-03T11:47:59.863 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.861+0000 7f04ae932800 4 ZoneGroup: default (6a811aad-435d-4fdd-93c9-b7e0b50de429) 2023-12-03T11:47:59.863 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.861+0000 7f04ae932800 4 Zone: default (83aabb46-04b5-4c96-9933-c6bfb1173a73) 2023-12-03T11:47:59.863 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.861+0000 7f04ae932800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:47:59.863 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.861+0000 7f04ae932800 20 zonegroup default 2023-12-03T11:47:59.863 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.861+0000 7f04ae932800 20 rados->read ofs=0 len=0 2023-12-03T11:47:59.863 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.861+0000 7f04ae932800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:47:59.863 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.861+0000 7f04ae932800 20 rados->read ofs=0 len=0 2023-12-03T11:47:59.863 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.862+0000 7f04ae932800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:47:59.863 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.862+0000 7f04ae932800 20 rados->read ofs=0 len=0 2023-12-03T11:47:59.864 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.862+0000 7f04ae932800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:47:59.864 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.862+0000 7f04ae932800 20 started sync module instance, tier type = 2023-12-03T11:47:59.864 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.862+0000 7f04ae932800 20 started zone id=83aabb46-04b5-4c96-9933-c6bfb1173a73 (name=default) with tier type = 2023-12-03T11:47:59.868 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.867+0000 7f04aa562640 0 -- 172.21.15.3:0/1122287350 >> [v2:172.21.15.3:6800/2373485412,v1:172.21.15.3:6801/2373485412] conn(0x7f0484079e10 msgr2=0x7f048407c240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-03T11:47:59.873 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.872+0000 7f04ae932800 20 add_watcher() i=0 2023-12-03T11:47:59.874 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.872+0000 7f04ae932800 20 add_watcher() i=1 2023-12-03T11:47:59.874 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.872+0000 7f04ae932800 20 add_watcher() i=2 2023-12-03T11:47:59.874 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.872+0000 7f04ae932800 20 add_watcher() i=3 2023-12-03T11:47:59.874 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.872+0000 7f04ae932800 20 add_watcher() i=4 2023-12-03T11:47:59.874 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.872+0000 7f04ae932800 20 add_watcher() i=5 2023-12-03T11:47:59.874 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.872+0000 7f04ae932800 20 add_watcher() i=6 2023-12-03T11:47:59.874 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.873+0000 7f04ae932800 20 add_watcher() i=7 2023-12-03T11:47:59.874 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.873+0000 7f04ae932800 2 all 8 watchers are set, enabling cache 2023-12-03T11:47:59.876 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.875+0000 7f046ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:47:59.876 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.875+0000 7f04ae932800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:47:59.876 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.875+0000 7f04ae932800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:47:59.882 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.881+0000 7f04ae932800 5 note: GC not initialized 2023-12-03T11:47:59.883 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.882+0000 7f03deffd640 20 reqs_thread_entry: start 2023-12-03T11:47:59.883 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.882+0000 7f04ae932800 20 init_complete bucket index max shards: 11 2023-12-03T11:47:59.883 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.882+0000 7f04ae932800 20 Filter name: none 2023-12-03T11:47:59.883 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.882+0000 7f03dcff9640 20 reqs_thread_entry: start 2023-12-03T11:47:59.883 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.882+0000 7f04ae932800 20 rados->read ofs=0 len=0 2023-12-03T11:47:59.884 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.883+0000 7f04ae932800 20 rados_obj.operate() r=0 bl.length=218 2023-12-03T11:47:59.884 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.883+0000 7f04ae932800 20 rados->read ofs=0 len=0 2023-12-03T11:47:59.885 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.883+0000 7f04ae932800 20 rados_obj.operate() r=0 bl.length=390 2023-12-03T11:47:59.885 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.883+0000 7f04ae932800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:47:59.885 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.883+0000 7f04ae932800 20 rados->read ofs=0 len=0 2023-12-03T11:47:59.885 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.884+0000 7f04ae932800 20 rados_obj.operate() r=0 bl.length=218 2023-12-03T11:47:59.885 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.884+0000 7f04ae932800 20 rados->read ofs=0 len=0 2023-12-03T11:47:59.885 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.884+0000 7f04ae932800 20 rados_obj.operate() r=0 bl.length=390 2023-12-03T11:47:59.885 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.884+0000 7f04ae932800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:47:59.887 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.885+0000 7f04ae932800 20 rados->read ofs=0 len=0 2023-12-03T11:47:59.887 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.885+0000 7f04ae932800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:47:59.887 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.886+0000 7f046ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:47:59.889 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.888+0000 7f04ae932800 20 remove_watcher() i=0 2023-12-03T11:47:59.889 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.888+0000 7f04ae932800 2 removed watcher, disabling cache 2023-12-03T11:47:59.891 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.890+0000 7f04ae932800 20 remove_watcher() i=1 2023-12-03T11:47:59.892 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.891+0000 7f04ae932800 20 remove_watcher() i=2 2023-12-03T11:47:59.894 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.892+0000 7f04ae932800 20 remove_watcher() i=3 2023-12-03T11:47:59.895 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.894+0000 7f04ae932800 20 remove_watcher() i=4 2023-12-03T11:47:59.896 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.895+0000 7f04ae932800 20 remove_watcher() i=5 2023-12-03T11:47:59.897 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.896+0000 7f04ae932800 20 remove_watcher() i=6 2023-12-03T11:47:59.898 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.897+0000 7f04ae932800 20 remove_watcher() i=7 2023-12-03T11:47:59.903 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:47:59.903 INFO:tasks.workunit.client.0.smithi003.stderr:BUCKET_STATS: 2023-12-03T11:47:59.903 INFO:tasks.workunit.client.0.smithi003.stderr:bucket: error-at-set-target-layout id: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.20 num_objects: 20 size_kb: 1 num_shards: 11 2023-12-03T11:47:59.903 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:47:59.904 INFO:tasks.workunit.client.0.smithi003.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at set_target_layout --inject-error-code 125 2023-12-03T11:47:59.940 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:47:59.940 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:47:59.955 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.953+0000 7fc1ce732800 20 rados->read ofs=0 len=0 2023-12-03T11:47:59.956 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.955+0000 7fc1ce732800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:47:59.956 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.955+0000 7fc1ce732800 20 realm 2023-12-03T11:47:59.957 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.955+0000 7fc1ce732800 20 rados->read ofs=0 len=0 2023-12-03T11:47:59.957 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.955+0000 7fc1ce732800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:47:59.957 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.955+0000 7fc1ce732800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:47:59.957 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.955+0000 7fc1ce732800 20 rados->read ofs=0 len=0 2023-12-03T11:47:59.957 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.955+0000 7fc1ce732800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:47:59.957 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.955+0000 7fc1ce732800 20 rados->read ofs=0 len=0 2023-12-03T11:47:59.958 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.956+0000 7fc1ce732800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:47:59.958 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.956+0000 7fc1ce732800 20 rados->read ofs=0 len=0 2023-12-03T11:47:59.958 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.957+0000 7fc1ce732800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:47:59.958 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.957+0000 7fc1ce732800 20 searching for the correct realm 2023-12-03T11:47:59.968 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.967+0000 7fc1ca362640 0 -- 172.21.15.3:0/2006974256 >> [v2:172.21.15.37:6805/1692844418,v1:172.21.15.37:6807/1692844418] conn(0x55c63f7aa480 msgr2=0x55c63f7ac8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:47:59.970 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.969+0000 7fc1ce732800 20 RGWRados::pool_iterate: got zone_info.83aabb46-04b5-4c96-9933-c6bfb1173a73 2023-12-03T11:47:59.970 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.969+0000 7fc1ce732800 20 RGWRados::pool_iterate: got zonegroup_info.6a811aad-435d-4fdd-93c9-b7e0b50de429 2023-12-03T11:47:59.971 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.969+0000 7fc1ce732800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:47:59.971 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.969+0000 7fc1ce732800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:47:59.971 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.969+0000 7fc1ce732800 20 rados->read ofs=0 len=0 2023-12-03T11:47:59.971 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.969+0000 7fc1ce732800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:47:59.971 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.969+0000 7fc1ce732800 20 rados->read ofs=0 len=0 2023-12-03T11:47:59.972 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.969+0000 7fc1ce732800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:47:59.972 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.969+0000 7fc1ce732800 20 rados->read ofs=0 len=0 2023-12-03T11:47:59.972 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.970+0000 7fc1ce732800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:47:59.972 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.970+0000 7fc1ce732800 20 zone default found 2023-12-03T11:47:59.972 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.970+0000 7fc1ce732800 4 Realm: () 2023-12-03T11:47:59.972 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.970+0000 7fc1ce732800 4 ZoneGroup: default (6a811aad-435d-4fdd-93c9-b7e0b50de429) 2023-12-03T11:47:59.972 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.970+0000 7fc1ce732800 4 Zone: default (83aabb46-04b5-4c96-9933-c6bfb1173a73) 2023-12-03T11:47:59.972 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.970+0000 7fc1ce732800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:47:59.972 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.970+0000 7fc1ce732800 20 zonegroup default 2023-12-03T11:47:59.972 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.970+0000 7fc1ce732800 20 rados->read ofs=0 len=0 2023-12-03T11:47:59.972 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.970+0000 7fc1ce732800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:47:59.972 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.970+0000 7fc1ce732800 20 rados->read ofs=0 len=0 2023-12-03T11:47:59.973 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.971+0000 7fc1ce732800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:47:59.973 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.971+0000 7fc1ce732800 20 rados->read ofs=0 len=0 2023-12-03T11:47:59.973 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.971+0000 7fc1ce732800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:47:59.973 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.971+0000 7fc1ce732800 20 started sync module instance, tier type = 2023-12-03T11:47:59.973 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.971+0000 7fc1ce732800 20 started zone id=83aabb46-04b5-4c96-9933-c6bfb1173a73 (name=default) with tier type = 2023-12-03T11:47:59.978 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.977+0000 7fc1cab63640 0 -- 172.21.15.3:0/2006974256 >> [v2:172.21.15.37:6816/3770469300,v1:172.21.15.37:6818/3770469300] conn(0x7fc1c0046400 msgr2=0x7fc1c0046860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-03T11:47:59.982 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.980+0000 7fc1ce732800 20 add_watcher() i=0 2023-12-03T11:47:59.982 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.980+0000 7fc1ce732800 20 add_watcher() i=1 2023-12-03T11:47:59.982 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.980+0000 7fc1ce732800 20 add_watcher() i=2 2023-12-03T11:47:59.982 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.980+0000 7fc1ce732800 20 add_watcher() i=3 2023-12-03T11:47:59.982 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.980+0000 7fc1ce732800 20 add_watcher() i=4 2023-12-03T11:47:59.983 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.980+0000 7fc1ce732800 20 add_watcher() i=5 2023-12-03T11:47:59.983 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.980+0000 7fc1ce732800 20 add_watcher() i=6 2023-12-03T11:47:59.983 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.981+0000 7fc1ce732800 20 add_watcher() i=7 2023-12-03T11:47:59.983 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.981+0000 7fc1ce732800 2 all 8 watchers are set, enabling cache 2023-12-03T11:47:59.984 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.983+0000 7fc18ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:47:59.984 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.983+0000 7fc1ce732800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:47:59.984 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.983+0000 7fc1ce732800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:47:59.991 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.989+0000 7fc1ce732800 5 note: GC not initialized 2023-12-03T11:47:59.991 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.989+0000 7fc0feffd640 20 reqs_thread_entry: start 2023-12-03T11:47:59.991 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.989+0000 7fc1ce732800 20 init_complete bucket index max shards: 11 2023-12-03T11:47:59.991 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.989+0000 7fc1ce732800 20 Filter name: none 2023-12-03T11:47:59.991 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.990+0000 7fc0fcff9640 20 reqs_thread_entry: start 2023-12-03T11:47:59.991 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.990+0000 7fc1ce732800 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2023-12-03T11:47:59.991 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.990+0000 7fc1ce732800 20 rados->read ofs=0 len=0 2023-12-03T11:47:59.992 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.990+0000 7fc1ce732800 20 rados_obj.operate() r=0 bl.length=218 2023-12-03T11:47:59.992 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.990+0000 7fc1ce732800 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2023-12-03T11:47:59.992 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.990+0000 7fc1ce732800 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2023-12-03T11:47:59.992 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.990+0000 7fc1ce732800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.20 : miss 2023-12-03T11:47:59.992 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.990+0000 7fc1ce732800 20 rados->read ofs=0 len=0 2023-12-03T11:47:59.992 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.990+0000 7fc1ce732800 20 rados_obj.operate() r=0 bl.length=390 2023-12-03T11:47:59.992 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.990+0000 7fc1ce732800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.20 info.flags=0x17 2023-12-03T11:47:59.993 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.990+0000 7fc1ce732800 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.20 to cache LRU end 2023-12-03T11:47:59.993 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.990+0000 7fc1ce732800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:47:59.993 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.990+0000 7fc1ce732800 10 updating xattr: name=user.rgw.acl bl.length()=265 2023-12-03T11:47:59.993 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.990+0000 7fc1ce732800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.20 2023-12-03T11:47:59.996 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.995+0000 7fc1ce732800 -1 Injecting error=-125 at location=set_target_layout 2023-12-03T11:47:59.997 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.996+0000 7fc1ce732800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.20 info.flags=0x17 2023-12-03T11:47:59.997 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.996+0000 7fc1ce732800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.20 to cache LRU end 2023-12-03T11:47:59.997 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.996+0000 7fc1ce732800 10 updating xattr: name=user.rgw.acl bl.length()=265 2023-12-03T11:47:59.998 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.996+0000 7fc1ce732800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.20, ofs0, ns] 2023-12-03T11:47:59.998 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.996+0000 7fc1abfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660569 cookie 94309956936832 notifier 6131 bl.length()=959 2023-12-03T11:47:59.998 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.996+0000 7fc1abfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.20 info.flags=0x17 2023-12-03T11:47:59.998 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.996+0000 7fc1abfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.20 to cache LRU end 2023-12-03T11:47:59.998 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.996+0000 7fc1abfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2023-12-03T11:47:59.999 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.998+0000 7fc1ce732800 20 handle_bi_update(): bucket=:error-at-set-target-layout[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.20]): orig_sources= new_sources= 2023-12-03T11:47:59.999 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.998+0000 7fc1ce732800 20 handle_bi_update(): bucket=:error-at-set-target-layout[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.20]): potential sources added=[] removed=[] 2023-12-03T11:47:59.999 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.998+0000 7fc1ce732800 20 handle_bi_update(): bucket=:error-at-set-target-layout[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.20]): orig_dests= new_dests= 2023-12-03T11:47:59.999 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:47:59.998+0000 7fc1ce732800 20 handle_bi_update(): bucket=:error-at-set-target-layout[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.20]): potential dests added=[] removed=[] 2023-12-03T11:48:00.002 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:00.001+0000 7fc1ce732800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.20.1.0 2023-12-03T11:48:00.002 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:00.001+0000 7fc1ce732800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.20.1.0 2023-12-03T11:48:00.002 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:00.001+0000 7fc1ce732800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.20.1.1 2023-12-03T11:48:00.002 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:00.001+0000 7fc1ce732800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.20.1.1 2023-12-03T11:48:00.003 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:00.001+0000 7fc1ce732800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.20.1.2 2023-12-03T11:48:00.003 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:00.001+0000 7fc1ce732800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.20.1.2 2023-12-03T11:48:00.003 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:00.001+0000 7fc1ce732800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.20.1.3 2023-12-03T11:48:00.003 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:00.001+0000 7fc1ce732800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.20.1.3 2023-12-03T11:48:00.003 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:00.001+0000 7fc1ce732800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.20.1.4 2023-12-03T11:48:00.003 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:00.001+0000 7fc1ce732800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.20.1.4 2023-12-03T11:48:00.003 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:00.001+0000 7fc1ce732800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.20.1.5 2023-12-03T11:48:00.003 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:00.001+0000 7fc1ce732800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.20.1.5 2023-12-03T11:48:00.003 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:00.001+0000 7fc1ce732800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.20.1.6 2023-12-03T11:48:00.003 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:00.001+0000 7fc1ce732800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.20.1.6 2023-12-03T11:48:00.003 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:00.001+0000 7fc1ce732800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.20.1.7 2023-12-03T11:48:00.003 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:00.001+0000 7fc1ce732800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.20.1.7 2023-12-03T11:48:00.003 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:00.001+0000 7fc1ce732800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.20.1.8 2023-12-03T11:48:00.003 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:00.001+0000 7fc1ce732800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.20.1.8 2023-12-03T11:48:00.003 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:00.001+0000 7fc1ce732800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.20.1.9 2023-12-03T11:48:00.003 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:00.001+0000 7fc1ce732800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.20.1.9 2023-12-03T11:48:00.004 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:00.001+0000 7fc1ce732800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.20.1.10 2023-12-03T11:48:00.004 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:00.001+0000 7fc1ce732800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.20.1.10 2023-12-03T11:48:00.004 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:00.001+0000 7fc1ce732800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.20.1.11 2023-12-03T11:48:00.004 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:00.001+0000 7fc1ce732800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.20.1.11 2023-12-03T11:48:00.004 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:00.001+0000 7fc1ce732800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.20.0 2023-12-03T11:48:00.005 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:00.001+0000 7fc1ce732800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.20.1 2023-12-03T11:48:00.005 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:00.002+0000 7fc1ce732800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.20.2 2023-12-03T11:48:00.005 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:00.002+0000 7fc1ce732800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.20.3 2023-12-03T11:48:00.005 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:00.003+0000 7fc1ce732800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.20.4 2023-12-03T11:48:00.005 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:00.003+0000 7fc1ce732800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.20.5 2023-12-03T11:48:00.005 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:00.004+0000 7fc1ce732800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.20.6 2023-12-03T11:48:00.005 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:00.004+0000 7fc1ce732800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.20.7 2023-12-03T11:48:00.006 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:00.005+0000 7fc1ce732800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.20.8 2023-12-03T11:48:00.007 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:00.006+0000 7fc1ce732800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.20.9 2023-12-03T11:48:00.007 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:00.006+0000 7fc1ce732800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.20.10 2023-12-03T11:48:00.010 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:00.009+0000 7fc1ce732800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.20 : hit (requested=0x17, cached=0x17) 2023-12-03T11:48:00.010 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:00.009+0000 7fc1ce732800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.20 2023-12-03T11:48:00.011 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:00.010+0000 7fc1ce732800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.20 info.flags=0x17 2023-12-03T11:48:00.012 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:00.010+0000 7fc1ce732800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.20 to cache LRU end 2023-12-03T11:48:00.012 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:00.010+0000 7fc1ce732800 10 updating xattr: name=user.rgw.acl bl.length()=265 2023-12-03T11:48:00.012 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:00.010+0000 7fc1ce732800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.20, ofs0, ns] 2023-12-03T11:48:00.012 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:00.010+0000 7fc1b8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660570 cookie 94309956936832 notifier 6131 bl.length()=927 2023-12-03T11:48:00.012 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:00.010+0000 7fc1b8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.20 info.flags=0x17 2023-12-03T11:48:00.012 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:00.010+0000 7fc1b8ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.20 to cache LRU end 2023-12-03T11:48:00.012 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:00.010+0000 7fc1b8ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2023-12-03T11:48:00.013 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:00.012+0000 7fc1ce732800 20 handle_bi_update(): bucket=:error-at-set-target-layout[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.20]): orig_sources= new_sources= 2023-12-03T11:48:00.013 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:00.012+0000 7fc1ce732800 20 handle_bi_update(): bucket=:error-at-set-target-layout[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.20]): potential sources added=[] removed=[] 2023-12-03T11:48:00.013 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:00.012+0000 7fc1ce732800 20 handle_bi_update(): bucket=:error-at-set-target-layout[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.20]): orig_dests= new_dests= 2023-12-03T11:48:00.013 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:00.012+0000 7fc1ce732800 20 handle_bi_update(): bucket=:error-at-set-target-layout[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.20]): potential dests added=[] removed=[] 2023-12-03T11:48:00.017 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:00.016+0000 7fc1ce732800 1 execute INFO: reshard of bucket "error-at-set-target-layout" completed successfully 2023-12-03T11:48:00.022 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:00.018+0000 7fc18ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:48:00.022 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:00.020+0000 7fc1ce732800 20 remove_watcher() i=0 2023-12-03T11:48:00.022 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:00.020+0000 7fc1ce732800 2 removed watcher, disabling cache 2023-12-03T11:48:00.022 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:00.021+0000 7fc1ce732800 20 remove_watcher() i=1 2023-12-03T11:48:00.024 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:00.022+0000 7fc1ce732800 20 remove_watcher() i=2 2023-12-03T11:48:00.024 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:00.023+0000 7fc1ce732800 20 remove_watcher() i=3 2023-12-03T11:48:00.025 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:00.024+0000 7fc1ce732800 20 remove_watcher() i=4 2023-12-03T11:48:00.027 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:00.025+0000 7fc1ce732800 20 remove_watcher() i=5 2023-12-03T11:48:00.028 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:00.027+0000 7fc1ce732800 20 remove_watcher() i=6 2023-12-03T11:48:00.029 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:00.028+0000 7fc1ce732800 20 remove_watcher() i=7 2023-12-03T11:48:00.036 INFO:tasks.workunit.client.0.smithi003.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2023-12-03T11:48:00.064 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:48:00.064 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:48:00.079 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:00.078+0000 7f2b2b127800 20 rados->read ofs=0 len=0 2023-12-03T11:48:00.080 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:00.079+0000 7f2b2b127800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:00.081 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:00.079+0000 7f2b2b127800 20 realm 2023-12-03T11:48:00.081 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:00.079+0000 7f2b2b127800 20 rados->read ofs=0 len=0 2023-12-03T11:48:00.081 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:00.079+0000 7f2b2b127800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:00.081 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:00.079+0000 7f2b2b127800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:48:00.081 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:00.079+0000 7f2b2b127800 20 rados->read ofs=0 len=0 2023-12-03T11:48:00.081 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:00.079+0000 7f2b2b127800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:00.081 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:00.079+0000 7f2b2b127800 20 rados->read ofs=0 len=0 2023-12-03T11:48:00.081 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:00.080+0000 7f2b2b127800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:48:00.082 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:00.080+0000 7f2b2b127800 20 rados->read ofs=0 len=0 2023-12-03T11:48:00.082 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:00.081+0000 7f2b2b127800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:48:00.082 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:00.081+0000 7f2b2b127800 20 searching for the correct realm 2023-12-03T11:48:00.092 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:00.090+0000 7f2b265f3640 0 -- 172.21.15.3:0/2714322963 >> [v2:172.21.15.3:6817/3356208405,v1:172.21.15.3:6819/3356208405] conn(0x5604d79a0550 msgr2=0x5604d79a2940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:48:00.094 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:00.092+0000 7f2b2b127800 20 RGWRados::pool_iterate: got zone_info.83aabb46-04b5-4c96-9933-c6bfb1173a73 2023-12-03T11:48:00.094 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:00.092+0000 7f2b2b127800 20 RGWRados::pool_iterate: got zonegroup_info.6a811aad-435d-4fdd-93c9-b7e0b50de429 2023-12-03T11:48:00.094 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:00.092+0000 7f2b2b127800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:48:00.094 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:00.092+0000 7f2b2b127800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:48:00.094 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:00.092+0000 7f2b2b127800 20 rados->read ofs=0 len=0 2023-12-03T11:48:00.094 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:00.092+0000 7f2b2b127800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:00.095 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:00.092+0000 7f2b2b127800 20 rados->read ofs=0 len=0 2023-12-03T11:48:00.095 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:00.093+0000 7f2b2b127800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:48:00.095 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:00.093+0000 7f2b2b127800 20 rados->read ofs=0 len=0 2023-12-03T11:48:00.097 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:00.093+0000 7f2b2b127800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:48:00.097 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:00.093+0000 7f2b2b127800 20 zone default found 2023-12-03T11:48:00.097 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:00.093+0000 7f2b2b127800 4 Realm: () 2023-12-03T11:48:00.097 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:00.093+0000 7f2b2b127800 4 ZoneGroup: default (6a811aad-435d-4fdd-93c9-b7e0b50de429) 2023-12-03T11:48:00.098 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:00.093+0000 7f2b2b127800 4 Zone: default (83aabb46-04b5-4c96-9933-c6bfb1173a73) 2023-12-03T11:48:00.098 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:00.093+0000 7f2b2b127800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:48:00.098 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:00.093+0000 7f2b2b127800 20 zonegroup default 2023-12-03T11:48:00.098 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:00.093+0000 7f2b2b127800 20 rados->read ofs=0 len=0 2023-12-03T11:48:00.098 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:00.093+0000 7f2b2b127800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:00.098 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:00.093+0000 7f2b2b127800 20 rados->read ofs=0 len=0 2023-12-03T11:48:00.098 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:00.093+0000 7f2b2b127800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:00.098 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:00.093+0000 7f2b2b127800 20 rados->read ofs=0 len=0 2023-12-03T11:48:00.098 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:00.094+0000 7f2b2b127800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:00.098 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:00.094+0000 7f2b2b127800 20 started sync module instance, tier type = 2023-12-03T11:48:00.098 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:00.094+0000 7f2b2b127800 20 started zone id=83aabb46-04b5-4c96-9933-c6bfb1173a73 (name=default) with tier type = 2023-12-03T11:48:00.101 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:00.100+0000 7f2b26df4640 0 -- 172.21.15.3:0/2714322963 >> [v2:172.21.15.3:6800/2373485412,v1:172.21.15.3:6801/2373485412] conn(0x7f2b2001d060 msgr2=0x7f2b20055a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:48:00.105 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:00.104+0000 7f2b2b127800 20 add_watcher() i=0 2023-12-03T11:48:00.106 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:00.104+0000 7f2b2b127800 20 add_watcher() i=1 2023-12-03T11:48:00.106 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:00.104+0000 7f2b2b127800 20 add_watcher() i=2 2023-12-03T11:48:00.106 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:00.104+0000 7f2b2b127800 20 add_watcher() i=3 2023-12-03T11:48:00.106 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:00.104+0000 7f2b2b127800 20 add_watcher() i=4 2023-12-03T11:48:00.106 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:00.104+0000 7f2b2b127800 20 add_watcher() i=5 2023-12-03T11:48:00.106 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:00.104+0000 7f2b2b127800 20 add_watcher() i=6 2023-12-03T11:48:00.107 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:00.106+0000 7f2b2b127800 20 add_watcher() i=7 2023-12-03T11:48:00.107 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:00.106+0000 7f2b2b127800 2 all 8 watchers are set, enabling cache 2023-12-03T11:48:00.108 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:00.107+0000 7f2a67fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:48:00.109 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:00.108+0000 7f2b2b127800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:48:00.109 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:00.108+0000 7f2b2b127800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:48:00.115 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:00.114+0000 7f2b2b127800 5 note: GC not initialized 2023-12-03T11:48:00.116 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:00.114+0000 7f2a56ffd640 20 reqs_thread_entry: start 2023-12-03T11:48:00.116 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:00.114+0000 7f2b2b127800 20 init_complete bucket index max shards: 11 2023-12-03T11:48:00.116 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:00.114+0000 7f2b2b127800 20 Filter name: none 2023-12-03T11:48:00.116 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:00.114+0000 7f2a54ff9640 20 reqs_thread_entry: start 2023-12-03T11:48:00.116 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:00.114+0000 7f2b2b127800 20 rados->read ofs=0 len=0 2023-12-03T11:48:00.117 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:00.114+0000 7f2b2b127800 20 rados_obj.operate() r=0 bl.length=218 2023-12-03T11:48:00.117 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:00.115+0000 7f2b2b127800 20 rados->read ofs=0 len=0 2023-12-03T11:48:00.117 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:00.115+0000 7f2b2b127800 20 rados_obj.operate() r=0 bl.length=390 2023-12-03T11:48:00.117 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:00.115+0000 7f2b2b127800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:48:00.117 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:00.115+0000 7f2b2b127800 20 rados->read ofs=0 len=0 2023-12-03T11:48:00.118 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:00.115+0000 7f2b2b127800 20 rados_obj.operate() r=0 bl.length=218 2023-12-03T11:48:00.118 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:00.115+0000 7f2b2b127800 20 rados->read ofs=0 len=0 2023-12-03T11:48:00.118 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:00.116+0000 7f2b2b127800 20 rados_obj.operate() r=0 bl.length=390 2023-12-03T11:48:00.118 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:00.116+0000 7f2b2b127800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:48:00.118 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:00.117+0000 7f2b2b127800 20 rados->read ofs=0 len=0 2023-12-03T11:48:00.118 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:00.117+0000 7f2b2b127800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:00.119 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:00.118+0000 7f2a67fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:48:00.121 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:00.120+0000 7f2b2b127800 20 remove_watcher() i=0 2023-12-03T11:48:00.121 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:00.120+0000 7f2b2b127800 2 removed watcher, disabling cache 2023-12-03T11:48:00.123 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:00.122+0000 7f2b2b127800 20 remove_watcher() i=1 2023-12-03T11:48:00.124 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:00.123+0000 7f2b2b127800 20 remove_watcher() i=2 2023-12-03T11:48:00.125 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:00.124+0000 7f2b2b127800 20 remove_watcher() i=3 2023-12-03T11:48:00.126 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:00.125+0000 7f2b2b127800 20 remove_watcher() i=4 2023-12-03T11:48:00.127 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:00.126+0000 7f2b2b127800 20 remove_watcher() i=5 2023-12-03T11:48:00.128 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:00.127+0000 7f2b2b127800 20 remove_watcher() i=6 2023-12-03T11:48:00.129 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:00.128+0000 7f2b2b127800 20 remove_watcher() i=7 2023-12-03T11:48:00.134 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:48:00.134 INFO:tasks.workunit.client.0.smithi003.stderr:BUCKET_STATS: 2023-12-03T11:48:00.134 INFO:tasks.workunit.client.0.smithi003.stderr:bucket: error-at-set-target-layout id: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.20 num_objects: 20 size_kb: 1 num_shards: 12 2023-12-03T11:48:00.134 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:48:00.455 INFO:tasks.workunit.client.0.smithi003.stderr:TEST: reshard bucket with abort at set_target_layout 2023-12-03T11:48:00.456 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:48:01.161 INFO:tasks.workunit.client.0.smithi003.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2023-12-03T11:48:01.188 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:48:01.188 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:48:01.202 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.201+0000 7fb8ac1dc800 20 rados->read ofs=0 len=0 2023-12-03T11:48:01.204 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.202+0000 7fb8ac1dc800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:01.204 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.202+0000 7fb8ac1dc800 20 realm 2023-12-03T11:48:01.204 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.202+0000 7fb8ac1dc800 20 rados->read ofs=0 len=0 2023-12-03T11:48:01.204 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.203+0000 7fb8ac1dc800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:01.204 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.203+0000 7fb8ac1dc800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:48:01.204 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.203+0000 7fb8ac1dc800 20 rados->read ofs=0 len=0 2023-12-03T11:48:01.204 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.203+0000 7fb8ac1dc800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:01.204 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.203+0000 7fb8ac1dc800 20 rados->read ofs=0 len=0 2023-12-03T11:48:01.205 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.204+0000 7fb8ac1dc800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:48:01.205 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.204+0000 7fb8ac1dc800 20 rados->read ofs=0 len=0 2023-12-03T11:48:01.205 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.204+0000 7fb8ac1dc800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:48:01.205 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.204+0000 7fb8ac1dc800 20 searching for the correct realm 2023-12-03T11:48:01.215 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.214+0000 7fb8a94e2640 0 -- 172.21.15.3:0/3865808522 >> [v2:172.21.15.3:6817/3356208405,v1:172.21.15.3:6819/3356208405] conn(0x7fb884079e10 msgr2=0x7fb88407c240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:48:01.217 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.216+0000 7fb8ac1dc800 20 RGWRados::pool_iterate: got zone_info.83aabb46-04b5-4c96-9933-c6bfb1173a73 2023-12-03T11:48:01.217 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.216+0000 7fb8ac1dc800 20 RGWRados::pool_iterate: got zonegroup_info.6a811aad-435d-4fdd-93c9-b7e0b50de429 2023-12-03T11:48:01.217 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.216+0000 7fb8ac1dc800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:48:01.217 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.216+0000 7fb8ac1dc800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:48:01.218 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.216+0000 7fb8ac1dc800 20 rados->read ofs=0 len=0 2023-12-03T11:48:01.218 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.216+0000 7fb8ac1dc800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:01.218 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.216+0000 7fb8ac1dc800 20 rados->read ofs=0 len=0 2023-12-03T11:48:01.219 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.216+0000 7fb8ac1dc800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:48:01.219 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.216+0000 7fb8ac1dc800 20 rados->read ofs=0 len=0 2023-12-03T11:48:01.219 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.217+0000 7fb8ac1dc800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:48:01.219 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.217+0000 7fb8ac1dc800 20 zone default found 2023-12-03T11:48:01.219 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.217+0000 7fb8ac1dc800 4 Realm: () 2023-12-03T11:48:01.219 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.217+0000 7fb8ac1dc800 4 ZoneGroup: default (6a811aad-435d-4fdd-93c9-b7e0b50de429) 2023-12-03T11:48:01.219 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.217+0000 7fb8ac1dc800 4 Zone: default (83aabb46-04b5-4c96-9933-c6bfb1173a73) 2023-12-03T11:48:01.219 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.217+0000 7fb8ac1dc800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:48:01.219 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.217+0000 7fb8ac1dc800 20 zonegroup default 2023-12-03T11:48:01.219 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.217+0000 7fb8ac1dc800 20 rados->read ofs=0 len=0 2023-12-03T11:48:01.219 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.217+0000 7fb8ac1dc800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:01.220 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.217+0000 7fb8ac1dc800 20 rados->read ofs=0 len=0 2023-12-03T11:48:01.220 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.217+0000 7fb8ac1dc800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:01.220 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.217+0000 7fb8ac1dc800 20 rados->read ofs=0 len=0 2023-12-03T11:48:01.220 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.218+0000 7fb8ac1dc800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:01.220 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.218+0000 7fb8ac1dc800 20 started sync module instance, tier type = 2023-12-03T11:48:01.220 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.218+0000 7fb8ac1dc800 20 started zone id=83aabb46-04b5-4c96-9933-c6bfb1173a73 (name=default) with tier type = 2023-12-03T11:48:01.223 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.222+0000 7fb8aa4e4640 0 -- 172.21.15.3:0/3865808522 >> [v2:172.21.15.37:6817/511039327,v1:172.21.15.37:6819/511039327] conn(0x7fb8a0078060 msgr2=0x7fb8a0098750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:48:01.228 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.227+0000 7fb8ac1dc800 20 add_watcher() i=0 2023-12-03T11:48:01.228 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.227+0000 7fb8ac1dc800 20 add_watcher() i=1 2023-12-03T11:48:01.228 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.227+0000 7fb8ac1dc800 20 add_watcher() i=2 2023-12-03T11:48:01.228 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.227+0000 7fb8ac1dc800 20 add_watcher() i=3 2023-12-03T11:48:01.228 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.227+0000 7fb8ac1dc800 20 add_watcher() i=4 2023-12-03T11:48:01.229 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.227+0000 7fb8ac1dc800 20 add_watcher() i=5 2023-12-03T11:48:01.229 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.227+0000 7fb8ac1dc800 20 add_watcher() i=6 2023-12-03T11:48:01.229 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.228+0000 7fb8ac1dc800 20 add_watcher() i=7 2023-12-03T11:48:01.229 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.228+0000 7fb8ac1dc800 2 all 8 watchers are set, enabling cache 2023-12-03T11:48:01.231 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.230+0000 7fb86f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:48:01.231 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.230+0000 7fb8ac1dc800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:48:01.231 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.230+0000 7fb8ac1dc800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:48:01.238 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.236+0000 7fb8ac1dc800 5 note: GC not initialized 2023-12-03T11:48:01.238 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.236+0000 7fb7de7fc640 20 reqs_thread_entry: start 2023-12-03T11:48:01.238 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.236+0000 7fb8ac1dc800 20 init_complete bucket index max shards: 11 2023-12-03T11:48:01.238 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.237+0000 7fb8ac1dc800 20 Filter name: none 2023-12-03T11:48:01.238 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.237+0000 7fb7cffff640 20 reqs_thread_entry: start 2023-12-03T11:48:01.238 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.237+0000 7fb8ac1dc800 20 rados->read ofs=0 len=0 2023-12-03T11:48:01.239 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.238+0000 7fb8ac1dc800 20 rados_obj.operate() r=0 bl.length=218 2023-12-03T11:48:01.239 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.238+0000 7fb8ac1dc800 20 rados->read ofs=0 len=0 2023-12-03T11:48:01.240 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.238+0000 7fb8ac1dc800 20 rados_obj.operate() r=0 bl.length=390 2023-12-03T11:48:01.240 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.238+0000 7fb8ac1dc800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:48:01.240 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.238+0000 7fb8ac1dc800 20 rados->read ofs=0 len=0 2023-12-03T11:48:01.240 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.239+0000 7fb8ac1dc800 20 rados_obj.operate() r=0 bl.length=218 2023-12-03T11:48:01.240 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.239+0000 7fb8ac1dc800 20 rados->read ofs=0 len=0 2023-12-03T11:48:01.240 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.239+0000 7fb8ac1dc800 20 rados_obj.operate() r=0 bl.length=390 2023-12-03T11:48:01.240 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.239+0000 7fb8ac1dc800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:48:01.241 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.240+0000 7fb8ac1dc800 20 rados->read ofs=0 len=0 2023-12-03T11:48:01.241 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.240+0000 7fb8ac1dc800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:01.242 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.241+0000 7fb86f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:48:01.245 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.244+0000 7fb8ac1dc800 20 remove_watcher() i=0 2023-12-03T11:48:01.245 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.244+0000 7fb8ac1dc800 2 removed watcher, disabling cache 2023-12-03T11:48:01.246 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.245+0000 7fb8ac1dc800 20 remove_watcher() i=1 2023-12-03T11:48:01.247 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.246+0000 7fb8ac1dc800 20 remove_watcher() i=2 2023-12-03T11:48:01.248 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.247+0000 7fb8ac1dc800 20 remove_watcher() i=3 2023-12-03T11:48:01.249 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.248+0000 7fb8ac1dc800 20 remove_watcher() i=4 2023-12-03T11:48:01.251 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.249+0000 7fb8ac1dc800 20 remove_watcher() i=5 2023-12-03T11:48:01.251 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.250+0000 7fb8ac1dc800 20 remove_watcher() i=6 2023-12-03T11:48:01.252 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.251+0000 7fb8ac1dc800 20 remove_watcher() i=7 2023-12-03T11:48:01.257 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:48:01.257 INFO:tasks.workunit.client.0.smithi003.stderr:BUCKET_STATS: 2023-12-03T11:48:01.257 INFO:tasks.workunit.client.0.smithi003.stderr:bucket: abort-at-set-target-layout id: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.21 num_objects: 20 size_kb: 1 num_shards: 11 2023-12-03T11:48:01.258 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:48:01.259 INFO:tasks.workunit.client.0.smithi003.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at set_target_layout 2023-12-03T11:48:01.292 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:48:01.292 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:48:01.306 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.305+0000 7f992c532800 20 rados->read ofs=0 len=0 2023-12-03T11:48:01.308 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.307+0000 7f992c532800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:01.308 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.307+0000 7f992c532800 20 realm 2023-12-03T11:48:01.308 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.307+0000 7f992c532800 20 rados->read ofs=0 len=0 2023-12-03T11:48:01.309 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.307+0000 7f992c532800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:01.309 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.307+0000 7f992c532800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:48:01.309 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.307+0000 7f992c532800 20 rados->read ofs=0 len=0 2023-12-03T11:48:01.309 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.307+0000 7f992c532800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:01.309 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.307+0000 7f992c532800 20 rados->read ofs=0 len=0 2023-12-03T11:48:01.309 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.308+0000 7f992c532800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:48:01.309 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.308+0000 7f992c532800 20 rados->read ofs=0 len=0 2023-12-03T11:48:01.310 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.308+0000 7f992c532800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:48:01.310 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.308+0000 7f992c532800 20 searching for the correct realm 2023-12-03T11:48:01.319 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.318+0000 7f992815b640 0 -- 172.21.15.3:0/3689260636 >> [v2:172.21.15.3:6808/263125788,v1:172.21.15.3:6809/263125788] conn(0x7f991c077250 msgr2=0x7f991c077790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:48:01.321 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.320+0000 7f992c532800 20 RGWRados::pool_iterate: got zone_info.83aabb46-04b5-4c96-9933-c6bfb1173a73 2023-12-03T11:48:01.321 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.320+0000 7f992c532800 20 RGWRados::pool_iterate: got zonegroup_info.6a811aad-435d-4fdd-93c9-b7e0b50de429 2023-12-03T11:48:01.321 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.320+0000 7f992c532800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:48:01.321 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.320+0000 7f992c532800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:48:01.321 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.320+0000 7f992c532800 20 rados->read ofs=0 len=0 2023-12-03T11:48:01.321 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.320+0000 7f992c532800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:01.321 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.320+0000 7f992c532800 20 rados->read ofs=0 len=0 2023-12-03T11:48:01.323 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.320+0000 7f992c532800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:48:01.323 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.320+0000 7f992c532800 20 rados->read ofs=0 len=0 2023-12-03T11:48:01.323 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.320+0000 7f992c532800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:48:01.323 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.320+0000 7f992c532800 20 zone default found 2023-12-03T11:48:01.323 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.320+0000 7f992c532800 4 Realm: () 2023-12-03T11:48:01.323 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.320+0000 7f992c532800 4 ZoneGroup: default (6a811aad-435d-4fdd-93c9-b7e0b50de429) 2023-12-03T11:48:01.323 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.320+0000 7f992c532800 4 Zone: default (83aabb46-04b5-4c96-9933-c6bfb1173a73) 2023-12-03T11:48:01.323 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.320+0000 7f992c532800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:48:01.323 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.320+0000 7f992c532800 20 zonegroup default 2023-12-03T11:48:01.323 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.320+0000 7f992c532800 20 rados->read ofs=0 len=0 2023-12-03T11:48:01.324 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.321+0000 7f992c532800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:01.324 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.321+0000 7f992c532800 20 rados->read ofs=0 len=0 2023-12-03T11:48:01.324 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.321+0000 7f992c532800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:01.324 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.321+0000 7f992c532800 20 rados->read ofs=0 len=0 2023-12-03T11:48:01.324 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.321+0000 7f992c532800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:01.324 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.321+0000 7f992c532800 20 started sync module instance, tier type = 2023-12-03T11:48:01.324 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.321+0000 7f992c532800 20 started zone id=83aabb46-04b5-4c96-9933-c6bfb1173a73 (name=default) with tier type = 2023-12-03T11:48:01.327 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.326+0000 7f992895c640 0 -- 172.21.15.3:0/3689260636 >> [v2:172.21.15.37:6817/511039327,v1:172.21.15.37:6819/511039327] conn(0x7f9904079e10 msgr2=0x7f990407c240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:48:01.332 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.330+0000 7f992c532800 20 add_watcher() i=0 2023-12-03T11:48:01.332 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.330+0000 7f992c532800 20 add_watcher() i=1 2023-12-03T11:48:01.332 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.330+0000 7f992c532800 20 add_watcher() i=2 2023-12-03T11:48:01.332 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.330+0000 7f992c532800 20 add_watcher() i=3 2023-12-03T11:48:01.332 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.330+0000 7f992c532800 20 add_watcher() i=4 2023-12-03T11:48:01.332 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.330+0000 7f992c532800 20 add_watcher() i=5 2023-12-03T11:48:01.332 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.330+0000 7f992c532800 20 add_watcher() i=6 2023-12-03T11:48:01.333 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.331+0000 7f992c532800 20 add_watcher() i=7 2023-12-03T11:48:01.333 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.331+0000 7f992c532800 2 all 8 watchers are set, enabling cache 2023-12-03T11:48:01.334 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.333+0000 7f98ee7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:48:01.334 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.333+0000 7f992c532800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:48:01.334 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.333+0000 7f992c532800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:48:01.342 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.339+0000 7f992c532800 5 note: GC not initialized 2023-12-03T11:48:01.343 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.339+0000 7f985d7fa640 20 reqs_thread_entry: start 2023-12-03T11:48:01.343 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.339+0000 7f992c532800 20 init_complete bucket index max shards: 11 2023-12-03T11:48:01.343 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.339+0000 7f992c532800 20 Filter name: none 2023-12-03T11:48:01.343 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.340+0000 7f9856ffd640 20 reqs_thread_entry: start 2023-12-03T11:48:01.343 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.340+0000 7f992c532800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2023-12-03T11:48:01.343 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.340+0000 7f992c532800 20 rados->read ofs=0 len=0 2023-12-03T11:48:01.344 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.340+0000 7f992c532800 20 rados_obj.operate() r=0 bl.length=218 2023-12-03T11:48:01.344 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.340+0000 7f992c532800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2023-12-03T11:48:01.344 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.340+0000 7f992c532800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2023-12-03T11:48:01.344 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.340+0000 7f992c532800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.21 : miss 2023-12-03T11:48:01.344 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.340+0000 7f992c532800 20 rados->read ofs=0 len=0 2023-12-03T11:48:01.344 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.341+0000 7f992c532800 20 rados_obj.operate() r=0 bl.length=390 2023-12-03T11:48:01.344 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.341+0000 7f992c532800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.21 info.flags=0x17 2023-12-03T11:48:01.344 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.341+0000 7f992c532800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.21 to cache LRU end 2023-12-03T11:48:01.344 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.341+0000 7f992c532800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:48:01.344 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.341+0000 7f992c532800 10 updating xattr: name=user.rgw.acl bl.length()=265 2023-12-03T11:48:01.344 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.341+0000 7f992c532800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.21 2023-12-03T11:48:01.346 INFO:tasks.workunit.client.0.smithi003.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7537-gbcbf278c/rpm/el9/BUILD/ceph-18.0.0-7537-gbcbf278c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f992c532800 time 2023-12-03T11:48:01.346191+0000 2023-12-03T11:48:01.346 INFO:tasks.workunit.client.0.smithi003.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7537-gbcbf278c/rpm/el9/BUILD/ceph-18.0.0-7537-gbcbf278c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2023-12-03T11:48:01.347 INFO:tasks.workunit.client.0.smithi003.stderr: ceph version 18.0.0-7537-gbcbf278c (bcbf278cf395873c2a482f5a7b2345faf2160319) reef (dev) 2023-12-03T11:48:01.347 INFO:tasks.workunit.client.0.smithi003.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f992f16eef8] 2023-12-03T11:48:01.347 INFO:tasks.workunit.client.0.smithi003.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f0b6) [0x7f992f16f0b6] 2023-12-03T11:48:01.347 INFO:tasks.workunit.client.0.smithi003.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55735c97ba71] 2023-12-03T11:48:01.347 INFO:tasks.workunit.client.0.smithi003.stderr: 4: radosgw-admin(+0x79787a) [0x55735c98387a] 2023-12-03T11:48:01.347 INFO:tasks.workunit.client.0.smithi003.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x24b) [0x55735c987e6b] 2023-12-03T11:48:01.347 INFO:tasks.workunit.client.0.smithi003.stderr: 6: main() 2023-12-03T11:48:01.347 INFO:tasks.workunit.client.0.smithi003.stderr: 7: /lib64/libc.so.6(+0x3feb0) [0x7f992c83feb0] 2023-12-03T11:48:01.347 INFO:tasks.workunit.client.0.smithi003.stderr: 8: __libc_start_main() 2023-12-03T11:48:01.347 INFO:tasks.workunit.client.0.smithi003.stderr: 9: _start() 2023-12-03T11:48:01.347 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.345+0000 7f992c532800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7537-gbcbf278c/rpm/el9/BUILD/ceph-18.0.0-7537-gbcbf278c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f992c532800 time 2023-12-03T11:48:01.346191+0000 2023-12-03T11:48:01.347 INFO:tasks.workunit.client.0.smithi003.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7537-gbcbf278c/rpm/el9/BUILD/ceph-18.0.0-7537-gbcbf278c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2023-12-03T11:48:01.348 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:48:01.348 INFO:tasks.workunit.client.0.smithi003.stderr: ceph version 18.0.0-7537-gbcbf278c (bcbf278cf395873c2a482f5a7b2345faf2160319) reef (dev) 2023-12-03T11:48:01.348 INFO:tasks.workunit.client.0.smithi003.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f992f16eef8] 2023-12-03T11:48:01.348 INFO:tasks.workunit.client.0.smithi003.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f0b6) [0x7f992f16f0b6] 2023-12-03T11:48:01.348 INFO:tasks.workunit.client.0.smithi003.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55735c97ba71] 2023-12-03T11:48:01.348 INFO:tasks.workunit.client.0.smithi003.stderr: 4: radosgw-admin(+0x79787a) [0x55735c98387a] 2023-12-03T11:48:01.348 INFO:tasks.workunit.client.0.smithi003.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x24b) [0x55735c987e6b] 2023-12-03T11:48:01.348 INFO:tasks.workunit.client.0.smithi003.stderr: 6: main() 2023-12-03T11:48:01.348 INFO:tasks.workunit.client.0.smithi003.stderr: 7: /lib64/libc.so.6(+0x3feb0) [0x7f992c83feb0] 2023-12-03T11:48:01.348 INFO:tasks.workunit.client.0.smithi003.stderr: 8: __libc_start_main() 2023-12-03T11:48:01.348 INFO:tasks.workunit.client.0.smithi003.stderr: 9: _start() 2023-12-03T11:48:01.348 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:48:01.349 INFO:tasks.workunit.client.0.smithi003.stderr:*** Caught signal (Aborted) ** 2023-12-03T11:48:01.349 INFO:tasks.workunit.client.0.smithi003.stderr: in thread 7f992c532800 thread_name:radosgw-admin 2023-12-03T11:48:01.365 INFO:tasks.workunit.client.0.smithi003.stderr: ceph version 18.0.0-7537-gbcbf278c (bcbf278cf395873c2a482f5a7b2345faf2160319) reef (dev) 2023-12-03T11:48:01.365 INFO:tasks.workunit.client.0.smithi003.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f992c854db0] 2023-12-03T11:48:01.365 INFO:tasks.workunit.client.0.smithi003.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f992c8a154c] 2023-12-03T11:48:01.365 INFO:tasks.workunit.client.0.smithi003.stderr: 3: raise() 2023-12-03T11:48:01.365 INFO:tasks.workunit.client.0.smithi003.stderr: 4: abort() 2023-12-03T11:48:01.365 INFO:tasks.workunit.client.0.smithi003.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f992f16ef52] 2023-12-03T11:48:01.365 INFO:tasks.workunit.client.0.smithi003.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f0b6) [0x7f992f16f0b6] 2023-12-03T11:48:01.366 INFO:tasks.workunit.client.0.smithi003.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55735c97ba71] 2023-12-03T11:48:01.366 INFO:tasks.workunit.client.0.smithi003.stderr: 8: radosgw-admin(+0x79787a) [0x55735c98387a] 2023-12-03T11:48:01.366 INFO:tasks.workunit.client.0.smithi003.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x24b) [0x55735c987e6b] 2023-12-03T11:48:01.366 INFO:tasks.workunit.client.0.smithi003.stderr: 10: main() 2023-12-03T11:48:01.366 INFO:tasks.workunit.client.0.smithi003.stderr: 11: /lib64/libc.so.6(+0x3feb0) [0x7f992c83feb0] 2023-12-03T11:48:01.366 INFO:tasks.workunit.client.0.smithi003.stderr: 12: __libc_start_main() 2023-12-03T11:48:01.366 INFO:tasks.workunit.client.0.smithi003.stderr: 13: _start() 2023-12-03T11:48:01.366 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.346+0000 7f992c532800 -1 *** Caught signal (Aborted) ** 2023-12-03T11:48:01.366 INFO:tasks.workunit.client.0.smithi003.stderr: in thread 7f992c532800 thread_name:radosgw-admin 2023-12-03T11:48:01.366 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:48:01.366 INFO:tasks.workunit.client.0.smithi003.stderr: ceph version 18.0.0-7537-gbcbf278c (bcbf278cf395873c2a482f5a7b2345faf2160319) reef (dev) 2023-12-03T11:48:01.366 INFO:tasks.workunit.client.0.smithi003.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f992c854db0] 2023-12-03T11:48:01.366 INFO:tasks.workunit.client.0.smithi003.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f992c8a154c] 2023-12-03T11:48:01.366 INFO:tasks.workunit.client.0.smithi003.stderr: 3: raise() 2023-12-03T11:48:01.366 INFO:tasks.workunit.client.0.smithi003.stderr: 4: abort() 2023-12-03T11:48:01.367 INFO:tasks.workunit.client.0.smithi003.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f992f16ef52] 2023-12-03T11:48:01.367 INFO:tasks.workunit.client.0.smithi003.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f0b6) [0x7f992f16f0b6] 2023-12-03T11:48:01.367 INFO:tasks.workunit.client.0.smithi003.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55735c97ba71] 2023-12-03T11:48:01.367 INFO:tasks.workunit.client.0.smithi003.stderr: 8: radosgw-admin(+0x79787a) [0x55735c98387a] 2023-12-03T11:48:01.367 INFO:tasks.workunit.client.0.smithi003.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x24b) [0x55735c987e6b] 2023-12-03T11:48:01.367 INFO:tasks.workunit.client.0.smithi003.stderr: 10: main() 2023-12-03T11:48:01.367 INFO:tasks.workunit.client.0.smithi003.stderr: 11: /lib64/libc.so.6(+0x3feb0) [0x7f992c83feb0] 2023-12-03T11:48:01.367 INFO:tasks.workunit.client.0.smithi003.stderr: 12: __libc_start_main() 2023-12-03T11:48:01.367 INFO:tasks.workunit.client.0.smithi003.stderr: 13: _start() 2023-12-03T11:48:01.367 INFO:tasks.workunit.client.0.smithi003.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-12-03T11:48:01.367 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:48:01.367 INFO:tasks.workunit.client.0.smithi003.stderr:--- begin dump of recent events --- 2023-12-03T11:48:01.367 INFO:tasks.workunit.client.0.smithi003.stderr: -499> 2023-12-03T11:48:01.299+0000 7f992815b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:48:01.367 INFO:tasks.workunit.client.0.smithi003.stderr: -498> 2023-12-03T11:48:01.299+0000 7f992815b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:48:01.368 INFO:tasks.workunit.client.0.smithi003.stderr: -497> 2023-12-03T11:48:01.299+0000 7f992795a640 10 monclient(hunting): handle_auth_done global_id 6537 payload 824 2023-12-03T11:48:01.368 INFO:tasks.workunit.client.0.smithi003.stderr: -496> 2023-12-03T11:48:01.299+0000 7f992795a640 10 monclient: _finish_hunting 0 2023-12-03T11:48:01.368 INFO:tasks.workunit.client.0.smithi003.stderr: -495> 2023-12-03T11:48:01.299+0000 7f992795a640 1 monclient: found mon.noname-a 2023-12-03T11:48:01.368 INFO:tasks.workunit.client.0.smithi003.stderr: -494> 2023-12-03T11:48:01.299+0000 7f992795a640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.3:3300/0 2023-12-03T11:48:01.368 INFO:tasks.workunit.client.0.smithi003.stderr: -493> 2023-12-03T11:48:01.299+0000 7f9925956640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:48:01.368 INFO:tasks.workunit.client.0.smithi003.stderr: -492> 2023-12-03T11:48:01.299+0000 7f9925956640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-12-03T11:48:01.368 INFO:tasks.workunit.client.0.smithi003.stderr: -491> 2023-12-03T11:48:01.299+0000 7f9925956640 10 monclient: dump: 2023-12-03T11:48:01.368 INFO:tasks.workunit.client.0.smithi003.stderr:epoch 1 2023-12-03T11:48:01.368 INFO:tasks.workunit.client.0.smithi003.stderr:fsid 296556de-a4fc-4095-9b6d-0fe813c2865c 2023-12-03T11:48:01.368 INFO:tasks.workunit.client.0.smithi003.stderr:last_changed 2023-12-03T11:33:18.862564+0000 2023-12-03T11:48:01.368 INFO:tasks.workunit.client.0.smithi003.stderr:created 2023-12-03T11:33:18.862564+0000 2023-12-03T11:48:01.368 INFO:tasks.workunit.client.0.smithi003.stderr:min_mon_release 18 (reef) 2023-12-03T11:48:01.368 INFO:tasks.workunit.client.0.smithi003.stderr:election_strategy: 1 2023-12-03T11:48:01.368 INFO:tasks.workunit.client.0.smithi003.stderr:0: [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] mon.a 2023-12-03T11:48:01.369 INFO:tasks.workunit.client.0.smithi003.stderr:1: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.b 2023-12-03T11:48:01.369 INFO:tasks.workunit.client.0.smithi003.stderr:2: [v2:172.21.15.3:3301/0,v1:172.21.15.3:6790/0] mon.c 2023-12-03T11:48:01.369 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:48:01.369 INFO:tasks.workunit.client.0.smithi003.stderr: -490> 2023-12-03T11:48:01.299+0000 7f9925956640 10 monclient: _finish_auth 0 2023-12-03T11:48:01.369 INFO:tasks.workunit.client.0.smithi003.stderr: -489> 2023-12-03T11:48:01.299+0000 7f9925956640 10 monclient: _check_auth_tickets 2023-12-03T11:48:01.369 INFO:tasks.workunit.client.0.smithi003.stderr: -488> 2023-12-03T11:48:01.299+0000 7f9925956640 10 monclient: handle_config config(0 keys) v1 2023-12-03T11:48:01.369 INFO:tasks.workunit.client.0.smithi003.stderr: -487> 2023-12-03T11:48:01.299+0000 7f9925956640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:48:01.369 INFO:tasks.workunit.client.0.smithi003.stderr: -486> 2023-12-03T11:48:01.299+0000 7f9925956640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-12-03T11:48:01.369 INFO:tasks.workunit.client.0.smithi003.stderr: -485> 2023-12-03T11:48:01.299+0000 7f9925956640 10 monclient: dump: 2023-12-03T11:48:01.369 INFO:tasks.workunit.client.0.smithi003.stderr:epoch 1 2023-12-03T11:48:01.369 INFO:tasks.workunit.client.0.smithi003.stderr:fsid 296556de-a4fc-4095-9b6d-0fe813c2865c 2023-12-03T11:48:01.369 INFO:tasks.workunit.client.0.smithi003.stderr:last_changed 2023-12-03T11:33:18.862564+0000 2023-12-03T11:48:01.369 INFO:tasks.workunit.client.0.smithi003.stderr:created 2023-12-03T11:33:18.862564+0000 2023-12-03T11:48:01.369 INFO:tasks.workunit.client.0.smithi003.stderr:min_mon_release 18 (reef) 2023-12-03T11:48:01.369 INFO:tasks.workunit.client.0.smithi003.stderr:election_strategy: 1 2023-12-03T11:48:01.369 INFO:tasks.workunit.client.0.smithi003.stderr:0: [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] mon.a 2023-12-03T11:48:01.370 INFO:tasks.workunit.client.0.smithi003.stderr:1: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.b 2023-12-03T11:48:01.370 INFO:tasks.workunit.client.0.smithi003.stderr:2: [v2:172.21.15.3:3301/0,v1:172.21.15.3:6790/0] mon.c 2023-12-03T11:48:01.370 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:48:01.370 INFO:tasks.workunit.client.0.smithi003.stderr: -484> 2023-12-03T11:48:01.299+0000 7f992c532800 5 monclient: authenticate success, global_id 6537 2023-12-03T11:48:01.370 INFO:tasks.workunit.client.0.smithi003.stderr: -483> 2023-12-03T11:48:01.299+0000 7f9926958640 4 set_mon_vals no callback set 2023-12-03T11:48:01.370 INFO:tasks.workunit.client.0.smithi003.stderr: -482> 2023-12-03T11:48:01.299+0000 7f992c532800 10 monclient: _renew_subs 2023-12-03T11:48:01.370 INFO:tasks.workunit.client.0.smithi003.stderr: -481> 2023-12-03T11:48:01.299+0000 7f992c532800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.3:3300/0 2023-12-03T11:48:01.370 INFO:tasks.workunit.client.0.smithi003.stderr: -480> 2023-12-03T11:48:01.299+0000 7f992c532800 10 monclient: _renew_subs 2023-12-03T11:48:01.370 INFO:tasks.workunit.client.0.smithi003.stderr: -479> 2023-12-03T11:48:01.299+0000 7f992c532800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.3:3300/0 2023-12-03T11:48:01.370 INFO:tasks.workunit.client.0.smithi003.stderr: -478> 2023-12-03T11:48:01.299+0000 7f992c532800 1 librados: init done 2023-12-03T11:48:01.370 INFO:tasks.workunit.client.0.smithi003.stderr: -477> 2023-12-03T11:48:01.300+0000 7f992c532800 10 monclient: get_monmap_and_config 2023-12-03T11:48:01.370 INFO:tasks.workunit.client.0.smithi003.stderr: -476> 2023-12-03T11:48:01.300+0000 7f992c532800 10 monclient: build_initial_monmap 2023-12-03T11:48:01.370 INFO:tasks.workunit.client.0.smithi003.stderr: -475> 2023-12-03T11:48:01.300+0000 7f992c532800 1 build_initial for_mkfs: 0 2023-12-03T11:48:01.370 INFO:tasks.workunit.client.0.smithi003.stderr: -474> 2023-12-03T11:48:01.300+0000 7f992c532800 10 monclient: monmap: 2023-12-03T11:48:01.371 INFO:tasks.workunit.client.0.smithi003.stderr:epoch 0 2023-12-03T11:48:01.371 INFO:tasks.workunit.client.0.smithi003.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-12-03T11:48:01.371 INFO:tasks.workunit.client.0.smithi003.stderr:last_changed 0.000000 2023-12-03T11:48:01.371 INFO:tasks.workunit.client.0.smithi003.stderr:created 0.000000 2023-12-03T11:48:01.371 INFO:tasks.workunit.client.0.smithi003.stderr:min_mon_release 0 (unknown) 2023-12-03T11:48:01.371 INFO:tasks.workunit.client.0.smithi003.stderr:election_strategy: 1 2023-12-03T11:48:01.371 INFO:tasks.workunit.client.0.smithi003.stderr:0: [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] mon.noname-a 2023-12-03T11:48:01.371 INFO:tasks.workunit.client.0.smithi003.stderr:1: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.noname-b 2023-12-03T11:48:01.371 INFO:tasks.workunit.client.0.smithi003.stderr:2: [v2:172.21.15.3:3301/0,v1:172.21.15.3:6790/0] mon.noname-c 2023-12-03T11:48:01.371 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:48:01.371 INFO:tasks.workunit.client.0.smithi003.stderr: -473> 2023-12-03T11:48:01.300+0000 7f992c532800 5 AuthRegistry(0x55735da73bc0) adding auth protocol: cephx 2023-12-03T11:48:01.371 INFO:tasks.workunit.client.0.smithi003.stderr: -472> 2023-12-03T11:48:01.300+0000 7f992c532800 5 AuthRegistry(0x55735da73bc0) adding auth protocol: cephx 2023-12-03T11:48:01.371 INFO:tasks.workunit.client.0.smithi003.stderr: -471> 2023-12-03T11:48:01.300+0000 7f992c532800 5 AuthRegistry(0x55735da73bc0) adding auth protocol: cephx 2023-12-03T11:48:01.371 INFO:tasks.workunit.client.0.smithi003.stderr: -470> 2023-12-03T11:48:01.300+0000 7f992c532800 5 AuthRegistry(0x55735da73bc0) adding con mode: secure 2023-12-03T11:48:01.371 INFO:tasks.workunit.client.0.smithi003.stderr: -469> 2023-12-03T11:48:01.300+0000 7f992c532800 5 AuthRegistry(0x55735da73bc0) adding con mode: crc 2023-12-03T11:48:01.371 INFO:tasks.workunit.client.0.smithi003.stderr: -468> 2023-12-03T11:48:01.300+0000 7f992c532800 5 AuthRegistry(0x55735da73bc0) adding con mode: secure 2023-12-03T11:48:01.372 INFO:tasks.workunit.client.0.smithi003.stderr: -467> 2023-12-03T11:48:01.300+0000 7f992c532800 5 AuthRegistry(0x55735da73bc0) adding con mode: crc 2023-12-03T11:48:01.372 INFO:tasks.workunit.client.0.smithi003.stderr: -466> 2023-12-03T11:48:01.300+0000 7f992c532800 5 AuthRegistry(0x55735da73bc0) adding con mode: secure 2023-12-03T11:48:01.372 INFO:tasks.workunit.client.0.smithi003.stderr: -465> 2023-12-03T11:48:01.300+0000 7f992c532800 5 AuthRegistry(0x55735da73bc0) adding con mode: crc 2023-12-03T11:48:01.372 INFO:tasks.workunit.client.0.smithi003.stderr: -464> 2023-12-03T11:48:01.300+0000 7f992c532800 5 AuthRegistry(0x55735da73bc0) adding con mode: crc 2023-12-03T11:48:01.372 INFO:tasks.workunit.client.0.smithi003.stderr: -463> 2023-12-03T11:48:01.300+0000 7f992c532800 5 AuthRegistry(0x55735da73bc0) adding con mode: secure 2023-12-03T11:48:01.372 INFO:tasks.workunit.client.0.smithi003.stderr: -462> 2023-12-03T11:48:01.300+0000 7f992c532800 5 AuthRegistry(0x55735da73bc0) adding con mode: crc 2023-12-03T11:48:01.372 INFO:tasks.workunit.client.0.smithi003.stderr: -461> 2023-12-03T11:48:01.300+0000 7f992c532800 5 AuthRegistry(0x55735da73bc0) adding con mode: secure 2023-12-03T11:48:01.372 INFO:tasks.workunit.client.0.smithi003.stderr: -460> 2023-12-03T11:48:01.300+0000 7f992c532800 5 AuthRegistry(0x55735da73bc0) adding con mode: crc 2023-12-03T11:48:01.372 INFO:tasks.workunit.client.0.smithi003.stderr: -459> 2023-12-03T11:48:01.300+0000 7f992c532800 5 AuthRegistry(0x55735da73bc0) adding con mode: secure 2023-12-03T11:48:01.372 INFO:tasks.workunit.client.0.smithi003.stderr: -458> 2023-12-03T11:48:01.300+0000 7f992c532800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:48:01.372 INFO:tasks.workunit.client.0.smithi003.stderr: -457> 2023-12-03T11:48:01.300+0000 7f992c532800 10 monclient: init 2023-12-03T11:48:01.373 INFO:tasks.workunit.client.0.smithi003.stderr: -456> 2023-12-03T11:48:01.300+0000 7f992c532800 5 AuthRegistry(0x7ffdc5f4c2e0) adding auth protocol: cephx 2023-12-03T11:48:01.373 INFO:tasks.workunit.client.0.smithi003.stderr: -455> 2023-12-03T11:48:01.300+0000 7f992c532800 5 AuthRegistry(0x7ffdc5f4c2e0) adding auth protocol: cephx 2023-12-03T11:48:01.373 INFO:tasks.workunit.client.0.smithi003.stderr: -454> 2023-12-03T11:48:01.300+0000 7f992c532800 5 AuthRegistry(0x7ffdc5f4c2e0) adding auth protocol: cephx 2023-12-03T11:48:01.373 INFO:tasks.workunit.client.0.smithi003.stderr: -453> 2023-12-03T11:48:01.300+0000 7f992c532800 5 AuthRegistry(0x7ffdc5f4c2e0) adding con mode: secure 2023-12-03T11:48:01.373 INFO:tasks.workunit.client.0.smithi003.stderr: -452> 2023-12-03T11:48:01.300+0000 7f992c532800 5 AuthRegistry(0x7ffdc5f4c2e0) adding con mode: crc 2023-12-03T11:48:01.373 INFO:tasks.workunit.client.0.smithi003.stderr: -451> 2023-12-03T11:48:01.300+0000 7f992c532800 5 AuthRegistry(0x7ffdc5f4c2e0) adding con mode: secure 2023-12-03T11:48:01.373 INFO:tasks.workunit.client.0.smithi003.stderr: -450> 2023-12-03T11:48:01.300+0000 7f992c532800 5 AuthRegistry(0x7ffdc5f4c2e0) adding con mode: crc 2023-12-03T11:48:01.373 INFO:tasks.workunit.client.0.smithi003.stderr: -449> 2023-12-03T11:48:01.300+0000 7f992c532800 5 AuthRegistry(0x7ffdc5f4c2e0) adding con mode: secure 2023-12-03T11:48:01.373 INFO:tasks.workunit.client.0.smithi003.stderr: -448> 2023-12-03T11:48:01.300+0000 7f992c532800 5 AuthRegistry(0x7ffdc5f4c2e0) adding con mode: crc 2023-12-03T11:48:01.373 INFO:tasks.workunit.client.0.smithi003.stderr: -447> 2023-12-03T11:48:01.300+0000 7f992c532800 5 AuthRegistry(0x7ffdc5f4c2e0) adding con mode: crc 2023-12-03T11:48:01.373 INFO:tasks.workunit.client.0.smithi003.stderr: -446> 2023-12-03T11:48:01.300+0000 7f992c532800 5 AuthRegistry(0x7ffdc5f4c2e0) adding con mode: secure 2023-12-03T11:48:01.373 INFO:tasks.workunit.client.0.smithi003.stderr: -445> 2023-12-03T11:48:01.300+0000 7f992c532800 5 AuthRegistry(0x7ffdc5f4c2e0) adding con mode: crc 2023-12-03T11:48:01.373 INFO:tasks.workunit.client.0.smithi003.stderr: -444> 2023-12-03T11:48:01.300+0000 7f992c532800 5 AuthRegistry(0x7ffdc5f4c2e0) adding con mode: secure 2023-12-03T11:48:01.373 INFO:tasks.workunit.client.0.smithi003.stderr: -443> 2023-12-03T11:48:01.300+0000 7f992c532800 5 AuthRegistry(0x7ffdc5f4c2e0) adding con mode: crc 2023-12-03T11:48:01.374 INFO:tasks.workunit.client.0.smithi003.stderr: -442> 2023-12-03T11:48:01.300+0000 7f992c532800 5 AuthRegistry(0x7ffdc5f4c2e0) adding con mode: secure 2023-12-03T11:48:01.374 INFO:tasks.workunit.client.0.smithi003.stderr: -441> 2023-12-03T11:48:01.301+0000 7f992c532800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:48:01.374 INFO:tasks.workunit.client.0.smithi003.stderr: -440> 2023-12-03T11:48:01.301+0000 7f992c532800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:48:01.374 INFO:tasks.workunit.client.0.smithi003.stderr: -439> 2023-12-03T11:48:01.301+0000 7f992c532800 5 asok(0x55735d868a10) register_command rotate-key cmddesc rotate-key hook 0x7ffdc5f4c428 EEXIST 2023-12-03T11:48:01.374 INFO:tasks.workunit.client.0.smithi003.stderr: -438> 2023-12-03T11:48:01.301+0000 7f992c532800 10 monclient: _reopen_session rank -1 2023-12-03T11:48:01.374 INFO:tasks.workunit.client.0.smithi003.stderr: -437> 2023-12-03T11:48:01.301+0000 7f992c532800 10 monclient: _add_conns ranks=[0,2,1] 2023-12-03T11:48:01.374 INFO:tasks.workunit.client.0.smithi003.stderr: -436> 2023-12-03T11:48:01.301+0000 7f992c532800 10 monclient(hunting): picked mon.noname-a con 0x55735daa3e50 addr [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] 2023-12-03T11:48:01.374 INFO:tasks.workunit.client.0.smithi003.stderr: -435> 2023-12-03T11:48:01.301+0000 7f992c532800 10 monclient(hunting): picked mon.noname-c con 0x55735daa4230 addr [v2:172.21.15.3:3301/0,v1:172.21.15.3:6790/0] 2023-12-03T11:48:01.374 INFO:tasks.workunit.client.0.smithi003.stderr: -434> 2023-12-03T11:48:01.301+0000 7f992c532800 10 monclient(hunting): picked mon.noname-b con 0x55735da78330 addr [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] 2023-12-03T11:48:01.374 INFO:tasks.workunit.client.0.smithi003.stderr: -433> 2023-12-03T11:48:01.301+0000 7f992c532800 10 monclient(hunting): start opening mon connection 2023-12-03T11:48:01.374 INFO:tasks.workunit.client.0.smithi003.stderr: -432> 2023-12-03T11:48:01.301+0000 7f992c532800 10 monclient(hunting): start opening mon connection 2023-12-03T11:48:01.374 INFO:tasks.workunit.client.0.smithi003.stderr: -431> 2023-12-03T11:48:01.301+0000 7f992c532800 10 monclient(hunting): start opening mon connection 2023-12-03T11:48:01.374 INFO:tasks.workunit.client.0.smithi003.stderr: -430> 2023-12-03T11:48:01.301+0000 7f992c532800 10 monclient(hunting): _renew_subs 2023-12-03T11:48:01.374 INFO:tasks.workunit.client.0.smithi003.stderr: -429> 2023-12-03T11:48:01.301+0000 7f992c532800 10 monclient(hunting): authenticate will time out at 1703.539651s 2023-12-03T11:48:01.375 INFO:tasks.workunit.client.0.smithi003.stderr: -428> 2023-12-03T11:48:01.301+0000 7f992815b640 10 monclient(hunting): get_auth_request con 0x55735daa4230 auth_method 0 2023-12-03T11:48:01.375 INFO:tasks.workunit.client.0.smithi003.stderr: -427> 2023-12-03T11:48:01.301+0000 7f992815b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:48:01.375 INFO:tasks.workunit.client.0.smithi003.stderr: -426> 2023-12-03T11:48:01.301+0000 7f992815b640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:48:01.375 INFO:tasks.workunit.client.0.smithi003.stderr: -425> 2023-12-03T11:48:01.301+0000 7f992815b640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:48:01.375 INFO:tasks.workunit.client.0.smithi003.stderr: -424> 2023-12-03T11:48:01.301+0000 7f992895c640 10 monclient(hunting): get_auth_request con 0x55735daa3e50 auth_method 0 2023-12-03T11:48:01.375 INFO:tasks.workunit.client.0.smithi003.stderr: -423> 2023-12-03T11:48:01.301+0000 7f992895c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:48:01.375 INFO:tasks.workunit.client.0.smithi003.stderr: -422> 2023-12-03T11:48:01.301+0000 7f992895c640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:48:01.375 INFO:tasks.workunit.client.0.smithi003.stderr: -421> 2023-12-03T11:48:01.301+0000 7f992895c640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:48:01.375 INFO:tasks.workunit.client.0.smithi003.stderr: -420> 2023-12-03T11:48:01.301+0000 7f992815b640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:48:01.375 INFO:tasks.workunit.client.0.smithi003.stderr: -419> 2023-12-03T11:48:01.301+0000 7f992815b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:48:01.375 INFO:tasks.workunit.client.0.smithi003.stderr: -418> 2023-12-03T11:48:01.301+0000 7f992815b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:48:01.375 INFO:tasks.workunit.client.0.smithi003.stderr: -417> 2023-12-03T11:48:01.301+0000 7f992895c640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:48:01.375 INFO:tasks.workunit.client.0.smithi003.stderr: -416> 2023-12-03T11:48:01.301+0000 7f992895c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:48:01.375 INFO:tasks.workunit.client.0.smithi003.stderr: -415> 2023-12-03T11:48:01.301+0000 7f992895c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:48:01.375 INFO:tasks.workunit.client.0.smithi003.stderr: -414> 2023-12-03T11:48:01.301+0000 7f9925956640 4 mgrc handle_mgr_map Got map version 5 2023-12-03T11:48:01.376 INFO:tasks.workunit.client.0.smithi003.stderr: -413> 2023-12-03T11:48:01.301+0000 7f9925956640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.37:6832/2165065416,v1:172.21.15.37:6833/2165065416] 2023-12-03T11:48:01.376 INFO:tasks.workunit.client.0.smithi003.stderr: -412> 2023-12-03T11:48:01.301+0000 7f9925956640 4 mgrc reconnect Starting new session with [v2:172.21.15.37:6832/2165065416,v1:172.21.15.37:6833/2165065416] 2023-12-03T11:48:01.376 INFO:tasks.workunit.client.0.smithi003.stderr: -411> 2023-12-03T11:48:01.301+0000 7f992815b640 10 monclient(hunting): handle_auth_done global_id 6185 payload 274 2023-12-03T11:48:01.376 INFO:tasks.workunit.client.0.smithi003.stderr: -410> 2023-12-03T11:48:01.301+0000 7f992815b640 10 monclient: _finish_hunting 0 2023-12-03T11:48:01.376 INFO:tasks.workunit.client.0.smithi003.stderr: -409> 2023-12-03T11:48:01.301+0000 7f992815b640 1 monclient: found mon.noname-c 2023-12-03T11:48:01.376 INFO:tasks.workunit.client.0.smithi003.stderr: -408> 2023-12-03T11:48:01.301+0000 7f992815b640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.3:3301/0 2023-12-03T11:48:01.376 INFO:tasks.workunit.client.0.smithi003.stderr: -407> 2023-12-03T11:48:01.301+0000 7f992795a640 10 monclient: get_auth_request con 0x55735da78330 auth_method 0 2023-12-03T11:48:01.376 INFO:tasks.workunit.client.0.smithi003.stderr: -406> 2023-12-03T11:48:01.301+0000 7f992895c640 10 monclient: get_auth_request con 0x7f9914069820 auth_method 0 2023-12-03T11:48:01.376 INFO:tasks.workunit.client.0.smithi003.stderr: -405> 2023-12-03T11:48:01.302+0000 7f990effd640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:48:01.376 INFO:tasks.workunit.client.0.smithi003.stderr: -404> 2023-12-03T11:48:01.302+0000 7f990effd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-12-03T11:48:01.376 INFO:tasks.workunit.client.0.smithi003.stderr: -403> 2023-12-03T11:48:01.302+0000 7f990effd640 10 monclient: dump: 2023-12-03T11:48:01.376 INFO:tasks.workunit.client.0.smithi003.stderr:epoch 1 2023-12-03T11:48:01.376 INFO:tasks.workunit.client.0.smithi003.stderr:fsid 296556de-a4fc-4095-9b6d-0fe813c2865c 2023-12-03T11:48:01.376 INFO:tasks.workunit.client.0.smithi003.stderr:last_changed 2023-12-03T11:33:18.862564+0000 2023-12-03T11:48:01.376 INFO:tasks.workunit.client.0.smithi003.stderr:created 2023-12-03T11:33:18.862564+0000 2023-12-03T11:48:01.377 INFO:tasks.workunit.client.0.smithi003.stderr:min_mon_release 18 (reef) 2023-12-03T11:48:01.377 INFO:tasks.workunit.client.0.smithi003.stderr:election_strategy: 1 2023-12-03T11:48:01.377 INFO:tasks.workunit.client.0.smithi003.stderr:0: [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] mon.a 2023-12-03T11:48:01.377 INFO:tasks.workunit.client.0.smithi003.stderr:1: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.b 2023-12-03T11:48:01.377 INFO:tasks.workunit.client.0.smithi003.stderr:2: [v2:172.21.15.3:3301/0,v1:172.21.15.3:6790/0] mon.c 2023-12-03T11:48:01.377 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:48:01.377 INFO:tasks.workunit.client.0.smithi003.stderr: -402> 2023-12-03T11:48:01.302+0000 7f990effd640 10 monclient: _finish_auth 0 2023-12-03T11:48:01.377 INFO:tasks.workunit.client.0.smithi003.stderr: -401> 2023-12-03T11:48:01.302+0000 7f990effd640 10 monclient: _check_auth_tickets 2023-12-03T11:48:01.377 INFO:tasks.workunit.client.0.smithi003.stderr: -400> 2023-12-03T11:48:01.302+0000 7f990effd640 10 monclient: handle_config config(0 keys) v1 2023-12-03T11:48:01.377 INFO:tasks.workunit.client.0.smithi003.stderr: -399> 2023-12-03T11:48:01.302+0000 7f990effd640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:48:01.377 INFO:tasks.workunit.client.0.smithi003.stderr: -398> 2023-12-03T11:48:01.302+0000 7f990effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-12-03T11:48:01.377 INFO:tasks.workunit.client.0.smithi003.stderr: -397> 2023-12-03T11:48:01.302+0000 7f990effd640 10 monclient: dump: 2023-12-03T11:48:01.377 INFO:tasks.workunit.client.0.smithi003.stderr:epoch 1 2023-12-03T11:48:01.377 INFO:tasks.workunit.client.0.smithi003.stderr:fsid 296556de-a4fc-4095-9b6d-0fe813c2865c 2023-12-03T11:48:01.377 INFO:tasks.workunit.client.0.smithi003.stderr:last_changed 2023-12-03T11:33:18.862564+0000 2023-12-03T11:48:01.378 INFO:tasks.workunit.client.0.smithi003.stderr:created 2023-12-03T11:33:18.862564+0000 2023-12-03T11:48:01.378 INFO:tasks.workunit.client.0.smithi003.stderr:min_mon_release 18 (reef) 2023-12-03T11:48:01.378 INFO:tasks.workunit.client.0.smithi003.stderr:election_strategy: 1 2023-12-03T11:48:01.378 INFO:tasks.workunit.client.0.smithi003.stderr:0: [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] mon.a 2023-12-03T11:48:01.378 INFO:tasks.workunit.client.0.smithi003.stderr:1: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.b 2023-12-03T11:48:01.378 INFO:tasks.workunit.client.0.smithi003.stderr:2: [v2:172.21.15.3:3301/0,v1:172.21.15.3:6790/0] mon.c 2023-12-03T11:48:01.378 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:48:01.378 INFO:tasks.workunit.client.0.smithi003.stderr: -396> 2023-12-03T11:48:01.302+0000 7f992c532800 5 monclient: authenticate success, global_id 6185 2023-12-03T11:48:01.378 INFO:tasks.workunit.client.0.smithi003.stderr: -395> 2023-12-03T11:48:01.302+0000 7f992c532800 10 monclient: get_monmap_and_config success 2023-12-03T11:48:01.378 INFO:tasks.workunit.client.0.smithi003.stderr: -394> 2023-12-03T11:48:01.302+0000 7f992c532800 4 set_mon_vals no callback set 2023-12-03T11:48:01.378 INFO:tasks.workunit.client.0.smithi003.stderr: -393> 2023-12-03T11:48:01.302+0000 7f992c532800 10 monclient: shutdown 2023-12-03T11:48:01.378 INFO:tasks.workunit.client.0.smithi003.stderr: -392> 2023-12-03T11:48:01.302+0000 7f992c532800 10 monclient: build_initial_monmap 2023-12-03T11:48:01.378 INFO:tasks.workunit.client.0.smithi003.stderr: -391> 2023-12-03T11:48:01.302+0000 7f992c532800 1 build_initial for_mkfs: 0 2023-12-03T11:48:01.378 INFO:tasks.workunit.client.0.smithi003.stderr: -390> 2023-12-03T11:48:01.302+0000 7f992c532800 10 monclient: monmap: 2023-12-03T11:48:01.378 INFO:tasks.workunit.client.0.smithi003.stderr:epoch 0 2023-12-03T11:48:01.379 INFO:tasks.workunit.client.0.smithi003.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-12-03T11:48:01.379 INFO:tasks.workunit.client.0.smithi003.stderr:last_changed 0.000000 2023-12-03T11:48:01.379 INFO:tasks.workunit.client.0.smithi003.stderr:created 0.000000 2023-12-03T11:48:01.379 INFO:tasks.workunit.client.0.smithi003.stderr:min_mon_release 0 (unknown) 2023-12-03T11:48:01.379 INFO:tasks.workunit.client.0.smithi003.stderr:election_strategy: 1 2023-12-03T11:48:01.379 INFO:tasks.workunit.client.0.smithi003.stderr:0: [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] mon.noname-a 2023-12-03T11:48:01.379 INFO:tasks.workunit.client.0.smithi003.stderr:1: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.noname-b 2023-12-03T11:48:01.379 INFO:tasks.workunit.client.0.smithi003.stderr:2: [v2:172.21.15.3:3301/0,v1:172.21.15.3:6790/0] mon.noname-c 2023-12-03T11:48:01.379 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:48:01.379 INFO:tasks.workunit.client.0.smithi003.stderr: -389> 2023-12-03T11:48:01.302+0000 7f992c532800 5 AuthRegistry(0x55735da73a90) adding auth protocol: cephx 2023-12-03T11:48:01.379 INFO:tasks.workunit.client.0.smithi003.stderr: -388> 2023-12-03T11:48:01.302+0000 7f992c532800 5 AuthRegistry(0x55735da73a90) adding auth protocol: cephx 2023-12-03T11:48:01.379 INFO:tasks.workunit.client.0.smithi003.stderr: -387> 2023-12-03T11:48:01.302+0000 7f992c532800 5 AuthRegistry(0x55735da73a90) adding auth protocol: cephx 2023-12-03T11:48:01.379 INFO:tasks.workunit.client.0.smithi003.stderr: -386> 2023-12-03T11:48:01.302+0000 7f992c532800 5 AuthRegistry(0x55735da73a90) adding con mode: secure 2023-12-03T11:48:01.379 INFO:tasks.workunit.client.0.smithi003.stderr: -385> 2023-12-03T11:48:01.302+0000 7f992c532800 5 AuthRegistry(0x55735da73a90) adding con mode: crc 2023-12-03T11:48:01.379 INFO:tasks.workunit.client.0.smithi003.stderr: -384> 2023-12-03T11:48:01.302+0000 7f992c532800 5 AuthRegistry(0x55735da73a90) adding con mode: secure 2023-12-03T11:48:01.380 INFO:tasks.workunit.client.0.smithi003.stderr: -383> 2023-12-03T11:48:01.302+0000 7f992c532800 5 AuthRegistry(0x55735da73a90) adding con mode: crc 2023-12-03T11:48:01.380 INFO:tasks.workunit.client.0.smithi003.stderr: -382> 2023-12-03T11:48:01.302+0000 7f992c532800 5 AuthRegistry(0x55735da73a90) adding con mode: secure 2023-12-03T11:48:01.380 INFO:tasks.workunit.client.0.smithi003.stderr: -381> 2023-12-03T11:48:01.302+0000 7f992c532800 5 AuthRegistry(0x55735da73a90) adding con mode: crc 2023-12-03T11:48:01.380 INFO:tasks.workunit.client.0.smithi003.stderr: -380> 2023-12-03T11:48:01.302+0000 7f992c532800 5 AuthRegistry(0x55735da73a90) adding con mode: crc 2023-12-03T11:48:01.380 INFO:tasks.workunit.client.0.smithi003.stderr: -379> 2023-12-03T11:48:01.302+0000 7f992c532800 5 AuthRegistry(0x55735da73a90) adding con mode: secure 2023-12-03T11:48:01.380 INFO:tasks.workunit.client.0.smithi003.stderr: -378> 2023-12-03T11:48:01.302+0000 7f992c532800 5 AuthRegistry(0x55735da73a90) adding con mode: crc 2023-12-03T11:48:01.380 INFO:tasks.workunit.client.0.smithi003.stderr: -377> 2023-12-03T11:48:01.302+0000 7f992c532800 5 AuthRegistry(0x55735da73a90) adding con mode: secure 2023-12-03T11:48:01.380 INFO:tasks.workunit.client.0.smithi003.stderr: -376> 2023-12-03T11:48:01.302+0000 7f992c532800 5 AuthRegistry(0x55735da73a90) adding con mode: crc 2023-12-03T11:48:01.380 INFO:tasks.workunit.client.0.smithi003.stderr: -375> 2023-12-03T11:48:01.302+0000 7f992c532800 5 AuthRegistry(0x55735da73a90) adding con mode: secure 2023-12-03T11:48:01.380 INFO:tasks.workunit.client.0.smithi003.stderr: -374> 2023-12-03T11:48:01.302+0000 7f992c532800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:48:01.380 INFO:tasks.workunit.client.0.smithi003.stderr: -373> 2023-12-03T11:48:01.302+0000 7f992c532800 1 librados: starting msgr at 2023-12-03T11:48:01.380 INFO:tasks.workunit.client.0.smithi003.stderr: -372> 2023-12-03T11:48:01.302+0000 7f992c532800 1 librados: starting objecter 2023-12-03T11:48:01.380 INFO:tasks.workunit.client.0.smithi003.stderr: -371> 2023-12-03T11:48:01.303+0000 7f992c532800 5 asok(0x55735d868a10) register_command objecter_requests cmddesc objecter_requests hook 0x55735daadba0 EEXIST 2023-12-03T11:48:01.380 INFO:tasks.workunit.client.0.smithi003.stderr: -370> 2023-12-03T11:48:01.303+0000 7f992c532800 1 librados: setting wanted keys 2023-12-03T11:48:01.380 INFO:tasks.workunit.client.0.smithi003.stderr: -369> 2023-12-03T11:48:01.303+0000 7f992c532800 1 librados: calling monclient init 2023-12-03T11:48:01.381 INFO:tasks.workunit.client.0.smithi003.stderr: -368> 2023-12-03T11:48:01.303+0000 7f992c532800 10 monclient: init 2023-12-03T11:48:01.381 INFO:tasks.workunit.client.0.smithi003.stderr: -367> 2023-12-03T11:48:01.303+0000 7f992c532800 5 AuthRegistry(0x55735da72128) adding auth protocol: cephx 2023-12-03T11:48:01.381 INFO:tasks.workunit.client.0.smithi003.stderr: -366> 2023-12-03T11:48:01.303+0000 7f992c532800 5 AuthRegistry(0x55735da72128) adding auth protocol: cephx 2023-12-03T11:48:01.381 INFO:tasks.workunit.client.0.smithi003.stderr: -365> 2023-12-03T11:48:01.303+0000 7f992c532800 5 AuthRegistry(0x55735da72128) adding auth protocol: cephx 2023-12-03T11:48:01.381 INFO:tasks.workunit.client.0.smithi003.stderr: -364> 2023-12-03T11:48:01.303+0000 7f992c532800 5 AuthRegistry(0x55735da72128) adding con mode: secure 2023-12-03T11:48:01.381 INFO:tasks.workunit.client.0.smithi003.stderr: -363> 2023-12-03T11:48:01.303+0000 7f992c532800 5 AuthRegistry(0x55735da72128) adding con mode: crc 2023-12-03T11:48:01.381 INFO:tasks.workunit.client.0.smithi003.stderr: -362> 2023-12-03T11:48:01.303+0000 7f992c532800 5 AuthRegistry(0x55735da72128) adding con mode: secure 2023-12-03T11:48:01.381 INFO:tasks.workunit.client.0.smithi003.stderr: -361> 2023-12-03T11:48:01.303+0000 7f992c532800 5 AuthRegistry(0x55735da72128) adding con mode: crc 2023-12-03T11:48:01.381 INFO:tasks.workunit.client.0.smithi003.stderr: -360> 2023-12-03T11:48:01.303+0000 7f992c532800 5 AuthRegistry(0x55735da72128) adding con mode: secure 2023-12-03T11:48:01.381 INFO:tasks.workunit.client.0.smithi003.stderr: -359> 2023-12-03T11:48:01.303+0000 7f992c532800 5 AuthRegistry(0x55735da72128) adding con mode: crc 2023-12-03T11:48:01.381 INFO:tasks.workunit.client.0.smithi003.stderr: -358> 2023-12-03T11:48:01.303+0000 7f992c532800 5 AuthRegistry(0x55735da72128) adding con mode: crc 2023-12-03T11:48:01.381 INFO:tasks.workunit.client.0.smithi003.stderr: -357> 2023-12-03T11:48:01.303+0000 7f992c532800 5 AuthRegistry(0x55735da72128) adding con mode: secure 2023-12-03T11:48:01.381 INFO:tasks.workunit.client.0.smithi003.stderr: -356> 2023-12-03T11:48:01.303+0000 7f992c532800 5 AuthRegistry(0x55735da72128) adding con mode: crc 2023-12-03T11:48:01.382 INFO:tasks.workunit.client.0.smithi003.stderr: -355> 2023-12-03T11:48:01.303+0000 7f992c532800 5 AuthRegistry(0x55735da72128) adding con mode: secure 2023-12-03T11:48:01.382 INFO:tasks.workunit.client.0.smithi003.stderr: -354> 2023-12-03T11:48:01.303+0000 7f992c532800 5 AuthRegistry(0x55735da72128) adding con mode: crc 2023-12-03T11:48:01.382 INFO:tasks.workunit.client.0.smithi003.stderr: -353> 2023-12-03T11:48:01.303+0000 7f992c532800 5 AuthRegistry(0x55735da72128) adding con mode: secure 2023-12-03T11:48:01.382 INFO:tasks.workunit.client.0.smithi003.stderr: -352> 2023-12-03T11:48:01.303+0000 7f992c532800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:48:01.382 INFO:tasks.workunit.client.0.smithi003.stderr: -351> 2023-12-03T11:48:01.303+0000 7f992c532800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:48:01.382 INFO:tasks.workunit.client.0.smithi003.stderr: -350> 2023-12-03T11:48:01.303+0000 7f992c532800 5 asok(0x55735d868a10) register_command rotate-key cmddesc rotate-key hook 0x55735da72270 EEXIST 2023-12-03T11:48:01.382 INFO:tasks.workunit.client.0.smithi003.stderr: -349> 2023-12-03T11:48:01.303+0000 7f992c532800 10 monclient: _reopen_session rank -1 2023-12-03T11:48:01.382 INFO:tasks.workunit.client.0.smithi003.stderr: -348> 2023-12-03T11:48:01.303+0000 7f992c532800 10 monclient: _add_conns ranks=[1,2,0] 2023-12-03T11:48:01.382 INFO:tasks.workunit.client.0.smithi003.stderr: -347> 2023-12-03T11:48:01.303+0000 7f992c532800 10 monclient(hunting): picked mon.noname-b con 0x55735da78330 addr [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] 2023-12-03T11:48:01.382 INFO:tasks.workunit.client.0.smithi003.stderr: -346> 2023-12-03T11:48:01.303+0000 7f992c532800 10 monclient(hunting): picked mon.noname-c con 0x55735daa3e50 addr [v2:172.21.15.3:3301/0,v1:172.21.15.3:6790/0] 2023-12-03T11:48:01.382 INFO:tasks.workunit.client.0.smithi003.stderr: -345> 2023-12-03T11:48:01.303+0000 7f992c532800 10 monclient(hunting): picked mon.noname-a con 0x55735daab970 addr [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] 2023-12-03T11:48:01.382 INFO:tasks.workunit.client.0.smithi003.stderr: -344> 2023-12-03T11:48:01.303+0000 7f992c532800 10 monclient(hunting): start opening mon connection 2023-12-03T11:48:01.382 INFO:tasks.workunit.client.0.smithi003.stderr: -343> 2023-12-03T11:48:01.303+0000 7f992c532800 10 monclient(hunting): start opening mon connection 2023-12-03T11:48:01.382 INFO:tasks.workunit.client.0.smithi003.stderr: -342> 2023-12-03T11:48:01.303+0000 7f992c532800 10 monclient(hunting): start opening mon connection 2023-12-03T11:48:01.382 INFO:tasks.workunit.client.0.smithi003.stderr: -341> 2023-12-03T11:48:01.303+0000 7f992c532800 10 monclient(hunting): _renew_subs 2023-12-03T11:48:01.383 INFO:tasks.workunit.client.0.smithi003.stderr: -340> 2023-12-03T11:48:01.303+0000 7f992c532800 10 monclient(hunting): authenticate will time out at 1703.541983s 2023-12-03T11:48:01.383 INFO:tasks.workunit.client.0.smithi003.stderr: -339> 2023-12-03T11:48:01.303+0000 7f992895c640 10 monclient(hunting): get_auth_request con 0x55735daab970 auth_method 0 2023-12-03T11:48:01.383 INFO:tasks.workunit.client.0.smithi003.stderr: -338> 2023-12-03T11:48:01.303+0000 7f992895c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:48:01.383 INFO:tasks.workunit.client.0.smithi003.stderr: -337> 2023-12-03T11:48:01.303+0000 7f992895c640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:48:01.383 INFO:tasks.workunit.client.0.smithi003.stderr: -336> 2023-12-03T11:48:01.303+0000 7f992895c640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:48:01.383 INFO:tasks.workunit.client.0.smithi003.stderr: -335> 2023-12-03T11:48:01.303+0000 7f992795a640 10 monclient(hunting): get_auth_request con 0x55735daa3e50 auth_method 0 2023-12-03T11:48:01.383 INFO:tasks.workunit.client.0.smithi003.stderr: -334> 2023-12-03T11:48:01.303+0000 7f992795a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:48:01.383 INFO:tasks.workunit.client.0.smithi003.stderr: -333> 2023-12-03T11:48:01.303+0000 7f992795a640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:48:01.383 INFO:tasks.workunit.client.0.smithi003.stderr: -332> 2023-12-03T11:48:01.303+0000 7f992795a640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:48:01.383 INFO:tasks.workunit.client.0.smithi003.stderr: -331> 2023-12-03T11:48:01.303+0000 7f992815b640 10 monclient(hunting): get_auth_request con 0x55735da78330 auth_method 0 2023-12-03T11:48:01.383 INFO:tasks.workunit.client.0.smithi003.stderr: -330> 2023-12-03T11:48:01.303+0000 7f992815b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:48:01.383 INFO:tasks.workunit.client.0.smithi003.stderr: -329> 2023-12-03T11:48:01.303+0000 7f992815b640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:48:01.383 INFO:tasks.workunit.client.0.smithi003.stderr: -328> 2023-12-03T11:48:01.303+0000 7f992815b640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:48:01.383 INFO:tasks.workunit.client.0.smithi003.stderr: -327> 2023-12-03T11:48:01.303+0000 7f992895c640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:48:01.383 INFO:tasks.workunit.client.0.smithi003.stderr: -326> 2023-12-03T11:48:01.303+0000 7f992895c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:48:01.384 INFO:tasks.workunit.client.0.smithi003.stderr: -325> 2023-12-03T11:48:01.303+0000 7f992895c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:48:01.384 INFO:tasks.workunit.client.0.smithi003.stderr: -324> 2023-12-03T11:48:01.303+0000 7f992795a640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:48:01.384 INFO:tasks.workunit.client.0.smithi003.stderr: -323> 2023-12-03T11:48:01.303+0000 7f992795a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:48:01.384 INFO:tasks.workunit.client.0.smithi003.stderr: -322> 2023-12-03T11:48:01.303+0000 7f992795a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:48:01.384 INFO:tasks.workunit.client.0.smithi003.stderr: -321> 2023-12-03T11:48:01.303+0000 7f992815b640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:48:01.384 INFO:tasks.workunit.client.0.smithi003.stderr: -320> 2023-12-03T11:48:01.303+0000 7f992815b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:48:01.384 INFO:tasks.workunit.client.0.smithi003.stderr: -319> 2023-12-03T11:48:01.303+0000 7f992815b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:48:01.384 INFO:tasks.workunit.client.0.smithi003.stderr: -318> 2023-12-03T11:48:01.304+0000 7f992895c640 10 monclient(hunting): handle_auth_done global_id 6543 payload 824 2023-12-03T11:48:01.384 INFO:tasks.workunit.client.0.smithi003.stderr: -317> 2023-12-03T11:48:01.304+0000 7f992895c640 10 monclient: _finish_hunting 0 2023-12-03T11:48:01.384 INFO:tasks.workunit.client.0.smithi003.stderr: -316> 2023-12-03T11:48:01.304+0000 7f992895c640 1 monclient: found mon.noname-a 2023-12-03T11:48:01.384 INFO:tasks.workunit.client.0.smithi003.stderr: -315> 2023-12-03T11:48:01.304+0000 7f992895c640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.3:3300/0 2023-12-03T11:48:01.384 INFO:tasks.workunit.client.0.smithi003.stderr: -314> 2023-12-03T11:48:01.304+0000 7f990d7fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:48:01.384 INFO:tasks.workunit.client.0.smithi003.stderr: -313> 2023-12-03T11:48:01.304+0000 7f990d7fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-12-03T11:48:01.384 INFO:tasks.workunit.client.0.smithi003.stderr: -312> 2023-12-03T11:48:01.304+0000 7f990d7fa640 10 monclient: dump: 2023-12-03T11:48:01.385 INFO:tasks.workunit.client.0.smithi003.stderr:epoch 1 2023-12-03T11:48:01.385 INFO:tasks.workunit.client.0.smithi003.stderr:fsid 296556de-a4fc-4095-9b6d-0fe813c2865c 2023-12-03T11:48:01.385 INFO:tasks.workunit.client.0.smithi003.stderr:last_changed 2023-12-03T11:33:18.862564+0000 2023-12-03T11:48:01.385 INFO:tasks.workunit.client.0.smithi003.stderr:created 2023-12-03T11:33:18.862564+0000 2023-12-03T11:48:01.385 INFO:tasks.workunit.client.0.smithi003.stderr:min_mon_release 18 (reef) 2023-12-03T11:48:01.385 INFO:tasks.workunit.client.0.smithi003.stderr:election_strategy: 1 2023-12-03T11:48:01.385 INFO:tasks.workunit.client.0.smithi003.stderr:0: [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] mon.a 2023-12-03T11:48:01.385 INFO:tasks.workunit.client.0.smithi003.stderr:1: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.b 2023-12-03T11:48:01.385 INFO:tasks.workunit.client.0.smithi003.stderr:2: [v2:172.21.15.3:3301/0,v1:172.21.15.3:6790/0] mon.c 2023-12-03T11:48:01.385 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:48:01.385 INFO:tasks.workunit.client.0.smithi003.stderr: -311> 2023-12-03T11:48:01.304+0000 7f990d7fa640 10 monclient: _finish_auth 0 2023-12-03T11:48:01.385 INFO:tasks.workunit.client.0.smithi003.stderr: -310> 2023-12-03T11:48:01.304+0000 7f990d7fa640 10 monclient: _check_auth_tickets 2023-12-03T11:48:01.385 INFO:tasks.workunit.client.0.smithi003.stderr: -309> 2023-12-03T11:48:01.304+0000 7f990d7fa640 10 monclient: handle_config config(0 keys) v1 2023-12-03T11:48:01.385 INFO:tasks.workunit.client.0.smithi003.stderr: -308> 2023-12-03T11:48:01.304+0000 7f992c532800 5 monclient: authenticate success, global_id 6543 2023-12-03T11:48:01.386 INFO:tasks.workunit.client.0.smithi003.stderr: -307> 2023-12-03T11:48:01.304+0000 7f992c532800 10 monclient: _renew_subs 2023-12-03T11:48:01.386 INFO:tasks.workunit.client.0.smithi003.stderr: -306> 2023-12-03T11:48:01.304+0000 7f992c532800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.3:3300/0 2023-12-03T11:48:01.386 INFO:tasks.workunit.client.0.smithi003.stderr: -305> 2023-12-03T11:48:01.304+0000 7f990d7fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:48:01.386 INFO:tasks.workunit.client.0.smithi003.stderr: -304> 2023-12-03T11:48:01.304+0000 7f990effd640 4 set_mon_vals no callback set 2023-12-03T11:48:01.386 INFO:tasks.workunit.client.0.smithi003.stderr: -303> 2023-12-03T11:48:01.304+0000 7f990d7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-12-03T11:48:01.386 INFO:tasks.workunit.client.0.smithi003.stderr: -302> 2023-12-03T11:48:01.304+0000 7f990d7fa640 10 monclient: dump: 2023-12-03T11:48:01.386 INFO:tasks.workunit.client.0.smithi003.stderr:epoch 1 2023-12-03T11:48:01.386 INFO:tasks.workunit.client.0.smithi003.stderr:fsid 296556de-a4fc-4095-9b6d-0fe813c2865c 2023-12-03T11:48:01.386 INFO:tasks.workunit.client.0.smithi003.stderr:last_changed 2023-12-03T11:33:18.862564+0000 2023-12-03T11:48:01.386 INFO:tasks.workunit.client.0.smithi003.stderr:created 2023-12-03T11:33:18.862564+0000 2023-12-03T11:48:01.386 INFO:tasks.workunit.client.0.smithi003.stderr:min_mon_release 18 (reef) 2023-12-03T11:48:01.386 INFO:tasks.workunit.client.0.smithi003.stderr:election_strategy: 1 2023-12-03T11:48:01.386 INFO:tasks.workunit.client.0.smithi003.stderr:0: [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] mon.a 2023-12-03T11:48:01.386 INFO:tasks.workunit.client.0.smithi003.stderr:1: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.b 2023-12-03T11:48:01.386 INFO:tasks.workunit.client.0.smithi003.stderr:2: [v2:172.21.15.3:3301/0,v1:172.21.15.3:6790/0] mon.c 2023-12-03T11:48:01.387 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:48:01.387 INFO:tasks.workunit.client.0.smithi003.stderr: -301> 2023-12-03T11:48:01.304+0000 7f992c532800 10 monclient: _renew_subs 2023-12-03T11:48:01.387 INFO:tasks.workunit.client.0.smithi003.stderr: -300> 2023-12-03T11:48:01.304+0000 7f992c532800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.3:3300/0 2023-12-03T11:48:01.387 INFO:tasks.workunit.client.0.smithi003.stderr: -299> 2023-12-03T11:48:01.304+0000 7f992c532800 1 librados: init done 2023-12-03T11:48:01.387 INFO:tasks.workunit.client.0.smithi003.stderr: -298> 2023-12-03T11:48:01.305+0000 7f992c532800 20 rados->read ofs=0 len=0 2023-12-03T11:48:01.387 INFO:tasks.workunit.client.0.smithi003.stderr: -297> 2023-12-03T11:48:01.306+0000 7f990d7fa640 4 mgrc handle_mgr_map Got map version 5 2023-12-03T11:48:01.387 INFO:tasks.workunit.client.0.smithi003.stderr: -296> 2023-12-03T11:48:01.306+0000 7f990d7fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.37:6832/2165065416,v1:172.21.15.37:6833/2165065416] 2023-12-03T11:48:01.387 INFO:tasks.workunit.client.0.smithi003.stderr: -295> 2023-12-03T11:48:01.306+0000 7f990d7fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.37:6832/2165065416,v1:172.21.15.37:6833/2165065416] 2023-12-03T11:48:01.387 INFO:tasks.workunit.client.0.smithi003.stderr: -294> 2023-12-03T11:48:01.306+0000 7f992815b640 10 monclient: get_auth_request con 0x7f9904069820 auth_method 0 2023-12-03T11:48:01.387 INFO:tasks.workunit.client.0.smithi003.stderr: -293> 2023-12-03T11:48:01.306+0000 7f992795a640 10 monclient: get_auth_request con 0x55735dac0840 auth_method 0 2023-12-03T11:48:01.387 INFO:tasks.workunit.client.0.smithi003.stderr: -292> 2023-12-03T11:48:01.307+0000 7f992c532800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:01.387 INFO:tasks.workunit.client.0.smithi003.stderr: -291> 2023-12-03T11:48:01.307+0000 7f992c532800 20 realm 2023-12-03T11:48:01.387 INFO:tasks.workunit.client.0.smithi003.stderr: -290> 2023-12-03T11:48:01.307+0000 7f992c532800 20 rados->read ofs=0 len=0 2023-12-03T11:48:01.387 INFO:tasks.workunit.client.0.smithi003.stderr: -289> 2023-12-03T11:48:01.307+0000 7f992c532800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:01.387 INFO:tasks.workunit.client.0.smithi003.stderr: -288> 2023-12-03T11:48:01.307+0000 7f992c532800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:48:01.388 INFO:tasks.workunit.client.0.smithi003.stderr: -287> 2023-12-03T11:48:01.307+0000 7f992c532800 20 rados->read ofs=0 len=0 2023-12-03T11:48:01.388 INFO:tasks.workunit.client.0.smithi003.stderr: -286> 2023-12-03T11:48:01.307+0000 7f992c532800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:01.388 INFO:tasks.workunit.client.0.smithi003.stderr: -285> 2023-12-03T11:48:01.307+0000 7f992c532800 20 rados->read ofs=0 len=0 2023-12-03T11:48:01.388 INFO:tasks.workunit.client.0.smithi003.stderr: -284> 2023-12-03T11:48:01.307+0000 7f992815b640 10 monclient: get_auth_request con 0x55735dac47a0 auth_method 0 2023-12-03T11:48:01.388 INFO:tasks.workunit.client.0.smithi003.stderr: -283> 2023-12-03T11:48:01.308+0000 7f992c532800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:48:01.388 INFO:tasks.workunit.client.0.smithi003.stderr: -282> 2023-12-03T11:48:01.308+0000 7f992c532800 20 rados->read ofs=0 len=0 2023-12-03T11:48:01.388 INFO:tasks.workunit.client.0.smithi003.stderr: -281> 2023-12-03T11:48:01.308+0000 7f992c532800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:48:01.388 INFO:tasks.workunit.client.0.smithi003.stderr: -280> 2023-12-03T11:48:01.308+0000 7f992c532800 20 searching for the correct realm 2023-12-03T11:48:01.388 INFO:tasks.workunit.client.0.smithi003.stderr: -279> 2023-12-03T11:48:01.308+0000 7f992795a640 10 monclient: get_auth_request con 0x55735dac97a0 auth_method 0 2023-12-03T11:48:01.388 INFO:tasks.workunit.client.0.smithi003.stderr: -278> 2023-12-03T11:48:01.309+0000 7f992895c640 10 monclient: get_auth_request con 0x7f991c0609a0 auth_method 0 2023-12-03T11:48:01.388 INFO:tasks.workunit.client.0.smithi003.stderr: -277> 2023-12-03T11:48:01.310+0000 7f992815b640 10 monclient: get_auth_request con 0x7f9920080060 auth_method 0 2023-12-03T11:48:01.388 INFO:tasks.workunit.client.0.smithi003.stderr: -276> 2023-12-03T11:48:01.311+0000 7f992795a640 10 monclient: get_auth_request con 0x7f9918035040 auth_method 0 2023-12-03T11:48:01.388 INFO:tasks.workunit.client.0.smithi003.stderr: -275> 2023-12-03T11:48:01.311+0000 7f990d7fa640 1 client.6543.objecter ms_handle_reset 0x7f991c0609a0 session 0x7f991c088370 osd.7 2023-12-03T11:48:01.388 INFO:tasks.workunit.client.0.smithi003.stderr: -274> 2023-12-03T11:48:01.311+0000 7f990d7fa640 10 monclient: _renew_subs 2023-12-03T11:48:01.388 INFO:tasks.workunit.client.0.smithi003.stderr: -273> 2023-12-03T11:48:01.311+0000 7f990d7fa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.3:3300/0 2023-12-03T11:48:01.389 INFO:tasks.workunit.client.0.smithi003.stderr: -272> 2023-12-03T11:48:01.311+0000 7f992895c640 10 monclient: get_auth_request con 0x7f9904079e10 auth_method 0 2023-12-03T11:48:01.389 INFO:tasks.workunit.client.0.smithi003.stderr: -271> 2023-12-03T11:48:01.313+0000 7f992895c640 10 monclient: get_auth_request con 0x7f991c058e40 auth_method 0 2023-12-03T11:48:01.389 INFO:tasks.workunit.client.0.smithi003.stderr: -270> 2023-12-03T11:48:01.315+0000 7f992815b640 10 monclient: get_auth_request con 0x7f991c077250 auth_method 0 2023-12-03T11:48:01.389 INFO:tasks.workunit.client.0.smithi003.stderr: -269> 2023-12-03T11:48:01.318+0000 7f992815b640 0 -- 172.21.15.3:0/3689260636 >> [v2:172.21.15.3:6808/263125788,v1:172.21.15.3:6809/263125788] conn(0x7f991c077250 msgr2=0x7f991c077790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:48:01.389 INFO:tasks.workunit.client.0.smithi003.stderr: -268> 2023-12-03T11:48:01.318+0000 7f990d7fa640 1 client.6543.objecter ms_handle_reset 0x7f991c077250 session 0x7f991c056f80 osd.0 2023-12-03T11:48:01.389 INFO:tasks.workunit.client.0.smithi003.stderr: -267> 2023-12-03T11:48:01.318+0000 7f992815b640 10 monclient: get_auth_request con 0x7f991c0609a0 auth_method 0 2023-12-03T11:48:01.389 INFO:tasks.workunit.client.0.smithi003.stderr: -266> 2023-12-03T11:48:01.320+0000 7f992c532800 20 RGWRados::pool_iterate: got zone_info.83aabb46-04b5-4c96-9933-c6bfb1173a73 2023-12-03T11:48:01.389 INFO:tasks.workunit.client.0.smithi003.stderr: -265> 2023-12-03T11:48:01.320+0000 7f992c532800 20 RGWRados::pool_iterate: got zonegroup_info.6a811aad-435d-4fdd-93c9-b7e0b50de429 2023-12-03T11:48:01.389 INFO:tasks.workunit.client.0.smithi003.stderr: -264> 2023-12-03T11:48:01.320+0000 7f992c532800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:48:01.389 INFO:tasks.workunit.client.0.smithi003.stderr: -263> 2023-12-03T11:48:01.320+0000 7f992c532800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:48:01.389 INFO:tasks.workunit.client.0.smithi003.stderr: -262> 2023-12-03T11:48:01.320+0000 7f992c532800 20 rados->read ofs=0 len=0 2023-12-03T11:48:01.389 INFO:tasks.workunit.client.0.smithi003.stderr: -261> 2023-12-03T11:48:01.320+0000 7f992c532800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:01.389 INFO:tasks.workunit.client.0.smithi003.stderr: -260> 2023-12-03T11:48:01.320+0000 7f992c532800 20 rados->read ofs=0 len=0 2023-12-03T11:48:01.389 INFO:tasks.workunit.client.0.smithi003.stderr: -259> 2023-12-03T11:48:01.320+0000 7f992c532800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:48:01.389 INFO:tasks.workunit.client.0.smithi003.stderr: -258> 2023-12-03T11:48:01.320+0000 7f992c532800 20 rados->read ofs=0 len=0 2023-12-03T11:48:01.390 INFO:tasks.workunit.client.0.smithi003.stderr: -257> 2023-12-03T11:48:01.320+0000 7f992c532800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:48:01.390 INFO:tasks.workunit.client.0.smithi003.stderr: -256> 2023-12-03T11:48:01.320+0000 7f992c532800 20 zone default found 2023-12-03T11:48:01.390 INFO:tasks.workunit.client.0.smithi003.stderr: -255> 2023-12-03T11:48:01.320+0000 7f992c532800 4 Realm: () 2023-12-03T11:48:01.390 INFO:tasks.workunit.client.0.smithi003.stderr: -254> 2023-12-03T11:48:01.320+0000 7f992c532800 4 ZoneGroup: default (6a811aad-435d-4fdd-93c9-b7e0b50de429) 2023-12-03T11:48:01.390 INFO:tasks.workunit.client.0.smithi003.stderr: -253> 2023-12-03T11:48:01.320+0000 7f992c532800 4 Zone: default (83aabb46-04b5-4c96-9933-c6bfb1173a73) 2023-12-03T11:48:01.390 INFO:tasks.workunit.client.0.smithi003.stderr: -252> 2023-12-03T11:48:01.320+0000 7f992c532800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:48:01.390 INFO:tasks.workunit.client.0.smithi003.stderr: -251> 2023-12-03T11:48:01.320+0000 7f992c532800 20 zonegroup default 2023-12-03T11:48:01.390 INFO:tasks.workunit.client.0.smithi003.stderr: -250> 2023-12-03T11:48:01.320+0000 7f992c532800 20 rados->read ofs=0 len=0 2023-12-03T11:48:01.390 INFO:tasks.workunit.client.0.smithi003.stderr: -249> 2023-12-03T11:48:01.321+0000 7f992c532800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:01.390 INFO:tasks.workunit.client.0.smithi003.stderr: -248> 2023-12-03T11:48:01.321+0000 7f992c532800 20 rados->read ofs=0 len=0 2023-12-03T11:48:01.390 INFO:tasks.workunit.client.0.smithi003.stderr: -247> 2023-12-03T11:48:01.321+0000 7f992c532800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:01.390 INFO:tasks.workunit.client.0.smithi003.stderr: -246> 2023-12-03T11:48:01.321+0000 7f992c532800 20 rados->read ofs=0 len=0 2023-12-03T11:48:01.390 INFO:tasks.workunit.client.0.smithi003.stderr: -245> 2023-12-03T11:48:01.321+0000 7f992c532800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:01.390 INFO:tasks.workunit.client.0.smithi003.stderr: -244> 2023-12-03T11:48:01.321+0000 7f992c532800 20 started sync module instance, tier type = 2023-12-03T11:48:01.390 INFO:tasks.workunit.client.0.smithi003.stderr: -243> 2023-12-03T11:48:01.321+0000 7f992c532800 20 started zone id=83aabb46-04b5-4c96-9933-c6bfb1173a73 (name=default) with tier type = 2023-12-03T11:48:01.391 INFO:tasks.workunit.client.0.smithi003.stderr: -242> 2023-12-03T11:48:01.326+0000 7f992895c640 0 -- 172.21.15.3:0/3689260636 >> [v2:172.21.15.37:6817/511039327,v1:172.21.15.37:6819/511039327] conn(0x7f9904079e10 msgr2=0x7f990407c240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:48:01.391 INFO:tasks.workunit.client.0.smithi003.stderr: -241> 2023-12-03T11:48:01.326+0000 7f990d7fa640 1 client.6543.objecter ms_handle_reset 0x7f9904079e10 session 0x7f991c088370 osd.7 2023-12-03T11:48:01.391 INFO:tasks.workunit.client.0.smithi003.stderr: -240> 2023-12-03T11:48:01.326+0000 7f992895c640 10 monclient: get_auth_request con 0x7f991c077250 auth_method 0 2023-12-03T11:48:01.391 INFO:tasks.workunit.client.0.smithi003.stderr: -239> 2023-12-03T11:48:01.330+0000 7f992c532800 20 add_watcher() i=0 2023-12-03T11:48:01.391 INFO:tasks.workunit.client.0.smithi003.stderr: -238> 2023-12-03T11:48:01.330+0000 7f992c532800 20 add_watcher() i=1 2023-12-03T11:48:01.391 INFO:tasks.workunit.client.0.smithi003.stderr: -237> 2023-12-03T11:48:01.330+0000 7f992c532800 20 add_watcher() i=2 2023-12-03T11:48:01.391 INFO:tasks.workunit.client.0.smithi003.stderr: -236> 2023-12-03T11:48:01.330+0000 7f992c532800 20 add_watcher() i=3 2023-12-03T11:48:01.391 INFO:tasks.workunit.client.0.smithi003.stderr: -235> 2023-12-03T11:48:01.330+0000 7f992c532800 20 add_watcher() i=4 2023-12-03T11:48:01.391 INFO:tasks.workunit.client.0.smithi003.stderr: -234> 2023-12-03T11:48:01.330+0000 7f992c532800 20 add_watcher() i=5 2023-12-03T11:48:01.391 INFO:tasks.workunit.client.0.smithi003.stderr: -233> 2023-12-03T11:48:01.330+0000 7f992c532800 20 add_watcher() i=6 2023-12-03T11:48:01.391 INFO:tasks.workunit.client.0.smithi003.stderr: -232> 2023-12-03T11:48:01.331+0000 7f992c532800 20 add_watcher() i=7 2023-12-03T11:48:01.391 INFO:tasks.workunit.client.0.smithi003.stderr: -231> 2023-12-03T11:48:01.331+0000 7f992c532800 2 all 8 watchers are set, enabling cache 2023-12-03T11:48:01.391 INFO:tasks.workunit.client.0.smithi003.stderr: -230> 2023-12-03T11:48:01.333+0000 7f992c532800 5 AuthRegistry(0x7ffdc5f4cd10) adding auth protocol: cephx 2023-12-03T11:48:01.391 INFO:tasks.workunit.client.0.smithi003.stderr: -229> 2023-12-03T11:48:01.333+0000 7f992c532800 5 AuthRegistry(0x7ffdc5f4cd10) adding auth protocol: cephx 2023-12-03T11:48:01.392 INFO:tasks.workunit.client.0.smithi003.stderr: -228> 2023-12-03T11:48:01.333+0000 7f992c532800 5 AuthRegistry(0x7ffdc5f4cd10) adding auth protocol: cephx 2023-12-03T11:48:01.392 INFO:tasks.workunit.client.0.smithi003.stderr: -227> 2023-12-03T11:48:01.333+0000 7f992c532800 5 AuthRegistry(0x7ffdc5f4cd10) adding con mode: secure 2023-12-03T11:48:01.392 INFO:tasks.workunit.client.0.smithi003.stderr: -226> 2023-12-03T11:48:01.333+0000 7f992c532800 5 AuthRegistry(0x7ffdc5f4cd10) adding con mode: crc 2023-12-03T11:48:01.392 INFO:tasks.workunit.client.0.smithi003.stderr: -225> 2023-12-03T11:48:01.333+0000 7f992c532800 5 AuthRegistry(0x7ffdc5f4cd10) adding con mode: secure 2023-12-03T11:48:01.392 INFO:tasks.workunit.client.0.smithi003.stderr: -224> 2023-12-03T11:48:01.333+0000 7f992c532800 5 AuthRegistry(0x7ffdc5f4cd10) adding con mode: crc 2023-12-03T11:48:01.392 INFO:tasks.workunit.client.0.smithi003.stderr: -223> 2023-12-03T11:48:01.333+0000 7f992c532800 5 AuthRegistry(0x7ffdc5f4cd10) adding con mode: secure 2023-12-03T11:48:01.392 INFO:tasks.workunit.client.0.smithi003.stderr: -222> 2023-12-03T11:48:01.333+0000 7f992c532800 5 AuthRegistry(0x7ffdc5f4cd10) adding con mode: crc 2023-12-03T11:48:01.392 INFO:tasks.workunit.client.0.smithi003.stderr: -221> 2023-12-03T11:48:01.333+0000 7f992c532800 5 AuthRegistry(0x7ffdc5f4cd10) adding con mode: crc 2023-12-03T11:48:01.392 INFO:tasks.workunit.client.0.smithi003.stderr: -220> 2023-12-03T11:48:01.333+0000 7f992c532800 5 AuthRegistry(0x7ffdc5f4cd10) adding con mode: secure 2023-12-03T11:48:01.392 INFO:tasks.workunit.client.0.smithi003.stderr: -219> 2023-12-03T11:48:01.333+0000 7f992c532800 5 AuthRegistry(0x7ffdc5f4cd10) adding con mode: crc 2023-12-03T11:48:01.392 INFO:tasks.workunit.client.0.smithi003.stderr: -218> 2023-12-03T11:48:01.333+0000 7f992c532800 5 AuthRegistry(0x7ffdc5f4cd10) adding con mode: secure 2023-12-03T11:48:01.392 INFO:tasks.workunit.client.0.smithi003.stderr: -217> 2023-12-03T11:48:01.333+0000 7f98ee7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:48:01.392 INFO:tasks.workunit.client.0.smithi003.stderr: -216> 2023-12-03T11:48:01.333+0000 7f992c532800 5 AuthRegistry(0x7ffdc5f4cd10) adding con mode: crc 2023-12-03T11:48:01.392 INFO:tasks.workunit.client.0.smithi003.stderr: -215> 2023-12-03T11:48:01.333+0000 7f992c532800 5 AuthRegistry(0x7ffdc5f4cd10) adding con mode: secure 2023-12-03T11:48:01.393 INFO:tasks.workunit.client.0.smithi003.stderr: -214> 2023-12-03T11:48:01.333+0000 7f992c532800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:48:01.393 INFO:tasks.workunit.client.0.smithi003.stderr: -213> 2023-12-03T11:48:01.333+0000 7f992c532800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:48:01.393 INFO:tasks.workunit.client.0.smithi003.stderr: -212> 2023-12-03T11:48:01.333+0000 7f992c532800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:48:01.393 INFO:tasks.workunit.client.0.smithi003.stderr: -211> 2023-12-03T11:48:01.333+0000 7f992c532800 5 asok(0x55735d868a10) register_command cache list hook 0x55735da4cb00 2023-12-03T11:48:01.393 INFO:tasks.workunit.client.0.smithi003.stderr: -210> 2023-12-03T11:48:01.333+0000 7f992c532800 5 asok(0x55735d868a10) register_command cache inspect hook 0x55735da4cb00 2023-12-03T11:48:01.393 INFO:tasks.workunit.client.0.smithi003.stderr: -209> 2023-12-03T11:48:01.333+0000 7f992c532800 5 asok(0x55735d868a10) register_command cache erase hook 0x55735da4cb00 2023-12-03T11:48:01.393 INFO:tasks.workunit.client.0.smithi003.stderr: -208> 2023-12-03T11:48:01.333+0000 7f992c532800 5 asok(0x55735d868a10) register_command cache zap hook 0x55735da4cb00 2023-12-03T11:48:01.393 INFO:tasks.workunit.client.0.smithi003.stderr: -207> 2023-12-03T11:48:01.333+0000 7f992c532800 10 monclient: get_monmap_and_config 2023-12-03T11:48:01.393 INFO:tasks.workunit.client.0.smithi003.stderr: -206> 2023-12-03T11:48:01.333+0000 7f992c532800 10 monclient: build_initial_monmap 2023-12-03T11:48:01.393 INFO:tasks.workunit.client.0.smithi003.stderr: -205> 2023-12-03T11:48:01.333+0000 7f992c532800 1 build_initial for_mkfs: 0 2023-12-03T11:48:01.393 INFO:tasks.workunit.client.0.smithi003.stderr: -204> 2023-12-03T11:48:01.333+0000 7f992c532800 10 monclient: monmap: 2023-12-03T11:48:01.393 INFO:tasks.workunit.client.0.smithi003.stderr:epoch 0 2023-12-03T11:48:01.393 INFO:tasks.workunit.client.0.smithi003.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-12-03T11:48:01.393 INFO:tasks.workunit.client.0.smithi003.stderr:last_changed 0.000000 2023-12-03T11:48:01.393 INFO:tasks.workunit.client.0.smithi003.stderr:created 0.000000 2023-12-03T11:48:01.394 INFO:tasks.workunit.client.0.smithi003.stderr:min_mon_release 0 (unknown) 2023-12-03T11:48:01.394 INFO:tasks.workunit.client.0.smithi003.stderr:election_strategy: 1 2023-12-03T11:48:01.394 INFO:tasks.workunit.client.0.smithi003.stderr:0: [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] mon.noname-a 2023-12-03T11:48:01.394 INFO:tasks.workunit.client.0.smithi003.stderr:1: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.noname-b 2023-12-03T11:48:01.394 INFO:tasks.workunit.client.0.smithi003.stderr:2: [v2:172.21.15.3:3301/0,v1:172.21.15.3:6790/0] mon.noname-c 2023-12-03T11:48:01.394 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:48:01.394 INFO:tasks.workunit.client.0.smithi003.stderr: -203> 2023-12-03T11:48:01.333+0000 7f992c532800 5 AuthRegistry(0x55735db080a0) adding auth protocol: cephx 2023-12-03T11:48:01.394 INFO:tasks.workunit.client.0.smithi003.stderr: -202> 2023-12-03T11:48:01.333+0000 7f992c532800 5 AuthRegistry(0x55735db080a0) adding auth protocol: cephx 2023-12-03T11:48:01.394 INFO:tasks.workunit.client.0.smithi003.stderr: -201> 2023-12-03T11:48:01.333+0000 7f992c532800 5 AuthRegistry(0x55735db080a0) adding auth protocol: cephx 2023-12-03T11:48:01.394 INFO:tasks.workunit.client.0.smithi003.stderr: -200> 2023-12-03T11:48:01.333+0000 7f992c532800 5 AuthRegistry(0x55735db080a0) adding con mode: secure 2023-12-03T11:48:01.394 INFO:tasks.workunit.client.0.smithi003.stderr: -199> 2023-12-03T11:48:01.333+0000 7f992c532800 5 AuthRegistry(0x55735db080a0) adding con mode: crc 2023-12-03T11:48:01.394 INFO:tasks.workunit.client.0.smithi003.stderr: -198> 2023-12-03T11:48:01.333+0000 7f992c532800 5 AuthRegistry(0x55735db080a0) adding con mode: secure 2023-12-03T11:48:01.394 INFO:tasks.workunit.client.0.smithi003.stderr: -197> 2023-12-03T11:48:01.333+0000 7f992c532800 5 AuthRegistry(0x55735db080a0) adding con mode: crc 2023-12-03T11:48:01.394 INFO:tasks.workunit.client.0.smithi003.stderr: -196> 2023-12-03T11:48:01.333+0000 7f992c532800 5 AuthRegistry(0x55735db080a0) adding con mode: secure 2023-12-03T11:48:01.395 INFO:tasks.workunit.client.0.smithi003.stderr: -195> 2023-12-03T11:48:01.333+0000 7f992c532800 5 AuthRegistry(0x55735db080a0) adding con mode: crc 2023-12-03T11:48:01.395 INFO:tasks.workunit.client.0.smithi003.stderr: -194> 2023-12-03T11:48:01.333+0000 7f992c532800 5 AuthRegistry(0x55735db080a0) adding con mode: crc 2023-12-03T11:48:01.395 INFO:tasks.workunit.client.0.smithi003.stderr: -193> 2023-12-03T11:48:01.333+0000 7f992c532800 5 AuthRegistry(0x55735db080a0) adding con mode: secure 2023-12-03T11:48:01.395 INFO:tasks.workunit.client.0.smithi003.stderr: -192> 2023-12-03T11:48:01.333+0000 7f992c532800 5 AuthRegistry(0x55735db080a0) adding con mode: crc 2023-12-03T11:48:01.395 INFO:tasks.workunit.client.0.smithi003.stderr: -191> 2023-12-03T11:48:01.333+0000 7f992c532800 5 AuthRegistry(0x55735db080a0) adding con mode: secure 2023-12-03T11:48:01.395 INFO:tasks.workunit.client.0.smithi003.stderr: -190> 2023-12-03T11:48:01.333+0000 7f992c532800 5 AuthRegistry(0x55735db080a0) adding con mode: crc 2023-12-03T11:48:01.395 INFO:tasks.workunit.client.0.smithi003.stderr: -189> 2023-12-03T11:48:01.333+0000 7f992c532800 5 AuthRegistry(0x55735db080a0) adding con mode: secure 2023-12-03T11:48:01.395 INFO:tasks.workunit.client.0.smithi003.stderr: -188> 2023-12-03T11:48:01.333+0000 7f992c532800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:48:01.395 INFO:tasks.workunit.client.0.smithi003.stderr: -187> 2023-12-03T11:48:01.333+0000 7f992c532800 10 monclient: init 2023-12-03T11:48:01.395 INFO:tasks.workunit.client.0.smithi003.stderr: -186> 2023-12-03T11:48:01.333+0000 7f992c532800 5 AuthRegistry(0x7ffdc5f4c860) adding auth protocol: cephx 2023-12-03T11:48:01.395 INFO:tasks.workunit.client.0.smithi003.stderr: -185> 2023-12-03T11:48:01.333+0000 7f992c532800 5 AuthRegistry(0x7ffdc5f4c860) adding auth protocol: cephx 2023-12-03T11:48:01.395 INFO:tasks.workunit.client.0.smithi003.stderr: -184> 2023-12-03T11:48:01.333+0000 7f992c532800 5 AuthRegistry(0x7ffdc5f4c860) adding auth protocol: cephx 2023-12-03T11:48:01.395 INFO:tasks.workunit.client.0.smithi003.stderr: -183> 2023-12-03T11:48:01.333+0000 7f992c532800 5 AuthRegistry(0x7ffdc5f4c860) adding con mode: secure 2023-12-03T11:48:01.395 INFO:tasks.workunit.client.0.smithi003.stderr: -182> 2023-12-03T11:48:01.333+0000 7f992c532800 5 AuthRegistry(0x7ffdc5f4c860) adding con mode: crc 2023-12-03T11:48:01.395 INFO:tasks.workunit.client.0.smithi003.stderr: -181> 2023-12-03T11:48:01.333+0000 7f992c532800 5 AuthRegistry(0x7ffdc5f4c860) adding con mode: secure 2023-12-03T11:48:01.396 INFO:tasks.workunit.client.0.smithi003.stderr: -180> 2023-12-03T11:48:01.333+0000 7f992c532800 5 AuthRegistry(0x7ffdc5f4c860) adding con mode: crc 2023-12-03T11:48:01.396 INFO:tasks.workunit.client.0.smithi003.stderr: -179> 2023-12-03T11:48:01.333+0000 7f992c532800 5 AuthRegistry(0x7ffdc5f4c860) adding con mode: secure 2023-12-03T11:48:01.396 INFO:tasks.workunit.client.0.smithi003.stderr: -178> 2023-12-03T11:48:01.333+0000 7f992c532800 5 AuthRegistry(0x7ffdc5f4c860) adding con mode: crc 2023-12-03T11:48:01.396 INFO:tasks.workunit.client.0.smithi003.stderr: -177> 2023-12-03T11:48:01.333+0000 7f992c532800 5 AuthRegistry(0x7ffdc5f4c860) adding con mode: crc 2023-12-03T11:48:01.396 INFO:tasks.workunit.client.0.smithi003.stderr: -176> 2023-12-03T11:48:01.333+0000 7f992c532800 5 AuthRegistry(0x7ffdc5f4c860) adding con mode: secure 2023-12-03T11:48:01.396 INFO:tasks.workunit.client.0.smithi003.stderr: -175> 2023-12-03T11:48:01.333+0000 7f992c532800 5 AuthRegistry(0x7ffdc5f4c860) adding con mode: crc 2023-12-03T11:48:01.396 INFO:tasks.workunit.client.0.smithi003.stderr: -174> 2023-12-03T11:48:01.333+0000 7f992c532800 5 AuthRegistry(0x7ffdc5f4c860) adding con mode: secure 2023-12-03T11:48:01.396 INFO:tasks.workunit.client.0.smithi003.stderr: -173> 2023-12-03T11:48:01.333+0000 7f992c532800 5 AuthRegistry(0x7ffdc5f4c860) adding con mode: crc 2023-12-03T11:48:01.396 INFO:tasks.workunit.client.0.smithi003.stderr: -172> 2023-12-03T11:48:01.333+0000 7f992c532800 5 AuthRegistry(0x7ffdc5f4c860) adding con mode: secure 2023-12-03T11:48:01.396 INFO:tasks.workunit.client.0.smithi003.stderr: -171> 2023-12-03T11:48:01.334+0000 7f992c532800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:48:01.396 INFO:tasks.workunit.client.0.smithi003.stderr: -170> 2023-12-03T11:48:01.334+0000 7f992c532800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:48:01.396 INFO:tasks.workunit.client.0.smithi003.stderr: -169> 2023-12-03T11:48:01.334+0000 7f992c532800 5 asok(0x55735d868a10) register_command rotate-key cmddesc rotate-key hook 0x7ffdc5f4c9a8 EEXIST 2023-12-03T11:48:01.396 INFO:tasks.workunit.client.0.smithi003.stderr: -168> 2023-12-03T11:48:01.334+0000 7f992c532800 10 monclient: _reopen_session rank -1 2023-12-03T11:48:01.396 INFO:tasks.workunit.client.0.smithi003.stderr: -167> 2023-12-03T11:48:01.334+0000 7f992c532800 10 monclient: _add_conns ranks=[0,1,2] 2023-12-03T11:48:01.396 INFO:tasks.workunit.client.0.smithi003.stderr: -166> 2023-12-03T11:48:01.334+0000 7f992c532800 10 monclient(hunting): picked mon.noname-a con 0x55735db09170 addr [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] 2023-12-03T11:48:01.397 INFO:tasks.workunit.client.0.smithi003.stderr: -165> 2023-12-03T11:48:01.334+0000 7f992c532800 10 monclient(hunting): picked mon.noname-b con 0x55735db14b70 addr [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] 2023-12-03T11:48:01.397 INFO:tasks.workunit.client.0.smithi003.stderr: -164> 2023-12-03T11:48:01.334+0000 7f992c532800 10 monclient(hunting): picked mon.noname-c con 0x55735db0f5e0 addr [v2:172.21.15.3:3301/0,v1:172.21.15.3:6790/0] 2023-12-03T11:48:01.397 INFO:tasks.workunit.client.0.smithi003.stderr: -163> 2023-12-03T11:48:01.334+0000 7f992c532800 10 monclient(hunting): start opening mon connection 2023-12-03T11:48:01.397 INFO:tasks.workunit.client.0.smithi003.stderr: -162> 2023-12-03T11:48:01.334+0000 7f992c532800 10 monclient(hunting): start opening mon connection 2023-12-03T11:48:01.397 INFO:tasks.workunit.client.0.smithi003.stderr: -161> 2023-12-03T11:48:01.334+0000 7f992c532800 10 monclient(hunting): start opening mon connection 2023-12-03T11:48:01.397 INFO:tasks.workunit.client.0.smithi003.stderr: -160> 2023-12-03T11:48:01.334+0000 7f992c532800 10 monclient(hunting): _renew_subs 2023-12-03T11:48:01.397 INFO:tasks.workunit.client.0.smithi003.stderr: -159> 2023-12-03T11:48:01.334+0000 7f992c532800 10 monclient(hunting): authenticate will time out at 1703.572792s 2023-12-03T11:48:01.397 INFO:tasks.workunit.client.0.smithi003.stderr: -158> 2023-12-03T11:48:01.334+0000 7f992895c640 10 monclient(hunting): get_auth_request con 0x55735db09170 auth_method 0 2023-12-03T11:48:01.397 INFO:tasks.workunit.client.0.smithi003.stderr: -157> 2023-12-03T11:48:01.334+0000 7f992895c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:48:01.397 INFO:tasks.workunit.client.0.smithi003.stderr: -156> 2023-12-03T11:48:01.334+0000 7f992895c640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:48:01.397 INFO:tasks.workunit.client.0.smithi003.stderr: -155> 2023-12-03T11:48:01.334+0000 7f992895c640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:48:01.397 INFO:tasks.workunit.client.0.smithi003.stderr: -154> 2023-12-03T11:48:01.334+0000 7f992795a640 10 monclient(hunting): get_auth_request con 0x55735db0f5e0 auth_method 0 2023-12-03T11:48:01.397 INFO:tasks.workunit.client.0.smithi003.stderr: -153> 2023-12-03T11:48:01.334+0000 7f992795a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:48:01.397 INFO:tasks.workunit.client.0.smithi003.stderr: -152> 2023-12-03T11:48:01.334+0000 7f992795a640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:48:01.397 INFO:tasks.workunit.client.0.smithi003.stderr: -151> 2023-12-03T11:48:01.334+0000 7f992795a640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:48:01.398 INFO:tasks.workunit.client.0.smithi003.stderr: -150> 2023-12-03T11:48:01.334+0000 7f992895c640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:48:01.398 INFO:tasks.workunit.client.0.smithi003.stderr: -149> 2023-12-03T11:48:01.334+0000 7f992895c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:48:01.398 INFO:tasks.workunit.client.0.smithi003.stderr: -148> 2023-12-03T11:48:01.334+0000 7f992895c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:48:01.398 INFO:tasks.workunit.client.0.smithi003.stderr: -147> 2023-12-03T11:48:01.334+0000 7f992795a640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:48:01.398 INFO:tasks.workunit.client.0.smithi003.stderr: -146> 2023-12-03T11:48:01.334+0000 7f992795a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:48:01.398 INFO:tasks.workunit.client.0.smithi003.stderr: -145> 2023-12-03T11:48:01.334+0000 7f992795a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:48:01.398 INFO:tasks.workunit.client.0.smithi003.stderr: -144> 2023-12-03T11:48:01.334+0000 7f992815b640 10 monclient(hunting): get_auth_request con 0x55735db14b70 auth_method 0 2023-12-03T11:48:01.398 INFO:tasks.workunit.client.0.smithi003.stderr: -143> 2023-12-03T11:48:01.334+0000 7f992815b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:48:01.398 INFO:tasks.workunit.client.0.smithi003.stderr: -142> 2023-12-03T11:48:01.334+0000 7f992815b640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:48:01.398 INFO:tasks.workunit.client.0.smithi003.stderr: -141> 2023-12-03T11:48:01.334+0000 7f992815b640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:48:01.398 INFO:tasks.workunit.client.0.smithi003.stderr: -140> 2023-12-03T11:48:01.334+0000 7f992795a640 10 monclient(hunting): handle_auth_done global_id 6191 payload 274 2023-12-03T11:48:01.398 INFO:tasks.workunit.client.0.smithi003.stderr: -139> 2023-12-03T11:48:01.334+0000 7f992795a640 10 monclient: _finish_hunting 0 2023-12-03T11:48:01.398 INFO:tasks.workunit.client.0.smithi003.stderr: -138> 2023-12-03T11:48:01.334+0000 7f992795a640 1 monclient: found mon.noname-c 2023-12-03T11:48:01.398 INFO:tasks.workunit.client.0.smithi003.stderr: -137> 2023-12-03T11:48:01.334+0000 7f992795a640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.3:3301/0 2023-12-03T11:48:01.398 INFO:tasks.workunit.client.0.smithi003.stderr: -136> 2023-12-03T11:48:01.335+0000 7f98edfe3640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:48:01.399 INFO:tasks.workunit.client.0.smithi003.stderr: -135> 2023-12-03T11:48:01.335+0000 7f98edfe3640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-12-03T11:48:01.399 INFO:tasks.workunit.client.0.smithi003.stderr: -134> 2023-12-03T11:48:01.335+0000 7f98edfe3640 10 monclient: dump: 2023-12-03T11:48:01.399 INFO:tasks.workunit.client.0.smithi003.stderr:epoch 1 2023-12-03T11:48:01.399 INFO:tasks.workunit.client.0.smithi003.stderr:fsid 296556de-a4fc-4095-9b6d-0fe813c2865c 2023-12-03T11:48:01.399 INFO:tasks.workunit.client.0.smithi003.stderr:last_changed 2023-12-03T11:33:18.862564+0000 2023-12-03T11:48:01.399 INFO:tasks.workunit.client.0.smithi003.stderr:created 2023-12-03T11:33:18.862564+0000 2023-12-03T11:48:01.399 INFO:tasks.workunit.client.0.smithi003.stderr:min_mon_release 18 (reef) 2023-12-03T11:48:01.399 INFO:tasks.workunit.client.0.smithi003.stderr:election_strategy: 1 2023-12-03T11:48:01.399 INFO:tasks.workunit.client.0.smithi003.stderr:0: [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] mon.a 2023-12-03T11:48:01.399 INFO:tasks.workunit.client.0.smithi003.stderr:1: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.b 2023-12-03T11:48:01.399 INFO:tasks.workunit.client.0.smithi003.stderr:2: [v2:172.21.15.3:3301/0,v1:172.21.15.3:6790/0] mon.c 2023-12-03T11:48:01.399 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:48:01.399 INFO:tasks.workunit.client.0.smithi003.stderr: -133> 2023-12-03T11:48:01.335+0000 7f98edfe3640 10 monclient: _finish_auth 0 2023-12-03T11:48:01.399 INFO:tasks.workunit.client.0.smithi003.stderr: -132> 2023-12-03T11:48:01.335+0000 7f98edfe3640 10 monclient: _check_auth_tickets 2023-12-03T11:48:01.400 INFO:tasks.workunit.client.0.smithi003.stderr: -131> 2023-12-03T11:48:01.335+0000 7f98edfe3640 10 monclient: handle_config config(0 keys) v1 2023-12-03T11:48:01.400 INFO:tasks.workunit.client.0.smithi003.stderr: -130> 2023-12-03T11:48:01.335+0000 7f98edfe3640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:48:01.400 INFO:tasks.workunit.client.0.smithi003.stderr: -129> 2023-12-03T11:48:01.335+0000 7f98edfe3640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-12-03T11:48:01.400 INFO:tasks.workunit.client.0.smithi003.stderr: -128> 2023-12-03T11:48:01.335+0000 7f98edfe3640 10 monclient: dump: 2023-12-03T11:48:01.400 INFO:tasks.workunit.client.0.smithi003.stderr:epoch 1 2023-12-03T11:48:01.400 INFO:tasks.workunit.client.0.smithi003.stderr:fsid 296556de-a4fc-4095-9b6d-0fe813c2865c 2023-12-03T11:48:01.400 INFO:tasks.workunit.client.0.smithi003.stderr:last_changed 2023-12-03T11:33:18.862564+0000 2023-12-03T11:48:01.400 INFO:tasks.workunit.client.0.smithi003.stderr:created 2023-12-03T11:33:18.862564+0000 2023-12-03T11:48:01.400 INFO:tasks.workunit.client.0.smithi003.stderr:min_mon_release 18 (reef) 2023-12-03T11:48:01.400 INFO:tasks.workunit.client.0.smithi003.stderr:election_strategy: 1 2023-12-03T11:48:01.400 INFO:tasks.workunit.client.0.smithi003.stderr:0: [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] mon.a 2023-12-03T11:48:01.400 INFO:tasks.workunit.client.0.smithi003.stderr:1: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.b 2023-12-03T11:48:01.400 INFO:tasks.workunit.client.0.smithi003.stderr:2: [v2:172.21.15.3:3301/0,v1:172.21.15.3:6790/0] mon.c 2023-12-03T11:48:01.401 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:48:01.401 INFO:tasks.workunit.client.0.smithi003.stderr: -127> 2023-12-03T11:48:01.335+0000 7f992c532800 5 monclient: authenticate success, global_id 6191 2023-12-03T11:48:01.401 INFO:tasks.workunit.client.0.smithi003.stderr: -126> 2023-12-03T11:48:01.335+0000 7f992c532800 10 monclient: get_monmap_and_config success 2023-12-03T11:48:01.401 INFO:tasks.workunit.client.0.smithi003.stderr: -125> 2023-12-03T11:48:01.335+0000 7f992c532800 4 set_mon_vals no callback set 2023-12-03T11:48:01.401 INFO:tasks.workunit.client.0.smithi003.stderr: -124> 2023-12-03T11:48:01.335+0000 7f992c532800 10 monclient: shutdown 2023-12-03T11:48:01.401 INFO:tasks.workunit.client.0.smithi003.stderr: -123> 2023-12-03T11:48:01.335+0000 7f992c532800 10 monclient: build_initial_monmap 2023-12-03T11:48:01.401 INFO:tasks.workunit.client.0.smithi003.stderr: -122> 2023-12-03T11:48:01.335+0000 7f992c532800 1 build_initial for_mkfs: 0 2023-12-03T11:48:01.401 INFO:tasks.workunit.client.0.smithi003.stderr: -121> 2023-12-03T11:48:01.335+0000 7f992c532800 10 monclient: monmap: 2023-12-03T11:48:01.401 INFO:tasks.workunit.client.0.smithi003.stderr:epoch 0 2023-12-03T11:48:01.401 INFO:tasks.workunit.client.0.smithi003.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-12-03T11:48:01.401 INFO:tasks.workunit.client.0.smithi003.stderr:last_changed 0.000000 2023-12-03T11:48:01.401 INFO:tasks.workunit.client.0.smithi003.stderr:created 0.000000 2023-12-03T11:48:01.401 INFO:tasks.workunit.client.0.smithi003.stderr:min_mon_release 0 (unknown) 2023-12-03T11:48:01.401 INFO:tasks.workunit.client.0.smithi003.stderr:election_strategy: 1 2023-12-03T11:48:01.401 INFO:tasks.workunit.client.0.smithi003.stderr:0: [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] mon.noname-a 2023-12-03T11:48:01.402 INFO:tasks.workunit.client.0.smithi003.stderr:1: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.noname-b 2023-12-03T11:48:01.402 INFO:tasks.workunit.client.0.smithi003.stderr:2: [v2:172.21.15.3:3301/0,v1:172.21.15.3:6790/0] mon.noname-c 2023-12-03T11:48:01.402 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:48:01.402 INFO:tasks.workunit.client.0.smithi003.stderr: -120> 2023-12-03T11:48:01.335+0000 7f992c532800 5 AuthRegistry(0x55735db080a0) adding auth protocol: cephx 2023-12-03T11:48:01.402 INFO:tasks.workunit.client.0.smithi003.stderr: -119> 2023-12-03T11:48:01.335+0000 7f992c532800 5 AuthRegistry(0x55735db080a0) adding auth protocol: cephx 2023-12-03T11:48:01.402 INFO:tasks.workunit.client.0.smithi003.stderr: -118> 2023-12-03T11:48:01.335+0000 7f992c532800 5 AuthRegistry(0x55735db080a0) adding auth protocol: cephx 2023-12-03T11:48:01.402 INFO:tasks.workunit.client.0.smithi003.stderr: -117> 2023-12-03T11:48:01.336+0000 7f992c532800 5 AuthRegistry(0x55735db080a0) adding con mode: secure 2023-12-03T11:48:01.402 INFO:tasks.workunit.client.0.smithi003.stderr: -116> 2023-12-03T11:48:01.336+0000 7f992c532800 5 AuthRegistry(0x55735db080a0) adding con mode: crc 2023-12-03T11:48:01.402 INFO:tasks.workunit.client.0.smithi003.stderr: -115> 2023-12-03T11:48:01.336+0000 7f992c532800 5 AuthRegistry(0x55735db080a0) adding con mode: secure 2023-12-03T11:48:01.402 INFO:tasks.workunit.client.0.smithi003.stderr: -114> 2023-12-03T11:48:01.336+0000 7f992c532800 5 AuthRegistry(0x55735db080a0) adding con mode: crc 2023-12-03T11:48:01.402 INFO:tasks.workunit.client.0.smithi003.stderr: -113> 2023-12-03T11:48:01.336+0000 7f992c532800 5 AuthRegistry(0x55735db080a0) adding con mode: secure 2023-12-03T11:48:01.402 INFO:tasks.workunit.client.0.smithi003.stderr: -112> 2023-12-03T11:48:01.336+0000 7f992c532800 5 AuthRegistry(0x55735db080a0) adding con mode: crc 2023-12-03T11:48:01.402 INFO:tasks.workunit.client.0.smithi003.stderr: -111> 2023-12-03T11:48:01.336+0000 7f992c532800 5 AuthRegistry(0x55735db080a0) adding con mode: crc 2023-12-03T11:48:01.402 INFO:tasks.workunit.client.0.smithi003.stderr: -110> 2023-12-03T11:48:01.336+0000 7f992c532800 5 AuthRegistry(0x55735db080a0) adding con mode: secure 2023-12-03T11:48:01.403 INFO:tasks.workunit.client.0.smithi003.stderr: -109> 2023-12-03T11:48:01.336+0000 7f992c532800 5 AuthRegistry(0x55735db080a0) adding con mode: crc 2023-12-03T11:48:01.403 INFO:tasks.workunit.client.0.smithi003.stderr: -108> 2023-12-03T11:48:01.336+0000 7f992c532800 5 AuthRegistry(0x55735db080a0) adding con mode: secure 2023-12-03T11:48:01.403 INFO:tasks.workunit.client.0.smithi003.stderr: -107> 2023-12-03T11:48:01.336+0000 7f992c532800 5 AuthRegistry(0x55735db080a0) adding con mode: crc 2023-12-03T11:48:01.403 INFO:tasks.workunit.client.0.smithi003.stderr: -106> 2023-12-03T11:48:01.336+0000 7f992c532800 5 AuthRegistry(0x55735db080a0) adding con mode: secure 2023-12-03T11:48:01.403 INFO:tasks.workunit.client.0.smithi003.stderr: -105> 2023-12-03T11:48:01.336+0000 7f992c532800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:48:01.403 INFO:tasks.workunit.client.0.smithi003.stderr: -104> 2023-12-03T11:48:01.336+0000 7f992c532800 1 librados: starting msgr at 2023-12-03T11:48:01.403 INFO:tasks.workunit.client.0.smithi003.stderr: -103> 2023-12-03T11:48:01.336+0000 7f992c532800 1 librados: starting objecter 2023-12-03T11:48:01.403 INFO:tasks.workunit.client.0.smithi003.stderr: -102> 2023-12-03T11:48:01.336+0000 7f992c532800 5 asok(0x55735d868a10) register_command objecter_requests cmddesc objecter_requests hook 0x55735dad05b0 EEXIST 2023-12-03T11:48:01.403 INFO:tasks.workunit.client.0.smithi003.stderr: -101> 2023-12-03T11:48:01.336+0000 7f992c532800 1 librados: setting wanted keys 2023-12-03T11:48:01.403 INFO:tasks.workunit.client.0.smithi003.stderr: -100> 2023-12-03T11:48:01.336+0000 7f992c532800 1 librados: calling monclient init 2023-12-03T11:48:01.403 INFO:tasks.workunit.client.0.smithi003.stderr: -99> 2023-12-03T11:48:01.336+0000 7f992c532800 10 monclient: init 2023-12-03T11:48:01.403 INFO:tasks.workunit.client.0.smithi003.stderr: -98> 2023-12-03T11:48:01.336+0000 7f992c532800 5 AuthRegistry(0x55735db0af38) adding auth protocol: cephx 2023-12-03T11:48:01.403 INFO:tasks.workunit.client.0.smithi003.stderr: -97> 2023-12-03T11:48:01.336+0000 7f992c532800 5 AuthRegistry(0x55735db0af38) adding auth protocol: cephx 2023-12-03T11:48:01.403 INFO:tasks.workunit.client.0.smithi003.stderr: -96> 2023-12-03T11:48:01.336+0000 7f992c532800 5 AuthRegistry(0x55735db0af38) adding auth protocol: cephx 2023-12-03T11:48:01.403 INFO:tasks.workunit.client.0.smithi003.stderr: -95> 2023-12-03T11:48:01.336+0000 7f992c532800 5 AuthRegistry(0x55735db0af38) adding con mode: secure 2023-12-03T11:48:01.404 INFO:tasks.workunit.client.0.smithi003.stderr: -94> 2023-12-03T11:48:01.336+0000 7f992c532800 5 AuthRegistry(0x55735db0af38) adding con mode: crc 2023-12-03T11:48:01.404 INFO:tasks.workunit.client.0.smithi003.stderr: -93> 2023-12-03T11:48:01.336+0000 7f992c532800 5 AuthRegistry(0x55735db0af38) adding con mode: secure 2023-12-03T11:48:01.404 INFO:tasks.workunit.client.0.smithi003.stderr: -92> 2023-12-03T11:48:01.336+0000 7f992c532800 5 AuthRegistry(0x55735db0af38) adding con mode: crc 2023-12-03T11:48:01.404 INFO:tasks.workunit.client.0.smithi003.stderr: -91> 2023-12-03T11:48:01.336+0000 7f992c532800 5 AuthRegistry(0x55735db0af38) adding con mode: secure 2023-12-03T11:48:01.404 INFO:tasks.workunit.client.0.smithi003.stderr: -90> 2023-12-03T11:48:01.336+0000 7f992c532800 5 AuthRegistry(0x55735db0af38) adding con mode: crc 2023-12-03T11:48:01.404 INFO:tasks.workunit.client.0.smithi003.stderr: -89> 2023-12-03T11:48:01.336+0000 7f992c532800 5 AuthRegistry(0x55735db0af38) adding con mode: crc 2023-12-03T11:48:01.404 INFO:tasks.workunit.client.0.smithi003.stderr: -88> 2023-12-03T11:48:01.336+0000 7f992c532800 5 AuthRegistry(0x55735db0af38) adding con mode: secure 2023-12-03T11:48:01.404 INFO:tasks.workunit.client.0.smithi003.stderr: -87> 2023-12-03T11:48:01.336+0000 7f992c532800 5 AuthRegistry(0x55735db0af38) adding con mode: crc 2023-12-03T11:48:01.404 INFO:tasks.workunit.client.0.smithi003.stderr: -86> 2023-12-03T11:48:01.336+0000 7f992c532800 5 AuthRegistry(0x55735db0af38) adding con mode: secure 2023-12-03T11:48:01.404 INFO:tasks.workunit.client.0.smithi003.stderr: -85> 2023-12-03T11:48:01.336+0000 7f992c532800 5 AuthRegistry(0x55735db0af38) adding con mode: crc 2023-12-03T11:48:01.404 INFO:tasks.workunit.client.0.smithi003.stderr: -84> 2023-12-03T11:48:01.336+0000 7f992c532800 5 AuthRegistry(0x55735db0af38) adding con mode: secure 2023-12-03T11:48:01.404 INFO:tasks.workunit.client.0.smithi003.stderr: -83> 2023-12-03T11:48:01.336+0000 7f992c532800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:48:01.404 INFO:tasks.workunit.client.0.smithi003.stderr: -82> 2023-12-03T11:48:01.336+0000 7f992c532800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:48:01.404 INFO:tasks.workunit.client.0.smithi003.stderr: -81> 2023-12-03T11:48:01.336+0000 7f992c532800 5 asok(0x55735d868a10) register_command rotate-key cmddesc rotate-key hook 0x55735db0b080 EEXIST 2023-12-03T11:48:01.404 INFO:tasks.workunit.client.0.smithi003.stderr: -80> 2023-12-03T11:48:01.336+0000 7f992c532800 10 monclient: _reopen_session rank -1 2023-12-03T11:48:01.405 INFO:tasks.workunit.client.0.smithi003.stderr: -79> 2023-12-03T11:48:01.336+0000 7f992c532800 10 monclient: _add_conns ranks=[1,0,2] 2023-12-03T11:48:01.405 INFO:tasks.workunit.client.0.smithi003.stderr: -78> 2023-12-03T11:48:01.336+0000 7f992c532800 10 monclient(hunting): picked mon.noname-b con 0x55735db09170 addr [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] 2023-12-03T11:48:01.405 INFO:tasks.workunit.client.0.smithi003.stderr: -77> 2023-12-03T11:48:01.336+0000 7f992c532800 10 monclient(hunting): picked mon.noname-a con 0x55735db0f5e0 addr [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] 2023-12-03T11:48:01.405 INFO:tasks.workunit.client.0.smithi003.stderr: -76> 2023-12-03T11:48:01.336+0000 7f992c532800 10 monclient(hunting): picked mon.noname-c con 0x55735db14b70 addr [v2:172.21.15.3:3301/0,v1:172.21.15.3:6790/0] 2023-12-03T11:48:01.405 INFO:tasks.workunit.client.0.smithi003.stderr: -75> 2023-12-03T11:48:01.336+0000 7f992c532800 10 monclient(hunting): start opening mon connection 2023-12-03T11:48:01.405 INFO:tasks.workunit.client.0.smithi003.stderr: -74> 2023-12-03T11:48:01.336+0000 7f992c532800 10 monclient(hunting): start opening mon connection 2023-12-03T11:48:01.405 INFO:tasks.workunit.client.0.smithi003.stderr: -73> 2023-12-03T11:48:01.336+0000 7f992c532800 10 monclient(hunting): start opening mon connection 2023-12-03T11:48:01.405 INFO:tasks.workunit.client.0.smithi003.stderr: -72> 2023-12-03T11:48:01.336+0000 7f992c532800 10 monclient(hunting): _renew_subs 2023-12-03T11:48:01.405 INFO:tasks.workunit.client.0.smithi003.stderr: -71> 2023-12-03T11:48:01.336+0000 7f992c532800 10 monclient(hunting): authenticate will time out at 1703.575298s 2023-12-03T11:48:01.405 INFO:tasks.workunit.client.0.smithi003.stderr: -70> 2023-12-03T11:48:01.337+0000 7f992815b640 10 monclient(hunting): get_auth_request con 0x55735db0f5e0 auth_method 0 2023-12-03T11:48:01.405 INFO:tasks.workunit.client.0.smithi003.stderr: -69> 2023-12-03T11:48:01.337+0000 7f992815b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:48:01.405 INFO:tasks.workunit.client.0.smithi003.stderr: -68> 2023-12-03T11:48:01.337+0000 7f992815b640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:48:01.405 INFO:tasks.workunit.client.0.smithi003.stderr: -67> 2023-12-03T11:48:01.337+0000 7f992815b640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:48:01.405 INFO:tasks.workunit.client.0.smithi003.stderr: -66> 2023-12-03T11:48:01.337+0000 7f992795a640 10 monclient(hunting): get_auth_request con 0x55735db14b70 auth_method 0 2023-12-03T11:48:01.405 INFO:tasks.workunit.client.0.smithi003.stderr: -65> 2023-12-03T11:48:01.337+0000 7f992795a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:48:01.405 INFO:tasks.workunit.client.0.smithi003.stderr: -64> 2023-12-03T11:48:01.337+0000 7f992795a640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:48:01.406 INFO:tasks.workunit.client.0.smithi003.stderr: -63> 2023-12-03T11:48:01.337+0000 7f992795a640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:48:01.406 INFO:tasks.workunit.client.0.smithi003.stderr: -62> 2023-12-03T11:48:01.337+0000 7f992815b640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:48:01.406 INFO:tasks.workunit.client.0.smithi003.stderr: -61> 2023-12-03T11:48:01.337+0000 7f992815b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:48:01.406 INFO:tasks.workunit.client.0.smithi003.stderr: -60> 2023-12-03T11:48:01.337+0000 7f992815b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:48:01.406 INFO:tasks.workunit.client.0.smithi003.stderr: -59> 2023-12-03T11:48:01.337+0000 7f992895c640 10 monclient(hunting): get_auth_request con 0x55735db09170 auth_method 0 2023-12-03T11:48:01.406 INFO:tasks.workunit.client.0.smithi003.stderr: -58> 2023-12-03T11:48:01.337+0000 7f992895c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:48:01.406 INFO:tasks.workunit.client.0.smithi003.stderr: -57> 2023-12-03T11:48:01.337+0000 7f992895c640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:48:01.406 INFO:tasks.workunit.client.0.smithi003.stderr: -56> 2023-12-03T11:48:01.337+0000 7f992895c640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:48:01.406 INFO:tasks.workunit.client.0.smithi003.stderr: -55> 2023-12-03T11:48:01.337+0000 7f992795a640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:48:01.406 INFO:tasks.workunit.client.0.smithi003.stderr: -54> 2023-12-03T11:48:01.337+0000 7f992795a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:48:01.406 INFO:tasks.workunit.client.0.smithi003.stderr: -53> 2023-12-03T11:48:01.337+0000 7f992795a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:48:01.406 INFO:tasks.workunit.client.0.smithi003.stderr: -52> 2023-12-03T11:48:01.337+0000 7f992895c640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:48:01.406 INFO:tasks.workunit.client.0.smithi003.stderr: -51> 2023-12-03T11:48:01.337+0000 7f992895c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:48:01.406 INFO:tasks.workunit.client.0.smithi003.stderr: -50> 2023-12-03T11:48:01.337+0000 7f992895c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:48:01.407 INFO:tasks.workunit.client.0.smithi003.stderr: -49> 2023-12-03T11:48:01.337+0000 7f992815b640 10 monclient(hunting): handle_auth_done global_id 6549 payload 824 2023-12-03T11:48:01.407 INFO:tasks.workunit.client.0.smithi003.stderr: -48> 2023-12-03T11:48:01.337+0000 7f992815b640 10 monclient: _finish_hunting 0 2023-12-03T11:48:01.407 INFO:tasks.workunit.client.0.smithi003.stderr: -47> 2023-12-03T11:48:01.337+0000 7f992815b640 1 monclient: found mon.noname-a 2023-12-03T11:48:01.407 INFO:tasks.workunit.client.0.smithi003.stderr: -46> 2023-12-03T11:48:01.337+0000 7f992815b640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.3:3300/0 2023-12-03T11:48:01.407 INFO:tasks.workunit.client.0.smithi003.stderr: -45> 2023-12-03T11:48:01.337+0000 7f985ffff640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:48:01.407 INFO:tasks.workunit.client.0.smithi003.stderr: -44> 2023-12-03T11:48:01.337+0000 7f985ffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-12-03T11:48:01.407 INFO:tasks.workunit.client.0.smithi003.stderr: -43> 2023-12-03T11:48:01.337+0000 7f985ffff640 10 monclient: dump: 2023-12-03T11:48:01.407 INFO:tasks.workunit.client.0.smithi003.stderr:epoch 1 2023-12-03T11:48:01.407 INFO:tasks.workunit.client.0.smithi003.stderr:fsid 296556de-a4fc-4095-9b6d-0fe813c2865c 2023-12-03T11:48:01.407 INFO:tasks.workunit.client.0.smithi003.stderr:last_changed 2023-12-03T11:33:18.862564+0000 2023-12-03T11:48:01.407 INFO:tasks.workunit.client.0.smithi003.stderr:created 2023-12-03T11:33:18.862564+0000 2023-12-03T11:48:01.407 INFO:tasks.workunit.client.0.smithi003.stderr:min_mon_release 18 (reef) 2023-12-03T11:48:01.407 INFO:tasks.workunit.client.0.smithi003.stderr:election_strategy: 1 2023-12-03T11:48:01.407 INFO:tasks.workunit.client.0.smithi003.stderr:0: [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] mon.a 2023-12-03T11:48:01.407 INFO:tasks.workunit.client.0.smithi003.stderr:1: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.b 2023-12-03T11:48:01.408 INFO:tasks.workunit.client.0.smithi003.stderr:2: [v2:172.21.15.3:3301/0,v1:172.21.15.3:6790/0] mon.c 2023-12-03T11:48:01.408 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:48:01.408 INFO:tasks.workunit.client.0.smithi003.stderr: -42> 2023-12-03T11:48:01.337+0000 7f985ffff640 10 monclient: _finish_auth 0 2023-12-03T11:48:01.408 INFO:tasks.workunit.client.0.smithi003.stderr: -41> 2023-12-03T11:48:01.337+0000 7f985ffff640 10 monclient: _check_auth_tickets 2023-12-03T11:48:01.408 INFO:tasks.workunit.client.0.smithi003.stderr: -40> 2023-12-03T11:48:01.337+0000 7f985ffff640 10 monclient: handle_config config(0 keys) v1 2023-12-03T11:48:01.408 INFO:tasks.workunit.client.0.smithi003.stderr: -39> 2023-12-03T11:48:01.337+0000 7f985ffff640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:48:01.408 INFO:tasks.workunit.client.0.smithi003.stderr: -38> 2023-12-03T11:48:01.337+0000 7f985ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-12-03T11:48:01.408 INFO:tasks.workunit.client.0.smithi003.stderr: -37> 2023-12-03T11:48:01.337+0000 7f985ffff640 10 monclient: dump: 2023-12-03T11:48:01.408 INFO:tasks.workunit.client.0.smithi003.stderr:epoch 1 2023-12-03T11:48:01.408 INFO:tasks.workunit.client.0.smithi003.stderr:fsid 296556de-a4fc-4095-9b6d-0fe813c2865c 2023-12-03T11:48:01.408 INFO:tasks.workunit.client.0.smithi003.stderr:last_changed 2023-12-03T11:33:18.862564+0000 2023-12-03T11:48:01.408 INFO:tasks.workunit.client.0.smithi003.stderr:created 2023-12-03T11:33:18.862564+0000 2023-12-03T11:48:01.408 INFO:tasks.workunit.client.0.smithi003.stderr:min_mon_release 18 (reef) 2023-12-03T11:48:01.408 INFO:tasks.workunit.client.0.smithi003.stderr:election_strategy: 1 2023-12-03T11:48:01.408 INFO:tasks.workunit.client.0.smithi003.stderr:0: [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] mon.a 2023-12-03T11:48:01.408 INFO:tasks.workunit.client.0.smithi003.stderr:1: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.b 2023-12-03T11:48:01.409 INFO:tasks.workunit.client.0.smithi003.stderr:2: [v2:172.21.15.3:3301/0,v1:172.21.15.3:6790/0] mon.c 2023-12-03T11:48:01.409 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:48:01.409 INFO:tasks.workunit.client.0.smithi003.stderr: -36> 2023-12-03T11:48:01.337+0000 7f992c532800 5 monclient: authenticate success, global_id 6549 2023-12-03T11:48:01.409 INFO:tasks.workunit.client.0.smithi003.stderr: -35> 2023-12-03T11:48:01.337+0000 7f98edfe3640 4 set_mon_vals no callback set 2023-12-03T11:48:01.409 INFO:tasks.workunit.client.0.smithi003.stderr: -34> 2023-12-03T11:48:01.337+0000 7f992c532800 10 monclient: _renew_subs 2023-12-03T11:48:01.409 INFO:tasks.workunit.client.0.smithi003.stderr: -33> 2023-12-03T11:48:01.337+0000 7f992c532800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.3:3300/0 2023-12-03T11:48:01.409 INFO:tasks.workunit.client.0.smithi003.stderr: -32> 2023-12-03T11:48:01.337+0000 7f992c532800 10 monclient: _renew_subs 2023-12-03T11:48:01.409 INFO:tasks.workunit.client.0.smithi003.stderr: -31> 2023-12-03T11:48:01.337+0000 7f992c532800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.3:3300/0 2023-12-03T11:48:01.409 INFO:tasks.workunit.client.0.smithi003.stderr: -30> 2023-12-03T11:48:01.337+0000 7f992c532800 1 librados: init done 2023-12-03T11:48:01.409 INFO:tasks.workunit.client.0.smithi003.stderr: -29> 2023-12-03T11:48:01.337+0000 7f992c532800 5 asok(0x55735d868a10) register_command cr dump hook 0x55735db14a88 2023-12-03T11:48:01.409 INFO:tasks.workunit.client.0.smithi003.stderr: -28> 2023-12-03T11:48:01.339+0000 7f985ffff640 4 mgrc handle_mgr_map Got map version 5 2023-12-03T11:48:01.409 INFO:tasks.workunit.client.0.smithi003.stderr: -27> 2023-12-03T11:48:01.339+0000 7f985ffff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.37:6832/2165065416,v1:172.21.15.37:6833/2165065416] 2023-12-03T11:48:01.409 INFO:tasks.workunit.client.0.smithi003.stderr: -26> 2023-12-03T11:48:01.339+0000 7f985ffff640 4 mgrc reconnect Starting new session with [v2:172.21.15.37:6832/2165065416,v1:172.21.15.37:6833/2165065416] 2023-12-03T11:48:01.409 INFO:tasks.workunit.client.0.smithi003.stderr: -25> 2023-12-03T11:48:01.339+0000 7f992c532800 5 note: GC not initialized 2023-12-03T11:48:01.409 INFO:tasks.workunit.client.0.smithi003.stderr: -24> 2023-12-03T11:48:01.339+0000 7f992895c640 10 monclient: get_auth_request con 0x7f9864069820 auth_method 0 2023-12-03T11:48:01.410 INFO:tasks.workunit.client.0.smithi003.stderr: -23> 2023-12-03T11:48:01.339+0000 7f985d7fa640 20 reqs_thread_entry: start 2023-12-03T11:48:01.410 INFO:tasks.workunit.client.0.smithi003.stderr: -22> 2023-12-03T11:48:01.339+0000 7f992c532800 5 asok(0x55735d868a10) register_command sync trace show hook 0x7f9920004720 2023-12-03T11:48:01.410 INFO:tasks.workunit.client.0.smithi003.stderr: -21> 2023-12-03T11:48:01.339+0000 7f992c532800 5 asok(0x55735d868a10) register_command sync trace history hook 0x7f9920004720 2023-12-03T11:48:01.410 INFO:tasks.workunit.client.0.smithi003.stderr: -20> 2023-12-03T11:48:01.339+0000 7f992c532800 5 asok(0x55735d868a10) register_command sync trace active hook 0x7f9920004720 2023-12-03T11:48:01.410 INFO:tasks.workunit.client.0.smithi003.stderr: -19> 2023-12-03T11:48:01.339+0000 7f992c532800 5 asok(0x55735d868a10) register_command sync trace active_short hook 0x7f9920004720 2023-12-03T11:48:01.410 INFO:tasks.workunit.client.0.smithi003.stderr: -18> 2023-12-03T11:48:01.339+0000 7f992c532800 20 init_complete bucket index max shards: 11 2023-12-03T11:48:01.410 INFO:tasks.workunit.client.0.smithi003.stderr: -17> 2023-12-03T11:48:01.339+0000 7f992c532800 20 Filter name: none 2023-12-03T11:48:01.410 INFO:tasks.workunit.client.0.smithi003.stderr: -16> 2023-12-03T11:48:01.340+0000 7f9856ffd640 20 reqs_thread_entry: start 2023-12-03T11:48:01.410 INFO:tasks.workunit.client.0.smithi003.stderr: -15> 2023-12-03T11:48:01.340+0000 7f992c532800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2023-12-03T11:48:01.410 INFO:tasks.workunit.client.0.smithi003.stderr: -14> 2023-12-03T11:48:01.340+0000 7f992c532800 20 rados->read ofs=0 len=0 2023-12-03T11:48:01.410 INFO:tasks.workunit.client.0.smithi003.stderr: -13> 2023-12-03T11:48:01.340+0000 7f992c532800 20 rados_obj.operate() r=0 bl.length=218 2023-12-03T11:48:01.410 INFO:tasks.workunit.client.0.smithi003.stderr: -12> 2023-12-03T11:48:01.340+0000 7f992c532800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2023-12-03T11:48:01.410 INFO:tasks.workunit.client.0.smithi003.stderr: -11> 2023-12-03T11:48:01.340+0000 7f992c532800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2023-12-03T11:48:01.410 INFO:tasks.workunit.client.0.smithi003.stderr: -10> 2023-12-03T11:48:01.340+0000 7f992c532800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.21 : miss 2023-12-03T11:48:01.410 INFO:tasks.workunit.client.0.smithi003.stderr: -9> 2023-12-03T11:48:01.340+0000 7f992c532800 20 rados->read ofs=0 len=0 2023-12-03T11:48:01.411 INFO:tasks.workunit.client.0.smithi003.stderr: -8> 2023-12-03T11:48:01.341+0000 7f992c532800 20 rados_obj.operate() r=0 bl.length=390 2023-12-03T11:48:01.411 INFO:tasks.workunit.client.0.smithi003.stderr: -7> 2023-12-03T11:48:01.341+0000 7f992c532800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.21 info.flags=0x17 2023-12-03T11:48:01.411 INFO:tasks.workunit.client.0.smithi003.stderr: -6> 2023-12-03T11:48:01.341+0000 7f992c532800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.21 to cache LRU end 2023-12-03T11:48:01.411 INFO:tasks.workunit.client.0.smithi003.stderr: -5> 2023-12-03T11:48:01.341+0000 7f992c532800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:48:01.411 INFO:tasks.workunit.client.0.smithi003.stderr: -4> 2023-12-03T11:48:01.341+0000 7f992c532800 10 updating xattr: name=user.rgw.acl bl.length()=265 2023-12-03T11:48:01.411 INFO:tasks.workunit.client.0.smithi003.stderr: -3> 2023-12-03T11:48:01.341+0000 7f992c532800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.21 2023-12-03T11:48:01.411 INFO:tasks.workunit.client.0.smithi003.stderr: -2> 2023-12-03T11:48:01.341+0000 7f992795a640 10 monclient: get_auth_request con 0x55735db583b0 auth_method 0 2023-12-03T11:48:01.411 INFO:tasks.workunit.client.0.smithi003.stderr: -1> 2023-12-03T11:48:01.345+0000 7f992c532800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7537-gbcbf278c/rpm/el9/BUILD/ceph-18.0.0-7537-gbcbf278c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f992c532800 time 2023-12-03T11:48:01.346191+0000 2023-12-03T11:48:01.411 INFO:tasks.workunit.client.0.smithi003.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7537-gbcbf278c/rpm/el9/BUILD/ceph-18.0.0-7537-gbcbf278c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2023-12-03T11:48:01.411 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:48:01.411 INFO:tasks.workunit.client.0.smithi003.stderr: ceph version 18.0.0-7537-gbcbf278c (bcbf278cf395873c2a482f5a7b2345faf2160319) reef (dev) 2023-12-03T11:48:01.411 INFO:tasks.workunit.client.0.smithi003.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f992f16eef8] 2023-12-03T11:48:01.411 INFO:tasks.workunit.client.0.smithi003.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f0b6) [0x7f992f16f0b6] 2023-12-03T11:48:01.411 INFO:tasks.workunit.client.0.smithi003.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55735c97ba71] 2023-12-03T11:48:01.411 INFO:tasks.workunit.client.0.smithi003.stderr: 4: radosgw-admin(+0x79787a) [0x55735c98387a] 2023-12-03T11:48:01.412 INFO:tasks.workunit.client.0.smithi003.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x24b) [0x55735c987e6b] 2023-12-03T11:48:01.412 INFO:tasks.workunit.client.0.smithi003.stderr: 6: main() 2023-12-03T11:48:01.412 INFO:tasks.workunit.client.0.smithi003.stderr: 7: /lib64/libc.so.6(+0x3feb0) [0x7f992c83feb0] 2023-12-03T11:48:01.412 INFO:tasks.workunit.client.0.smithi003.stderr: 8: __libc_start_main() 2023-12-03T11:48:01.412 INFO:tasks.workunit.client.0.smithi003.stderr: 9: _start() 2023-12-03T11:48:01.412 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:48:01.412 INFO:tasks.workunit.client.0.smithi003.stderr: 0> 2023-12-03T11:48:01.346+0000 7f992c532800 -1 *** Caught signal (Aborted) ** 2023-12-03T11:48:01.412 INFO:tasks.workunit.client.0.smithi003.stderr: in thread 7f992c532800 thread_name:radosgw-admin 2023-12-03T11:48:01.412 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:48:01.412 INFO:tasks.workunit.client.0.smithi003.stderr: ceph version 18.0.0-7537-gbcbf278c (bcbf278cf395873c2a482f5a7b2345faf2160319) reef (dev) 2023-12-03T11:48:01.412 INFO:tasks.workunit.client.0.smithi003.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f992c854db0] 2023-12-03T11:48:01.412 INFO:tasks.workunit.client.0.smithi003.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f992c8a154c] 2023-12-03T11:48:01.412 INFO:tasks.workunit.client.0.smithi003.stderr: 3: raise() 2023-12-03T11:48:01.412 INFO:tasks.workunit.client.0.smithi003.stderr: 4: abort() 2023-12-03T11:48:01.413 INFO:tasks.workunit.client.0.smithi003.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f992f16ef52] 2023-12-03T11:48:01.413 INFO:tasks.workunit.client.0.smithi003.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f0b6) [0x7f992f16f0b6] 2023-12-03T11:48:01.413 INFO:tasks.workunit.client.0.smithi003.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55735c97ba71] 2023-12-03T11:48:01.413 INFO:tasks.workunit.client.0.smithi003.stderr: 8: radosgw-admin(+0x79787a) [0x55735c98387a] 2023-12-03T11:48:01.413 INFO:tasks.workunit.client.0.smithi003.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x24b) [0x55735c987e6b] 2023-12-03T11:48:01.413 INFO:tasks.workunit.client.0.smithi003.stderr: 10: main() 2023-12-03T11:48:01.413 INFO:tasks.workunit.client.0.smithi003.stderr: 11: /lib64/libc.so.6(+0x3feb0) [0x7f992c83feb0] 2023-12-03T11:48:01.413 INFO:tasks.workunit.client.0.smithi003.stderr: 12: __libc_start_main() 2023-12-03T11:48:01.413 INFO:tasks.workunit.client.0.smithi003.stderr: 13: _start() 2023-12-03T11:48:01.413 INFO:tasks.workunit.client.0.smithi003.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-12-03T11:48:01.413 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:48:01.414 INFO:tasks.workunit.client.0.smithi003.stderr:--- logging levels --- 2023-12-03T11:48:01.414 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 none 2023-12-03T11:48:01.414 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 1 lockdep 2023-12-03T11:48:01.414 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 1 context 2023-12-03T11:48:01.414 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 1 crush 2023-12-03T11:48:01.414 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 mds 2023-12-03T11:48:01.414 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 mds_balancer 2023-12-03T11:48:01.414 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 mds_locker 2023-12-03T11:48:01.414 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 mds_log 2023-12-03T11:48:01.414 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 mds_log_expire 2023-12-03T11:48:01.414 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 mds_migrator 2023-12-03T11:48:01.414 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 1 buffer 2023-12-03T11:48:01.414 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 1 timer 2023-12-03T11:48:01.414 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 1 filer 2023-12-03T11:48:01.415 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 1 striper 2023-12-03T11:48:01.415 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 1 objecter 2023-12-03T11:48:01.415 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 rados 2023-12-03T11:48:01.415 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 rbd 2023-12-03T11:48:01.415 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 rbd_mirror 2023-12-03T11:48:01.415 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 rbd_replay 2023-12-03T11:48:01.415 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 rbd_pwl 2023-12-03T11:48:01.415 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 journaler 2023-12-03T11:48:01.415 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 objectcacher 2023-12-03T11:48:01.415 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 immutable_obj_cache 2023-12-03T11:48:01.415 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 client 2023-12-03T11:48:01.415 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 osd 2023-12-03T11:48:01.415 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 optracker 2023-12-03T11:48:01.415 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 objclass 2023-12-03T11:48:01.415 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 3 filestore 2023-12-03T11:48:01.415 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 3 journal 2023-12-03T11:48:01.416 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 0 ms 2023-12-03T11:48:01.416 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 mon 2023-12-03T11:48:01.416 INFO:tasks.workunit.client.0.smithi003.stderr: 0/10 monc 2023-12-03T11:48:01.416 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 paxos 2023-12-03T11:48:01.416 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 tp 2023-12-03T11:48:01.416 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 auth 2023-12-03T11:48:01.416 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 crypto 2023-12-03T11:48:01.416 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 1 finisher 2023-12-03T11:48:01.416 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 1 reserver 2023-12-03T11:48:01.416 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 heartbeatmap 2023-12-03T11:48:01.416 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 perfcounter 2023-12-03T11:48:01.416 INFO:tasks.workunit.client.0.smithi003.stderr: 20/20 rgw 2023-12-03T11:48:01.416 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 rgw_sync 2023-12-03T11:48:01.416 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 rgw_datacache 2023-12-03T11:48:01.416 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 rgw_access 2023-12-03T11:48:01.417 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 rgw_dbstore 2023-12-03T11:48:01.417 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 rgw_flight 2023-12-03T11:48:01.417 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 javaclient 2023-12-03T11:48:01.417 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 asok 2023-12-03T11:48:01.417 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 1 throttle 2023-12-03T11:48:01.417 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 0 refs 2023-12-03T11:48:01.417 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 compressor 2023-12-03T11:48:01.417 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 bluestore 2023-12-03T11:48:01.417 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 bluefs 2023-12-03T11:48:01.417 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 3 bdev 2023-12-03T11:48:01.417 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 kstore 2023-12-03T11:48:01.417 INFO:tasks.workunit.client.0.smithi003.stderr: 4/ 5 rocksdb 2023-12-03T11:48:01.417 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 fuse 2023-12-03T11:48:01.417 INFO:tasks.workunit.client.0.smithi003.stderr: 2/ 5 mgr 2023-12-03T11:48:01.417 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 mgrc 2023-12-03T11:48:01.418 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 dpdk 2023-12-03T11:48:01.418 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 eventtrace 2023-12-03T11:48:01.418 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 prioritycache 2023-12-03T11:48:01.418 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 test 2023-12-03T11:48:01.418 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 cephfs_mirror 2023-12-03T11:48:01.418 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 cephsqlite 2023-12-03T11:48:01.418 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 crimson_interrupt 2023-12-03T11:48:01.418 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 seastore 2023-12-03T11:48:01.418 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 seastore_onode 2023-12-03T11:48:01.418 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 seastore_odata 2023-12-03T11:48:01.418 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 seastore_omap 2023-12-03T11:48:01.418 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 seastore_tm 2023-12-03T11:48:01.418 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 seastore_t 2023-12-03T11:48:01.418 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 seastore_cleaner 2023-12-03T11:48:01.418 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 seastore_epm 2023-12-03T11:48:01.419 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 seastore_lba 2023-12-03T11:48:01.419 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 seastore_fixedkv_tree 2023-12-03T11:48:01.419 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 seastore_cache 2023-12-03T11:48:01.419 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 seastore_journal 2023-12-03T11:48:01.419 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 seastore_device 2023-12-03T11:48:01.419 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 seastore_backref 2023-12-03T11:48:01.419 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 alienstore 2023-12-03T11:48:01.419 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 mclock 2023-12-03T11:48:01.419 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 cyanstore 2023-12-03T11:48:01.419 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 ceph_exporter 2023-12-03T11:48:01.419 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 memstore 2023-12-03T11:48:01.419 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 trace 2023-12-03T11:48:01.419 INFO:tasks.workunit.client.0.smithi003.stderr: -2/-2 (syslog threshold) 2023-12-03T11:48:01.419 INFO:tasks.workunit.client.0.smithi003.stderr: 99/99 (stderr threshold) 2023-12-03T11:48:01.420 INFO:tasks.workunit.client.0.smithi003.stderr:--- pthread ID / name mapping for recent threads --- 2023-12-03T11:48:01.420 INFO:tasks.workunit.client.0.smithi003.stderr: 7f9856ffd640 / http_manager 2023-12-03T11:48:01.420 INFO:tasks.workunit.client.0.smithi003.stderr: 7f985d7fa640 / http_manager 2023-12-03T11:48:01.420 INFO:tasks.workunit.client.0.smithi003.stderr: 7f985ffff640 / ms_dispatch 2023-12-03T11:48:01.420 INFO:tasks.workunit.client.0.smithi003.stderr: 7f98edfe3640 / io_context_pool 2023-12-03T11:48:01.420 INFO:tasks.workunit.client.0.smithi003.stderr: 7f98ee7e4640 / rgw_dt_lg_renew 2023-12-03T11:48:01.420 INFO:tasks.workunit.client.0.smithi003.stderr: 7f990d7fa640 / ms_dispatch 2023-12-03T11:48:01.420 INFO:tasks.workunit.client.0.smithi003.stderr: 7f990effd640 / io_context_pool 2023-12-03T11:48:01.420 INFO:tasks.workunit.client.0.smithi003.stderr: 7f9925956640 / ms_dispatch 2023-12-03T11:48:01.420 INFO:tasks.workunit.client.0.smithi003.stderr: 7f9926958640 / io_context_pool 2023-12-03T11:48:01.420 INFO:tasks.workunit.client.0.smithi003.stderr: 7f992795a640 / msgr-worker-2 2023-12-03T11:48:01.420 INFO:tasks.workunit.client.0.smithi003.stderr: 7f992815b640 / msgr-worker-1 2023-12-03T11:48:01.420 INFO:tasks.workunit.client.0.smithi003.stderr: 7f992895c640 / msgr-worker-0 2023-12-03T11:48:01.420 INFO:tasks.workunit.client.0.smithi003.stderr: 7f992c532800 / radosgw-admin 2023-12-03T11:48:01.420 INFO:tasks.workunit.client.0.smithi003.stderr: max_recent 500 2023-12-03T11:48:01.421 INFO:tasks.workunit.client.0.smithi003.stderr: max_new 1000 2023-12-03T11:48:01.421 INFO:tasks.workunit.client.0.smithi003.stderr: log_file /var/log/ceph/ceph-client.admin.102138.log 2023-12-03T11:48:01.421 INFO:tasks.workunit.client.0.smithi003.stderr:--- end dump of recent events --- 2023-12-03T11:48:01.421 INFO:tasks.workunit.client.0.smithi003.stderr:--- begin dump of recent events --- 2023-12-03T11:48:01.421 INFO:tasks.workunit.client.0.smithi003.stderr: -499> 2023-12-03T11:48:01.299+0000 7f992815b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:48:01.421 INFO:tasks.workunit.client.0.smithi003.stderr: -498> 2023-12-03T11:48:01.299+0000 7f992815b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:48:01.421 INFO:tasks.workunit.client.0.smithi003.stderr: -497> 2023-12-03T11:48:01.299+0000 7f992795a640 10 monclient(hunting): handle_auth_done global_id 6537 payload 824 2023-12-03T11:48:01.421 INFO:tasks.workunit.client.0.smithi003.stderr: -496> 2023-12-03T11:48:01.299+0000 7f992795a640 10 monclient: _finish_hunting 0 2023-12-03T11:48:01.421 INFO:tasks.workunit.client.0.smithi003.stderr: -495> 2023-12-03T11:48:01.299+0000 7f992795a640 1 monclient: found mon.noname-a 2023-12-03T11:48:01.421 INFO:tasks.workunit.client.0.smithi003.stderr: -494> 2023-12-03T11:48:01.299+0000 7f992795a640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.3:3300/0 2023-12-03T11:48:01.421 INFO:tasks.workunit.client.0.smithi003.stderr: -493> 2023-12-03T11:48:01.299+0000 7f9925956640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:48:01.421 INFO:tasks.workunit.client.0.smithi003.stderr: -492> 2023-12-03T11:48:01.299+0000 7f9925956640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-12-03T11:48:01.421 INFO:tasks.workunit.client.0.smithi003.stderr: -491> 2023-12-03T11:48:01.299+0000 7f9925956640 10 monclient: dump: 2023-12-03T11:48:01.421 INFO:tasks.workunit.client.0.smithi003.stderr:epoch 1 2023-12-03T11:48:01.422 INFO:tasks.workunit.client.0.smithi003.stderr:fsid 296556de-a4fc-4095-9b6d-0fe813c2865c 2023-12-03T11:48:01.422 INFO:tasks.workunit.client.0.smithi003.stderr:last_changed 2023-12-03T11:33:18.862564+0000 2023-12-03T11:48:01.422 INFO:tasks.workunit.client.0.smithi003.stderr:created 2023-12-03T11:33:18.862564+0000 2023-12-03T11:48:01.422 INFO:tasks.workunit.client.0.smithi003.stderr:min_mon_release 18 (reef) 2023-12-03T11:48:01.422 INFO:tasks.workunit.client.0.smithi003.stderr:election_strategy: 1 2023-12-03T11:48:01.422 INFO:tasks.workunit.client.0.smithi003.stderr:0: [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] mon.a 2023-12-03T11:48:01.422 INFO:tasks.workunit.client.0.smithi003.stderr:1: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.b 2023-12-03T11:48:01.422 INFO:tasks.workunit.client.0.smithi003.stderr:2: [v2:172.21.15.3:3301/0,v1:172.21.15.3:6790/0] mon.c 2023-12-03T11:48:01.422 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:48:01.422 INFO:tasks.workunit.client.0.smithi003.stderr: -490> 2023-12-03T11:48:01.299+0000 7f9925956640 10 monclient: _finish_auth 0 2023-12-03T11:48:01.422 INFO:tasks.workunit.client.0.smithi003.stderr: -489> 2023-12-03T11:48:01.299+0000 7f9925956640 10 monclient: _check_auth_tickets 2023-12-03T11:48:01.422 INFO:tasks.workunit.client.0.smithi003.stderr: -488> 2023-12-03T11:48:01.299+0000 7f9925956640 10 monclient: handle_config config(0 keys) v1 2023-12-03T11:48:01.422 INFO:tasks.workunit.client.0.smithi003.stderr: -487> 2023-12-03T11:48:01.299+0000 7f9925956640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:48:01.422 INFO:tasks.workunit.client.0.smithi003.stderr: -486> 2023-12-03T11:48:01.299+0000 7f9925956640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-12-03T11:48:01.422 INFO:tasks.workunit.client.0.smithi003.stderr: -485> 2023-12-03T11:48:01.299+0000 7f9925956640 10 monclient: dump: 2023-12-03T11:48:01.423 INFO:tasks.workunit.client.0.smithi003.stderr:epoch 1 2023-12-03T11:48:01.423 INFO:tasks.workunit.client.0.smithi003.stderr:fsid 296556de-a4fc-4095-9b6d-0fe813c2865c 2023-12-03T11:48:01.423 INFO:tasks.workunit.client.0.smithi003.stderr:last_changed 2023-12-03T11:33:18.862564+0000 2023-12-03T11:48:01.423 INFO:tasks.workunit.client.0.smithi003.stderr:created 2023-12-03T11:33:18.862564+0000 2023-12-03T11:48:01.423 INFO:tasks.workunit.client.0.smithi003.stderr:min_mon_release 18 (reef) 2023-12-03T11:48:01.423 INFO:tasks.workunit.client.0.smithi003.stderr:election_strategy: 1 2023-12-03T11:48:01.423 INFO:tasks.workunit.client.0.smithi003.stderr:0: [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] mon.a 2023-12-03T11:48:01.423 INFO:tasks.workunit.client.0.smithi003.stderr:1: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.b 2023-12-03T11:48:01.423 INFO:tasks.workunit.client.0.smithi003.stderr:2: [v2:172.21.15.3:3301/0,v1:172.21.15.3:6790/0] mon.c 2023-12-03T11:48:01.423 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:48:01.423 INFO:tasks.workunit.client.0.smithi003.stderr: -484> 2023-12-03T11:48:01.299+0000 7f992c532800 5 monclient: authenticate success, global_id 6537 2023-12-03T11:48:01.423 INFO:tasks.workunit.client.0.smithi003.stderr: -483> 2023-12-03T11:48:01.299+0000 7f9926958640 4 set_mon_vals no callback set 2023-12-03T11:48:01.423 INFO:tasks.workunit.client.0.smithi003.stderr: -482> 2023-12-03T11:48:01.299+0000 7f992c532800 10 monclient: _renew_subs 2023-12-03T11:48:01.423 INFO:tasks.workunit.client.0.smithi003.stderr: -481> 2023-12-03T11:48:01.299+0000 7f992c532800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.3:3300/0 2023-12-03T11:48:01.424 INFO:tasks.workunit.client.0.smithi003.stderr: -480> 2023-12-03T11:48:01.299+0000 7f992c532800 10 monclient: _renew_subs 2023-12-03T11:48:01.424 INFO:tasks.workunit.client.0.smithi003.stderr: -479> 2023-12-03T11:48:01.299+0000 7f992c532800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.3:3300/0 2023-12-03T11:48:01.424 INFO:tasks.workunit.client.0.smithi003.stderr: -478> 2023-12-03T11:48:01.299+0000 7f992c532800 1 librados: init done 2023-12-03T11:48:01.424 INFO:tasks.workunit.client.0.smithi003.stderr: -477> 2023-12-03T11:48:01.300+0000 7f992c532800 10 monclient: get_monmap_and_config 2023-12-03T11:48:01.424 INFO:tasks.workunit.client.0.smithi003.stderr: -476> 2023-12-03T11:48:01.300+0000 7f992c532800 10 monclient: build_initial_monmap 2023-12-03T11:48:01.424 INFO:tasks.workunit.client.0.smithi003.stderr: -475> 2023-12-03T11:48:01.300+0000 7f992c532800 1 build_initial for_mkfs: 0 2023-12-03T11:48:01.424 INFO:tasks.workunit.client.0.smithi003.stderr: -474> 2023-12-03T11:48:01.300+0000 7f992c532800 10 monclient: monmap: 2023-12-03T11:48:01.424 INFO:tasks.workunit.client.0.smithi003.stderr:epoch 0 2023-12-03T11:48:01.424 INFO:tasks.workunit.client.0.smithi003.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-12-03T11:48:01.424 INFO:tasks.workunit.client.0.smithi003.stderr:last_changed 0.000000 2023-12-03T11:48:01.424 INFO:tasks.workunit.client.0.smithi003.stderr:created 0.000000 2023-12-03T11:48:01.424 INFO:tasks.workunit.client.0.smithi003.stderr:min_mon_release 0 (unknown) 2023-12-03T11:48:01.424 INFO:tasks.workunit.client.0.smithi003.stderr:election_strategy: 1 2023-12-03T11:48:01.424 INFO:tasks.workunit.client.0.smithi003.stderr:0: [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] mon.noname-a 2023-12-03T11:48:01.424 INFO:tasks.workunit.client.0.smithi003.stderr:1: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.noname-b 2023-12-03T11:48:01.425 INFO:tasks.workunit.client.0.smithi003.stderr:2: [v2:172.21.15.3:3301/0,v1:172.21.15.3:6790/0] mon.noname-c 2023-12-03T11:48:01.425 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:48:01.425 INFO:tasks.workunit.client.0.smithi003.stderr: -473> 2023-12-03T11:48:01.300+0000 7f992c532800 5 AuthRegistry(0x55735da73bc0) adding auth protocol: cephx 2023-12-03T11:48:01.425 INFO:tasks.workunit.client.0.smithi003.stderr: -472> 2023-12-03T11:48:01.300+0000 7f992c532800 5 AuthRegistry(0x55735da73bc0) adding auth protocol: cephx 2023-12-03T11:48:01.425 INFO:tasks.workunit.client.0.smithi003.stderr: -471> 2023-12-03T11:48:01.300+0000 7f992c532800 5 AuthRegistry(0x55735da73bc0) adding auth protocol: cephx 2023-12-03T11:48:01.425 INFO:tasks.workunit.client.0.smithi003.stderr: -470> 2023-12-03T11:48:01.300+0000 7f992c532800 5 AuthRegistry(0x55735da73bc0) adding con mode: secure 2023-12-03T11:48:01.425 INFO:tasks.workunit.client.0.smithi003.stderr: -469> 2023-12-03T11:48:01.300+0000 7f992c532800 5 AuthRegistry(0x55735da73bc0) adding con mode: crc 2023-12-03T11:48:01.425 INFO:tasks.workunit.client.0.smithi003.stderr: -468> 2023-12-03T11:48:01.300+0000 7f992c532800 5 AuthRegistry(0x55735da73bc0) adding con mode: secure 2023-12-03T11:48:01.425 INFO:tasks.workunit.client.0.smithi003.stderr: -467> 2023-12-03T11:48:01.300+0000 7f992c532800 5 AuthRegistry(0x55735da73bc0) adding con mode: crc 2023-12-03T11:48:01.425 INFO:tasks.workunit.client.0.smithi003.stderr: -466> 2023-12-03T11:48:01.300+0000 7f992c532800 5 AuthRegistry(0x55735da73bc0) adding con mode: secure 2023-12-03T11:48:01.425 INFO:tasks.workunit.client.0.smithi003.stderr: -465> 2023-12-03T11:48:01.300+0000 7f992c532800 5 AuthRegistry(0x55735da73bc0) adding con mode: crc 2023-12-03T11:48:01.425 INFO:tasks.workunit.client.0.smithi003.stderr: -464> 2023-12-03T11:48:01.300+0000 7f992c532800 5 AuthRegistry(0x55735da73bc0) adding con mode: crc 2023-12-03T11:48:01.425 INFO:tasks.workunit.client.0.smithi003.stderr: -463> 2023-12-03T11:48:01.300+0000 7f992c532800 5 AuthRegistry(0x55735da73bc0) adding con mode: secure 2023-12-03T11:48:01.425 INFO:tasks.workunit.client.0.smithi003.stderr: -462> 2023-12-03T11:48:01.300+0000 7f992c532800 5 AuthRegistry(0x55735da73bc0) adding con mode: crc 2023-12-03T11:48:01.426 INFO:tasks.workunit.client.0.smithi003.stderr: -461> 2023-12-03T11:48:01.300+0000 7f992c532800 5 AuthRegistry(0x55735da73bc0) adding con mode: secure 2023-12-03T11:48:01.426 INFO:tasks.workunit.client.0.smithi003.stderr: -460> 2023-12-03T11:48:01.300+0000 7f992c532800 5 AuthRegistry(0x55735da73bc0) adding con mode: crc 2023-12-03T11:48:01.426 INFO:tasks.workunit.client.0.smithi003.stderr: -459> 2023-12-03T11:48:01.300+0000 7f992c532800 5 AuthRegistry(0x55735da73bc0) adding con mode: secure 2023-12-03T11:48:01.426 INFO:tasks.workunit.client.0.smithi003.stderr: -458> 2023-12-03T11:48:01.300+0000 7f992c532800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:48:01.426 INFO:tasks.workunit.client.0.smithi003.stderr: -457> 2023-12-03T11:48:01.300+0000 7f992c532800 10 monclient: init 2023-12-03T11:48:01.426 INFO:tasks.workunit.client.0.smithi003.stderr: -456> 2023-12-03T11:48:01.300+0000 7f992c532800 5 AuthRegistry(0x7ffdc5f4c2e0) adding auth protocol: cephx 2023-12-03T11:48:01.426 INFO:tasks.workunit.client.0.smithi003.stderr: -455> 2023-12-03T11:48:01.300+0000 7f992c532800 5 AuthRegistry(0x7ffdc5f4c2e0) adding auth protocol: cephx 2023-12-03T11:48:01.426 INFO:tasks.workunit.client.0.smithi003.stderr: -454> 2023-12-03T11:48:01.300+0000 7f992c532800 5 AuthRegistry(0x7ffdc5f4c2e0) adding auth protocol: cephx 2023-12-03T11:48:01.426 INFO:tasks.workunit.client.0.smithi003.stderr: -453> 2023-12-03T11:48:01.300+0000 7f992c532800 5 AuthRegistry(0x7ffdc5f4c2e0) adding con mode: secure 2023-12-03T11:48:01.426 INFO:tasks.workunit.client.0.smithi003.stderr: -452> 2023-12-03T11:48:01.300+0000 7f992c532800 5 AuthRegistry(0x7ffdc5f4c2e0) adding con mode: crc 2023-12-03T11:48:01.426 INFO:tasks.workunit.client.0.smithi003.stderr: -451> 2023-12-03T11:48:01.300+0000 7f992c532800 5 AuthRegistry(0x7ffdc5f4c2e0) adding con mode: secure 2023-12-03T11:48:01.426 INFO:tasks.workunit.client.0.smithi003.stderr: -450> 2023-12-03T11:48:01.300+0000 7f992c532800 5 AuthRegistry(0x7ffdc5f4c2e0) adding con mode: crc 2023-12-03T11:48:01.426 INFO:tasks.workunit.client.0.smithi003.stderr: -449> 2023-12-03T11:48:01.300+0000 7f992c532800 5 AuthRegistry(0x7ffdc5f4c2e0) adding con mode: secure 2023-12-03T11:48:01.426 INFO:tasks.workunit.client.0.smithi003.stderr: -448> 2023-12-03T11:48:01.300+0000 7f992c532800 5 AuthRegistry(0x7ffdc5f4c2e0) adding con mode: crc 2023-12-03T11:48:01.426 INFO:tasks.workunit.client.0.smithi003.stderr: -447> 2023-12-03T11:48:01.300+0000 7f992c532800 5 AuthRegistry(0x7ffdc5f4c2e0) adding con mode: crc 2023-12-03T11:48:01.427 INFO:tasks.workunit.client.0.smithi003.stderr: -446> 2023-12-03T11:48:01.300+0000 7f992c532800 5 AuthRegistry(0x7ffdc5f4c2e0) adding con mode: secure 2023-12-03T11:48:01.427 INFO:tasks.workunit.client.0.smithi003.stderr: -445> 2023-12-03T11:48:01.300+0000 7f992c532800 5 AuthRegistry(0x7ffdc5f4c2e0) adding con mode: crc 2023-12-03T11:48:01.427 INFO:tasks.workunit.client.0.smithi003.stderr: -444> 2023-12-03T11:48:01.300+0000 7f992c532800 5 AuthRegistry(0x7ffdc5f4c2e0) adding con mode: secure 2023-12-03T11:48:01.427 INFO:tasks.workunit.client.0.smithi003.stderr: -443> 2023-12-03T11:48:01.300+0000 7f992c532800 5 AuthRegistry(0x7ffdc5f4c2e0) adding con mode: crc 2023-12-03T11:48:01.427 INFO:tasks.workunit.client.0.smithi003.stderr: -442> 2023-12-03T11:48:01.300+0000 7f992c532800 5 AuthRegistry(0x7ffdc5f4c2e0) adding con mode: secure 2023-12-03T11:48:01.427 INFO:tasks.workunit.client.0.smithi003.stderr: -441> 2023-12-03T11:48:01.301+0000 7f992c532800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:48:01.427 INFO:tasks.workunit.client.0.smithi003.stderr: -440> 2023-12-03T11:48:01.301+0000 7f992c532800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:48:01.427 INFO:tasks.workunit.client.0.smithi003.stderr: -439> 2023-12-03T11:48:01.301+0000 7f992c532800 5 asok(0x55735d868a10) register_command rotate-key cmddesc rotate-key hook 0x7ffdc5f4c428 EEXIST 2023-12-03T11:48:01.427 INFO:tasks.workunit.client.0.smithi003.stderr: -438> 2023-12-03T11:48:01.301+0000 7f992c532800 10 monclient: _reopen_session rank -1 2023-12-03T11:48:01.427 INFO:tasks.workunit.client.0.smithi003.stderr: -437> 2023-12-03T11:48:01.301+0000 7f992c532800 10 monclient: _add_conns ranks=[0,2,1] 2023-12-03T11:48:01.427 INFO:tasks.workunit.client.0.smithi003.stderr: -436> 2023-12-03T11:48:01.301+0000 7f992c532800 10 monclient(hunting): picked mon.noname-a con 0x55735daa3e50 addr [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] 2023-12-03T11:48:01.427 INFO:tasks.workunit.client.0.smithi003.stderr: -435> 2023-12-03T11:48:01.301+0000 7f992c532800 10 monclient(hunting): picked mon.noname-c con 0x55735daa4230 addr [v2:172.21.15.3:3301/0,v1:172.21.15.3:6790/0] 2023-12-03T11:48:01.427 INFO:tasks.workunit.client.0.smithi003.stderr: -434> 2023-12-03T11:48:01.301+0000 7f992c532800 10 monclient(hunting): picked mon.noname-b con 0x55735da78330 addr [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] 2023-12-03T11:48:01.427 INFO:tasks.workunit.client.0.smithi003.stderr: -433> 2023-12-03T11:48:01.301+0000 7f992c532800 10 monclient(hunting): start opening mon connection 2023-12-03T11:48:01.427 INFO:tasks.workunit.client.0.smithi003.stderr: -432> 2023-12-03T11:48:01.301+0000 7f992c532800 10 monclient(hunting): start opening mon connection 2023-12-03T11:48:01.428 INFO:tasks.workunit.client.0.smithi003.stderr: -431> 2023-12-03T11:48:01.301+0000 7f992c532800 10 monclient(hunting): start opening mon connection 2023-12-03T11:48:01.428 INFO:tasks.workunit.client.0.smithi003.stderr: -430> 2023-12-03T11:48:01.301+0000 7f992c532800 10 monclient(hunting): _renew_subs 2023-12-03T11:48:01.428 INFO:tasks.workunit.client.0.smithi003.stderr: -429> 2023-12-03T11:48:01.301+0000 7f992c532800 10 monclient(hunting): authenticate will time out at 1703.539651s 2023-12-03T11:48:01.428 INFO:tasks.workunit.client.0.smithi003.stderr: -428> 2023-12-03T11:48:01.301+0000 7f992815b640 10 monclient(hunting): get_auth_request con 0x55735daa4230 auth_method 0 2023-12-03T11:48:01.428 INFO:tasks.workunit.client.0.smithi003.stderr: -427> 2023-12-03T11:48:01.301+0000 7f992815b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:48:01.428 INFO:tasks.workunit.client.0.smithi003.stderr: -426> 2023-12-03T11:48:01.301+0000 7f992815b640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:48:01.428 INFO:tasks.workunit.client.0.smithi003.stderr: -425> 2023-12-03T11:48:01.301+0000 7f992815b640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:48:01.428 INFO:tasks.workunit.client.0.smithi003.stderr: -424> 2023-12-03T11:48:01.301+0000 7f992895c640 10 monclient(hunting): get_auth_request con 0x55735daa3e50 auth_method 0 2023-12-03T11:48:01.428 INFO:tasks.workunit.client.0.smithi003.stderr: -423> 2023-12-03T11:48:01.301+0000 7f992895c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:48:01.428 INFO:tasks.workunit.client.0.smithi003.stderr: -422> 2023-12-03T11:48:01.301+0000 7f992895c640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:48:01.428 INFO:tasks.workunit.client.0.smithi003.stderr: -421> 2023-12-03T11:48:01.301+0000 7f992895c640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:48:01.428 INFO:tasks.workunit.client.0.smithi003.stderr: -420> 2023-12-03T11:48:01.301+0000 7f992815b640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:48:01.428 INFO:tasks.workunit.client.0.smithi003.stderr: -419> 2023-12-03T11:48:01.301+0000 7f992815b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:48:01.428 INFO:tasks.workunit.client.0.smithi003.stderr: -418> 2023-12-03T11:48:01.301+0000 7f992815b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:48:01.428 INFO:tasks.workunit.client.0.smithi003.stderr: -417> 2023-12-03T11:48:01.301+0000 7f992895c640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:48:01.429 INFO:tasks.workunit.client.0.smithi003.stderr: -416> 2023-12-03T11:48:01.301+0000 7f992895c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:48:01.429 INFO:tasks.workunit.client.0.smithi003.stderr: -415> 2023-12-03T11:48:01.301+0000 7f992895c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:48:01.429 INFO:tasks.workunit.client.0.smithi003.stderr: -414> 2023-12-03T11:48:01.301+0000 7f9925956640 4 mgrc handle_mgr_map Got map version 5 2023-12-03T11:48:01.429 INFO:tasks.workunit.client.0.smithi003.stderr: -413> 2023-12-03T11:48:01.301+0000 7f9925956640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.37:6832/2165065416,v1:172.21.15.37:6833/2165065416] 2023-12-03T11:48:01.429 INFO:tasks.workunit.client.0.smithi003.stderr: -412> 2023-12-03T11:48:01.301+0000 7f9925956640 4 mgrc reconnect Starting new session with [v2:172.21.15.37:6832/2165065416,v1:172.21.15.37:6833/2165065416] 2023-12-03T11:48:01.429 INFO:tasks.workunit.client.0.smithi003.stderr: -411> 2023-12-03T11:48:01.301+0000 7f992815b640 10 monclient(hunting): handle_auth_done global_id 6185 payload 274 2023-12-03T11:48:01.429 INFO:tasks.workunit.client.0.smithi003.stderr: -410> 2023-12-03T11:48:01.301+0000 7f992815b640 10 monclient: _finish_hunting 0 2023-12-03T11:48:01.429 INFO:tasks.workunit.client.0.smithi003.stderr: -409> 2023-12-03T11:48:01.301+0000 7f992815b640 1 monclient: found mon.noname-c 2023-12-03T11:48:01.429 INFO:tasks.workunit.client.0.smithi003.stderr: -408> 2023-12-03T11:48:01.301+0000 7f992815b640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.3:3301/0 2023-12-03T11:48:01.429 INFO:tasks.workunit.client.0.smithi003.stderr: -407> 2023-12-03T11:48:01.301+0000 7f992795a640 10 monclient: get_auth_request con 0x55735da78330 auth_method 0 2023-12-03T11:48:01.429 INFO:tasks.workunit.client.0.smithi003.stderr: -406> 2023-12-03T11:48:01.301+0000 7f992895c640 10 monclient: get_auth_request con 0x7f9914069820 auth_method 0 2023-12-03T11:48:01.429 INFO:tasks.workunit.client.0.smithi003.stderr: -405> 2023-12-03T11:48:01.302+0000 7f990effd640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:48:01.429 INFO:tasks.workunit.client.0.smithi003.stderr: -404> 2023-12-03T11:48:01.302+0000 7f990effd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-12-03T11:48:01.430 INFO:tasks.workunit.client.0.smithi003.stderr: -403> 2023-12-03T11:48:01.302+0000 7f990effd640 10 monclient: dump: 2023-12-03T11:48:01.430 INFO:tasks.workunit.client.0.smithi003.stderr:epoch 1 2023-12-03T11:48:01.430 INFO:tasks.workunit.client.0.smithi003.stderr:fsid 296556de-a4fc-4095-9b6d-0fe813c2865c 2023-12-03T11:48:01.430 INFO:tasks.workunit.client.0.smithi003.stderr:last_changed 2023-12-03T11:33:18.862564+0000 2023-12-03T11:48:01.430 INFO:tasks.workunit.client.0.smithi003.stderr:created 2023-12-03T11:33:18.862564+0000 2023-12-03T11:48:01.430 INFO:tasks.workunit.client.0.smithi003.stderr:min_mon_release 18 (reef) 2023-12-03T11:48:01.430 INFO:tasks.workunit.client.0.smithi003.stderr:election_strategy: 1 2023-12-03T11:48:01.430 INFO:tasks.workunit.client.0.smithi003.stderr:0: [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] mon.a 2023-12-03T11:48:01.430 INFO:tasks.workunit.client.0.smithi003.stderr:1: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.b 2023-12-03T11:48:01.430 INFO:tasks.workunit.client.0.smithi003.stderr:2: [v2:172.21.15.3:3301/0,v1:172.21.15.3:6790/0] mon.c 2023-12-03T11:48:01.430 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:48:01.430 INFO:tasks.workunit.client.0.smithi003.stderr: -402> 2023-12-03T11:48:01.302+0000 7f990effd640 10 monclient: _finish_auth 0 2023-12-03T11:48:01.430 INFO:tasks.workunit.client.0.smithi003.stderr: -401> 2023-12-03T11:48:01.302+0000 7f990effd640 10 monclient: _check_auth_tickets 2023-12-03T11:48:01.431 INFO:tasks.workunit.client.0.smithi003.stderr: -400> 2023-12-03T11:48:01.302+0000 7f990effd640 10 monclient: handle_config config(0 keys) v1 2023-12-03T11:48:01.431 INFO:tasks.workunit.client.0.smithi003.stderr: -399> 2023-12-03T11:48:01.302+0000 7f990effd640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:48:01.431 INFO:tasks.workunit.client.0.smithi003.stderr: -398> 2023-12-03T11:48:01.302+0000 7f990effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-12-03T11:48:01.431 INFO:tasks.workunit.client.0.smithi003.stderr: -397> 2023-12-03T11:48:01.302+0000 7f990effd640 10 monclient: dump: 2023-12-03T11:48:01.431 INFO:tasks.workunit.client.0.smithi003.stderr:epoch 1 2023-12-03T11:48:01.431 INFO:tasks.workunit.client.0.smithi003.stderr:fsid 296556de-a4fc-4095-9b6d-0fe813c2865c 2023-12-03T11:48:01.431 INFO:tasks.workunit.client.0.smithi003.stderr:last_changed 2023-12-03T11:33:18.862564+0000 2023-12-03T11:48:01.431 INFO:tasks.workunit.client.0.smithi003.stderr:created 2023-12-03T11:33:18.862564+0000 2023-12-03T11:48:01.431 INFO:tasks.workunit.client.0.smithi003.stderr:min_mon_release 18 (reef) 2023-12-03T11:48:01.431 INFO:tasks.workunit.client.0.smithi003.stderr:election_strategy: 1 2023-12-03T11:48:01.431 INFO:tasks.workunit.client.0.smithi003.stderr:0: [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] mon.a 2023-12-03T11:48:01.431 INFO:tasks.workunit.client.0.smithi003.stderr:1: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.b 2023-12-03T11:48:01.431 INFO:tasks.workunit.client.0.smithi003.stderr:2: [v2:172.21.15.3:3301/0,v1:172.21.15.3:6790/0] mon.c 2023-12-03T11:48:01.431 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:48:01.431 INFO:tasks.workunit.client.0.smithi003.stderr: -396> 2023-12-03T11:48:01.302+0000 7f992c532800 5 monclient: authenticate success, global_id 6185 2023-12-03T11:48:01.432 INFO:tasks.workunit.client.0.smithi003.stderr: -395> 2023-12-03T11:48:01.302+0000 7f992c532800 10 monclient: get_monmap_and_config success 2023-12-03T11:48:01.432 INFO:tasks.workunit.client.0.smithi003.stderr: -394> 2023-12-03T11:48:01.302+0000 7f992c532800 4 set_mon_vals no callback set 2023-12-03T11:48:01.432 INFO:tasks.workunit.client.0.smithi003.stderr: -393> 2023-12-03T11:48:01.302+0000 7f992c532800 10 monclient: shutdown 2023-12-03T11:48:01.432 INFO:tasks.workunit.client.0.smithi003.stderr: -392> 2023-12-03T11:48:01.302+0000 7f992c532800 10 monclient: build_initial_monmap 2023-12-03T11:48:01.432 INFO:tasks.workunit.client.0.smithi003.stderr: -391> 2023-12-03T11:48:01.302+0000 7f992c532800 1 build_initial for_mkfs: 0 2023-12-03T11:48:01.432 INFO:tasks.workunit.client.0.smithi003.stderr: -390> 2023-12-03T11:48:01.302+0000 7f992c532800 10 monclient: monmap: 2023-12-03T11:48:01.432 INFO:tasks.workunit.client.0.smithi003.stderr:epoch 0 2023-12-03T11:48:01.432 INFO:tasks.workunit.client.0.smithi003.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-12-03T11:48:01.432 INFO:tasks.workunit.client.0.smithi003.stderr:last_changed 0.000000 2023-12-03T11:48:01.432 INFO:tasks.workunit.client.0.smithi003.stderr:created 0.000000 2023-12-03T11:48:01.432 INFO:tasks.workunit.client.0.smithi003.stderr:min_mon_release 0 (unknown) 2023-12-03T11:48:01.432 INFO:tasks.workunit.client.0.smithi003.stderr:election_strategy: 1 2023-12-03T11:48:01.432 INFO:tasks.workunit.client.0.smithi003.stderr:0: [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] mon.noname-a 2023-12-03T11:48:01.432 INFO:tasks.workunit.client.0.smithi003.stderr:1: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.noname-b 2023-12-03T11:48:01.432 INFO:tasks.workunit.client.0.smithi003.stderr:2: [v2:172.21.15.3:3301/0,v1:172.21.15.3:6790/0] mon.noname-c 2023-12-03T11:48:01.433 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:48:01.433 INFO:tasks.workunit.client.0.smithi003.stderr: -389> 2023-12-03T11:48:01.302+0000 7f992c532800 5 AuthRegistry(0x55735da73a90) adding auth protocol: cephx 2023-12-03T11:48:01.433 INFO:tasks.workunit.client.0.smithi003.stderr: -388> 2023-12-03T11:48:01.302+0000 7f992c532800 5 AuthRegistry(0x55735da73a90) adding auth protocol: cephx 2023-12-03T11:48:01.433 INFO:tasks.workunit.client.0.smithi003.stderr: -387> 2023-12-03T11:48:01.302+0000 7f992c532800 5 AuthRegistry(0x55735da73a90) adding auth protocol: cephx 2023-12-03T11:48:01.433 INFO:tasks.workunit.client.0.smithi003.stderr: -386> 2023-12-03T11:48:01.302+0000 7f992c532800 5 AuthRegistry(0x55735da73a90) adding con mode: secure 2023-12-03T11:48:01.433 INFO:tasks.workunit.client.0.smithi003.stderr: -385> 2023-12-03T11:48:01.302+0000 7f992c532800 5 AuthRegistry(0x55735da73a90) adding con mode: crc 2023-12-03T11:48:01.433 INFO:tasks.workunit.client.0.smithi003.stderr: -384> 2023-12-03T11:48:01.302+0000 7f992c532800 5 AuthRegistry(0x55735da73a90) adding con mode: secure 2023-12-03T11:48:01.433 INFO:tasks.workunit.client.0.smithi003.stderr: -383> 2023-12-03T11:48:01.302+0000 7f992c532800 5 AuthRegistry(0x55735da73a90) adding con mode: crc 2023-12-03T11:48:01.433 INFO:tasks.workunit.client.0.smithi003.stderr: -382> 2023-12-03T11:48:01.302+0000 7f992c532800 5 AuthRegistry(0x55735da73a90) adding con mode: secure 2023-12-03T11:48:01.433 INFO:tasks.workunit.client.0.smithi003.stderr: -381> 2023-12-03T11:48:01.302+0000 7f992c532800 5 AuthRegistry(0x55735da73a90) adding con mode: crc 2023-12-03T11:48:01.433 INFO:tasks.workunit.client.0.smithi003.stderr: -380> 2023-12-03T11:48:01.302+0000 7f992c532800 5 AuthRegistry(0x55735da73a90) adding con mode: crc 2023-12-03T11:48:01.433 INFO:tasks.workunit.client.0.smithi003.stderr: -379> 2023-12-03T11:48:01.302+0000 7f992c532800 5 AuthRegistry(0x55735da73a90) adding con mode: secure 2023-12-03T11:48:01.433 INFO:tasks.workunit.client.0.smithi003.stderr: -378> 2023-12-03T11:48:01.302+0000 7f992c532800 5 AuthRegistry(0x55735da73a90) adding con mode: crc 2023-12-03T11:48:01.433 INFO:tasks.workunit.client.0.smithi003.stderr: -377> 2023-12-03T11:48:01.302+0000 7f992c532800 5 AuthRegistry(0x55735da73a90) adding con mode: secure 2023-12-03T11:48:01.433 INFO:tasks.workunit.client.0.smithi003.stderr: -376> 2023-12-03T11:48:01.302+0000 7f992c532800 5 AuthRegistry(0x55735da73a90) adding con mode: crc 2023-12-03T11:48:01.434 INFO:tasks.workunit.client.0.smithi003.stderr: -375> 2023-12-03T11:48:01.302+0000 7f992c532800 5 AuthRegistry(0x55735da73a90) adding con mode: secure 2023-12-03T11:48:01.434 INFO:tasks.workunit.client.0.smithi003.stderr: -374> 2023-12-03T11:48:01.302+0000 7f992c532800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:48:01.434 INFO:tasks.workunit.client.0.smithi003.stderr: -373> 2023-12-03T11:48:01.302+0000 7f992c532800 1 librados: starting msgr at 2023-12-03T11:48:01.434 INFO:tasks.workunit.client.0.smithi003.stderr: -372> 2023-12-03T11:48:01.302+0000 7f992c532800 1 librados: starting objecter 2023-12-03T11:48:01.434 INFO:tasks.workunit.client.0.smithi003.stderr: -371> 2023-12-03T11:48:01.303+0000 7f992c532800 5 asok(0x55735d868a10) register_command objecter_requests cmddesc objecter_requests hook 0x55735daadba0 EEXIST 2023-12-03T11:48:01.434 INFO:tasks.workunit.client.0.smithi003.stderr: -370> 2023-12-03T11:48:01.303+0000 7f992c532800 1 librados: setting wanted keys 2023-12-03T11:48:01.434 INFO:tasks.workunit.client.0.smithi003.stderr: -369> 2023-12-03T11:48:01.303+0000 7f992c532800 1 librados: calling monclient init 2023-12-03T11:48:01.434 INFO:tasks.workunit.client.0.smithi003.stderr: -368> 2023-12-03T11:48:01.303+0000 7f992c532800 10 monclient: init 2023-12-03T11:48:01.434 INFO:tasks.workunit.client.0.smithi003.stderr: -367> 2023-12-03T11:48:01.303+0000 7f992c532800 5 AuthRegistry(0x55735da72128) adding auth protocol: cephx 2023-12-03T11:48:01.434 INFO:tasks.workunit.client.0.smithi003.stderr: -366> 2023-12-03T11:48:01.303+0000 7f992c532800 5 AuthRegistry(0x55735da72128) adding auth protocol: cephx 2023-12-03T11:48:01.434 INFO:tasks.workunit.client.0.smithi003.stderr: -365> 2023-12-03T11:48:01.303+0000 7f992c532800 5 AuthRegistry(0x55735da72128) adding auth protocol: cephx 2023-12-03T11:48:01.434 INFO:tasks.workunit.client.0.smithi003.stderr: -364> 2023-12-03T11:48:01.303+0000 7f992c532800 5 AuthRegistry(0x55735da72128) adding con mode: secure 2023-12-03T11:48:01.434 INFO:tasks.workunit.client.0.smithi003.stderr: -363> 2023-12-03T11:48:01.303+0000 7f992c532800 5 AuthRegistry(0x55735da72128) adding con mode: crc 2023-12-03T11:48:01.435 INFO:tasks.workunit.client.0.smithi003.stderr: -362> 2023-12-03T11:48:01.303+0000 7f992c532800 5 AuthRegistry(0x55735da72128) adding con mode: secure 2023-12-03T11:48:01.435 INFO:tasks.workunit.client.0.smithi003.stderr: -361> 2023-12-03T11:48:01.303+0000 7f992c532800 5 AuthRegistry(0x55735da72128) adding con mode: crc 2023-12-03T11:48:01.435 INFO:tasks.workunit.client.0.smithi003.stderr: -360> 2023-12-03T11:48:01.303+0000 7f992c532800 5 AuthRegistry(0x55735da72128) adding con mode: secure 2023-12-03T11:48:01.435 INFO:tasks.workunit.client.0.smithi003.stderr: -359> 2023-12-03T11:48:01.303+0000 7f992c532800 5 AuthRegistry(0x55735da72128) adding con mode: crc 2023-12-03T11:48:01.435 INFO:tasks.workunit.client.0.smithi003.stderr: -358> 2023-12-03T11:48:01.303+0000 7f992c532800 5 AuthRegistry(0x55735da72128) adding con mode: crc 2023-12-03T11:48:01.435 INFO:tasks.workunit.client.0.smithi003.stderr: -357> 2023-12-03T11:48:01.303+0000 7f992c532800 5 AuthRegistry(0x55735da72128) adding con mode: secure 2023-12-03T11:48:01.435 INFO:tasks.workunit.client.0.smithi003.stderr: -356> 2023-12-03T11:48:01.303+0000 7f992c532800 5 AuthRegistry(0x55735da72128) adding con mode: crc 2023-12-03T11:48:01.435 INFO:tasks.workunit.client.0.smithi003.stderr: -355> 2023-12-03T11:48:01.303+0000 7f992c532800 5 AuthRegistry(0x55735da72128) adding con mode: secure 2023-12-03T11:48:01.435 INFO:tasks.workunit.client.0.smithi003.stderr: -354> 2023-12-03T11:48:01.303+0000 7f992c532800 5 AuthRegistry(0x55735da72128) adding con mode: crc 2023-12-03T11:48:01.435 INFO:tasks.workunit.client.0.smithi003.stderr: -353> 2023-12-03T11:48:01.303+0000 7f992c532800 5 AuthRegistry(0x55735da72128) adding con mode: secure 2023-12-03T11:48:01.435 INFO:tasks.workunit.client.0.smithi003.stderr: -352> 2023-12-03T11:48:01.303+0000 7f992c532800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:48:01.435 INFO:tasks.workunit.client.0.smithi003.stderr: -351> 2023-12-03T11:48:01.303+0000 7f992c532800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:48:01.435 INFO:tasks.workunit.client.0.smithi003.stderr: -350> 2023-12-03T11:48:01.303+0000 7f992c532800 5 asok(0x55735d868a10) register_command rotate-key cmddesc rotate-key hook 0x55735da72270 EEXIST 2023-12-03T11:48:01.435 INFO:tasks.workunit.client.0.smithi003.stderr: -349> 2023-12-03T11:48:01.303+0000 7f992c532800 10 monclient: _reopen_session rank -1 2023-12-03T11:48:01.436 INFO:tasks.workunit.client.0.smithi003.stderr: -348> 2023-12-03T11:48:01.303+0000 7f992c532800 10 monclient: _add_conns ranks=[1,2,0] 2023-12-03T11:48:01.436 INFO:tasks.workunit.client.0.smithi003.stderr: -347> 2023-12-03T11:48:01.303+0000 7f992c532800 10 monclient(hunting): picked mon.noname-b con 0x55735da78330 addr [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] 2023-12-03T11:48:01.436 INFO:tasks.workunit.client.0.smithi003.stderr: -346> 2023-12-03T11:48:01.303+0000 7f992c532800 10 monclient(hunting): picked mon.noname-c con 0x55735daa3e50 addr [v2:172.21.15.3:3301/0,v1:172.21.15.3:6790/0] 2023-12-03T11:48:01.436 INFO:tasks.workunit.client.0.smithi003.stderr: -345> 2023-12-03T11:48:01.303+0000 7f992c532800 10 monclient(hunting): picked mon.noname-a con 0x55735daab970 addr [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] 2023-12-03T11:48:01.436 INFO:tasks.workunit.client.0.smithi003.stderr: -344> 2023-12-03T11:48:01.303+0000 7f992c532800 10 monclient(hunting): start opening mon connection 2023-12-03T11:48:01.436 INFO:tasks.workunit.client.0.smithi003.stderr: -343> 2023-12-03T11:48:01.303+0000 7f992c532800 10 monclient(hunting): start opening mon connection 2023-12-03T11:48:01.436 INFO:tasks.workunit.client.0.smithi003.stderr: -342> 2023-12-03T11:48:01.303+0000 7f992c532800 10 monclient(hunting): start opening mon connection 2023-12-03T11:48:01.436 INFO:tasks.workunit.client.0.smithi003.stderr: -341> 2023-12-03T11:48:01.303+0000 7f992c532800 10 monclient(hunting): _renew_subs 2023-12-03T11:48:01.436 INFO:tasks.workunit.client.0.smithi003.stderr: -340> 2023-12-03T11:48:01.303+0000 7f992c532800 10 monclient(hunting): authenticate will time out at 1703.541983s 2023-12-03T11:48:01.436 INFO:tasks.workunit.client.0.smithi003.stderr: -339> 2023-12-03T11:48:01.303+0000 7f992895c640 10 monclient(hunting): get_auth_request con 0x55735daab970 auth_method 0 2023-12-03T11:48:01.436 INFO:tasks.workunit.client.0.smithi003.stderr: -338> 2023-12-03T11:48:01.303+0000 7f992895c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:48:01.436 INFO:tasks.workunit.client.0.smithi003.stderr: -337> 2023-12-03T11:48:01.303+0000 7f992895c640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:48:01.436 INFO:tasks.workunit.client.0.smithi003.stderr: -336> 2023-12-03T11:48:01.303+0000 7f992895c640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:48:01.436 INFO:tasks.workunit.client.0.smithi003.stderr: -335> 2023-12-03T11:48:01.303+0000 7f992795a640 10 monclient(hunting): get_auth_request con 0x55735daa3e50 auth_method 0 2023-12-03T11:48:01.436 INFO:tasks.workunit.client.0.smithi003.stderr: -334> 2023-12-03T11:48:01.303+0000 7f992795a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:48:01.437 INFO:tasks.workunit.client.0.smithi003.stderr: -333> 2023-12-03T11:48:01.303+0000 7f992795a640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:48:01.437 INFO:tasks.workunit.client.0.smithi003.stderr: -332> 2023-12-03T11:48:01.303+0000 7f992795a640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:48:01.437 INFO:tasks.workunit.client.0.smithi003.stderr: -331> 2023-12-03T11:48:01.303+0000 7f992815b640 10 monclient(hunting): get_auth_request con 0x55735da78330 auth_method 0 2023-12-03T11:48:01.437 INFO:tasks.workunit.client.0.smithi003.stderr: -330> 2023-12-03T11:48:01.303+0000 7f992815b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:48:01.437 INFO:tasks.workunit.client.0.smithi003.stderr: -329> 2023-12-03T11:48:01.303+0000 7f992815b640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:48:01.437 INFO:tasks.workunit.client.0.smithi003.stderr: -328> 2023-12-03T11:48:01.303+0000 7f992815b640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:48:01.437 INFO:tasks.workunit.client.0.smithi003.stderr: -327> 2023-12-03T11:48:01.303+0000 7f992895c640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:48:01.437 INFO:tasks.workunit.client.0.smithi003.stderr: -326> 2023-12-03T11:48:01.303+0000 7f992895c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:48:01.437 INFO:tasks.workunit.client.0.smithi003.stderr: -325> 2023-12-03T11:48:01.303+0000 7f992895c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:48:01.437 INFO:tasks.workunit.client.0.smithi003.stderr: -324> 2023-12-03T11:48:01.303+0000 7f992795a640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:48:01.437 INFO:tasks.workunit.client.0.smithi003.stderr: -323> 2023-12-03T11:48:01.303+0000 7f992795a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:48:01.437 INFO:tasks.workunit.client.0.smithi003.stderr: -322> 2023-12-03T11:48:01.303+0000 7f992795a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:48:01.437 INFO:tasks.workunit.client.0.smithi003.stderr: -321> 2023-12-03T11:48:01.303+0000 7f992815b640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:48:01.437 INFO:tasks.workunit.client.0.smithi003.stderr: -320> 2023-12-03T11:48:01.303+0000 7f992815b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:48:01.438 INFO:tasks.workunit.client.0.smithi003.stderr: -319> 2023-12-03T11:48:01.303+0000 7f992815b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:48:01.438 INFO:tasks.workunit.client.0.smithi003.stderr: -318> 2023-12-03T11:48:01.304+0000 7f992895c640 10 monclient(hunting): handle_auth_done global_id 6543 payload 824 2023-12-03T11:48:01.438 INFO:tasks.workunit.client.0.smithi003.stderr: -317> 2023-12-03T11:48:01.304+0000 7f992895c640 10 monclient: _finish_hunting 0 2023-12-03T11:48:01.438 INFO:tasks.workunit.client.0.smithi003.stderr: -316> 2023-12-03T11:48:01.304+0000 7f992895c640 1 monclient: found mon.noname-a 2023-12-03T11:48:01.438 INFO:tasks.workunit.client.0.smithi003.stderr: -315> 2023-12-03T11:48:01.304+0000 7f992895c640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.3:3300/0 2023-12-03T11:48:01.438 INFO:tasks.workunit.client.0.smithi003.stderr: -314> 2023-12-03T11:48:01.304+0000 7f990d7fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:48:01.438 INFO:tasks.workunit.client.0.smithi003.stderr: -313> 2023-12-03T11:48:01.304+0000 7f990d7fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-12-03T11:48:01.438 INFO:tasks.workunit.client.0.smithi003.stderr: -312> 2023-12-03T11:48:01.304+0000 7f990d7fa640 10 monclient: dump: 2023-12-03T11:48:01.438 INFO:tasks.workunit.client.0.smithi003.stderr:epoch 1 2023-12-03T11:48:01.438 INFO:tasks.workunit.client.0.smithi003.stderr:fsid 296556de-a4fc-4095-9b6d-0fe813c2865c 2023-12-03T11:48:01.438 INFO:tasks.workunit.client.0.smithi003.stderr:last_changed 2023-12-03T11:33:18.862564+0000 2023-12-03T11:48:01.438 INFO:tasks.workunit.client.0.smithi003.stderr:created 2023-12-03T11:33:18.862564+0000 2023-12-03T11:48:01.438 INFO:tasks.workunit.client.0.smithi003.stderr:min_mon_release 18 (reef) 2023-12-03T11:48:01.438 INFO:tasks.workunit.client.0.smithi003.stderr:election_strategy: 1 2023-12-03T11:48:01.438 INFO:tasks.workunit.client.0.smithi003.stderr:0: [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] mon.a 2023-12-03T11:48:01.439 INFO:tasks.workunit.client.0.smithi003.stderr:1: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.b 2023-12-03T11:48:01.439 INFO:tasks.workunit.client.0.smithi003.stderr:2: [v2:172.21.15.3:3301/0,v1:172.21.15.3:6790/0] mon.c 2023-12-03T11:48:01.439 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:48:01.439 INFO:tasks.workunit.client.0.smithi003.stderr: -311> 2023-12-03T11:48:01.304+0000 7f990d7fa640 10 monclient: _finish_auth 0 2023-12-03T11:48:01.439 INFO:tasks.workunit.client.0.smithi003.stderr: -310> 2023-12-03T11:48:01.304+0000 7f990d7fa640 10 monclient: _check_auth_tickets 2023-12-03T11:48:01.439 INFO:tasks.workunit.client.0.smithi003.stderr: -309> 2023-12-03T11:48:01.304+0000 7f990d7fa640 10 monclient: handle_config config(0 keys) v1 2023-12-03T11:48:01.439 INFO:tasks.workunit.client.0.smithi003.stderr: -308> 2023-12-03T11:48:01.304+0000 7f992c532800 5 monclient: authenticate success, global_id 6543 2023-12-03T11:48:01.439 INFO:tasks.workunit.client.0.smithi003.stderr: -307> 2023-12-03T11:48:01.304+0000 7f992c532800 10 monclient: _renew_subs 2023-12-03T11:48:01.439 INFO:tasks.workunit.client.0.smithi003.stderr: -306> 2023-12-03T11:48:01.304+0000 7f992c532800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.3:3300/0 2023-12-03T11:48:01.439 INFO:tasks.workunit.client.0.smithi003.stderr: -305> 2023-12-03T11:48:01.304+0000 7f990d7fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:48:01.439 INFO:tasks.workunit.client.0.smithi003.stderr: -304> 2023-12-03T11:48:01.304+0000 7f990effd640 4 set_mon_vals no callback set 2023-12-03T11:48:01.439 INFO:tasks.workunit.client.0.smithi003.stderr: -303> 2023-12-03T11:48:01.304+0000 7f990d7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-12-03T11:48:01.439 INFO:tasks.workunit.client.0.smithi003.stderr: -302> 2023-12-03T11:48:01.304+0000 7f990d7fa640 10 monclient: dump: 2023-12-03T11:48:01.439 INFO:tasks.workunit.client.0.smithi003.stderr:epoch 1 2023-12-03T11:48:01.440 INFO:tasks.workunit.client.0.smithi003.stderr:fsid 296556de-a4fc-4095-9b6d-0fe813c2865c 2023-12-03T11:48:01.440 INFO:tasks.workunit.client.0.smithi003.stderr:last_changed 2023-12-03T11:33:18.862564+0000 2023-12-03T11:48:01.440 INFO:tasks.workunit.client.0.smithi003.stderr:created 2023-12-03T11:33:18.862564+0000 2023-12-03T11:48:01.440 INFO:tasks.workunit.client.0.smithi003.stderr:min_mon_release 18 (reef) 2023-12-03T11:48:01.440 INFO:tasks.workunit.client.0.smithi003.stderr:election_strategy: 1 2023-12-03T11:48:01.440 INFO:tasks.workunit.client.0.smithi003.stderr:0: [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] mon.a 2023-12-03T11:48:01.440 INFO:tasks.workunit.client.0.smithi003.stderr:1: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.b 2023-12-03T11:48:01.440 INFO:tasks.workunit.client.0.smithi003.stderr:2: [v2:172.21.15.3:3301/0,v1:172.21.15.3:6790/0] mon.c 2023-12-03T11:48:01.440 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:48:01.440 INFO:tasks.workunit.client.0.smithi003.stderr: -301> 2023-12-03T11:48:01.304+0000 7f992c532800 10 monclient: _renew_subs 2023-12-03T11:48:01.440 INFO:tasks.workunit.client.0.smithi003.stderr: -300> 2023-12-03T11:48:01.304+0000 7f992c532800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.3:3300/0 2023-12-03T11:48:01.440 INFO:tasks.workunit.client.0.smithi003.stderr: -299> 2023-12-03T11:48:01.304+0000 7f992c532800 1 librados: init done 2023-12-03T11:48:01.440 INFO:tasks.workunit.client.0.smithi003.stderr: -298> 2023-12-03T11:48:01.305+0000 7f992c532800 20 rados->read ofs=0 len=0 2023-12-03T11:48:01.440 INFO:tasks.workunit.client.0.smithi003.stderr: -297> 2023-12-03T11:48:01.306+0000 7f990d7fa640 4 mgrc handle_mgr_map Got map version 5 2023-12-03T11:48:01.441 INFO:tasks.workunit.client.0.smithi003.stderr: -296> 2023-12-03T11:48:01.306+0000 7f990d7fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.37:6832/2165065416,v1:172.21.15.37:6833/2165065416] 2023-12-03T11:48:01.441 INFO:tasks.workunit.client.0.smithi003.stderr: -295> 2023-12-03T11:48:01.306+0000 7f990d7fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.37:6832/2165065416,v1:172.21.15.37:6833/2165065416] 2023-12-03T11:48:01.441 INFO:tasks.workunit.client.0.smithi003.stderr: -294> 2023-12-03T11:48:01.306+0000 7f992815b640 10 monclient: get_auth_request con 0x7f9904069820 auth_method 0 2023-12-03T11:48:01.441 INFO:tasks.workunit.client.0.smithi003.stderr: -293> 2023-12-03T11:48:01.306+0000 7f992795a640 10 monclient: get_auth_request con 0x55735dac0840 auth_method 0 2023-12-03T11:48:01.441 INFO:tasks.workunit.client.0.smithi003.stderr: -292> 2023-12-03T11:48:01.307+0000 7f992c532800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:01.441 INFO:tasks.workunit.client.0.smithi003.stderr: -291> 2023-12-03T11:48:01.307+0000 7f992c532800 20 realm 2023-12-03T11:48:01.441 INFO:tasks.workunit.client.0.smithi003.stderr: -290> 2023-12-03T11:48:01.307+0000 7f992c532800 20 rados->read ofs=0 len=0 2023-12-03T11:48:01.441 INFO:tasks.workunit.client.0.smithi003.stderr: -289> 2023-12-03T11:48:01.307+0000 7f992c532800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:01.441 INFO:tasks.workunit.client.0.smithi003.stderr: -288> 2023-12-03T11:48:01.307+0000 7f992c532800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:48:01.441 INFO:tasks.workunit.client.0.smithi003.stderr: -287> 2023-12-03T11:48:01.307+0000 7f992c532800 20 rados->read ofs=0 len=0 2023-12-03T11:48:01.441 INFO:tasks.workunit.client.0.smithi003.stderr: -286> 2023-12-03T11:48:01.307+0000 7f992c532800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:01.441 INFO:tasks.workunit.client.0.smithi003.stderr: -285> 2023-12-03T11:48:01.307+0000 7f992c532800 20 rados->read ofs=0 len=0 2023-12-03T11:48:01.441 INFO:tasks.workunit.client.0.smithi003.stderr: -284> 2023-12-03T11:48:01.307+0000 7f992815b640 10 monclient: get_auth_request con 0x55735dac47a0 auth_method 0 2023-12-03T11:48:01.441 INFO:tasks.workunit.client.0.smithi003.stderr: -283> 2023-12-03T11:48:01.308+0000 7f992c532800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:48:01.441 INFO:tasks.workunit.client.0.smithi003.stderr: -282> 2023-12-03T11:48:01.308+0000 7f992c532800 20 rados->read ofs=0 len=0 2023-12-03T11:48:01.442 INFO:tasks.workunit.client.0.smithi003.stderr: -281> 2023-12-03T11:48:01.308+0000 7f992c532800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:48:01.442 INFO:tasks.workunit.client.0.smithi003.stderr: -280> 2023-12-03T11:48:01.308+0000 7f992c532800 20 searching for the correct realm 2023-12-03T11:48:01.442 INFO:tasks.workunit.client.0.smithi003.stderr: -279> 2023-12-03T11:48:01.308+0000 7f992795a640 10 monclient: get_auth_request con 0x55735dac97a0 auth_method 0 2023-12-03T11:48:01.442 INFO:tasks.workunit.client.0.smithi003.stderr: -278> 2023-12-03T11:48:01.309+0000 7f992895c640 10 monclient: get_auth_request con 0x7f991c0609a0 auth_method 0 2023-12-03T11:48:01.442 INFO:tasks.workunit.client.0.smithi003.stderr: -277> 2023-12-03T11:48:01.310+0000 7f992815b640 10 monclient: get_auth_request con 0x7f9920080060 auth_method 0 2023-12-03T11:48:01.442 INFO:tasks.workunit.client.0.smithi003.stderr: -276> 2023-12-03T11:48:01.311+0000 7f992795a640 10 monclient: get_auth_request con 0x7f9918035040 auth_method 0 2023-12-03T11:48:01.442 INFO:tasks.workunit.client.0.smithi003.stderr: -275> 2023-12-03T11:48:01.311+0000 7f990d7fa640 1 client.6543.objecter ms_handle_reset 0x7f991c0609a0 session 0x7f991c088370 osd.7 2023-12-03T11:48:01.442 INFO:tasks.workunit.client.0.smithi003.stderr: -274> 2023-12-03T11:48:01.311+0000 7f990d7fa640 10 monclient: _renew_subs 2023-12-03T11:48:01.442 INFO:tasks.workunit.client.0.smithi003.stderr: -273> 2023-12-03T11:48:01.311+0000 7f990d7fa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.3:3300/0 2023-12-03T11:48:01.442 INFO:tasks.workunit.client.0.smithi003.stderr: -272> 2023-12-03T11:48:01.311+0000 7f992895c640 10 monclient: get_auth_request con 0x7f9904079e10 auth_method 0 2023-12-03T11:48:01.442 INFO:tasks.workunit.client.0.smithi003.stderr: -271> 2023-12-03T11:48:01.313+0000 7f992895c640 10 monclient: get_auth_request con 0x7f991c058e40 auth_method 0 2023-12-03T11:48:01.442 INFO:tasks.workunit.client.0.smithi003.stderr: -270> 2023-12-03T11:48:01.315+0000 7f992815b640 10 monclient: get_auth_request con 0x7f991c077250 auth_method 0 2023-12-03T11:48:01.442 INFO:tasks.workunit.client.0.smithi003.stderr: -269> 2023-12-03T11:48:01.318+0000 7f992815b640 0 -- 172.21.15.3:0/3689260636 >> [v2:172.21.15.3:6808/263125788,v1:172.21.15.3:6809/263125788] conn(0x7f991c077250 msgr2=0x7f991c077790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:48:01.442 INFO:tasks.workunit.client.0.smithi003.stderr: -268> 2023-12-03T11:48:01.318+0000 7f990d7fa640 1 client.6543.objecter ms_handle_reset 0x7f991c077250 session 0x7f991c056f80 osd.0 2023-12-03T11:48:01.442 INFO:tasks.workunit.client.0.smithi003.stderr: -267> 2023-12-03T11:48:01.318+0000 7f992815b640 10 monclient: get_auth_request con 0x7f991c0609a0 auth_method 0 2023-12-03T11:48:01.443 INFO:tasks.workunit.client.0.smithi003.stderr: -266> 2023-12-03T11:48:01.320+0000 7f992c532800 20 RGWRados::pool_iterate: got zone_info.83aabb46-04b5-4c96-9933-c6bfb1173a73 2023-12-03T11:48:01.443 INFO:tasks.workunit.client.0.smithi003.stderr: -265> 2023-12-03T11:48:01.320+0000 7f992c532800 20 RGWRados::pool_iterate: got zonegroup_info.6a811aad-435d-4fdd-93c9-b7e0b50de429 2023-12-03T11:48:01.443 INFO:tasks.workunit.client.0.smithi003.stderr: -264> 2023-12-03T11:48:01.320+0000 7f992c532800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:48:01.443 INFO:tasks.workunit.client.0.smithi003.stderr: -263> 2023-12-03T11:48:01.320+0000 7f992c532800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:48:01.443 INFO:tasks.workunit.client.0.smithi003.stderr: -262> 2023-12-03T11:48:01.320+0000 7f992c532800 20 rados->read ofs=0 len=0 2023-12-03T11:48:01.443 INFO:tasks.workunit.client.0.smithi003.stderr: -261> 2023-12-03T11:48:01.320+0000 7f992c532800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:01.443 INFO:tasks.workunit.client.0.smithi003.stderr: -260> 2023-12-03T11:48:01.320+0000 7f992c532800 20 rados->read ofs=0 len=0 2023-12-03T11:48:01.443 INFO:tasks.workunit.client.0.smithi003.stderr: -259> 2023-12-03T11:48:01.320+0000 7f992c532800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:48:01.443 INFO:tasks.workunit.client.0.smithi003.stderr: -258> 2023-12-03T11:48:01.320+0000 7f992c532800 20 rados->read ofs=0 len=0 2023-12-03T11:48:01.443 INFO:tasks.workunit.client.0.smithi003.stderr: -257> 2023-12-03T11:48:01.320+0000 7f992c532800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:48:01.443 INFO:tasks.workunit.client.0.smithi003.stderr: -256> 2023-12-03T11:48:01.320+0000 7f992c532800 20 zone default found 2023-12-03T11:48:01.443 INFO:tasks.workunit.client.0.smithi003.stderr: -255> 2023-12-03T11:48:01.320+0000 7f992c532800 4 Realm: () 2023-12-03T11:48:01.443 INFO:tasks.workunit.client.0.smithi003.stderr: -254> 2023-12-03T11:48:01.320+0000 7f992c532800 4 ZoneGroup: default (6a811aad-435d-4fdd-93c9-b7e0b50de429) 2023-12-03T11:48:01.443 INFO:tasks.workunit.client.0.smithi003.stderr: -253> 2023-12-03T11:48:01.320+0000 7f992c532800 4 Zone: default (83aabb46-04b5-4c96-9933-c6bfb1173a73) 2023-12-03T11:48:01.443 INFO:tasks.workunit.client.0.smithi003.stderr: -252> 2023-12-03T11:48:01.320+0000 7f992c532800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:48:01.444 INFO:tasks.workunit.client.0.smithi003.stderr: -251> 2023-12-03T11:48:01.320+0000 7f992c532800 20 zonegroup default 2023-12-03T11:48:01.444 INFO:tasks.workunit.client.0.smithi003.stderr: -250> 2023-12-03T11:48:01.320+0000 7f992c532800 20 rados->read ofs=0 len=0 2023-12-03T11:48:01.444 INFO:tasks.workunit.client.0.smithi003.stderr: -249> 2023-12-03T11:48:01.321+0000 7f992c532800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:01.444 INFO:tasks.workunit.client.0.smithi003.stderr: -248> 2023-12-03T11:48:01.321+0000 7f992c532800 20 rados->read ofs=0 len=0 2023-12-03T11:48:01.444 INFO:tasks.workunit.client.0.smithi003.stderr: -247> 2023-12-03T11:48:01.321+0000 7f992c532800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:01.444 INFO:tasks.workunit.client.0.smithi003.stderr: -246> 2023-12-03T11:48:01.321+0000 7f992c532800 20 rados->read ofs=0 len=0 2023-12-03T11:48:01.444 INFO:tasks.workunit.client.0.smithi003.stderr: -245> 2023-12-03T11:48:01.321+0000 7f992c532800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:01.444 INFO:tasks.workunit.client.0.smithi003.stderr: -244> 2023-12-03T11:48:01.321+0000 7f992c532800 20 started sync module instance, tier type = 2023-12-03T11:48:01.444 INFO:tasks.workunit.client.0.smithi003.stderr: -243> 2023-12-03T11:48:01.321+0000 7f992c532800 20 started zone id=83aabb46-04b5-4c96-9933-c6bfb1173a73 (name=default) with tier type = 2023-12-03T11:48:01.444 INFO:tasks.workunit.client.0.smithi003.stderr: -242> 2023-12-03T11:48:01.326+0000 7f992895c640 0 -- 172.21.15.3:0/3689260636 >> [v2:172.21.15.37:6817/511039327,v1:172.21.15.37:6819/511039327] conn(0x7f9904079e10 msgr2=0x7f990407c240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:48:01.444 INFO:tasks.workunit.client.0.smithi003.stderr: -241> 2023-12-03T11:48:01.326+0000 7f990d7fa640 1 client.6543.objecter ms_handle_reset 0x7f9904079e10 session 0x7f991c088370 osd.7 2023-12-03T11:48:01.444 INFO:tasks.workunit.client.0.smithi003.stderr: -240> 2023-12-03T11:48:01.326+0000 7f992895c640 10 monclient: get_auth_request con 0x7f991c077250 auth_method 0 2023-12-03T11:48:01.444 INFO:tasks.workunit.client.0.smithi003.stderr: -239> 2023-12-03T11:48:01.330+0000 7f992c532800 20 add_watcher() i=0 2023-12-03T11:48:01.444 INFO:tasks.workunit.client.0.smithi003.stderr: -238> 2023-12-03T11:48:01.330+0000 7f992c532800 20 add_watcher() i=1 2023-12-03T11:48:01.444 INFO:tasks.workunit.client.0.smithi003.stderr: -237> 2023-12-03T11:48:01.330+0000 7f992c532800 20 add_watcher() i=2 2023-12-03T11:48:01.444 INFO:tasks.workunit.client.0.smithi003.stderr: -236> 2023-12-03T11:48:01.330+0000 7f992c532800 20 add_watcher() i=3 2023-12-03T11:48:01.445 INFO:tasks.workunit.client.0.smithi003.stderr: -235> 2023-12-03T11:48:01.330+0000 7f992c532800 20 add_watcher() i=4 2023-12-03T11:48:01.445 INFO:tasks.workunit.client.0.smithi003.stderr: -234> 2023-12-03T11:48:01.330+0000 7f992c532800 20 add_watcher() i=5 2023-12-03T11:48:01.445 INFO:tasks.workunit.client.0.smithi003.stderr: -233> 2023-12-03T11:48:01.330+0000 7f992c532800 20 add_watcher() i=6 2023-12-03T11:48:01.445 INFO:tasks.workunit.client.0.smithi003.stderr: -232> 2023-12-03T11:48:01.331+0000 7f992c532800 20 add_watcher() i=7 2023-12-03T11:48:01.445 INFO:tasks.workunit.client.0.smithi003.stderr: -231> 2023-12-03T11:48:01.331+0000 7f992c532800 2 all 8 watchers are set, enabling cache 2023-12-03T11:48:01.445 INFO:tasks.workunit.client.0.smithi003.stderr: -230> 2023-12-03T11:48:01.333+0000 7f992c532800 5 AuthRegistry(0x7ffdc5f4cd10) adding auth protocol: cephx 2023-12-03T11:48:01.445 INFO:tasks.workunit.client.0.smithi003.stderr: -229> 2023-12-03T11:48:01.333+0000 7f992c532800 5 AuthRegistry(0x7ffdc5f4cd10) adding auth protocol: cephx 2023-12-03T11:48:01.445 INFO:tasks.workunit.client.0.smithi003.stderr: -228> 2023-12-03T11:48:01.333+0000 7f992c532800 5 AuthRegistry(0x7ffdc5f4cd10) adding auth protocol: cephx 2023-12-03T11:48:01.445 INFO:tasks.workunit.client.0.smithi003.stderr: -227> 2023-12-03T11:48:01.333+0000 7f992c532800 5 AuthRegistry(0x7ffdc5f4cd10) adding con mode: secure 2023-12-03T11:48:01.445 INFO:tasks.workunit.client.0.smithi003.stderr: -226> 2023-12-03T11:48:01.333+0000 7f992c532800 5 AuthRegistry(0x7ffdc5f4cd10) adding con mode: crc 2023-12-03T11:48:01.445 INFO:tasks.workunit.client.0.smithi003.stderr: -225> 2023-12-03T11:48:01.333+0000 7f992c532800 5 AuthRegistry(0x7ffdc5f4cd10) adding con mode: secure 2023-12-03T11:48:01.445 INFO:tasks.workunit.client.0.smithi003.stderr: -224> 2023-12-03T11:48:01.333+0000 7f992c532800 5 AuthRegistry(0x7ffdc5f4cd10) adding con mode: crc 2023-12-03T11:48:01.445 INFO:tasks.workunit.client.0.smithi003.stderr: -223> 2023-12-03T11:48:01.333+0000 7f992c532800 5 AuthRegistry(0x7ffdc5f4cd10) adding con mode: secure 2023-12-03T11:48:01.445 INFO:tasks.workunit.client.0.smithi003.stderr: -222> 2023-12-03T11:48:01.333+0000 7f992c532800 5 AuthRegistry(0x7ffdc5f4cd10) adding con mode: crc 2023-12-03T11:48:01.445 INFO:tasks.workunit.client.0.smithi003.stderr: -221> 2023-12-03T11:48:01.333+0000 7f992c532800 5 AuthRegistry(0x7ffdc5f4cd10) adding con mode: crc 2023-12-03T11:48:01.446 INFO:tasks.workunit.client.0.smithi003.stderr: -220> 2023-12-03T11:48:01.333+0000 7f992c532800 5 AuthRegistry(0x7ffdc5f4cd10) adding con mode: secure 2023-12-03T11:48:01.446 INFO:tasks.workunit.client.0.smithi003.stderr: -219> 2023-12-03T11:48:01.333+0000 7f992c532800 5 AuthRegistry(0x7ffdc5f4cd10) adding con mode: crc 2023-12-03T11:48:01.446 INFO:tasks.workunit.client.0.smithi003.stderr: -218> 2023-12-03T11:48:01.333+0000 7f992c532800 5 AuthRegistry(0x7ffdc5f4cd10) adding con mode: secure 2023-12-03T11:48:01.446 INFO:tasks.workunit.client.0.smithi003.stderr: -217> 2023-12-03T11:48:01.333+0000 7f98ee7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:48:01.446 INFO:tasks.workunit.client.0.smithi003.stderr: -216> 2023-12-03T11:48:01.333+0000 7f992c532800 5 AuthRegistry(0x7ffdc5f4cd10) adding con mode: crc 2023-12-03T11:48:01.446 INFO:tasks.workunit.client.0.smithi003.stderr: -215> 2023-12-03T11:48:01.333+0000 7f992c532800 5 AuthRegistry(0x7ffdc5f4cd10) adding con mode: secure 2023-12-03T11:48:01.446 INFO:tasks.workunit.client.0.smithi003.stderr: -214> 2023-12-03T11:48:01.333+0000 7f992c532800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:48:01.446 INFO:tasks.workunit.client.0.smithi003.stderr: -213> 2023-12-03T11:48:01.333+0000 7f992c532800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:48:01.446 INFO:tasks.workunit.client.0.smithi003.stderr: -212> 2023-12-03T11:48:01.333+0000 7f992c532800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:48:01.446 INFO:tasks.workunit.client.0.smithi003.stderr: -211> 2023-12-03T11:48:01.333+0000 7f992c532800 5 asok(0x55735d868a10) register_command cache list hook 0x55735da4cb00 2023-12-03T11:48:01.446 INFO:tasks.workunit.client.0.smithi003.stderr: -210> 2023-12-03T11:48:01.333+0000 7f992c532800 5 asok(0x55735d868a10) register_command cache inspect hook 0x55735da4cb00 2023-12-03T11:48:01.446 INFO:tasks.workunit.client.0.smithi003.stderr: -209> 2023-12-03T11:48:01.333+0000 7f992c532800 5 asok(0x55735d868a10) register_command cache erase hook 0x55735da4cb00 2023-12-03T11:48:01.446 INFO:tasks.workunit.client.0.smithi003.stderr: -208> 2023-12-03T11:48:01.333+0000 7f992c532800 5 asok(0x55735d868a10) register_command cache zap hook 0x55735da4cb00 2023-12-03T11:48:01.446 INFO:tasks.workunit.client.0.smithi003.stderr: -207> 2023-12-03T11:48:01.333+0000 7f992c532800 10 monclient: get_monmap_and_config 2023-12-03T11:48:01.447 INFO:tasks.workunit.client.0.smithi003.stderr: -206> 2023-12-03T11:48:01.333+0000 7f992c532800 10 monclient: build_initial_monmap 2023-12-03T11:48:01.447 INFO:tasks.workunit.client.0.smithi003.stderr: -205> 2023-12-03T11:48:01.333+0000 7f992c532800 1 build_initial for_mkfs: 0 2023-12-03T11:48:01.447 INFO:tasks.workunit.client.0.smithi003.stderr: -204> 2023-12-03T11:48:01.333+0000 7f992c532800 10 monclient: monmap: 2023-12-03T11:48:01.447 INFO:tasks.workunit.client.0.smithi003.stderr:epoch 0 2023-12-03T11:48:01.447 INFO:tasks.workunit.client.0.smithi003.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-12-03T11:48:01.447 INFO:tasks.workunit.client.0.smithi003.stderr:last_changed 0.000000 2023-12-03T11:48:01.447 INFO:tasks.workunit.client.0.smithi003.stderr:created 0.000000 2023-12-03T11:48:01.447 INFO:tasks.workunit.client.0.smithi003.stderr:min_mon_release 0 (unknown) 2023-12-03T11:48:01.447 INFO:tasks.workunit.client.0.smithi003.stderr:election_strategy: 1 2023-12-03T11:48:01.447 INFO:tasks.workunit.client.0.smithi003.stderr:0: [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] mon.noname-a 2023-12-03T11:48:01.447 INFO:tasks.workunit.client.0.smithi003.stderr:1: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.noname-b 2023-12-03T11:48:01.447 INFO:tasks.workunit.client.0.smithi003.stderr:2: [v2:172.21.15.3:3301/0,v1:172.21.15.3:6790/0] mon.noname-c 2023-12-03T11:48:01.447 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:48:01.447 INFO:tasks.workunit.client.0.smithi003.stderr: -203> 2023-12-03T11:48:01.333+0000 7f992c532800 5 AuthRegistry(0x55735db080a0) adding auth protocol: cephx 2023-12-03T11:48:01.447 INFO:tasks.workunit.client.0.smithi003.stderr: -202> 2023-12-03T11:48:01.333+0000 7f992c532800 5 AuthRegistry(0x55735db080a0) adding auth protocol: cephx 2023-12-03T11:48:01.448 INFO:tasks.workunit.client.0.smithi003.stderr: -201> 2023-12-03T11:48:01.333+0000 7f992c532800 5 AuthRegistry(0x55735db080a0) adding auth protocol: cephx 2023-12-03T11:48:01.448 INFO:tasks.workunit.client.0.smithi003.stderr: -200> 2023-12-03T11:48:01.333+0000 7f992c532800 5 AuthRegistry(0x55735db080a0) adding con mode: secure 2023-12-03T11:48:01.448 INFO:tasks.workunit.client.0.smithi003.stderr: -199> 2023-12-03T11:48:01.333+0000 7f992c532800 5 AuthRegistry(0x55735db080a0) adding con mode: crc 2023-12-03T11:48:01.448 INFO:tasks.workunit.client.0.smithi003.stderr: -198> 2023-12-03T11:48:01.333+0000 7f992c532800 5 AuthRegistry(0x55735db080a0) adding con mode: secure 2023-12-03T11:48:01.448 INFO:tasks.workunit.client.0.smithi003.stderr: -197> 2023-12-03T11:48:01.333+0000 7f992c532800 5 AuthRegistry(0x55735db080a0) adding con mode: crc 2023-12-03T11:48:01.448 INFO:tasks.workunit.client.0.smithi003.stderr: -196> 2023-12-03T11:48:01.333+0000 7f992c532800 5 AuthRegistry(0x55735db080a0) adding con mode: secure 2023-12-03T11:48:01.448 INFO:tasks.workunit.client.0.smithi003.stderr: -195> 2023-12-03T11:48:01.333+0000 7f992c532800 5 AuthRegistry(0x55735db080a0) adding con mode: crc 2023-12-03T11:48:01.448 INFO:tasks.workunit.client.0.smithi003.stderr: -194> 2023-12-03T11:48:01.333+0000 7f992c532800 5 AuthRegistry(0x55735db080a0) adding con mode: crc 2023-12-03T11:48:01.448 INFO:tasks.workunit.client.0.smithi003.stderr: -193> 2023-12-03T11:48:01.333+0000 7f992c532800 5 AuthRegistry(0x55735db080a0) adding con mode: secure 2023-12-03T11:48:01.448 INFO:tasks.workunit.client.0.smithi003.stderr: -192> 2023-12-03T11:48:01.333+0000 7f992c532800 5 AuthRegistry(0x55735db080a0) adding con mode: crc 2023-12-03T11:48:01.448 INFO:tasks.workunit.client.0.smithi003.stderr: -191> 2023-12-03T11:48:01.333+0000 7f992c532800 5 AuthRegistry(0x55735db080a0) adding con mode: secure 2023-12-03T11:48:01.448 INFO:tasks.workunit.client.0.smithi003.stderr: -190> 2023-12-03T11:48:01.333+0000 7f992c532800 5 AuthRegistry(0x55735db080a0) adding con mode: crc 2023-12-03T11:48:01.448 INFO:tasks.workunit.client.0.smithi003.stderr: -189> 2023-12-03T11:48:01.333+0000 7f992c532800 5 AuthRegistry(0x55735db080a0) adding con mode: secure 2023-12-03T11:48:01.448 INFO:tasks.workunit.client.0.smithi003.stderr: -188> 2023-12-03T11:48:01.333+0000 7f992c532800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:48:01.448 INFO:tasks.workunit.client.0.smithi003.stderr: -187> 2023-12-03T11:48:01.333+0000 7f992c532800 10 monclient: init 2023-12-03T11:48:01.449 INFO:tasks.workunit.client.0.smithi003.stderr: -186> 2023-12-03T11:48:01.333+0000 7f992c532800 5 AuthRegistry(0x7ffdc5f4c860) adding auth protocol: cephx 2023-12-03T11:48:01.449 INFO:tasks.workunit.client.0.smithi003.stderr: -185> 2023-12-03T11:48:01.333+0000 7f992c532800 5 AuthRegistry(0x7ffdc5f4c860) adding auth protocol: cephx 2023-12-03T11:48:01.449 INFO:tasks.workunit.client.0.smithi003.stderr: -184> 2023-12-03T11:48:01.333+0000 7f992c532800 5 AuthRegistry(0x7ffdc5f4c860) adding auth protocol: cephx 2023-12-03T11:48:01.449 INFO:tasks.workunit.client.0.smithi003.stderr: -183> 2023-12-03T11:48:01.333+0000 7f992c532800 5 AuthRegistry(0x7ffdc5f4c860) adding con mode: secure 2023-12-03T11:48:01.449 INFO:tasks.workunit.client.0.smithi003.stderr: -182> 2023-12-03T11:48:01.333+0000 7f992c532800 5 AuthRegistry(0x7ffdc5f4c860) adding con mode: crc 2023-12-03T11:48:01.449 INFO:tasks.workunit.client.0.smithi003.stderr: -181> 2023-12-03T11:48:01.333+0000 7f992c532800 5 AuthRegistry(0x7ffdc5f4c860) adding con mode: secure 2023-12-03T11:48:01.449 INFO:tasks.workunit.client.0.smithi003.stderr: -180> 2023-12-03T11:48:01.333+0000 7f992c532800 5 AuthRegistry(0x7ffdc5f4c860) adding con mode: crc 2023-12-03T11:48:01.449 INFO:tasks.workunit.client.0.smithi003.stderr: -179> 2023-12-03T11:48:01.333+0000 7f992c532800 5 AuthRegistry(0x7ffdc5f4c860) adding con mode: secure 2023-12-03T11:48:01.449 INFO:tasks.workunit.client.0.smithi003.stderr: -178> 2023-12-03T11:48:01.333+0000 7f992c532800 5 AuthRegistry(0x7ffdc5f4c860) adding con mode: crc 2023-12-03T11:48:01.449 INFO:tasks.workunit.client.0.smithi003.stderr: -177> 2023-12-03T11:48:01.333+0000 7f992c532800 5 AuthRegistry(0x7ffdc5f4c860) adding con mode: crc 2023-12-03T11:48:01.449 INFO:tasks.workunit.client.0.smithi003.stderr: -176> 2023-12-03T11:48:01.333+0000 7f992c532800 5 AuthRegistry(0x7ffdc5f4c860) adding con mode: secure 2023-12-03T11:48:01.449 INFO:tasks.workunit.client.0.smithi003.stderr: -175> 2023-12-03T11:48:01.333+0000 7f992c532800 5 AuthRegistry(0x7ffdc5f4c860) adding con mode: crc 2023-12-03T11:48:01.449 INFO:tasks.workunit.client.0.smithi003.stderr: -174> 2023-12-03T11:48:01.333+0000 7f992c532800 5 AuthRegistry(0x7ffdc5f4c860) adding con mode: secure 2023-12-03T11:48:01.449 INFO:tasks.workunit.client.0.smithi003.stderr: -173> 2023-12-03T11:48:01.333+0000 7f992c532800 5 AuthRegistry(0x7ffdc5f4c860) adding con mode: crc 2023-12-03T11:48:01.449 INFO:tasks.workunit.client.0.smithi003.stderr: -172> 2023-12-03T11:48:01.333+0000 7f992c532800 5 AuthRegistry(0x7ffdc5f4c860) adding con mode: secure 2023-12-03T11:48:01.450 INFO:tasks.workunit.client.0.smithi003.stderr: -171> 2023-12-03T11:48:01.334+0000 7f992c532800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:48:01.450 INFO:tasks.workunit.client.0.smithi003.stderr: -170> 2023-12-03T11:48:01.334+0000 7f992c532800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:48:01.450 INFO:tasks.workunit.client.0.smithi003.stderr: -169> 2023-12-03T11:48:01.334+0000 7f992c532800 5 asok(0x55735d868a10) register_command rotate-key cmddesc rotate-key hook 0x7ffdc5f4c9a8 EEXIST 2023-12-03T11:48:01.450 INFO:tasks.workunit.client.0.smithi003.stderr: -168> 2023-12-03T11:48:01.334+0000 7f992c532800 10 monclient: _reopen_session rank -1 2023-12-03T11:48:01.450 INFO:tasks.workunit.client.0.smithi003.stderr: -167> 2023-12-03T11:48:01.334+0000 7f992c532800 10 monclient: _add_conns ranks=[0,1,2] 2023-12-03T11:48:01.450 INFO:tasks.workunit.client.0.smithi003.stderr: -166> 2023-12-03T11:48:01.334+0000 7f992c532800 10 monclient(hunting): picked mon.noname-a con 0x55735db09170 addr [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] 2023-12-03T11:48:01.450 INFO:tasks.workunit.client.0.smithi003.stderr: -165> 2023-12-03T11:48:01.334+0000 7f992c532800 10 monclient(hunting): picked mon.noname-b con 0x55735db14b70 addr [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] 2023-12-03T11:48:01.450 INFO:tasks.workunit.client.0.smithi003.stderr: -164> 2023-12-03T11:48:01.334+0000 7f992c532800 10 monclient(hunting): picked mon.noname-c con 0x55735db0f5e0 addr [v2:172.21.15.3:3301/0,v1:172.21.15.3:6790/0] 2023-12-03T11:48:01.450 INFO:tasks.workunit.client.0.smithi003.stderr: -163> 2023-12-03T11:48:01.334+0000 7f992c532800 10 monclient(hunting): start opening mon connection 2023-12-03T11:48:01.450 INFO:tasks.workunit.client.0.smithi003.stderr: -162> 2023-12-03T11:48:01.334+0000 7f992c532800 10 monclient(hunting): start opening mon connection 2023-12-03T11:48:01.450 INFO:tasks.workunit.client.0.smithi003.stderr: -161> 2023-12-03T11:48:01.334+0000 7f992c532800 10 monclient(hunting): start opening mon connection 2023-12-03T11:48:01.450 INFO:tasks.workunit.client.0.smithi003.stderr: -160> 2023-12-03T11:48:01.334+0000 7f992c532800 10 monclient(hunting): _renew_subs 2023-12-03T11:48:01.450 INFO:tasks.workunit.client.0.smithi003.stderr: -159> 2023-12-03T11:48:01.334+0000 7f992c532800 10 monclient(hunting): authenticate will time out at 1703.572792s 2023-12-03T11:48:01.450 INFO:tasks.workunit.client.0.smithi003.stderr: -158> 2023-12-03T11:48:01.334+0000 7f992895c640 10 monclient(hunting): get_auth_request con 0x55735db09170 auth_method 0 2023-12-03T11:48:01.450 INFO:tasks.workunit.client.0.smithi003.stderr: -157> 2023-12-03T11:48:01.334+0000 7f992895c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:48:01.451 INFO:tasks.workunit.client.0.smithi003.stderr: -156> 2023-12-03T11:48:01.334+0000 7f992895c640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:48:01.451 INFO:tasks.workunit.client.0.smithi003.stderr: -155> 2023-12-03T11:48:01.334+0000 7f992895c640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:48:01.451 INFO:tasks.workunit.client.0.smithi003.stderr: -154> 2023-12-03T11:48:01.334+0000 7f992795a640 10 monclient(hunting): get_auth_request con 0x55735db0f5e0 auth_method 0 2023-12-03T11:48:01.451 INFO:tasks.workunit.client.0.smithi003.stderr: -153> 2023-12-03T11:48:01.334+0000 7f992795a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:48:01.451 INFO:tasks.workunit.client.0.smithi003.stderr: -152> 2023-12-03T11:48:01.334+0000 7f992795a640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:48:01.451 INFO:tasks.workunit.client.0.smithi003.stderr: -151> 2023-12-03T11:48:01.334+0000 7f992795a640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:48:01.451 INFO:tasks.workunit.client.0.smithi003.stderr: -150> 2023-12-03T11:48:01.334+0000 7f992895c640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:48:01.451 INFO:tasks.workunit.client.0.smithi003.stderr: -149> 2023-12-03T11:48:01.334+0000 7f992895c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:48:01.451 INFO:tasks.workunit.client.0.smithi003.stderr: -148> 2023-12-03T11:48:01.334+0000 7f992895c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:48:01.451 INFO:tasks.workunit.client.0.smithi003.stderr: -147> 2023-12-03T11:48:01.334+0000 7f992795a640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:48:01.451 INFO:tasks.workunit.client.0.smithi003.stderr: -146> 2023-12-03T11:48:01.334+0000 7f992795a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:48:01.451 INFO:tasks.workunit.client.0.smithi003.stderr: -145> 2023-12-03T11:48:01.334+0000 7f992795a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:48:01.451 INFO:tasks.workunit.client.0.smithi003.stderr: -144> 2023-12-03T11:48:01.334+0000 7f992815b640 10 monclient(hunting): get_auth_request con 0x55735db14b70 auth_method 0 2023-12-03T11:48:01.451 INFO:tasks.workunit.client.0.smithi003.stderr: -143> 2023-12-03T11:48:01.334+0000 7f992815b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:48:01.451 INFO:tasks.workunit.client.0.smithi003.stderr: -142> 2023-12-03T11:48:01.334+0000 7f992815b640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:48:01.452 INFO:tasks.workunit.client.0.smithi003.stderr: -141> 2023-12-03T11:48:01.334+0000 7f992815b640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:48:01.452 INFO:tasks.workunit.client.0.smithi003.stderr: -140> 2023-12-03T11:48:01.334+0000 7f992795a640 10 monclient(hunting): handle_auth_done global_id 6191 payload 274 2023-12-03T11:48:01.452 INFO:tasks.workunit.client.0.smithi003.stderr: -139> 2023-12-03T11:48:01.334+0000 7f992795a640 10 monclient: _finish_hunting 0 2023-12-03T11:48:01.452 INFO:tasks.workunit.client.0.smithi003.stderr: -138> 2023-12-03T11:48:01.334+0000 7f992795a640 1 monclient: found mon.noname-c 2023-12-03T11:48:01.452 INFO:tasks.workunit.client.0.smithi003.stderr: -137> 2023-12-03T11:48:01.334+0000 7f992795a640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.3:3301/0 2023-12-03T11:48:01.452 INFO:tasks.workunit.client.0.smithi003.stderr: -136> 2023-12-03T11:48:01.335+0000 7f98edfe3640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:48:01.452 INFO:tasks.workunit.client.0.smithi003.stderr: -135> 2023-12-03T11:48:01.335+0000 7f98edfe3640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-12-03T11:48:01.452 INFO:tasks.workunit.client.0.smithi003.stderr: -134> 2023-12-03T11:48:01.335+0000 7f98edfe3640 10 monclient: dump: 2023-12-03T11:48:01.452 INFO:tasks.workunit.client.0.smithi003.stderr:epoch 1 2023-12-03T11:48:01.452 INFO:tasks.workunit.client.0.smithi003.stderr:fsid 296556de-a4fc-4095-9b6d-0fe813c2865c 2023-12-03T11:48:01.452 INFO:tasks.workunit.client.0.smithi003.stderr:last_changed 2023-12-03T11:33:18.862564+0000 2023-12-03T11:48:01.452 INFO:tasks.workunit.client.0.smithi003.stderr:created 2023-12-03T11:33:18.862564+0000 2023-12-03T11:48:01.452 INFO:tasks.workunit.client.0.smithi003.stderr:min_mon_release 18 (reef) 2023-12-03T11:48:01.452 INFO:tasks.workunit.client.0.smithi003.stderr:election_strategy: 1 2023-12-03T11:48:01.452 INFO:tasks.workunit.client.0.smithi003.stderr:0: [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] mon.a 2023-12-03T11:48:01.453 INFO:tasks.workunit.client.0.smithi003.stderr:1: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.b 2023-12-03T11:48:01.453 INFO:tasks.workunit.client.0.smithi003.stderr:2: [v2:172.21.15.3:3301/0,v1:172.21.15.3:6790/0] mon.c 2023-12-03T11:48:01.453 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:48:01.453 INFO:tasks.workunit.client.0.smithi003.stderr: -133> 2023-12-03T11:48:01.335+0000 7f98edfe3640 10 monclient: _finish_auth 0 2023-12-03T11:48:01.453 INFO:tasks.workunit.client.0.smithi003.stderr: -132> 2023-12-03T11:48:01.335+0000 7f98edfe3640 10 monclient: _check_auth_tickets 2023-12-03T11:48:01.453 INFO:tasks.workunit.client.0.smithi003.stderr: -131> 2023-12-03T11:48:01.335+0000 7f98edfe3640 10 monclient: handle_config config(0 keys) v1 2023-12-03T11:48:01.453 INFO:tasks.workunit.client.0.smithi003.stderr: -130> 2023-12-03T11:48:01.335+0000 7f98edfe3640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:48:01.453 INFO:tasks.workunit.client.0.smithi003.stderr: -129> 2023-12-03T11:48:01.335+0000 7f98edfe3640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-12-03T11:48:01.453 INFO:tasks.workunit.client.0.smithi003.stderr: -128> 2023-12-03T11:48:01.335+0000 7f98edfe3640 10 monclient: dump: 2023-12-03T11:48:01.453 INFO:tasks.workunit.client.0.smithi003.stderr:epoch 1 2023-12-03T11:48:01.453 INFO:tasks.workunit.client.0.smithi003.stderr:fsid 296556de-a4fc-4095-9b6d-0fe813c2865c 2023-12-03T11:48:01.453 INFO:tasks.workunit.client.0.smithi003.stderr:last_changed 2023-12-03T11:33:18.862564+0000 2023-12-03T11:48:01.453 INFO:tasks.workunit.client.0.smithi003.stderr:created 2023-12-03T11:33:18.862564+0000 2023-12-03T11:48:01.453 INFO:tasks.workunit.client.0.smithi003.stderr:min_mon_release 18 (reef) 2023-12-03T11:48:01.453 INFO:tasks.workunit.client.0.smithi003.stderr:election_strategy: 1 2023-12-03T11:48:01.454 INFO:tasks.workunit.client.0.smithi003.stderr:0: [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] mon.a 2023-12-03T11:48:01.454 INFO:tasks.workunit.client.0.smithi003.stderr:1: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.b 2023-12-03T11:48:01.454 INFO:tasks.workunit.client.0.smithi003.stderr:2: [v2:172.21.15.3:3301/0,v1:172.21.15.3:6790/0] mon.c 2023-12-03T11:48:01.454 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:48:01.454 INFO:tasks.workunit.client.0.smithi003.stderr: -127> 2023-12-03T11:48:01.335+0000 7f992c532800 5 monclient: authenticate success, global_id 6191 2023-12-03T11:48:01.454 INFO:tasks.workunit.client.0.smithi003.stderr: -126> 2023-12-03T11:48:01.335+0000 7f992c532800 10 monclient: get_monmap_and_config success 2023-12-03T11:48:01.454 INFO:tasks.workunit.client.0.smithi003.stderr: -125> 2023-12-03T11:48:01.335+0000 7f992c532800 4 set_mon_vals no callback set 2023-12-03T11:48:01.454 INFO:tasks.workunit.client.0.smithi003.stderr: -124> 2023-12-03T11:48:01.335+0000 7f992c532800 10 monclient: shutdown 2023-12-03T11:48:01.454 INFO:tasks.workunit.client.0.smithi003.stderr: -123> 2023-12-03T11:48:01.335+0000 7f992c532800 10 monclient: build_initial_monmap 2023-12-03T11:48:01.454 INFO:tasks.workunit.client.0.smithi003.stderr: -122> 2023-12-03T11:48:01.335+0000 7f992c532800 1 build_initial for_mkfs: 0 2023-12-03T11:48:01.454 INFO:tasks.workunit.client.0.smithi003.stderr: -121> 2023-12-03T11:48:01.335+0000 7f992c532800 10 monclient: monmap: 2023-12-03T11:48:01.454 INFO:tasks.workunit.client.0.smithi003.stderr:epoch 0 2023-12-03T11:48:01.454 INFO:tasks.workunit.client.0.smithi003.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-12-03T11:48:01.454 INFO:tasks.workunit.client.0.smithi003.stderr:last_changed 0.000000 2023-12-03T11:48:01.454 INFO:tasks.workunit.client.0.smithi003.stderr:created 0.000000 2023-12-03T11:48:01.455 INFO:tasks.workunit.client.0.smithi003.stderr:min_mon_release 0 (unknown) 2023-12-03T11:48:01.455 INFO:tasks.workunit.client.0.smithi003.stderr:election_strategy: 1 2023-12-03T11:48:01.455 INFO:tasks.workunit.client.0.smithi003.stderr:0: [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] mon.noname-a 2023-12-03T11:48:01.455 INFO:tasks.workunit.client.0.smithi003.stderr:1: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.noname-b 2023-12-03T11:48:01.455 INFO:tasks.workunit.client.0.smithi003.stderr:2: [v2:172.21.15.3:3301/0,v1:172.21.15.3:6790/0] mon.noname-c 2023-12-03T11:48:01.455 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:48:01.455 INFO:tasks.workunit.client.0.smithi003.stderr: -120> 2023-12-03T11:48:01.335+0000 7f992c532800 5 AuthRegistry(0x55735db080a0) adding auth protocol: cephx 2023-12-03T11:48:01.455 INFO:tasks.workunit.client.0.smithi003.stderr: -119> 2023-12-03T11:48:01.335+0000 7f992c532800 5 AuthRegistry(0x55735db080a0) adding auth protocol: cephx 2023-12-03T11:48:01.455 INFO:tasks.workunit.client.0.smithi003.stderr: -118> 2023-12-03T11:48:01.335+0000 7f992c532800 5 AuthRegistry(0x55735db080a0) adding auth protocol: cephx 2023-12-03T11:48:01.455 INFO:tasks.workunit.client.0.smithi003.stderr: -117> 2023-12-03T11:48:01.336+0000 7f992c532800 5 AuthRegistry(0x55735db080a0) adding con mode: secure 2023-12-03T11:48:01.455 INFO:tasks.workunit.client.0.smithi003.stderr: -116> 2023-12-03T11:48:01.336+0000 7f992c532800 5 AuthRegistry(0x55735db080a0) adding con mode: crc 2023-12-03T11:48:01.455 INFO:tasks.workunit.client.0.smithi003.stderr: -115> 2023-12-03T11:48:01.336+0000 7f992c532800 5 AuthRegistry(0x55735db080a0) adding con mode: secure 2023-12-03T11:48:01.455 INFO:tasks.workunit.client.0.smithi003.stderr: -114> 2023-12-03T11:48:01.336+0000 7f992c532800 5 AuthRegistry(0x55735db080a0) adding con mode: crc 2023-12-03T11:48:01.455 INFO:tasks.workunit.client.0.smithi003.stderr: -113> 2023-12-03T11:48:01.336+0000 7f992c532800 5 AuthRegistry(0x55735db080a0) adding con mode: secure 2023-12-03T11:48:01.455 INFO:tasks.workunit.client.0.smithi003.stderr: -112> 2023-12-03T11:48:01.336+0000 7f992c532800 5 AuthRegistry(0x55735db080a0) adding con mode: crc 2023-12-03T11:48:01.456 INFO:tasks.workunit.client.0.smithi003.stderr: -111> 2023-12-03T11:48:01.336+0000 7f992c532800 5 AuthRegistry(0x55735db080a0) adding con mode: crc 2023-12-03T11:48:01.456 INFO:tasks.workunit.client.0.smithi003.stderr: -110> 2023-12-03T11:48:01.336+0000 7f992c532800 5 AuthRegistry(0x55735db080a0) adding con mode: secure 2023-12-03T11:48:01.456 INFO:tasks.workunit.client.0.smithi003.stderr: -109> 2023-12-03T11:48:01.336+0000 7f992c532800 5 AuthRegistry(0x55735db080a0) adding con mode: crc 2023-12-03T11:48:01.456 INFO:tasks.workunit.client.0.smithi003.stderr: -108> 2023-12-03T11:48:01.336+0000 7f992c532800 5 AuthRegistry(0x55735db080a0) adding con mode: secure 2023-12-03T11:48:01.456 INFO:tasks.workunit.client.0.smithi003.stderr: -107> 2023-12-03T11:48:01.336+0000 7f992c532800 5 AuthRegistry(0x55735db080a0) adding con mode: crc 2023-12-03T11:48:01.456 INFO:tasks.workunit.client.0.smithi003.stderr: -106> 2023-12-03T11:48:01.336+0000 7f992c532800 5 AuthRegistry(0x55735db080a0) adding con mode: secure 2023-12-03T11:48:01.456 INFO:tasks.workunit.client.0.smithi003.stderr: -105> 2023-12-03T11:48:01.336+0000 7f992c532800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:48:01.456 INFO:tasks.workunit.client.0.smithi003.stderr: -104> 2023-12-03T11:48:01.336+0000 7f992c532800 1 librados: starting msgr at 2023-12-03T11:48:01.456 INFO:tasks.workunit.client.0.smithi003.stderr: -103> 2023-12-03T11:48:01.336+0000 7f992c532800 1 librados: starting objecter 2023-12-03T11:48:01.456 INFO:tasks.workunit.client.0.smithi003.stderr: -102> 2023-12-03T11:48:01.336+0000 7f992c532800 5 asok(0x55735d868a10) register_command objecter_requests cmddesc objecter_requests hook 0x55735dad05b0 EEXIST 2023-12-03T11:48:01.456 INFO:tasks.workunit.client.0.smithi003.stderr: -101> 2023-12-03T11:48:01.336+0000 7f992c532800 1 librados: setting wanted keys 2023-12-03T11:48:01.456 INFO:tasks.workunit.client.0.smithi003.stderr: -100> 2023-12-03T11:48:01.336+0000 7f992c532800 1 librados: calling monclient init 2023-12-03T11:48:01.456 INFO:tasks.workunit.client.0.smithi003.stderr: -99> 2023-12-03T11:48:01.336+0000 7f992c532800 10 monclient: init 2023-12-03T11:48:01.456 INFO:tasks.workunit.client.0.smithi003.stderr: -98> 2023-12-03T11:48:01.336+0000 7f992c532800 5 AuthRegistry(0x55735db0af38) adding auth protocol: cephx 2023-12-03T11:48:01.456 INFO:tasks.workunit.client.0.smithi003.stderr: -97> 2023-12-03T11:48:01.336+0000 7f992c532800 5 AuthRegistry(0x55735db0af38) adding auth protocol: cephx 2023-12-03T11:48:01.457 INFO:tasks.workunit.client.0.smithi003.stderr: -96> 2023-12-03T11:48:01.336+0000 7f992c532800 5 AuthRegistry(0x55735db0af38) adding auth protocol: cephx 2023-12-03T11:48:01.457 INFO:tasks.workunit.client.0.smithi003.stderr: -95> 2023-12-03T11:48:01.336+0000 7f992c532800 5 AuthRegistry(0x55735db0af38) adding con mode: secure 2023-12-03T11:48:01.457 INFO:tasks.workunit.client.0.smithi003.stderr: -94> 2023-12-03T11:48:01.336+0000 7f992c532800 5 AuthRegistry(0x55735db0af38) adding con mode: crc 2023-12-03T11:48:01.457 INFO:tasks.workunit.client.0.smithi003.stderr: -93> 2023-12-03T11:48:01.336+0000 7f992c532800 5 AuthRegistry(0x55735db0af38) adding con mode: secure 2023-12-03T11:48:01.457 INFO:tasks.workunit.client.0.smithi003.stderr: -92> 2023-12-03T11:48:01.336+0000 7f992c532800 5 AuthRegistry(0x55735db0af38) adding con mode: crc 2023-12-03T11:48:01.457 INFO:tasks.workunit.client.0.smithi003.stderr: -91> 2023-12-03T11:48:01.336+0000 7f992c532800 5 AuthRegistry(0x55735db0af38) adding con mode: secure 2023-12-03T11:48:01.457 INFO:tasks.workunit.client.0.smithi003.stderr: -90> 2023-12-03T11:48:01.336+0000 7f992c532800 5 AuthRegistry(0x55735db0af38) adding con mode: crc 2023-12-03T11:48:01.457 INFO:tasks.workunit.client.0.smithi003.stderr: -89> 2023-12-03T11:48:01.336+0000 7f992c532800 5 AuthRegistry(0x55735db0af38) adding con mode: crc 2023-12-03T11:48:01.457 INFO:tasks.workunit.client.0.smithi003.stderr: -88> 2023-12-03T11:48:01.336+0000 7f992c532800 5 AuthRegistry(0x55735db0af38) adding con mode: secure 2023-12-03T11:48:01.457 INFO:tasks.workunit.client.0.smithi003.stderr: -87> 2023-12-03T11:48:01.336+0000 7f992c532800 5 AuthRegistry(0x55735db0af38) adding con mode: crc 2023-12-03T11:48:01.457 INFO:tasks.workunit.client.0.smithi003.stderr: -86> 2023-12-03T11:48:01.336+0000 7f992c532800 5 AuthRegistry(0x55735db0af38) adding con mode: secure 2023-12-03T11:48:01.457 INFO:tasks.workunit.client.0.smithi003.stderr: -85> 2023-12-03T11:48:01.336+0000 7f992c532800 5 AuthRegistry(0x55735db0af38) adding con mode: crc 2023-12-03T11:48:01.457 INFO:tasks.workunit.client.0.smithi003.stderr: -84> 2023-12-03T11:48:01.336+0000 7f992c532800 5 AuthRegistry(0x55735db0af38) adding con mode: secure 2023-12-03T11:48:01.457 INFO:tasks.workunit.client.0.smithi003.stderr: -83> 2023-12-03T11:48:01.336+0000 7f992c532800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:48:01.458 INFO:tasks.workunit.client.0.smithi003.stderr: -82> 2023-12-03T11:48:01.336+0000 7f992c532800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:48:01.458 INFO:tasks.workunit.client.0.smithi003.stderr: -81> 2023-12-03T11:48:01.336+0000 7f992c532800 5 asok(0x55735d868a10) register_command rotate-key cmddesc rotate-key hook 0x55735db0b080 EEXIST 2023-12-03T11:48:01.458 INFO:tasks.workunit.client.0.smithi003.stderr: -80> 2023-12-03T11:48:01.336+0000 7f992c532800 10 monclient: _reopen_session rank -1 2023-12-03T11:48:01.458 INFO:tasks.workunit.client.0.smithi003.stderr: -79> 2023-12-03T11:48:01.336+0000 7f992c532800 10 monclient: _add_conns ranks=[1,0,2] 2023-12-03T11:48:01.458 INFO:tasks.workunit.client.0.smithi003.stderr: -78> 2023-12-03T11:48:01.336+0000 7f992c532800 10 monclient(hunting): picked mon.noname-b con 0x55735db09170 addr [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] 2023-12-03T11:48:01.458 INFO:tasks.workunit.client.0.smithi003.stderr: -77> 2023-12-03T11:48:01.336+0000 7f992c532800 10 monclient(hunting): picked mon.noname-a con 0x55735db0f5e0 addr [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] 2023-12-03T11:48:01.458 INFO:tasks.workunit.client.0.smithi003.stderr: -76> 2023-12-03T11:48:01.336+0000 7f992c532800 10 monclient(hunting): picked mon.noname-c con 0x55735db14b70 addr [v2:172.21.15.3:3301/0,v1:172.21.15.3:6790/0] 2023-12-03T11:48:01.458 INFO:tasks.workunit.client.0.smithi003.stderr: -75> 2023-12-03T11:48:01.336+0000 7f992c532800 10 monclient(hunting): start opening mon connection 2023-12-03T11:48:01.458 INFO:tasks.workunit.client.0.smithi003.stderr: -74> 2023-12-03T11:48:01.336+0000 7f992c532800 10 monclient(hunting): start opening mon connection 2023-12-03T11:48:01.458 INFO:tasks.workunit.client.0.smithi003.stderr: -73> 2023-12-03T11:48:01.336+0000 7f992c532800 10 monclient(hunting): start opening mon connection 2023-12-03T11:48:01.458 INFO:tasks.workunit.client.0.smithi003.stderr: -72> 2023-12-03T11:48:01.336+0000 7f992c532800 10 monclient(hunting): _renew_subs 2023-12-03T11:48:01.459 INFO:tasks.workunit.client.0.smithi003.stderr: -71> 2023-12-03T11:48:01.336+0000 7f992c532800 10 monclient(hunting): authenticate will time out at 1703.575298s 2023-12-03T11:48:01.459 INFO:tasks.workunit.client.0.smithi003.stderr: -70> 2023-12-03T11:48:01.337+0000 7f992815b640 10 monclient(hunting): get_auth_request con 0x55735db0f5e0 auth_method 0 2023-12-03T11:48:01.459 INFO:tasks.workunit.client.0.smithi003.stderr: -69> 2023-12-03T11:48:01.337+0000 7f992815b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:48:01.459 INFO:tasks.workunit.client.0.smithi003.stderr: -68> 2023-12-03T11:48:01.337+0000 7f992815b640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:48:01.459 INFO:tasks.workunit.client.0.smithi003.stderr: -67> 2023-12-03T11:48:01.337+0000 7f992815b640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:48:01.459 INFO:tasks.workunit.client.0.smithi003.stderr: -66> 2023-12-03T11:48:01.337+0000 7f992795a640 10 monclient(hunting): get_auth_request con 0x55735db14b70 auth_method 0 2023-12-03T11:48:01.459 INFO:tasks.workunit.client.0.smithi003.stderr: -65> 2023-12-03T11:48:01.337+0000 7f992795a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:48:01.459 INFO:tasks.workunit.client.0.smithi003.stderr: -64> 2023-12-03T11:48:01.337+0000 7f992795a640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:48:01.459 INFO:tasks.workunit.client.0.smithi003.stderr: -63> 2023-12-03T11:48:01.337+0000 7f992795a640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:48:01.459 INFO:tasks.workunit.client.0.smithi003.stderr: -62> 2023-12-03T11:48:01.337+0000 7f992815b640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:48:01.459 INFO:tasks.workunit.client.0.smithi003.stderr: -61> 2023-12-03T11:48:01.337+0000 7f992815b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:48:01.459 INFO:tasks.workunit.client.0.smithi003.stderr: -60> 2023-12-03T11:48:01.337+0000 7f992815b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:48:01.459 INFO:tasks.workunit.client.0.smithi003.stderr: -59> 2023-12-03T11:48:01.337+0000 7f992895c640 10 monclient(hunting): get_auth_request con 0x55735db09170 auth_method 0 2023-12-03T11:48:01.459 INFO:tasks.workunit.client.0.smithi003.stderr: -58> 2023-12-03T11:48:01.337+0000 7f992895c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:48:01.460 INFO:tasks.workunit.client.0.smithi003.stderr: -57> 2023-12-03T11:48:01.337+0000 7f992895c640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:48:01.460 INFO:tasks.workunit.client.0.smithi003.stderr: -56> 2023-12-03T11:48:01.337+0000 7f992895c640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:48:01.460 INFO:tasks.workunit.client.0.smithi003.stderr: -55> 2023-12-03T11:48:01.337+0000 7f992795a640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:48:01.460 INFO:tasks.workunit.client.0.smithi003.stderr: -54> 2023-12-03T11:48:01.337+0000 7f992795a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:48:01.460 INFO:tasks.workunit.client.0.smithi003.stderr: -53> 2023-12-03T11:48:01.337+0000 7f992795a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:48:01.460 INFO:tasks.workunit.client.0.smithi003.stderr: -52> 2023-12-03T11:48:01.337+0000 7f992895c640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:48:01.460 INFO:tasks.workunit.client.0.smithi003.stderr: -51> 2023-12-03T11:48:01.337+0000 7f992895c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:48:01.460 INFO:tasks.workunit.client.0.smithi003.stderr: -50> 2023-12-03T11:48:01.337+0000 7f992895c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:48:01.460 INFO:tasks.workunit.client.0.smithi003.stderr: -49> 2023-12-03T11:48:01.337+0000 7f992815b640 10 monclient(hunting): handle_auth_done global_id 6549 payload 824 2023-12-03T11:48:01.460 INFO:tasks.workunit.client.0.smithi003.stderr: -48> 2023-12-03T11:48:01.337+0000 7f992815b640 10 monclient: _finish_hunting 0 2023-12-03T11:48:01.460 INFO:tasks.workunit.client.0.smithi003.stderr: -47> 2023-12-03T11:48:01.337+0000 7f992815b640 1 monclient: found mon.noname-a 2023-12-03T11:48:01.460 INFO:tasks.workunit.client.0.smithi003.stderr: -46> 2023-12-03T11:48:01.337+0000 7f992815b640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.3:3300/0 2023-12-03T11:48:01.460 INFO:tasks.workunit.client.0.smithi003.stderr: -45> 2023-12-03T11:48:01.337+0000 7f985ffff640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:48:01.460 INFO:tasks.workunit.client.0.smithi003.stderr: -44> 2023-12-03T11:48:01.337+0000 7f985ffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-12-03T11:48:01.460 INFO:tasks.workunit.client.0.smithi003.stderr: -43> 2023-12-03T11:48:01.337+0000 7f985ffff640 10 monclient: dump: 2023-12-03T11:48:01.460 INFO:tasks.workunit.client.0.smithi003.stderr:epoch 1 2023-12-03T11:48:01.461 INFO:tasks.workunit.client.0.smithi003.stderr:fsid 296556de-a4fc-4095-9b6d-0fe813c2865c 2023-12-03T11:48:01.461 INFO:tasks.workunit.client.0.smithi003.stderr:last_changed 2023-12-03T11:33:18.862564+0000 2023-12-03T11:48:01.461 INFO:tasks.workunit.client.0.smithi003.stderr:created 2023-12-03T11:33:18.862564+0000 2023-12-03T11:48:01.461 INFO:tasks.workunit.client.0.smithi003.stderr:min_mon_release 18 (reef) 2023-12-03T11:48:01.461 INFO:tasks.workunit.client.0.smithi003.stderr:election_strategy: 1 2023-12-03T11:48:01.461 INFO:tasks.workunit.client.0.smithi003.stderr:0: [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] mon.a 2023-12-03T11:48:01.461 INFO:tasks.workunit.client.0.smithi003.stderr:1: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.b 2023-12-03T11:48:01.461 INFO:tasks.workunit.client.0.smithi003.stderr:2: [v2:172.21.15.3:3301/0,v1:172.21.15.3:6790/0] mon.c 2023-12-03T11:48:01.461 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:48:01.461 INFO:tasks.workunit.client.0.smithi003.stderr: -42> 2023-12-03T11:48:01.337+0000 7f985ffff640 10 monclient: _finish_auth 0 2023-12-03T11:48:01.461 INFO:tasks.workunit.client.0.smithi003.stderr: -41> 2023-12-03T11:48:01.337+0000 7f985ffff640 10 monclient: _check_auth_tickets 2023-12-03T11:48:01.461 INFO:tasks.workunit.client.0.smithi003.stderr: -40> 2023-12-03T11:48:01.337+0000 7f985ffff640 10 monclient: handle_config config(0 keys) v1 2023-12-03T11:48:01.461 INFO:tasks.workunit.client.0.smithi003.stderr: -39> 2023-12-03T11:48:01.337+0000 7f985ffff640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:48:01.461 INFO:tasks.workunit.client.0.smithi003.stderr: -38> 2023-12-03T11:48:01.337+0000 7f985ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-12-03T11:48:01.462 INFO:tasks.workunit.client.0.smithi003.stderr: -37> 2023-12-03T11:48:01.337+0000 7f985ffff640 10 monclient: dump: 2023-12-03T11:48:01.462 INFO:tasks.workunit.client.0.smithi003.stderr:epoch 1 2023-12-03T11:48:01.462 INFO:tasks.workunit.client.0.smithi003.stderr:fsid 296556de-a4fc-4095-9b6d-0fe813c2865c 2023-12-03T11:48:01.462 INFO:tasks.workunit.client.0.smithi003.stderr:last_changed 2023-12-03T11:33:18.862564+0000 2023-12-03T11:48:01.462 INFO:tasks.workunit.client.0.smithi003.stderr:created 2023-12-03T11:33:18.862564+0000 2023-12-03T11:48:01.462 INFO:tasks.workunit.client.0.smithi003.stderr:min_mon_release 18 (reef) 2023-12-03T11:48:01.462 INFO:tasks.workunit.client.0.smithi003.stderr:election_strategy: 1 2023-12-03T11:48:01.462 INFO:tasks.workunit.client.0.smithi003.stderr:0: [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] mon.a 2023-12-03T11:48:01.462 INFO:tasks.workunit.client.0.smithi003.stderr:1: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.b 2023-12-03T11:48:01.462 INFO:tasks.workunit.client.0.smithi003.stderr:2: [v2:172.21.15.3:3301/0,v1:172.21.15.3:6790/0] mon.c 2023-12-03T11:48:01.462 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:48:01.462 INFO:tasks.workunit.client.0.smithi003.stderr: -36> 2023-12-03T11:48:01.337+0000 7f992c532800 5 monclient: authenticate success, global_id 6549 2023-12-03T11:48:01.462 INFO:tasks.workunit.client.0.smithi003.stderr: -35> 2023-12-03T11:48:01.337+0000 7f98edfe3640 4 set_mon_vals no callback set 2023-12-03T11:48:01.462 INFO:tasks.workunit.client.0.smithi003.stderr: -34> 2023-12-03T11:48:01.337+0000 7f992c532800 10 monclient: _renew_subs 2023-12-03T11:48:01.462 INFO:tasks.workunit.client.0.smithi003.stderr: -33> 2023-12-03T11:48:01.337+0000 7f992c532800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.3:3300/0 2023-12-03T11:48:01.463 INFO:tasks.workunit.client.0.smithi003.stderr: -32> 2023-12-03T11:48:01.337+0000 7f992c532800 10 monclient: _renew_subs 2023-12-03T11:48:01.463 INFO:tasks.workunit.client.0.smithi003.stderr: -31> 2023-12-03T11:48:01.337+0000 7f992c532800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.3:3300/0 2023-12-03T11:48:01.463 INFO:tasks.workunit.client.0.smithi003.stderr: -30> 2023-12-03T11:48:01.337+0000 7f992c532800 1 librados: init done 2023-12-03T11:48:01.463 INFO:tasks.workunit.client.0.smithi003.stderr: -29> 2023-12-03T11:48:01.337+0000 7f992c532800 5 asok(0x55735d868a10) register_command cr dump hook 0x55735db14a88 2023-12-03T11:48:01.463 INFO:tasks.workunit.client.0.smithi003.stderr: -28> 2023-12-03T11:48:01.339+0000 7f985ffff640 4 mgrc handle_mgr_map Got map version 5 2023-12-03T11:48:01.463 INFO:tasks.workunit.client.0.smithi003.stderr: -27> 2023-12-03T11:48:01.339+0000 7f985ffff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.37:6832/2165065416,v1:172.21.15.37:6833/2165065416] 2023-12-03T11:48:01.463 INFO:tasks.workunit.client.0.smithi003.stderr: -26> 2023-12-03T11:48:01.339+0000 7f985ffff640 4 mgrc reconnect Starting new session with [v2:172.21.15.37:6832/2165065416,v1:172.21.15.37:6833/2165065416] 2023-12-03T11:48:01.463 INFO:tasks.workunit.client.0.smithi003.stderr: -25> 2023-12-03T11:48:01.339+0000 7f992c532800 5 note: GC not initialized 2023-12-03T11:48:01.463 INFO:tasks.workunit.client.0.smithi003.stderr: -24> 2023-12-03T11:48:01.339+0000 7f992895c640 10 monclient: get_auth_request con 0x7f9864069820 auth_method 0 2023-12-03T11:48:01.463 INFO:tasks.workunit.client.0.smithi003.stderr: -23> 2023-12-03T11:48:01.339+0000 7f985d7fa640 20 reqs_thread_entry: start 2023-12-03T11:48:01.463 INFO:tasks.workunit.client.0.smithi003.stderr: -22> 2023-12-03T11:48:01.339+0000 7f992c532800 5 asok(0x55735d868a10) register_command sync trace show hook 0x7f9920004720 2023-12-03T11:48:01.463 INFO:tasks.workunit.client.0.smithi003.stderr: -21> 2023-12-03T11:48:01.339+0000 7f992c532800 5 asok(0x55735d868a10) register_command sync trace history hook 0x7f9920004720 2023-12-03T11:48:01.463 INFO:tasks.workunit.client.0.smithi003.stderr: -20> 2023-12-03T11:48:01.339+0000 7f992c532800 5 asok(0x55735d868a10) register_command sync trace active hook 0x7f9920004720 2023-12-03T11:48:01.463 INFO:tasks.workunit.client.0.smithi003.stderr: -19> 2023-12-03T11:48:01.339+0000 7f992c532800 5 asok(0x55735d868a10) register_command sync trace active_short hook 0x7f9920004720 2023-12-03T11:48:01.464 INFO:tasks.workunit.client.0.smithi003.stderr: -18> 2023-12-03T11:48:01.339+0000 7f992c532800 20 init_complete bucket index max shards: 11 2023-12-03T11:48:01.464 INFO:tasks.workunit.client.0.smithi003.stderr: -17> 2023-12-03T11:48:01.339+0000 7f992c532800 20 Filter name: none 2023-12-03T11:48:01.464 INFO:tasks.workunit.client.0.smithi003.stderr: -16> 2023-12-03T11:48:01.340+0000 7f9856ffd640 20 reqs_thread_entry: start 2023-12-03T11:48:01.464 INFO:tasks.workunit.client.0.smithi003.stderr: -15> 2023-12-03T11:48:01.340+0000 7f992c532800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2023-12-03T11:48:01.464 INFO:tasks.workunit.client.0.smithi003.stderr: -14> 2023-12-03T11:48:01.340+0000 7f992c532800 20 rados->read ofs=0 len=0 2023-12-03T11:48:01.464 INFO:tasks.workunit.client.0.smithi003.stderr: -13> 2023-12-03T11:48:01.340+0000 7f992c532800 20 rados_obj.operate() r=0 bl.length=218 2023-12-03T11:48:01.464 INFO:tasks.workunit.client.0.smithi003.stderr: -12> 2023-12-03T11:48:01.340+0000 7f992c532800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2023-12-03T11:48:01.464 INFO:tasks.workunit.client.0.smithi003.stderr: -11> 2023-12-03T11:48:01.340+0000 7f992c532800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2023-12-03T11:48:01.464 INFO:tasks.workunit.client.0.smithi003.stderr: -10> 2023-12-03T11:48:01.340+0000 7f992c532800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.21 : miss 2023-12-03T11:48:01.464 INFO:tasks.workunit.client.0.smithi003.stderr: -9> 2023-12-03T11:48:01.340+0000 7f992c532800 20 rados->read ofs=0 len=0 2023-12-03T11:48:01.464 INFO:tasks.workunit.client.0.smithi003.stderr: -8> 2023-12-03T11:48:01.341+0000 7f992c532800 20 rados_obj.operate() r=0 bl.length=390 2023-12-03T11:48:01.464 INFO:tasks.workunit.client.0.smithi003.stderr: -7> 2023-12-03T11:48:01.341+0000 7f992c532800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.21 info.flags=0x17 2023-12-03T11:48:01.464 INFO:tasks.workunit.client.0.smithi003.stderr: -6> 2023-12-03T11:48:01.341+0000 7f992c532800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.21 to cache LRU end 2023-12-03T11:48:01.464 INFO:tasks.workunit.client.0.smithi003.stderr: -5> 2023-12-03T11:48:01.341+0000 7f992c532800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:48:01.465 INFO:tasks.workunit.client.0.smithi003.stderr: -4> 2023-12-03T11:48:01.341+0000 7f992c532800 10 updating xattr: name=user.rgw.acl bl.length()=265 2023-12-03T11:48:01.465 INFO:tasks.workunit.client.0.smithi003.stderr: -3> 2023-12-03T11:48:01.341+0000 7f992c532800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.21 2023-12-03T11:48:01.465 INFO:tasks.workunit.client.0.smithi003.stderr: -2> 2023-12-03T11:48:01.341+0000 7f992795a640 10 monclient: get_auth_request con 0x55735db583b0 auth_method 0 2023-12-03T11:48:01.465 INFO:tasks.workunit.client.0.smithi003.stderr: -1> 2023-12-03T11:48:01.345+0000 7f992c532800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7537-gbcbf278c/rpm/el9/BUILD/ceph-18.0.0-7537-gbcbf278c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f992c532800 time 2023-12-03T11:48:01.346191+0000 2023-12-03T11:48:01.465 INFO:tasks.workunit.client.0.smithi003.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7537-gbcbf278c/rpm/el9/BUILD/ceph-18.0.0-7537-gbcbf278c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2023-12-03T11:48:01.465 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:48:01.465 INFO:tasks.workunit.client.0.smithi003.stderr: ceph version 18.0.0-7537-gbcbf278c (bcbf278cf395873c2a482f5a7b2345faf2160319) reef (dev) 2023-12-03T11:48:01.465 INFO:tasks.workunit.client.0.smithi003.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f992f16eef8] 2023-12-03T11:48:01.465 INFO:tasks.workunit.client.0.smithi003.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f0b6) [0x7f992f16f0b6] 2023-12-03T11:48:01.465 INFO:tasks.workunit.client.0.smithi003.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55735c97ba71] 2023-12-03T11:48:01.465 INFO:tasks.workunit.client.0.smithi003.stderr: 4: radosgw-admin(+0x79787a) [0x55735c98387a] 2023-12-03T11:48:01.465 INFO:tasks.workunit.client.0.smithi003.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x24b) [0x55735c987e6b] 2023-12-03T11:48:01.465 INFO:tasks.workunit.client.0.smithi003.stderr: 6: main() 2023-12-03T11:48:01.465 INFO:tasks.workunit.client.0.smithi003.stderr: 7: /lib64/libc.so.6(+0x3feb0) [0x7f992c83feb0] 2023-12-03T11:48:01.465 INFO:tasks.workunit.client.0.smithi003.stderr: 8: __libc_start_main() 2023-12-03T11:48:01.466 INFO:tasks.workunit.client.0.smithi003.stderr: 9: _start() 2023-12-03T11:48:01.466 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:48:01.466 INFO:tasks.workunit.client.0.smithi003.stderr: 0> 2023-12-03T11:48:01.346+0000 7f992c532800 -1 *** Caught signal (Aborted) ** 2023-12-03T11:48:01.466 INFO:tasks.workunit.client.0.smithi003.stderr: in thread 7f992c532800 thread_name:radosgw-admin 2023-12-03T11:48:01.466 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:48:01.466 INFO:tasks.workunit.client.0.smithi003.stderr: ceph version 18.0.0-7537-gbcbf278c (bcbf278cf395873c2a482f5a7b2345faf2160319) reef (dev) 2023-12-03T11:48:01.466 INFO:tasks.workunit.client.0.smithi003.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f992c854db0] 2023-12-03T11:48:01.466 INFO:tasks.workunit.client.0.smithi003.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f992c8a154c] 2023-12-03T11:48:01.466 INFO:tasks.workunit.client.0.smithi003.stderr: 3: raise() 2023-12-03T11:48:01.466 INFO:tasks.workunit.client.0.smithi003.stderr: 4: abort() 2023-12-03T11:48:01.466 INFO:tasks.workunit.client.0.smithi003.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f992f16ef52] 2023-12-03T11:48:01.466 INFO:tasks.workunit.client.0.smithi003.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f0b6) [0x7f992f16f0b6] 2023-12-03T11:48:01.466 INFO:tasks.workunit.client.0.smithi003.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55735c97ba71] 2023-12-03T11:48:01.466 INFO:tasks.workunit.client.0.smithi003.stderr: 8: radosgw-admin(+0x79787a) [0x55735c98387a] 2023-12-03T11:48:01.467 INFO:tasks.workunit.client.0.smithi003.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x24b) [0x55735c987e6b] 2023-12-03T11:48:01.467 INFO:tasks.workunit.client.0.smithi003.stderr: 10: main() 2023-12-03T11:48:01.467 INFO:tasks.workunit.client.0.smithi003.stderr: 11: /lib64/libc.so.6(+0x3feb0) [0x7f992c83feb0] 2023-12-03T11:48:01.467 INFO:tasks.workunit.client.0.smithi003.stderr: 12: __libc_start_main() 2023-12-03T11:48:01.467 INFO:tasks.workunit.client.0.smithi003.stderr: 13: _start() 2023-12-03T11:48:01.467 INFO:tasks.workunit.client.0.smithi003.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-12-03T11:48:01.467 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:48:01.467 INFO:tasks.workunit.client.0.smithi003.stderr:--- logging levels --- 2023-12-03T11:48:01.467 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 none 2023-12-03T11:48:01.467 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 1 lockdep 2023-12-03T11:48:01.467 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 1 context 2023-12-03T11:48:01.467 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 1 crush 2023-12-03T11:48:01.467 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 mds 2023-12-03T11:48:01.467 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 mds_balancer 2023-12-03T11:48:01.467 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 mds_locker 2023-12-03T11:48:01.468 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 mds_log 2023-12-03T11:48:01.468 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 mds_log_expire 2023-12-03T11:48:01.468 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 mds_migrator 2023-12-03T11:48:01.468 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 1 buffer 2023-12-03T11:48:01.468 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 1 timer 2023-12-03T11:48:01.468 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 1 filer 2023-12-03T11:48:01.468 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 1 striper 2023-12-03T11:48:01.468 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 1 objecter 2023-12-03T11:48:01.468 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 rados 2023-12-03T11:48:01.468 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 rbd 2023-12-03T11:48:01.468 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 rbd_mirror 2023-12-03T11:48:01.468 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 rbd_replay 2023-12-03T11:48:01.468 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 rbd_pwl 2023-12-03T11:48:01.468 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 journaler 2023-12-03T11:48:01.468 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 objectcacher 2023-12-03T11:48:01.468 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 immutable_obj_cache 2023-12-03T11:48:01.469 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 client 2023-12-03T11:48:01.469 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 osd 2023-12-03T11:48:01.469 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 optracker 2023-12-03T11:48:01.469 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 objclass 2023-12-03T11:48:01.469 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 3 filestore 2023-12-03T11:48:01.469 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 3 journal 2023-12-03T11:48:01.469 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 0 ms 2023-12-03T11:48:01.469 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 mon 2023-12-03T11:48:01.469 INFO:tasks.workunit.client.0.smithi003.stderr: 0/10 monc 2023-12-03T11:48:01.469 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 paxos 2023-12-03T11:48:01.469 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 tp 2023-12-03T11:48:01.469 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 auth 2023-12-03T11:48:01.469 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 crypto 2023-12-03T11:48:01.469 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 1 finisher 2023-12-03T11:48:01.469 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 1 reserver 2023-12-03T11:48:01.470 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 heartbeatmap 2023-12-03T11:48:01.470 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 perfcounter 2023-12-03T11:48:01.470 INFO:tasks.workunit.client.0.smithi003.stderr: 20/20 rgw 2023-12-03T11:48:01.470 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 rgw_sync 2023-12-03T11:48:01.470 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 rgw_datacache 2023-12-03T11:48:01.470 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 rgw_access 2023-12-03T11:48:01.470 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 rgw_dbstore 2023-12-03T11:48:01.470 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 rgw_flight 2023-12-03T11:48:01.470 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 javaclient 2023-12-03T11:48:01.470 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 asok 2023-12-03T11:48:01.470 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 1 throttle 2023-12-03T11:48:01.470 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 0 refs 2023-12-03T11:48:01.470 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 compressor 2023-12-03T11:48:01.470 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 bluestore 2023-12-03T11:48:01.470 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 bluefs 2023-12-03T11:48:01.471 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 3 bdev 2023-12-03T11:48:01.471 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 kstore 2023-12-03T11:48:01.471 INFO:tasks.workunit.client.0.smithi003.stderr: 4/ 5 rocksdb 2023-12-03T11:48:01.471 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 fuse 2023-12-03T11:48:01.471 INFO:tasks.workunit.client.0.smithi003.stderr: 2/ 5 mgr 2023-12-03T11:48:01.471 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 mgrc 2023-12-03T11:48:01.471 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 dpdk 2023-12-03T11:48:01.471 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 eventtrace 2023-12-03T11:48:01.471 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 prioritycache 2023-12-03T11:48:01.471 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 test 2023-12-03T11:48:01.471 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 cephfs_mirror 2023-12-03T11:48:01.471 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 cephsqlite 2023-12-03T11:48:01.471 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 crimson_interrupt 2023-12-03T11:48:01.471 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 seastore 2023-12-03T11:48:01.471 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 seastore_onode 2023-12-03T11:48:01.472 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 seastore_odata 2023-12-03T11:48:01.472 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 seastore_omap 2023-12-03T11:48:01.472 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 seastore_tm 2023-12-03T11:48:01.472 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 seastore_t 2023-12-03T11:48:01.472 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 seastore_cleaner 2023-12-03T11:48:01.472 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 seastore_epm 2023-12-03T11:48:01.472 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 seastore_lba 2023-12-03T11:48:01.472 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 seastore_fixedkv_tree 2023-12-03T11:48:01.472 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 seastore_cache 2023-12-03T11:48:01.472 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 seastore_journal 2023-12-03T11:48:01.472 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 seastore_device 2023-12-03T11:48:01.472 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 seastore_backref 2023-12-03T11:48:01.472 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 alienstore 2023-12-03T11:48:01.472 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 mclock 2023-12-03T11:48:01.472 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 cyanstore 2023-12-03T11:48:01.472 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 ceph_exporter 2023-12-03T11:48:01.473 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 memstore 2023-12-03T11:48:01.473 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 trace 2023-12-03T11:48:01.473 INFO:tasks.workunit.client.0.smithi003.stderr: -2/-2 (syslog threshold) 2023-12-03T11:48:01.473 INFO:tasks.workunit.client.0.smithi003.stderr: 99/99 (stderr threshold) 2023-12-03T11:48:01.473 INFO:tasks.workunit.client.0.smithi003.stderr:--- pthread ID / name mapping for recent threads --- 2023-12-03T11:48:01.473 INFO:tasks.workunit.client.0.smithi003.stderr: 7f9856ffd640 / http_manager 2023-12-03T11:48:01.473 INFO:tasks.workunit.client.0.smithi003.stderr: 7f985d7fa640 / http_manager 2023-12-03T11:48:01.473 INFO:tasks.workunit.client.0.smithi003.stderr: 7f985ffff640 / ms_dispatch 2023-12-03T11:48:01.473 INFO:tasks.workunit.client.0.smithi003.stderr: 7f98edfe3640 / io_context_pool 2023-12-03T11:48:01.473 INFO:tasks.workunit.client.0.smithi003.stderr: 7f98ee7e4640 / rgw_dt_lg_renew 2023-12-03T11:48:01.473 INFO:tasks.workunit.client.0.smithi003.stderr: 7f990d7fa640 / ms_dispatch 2023-12-03T11:48:01.473 INFO:tasks.workunit.client.0.smithi003.stderr: 7f990effd640 / io_context_pool 2023-12-03T11:48:01.473 INFO:tasks.workunit.client.0.smithi003.stderr: 7f9925956640 / ms_dispatch 2023-12-03T11:48:01.473 INFO:tasks.workunit.client.0.smithi003.stderr: 7f9926958640 / io_context_pool 2023-12-03T11:48:01.474 INFO:tasks.workunit.client.0.smithi003.stderr: 7f992795a640 / msgr-worker-2 2023-12-03T11:48:01.474 INFO:tasks.workunit.client.0.smithi003.stderr: 7f992815b640 / msgr-worker-1 2023-12-03T11:48:01.474 INFO:tasks.workunit.client.0.smithi003.stderr: 7f992895c640 / msgr-worker-0 2023-12-03T11:48:01.474 INFO:tasks.workunit.client.0.smithi003.stderr: 7f992c532800 / radosgw-admin 2023-12-03T11:48:01.474 INFO:tasks.workunit.client.0.smithi003.stderr: max_recent 500 2023-12-03T11:48:01.474 INFO:tasks.workunit.client.0.smithi003.stderr: max_new 1000 2023-12-03T11:48:01.474 INFO:tasks.workunit.client.0.smithi003.stderr: log_file /var/lib/ceph/crash/2023-12-03T11:48:01.347790Z_cbb074d9-d9e1-48e4-b1f0-697b219eeb9a/log 2023-12-03T11:48:01.474 INFO:tasks.workunit.client.0.smithi003.stderr:--- end dump of recent events --- 2023-12-03T11:48:01.474 INFO:tasks.workunit.client.0.smithi003.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2023-12-03T11:48:01.479 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:48:01.479 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:48:01.479 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.396+0000 7f05f0b25800 20 rados->read ofs=0 len=0 2023-12-03T11:48:01.479 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.398+0000 7f05f0b25800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:01.479 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.398+0000 7f05f0b25800 20 realm 2023-12-03T11:48:01.479 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.398+0000 7f05f0b25800 20 rados->read ofs=0 len=0 2023-12-03T11:48:01.480 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.399+0000 7f05f0b25800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:01.480 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.399+0000 7f05f0b25800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:48:01.480 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.399+0000 7f05f0b25800 20 rados->read ofs=0 len=0 2023-12-03T11:48:01.480 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.399+0000 7f05f0b25800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:01.480 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.399+0000 7f05f0b25800 20 rados->read ofs=0 len=0 2023-12-03T11:48:01.480 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.399+0000 7f05f0b25800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:48:01.480 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.400+0000 7f05f0b25800 20 rados->read ofs=0 len=0 2023-12-03T11:48:01.480 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.400+0000 7f05f0b25800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:48:01.480 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.400+0000 7f05f0b25800 20 searching for the correct realm 2023-12-03T11:48:01.480 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.410+0000 7f05ec8b8640 0 -- 172.21.15.3:0/2214108578 >> [v2:172.21.15.37:6805/1692844418,v1:172.21.15.37:6807/1692844418] conn(0x556fb57d5f50 msgr2=0x556fb57d8360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:48:01.480 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.411+0000 7f05f0b25800 20 RGWRados::pool_iterate: got zone_info.83aabb46-04b5-4c96-9933-c6bfb1173a73 2023-12-03T11:48:01.480 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.411+0000 7f05f0b25800 20 RGWRados::pool_iterate: got zonegroup_info.6a811aad-435d-4fdd-93c9-b7e0b50de429 2023-12-03T11:48:01.480 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.411+0000 7f05f0b25800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:48:01.480 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.411+0000 7f05f0b25800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:48:01.481 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.411+0000 7f05f0b25800 20 rados->read ofs=0 len=0 2023-12-03T11:48:01.481 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.411+0000 7f05f0b25800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:01.481 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.411+0000 7f05f0b25800 20 rados->read ofs=0 len=0 2023-12-03T11:48:01.481 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.411+0000 7f05f0b25800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:48:01.481 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.411+0000 7f05f0b25800 20 rados->read ofs=0 len=0 2023-12-03T11:48:01.481 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.411+0000 7f05f0b25800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:48:01.481 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.411+0000 7f05f0b25800 20 zone default found 2023-12-03T11:48:01.481 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.411+0000 7f05f0b25800 4 Realm: () 2023-12-03T11:48:01.481 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.411+0000 7f05f0b25800 4 ZoneGroup: default (6a811aad-435d-4fdd-93c9-b7e0b50de429) 2023-12-03T11:48:01.481 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.411+0000 7f05f0b25800 4 Zone: default (83aabb46-04b5-4c96-9933-c6bfb1173a73) 2023-12-03T11:48:01.481 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.411+0000 7f05f0b25800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:48:01.481 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.411+0000 7f05f0b25800 20 zonegroup default 2023-12-03T11:48:01.481 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.411+0000 7f05f0b25800 20 rados->read ofs=0 len=0 2023-12-03T11:48:01.481 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.412+0000 7f05f0b25800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:01.482 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.412+0000 7f05f0b25800 20 rados->read ofs=0 len=0 2023-12-03T11:48:01.482 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.412+0000 7f05f0b25800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:01.482 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.412+0000 7f05f0b25800 20 rados->read ofs=0 len=0 2023-12-03T11:48:01.482 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.412+0000 7f05f0b25800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:01.482 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.412+0000 7f05f0b25800 20 started sync module instance, tier type = 2023-12-03T11:48:01.482 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.412+0000 7f05f0b25800 20 started zone id=83aabb46-04b5-4c96-9933-c6bfb1173a73 (name=default) with tier type = 2023-12-03T11:48:01.482 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.419+0000 7f05ec0b7640 0 -- 172.21.15.3:0/2214108578 >> [v2:172.21.15.3:6817/3356208405,v1:172.21.15.3:6819/3356208405] conn(0x556fb57dafa0 msgr2=0x556fb57dd390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-03T11:48:01.482 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.422+0000 7f05f0b25800 20 add_watcher() i=0 2023-12-03T11:48:01.482 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.422+0000 7f05f0b25800 20 add_watcher() i=1 2023-12-03T11:48:01.482 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.422+0000 7f05f0b25800 20 add_watcher() i=2 2023-12-03T11:48:01.482 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.422+0000 7f05f0b25800 20 add_watcher() i=3 2023-12-03T11:48:01.482 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.422+0000 7f05f0b25800 20 add_watcher() i=4 2023-12-03T11:48:01.482 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.422+0000 7f05f0b25800 20 add_watcher() i=5 2023-12-03T11:48:01.482 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.422+0000 7f05f0b25800 20 add_watcher() i=6 2023-12-03T11:48:01.482 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.423+0000 7f05f0b25800 20 add_watcher() i=7 2023-12-03T11:48:01.483 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.423+0000 7f05f0b25800 2 all 8 watchers are set, enabling cache 2023-12-03T11:48:01.483 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.424+0000 7f05b2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:48:01.483 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.424+0000 7f05f0b25800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:48:01.483 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.424+0000 7f05f0b25800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:48:01.483 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.431+0000 7f05f0b25800 5 note: GC not initialized 2023-12-03T11:48:01.483 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.431+0000 7f0521ffb640 20 reqs_thread_entry: start 2023-12-03T11:48:01.483 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.431+0000 7f05f0b25800 20 init_complete bucket index max shards: 11 2023-12-03T11:48:01.483 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.431+0000 7f05f0b25800 20 Filter name: none 2023-12-03T11:48:01.483 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.431+0000 7f05137fe640 20 reqs_thread_entry: start 2023-12-03T11:48:01.483 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.431+0000 7f05f0b25800 20 rados->read ofs=0 len=0 2023-12-03T11:48:01.483 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.432+0000 7f05f0b25800 20 rados_obj.operate() r=0 bl.length=218 2023-12-03T11:48:01.483 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.432+0000 7f05f0b25800 20 rados->read ofs=0 len=0 2023-12-03T11:48:01.483 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.432+0000 7f05f0b25800 20 rados_obj.operate() r=0 bl.length=390 2023-12-03T11:48:01.483 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.432+0000 7f05f0b25800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:48:01.484 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.432+0000 7f05f0b25800 20 rados->read ofs=0 len=0 2023-12-03T11:48:01.484 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.432+0000 7f05f0b25800 20 rados_obj.operate() r=0 bl.length=218 2023-12-03T11:48:01.484 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.433+0000 7f05f0b25800 20 rados->read ofs=0 len=0 2023-12-03T11:48:01.484 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.433+0000 7f05f0b25800 20 rados_obj.operate() r=0 bl.length=390 2023-12-03T11:48:01.484 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.433+0000 7f05f0b25800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:48:01.484 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.434+0000 7f05f0b25800 20 rados->read ofs=0 len=0 2023-12-03T11:48:01.484 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.434+0000 7f05f0b25800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:01.484 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.435+0000 7f05b2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:48:01.484 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.437+0000 7f05f0b25800 20 remove_watcher() i=0 2023-12-03T11:48:01.484 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.437+0000 7f05f0b25800 2 removed watcher, disabling cache 2023-12-03T11:48:01.484 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.438+0000 7f05f0b25800 20 remove_watcher() i=1 2023-12-03T11:48:01.484 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.439+0000 7f05f0b25800 20 remove_watcher() i=2 2023-12-03T11:48:01.484 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.440+0000 7f05f0b25800 20 remove_watcher() i=3 2023-12-03T11:48:01.484 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.441+0000 7f05f0b25800 20 remove_watcher() i=4 2023-12-03T11:48:01.484 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.442+0000 7f05f0b25800 20 remove_watcher() i=5 2023-12-03T11:48:01.484 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.443+0000 7f05f0b25800 20 remove_watcher() i=6 2023-12-03T11:48:01.485 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.444+0000 7f05f0b25800 20 remove_watcher() i=7 2023-12-03T11:48:01.485 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:48:01.485 INFO:tasks.workunit.client.0.smithi003.stderr:BUCKET_STATS: 2023-12-03T11:48:01.485 INFO:tasks.workunit.client.0.smithi003.stderr:bucket: abort-at-set-target-layout id: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.21 num_objects: 20 size_kb: 1 num_shards: 11 2023-12-03T11:48:01.485 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:48:01.533 INFO:tasks.workunit.client.0.smithi003.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2023-12-03T11:48:01.563 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:48:01.564 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:48:01.578 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.577+0000 7fe5c560f800 20 rados->read ofs=0 len=0 2023-12-03T11:48:01.580 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.579+0000 7fe5c560f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:01.580 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.579+0000 7fe5c560f800 20 realm 2023-12-03T11:48:01.580 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.579+0000 7fe5c560f800 20 rados->read ofs=0 len=0 2023-12-03T11:48:01.580 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.579+0000 7fe5c560f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:01.581 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.579+0000 7fe5c560f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:48:01.581 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.579+0000 7fe5c560f800 20 rados->read ofs=0 len=0 2023-12-03T11:48:01.581 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.579+0000 7fe5c560f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:01.581 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.579+0000 7fe5c560f800 20 rados->read ofs=0 len=0 2023-12-03T11:48:01.581 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.580+0000 7fe5c560f800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:48:01.582 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.580+0000 7fe5c560f800 20 rados->read ofs=0 len=0 2023-12-03T11:48:01.582 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.581+0000 7fe5c560f800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:48:01.582 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.581+0000 7fe5c560f800 20 searching for the correct realm 2023-12-03T11:48:01.592 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.591+0000 7fe5c0d47640 0 -- 172.21.15.3:0/842507114 >> [v2:172.21.15.37:6805/1692844418,v1:172.21.15.37:6807/1692844418] conn(0x556619376cc0 msgr2=0x5566193790f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:48:01.594 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.592+0000 7fe5c560f800 20 RGWRados::pool_iterate: got zone_info.83aabb46-04b5-4c96-9933-c6bfb1173a73 2023-12-03T11:48:01.594 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.592+0000 7fe5c560f800 20 RGWRados::pool_iterate: got zonegroup_info.6a811aad-435d-4fdd-93c9-b7e0b50de429 2023-12-03T11:48:01.594 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.592+0000 7fe5c560f800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:48:01.594 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.592+0000 7fe5c560f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:48:01.594 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.592+0000 7fe5c560f800 20 rados->read ofs=0 len=0 2023-12-03T11:48:01.594 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.593+0000 7fe5c560f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:01.594 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.593+0000 7fe5c560f800 20 rados->read ofs=0 len=0 2023-12-03T11:48:01.595 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.593+0000 7fe5c560f800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:48:01.595 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.593+0000 7fe5c560f800 20 rados->read ofs=0 len=0 2023-12-03T11:48:01.595 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.593+0000 7fe5c560f800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:48:01.595 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.593+0000 7fe5c560f800 20 zone default found 2023-12-03T11:48:01.596 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.593+0000 7fe5c560f800 4 Realm: () 2023-12-03T11:48:01.596 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.593+0000 7fe5c560f800 4 ZoneGroup: default (6a811aad-435d-4fdd-93c9-b7e0b50de429) 2023-12-03T11:48:01.596 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.593+0000 7fe5c560f800 4 Zone: default (83aabb46-04b5-4c96-9933-c6bfb1173a73) 2023-12-03T11:48:01.596 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.593+0000 7fe5c560f800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:48:01.596 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.593+0000 7fe5c560f800 20 zonegroup default 2023-12-03T11:48:01.596 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.593+0000 7fe5c560f800 20 rados->read ofs=0 len=0 2023-12-03T11:48:01.596 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.593+0000 7fe5c560f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:01.596 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.593+0000 7fe5c560f800 20 rados->read ofs=0 len=0 2023-12-03T11:48:01.596 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.594+0000 7fe5c560f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:01.596 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.594+0000 7fe5c560f800 20 rados->read ofs=0 len=0 2023-12-03T11:48:01.596 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.594+0000 7fe5c560f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:01.596 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.594+0000 7fe5c560f800 20 started sync module instance, tier type = 2023-12-03T11:48:01.596 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.594+0000 7fe5c560f800 20 started zone id=83aabb46-04b5-4c96-9933-c6bfb1173a73 (name=default) with tier type = 2023-12-03T11:48:01.602 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.601+0000 7fe5c1548640 0 -- 172.21.15.3:0/842507114 >> [v2:172.21.15.37:6816/3770469300,v1:172.21.15.37:6818/3770469300] conn(0x7fe5b405b420 msgr2=0x7fe5b405b8a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:48:01.604 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.603+0000 7fe5c560f800 20 add_watcher() i=0 2023-12-03T11:48:01.605 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.603+0000 7fe5c560f800 20 add_watcher() i=1 2023-12-03T11:48:01.605 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.603+0000 7fe5c560f800 20 add_watcher() i=2 2023-12-03T11:48:01.605 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.603+0000 7fe5c560f800 20 add_watcher() i=3 2023-12-03T11:48:01.605 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.603+0000 7fe5c560f800 20 add_watcher() i=4 2023-12-03T11:48:01.605 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.603+0000 7fe5c560f800 20 add_watcher() i=5 2023-12-03T11:48:01.605 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.603+0000 7fe5c560f800 20 add_watcher() i=6 2023-12-03T11:48:01.605 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.604+0000 7fe5c560f800 20 add_watcher() i=7 2023-12-03T11:48:01.606 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.604+0000 7fe5c560f800 2 all 8 watchers are set, enabling cache 2023-12-03T11:48:01.606 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.605+0000 7fe586fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:48:01.607 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.606+0000 7fe5c560f800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:48:01.607 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.606+0000 7fe5c560f800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:48:01.614 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.612+0000 7fe5c560f800 5 note: GC not initialized 2023-12-03T11:48:01.614 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.612+0000 7fe4f5ffb640 20 reqs_thread_entry: start 2023-12-03T11:48:01.614 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.612+0000 7fe5c560f800 20 init_complete bucket index max shards: 11 2023-12-03T11:48:01.614 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.612+0000 7fe5c560f800 20 Filter name: none 2023-12-03T11:48:01.614 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.612+0000 7fe4e77fe640 20 reqs_thread_entry: start 2023-12-03T11:48:01.614 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.612+0000 7fe5c560f800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2023-12-03T11:48:01.614 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.612+0000 7fe5c560f800 20 rados->read ofs=0 len=0 2023-12-03T11:48:01.615 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.613+0000 7fe5c560f800 20 rados_obj.operate() r=0 bl.length=218 2023-12-03T11:48:01.615 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.613+0000 7fe5c560f800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2023-12-03T11:48:01.615 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.613+0000 7fe5c560f800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2023-12-03T11:48:01.615 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.613+0000 7fe5c560f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.21 : miss 2023-12-03T11:48:01.615 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.613+0000 7fe5c560f800 20 rados->read ofs=0 len=0 2023-12-03T11:48:01.615 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.613+0000 7fe5c560f800 20 rados_obj.operate() r=0 bl.length=390 2023-12-03T11:48:01.615 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.613+0000 7fe5c560f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.21 info.flags=0x17 2023-12-03T11:48:01.616 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.613+0000 7fe5c560f800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.21 to cache LRU end 2023-12-03T11:48:01.616 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.613+0000 7fe5c560f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:48:01.616 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.613+0000 7fe5c560f800 10 updating xattr: name=user.rgw.acl bl.length()=265 2023-12-03T11:48:01.616 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.613+0000 7fe5c560f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.21 2023-12-03T11:48:01.616 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.615+0000 7fe5c560f800 0 INFO: RGWReshardLock::lock found lock on abort-at-set-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.21 to be held by another RGW process; skipping for now 2023-12-03T11:48:01.617 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.616+0000 7fe586fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:48:01.619 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.618+0000 7fe5c560f800 20 remove_watcher() i=0 2023-12-03T11:48:01.619 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.618+0000 7fe5c560f800 2 removed watcher, disabling cache 2023-12-03T11:48:01.620 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.619+0000 7fe5c560f800 20 remove_watcher() i=1 2023-12-03T11:48:01.621 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.620+0000 7fe5c560f800 20 remove_watcher() i=2 2023-12-03T11:48:01.622 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.621+0000 7fe5c560f800 20 remove_watcher() i=3 2023-12-03T11:48:01.623 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.622+0000 7fe5c560f800 20 remove_watcher() i=4 2023-12-03T11:48:01.624 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.623+0000 7fe5c560f800 20 remove_watcher() i=5 2023-12-03T11:48:01.625 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.624+0000 7fe5c560f800 20 remove_watcher() i=6 2023-12-03T11:48:01.626 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:01.625+0000 7fe5c560f800 20 remove_watcher() i=7 2023-12-03T11:48:01.631 INFO:tasks.workunit.client.0.smithi003.stderr:waiting 30 seconds for reshard lock to expire... 2023-12-03T11:48:31.640 INFO:tasks.workunit.client.0.smithi003.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2023-12-03T11:48:31.674 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:48:31.674 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:48:31.691 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.689+0000 7f296391f800 20 rados->read ofs=0 len=0 2023-12-03T11:48:31.693 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.691+0000 7f296391f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:31.693 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.691+0000 7f296391f800 20 realm 2023-12-03T11:48:31.693 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.691+0000 7f296391f800 20 rados->read ofs=0 len=0 2023-12-03T11:48:31.694 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.692+0000 7f296391f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:31.694 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.692+0000 7f296391f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:48:31.694 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.692+0000 7f296391f800 20 rados->read ofs=0 len=0 2023-12-03T11:48:31.694 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.692+0000 7f296391f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:31.694 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.692+0000 7f296391f800 20 rados->read ofs=0 len=0 2023-12-03T11:48:31.695 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.693+0000 7f296391f800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:48:31.695 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.693+0000 7f296391f800 20 rados->read ofs=0 len=0 2023-12-03T11:48:31.695 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.693+0000 7f296391f800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:48:31.695 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.693+0000 7f296391f800 20 searching for the correct realm 2023-12-03T11:48:31.707 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.705+0000 7f295f54d640 0 -- 172.21.15.3:0/2013407253 >> [v2:172.21.15.3:6800/2373485412,v1:172.21.15.3:6801/2373485412] conn(0x7f295801e060 msgr2=0x7f2958056010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:48:31.709 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.707+0000 7f296391f800 20 RGWRados::pool_iterate: got zone_info.83aabb46-04b5-4c96-9933-c6bfb1173a73 2023-12-03T11:48:31.709 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.707+0000 7f296391f800 20 RGWRados::pool_iterate: got zonegroup_info.6a811aad-435d-4fdd-93c9-b7e0b50de429 2023-12-03T11:48:31.709 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.707+0000 7f296391f800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:48:31.709 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.707+0000 7f296391f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:48:31.709 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.707+0000 7f296391f800 20 rados->read ofs=0 len=0 2023-12-03T11:48:31.709 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.707+0000 7f296391f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:31.709 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.707+0000 7f296391f800 20 rados->read ofs=0 len=0 2023-12-03T11:48:31.709 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.708+0000 7f296391f800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:48:31.710 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.708+0000 7f296391f800 20 rados->read ofs=0 len=0 2023-12-03T11:48:31.711 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.708+0000 7f296391f800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:48:31.711 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.708+0000 7f296391f800 20 zone default found 2023-12-03T11:48:31.711 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.708+0000 7f296391f800 4 Realm: () 2023-12-03T11:48:31.711 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.708+0000 7f296391f800 4 ZoneGroup: default (6a811aad-435d-4fdd-93c9-b7e0b50de429) 2023-12-03T11:48:31.711 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.708+0000 7f296391f800 4 Zone: default (83aabb46-04b5-4c96-9933-c6bfb1173a73) 2023-12-03T11:48:31.711 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.708+0000 7f296391f800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:48:31.711 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.708+0000 7f296391f800 20 zonegroup default 2023-12-03T11:48:31.711 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.708+0000 7f296391f800 20 rados->read ofs=0 len=0 2023-12-03T11:48:31.711 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.708+0000 7f296391f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:31.711 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.708+0000 7f296391f800 20 rados->read ofs=0 len=0 2023-12-03T11:48:31.711 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.709+0000 7f296391f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:31.711 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.709+0000 7f296391f800 20 rados->read ofs=0 len=0 2023-12-03T11:48:31.712 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.709+0000 7f296391f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:31.712 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.709+0000 7f296391f800 20 started sync module instance, tier type = 2023-12-03T11:48:31.712 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.709+0000 7f296391f800 20 started zone id=83aabb46-04b5-4c96-9933-c6bfb1173a73 (name=default) with tier type = 2023-12-03T11:48:31.717 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.716+0000 7f295f54d640 0 -- 172.21.15.3:0/2013407253 >> [v2:172.21.15.3:6800/2373485412,v1:172.21.15.3:6801/2373485412] conn(0x7f2938079e10 msgr2=0x7f293807c240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:48:31.721 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.720+0000 7f296391f800 20 add_watcher() i=0 2023-12-03T11:48:31.721 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.720+0000 7f296391f800 20 add_watcher() i=1 2023-12-03T11:48:31.721 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.720+0000 7f296391f800 20 add_watcher() i=2 2023-12-03T11:48:31.721 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.720+0000 7f296391f800 20 add_watcher() i=3 2023-12-03T11:48:31.722 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.720+0000 7f296391f800 20 add_watcher() i=4 2023-12-03T11:48:31.722 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.720+0000 7f296391f800 20 add_watcher() i=5 2023-12-03T11:48:31.722 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.720+0000 7f296391f800 20 add_watcher() i=6 2023-12-03T11:48:31.722 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.720+0000 7f296391f800 20 add_watcher() i=7 2023-12-03T11:48:31.723 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.720+0000 7f296391f800 2 all 8 watchers are set, enabling cache 2023-12-03T11:48:31.724 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.722+0000 7f29257e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:48:31.724 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.723+0000 7f296391f800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:48:31.724 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.723+0000 7f296391f800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:48:31.732 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.729+0000 7f296391f800 5 note: GC not initialized 2023-12-03T11:48:31.732 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.729+0000 7f2893fff640 20 reqs_thread_entry: start 2023-12-03T11:48:31.732 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.729+0000 7f296391f800 20 init_complete bucket index max shards: 11 2023-12-03T11:48:31.733 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.730+0000 7f296391f800 20 Filter name: none 2023-12-03T11:48:31.733 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.730+0000 7f2891ffb640 20 reqs_thread_entry: start 2023-12-03T11:48:31.733 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.730+0000 7f296391f800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2023-12-03T11:48:31.733 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.730+0000 7f296391f800 20 rados->read ofs=0 len=0 2023-12-03T11:48:31.733 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.730+0000 7f296391f800 20 rados_obj.operate() r=0 bl.length=218 2023-12-03T11:48:31.733 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.730+0000 7f296391f800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2023-12-03T11:48:31.733 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.730+0000 7f296391f800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2023-12-03T11:48:31.733 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.730+0000 7f296391f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.21 : miss 2023-12-03T11:48:31.733 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.730+0000 7f296391f800 20 rados->read ofs=0 len=0 2023-12-03T11:48:31.733 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.731+0000 7f296391f800 20 rados_obj.operate() r=0 bl.length=390 2023-12-03T11:48:31.733 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.731+0000 7f296391f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.21 info.flags=0x17 2023-12-03T11:48:31.733 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.731+0000 7f296391f800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.21 to cache LRU end 2023-12-03T11:48:31.733 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.731+0000 7f296391f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:48:31.734 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.731+0000 7f296391f800 10 updating xattr: name=user.rgw.acl bl.length()=265 2023-12-03T11:48:31.734 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.731+0000 7f296391f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.21 2023-12-03T11:48:31.739 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.738+0000 7f296391f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.21 info.flags=0x17 2023-12-03T11:48:31.739 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.738+0000 7f296391f800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.21 to cache LRU end 2023-12-03T11:48:31.739 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.738+0000 7f296391f800 10 updating xattr: name=user.rgw.acl bl.length()=265 2023-12-03T11:48:31.739 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.738+0000 7f296391f800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.21, ofs0, ns] 2023-12-03T11:48:31.740 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.738+0000 7f2945ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660502 cookie 94707145859168 notifier 6609 bl.length()=959 2023-12-03T11:48:31.740 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.738+0000 7f2945ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.21 info.flags=0x17 2023-12-03T11:48:31.740 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.738+0000 7f2945ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.21 to cache LRU end 2023-12-03T11:48:31.740 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.738+0000 7f2945ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2023-12-03T11:48:31.741 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.740+0000 7f296391f800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.21]): orig_sources= new_sources= 2023-12-03T11:48:31.741 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.740+0000 7f296391f800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.21]): potential sources added=[] removed=[] 2023-12-03T11:48:31.742 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.740+0000 7f296391f800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.21]): orig_dests= new_dests= 2023-12-03T11:48:31.742 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.740+0000 7f296391f800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.21]): potential dests added=[] removed=[] 2023-12-03T11:48:31.745 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.744+0000 7f296391f800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.21.1.0 2023-12-03T11:48:31.745 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.744+0000 7f296391f800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.21.1.0 2023-12-03T11:48:31.746 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.744+0000 7f296391f800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.21.1.1 2023-12-03T11:48:31.746 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.744+0000 7f296391f800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.21.1.1 2023-12-03T11:48:31.746 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.744+0000 7f296391f800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.21.1.2 2023-12-03T11:48:31.746 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.744+0000 7f296391f800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.21.1.2 2023-12-03T11:48:31.746 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.744+0000 7f296391f800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.21.1.3 2023-12-03T11:48:31.746 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.744+0000 7f296391f800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.21.1.3 2023-12-03T11:48:31.746 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.744+0000 7f296391f800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.21.1.4 2023-12-03T11:48:31.746 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.744+0000 7f296391f800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.21.1.4 2023-12-03T11:48:31.746 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.744+0000 7f296391f800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.21.1.5 2023-12-03T11:48:31.746 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.744+0000 7f296391f800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.21.1.5 2023-12-03T11:48:31.746 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.744+0000 7f296391f800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.21.1.6 2023-12-03T11:48:31.746 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.744+0000 7f296391f800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.21.1.6 2023-12-03T11:48:31.746 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.744+0000 7f296391f800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.21.1.7 2023-12-03T11:48:31.747 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.744+0000 7f296391f800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.21.1.7 2023-12-03T11:48:31.747 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.744+0000 7f296391f800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.21.1.8 2023-12-03T11:48:31.747 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.744+0000 7f296391f800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.21.1.8 2023-12-03T11:48:31.747 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.744+0000 7f296391f800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.21.1.9 2023-12-03T11:48:31.747 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.744+0000 7f296391f800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.21.1.9 2023-12-03T11:48:31.747 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.744+0000 7f296391f800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.21.1.10 2023-12-03T11:48:31.747 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.744+0000 7f296391f800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.21.1.10 2023-12-03T11:48:31.747 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.744+0000 7f296391f800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.21.1.11 2023-12-03T11:48:31.747 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.744+0000 7f296391f800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.21.1.11 2023-12-03T11:48:31.747 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.744+0000 7f296391f800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.21.0 2023-12-03T11:48:31.747 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.744+0000 7f296391f800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.21.1 2023-12-03T11:48:31.748 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.745+0000 7f296391f800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.21.2 2023-12-03T11:48:31.748 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.745+0000 7f296391f800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.21.3 2023-12-03T11:48:31.748 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.746+0000 7f296391f800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.21.4 2023-12-03T11:48:31.748 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.746+0000 7f296391f800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.21.5 2023-12-03T11:48:31.748 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.747+0000 7f296391f800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.21.6 2023-12-03T11:48:31.749 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.747+0000 7f296391f800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.21.7 2023-12-03T11:48:31.749 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.748+0000 7f296391f800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.21.8 2023-12-03T11:48:31.749 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.748+0000 7f296391f800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.21.9 2023-12-03T11:48:31.750 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.749+0000 7f296391f800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.21.10 2023-12-03T11:48:31.753 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.752+0000 7f296391f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.21 : hit (requested=0x17, cached=0x17) 2023-12-03T11:48:31.753 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.752+0000 7f296391f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.21 2023-12-03T11:48:31.755 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.753+0000 7f296391f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.21 info.flags=0x17 2023-12-03T11:48:31.755 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.754+0000 7f296391f800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.21 to cache LRU end 2023-12-03T11:48:31.755 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.754+0000 7f296391f800 10 updating xattr: name=user.rgw.acl bl.length()=265 2023-12-03T11:48:31.755 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.754+0000 7f296391f800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.21, ofs0, ns] 2023-12-03T11:48:31.755 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.754+0000 7f2945ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660503 cookie 94707145859168 notifier 6609 bl.length()=927 2023-12-03T11:48:31.755 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.754+0000 7f2945ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.21 info.flags=0x17 2023-12-03T11:48:31.756 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.754+0000 7f2945ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.21 to cache LRU end 2023-12-03T11:48:31.756 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.754+0000 7f2945ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2023-12-03T11:48:31.757 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.756+0000 7f296391f800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.21]): orig_sources= new_sources= 2023-12-03T11:48:31.757 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.756+0000 7f296391f800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.21]): potential sources added=[] removed=[] 2023-12-03T11:48:31.757 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.756+0000 7f296391f800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.21]): orig_dests= new_dests= 2023-12-03T11:48:31.757 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.756+0000 7f296391f800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.21]): potential dests added=[] removed=[] 2023-12-03T11:48:31.759 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.758+0000 7f296391f800 1 execute INFO: reshard of bucket "abort-at-set-target-layout" completed successfully 2023-12-03T11:48:31.761 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.760+0000 7f29257e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:48:31.763 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.762+0000 7f296391f800 20 remove_watcher() i=0 2023-12-03T11:48:31.764 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.762+0000 7f296391f800 2 removed watcher, disabling cache 2023-12-03T11:48:31.764 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.763+0000 7f296391f800 20 remove_watcher() i=1 2023-12-03T11:48:31.766 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.764+0000 7f296391f800 20 remove_watcher() i=2 2023-12-03T11:48:31.767 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.765+0000 7f296391f800 20 remove_watcher() i=3 2023-12-03T11:48:31.768 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.767+0000 7f296391f800 20 remove_watcher() i=4 2023-12-03T11:48:31.769 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.768+0000 7f296391f800 20 remove_watcher() i=5 2023-12-03T11:48:31.770 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.769+0000 7f296391f800 20 remove_watcher() i=6 2023-12-03T11:48:31.771 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.770+0000 7f296391f800 20 remove_watcher() i=7 2023-12-03T11:48:31.777 INFO:tasks.workunit.client.0.smithi003.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2023-12-03T11:48:31.806 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:48:31.806 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:48:31.820 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.818+0000 7f4a90833800 20 rados->read ofs=0 len=0 2023-12-03T11:48:31.822 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.820+0000 7f4a90833800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:31.822 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.820+0000 7f4a90833800 20 realm 2023-12-03T11:48:31.822 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.820+0000 7f4a90833800 20 rados->read ofs=0 len=0 2023-12-03T11:48:31.822 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.820+0000 7f4a90833800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:31.822 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.820+0000 7f4a90833800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:48:31.822 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.820+0000 7f4a90833800 20 rados->read ofs=0 len=0 2023-12-03T11:48:31.823 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.821+0000 7f4a90833800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:31.823 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.821+0000 7f4a90833800 20 rados->read ofs=0 len=0 2023-12-03T11:48:31.823 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.821+0000 7f4a90833800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:48:31.823 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.821+0000 7f4a90833800 20 rados->read ofs=0 len=0 2023-12-03T11:48:31.823 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.822+0000 7f4a90833800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:48:31.823 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.822+0000 7f4a90833800 20 searching for the correct realm 2023-12-03T11:48:31.833 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.832+0000 7f4a8e333640 0 -- 172.21.15.3:0/2132525984 >> [v2:172.21.15.37:6805/1692844418,v1:172.21.15.37:6807/1692844418] conn(0x560ad07ea330 msgr2=0x560ad07ed500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:48:31.835 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.834+0000 7f4a90833800 20 RGWRados::pool_iterate: got zone_info.83aabb46-04b5-4c96-9933-c6bfb1173a73 2023-12-03T11:48:31.835 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.834+0000 7f4a90833800 20 RGWRados::pool_iterate: got zonegroup_info.6a811aad-435d-4fdd-93c9-b7e0b50de429 2023-12-03T11:48:31.835 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.834+0000 7f4a90833800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:48:31.835 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.834+0000 7f4a90833800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:48:31.835 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.834+0000 7f4a90833800 20 rados->read ofs=0 len=0 2023-12-03T11:48:31.836 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.834+0000 7f4a90833800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:31.836 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.834+0000 7f4a90833800 20 rados->read ofs=0 len=0 2023-12-03T11:48:31.837 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.834+0000 7f4a90833800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:48:31.837 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.834+0000 7f4a90833800 20 rados->read ofs=0 len=0 2023-12-03T11:48:31.837 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.835+0000 7f4a90833800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:48:31.837 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.835+0000 7f4a90833800 20 zone default found 2023-12-03T11:48:31.837 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.835+0000 7f4a90833800 4 Realm: () 2023-12-03T11:48:31.837 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.835+0000 7f4a90833800 4 ZoneGroup: default (6a811aad-435d-4fdd-93c9-b7e0b50de429) 2023-12-03T11:48:31.837 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.835+0000 7f4a90833800 4 Zone: default (83aabb46-04b5-4c96-9933-c6bfb1173a73) 2023-12-03T11:48:31.837 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.835+0000 7f4a90833800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:48:31.837 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.835+0000 7f4a90833800 20 zonegroup default 2023-12-03T11:48:31.837 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.835+0000 7f4a90833800 20 rados->read ofs=0 len=0 2023-12-03T11:48:31.837 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.835+0000 7f4a90833800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:31.837 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.835+0000 7f4a90833800 20 rados->read ofs=0 len=0 2023-12-03T11:48:31.838 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.835+0000 7f4a90833800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:31.838 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.835+0000 7f4a90833800 20 rados->read ofs=0 len=0 2023-12-03T11:48:31.838 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.835+0000 7f4a90833800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:31.838 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.835+0000 7f4a90833800 20 started sync module instance, tier type = 2023-12-03T11:48:31.838 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.835+0000 7f4a90833800 20 started zone id=83aabb46-04b5-4c96-9933-c6bfb1173a73 (name=default) with tier type = 2023-12-03T11:48:31.843 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.841+0000 7f4a8eb34640 0 -- 172.21.15.3:0/2132525984 >> [v2:172.21.15.37:6816/3770469300,v1:172.21.15.37:6818/3770469300] conn(0x7f4a8407f410 msgr2=0x7f4a8407f890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:48:31.846 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.845+0000 7f4a90833800 20 add_watcher() i=0 2023-12-03T11:48:31.846 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.845+0000 7f4a90833800 20 add_watcher() i=1 2023-12-03T11:48:31.846 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.845+0000 7f4a90833800 20 add_watcher() i=2 2023-12-03T11:48:31.846 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.845+0000 7f4a90833800 20 add_watcher() i=3 2023-12-03T11:48:31.846 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.845+0000 7f4a90833800 20 add_watcher() i=4 2023-12-03T11:48:31.846 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.845+0000 7f4a90833800 20 add_watcher() i=5 2023-12-03T11:48:31.846 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.845+0000 7f4a90833800 20 add_watcher() i=6 2023-12-03T11:48:31.847 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.846+0000 7f4a90833800 20 add_watcher() i=7 2023-12-03T11:48:31.847 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.846+0000 7f4a90833800 2 all 8 watchers are set, enabling cache 2023-12-03T11:48:31.848 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.847+0000 7f4a53fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:48:31.849 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.848+0000 7f4a90833800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:48:31.849 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.848+0000 7f4a90833800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:48:31.855 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.854+0000 7f4a90833800 5 note: GC not initialized 2023-12-03T11:48:31.855 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.854+0000 7f49c2ffd640 20 reqs_thread_entry: start 2023-12-03T11:48:31.855 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.854+0000 7f4a90833800 20 init_complete bucket index max shards: 11 2023-12-03T11:48:31.855 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.854+0000 7f4a90833800 20 Filter name: none 2023-12-03T11:48:31.856 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.854+0000 7f49c0ff9640 20 reqs_thread_entry: start 2023-12-03T11:48:31.856 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.854+0000 7f4a90833800 20 rados->read ofs=0 len=0 2023-12-03T11:48:31.856 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.854+0000 7f4a90833800 20 rados_obj.operate() r=0 bl.length=218 2023-12-03T11:48:31.857 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.854+0000 7f4a90833800 20 rados->read ofs=0 len=0 2023-12-03T11:48:31.857 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.855+0000 7f4a90833800 20 rados_obj.operate() r=0 bl.length=390 2023-12-03T11:48:31.857 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.855+0000 7f4a90833800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:48:31.857 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.855+0000 7f4a90833800 20 rados->read ofs=0 len=0 2023-12-03T11:48:31.857 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.855+0000 7f4a90833800 20 rados_obj.operate() r=0 bl.length=218 2023-12-03T11:48:31.857 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.855+0000 7f4a90833800 20 rados->read ofs=0 len=0 2023-12-03T11:48:31.857 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.856+0000 7f4a90833800 20 rados_obj.operate() r=0 bl.length=390 2023-12-03T11:48:31.857 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.856+0000 7f4a90833800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:48:31.858 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.857+0000 7f4a90833800 20 rados->read ofs=0 len=0 2023-12-03T11:48:31.858 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.857+0000 7f4a90833800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:31.859 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.858+0000 7f4a53fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:48:31.861 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.860+0000 7f4a90833800 20 remove_watcher() i=0 2023-12-03T11:48:31.861 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.860+0000 7f4a90833800 2 removed watcher, disabling cache 2023-12-03T11:48:31.862 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.861+0000 7f4a90833800 20 remove_watcher() i=1 2023-12-03T11:48:31.863 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.862+0000 7f4a90833800 20 remove_watcher() i=2 2023-12-03T11:48:31.864 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.863+0000 7f4a90833800 20 remove_watcher() i=3 2023-12-03T11:48:31.865 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.864+0000 7f4a90833800 20 remove_watcher() i=4 2023-12-03T11:48:31.866 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.865+0000 7f4a90833800 20 remove_watcher() i=5 2023-12-03T11:48:31.867 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.866+0000 7f4a90833800 20 remove_watcher() i=6 2023-12-03T11:48:31.868 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:31.867+0000 7f4a90833800 20 remove_watcher() i=7 2023-12-03T11:48:31.873 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:48:31.873 INFO:tasks.workunit.client.0.smithi003.stderr:BUCKET_STATS: 2023-12-03T11:48:31.873 INFO:tasks.workunit.client.0.smithi003.stderr:bucket: abort-at-set-target-layout id: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.21 num_objects: 19 size_kb: 1 num_shards: 12 2023-12-03T11:48:31.873 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:48:32.193 INFO:tasks.workunit.client.0.smithi003.stderr:TEST: reshard bucket with EIO injected at block_writes 2023-12-03T11:48:32.193 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:48:32.895 INFO:tasks.workunit.client.0.smithi003.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2023-12-03T11:48:32.923 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:48:32.923 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:48:32.937 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:32.936+0000 7fcd0b137800 20 rados->read ofs=0 len=0 2023-12-03T11:48:32.939 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:32.937+0000 7fcd0b137800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:32.939 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:32.937+0000 7fcd0b137800 20 realm 2023-12-03T11:48:32.939 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:32.937+0000 7fcd0b137800 20 rados->read ofs=0 len=0 2023-12-03T11:48:32.939 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:32.937+0000 7fcd0b137800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:32.939 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:32.937+0000 7fcd0b137800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:48:32.939 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:32.937+0000 7fcd0b137800 20 rados->read ofs=0 len=0 2023-12-03T11:48:32.939 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:32.938+0000 7fcd0b137800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:32.939 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:32.938+0000 7fcd0b137800 20 rados->read ofs=0 len=0 2023-12-03T11:48:32.940 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:32.938+0000 7fcd0b137800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:48:32.940 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:32.938+0000 7fcd0b137800 20 rados->read ofs=0 len=0 2023-12-03T11:48:32.940 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:32.939+0000 7fcd0b137800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:48:32.940 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:32.939+0000 7fcd0b137800 20 searching for the correct realm 2023-12-03T11:48:32.951 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:32.949+0000 7fcd06e6f640 0 -- 172.21.15.3:0/2325299717 >> [v2:172.21.15.37:6805/1692844418,v1:172.21.15.37:6807/1692844418] conn(0x557e17920930 msgr2=0x557e17922d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:48:32.953 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:32.951+0000 7fcd0b137800 20 RGWRados::pool_iterate: got zone_info.83aabb46-04b5-4c96-9933-c6bfb1173a73 2023-12-03T11:48:32.953 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:32.951+0000 7fcd0b137800 20 RGWRados::pool_iterate: got zonegroup_info.6a811aad-435d-4fdd-93c9-b7e0b50de429 2023-12-03T11:48:32.953 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:32.951+0000 7fcd0b137800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:48:32.953 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:32.951+0000 7fcd0b137800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:48:32.953 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:32.951+0000 7fcd0b137800 20 rados->read ofs=0 len=0 2023-12-03T11:48:32.953 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:32.951+0000 7fcd0b137800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:32.953 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:32.951+0000 7fcd0b137800 20 rados->read ofs=0 len=0 2023-12-03T11:48:32.953 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:32.951+0000 7fcd0b137800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:48:32.953 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:32.951+0000 7fcd0b137800 20 rados->read ofs=0 len=0 2023-12-03T11:48:32.954 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:32.951+0000 7fcd0b137800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:48:32.954 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:32.951+0000 7fcd0b137800 20 zone default found 2023-12-03T11:48:32.954 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:32.951+0000 7fcd0b137800 4 Realm: () 2023-12-03T11:48:32.954 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:32.951+0000 7fcd0b137800 4 ZoneGroup: default (6a811aad-435d-4fdd-93c9-b7e0b50de429) 2023-12-03T11:48:32.954 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:32.951+0000 7fcd0b137800 4 Zone: default (83aabb46-04b5-4c96-9933-c6bfb1173a73) 2023-12-03T11:48:32.954 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:32.951+0000 7fcd0b137800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:48:32.954 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:32.951+0000 7fcd0b137800 20 zonegroup default 2023-12-03T11:48:32.954 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:32.951+0000 7fcd0b137800 20 rados->read ofs=0 len=0 2023-12-03T11:48:32.954 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:32.952+0000 7fcd0b137800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:32.954 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:32.952+0000 7fcd0b137800 20 rados->read ofs=0 len=0 2023-12-03T11:48:32.955 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:32.952+0000 7fcd0b137800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:32.955 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:32.952+0000 7fcd0b137800 20 rados->read ofs=0 len=0 2023-12-03T11:48:32.955 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:32.953+0000 7fcd0b137800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:32.955 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:32.953+0000 7fcd0b137800 20 started sync module instance, tier type = 2023-12-03T11:48:32.955 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:32.953+0000 7fcd0b137800 20 started zone id=83aabb46-04b5-4c96-9933-c6bfb1173a73 (name=default) with tier type = 2023-12-03T11:48:32.960 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:32.959+0000 7fcd0666e640 0 -- 172.21.15.3:0/2325299717 >> [v2:172.21.15.3:6817/3356208405,v1:172.21.15.3:6819/3356208405] conn(0x557e179254b0 msgr2=0x557e17927900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-03T11:48:32.963 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:32.962+0000 7fcd0b137800 20 add_watcher() i=0 2023-12-03T11:48:32.963 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:32.962+0000 7fcd0b137800 20 add_watcher() i=1 2023-12-03T11:48:32.963 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:32.962+0000 7fcd0b137800 20 add_watcher() i=2 2023-12-03T11:48:32.964 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:32.962+0000 7fcd0b137800 20 add_watcher() i=3 2023-12-03T11:48:32.964 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:32.962+0000 7fcd0b137800 20 add_watcher() i=4 2023-12-03T11:48:32.964 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:32.962+0000 7fcd0b137800 20 add_watcher() i=5 2023-12-03T11:48:32.964 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:32.962+0000 7fcd0b137800 20 add_watcher() i=6 2023-12-03T11:48:32.964 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:32.963+0000 7fcd0b137800 20 add_watcher() i=7 2023-12-03T11:48:32.964 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:32.963+0000 7fcd0b137800 2 all 8 watchers are set, enabling cache 2023-12-03T11:48:32.966 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:32.965+0000 7fcc47fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:48:32.966 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:32.965+0000 7fcd0b137800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:48:32.966 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:32.965+0000 7fcd0b137800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:48:32.973 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:32.971+0000 7fcd0b137800 5 note: GC not initialized 2023-12-03T11:48:32.973 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:32.971+0000 7fcc36ffd640 20 reqs_thread_entry: start 2023-12-03T11:48:32.973 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:32.972+0000 7fcd0b137800 20 init_complete bucket index max shards: 11 2023-12-03T11:48:32.973 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:32.972+0000 7fcd0b137800 20 Filter name: none 2023-12-03T11:48:32.973 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:32.972+0000 7fcc34ff9640 20 reqs_thread_entry: start 2023-12-03T11:48:32.973 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:32.972+0000 7fcd0b137800 20 rados->read ofs=0 len=0 2023-12-03T11:48:32.974 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:32.972+0000 7fcd0b137800 20 rados_obj.operate() r=0 bl.length=213 2023-12-03T11:48:32.974 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:32.972+0000 7fcd0b137800 20 rados->read ofs=0 len=0 2023-12-03T11:48:32.974 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:32.973+0000 7fcd0b137800 20 rados_obj.operate() r=0 bl.length=385 2023-12-03T11:48:32.974 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:32.973+0000 7fcd0b137800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:48:32.974 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:32.973+0000 7fcd0b137800 20 rados->read ofs=0 len=0 2023-12-03T11:48:32.975 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:32.974+0000 7fcd0b137800 20 rados_obj.operate() r=0 bl.length=213 2023-12-03T11:48:32.975 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:32.974+0000 7fcd0b137800 20 rados->read ofs=0 len=0 2023-12-03T11:48:32.975 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:32.974+0000 7fcd0b137800 20 rados_obj.operate() r=0 bl.length=385 2023-12-03T11:48:32.975 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:32.974+0000 7fcd0b137800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:48:32.976 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:32.975+0000 7fcd0b137800 20 rados->read ofs=0 len=0 2023-12-03T11:48:32.976 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:32.975+0000 7fcd0b137800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:32.977 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:32.976+0000 7fcc47fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:48:32.979 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:32.978+0000 7fcd0b137800 20 remove_watcher() i=0 2023-12-03T11:48:32.979 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:32.978+0000 7fcd0b137800 2 removed watcher, disabling cache 2023-12-03T11:48:32.980 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:32.979+0000 7fcd0b137800 20 remove_watcher() i=1 2023-12-03T11:48:32.982 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:32.981+0000 7fcd0b137800 20 remove_watcher() i=2 2023-12-03T11:48:32.983 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:32.982+0000 7fcd0b137800 20 remove_watcher() i=3 2023-12-03T11:48:32.984 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:32.983+0000 7fcd0b137800 20 remove_watcher() i=4 2023-12-03T11:48:32.985 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:32.984+0000 7fcd0b137800 20 remove_watcher() i=5 2023-12-03T11:48:32.986 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:32.984+0000 7fcd0b137800 20 remove_watcher() i=6 2023-12-03T11:48:32.986 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:32.985+0000 7fcd0b137800 20 remove_watcher() i=7 2023-12-03T11:48:32.991 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:48:32.991 INFO:tasks.workunit.client.0.smithi003.stderr:BUCKET_STATS: 2023-12-03T11:48:32.992 INFO:tasks.workunit.client.0.smithi003.stderr:bucket: error-at-block-writes id: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.22 num_objects: 20 size_kb: 1 num_shards: 11 2023-12-03T11:48:32.992 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:48:32.993 INFO:tasks.workunit.client.0.smithi003.stderr:radosgw-admin bucket reshard --bucket error-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at block_writes 2023-12-03T11:48:33.027 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:48:33.028 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:48:33.041 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.039+0000 7f21dac11800 20 rados->read ofs=0 len=0 2023-12-03T11:48:33.044 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.041+0000 7f21dac11800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:33.044 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.041+0000 7f21dac11800 20 realm 2023-12-03T11:48:33.045 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.041+0000 7f21dac11800 20 rados->read ofs=0 len=0 2023-12-03T11:48:33.045 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.041+0000 7f21dac11800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:33.045 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.041+0000 7f21dac11800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:48:33.045 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.041+0000 7f21dac11800 20 rados->read ofs=0 len=0 2023-12-03T11:48:33.045 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.042+0000 7f21dac11800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:33.045 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.042+0000 7f21dac11800 20 rados->read ofs=0 len=0 2023-12-03T11:48:33.045 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.042+0000 7f21dac11800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:48:33.046 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.042+0000 7f21dac11800 20 rados->read ofs=0 len=0 2023-12-03T11:48:33.046 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.043+0000 7f21dac11800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:48:33.046 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.043+0000 7f21dac11800 20 searching for the correct realm 2023-12-03T11:48:33.053 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.052+0000 7f21d5a19640 0 -- 172.21.15.3:0/3026516220 >> [v2:172.21.15.3:6817/3356208405,v1:172.21.15.3:6819/3356208405] conn(0x55a97c45f090 msgr2=0x55a97c461480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:48:33.056 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.054+0000 7f21dac11800 20 RGWRados::pool_iterate: got zone_info.83aabb46-04b5-4c96-9933-c6bfb1173a73 2023-12-03T11:48:33.056 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.054+0000 7f21dac11800 20 RGWRados::pool_iterate: got zonegroup_info.6a811aad-435d-4fdd-93c9-b7e0b50de429 2023-12-03T11:48:33.056 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.054+0000 7f21dac11800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:48:33.057 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.054+0000 7f21dac11800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:48:33.057 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.054+0000 7f21dac11800 20 rados->read ofs=0 len=0 2023-12-03T11:48:33.057 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.054+0000 7f21dac11800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:33.057 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.054+0000 7f21dac11800 20 rados->read ofs=0 len=0 2023-12-03T11:48:33.057 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.055+0000 7f21dac11800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:48:33.057 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.055+0000 7f21dac11800 20 rados->read ofs=0 len=0 2023-12-03T11:48:33.057 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.055+0000 7f21dac11800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:48:33.057 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.055+0000 7f21dac11800 20 zone default found 2023-12-03T11:48:33.057 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.055+0000 7f21dac11800 4 Realm: () 2023-12-03T11:48:33.057 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.055+0000 7f21dac11800 4 ZoneGroup: default (6a811aad-435d-4fdd-93c9-b7e0b50de429) 2023-12-03T11:48:33.057 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.055+0000 7f21dac11800 4 Zone: default (83aabb46-04b5-4c96-9933-c6bfb1173a73) 2023-12-03T11:48:33.057 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.055+0000 7f21dac11800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:48:33.057 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.055+0000 7f21dac11800 20 zonegroup default 2023-12-03T11:48:33.057 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.055+0000 7f21dac11800 20 rados->read ofs=0 len=0 2023-12-03T11:48:33.057 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.055+0000 7f21dac11800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:33.058 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.055+0000 7f21dac11800 20 rados->read ofs=0 len=0 2023-12-03T11:48:33.058 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.055+0000 7f21dac11800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:33.058 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.055+0000 7f21dac11800 20 rados->read ofs=0 len=0 2023-12-03T11:48:33.058 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.056+0000 7f21dac11800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:33.058 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.056+0000 7f21dac11800 20 started sync module instance, tier type = 2023-12-03T11:48:33.059 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.056+0000 7f21dac11800 20 started zone id=83aabb46-04b5-4c96-9933-c6bfb1173a73 (name=default) with tier type = 2023-12-03T11:48:33.061 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.060+0000 7f21d621a640 0 -- 172.21.15.3:0/3026516220 >> [v2:172.21.15.3:6800/2373485412,v1:172.21.15.3:6801/2373485412] conn(0x7f21d0038820 msgr2=0x7f21d002c420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-03T11:48:33.066 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.065+0000 7f21dac11800 20 add_watcher() i=0 2023-12-03T11:48:33.066 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.065+0000 7f21dac11800 20 add_watcher() i=1 2023-12-03T11:48:33.067 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.065+0000 7f21dac11800 20 add_watcher() i=2 2023-12-03T11:48:33.067 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.065+0000 7f21dac11800 20 add_watcher() i=3 2023-12-03T11:48:33.067 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.065+0000 7f21dac11800 20 add_watcher() i=4 2023-12-03T11:48:33.067 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.065+0000 7f21dac11800 20 add_watcher() i=5 2023-12-03T11:48:33.067 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.065+0000 7f21dac11800 20 add_watcher() i=6 2023-12-03T11:48:33.067 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.066+0000 7f21dac11800 20 add_watcher() i=7 2023-12-03T11:48:33.068 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.066+0000 7f21dac11800 2 all 8 watchers are set, enabling cache 2023-12-03T11:48:33.068 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.067+0000 7f219bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:48:33.069 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.068+0000 7f21dac11800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:48:33.069 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.068+0000 7f21dac11800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:48:33.076 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.074+0000 7f21dac11800 5 note: GC not initialized 2023-12-03T11:48:33.076 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.074+0000 7f210affd640 20 reqs_thread_entry: start 2023-12-03T11:48:33.076 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.074+0000 7f21dac11800 20 init_complete bucket index max shards: 11 2023-12-03T11:48:33.077 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.074+0000 7f21dac11800 20 Filter name: none 2023-12-03T11:48:33.077 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.074+0000 7f2108ff9640 20 reqs_thread_entry: start 2023-12-03T11:48:33.077 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.074+0000 7f21dac11800 10 cache get: name=default.rgw.meta+root+error-at-block-writes : miss 2023-12-03T11:48:33.077 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.074+0000 7f21dac11800 20 rados->read ofs=0 len=0 2023-12-03T11:48:33.077 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.074+0000 7f21dac11800 20 rados_obj.operate() r=0 bl.length=213 2023-12-03T11:48:33.077 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.074+0000 7f21dac11800 10 cache put: name=default.rgw.meta+root+error-at-block-writes info.flags=0x11 2023-12-03T11:48:33.077 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.074+0000 7f21dac11800 10 adding default.rgw.meta+root+error-at-block-writes to cache LRU end 2023-12-03T11:48:33.077 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.075+0000 7f21dac11800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.22 : miss 2023-12-03T11:48:33.077 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.075+0000 7f21dac11800 20 rados->read ofs=0 len=0 2023-12-03T11:48:33.077 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.075+0000 7f21dac11800 20 rados_obj.operate() r=0 bl.length=385 2023-12-03T11:48:33.077 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.075+0000 7f21dac11800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.22 info.flags=0x17 2023-12-03T11:48:33.078 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.075+0000 7f21dac11800 10 adding default.rgw.meta+root+.bucket.meta.error-at-block-writes:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.22 to cache LRU end 2023-12-03T11:48:33.078 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.075+0000 7f21dac11800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:48:33.078 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.075+0000 7f21dac11800 10 updating xattr: name=user.rgw.acl bl.length()=265 2023-12-03T11:48:33.078 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.075+0000 7f21dac11800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.22 2023-12-03T11:48:33.083 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.081+0000 7f21dac11800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.22 info.flags=0x17 2023-12-03T11:48:33.083 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.081+0000 7f21dac11800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.22 to cache LRU end 2023-12-03T11:48:33.083 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.081+0000 7f21dac11800 10 updating xattr: name=user.rgw.acl bl.length()=265 2023-12-03T11:48:33.083 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.081+0000 7f21dac11800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.22, ofs0, ns] 2023-12-03T11:48:33.084 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.082+0000 7f21b7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660540 cookie 94186422800576 notifier 6672 bl.length()=949 2023-12-03T11:48:33.084 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.082+0000 7f21b7fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.22 info.flags=0x17 2023-12-03T11:48:33.084 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.082+0000 7f21b7fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.22 to cache LRU end 2023-12-03T11:48:33.084 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.082+0000 7f21b7fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2023-12-03T11:48:33.085 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.083+0000 7f21dac11800 20 handle_bi_update(): bucket=:error-at-block-writes[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.22]): orig_sources= new_sources= 2023-12-03T11:48:33.085 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.083+0000 7f21dac11800 20 handle_bi_update(): bucket=:error-at-block-writes[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.22]): potential sources added=[] removed=[] 2023-12-03T11:48:33.085 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.083+0000 7f21dac11800 20 handle_bi_update(): bucket=:error-at-block-writes[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.22]): orig_dests= new_dests= 2023-12-03T11:48:33.085 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.083+0000 7f21dac11800 20 handle_bi_update(): bucket=:error-at-block-writes[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.22]): potential dests added=[] removed=[] 2023-12-03T11:48:33.085 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.083+0000 7f21dac11800 -1 Injecting error=-5 at location=block_writes 2023-12-03T11:48:33.086 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.083+0000 7f21dac11800 0 ERROR: init_reshard failed to pause writes to the current index: (5) Input/output error 2023-12-03T11:48:33.087 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.086+0000 7f21dac11800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.22 : hit (requested=0x17, cached=0x17) 2023-12-03T11:48:33.087 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.086+0000 7f21dac11800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.22 2023-12-03T11:48:33.088 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.087+0000 7f21dac11800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.22 info.flags=0x17 2023-12-03T11:48:33.088 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.087+0000 7f21dac11800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.22 to cache LRU end 2023-12-03T11:48:33.088 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.087+0000 7f21dac11800 10 updating xattr: name=user.rgw.acl bl.length()=265 2023-12-03T11:48:33.089 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.087+0000 7f21dac11800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.22, ofs0, ns] 2023-12-03T11:48:33.089 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.087+0000 7f21b7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660541 cookie 94186422800576 notifier 6672 bl.length()=917 2023-12-03T11:48:33.090 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.087+0000 7f21b7fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.22 info.flags=0x17 2023-12-03T11:48:33.090 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.087+0000 7f21b7fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.22 to cache LRU end 2023-12-03T11:48:33.090 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.087+0000 7f21b7fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2023-12-03T11:48:33.090 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.089+0000 7f21dac11800 20 handle_bi_update(): bucket=:error-at-block-writes[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.22]): orig_sources= new_sources= 2023-12-03T11:48:33.090 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.089+0000 7f21dac11800 20 handle_bi_update(): bucket=:error-at-block-writes[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.22]): potential sources added=[] removed=[] 2023-12-03T11:48:33.091 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.089+0000 7f21dac11800 20 handle_bi_update(): bucket=:error-at-block-writes[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.22]): orig_dests= new_dests= 2023-12-03T11:48:33.091 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.089+0000 7f21dac11800 20 handle_bi_update(): bucket=:error-at-block-writes[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.22]): potential dests added=[] removed=[] 2023-12-03T11:48:33.092 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.091+0000 7f219bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:48:33.094 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.093+0000 7f21dac11800 20 remove_watcher() i=0 2023-12-03T11:48:33.094 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.093+0000 7f21dac11800 2 removed watcher, disabling cache 2023-12-03T11:48:33.095 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.094+0000 7f21dac11800 20 remove_watcher() i=1 2023-12-03T11:48:33.096 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.095+0000 7f21dac11800 20 remove_watcher() i=2 2023-12-03T11:48:33.097 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.096+0000 7f21dac11800 20 remove_watcher() i=3 2023-12-03T11:48:33.098 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.097+0000 7f21dac11800 20 remove_watcher() i=4 2023-12-03T11:48:33.099 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.098+0000 7f21dac11800 20 remove_watcher() i=5 2023-12-03T11:48:33.100 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.098+0000 7f21dac11800 20 remove_watcher() i=6 2023-12-03T11:48:33.100 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.099+0000 7f21dac11800 20 remove_watcher() i=7 2023-12-03T11:48:33.107 INFO:tasks.workunit.client.0.smithi003.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2023-12-03T11:48:33.136 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:48:33.136 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:48:33.151 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.150+0000 7f6a1d32c800 20 rados->read ofs=0 len=0 2023-12-03T11:48:33.153 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.151+0000 7f6a1d32c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:33.153 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.151+0000 7f6a1d32c800 20 realm 2023-12-03T11:48:33.153 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.151+0000 7f6a1d32c800 20 rados->read ofs=0 len=0 2023-12-03T11:48:33.153 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.152+0000 7f6a1d32c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:33.153 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.152+0000 7f6a1d32c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:48:33.153 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.152+0000 7f6a1d32c800 20 rados->read ofs=0 len=0 2023-12-03T11:48:33.153 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.152+0000 7f6a1d32c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:33.154 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.152+0000 7f6a1d32c800 20 rados->read ofs=0 len=0 2023-12-03T11:48:33.154 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.153+0000 7f6a1d32c800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:48:33.154 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.153+0000 7f6a1d32c800 20 rados->read ofs=0 len=0 2023-12-03T11:48:33.154 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.153+0000 7f6a1d32c800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:48:33.154 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.153+0000 7f6a1d32c800 20 searching for the correct realm 2023-12-03T11:48:33.165 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.164+0000 7f6a190f0640 0 -- 172.21.15.3:0/2993958891 >> [v2:172.21.15.37:6805/1692844418,v1:172.21.15.37:6807/1692844418] conn(0x564d90adb060 msgr2=0x564d90add470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:48:33.165 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.164+0000 7f6a1d32c800 20 RGWRados::pool_iterate: got zone_info.83aabb46-04b5-4c96-9933-c6bfb1173a73 2023-12-03T11:48:33.165 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.164+0000 7f6a1d32c800 20 RGWRados::pool_iterate: got zonegroup_info.6a811aad-435d-4fdd-93c9-b7e0b50de429 2023-12-03T11:48:33.165 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.164+0000 7f6a1d32c800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:48:33.166 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.164+0000 7f6a1d32c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:48:33.166 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.164+0000 7f6a1d32c800 20 rados->read ofs=0 len=0 2023-12-03T11:48:33.166 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.164+0000 7f6a1d32c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:33.166 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.164+0000 7f6a1d32c800 20 rados->read ofs=0 len=0 2023-12-03T11:48:33.167 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.164+0000 7f6a1d32c800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:48:33.167 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.164+0000 7f6a1d32c800 20 rados->read ofs=0 len=0 2023-12-03T11:48:33.167 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.165+0000 7f6a1d32c800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:48:33.167 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.165+0000 7f6a1d32c800 20 zone default found 2023-12-03T11:48:33.167 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.165+0000 7f6a1d32c800 4 Realm: () 2023-12-03T11:48:33.167 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.165+0000 7f6a1d32c800 4 ZoneGroup: default (6a811aad-435d-4fdd-93c9-b7e0b50de429) 2023-12-03T11:48:33.167 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.165+0000 7f6a1d32c800 4 Zone: default (83aabb46-04b5-4c96-9933-c6bfb1173a73) 2023-12-03T11:48:33.167 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.165+0000 7f6a1d32c800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:48:33.167 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.165+0000 7f6a1d32c800 20 zonegroup default 2023-12-03T11:48:33.168 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.165+0000 7f6a1d32c800 20 rados->read ofs=0 len=0 2023-12-03T11:48:33.168 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.165+0000 7f6a1d32c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:33.168 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.165+0000 7f6a1d32c800 20 rados->read ofs=0 len=0 2023-12-03T11:48:33.168 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.165+0000 7f6a1d32c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:33.168 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.165+0000 7f6a1d32c800 20 rados->read ofs=0 len=0 2023-12-03T11:48:33.168 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.165+0000 7f6a1d32c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:33.168 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.165+0000 7f6a1d32c800 20 started sync module instance, tier type = 2023-12-03T11:48:33.168 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.165+0000 7f6a1d32c800 20 started zone id=83aabb46-04b5-4c96-9933-c6bfb1173a73 (name=default) with tier type = 2023-12-03T11:48:33.174 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.173+0000 7f6a188ef640 0 -- 172.21.15.3:0/2993958891 >> [v2:172.21.15.3:6817/3356208405,v1:172.21.15.3:6819/3356208405] conn(0x564d90ae00b0 msgr2=0x564d90ae24a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:48:33.176 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.175+0000 7f6a1d32c800 20 add_watcher() i=0 2023-12-03T11:48:33.176 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.175+0000 7f6a1d32c800 20 add_watcher() i=1 2023-12-03T11:48:33.176 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.175+0000 7f6a1d32c800 20 add_watcher() i=2 2023-12-03T11:48:33.176 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.175+0000 7f6a1d32c800 20 add_watcher() i=3 2023-12-03T11:48:33.176 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.175+0000 7f6a1d32c800 20 add_watcher() i=4 2023-12-03T11:48:33.176 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.175+0000 7f6a1d32c800 20 add_watcher() i=5 2023-12-03T11:48:33.176 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.175+0000 7f6a1d32c800 20 add_watcher() i=6 2023-12-03T11:48:33.177 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.176+0000 7f6a1d32c800 20 add_watcher() i=7 2023-12-03T11:48:33.177 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.176+0000 7f6a1d32c800 2 all 8 watchers are set, enabling cache 2023-12-03T11:48:33.178 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.177+0000 7f69defe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:48:33.179 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.178+0000 7f6a1d32c800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:48:33.179 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.178+0000 7f6a1d32c800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:48:33.185 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.184+0000 7f6a1d32c800 5 note: GC not initialized 2023-12-03T11:48:33.185 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.184+0000 7f694dffb640 20 reqs_thread_entry: start 2023-12-03T11:48:33.185 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.184+0000 7f6a1d32c800 20 init_complete bucket index max shards: 11 2023-12-03T11:48:33.185 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.184+0000 7f6a1d32c800 20 Filter name: none 2023-12-03T11:48:33.186 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.184+0000 7f693f7fe640 20 reqs_thread_entry: start 2023-12-03T11:48:33.186 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.184+0000 7f6a1d32c800 20 rados->read ofs=0 len=0 2023-12-03T11:48:33.186 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.184+0000 7f6a1d32c800 20 rados_obj.operate() r=0 bl.length=213 2023-12-03T11:48:33.186 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.184+0000 7f6a1d32c800 20 rados->read ofs=0 len=0 2023-12-03T11:48:33.186 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.185+0000 7f6a1d32c800 20 rados_obj.operate() r=0 bl.length=385 2023-12-03T11:48:33.187 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.185+0000 7f6a1d32c800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:48:33.187 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.185+0000 7f6a1d32c800 20 rados->read ofs=0 len=0 2023-12-03T11:48:33.187 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.186+0000 7f6a1d32c800 20 rados_obj.operate() r=0 bl.length=213 2023-12-03T11:48:33.187 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.186+0000 7f6a1d32c800 20 rados->read ofs=0 len=0 2023-12-03T11:48:33.187 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.186+0000 7f6a1d32c800 20 rados_obj.operate() r=0 bl.length=385 2023-12-03T11:48:33.187 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.186+0000 7f6a1d32c800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:48:33.188 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.187+0000 7f6a1d32c800 20 rados->read ofs=0 len=0 2023-12-03T11:48:33.189 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.187+0000 7f6a1d32c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:33.189 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.188+0000 7f69defe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:48:33.191 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.190+0000 7f6a1d32c800 20 remove_watcher() i=0 2023-12-03T11:48:33.192 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.190+0000 7f6a1d32c800 2 removed watcher, disabling cache 2023-12-03T11:48:33.193 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.192+0000 7f6a1d32c800 20 remove_watcher() i=1 2023-12-03T11:48:33.194 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.193+0000 7f6a1d32c800 20 remove_watcher() i=2 2023-12-03T11:48:33.195 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.194+0000 7f6a1d32c800 20 remove_watcher() i=3 2023-12-03T11:48:33.196 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.195+0000 7f6a1d32c800 20 remove_watcher() i=4 2023-12-03T11:48:33.197 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.196+0000 7f6a1d32c800 20 remove_watcher() i=5 2023-12-03T11:48:33.198 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.197+0000 7f6a1d32c800 20 remove_watcher() i=6 2023-12-03T11:48:33.199 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.198+0000 7f6a1d32c800 20 remove_watcher() i=7 2023-12-03T11:48:33.203 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:48:33.203 INFO:tasks.workunit.client.0.smithi003.stderr:BUCKET_STATS: 2023-12-03T11:48:33.204 INFO:tasks.workunit.client.0.smithi003.stderr:bucket: error-at-block-writes id: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.22 num_objects: 20 size_kb: 1 num_shards: 11 2023-12-03T11:48:33.204 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:48:33.291 INFO:tasks.workunit.client.0.smithi003.stderr:radosgw-admin bucket reshard --bucket error-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2023-12-03T11:48:33.324 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:48:33.324 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:48:33.338 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.337+0000 7f7204f32800 20 rados->read ofs=0 len=0 2023-12-03T11:48:33.341 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.339+0000 7f7204f32800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:33.341 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.339+0000 7f7204f32800 20 realm 2023-12-03T11:48:33.341 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.339+0000 7f7204f32800 20 rados->read ofs=0 len=0 2023-12-03T11:48:33.341 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.339+0000 7f7204f32800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:33.341 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.339+0000 7f7204f32800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:48:33.341 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.339+0000 7f7204f32800 20 rados->read ofs=0 len=0 2023-12-03T11:48:33.341 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.340+0000 7f7204f32800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:33.341 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.340+0000 7f7204f32800 20 rados->read ofs=0 len=0 2023-12-03T11:48:33.342 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.340+0000 7f7204f32800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:48:33.342 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.340+0000 7f7204f32800 20 rados->read ofs=0 len=0 2023-12-03T11:48:33.342 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.341+0000 7f7204f32800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:48:33.342 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.341+0000 7f7204f32800 20 searching for the correct realm 2023-12-03T11:48:33.353 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.352+0000 7f7200b62640 0 -- 172.21.15.3:0/1220416850 >> [v2:172.21.15.37:6805/1692844418,v1:172.21.15.37:6807/1692844418] conn(0x55fbe487b730 msgr2=0x55fbe487dbc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:48:33.353 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.352+0000 7f7204f32800 20 RGWRados::pool_iterate: got zone_info.83aabb46-04b5-4c96-9933-c6bfb1173a73 2023-12-03T11:48:33.353 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.352+0000 7f7204f32800 20 RGWRados::pool_iterate: got zonegroup_info.6a811aad-435d-4fdd-93c9-b7e0b50de429 2023-12-03T11:48:33.353 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.352+0000 7f7204f32800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:48:33.354 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.352+0000 7f7204f32800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:48:33.354 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.352+0000 7f7204f32800 20 rados->read ofs=0 len=0 2023-12-03T11:48:33.354 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.352+0000 7f7204f32800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:33.354 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.352+0000 7f7204f32800 20 rados->read ofs=0 len=0 2023-12-03T11:48:33.356 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.352+0000 7f7204f32800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:48:33.356 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.352+0000 7f7204f32800 20 rados->read ofs=0 len=0 2023-12-03T11:48:33.356 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.353+0000 7f7204f32800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:48:33.356 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.353+0000 7f7204f32800 20 zone default found 2023-12-03T11:48:33.356 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.353+0000 7f7204f32800 4 Realm: () 2023-12-03T11:48:33.356 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.353+0000 7f7204f32800 4 ZoneGroup: default (6a811aad-435d-4fdd-93c9-b7e0b50de429) 2023-12-03T11:48:33.356 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.353+0000 7f7204f32800 4 Zone: default (83aabb46-04b5-4c96-9933-c6bfb1173a73) 2023-12-03T11:48:33.356 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.353+0000 7f7204f32800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:48:33.356 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.353+0000 7f7204f32800 20 zonegroup default 2023-12-03T11:48:33.356 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.353+0000 7f7204f32800 20 rados->read ofs=0 len=0 2023-12-03T11:48:33.356 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.353+0000 7f7204f32800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:33.357 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.353+0000 7f7204f32800 20 rados->read ofs=0 len=0 2023-12-03T11:48:33.357 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.353+0000 7f7204f32800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:33.357 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.353+0000 7f7204f32800 20 rados->read ofs=0 len=0 2023-12-03T11:48:33.357 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.354+0000 7f7204f32800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:33.357 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.354+0000 7f7204f32800 20 started sync module instance, tier type = 2023-12-03T11:48:33.357 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.354+0000 7f7204f32800 20 started zone id=83aabb46-04b5-4c96-9933-c6bfb1173a73 (name=default) with tier type = 2023-12-03T11:48:33.362 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.361+0000 7f71fbfff640 0 -- 172.21.15.3:0/1220416850 >> [v2:172.21.15.3:6817/3356208405,v1:172.21.15.3:6819/3356208405] conn(0x55fbe48807b0 msgr2=0x55fbe4882ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:48:33.364 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.362+0000 7f7204f32800 20 add_watcher() i=0 2023-12-03T11:48:33.364 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.362+0000 7f7204f32800 20 add_watcher() i=1 2023-12-03T11:48:33.364 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.362+0000 7f7204f32800 20 add_watcher() i=2 2023-12-03T11:48:33.364 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.362+0000 7f7204f32800 20 add_watcher() i=3 2023-12-03T11:48:33.364 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.362+0000 7f7204f32800 20 add_watcher() i=4 2023-12-03T11:48:33.364 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.362+0000 7f7204f32800 20 add_watcher() i=5 2023-12-03T11:48:33.364 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.363+0000 7f7204f32800 20 add_watcher() i=6 2023-12-03T11:48:33.364 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.363+0000 7f7204f32800 20 add_watcher() i=7 2023-12-03T11:48:33.365 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.363+0000 7f7204f32800 2 all 8 watchers are set, enabling cache 2023-12-03T11:48:33.366 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.365+0000 7f71c67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:48:33.367 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.365+0000 7f7204f32800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:48:33.367 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.365+0000 7f7204f32800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:48:33.373 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.371+0000 7f7204f32800 5 note: GC not initialized 2023-12-03T11:48:33.373 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.372+0000 7f71357fa640 20 reqs_thread_entry: start 2023-12-03T11:48:33.373 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.372+0000 7f7204f32800 20 init_complete bucket index max shards: 11 2023-12-03T11:48:33.373 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.372+0000 7f7204f32800 20 Filter name: none 2023-12-03T11:48:33.373 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.372+0000 7f712effd640 20 reqs_thread_entry: start 2023-12-03T11:48:33.374 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.372+0000 7f7204f32800 10 cache get: name=default.rgw.meta+root+error-at-block-writes : miss 2023-12-03T11:48:33.374 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.372+0000 7f7204f32800 20 rados->read ofs=0 len=0 2023-12-03T11:48:33.375 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.372+0000 7f7204f32800 20 rados_obj.operate() r=0 bl.length=213 2023-12-03T11:48:33.375 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.372+0000 7f7204f32800 10 cache put: name=default.rgw.meta+root+error-at-block-writes info.flags=0x11 2023-12-03T11:48:33.375 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.372+0000 7f7204f32800 10 adding default.rgw.meta+root+error-at-block-writes to cache LRU end 2023-12-03T11:48:33.375 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.372+0000 7f7204f32800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.22 : miss 2023-12-03T11:48:33.375 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.372+0000 7f7204f32800 20 rados->read ofs=0 len=0 2023-12-03T11:48:33.375 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.373+0000 7f7204f32800 20 rados_obj.operate() r=0 bl.length=385 2023-12-03T11:48:33.375 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.373+0000 7f7204f32800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.22 info.flags=0x17 2023-12-03T11:48:33.375 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.373+0000 7f7204f32800 10 adding default.rgw.meta+root+.bucket.meta.error-at-block-writes:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.22 to cache LRU end 2023-12-03T11:48:33.375 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.373+0000 7f7204f32800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:48:33.375 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.373+0000 7f7204f32800 10 updating xattr: name=user.rgw.acl bl.length()=265 2023-12-03T11:48:33.375 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.373+0000 7f7204f32800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.22 2023-12-03T11:48:33.379 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.378+0000 7f7204f32800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.22 info.flags=0x17 2023-12-03T11:48:33.380 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.378+0000 7f7204f32800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.22 to cache LRU end 2023-12-03T11:48:33.380 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.378+0000 7f7204f32800 10 updating xattr: name=user.rgw.acl bl.length()=265 2023-12-03T11:48:33.380 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.378+0000 7f7204f32800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.22, ofs0, ns] 2023-12-03T11:48:33.380 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.378+0000 7f71e2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660542 cookie 94540359295792 notifier 6708 bl.length()=949 2023-12-03T11:48:33.380 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.378+0000 7f71e2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.22 info.flags=0x17 2023-12-03T11:48:33.380 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.378+0000 7f71e2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.22 to cache LRU end 2023-12-03T11:48:33.380 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.378+0000 7f71e2ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2023-12-03T11:48:33.381 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.380+0000 7f7204f32800 20 handle_bi_update(): bucket=:error-at-block-writes[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.22]): orig_sources= new_sources= 2023-12-03T11:48:33.381 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.380+0000 7f7204f32800 20 handle_bi_update(): bucket=:error-at-block-writes[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.22]): potential sources added=[] removed=[] 2023-12-03T11:48:33.382 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.380+0000 7f7204f32800 20 handle_bi_update(): bucket=:error-at-block-writes[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.22]): orig_dests= new_dests= 2023-12-03T11:48:33.382 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.380+0000 7f7204f32800 20 handle_bi_update(): bucket=:error-at-block-writes[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.22]): potential dests added=[] removed=[] 2023-12-03T11:48:33.384 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.383+0000 7f7204f32800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.22.1.0 2023-12-03T11:48:33.384 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.383+0000 7f7204f32800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.22.1.0 2023-12-03T11:48:33.385 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.383+0000 7f7204f32800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.22.1.1 2023-12-03T11:48:33.385 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.383+0000 7f7204f32800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.22.1.1 2023-12-03T11:48:33.385 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.383+0000 7f7204f32800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.22.1.2 2023-12-03T11:48:33.385 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.383+0000 7f7204f32800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.22.1.2 2023-12-03T11:48:33.385 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.383+0000 7f7204f32800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.22.1.3 2023-12-03T11:48:33.385 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.383+0000 7f7204f32800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.22.1.3 2023-12-03T11:48:33.385 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.383+0000 7f7204f32800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.22.1.4 2023-12-03T11:48:33.385 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.383+0000 7f7204f32800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.22.1.4 2023-12-03T11:48:33.385 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.383+0000 7f7204f32800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.22.1.5 2023-12-03T11:48:33.385 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.383+0000 7f7204f32800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.22.1.5 2023-12-03T11:48:33.385 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.383+0000 7f7204f32800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.22.1.6 2023-12-03T11:48:33.385 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.383+0000 7f7204f32800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.22.1.6 2023-12-03T11:48:33.385 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.383+0000 7f7204f32800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.22.1.7 2023-12-03T11:48:33.386 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.383+0000 7f7204f32800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.22.1.7 2023-12-03T11:48:33.386 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.383+0000 7f7204f32800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.22.1.8 2023-12-03T11:48:33.386 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.383+0000 7f7204f32800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.22.1.8 2023-12-03T11:48:33.386 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.383+0000 7f7204f32800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.22.1.9 2023-12-03T11:48:33.386 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.383+0000 7f7204f32800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.22.1.9 2023-12-03T11:48:33.386 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.383+0000 7f7204f32800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.22.1.10 2023-12-03T11:48:33.386 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.383+0000 7f7204f32800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.22.1.10 2023-12-03T11:48:33.386 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.383+0000 7f7204f32800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.22.1.11 2023-12-03T11:48:33.386 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.383+0000 7f7204f32800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.22.1.11 2023-12-03T11:48:33.386 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.383+0000 7f7204f32800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.22.0 2023-12-03T11:48:33.386 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.383+0000 7f7204f32800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.22.1 2023-12-03T11:48:33.387 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.384+0000 7f7204f32800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.22.2 2023-12-03T11:48:33.387 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.384+0000 7f7204f32800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.22.3 2023-12-03T11:48:33.387 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.385+0000 7f7204f32800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.22.4 2023-12-03T11:48:33.387 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.385+0000 7f7204f32800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.22.5 2023-12-03T11:48:33.387 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.386+0000 7f7204f32800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.22.6 2023-12-03T11:48:33.388 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.386+0000 7f7204f32800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.22.7 2023-12-03T11:48:33.388 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.387+0000 7f7204f32800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.22.8 2023-12-03T11:48:33.388 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.387+0000 7f7204f32800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.22.9 2023-12-03T11:48:33.389 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.388+0000 7f7204f32800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.22.10 2023-12-03T11:48:33.392 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.391+0000 7f7204f32800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.22 : hit (requested=0x17, cached=0x17) 2023-12-03T11:48:33.392 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.391+0000 7f7204f32800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.22 2023-12-03T11:48:33.393 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.392+0000 7f7204f32800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.22 info.flags=0x17 2023-12-03T11:48:33.393 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.392+0000 7f7204f32800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.22 to cache LRU end 2023-12-03T11:48:33.393 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.392+0000 7f7204f32800 10 updating xattr: name=user.rgw.acl bl.length()=265 2023-12-03T11:48:33.393 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.392+0000 7f7204f32800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.22, ofs0, ns] 2023-12-03T11:48:33.394 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.392+0000 7f71e2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660543 cookie 94540359295792 notifier 6708 bl.length()=917 2023-12-03T11:48:33.394 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.392+0000 7f71e2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.22 info.flags=0x17 2023-12-03T11:48:33.394 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.392+0000 7f71e2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.22 to cache LRU end 2023-12-03T11:48:33.394 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.392+0000 7f71e2ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2023-12-03T11:48:33.395 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.394+0000 7f7204f32800 20 handle_bi_update(): bucket=:error-at-block-writes[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.22]): orig_sources= new_sources= 2023-12-03T11:48:33.395 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.394+0000 7f7204f32800 20 handle_bi_update(): bucket=:error-at-block-writes[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.22]): potential sources added=[] removed=[] 2023-12-03T11:48:33.395 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.394+0000 7f7204f32800 20 handle_bi_update(): bucket=:error-at-block-writes[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.22]): orig_dests= new_dests= 2023-12-03T11:48:33.396 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.394+0000 7f7204f32800 20 handle_bi_update(): bucket=:error-at-block-writes[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.22]): potential dests added=[] removed=[] 2023-12-03T11:48:33.398 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.397+0000 7f7204f32800 1 execute INFO: reshard of bucket "error-at-block-writes" completed successfully 2023-12-03T11:48:33.399 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.398+0000 7f71c67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:48:33.401 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.400+0000 7f7204f32800 20 remove_watcher() i=0 2023-12-03T11:48:33.402 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.400+0000 7f7204f32800 2 removed watcher, disabling cache 2023-12-03T11:48:33.403 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.401+0000 7f7204f32800 20 remove_watcher() i=1 2023-12-03T11:48:33.404 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.402+0000 7f7204f32800 20 remove_watcher() i=2 2023-12-03T11:48:33.404 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.403+0000 7f7204f32800 20 remove_watcher() i=3 2023-12-03T11:48:33.405 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.404+0000 7f7204f32800 20 remove_watcher() i=4 2023-12-03T11:48:33.406 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.405+0000 7f7204f32800 20 remove_watcher() i=5 2023-12-03T11:48:33.407 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.406+0000 7f7204f32800 20 remove_watcher() i=6 2023-12-03T11:48:33.408 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.407+0000 7f7204f32800 20 remove_watcher() i=7 2023-12-03T11:48:33.415 INFO:tasks.workunit.client.0.smithi003.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2023-12-03T11:48:33.443 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:48:33.443 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:48:33.458 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.456+0000 7fe78eb37800 20 rados->read ofs=0 len=0 2023-12-03T11:48:33.459 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.458+0000 7fe78eb37800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:33.459 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.458+0000 7fe78eb37800 20 realm 2023-12-03T11:48:33.460 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.458+0000 7fe78eb37800 20 rados->read ofs=0 len=0 2023-12-03T11:48:33.460 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.458+0000 7fe78eb37800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:33.460 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.458+0000 7fe78eb37800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:48:33.460 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.458+0000 7fe78eb37800 20 rados->read ofs=0 len=0 2023-12-03T11:48:33.460 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.458+0000 7fe78eb37800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:33.460 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.458+0000 7fe78eb37800 20 rados->read ofs=0 len=0 2023-12-03T11:48:33.460 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.459+0000 7fe78eb37800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:48:33.461 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.459+0000 7fe78eb37800 20 rados->read ofs=0 len=0 2023-12-03T11:48:33.461 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.459+0000 7fe78eb37800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:48:33.461 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.459+0000 7fe78eb37800 20 searching for the correct realm 2023-12-03T11:48:33.470 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.468+0000 7fe78a06e640 0 -- 172.21.15.3:0/3503378951 >> [v2:172.21.15.3:6817/3356208405,v1:172.21.15.3:6819/3356208405] conn(0x55b7b844d7d0 msgr2=0x55b7b844fbc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-03T11:48:33.472 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.471+0000 7fe78eb37800 20 RGWRados::pool_iterate: got zone_info.83aabb46-04b5-4c96-9933-c6bfb1173a73 2023-12-03T11:48:33.472 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.471+0000 7fe78eb37800 20 RGWRados::pool_iterate: got zonegroup_info.6a811aad-435d-4fdd-93c9-b7e0b50de429 2023-12-03T11:48:33.472 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.471+0000 7fe78eb37800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:48:33.473 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.471+0000 7fe78eb37800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:48:33.473 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.471+0000 7fe78eb37800 20 rados->read ofs=0 len=0 2023-12-03T11:48:33.473 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.471+0000 7fe78eb37800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:33.473 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.471+0000 7fe78eb37800 20 rados->read ofs=0 len=0 2023-12-03T11:48:33.473 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.471+0000 7fe78eb37800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:48:33.473 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.471+0000 7fe78eb37800 20 rados->read ofs=0 len=0 2023-12-03T11:48:33.474 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.471+0000 7fe78eb37800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:48:33.474 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.471+0000 7fe78eb37800 20 zone default found 2023-12-03T11:48:33.474 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.471+0000 7fe78eb37800 4 Realm: () 2023-12-03T11:48:33.474 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.471+0000 7fe78eb37800 4 ZoneGroup: default (6a811aad-435d-4fdd-93c9-b7e0b50de429) 2023-12-03T11:48:33.474 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.471+0000 7fe78eb37800 4 Zone: default (83aabb46-04b5-4c96-9933-c6bfb1173a73) 2023-12-03T11:48:33.474 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.471+0000 7fe78eb37800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:48:33.474 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.471+0000 7fe78eb37800 20 zonegroup default 2023-12-03T11:48:33.474 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.471+0000 7fe78eb37800 20 rados->read ofs=0 len=0 2023-12-03T11:48:33.474 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.472+0000 7fe78eb37800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:33.474 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.472+0000 7fe78eb37800 20 rados->read ofs=0 len=0 2023-12-03T11:48:33.474 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.472+0000 7fe78eb37800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:33.475 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.472+0000 7fe78eb37800 20 rados->read ofs=0 len=0 2023-12-03T11:48:33.475 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.472+0000 7fe78eb37800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:33.475 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.472+0000 7fe78eb37800 20 started sync module instance, tier type = 2023-12-03T11:48:33.475 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.472+0000 7fe78eb37800 20 started zone id=83aabb46-04b5-4c96-9933-c6bfb1173a73 (name=default) with tier type = 2023-12-03T11:48:33.478 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.477+0000 7fe78b070640 0 -- 172.21.15.3:0/3503378951 >> [v2:172.21.15.37:6817/511039327,v1:172.21.15.37:6819/511039327] conn(0x7fe780069020 msgr2=0x7fe780075920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:48:33.483 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.481+0000 7fe78eb37800 20 add_watcher() i=0 2023-12-03T11:48:33.483 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.481+0000 7fe78eb37800 20 add_watcher() i=1 2023-12-03T11:48:33.483 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.481+0000 7fe78eb37800 20 add_watcher() i=2 2023-12-03T11:48:33.483 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.481+0000 7fe78eb37800 20 add_watcher() i=3 2023-12-03T11:48:33.483 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.481+0000 7fe78eb37800 20 add_watcher() i=4 2023-12-03T11:48:33.483 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.481+0000 7fe78eb37800 20 add_watcher() i=5 2023-12-03T11:48:33.483 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.481+0000 7fe78eb37800 20 add_watcher() i=6 2023-12-03T11:48:33.484 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.482+0000 7fe78eb37800 20 add_watcher() i=7 2023-12-03T11:48:33.484 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.482+0000 7fe78eb37800 2 all 8 watchers are set, enabling cache 2023-12-03T11:48:33.485 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.484+0000 7fe6cbfff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:48:33.485 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.484+0000 7fe78eb37800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:48:33.485 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.484+0000 7fe78eb37800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:48:33.492 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.490+0000 7fe78eb37800 5 note: GC not initialized 2023-12-03T11:48:33.492 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.490+0000 7fe6c2ffd640 20 reqs_thread_entry: start 2023-12-03T11:48:33.492 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.491+0000 7fe78eb37800 20 init_complete bucket index max shards: 11 2023-12-03T11:48:33.492 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.491+0000 7fe78eb37800 20 Filter name: none 2023-12-03T11:48:33.492 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.491+0000 7fe6c0ff9640 20 reqs_thread_entry: start 2023-12-03T11:48:33.492 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.491+0000 7fe78eb37800 20 rados->read ofs=0 len=0 2023-12-03T11:48:33.493 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.491+0000 7fe78eb37800 20 rados_obj.operate() r=0 bl.length=213 2023-12-03T11:48:33.493 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.491+0000 7fe78eb37800 20 rados->read ofs=0 len=0 2023-12-03T11:48:33.493 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.492+0000 7fe78eb37800 20 rados_obj.operate() r=0 bl.length=385 2023-12-03T11:48:33.493 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.492+0000 7fe78eb37800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:48:33.494 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.492+0000 7fe78eb37800 20 rados->read ofs=0 len=0 2023-12-03T11:48:33.494 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.492+0000 7fe78eb37800 20 rados_obj.operate() r=0 bl.length=213 2023-12-03T11:48:33.494 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.492+0000 7fe78eb37800 20 rados->read ofs=0 len=0 2023-12-03T11:48:33.494 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.493+0000 7fe78eb37800 20 rados_obj.operate() r=0 bl.length=385 2023-12-03T11:48:33.494 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.493+0000 7fe78eb37800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:48:33.495 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.494+0000 7fe78eb37800 20 rados->read ofs=0 len=0 2023-12-03T11:48:33.495 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.494+0000 7fe78eb37800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:33.496 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.495+0000 7fe6cbfff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:48:33.498 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.497+0000 7fe78eb37800 20 remove_watcher() i=0 2023-12-03T11:48:33.498 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.497+0000 7fe78eb37800 2 removed watcher, disabling cache 2023-12-03T11:48:33.499 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.498+0000 7fe78eb37800 20 remove_watcher() i=1 2023-12-03T11:48:33.500 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.499+0000 7fe78eb37800 20 remove_watcher() i=2 2023-12-03T11:48:33.501 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.500+0000 7fe78eb37800 20 remove_watcher() i=3 2023-12-03T11:48:33.502 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.501+0000 7fe78eb37800 20 remove_watcher() i=4 2023-12-03T11:48:33.503 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.502+0000 7fe78eb37800 20 remove_watcher() i=5 2023-12-03T11:48:33.504 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.503+0000 7fe78eb37800 20 remove_watcher() i=6 2023-12-03T11:48:33.505 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:33.504+0000 7fe78eb37800 20 remove_watcher() i=7 2023-12-03T11:48:33.509 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:48:33.510 INFO:tasks.workunit.client.0.smithi003.stderr:BUCKET_STATS: 2023-12-03T11:48:33.510 INFO:tasks.workunit.client.0.smithi003.stderr:bucket: error-at-block-writes id: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.22 num_objects: 19 size_kb: 1 num_shards: 12 2023-12-03T11:48:33.510 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:48:33.824 INFO:tasks.workunit.client.0.smithi003.stderr:TEST: reshard bucket with abort at block_writes 2023-12-03T11:48:33.824 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:48:34.525 INFO:tasks.workunit.client.0.smithi003.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2023-12-03T11:48:34.552 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:48:34.552 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:48:34.566 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.565+0000 7f0da3b1f800 20 rados->read ofs=0 len=0 2023-12-03T11:48:34.568 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.567+0000 7f0da3b1f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:34.568 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.567+0000 7f0da3b1f800 20 realm 2023-12-03T11:48:34.568 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.567+0000 7f0da3b1f800 20 rados->read ofs=0 len=0 2023-12-03T11:48:34.569 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.567+0000 7f0da3b1f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:34.569 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.567+0000 7f0da3b1f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:48:34.569 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.567+0000 7f0da3b1f800 20 rados->read ofs=0 len=0 2023-12-03T11:48:34.569 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.567+0000 7f0da3b1f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:34.569 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.567+0000 7f0da3b1f800 20 rados->read ofs=0 len=0 2023-12-03T11:48:34.569 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.568+0000 7f0da3b1f800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:48:34.569 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.568+0000 7f0da3b1f800 20 rados->read ofs=0 len=0 2023-12-03T11:48:34.570 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.569+0000 7f0da3b1f800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:48:34.570 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.569+0000 7f0da3b1f800 20 searching for the correct realm 2023-12-03T11:48:34.579 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.578+0000 7f0d9f74d640 0 -- 172.21.15.3:0/3142585238 >> [v2:172.21.15.37:6805/1692844418,v1:172.21.15.37:6807/1692844418] conn(0x55f9e8ea75f0 msgr2=0x55f9e8ea99e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:48:34.581 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.580+0000 7f0da3b1f800 20 RGWRados::pool_iterate: got zone_info.83aabb46-04b5-4c96-9933-c6bfb1173a73 2023-12-03T11:48:34.581 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.580+0000 7f0da3b1f800 20 RGWRados::pool_iterate: got zonegroup_info.6a811aad-435d-4fdd-93c9-b7e0b50de429 2023-12-03T11:48:34.581 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.580+0000 7f0da3b1f800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:48:34.581 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.580+0000 7f0da3b1f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:48:34.582 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.580+0000 7f0da3b1f800 20 rados->read ofs=0 len=0 2023-12-03T11:48:34.582 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.580+0000 7f0da3b1f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:34.582 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.580+0000 7f0da3b1f800 20 rados->read ofs=0 len=0 2023-12-03T11:48:34.583 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.580+0000 7f0da3b1f800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:48:34.583 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.580+0000 7f0da3b1f800 20 rados->read ofs=0 len=0 2023-12-03T11:48:34.583 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.581+0000 7f0da3b1f800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:48:34.583 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.581+0000 7f0da3b1f800 20 zone default found 2023-12-03T11:48:34.583 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.581+0000 7f0da3b1f800 4 Realm: () 2023-12-03T11:48:34.583 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.581+0000 7f0da3b1f800 4 ZoneGroup: default (6a811aad-435d-4fdd-93c9-b7e0b50de429) 2023-12-03T11:48:34.583 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.581+0000 7f0da3b1f800 4 Zone: default (83aabb46-04b5-4c96-9933-c6bfb1173a73) 2023-12-03T11:48:34.584 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.581+0000 7f0da3b1f800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:48:34.584 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.581+0000 7f0da3b1f800 20 zonegroup default 2023-12-03T11:48:34.584 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.581+0000 7f0da3b1f800 20 rados->read ofs=0 len=0 2023-12-03T11:48:34.584 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.581+0000 7f0da3b1f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:34.584 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.581+0000 7f0da3b1f800 20 rados->read ofs=0 len=0 2023-12-03T11:48:34.584 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.581+0000 7f0da3b1f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:34.584 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.581+0000 7f0da3b1f800 20 rados->read ofs=0 len=0 2023-12-03T11:48:34.584 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.582+0000 7f0da3b1f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:34.584 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.582+0000 7f0da3b1f800 20 started sync module instance, tier type = 2023-12-03T11:48:34.584 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.582+0000 7f0da3b1f800 20 started zone id=83aabb46-04b5-4c96-9933-c6bfb1173a73 (name=default) with tier type = 2023-12-03T11:48:34.589 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.588+0000 7f0d9ef4c640 0 -- 172.21.15.3:0/3142585238 >> [v2:172.21.15.3:6817/3356208405,v1:172.21.15.3:6819/3356208405] conn(0x55f9e8eac200 msgr2=0x55f9e8eae630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:48:34.592 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.591+0000 7f0da3b1f800 20 add_watcher() i=0 2023-12-03T11:48:34.592 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.591+0000 7f0da3b1f800 20 add_watcher() i=1 2023-12-03T11:48:34.592 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.591+0000 7f0da3b1f800 20 add_watcher() i=2 2023-12-03T11:48:34.592 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.591+0000 7f0da3b1f800 20 add_watcher() i=3 2023-12-03T11:48:34.592 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.591+0000 7f0da3b1f800 20 add_watcher() i=4 2023-12-03T11:48:34.592 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.591+0000 7f0da3b1f800 20 add_watcher() i=5 2023-12-03T11:48:34.592 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.591+0000 7f0da3b1f800 20 add_watcher() i=6 2023-12-03T11:48:34.593 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.592+0000 7f0da3b1f800 20 add_watcher() i=7 2023-12-03T11:48:34.593 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.592+0000 7f0da3b1f800 2 all 8 watchers are set, enabling cache 2023-12-03T11:48:34.594 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.593+0000 7f0d657e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:48:34.595 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.593+0000 7f0da3b1f800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:48:34.595 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.593+0000 7f0da3b1f800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:48:34.601 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.599+0000 7f0da3b1f800 5 note: GC not initialized 2023-12-03T11:48:34.601 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.600+0000 7f0cd3fff640 20 reqs_thread_entry: start 2023-12-03T11:48:34.602 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.600+0000 7f0da3b1f800 20 init_complete bucket index max shards: 11 2023-12-03T11:48:34.602 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.600+0000 7f0da3b1f800 20 Filter name: none 2023-12-03T11:48:34.602 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.600+0000 7f0cd1ffb640 20 reqs_thread_entry: start 2023-12-03T11:48:34.602 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.600+0000 7f0da3b1f800 20 rados->read ofs=0 len=0 2023-12-03T11:48:34.602 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.601+0000 7f0da3b1f800 20 rados_obj.operate() r=0 bl.length=213 2023-12-03T11:48:34.602 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.601+0000 7f0da3b1f800 20 rados->read ofs=0 len=0 2023-12-03T11:48:34.603 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.601+0000 7f0da3b1f800 20 rados_obj.operate() r=0 bl.length=385 2023-12-03T11:48:34.603 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.601+0000 7f0da3b1f800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:48:34.603 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.601+0000 7f0da3b1f800 20 rados->read ofs=0 len=0 2023-12-03T11:48:34.603 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.602+0000 7f0da3b1f800 20 rados_obj.operate() r=0 bl.length=213 2023-12-03T11:48:34.603 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.602+0000 7f0da3b1f800 20 rados->read ofs=0 len=0 2023-12-03T11:48:34.604 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.602+0000 7f0da3b1f800 20 rados_obj.operate() r=0 bl.length=385 2023-12-03T11:48:34.604 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.602+0000 7f0da3b1f800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:48:34.604 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.603+0000 7f0da3b1f800 20 rados->read ofs=0 len=0 2023-12-03T11:48:34.604 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.603+0000 7f0da3b1f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:34.605 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.604+0000 7f0d657e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:48:34.607 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.606+0000 7f0da3b1f800 20 remove_watcher() i=0 2023-12-03T11:48:34.607 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.606+0000 7f0da3b1f800 2 removed watcher, disabling cache 2023-12-03T11:48:34.608 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.607+0000 7f0da3b1f800 20 remove_watcher() i=1 2023-12-03T11:48:34.609 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.608+0000 7f0da3b1f800 20 remove_watcher() i=2 2023-12-03T11:48:34.610 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.609+0000 7f0da3b1f800 20 remove_watcher() i=3 2023-12-03T11:48:34.611 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.610+0000 7f0da3b1f800 20 remove_watcher() i=4 2023-12-03T11:48:34.612 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.611+0000 7f0da3b1f800 20 remove_watcher() i=5 2023-12-03T11:48:34.613 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.612+0000 7f0da3b1f800 20 remove_watcher() i=6 2023-12-03T11:48:34.614 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.613+0000 7f0da3b1f800 20 remove_watcher() i=7 2023-12-03T11:48:34.619 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:48:34.619 INFO:tasks.workunit.client.0.smithi003.stderr:BUCKET_STATS: 2023-12-03T11:48:34.619 INFO:tasks.workunit.client.0.smithi003.stderr:bucket: abort-at-block-writes id: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.23 num_objects: 20 size_kb: 1 num_shards: 11 2023-12-03T11:48:34.619 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:48:34.621 INFO:tasks.workunit.client.0.smithi003.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at block_writes 2023-12-03T11:48:34.654 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:48:34.654 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:48:34.668 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.667+0000 7f3e68daf800 20 rados->read ofs=0 len=0 2023-12-03T11:48:34.670 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.669+0000 7f3e68daf800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:34.671 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.669+0000 7f3e68daf800 20 realm 2023-12-03T11:48:34.671 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.669+0000 7f3e68daf800 20 rados->read ofs=0 len=0 2023-12-03T11:48:34.671 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.669+0000 7f3e68daf800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:34.671 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.669+0000 7f3e68daf800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:48:34.671 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.669+0000 7f3e68daf800 20 rados->read ofs=0 len=0 2023-12-03T11:48:34.671 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.669+0000 7f3e68daf800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:34.671 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.669+0000 7f3e68daf800 20 rados->read ofs=0 len=0 2023-12-03T11:48:34.673 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.670+0000 7f3e68daf800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:48:34.673 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.670+0000 7f3e68daf800 20 rados->read ofs=0 len=0 2023-12-03T11:48:34.673 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.670+0000 7f3e68daf800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:48:34.673 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.670+0000 7f3e68daf800 20 searching for the correct realm 2023-12-03T11:48:34.681 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.680+0000 7f3e660ae640 0 -- 172.21.15.3:0/2313644263 >> [v2:172.21.15.3:6817/3356208405,v1:172.21.15.3:6819/3356208405] conn(0x5560f5bfd6d0 msgr2=0x5560f5bffac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:48:34.683 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.681+0000 7f3e68daf800 20 RGWRados::pool_iterate: got zone_info.83aabb46-04b5-4c96-9933-c6bfb1173a73 2023-12-03T11:48:34.683 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.681+0000 7f3e68daf800 20 RGWRados::pool_iterate: got zonegroup_info.6a811aad-435d-4fdd-93c9-b7e0b50de429 2023-12-03T11:48:34.683 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.681+0000 7f3e68daf800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:48:34.683 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.681+0000 7f3e68daf800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:48:34.683 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.681+0000 7f3e68daf800 20 rados->read ofs=0 len=0 2023-12-03T11:48:34.683 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.682+0000 7f3e68daf800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:34.683 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.682+0000 7f3e68daf800 20 rados->read ofs=0 len=0 2023-12-03T11:48:34.685 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.682+0000 7f3e68daf800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:48:34.685 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.682+0000 7f3e68daf800 20 rados->read ofs=0 len=0 2023-12-03T11:48:34.685 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.683+0000 7f3e68daf800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:48:34.685 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.683+0000 7f3e68daf800 20 zone default found 2023-12-03T11:48:34.685 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.683+0000 7f3e68daf800 4 Realm: () 2023-12-03T11:48:34.685 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.683+0000 7f3e68daf800 4 ZoneGroup: default (6a811aad-435d-4fdd-93c9-b7e0b50de429) 2023-12-03T11:48:34.685 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.683+0000 7f3e68daf800 4 Zone: default (83aabb46-04b5-4c96-9933-c6bfb1173a73) 2023-12-03T11:48:34.685 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.683+0000 7f3e68daf800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:48:34.685 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.683+0000 7f3e68daf800 20 zonegroup default 2023-12-03T11:48:34.685 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.683+0000 7f3e68daf800 20 rados->read ofs=0 len=0 2023-12-03T11:48:34.686 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.683+0000 7f3e68daf800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:34.686 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.683+0000 7f3e68daf800 20 rados->read ofs=0 len=0 2023-12-03T11:48:34.686 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.683+0000 7f3e68daf800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:34.686 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.683+0000 7f3e68daf800 20 rados->read ofs=0 len=0 2023-12-03T11:48:34.686 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.684+0000 7f3e68daf800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:34.686 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.684+0000 7f3e68daf800 20 started sync module instance, tier type = 2023-12-03T11:48:34.686 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.684+0000 7f3e68daf800 20 started zone id=83aabb46-04b5-4c96-9933-c6bfb1173a73 (name=default) with tier type = 2023-12-03T11:48:34.691 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.690+0000 7f3e668af640 0 -- 172.21.15.3:0/2313644263 >> [v2:172.21.15.3:6800/2373485412,v1:172.21.15.3:6801/2373485412] conn(0x7f3e60067070 msgr2=0x7f3e60075480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:48:34.695 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.694+0000 7f3e68daf800 20 add_watcher() i=0 2023-12-03T11:48:34.696 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.694+0000 7f3e68daf800 20 add_watcher() i=1 2023-12-03T11:48:34.696 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.694+0000 7f3e68daf800 20 add_watcher() i=2 2023-12-03T11:48:34.696 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.694+0000 7f3e68daf800 20 add_watcher() i=3 2023-12-03T11:48:34.696 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.694+0000 7f3e68daf800 20 add_watcher() i=4 2023-12-03T11:48:34.696 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.694+0000 7f3e68daf800 20 add_watcher() i=5 2023-12-03T11:48:34.696 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.694+0000 7f3e68daf800 20 add_watcher() i=6 2023-12-03T11:48:34.696 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.695+0000 7f3e68daf800 20 add_watcher() i=7 2023-12-03T11:48:34.697 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.695+0000 7f3e68daf800 2 all 8 watchers are set, enabling cache 2023-12-03T11:48:34.698 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.697+0000 7f3da7fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:48:34.698 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.697+0000 7f3e68daf800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:48:34.698 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.697+0000 7f3e68daf800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:48:34.706 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.703+0000 7f3e68daf800 5 note: GC not initialized 2023-12-03T11:48:34.707 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.703+0000 7f3d96ffd640 20 reqs_thread_entry: start 2023-12-03T11:48:34.707 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.703+0000 7f3e68daf800 20 init_complete bucket index max shards: 11 2023-12-03T11:48:34.707 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.703+0000 7f3e68daf800 20 Filter name: none 2023-12-03T11:48:34.707 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.703+0000 7f3d94ff9640 20 reqs_thread_entry: start 2023-12-03T11:48:34.707 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.703+0000 7f3e68daf800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2023-12-03T11:48:34.707 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.703+0000 7f3e68daf800 20 rados->read ofs=0 len=0 2023-12-03T11:48:34.707 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.704+0000 7f3e68daf800 20 rados_obj.operate() r=0 bl.length=213 2023-12-03T11:48:34.708 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.704+0000 7f3e68daf800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2023-12-03T11:48:34.708 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.704+0000 7f3e68daf800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2023-12-03T11:48:34.708 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.704+0000 7f3e68daf800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.23 : miss 2023-12-03T11:48:34.708 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.704+0000 7f3e68daf800 20 rados->read ofs=0 len=0 2023-12-03T11:48:34.708 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.704+0000 7f3e68daf800 20 rados_obj.operate() r=0 bl.length=385 2023-12-03T11:48:34.708 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.704+0000 7f3e68daf800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.23 info.flags=0x17 2023-12-03T11:48:34.708 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.704+0000 7f3e68daf800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.23 to cache LRU end 2023-12-03T11:48:34.708 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.704+0000 7f3e68daf800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:48:34.709 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.704+0000 7f3e68daf800 10 updating xattr: name=user.rgw.acl bl.length()=265 2023-12-03T11:48:34.709 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.704+0000 7f3e68daf800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.23 2023-12-03T11:48:34.711 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.710+0000 7f3e68daf800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.23 info.flags=0x17 2023-12-03T11:48:34.711 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.710+0000 7f3e68daf800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.23 to cache LRU end 2023-12-03T11:48:34.711 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.710+0000 7f3e68daf800 10 updating xattr: name=user.rgw.acl bl.length()=265 2023-12-03T11:48:34.711 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.710+0000 7f3e68daf800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.23, ofs0, ns] 2023-12-03T11:48:34.712 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.710+0000 7f3e4cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660508 cookie 93874928231680 notifier 6404 bl.length()=949 2023-12-03T11:48:34.712 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.710+0000 7f3e4cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.23 info.flags=0x17 2023-12-03T11:48:34.712 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.710+0000 7f3e4cff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.23 to cache LRU end 2023-12-03T11:48:34.712 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.710+0000 7f3e4cff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2023-12-03T11:48:34.714 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.711+0000 7f3e68daf800 20 handle_bi_update(): bucket=:abort-at-block-writes[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.23]): orig_sources= new_sources= 2023-12-03T11:48:34.714 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.711+0000 7f3e68daf800 20 handle_bi_update(): bucket=:abort-at-block-writes[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.23]): potential sources added=[] removed=[] 2023-12-03T11:48:34.714 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.711+0000 7f3e68daf800 20 handle_bi_update(): bucket=:abort-at-block-writes[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.23]): orig_dests= new_dests= 2023-12-03T11:48:34.714 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.711+0000 7f3e68daf800 20 handle_bi_update(): bucket=:abort-at-block-writes[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.23]): potential dests added=[] removed=[] 2023-12-03T11:48:34.714 INFO:tasks.workunit.client.0.smithi003.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7537-gbcbf278c/rpm/el9/BUILD/ceph-18.0.0-7537-gbcbf278c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f3e68daf800 time 2023-12-03T11:48:34.712941+0000 2023-12-03T11:48:34.714 INFO:tasks.workunit.client.0.smithi003.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7537-gbcbf278c/rpm/el9/BUILD/ceph-18.0.0-7537-gbcbf278c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2023-12-03T11:48:34.714 INFO:tasks.workunit.client.0.smithi003.stderr: ceph version 18.0.0-7537-gbcbf278c (bcbf278cf395873c2a482f5a7b2345faf2160319) reef (dev) 2023-12-03T11:48:34.715 INFO:tasks.workunit.client.0.smithi003.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f3e6d76eef8] 2023-12-03T11:48:34.715 INFO:tasks.workunit.client.0.smithi003.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f0b6) [0x7f3e6d76f0b6] 2023-12-03T11:48:34.715 INFO:tasks.workunit.client.0.smithi003.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5560f453fa71] 2023-12-03T11:48:34.715 INFO:tasks.workunit.client.0.smithi003.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x2a4) [0x5560f454bec4] 2023-12-03T11:48:34.715 INFO:tasks.workunit.client.0.smithi003.stderr: 5: main() 2023-12-03T11:48:34.715 INFO:tasks.workunit.client.0.smithi003.stderr: 6: /lib64/libc.so.6(+0x3feb0) [0x7f3e6b03feb0] 2023-12-03T11:48:34.715 INFO:tasks.workunit.client.0.smithi003.stderr: 7: __libc_start_main() 2023-12-03T11:48:34.715 INFO:tasks.workunit.client.0.smithi003.stderr: 8: _start() 2023-12-03T11:48:34.715 INFO:tasks.workunit.client.0.smithi003.stderr:*** Caught signal (Aborted) ** 2023-12-03T11:48:34.715 INFO:tasks.workunit.client.0.smithi003.stderr: in thread 7f3e68daf800 thread_name:radosgw-admin 2023-12-03T11:48:34.715 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.712+0000 7f3e68daf800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7537-gbcbf278c/rpm/el9/BUILD/ceph-18.0.0-7537-gbcbf278c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f3e68daf800 time 2023-12-03T11:48:34.712941+0000 2023-12-03T11:48:34.715 INFO:tasks.workunit.client.0.smithi003.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7537-gbcbf278c/rpm/el9/BUILD/ceph-18.0.0-7537-gbcbf278c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2023-12-03T11:48:34.716 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:48:34.716 INFO:tasks.workunit.client.0.smithi003.stderr: ceph version 18.0.0-7537-gbcbf278c (bcbf278cf395873c2a482f5a7b2345faf2160319) reef (dev) 2023-12-03T11:48:34.716 INFO:tasks.workunit.client.0.smithi003.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f3e6d76eef8] 2023-12-03T11:48:34.716 INFO:tasks.workunit.client.0.smithi003.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f0b6) [0x7f3e6d76f0b6] 2023-12-03T11:48:34.716 INFO:tasks.workunit.client.0.smithi003.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5560f453fa71] 2023-12-03T11:48:34.716 INFO:tasks.workunit.client.0.smithi003.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x2a4) [0x5560f454bec4] 2023-12-03T11:48:34.716 INFO:tasks.workunit.client.0.smithi003.stderr: 5: main() 2023-12-03T11:48:34.716 INFO:tasks.workunit.client.0.smithi003.stderr: 6: /lib64/libc.so.6(+0x3feb0) [0x7f3e6b03feb0] 2023-12-03T11:48:34.716 INFO:tasks.workunit.client.0.smithi003.stderr: 7: __libc_start_main() 2023-12-03T11:48:34.716 INFO:tasks.workunit.client.0.smithi003.stderr: 8: _start() 2023-12-03T11:48:34.716 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:48:34.743 INFO:tasks.workunit.client.0.smithi003.stderr: ceph version 18.0.0-7537-gbcbf278c (bcbf278cf395873c2a482f5a7b2345faf2160319) reef (dev) 2023-12-03T11:48:34.744 INFO:tasks.workunit.client.0.smithi003.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f3e6b054db0] 2023-12-03T11:48:34.744 INFO:tasks.workunit.client.0.smithi003.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f3e6b0a154c] 2023-12-03T11:48:34.744 INFO:tasks.workunit.client.0.smithi003.stderr: 3: raise() 2023-12-03T11:48:34.744 INFO:tasks.workunit.client.0.smithi003.stderr: 4: abort() 2023-12-03T11:48:34.744 INFO:tasks.workunit.client.0.smithi003.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f3e6d76ef52] 2023-12-03T11:48:34.744 INFO:tasks.workunit.client.0.smithi003.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f0b6) [0x7f3e6d76f0b6] 2023-12-03T11:48:34.744 INFO:tasks.workunit.client.0.smithi003.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5560f453fa71] 2023-12-03T11:48:34.745 INFO:tasks.workunit.client.0.smithi003.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x2a4) [0x5560f454bec4] 2023-12-03T11:48:34.745 INFO:tasks.workunit.client.0.smithi003.stderr: 9: main() 2023-12-03T11:48:34.745 INFO:tasks.workunit.client.0.smithi003.stderr: 10: /lib64/libc.so.6(+0x3feb0) [0x7f3e6b03feb0] 2023-12-03T11:48:34.745 INFO:tasks.workunit.client.0.smithi003.stderr: 11: __libc_start_main() 2023-12-03T11:48:34.745 INFO:tasks.workunit.client.0.smithi003.stderr: 12: _start() 2023-12-03T11:48:34.745 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.713+0000 7f3e68daf800 -1 *** Caught signal (Aborted) ** 2023-12-03T11:48:34.745 INFO:tasks.workunit.client.0.smithi003.stderr: in thread 7f3e68daf800 thread_name:radosgw-admin 2023-12-03T11:48:34.745 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:48:34.746 INFO:tasks.workunit.client.0.smithi003.stderr: ceph version 18.0.0-7537-gbcbf278c (bcbf278cf395873c2a482f5a7b2345faf2160319) reef (dev) 2023-12-03T11:48:34.746 INFO:tasks.workunit.client.0.smithi003.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f3e6b054db0] 2023-12-03T11:48:34.746 INFO:tasks.workunit.client.0.smithi003.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f3e6b0a154c] 2023-12-03T11:48:34.746 INFO:tasks.workunit.client.0.smithi003.stderr: 3: raise() 2023-12-03T11:48:34.746 INFO:tasks.workunit.client.0.smithi003.stderr: 4: abort() 2023-12-03T11:48:34.746 INFO:tasks.workunit.client.0.smithi003.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f3e6d76ef52] 2023-12-03T11:48:34.747 INFO:tasks.workunit.client.0.smithi003.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f0b6) [0x7f3e6d76f0b6] 2023-12-03T11:48:34.747 INFO:tasks.workunit.client.0.smithi003.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5560f453fa71] 2023-12-03T11:48:34.747 INFO:tasks.workunit.client.0.smithi003.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x2a4) [0x5560f454bec4] 2023-12-03T11:48:34.747 INFO:tasks.workunit.client.0.smithi003.stderr: 9: main() 2023-12-03T11:48:34.747 INFO:tasks.workunit.client.0.smithi003.stderr: 10: /lib64/libc.so.6(+0x3feb0) [0x7f3e6b03feb0] 2023-12-03T11:48:34.747 INFO:tasks.workunit.client.0.smithi003.stderr: 11: __libc_start_main() 2023-12-03T11:48:34.747 INFO:tasks.workunit.client.0.smithi003.stderr: 12: _start() 2023-12-03T11:48:34.747 INFO:tasks.workunit.client.0.smithi003.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-12-03T11:48:34.748 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:48:34.748 INFO:tasks.workunit.client.0.smithi003.stderr:--- begin dump of recent events --- 2023-12-03T11:48:34.748 INFO:tasks.workunit.client.0.smithi003.stderr: -499> 2023-12-03T11:48:34.662+0000 7f3e68daf800 10 monclient: _renew_subs 2023-12-03T11:48:34.748 INFO:tasks.workunit.client.0.smithi003.stderr: -498> 2023-12-03T11:48:34.662+0000 7f3e68daf800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.3:3300/0 2023-12-03T11:48:34.748 INFO:tasks.workunit.client.0.smithi003.stderr: -497> 2023-12-03T11:48:34.662+0000 7f3e68daf800 1 librados: init done 2023-12-03T11:48:34.748 INFO:tasks.workunit.client.0.smithi003.stderr: -496> 2023-12-03T11:48:34.662+0000 7f3e68daf800 10 monclient: get_monmap_and_config 2023-12-03T11:48:34.748 INFO:tasks.workunit.client.0.smithi003.stderr: -495> 2023-12-03T11:48:34.662+0000 7f3e68daf800 10 monclient: build_initial_monmap 2023-12-03T11:48:34.748 INFO:tasks.workunit.client.0.smithi003.stderr: -494> 2023-12-03T11:48:34.662+0000 7f3e68daf800 1 build_initial for_mkfs: 0 2023-12-03T11:48:34.749 INFO:tasks.workunit.client.0.smithi003.stderr: -493> 2023-12-03T11:48:34.662+0000 7f3e68daf800 10 monclient: monmap: 2023-12-03T11:48:34.749 INFO:tasks.workunit.client.0.smithi003.stderr:epoch 0 2023-12-03T11:48:34.749 INFO:tasks.workunit.client.0.smithi003.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-12-03T11:48:34.749 INFO:tasks.workunit.client.0.smithi003.stderr:last_changed 0.000000 2023-12-03T11:48:34.749 INFO:tasks.workunit.client.0.smithi003.stderr:created 0.000000 2023-12-03T11:48:34.749 INFO:tasks.workunit.client.0.smithi003.stderr:min_mon_release 0 (unknown) 2023-12-03T11:48:34.749 INFO:tasks.workunit.client.0.smithi003.stderr:election_strategy: 1 2023-12-03T11:48:34.749 INFO:tasks.workunit.client.0.smithi003.stderr:0: [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] mon.noname-a 2023-12-03T11:48:34.750 INFO:tasks.workunit.client.0.smithi003.stderr:1: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.noname-b 2023-12-03T11:48:34.750 INFO:tasks.workunit.client.0.smithi003.stderr:2: [v2:172.21.15.3:3301/0,v1:172.21.15.3:6790/0] mon.noname-c 2023-12-03T11:48:34.750 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:48:34.750 INFO:tasks.workunit.client.0.smithi003.stderr: -492> 2023-12-03T11:48:34.662+0000 7f3e68daf800 5 AuthRegistry(0x5560f5ba7a10) adding auth protocol: cephx 2023-12-03T11:48:34.750 INFO:tasks.workunit.client.0.smithi003.stderr: -491> 2023-12-03T11:48:34.662+0000 7f3e68daf800 5 AuthRegistry(0x5560f5ba7a10) adding auth protocol: cephx 2023-12-03T11:48:34.750 INFO:tasks.workunit.client.0.smithi003.stderr: -490> 2023-12-03T11:48:34.662+0000 7f3e68daf800 5 AuthRegistry(0x5560f5ba7a10) adding auth protocol: cephx 2023-12-03T11:48:34.750 INFO:tasks.workunit.client.0.smithi003.stderr: -489> 2023-12-03T11:48:34.662+0000 7f3e68daf800 5 AuthRegistry(0x5560f5ba7a10) adding con mode: secure 2023-12-03T11:48:34.751 INFO:tasks.workunit.client.0.smithi003.stderr: -488> 2023-12-03T11:48:34.662+0000 7f3e68daf800 5 AuthRegistry(0x5560f5ba7a10) adding con mode: crc 2023-12-03T11:48:34.751 INFO:tasks.workunit.client.0.smithi003.stderr: -487> 2023-12-03T11:48:34.662+0000 7f3e68daf800 5 AuthRegistry(0x5560f5ba7a10) adding con mode: secure 2023-12-03T11:48:34.751 INFO:tasks.workunit.client.0.smithi003.stderr: -486> 2023-12-03T11:48:34.662+0000 7f3e68daf800 5 AuthRegistry(0x5560f5ba7a10) adding con mode: crc 2023-12-03T11:48:34.751 INFO:tasks.workunit.client.0.smithi003.stderr: -485> 2023-12-03T11:48:34.662+0000 7f3e68daf800 5 AuthRegistry(0x5560f5ba7a10) adding con mode: secure 2023-12-03T11:48:34.751 INFO:tasks.workunit.client.0.smithi003.stderr: -484> 2023-12-03T11:48:34.662+0000 7f3e68daf800 5 AuthRegistry(0x5560f5ba7a10) adding con mode: crc 2023-12-03T11:48:34.751 INFO:tasks.workunit.client.0.smithi003.stderr: -483> 2023-12-03T11:48:34.662+0000 7f3e68daf800 5 AuthRegistry(0x5560f5ba7a10) adding con mode: crc 2023-12-03T11:48:34.751 INFO:tasks.workunit.client.0.smithi003.stderr: -482> 2023-12-03T11:48:34.662+0000 7f3e68daf800 5 AuthRegistry(0x5560f5ba7a10) adding con mode: secure 2023-12-03T11:48:34.751 INFO:tasks.workunit.client.0.smithi003.stderr: -481> 2023-12-03T11:48:34.662+0000 7f3e68daf800 5 AuthRegistry(0x5560f5ba7a10) adding con mode: crc 2023-12-03T11:48:34.751 INFO:tasks.workunit.client.0.smithi003.stderr: -480> 2023-12-03T11:48:34.662+0000 7f3e68daf800 5 AuthRegistry(0x5560f5ba7a10) adding con mode: secure 2023-12-03T11:48:34.752 INFO:tasks.workunit.client.0.smithi003.stderr: -479> 2023-12-03T11:48:34.662+0000 7f3e68daf800 5 AuthRegistry(0x5560f5ba7a10) adding con mode: crc 2023-12-03T11:48:34.752 INFO:tasks.workunit.client.0.smithi003.stderr: -478> 2023-12-03T11:48:34.662+0000 7f3e68daf800 5 AuthRegistry(0x5560f5ba7a10) adding con mode: secure 2023-12-03T11:48:34.752 INFO:tasks.workunit.client.0.smithi003.stderr: -477> 2023-12-03T11:48:34.662+0000 7f3e68daf800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:48:34.752 INFO:tasks.workunit.client.0.smithi003.stderr: -476> 2023-12-03T11:48:34.662+0000 7f3e68daf800 10 monclient: init 2023-12-03T11:48:34.752 INFO:tasks.workunit.client.0.smithi003.stderr: -475> 2023-12-03T11:48:34.663+0000 7f3e68daf800 5 AuthRegistry(0x7fff3da1fa20) adding auth protocol: cephx 2023-12-03T11:48:34.752 INFO:tasks.workunit.client.0.smithi003.stderr: -474> 2023-12-03T11:48:34.663+0000 7f3e68daf800 5 AuthRegistry(0x7fff3da1fa20) adding auth protocol: cephx 2023-12-03T11:48:34.752 INFO:tasks.workunit.client.0.smithi003.stderr: -473> 2023-12-03T11:48:34.663+0000 7f3e68daf800 5 AuthRegistry(0x7fff3da1fa20) adding auth protocol: cephx 2023-12-03T11:48:34.752 INFO:tasks.workunit.client.0.smithi003.stderr: -472> 2023-12-03T11:48:34.663+0000 7f3e68daf800 5 AuthRegistry(0x7fff3da1fa20) adding con mode: secure 2023-12-03T11:48:34.753 INFO:tasks.workunit.client.0.smithi003.stderr: -471> 2023-12-03T11:48:34.663+0000 7f3e68daf800 5 AuthRegistry(0x7fff3da1fa20) adding con mode: crc 2023-12-03T11:48:34.753 INFO:tasks.workunit.client.0.smithi003.stderr: -470> 2023-12-03T11:48:34.663+0000 7f3e68daf800 5 AuthRegistry(0x7fff3da1fa20) adding con mode: secure 2023-12-03T11:48:34.753 INFO:tasks.workunit.client.0.smithi003.stderr: -469> 2023-12-03T11:48:34.663+0000 7f3e68daf800 5 AuthRegistry(0x7fff3da1fa20) adding con mode: crc 2023-12-03T11:48:34.753 INFO:tasks.workunit.client.0.smithi003.stderr: -468> 2023-12-03T11:48:34.663+0000 7f3e68daf800 5 AuthRegistry(0x7fff3da1fa20) adding con mode: secure 2023-12-03T11:48:34.753 INFO:tasks.workunit.client.0.smithi003.stderr: -467> 2023-12-03T11:48:34.663+0000 7f3e68daf800 5 AuthRegistry(0x7fff3da1fa20) adding con mode: crc 2023-12-03T11:48:34.753 INFO:tasks.workunit.client.0.smithi003.stderr: -466> 2023-12-03T11:48:34.663+0000 7f3e68daf800 5 AuthRegistry(0x7fff3da1fa20) adding con mode: crc 2023-12-03T11:48:34.753 INFO:tasks.workunit.client.0.smithi003.stderr: -465> 2023-12-03T11:48:34.663+0000 7f3e68daf800 5 AuthRegistry(0x7fff3da1fa20) adding con mode: secure 2023-12-03T11:48:34.753 INFO:tasks.workunit.client.0.smithi003.stderr: -464> 2023-12-03T11:48:34.663+0000 7f3e68daf800 5 AuthRegistry(0x7fff3da1fa20) adding con mode: crc 2023-12-03T11:48:34.754 INFO:tasks.workunit.client.0.smithi003.stderr: -463> 2023-12-03T11:48:34.663+0000 7f3e68daf800 5 AuthRegistry(0x7fff3da1fa20) adding con mode: secure 2023-12-03T11:48:34.754 INFO:tasks.workunit.client.0.smithi003.stderr: -462> 2023-12-03T11:48:34.663+0000 7f3e68daf800 5 AuthRegistry(0x7fff3da1fa20) adding con mode: crc 2023-12-03T11:48:34.754 INFO:tasks.workunit.client.0.smithi003.stderr: -461> 2023-12-03T11:48:34.663+0000 7f3e68daf800 5 AuthRegistry(0x7fff3da1fa20) adding con mode: secure 2023-12-03T11:48:34.754 INFO:tasks.workunit.client.0.smithi003.stderr: -460> 2023-12-03T11:48:34.663+0000 7f3e68daf800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:48:34.754 INFO:tasks.workunit.client.0.smithi003.stderr: -459> 2023-12-03T11:48:34.663+0000 7f3e68daf800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:48:34.754 INFO:tasks.workunit.client.0.smithi003.stderr: -458> 2023-12-03T11:48:34.663+0000 7f3e68daf800 5 asok(0x5560f599ca10) register_command rotate-key cmddesc rotate-key hook 0x7fff3da1fb68 EEXIST 2023-12-03T11:48:34.754 INFO:tasks.workunit.client.0.smithi003.stderr: -457> 2023-12-03T11:48:34.663+0000 7f3e68daf800 10 monclient: _reopen_session rank -1 2023-12-03T11:48:34.754 INFO:tasks.workunit.client.0.smithi003.stderr: -456> 2023-12-03T11:48:34.663+0000 7f3e68daf800 10 monclient: _add_conns ranks=[1,0,2] 2023-12-03T11:48:34.754 INFO:tasks.workunit.client.0.smithi003.stderr: -455> 2023-12-03T11:48:34.663+0000 7f3e68daf800 10 monclient(hunting): picked mon.noname-b con 0x5560f5bd6660 addr [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] 2023-12-03T11:48:34.755 INFO:tasks.workunit.client.0.smithi003.stderr: -454> 2023-12-03T11:48:34.663+0000 7f3e68daf800 10 monclient(hunting): picked mon.noname-a con 0x5560f5bd6a40 addr [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] 2023-12-03T11:48:34.755 INFO:tasks.workunit.client.0.smithi003.stderr: -453> 2023-12-03T11:48:34.663+0000 7f3e68daf800 10 monclient(hunting): picked mon.noname-c con 0x5560f5be1260 addr [v2:172.21.15.3:3301/0,v1:172.21.15.3:6790/0] 2023-12-03T11:48:34.755 INFO:tasks.workunit.client.0.smithi003.stderr: -452> 2023-12-03T11:48:34.663+0000 7f3e68daf800 10 monclient(hunting): start opening mon connection 2023-12-03T11:48:34.755 INFO:tasks.workunit.client.0.smithi003.stderr: -451> 2023-12-03T11:48:34.663+0000 7f3e68daf800 10 monclient(hunting): start opening mon connection 2023-12-03T11:48:34.755 INFO:tasks.workunit.client.0.smithi003.stderr: -450> 2023-12-03T11:48:34.663+0000 7f3e68daf800 10 monclient(hunting): start opening mon connection 2023-12-03T11:48:34.755 INFO:tasks.workunit.client.0.smithi003.stderr: -449> 2023-12-03T11:48:34.663+0000 7f3e68daf800 10 monclient(hunting): _renew_subs 2023-12-03T11:48:34.755 INFO:tasks.workunit.client.0.smithi003.stderr: -448> 2023-12-03T11:48:34.663+0000 7f3e68daf800 10 monclient(hunting): authenticate will time out at 1736.901816s 2023-12-03T11:48:34.755 INFO:tasks.workunit.client.0.smithi003.stderr: -447> 2023-12-03T11:48:34.663+0000 7f3e660ae640 10 monclient(hunting): get_auth_request con 0x5560f5be1260 auth_method 0 2023-12-03T11:48:34.755 INFO:tasks.workunit.client.0.smithi003.stderr: -446> 2023-12-03T11:48:34.663+0000 7f3e660ae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:48:34.755 INFO:tasks.workunit.client.0.smithi003.stderr: -445> 2023-12-03T11:48:34.663+0000 7f3e660ae640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:48:34.755 INFO:tasks.workunit.client.0.smithi003.stderr: -444> 2023-12-03T11:48:34.663+0000 7f3e660ae640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:48:34.755 INFO:tasks.workunit.client.0.smithi003.stderr: -443> 2023-12-03T11:48:34.663+0000 7f3e668af640 10 monclient(hunting): get_auth_request con 0x5560f5bd6a40 auth_method 0 2023-12-03T11:48:34.755 INFO:tasks.workunit.client.0.smithi003.stderr: -442> 2023-12-03T11:48:34.663+0000 7f3e668af640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:48:34.755 INFO:tasks.workunit.client.0.smithi003.stderr: -441> 2023-12-03T11:48:34.663+0000 7f3e668af640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:48:34.756 INFO:tasks.workunit.client.0.smithi003.stderr: -440> 2023-12-03T11:48:34.663+0000 7f3e668af640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:48:34.756 INFO:tasks.workunit.client.0.smithi003.stderr: -439> 2023-12-03T11:48:34.663+0000 7f3e670b0640 10 monclient(hunting): get_auth_request con 0x5560f5bd6660 auth_method 0 2023-12-03T11:48:34.756 INFO:tasks.workunit.client.0.smithi003.stderr: -438> 2023-12-03T11:48:34.663+0000 7f3e670b0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:48:34.756 INFO:tasks.workunit.client.0.smithi003.stderr: -437> 2023-12-03T11:48:34.663+0000 7f3e670b0640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:48:34.756 INFO:tasks.workunit.client.0.smithi003.stderr: -436> 2023-12-03T11:48:34.663+0000 7f3e670b0640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:48:34.756 INFO:tasks.workunit.client.0.smithi003.stderr: -435> 2023-12-03T11:48:34.663+0000 7f3e660ae640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:48:34.756 INFO:tasks.workunit.client.0.smithi003.stderr: -434> 2023-12-03T11:48:34.663+0000 7f3e660ae640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:48:34.756 INFO:tasks.workunit.client.0.smithi003.stderr: -433> 2023-12-03T11:48:34.663+0000 7f3e660ae640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:48:34.756 INFO:tasks.workunit.client.0.smithi003.stderr: -432> 2023-12-03T11:48:34.663+0000 7f3e668af640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:48:34.756 INFO:tasks.workunit.client.0.smithi003.stderr: -431> 2023-12-03T11:48:34.663+0000 7f3e668af640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:48:34.756 INFO:tasks.workunit.client.0.smithi003.stderr: -430> 2023-12-03T11:48:34.663+0000 7f3e668af640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:48:34.756 INFO:tasks.workunit.client.0.smithi003.stderr: -429> 2023-12-03T11:48:34.663+0000 7f3e670b0640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:48:34.756 INFO:tasks.workunit.client.0.smithi003.stderr: -428> 2023-12-03T11:48:34.663+0000 7f3e670b0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:48:34.756 INFO:tasks.workunit.client.0.smithi003.stderr: -427> 2023-12-03T11:48:34.663+0000 7f3e670b0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:48:34.756 INFO:tasks.workunit.client.0.smithi003.stderr: -426> 2023-12-03T11:48:34.663+0000 7f3e660ae640 10 monclient(hunting): handle_auth_done global_id 6401 payload 274 2023-12-03T11:48:34.757 INFO:tasks.workunit.client.0.smithi003.stderr: -425> 2023-12-03T11:48:34.663+0000 7f3e660ae640 10 monclient: _finish_hunting 0 2023-12-03T11:48:34.757 INFO:tasks.workunit.client.0.smithi003.stderr: -424> 2023-12-03T11:48:34.663+0000 7f3e660ae640 1 monclient: found mon.noname-c 2023-12-03T11:48:34.757 INFO:tasks.workunit.client.0.smithi003.stderr: -423> 2023-12-03T11:48:34.663+0000 7f3e660ae640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.3:3301/0 2023-12-03T11:48:34.757 INFO:tasks.workunit.client.0.smithi003.stderr: -422> 2023-12-03T11:48:34.663+0000 7f3e4ffff640 4 mgrc handle_mgr_map Got map version 5 2023-12-03T11:48:34.757 INFO:tasks.workunit.client.0.smithi003.stderr: -421> 2023-12-03T11:48:34.663+0000 7f3e4ffff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.37:6832/2165065416,v1:172.21.15.37:6833/2165065416] 2023-12-03T11:48:34.757 INFO:tasks.workunit.client.0.smithi003.stderr: -420> 2023-12-03T11:48:34.663+0000 7f3e4ffff640 4 mgrc reconnect Starting new session with [v2:172.21.15.37:6832/2165065416,v1:172.21.15.37:6833/2165065416] 2023-12-03T11:48:34.757 INFO:tasks.workunit.client.0.smithi003.stderr: -419> 2023-12-03T11:48:34.664+0000 7f3e670b0640 10 monclient: get_auth_request con 0x7f3e54069820 auth_method 0 2023-12-03T11:48:34.757 INFO:tasks.workunit.client.0.smithi003.stderr: -418> 2023-12-03T11:48:34.664+0000 7f3e4d7fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:48:34.757 INFO:tasks.workunit.client.0.smithi003.stderr: -417> 2023-12-03T11:48:34.664+0000 7f3e4d7fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-12-03T11:48:34.757 INFO:tasks.workunit.client.0.smithi003.stderr: -416> 2023-12-03T11:48:34.664+0000 7f3e4d7fa640 10 monclient: dump: 2023-12-03T11:48:34.757 INFO:tasks.workunit.client.0.smithi003.stderr:epoch 1 2023-12-03T11:48:34.757 INFO:tasks.workunit.client.0.smithi003.stderr:fsid 296556de-a4fc-4095-9b6d-0fe813c2865c 2023-12-03T11:48:34.757 INFO:tasks.workunit.client.0.smithi003.stderr:last_changed 2023-12-03T11:33:18.862564+0000 2023-12-03T11:48:34.757 INFO:tasks.workunit.client.0.smithi003.stderr:created 2023-12-03T11:33:18.862564+0000 2023-12-03T11:48:34.757 INFO:tasks.workunit.client.0.smithi003.stderr:min_mon_release 18 (reef) 2023-12-03T11:48:34.758 INFO:tasks.workunit.client.0.smithi003.stderr:election_strategy: 1 2023-12-03T11:48:34.758 INFO:tasks.workunit.client.0.smithi003.stderr:0: [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] mon.a 2023-12-03T11:48:34.758 INFO:tasks.workunit.client.0.smithi003.stderr:1: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.b 2023-12-03T11:48:34.758 INFO:tasks.workunit.client.0.smithi003.stderr:2: [v2:172.21.15.3:3301/0,v1:172.21.15.3:6790/0] mon.c 2023-12-03T11:48:34.758 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:48:34.758 INFO:tasks.workunit.client.0.smithi003.stderr: -415> 2023-12-03T11:48:34.664+0000 7f3e4d7fa640 10 monclient: _finish_auth 0 2023-12-03T11:48:34.758 INFO:tasks.workunit.client.0.smithi003.stderr: -414> 2023-12-03T11:48:34.664+0000 7f3e4d7fa640 10 monclient: _check_auth_tickets 2023-12-03T11:48:34.758 INFO:tasks.workunit.client.0.smithi003.stderr: -413> 2023-12-03T11:48:34.664+0000 7f3e4d7fa640 10 monclient: handle_config config(0 keys) v1 2023-12-03T11:48:34.758 INFO:tasks.workunit.client.0.smithi003.stderr: -412> 2023-12-03T11:48:34.664+0000 7f3e4d7fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:48:34.758 INFO:tasks.workunit.client.0.smithi003.stderr: -411> 2023-12-03T11:48:34.664+0000 7f3e4d7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-12-03T11:48:34.758 INFO:tasks.workunit.client.0.smithi003.stderr: -410> 2023-12-03T11:48:34.664+0000 7f3e4d7fa640 10 monclient: dump: 2023-12-03T11:48:34.758 INFO:tasks.workunit.client.0.smithi003.stderr:epoch 1 2023-12-03T11:48:34.758 INFO:tasks.workunit.client.0.smithi003.stderr:fsid 296556de-a4fc-4095-9b6d-0fe813c2865c 2023-12-03T11:48:34.758 INFO:tasks.workunit.client.0.smithi003.stderr:last_changed 2023-12-03T11:33:18.862564+0000 2023-12-03T11:48:34.759 INFO:tasks.workunit.client.0.smithi003.stderr:created 2023-12-03T11:33:18.862564+0000 2023-12-03T11:48:34.759 INFO:tasks.workunit.client.0.smithi003.stderr:min_mon_release 18 (reef) 2023-12-03T11:48:34.759 INFO:tasks.workunit.client.0.smithi003.stderr:election_strategy: 1 2023-12-03T11:48:34.759 INFO:tasks.workunit.client.0.smithi003.stderr:0: [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] mon.a 2023-12-03T11:48:34.759 INFO:tasks.workunit.client.0.smithi003.stderr:1: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.b 2023-12-03T11:48:34.759 INFO:tasks.workunit.client.0.smithi003.stderr:2: [v2:172.21.15.3:3301/0,v1:172.21.15.3:6790/0] mon.c 2023-12-03T11:48:34.759 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:48:34.759 INFO:tasks.workunit.client.0.smithi003.stderr: -409> 2023-12-03T11:48:34.664+0000 7f3e68daf800 5 monclient: authenticate success, global_id 6401 2023-12-03T11:48:34.759 INFO:tasks.workunit.client.0.smithi003.stderr: -408> 2023-12-03T11:48:34.664+0000 7f3e68daf800 10 monclient: get_monmap_and_config success 2023-12-03T11:48:34.759 INFO:tasks.workunit.client.0.smithi003.stderr: -407> 2023-12-03T11:48:34.664+0000 7f3e68daf800 4 set_mon_vals no callback set 2023-12-03T11:48:34.759 INFO:tasks.workunit.client.0.smithi003.stderr: -406> 2023-12-03T11:48:34.664+0000 7f3e68daf800 10 monclient: shutdown 2023-12-03T11:48:34.759 INFO:tasks.workunit.client.0.smithi003.stderr: -405> 2023-12-03T11:48:34.664+0000 7f3e68daf800 10 monclient: build_initial_monmap 2023-12-03T11:48:34.759 INFO:tasks.workunit.client.0.smithi003.stderr: -404> 2023-12-03T11:48:34.664+0000 7f3e68daf800 1 build_initial for_mkfs: 0 2023-12-03T11:48:34.759 INFO:tasks.workunit.client.0.smithi003.stderr: -403> 2023-12-03T11:48:34.664+0000 7f3e68daf800 10 monclient: monmap: 2023-12-03T11:48:34.759 INFO:tasks.workunit.client.0.smithi003.stderr:epoch 0 2023-12-03T11:48:34.760 INFO:tasks.workunit.client.0.smithi003.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-12-03T11:48:34.760 INFO:tasks.workunit.client.0.smithi003.stderr:last_changed 0.000000 2023-12-03T11:48:34.760 INFO:tasks.workunit.client.0.smithi003.stderr:created 0.000000 2023-12-03T11:48:34.760 INFO:tasks.workunit.client.0.smithi003.stderr:min_mon_release 0 (unknown) 2023-12-03T11:48:34.760 INFO:tasks.workunit.client.0.smithi003.stderr:election_strategy: 1 2023-12-03T11:48:34.760 INFO:tasks.workunit.client.0.smithi003.stderr:0: [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] mon.noname-a 2023-12-03T11:48:34.760 INFO:tasks.workunit.client.0.smithi003.stderr:1: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.noname-b 2023-12-03T11:48:34.760 INFO:tasks.workunit.client.0.smithi003.stderr:2: [v2:172.21.15.3:3301/0,v1:172.21.15.3:6790/0] mon.noname-c 2023-12-03T11:48:34.760 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:48:34.760 INFO:tasks.workunit.client.0.smithi003.stderr: -402> 2023-12-03T11:48:34.664+0000 7f3e68daf800 5 AuthRegistry(0x5560f5ba78e0) adding auth protocol: cephx 2023-12-03T11:48:34.760 INFO:tasks.workunit.client.0.smithi003.stderr: -401> 2023-12-03T11:48:34.664+0000 7f3e68daf800 5 AuthRegistry(0x5560f5ba78e0) adding auth protocol: cephx 2023-12-03T11:48:34.760 INFO:tasks.workunit.client.0.smithi003.stderr: -400> 2023-12-03T11:48:34.664+0000 7f3e68daf800 5 AuthRegistry(0x5560f5ba78e0) adding auth protocol: cephx 2023-12-03T11:48:34.760 INFO:tasks.workunit.client.0.smithi003.stderr: -399> 2023-12-03T11:48:34.664+0000 7f3e68daf800 5 AuthRegistry(0x5560f5ba78e0) adding con mode: secure 2023-12-03T11:48:34.760 INFO:tasks.workunit.client.0.smithi003.stderr: -398> 2023-12-03T11:48:34.664+0000 7f3e68daf800 5 AuthRegistry(0x5560f5ba78e0) adding con mode: crc 2023-12-03T11:48:34.760 INFO:tasks.workunit.client.0.smithi003.stderr: -397> 2023-12-03T11:48:34.664+0000 7f3e68daf800 5 AuthRegistry(0x5560f5ba78e0) adding con mode: secure 2023-12-03T11:48:34.761 INFO:tasks.workunit.client.0.smithi003.stderr: -396> 2023-12-03T11:48:34.664+0000 7f3e68daf800 5 AuthRegistry(0x5560f5ba78e0) adding con mode: crc 2023-12-03T11:48:34.761 INFO:tasks.workunit.client.0.smithi003.stderr: -395> 2023-12-03T11:48:34.664+0000 7f3e68daf800 5 AuthRegistry(0x5560f5ba78e0) adding con mode: secure 2023-12-03T11:48:34.761 INFO:tasks.workunit.client.0.smithi003.stderr: -394> 2023-12-03T11:48:34.664+0000 7f3e68daf800 5 AuthRegistry(0x5560f5ba78e0) adding con mode: crc 2023-12-03T11:48:34.761 INFO:tasks.workunit.client.0.smithi003.stderr: -393> 2023-12-03T11:48:34.664+0000 7f3e68daf800 5 AuthRegistry(0x5560f5ba78e0) adding con mode: crc 2023-12-03T11:48:34.761 INFO:tasks.workunit.client.0.smithi003.stderr: -392> 2023-12-03T11:48:34.664+0000 7f3e68daf800 5 AuthRegistry(0x5560f5ba78e0) adding con mode: secure 2023-12-03T11:48:34.761 INFO:tasks.workunit.client.0.smithi003.stderr: -391> 2023-12-03T11:48:34.664+0000 7f3e68daf800 5 AuthRegistry(0x5560f5ba78e0) adding con mode: crc 2023-12-03T11:48:34.761 INFO:tasks.workunit.client.0.smithi003.stderr: -390> 2023-12-03T11:48:34.664+0000 7f3e68daf800 5 AuthRegistry(0x5560f5ba78e0) adding con mode: secure 2023-12-03T11:48:34.761 INFO:tasks.workunit.client.0.smithi003.stderr: -389> 2023-12-03T11:48:34.664+0000 7f3e68daf800 5 AuthRegistry(0x5560f5ba78e0) adding con mode: crc 2023-12-03T11:48:34.761 INFO:tasks.workunit.client.0.smithi003.stderr: -388> 2023-12-03T11:48:34.664+0000 7f3e68daf800 5 AuthRegistry(0x5560f5ba78e0) adding con mode: secure 2023-12-03T11:48:34.761 INFO:tasks.workunit.client.0.smithi003.stderr: -387> 2023-12-03T11:48:34.665+0000 7f3e68daf800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:48:34.761 INFO:tasks.workunit.client.0.smithi003.stderr: -386> 2023-12-03T11:48:34.665+0000 7f3e68daf800 1 librados: starting msgr at 2023-12-03T11:48:34.761 INFO:tasks.workunit.client.0.smithi003.stderr: -385> 2023-12-03T11:48:34.665+0000 7f3e68daf800 1 librados: starting objecter 2023-12-03T11:48:34.761 INFO:tasks.workunit.client.0.smithi003.stderr: -384> 2023-12-03T11:48:34.665+0000 7f3e68daf800 5 asok(0x5560f599ca10) register_command objecter_requests cmddesc objecter_requests hook 0x5560f5ba7590 EEXIST 2023-12-03T11:48:34.761 INFO:tasks.workunit.client.0.smithi003.stderr: -383> 2023-12-03T11:48:34.665+0000 7f3e68daf800 1 librados: setting wanted keys 2023-12-03T11:48:34.762 INFO:tasks.workunit.client.0.smithi003.stderr: -382> 2023-12-03T11:48:34.665+0000 7f3e68daf800 1 librados: calling monclient init 2023-12-03T11:48:34.762 INFO:tasks.workunit.client.0.smithi003.stderr: -381> 2023-12-03T11:48:34.665+0000 7f3e68daf800 10 monclient: init 2023-12-03T11:48:34.762 INFO:tasks.workunit.client.0.smithi003.stderr: -380> 2023-12-03T11:48:34.665+0000 7f3e68daf800 5 AuthRegistry(0x5560f5ba5af8) adding auth protocol: cephx 2023-12-03T11:48:34.762 INFO:tasks.workunit.client.0.smithi003.stderr: -379> 2023-12-03T11:48:34.665+0000 7f3e68daf800 5 AuthRegistry(0x5560f5ba5af8) adding auth protocol: cephx 2023-12-03T11:48:34.762 INFO:tasks.workunit.client.0.smithi003.stderr: -378> 2023-12-03T11:48:34.665+0000 7f3e68daf800 5 AuthRegistry(0x5560f5ba5af8) adding auth protocol: cephx 2023-12-03T11:48:34.762 INFO:tasks.workunit.client.0.smithi003.stderr: -377> 2023-12-03T11:48:34.665+0000 7f3e68daf800 5 AuthRegistry(0x5560f5ba5af8) adding con mode: secure 2023-12-03T11:48:34.762 INFO:tasks.workunit.client.0.smithi003.stderr: -376> 2023-12-03T11:48:34.665+0000 7f3e68daf800 5 AuthRegistry(0x5560f5ba5af8) adding con mode: crc 2023-12-03T11:48:34.762 INFO:tasks.workunit.client.0.smithi003.stderr: -375> 2023-12-03T11:48:34.665+0000 7f3e68daf800 5 AuthRegistry(0x5560f5ba5af8) adding con mode: secure 2023-12-03T11:48:34.762 INFO:tasks.workunit.client.0.smithi003.stderr: -374> 2023-12-03T11:48:34.665+0000 7f3e68daf800 5 AuthRegistry(0x5560f5ba5af8) adding con mode: crc 2023-12-03T11:48:34.762 INFO:tasks.workunit.client.0.smithi003.stderr: -373> 2023-12-03T11:48:34.665+0000 7f3e68daf800 5 AuthRegistry(0x5560f5ba5af8) adding con mode: secure 2023-12-03T11:48:34.762 INFO:tasks.workunit.client.0.smithi003.stderr: -372> 2023-12-03T11:48:34.665+0000 7f3e68daf800 5 AuthRegistry(0x5560f5ba5af8) adding con mode: crc 2023-12-03T11:48:34.762 INFO:tasks.workunit.client.0.smithi003.stderr: -371> 2023-12-03T11:48:34.665+0000 7f3e68daf800 5 AuthRegistry(0x5560f5ba5af8) adding con mode: crc 2023-12-03T11:48:34.762 INFO:tasks.workunit.client.0.smithi003.stderr: -370> 2023-12-03T11:48:34.665+0000 7f3e68daf800 5 AuthRegistry(0x5560f5ba5af8) adding con mode: secure 2023-12-03T11:48:34.762 INFO:tasks.workunit.client.0.smithi003.stderr: -369> 2023-12-03T11:48:34.665+0000 7f3e68daf800 5 AuthRegistry(0x5560f5ba5af8) adding con mode: crc 2023-12-03T11:48:34.763 INFO:tasks.workunit.client.0.smithi003.stderr: -368> 2023-12-03T11:48:34.665+0000 7f3e68daf800 5 AuthRegistry(0x5560f5ba5af8) adding con mode: secure 2023-12-03T11:48:34.763 INFO:tasks.workunit.client.0.smithi003.stderr: -367> 2023-12-03T11:48:34.665+0000 7f3e68daf800 5 AuthRegistry(0x5560f5ba5af8) adding con mode: crc 2023-12-03T11:48:34.763 INFO:tasks.workunit.client.0.smithi003.stderr: -366> 2023-12-03T11:48:34.665+0000 7f3e68daf800 5 AuthRegistry(0x5560f5ba5af8) adding con mode: secure 2023-12-03T11:48:34.763 INFO:tasks.workunit.client.0.smithi003.stderr: -365> 2023-12-03T11:48:34.665+0000 7f3e68daf800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:48:34.763 INFO:tasks.workunit.client.0.smithi003.stderr: -364> 2023-12-03T11:48:34.665+0000 7f3e68daf800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:48:34.763 INFO:tasks.workunit.client.0.smithi003.stderr: -363> 2023-12-03T11:48:34.665+0000 7f3e68daf800 5 asok(0x5560f599ca10) register_command rotate-key cmddesc rotate-key hook 0x5560f5ba5c40 EEXIST 2023-12-03T11:48:34.763 INFO:tasks.workunit.client.0.smithi003.stderr: -362> 2023-12-03T11:48:34.665+0000 7f3e68daf800 10 monclient: _reopen_session rank -1 2023-12-03T11:48:34.763 INFO:tasks.workunit.client.0.smithi003.stderr: -361> 2023-12-03T11:48:34.665+0000 7f3e68daf800 10 monclient: _add_conns ranks=[2,0,1] 2023-12-03T11:48:34.763 INFO:tasks.workunit.client.0.smithi003.stderr: -360> 2023-12-03T11:48:34.665+0000 7f3e68daf800 10 monclient(hunting): picked mon.noname-c con 0x5560f5bd6660 addr [v2:172.21.15.3:3301/0,v1:172.21.15.3:6790/0] 2023-12-03T11:48:34.763 INFO:tasks.workunit.client.0.smithi003.stderr: -359> 2023-12-03T11:48:34.665+0000 7f3e68daf800 10 monclient(hunting): picked mon.noname-a con 0x5560f5be1260 addr [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] 2023-12-03T11:48:34.763 INFO:tasks.workunit.client.0.smithi003.stderr: -358> 2023-12-03T11:48:34.665+0000 7f3e68daf800 10 monclient(hunting): picked mon.noname-b con 0x5560f5bdf780 addr [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] 2023-12-03T11:48:34.763 INFO:tasks.workunit.client.0.smithi003.stderr: -357> 2023-12-03T11:48:34.665+0000 7f3e68daf800 10 monclient(hunting): start opening mon connection 2023-12-03T11:48:34.763 INFO:tasks.workunit.client.0.smithi003.stderr: -356> 2023-12-03T11:48:34.665+0000 7f3e68daf800 10 monclient(hunting): start opening mon connection 2023-12-03T11:48:34.763 INFO:tasks.workunit.client.0.smithi003.stderr: -355> 2023-12-03T11:48:34.665+0000 7f3e68daf800 10 monclient(hunting): start opening mon connection 2023-12-03T11:48:34.763 INFO:tasks.workunit.client.0.smithi003.stderr: -354> 2023-12-03T11:48:34.665+0000 7f3e68daf800 10 monclient(hunting): _renew_subs 2023-12-03T11:48:34.763 INFO:tasks.workunit.client.0.smithi003.stderr: -353> 2023-12-03T11:48:34.665+0000 7f3e68daf800 10 monclient(hunting): authenticate will time out at 1736.904133s 2023-12-03T11:48:34.764 INFO:tasks.workunit.client.0.smithi003.stderr: -352> 2023-12-03T11:48:34.665+0000 7f3e668af640 10 monclient(hunting): get_auth_request con 0x5560f5bd6660 auth_method 0 2023-12-03T11:48:34.764 INFO:tasks.workunit.client.0.smithi003.stderr: -351> 2023-12-03T11:48:34.665+0000 7f3e668af640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:48:34.764 INFO:tasks.workunit.client.0.smithi003.stderr: -350> 2023-12-03T11:48:34.665+0000 7f3e668af640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:48:34.764 INFO:tasks.workunit.client.0.smithi003.stderr: -349> 2023-12-03T11:48:34.665+0000 7f3e668af640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:48:34.764 INFO:tasks.workunit.client.0.smithi003.stderr: -348> 2023-12-03T11:48:34.665+0000 7f3e660ae640 10 monclient(hunting): get_auth_request con 0x5560f5be1260 auth_method 0 2023-12-03T11:48:34.764 INFO:tasks.workunit.client.0.smithi003.stderr: -347> 2023-12-03T11:48:34.665+0000 7f3e660ae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:48:34.764 INFO:tasks.workunit.client.0.smithi003.stderr: -346> 2023-12-03T11:48:34.665+0000 7f3e660ae640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:48:34.764 INFO:tasks.workunit.client.0.smithi003.stderr: -345> 2023-12-03T11:48:34.665+0000 7f3e660ae640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:48:34.764 INFO:tasks.workunit.client.0.smithi003.stderr: -344> 2023-12-03T11:48:34.666+0000 7f3e668af640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:48:34.764 INFO:tasks.workunit.client.0.smithi003.stderr: -343> 2023-12-03T11:48:34.666+0000 7f3e668af640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:48:34.764 INFO:tasks.workunit.client.0.smithi003.stderr: -342> 2023-12-03T11:48:34.666+0000 7f3e668af640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:48:34.764 INFO:tasks.workunit.client.0.smithi003.stderr: -341> 2023-12-03T11:48:34.666+0000 7f3e670b0640 10 monclient(hunting): get_auth_request con 0x5560f5bdf780 auth_method 0 2023-12-03T11:48:34.765 INFO:tasks.workunit.client.0.smithi003.stderr: -340> 2023-12-03T11:48:34.666+0000 7f3e670b0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:48:34.765 INFO:tasks.workunit.client.0.smithi003.stderr: -339> 2023-12-03T11:48:34.666+0000 7f3e670b0640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:48:34.765 INFO:tasks.workunit.client.0.smithi003.stderr: -338> 2023-12-03T11:48:34.666+0000 7f3e670b0640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:48:34.765 INFO:tasks.workunit.client.0.smithi003.stderr: -337> 2023-12-03T11:48:34.666+0000 7f3e660ae640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:48:34.765 INFO:tasks.workunit.client.0.smithi003.stderr: -336> 2023-12-03T11:48:34.666+0000 7f3e660ae640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:48:34.765 INFO:tasks.workunit.client.0.smithi003.stderr: -335> 2023-12-03T11:48:34.666+0000 7f3e660ae640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:48:34.765 INFO:tasks.workunit.client.0.smithi003.stderr: -334> 2023-12-03T11:48:34.666+0000 7f3e670b0640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:48:34.766 INFO:tasks.workunit.client.0.smithi003.stderr: -333> 2023-12-03T11:48:34.666+0000 7f3e670b0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:48:34.766 INFO:tasks.workunit.client.0.smithi003.stderr: -332> 2023-12-03T11:48:34.666+0000 7f3e670b0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:48:34.766 INFO:tasks.workunit.client.0.smithi003.stderr: -331> 2023-12-03T11:48:34.666+0000 7f3e668af640 10 monclient(hunting): handle_auth_done global_id 6404 payload 824 2023-12-03T11:48:34.766 INFO:tasks.workunit.client.0.smithi003.stderr: -330> 2023-12-03T11:48:34.666+0000 7f3e668af640 10 monclient: _finish_hunting 0 2023-12-03T11:48:34.766 INFO:tasks.workunit.client.0.smithi003.stderr: -329> 2023-12-03T11:48:34.666+0000 7f3e668af640 1 monclient: found mon.noname-c 2023-12-03T11:48:34.766 INFO:tasks.workunit.client.0.smithi003.stderr: -328> 2023-12-03T11:48:34.666+0000 7f3e668af640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.3:3301/0 2023-12-03T11:48:34.767 INFO:tasks.workunit.client.0.smithi003.stderr: -327> 2023-12-03T11:48:34.666+0000 7f3e477fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:48:34.767 INFO:tasks.workunit.client.0.smithi003.stderr: -326> 2023-12-03T11:48:34.666+0000 7f3e477fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-12-03T11:48:34.767 INFO:tasks.workunit.client.0.smithi003.stderr: -325> 2023-12-03T11:48:34.666+0000 7f3e477fe640 10 monclient: dump: 2023-12-03T11:48:34.767 INFO:tasks.workunit.client.0.smithi003.stderr:epoch 1 2023-12-03T11:48:34.767 INFO:tasks.workunit.client.0.smithi003.stderr:fsid 296556de-a4fc-4095-9b6d-0fe813c2865c 2023-12-03T11:48:34.767 INFO:tasks.workunit.client.0.smithi003.stderr:last_changed 2023-12-03T11:33:18.862564+0000 2023-12-03T11:48:34.767 INFO:tasks.workunit.client.0.smithi003.stderr:created 2023-12-03T11:33:18.862564+0000 2023-12-03T11:48:34.768 INFO:tasks.workunit.client.0.smithi003.stderr:min_mon_release 18 (reef) 2023-12-03T11:48:34.768 INFO:tasks.workunit.client.0.smithi003.stderr:election_strategy: 1 2023-12-03T11:48:34.768 INFO:tasks.workunit.client.0.smithi003.stderr:0: [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] mon.a 2023-12-03T11:48:34.768 INFO:tasks.workunit.client.0.smithi003.stderr:1: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.b 2023-12-03T11:48:34.768 INFO:tasks.workunit.client.0.smithi003.stderr:2: [v2:172.21.15.3:3301/0,v1:172.21.15.3:6790/0] mon.c 2023-12-03T11:48:34.768 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:48:34.768 INFO:tasks.workunit.client.0.smithi003.stderr: -324> 2023-12-03T11:48:34.666+0000 7f3e477fe640 10 monclient: _finish_auth 0 2023-12-03T11:48:34.768 INFO:tasks.workunit.client.0.smithi003.stderr: -323> 2023-12-03T11:48:34.666+0000 7f3e477fe640 10 monclient: _check_auth_tickets 2023-12-03T11:48:34.768 INFO:tasks.workunit.client.0.smithi003.stderr: -322> 2023-12-03T11:48:34.666+0000 7f3e477fe640 10 monclient: handle_config config(0 keys) v1 2023-12-03T11:48:34.768 INFO:tasks.workunit.client.0.smithi003.stderr: -321> 2023-12-03T11:48:34.666+0000 7f3e477fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:48:34.768 INFO:tasks.workunit.client.0.smithi003.stderr: -320> 2023-12-03T11:48:34.666+0000 7f3e477fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-12-03T11:48:34.768 INFO:tasks.workunit.client.0.smithi003.stderr: -319> 2023-12-03T11:48:34.666+0000 7f3e477fe640 10 monclient: dump: 2023-12-03T11:48:34.768 INFO:tasks.workunit.client.0.smithi003.stderr:epoch 1 2023-12-03T11:48:34.768 INFO:tasks.workunit.client.0.smithi003.stderr:fsid 296556de-a4fc-4095-9b6d-0fe813c2865c 2023-12-03T11:48:34.769 INFO:tasks.workunit.client.0.smithi003.stderr:last_changed 2023-12-03T11:33:18.862564+0000 2023-12-03T11:48:34.769 INFO:tasks.workunit.client.0.smithi003.stderr:created 2023-12-03T11:33:18.862564+0000 2023-12-03T11:48:34.769 INFO:tasks.workunit.client.0.smithi003.stderr:min_mon_release 18 (reef) 2023-12-03T11:48:34.769 INFO:tasks.workunit.client.0.smithi003.stderr:election_strategy: 1 2023-12-03T11:48:34.769 INFO:tasks.workunit.client.0.smithi003.stderr:0: [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] mon.a 2023-12-03T11:48:34.769 INFO:tasks.workunit.client.0.smithi003.stderr:1: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.b 2023-12-03T11:48:34.769 INFO:tasks.workunit.client.0.smithi003.stderr:2: [v2:172.21.15.3:3301/0,v1:172.21.15.3:6790/0] mon.c 2023-12-03T11:48:34.769 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:48:34.769 INFO:tasks.workunit.client.0.smithi003.stderr: -318> 2023-12-03T11:48:34.666+0000 7f3e68daf800 5 monclient: authenticate success, global_id 6404 2023-12-03T11:48:34.769 INFO:tasks.workunit.client.0.smithi003.stderr: -317> 2023-12-03T11:48:34.666+0000 7f3e4d7fa640 4 set_mon_vals no callback set 2023-12-03T11:48:34.769 INFO:tasks.workunit.client.0.smithi003.stderr: -316> 2023-12-03T11:48:34.666+0000 7f3e68daf800 10 monclient: _renew_subs 2023-12-03T11:48:34.769 INFO:tasks.workunit.client.0.smithi003.stderr: -315> 2023-12-03T11:48:34.666+0000 7f3e68daf800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.3:3301/0 2023-12-03T11:48:34.769 INFO:tasks.workunit.client.0.smithi003.stderr: -314> 2023-12-03T11:48:34.666+0000 7f3e68daf800 10 monclient: _renew_subs 2023-12-03T11:48:34.769 INFO:tasks.workunit.client.0.smithi003.stderr: -313> 2023-12-03T11:48:34.666+0000 7f3e68daf800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.3:3301/0 2023-12-03T11:48:34.769 INFO:tasks.workunit.client.0.smithi003.stderr: -312> 2023-12-03T11:48:34.666+0000 7f3e68daf800 1 librados: init done 2023-12-03T11:48:34.770 INFO:tasks.workunit.client.0.smithi003.stderr: -311> 2023-12-03T11:48:34.667+0000 7f3e68daf800 20 rados->read ofs=0 len=0 2023-12-03T11:48:34.770 INFO:tasks.workunit.client.0.smithi003.stderr: -310> 2023-12-03T11:48:34.668+0000 7f3e477fe640 4 mgrc handle_mgr_map Got map version 5 2023-12-03T11:48:34.770 INFO:tasks.workunit.client.0.smithi003.stderr: -309> 2023-12-03T11:48:34.668+0000 7f3e477fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.37:6832/2165065416,v1:172.21.15.37:6833/2165065416] 2023-12-03T11:48:34.770 INFO:tasks.workunit.client.0.smithi003.stderr: -308> 2023-12-03T11:48:34.668+0000 7f3e477fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.37:6832/2165065416,v1:172.21.15.37:6833/2165065416] 2023-12-03T11:48:34.770 INFO:tasks.workunit.client.0.smithi003.stderr: -307> 2023-12-03T11:48:34.668+0000 7f3e660ae640 10 monclient: get_auth_request con 0x7f3e40069820 auth_method 0 2023-12-03T11:48:34.770 INFO:tasks.workunit.client.0.smithi003.stderr: -306> 2023-12-03T11:48:34.668+0000 7f3e670b0640 10 monclient: get_auth_request con 0x5560f5bf4760 auth_method 0 2023-12-03T11:48:34.770 INFO:tasks.workunit.client.0.smithi003.stderr: -305> 2023-12-03T11:48:34.669+0000 7f3e68daf800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:34.770 INFO:tasks.workunit.client.0.smithi003.stderr: -304> 2023-12-03T11:48:34.669+0000 7f3e68daf800 20 realm 2023-12-03T11:48:34.770 INFO:tasks.workunit.client.0.smithi003.stderr: -303> 2023-12-03T11:48:34.669+0000 7f3e68daf800 20 rados->read ofs=0 len=0 2023-12-03T11:48:34.770 INFO:tasks.workunit.client.0.smithi003.stderr: -302> 2023-12-03T11:48:34.669+0000 7f3e68daf800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:34.770 INFO:tasks.workunit.client.0.smithi003.stderr: -301> 2023-12-03T11:48:34.669+0000 7f3e68daf800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:48:34.770 INFO:tasks.workunit.client.0.smithi003.stderr: -300> 2023-12-03T11:48:34.669+0000 7f3e68daf800 20 rados->read ofs=0 len=0 2023-12-03T11:48:34.770 INFO:tasks.workunit.client.0.smithi003.stderr: -299> 2023-12-03T11:48:34.669+0000 7f3e68daf800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:34.770 INFO:tasks.workunit.client.0.smithi003.stderr: -298> 2023-12-03T11:48:34.669+0000 7f3e68daf800 20 rados->read ofs=0 len=0 2023-12-03T11:48:34.770 INFO:tasks.workunit.client.0.smithi003.stderr: -297> 2023-12-03T11:48:34.669+0000 7f3e668af640 10 monclient: get_auth_request con 0x5560f5bf86d0 auth_method 0 2023-12-03T11:48:34.771 INFO:tasks.workunit.client.0.smithi003.stderr: -296> 2023-12-03T11:48:34.670+0000 7f3e68daf800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:48:34.771 INFO:tasks.workunit.client.0.smithi003.stderr: -295> 2023-12-03T11:48:34.670+0000 7f3e68daf800 20 rados->read ofs=0 len=0 2023-12-03T11:48:34.771 INFO:tasks.workunit.client.0.smithi003.stderr: -294> 2023-12-03T11:48:34.670+0000 7f3e68daf800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:48:34.771 INFO:tasks.workunit.client.0.smithi003.stderr: -293> 2023-12-03T11:48:34.670+0000 7f3e68daf800 20 searching for the correct realm 2023-12-03T11:48:34.771 INFO:tasks.workunit.client.0.smithi003.stderr: -292> 2023-12-03T11:48:34.671+0000 7f3e660ae640 10 monclient: get_auth_request con 0x5560f5bfd6d0 auth_method 0 2023-12-03T11:48:34.771 INFO:tasks.workunit.client.0.smithi003.stderr: -291> 2023-12-03T11:48:34.671+0000 7f3e670b0640 10 monclient: get_auth_request con 0x7f3e5c02f040 auth_method 0 2023-12-03T11:48:34.771 INFO:tasks.workunit.client.0.smithi003.stderr: -290> 2023-12-03T11:48:34.672+0000 7f3e668af640 10 monclient: get_auth_request con 0x7f3e60067070 auth_method 0 2023-12-03T11:48:34.771 INFO:tasks.workunit.client.0.smithi003.stderr: -289> 2023-12-03T11:48:34.673+0000 7f3e660ae640 10 monclient: get_auth_request con 0x7f3e5806e060 auth_method 0 2023-12-03T11:48:34.771 INFO:tasks.workunit.client.0.smithi003.stderr: -288> 2023-12-03T11:48:34.675+0000 7f3e670b0640 10 monclient: get_auth_request con 0x7f3e5c0223f0 auth_method 0 2023-12-03T11:48:34.771 INFO:tasks.workunit.client.0.smithi003.stderr: -287> 2023-12-03T11:48:34.677+0000 7f3e668af640 10 monclient: get_auth_request con 0x7f3e5c0168f0 auth_method 0 2023-12-03T11:48:34.771 INFO:tasks.workunit.client.0.smithi003.stderr: -286> 2023-12-03T11:48:34.680+0000 7f3e660ae640 0 -- 172.21.15.3:0/2313644263 >> [v2:172.21.15.3:6817/3356208405,v1:172.21.15.3:6819/3356208405] conn(0x5560f5bfd6d0 msgr2=0x5560f5bffac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:48:34.771 INFO:tasks.workunit.client.0.smithi003.stderr: -285> 2023-12-03T11:48:34.680+0000 7f3e477fe640 1 client.6404.objecter ms_handle_reset 0x5560f5bfd6d0 session 0x5560f5989060 osd.3 2023-12-03T11:48:34.771 INFO:tasks.workunit.client.0.smithi003.stderr: -284> 2023-12-03T11:48:34.680+0000 7f3e477fe640 10 monclient: _renew_subs 2023-12-03T11:48:34.771 INFO:tasks.workunit.client.0.smithi003.stderr: -283> 2023-12-03T11:48:34.680+0000 7f3e477fe640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.3:3301/0 2023-12-03T11:48:34.771 INFO:tasks.workunit.client.0.smithi003.stderr: -282> 2023-12-03T11:48:34.680+0000 7f3e660ae640 10 monclient: get_auth_request con 0x7f3e40079e10 auth_method 0 2023-12-03T11:48:34.772 INFO:tasks.workunit.client.0.smithi003.stderr: -281> 2023-12-03T11:48:34.681+0000 7f3e68daf800 20 RGWRados::pool_iterate: got zone_info.83aabb46-04b5-4c96-9933-c6bfb1173a73 2023-12-03T11:48:34.772 INFO:tasks.workunit.client.0.smithi003.stderr: -280> 2023-12-03T11:48:34.681+0000 7f3e68daf800 20 RGWRados::pool_iterate: got zonegroup_info.6a811aad-435d-4fdd-93c9-b7e0b50de429 2023-12-03T11:48:34.772 INFO:tasks.workunit.client.0.smithi003.stderr: -279> 2023-12-03T11:48:34.681+0000 7f3e68daf800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:48:34.772 INFO:tasks.workunit.client.0.smithi003.stderr: -278> 2023-12-03T11:48:34.681+0000 7f3e68daf800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:48:34.772 INFO:tasks.workunit.client.0.smithi003.stderr: -277> 2023-12-03T11:48:34.681+0000 7f3e68daf800 20 rados->read ofs=0 len=0 2023-12-03T11:48:34.772 INFO:tasks.workunit.client.0.smithi003.stderr: -276> 2023-12-03T11:48:34.682+0000 7f3e68daf800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:34.772 INFO:tasks.workunit.client.0.smithi003.stderr: -275> 2023-12-03T11:48:34.682+0000 7f3e68daf800 20 rados->read ofs=0 len=0 2023-12-03T11:48:34.772 INFO:tasks.workunit.client.0.smithi003.stderr: -274> 2023-12-03T11:48:34.682+0000 7f3e68daf800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:48:34.772 INFO:tasks.workunit.client.0.smithi003.stderr: -273> 2023-12-03T11:48:34.682+0000 7f3e68daf800 20 rados->read ofs=0 len=0 2023-12-03T11:48:34.772 INFO:tasks.workunit.client.0.smithi003.stderr: -272> 2023-12-03T11:48:34.683+0000 7f3e68daf800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:48:34.772 INFO:tasks.workunit.client.0.smithi003.stderr: -271> 2023-12-03T11:48:34.683+0000 7f3e68daf800 20 zone default found 2023-12-03T11:48:34.772 INFO:tasks.workunit.client.0.smithi003.stderr: -270> 2023-12-03T11:48:34.683+0000 7f3e68daf800 4 Realm: () 2023-12-03T11:48:34.772 INFO:tasks.workunit.client.0.smithi003.stderr: -269> 2023-12-03T11:48:34.683+0000 7f3e68daf800 4 ZoneGroup: default (6a811aad-435d-4fdd-93c9-b7e0b50de429) 2023-12-03T11:48:34.772 INFO:tasks.workunit.client.0.smithi003.stderr: -268> 2023-12-03T11:48:34.683+0000 7f3e68daf800 4 Zone: default (83aabb46-04b5-4c96-9933-c6bfb1173a73) 2023-12-03T11:48:34.772 INFO:tasks.workunit.client.0.smithi003.stderr: -267> 2023-12-03T11:48:34.683+0000 7f3e68daf800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:48:34.772 INFO:tasks.workunit.client.0.smithi003.stderr: -266> 2023-12-03T11:48:34.683+0000 7f3e68daf800 20 zonegroup default 2023-12-03T11:48:34.773 INFO:tasks.workunit.client.0.smithi003.stderr: -265> 2023-12-03T11:48:34.683+0000 7f3e68daf800 20 rados->read ofs=0 len=0 2023-12-03T11:48:34.773 INFO:tasks.workunit.client.0.smithi003.stderr: -264> 2023-12-03T11:48:34.683+0000 7f3e68daf800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:34.773 INFO:tasks.workunit.client.0.smithi003.stderr: -263> 2023-12-03T11:48:34.683+0000 7f3e68daf800 20 rados->read ofs=0 len=0 2023-12-03T11:48:34.773 INFO:tasks.workunit.client.0.smithi003.stderr: -262> 2023-12-03T11:48:34.683+0000 7f3e68daf800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:34.773 INFO:tasks.workunit.client.0.smithi003.stderr: -261> 2023-12-03T11:48:34.683+0000 7f3e68daf800 20 rados->read ofs=0 len=0 2023-12-03T11:48:34.773 INFO:tasks.workunit.client.0.smithi003.stderr: -260> 2023-12-03T11:48:34.684+0000 7f3e68daf800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:34.773 INFO:tasks.workunit.client.0.smithi003.stderr: -259> 2023-12-03T11:48:34.684+0000 7f3e68daf800 20 started sync module instance, tier type = 2023-12-03T11:48:34.773 INFO:tasks.workunit.client.0.smithi003.stderr: -258> 2023-12-03T11:48:34.684+0000 7f3e68daf800 20 started zone id=83aabb46-04b5-4c96-9933-c6bfb1173a73 (name=default) with tier type = 2023-12-03T11:48:34.773 INFO:tasks.workunit.client.0.smithi003.stderr: -257> 2023-12-03T11:48:34.690+0000 7f3e668af640 0 -- 172.21.15.3:0/2313644263 >> [v2:172.21.15.3:6800/2373485412,v1:172.21.15.3:6801/2373485412] conn(0x7f3e60067070 msgr2=0x7f3e60075480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:48:34.773 INFO:tasks.workunit.client.0.smithi003.stderr: -256> 2023-12-03T11:48:34.690+0000 7f3e477fe640 1 client.6404.objecter ms_handle_reset 0x7f3e60067070 session 0x7f3e6007c040 osd.2 2023-12-03T11:48:34.773 INFO:tasks.workunit.client.0.smithi003.stderr: -255> 2023-12-03T11:48:34.690+0000 7f3e668af640 10 monclient: get_auth_request con 0x5560f5bfd6d0 auth_method 0 2023-12-03T11:48:34.773 INFO:tasks.workunit.client.0.smithi003.stderr: -254> 2023-12-03T11:48:34.694+0000 7f3e68daf800 20 add_watcher() i=0 2023-12-03T11:48:34.773 INFO:tasks.workunit.client.0.smithi003.stderr: -253> 2023-12-03T11:48:34.694+0000 7f3e68daf800 20 add_watcher() i=1 2023-12-03T11:48:34.773 INFO:tasks.workunit.client.0.smithi003.stderr: -252> 2023-12-03T11:48:34.694+0000 7f3e68daf800 20 add_watcher() i=2 2023-12-03T11:48:34.773 INFO:tasks.workunit.client.0.smithi003.stderr: -251> 2023-12-03T11:48:34.694+0000 7f3e68daf800 20 add_watcher() i=3 2023-12-03T11:48:34.774 INFO:tasks.workunit.client.0.smithi003.stderr: -250> 2023-12-03T11:48:34.694+0000 7f3e68daf800 20 add_watcher() i=4 2023-12-03T11:48:34.774 INFO:tasks.workunit.client.0.smithi003.stderr: -249> 2023-12-03T11:48:34.694+0000 7f3e68daf800 20 add_watcher() i=5 2023-12-03T11:48:34.774 INFO:tasks.workunit.client.0.smithi003.stderr: -248> 2023-12-03T11:48:34.694+0000 7f3e68daf800 20 add_watcher() i=6 2023-12-03T11:48:34.774 INFO:tasks.workunit.client.0.smithi003.stderr: -247> 2023-12-03T11:48:34.695+0000 7f3e68daf800 20 add_watcher() i=7 2023-12-03T11:48:34.774 INFO:tasks.workunit.client.0.smithi003.stderr: -246> 2023-12-03T11:48:34.695+0000 7f3e68daf800 2 all 8 watchers are set, enabling cache 2023-12-03T11:48:34.774 INFO:tasks.workunit.client.0.smithi003.stderr: -245> 2023-12-03T11:48:34.697+0000 7f3e68daf800 5 AuthRegistry(0x7fff3da20450) adding auth protocol: cephx 2023-12-03T11:48:34.774 INFO:tasks.workunit.client.0.smithi003.stderr: -244> 2023-12-03T11:48:34.697+0000 7f3e68daf800 5 AuthRegistry(0x7fff3da20450) adding auth protocol: cephx 2023-12-03T11:48:34.774 INFO:tasks.workunit.client.0.smithi003.stderr: -243> 2023-12-03T11:48:34.697+0000 7f3e68daf800 5 AuthRegistry(0x7fff3da20450) adding auth protocol: cephx 2023-12-03T11:48:34.774 INFO:tasks.workunit.client.0.smithi003.stderr: -242> 2023-12-03T11:48:34.697+0000 7f3e68daf800 5 AuthRegistry(0x7fff3da20450) adding con mode: secure 2023-12-03T11:48:34.774 INFO:tasks.workunit.client.0.smithi003.stderr: -241> 2023-12-03T11:48:34.697+0000 7f3e68daf800 5 AuthRegistry(0x7fff3da20450) adding con mode: crc 2023-12-03T11:48:34.774 INFO:tasks.workunit.client.0.smithi003.stderr: -240> 2023-12-03T11:48:34.697+0000 7f3e68daf800 5 AuthRegistry(0x7fff3da20450) adding con mode: secure 2023-12-03T11:48:34.774 INFO:tasks.workunit.client.0.smithi003.stderr: -239> 2023-12-03T11:48:34.697+0000 7f3e68daf800 5 AuthRegistry(0x7fff3da20450) adding con mode: crc 2023-12-03T11:48:34.774 INFO:tasks.workunit.client.0.smithi003.stderr: -238> 2023-12-03T11:48:34.697+0000 7f3e68daf800 5 AuthRegistry(0x7fff3da20450) adding con mode: secure 2023-12-03T11:48:34.774 INFO:tasks.workunit.client.0.smithi003.stderr: -237> 2023-12-03T11:48:34.697+0000 7f3e68daf800 5 AuthRegistry(0x7fff3da20450) adding con mode: crc 2023-12-03T11:48:34.774 INFO:tasks.workunit.client.0.smithi003.stderr: -236> 2023-12-03T11:48:34.697+0000 7f3e68daf800 5 AuthRegistry(0x7fff3da20450) adding con mode: crc 2023-12-03T11:48:34.775 INFO:tasks.workunit.client.0.smithi003.stderr: -235> 2023-12-03T11:48:34.697+0000 7f3e68daf800 5 AuthRegistry(0x7fff3da20450) adding con mode: secure 2023-12-03T11:48:34.775 INFO:tasks.workunit.client.0.smithi003.stderr: -234> 2023-12-03T11:48:34.697+0000 7f3e68daf800 5 AuthRegistry(0x7fff3da20450) adding con mode: crc 2023-12-03T11:48:34.775 INFO:tasks.workunit.client.0.smithi003.stderr: -233> 2023-12-03T11:48:34.697+0000 7f3e68daf800 5 AuthRegistry(0x7fff3da20450) adding con mode: secure 2023-12-03T11:48:34.775 INFO:tasks.workunit.client.0.smithi003.stderr: -232> 2023-12-03T11:48:34.697+0000 7f3da7fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:48:34.775 INFO:tasks.workunit.client.0.smithi003.stderr: -231> 2023-12-03T11:48:34.697+0000 7f3e68daf800 5 AuthRegistry(0x7fff3da20450) adding con mode: crc 2023-12-03T11:48:34.775 INFO:tasks.workunit.client.0.smithi003.stderr: -230> 2023-12-03T11:48:34.697+0000 7f3e68daf800 5 AuthRegistry(0x7fff3da20450) adding con mode: secure 2023-12-03T11:48:34.775 INFO:tasks.workunit.client.0.smithi003.stderr: -229> 2023-12-03T11:48:34.697+0000 7f3e68daf800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:48:34.775 INFO:tasks.workunit.client.0.smithi003.stderr: -228> 2023-12-03T11:48:34.697+0000 7f3e68daf800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:48:34.775 INFO:tasks.workunit.client.0.smithi003.stderr: -227> 2023-12-03T11:48:34.697+0000 7f3e68daf800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:48:34.775 INFO:tasks.workunit.client.0.smithi003.stderr: -226> 2023-12-03T11:48:34.697+0000 7f3e68daf800 5 asok(0x5560f599ca10) register_command cache list hook 0x5560f5b8ed60 2023-12-03T11:48:34.775 INFO:tasks.workunit.client.0.smithi003.stderr: -225> 2023-12-03T11:48:34.697+0000 7f3e68daf800 5 asok(0x5560f599ca10) register_command cache inspect hook 0x5560f5b8ed60 2023-12-03T11:48:34.775 INFO:tasks.workunit.client.0.smithi003.stderr: -224> 2023-12-03T11:48:34.697+0000 7f3e68daf800 5 asok(0x5560f599ca10) register_command cache erase hook 0x5560f5b8ed60 2023-12-03T11:48:34.775 INFO:tasks.workunit.client.0.smithi003.stderr: -223> 2023-12-03T11:48:34.697+0000 7f3e68daf800 5 asok(0x5560f599ca10) register_command cache zap hook 0x5560f5b8ed60 2023-12-03T11:48:34.775 INFO:tasks.workunit.client.0.smithi003.stderr: -222> 2023-12-03T11:48:34.697+0000 7f3e68daf800 10 monclient: get_monmap_and_config 2023-12-03T11:48:34.775 INFO:tasks.workunit.client.0.smithi003.stderr: -221> 2023-12-03T11:48:34.697+0000 7f3e68daf800 10 monclient: build_initial_monmap 2023-12-03T11:48:34.776 INFO:tasks.workunit.client.0.smithi003.stderr: -220> 2023-12-03T11:48:34.697+0000 7f3e68daf800 1 build_initial for_mkfs: 0 2023-12-03T11:48:34.776 INFO:tasks.workunit.client.0.smithi003.stderr: -219> 2023-12-03T11:48:34.697+0000 7f3e68daf800 10 monclient: monmap: 2023-12-03T11:48:34.776 INFO:tasks.workunit.client.0.smithi003.stderr:epoch 0 2023-12-03T11:48:34.776 INFO:tasks.workunit.client.0.smithi003.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-12-03T11:48:34.776 INFO:tasks.workunit.client.0.smithi003.stderr:last_changed 0.000000 2023-12-03T11:48:34.776 INFO:tasks.workunit.client.0.smithi003.stderr:created 0.000000 2023-12-03T11:48:34.776 INFO:tasks.workunit.client.0.smithi003.stderr:min_mon_release 0 (unknown) 2023-12-03T11:48:34.776 INFO:tasks.workunit.client.0.smithi003.stderr:election_strategy: 1 2023-12-03T11:48:34.776 INFO:tasks.workunit.client.0.smithi003.stderr:0: [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] mon.noname-a 2023-12-03T11:48:34.776 INFO:tasks.workunit.client.0.smithi003.stderr:1: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.noname-b 2023-12-03T11:48:34.776 INFO:tasks.workunit.client.0.smithi003.stderr:2: [v2:172.21.15.3:3301/0,v1:172.21.15.3:6790/0] mon.noname-c 2023-12-03T11:48:34.776 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:48:34.776 INFO:tasks.workunit.client.0.smithi003.stderr: -218> 2023-12-03T11:48:34.697+0000 7f3e68daf800 5 AuthRegistry(0x5560f5c39350) adding auth protocol: cephx 2023-12-03T11:48:34.776 INFO:tasks.workunit.client.0.smithi003.stderr: -217> 2023-12-03T11:48:34.697+0000 7f3e68daf800 5 AuthRegistry(0x5560f5c39350) adding auth protocol: cephx 2023-12-03T11:48:34.776 INFO:tasks.workunit.client.0.smithi003.stderr: -216> 2023-12-03T11:48:34.697+0000 7f3e68daf800 5 AuthRegistry(0x5560f5c39350) adding auth protocol: cephx 2023-12-03T11:48:34.777 INFO:tasks.workunit.client.0.smithi003.stderr: -215> 2023-12-03T11:48:34.697+0000 7f3e68daf800 5 AuthRegistry(0x5560f5c39350) adding con mode: secure 2023-12-03T11:48:34.777 INFO:tasks.workunit.client.0.smithi003.stderr: -214> 2023-12-03T11:48:34.697+0000 7f3e68daf800 5 AuthRegistry(0x5560f5c39350) adding con mode: crc 2023-12-03T11:48:34.777 INFO:tasks.workunit.client.0.smithi003.stderr: -213> 2023-12-03T11:48:34.697+0000 7f3e68daf800 5 AuthRegistry(0x5560f5c39350) adding con mode: secure 2023-12-03T11:48:34.777 INFO:tasks.workunit.client.0.smithi003.stderr: -212> 2023-12-03T11:48:34.697+0000 7f3e68daf800 5 AuthRegistry(0x5560f5c39350) adding con mode: crc 2023-12-03T11:48:34.777 INFO:tasks.workunit.client.0.smithi003.stderr: -211> 2023-12-03T11:48:34.697+0000 7f3e68daf800 5 AuthRegistry(0x5560f5c39350) adding con mode: secure 2023-12-03T11:48:34.777 INFO:tasks.workunit.client.0.smithi003.stderr: -210> 2023-12-03T11:48:34.697+0000 7f3e68daf800 5 AuthRegistry(0x5560f5c39350) adding con mode: crc 2023-12-03T11:48:34.777 INFO:tasks.workunit.client.0.smithi003.stderr: -209> 2023-12-03T11:48:34.697+0000 7f3e68daf800 5 AuthRegistry(0x5560f5c39350) adding con mode: crc 2023-12-03T11:48:34.777 INFO:tasks.workunit.client.0.smithi003.stderr: -208> 2023-12-03T11:48:34.697+0000 7f3e68daf800 5 AuthRegistry(0x5560f5c39350) adding con mode: secure 2023-12-03T11:48:34.777 INFO:tasks.workunit.client.0.smithi003.stderr: -207> 2023-12-03T11:48:34.697+0000 7f3e68daf800 5 AuthRegistry(0x5560f5c39350) adding con mode: crc 2023-12-03T11:48:34.777 INFO:tasks.workunit.client.0.smithi003.stderr: -206> 2023-12-03T11:48:34.697+0000 7f3e68daf800 5 AuthRegistry(0x5560f5c39350) adding con mode: secure 2023-12-03T11:48:34.777 INFO:tasks.workunit.client.0.smithi003.stderr: -205> 2023-12-03T11:48:34.697+0000 7f3e68daf800 5 AuthRegistry(0x5560f5c39350) adding con mode: crc 2023-12-03T11:48:34.777 INFO:tasks.workunit.client.0.smithi003.stderr: -204> 2023-12-03T11:48:34.697+0000 7f3e68daf800 5 AuthRegistry(0x5560f5c39350) adding con mode: secure 2023-12-03T11:48:34.777 INFO:tasks.workunit.client.0.smithi003.stderr: -203> 2023-12-03T11:48:34.697+0000 7f3e68daf800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:48:34.777 INFO:tasks.workunit.client.0.smithi003.stderr: -202> 2023-12-03T11:48:34.697+0000 7f3e68daf800 10 monclient: init 2023-12-03T11:48:34.777 INFO:tasks.workunit.client.0.smithi003.stderr: -201> 2023-12-03T11:48:34.697+0000 7f3e68daf800 5 AuthRegistry(0x7fff3da1ffa0) adding auth protocol: cephx 2023-12-03T11:48:34.777 INFO:tasks.workunit.client.0.smithi003.stderr: -200> 2023-12-03T11:48:34.697+0000 7f3e68daf800 5 AuthRegistry(0x7fff3da1ffa0) adding auth protocol: cephx 2023-12-03T11:48:34.778 INFO:tasks.workunit.client.0.smithi003.stderr: -199> 2023-12-03T11:48:34.697+0000 7f3e68daf800 5 AuthRegistry(0x7fff3da1ffa0) adding auth protocol: cephx 2023-12-03T11:48:34.778 INFO:tasks.workunit.client.0.smithi003.stderr: -198> 2023-12-03T11:48:34.697+0000 7f3e68daf800 5 AuthRegistry(0x7fff3da1ffa0) adding con mode: secure 2023-12-03T11:48:34.778 INFO:tasks.workunit.client.0.smithi003.stderr: -197> 2023-12-03T11:48:34.697+0000 7f3e68daf800 5 AuthRegistry(0x7fff3da1ffa0) adding con mode: crc 2023-12-03T11:48:34.778 INFO:tasks.workunit.client.0.smithi003.stderr: -196> 2023-12-03T11:48:34.697+0000 7f3e68daf800 5 AuthRegistry(0x7fff3da1ffa0) adding con mode: secure 2023-12-03T11:48:34.778 INFO:tasks.workunit.client.0.smithi003.stderr: -195> 2023-12-03T11:48:34.697+0000 7f3e68daf800 5 AuthRegistry(0x7fff3da1ffa0) adding con mode: crc 2023-12-03T11:48:34.778 INFO:tasks.workunit.client.0.smithi003.stderr: -194> 2023-12-03T11:48:34.697+0000 7f3e68daf800 5 AuthRegistry(0x7fff3da1ffa0) adding con mode: secure 2023-12-03T11:48:34.778 INFO:tasks.workunit.client.0.smithi003.stderr: -193> 2023-12-03T11:48:34.697+0000 7f3e68daf800 5 AuthRegistry(0x7fff3da1ffa0) adding con mode: crc 2023-12-03T11:48:34.778 INFO:tasks.workunit.client.0.smithi003.stderr: -192> 2023-12-03T11:48:34.697+0000 7f3e68daf800 5 AuthRegistry(0x7fff3da1ffa0) adding con mode: crc 2023-12-03T11:48:34.778 INFO:tasks.workunit.client.0.smithi003.stderr: -191> 2023-12-03T11:48:34.697+0000 7f3e68daf800 5 AuthRegistry(0x7fff3da1ffa0) adding con mode: secure 2023-12-03T11:48:34.778 INFO:tasks.workunit.client.0.smithi003.stderr: -190> 2023-12-03T11:48:34.697+0000 7f3e68daf800 5 AuthRegistry(0x7fff3da1ffa0) adding con mode: crc 2023-12-03T11:48:34.778 INFO:tasks.workunit.client.0.smithi003.stderr: -189> 2023-12-03T11:48:34.697+0000 7f3e68daf800 5 AuthRegistry(0x7fff3da1ffa0) adding con mode: secure 2023-12-03T11:48:34.778 INFO:tasks.workunit.client.0.smithi003.stderr: -188> 2023-12-03T11:48:34.697+0000 7f3e68daf800 5 AuthRegistry(0x7fff3da1ffa0) adding con mode: crc 2023-12-03T11:48:34.778 INFO:tasks.workunit.client.0.smithi003.stderr: -187> 2023-12-03T11:48:34.697+0000 7f3e68daf800 5 AuthRegistry(0x7fff3da1ffa0) adding con mode: secure 2023-12-03T11:48:34.778 INFO:tasks.workunit.client.0.smithi003.stderr: -186> 2023-12-03T11:48:34.698+0000 7f3e68daf800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:48:34.778 INFO:tasks.workunit.client.0.smithi003.stderr: -185> 2023-12-03T11:48:34.698+0000 7f3e68daf800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:48:34.779 INFO:tasks.workunit.client.0.smithi003.stderr: -184> 2023-12-03T11:48:34.698+0000 7f3e68daf800 5 asok(0x5560f599ca10) register_command rotate-key cmddesc rotate-key hook 0x7fff3da200e8 EEXIST 2023-12-03T11:48:34.779 INFO:tasks.workunit.client.0.smithi003.stderr: -183> 2023-12-03T11:48:34.698+0000 7f3e68daf800 10 monclient: _reopen_session rank -1 2023-12-03T11:48:34.779 INFO:tasks.workunit.client.0.smithi003.stderr: -182> 2023-12-03T11:48:34.698+0000 7f3e68daf800 10 monclient: _add_conns ranks=[0,2,1] 2023-12-03T11:48:34.779 INFO:tasks.workunit.client.0.smithi003.stderr: -181> 2023-12-03T11:48:34.698+0000 7f3e68daf800 10 monclient(hunting): picked mon.noname-a con 0x5560f5c3a8a0 addr [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] 2023-12-03T11:48:34.779 INFO:tasks.workunit.client.0.smithi003.stderr: -180> 2023-12-03T11:48:34.698+0000 7f3e68daf800 10 monclient(hunting): picked mon.noname-c con 0x5560f5c2ec70 addr [v2:172.21.15.3:3301/0,v1:172.21.15.3:6790/0] 2023-12-03T11:48:34.779 INFO:tasks.workunit.client.0.smithi003.stderr: -179> 2023-12-03T11:48:34.698+0000 7f3e68daf800 10 monclient(hunting): picked mon.noname-b con 0x5560f5c3b890 addr [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] 2023-12-03T11:48:34.779 INFO:tasks.workunit.client.0.smithi003.stderr: -178> 2023-12-03T11:48:34.698+0000 7f3e68daf800 10 monclient(hunting): start opening mon connection 2023-12-03T11:48:34.779 INFO:tasks.workunit.client.0.smithi003.stderr: -177> 2023-12-03T11:48:34.698+0000 7f3e68daf800 10 monclient(hunting): start opening mon connection 2023-12-03T11:48:34.779 INFO:tasks.workunit.client.0.smithi003.stderr: -176> 2023-12-03T11:48:34.698+0000 7f3e68daf800 10 monclient(hunting): start opening mon connection 2023-12-03T11:48:34.779 INFO:tasks.workunit.client.0.smithi003.stderr: -175> 2023-12-03T11:48:34.698+0000 7f3e68daf800 10 monclient(hunting): _renew_subs 2023-12-03T11:48:34.779 INFO:tasks.workunit.client.0.smithi003.stderr: -174> 2023-12-03T11:48:34.698+0000 7f3e68daf800 10 monclient(hunting): authenticate will time out at 1736.936740s 2023-12-03T11:48:34.779 INFO:tasks.workunit.client.0.smithi003.stderr: -173> 2023-12-03T11:48:34.698+0000 7f3e668af640 10 monclient(hunting): get_auth_request con 0x5560f5c2ec70 auth_method 0 2023-12-03T11:48:34.779 INFO:tasks.workunit.client.0.smithi003.stderr: -172> 2023-12-03T11:48:34.698+0000 7f3e668af640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:48:34.779 INFO:tasks.workunit.client.0.smithi003.stderr: -171> 2023-12-03T11:48:34.698+0000 7f3e668af640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:48:34.779 INFO:tasks.workunit.client.0.smithi003.stderr: -170> 2023-12-03T11:48:34.698+0000 7f3e668af640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:48:34.780 INFO:tasks.workunit.client.0.smithi003.stderr: -169> 2023-12-03T11:48:34.698+0000 7f3e670b0640 10 monclient(hunting): get_auth_request con 0x5560f5c3a8a0 auth_method 0 2023-12-03T11:48:34.780 INFO:tasks.workunit.client.0.smithi003.stderr: -168> 2023-12-03T11:48:34.698+0000 7f3e670b0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:48:34.780 INFO:tasks.workunit.client.0.smithi003.stderr: -167> 2023-12-03T11:48:34.698+0000 7f3e670b0640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:48:34.780 INFO:tasks.workunit.client.0.smithi003.stderr: -166> 2023-12-03T11:48:34.698+0000 7f3e670b0640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:48:34.780 INFO:tasks.workunit.client.0.smithi003.stderr: -165> 2023-12-03T11:48:34.698+0000 7f3e668af640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:48:34.780 INFO:tasks.workunit.client.0.smithi003.stderr: -164> 2023-12-03T11:48:34.698+0000 7f3e668af640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:48:34.780 INFO:tasks.workunit.client.0.smithi003.stderr: -163> 2023-12-03T11:48:34.698+0000 7f3e668af640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:48:34.780 INFO:tasks.workunit.client.0.smithi003.stderr: -162> 2023-12-03T11:48:34.698+0000 7f3e660ae640 10 monclient(hunting): get_auth_request con 0x5560f5c3b890 auth_method 0 2023-12-03T11:48:34.780 INFO:tasks.workunit.client.0.smithi003.stderr: -161> 2023-12-03T11:48:34.698+0000 7f3e660ae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:48:34.780 INFO:tasks.workunit.client.0.smithi003.stderr: -160> 2023-12-03T11:48:34.698+0000 7f3e660ae640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:48:34.780 INFO:tasks.workunit.client.0.smithi003.stderr: -159> 2023-12-03T11:48:34.698+0000 7f3e660ae640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:48:34.780 INFO:tasks.workunit.client.0.smithi003.stderr: -158> 2023-12-03T11:48:34.698+0000 7f3e670b0640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:48:34.780 INFO:tasks.workunit.client.0.smithi003.stderr: -157> 2023-12-03T11:48:34.698+0000 7f3e670b0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:48:34.780 INFO:tasks.workunit.client.0.smithi003.stderr: -156> 2023-12-03T11:48:34.698+0000 7f3e670b0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:48:34.781 INFO:tasks.workunit.client.0.smithi003.stderr: -155> 2023-12-03T11:48:34.698+0000 7f3e660ae640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:48:34.781 INFO:tasks.workunit.client.0.smithi003.stderr: -154> 2023-12-03T11:48:34.698+0000 7f3e660ae640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:48:34.781 INFO:tasks.workunit.client.0.smithi003.stderr: -153> 2023-12-03T11:48:34.698+0000 7f3e660ae640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:48:34.781 INFO:tasks.workunit.client.0.smithi003.stderr: -152> 2023-12-03T11:48:34.698+0000 7f3e668af640 10 monclient(hunting): handle_auth_done global_id 6407 payload 274 2023-12-03T11:48:34.781 INFO:tasks.workunit.client.0.smithi003.stderr: -151> 2023-12-03T11:48:34.698+0000 7f3e668af640 10 monclient: _finish_hunting 0 2023-12-03T11:48:34.781 INFO:tasks.workunit.client.0.smithi003.stderr: -150> 2023-12-03T11:48:34.698+0000 7f3e668af640 1 monclient: found mon.noname-c 2023-12-03T11:48:34.781 INFO:tasks.workunit.client.0.smithi003.stderr: -149> 2023-12-03T11:48:34.698+0000 7f3e668af640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.3:3301/0 2023-12-03T11:48:34.781 INFO:tasks.workunit.client.0.smithi003.stderr: -148> 2023-12-03T11:48:34.699+0000 7f3da77fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:48:34.781 INFO:tasks.workunit.client.0.smithi003.stderr: -147> 2023-12-03T11:48:34.699+0000 7f3da77fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-12-03T11:48:34.781 INFO:tasks.workunit.client.0.smithi003.stderr: -146> 2023-12-03T11:48:34.699+0000 7f3da77fe640 10 monclient: dump: 2023-12-03T11:48:34.781 INFO:tasks.workunit.client.0.smithi003.stderr:epoch 1 2023-12-03T11:48:34.781 INFO:tasks.workunit.client.0.smithi003.stderr:fsid 296556de-a4fc-4095-9b6d-0fe813c2865c 2023-12-03T11:48:34.781 INFO:tasks.workunit.client.0.smithi003.stderr:last_changed 2023-12-03T11:33:18.862564+0000 2023-12-03T11:48:34.781 INFO:tasks.workunit.client.0.smithi003.stderr:created 2023-12-03T11:33:18.862564+0000 2023-12-03T11:48:34.781 INFO:tasks.workunit.client.0.smithi003.stderr:min_mon_release 18 (reef) 2023-12-03T11:48:34.781 INFO:tasks.workunit.client.0.smithi003.stderr:election_strategy: 1 2023-12-03T11:48:34.782 INFO:tasks.workunit.client.0.smithi003.stderr:0: [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] mon.a 2023-12-03T11:48:34.782 INFO:tasks.workunit.client.0.smithi003.stderr:1: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.b 2023-12-03T11:48:34.782 INFO:tasks.workunit.client.0.smithi003.stderr:2: [v2:172.21.15.3:3301/0,v1:172.21.15.3:6790/0] mon.c 2023-12-03T11:48:34.782 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:48:34.782 INFO:tasks.workunit.client.0.smithi003.stderr: -145> 2023-12-03T11:48:34.699+0000 7f3da77fe640 10 monclient: _finish_auth 0 2023-12-03T11:48:34.782 INFO:tasks.workunit.client.0.smithi003.stderr: -144> 2023-12-03T11:48:34.699+0000 7f3da77fe640 10 monclient: _check_auth_tickets 2023-12-03T11:48:34.782 INFO:tasks.workunit.client.0.smithi003.stderr: -143> 2023-12-03T11:48:34.699+0000 7f3da77fe640 10 monclient: handle_config config(0 keys) v1 2023-12-03T11:48:34.782 INFO:tasks.workunit.client.0.smithi003.stderr: -142> 2023-12-03T11:48:34.699+0000 7f3da77fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:48:34.782 INFO:tasks.workunit.client.0.smithi003.stderr: -141> 2023-12-03T11:48:34.699+0000 7f3da77fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-12-03T11:48:34.782 INFO:tasks.workunit.client.0.smithi003.stderr: -140> 2023-12-03T11:48:34.699+0000 7f3da77fe640 10 monclient: dump: 2023-12-03T11:48:34.782 INFO:tasks.workunit.client.0.smithi003.stderr:epoch 1 2023-12-03T11:48:34.782 INFO:tasks.workunit.client.0.smithi003.stderr:fsid 296556de-a4fc-4095-9b6d-0fe813c2865c 2023-12-03T11:48:34.782 INFO:tasks.workunit.client.0.smithi003.stderr:last_changed 2023-12-03T11:33:18.862564+0000 2023-12-03T11:48:34.782 INFO:tasks.workunit.client.0.smithi003.stderr:created 2023-12-03T11:33:18.862564+0000 2023-12-03T11:48:34.782 INFO:tasks.workunit.client.0.smithi003.stderr:min_mon_release 18 (reef) 2023-12-03T11:48:34.783 INFO:tasks.workunit.client.0.smithi003.stderr:election_strategy: 1 2023-12-03T11:48:34.783 INFO:tasks.workunit.client.0.smithi003.stderr:0: [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] mon.a 2023-12-03T11:48:34.783 INFO:tasks.workunit.client.0.smithi003.stderr:1: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.b 2023-12-03T11:48:34.783 INFO:tasks.workunit.client.0.smithi003.stderr:2: [v2:172.21.15.3:3301/0,v1:172.21.15.3:6790/0] mon.c 2023-12-03T11:48:34.783 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:48:34.783 INFO:tasks.workunit.client.0.smithi003.stderr: -139> 2023-12-03T11:48:34.699+0000 7f3e68daf800 5 monclient: authenticate success, global_id 6407 2023-12-03T11:48:34.783 INFO:tasks.workunit.client.0.smithi003.stderr: -138> 2023-12-03T11:48:34.699+0000 7f3e68daf800 10 monclient: get_monmap_and_config success 2023-12-03T11:48:34.783 INFO:tasks.workunit.client.0.smithi003.stderr: -137> 2023-12-03T11:48:34.699+0000 7f3e68daf800 4 set_mon_vals no callback set 2023-12-03T11:48:34.783 INFO:tasks.workunit.client.0.smithi003.stderr: -136> 2023-12-03T11:48:34.699+0000 7f3e68daf800 10 monclient: shutdown 2023-12-03T11:48:34.783 INFO:tasks.workunit.client.0.smithi003.stderr: -135> 2023-12-03T11:48:34.699+0000 7f3e68daf800 10 monclient: build_initial_monmap 2023-12-03T11:48:34.783 INFO:tasks.workunit.client.0.smithi003.stderr: -134> 2023-12-03T11:48:34.699+0000 7f3e68daf800 1 build_initial for_mkfs: 0 2023-12-03T11:48:34.783 INFO:tasks.workunit.client.0.smithi003.stderr: -133> 2023-12-03T11:48:34.699+0000 7f3e68daf800 10 monclient: monmap: 2023-12-03T11:48:34.783 INFO:tasks.workunit.client.0.smithi003.stderr:epoch 0 2023-12-03T11:48:34.783 INFO:tasks.workunit.client.0.smithi003.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-12-03T11:48:34.783 INFO:tasks.workunit.client.0.smithi003.stderr:last_changed 0.000000 2023-12-03T11:48:34.784 INFO:tasks.workunit.client.0.smithi003.stderr:created 0.000000 2023-12-03T11:48:34.784 INFO:tasks.workunit.client.0.smithi003.stderr:min_mon_release 0 (unknown) 2023-12-03T11:48:34.784 INFO:tasks.workunit.client.0.smithi003.stderr:election_strategy: 1 2023-12-03T11:48:34.784 INFO:tasks.workunit.client.0.smithi003.stderr:0: [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] mon.noname-a 2023-12-03T11:48:34.784 INFO:tasks.workunit.client.0.smithi003.stderr:1: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.noname-b 2023-12-03T11:48:34.784 INFO:tasks.workunit.client.0.smithi003.stderr:2: [v2:172.21.15.3:3301/0,v1:172.21.15.3:6790/0] mon.noname-c 2023-12-03T11:48:34.784 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:48:34.784 INFO:tasks.workunit.client.0.smithi003.stderr: -132> 2023-12-03T11:48:34.699+0000 7f3e68daf800 5 AuthRegistry(0x5560f5c39260) adding auth protocol: cephx 2023-12-03T11:48:34.784 INFO:tasks.workunit.client.0.smithi003.stderr: -131> 2023-12-03T11:48:34.699+0000 7f3e68daf800 5 AuthRegistry(0x5560f5c39260) adding auth protocol: cephx 2023-12-03T11:48:34.784 INFO:tasks.workunit.client.0.smithi003.stderr: -130> 2023-12-03T11:48:34.699+0000 7f3e68daf800 5 AuthRegistry(0x5560f5c39260) adding auth protocol: cephx 2023-12-03T11:48:34.784 INFO:tasks.workunit.client.0.smithi003.stderr: -129> 2023-12-03T11:48:34.699+0000 7f3e68daf800 5 AuthRegistry(0x5560f5c39260) adding con mode: secure 2023-12-03T11:48:34.784 INFO:tasks.workunit.client.0.smithi003.stderr: -128> 2023-12-03T11:48:34.699+0000 7f3e68daf800 5 AuthRegistry(0x5560f5c39260) adding con mode: crc 2023-12-03T11:48:34.784 INFO:tasks.workunit.client.0.smithi003.stderr: -127> 2023-12-03T11:48:34.699+0000 7f3e68daf800 5 AuthRegistry(0x5560f5c39260) adding con mode: secure 2023-12-03T11:48:34.784 INFO:tasks.workunit.client.0.smithi003.stderr: -126> 2023-12-03T11:48:34.699+0000 7f3e68daf800 5 AuthRegistry(0x5560f5c39260) adding con mode: crc 2023-12-03T11:48:34.784 INFO:tasks.workunit.client.0.smithi003.stderr: -125> 2023-12-03T11:48:34.699+0000 7f3e68daf800 5 AuthRegistry(0x5560f5c39260) adding con mode: secure 2023-12-03T11:48:34.784 INFO:tasks.workunit.client.0.smithi003.stderr: -124> 2023-12-03T11:48:34.699+0000 7f3e68daf800 5 AuthRegistry(0x5560f5c39260) adding con mode: crc 2023-12-03T11:48:34.785 INFO:tasks.workunit.client.0.smithi003.stderr: -123> 2023-12-03T11:48:34.699+0000 7f3e68daf800 5 AuthRegistry(0x5560f5c39260) adding con mode: crc 2023-12-03T11:48:34.785 INFO:tasks.workunit.client.0.smithi003.stderr: -122> 2023-12-03T11:48:34.699+0000 7f3e68daf800 5 AuthRegistry(0x5560f5c39260) adding con mode: secure 2023-12-03T11:48:34.785 INFO:tasks.workunit.client.0.smithi003.stderr: -121> 2023-12-03T11:48:34.699+0000 7f3e68daf800 5 AuthRegistry(0x5560f5c39260) adding con mode: crc 2023-12-03T11:48:34.785 INFO:tasks.workunit.client.0.smithi003.stderr: -120> 2023-12-03T11:48:34.699+0000 7f3e68daf800 5 AuthRegistry(0x5560f5c39260) adding con mode: secure 2023-12-03T11:48:34.785 INFO:tasks.workunit.client.0.smithi003.stderr: -119> 2023-12-03T11:48:34.699+0000 7f3e68daf800 5 AuthRegistry(0x5560f5c39260) adding con mode: crc 2023-12-03T11:48:34.785 INFO:tasks.workunit.client.0.smithi003.stderr: -118> 2023-12-03T11:48:34.699+0000 7f3e68daf800 5 AuthRegistry(0x5560f5c39260) adding con mode: secure 2023-12-03T11:48:34.785 INFO:tasks.workunit.client.0.smithi003.stderr: -117> 2023-12-03T11:48:34.700+0000 7f3e68daf800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:48:34.785 INFO:tasks.workunit.client.0.smithi003.stderr: -116> 2023-12-03T11:48:34.700+0000 7f3e68daf800 1 librados: starting msgr at 2023-12-03T11:48:34.785 INFO:tasks.workunit.client.0.smithi003.stderr: -115> 2023-12-03T11:48:34.700+0000 7f3e68daf800 1 librados: starting objecter 2023-12-03T11:48:34.785 INFO:tasks.workunit.client.0.smithi003.stderr: -114> 2023-12-03T11:48:34.700+0000 7f3e68daf800 5 asok(0x5560f599ca10) register_command objecter_requests cmddesc objecter_requests hook 0x5560f5c02910 EEXIST 2023-12-03T11:48:34.785 INFO:tasks.workunit.client.0.smithi003.stderr: -113> 2023-12-03T11:48:34.700+0000 7f3e68daf800 1 librados: setting wanted keys 2023-12-03T11:48:34.785 INFO:tasks.workunit.client.0.smithi003.stderr: -112> 2023-12-03T11:48:34.700+0000 7f3e68daf800 1 librados: calling monclient init 2023-12-03T11:48:34.785 INFO:tasks.workunit.client.0.smithi003.stderr: -111> 2023-12-03T11:48:34.700+0000 7f3e68daf800 10 monclient: init 2023-12-03T11:48:34.785 INFO:tasks.workunit.client.0.smithi003.stderr: -110> 2023-12-03T11:48:34.700+0000 7f3e68daf800 5 AuthRegistry(0x5560f5c3c868) adding auth protocol: cephx 2023-12-03T11:48:34.785 INFO:tasks.workunit.client.0.smithi003.stderr: -109> 2023-12-03T11:48:34.700+0000 7f3e68daf800 5 AuthRegistry(0x5560f5c3c868) adding auth protocol: cephx 2023-12-03T11:48:34.786 INFO:tasks.workunit.client.0.smithi003.stderr: -108> 2023-12-03T11:48:34.700+0000 7f3e68daf800 5 AuthRegistry(0x5560f5c3c868) adding auth protocol: cephx 2023-12-03T11:48:34.786 INFO:tasks.workunit.client.0.smithi003.stderr: -107> 2023-12-03T11:48:34.700+0000 7f3e68daf800 5 AuthRegistry(0x5560f5c3c868) adding con mode: secure 2023-12-03T11:48:34.786 INFO:tasks.workunit.client.0.smithi003.stderr: -106> 2023-12-03T11:48:34.700+0000 7f3e68daf800 5 AuthRegistry(0x5560f5c3c868) adding con mode: crc 2023-12-03T11:48:34.786 INFO:tasks.workunit.client.0.smithi003.stderr: -105> 2023-12-03T11:48:34.700+0000 7f3e68daf800 5 AuthRegistry(0x5560f5c3c868) adding con mode: secure 2023-12-03T11:48:34.786 INFO:tasks.workunit.client.0.smithi003.stderr: -104> 2023-12-03T11:48:34.700+0000 7f3e68daf800 5 AuthRegistry(0x5560f5c3c868) adding con mode: crc 2023-12-03T11:48:34.786 INFO:tasks.workunit.client.0.smithi003.stderr: -103> 2023-12-03T11:48:34.700+0000 7f3e68daf800 5 AuthRegistry(0x5560f5c3c868) adding con mode: secure 2023-12-03T11:48:34.786 INFO:tasks.workunit.client.0.smithi003.stderr: -102> 2023-12-03T11:48:34.700+0000 7f3e68daf800 5 AuthRegistry(0x5560f5c3c868) adding con mode: crc 2023-12-03T11:48:34.786 INFO:tasks.workunit.client.0.smithi003.stderr: -101> 2023-12-03T11:48:34.700+0000 7f3e68daf800 5 AuthRegistry(0x5560f5c3c868) adding con mode: crc 2023-12-03T11:48:34.786 INFO:tasks.workunit.client.0.smithi003.stderr: -100> 2023-12-03T11:48:34.700+0000 7f3e68daf800 5 AuthRegistry(0x5560f5c3c868) adding con mode: secure 2023-12-03T11:48:34.786 INFO:tasks.workunit.client.0.smithi003.stderr: -99> 2023-12-03T11:48:34.700+0000 7f3e68daf800 5 AuthRegistry(0x5560f5c3c868) adding con mode: crc 2023-12-03T11:48:34.786 INFO:tasks.workunit.client.0.smithi003.stderr: -98> 2023-12-03T11:48:34.700+0000 7f3e68daf800 5 AuthRegistry(0x5560f5c3c868) adding con mode: secure 2023-12-03T11:48:34.786 INFO:tasks.workunit.client.0.smithi003.stderr: -97> 2023-12-03T11:48:34.700+0000 7f3e68daf800 5 AuthRegistry(0x5560f5c3c868) adding con mode: crc 2023-12-03T11:48:34.786 INFO:tasks.workunit.client.0.smithi003.stderr: -96> 2023-12-03T11:48:34.700+0000 7f3e68daf800 5 AuthRegistry(0x5560f5c3c868) adding con mode: secure 2023-12-03T11:48:34.786 INFO:tasks.workunit.client.0.smithi003.stderr: -95> 2023-12-03T11:48:34.700+0000 7f3e68daf800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:48:34.786 INFO:tasks.workunit.client.0.smithi003.stderr: -94> 2023-12-03T11:48:34.700+0000 7f3e68daf800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:48:34.787 INFO:tasks.workunit.client.0.smithi003.stderr: -93> 2023-12-03T11:48:34.700+0000 7f3e68daf800 5 asok(0x5560f599ca10) register_command rotate-key cmddesc rotate-key hook 0x5560f5c3c9b0 EEXIST 2023-12-03T11:48:34.787 INFO:tasks.workunit.client.0.smithi003.stderr: -92> 2023-12-03T11:48:34.700+0000 7f3e68daf800 10 monclient: _reopen_session rank -1 2023-12-03T11:48:34.787 INFO:tasks.workunit.client.0.smithi003.stderr: -91> 2023-12-03T11:48:34.700+0000 7f3e68daf800 10 monclient: _add_conns ranks=[0,2,1] 2023-12-03T11:48:34.787 INFO:tasks.workunit.client.0.smithi003.stderr: -90> 2023-12-03T11:48:34.700+0000 7f3e68daf800 10 monclient(hunting): picked mon.noname-a con 0x5560f5c2ec70 addr [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] 2023-12-03T11:48:34.787 INFO:tasks.workunit.client.0.smithi003.stderr: -89> 2023-12-03T11:48:34.700+0000 7f3e68daf800 10 monclient(hunting): picked mon.noname-c con 0x5560f5c3a8a0 addr [v2:172.21.15.3:3301/0,v1:172.21.15.3:6790/0] 2023-12-03T11:48:34.787 INFO:tasks.workunit.client.0.smithi003.stderr: -88> 2023-12-03T11:48:34.700+0000 7f3e68daf800 10 monclient(hunting): picked mon.noname-b con 0x5560f5c3b890 addr [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] 2023-12-03T11:48:34.787 INFO:tasks.workunit.client.0.smithi003.stderr: -87> 2023-12-03T11:48:34.700+0000 7f3e68daf800 10 monclient(hunting): start opening mon connection 2023-12-03T11:48:34.787 INFO:tasks.workunit.client.0.smithi003.stderr: -86> 2023-12-03T11:48:34.700+0000 7f3e68daf800 10 monclient(hunting): start opening mon connection 2023-12-03T11:48:34.787 INFO:tasks.workunit.client.0.smithi003.stderr: -85> 2023-12-03T11:48:34.700+0000 7f3e68daf800 10 monclient(hunting): start opening mon connection 2023-12-03T11:48:34.787 INFO:tasks.workunit.client.0.smithi003.stderr: -84> 2023-12-03T11:48:34.700+0000 7f3e68daf800 10 monclient(hunting): _renew_subs 2023-12-03T11:48:34.787 INFO:tasks.workunit.client.0.smithi003.stderr: -83> 2023-12-03T11:48:34.700+0000 7f3e68daf800 10 monclient(hunting): authenticate will time out at 1736.939208s 2023-12-03T11:48:34.787 INFO:tasks.workunit.client.0.smithi003.stderr: -82> 2023-12-03T11:48:34.701+0000 7f3e670b0640 10 monclient(hunting): get_auth_request con 0x5560f5c2ec70 auth_method 0 2023-12-03T11:48:34.787 INFO:tasks.workunit.client.0.smithi003.stderr: -81> 2023-12-03T11:48:34.701+0000 7f3e670b0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:48:34.787 INFO:tasks.workunit.client.0.smithi003.stderr: -80> 2023-12-03T11:48:34.701+0000 7f3e670b0640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:48:34.787 INFO:tasks.workunit.client.0.smithi003.stderr: -79> 2023-12-03T11:48:34.701+0000 7f3e670b0640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:48:34.788 INFO:tasks.workunit.client.0.smithi003.stderr: -78> 2023-12-03T11:48:34.701+0000 7f3e668af640 10 monclient(hunting): get_auth_request con 0x5560f5c3a8a0 auth_method 0 2023-12-03T11:48:34.788 INFO:tasks.workunit.client.0.smithi003.stderr: -77> 2023-12-03T11:48:34.701+0000 7f3e668af640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:48:34.788 INFO:tasks.workunit.client.0.smithi003.stderr: -76> 2023-12-03T11:48:34.701+0000 7f3e668af640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:48:34.788 INFO:tasks.workunit.client.0.smithi003.stderr: -75> 2023-12-03T11:48:34.701+0000 7f3e668af640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:48:34.788 INFO:tasks.workunit.client.0.smithi003.stderr: -74> 2023-12-03T11:48:34.701+0000 7f3e660ae640 10 monclient(hunting): get_auth_request con 0x5560f5c3b890 auth_method 0 2023-12-03T11:48:34.788 INFO:tasks.workunit.client.0.smithi003.stderr: -73> 2023-12-03T11:48:34.701+0000 7f3e660ae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:48:34.788 INFO:tasks.workunit.client.0.smithi003.stderr: -72> 2023-12-03T11:48:34.701+0000 7f3e660ae640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:48:34.788 INFO:tasks.workunit.client.0.smithi003.stderr: -71> 2023-12-03T11:48:34.701+0000 7f3e660ae640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:48:34.788 INFO:tasks.workunit.client.0.smithi003.stderr: -70> 2023-12-03T11:48:34.701+0000 7f3e670b0640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:48:34.788 INFO:tasks.workunit.client.0.smithi003.stderr: -69> 2023-12-03T11:48:34.701+0000 7f3e670b0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:48:34.788 INFO:tasks.workunit.client.0.smithi003.stderr: -68> 2023-12-03T11:48:34.701+0000 7f3e670b0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:48:34.788 INFO:tasks.workunit.client.0.smithi003.stderr: -67> 2023-12-03T11:48:34.701+0000 7f3e668af640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:48:34.788 INFO:tasks.workunit.client.0.smithi003.stderr: -66> 2023-12-03T11:48:34.701+0000 7f3e668af640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:48:34.788 INFO:tasks.workunit.client.0.smithi003.stderr: -65> 2023-12-03T11:48:34.701+0000 7f3e668af640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:48:34.788 INFO:tasks.workunit.client.0.smithi003.stderr: -64> 2023-12-03T11:48:34.701+0000 7f3e660ae640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:48:34.788 INFO:tasks.workunit.client.0.smithi003.stderr: -63> 2023-12-03T11:48:34.701+0000 7f3e660ae640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:48:34.789 INFO:tasks.workunit.client.0.smithi003.stderr: -62> 2023-12-03T11:48:34.701+0000 7f3e660ae640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:48:34.789 INFO:tasks.workunit.client.0.smithi003.stderr: -61> 2023-12-03T11:48:34.701+0000 7f3e668af640 10 monclient(hunting): handle_auth_done global_id 6410 payload 824 2023-12-03T11:48:34.789 INFO:tasks.workunit.client.0.smithi003.stderr: -60> 2023-12-03T11:48:34.701+0000 7f3e668af640 10 monclient: _finish_hunting 0 2023-12-03T11:48:34.789 INFO:tasks.workunit.client.0.smithi003.stderr: -59> 2023-12-03T11:48:34.701+0000 7f3e668af640 1 monclient: found mon.noname-c 2023-12-03T11:48:34.789 INFO:tasks.workunit.client.0.smithi003.stderr: -58> 2023-12-03T11:48:34.701+0000 7f3e668af640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.3:3301/0 2023-12-03T11:48:34.789 INFO:tasks.workunit.client.0.smithi003.stderr: -57> 2023-12-03T11:48:34.701+0000 7f3da5ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:48:34.789 INFO:tasks.workunit.client.0.smithi003.stderr: -56> 2023-12-03T11:48:34.701+0000 7f3da5ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-12-03T11:48:34.789 INFO:tasks.workunit.client.0.smithi003.stderr: -55> 2023-12-03T11:48:34.701+0000 7f3da5ffb640 10 monclient: dump: 2023-12-03T11:48:34.789 INFO:tasks.workunit.client.0.smithi003.stderr:epoch 1 2023-12-03T11:48:34.789 INFO:tasks.workunit.client.0.smithi003.stderr:fsid 296556de-a4fc-4095-9b6d-0fe813c2865c 2023-12-03T11:48:34.789 INFO:tasks.workunit.client.0.smithi003.stderr:last_changed 2023-12-03T11:33:18.862564+0000 2023-12-03T11:48:34.789 INFO:tasks.workunit.client.0.smithi003.stderr:created 2023-12-03T11:33:18.862564+0000 2023-12-03T11:48:34.789 INFO:tasks.workunit.client.0.smithi003.stderr:min_mon_release 18 (reef) 2023-12-03T11:48:34.789 INFO:tasks.workunit.client.0.smithi003.stderr:election_strategy: 1 2023-12-03T11:48:34.789 INFO:tasks.workunit.client.0.smithi003.stderr:0: [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] mon.a 2023-12-03T11:48:34.789 INFO:tasks.workunit.client.0.smithi003.stderr:1: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.b 2023-12-03T11:48:34.790 INFO:tasks.workunit.client.0.smithi003.stderr:2: [v2:172.21.15.3:3301/0,v1:172.21.15.3:6790/0] mon.c 2023-12-03T11:48:34.790 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:48:34.790 INFO:tasks.workunit.client.0.smithi003.stderr: -54> 2023-12-03T11:48:34.701+0000 7f3da5ffb640 10 monclient: _finish_auth 0 2023-12-03T11:48:34.790 INFO:tasks.workunit.client.0.smithi003.stderr: -53> 2023-12-03T11:48:34.701+0000 7f3da5ffb640 10 monclient: _check_auth_tickets 2023-12-03T11:48:34.790 INFO:tasks.workunit.client.0.smithi003.stderr: -52> 2023-12-03T11:48:34.701+0000 7f3da5ffb640 10 monclient: handle_config config(0 keys) v1 2023-12-03T11:48:34.790 INFO:tasks.workunit.client.0.smithi003.stderr: -51> 2023-12-03T11:48:34.701+0000 7f3da5ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:48:34.790 INFO:tasks.workunit.client.0.smithi003.stderr: -50> 2023-12-03T11:48:34.701+0000 7f3da5ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-12-03T11:48:34.790 INFO:tasks.workunit.client.0.smithi003.stderr: -49> 2023-12-03T11:48:34.701+0000 7f3da5ffb640 10 monclient: dump: 2023-12-03T11:48:34.790 INFO:tasks.workunit.client.0.smithi003.stderr:epoch 1 2023-12-03T11:48:34.790 INFO:tasks.workunit.client.0.smithi003.stderr:fsid 296556de-a4fc-4095-9b6d-0fe813c2865c 2023-12-03T11:48:34.790 INFO:tasks.workunit.client.0.smithi003.stderr:last_changed 2023-12-03T11:33:18.862564+0000 2023-12-03T11:48:34.790 INFO:tasks.workunit.client.0.smithi003.stderr:created 2023-12-03T11:33:18.862564+0000 2023-12-03T11:48:34.790 INFO:tasks.workunit.client.0.smithi003.stderr:min_mon_release 18 (reef) 2023-12-03T11:48:34.790 INFO:tasks.workunit.client.0.smithi003.stderr:election_strategy: 1 2023-12-03T11:48:34.790 INFO:tasks.workunit.client.0.smithi003.stderr:0: [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] mon.a 2023-12-03T11:48:34.791 INFO:tasks.workunit.client.0.smithi003.stderr:1: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.b 2023-12-03T11:48:34.791 INFO:tasks.workunit.client.0.smithi003.stderr:2: [v2:172.21.15.3:3301/0,v1:172.21.15.3:6790/0] mon.c 2023-12-03T11:48:34.791 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:48:34.791 INFO:tasks.workunit.client.0.smithi003.stderr: -48> 2023-12-03T11:48:34.701+0000 7f3da77fe640 4 set_mon_vals no callback set 2023-12-03T11:48:34.791 INFO:tasks.workunit.client.0.smithi003.stderr: -47> 2023-12-03T11:48:34.701+0000 7f3e68daf800 5 monclient: authenticate success, global_id 6410 2023-12-03T11:48:34.791 INFO:tasks.workunit.client.0.smithi003.stderr: -46> 2023-12-03T11:48:34.701+0000 7f3e68daf800 10 monclient: _renew_subs 2023-12-03T11:48:34.791 INFO:tasks.workunit.client.0.smithi003.stderr: -45> 2023-12-03T11:48:34.701+0000 7f3e68daf800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.3:3301/0 2023-12-03T11:48:34.791 INFO:tasks.workunit.client.0.smithi003.stderr: -44> 2023-12-03T11:48:34.701+0000 7f3e68daf800 10 monclient: _renew_subs 2023-12-03T11:48:34.791 INFO:tasks.workunit.client.0.smithi003.stderr: -43> 2023-12-03T11:48:34.701+0000 7f3e68daf800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.3:3301/0 2023-12-03T11:48:34.791 INFO:tasks.workunit.client.0.smithi003.stderr: -42> 2023-12-03T11:48:34.701+0000 7f3e68daf800 1 librados: init done 2023-12-03T11:48:34.791 INFO:tasks.workunit.client.0.smithi003.stderr: -41> 2023-12-03T11:48:34.701+0000 7f3e68daf800 5 asok(0x5560f599ca10) register_command cr dump hook 0x5560f5c3e708 2023-12-03T11:48:34.791 INFO:tasks.workunit.client.0.smithi003.stderr: -40> 2023-12-03T11:48:34.703+0000 7f3da5ffb640 4 mgrc handle_mgr_map Got map version 5 2023-12-03T11:48:34.791 INFO:tasks.workunit.client.0.smithi003.stderr: -39> 2023-12-03T11:48:34.703+0000 7f3da5ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.37:6832/2165065416,v1:172.21.15.37:6833/2165065416] 2023-12-03T11:48:34.791 INFO:tasks.workunit.client.0.smithi003.stderr: -38> 2023-12-03T11:48:34.703+0000 7f3da5ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.37:6832/2165065416,v1:172.21.15.37:6833/2165065416] 2023-12-03T11:48:34.791 INFO:tasks.workunit.client.0.smithi003.stderr: -37> 2023-12-03T11:48:34.703+0000 7f3e670b0640 10 monclient: get_auth_request con 0x7f3d98069850 auth_method 0 2023-12-03T11:48:34.792 INFO:tasks.workunit.client.0.smithi003.stderr: -36> 2023-12-03T11:48:34.703+0000 7f3e68daf800 5 note: GC not initialized 2023-12-03T11:48:34.792 INFO:tasks.workunit.client.0.smithi003.stderr: -35> 2023-12-03T11:48:34.703+0000 7f3d96ffd640 20 reqs_thread_entry: start 2023-12-03T11:48:34.792 INFO:tasks.workunit.client.0.smithi003.stderr: -34> 2023-12-03T11:48:34.703+0000 7f3e68daf800 5 asok(0x5560f599ca10) register_command sync trace show hook 0x7f3e60004720 2023-12-03T11:48:34.792 INFO:tasks.workunit.client.0.smithi003.stderr: -33> 2023-12-03T11:48:34.703+0000 7f3e68daf800 5 asok(0x5560f599ca10) register_command sync trace history hook 0x7f3e60004720 2023-12-03T11:48:34.792 INFO:tasks.workunit.client.0.smithi003.stderr: -32> 2023-12-03T11:48:34.703+0000 7f3e68daf800 5 asok(0x5560f599ca10) register_command sync trace active hook 0x7f3e60004720 2023-12-03T11:48:34.792 INFO:tasks.workunit.client.0.smithi003.stderr: -31> 2023-12-03T11:48:34.703+0000 7f3e68daf800 5 asok(0x5560f599ca10) register_command sync trace active_short hook 0x7f3e60004720 2023-12-03T11:48:34.792 INFO:tasks.workunit.client.0.smithi003.stderr: -30> 2023-12-03T11:48:34.703+0000 7f3e68daf800 20 init_complete bucket index max shards: 11 2023-12-03T11:48:34.792 INFO:tasks.workunit.client.0.smithi003.stderr: -29> 2023-12-03T11:48:34.703+0000 7f3e68daf800 20 Filter name: none 2023-12-03T11:48:34.792 INFO:tasks.workunit.client.0.smithi003.stderr: -28> 2023-12-03T11:48:34.703+0000 7f3d94ff9640 20 reqs_thread_entry: start 2023-12-03T11:48:34.792 INFO:tasks.workunit.client.0.smithi003.stderr: -27> 2023-12-03T11:48:34.703+0000 7f3e68daf800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2023-12-03T11:48:34.792 INFO:tasks.workunit.client.0.smithi003.stderr: -26> 2023-12-03T11:48:34.703+0000 7f3e68daf800 20 rados->read ofs=0 len=0 2023-12-03T11:48:34.792 INFO:tasks.workunit.client.0.smithi003.stderr: -25> 2023-12-03T11:48:34.704+0000 7f3e68daf800 20 rados_obj.operate() r=0 bl.length=213 2023-12-03T11:48:34.792 INFO:tasks.workunit.client.0.smithi003.stderr: -24> 2023-12-03T11:48:34.704+0000 7f3e68daf800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2023-12-03T11:48:34.792 INFO:tasks.workunit.client.0.smithi003.stderr: -23> 2023-12-03T11:48:34.704+0000 7f3e68daf800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2023-12-03T11:48:34.792 INFO:tasks.workunit.client.0.smithi003.stderr: -22> 2023-12-03T11:48:34.704+0000 7f3e68daf800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.23 : miss 2023-12-03T11:48:34.792 INFO:tasks.workunit.client.0.smithi003.stderr: -21> 2023-12-03T11:48:34.704+0000 7f3e68daf800 20 rados->read ofs=0 len=0 2023-12-03T11:48:34.793 INFO:tasks.workunit.client.0.smithi003.stderr: -20> 2023-12-03T11:48:34.704+0000 7f3e68daf800 20 rados_obj.operate() r=0 bl.length=385 2023-12-03T11:48:34.793 INFO:tasks.workunit.client.0.smithi003.stderr: -19> 2023-12-03T11:48:34.704+0000 7f3e68daf800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.23 info.flags=0x17 2023-12-03T11:48:34.793 INFO:tasks.workunit.client.0.smithi003.stderr: -18> 2023-12-03T11:48:34.704+0000 7f3e68daf800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.23 to cache LRU end 2023-12-03T11:48:34.793 INFO:tasks.workunit.client.0.smithi003.stderr: -17> 2023-12-03T11:48:34.704+0000 7f3e68daf800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:48:34.793 INFO:tasks.workunit.client.0.smithi003.stderr: -16> 2023-12-03T11:48:34.704+0000 7f3e68daf800 10 updating xattr: name=user.rgw.acl bl.length()=265 2023-12-03T11:48:34.793 INFO:tasks.workunit.client.0.smithi003.stderr: -15> 2023-12-03T11:48:34.704+0000 7f3e68daf800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.23 2023-12-03T11:48:34.793 INFO:tasks.workunit.client.0.smithi003.stderr: -14> 2023-12-03T11:48:34.705+0000 7f3e660ae640 10 monclient: get_auth_request con 0x5560f5c896c0 auth_method 0 2023-12-03T11:48:34.793 INFO:tasks.workunit.client.0.smithi003.stderr: -13> 2023-12-03T11:48:34.710+0000 7f3e68daf800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.23 info.flags=0x17 2023-12-03T11:48:34.793 INFO:tasks.workunit.client.0.smithi003.stderr: -12> 2023-12-03T11:48:34.710+0000 7f3e68daf800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.23 to cache LRU end 2023-12-03T11:48:34.793 INFO:tasks.workunit.client.0.smithi003.stderr: -11> 2023-12-03T11:48:34.710+0000 7f3e68daf800 10 updating xattr: name=user.rgw.acl bl.length()=265 2023-12-03T11:48:34.793 INFO:tasks.workunit.client.0.smithi003.stderr: -10> 2023-12-03T11:48:34.710+0000 7f3e68daf800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.23, ofs0, ns] 2023-12-03T11:48:34.793 INFO:tasks.workunit.client.0.smithi003.stderr: -9> 2023-12-03T11:48:34.710+0000 7f3e4cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660508 cookie 93874928231680 notifier 6404 bl.length()=949 2023-12-03T11:48:34.793 INFO:tasks.workunit.client.0.smithi003.stderr: -8> 2023-12-03T11:48:34.710+0000 7f3e4cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.23 info.flags=0x17 2023-12-03T11:48:34.793 INFO:tasks.workunit.client.0.smithi003.stderr: -7> 2023-12-03T11:48:34.710+0000 7f3e4cff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.23 to cache LRU end 2023-12-03T11:48:34.793 INFO:tasks.workunit.client.0.smithi003.stderr: -6> 2023-12-03T11:48:34.710+0000 7f3e4cff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2023-12-03T11:48:34.794 INFO:tasks.workunit.client.0.smithi003.stderr: -5> 2023-12-03T11:48:34.711+0000 7f3e68daf800 20 handle_bi_update(): bucket=:abort-at-block-writes[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.23]): orig_sources= new_sources= 2023-12-03T11:48:34.794 INFO:tasks.workunit.client.0.smithi003.stderr: -4> 2023-12-03T11:48:34.711+0000 7f3e68daf800 20 handle_bi_update(): bucket=:abort-at-block-writes[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.23]): potential sources added=[] removed=[] 2023-12-03T11:48:34.794 INFO:tasks.workunit.client.0.smithi003.stderr: -3> 2023-12-03T11:48:34.711+0000 7f3e68daf800 20 handle_bi_update(): bucket=:abort-at-block-writes[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.23]): orig_dests= new_dests= 2023-12-03T11:48:34.794 INFO:tasks.workunit.client.0.smithi003.stderr: -2> 2023-12-03T11:48:34.711+0000 7f3e68daf800 20 handle_bi_update(): bucket=:abort-at-block-writes[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.23]): potential dests added=[] removed=[] 2023-12-03T11:48:34.794 INFO:tasks.workunit.client.0.smithi003.stderr: -1> 2023-12-03T11:48:34.712+0000 7f3e68daf800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7537-gbcbf278c/rpm/el9/BUILD/ceph-18.0.0-7537-gbcbf278c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f3e68daf800 time 2023-12-03T11:48:34.712941+0000 2023-12-03T11:48:34.794 INFO:tasks.workunit.client.0.smithi003.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7537-gbcbf278c/rpm/el9/BUILD/ceph-18.0.0-7537-gbcbf278c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2023-12-03T11:48:34.794 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:48:34.794 INFO:tasks.workunit.client.0.smithi003.stderr: ceph version 18.0.0-7537-gbcbf278c (bcbf278cf395873c2a482f5a7b2345faf2160319) reef (dev) 2023-12-03T11:48:34.794 INFO:tasks.workunit.client.0.smithi003.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f3e6d76eef8] 2023-12-03T11:48:34.794 INFO:tasks.workunit.client.0.smithi003.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f0b6) [0x7f3e6d76f0b6] 2023-12-03T11:48:34.794 INFO:tasks.workunit.client.0.smithi003.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5560f453fa71] 2023-12-03T11:48:34.794 INFO:tasks.workunit.client.0.smithi003.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x2a4) [0x5560f454bec4] 2023-12-03T11:48:34.794 INFO:tasks.workunit.client.0.smithi003.stderr: 5: main() 2023-12-03T11:48:34.794 INFO:tasks.workunit.client.0.smithi003.stderr: 6: /lib64/libc.so.6(+0x3feb0) [0x7f3e6b03feb0] 2023-12-03T11:48:34.794 INFO:tasks.workunit.client.0.smithi003.stderr: 7: __libc_start_main() 2023-12-03T11:48:34.795 INFO:tasks.workunit.client.0.smithi003.stderr: 8: _start() 2023-12-03T11:48:34.795 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:48:34.795 INFO:tasks.workunit.client.0.smithi003.stderr: 0> 2023-12-03T11:48:34.713+0000 7f3e68daf800 -1 *** Caught signal (Aborted) ** 2023-12-03T11:48:34.795 INFO:tasks.workunit.client.0.smithi003.stderr: in thread 7f3e68daf800 thread_name:radosgw-admin 2023-12-03T11:48:34.795 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:48:34.795 INFO:tasks.workunit.client.0.smithi003.stderr: ceph version 18.0.0-7537-gbcbf278c (bcbf278cf395873c2a482f5a7b2345faf2160319) reef (dev) 2023-12-03T11:48:34.795 INFO:tasks.workunit.client.0.smithi003.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f3e6b054db0] 2023-12-03T11:48:34.795 INFO:tasks.workunit.client.0.smithi003.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f3e6b0a154c] 2023-12-03T11:48:34.795 INFO:tasks.workunit.client.0.smithi003.stderr: 3: raise() 2023-12-03T11:48:34.795 INFO:tasks.workunit.client.0.smithi003.stderr: 4: abort() 2023-12-03T11:48:34.795 INFO:tasks.workunit.client.0.smithi003.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f3e6d76ef52] 2023-12-03T11:48:34.795 INFO:tasks.workunit.client.0.smithi003.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f0b6) [0x7f3e6d76f0b6] 2023-12-03T11:48:34.795 INFO:tasks.workunit.client.0.smithi003.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5560f453fa71] 2023-12-03T11:48:34.795 INFO:tasks.workunit.client.0.smithi003.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x2a4) [0x5560f454bec4] 2023-12-03T11:48:34.795 INFO:tasks.workunit.client.0.smithi003.stderr: 9: main() 2023-12-03T11:48:34.796 INFO:tasks.workunit.client.0.smithi003.stderr: 10: /lib64/libc.so.6(+0x3feb0) [0x7f3e6b03feb0] 2023-12-03T11:48:34.796 INFO:tasks.workunit.client.0.smithi003.stderr: 11: __libc_start_main() 2023-12-03T11:48:34.796 INFO:tasks.workunit.client.0.smithi003.stderr: 12: _start() 2023-12-03T11:48:34.796 INFO:tasks.workunit.client.0.smithi003.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-12-03T11:48:34.796 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:48:34.796 INFO:tasks.workunit.client.0.smithi003.stderr:--- logging levels --- 2023-12-03T11:48:34.796 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 none 2023-12-03T11:48:34.796 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 1 lockdep 2023-12-03T11:48:34.796 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 1 context 2023-12-03T11:48:34.796 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 1 crush 2023-12-03T11:48:34.796 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 mds 2023-12-03T11:48:34.796 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 mds_balancer 2023-12-03T11:48:34.796 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 mds_locker 2023-12-03T11:48:34.796 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 mds_log 2023-12-03T11:48:34.796 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 mds_log_expire 2023-12-03T11:48:34.796 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 mds_migrator 2023-12-03T11:48:34.796 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 1 buffer 2023-12-03T11:48:34.797 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 1 timer 2023-12-03T11:48:34.797 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 1 filer 2023-12-03T11:48:34.797 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 1 striper 2023-12-03T11:48:34.797 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 1 objecter 2023-12-03T11:48:34.797 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 rados 2023-12-03T11:48:34.797 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 rbd 2023-12-03T11:48:34.797 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 rbd_mirror 2023-12-03T11:48:34.797 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 rbd_replay 2023-12-03T11:48:34.797 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 rbd_pwl 2023-12-03T11:48:34.797 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 journaler 2023-12-03T11:48:34.797 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 objectcacher 2023-12-03T11:48:34.797 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 immutable_obj_cache 2023-12-03T11:48:34.797 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 client 2023-12-03T11:48:34.797 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 osd 2023-12-03T11:48:34.797 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 optracker 2023-12-03T11:48:34.797 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 objclass 2023-12-03T11:48:34.798 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 3 filestore 2023-12-03T11:48:34.798 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 3 journal 2023-12-03T11:48:34.798 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 0 ms 2023-12-03T11:48:34.798 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 mon 2023-12-03T11:48:34.798 INFO:tasks.workunit.client.0.smithi003.stderr: 0/10 monc 2023-12-03T11:48:34.798 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 paxos 2023-12-03T11:48:34.798 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 tp 2023-12-03T11:48:34.798 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 auth 2023-12-03T11:48:34.798 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 crypto 2023-12-03T11:48:34.798 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 1 finisher 2023-12-03T11:48:34.798 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 1 reserver 2023-12-03T11:48:34.798 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 heartbeatmap 2023-12-03T11:48:34.798 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 perfcounter 2023-12-03T11:48:34.798 INFO:tasks.workunit.client.0.smithi003.stderr: 20/20 rgw 2023-12-03T11:48:34.798 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 rgw_sync 2023-12-03T11:48:34.799 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 rgw_datacache 2023-12-03T11:48:34.799 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 rgw_access 2023-12-03T11:48:34.799 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 rgw_dbstore 2023-12-03T11:48:34.799 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 rgw_flight 2023-12-03T11:48:34.799 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 javaclient 2023-12-03T11:48:34.799 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 asok 2023-12-03T11:48:34.799 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 1 throttle 2023-12-03T11:48:34.799 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 0 refs 2023-12-03T11:48:34.799 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 compressor 2023-12-03T11:48:34.799 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 bluestore 2023-12-03T11:48:34.799 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 bluefs 2023-12-03T11:48:34.799 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 3 bdev 2023-12-03T11:48:34.799 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 kstore 2023-12-03T11:48:34.799 INFO:tasks.workunit.client.0.smithi003.stderr: 4/ 5 rocksdb 2023-12-03T11:48:34.799 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 fuse 2023-12-03T11:48:34.799 INFO:tasks.workunit.client.0.smithi003.stderr: 2/ 5 mgr 2023-12-03T11:48:34.800 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 mgrc 2023-12-03T11:48:34.800 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 dpdk 2023-12-03T11:48:34.800 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 eventtrace 2023-12-03T11:48:34.800 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 prioritycache 2023-12-03T11:48:34.800 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 test 2023-12-03T11:48:34.800 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 cephfs_mirror 2023-12-03T11:48:34.800 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 cephsqlite 2023-12-03T11:48:34.800 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 crimson_interrupt 2023-12-03T11:48:34.800 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 seastore 2023-12-03T11:48:34.800 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 seastore_onode 2023-12-03T11:48:34.800 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 seastore_odata 2023-12-03T11:48:34.800 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 seastore_omap 2023-12-03T11:48:34.800 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 seastore_tm 2023-12-03T11:48:34.800 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 seastore_t 2023-12-03T11:48:34.800 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 seastore_cleaner 2023-12-03T11:48:34.800 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 seastore_epm 2023-12-03T11:48:34.801 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 seastore_lba 2023-12-03T11:48:34.801 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 seastore_fixedkv_tree 2023-12-03T11:48:34.801 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 seastore_cache 2023-12-03T11:48:34.801 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 seastore_journal 2023-12-03T11:48:34.801 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 seastore_device 2023-12-03T11:48:34.801 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 seastore_backref 2023-12-03T11:48:34.801 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 alienstore 2023-12-03T11:48:34.801 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 mclock 2023-12-03T11:48:34.801 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 cyanstore 2023-12-03T11:48:34.801 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 ceph_exporter 2023-12-03T11:48:34.801 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 memstore 2023-12-03T11:48:34.801 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 trace 2023-12-03T11:48:34.801 INFO:tasks.workunit.client.0.smithi003.stderr: -2/-2 (syslog threshold) 2023-12-03T11:48:34.801 INFO:tasks.workunit.client.0.smithi003.stderr: 99/99 (stderr threshold) 2023-12-03T11:48:34.801 INFO:tasks.workunit.client.0.smithi003.stderr:--- pthread ID / name mapping for recent threads --- 2023-12-03T11:48:34.801 INFO:tasks.workunit.client.0.smithi003.stderr: 7f3d94ff9640 / http_manager 2023-12-03T11:48:34.802 INFO:tasks.workunit.client.0.smithi003.stderr: 7f3d96ffd640 / http_manager 2023-12-03T11:48:34.802 INFO:tasks.workunit.client.0.smithi003.stderr: 7f3da5ffb640 / ms_dispatch 2023-12-03T11:48:34.802 INFO:tasks.workunit.client.0.smithi003.stderr: 7f3da77fe640 / io_context_pool 2023-12-03T11:48:34.802 INFO:tasks.workunit.client.0.smithi003.stderr: 7f3da7fff640 / rgw_dt_lg_renew 2023-12-03T11:48:34.802 INFO:tasks.workunit.client.0.smithi003.stderr: 7f3e477fe640 / ms_dispatch 2023-12-03T11:48:34.802 INFO:tasks.workunit.client.0.smithi003.stderr: 7f3e4cff9640 / io_context_pool 2023-12-03T11:48:34.802 INFO:tasks.workunit.client.0.smithi003.stderr: 7f3e4d7fa640 / io_context_pool 2023-12-03T11:48:34.802 INFO:tasks.workunit.client.0.smithi003.stderr: 7f3e4ffff640 / ms_dispatch 2023-12-03T11:48:34.802 INFO:tasks.workunit.client.0.smithi003.stderr: 7f3e660ae640 / msgr-worker-2 2023-12-03T11:48:34.802 INFO:tasks.workunit.client.0.smithi003.stderr: 7f3e668af640 / msgr-worker-1 2023-12-03T11:48:34.802 INFO:tasks.workunit.client.0.smithi003.stderr: 7f3e670b0640 / msgr-worker-0 2023-12-03T11:48:34.802 INFO:tasks.workunit.client.0.smithi003.stderr: 7f3e68daf800 / radosgw-admin 2023-12-03T11:48:34.802 INFO:tasks.workunit.client.0.smithi003.stderr: max_recent 500 2023-12-03T11:48:34.802 INFO:tasks.workunit.client.0.smithi003.stderr: max_new 1000 2023-12-03T11:48:34.802 INFO:tasks.workunit.client.0.smithi003.stderr: log_file /var/log/ceph/ceph-client.admin.103041.log 2023-12-03T11:48:34.803 INFO:tasks.workunit.client.0.smithi003.stderr:--- end dump of recent events --- 2023-12-03T11:48:34.803 INFO:tasks.workunit.client.0.smithi003.stderr:--- begin dump of recent events --- 2023-12-03T11:48:34.803 INFO:tasks.workunit.client.0.smithi003.stderr: -499> 2023-12-03T11:48:34.662+0000 7f3e68daf800 10 monclient: _renew_subs 2023-12-03T11:48:34.803 INFO:tasks.workunit.client.0.smithi003.stderr: -498> 2023-12-03T11:48:34.662+0000 7f3e68daf800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.3:3300/0 2023-12-03T11:48:34.803 INFO:tasks.workunit.client.0.smithi003.stderr: -497> 2023-12-03T11:48:34.662+0000 7f3e68daf800 1 librados: init done 2023-12-03T11:48:34.803 INFO:tasks.workunit.client.0.smithi003.stderr: -496> 2023-12-03T11:48:34.662+0000 7f3e68daf800 10 monclient: get_monmap_and_config 2023-12-03T11:48:34.803 INFO:tasks.workunit.client.0.smithi003.stderr: -495> 2023-12-03T11:48:34.662+0000 7f3e68daf800 10 monclient: build_initial_monmap 2023-12-03T11:48:34.803 INFO:tasks.workunit.client.0.smithi003.stderr: -494> 2023-12-03T11:48:34.662+0000 7f3e68daf800 1 build_initial for_mkfs: 0 2023-12-03T11:48:34.803 INFO:tasks.workunit.client.0.smithi003.stderr: -493> 2023-12-03T11:48:34.662+0000 7f3e68daf800 10 monclient: monmap: 2023-12-03T11:48:34.803 INFO:tasks.workunit.client.0.smithi003.stderr:epoch 0 2023-12-03T11:48:34.803 INFO:tasks.workunit.client.0.smithi003.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-12-03T11:48:34.803 INFO:tasks.workunit.client.0.smithi003.stderr:last_changed 0.000000 2023-12-03T11:48:34.803 INFO:tasks.workunit.client.0.smithi003.stderr:created 0.000000 2023-12-03T11:48:34.803 INFO:tasks.workunit.client.0.smithi003.stderr:min_mon_release 0 (unknown) 2023-12-03T11:48:34.803 INFO:tasks.workunit.client.0.smithi003.stderr:election_strategy: 1 2023-12-03T11:48:34.803 INFO:tasks.workunit.client.0.smithi003.stderr:0: [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] mon.noname-a 2023-12-03T11:48:34.804 INFO:tasks.workunit.client.0.smithi003.stderr:1: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.noname-b 2023-12-03T11:48:34.804 INFO:tasks.workunit.client.0.smithi003.stderr:2: [v2:172.21.15.3:3301/0,v1:172.21.15.3:6790/0] mon.noname-c 2023-12-03T11:48:34.804 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:48:34.804 INFO:tasks.workunit.client.0.smithi003.stderr: -492> 2023-12-03T11:48:34.662+0000 7f3e68daf800 5 AuthRegistry(0x5560f5ba7a10) adding auth protocol: cephx 2023-12-03T11:48:34.804 INFO:tasks.workunit.client.0.smithi003.stderr: -491> 2023-12-03T11:48:34.662+0000 7f3e68daf800 5 AuthRegistry(0x5560f5ba7a10) adding auth protocol: cephx 2023-12-03T11:48:34.804 INFO:tasks.workunit.client.0.smithi003.stderr: -490> 2023-12-03T11:48:34.662+0000 7f3e68daf800 5 AuthRegistry(0x5560f5ba7a10) adding auth protocol: cephx 2023-12-03T11:48:34.804 INFO:tasks.workunit.client.0.smithi003.stderr: -489> 2023-12-03T11:48:34.662+0000 7f3e68daf800 5 AuthRegistry(0x5560f5ba7a10) adding con mode: secure 2023-12-03T11:48:34.804 INFO:tasks.workunit.client.0.smithi003.stderr: -488> 2023-12-03T11:48:34.662+0000 7f3e68daf800 5 AuthRegistry(0x5560f5ba7a10) adding con mode: crc 2023-12-03T11:48:34.804 INFO:tasks.workunit.client.0.smithi003.stderr: -487> 2023-12-03T11:48:34.662+0000 7f3e68daf800 5 AuthRegistry(0x5560f5ba7a10) adding con mode: secure 2023-12-03T11:48:34.804 INFO:tasks.workunit.client.0.smithi003.stderr: -486> 2023-12-03T11:48:34.662+0000 7f3e68daf800 5 AuthRegistry(0x5560f5ba7a10) adding con mode: crc 2023-12-03T11:48:34.804 INFO:tasks.workunit.client.0.smithi003.stderr: -485> 2023-12-03T11:48:34.662+0000 7f3e68daf800 5 AuthRegistry(0x5560f5ba7a10) adding con mode: secure 2023-12-03T11:48:34.804 INFO:tasks.workunit.client.0.smithi003.stderr: -484> 2023-12-03T11:48:34.662+0000 7f3e68daf800 5 AuthRegistry(0x5560f5ba7a10) adding con mode: crc 2023-12-03T11:48:34.804 INFO:tasks.workunit.client.0.smithi003.stderr: -483> 2023-12-03T11:48:34.662+0000 7f3e68daf800 5 AuthRegistry(0x5560f5ba7a10) adding con mode: crc 2023-12-03T11:48:34.804 INFO:tasks.workunit.client.0.smithi003.stderr: -482> 2023-12-03T11:48:34.662+0000 7f3e68daf800 5 AuthRegistry(0x5560f5ba7a10) adding con mode: secure 2023-12-03T11:48:34.804 INFO:tasks.workunit.client.0.smithi003.stderr: -481> 2023-12-03T11:48:34.662+0000 7f3e68daf800 5 AuthRegistry(0x5560f5ba7a10) adding con mode: crc 2023-12-03T11:48:34.804 INFO:tasks.workunit.client.0.smithi003.stderr: -480> 2023-12-03T11:48:34.662+0000 7f3e68daf800 5 AuthRegistry(0x5560f5ba7a10) adding con mode: secure 2023-12-03T11:48:34.805 INFO:tasks.workunit.client.0.smithi003.stderr: -479> 2023-12-03T11:48:34.662+0000 7f3e68daf800 5 AuthRegistry(0x5560f5ba7a10) adding con mode: crc 2023-12-03T11:48:34.805 INFO:tasks.workunit.client.0.smithi003.stderr: -478> 2023-12-03T11:48:34.662+0000 7f3e68daf800 5 AuthRegistry(0x5560f5ba7a10) adding con mode: secure 2023-12-03T11:48:34.805 INFO:tasks.workunit.client.0.smithi003.stderr: -477> 2023-12-03T11:48:34.662+0000 7f3e68daf800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:48:34.805 INFO:tasks.workunit.client.0.smithi003.stderr: -476> 2023-12-03T11:48:34.662+0000 7f3e68daf800 10 monclient: init 2023-12-03T11:48:34.805 INFO:tasks.workunit.client.0.smithi003.stderr: -475> 2023-12-03T11:48:34.663+0000 7f3e68daf800 5 AuthRegistry(0x7fff3da1fa20) adding auth protocol: cephx 2023-12-03T11:48:34.805 INFO:tasks.workunit.client.0.smithi003.stderr: -474> 2023-12-03T11:48:34.663+0000 7f3e68daf800 5 AuthRegistry(0x7fff3da1fa20) adding auth protocol: cephx 2023-12-03T11:48:34.805 INFO:tasks.workunit.client.0.smithi003.stderr: -473> 2023-12-03T11:48:34.663+0000 7f3e68daf800 5 AuthRegistry(0x7fff3da1fa20) adding auth protocol: cephx 2023-12-03T11:48:34.805 INFO:tasks.workunit.client.0.smithi003.stderr: -472> 2023-12-03T11:48:34.663+0000 7f3e68daf800 5 AuthRegistry(0x7fff3da1fa20) adding con mode: secure 2023-12-03T11:48:34.805 INFO:tasks.workunit.client.0.smithi003.stderr: -471> 2023-12-03T11:48:34.663+0000 7f3e68daf800 5 AuthRegistry(0x7fff3da1fa20) adding con mode: crc 2023-12-03T11:48:34.805 INFO:tasks.workunit.client.0.smithi003.stderr: -470> 2023-12-03T11:48:34.663+0000 7f3e68daf800 5 AuthRegistry(0x7fff3da1fa20) adding con mode: secure 2023-12-03T11:48:34.805 INFO:tasks.workunit.client.0.smithi003.stderr: -469> 2023-12-03T11:48:34.663+0000 7f3e68daf800 5 AuthRegistry(0x7fff3da1fa20) adding con mode: crc 2023-12-03T11:48:34.805 INFO:tasks.workunit.client.0.smithi003.stderr: -468> 2023-12-03T11:48:34.663+0000 7f3e68daf800 5 AuthRegistry(0x7fff3da1fa20) adding con mode: secure 2023-12-03T11:48:34.805 INFO:tasks.workunit.client.0.smithi003.stderr: -467> 2023-12-03T11:48:34.663+0000 7f3e68daf800 5 AuthRegistry(0x7fff3da1fa20) adding con mode: crc 2023-12-03T11:48:34.805 INFO:tasks.workunit.client.0.smithi003.stderr: -466> 2023-12-03T11:48:34.663+0000 7f3e68daf800 5 AuthRegistry(0x7fff3da1fa20) adding con mode: crc 2023-12-03T11:48:34.805 INFO:tasks.workunit.client.0.smithi003.stderr: -465> 2023-12-03T11:48:34.663+0000 7f3e68daf800 5 AuthRegistry(0x7fff3da1fa20) adding con mode: secure 2023-12-03T11:48:34.806 INFO:tasks.workunit.client.0.smithi003.stderr: -464> 2023-12-03T11:48:34.663+0000 7f3e68daf800 5 AuthRegistry(0x7fff3da1fa20) adding con mode: crc 2023-12-03T11:48:34.806 INFO:tasks.workunit.client.0.smithi003.stderr: -463> 2023-12-03T11:48:34.663+0000 7f3e68daf800 5 AuthRegistry(0x7fff3da1fa20) adding con mode: secure 2023-12-03T11:48:34.806 INFO:tasks.workunit.client.0.smithi003.stderr: -462> 2023-12-03T11:48:34.663+0000 7f3e68daf800 5 AuthRegistry(0x7fff3da1fa20) adding con mode: crc 2023-12-03T11:48:34.806 INFO:tasks.workunit.client.0.smithi003.stderr: -461> 2023-12-03T11:48:34.663+0000 7f3e68daf800 5 AuthRegistry(0x7fff3da1fa20) adding con mode: secure 2023-12-03T11:48:34.806 INFO:tasks.workunit.client.0.smithi003.stderr: -460> 2023-12-03T11:48:34.663+0000 7f3e68daf800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:48:34.806 INFO:tasks.workunit.client.0.smithi003.stderr: -459> 2023-12-03T11:48:34.663+0000 7f3e68daf800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:48:34.806 INFO:tasks.workunit.client.0.smithi003.stderr: -458> 2023-12-03T11:48:34.663+0000 7f3e68daf800 5 asok(0x5560f599ca10) register_command rotate-key cmddesc rotate-key hook 0x7fff3da1fb68 EEXIST 2023-12-03T11:48:34.806 INFO:tasks.workunit.client.0.smithi003.stderr: -457> 2023-12-03T11:48:34.663+0000 7f3e68daf800 10 monclient: _reopen_session rank -1 2023-12-03T11:48:34.806 INFO:tasks.workunit.client.0.smithi003.stderr: -456> 2023-12-03T11:48:34.663+0000 7f3e68daf800 10 monclient: _add_conns ranks=[1,0,2] 2023-12-03T11:48:34.806 INFO:tasks.workunit.client.0.smithi003.stderr: -455> 2023-12-03T11:48:34.663+0000 7f3e68daf800 10 monclient(hunting): picked mon.noname-b con 0x5560f5bd6660 addr [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] 2023-12-03T11:48:34.806 INFO:tasks.workunit.client.0.smithi003.stderr: -454> 2023-12-03T11:48:34.663+0000 7f3e68daf800 10 monclient(hunting): picked mon.noname-a con 0x5560f5bd6a40 addr [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] 2023-12-03T11:48:34.806 INFO:tasks.workunit.client.0.smithi003.stderr: -453> 2023-12-03T11:48:34.663+0000 7f3e68daf800 10 monclient(hunting): picked mon.noname-c con 0x5560f5be1260 addr [v2:172.21.15.3:3301/0,v1:172.21.15.3:6790/0] 2023-12-03T11:48:34.806 INFO:tasks.workunit.client.0.smithi003.stderr: -452> 2023-12-03T11:48:34.663+0000 7f3e68daf800 10 monclient(hunting): start opening mon connection 2023-12-03T11:48:34.806 INFO:tasks.workunit.client.0.smithi003.stderr: -451> 2023-12-03T11:48:34.663+0000 7f3e68daf800 10 monclient(hunting): start opening mon connection 2023-12-03T11:48:34.806 INFO:tasks.workunit.client.0.smithi003.stderr: -450> 2023-12-03T11:48:34.663+0000 7f3e68daf800 10 monclient(hunting): start opening mon connection 2023-12-03T11:48:34.807 INFO:tasks.workunit.client.0.smithi003.stderr: -449> 2023-12-03T11:48:34.663+0000 7f3e68daf800 10 monclient(hunting): _renew_subs 2023-12-03T11:48:34.807 INFO:tasks.workunit.client.0.smithi003.stderr: -448> 2023-12-03T11:48:34.663+0000 7f3e68daf800 10 monclient(hunting): authenticate will time out at 1736.901816s 2023-12-03T11:48:34.807 INFO:tasks.workunit.client.0.smithi003.stderr: -447> 2023-12-03T11:48:34.663+0000 7f3e660ae640 10 monclient(hunting): get_auth_request con 0x5560f5be1260 auth_method 0 2023-12-03T11:48:34.807 INFO:tasks.workunit.client.0.smithi003.stderr: -446> 2023-12-03T11:48:34.663+0000 7f3e660ae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:48:34.807 INFO:tasks.workunit.client.0.smithi003.stderr: -445> 2023-12-03T11:48:34.663+0000 7f3e660ae640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:48:34.807 INFO:tasks.workunit.client.0.smithi003.stderr: -444> 2023-12-03T11:48:34.663+0000 7f3e660ae640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:48:34.807 INFO:tasks.workunit.client.0.smithi003.stderr: -443> 2023-12-03T11:48:34.663+0000 7f3e668af640 10 monclient(hunting): get_auth_request con 0x5560f5bd6a40 auth_method 0 2023-12-03T11:48:34.807 INFO:tasks.workunit.client.0.smithi003.stderr: -442> 2023-12-03T11:48:34.663+0000 7f3e668af640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:48:34.807 INFO:tasks.workunit.client.0.smithi003.stderr: -441> 2023-12-03T11:48:34.663+0000 7f3e668af640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:48:34.807 INFO:tasks.workunit.client.0.smithi003.stderr: -440> 2023-12-03T11:48:34.663+0000 7f3e668af640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:48:34.807 INFO:tasks.workunit.client.0.smithi003.stderr: -439> 2023-12-03T11:48:34.663+0000 7f3e670b0640 10 monclient(hunting): get_auth_request con 0x5560f5bd6660 auth_method 0 2023-12-03T11:48:34.807 INFO:tasks.workunit.client.0.smithi003.stderr: -438> 2023-12-03T11:48:34.663+0000 7f3e670b0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:48:34.807 INFO:tasks.workunit.client.0.smithi003.stderr: -437> 2023-12-03T11:48:34.663+0000 7f3e670b0640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:48:34.807 INFO:tasks.workunit.client.0.smithi003.stderr: -436> 2023-12-03T11:48:34.663+0000 7f3e670b0640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:48:34.807 INFO:tasks.workunit.client.0.smithi003.stderr: -435> 2023-12-03T11:48:34.663+0000 7f3e660ae640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:48:34.807 INFO:tasks.workunit.client.0.smithi003.stderr: -434> 2023-12-03T11:48:34.663+0000 7f3e660ae640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:48:34.808 INFO:tasks.workunit.client.0.smithi003.stderr: -433> 2023-12-03T11:48:34.663+0000 7f3e660ae640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:48:34.808 INFO:tasks.workunit.client.0.smithi003.stderr: -432> 2023-12-03T11:48:34.663+0000 7f3e668af640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:48:34.808 INFO:tasks.workunit.client.0.smithi003.stderr: -431> 2023-12-03T11:48:34.663+0000 7f3e668af640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:48:34.808 INFO:tasks.workunit.client.0.smithi003.stderr: -430> 2023-12-03T11:48:34.663+0000 7f3e668af640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:48:34.808 INFO:tasks.workunit.client.0.smithi003.stderr: -429> 2023-12-03T11:48:34.663+0000 7f3e670b0640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:48:34.808 INFO:tasks.workunit.client.0.smithi003.stderr: -428> 2023-12-03T11:48:34.663+0000 7f3e670b0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:48:34.808 INFO:tasks.workunit.client.0.smithi003.stderr: -427> 2023-12-03T11:48:34.663+0000 7f3e670b0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:48:34.808 INFO:tasks.workunit.client.0.smithi003.stderr: -426> 2023-12-03T11:48:34.663+0000 7f3e660ae640 10 monclient(hunting): handle_auth_done global_id 6401 payload 274 2023-12-03T11:48:34.808 INFO:tasks.workunit.client.0.smithi003.stderr: -425> 2023-12-03T11:48:34.663+0000 7f3e660ae640 10 monclient: _finish_hunting 0 2023-12-03T11:48:34.808 INFO:tasks.workunit.client.0.smithi003.stderr: -424> 2023-12-03T11:48:34.663+0000 7f3e660ae640 1 monclient: found mon.noname-c 2023-12-03T11:48:34.808 INFO:tasks.workunit.client.0.smithi003.stderr: -423> 2023-12-03T11:48:34.663+0000 7f3e660ae640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.3:3301/0 2023-12-03T11:48:34.808 INFO:tasks.workunit.client.0.smithi003.stderr: -422> 2023-12-03T11:48:34.663+0000 7f3e4ffff640 4 mgrc handle_mgr_map Got map version 5 2023-12-03T11:48:34.808 INFO:tasks.workunit.client.0.smithi003.stderr: -421> 2023-12-03T11:48:34.663+0000 7f3e4ffff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.37:6832/2165065416,v1:172.21.15.37:6833/2165065416] 2023-12-03T11:48:34.808 INFO:tasks.workunit.client.0.smithi003.stderr: -420> 2023-12-03T11:48:34.663+0000 7f3e4ffff640 4 mgrc reconnect Starting new session with [v2:172.21.15.37:6832/2165065416,v1:172.21.15.37:6833/2165065416] 2023-12-03T11:48:34.808 INFO:tasks.workunit.client.0.smithi003.stderr: -419> 2023-12-03T11:48:34.664+0000 7f3e670b0640 10 monclient: get_auth_request con 0x7f3e54069820 auth_method 0 2023-12-03T11:48:34.809 INFO:tasks.workunit.client.0.smithi003.stderr: -418> 2023-12-03T11:48:34.664+0000 7f3e4d7fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:48:34.809 INFO:tasks.workunit.client.0.smithi003.stderr: -417> 2023-12-03T11:48:34.664+0000 7f3e4d7fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-12-03T11:48:34.809 INFO:tasks.workunit.client.0.smithi003.stderr: -416> 2023-12-03T11:48:34.664+0000 7f3e4d7fa640 10 monclient: dump: 2023-12-03T11:48:34.809 INFO:tasks.workunit.client.0.smithi003.stderr:epoch 1 2023-12-03T11:48:34.809 INFO:tasks.workunit.client.0.smithi003.stderr:fsid 296556de-a4fc-4095-9b6d-0fe813c2865c 2023-12-03T11:48:34.809 INFO:tasks.workunit.client.0.smithi003.stderr:last_changed 2023-12-03T11:33:18.862564+0000 2023-12-03T11:48:34.809 INFO:tasks.workunit.client.0.smithi003.stderr:created 2023-12-03T11:33:18.862564+0000 2023-12-03T11:48:34.809 INFO:tasks.workunit.client.0.smithi003.stderr:min_mon_release 18 (reef) 2023-12-03T11:48:34.809 INFO:tasks.workunit.client.0.smithi003.stderr:election_strategy: 1 2023-12-03T11:48:34.809 INFO:tasks.workunit.client.0.smithi003.stderr:0: [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] mon.a 2023-12-03T11:48:34.809 INFO:tasks.workunit.client.0.smithi003.stderr:1: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.b 2023-12-03T11:48:34.809 INFO:tasks.workunit.client.0.smithi003.stderr:2: [v2:172.21.15.3:3301/0,v1:172.21.15.3:6790/0] mon.c 2023-12-03T11:48:34.809 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:48:34.809 INFO:tasks.workunit.client.0.smithi003.stderr: -415> 2023-12-03T11:48:34.664+0000 7f3e4d7fa640 10 monclient: _finish_auth 0 2023-12-03T11:48:34.809 INFO:tasks.workunit.client.0.smithi003.stderr: -414> 2023-12-03T11:48:34.664+0000 7f3e4d7fa640 10 monclient: _check_auth_tickets 2023-12-03T11:48:34.809 INFO:tasks.workunit.client.0.smithi003.stderr: -413> 2023-12-03T11:48:34.664+0000 7f3e4d7fa640 10 monclient: handle_config config(0 keys) v1 2023-12-03T11:48:34.810 INFO:tasks.workunit.client.0.smithi003.stderr: -412> 2023-12-03T11:48:34.664+0000 7f3e4d7fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:48:34.810 INFO:tasks.workunit.client.0.smithi003.stderr: -411> 2023-12-03T11:48:34.664+0000 7f3e4d7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-12-03T11:48:34.810 INFO:tasks.workunit.client.0.smithi003.stderr: -410> 2023-12-03T11:48:34.664+0000 7f3e4d7fa640 10 monclient: dump: 2023-12-03T11:48:34.810 INFO:tasks.workunit.client.0.smithi003.stderr:epoch 1 2023-12-03T11:48:34.810 INFO:tasks.workunit.client.0.smithi003.stderr:fsid 296556de-a4fc-4095-9b6d-0fe813c2865c 2023-12-03T11:48:34.810 INFO:tasks.workunit.client.0.smithi003.stderr:last_changed 2023-12-03T11:33:18.862564+0000 2023-12-03T11:48:34.810 INFO:tasks.workunit.client.0.smithi003.stderr:created 2023-12-03T11:33:18.862564+0000 2023-12-03T11:48:34.810 INFO:tasks.workunit.client.0.smithi003.stderr:min_mon_release 18 (reef) 2023-12-03T11:48:34.810 INFO:tasks.workunit.client.0.smithi003.stderr:election_strategy: 1 2023-12-03T11:48:34.810 INFO:tasks.workunit.client.0.smithi003.stderr:0: [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] mon.a 2023-12-03T11:48:34.810 INFO:tasks.workunit.client.0.smithi003.stderr:1: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.b 2023-12-03T11:48:34.810 INFO:tasks.workunit.client.0.smithi003.stderr:2: [v2:172.21.15.3:3301/0,v1:172.21.15.3:6790/0] mon.c 2023-12-03T11:48:34.810 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:48:34.810 INFO:tasks.workunit.client.0.smithi003.stderr: -409> 2023-12-03T11:48:34.664+0000 7f3e68daf800 5 monclient: authenticate success, global_id 6401 2023-12-03T11:48:34.810 INFO:tasks.workunit.client.0.smithi003.stderr: -408> 2023-12-03T11:48:34.664+0000 7f3e68daf800 10 monclient: get_monmap_and_config success 2023-12-03T11:48:34.811 INFO:tasks.workunit.client.0.smithi003.stderr: -407> 2023-12-03T11:48:34.664+0000 7f3e68daf800 4 set_mon_vals no callback set 2023-12-03T11:48:34.811 INFO:tasks.workunit.client.0.smithi003.stderr: -406> 2023-12-03T11:48:34.664+0000 7f3e68daf800 10 monclient: shutdown 2023-12-03T11:48:34.811 INFO:tasks.workunit.client.0.smithi003.stderr: -405> 2023-12-03T11:48:34.664+0000 7f3e68daf800 10 monclient: build_initial_monmap 2023-12-03T11:48:34.811 INFO:tasks.workunit.client.0.smithi003.stderr: -404> 2023-12-03T11:48:34.664+0000 7f3e68daf800 1 build_initial for_mkfs: 0 2023-12-03T11:48:34.811 INFO:tasks.workunit.client.0.smithi003.stderr: -403> 2023-12-03T11:48:34.664+0000 7f3e68daf800 10 monclient: monmap: 2023-12-03T11:48:34.811 INFO:tasks.workunit.client.0.smithi003.stderr:epoch 0 2023-12-03T11:48:34.811 INFO:tasks.workunit.client.0.smithi003.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-12-03T11:48:34.811 INFO:tasks.workunit.client.0.smithi003.stderr:last_changed 0.000000 2023-12-03T11:48:34.811 INFO:tasks.workunit.client.0.smithi003.stderr:created 0.000000 2023-12-03T11:48:34.811 INFO:tasks.workunit.client.0.smithi003.stderr:min_mon_release 0 (unknown) 2023-12-03T11:48:34.811 INFO:tasks.workunit.client.0.smithi003.stderr:election_strategy: 1 2023-12-03T11:48:34.811 INFO:tasks.workunit.client.0.smithi003.stderr:0: [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] mon.noname-a 2023-12-03T11:48:34.811 INFO:tasks.workunit.client.0.smithi003.stderr:1: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.noname-b 2023-12-03T11:48:34.811 INFO:tasks.workunit.client.0.smithi003.stderr:2: [v2:172.21.15.3:3301/0,v1:172.21.15.3:6790/0] mon.noname-c 2023-12-03T11:48:34.811 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:48:34.812 INFO:tasks.workunit.client.0.smithi003.stderr: -402> 2023-12-03T11:48:34.664+0000 7f3e68daf800 5 AuthRegistry(0x5560f5ba78e0) adding auth protocol: cephx 2023-12-03T11:48:34.812 INFO:tasks.workunit.client.0.smithi003.stderr: -401> 2023-12-03T11:48:34.664+0000 7f3e68daf800 5 AuthRegistry(0x5560f5ba78e0) adding auth protocol: cephx 2023-12-03T11:48:34.812 INFO:tasks.workunit.client.0.smithi003.stderr: -400> 2023-12-03T11:48:34.664+0000 7f3e68daf800 5 AuthRegistry(0x5560f5ba78e0) adding auth protocol: cephx 2023-12-03T11:48:34.812 INFO:tasks.workunit.client.0.smithi003.stderr: -399> 2023-12-03T11:48:34.664+0000 7f3e68daf800 5 AuthRegistry(0x5560f5ba78e0) adding con mode: secure 2023-12-03T11:48:34.812 INFO:tasks.workunit.client.0.smithi003.stderr: -398> 2023-12-03T11:48:34.664+0000 7f3e68daf800 5 AuthRegistry(0x5560f5ba78e0) adding con mode: crc 2023-12-03T11:48:34.812 INFO:tasks.workunit.client.0.smithi003.stderr: -397> 2023-12-03T11:48:34.664+0000 7f3e68daf800 5 AuthRegistry(0x5560f5ba78e0) adding con mode: secure 2023-12-03T11:48:34.812 INFO:tasks.workunit.client.0.smithi003.stderr: -396> 2023-12-03T11:48:34.664+0000 7f3e68daf800 5 AuthRegistry(0x5560f5ba78e0) adding con mode: crc 2023-12-03T11:48:34.812 INFO:tasks.workunit.client.0.smithi003.stderr: -395> 2023-12-03T11:48:34.664+0000 7f3e68daf800 5 AuthRegistry(0x5560f5ba78e0) adding con mode: secure 2023-12-03T11:48:34.812 INFO:tasks.workunit.client.0.smithi003.stderr: -394> 2023-12-03T11:48:34.664+0000 7f3e68daf800 5 AuthRegistry(0x5560f5ba78e0) adding con mode: crc 2023-12-03T11:48:34.812 INFO:tasks.workunit.client.0.smithi003.stderr: -393> 2023-12-03T11:48:34.664+0000 7f3e68daf800 5 AuthRegistry(0x5560f5ba78e0) adding con mode: crc 2023-12-03T11:48:34.812 INFO:tasks.workunit.client.0.smithi003.stderr: -392> 2023-12-03T11:48:34.664+0000 7f3e68daf800 5 AuthRegistry(0x5560f5ba78e0) adding con mode: secure 2023-12-03T11:48:34.812 INFO:tasks.workunit.client.0.smithi003.stderr: -391> 2023-12-03T11:48:34.664+0000 7f3e68daf800 5 AuthRegistry(0x5560f5ba78e0) adding con mode: crc 2023-12-03T11:48:34.812 INFO:tasks.workunit.client.0.smithi003.stderr: -390> 2023-12-03T11:48:34.664+0000 7f3e68daf800 5 AuthRegistry(0x5560f5ba78e0) adding con mode: secure 2023-12-03T11:48:34.812 INFO:tasks.workunit.client.0.smithi003.stderr: -389> 2023-12-03T11:48:34.664+0000 7f3e68daf800 5 AuthRegistry(0x5560f5ba78e0) adding con mode: crc 2023-12-03T11:48:34.812 INFO:tasks.workunit.client.0.smithi003.stderr: -388> 2023-12-03T11:48:34.664+0000 7f3e68daf800 5 AuthRegistry(0x5560f5ba78e0) adding con mode: secure 2023-12-03T11:48:34.812 INFO:tasks.workunit.client.0.smithi003.stderr: -387> 2023-12-03T11:48:34.665+0000 7f3e68daf800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:48:34.813 INFO:tasks.workunit.client.0.smithi003.stderr: -386> 2023-12-03T11:48:34.665+0000 7f3e68daf800 1 librados: starting msgr at 2023-12-03T11:48:34.813 INFO:tasks.workunit.client.0.smithi003.stderr: -385> 2023-12-03T11:48:34.665+0000 7f3e68daf800 1 librados: starting objecter 2023-12-03T11:48:34.813 INFO:tasks.workunit.client.0.smithi003.stderr: -384> 2023-12-03T11:48:34.665+0000 7f3e68daf800 5 asok(0x5560f599ca10) register_command objecter_requests cmddesc objecter_requests hook 0x5560f5ba7590 EEXIST 2023-12-03T11:48:34.813 INFO:tasks.workunit.client.0.smithi003.stderr: -383> 2023-12-03T11:48:34.665+0000 7f3e68daf800 1 librados: setting wanted keys 2023-12-03T11:48:34.813 INFO:tasks.workunit.client.0.smithi003.stderr: -382> 2023-12-03T11:48:34.665+0000 7f3e68daf800 1 librados: calling monclient init 2023-12-03T11:48:34.813 INFO:tasks.workunit.client.0.smithi003.stderr: -381> 2023-12-03T11:48:34.665+0000 7f3e68daf800 10 monclient: init 2023-12-03T11:48:34.813 INFO:tasks.workunit.client.0.smithi003.stderr: -380> 2023-12-03T11:48:34.665+0000 7f3e68daf800 5 AuthRegistry(0x5560f5ba5af8) adding auth protocol: cephx 2023-12-03T11:48:34.813 INFO:tasks.workunit.client.0.smithi003.stderr: -379> 2023-12-03T11:48:34.665+0000 7f3e68daf800 5 AuthRegistry(0x5560f5ba5af8) adding auth protocol: cephx 2023-12-03T11:48:34.813 INFO:tasks.workunit.client.0.smithi003.stderr: -378> 2023-12-03T11:48:34.665+0000 7f3e68daf800 5 AuthRegistry(0x5560f5ba5af8) adding auth protocol: cephx 2023-12-03T11:48:34.813 INFO:tasks.workunit.client.0.smithi003.stderr: -377> 2023-12-03T11:48:34.665+0000 7f3e68daf800 5 AuthRegistry(0x5560f5ba5af8) adding con mode: secure 2023-12-03T11:48:34.813 INFO:tasks.workunit.client.0.smithi003.stderr: -376> 2023-12-03T11:48:34.665+0000 7f3e68daf800 5 AuthRegistry(0x5560f5ba5af8) adding con mode: crc 2023-12-03T11:48:34.813 INFO:tasks.workunit.client.0.smithi003.stderr: -375> 2023-12-03T11:48:34.665+0000 7f3e68daf800 5 AuthRegistry(0x5560f5ba5af8) adding con mode: secure 2023-12-03T11:48:34.813 INFO:tasks.workunit.client.0.smithi003.stderr: -374> 2023-12-03T11:48:34.665+0000 7f3e68daf800 5 AuthRegistry(0x5560f5ba5af8) adding con mode: crc 2023-12-03T11:48:34.813 INFO:tasks.workunit.client.0.smithi003.stderr: -373> 2023-12-03T11:48:34.665+0000 7f3e68daf800 5 AuthRegistry(0x5560f5ba5af8) adding con mode: secure 2023-12-03T11:48:34.813 INFO:tasks.workunit.client.0.smithi003.stderr: -372> 2023-12-03T11:48:34.665+0000 7f3e68daf800 5 AuthRegistry(0x5560f5ba5af8) adding con mode: crc 2023-12-03T11:48:34.814 INFO:tasks.workunit.client.0.smithi003.stderr: -371> 2023-12-03T11:48:34.665+0000 7f3e68daf800 5 AuthRegistry(0x5560f5ba5af8) adding con mode: crc 2023-12-03T11:48:34.814 INFO:tasks.workunit.client.0.smithi003.stderr: -370> 2023-12-03T11:48:34.665+0000 7f3e68daf800 5 AuthRegistry(0x5560f5ba5af8) adding con mode: secure 2023-12-03T11:48:34.814 INFO:tasks.workunit.client.0.smithi003.stderr: -369> 2023-12-03T11:48:34.665+0000 7f3e68daf800 5 AuthRegistry(0x5560f5ba5af8) adding con mode: crc 2023-12-03T11:48:34.814 INFO:tasks.workunit.client.0.smithi003.stderr: -368> 2023-12-03T11:48:34.665+0000 7f3e68daf800 5 AuthRegistry(0x5560f5ba5af8) adding con mode: secure 2023-12-03T11:48:34.814 INFO:tasks.workunit.client.0.smithi003.stderr: -367> 2023-12-03T11:48:34.665+0000 7f3e68daf800 5 AuthRegistry(0x5560f5ba5af8) adding con mode: crc 2023-12-03T11:48:34.814 INFO:tasks.workunit.client.0.smithi003.stderr: -366> 2023-12-03T11:48:34.665+0000 7f3e68daf800 5 AuthRegistry(0x5560f5ba5af8) adding con mode: secure 2023-12-03T11:48:34.814 INFO:tasks.workunit.client.0.smithi003.stderr: -365> 2023-12-03T11:48:34.665+0000 7f3e68daf800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:48:34.814 INFO:tasks.workunit.client.0.smithi003.stderr: -364> 2023-12-03T11:48:34.665+0000 7f3e68daf800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:48:34.814 INFO:tasks.workunit.client.0.smithi003.stderr: -363> 2023-12-03T11:48:34.665+0000 7f3e68daf800 5 asok(0x5560f599ca10) register_command rotate-key cmddesc rotate-key hook 0x5560f5ba5c40 EEXIST 2023-12-03T11:48:34.814 INFO:tasks.workunit.client.0.smithi003.stderr: -362> 2023-12-03T11:48:34.665+0000 7f3e68daf800 10 monclient: _reopen_session rank -1 2023-12-03T11:48:34.814 INFO:tasks.workunit.client.0.smithi003.stderr: -361> 2023-12-03T11:48:34.665+0000 7f3e68daf800 10 monclient: _add_conns ranks=[2,0,1] 2023-12-03T11:48:34.814 INFO:tasks.workunit.client.0.smithi003.stderr: -360> 2023-12-03T11:48:34.665+0000 7f3e68daf800 10 monclient(hunting): picked mon.noname-c con 0x5560f5bd6660 addr [v2:172.21.15.3:3301/0,v1:172.21.15.3:6790/0] 2023-12-03T11:48:34.814 INFO:tasks.workunit.client.0.smithi003.stderr: -359> 2023-12-03T11:48:34.665+0000 7f3e68daf800 10 monclient(hunting): picked mon.noname-a con 0x5560f5be1260 addr [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] 2023-12-03T11:48:34.814 INFO:tasks.workunit.client.0.smithi003.stderr: -358> 2023-12-03T11:48:34.665+0000 7f3e68daf800 10 monclient(hunting): picked mon.noname-b con 0x5560f5bdf780 addr [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] 2023-12-03T11:48:34.814 INFO:tasks.workunit.client.0.smithi003.stderr: -357> 2023-12-03T11:48:34.665+0000 7f3e68daf800 10 monclient(hunting): start opening mon connection 2023-12-03T11:48:34.815 INFO:tasks.workunit.client.0.smithi003.stderr: -356> 2023-12-03T11:48:34.665+0000 7f3e68daf800 10 monclient(hunting): start opening mon connection 2023-12-03T11:48:34.815 INFO:tasks.workunit.client.0.smithi003.stderr: -355> 2023-12-03T11:48:34.665+0000 7f3e68daf800 10 monclient(hunting): start opening mon connection 2023-12-03T11:48:34.815 INFO:tasks.workunit.client.0.smithi003.stderr: -354> 2023-12-03T11:48:34.665+0000 7f3e68daf800 10 monclient(hunting): _renew_subs 2023-12-03T11:48:34.815 INFO:tasks.workunit.client.0.smithi003.stderr: -353> 2023-12-03T11:48:34.665+0000 7f3e68daf800 10 monclient(hunting): authenticate will time out at 1736.904133s 2023-12-03T11:48:34.815 INFO:tasks.workunit.client.0.smithi003.stderr: -352> 2023-12-03T11:48:34.665+0000 7f3e668af640 10 monclient(hunting): get_auth_request con 0x5560f5bd6660 auth_method 0 2023-12-03T11:48:34.815 INFO:tasks.workunit.client.0.smithi003.stderr: -351> 2023-12-03T11:48:34.665+0000 7f3e668af640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:48:34.815 INFO:tasks.workunit.client.0.smithi003.stderr: -350> 2023-12-03T11:48:34.665+0000 7f3e668af640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:48:34.815 INFO:tasks.workunit.client.0.smithi003.stderr: -349> 2023-12-03T11:48:34.665+0000 7f3e668af640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:48:34.815 INFO:tasks.workunit.client.0.smithi003.stderr: -348> 2023-12-03T11:48:34.665+0000 7f3e660ae640 10 monclient(hunting): get_auth_request con 0x5560f5be1260 auth_method 0 2023-12-03T11:48:34.815 INFO:tasks.workunit.client.0.smithi003.stderr: -347> 2023-12-03T11:48:34.665+0000 7f3e660ae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:48:34.815 INFO:tasks.workunit.client.0.smithi003.stderr: -346> 2023-12-03T11:48:34.665+0000 7f3e660ae640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:48:34.815 INFO:tasks.workunit.client.0.smithi003.stderr: -345> 2023-12-03T11:48:34.665+0000 7f3e660ae640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:48:34.815 INFO:tasks.workunit.client.0.smithi003.stderr: -344> 2023-12-03T11:48:34.666+0000 7f3e668af640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:48:34.815 INFO:tasks.workunit.client.0.smithi003.stderr: -343> 2023-12-03T11:48:34.666+0000 7f3e668af640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:48:34.815 INFO:tasks.workunit.client.0.smithi003.stderr: -342> 2023-12-03T11:48:34.666+0000 7f3e668af640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:48:34.815 INFO:tasks.workunit.client.0.smithi003.stderr: -341> 2023-12-03T11:48:34.666+0000 7f3e670b0640 10 monclient(hunting): get_auth_request con 0x5560f5bdf780 auth_method 0 2023-12-03T11:48:34.816 INFO:tasks.workunit.client.0.smithi003.stderr: -340> 2023-12-03T11:48:34.666+0000 7f3e670b0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:48:34.816 INFO:tasks.workunit.client.0.smithi003.stderr: -339> 2023-12-03T11:48:34.666+0000 7f3e670b0640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:48:34.816 INFO:tasks.workunit.client.0.smithi003.stderr: -338> 2023-12-03T11:48:34.666+0000 7f3e670b0640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:48:34.816 INFO:tasks.workunit.client.0.smithi003.stderr: -337> 2023-12-03T11:48:34.666+0000 7f3e660ae640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:48:34.816 INFO:tasks.workunit.client.0.smithi003.stderr: -336> 2023-12-03T11:48:34.666+0000 7f3e660ae640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:48:34.816 INFO:tasks.workunit.client.0.smithi003.stderr: -335> 2023-12-03T11:48:34.666+0000 7f3e660ae640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:48:34.816 INFO:tasks.workunit.client.0.smithi003.stderr: -334> 2023-12-03T11:48:34.666+0000 7f3e670b0640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:48:34.816 INFO:tasks.workunit.client.0.smithi003.stderr: -333> 2023-12-03T11:48:34.666+0000 7f3e670b0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:48:34.816 INFO:tasks.workunit.client.0.smithi003.stderr: -332> 2023-12-03T11:48:34.666+0000 7f3e670b0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:48:34.816 INFO:tasks.workunit.client.0.smithi003.stderr: -331> 2023-12-03T11:48:34.666+0000 7f3e668af640 10 monclient(hunting): handle_auth_done global_id 6404 payload 824 2023-12-03T11:48:34.816 INFO:tasks.workunit.client.0.smithi003.stderr: -330> 2023-12-03T11:48:34.666+0000 7f3e668af640 10 monclient: _finish_hunting 0 2023-12-03T11:48:34.816 INFO:tasks.workunit.client.0.smithi003.stderr: -329> 2023-12-03T11:48:34.666+0000 7f3e668af640 1 monclient: found mon.noname-c 2023-12-03T11:48:34.816 INFO:tasks.workunit.client.0.smithi003.stderr: -328> 2023-12-03T11:48:34.666+0000 7f3e668af640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.3:3301/0 2023-12-03T11:48:34.816 INFO:tasks.workunit.client.0.smithi003.stderr: -327> 2023-12-03T11:48:34.666+0000 7f3e477fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:48:34.816 INFO:tasks.workunit.client.0.smithi003.stderr: -326> 2023-12-03T11:48:34.666+0000 7f3e477fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-12-03T11:48:34.816 INFO:tasks.workunit.client.0.smithi003.stderr: -325> 2023-12-03T11:48:34.666+0000 7f3e477fe640 10 monclient: dump: 2023-12-03T11:48:34.817 INFO:tasks.workunit.client.0.smithi003.stderr:epoch 1 2023-12-03T11:48:34.817 INFO:tasks.workunit.client.0.smithi003.stderr:fsid 296556de-a4fc-4095-9b6d-0fe813c2865c 2023-12-03T11:48:34.817 INFO:tasks.workunit.client.0.smithi003.stderr:last_changed 2023-12-03T11:33:18.862564+0000 2023-12-03T11:48:34.817 INFO:tasks.workunit.client.0.smithi003.stderr:created 2023-12-03T11:33:18.862564+0000 2023-12-03T11:48:34.817 INFO:tasks.workunit.client.0.smithi003.stderr:min_mon_release 18 (reef) 2023-12-03T11:48:34.817 INFO:tasks.workunit.client.0.smithi003.stderr:election_strategy: 1 2023-12-03T11:48:34.817 INFO:tasks.workunit.client.0.smithi003.stderr:0: [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] mon.a 2023-12-03T11:48:34.817 INFO:tasks.workunit.client.0.smithi003.stderr:1: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.b 2023-12-03T11:48:34.817 INFO:tasks.workunit.client.0.smithi003.stderr:2: [v2:172.21.15.3:3301/0,v1:172.21.15.3:6790/0] mon.c 2023-12-03T11:48:34.817 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:48:34.817 INFO:tasks.workunit.client.0.smithi003.stderr: -324> 2023-12-03T11:48:34.666+0000 7f3e477fe640 10 monclient: _finish_auth 0 2023-12-03T11:48:34.817 INFO:tasks.workunit.client.0.smithi003.stderr: -323> 2023-12-03T11:48:34.666+0000 7f3e477fe640 10 monclient: _check_auth_tickets 2023-12-03T11:48:34.817 INFO:tasks.workunit.client.0.smithi003.stderr: -322> 2023-12-03T11:48:34.666+0000 7f3e477fe640 10 monclient: handle_config config(0 keys) v1 2023-12-03T11:48:34.817 INFO:tasks.workunit.client.0.smithi003.stderr: -321> 2023-12-03T11:48:34.666+0000 7f3e477fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:48:34.817 INFO:tasks.workunit.client.0.smithi003.stderr: -320> 2023-12-03T11:48:34.666+0000 7f3e477fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-12-03T11:48:34.817 INFO:tasks.workunit.client.0.smithi003.stderr: -319> 2023-12-03T11:48:34.666+0000 7f3e477fe640 10 monclient: dump: 2023-12-03T11:48:34.818 INFO:tasks.workunit.client.0.smithi003.stderr:epoch 1 2023-12-03T11:48:34.818 INFO:tasks.workunit.client.0.smithi003.stderr:fsid 296556de-a4fc-4095-9b6d-0fe813c2865c 2023-12-03T11:48:34.818 INFO:tasks.workunit.client.0.smithi003.stderr:last_changed 2023-12-03T11:33:18.862564+0000 2023-12-03T11:48:34.818 INFO:tasks.workunit.client.0.smithi003.stderr:created 2023-12-03T11:33:18.862564+0000 2023-12-03T11:48:34.818 INFO:tasks.workunit.client.0.smithi003.stderr:min_mon_release 18 (reef) 2023-12-03T11:48:34.818 INFO:tasks.workunit.client.0.smithi003.stderr:election_strategy: 1 2023-12-03T11:48:34.818 INFO:tasks.workunit.client.0.smithi003.stderr:0: [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] mon.a 2023-12-03T11:48:34.818 INFO:tasks.workunit.client.0.smithi003.stderr:1: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.b 2023-12-03T11:48:34.818 INFO:tasks.workunit.client.0.smithi003.stderr:2: [v2:172.21.15.3:3301/0,v1:172.21.15.3:6790/0] mon.c 2023-12-03T11:48:34.818 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:48:34.818 INFO:tasks.workunit.client.0.smithi003.stderr: -318> 2023-12-03T11:48:34.666+0000 7f3e68daf800 5 monclient: authenticate success, global_id 6404 2023-12-03T11:48:34.818 INFO:tasks.workunit.client.0.smithi003.stderr: -317> 2023-12-03T11:48:34.666+0000 7f3e4d7fa640 4 set_mon_vals no callback set 2023-12-03T11:48:34.818 INFO:tasks.workunit.client.0.smithi003.stderr: -316> 2023-12-03T11:48:34.666+0000 7f3e68daf800 10 monclient: _renew_subs 2023-12-03T11:48:34.818 INFO:tasks.workunit.client.0.smithi003.stderr: -315> 2023-12-03T11:48:34.666+0000 7f3e68daf800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.3:3301/0 2023-12-03T11:48:34.818 INFO:tasks.workunit.client.0.smithi003.stderr: -314> 2023-12-03T11:48:34.666+0000 7f3e68daf800 10 monclient: _renew_subs 2023-12-03T11:48:34.819 INFO:tasks.workunit.client.0.smithi003.stderr: -313> 2023-12-03T11:48:34.666+0000 7f3e68daf800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.3:3301/0 2023-12-03T11:48:34.819 INFO:tasks.workunit.client.0.smithi003.stderr: -312> 2023-12-03T11:48:34.666+0000 7f3e68daf800 1 librados: init done 2023-12-03T11:48:34.819 INFO:tasks.workunit.client.0.smithi003.stderr: -311> 2023-12-03T11:48:34.667+0000 7f3e68daf800 20 rados->read ofs=0 len=0 2023-12-03T11:48:34.819 INFO:tasks.workunit.client.0.smithi003.stderr: -310> 2023-12-03T11:48:34.668+0000 7f3e477fe640 4 mgrc handle_mgr_map Got map version 5 2023-12-03T11:48:34.819 INFO:tasks.workunit.client.0.smithi003.stderr: -309> 2023-12-03T11:48:34.668+0000 7f3e477fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.37:6832/2165065416,v1:172.21.15.37:6833/2165065416] 2023-12-03T11:48:34.819 INFO:tasks.workunit.client.0.smithi003.stderr: -308> 2023-12-03T11:48:34.668+0000 7f3e477fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.37:6832/2165065416,v1:172.21.15.37:6833/2165065416] 2023-12-03T11:48:34.819 INFO:tasks.workunit.client.0.smithi003.stderr: -307> 2023-12-03T11:48:34.668+0000 7f3e660ae640 10 monclient: get_auth_request con 0x7f3e40069820 auth_method 0 2023-12-03T11:48:34.819 INFO:tasks.workunit.client.0.smithi003.stderr: -306> 2023-12-03T11:48:34.668+0000 7f3e670b0640 10 monclient: get_auth_request con 0x5560f5bf4760 auth_method 0 2023-12-03T11:48:34.819 INFO:tasks.workunit.client.0.smithi003.stderr: -305> 2023-12-03T11:48:34.669+0000 7f3e68daf800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:34.819 INFO:tasks.workunit.client.0.smithi003.stderr: -304> 2023-12-03T11:48:34.669+0000 7f3e68daf800 20 realm 2023-12-03T11:48:34.819 INFO:tasks.workunit.client.0.smithi003.stderr: -303> 2023-12-03T11:48:34.669+0000 7f3e68daf800 20 rados->read ofs=0 len=0 2023-12-03T11:48:34.819 INFO:tasks.workunit.client.0.smithi003.stderr: -302> 2023-12-03T11:48:34.669+0000 7f3e68daf800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:34.819 INFO:tasks.workunit.client.0.smithi003.stderr: -301> 2023-12-03T11:48:34.669+0000 7f3e68daf800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:48:34.819 INFO:tasks.workunit.client.0.smithi003.stderr: -300> 2023-12-03T11:48:34.669+0000 7f3e68daf800 20 rados->read ofs=0 len=0 2023-12-03T11:48:34.819 INFO:tasks.workunit.client.0.smithi003.stderr: -299> 2023-12-03T11:48:34.669+0000 7f3e68daf800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:34.820 INFO:tasks.workunit.client.0.smithi003.stderr: -298> 2023-12-03T11:48:34.669+0000 7f3e68daf800 20 rados->read ofs=0 len=0 2023-12-03T11:48:34.820 INFO:tasks.workunit.client.0.smithi003.stderr: -297> 2023-12-03T11:48:34.669+0000 7f3e668af640 10 monclient: get_auth_request con 0x5560f5bf86d0 auth_method 0 2023-12-03T11:48:34.820 INFO:tasks.workunit.client.0.smithi003.stderr: -296> 2023-12-03T11:48:34.670+0000 7f3e68daf800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:48:34.820 INFO:tasks.workunit.client.0.smithi003.stderr: -295> 2023-12-03T11:48:34.670+0000 7f3e68daf800 20 rados->read ofs=0 len=0 2023-12-03T11:48:34.820 INFO:tasks.workunit.client.0.smithi003.stderr: -294> 2023-12-03T11:48:34.670+0000 7f3e68daf800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:48:34.820 INFO:tasks.workunit.client.0.smithi003.stderr: -293> 2023-12-03T11:48:34.670+0000 7f3e68daf800 20 searching for the correct realm 2023-12-03T11:48:34.820 INFO:tasks.workunit.client.0.smithi003.stderr: -292> 2023-12-03T11:48:34.671+0000 7f3e660ae640 10 monclient: get_auth_request con 0x5560f5bfd6d0 auth_method 0 2023-12-03T11:48:34.820 INFO:tasks.workunit.client.0.smithi003.stderr: -291> 2023-12-03T11:48:34.671+0000 7f3e670b0640 10 monclient: get_auth_request con 0x7f3e5c02f040 auth_method 0 2023-12-03T11:48:34.820 INFO:tasks.workunit.client.0.smithi003.stderr: -290> 2023-12-03T11:48:34.672+0000 7f3e668af640 10 monclient: get_auth_request con 0x7f3e60067070 auth_method 0 2023-12-03T11:48:34.820 INFO:tasks.workunit.client.0.smithi003.stderr: -289> 2023-12-03T11:48:34.673+0000 7f3e660ae640 10 monclient: get_auth_request con 0x7f3e5806e060 auth_method 0 2023-12-03T11:48:34.820 INFO:tasks.workunit.client.0.smithi003.stderr: -288> 2023-12-03T11:48:34.675+0000 7f3e670b0640 10 monclient: get_auth_request con 0x7f3e5c0223f0 auth_method 0 2023-12-03T11:48:34.820 INFO:tasks.workunit.client.0.smithi003.stderr: -287> 2023-12-03T11:48:34.677+0000 7f3e668af640 10 monclient: get_auth_request con 0x7f3e5c0168f0 auth_method 0 2023-12-03T11:48:34.820 INFO:tasks.workunit.client.0.smithi003.stderr: -286> 2023-12-03T11:48:34.680+0000 7f3e660ae640 0 -- 172.21.15.3:0/2313644263 >> [v2:172.21.15.3:6817/3356208405,v1:172.21.15.3:6819/3356208405] conn(0x5560f5bfd6d0 msgr2=0x5560f5bffac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:48:34.820 INFO:tasks.workunit.client.0.smithi003.stderr: -285> 2023-12-03T11:48:34.680+0000 7f3e477fe640 1 client.6404.objecter ms_handle_reset 0x5560f5bfd6d0 session 0x5560f5989060 osd.3 2023-12-03T11:48:34.821 INFO:tasks.workunit.client.0.smithi003.stderr: -284> 2023-12-03T11:48:34.680+0000 7f3e477fe640 10 monclient: _renew_subs 2023-12-03T11:48:34.821 INFO:tasks.workunit.client.0.smithi003.stderr: -283> 2023-12-03T11:48:34.680+0000 7f3e477fe640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.3:3301/0 2023-12-03T11:48:34.821 INFO:tasks.workunit.client.0.smithi003.stderr: -282> 2023-12-03T11:48:34.680+0000 7f3e660ae640 10 monclient: get_auth_request con 0x7f3e40079e10 auth_method 0 2023-12-03T11:48:34.821 INFO:tasks.workunit.client.0.smithi003.stderr: -281> 2023-12-03T11:48:34.681+0000 7f3e68daf800 20 RGWRados::pool_iterate: got zone_info.83aabb46-04b5-4c96-9933-c6bfb1173a73 2023-12-03T11:48:34.821 INFO:tasks.workunit.client.0.smithi003.stderr: -280> 2023-12-03T11:48:34.681+0000 7f3e68daf800 20 RGWRados::pool_iterate: got zonegroup_info.6a811aad-435d-4fdd-93c9-b7e0b50de429 2023-12-03T11:48:34.821 INFO:tasks.workunit.client.0.smithi003.stderr: -279> 2023-12-03T11:48:34.681+0000 7f3e68daf800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:48:34.821 INFO:tasks.workunit.client.0.smithi003.stderr: -278> 2023-12-03T11:48:34.681+0000 7f3e68daf800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:48:34.821 INFO:tasks.workunit.client.0.smithi003.stderr: -277> 2023-12-03T11:48:34.681+0000 7f3e68daf800 20 rados->read ofs=0 len=0 2023-12-03T11:48:34.821 INFO:tasks.workunit.client.0.smithi003.stderr: -276> 2023-12-03T11:48:34.682+0000 7f3e68daf800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:34.821 INFO:tasks.workunit.client.0.smithi003.stderr: -275> 2023-12-03T11:48:34.682+0000 7f3e68daf800 20 rados->read ofs=0 len=0 2023-12-03T11:48:34.821 INFO:tasks.workunit.client.0.smithi003.stderr: -274> 2023-12-03T11:48:34.682+0000 7f3e68daf800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:48:34.821 INFO:tasks.workunit.client.0.smithi003.stderr: -273> 2023-12-03T11:48:34.682+0000 7f3e68daf800 20 rados->read ofs=0 len=0 2023-12-03T11:48:34.821 INFO:tasks.workunit.client.0.smithi003.stderr: -272> 2023-12-03T11:48:34.683+0000 7f3e68daf800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:48:34.821 INFO:tasks.workunit.client.0.smithi003.stderr: -271> 2023-12-03T11:48:34.683+0000 7f3e68daf800 20 zone default found 2023-12-03T11:48:34.821 INFO:tasks.workunit.client.0.smithi003.stderr: -270> 2023-12-03T11:48:34.683+0000 7f3e68daf800 4 Realm: () 2023-12-03T11:48:34.821 INFO:tasks.workunit.client.0.smithi003.stderr: -269> 2023-12-03T11:48:34.683+0000 7f3e68daf800 4 ZoneGroup: default (6a811aad-435d-4fdd-93c9-b7e0b50de429) 2023-12-03T11:48:34.822 INFO:tasks.workunit.client.0.smithi003.stderr: -268> 2023-12-03T11:48:34.683+0000 7f3e68daf800 4 Zone: default (83aabb46-04b5-4c96-9933-c6bfb1173a73) 2023-12-03T11:48:34.822 INFO:tasks.workunit.client.0.smithi003.stderr: -267> 2023-12-03T11:48:34.683+0000 7f3e68daf800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:48:34.822 INFO:tasks.workunit.client.0.smithi003.stderr: -266> 2023-12-03T11:48:34.683+0000 7f3e68daf800 20 zonegroup default 2023-12-03T11:48:34.822 INFO:tasks.workunit.client.0.smithi003.stderr: -265> 2023-12-03T11:48:34.683+0000 7f3e68daf800 20 rados->read ofs=0 len=0 2023-12-03T11:48:34.822 INFO:tasks.workunit.client.0.smithi003.stderr: -264> 2023-12-03T11:48:34.683+0000 7f3e68daf800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:34.822 INFO:tasks.workunit.client.0.smithi003.stderr: -263> 2023-12-03T11:48:34.683+0000 7f3e68daf800 20 rados->read ofs=0 len=0 2023-12-03T11:48:34.822 INFO:tasks.workunit.client.0.smithi003.stderr: -262> 2023-12-03T11:48:34.683+0000 7f3e68daf800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:34.822 INFO:tasks.workunit.client.0.smithi003.stderr: -261> 2023-12-03T11:48:34.683+0000 7f3e68daf800 20 rados->read ofs=0 len=0 2023-12-03T11:48:34.822 INFO:tasks.workunit.client.0.smithi003.stderr: -260> 2023-12-03T11:48:34.684+0000 7f3e68daf800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:34.822 INFO:tasks.workunit.client.0.smithi003.stderr: -259> 2023-12-03T11:48:34.684+0000 7f3e68daf800 20 started sync module instance, tier type = 2023-12-03T11:48:34.822 INFO:tasks.workunit.client.0.smithi003.stderr: -258> 2023-12-03T11:48:34.684+0000 7f3e68daf800 20 started zone id=83aabb46-04b5-4c96-9933-c6bfb1173a73 (name=default) with tier type = 2023-12-03T11:48:34.822 INFO:tasks.workunit.client.0.smithi003.stderr: -257> 2023-12-03T11:48:34.690+0000 7f3e668af640 0 -- 172.21.15.3:0/2313644263 >> [v2:172.21.15.3:6800/2373485412,v1:172.21.15.3:6801/2373485412] conn(0x7f3e60067070 msgr2=0x7f3e60075480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:48:34.822 INFO:tasks.workunit.client.0.smithi003.stderr: -256> 2023-12-03T11:48:34.690+0000 7f3e477fe640 1 client.6404.objecter ms_handle_reset 0x7f3e60067070 session 0x7f3e6007c040 osd.2 2023-12-03T11:48:34.822 INFO:tasks.workunit.client.0.smithi003.stderr: -255> 2023-12-03T11:48:34.690+0000 7f3e668af640 10 monclient: get_auth_request con 0x5560f5bfd6d0 auth_method 0 2023-12-03T11:48:34.822 INFO:tasks.workunit.client.0.smithi003.stderr: -254> 2023-12-03T11:48:34.694+0000 7f3e68daf800 20 add_watcher() i=0 2023-12-03T11:48:34.823 INFO:tasks.workunit.client.0.smithi003.stderr: -253> 2023-12-03T11:48:34.694+0000 7f3e68daf800 20 add_watcher() i=1 2023-12-03T11:48:34.823 INFO:tasks.workunit.client.0.smithi003.stderr: -252> 2023-12-03T11:48:34.694+0000 7f3e68daf800 20 add_watcher() i=2 2023-12-03T11:48:34.823 INFO:tasks.workunit.client.0.smithi003.stderr: -251> 2023-12-03T11:48:34.694+0000 7f3e68daf800 20 add_watcher() i=3 2023-12-03T11:48:34.823 INFO:tasks.workunit.client.0.smithi003.stderr: -250> 2023-12-03T11:48:34.694+0000 7f3e68daf800 20 add_watcher() i=4 2023-12-03T11:48:34.823 INFO:tasks.workunit.client.0.smithi003.stderr: -249> 2023-12-03T11:48:34.694+0000 7f3e68daf800 20 add_watcher() i=5 2023-12-03T11:48:34.823 INFO:tasks.workunit.client.0.smithi003.stderr: -248> 2023-12-03T11:48:34.694+0000 7f3e68daf800 20 add_watcher() i=6 2023-12-03T11:48:34.823 INFO:tasks.workunit.client.0.smithi003.stderr: -247> 2023-12-03T11:48:34.695+0000 7f3e68daf800 20 add_watcher() i=7 2023-12-03T11:48:34.823 INFO:tasks.workunit.client.0.smithi003.stderr: -246> 2023-12-03T11:48:34.695+0000 7f3e68daf800 2 all 8 watchers are set, enabling cache 2023-12-03T11:48:34.823 INFO:tasks.workunit.client.0.smithi003.stderr: -245> 2023-12-03T11:48:34.697+0000 7f3e68daf800 5 AuthRegistry(0x7fff3da20450) adding auth protocol: cephx 2023-12-03T11:48:34.823 INFO:tasks.workunit.client.0.smithi003.stderr: -244> 2023-12-03T11:48:34.697+0000 7f3e68daf800 5 AuthRegistry(0x7fff3da20450) adding auth protocol: cephx 2023-12-03T11:48:34.823 INFO:tasks.workunit.client.0.smithi003.stderr: -243> 2023-12-03T11:48:34.697+0000 7f3e68daf800 5 AuthRegistry(0x7fff3da20450) adding auth protocol: cephx 2023-12-03T11:48:34.823 INFO:tasks.workunit.client.0.smithi003.stderr: -242> 2023-12-03T11:48:34.697+0000 7f3e68daf800 5 AuthRegistry(0x7fff3da20450) adding con mode: secure 2023-12-03T11:48:34.823 INFO:tasks.workunit.client.0.smithi003.stderr: -241> 2023-12-03T11:48:34.697+0000 7f3e68daf800 5 AuthRegistry(0x7fff3da20450) adding con mode: crc 2023-12-03T11:48:34.823 INFO:tasks.workunit.client.0.smithi003.stderr: -240> 2023-12-03T11:48:34.697+0000 7f3e68daf800 5 AuthRegistry(0x7fff3da20450) adding con mode: secure 2023-12-03T11:48:34.823 INFO:tasks.workunit.client.0.smithi003.stderr: -239> 2023-12-03T11:48:34.697+0000 7f3e68daf800 5 AuthRegistry(0x7fff3da20450) adding con mode: crc 2023-12-03T11:48:34.824 INFO:tasks.workunit.client.0.smithi003.stderr: -238> 2023-12-03T11:48:34.697+0000 7f3e68daf800 5 AuthRegistry(0x7fff3da20450) adding con mode: secure 2023-12-03T11:48:34.824 INFO:tasks.workunit.client.0.smithi003.stderr: -237> 2023-12-03T11:48:34.697+0000 7f3e68daf800 5 AuthRegistry(0x7fff3da20450) adding con mode: crc 2023-12-03T11:48:34.824 INFO:tasks.workunit.client.0.smithi003.stderr: -236> 2023-12-03T11:48:34.697+0000 7f3e68daf800 5 AuthRegistry(0x7fff3da20450) adding con mode: crc 2023-12-03T11:48:34.824 INFO:tasks.workunit.client.0.smithi003.stderr: -235> 2023-12-03T11:48:34.697+0000 7f3e68daf800 5 AuthRegistry(0x7fff3da20450) adding con mode: secure 2023-12-03T11:48:34.824 INFO:tasks.workunit.client.0.smithi003.stderr: -234> 2023-12-03T11:48:34.697+0000 7f3e68daf800 5 AuthRegistry(0x7fff3da20450) adding con mode: crc 2023-12-03T11:48:34.824 INFO:tasks.workunit.client.0.smithi003.stderr: -233> 2023-12-03T11:48:34.697+0000 7f3e68daf800 5 AuthRegistry(0x7fff3da20450) adding con mode: secure 2023-12-03T11:48:34.824 INFO:tasks.workunit.client.0.smithi003.stderr: -232> 2023-12-03T11:48:34.697+0000 7f3da7fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:48:34.824 INFO:tasks.workunit.client.0.smithi003.stderr: -231> 2023-12-03T11:48:34.697+0000 7f3e68daf800 5 AuthRegistry(0x7fff3da20450) adding con mode: crc 2023-12-03T11:48:34.824 INFO:tasks.workunit.client.0.smithi003.stderr: -230> 2023-12-03T11:48:34.697+0000 7f3e68daf800 5 AuthRegistry(0x7fff3da20450) adding con mode: secure 2023-12-03T11:48:34.824 INFO:tasks.workunit.client.0.smithi003.stderr: -229> 2023-12-03T11:48:34.697+0000 7f3e68daf800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:48:34.824 INFO:tasks.workunit.client.0.smithi003.stderr: -228> 2023-12-03T11:48:34.697+0000 7f3e68daf800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:48:34.824 INFO:tasks.workunit.client.0.smithi003.stderr: -227> 2023-12-03T11:48:34.697+0000 7f3e68daf800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:48:34.824 INFO:tasks.workunit.client.0.smithi003.stderr: -226> 2023-12-03T11:48:34.697+0000 7f3e68daf800 5 asok(0x5560f599ca10) register_command cache list hook 0x5560f5b8ed60 2023-12-03T11:48:34.824 INFO:tasks.workunit.client.0.smithi003.stderr: -225> 2023-12-03T11:48:34.697+0000 7f3e68daf800 5 asok(0x5560f599ca10) register_command cache inspect hook 0x5560f5b8ed60 2023-12-03T11:48:34.824 INFO:tasks.workunit.client.0.smithi003.stderr: -224> 2023-12-03T11:48:34.697+0000 7f3e68daf800 5 asok(0x5560f599ca10) register_command cache erase hook 0x5560f5b8ed60 2023-12-03T11:48:34.824 INFO:tasks.workunit.client.0.smithi003.stderr: -223> 2023-12-03T11:48:34.697+0000 7f3e68daf800 5 asok(0x5560f599ca10) register_command cache zap hook 0x5560f5b8ed60 2023-12-03T11:48:34.825 INFO:tasks.workunit.client.0.smithi003.stderr: -222> 2023-12-03T11:48:34.697+0000 7f3e68daf800 10 monclient: get_monmap_and_config 2023-12-03T11:48:34.825 INFO:tasks.workunit.client.0.smithi003.stderr: -221> 2023-12-03T11:48:34.697+0000 7f3e68daf800 10 monclient: build_initial_monmap 2023-12-03T11:48:34.825 INFO:tasks.workunit.client.0.smithi003.stderr: -220> 2023-12-03T11:48:34.697+0000 7f3e68daf800 1 build_initial for_mkfs: 0 2023-12-03T11:48:34.825 INFO:tasks.workunit.client.0.smithi003.stderr: -219> 2023-12-03T11:48:34.697+0000 7f3e68daf800 10 monclient: monmap: 2023-12-03T11:48:34.825 INFO:tasks.workunit.client.0.smithi003.stderr:epoch 0 2023-12-03T11:48:34.825 INFO:tasks.workunit.client.0.smithi003.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-12-03T11:48:34.825 INFO:tasks.workunit.client.0.smithi003.stderr:last_changed 0.000000 2023-12-03T11:48:34.825 INFO:tasks.workunit.client.0.smithi003.stderr:created 0.000000 2023-12-03T11:48:34.825 INFO:tasks.workunit.client.0.smithi003.stderr:min_mon_release 0 (unknown) 2023-12-03T11:48:34.825 INFO:tasks.workunit.client.0.smithi003.stderr:election_strategy: 1 2023-12-03T11:48:34.825 INFO:tasks.workunit.client.0.smithi003.stderr:0: [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] mon.noname-a 2023-12-03T11:48:34.825 INFO:tasks.workunit.client.0.smithi003.stderr:1: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.noname-b 2023-12-03T11:48:34.825 INFO:tasks.workunit.client.0.smithi003.stderr:2: [v2:172.21.15.3:3301/0,v1:172.21.15.3:6790/0] mon.noname-c 2023-12-03T11:48:34.825 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:48:34.825 INFO:tasks.workunit.client.0.smithi003.stderr: -218> 2023-12-03T11:48:34.697+0000 7f3e68daf800 5 AuthRegistry(0x5560f5c39350) adding auth protocol: cephx 2023-12-03T11:48:34.826 INFO:tasks.workunit.client.0.smithi003.stderr: -217> 2023-12-03T11:48:34.697+0000 7f3e68daf800 5 AuthRegistry(0x5560f5c39350) adding auth protocol: cephx 2023-12-03T11:48:34.826 INFO:tasks.workunit.client.0.smithi003.stderr: -216> 2023-12-03T11:48:34.697+0000 7f3e68daf800 5 AuthRegistry(0x5560f5c39350) adding auth protocol: cephx 2023-12-03T11:48:34.826 INFO:tasks.workunit.client.0.smithi003.stderr: -215> 2023-12-03T11:48:34.697+0000 7f3e68daf800 5 AuthRegistry(0x5560f5c39350) adding con mode: secure 2023-12-03T11:48:34.826 INFO:tasks.workunit.client.0.smithi003.stderr: -214> 2023-12-03T11:48:34.697+0000 7f3e68daf800 5 AuthRegistry(0x5560f5c39350) adding con mode: crc 2023-12-03T11:48:34.826 INFO:tasks.workunit.client.0.smithi003.stderr: -213> 2023-12-03T11:48:34.697+0000 7f3e68daf800 5 AuthRegistry(0x5560f5c39350) adding con mode: secure 2023-12-03T11:48:34.826 INFO:tasks.workunit.client.0.smithi003.stderr: -212> 2023-12-03T11:48:34.697+0000 7f3e68daf800 5 AuthRegistry(0x5560f5c39350) adding con mode: crc 2023-12-03T11:48:34.826 INFO:tasks.workunit.client.0.smithi003.stderr: -211> 2023-12-03T11:48:34.697+0000 7f3e68daf800 5 AuthRegistry(0x5560f5c39350) adding con mode: secure 2023-12-03T11:48:34.826 INFO:tasks.workunit.client.0.smithi003.stderr: -210> 2023-12-03T11:48:34.697+0000 7f3e68daf800 5 AuthRegistry(0x5560f5c39350) adding con mode: crc 2023-12-03T11:48:34.826 INFO:tasks.workunit.client.0.smithi003.stderr: -209> 2023-12-03T11:48:34.697+0000 7f3e68daf800 5 AuthRegistry(0x5560f5c39350) adding con mode: crc 2023-12-03T11:48:34.826 INFO:tasks.workunit.client.0.smithi003.stderr: -208> 2023-12-03T11:48:34.697+0000 7f3e68daf800 5 AuthRegistry(0x5560f5c39350) adding con mode: secure 2023-12-03T11:48:34.826 INFO:tasks.workunit.client.0.smithi003.stderr: -207> 2023-12-03T11:48:34.697+0000 7f3e68daf800 5 AuthRegistry(0x5560f5c39350) adding con mode: crc 2023-12-03T11:48:34.826 INFO:tasks.workunit.client.0.smithi003.stderr: -206> 2023-12-03T11:48:34.697+0000 7f3e68daf800 5 AuthRegistry(0x5560f5c39350) adding con mode: secure 2023-12-03T11:48:34.826 INFO:tasks.workunit.client.0.smithi003.stderr: -205> 2023-12-03T11:48:34.697+0000 7f3e68daf800 5 AuthRegistry(0x5560f5c39350) adding con mode: crc 2023-12-03T11:48:34.826 INFO:tasks.workunit.client.0.smithi003.stderr: -204> 2023-12-03T11:48:34.697+0000 7f3e68daf800 5 AuthRegistry(0x5560f5c39350) adding con mode: secure 2023-12-03T11:48:34.826 INFO:tasks.workunit.client.0.smithi003.stderr: -203> 2023-12-03T11:48:34.697+0000 7f3e68daf800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:48:34.827 INFO:tasks.workunit.client.0.smithi003.stderr: -202> 2023-12-03T11:48:34.697+0000 7f3e68daf800 10 monclient: init 2023-12-03T11:48:34.827 INFO:tasks.workunit.client.0.smithi003.stderr: -201> 2023-12-03T11:48:34.697+0000 7f3e68daf800 5 AuthRegistry(0x7fff3da1ffa0) adding auth protocol: cephx 2023-12-03T11:48:34.827 INFO:tasks.workunit.client.0.smithi003.stderr: -200> 2023-12-03T11:48:34.697+0000 7f3e68daf800 5 AuthRegistry(0x7fff3da1ffa0) adding auth protocol: cephx 2023-12-03T11:48:34.827 INFO:tasks.workunit.client.0.smithi003.stderr: -199> 2023-12-03T11:48:34.697+0000 7f3e68daf800 5 AuthRegistry(0x7fff3da1ffa0) adding auth protocol: cephx 2023-12-03T11:48:34.827 INFO:tasks.workunit.client.0.smithi003.stderr: -198> 2023-12-03T11:48:34.697+0000 7f3e68daf800 5 AuthRegistry(0x7fff3da1ffa0) adding con mode: secure 2023-12-03T11:48:34.827 INFO:tasks.workunit.client.0.smithi003.stderr: -197> 2023-12-03T11:48:34.697+0000 7f3e68daf800 5 AuthRegistry(0x7fff3da1ffa0) adding con mode: crc 2023-12-03T11:48:34.827 INFO:tasks.workunit.client.0.smithi003.stderr: -196> 2023-12-03T11:48:34.697+0000 7f3e68daf800 5 AuthRegistry(0x7fff3da1ffa0) adding con mode: secure 2023-12-03T11:48:34.827 INFO:tasks.workunit.client.0.smithi003.stderr: -195> 2023-12-03T11:48:34.697+0000 7f3e68daf800 5 AuthRegistry(0x7fff3da1ffa0) adding con mode: crc 2023-12-03T11:48:34.827 INFO:tasks.workunit.client.0.smithi003.stderr: -194> 2023-12-03T11:48:34.697+0000 7f3e68daf800 5 AuthRegistry(0x7fff3da1ffa0) adding con mode: secure 2023-12-03T11:48:34.827 INFO:tasks.workunit.client.0.smithi003.stderr: -193> 2023-12-03T11:48:34.697+0000 7f3e68daf800 5 AuthRegistry(0x7fff3da1ffa0) adding con mode: crc 2023-12-03T11:48:34.827 INFO:tasks.workunit.client.0.smithi003.stderr: -192> 2023-12-03T11:48:34.697+0000 7f3e68daf800 5 AuthRegistry(0x7fff3da1ffa0) adding con mode: crc 2023-12-03T11:48:34.827 INFO:tasks.workunit.client.0.smithi003.stderr: -191> 2023-12-03T11:48:34.697+0000 7f3e68daf800 5 AuthRegistry(0x7fff3da1ffa0) adding con mode: secure 2023-12-03T11:48:34.827 INFO:tasks.workunit.client.0.smithi003.stderr: -190> 2023-12-03T11:48:34.697+0000 7f3e68daf800 5 AuthRegistry(0x7fff3da1ffa0) adding con mode: crc 2023-12-03T11:48:34.827 INFO:tasks.workunit.client.0.smithi003.stderr: -189> 2023-12-03T11:48:34.697+0000 7f3e68daf800 5 AuthRegistry(0x7fff3da1ffa0) adding con mode: secure 2023-12-03T11:48:34.827 INFO:tasks.workunit.client.0.smithi003.stderr: -188> 2023-12-03T11:48:34.697+0000 7f3e68daf800 5 AuthRegistry(0x7fff3da1ffa0) adding con mode: crc 2023-12-03T11:48:34.827 INFO:tasks.workunit.client.0.smithi003.stderr: -187> 2023-12-03T11:48:34.697+0000 7f3e68daf800 5 AuthRegistry(0x7fff3da1ffa0) adding con mode: secure 2023-12-03T11:48:34.828 INFO:tasks.workunit.client.0.smithi003.stderr: -186> 2023-12-03T11:48:34.698+0000 7f3e68daf800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:48:34.828 INFO:tasks.workunit.client.0.smithi003.stderr: -185> 2023-12-03T11:48:34.698+0000 7f3e68daf800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:48:34.828 INFO:tasks.workunit.client.0.smithi003.stderr: -184> 2023-12-03T11:48:34.698+0000 7f3e68daf800 5 asok(0x5560f599ca10) register_command rotate-key cmddesc rotate-key hook 0x7fff3da200e8 EEXIST 2023-12-03T11:48:34.828 INFO:tasks.workunit.client.0.smithi003.stderr: -183> 2023-12-03T11:48:34.698+0000 7f3e68daf800 10 monclient: _reopen_session rank -1 2023-12-03T11:48:34.828 INFO:tasks.workunit.client.0.smithi003.stderr: -182> 2023-12-03T11:48:34.698+0000 7f3e68daf800 10 monclient: _add_conns ranks=[0,2,1] 2023-12-03T11:48:34.828 INFO:tasks.workunit.client.0.smithi003.stderr: -181> 2023-12-03T11:48:34.698+0000 7f3e68daf800 10 monclient(hunting): picked mon.noname-a con 0x5560f5c3a8a0 addr [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] 2023-12-03T11:48:34.828 INFO:tasks.workunit.client.0.smithi003.stderr: -180> 2023-12-03T11:48:34.698+0000 7f3e68daf800 10 monclient(hunting): picked mon.noname-c con 0x5560f5c2ec70 addr [v2:172.21.15.3:3301/0,v1:172.21.15.3:6790/0] 2023-12-03T11:48:34.828 INFO:tasks.workunit.client.0.smithi003.stderr: -179> 2023-12-03T11:48:34.698+0000 7f3e68daf800 10 monclient(hunting): picked mon.noname-b con 0x5560f5c3b890 addr [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] 2023-12-03T11:48:34.828 INFO:tasks.workunit.client.0.smithi003.stderr: -178> 2023-12-03T11:48:34.698+0000 7f3e68daf800 10 monclient(hunting): start opening mon connection 2023-12-03T11:48:34.828 INFO:tasks.workunit.client.0.smithi003.stderr: -177> 2023-12-03T11:48:34.698+0000 7f3e68daf800 10 monclient(hunting): start opening mon connection 2023-12-03T11:48:34.828 INFO:tasks.workunit.client.0.smithi003.stderr: -176> 2023-12-03T11:48:34.698+0000 7f3e68daf800 10 monclient(hunting): start opening mon connection 2023-12-03T11:48:34.828 INFO:tasks.workunit.client.0.smithi003.stderr: -175> 2023-12-03T11:48:34.698+0000 7f3e68daf800 10 monclient(hunting): _renew_subs 2023-12-03T11:48:34.828 INFO:tasks.workunit.client.0.smithi003.stderr: -174> 2023-12-03T11:48:34.698+0000 7f3e68daf800 10 monclient(hunting): authenticate will time out at 1736.936740s 2023-12-03T11:48:34.828 INFO:tasks.workunit.client.0.smithi003.stderr: -173> 2023-12-03T11:48:34.698+0000 7f3e668af640 10 monclient(hunting): get_auth_request con 0x5560f5c2ec70 auth_method 0 2023-12-03T11:48:34.829 INFO:tasks.workunit.client.0.smithi003.stderr: -172> 2023-12-03T11:48:34.698+0000 7f3e668af640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:48:34.829 INFO:tasks.workunit.client.0.smithi003.stderr: -171> 2023-12-03T11:48:34.698+0000 7f3e668af640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:48:34.829 INFO:tasks.workunit.client.0.smithi003.stderr: -170> 2023-12-03T11:48:34.698+0000 7f3e668af640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:48:34.829 INFO:tasks.workunit.client.0.smithi003.stderr: -169> 2023-12-03T11:48:34.698+0000 7f3e670b0640 10 monclient(hunting): get_auth_request con 0x5560f5c3a8a0 auth_method 0 2023-12-03T11:48:34.829 INFO:tasks.workunit.client.0.smithi003.stderr: -168> 2023-12-03T11:48:34.698+0000 7f3e670b0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:48:34.829 INFO:tasks.workunit.client.0.smithi003.stderr: -167> 2023-12-03T11:48:34.698+0000 7f3e670b0640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:48:34.829 INFO:tasks.workunit.client.0.smithi003.stderr: -166> 2023-12-03T11:48:34.698+0000 7f3e670b0640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:48:34.829 INFO:tasks.workunit.client.0.smithi003.stderr: -165> 2023-12-03T11:48:34.698+0000 7f3e668af640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:48:34.829 INFO:tasks.workunit.client.0.smithi003.stderr: -164> 2023-12-03T11:48:34.698+0000 7f3e668af640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:48:34.829 INFO:tasks.workunit.client.0.smithi003.stderr: -163> 2023-12-03T11:48:34.698+0000 7f3e668af640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:48:34.829 INFO:tasks.workunit.client.0.smithi003.stderr: -162> 2023-12-03T11:48:34.698+0000 7f3e660ae640 10 monclient(hunting): get_auth_request con 0x5560f5c3b890 auth_method 0 2023-12-03T11:48:34.829 INFO:tasks.workunit.client.0.smithi003.stderr: -161> 2023-12-03T11:48:34.698+0000 7f3e660ae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:48:34.829 INFO:tasks.workunit.client.0.smithi003.stderr: -160> 2023-12-03T11:48:34.698+0000 7f3e660ae640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:48:34.829 INFO:tasks.workunit.client.0.smithi003.stderr: -159> 2023-12-03T11:48:34.698+0000 7f3e660ae640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:48:34.829 INFO:tasks.workunit.client.0.smithi003.stderr: -158> 2023-12-03T11:48:34.698+0000 7f3e670b0640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:48:34.829 INFO:tasks.workunit.client.0.smithi003.stderr: -157> 2023-12-03T11:48:34.698+0000 7f3e670b0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:48:34.830 INFO:tasks.workunit.client.0.smithi003.stderr: -156> 2023-12-03T11:48:34.698+0000 7f3e670b0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:48:34.830 INFO:tasks.workunit.client.0.smithi003.stderr: -155> 2023-12-03T11:48:34.698+0000 7f3e660ae640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:48:34.830 INFO:tasks.workunit.client.0.smithi003.stderr: -154> 2023-12-03T11:48:34.698+0000 7f3e660ae640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:48:34.830 INFO:tasks.workunit.client.0.smithi003.stderr: -153> 2023-12-03T11:48:34.698+0000 7f3e660ae640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:48:34.830 INFO:tasks.workunit.client.0.smithi003.stderr: -152> 2023-12-03T11:48:34.698+0000 7f3e668af640 10 monclient(hunting): handle_auth_done global_id 6407 payload 274 2023-12-03T11:48:34.830 INFO:tasks.workunit.client.0.smithi003.stderr: -151> 2023-12-03T11:48:34.698+0000 7f3e668af640 10 monclient: _finish_hunting 0 2023-12-03T11:48:34.830 INFO:tasks.workunit.client.0.smithi003.stderr: -150> 2023-12-03T11:48:34.698+0000 7f3e668af640 1 monclient: found mon.noname-c 2023-12-03T11:48:34.830 INFO:tasks.workunit.client.0.smithi003.stderr: -149> 2023-12-03T11:48:34.698+0000 7f3e668af640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.3:3301/0 2023-12-03T11:48:34.830 INFO:tasks.workunit.client.0.smithi003.stderr: -148> 2023-12-03T11:48:34.699+0000 7f3da77fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:48:34.830 INFO:tasks.workunit.client.0.smithi003.stderr: -147> 2023-12-03T11:48:34.699+0000 7f3da77fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-12-03T11:48:34.830 INFO:tasks.workunit.client.0.smithi003.stderr: -146> 2023-12-03T11:48:34.699+0000 7f3da77fe640 10 monclient: dump: 2023-12-03T11:48:34.830 INFO:tasks.workunit.client.0.smithi003.stderr:epoch 1 2023-12-03T11:48:34.830 INFO:tasks.workunit.client.0.smithi003.stderr:fsid 296556de-a4fc-4095-9b6d-0fe813c2865c 2023-12-03T11:48:34.830 INFO:tasks.workunit.client.0.smithi003.stderr:last_changed 2023-12-03T11:33:18.862564+0000 2023-12-03T11:48:34.830 INFO:tasks.workunit.client.0.smithi003.stderr:created 2023-12-03T11:33:18.862564+0000 2023-12-03T11:48:34.831 INFO:tasks.workunit.client.0.smithi003.stderr:min_mon_release 18 (reef) 2023-12-03T11:48:34.831 INFO:tasks.workunit.client.0.smithi003.stderr:election_strategy: 1 2023-12-03T11:48:34.831 INFO:tasks.workunit.client.0.smithi003.stderr:0: [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] mon.a 2023-12-03T11:48:34.831 INFO:tasks.workunit.client.0.smithi003.stderr:1: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.b 2023-12-03T11:48:34.831 INFO:tasks.workunit.client.0.smithi003.stderr:2: [v2:172.21.15.3:3301/0,v1:172.21.15.3:6790/0] mon.c 2023-12-03T11:48:34.831 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:48:34.831 INFO:tasks.workunit.client.0.smithi003.stderr: -145> 2023-12-03T11:48:34.699+0000 7f3da77fe640 10 monclient: _finish_auth 0 2023-12-03T11:48:34.831 INFO:tasks.workunit.client.0.smithi003.stderr: -144> 2023-12-03T11:48:34.699+0000 7f3da77fe640 10 monclient: _check_auth_tickets 2023-12-03T11:48:34.831 INFO:tasks.workunit.client.0.smithi003.stderr: -143> 2023-12-03T11:48:34.699+0000 7f3da77fe640 10 monclient: handle_config config(0 keys) v1 2023-12-03T11:48:34.831 INFO:tasks.workunit.client.0.smithi003.stderr: -142> 2023-12-03T11:48:34.699+0000 7f3da77fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:48:34.831 INFO:tasks.workunit.client.0.smithi003.stderr: -141> 2023-12-03T11:48:34.699+0000 7f3da77fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-12-03T11:48:34.831 INFO:tasks.workunit.client.0.smithi003.stderr: -140> 2023-12-03T11:48:34.699+0000 7f3da77fe640 10 monclient: dump: 2023-12-03T11:48:34.831 INFO:tasks.workunit.client.0.smithi003.stderr:epoch 1 2023-12-03T11:48:34.831 INFO:tasks.workunit.client.0.smithi003.stderr:fsid 296556de-a4fc-4095-9b6d-0fe813c2865c 2023-12-03T11:48:34.831 INFO:tasks.workunit.client.0.smithi003.stderr:last_changed 2023-12-03T11:33:18.862564+0000 2023-12-03T11:48:34.832 INFO:tasks.workunit.client.0.smithi003.stderr:created 2023-12-03T11:33:18.862564+0000 2023-12-03T11:48:34.832 INFO:tasks.workunit.client.0.smithi003.stderr:min_mon_release 18 (reef) 2023-12-03T11:48:34.832 INFO:tasks.workunit.client.0.smithi003.stderr:election_strategy: 1 2023-12-03T11:48:34.832 INFO:tasks.workunit.client.0.smithi003.stderr:0: [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] mon.a 2023-12-03T11:48:34.832 INFO:tasks.workunit.client.0.smithi003.stderr:1: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.b 2023-12-03T11:48:34.832 INFO:tasks.workunit.client.0.smithi003.stderr:2: [v2:172.21.15.3:3301/0,v1:172.21.15.3:6790/0] mon.c 2023-12-03T11:48:34.832 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:48:34.832 INFO:tasks.workunit.client.0.smithi003.stderr: -139> 2023-12-03T11:48:34.699+0000 7f3e68daf800 5 monclient: authenticate success, global_id 6407 2023-12-03T11:48:34.832 INFO:tasks.workunit.client.0.smithi003.stderr: -138> 2023-12-03T11:48:34.699+0000 7f3e68daf800 10 monclient: get_monmap_and_config success 2023-12-03T11:48:34.832 INFO:tasks.workunit.client.0.smithi003.stderr: -137> 2023-12-03T11:48:34.699+0000 7f3e68daf800 4 set_mon_vals no callback set 2023-12-03T11:48:34.832 INFO:tasks.workunit.client.0.smithi003.stderr: -136> 2023-12-03T11:48:34.699+0000 7f3e68daf800 10 monclient: shutdown 2023-12-03T11:48:34.832 INFO:tasks.workunit.client.0.smithi003.stderr: -135> 2023-12-03T11:48:34.699+0000 7f3e68daf800 10 monclient: build_initial_monmap 2023-12-03T11:48:34.832 INFO:tasks.workunit.client.0.smithi003.stderr: -134> 2023-12-03T11:48:34.699+0000 7f3e68daf800 1 build_initial for_mkfs: 0 2023-12-03T11:48:34.832 INFO:tasks.workunit.client.0.smithi003.stderr: -133> 2023-12-03T11:48:34.699+0000 7f3e68daf800 10 monclient: monmap: 2023-12-03T11:48:34.832 INFO:tasks.workunit.client.0.smithi003.stderr:epoch 0 2023-12-03T11:48:34.833 INFO:tasks.workunit.client.0.smithi003.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-12-03T11:48:34.833 INFO:tasks.workunit.client.0.smithi003.stderr:last_changed 0.000000 2023-12-03T11:48:34.833 INFO:tasks.workunit.client.0.smithi003.stderr:created 0.000000 2023-12-03T11:48:34.833 INFO:tasks.workunit.client.0.smithi003.stderr:min_mon_release 0 (unknown) 2023-12-03T11:48:34.833 INFO:tasks.workunit.client.0.smithi003.stderr:election_strategy: 1 2023-12-03T11:48:34.833 INFO:tasks.workunit.client.0.smithi003.stderr:0: [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] mon.noname-a 2023-12-03T11:48:34.833 INFO:tasks.workunit.client.0.smithi003.stderr:1: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.noname-b 2023-12-03T11:48:34.833 INFO:tasks.workunit.client.0.smithi003.stderr:2: [v2:172.21.15.3:3301/0,v1:172.21.15.3:6790/0] mon.noname-c 2023-12-03T11:48:34.833 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:48:34.833 INFO:tasks.workunit.client.0.smithi003.stderr: -132> 2023-12-03T11:48:34.699+0000 7f3e68daf800 5 AuthRegistry(0x5560f5c39260) adding auth protocol: cephx 2023-12-03T11:48:34.833 INFO:tasks.workunit.client.0.smithi003.stderr: -131> 2023-12-03T11:48:34.699+0000 7f3e68daf800 5 AuthRegistry(0x5560f5c39260) adding auth protocol: cephx 2023-12-03T11:48:34.833 INFO:tasks.workunit.client.0.smithi003.stderr: -130> 2023-12-03T11:48:34.699+0000 7f3e68daf800 5 AuthRegistry(0x5560f5c39260) adding auth protocol: cephx 2023-12-03T11:48:34.833 INFO:tasks.workunit.client.0.smithi003.stderr: -129> 2023-12-03T11:48:34.699+0000 7f3e68daf800 5 AuthRegistry(0x5560f5c39260) adding con mode: secure 2023-12-03T11:48:34.833 INFO:tasks.workunit.client.0.smithi003.stderr: -128> 2023-12-03T11:48:34.699+0000 7f3e68daf800 5 AuthRegistry(0x5560f5c39260) adding con mode: crc 2023-12-03T11:48:34.833 INFO:tasks.workunit.client.0.smithi003.stderr: -127> 2023-12-03T11:48:34.699+0000 7f3e68daf800 5 AuthRegistry(0x5560f5c39260) adding con mode: secure 2023-12-03T11:48:34.833 INFO:tasks.workunit.client.0.smithi003.stderr: -126> 2023-12-03T11:48:34.699+0000 7f3e68daf800 5 AuthRegistry(0x5560f5c39260) adding con mode: crc 2023-12-03T11:48:34.834 INFO:tasks.workunit.client.0.smithi003.stderr: -125> 2023-12-03T11:48:34.699+0000 7f3e68daf800 5 AuthRegistry(0x5560f5c39260) adding con mode: secure 2023-12-03T11:48:34.834 INFO:tasks.workunit.client.0.smithi003.stderr: -124> 2023-12-03T11:48:34.699+0000 7f3e68daf800 5 AuthRegistry(0x5560f5c39260) adding con mode: crc 2023-12-03T11:48:34.834 INFO:tasks.workunit.client.0.smithi003.stderr: -123> 2023-12-03T11:48:34.699+0000 7f3e68daf800 5 AuthRegistry(0x5560f5c39260) adding con mode: crc 2023-12-03T11:48:34.834 INFO:tasks.workunit.client.0.smithi003.stderr: -122> 2023-12-03T11:48:34.699+0000 7f3e68daf800 5 AuthRegistry(0x5560f5c39260) adding con mode: secure 2023-12-03T11:48:34.834 INFO:tasks.workunit.client.0.smithi003.stderr: -121> 2023-12-03T11:48:34.699+0000 7f3e68daf800 5 AuthRegistry(0x5560f5c39260) adding con mode: crc 2023-12-03T11:48:34.834 INFO:tasks.workunit.client.0.smithi003.stderr: -120> 2023-12-03T11:48:34.699+0000 7f3e68daf800 5 AuthRegistry(0x5560f5c39260) adding con mode: secure 2023-12-03T11:48:34.834 INFO:tasks.workunit.client.0.smithi003.stderr: -119> 2023-12-03T11:48:34.699+0000 7f3e68daf800 5 AuthRegistry(0x5560f5c39260) adding con mode: crc 2023-12-03T11:48:34.834 INFO:tasks.workunit.client.0.smithi003.stderr: -118> 2023-12-03T11:48:34.699+0000 7f3e68daf800 5 AuthRegistry(0x5560f5c39260) adding con mode: secure 2023-12-03T11:48:34.834 INFO:tasks.workunit.client.0.smithi003.stderr: -117> 2023-12-03T11:48:34.700+0000 7f3e68daf800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:48:34.834 INFO:tasks.workunit.client.0.smithi003.stderr: -116> 2023-12-03T11:48:34.700+0000 7f3e68daf800 1 librados: starting msgr at 2023-12-03T11:48:34.834 INFO:tasks.workunit.client.0.smithi003.stderr: -115> 2023-12-03T11:48:34.700+0000 7f3e68daf800 1 librados: starting objecter 2023-12-03T11:48:34.834 INFO:tasks.workunit.client.0.smithi003.stderr: -114> 2023-12-03T11:48:34.700+0000 7f3e68daf800 5 asok(0x5560f599ca10) register_command objecter_requests cmddesc objecter_requests hook 0x5560f5c02910 EEXIST 2023-12-03T11:48:34.834 INFO:tasks.workunit.client.0.smithi003.stderr: -113> 2023-12-03T11:48:34.700+0000 7f3e68daf800 1 librados: setting wanted keys 2023-12-03T11:48:34.834 INFO:tasks.workunit.client.0.smithi003.stderr: -112> 2023-12-03T11:48:34.700+0000 7f3e68daf800 1 librados: calling monclient init 2023-12-03T11:48:34.834 INFO:tasks.workunit.client.0.smithi003.stderr: -111> 2023-12-03T11:48:34.700+0000 7f3e68daf800 10 monclient: init 2023-12-03T11:48:34.835 INFO:tasks.workunit.client.0.smithi003.stderr: -110> 2023-12-03T11:48:34.700+0000 7f3e68daf800 5 AuthRegistry(0x5560f5c3c868) adding auth protocol: cephx 2023-12-03T11:48:34.835 INFO:tasks.workunit.client.0.smithi003.stderr: -109> 2023-12-03T11:48:34.700+0000 7f3e68daf800 5 AuthRegistry(0x5560f5c3c868) adding auth protocol: cephx 2023-12-03T11:48:34.835 INFO:tasks.workunit.client.0.smithi003.stderr: -108> 2023-12-03T11:48:34.700+0000 7f3e68daf800 5 AuthRegistry(0x5560f5c3c868) adding auth protocol: cephx 2023-12-03T11:48:34.835 INFO:tasks.workunit.client.0.smithi003.stderr: -107> 2023-12-03T11:48:34.700+0000 7f3e68daf800 5 AuthRegistry(0x5560f5c3c868) adding con mode: secure 2023-12-03T11:48:34.835 INFO:tasks.workunit.client.0.smithi003.stderr: -106> 2023-12-03T11:48:34.700+0000 7f3e68daf800 5 AuthRegistry(0x5560f5c3c868) adding con mode: crc 2023-12-03T11:48:34.835 INFO:tasks.workunit.client.0.smithi003.stderr: -105> 2023-12-03T11:48:34.700+0000 7f3e68daf800 5 AuthRegistry(0x5560f5c3c868) adding con mode: secure 2023-12-03T11:48:34.835 INFO:tasks.workunit.client.0.smithi003.stderr: -104> 2023-12-03T11:48:34.700+0000 7f3e68daf800 5 AuthRegistry(0x5560f5c3c868) adding con mode: crc 2023-12-03T11:48:34.835 INFO:tasks.workunit.client.0.smithi003.stderr: -103> 2023-12-03T11:48:34.700+0000 7f3e68daf800 5 AuthRegistry(0x5560f5c3c868) adding con mode: secure 2023-12-03T11:48:34.835 INFO:tasks.workunit.client.0.smithi003.stderr: -102> 2023-12-03T11:48:34.700+0000 7f3e68daf800 5 AuthRegistry(0x5560f5c3c868) adding con mode: crc 2023-12-03T11:48:34.835 INFO:tasks.workunit.client.0.smithi003.stderr: -101> 2023-12-03T11:48:34.700+0000 7f3e68daf800 5 AuthRegistry(0x5560f5c3c868) adding con mode: crc 2023-12-03T11:48:34.835 INFO:tasks.workunit.client.0.smithi003.stderr: -100> 2023-12-03T11:48:34.700+0000 7f3e68daf800 5 AuthRegistry(0x5560f5c3c868) adding con mode: secure 2023-12-03T11:48:34.835 INFO:tasks.workunit.client.0.smithi003.stderr: -99> 2023-12-03T11:48:34.700+0000 7f3e68daf800 5 AuthRegistry(0x5560f5c3c868) adding con mode: crc 2023-12-03T11:48:34.835 INFO:tasks.workunit.client.0.smithi003.stderr: -98> 2023-12-03T11:48:34.700+0000 7f3e68daf800 5 AuthRegistry(0x5560f5c3c868) adding con mode: secure 2023-12-03T11:48:34.835 INFO:tasks.workunit.client.0.smithi003.stderr: -97> 2023-12-03T11:48:34.700+0000 7f3e68daf800 5 AuthRegistry(0x5560f5c3c868) adding con mode: crc 2023-12-03T11:48:34.835 INFO:tasks.workunit.client.0.smithi003.stderr: -96> 2023-12-03T11:48:34.700+0000 7f3e68daf800 5 AuthRegistry(0x5560f5c3c868) adding con mode: secure 2023-12-03T11:48:34.835 INFO:tasks.workunit.client.0.smithi003.stderr: -95> 2023-12-03T11:48:34.700+0000 7f3e68daf800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:48:34.836 INFO:tasks.workunit.client.0.smithi003.stderr: -94> 2023-12-03T11:48:34.700+0000 7f3e68daf800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:48:34.836 INFO:tasks.workunit.client.0.smithi003.stderr: -93> 2023-12-03T11:48:34.700+0000 7f3e68daf800 5 asok(0x5560f599ca10) register_command rotate-key cmddesc rotate-key hook 0x5560f5c3c9b0 EEXIST 2023-12-03T11:48:34.836 INFO:tasks.workunit.client.0.smithi003.stderr: -92> 2023-12-03T11:48:34.700+0000 7f3e68daf800 10 monclient: _reopen_session rank -1 2023-12-03T11:48:34.836 INFO:tasks.workunit.client.0.smithi003.stderr: -91> 2023-12-03T11:48:34.700+0000 7f3e68daf800 10 monclient: _add_conns ranks=[0,2,1] 2023-12-03T11:48:34.836 INFO:tasks.workunit.client.0.smithi003.stderr: -90> 2023-12-03T11:48:34.700+0000 7f3e68daf800 10 monclient(hunting): picked mon.noname-a con 0x5560f5c2ec70 addr [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] 2023-12-03T11:48:34.836 INFO:tasks.workunit.client.0.smithi003.stderr: -89> 2023-12-03T11:48:34.700+0000 7f3e68daf800 10 monclient(hunting): picked mon.noname-c con 0x5560f5c3a8a0 addr [v2:172.21.15.3:3301/0,v1:172.21.15.3:6790/0] 2023-12-03T11:48:34.836 INFO:tasks.workunit.client.0.smithi003.stderr: -88> 2023-12-03T11:48:34.700+0000 7f3e68daf800 10 monclient(hunting): picked mon.noname-b con 0x5560f5c3b890 addr [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] 2023-12-03T11:48:34.836 INFO:tasks.workunit.client.0.smithi003.stderr: -87> 2023-12-03T11:48:34.700+0000 7f3e68daf800 10 monclient(hunting): start opening mon connection 2023-12-03T11:48:34.836 INFO:tasks.workunit.client.0.smithi003.stderr: -86> 2023-12-03T11:48:34.700+0000 7f3e68daf800 10 monclient(hunting): start opening mon connection 2023-12-03T11:48:34.836 INFO:tasks.workunit.client.0.smithi003.stderr: -85> 2023-12-03T11:48:34.700+0000 7f3e68daf800 10 monclient(hunting): start opening mon connection 2023-12-03T11:48:34.836 INFO:tasks.workunit.client.0.smithi003.stderr: -84> 2023-12-03T11:48:34.700+0000 7f3e68daf800 10 monclient(hunting): _renew_subs 2023-12-03T11:48:34.836 INFO:tasks.workunit.client.0.smithi003.stderr: -83> 2023-12-03T11:48:34.700+0000 7f3e68daf800 10 monclient(hunting): authenticate will time out at 1736.939208s 2023-12-03T11:48:34.836 INFO:tasks.workunit.client.0.smithi003.stderr: -82> 2023-12-03T11:48:34.701+0000 7f3e670b0640 10 monclient(hunting): get_auth_request con 0x5560f5c2ec70 auth_method 0 2023-12-03T11:48:34.836 INFO:tasks.workunit.client.0.smithi003.stderr: -81> 2023-12-03T11:48:34.701+0000 7f3e670b0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:48:34.836 INFO:tasks.workunit.client.0.smithi003.stderr: -80> 2023-12-03T11:48:34.701+0000 7f3e670b0640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:48:34.837 INFO:tasks.workunit.client.0.smithi003.stderr: -79> 2023-12-03T11:48:34.701+0000 7f3e670b0640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:48:34.837 INFO:tasks.workunit.client.0.smithi003.stderr: -78> 2023-12-03T11:48:34.701+0000 7f3e668af640 10 monclient(hunting): get_auth_request con 0x5560f5c3a8a0 auth_method 0 2023-12-03T11:48:34.837 INFO:tasks.workunit.client.0.smithi003.stderr: -77> 2023-12-03T11:48:34.701+0000 7f3e668af640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:48:34.837 INFO:tasks.workunit.client.0.smithi003.stderr: -76> 2023-12-03T11:48:34.701+0000 7f3e668af640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:48:34.837 INFO:tasks.workunit.client.0.smithi003.stderr: -75> 2023-12-03T11:48:34.701+0000 7f3e668af640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:48:34.837 INFO:tasks.workunit.client.0.smithi003.stderr: -74> 2023-12-03T11:48:34.701+0000 7f3e660ae640 10 monclient(hunting): get_auth_request con 0x5560f5c3b890 auth_method 0 2023-12-03T11:48:34.837 INFO:tasks.workunit.client.0.smithi003.stderr: -73> 2023-12-03T11:48:34.701+0000 7f3e660ae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:48:34.837 INFO:tasks.workunit.client.0.smithi003.stderr: -72> 2023-12-03T11:48:34.701+0000 7f3e660ae640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:48:34.837 INFO:tasks.workunit.client.0.smithi003.stderr: -71> 2023-12-03T11:48:34.701+0000 7f3e660ae640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:48:34.837 INFO:tasks.workunit.client.0.smithi003.stderr: -70> 2023-12-03T11:48:34.701+0000 7f3e670b0640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:48:34.837 INFO:tasks.workunit.client.0.smithi003.stderr: -69> 2023-12-03T11:48:34.701+0000 7f3e670b0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:48:34.837 INFO:tasks.workunit.client.0.smithi003.stderr: -68> 2023-12-03T11:48:34.701+0000 7f3e670b0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:48:34.837 INFO:tasks.workunit.client.0.smithi003.stderr: -67> 2023-12-03T11:48:34.701+0000 7f3e668af640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:48:34.837 INFO:tasks.workunit.client.0.smithi003.stderr: -66> 2023-12-03T11:48:34.701+0000 7f3e668af640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:48:34.837 INFO:tasks.workunit.client.0.smithi003.stderr: -65> 2023-12-03T11:48:34.701+0000 7f3e668af640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:48:34.838 INFO:tasks.workunit.client.0.smithi003.stderr: -64> 2023-12-03T11:48:34.701+0000 7f3e660ae640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:48:34.838 INFO:tasks.workunit.client.0.smithi003.stderr: -63> 2023-12-03T11:48:34.701+0000 7f3e660ae640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:48:34.838 INFO:tasks.workunit.client.0.smithi003.stderr: -62> 2023-12-03T11:48:34.701+0000 7f3e660ae640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:48:34.838 INFO:tasks.workunit.client.0.smithi003.stderr: -61> 2023-12-03T11:48:34.701+0000 7f3e668af640 10 monclient(hunting): handle_auth_done global_id 6410 payload 824 2023-12-03T11:48:34.838 INFO:tasks.workunit.client.0.smithi003.stderr: -60> 2023-12-03T11:48:34.701+0000 7f3e668af640 10 monclient: _finish_hunting 0 2023-12-03T11:48:34.838 INFO:tasks.workunit.client.0.smithi003.stderr: -59> 2023-12-03T11:48:34.701+0000 7f3e668af640 1 monclient: found mon.noname-c 2023-12-03T11:48:34.838 INFO:tasks.workunit.client.0.smithi003.stderr: -58> 2023-12-03T11:48:34.701+0000 7f3e668af640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.3:3301/0 2023-12-03T11:48:34.838 INFO:tasks.workunit.client.0.smithi003.stderr: -57> 2023-12-03T11:48:34.701+0000 7f3da5ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:48:34.838 INFO:tasks.workunit.client.0.smithi003.stderr: -56> 2023-12-03T11:48:34.701+0000 7f3da5ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-12-03T11:48:34.838 INFO:tasks.workunit.client.0.smithi003.stderr: -55> 2023-12-03T11:48:34.701+0000 7f3da5ffb640 10 monclient: dump: 2023-12-03T11:48:34.838 INFO:tasks.workunit.client.0.smithi003.stderr:epoch 1 2023-12-03T11:48:34.838 INFO:tasks.workunit.client.0.smithi003.stderr:fsid 296556de-a4fc-4095-9b6d-0fe813c2865c 2023-12-03T11:48:34.838 INFO:tasks.workunit.client.0.smithi003.stderr:last_changed 2023-12-03T11:33:18.862564+0000 2023-12-03T11:48:34.838 INFO:tasks.workunit.client.0.smithi003.stderr:created 2023-12-03T11:33:18.862564+0000 2023-12-03T11:48:34.838 INFO:tasks.workunit.client.0.smithi003.stderr:min_mon_release 18 (reef) 2023-12-03T11:48:34.839 INFO:tasks.workunit.client.0.smithi003.stderr:election_strategy: 1 2023-12-03T11:48:34.839 INFO:tasks.workunit.client.0.smithi003.stderr:0: [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] mon.a 2023-12-03T11:48:34.839 INFO:tasks.workunit.client.0.smithi003.stderr:1: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.b 2023-12-03T11:48:34.839 INFO:tasks.workunit.client.0.smithi003.stderr:2: [v2:172.21.15.3:3301/0,v1:172.21.15.3:6790/0] mon.c 2023-12-03T11:48:34.839 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:48:34.839 INFO:tasks.workunit.client.0.smithi003.stderr: -54> 2023-12-03T11:48:34.701+0000 7f3da5ffb640 10 monclient: _finish_auth 0 2023-12-03T11:48:34.839 INFO:tasks.workunit.client.0.smithi003.stderr: -53> 2023-12-03T11:48:34.701+0000 7f3da5ffb640 10 monclient: _check_auth_tickets 2023-12-03T11:48:34.839 INFO:tasks.workunit.client.0.smithi003.stderr: -52> 2023-12-03T11:48:34.701+0000 7f3da5ffb640 10 monclient: handle_config config(0 keys) v1 2023-12-03T11:48:34.839 INFO:tasks.workunit.client.0.smithi003.stderr: -51> 2023-12-03T11:48:34.701+0000 7f3da5ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:48:34.839 INFO:tasks.workunit.client.0.smithi003.stderr: -50> 2023-12-03T11:48:34.701+0000 7f3da5ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-12-03T11:48:34.839 INFO:tasks.workunit.client.0.smithi003.stderr: -49> 2023-12-03T11:48:34.701+0000 7f3da5ffb640 10 monclient: dump: 2023-12-03T11:48:34.839 INFO:tasks.workunit.client.0.smithi003.stderr:epoch 1 2023-12-03T11:48:34.839 INFO:tasks.workunit.client.0.smithi003.stderr:fsid 296556de-a4fc-4095-9b6d-0fe813c2865c 2023-12-03T11:48:34.839 INFO:tasks.workunit.client.0.smithi003.stderr:last_changed 2023-12-03T11:33:18.862564+0000 2023-12-03T11:48:34.839 INFO:tasks.workunit.client.0.smithi003.stderr:created 2023-12-03T11:33:18.862564+0000 2023-12-03T11:48:34.839 INFO:tasks.workunit.client.0.smithi003.stderr:min_mon_release 18 (reef) 2023-12-03T11:48:34.840 INFO:tasks.workunit.client.0.smithi003.stderr:election_strategy: 1 2023-12-03T11:48:34.840 INFO:tasks.workunit.client.0.smithi003.stderr:0: [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] mon.a 2023-12-03T11:48:34.840 INFO:tasks.workunit.client.0.smithi003.stderr:1: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.b 2023-12-03T11:48:34.840 INFO:tasks.workunit.client.0.smithi003.stderr:2: [v2:172.21.15.3:3301/0,v1:172.21.15.3:6790/0] mon.c 2023-12-03T11:48:34.840 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:48:34.840 INFO:tasks.workunit.client.0.smithi003.stderr: -48> 2023-12-03T11:48:34.701+0000 7f3da77fe640 4 set_mon_vals no callback set 2023-12-03T11:48:34.840 INFO:tasks.workunit.client.0.smithi003.stderr: -47> 2023-12-03T11:48:34.701+0000 7f3e68daf800 5 monclient: authenticate success, global_id 6410 2023-12-03T11:48:34.840 INFO:tasks.workunit.client.0.smithi003.stderr: -46> 2023-12-03T11:48:34.701+0000 7f3e68daf800 10 monclient: _renew_subs 2023-12-03T11:48:34.840 INFO:tasks.workunit.client.0.smithi003.stderr: -45> 2023-12-03T11:48:34.701+0000 7f3e68daf800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.3:3301/0 2023-12-03T11:48:34.840 INFO:tasks.workunit.client.0.smithi003.stderr: -44> 2023-12-03T11:48:34.701+0000 7f3e68daf800 10 monclient: _renew_subs 2023-12-03T11:48:34.840 INFO:tasks.workunit.client.0.smithi003.stderr: -43> 2023-12-03T11:48:34.701+0000 7f3e68daf800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.3:3301/0 2023-12-03T11:48:34.840 INFO:tasks.workunit.client.0.smithi003.stderr: -42> 2023-12-03T11:48:34.701+0000 7f3e68daf800 1 librados: init done 2023-12-03T11:48:34.840 INFO:tasks.workunit.client.0.smithi003.stderr: -41> 2023-12-03T11:48:34.701+0000 7f3e68daf800 5 asok(0x5560f599ca10) register_command cr dump hook 0x5560f5c3e708 2023-12-03T11:48:34.840 INFO:tasks.workunit.client.0.smithi003.stderr: -40> 2023-12-03T11:48:34.703+0000 7f3da5ffb640 4 mgrc handle_mgr_map Got map version 5 2023-12-03T11:48:34.840 INFO:tasks.workunit.client.0.smithi003.stderr: -39> 2023-12-03T11:48:34.703+0000 7f3da5ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.37:6832/2165065416,v1:172.21.15.37:6833/2165065416] 2023-12-03T11:48:34.841 INFO:tasks.workunit.client.0.smithi003.stderr: -38> 2023-12-03T11:48:34.703+0000 7f3da5ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.37:6832/2165065416,v1:172.21.15.37:6833/2165065416] 2023-12-03T11:48:34.841 INFO:tasks.workunit.client.0.smithi003.stderr: -37> 2023-12-03T11:48:34.703+0000 7f3e670b0640 10 monclient: get_auth_request con 0x7f3d98069850 auth_method 0 2023-12-03T11:48:34.841 INFO:tasks.workunit.client.0.smithi003.stderr: -36> 2023-12-03T11:48:34.703+0000 7f3e68daf800 5 note: GC not initialized 2023-12-03T11:48:34.841 INFO:tasks.workunit.client.0.smithi003.stderr: -35> 2023-12-03T11:48:34.703+0000 7f3d96ffd640 20 reqs_thread_entry: start 2023-12-03T11:48:34.841 INFO:tasks.workunit.client.0.smithi003.stderr: -34> 2023-12-03T11:48:34.703+0000 7f3e68daf800 5 asok(0x5560f599ca10) register_command sync trace show hook 0x7f3e60004720 2023-12-03T11:48:34.841 INFO:tasks.workunit.client.0.smithi003.stderr: -33> 2023-12-03T11:48:34.703+0000 7f3e68daf800 5 asok(0x5560f599ca10) register_command sync trace history hook 0x7f3e60004720 2023-12-03T11:48:34.841 INFO:tasks.workunit.client.0.smithi003.stderr: -32> 2023-12-03T11:48:34.703+0000 7f3e68daf800 5 asok(0x5560f599ca10) register_command sync trace active hook 0x7f3e60004720 2023-12-03T11:48:34.841 INFO:tasks.workunit.client.0.smithi003.stderr: -31> 2023-12-03T11:48:34.703+0000 7f3e68daf800 5 asok(0x5560f599ca10) register_command sync trace active_short hook 0x7f3e60004720 2023-12-03T11:48:34.841 INFO:tasks.workunit.client.0.smithi003.stderr: -30> 2023-12-03T11:48:34.703+0000 7f3e68daf800 20 init_complete bucket index max shards: 11 2023-12-03T11:48:34.841 INFO:tasks.workunit.client.0.smithi003.stderr: -29> 2023-12-03T11:48:34.703+0000 7f3e68daf800 20 Filter name: none 2023-12-03T11:48:34.841 INFO:tasks.workunit.client.0.smithi003.stderr: -28> 2023-12-03T11:48:34.703+0000 7f3d94ff9640 20 reqs_thread_entry: start 2023-12-03T11:48:34.841 INFO:tasks.workunit.client.0.smithi003.stderr: -27> 2023-12-03T11:48:34.703+0000 7f3e68daf800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2023-12-03T11:48:34.841 INFO:tasks.workunit.client.0.smithi003.stderr: -26> 2023-12-03T11:48:34.703+0000 7f3e68daf800 20 rados->read ofs=0 len=0 2023-12-03T11:48:34.841 INFO:tasks.workunit.client.0.smithi003.stderr: -25> 2023-12-03T11:48:34.704+0000 7f3e68daf800 20 rados_obj.operate() r=0 bl.length=213 2023-12-03T11:48:34.841 INFO:tasks.workunit.client.0.smithi003.stderr: -24> 2023-12-03T11:48:34.704+0000 7f3e68daf800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2023-12-03T11:48:34.842 INFO:tasks.workunit.client.0.smithi003.stderr: -23> 2023-12-03T11:48:34.704+0000 7f3e68daf800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2023-12-03T11:48:34.842 INFO:tasks.workunit.client.0.smithi003.stderr: -22> 2023-12-03T11:48:34.704+0000 7f3e68daf800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.23 : miss 2023-12-03T11:48:34.842 INFO:tasks.workunit.client.0.smithi003.stderr: -21> 2023-12-03T11:48:34.704+0000 7f3e68daf800 20 rados->read ofs=0 len=0 2023-12-03T11:48:34.842 INFO:tasks.workunit.client.0.smithi003.stderr: -20> 2023-12-03T11:48:34.704+0000 7f3e68daf800 20 rados_obj.operate() r=0 bl.length=385 2023-12-03T11:48:34.842 INFO:tasks.workunit.client.0.smithi003.stderr: -19> 2023-12-03T11:48:34.704+0000 7f3e68daf800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.23 info.flags=0x17 2023-12-03T11:48:34.842 INFO:tasks.workunit.client.0.smithi003.stderr: -18> 2023-12-03T11:48:34.704+0000 7f3e68daf800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.23 to cache LRU end 2023-12-03T11:48:34.842 INFO:tasks.workunit.client.0.smithi003.stderr: -17> 2023-12-03T11:48:34.704+0000 7f3e68daf800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:48:34.842 INFO:tasks.workunit.client.0.smithi003.stderr: -16> 2023-12-03T11:48:34.704+0000 7f3e68daf800 10 updating xattr: name=user.rgw.acl bl.length()=265 2023-12-03T11:48:34.842 INFO:tasks.workunit.client.0.smithi003.stderr: -15> 2023-12-03T11:48:34.704+0000 7f3e68daf800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.23 2023-12-03T11:48:34.842 INFO:tasks.workunit.client.0.smithi003.stderr: -14> 2023-12-03T11:48:34.705+0000 7f3e660ae640 10 monclient: get_auth_request con 0x5560f5c896c0 auth_method 0 2023-12-03T11:48:34.842 INFO:tasks.workunit.client.0.smithi003.stderr: -13> 2023-12-03T11:48:34.710+0000 7f3e68daf800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.23 info.flags=0x17 2023-12-03T11:48:34.842 INFO:tasks.workunit.client.0.smithi003.stderr: -12> 2023-12-03T11:48:34.710+0000 7f3e68daf800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.23 to cache LRU end 2023-12-03T11:48:34.842 INFO:tasks.workunit.client.0.smithi003.stderr: -11> 2023-12-03T11:48:34.710+0000 7f3e68daf800 10 updating xattr: name=user.rgw.acl bl.length()=265 2023-12-03T11:48:34.842 INFO:tasks.workunit.client.0.smithi003.stderr: -10> 2023-12-03T11:48:34.710+0000 7f3e68daf800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.23, ofs0, ns] 2023-12-03T11:48:34.843 INFO:tasks.workunit.client.0.smithi003.stderr: -9> 2023-12-03T11:48:34.710+0000 7f3e4cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660508 cookie 93874928231680 notifier 6404 bl.length()=949 2023-12-03T11:48:34.843 INFO:tasks.workunit.client.0.smithi003.stderr: -8> 2023-12-03T11:48:34.710+0000 7f3e4cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.23 info.flags=0x17 2023-12-03T11:48:34.843 INFO:tasks.workunit.client.0.smithi003.stderr: -7> 2023-12-03T11:48:34.710+0000 7f3e4cff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.23 to cache LRU end 2023-12-03T11:48:34.843 INFO:tasks.workunit.client.0.smithi003.stderr: -6> 2023-12-03T11:48:34.710+0000 7f3e4cff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2023-12-03T11:48:34.843 INFO:tasks.workunit.client.0.smithi003.stderr: -5> 2023-12-03T11:48:34.711+0000 7f3e68daf800 20 handle_bi_update(): bucket=:abort-at-block-writes[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.23]): orig_sources= new_sources= 2023-12-03T11:48:34.843 INFO:tasks.workunit.client.0.smithi003.stderr: -4> 2023-12-03T11:48:34.711+0000 7f3e68daf800 20 handle_bi_update(): bucket=:abort-at-block-writes[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.23]): potential sources added=[] removed=[] 2023-12-03T11:48:34.843 INFO:tasks.workunit.client.0.smithi003.stderr: -3> 2023-12-03T11:48:34.711+0000 7f3e68daf800 20 handle_bi_update(): bucket=:abort-at-block-writes[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.23]): orig_dests= new_dests= 2023-12-03T11:48:34.843 INFO:tasks.workunit.client.0.smithi003.stderr: -2> 2023-12-03T11:48:34.711+0000 7f3e68daf800 20 handle_bi_update(): bucket=:abort-at-block-writes[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.23]): potential dests added=[] removed=[] 2023-12-03T11:48:34.843 INFO:tasks.workunit.client.0.smithi003.stderr: -1> 2023-12-03T11:48:34.712+0000 7f3e68daf800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7537-gbcbf278c/rpm/el9/BUILD/ceph-18.0.0-7537-gbcbf278c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f3e68daf800 time 2023-12-03T11:48:34.712941+0000 2023-12-03T11:48:34.843 INFO:tasks.workunit.client.0.smithi003.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7537-gbcbf278c/rpm/el9/BUILD/ceph-18.0.0-7537-gbcbf278c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2023-12-03T11:48:34.843 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:48:34.843 INFO:tasks.workunit.client.0.smithi003.stderr: ceph version 18.0.0-7537-gbcbf278c (bcbf278cf395873c2a482f5a7b2345faf2160319) reef (dev) 2023-12-03T11:48:34.843 INFO:tasks.workunit.client.0.smithi003.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f3e6d76eef8] 2023-12-03T11:48:34.843 INFO:tasks.workunit.client.0.smithi003.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f0b6) [0x7f3e6d76f0b6] 2023-12-03T11:48:34.843 INFO:tasks.workunit.client.0.smithi003.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5560f453fa71] 2023-12-03T11:48:34.844 INFO:tasks.workunit.client.0.smithi003.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x2a4) [0x5560f454bec4] 2023-12-03T11:48:34.844 INFO:tasks.workunit.client.0.smithi003.stderr: 5: main() 2023-12-03T11:48:34.844 INFO:tasks.workunit.client.0.smithi003.stderr: 6: /lib64/libc.so.6(+0x3feb0) [0x7f3e6b03feb0] 2023-12-03T11:48:34.844 INFO:tasks.workunit.client.0.smithi003.stderr: 7: __libc_start_main() 2023-12-03T11:48:34.844 INFO:tasks.workunit.client.0.smithi003.stderr: 8: _start() 2023-12-03T11:48:34.844 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:48:34.844 INFO:tasks.workunit.client.0.smithi003.stderr: 0> 2023-12-03T11:48:34.713+0000 7f3e68daf800 -1 *** Caught signal (Aborted) ** 2023-12-03T11:48:34.844 INFO:tasks.workunit.client.0.smithi003.stderr: in thread 7f3e68daf800 thread_name:radosgw-admin 2023-12-03T11:48:34.844 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:48:34.844 INFO:tasks.workunit.client.0.smithi003.stderr: ceph version 18.0.0-7537-gbcbf278c (bcbf278cf395873c2a482f5a7b2345faf2160319) reef (dev) 2023-12-03T11:48:34.844 INFO:tasks.workunit.client.0.smithi003.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f3e6b054db0] 2023-12-03T11:48:34.844 INFO:tasks.workunit.client.0.smithi003.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f3e6b0a154c] 2023-12-03T11:48:34.844 INFO:tasks.workunit.client.0.smithi003.stderr: 3: raise() 2023-12-03T11:48:34.844 INFO:tasks.workunit.client.0.smithi003.stderr: 4: abort() 2023-12-03T11:48:34.844 INFO:tasks.workunit.client.0.smithi003.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f3e6d76ef52] 2023-12-03T11:48:34.844 INFO:tasks.workunit.client.0.smithi003.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f0b6) [0x7f3e6d76f0b6] 2023-12-03T11:48:34.845 INFO:tasks.workunit.client.0.smithi003.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5560f453fa71] 2023-12-03T11:48:34.845 INFO:tasks.workunit.client.0.smithi003.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x2a4) [0x5560f454bec4] 2023-12-03T11:48:34.845 INFO:tasks.workunit.client.0.smithi003.stderr: 9: main() 2023-12-03T11:48:34.845 INFO:tasks.workunit.client.0.smithi003.stderr: 10: /lib64/libc.so.6(+0x3feb0) [0x7f3e6b03feb0] 2023-12-03T11:48:34.845 INFO:tasks.workunit.client.0.smithi003.stderr: 11: __libc_start_main() 2023-12-03T11:48:34.845 INFO:tasks.workunit.client.0.smithi003.stderr: 12: _start() 2023-12-03T11:48:34.845 INFO:tasks.workunit.client.0.smithi003.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-12-03T11:48:34.845 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:48:34.845 INFO:tasks.workunit.client.0.smithi003.stderr:--- logging levels --- 2023-12-03T11:48:34.845 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 none 2023-12-03T11:48:34.845 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 1 lockdep 2023-12-03T11:48:34.845 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 1 context 2023-12-03T11:48:34.845 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 1 crush 2023-12-03T11:48:34.845 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 mds 2023-12-03T11:48:34.845 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 mds_balancer 2023-12-03T11:48:34.846 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 mds_locker 2023-12-03T11:48:34.846 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 mds_log 2023-12-03T11:48:34.846 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 mds_log_expire 2023-12-03T11:48:34.846 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 mds_migrator 2023-12-03T11:48:34.846 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 1 buffer 2023-12-03T11:48:34.846 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 1 timer 2023-12-03T11:48:34.846 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 1 filer 2023-12-03T11:48:34.846 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 1 striper 2023-12-03T11:48:34.846 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 1 objecter 2023-12-03T11:48:34.846 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 rados 2023-12-03T11:48:34.846 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 rbd 2023-12-03T11:48:34.846 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 rbd_mirror 2023-12-03T11:48:34.846 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 rbd_replay 2023-12-03T11:48:34.846 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 rbd_pwl 2023-12-03T11:48:34.846 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 journaler 2023-12-03T11:48:34.847 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 objectcacher 2023-12-03T11:48:34.847 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 immutable_obj_cache 2023-12-03T11:48:34.847 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 client 2023-12-03T11:48:34.847 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 osd 2023-12-03T11:48:34.847 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 optracker 2023-12-03T11:48:34.847 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 objclass 2023-12-03T11:48:34.847 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 3 filestore 2023-12-03T11:48:34.847 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 3 journal 2023-12-03T11:48:34.847 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 0 ms 2023-12-03T11:48:34.847 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 mon 2023-12-03T11:48:34.847 INFO:tasks.workunit.client.0.smithi003.stderr: 0/10 monc 2023-12-03T11:48:34.847 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 paxos 2023-12-03T11:48:34.847 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 tp 2023-12-03T11:48:34.847 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 auth 2023-12-03T11:48:34.847 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 crypto 2023-12-03T11:48:34.847 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 1 finisher 2023-12-03T11:48:34.848 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 1 reserver 2023-12-03T11:48:34.848 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 heartbeatmap 2023-12-03T11:48:34.848 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 perfcounter 2023-12-03T11:48:34.848 INFO:tasks.workunit.client.0.smithi003.stderr: 20/20 rgw 2023-12-03T11:48:34.848 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 rgw_sync 2023-12-03T11:48:34.848 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 rgw_datacache 2023-12-03T11:48:34.848 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 rgw_access 2023-12-03T11:48:34.848 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 rgw_dbstore 2023-12-03T11:48:34.848 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 rgw_flight 2023-12-03T11:48:34.848 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 javaclient 2023-12-03T11:48:34.848 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 asok 2023-12-03T11:48:34.848 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 1 throttle 2023-12-03T11:48:34.848 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 0 refs 2023-12-03T11:48:34.848 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 compressor 2023-12-03T11:48:34.848 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 bluestore 2023-12-03T11:48:34.848 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 bluefs 2023-12-03T11:48:34.849 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 3 bdev 2023-12-03T11:48:34.849 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 kstore 2023-12-03T11:48:34.849 INFO:tasks.workunit.client.0.smithi003.stderr: 4/ 5 rocksdb 2023-12-03T11:48:34.849 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 fuse 2023-12-03T11:48:34.849 INFO:tasks.workunit.client.0.smithi003.stderr: 2/ 5 mgr 2023-12-03T11:48:34.849 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 mgrc 2023-12-03T11:48:34.849 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 dpdk 2023-12-03T11:48:34.849 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 eventtrace 2023-12-03T11:48:34.849 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 prioritycache 2023-12-03T11:48:34.849 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 test 2023-12-03T11:48:34.849 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 cephfs_mirror 2023-12-03T11:48:34.849 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 cephsqlite 2023-12-03T11:48:34.849 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 crimson_interrupt 2023-12-03T11:48:34.849 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 seastore 2023-12-03T11:48:34.849 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 seastore_onode 2023-12-03T11:48:34.849 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 seastore_odata 2023-12-03T11:48:34.850 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 seastore_omap 2023-12-03T11:48:34.850 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 seastore_tm 2023-12-03T11:48:34.850 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 seastore_t 2023-12-03T11:48:34.850 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 seastore_cleaner 2023-12-03T11:48:34.850 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 seastore_epm 2023-12-03T11:48:34.850 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 seastore_lba 2023-12-03T11:48:34.850 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 seastore_fixedkv_tree 2023-12-03T11:48:34.850 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 seastore_cache 2023-12-03T11:48:34.850 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 seastore_journal 2023-12-03T11:48:34.850 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 seastore_device 2023-12-03T11:48:34.850 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 seastore_backref 2023-12-03T11:48:34.850 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 alienstore 2023-12-03T11:48:34.850 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 mclock 2023-12-03T11:48:34.850 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 cyanstore 2023-12-03T11:48:34.850 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 ceph_exporter 2023-12-03T11:48:34.851 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 memstore 2023-12-03T11:48:34.851 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 trace 2023-12-03T11:48:34.851 INFO:tasks.workunit.client.0.smithi003.stderr: -2/-2 (syslog threshold) 2023-12-03T11:48:34.851 INFO:tasks.workunit.client.0.smithi003.stderr: 99/99 (stderr threshold) 2023-12-03T11:48:34.851 INFO:tasks.workunit.client.0.smithi003.stderr:--- pthread ID / name mapping for recent threads --- 2023-12-03T11:48:34.851 INFO:tasks.workunit.client.0.smithi003.stderr: 7f3d94ff9640 / http_manager 2023-12-03T11:48:34.851 INFO:tasks.workunit.client.0.smithi003.stderr: 7f3d96ffd640 / http_manager 2023-12-03T11:48:34.851 INFO:tasks.workunit.client.0.smithi003.stderr: 7f3da5ffb640 / ms_dispatch 2023-12-03T11:48:34.851 INFO:tasks.workunit.client.0.smithi003.stderr: 7f3da77fe640 / io_context_pool 2023-12-03T11:48:34.851 INFO:tasks.workunit.client.0.smithi003.stderr: 7f3da7fff640 / rgw_dt_lg_renew 2023-12-03T11:48:34.851 INFO:tasks.workunit.client.0.smithi003.stderr: 7f3e477fe640 / ms_dispatch 2023-12-03T11:48:34.851 INFO:tasks.workunit.client.0.smithi003.stderr: 7f3e4cff9640 / io_context_pool 2023-12-03T11:48:34.851 INFO:tasks.workunit.client.0.smithi003.stderr: 7f3e4d7fa640 / io_context_pool 2023-12-03T11:48:34.851 INFO:tasks.workunit.client.0.smithi003.stderr: 7f3e4ffff640 / ms_dispatch 2023-12-03T11:48:34.851 INFO:tasks.workunit.client.0.smithi003.stderr: 7f3e660ae640 / msgr-worker-2 2023-12-03T11:48:34.851 INFO:tasks.workunit.client.0.smithi003.stderr: 7f3e668af640 / msgr-worker-1 2023-12-03T11:48:34.852 INFO:tasks.workunit.client.0.smithi003.stderr: 7f3e670b0640 / msgr-worker-0 2023-12-03T11:48:34.852 INFO:tasks.workunit.client.0.smithi003.stderr: 7f3e68daf800 / radosgw-admin 2023-12-03T11:48:34.852 INFO:tasks.workunit.client.0.smithi003.stderr: max_recent 500 2023-12-03T11:48:34.852 INFO:tasks.workunit.client.0.smithi003.stderr: max_new 1000 2023-12-03T11:48:34.852 INFO:tasks.workunit.client.0.smithi003.stderr: log_file /var/lib/ceph/crash/2023-12-03T11:48:34.714437Z_16a0f23c-ea7a-417c-815d-b9df01d7f130/log 2023-12-03T11:48:34.852 INFO:tasks.workunit.client.0.smithi003.stderr:--- end dump of recent events --- 2023-12-03T11:48:34.852 INFO:tasks.workunit.client.0.smithi003.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2023-12-03T11:48:34.857 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:48:34.857 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:48:34.857 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.761+0000 7f641b725800 20 rados->read ofs=0 len=0 2023-12-03T11:48:34.857 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.763+0000 7f641b725800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:34.857 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.763+0000 7f641b725800 20 realm 2023-12-03T11:48:34.857 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.763+0000 7f641b725800 20 rados->read ofs=0 len=0 2023-12-03T11:48:34.857 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.763+0000 7f641b725800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:34.857 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.763+0000 7f641b725800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:48:34.857 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.763+0000 7f641b725800 20 rados->read ofs=0 len=0 2023-12-03T11:48:34.858 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.763+0000 7f641b725800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:34.858 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.763+0000 7f641b725800 20 rados->read ofs=0 len=0 2023-12-03T11:48:34.858 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.764+0000 7f641b725800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:48:34.858 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.764+0000 7f641b725800 20 rados->read ofs=0 len=0 2023-12-03T11:48:34.858 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.764+0000 7f641b725800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:48:34.858 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.764+0000 7f641b725800 20 searching for the correct realm 2023-12-03T11:48:34.858 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.774+0000 7f64174e5640 0 -- 172.21.15.3:0/2824694738 >> [v2:172.21.15.37:6805/1692844418,v1:172.21.15.37:6807/1692844418] conn(0x5576ecddfaa0 msgr2=0x5576ecde1eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-03T11:48:34.858 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.775+0000 7f641b725800 20 RGWRados::pool_iterate: got zone_info.83aabb46-04b5-4c96-9933-c6bfb1173a73 2023-12-03T11:48:34.858 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.775+0000 7f641b725800 20 RGWRados::pool_iterate: got zonegroup_info.6a811aad-435d-4fdd-93c9-b7e0b50de429 2023-12-03T11:48:34.858 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.775+0000 7f641b725800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:48:34.858 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.775+0000 7f641b725800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:48:34.858 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.775+0000 7f641b725800 20 rados->read ofs=0 len=0 2023-12-03T11:48:34.858 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.776+0000 7f641b725800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:34.858 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.776+0000 7f641b725800 20 rados->read ofs=0 len=0 2023-12-03T11:48:34.858 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.776+0000 7f641b725800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:48:34.859 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.776+0000 7f641b725800 20 rados->read ofs=0 len=0 2023-12-03T11:48:34.859 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.777+0000 7f641b725800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:48:34.859 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.777+0000 7f641b725800 20 zone default found 2023-12-03T11:48:34.859 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.777+0000 7f641b725800 4 Realm: () 2023-12-03T11:48:34.859 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.777+0000 7f641b725800 4 ZoneGroup: default (6a811aad-435d-4fdd-93c9-b7e0b50de429) 2023-12-03T11:48:34.859 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.777+0000 7f641b725800 4 Zone: default (83aabb46-04b5-4c96-9933-c6bfb1173a73) 2023-12-03T11:48:34.859 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.777+0000 7f641b725800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:48:34.859 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.777+0000 7f641b725800 20 zonegroup default 2023-12-03T11:48:34.859 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.777+0000 7f641b725800 20 rados->read ofs=0 len=0 2023-12-03T11:48:34.859 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.777+0000 7f641b725800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:34.859 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.777+0000 7f641b725800 20 rados->read ofs=0 len=0 2023-12-03T11:48:34.859 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.777+0000 7f641b725800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:34.859 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.777+0000 7f641b725800 20 rados->read ofs=0 len=0 2023-12-03T11:48:34.859 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.778+0000 7f641b725800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:34.859 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.778+0000 7f641b725800 20 started sync module instance, tier type = 2023-12-03T11:48:34.859 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.778+0000 7f641b725800 20 started zone id=83aabb46-04b5-4c96-9933-c6bfb1173a73 (name=default) with tier type = 2023-12-03T11:48:34.860 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.784+0000 7f6416ce4640 0 -- 172.21.15.3:0/2824694738 >> [v2:172.21.15.3:6817/3356208405,v1:172.21.15.3:6819/3356208405] conn(0x5576ecde4af0 msgr2=0x5576ecde6ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:48:34.860 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.787+0000 7f641b725800 20 add_watcher() i=0 2023-12-03T11:48:34.860 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.787+0000 7f641b725800 20 add_watcher() i=1 2023-12-03T11:48:34.860 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.787+0000 7f641b725800 20 add_watcher() i=2 2023-12-03T11:48:34.860 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.787+0000 7f641b725800 20 add_watcher() i=3 2023-12-03T11:48:34.860 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.787+0000 7f641b725800 20 add_watcher() i=4 2023-12-03T11:48:34.860 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.787+0000 7f641b725800 20 add_watcher() i=5 2023-12-03T11:48:34.860 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.787+0000 7f641b725800 20 add_watcher() i=6 2023-12-03T11:48:34.860 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.788+0000 7f641b725800 20 add_watcher() i=7 2023-12-03T11:48:34.860 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.788+0000 7f641b725800 2 all 8 watchers are set, enabling cache 2023-12-03T11:48:34.860 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.789+0000 7f63dd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:48:34.860 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.790+0000 7f641b725800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:48:34.860 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.790+0000 7f641b725800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:48:34.860 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.795+0000 7f641b725800 5 note: GC not initialized 2023-12-03T11:48:34.860 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.796+0000 7f634bfff640 20 reqs_thread_entry: start 2023-12-03T11:48:34.861 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.796+0000 7f641b725800 20 init_complete bucket index max shards: 11 2023-12-03T11:48:34.861 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.796+0000 7f641b725800 20 Filter name: none 2023-12-03T11:48:34.861 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.796+0000 7f6349ffb640 20 reqs_thread_entry: start 2023-12-03T11:48:34.861 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.796+0000 7f641b725800 20 rados->read ofs=0 len=0 2023-12-03T11:48:34.861 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.796+0000 7f641b725800 20 rados_obj.operate() r=0 bl.length=213 2023-12-03T11:48:34.861 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.796+0000 7f641b725800 20 rados->read ofs=0 len=0 2023-12-03T11:48:34.861 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.797+0000 7f641b725800 20 rados_obj.operate() r=0 bl.length=417 2023-12-03T11:48:34.861 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.797+0000 7f641b725800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:48:34.861 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.797+0000 7f641b725800 20 rados->read ofs=0 len=0 2023-12-03T11:48:34.861 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.797+0000 7f641b725800 20 rados_obj.operate() r=0 bl.length=213 2023-12-03T11:48:34.861 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.797+0000 7f641b725800 20 rados->read ofs=0 len=0 2023-12-03T11:48:34.861 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.798+0000 7f641b725800 20 rados_obj.operate() r=0 bl.length=417 2023-12-03T11:48:34.861 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.798+0000 7f641b725800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:48:34.861 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.799+0000 7f641b725800 20 rados->read ofs=0 len=0 2023-12-03T11:48:34.861 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.799+0000 7f641b725800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:34.861 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.800+0000 7f63dd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:48:34.862 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.802+0000 7f641b725800 20 remove_watcher() i=0 2023-12-03T11:48:34.862 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.802+0000 7f641b725800 2 removed watcher, disabling cache 2023-12-03T11:48:34.862 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.803+0000 7f641b725800 20 remove_watcher() i=1 2023-12-03T11:48:34.862 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.804+0000 7f641b725800 20 remove_watcher() i=2 2023-12-03T11:48:34.862 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.805+0000 7f641b725800 20 remove_watcher() i=3 2023-12-03T11:48:34.862 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.806+0000 7f641b725800 20 remove_watcher() i=4 2023-12-03T11:48:34.862 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.807+0000 7f641b725800 20 remove_watcher() i=5 2023-12-03T11:48:34.862 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.808+0000 7f641b725800 20 remove_watcher() i=6 2023-12-03T11:48:34.862 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.809+0000 7f641b725800 20 remove_watcher() i=7 2023-12-03T11:48:34.862 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:48:34.862 INFO:tasks.workunit.client.0.smithi003.stderr:BUCKET_STATS: 2023-12-03T11:48:34.862 INFO:tasks.workunit.client.0.smithi003.stderr:bucket: abort-at-block-writes id: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.23 num_objects: 20 size_kb: 1 num_shards: 11 2023-12-03T11:48:34.862 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:48:34.900 INFO:tasks.workunit.client.0.smithi003.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2023-12-03T11:48:34.932 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:48:34.932 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:48:34.946 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.945+0000 7f3249511800 20 rados->read ofs=0 len=0 2023-12-03T11:48:34.949 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.947+0000 7f3249511800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:34.949 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.947+0000 7f3249511800 20 realm 2023-12-03T11:48:34.949 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.947+0000 7f3249511800 20 rados->read ofs=0 len=0 2023-12-03T11:48:34.949 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.947+0000 7f3249511800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:34.949 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.947+0000 7f3249511800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:48:34.949 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.947+0000 7f3249511800 20 rados->read ofs=0 len=0 2023-12-03T11:48:34.949 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.947+0000 7f3249511800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:34.949 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.947+0000 7f3249511800 20 rados->read ofs=0 len=0 2023-12-03T11:48:34.950 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.948+0000 7f3249511800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:48:34.950 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.948+0000 7f3249511800 20 rados->read ofs=0 len=0 2023-12-03T11:48:34.950 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.948+0000 7f3249511800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:48:34.950 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.948+0000 7f3249511800 20 searching for the correct realm 2023-12-03T11:48:34.960 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.959+0000 7f3249511800 20 RGWRados::pool_iterate: got zone_info.83aabb46-04b5-4c96-9933-c6bfb1173a73 2023-12-03T11:48:34.960 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.959+0000 7f3249511800 20 RGWRados::pool_iterate: got zonegroup_info.6a811aad-435d-4fdd-93c9-b7e0b50de429 2023-12-03T11:48:34.960 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.959+0000 7f3249511800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:48:34.961 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.959+0000 7f3249511800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:48:34.961 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.959+0000 7f3249511800 20 rados->read ofs=0 len=0 2023-12-03T11:48:34.961 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.959+0000 7f3247819640 0 -- 172.21.15.3:0/114096321 >> [v2:172.21.15.3:6816/2638197404,v1:172.21.15.3:6818/2638197404] conn(0x5599a582a460 msgr2=0x5599a582c850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:48:34.961 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.959+0000 7f3249511800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:34.961 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.959+0000 7f3249511800 20 rados->read ofs=0 len=0 2023-12-03T11:48:34.962 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.959+0000 7f3249511800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:48:34.962 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.959+0000 7f3249511800 20 rados->read ofs=0 len=0 2023-12-03T11:48:34.962 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.960+0000 7f3249511800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:48:34.963 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.960+0000 7f3249511800 20 zone default found 2023-12-03T11:48:34.963 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.960+0000 7f3249511800 4 Realm: () 2023-12-03T11:48:34.963 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.960+0000 7f3249511800 4 ZoneGroup: default (6a811aad-435d-4fdd-93c9-b7e0b50de429) 2023-12-03T11:48:34.963 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.960+0000 7f3249511800 4 Zone: default (83aabb46-04b5-4c96-9933-c6bfb1173a73) 2023-12-03T11:48:34.963 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.960+0000 7f3249511800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:48:34.963 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.960+0000 7f3249511800 20 zonegroup default 2023-12-03T11:48:34.963 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.960+0000 7f3249511800 20 rados->read ofs=0 len=0 2023-12-03T11:48:34.963 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.960+0000 7f3249511800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:34.963 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.960+0000 7f3249511800 20 rados->read ofs=0 len=0 2023-12-03T11:48:34.963 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.960+0000 7f3249511800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:34.963 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.960+0000 7f3249511800 20 rados->read ofs=0 len=0 2023-12-03T11:48:34.963 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.961+0000 7f3249511800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:48:34.963 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.961+0000 7f3249511800 20 started sync module instance, tier type = 2023-12-03T11:48:34.963 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.961+0000 7f3249511800 20 started zone id=83aabb46-04b5-4c96-9933-c6bfb1173a73 (name=default) with tier type = 2023-12-03T11:48:34.968 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.967+0000 7f3246817640 0 -- 172.21.15.3:0/114096321 >> [v2:172.21.15.3:6817/3356208405,v1:172.21.15.3:6819/3356208405] conn(0x5599a5833190 msgr2=0x5599a5835580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:48:34.971 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.970+0000 7f3249511800 20 add_watcher() i=0 2023-12-03T11:48:34.972 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.970+0000 7f3249511800 20 add_watcher() i=1 2023-12-03T11:48:34.972 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.970+0000 7f3249511800 20 add_watcher() i=2 2023-12-03T11:48:34.972 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.970+0000 7f3249511800 20 add_watcher() i=3 2023-12-03T11:48:34.972 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.970+0000 7f3249511800 20 add_watcher() i=4 2023-12-03T11:48:34.972 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.970+0000 7f3249511800 20 add_watcher() i=5 2023-12-03T11:48:34.972 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.970+0000 7f3249511800 20 add_watcher() i=6 2023-12-03T11:48:34.972 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.971+0000 7f3249511800 20 add_watcher() i=7 2023-12-03T11:48:34.972 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.971+0000 7f3249511800 2 all 8 watchers are set, enabling cache 2023-12-03T11:48:34.974 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.973+0000 7f320d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:48:34.974 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.973+0000 7f3249511800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:48:34.975 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.973+0000 7f3249511800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:48:34.981 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.979+0000 7f3249511800 5 note: GC not initialized 2023-12-03T11:48:34.981 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.979+0000 7f317bfff640 20 reqs_thread_entry: start 2023-12-03T11:48:34.981 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.980+0000 7f3249511800 20 init_complete bucket index max shards: 11 2023-12-03T11:48:34.982 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.980+0000 7f3249511800 20 Filter name: none 2023-12-03T11:48:34.982 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.980+0000 7f3179ffb640 20 reqs_thread_entry: start 2023-12-03T11:48:34.982 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.980+0000 7f3249511800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2023-12-03T11:48:34.982 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.980+0000 7f3249511800 20 rados->read ofs=0 len=0 2023-12-03T11:48:34.982 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.980+0000 7f3249511800 20 rados_obj.operate() r=0 bl.length=213 2023-12-03T11:48:34.982 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.980+0000 7f3249511800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2023-12-03T11:48:34.982 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.980+0000 7f3249511800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2023-12-03T11:48:34.982 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.980+0000 7f3249511800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.23 : miss 2023-12-03T11:48:34.982 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.980+0000 7f3249511800 20 rados->read ofs=0 len=0 2023-12-03T11:48:34.983 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.981+0000 7f3249511800 20 rados_obj.operate() r=0 bl.length=417 2023-12-03T11:48:34.983 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.981+0000 7f3249511800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.23 info.flags=0x17 2023-12-03T11:48:34.983 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.981+0000 7f3249511800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.23 to cache LRU end 2023-12-03T11:48:34.983 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.981+0000 7f3249511800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:48:34.983 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.981+0000 7f3249511800 10 updating xattr: name=user.rgw.acl bl.length()=265 2023-12-03T11:48:34.983 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.981+0000 7f3249511800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.23 2023-12-03T11:48:34.984 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.982+0000 7f3249511800 0 INFO: RGWReshardLock::lock found lock on abort-at-block-writes:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.23 to be held by another RGW process; skipping for now 2023-12-03T11:48:34.984 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.983+0000 7f320d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:48:34.986 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.985+0000 7f3249511800 20 remove_watcher() i=0 2023-12-03T11:48:34.986 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.985+0000 7f3249511800 2 removed watcher, disabling cache 2023-12-03T11:48:34.987 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.986+0000 7f3249511800 20 remove_watcher() i=1 2023-12-03T11:48:34.988 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.987+0000 7f3249511800 20 remove_watcher() i=2 2023-12-03T11:48:34.990 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.988+0000 7f3249511800 20 remove_watcher() i=3 2023-12-03T11:48:34.990 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.989+0000 7f3249511800 20 remove_watcher() i=4 2023-12-03T11:48:34.991 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.990+0000 7f3249511800 20 remove_watcher() i=5 2023-12-03T11:48:34.992 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.991+0000 7f3249511800 20 remove_watcher() i=6 2023-12-03T11:48:34.993 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:48:34.992+0000 7f3249511800 20 remove_watcher() i=7 2023-12-03T11:48:34.998 INFO:tasks.workunit.client.0.smithi003.stderr:waiting 30 seconds for reshard lock to expire... 2023-12-03T11:49:05.028 INFO:tasks.workunit.client.0.smithi003.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2023-12-03T11:49:05.063 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:49:05.064 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:49:05.080 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.079+0000 7f38ccf75800 20 rados->read ofs=0 len=0 2023-12-03T11:49:05.082 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.081+0000 7f38ccf75800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:05.082 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.081+0000 7f38ccf75800 20 realm 2023-12-03T11:49:05.082 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.081+0000 7f38ccf75800 20 rados->read ofs=0 len=0 2023-12-03T11:49:05.083 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.081+0000 7f38ccf75800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:05.083 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.081+0000 7f38ccf75800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:49:05.083 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.081+0000 7f38ccf75800 20 rados->read ofs=0 len=0 2023-12-03T11:49:05.083 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.081+0000 7f38ccf75800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:05.083 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.081+0000 7f38ccf75800 20 rados->read ofs=0 len=0 2023-12-03T11:49:05.084 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.082+0000 7f38ccf75800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:49:05.084 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.082+0000 7f38ccf75800 20 rados->read ofs=0 len=0 2023-12-03T11:49:05.084 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.083+0000 7f38ccf75800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:49:05.085 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.083+0000 7f38ccf75800 20 searching for the correct realm 2023-12-03T11:49:05.096 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.095+0000 7f38caa75640 0 -- 172.21.15.3:0/2178701875 >> [v2:172.21.15.37:6805/1692844418,v1:172.21.15.37:6807/1692844418] conn(0x5575d27574d0 msgr2=0x5575d2759920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-03T11:49:05.098 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.097+0000 7f38ccf75800 20 RGWRados::pool_iterate: got zone_info.83aabb46-04b5-4c96-9933-c6bfb1173a73 2023-12-03T11:49:05.098 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.097+0000 7f38ccf75800 20 RGWRados::pool_iterate: got zonegroup_info.6a811aad-435d-4fdd-93c9-b7e0b50de429 2023-12-03T11:49:05.098 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.097+0000 7f38ccf75800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:49:05.098 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.097+0000 7f38ccf75800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:49:05.098 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.097+0000 7f38ccf75800 20 rados->read ofs=0 len=0 2023-12-03T11:49:05.100 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.097+0000 7f38ccf75800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:05.100 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.097+0000 7f38ccf75800 20 rados->read ofs=0 len=0 2023-12-03T11:49:05.100 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.098+0000 7f38ccf75800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:49:05.100 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.098+0000 7f38ccf75800 20 rados->read ofs=0 len=0 2023-12-03T11:49:05.100 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.098+0000 7f38ccf75800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:49:05.100 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.098+0000 7f38ccf75800 20 zone default found 2023-12-03T11:49:05.100 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.098+0000 7f38ccf75800 4 Realm: () 2023-12-03T11:49:05.100 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.098+0000 7f38ccf75800 4 ZoneGroup: default (6a811aad-435d-4fdd-93c9-b7e0b50de429) 2023-12-03T11:49:05.100 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.098+0000 7f38ccf75800 4 Zone: default (83aabb46-04b5-4c96-9933-c6bfb1173a73) 2023-12-03T11:49:05.100 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.098+0000 7f38ccf75800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:49:05.100 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.098+0000 7f38ccf75800 20 zonegroup default 2023-12-03T11:49:05.101 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.098+0000 7f38ccf75800 20 rados->read ofs=0 len=0 2023-12-03T11:49:05.101 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.098+0000 7f38ccf75800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:05.101 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.098+0000 7f38ccf75800 20 rados->read ofs=0 len=0 2023-12-03T11:49:05.101 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.099+0000 7f38ccf75800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:05.101 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.099+0000 7f38ccf75800 20 rados->read ofs=0 len=0 2023-12-03T11:49:05.101 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.099+0000 7f38ccf75800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:05.101 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.099+0000 7f38ccf75800 20 started sync module instance, tier type = 2023-12-03T11:49:05.101 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.099+0000 7f38ccf75800 20 started zone id=83aabb46-04b5-4c96-9933-c6bfb1173a73 (name=default) with tier type = 2023-12-03T11:49:05.108 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.107+0000 7f38ca274640 0 -- 172.21.15.3:0/2178701875 >> [v2:172.21.15.3:6817/3356208405,v1:172.21.15.3:6819/3356208405] conn(0x5575d275c510 msgr2=0x5575d275e900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:49:05.111 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.110+0000 7f38ccf75800 20 add_watcher() i=0 2023-12-03T11:49:05.111 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.110+0000 7f38ccf75800 20 add_watcher() i=1 2023-12-03T11:49:05.111 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.110+0000 7f38ccf75800 20 add_watcher() i=2 2023-12-03T11:49:05.111 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.110+0000 7f38ccf75800 20 add_watcher() i=3 2023-12-03T11:49:05.111 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.110+0000 7f38ccf75800 20 add_watcher() i=4 2023-12-03T11:49:05.111 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.110+0000 7f38ccf75800 20 add_watcher() i=5 2023-12-03T11:49:05.111 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.110+0000 7f38ccf75800 20 add_watcher() i=6 2023-12-03T11:49:05.112 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.111+0000 7f38ccf75800 20 add_watcher() i=7 2023-12-03T11:49:05.112 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.111+0000 7f38ccf75800 2 all 8 watchers are set, enabling cache 2023-12-03T11:49:05.114 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.113+0000 7f380bfff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:49:05.115 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.114+0000 7f38ccf75800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:49:05.115 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.114+0000 7f38ccf75800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:49:05.123 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.120+0000 7f38ccf75800 5 note: GC not initialized 2023-12-03T11:49:05.123 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.120+0000 7f37faffd640 20 reqs_thread_entry: start 2023-12-03T11:49:05.123 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.121+0000 7f38ccf75800 20 init_complete bucket index max shards: 11 2023-12-03T11:49:05.123 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.121+0000 7f38ccf75800 20 Filter name: none 2023-12-03T11:49:05.123 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.121+0000 7f37f8ff9640 20 reqs_thread_entry: start 2023-12-03T11:49:05.123 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.121+0000 7f38ccf75800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2023-12-03T11:49:05.123 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.121+0000 7f38ccf75800 20 rados->read ofs=0 len=0 2023-12-03T11:49:05.123 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.121+0000 7f38ccf75800 20 rados_obj.operate() r=0 bl.length=213 2023-12-03T11:49:05.124 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.121+0000 7f38ccf75800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2023-12-03T11:49:05.124 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.121+0000 7f38ccf75800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2023-12-03T11:49:05.124 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.121+0000 7f38ccf75800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.23 : miss 2023-12-03T11:49:05.124 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.121+0000 7f38ccf75800 20 rados->read ofs=0 len=0 2023-12-03T11:49:05.124 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.122+0000 7f38ccf75800 20 rados_obj.operate() r=0 bl.length=417 2023-12-03T11:49:05.124 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.122+0000 7f38ccf75800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.23 info.flags=0x17 2023-12-03T11:49:05.124 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.122+0000 7f38ccf75800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.23 to cache LRU end 2023-12-03T11:49:05.124 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.122+0000 7f38ccf75800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:49:05.125 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.122+0000 7f38ccf75800 10 updating xattr: name=user.rgw.acl bl.length()=265 2023-12-03T11:49:05.125 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.122+0000 7f38ccf75800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.23 2023-12-03T11:49:05.125 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.124+0000 7f38ccf75800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2023-12-03T11:49:05.132 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.131+0000 7f38ccf75800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.23 info.flags=0x17 2023-12-03T11:49:05.132 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.131+0000 7f38ccf75800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.23 to cache LRU end 2023-12-03T11:49:05.132 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.131+0000 7f38ccf75800 10 updating xattr: name=user.rgw.acl bl.length()=265 2023-12-03T11:49:05.132 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.131+0000 7f38ccf75800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.23, ofs0, ns] 2023-12-03T11:49:05.133 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.131+0000 7f38b0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660509 cookie 93964530486800 notifier 6461 bl.length()=949 2023-12-03T11:49:05.133 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.131+0000 7f38b0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.23 info.flags=0x17 2023-12-03T11:49:05.133 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.131+0000 7f38b0ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.23 to cache LRU end 2023-12-03T11:49:05.133 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.131+0000 7f38b0ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2023-12-03T11:49:05.134 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.133+0000 7f38ccf75800 20 handle_bi_update(): bucket=:abort-at-block-writes[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.23]): orig_sources= new_sources= 2023-12-03T11:49:05.134 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.133+0000 7f38ccf75800 20 handle_bi_update(): bucket=:abort-at-block-writes[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.23]): potential sources added=[] removed=[] 2023-12-03T11:49:05.135 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.133+0000 7f38ccf75800 20 handle_bi_update(): bucket=:abort-at-block-writes[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.23]): orig_dests= new_dests= 2023-12-03T11:49:05.135 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.133+0000 7f38ccf75800 20 handle_bi_update(): bucket=:abort-at-block-writes[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.23]): potential dests added=[] removed=[] 2023-12-03T11:49:05.138 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.136+0000 7f38ccf75800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.23.2.0 2023-12-03T11:49:05.138 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.136+0000 7f38ccf75800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.23.2.0 2023-12-03T11:49:05.138 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.136+0000 7f38ccf75800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.23.2.1 2023-12-03T11:49:05.138 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.136+0000 7f38ccf75800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.23.2.1 2023-12-03T11:49:05.138 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.136+0000 7f38ccf75800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.23.2.2 2023-12-03T11:49:05.139 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.136+0000 7f38ccf75800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.23.2.2 2023-12-03T11:49:05.139 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.136+0000 7f38ccf75800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.23.2.3 2023-12-03T11:49:05.139 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.136+0000 7f38ccf75800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.23.2.3 2023-12-03T11:49:05.139 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.136+0000 7f38ccf75800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.23.2.4 2023-12-03T11:49:05.139 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.136+0000 7f38ccf75800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.23.2.4 2023-12-03T11:49:05.139 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.136+0000 7f38ccf75800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.23.2.5 2023-12-03T11:49:05.140 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.136+0000 7f38ccf75800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.23.2.5 2023-12-03T11:49:05.140 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.136+0000 7f38ccf75800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.23.2.6 2023-12-03T11:49:05.140 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.136+0000 7f38ccf75800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.23.2.6 2023-12-03T11:49:05.140 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.136+0000 7f38ccf75800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.23.2.7 2023-12-03T11:49:05.140 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.136+0000 7f38ccf75800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.23.2.7 2023-12-03T11:49:05.140 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.136+0000 7f38ccf75800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.23.2.8 2023-12-03T11:49:05.141 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.136+0000 7f38ccf75800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.23.2.8 2023-12-03T11:49:05.141 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.136+0000 7f38ccf75800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.23.2.9 2023-12-03T11:49:05.141 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.136+0000 7f38ccf75800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.23.2.9 2023-12-03T11:49:05.141 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.136+0000 7f38ccf75800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.23.2.10 2023-12-03T11:49:05.141 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.136+0000 7f38ccf75800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.23.2.10 2023-12-03T11:49:05.141 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.136+0000 7f38ccf75800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.23.2.11 2023-12-03T11:49:05.141 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.136+0000 7f38ccf75800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.23.2.11 2023-12-03T11:49:05.142 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.136+0000 7f38ccf75800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.23.0 2023-12-03T11:49:05.142 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.136+0000 7f38ccf75800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.23.1 2023-12-03T11:49:05.144 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.137+0000 7f38ccf75800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.23.2 2023-12-03T11:49:05.144 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.137+0000 7f38ccf75800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.23.3 2023-12-03T11:49:05.144 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.138+0000 7f38ccf75800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.23.4 2023-12-03T11:49:05.144 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.138+0000 7f38ccf75800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.23.5 2023-12-03T11:49:05.144 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.139+0000 7f38ccf75800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.23.6 2023-12-03T11:49:05.144 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.139+0000 7f38ccf75800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.23.7 2023-12-03T11:49:05.144 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.140+0000 7f38ccf75800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.23.8 2023-12-03T11:49:05.145 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.140+0000 7f38ccf75800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.23.9 2023-12-03T11:49:05.145 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.141+0000 7f38ccf75800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.23.10 2023-12-03T11:49:05.145 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.144+0000 7f38ccf75800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.23 : hit (requested=0x17, cached=0x17) 2023-12-03T11:49:05.145 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.144+0000 7f38ccf75800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.23 2023-12-03T11:49:05.146 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.145+0000 7f38ccf75800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.23 info.flags=0x17 2023-12-03T11:49:05.147 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.145+0000 7f38ccf75800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.23 to cache LRU end 2023-12-03T11:49:05.147 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.145+0000 7f38ccf75800 10 updating xattr: name=user.rgw.acl bl.length()=265 2023-12-03T11:49:05.147 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.145+0000 7f38ccf75800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.23, ofs0, ns] 2023-12-03T11:49:05.147 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.145+0000 7f38b0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660510 cookie 93964530486800 notifier 6461 bl.length()=917 2023-12-03T11:49:05.147 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.145+0000 7f38b0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.23 info.flags=0x17 2023-12-03T11:49:05.147 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.145+0000 7f38b0ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.23 to cache LRU end 2023-12-03T11:49:05.147 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.145+0000 7f38b0ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2023-12-03T11:49:05.148 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.147+0000 7f38ccf75800 20 handle_bi_update(): bucket=:abort-at-block-writes[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.23]): orig_sources= new_sources= 2023-12-03T11:49:05.149 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.147+0000 7f38ccf75800 20 handle_bi_update(): bucket=:abort-at-block-writes[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.23]): potential sources added=[] removed=[] 2023-12-03T11:49:05.149 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.147+0000 7f38ccf75800 20 handle_bi_update(): bucket=:abort-at-block-writes[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.23]): orig_dests= new_dests= 2023-12-03T11:49:05.149 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.147+0000 7f38ccf75800 20 handle_bi_update(): bucket=:abort-at-block-writes[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.23]): potential dests added=[] removed=[] 2023-12-03T11:49:05.151 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.150+0000 7f38ccf75800 1 execute INFO: reshard of bucket "abort-at-block-writes" completed successfully 2023-12-03T11:49:05.153 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.151+0000 7f380bfff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:49:05.155 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.154+0000 7f38ccf75800 20 remove_watcher() i=0 2023-12-03T11:49:05.155 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.154+0000 7f38ccf75800 2 removed watcher, disabling cache 2023-12-03T11:49:05.156 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.155+0000 7f38ccf75800 20 remove_watcher() i=1 2023-12-03T11:49:05.157 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.156+0000 7f38ccf75800 20 remove_watcher() i=2 2023-12-03T11:49:05.158 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.157+0000 7f38ccf75800 20 remove_watcher() i=3 2023-12-03T11:49:05.160 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.158+0000 7f38ccf75800 20 remove_watcher() i=4 2023-12-03T11:49:05.161 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.160+0000 7f38ccf75800 20 remove_watcher() i=5 2023-12-03T11:49:05.162 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.161+0000 7f38ccf75800 20 remove_watcher() i=6 2023-12-03T11:49:05.163 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.162+0000 7f38ccf75800 20 remove_watcher() i=7 2023-12-03T11:49:05.169 INFO:tasks.workunit.client.0.smithi003.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2023-12-03T11:49:05.197 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:49:05.197 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:49:05.212 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.210+0000 7f3db560f800 20 rados->read ofs=0 len=0 2023-12-03T11:49:05.214 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.212+0000 7f3db560f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:05.214 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.212+0000 7f3db560f800 20 realm 2023-12-03T11:49:05.214 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.212+0000 7f3db560f800 20 rados->read ofs=0 len=0 2023-12-03T11:49:05.215 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.212+0000 7f3db560f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:05.215 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.212+0000 7f3db560f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:49:05.215 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.212+0000 7f3db560f800 20 rados->read ofs=0 len=0 2023-12-03T11:49:05.215 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.212+0000 7f3db560f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:05.215 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.212+0000 7f3db560f800 20 rados->read ofs=0 len=0 2023-12-03T11:49:05.215 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.213+0000 7f3db560f800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:49:05.216 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.213+0000 7f3db560f800 20 rados->read ofs=0 len=0 2023-12-03T11:49:05.216 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.214+0000 7f3db560f800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:49:05.216 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.214+0000 7f3db560f800 20 searching for the correct realm 2023-12-03T11:49:05.226 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.225+0000 7f3db0bb1640 0 -- 172.21.15.3:0/3585678917 >> [v2:172.21.15.37:6805/1692844418,v1:172.21.15.37:6807/1692844418] conn(0x559ce3b4bc10 msgr2=0x559ce3b4e000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:49:05.228 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.227+0000 7f3db560f800 20 RGWRados::pool_iterate: got zone_info.83aabb46-04b5-4c96-9933-c6bfb1173a73 2023-12-03T11:49:05.228 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.227+0000 7f3db560f800 20 RGWRados::pool_iterate: got zonegroup_info.6a811aad-435d-4fdd-93c9-b7e0b50de429 2023-12-03T11:49:05.228 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.227+0000 7f3db560f800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:49:05.228 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.227+0000 7f3db560f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:49:05.228 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.227+0000 7f3db560f800 20 rados->read ofs=0 len=0 2023-12-03T11:49:05.229 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.227+0000 7f3db560f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:05.229 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.227+0000 7f3db560f800 20 rados->read ofs=0 len=0 2023-12-03T11:49:05.230 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.227+0000 7f3db560f800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:49:05.230 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.227+0000 7f3db560f800 20 rados->read ofs=0 len=0 2023-12-03T11:49:05.230 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.228+0000 7f3db560f800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:49:05.230 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.228+0000 7f3db560f800 20 zone default found 2023-12-03T11:49:05.231 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.228+0000 7f3db560f800 4 Realm: () 2023-12-03T11:49:05.231 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.228+0000 7f3db560f800 4 ZoneGroup: default (6a811aad-435d-4fdd-93c9-b7e0b50de429) 2023-12-03T11:49:05.231 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.228+0000 7f3db560f800 4 Zone: default (83aabb46-04b5-4c96-9933-c6bfb1173a73) 2023-12-03T11:49:05.231 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.228+0000 7f3db560f800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:49:05.232 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.228+0000 7f3db560f800 20 zonegroup default 2023-12-03T11:49:05.232 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.228+0000 7f3db560f800 20 rados->read ofs=0 len=0 2023-12-03T11:49:05.232 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.228+0000 7f3db560f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:05.232 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.228+0000 7f3db560f800 20 rados->read ofs=0 len=0 2023-12-03T11:49:05.232 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.228+0000 7f3db560f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:05.232 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.228+0000 7f3db560f800 20 rados->read ofs=0 len=0 2023-12-03T11:49:05.232 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.229+0000 7f3db560f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:05.232 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.229+0000 7f3db560f800 20 started sync module instance, tier type = 2023-12-03T11:49:05.232 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.229+0000 7f3db560f800 20 started zone id=83aabb46-04b5-4c96-9933-c6bfb1173a73 (name=default) with tier type = 2023-12-03T11:49:05.236 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.235+0000 7f3db0bb1640 0 -- 172.21.15.3:0/3585678917 >> [v2:172.21.15.3:6800/2373485412,v1:172.21.15.3:6801/2373485412] conn(0x7f3da8026920 msgr2=0x7f3da80243f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:49:05.241 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.238+0000 7f3db560f800 20 add_watcher() i=0 2023-12-03T11:49:05.241 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.238+0000 7f3db560f800 20 add_watcher() i=1 2023-12-03T11:49:05.242 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.238+0000 7f3db560f800 20 add_watcher() i=2 2023-12-03T11:49:05.242 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.238+0000 7f3db560f800 20 add_watcher() i=3 2023-12-03T11:49:05.242 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.238+0000 7f3db560f800 20 add_watcher() i=4 2023-12-03T11:49:05.242 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.238+0000 7f3db560f800 20 add_watcher() i=5 2023-12-03T11:49:05.242 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.238+0000 7f3db560f800 20 add_watcher() i=6 2023-12-03T11:49:05.243 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.239+0000 7f3db560f800 20 add_watcher() i=7 2023-12-03T11:49:05.243 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.239+0000 7f3db560f800 2 all 8 watchers are set, enabling cache 2023-12-03T11:49:05.243 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.241+0000 7f3d76fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:49:05.243 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.241+0000 7f3db560f800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:49:05.243 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.241+0000 7f3db560f800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:49:05.249 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.248+0000 7f3db560f800 5 note: GC not initialized 2023-12-03T11:49:05.249 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.248+0000 7f3ce5ffb640 20 reqs_thread_entry: start 2023-12-03T11:49:05.249 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.248+0000 7f3db560f800 20 init_complete bucket index max shards: 11 2023-12-03T11:49:05.250 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.248+0000 7f3db560f800 20 Filter name: none 2023-12-03T11:49:05.250 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.248+0000 7f3cd77fe640 20 reqs_thread_entry: start 2023-12-03T11:49:05.250 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.248+0000 7f3db560f800 20 rados->read ofs=0 len=0 2023-12-03T11:49:05.250 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.248+0000 7f3db560f800 20 rados_obj.operate() r=0 bl.length=213 2023-12-03T11:49:05.251 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.249+0000 7f3db560f800 20 rados->read ofs=0 len=0 2023-12-03T11:49:05.251 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.249+0000 7f3db560f800 20 rados_obj.operate() r=0 bl.length=385 2023-12-03T11:49:05.251 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.249+0000 7f3db560f800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:49:05.251 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.249+0000 7f3db560f800 20 rados->read ofs=0 len=0 2023-12-03T11:49:05.251 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.249+0000 7f3db560f800 20 rados_obj.operate() r=0 bl.length=213 2023-12-03T11:49:05.251 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.249+0000 7f3db560f800 20 rados->read ofs=0 len=0 2023-12-03T11:49:05.252 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.250+0000 7f3db560f800 20 rados_obj.operate() r=0 bl.length=385 2023-12-03T11:49:05.252 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.250+0000 7f3db560f800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:49:05.252 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.251+0000 7f3db560f800 20 rados->read ofs=0 len=0 2023-12-03T11:49:05.252 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.251+0000 7f3db560f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:05.253 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.252+0000 7f3d76fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:49:05.255 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.254+0000 7f3db560f800 20 remove_watcher() i=0 2023-12-03T11:49:05.255 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.254+0000 7f3db560f800 2 removed watcher, disabling cache 2023-12-03T11:49:05.256 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.255+0000 7f3db560f800 20 remove_watcher() i=1 2023-12-03T11:49:05.257 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.256+0000 7f3db560f800 20 remove_watcher() i=2 2023-12-03T11:49:05.258 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.257+0000 7f3db560f800 20 remove_watcher() i=3 2023-12-03T11:49:05.259 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.258+0000 7f3db560f800 20 remove_watcher() i=4 2023-12-03T11:49:05.260 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.259+0000 7f3db560f800 20 remove_watcher() i=5 2023-12-03T11:49:05.261 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.260+0000 7f3db560f800 20 remove_watcher() i=6 2023-12-03T11:49:05.262 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:05.261+0000 7f3db560f800 20 remove_watcher() i=7 2023-12-03T11:49:05.267 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:49:05.267 INFO:tasks.workunit.client.0.smithi003.stderr:BUCKET_STATS: 2023-12-03T11:49:05.267 INFO:tasks.workunit.client.0.smithi003.stderr:bucket: abort-at-block-writes id: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.23 num_objects: 19 size_kb: 1 num_shards: 12 2023-12-03T11:49:05.267 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:49:05.569 INFO:tasks.workunit.client.0.smithi003.stderr:TEST: reshard bucket with EIO injected at commit_target_layout 2023-12-03T11:49:05.569 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:49:06.266 INFO:tasks.workunit.client.0.smithi003.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2023-12-03T11:49:06.293 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:49:06.293 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:49:06.308 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.306+0000 7ff476d40800 20 rados->read ofs=0 len=0 2023-12-03T11:49:06.311 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.308+0000 7ff476d40800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:06.311 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.308+0000 7ff476d40800 20 realm 2023-12-03T11:49:06.312 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.308+0000 7ff476d40800 20 rados->read ofs=0 len=0 2023-12-03T11:49:06.312 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.308+0000 7ff476d40800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:06.312 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.308+0000 7ff476d40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:49:06.312 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.308+0000 7ff476d40800 20 rados->read ofs=0 len=0 2023-12-03T11:49:06.312 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.308+0000 7ff476d40800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:06.312 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.308+0000 7ff476d40800 20 rados->read ofs=0 len=0 2023-12-03T11:49:06.312 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.309+0000 7ff476d40800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:49:06.313 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.309+0000 7ff476d40800 20 rados->read ofs=0 len=0 2023-12-03T11:49:06.313 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.310+0000 7ff476d40800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:49:06.313 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.310+0000 7ff476d40800 20 searching for the correct realm 2023-12-03T11:49:06.320 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.319+0000 7ff472a4c640 0 -- 172.21.15.3:0/3725869514 >> [v2:172.21.15.3:6800/2373485412,v1:172.21.15.3:6801/2373485412] conn(0x7ff46c06c040 msgr2=0x7ff46c05e930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:49:06.323 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.322+0000 7ff476d40800 20 RGWRados::pool_iterate: got zone_info.83aabb46-04b5-4c96-9933-c6bfb1173a73 2023-12-03T11:49:06.323 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.322+0000 7ff476d40800 20 RGWRados::pool_iterate: got zonegroup_info.6a811aad-435d-4fdd-93c9-b7e0b50de429 2023-12-03T11:49:06.323 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.322+0000 7ff476d40800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:49:06.323 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.322+0000 7ff476d40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:49:06.323 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.322+0000 7ff476d40800 20 rados->read ofs=0 len=0 2023-12-03T11:49:06.323 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.322+0000 7ff476d40800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:06.323 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.322+0000 7ff476d40800 20 rados->read ofs=0 len=0 2023-12-03T11:49:06.325 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.322+0000 7ff476d40800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:49:06.325 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.322+0000 7ff476d40800 20 rados->read ofs=0 len=0 2023-12-03T11:49:06.325 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.322+0000 7ff476d40800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:49:06.325 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.322+0000 7ff476d40800 20 zone default found 2023-12-03T11:49:06.325 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.322+0000 7ff476d40800 4 Realm: () 2023-12-03T11:49:06.325 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.322+0000 7ff476d40800 4 ZoneGroup: default (6a811aad-435d-4fdd-93c9-b7e0b50de429) 2023-12-03T11:49:06.325 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.322+0000 7ff476d40800 4 Zone: default (83aabb46-04b5-4c96-9933-c6bfb1173a73) 2023-12-03T11:49:06.325 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.322+0000 7ff476d40800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:49:06.326 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.322+0000 7ff476d40800 20 zonegroup default 2023-12-03T11:49:06.326 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.322+0000 7ff476d40800 20 rados->read ofs=0 len=0 2023-12-03T11:49:06.326 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.323+0000 7ff476d40800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:06.326 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.323+0000 7ff476d40800 20 rados->read ofs=0 len=0 2023-12-03T11:49:06.326 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.323+0000 7ff476d40800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:06.326 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.323+0000 7ff476d40800 20 rados->read ofs=0 len=0 2023-12-03T11:49:06.326 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.323+0000 7ff476d40800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:06.326 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.323+0000 7ff476d40800 20 started sync module instance, tier type = 2023-12-03T11:49:06.326 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.323+0000 7ff476d40800 20 started zone id=83aabb46-04b5-4c96-9933-c6bfb1173a73 (name=default) with tier type = 2023-12-03T11:49:06.327 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.326+0000 7ff472a4c640 0 -- 172.21.15.3:0/3725869514 >> [v2:172.21.15.37:6805/1692844418,v1:172.21.15.37:6807/1692844418] conn(0x560e9358e430 msgr2=0x560e93590840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-03T11:49:06.334 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.333+0000 7ff476d40800 20 add_watcher() i=0 2023-12-03T11:49:06.334 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.333+0000 7ff476d40800 20 add_watcher() i=1 2023-12-03T11:49:06.334 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.333+0000 7ff476d40800 20 add_watcher() i=2 2023-12-03T11:49:06.334 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.333+0000 7ff476d40800 20 add_watcher() i=3 2023-12-03T11:49:06.334 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.333+0000 7ff476d40800 20 add_watcher() i=4 2023-12-03T11:49:06.334 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.333+0000 7ff476d40800 20 add_watcher() i=5 2023-12-03T11:49:06.334 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.333+0000 7ff476d40800 20 add_watcher() i=6 2023-12-03T11:49:06.335 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.334+0000 7ff476d40800 20 add_watcher() i=7 2023-12-03T11:49:06.335 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.334+0000 7ff476d40800 2 all 8 watchers are set, enabling cache 2023-12-03T11:49:06.337 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.335+0000 7ff3b3fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:49:06.337 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.335+0000 7ff476d40800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:49:06.337 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.335+0000 7ff476d40800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:49:06.344 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.342+0000 7ff476d40800 5 note: GC not initialized 2023-12-03T11:49:06.344 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.342+0000 7ff3a2ffd640 20 reqs_thread_entry: start 2023-12-03T11:49:06.344 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.342+0000 7ff476d40800 20 init_complete bucket index max shards: 11 2023-12-03T11:49:06.344 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.342+0000 7ff476d40800 20 Filter name: none 2023-12-03T11:49:06.344 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.342+0000 7ff3a0ff9640 20 reqs_thread_entry: start 2023-12-03T11:49:06.345 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.342+0000 7ff476d40800 20 rados->read ofs=0 len=0 2023-12-03T11:49:06.346 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.343+0000 7ff476d40800 20 rados_obj.operate() r=0 bl.length=221 2023-12-03T11:49:06.346 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.343+0000 7ff476d40800 20 rados->read ofs=0 len=0 2023-12-03T11:49:06.346 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.343+0000 7ff476d40800 20 rados_obj.operate() r=0 bl.length=393 2023-12-03T11:49:06.346 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.344+0000 7ff476d40800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:49:06.346 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.344+0000 7ff476d40800 20 rados->read ofs=0 len=0 2023-12-03T11:49:06.346 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.344+0000 7ff476d40800 20 rados_obj.operate() r=0 bl.length=221 2023-12-03T11:49:06.346 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.344+0000 7ff476d40800 20 rados->read ofs=0 len=0 2023-12-03T11:49:06.347 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.344+0000 7ff476d40800 20 rados_obj.operate() r=0 bl.length=393 2023-12-03T11:49:06.347 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.344+0000 7ff476d40800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:49:06.347 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.345+0000 7ff476d40800 20 rados->read ofs=0 len=0 2023-12-03T11:49:06.347 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.346+0000 7ff476d40800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:06.348 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.346+0000 7ff3b3fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:49:06.350 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.349+0000 7ff476d40800 20 remove_watcher() i=0 2023-12-03T11:49:06.350 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.349+0000 7ff476d40800 2 removed watcher, disabling cache 2023-12-03T11:49:06.351 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.350+0000 7ff476d40800 20 remove_watcher() i=1 2023-12-03T11:49:06.352 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.351+0000 7ff476d40800 20 remove_watcher() i=2 2023-12-03T11:49:06.353 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.352+0000 7ff476d40800 20 remove_watcher() i=3 2023-12-03T11:49:06.354 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.353+0000 7ff476d40800 20 remove_watcher() i=4 2023-12-03T11:49:06.355 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.354+0000 7ff476d40800 20 remove_watcher() i=5 2023-12-03T11:49:06.356 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.355+0000 7ff476d40800 20 remove_watcher() i=6 2023-12-03T11:49:06.357 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.356+0000 7ff476d40800 20 remove_watcher() i=7 2023-12-03T11:49:06.362 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:49:06.362 INFO:tasks.workunit.client.0.smithi003.stderr:BUCKET_STATS: 2023-12-03T11:49:06.362 INFO:tasks.workunit.client.0.smithi003.stderr:bucket: error-at-commit-target-layout id: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.24 num_objects: 20 size_kb: 1 num_shards: 11 2023-12-03T11:49:06.362 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:49:06.363 INFO:tasks.workunit.client.0.smithi003.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at commit_target_layout 2023-12-03T11:49:06.397 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:49:06.397 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:49:06.412 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.411+0000 7f7d3ad23800 20 rados->read ofs=0 len=0 2023-12-03T11:49:06.414 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.412+0000 7f7d3ad23800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:06.414 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.412+0000 7f7d3ad23800 20 realm 2023-12-03T11:49:06.415 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.412+0000 7f7d3ad23800 20 rados->read ofs=0 len=0 2023-12-03T11:49:06.415 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.412+0000 7f7d3ad23800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:06.415 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.412+0000 7f7d3ad23800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:49:06.415 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.412+0000 7f7d3ad23800 20 rados->read ofs=0 len=0 2023-12-03T11:49:06.415 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.413+0000 7f7d3ad23800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:06.415 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.413+0000 7f7d3ad23800 20 rados->read ofs=0 len=0 2023-12-03T11:49:06.416 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.413+0000 7f7d3ad23800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:49:06.416 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.413+0000 7f7d3ad23800 20 rados->read ofs=0 len=0 2023-12-03T11:49:06.417 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.414+0000 7f7d3ad23800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:49:06.417 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.414+0000 7f7d3ad23800 20 searching for the correct realm 2023-12-03T11:49:06.423 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.421+0000 7f7d3713d640 0 -- 172.21.15.3:0/1360614848 >> [v2:172.21.15.3:6816/2638197404,v1:172.21.15.3:6818/2638197404] conn(0x55abb18ace80 msgr2=0x55abb18af270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-03T11:49:06.428 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.425+0000 7f7d3ad23800 20 RGWRados::pool_iterate: got zone_info.83aabb46-04b5-4c96-9933-c6bfb1173a73 2023-12-03T11:49:06.428 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.425+0000 7f7d3ad23800 20 RGWRados::pool_iterate: got zonegroup_info.6a811aad-435d-4fdd-93c9-b7e0b50de429 2023-12-03T11:49:06.428 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.425+0000 7f7d3ad23800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:49:06.428 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.425+0000 7f7d3ad23800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:49:06.428 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.425+0000 7f7d3ad23800 20 rados->read ofs=0 len=0 2023-12-03T11:49:06.428 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.425+0000 7f7d3ad23800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:06.428 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.425+0000 7f7d3ad23800 20 rados->read ofs=0 len=0 2023-12-03T11:49:06.428 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.426+0000 7f7d3ad23800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:49:06.429 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.426+0000 7f7d3ad23800 20 rados->read ofs=0 len=0 2023-12-03T11:49:06.429 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.426+0000 7f7d3ad23800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:49:06.429 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.426+0000 7f7d3ad23800 20 zone default found 2023-12-03T11:49:06.429 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.426+0000 7f7d3ad23800 4 Realm: () 2023-12-03T11:49:06.429 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.426+0000 7f7d3ad23800 4 ZoneGroup: default (6a811aad-435d-4fdd-93c9-b7e0b50de429) 2023-12-03T11:49:06.429 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.426+0000 7f7d3ad23800 4 Zone: default (83aabb46-04b5-4c96-9933-c6bfb1173a73) 2023-12-03T11:49:06.429 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.426+0000 7f7d3ad23800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:49:06.429 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.426+0000 7f7d3ad23800 20 zonegroup default 2023-12-03T11:49:06.429 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.426+0000 7f7d3ad23800 20 rados->read ofs=0 len=0 2023-12-03T11:49:06.429 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.426+0000 7f7d3ad23800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:06.429 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.426+0000 7f7d3ad23800 20 rados->read ofs=0 len=0 2023-12-03T11:49:06.429 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.427+0000 7f7d3ad23800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:06.429 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.427+0000 7f7d3ad23800 20 rados->read ofs=0 len=0 2023-12-03T11:49:06.430 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.427+0000 7f7d3613b640 0 -- 172.21.15.3:0/1360614848 >> [v2:172.21.15.3:6817/3356208405,v1:172.21.15.3:6819/3356208405] conn(0x55abb18b5d80 msgr2=0x55abb18b8170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-03T11:49:06.430 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.427+0000 7f7d3ad23800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:06.430 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.427+0000 7f7d3ad23800 20 started sync module instance, tier type = 2023-12-03T11:49:06.430 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.427+0000 7f7d3ad23800 20 started zone id=83aabb46-04b5-4c96-9933-c6bfb1173a73 (name=default) with tier type = 2023-12-03T11:49:06.439 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.437+0000 7f7d3ad23800 20 add_watcher() i=0 2023-12-03T11:49:06.439 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.437+0000 7f7d3ad23800 20 add_watcher() i=1 2023-12-03T11:49:06.439 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.437+0000 7f7d3ad23800 20 add_watcher() i=2 2023-12-03T11:49:06.439 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.437+0000 7f7d3ad23800 20 add_watcher() i=3 2023-12-03T11:49:06.439 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.437+0000 7f7d3ad23800 20 add_watcher() i=4 2023-12-03T11:49:06.439 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.437+0000 7f7d3ad23800 20 add_watcher() i=5 2023-12-03T11:49:06.439 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.437+0000 7f7d3ad23800 20 add_watcher() i=6 2023-12-03T11:49:06.439 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.438+0000 7f7d3ad23800 20 add_watcher() i=7 2023-12-03T11:49:06.440 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.438+0000 7f7d3ad23800 2 all 8 watchers are set, enabling cache 2023-12-03T11:49:06.441 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.440+0000 7f7c77fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:49:06.441 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.440+0000 7f7d3ad23800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:49:06.441 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.440+0000 7f7d3ad23800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:49:06.449 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.447+0000 7f7d3ad23800 5 note: GC not initialized 2023-12-03T11:49:06.449 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.447+0000 7f7c66ffd640 20 reqs_thread_entry: start 2023-12-03T11:49:06.449 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.447+0000 7f7d3ad23800 20 init_complete bucket index max shards: 11 2023-12-03T11:49:06.449 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.447+0000 7f7d3ad23800 20 Filter name: none 2023-12-03T11:49:06.449 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.447+0000 7f7c64ff9640 20 reqs_thread_entry: start 2023-12-03T11:49:06.449 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.447+0000 7f7d3ad23800 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2023-12-03T11:49:06.449 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.447+0000 7f7d3ad23800 20 rados->read ofs=0 len=0 2023-12-03T11:49:06.450 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.448+0000 7f7d3ad23800 20 rados_obj.operate() r=0 bl.length=221 2023-12-03T11:49:06.450 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.448+0000 7f7d3ad23800 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2023-12-03T11:49:06.450 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.448+0000 7f7d3ad23800 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2023-12-03T11:49:06.451 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.448+0000 7f7d3ad23800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.24 : miss 2023-12-03T11:49:06.451 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.448+0000 7f7d3ad23800 20 rados->read ofs=0 len=0 2023-12-03T11:49:06.451 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.448+0000 7f7d3ad23800 20 rados_obj.operate() r=0 bl.length=393 2023-12-03T11:49:06.451 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.448+0000 7f7d3ad23800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.24 info.flags=0x17 2023-12-03T11:49:06.451 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.448+0000 7f7d3ad23800 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.24 to cache LRU end 2023-12-03T11:49:06.451 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.448+0000 7f7d3ad23800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:49:06.451 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.448+0000 7f7d3ad23800 10 updating xattr: name=user.rgw.acl bl.length()=265 2023-12-03T11:49:06.451 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.448+0000 7f7d3ad23800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.24 2023-12-03T11:49:06.458 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.457+0000 7f7d3ad23800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.24 info.flags=0x17 2023-12-03T11:49:06.458 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.457+0000 7f7d3ad23800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.24 to cache LRU end 2023-12-03T11:49:06.458 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.457+0000 7f7d3ad23800 10 updating xattr: name=user.rgw.acl bl.length()=265 2023-12-03T11:49:06.458 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.457+0000 7f7d3ad23800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.24, ofs0, ns] 2023-12-03T11:49:06.459 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.457+0000 7f7d1cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660500 cookie 94195906492944 notifier 6518 bl.length()=965 2023-12-03T11:49:06.459 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.457+0000 7f7d1cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.24 info.flags=0x17 2023-12-03T11:49:06.459 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.457+0000 7f7d1cff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.24 to cache LRU end 2023-12-03T11:49:06.459 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.457+0000 7f7d1cff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2023-12-03T11:49:06.460 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.458+0000 7f7d3ad23800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.24]): orig_sources= new_sources= 2023-12-03T11:49:06.460 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.458+0000 7f7d3ad23800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.24]): potential sources added=[] removed=[] 2023-12-03T11:49:06.460 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.458+0000 7f7d3ad23800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.24]): orig_dests= new_dests= 2023-12-03T11:49:06.460 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.458+0000 7f7d3ad23800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.24]): potential dests added=[] removed=[] 2023-12-03T11:49:06.463 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.461+0000 7f7d3ad23800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.24.1.0 2023-12-03T11:49:06.463 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.461+0000 7f7d3ad23800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.24.1.0 2023-12-03T11:49:06.463 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.461+0000 7f7d3ad23800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.24.1.1 2023-12-03T11:49:06.463 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.461+0000 7f7d3ad23800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.24.1.1 2023-12-03T11:49:06.463 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.461+0000 7f7d3ad23800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.24.1.2 2023-12-03T11:49:06.463 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.461+0000 7f7d3ad23800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.24.1.2 2023-12-03T11:49:06.463 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.461+0000 7f7d3ad23800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.24.1.3 2023-12-03T11:49:06.463 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.461+0000 7f7d3ad23800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.24.1.3 2023-12-03T11:49:06.464 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.461+0000 7f7d3ad23800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.24.1.4 2023-12-03T11:49:06.464 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.461+0000 7f7d3ad23800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.24.1.4 2023-12-03T11:49:06.464 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.461+0000 7f7d3ad23800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.24.1.5 2023-12-03T11:49:06.464 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.461+0000 7f7d3ad23800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.24.1.5 2023-12-03T11:49:06.464 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.461+0000 7f7d3ad23800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.24.1.6 2023-12-03T11:49:06.464 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.461+0000 7f7d3ad23800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.24.1.6 2023-12-03T11:49:06.464 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.461+0000 7f7d3ad23800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.24.1.7 2023-12-03T11:49:06.464 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.461+0000 7f7d3ad23800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.24.1.7 2023-12-03T11:49:06.464 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.461+0000 7f7d3ad23800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.24.1.8 2023-12-03T11:49:06.464 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.461+0000 7f7d3ad23800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.24.1.8 2023-12-03T11:49:06.464 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.461+0000 7f7d3ad23800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.24.1.9 2023-12-03T11:49:06.464 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.461+0000 7f7d3ad23800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.24.1.9 2023-12-03T11:49:06.465 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.461+0000 7f7d3ad23800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.24.1.10 2023-12-03T11:49:06.465 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.461+0000 7f7d3ad23800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.24.1.10 2023-12-03T11:49:06.465 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.461+0000 7f7d3ad23800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.24.1.11 2023-12-03T11:49:06.465 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.461+0000 7f7d3ad23800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.24.1.11 2023-12-03T11:49:06.465 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.461+0000 7f7d3ad23800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.24.0 2023-12-03T11:49:06.466 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.462+0000 7f7d3ad23800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.24.1 2023-12-03T11:49:06.466 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.462+0000 7f7d3ad23800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.24.2 2023-12-03T11:49:06.466 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.463+0000 7f7d3ad23800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.24.3 2023-12-03T11:49:06.466 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.463+0000 7f7d3ad23800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.24.4 2023-12-03T11:49:06.466 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.464+0000 7f7d3ad23800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.24.5 2023-12-03T11:49:06.466 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.465+0000 7f7d3ad23800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.24.6 2023-12-03T11:49:06.467 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.465+0000 7f7d3ad23800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.24.7 2023-12-03T11:49:06.467 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.465+0000 7f7d3ad23800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.24.8 2023-12-03T11:49:06.467 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.466+0000 7f7d3ad23800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.24.9 2023-12-03T11:49:06.467 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.466+0000 7f7d3ad23800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.24.10 2023-12-03T11:49:06.473 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.470+0000 7f7d3ad23800 -1 Injecting error=-5 at location=commit_target_layout 2023-12-03T11:49:06.473 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.470+0000 7f7d3ad23800 0 ERROR: commit_reshard failed to commit target index layout: (5) Input/output error 2023-12-03T11:49:06.476 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.474+0000 7f7c77fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:49:06.478 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.476+0000 7f7d3ad23800 20 remove_watcher() i=0 2023-12-03T11:49:06.478 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.476+0000 7f7d3ad23800 2 removed watcher, disabling cache 2023-12-03T11:49:06.479 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.478+0000 7f7d3ad23800 20 remove_watcher() i=1 2023-12-03T11:49:06.480 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.479+0000 7f7d3ad23800 20 remove_watcher() i=2 2023-12-03T11:49:06.481 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.480+0000 7f7d3ad23800 20 remove_watcher() i=3 2023-12-03T11:49:06.482 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.481+0000 7f7d3ad23800 20 remove_watcher() i=4 2023-12-03T11:49:06.483 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.482+0000 7f7d3ad23800 20 remove_watcher() i=5 2023-12-03T11:49:06.484 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.483+0000 7f7d3ad23800 20 remove_watcher() i=6 2023-12-03T11:49:06.485 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.484+0000 7f7d3ad23800 20 remove_watcher() i=7 2023-12-03T11:49:06.491 INFO:tasks.workunit.client.0.smithi003.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2023-12-03T11:49:06.519 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:49:06.519 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:49:06.533 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.532+0000 7f3f54137800 20 rados->read ofs=0 len=0 2023-12-03T11:49:06.535 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.533+0000 7f3f54137800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:06.535 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.533+0000 7f3f54137800 20 realm 2023-12-03T11:49:06.535 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.533+0000 7f3f54137800 20 rados->read ofs=0 len=0 2023-12-03T11:49:06.535 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.534+0000 7f3f54137800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:06.535 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.534+0000 7f3f54137800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:49:06.536 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.534+0000 7f3f54137800 20 rados->read ofs=0 len=0 2023-12-03T11:49:06.536 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.534+0000 7f3f54137800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:06.536 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.534+0000 7f3f54137800 20 rados->read ofs=0 len=0 2023-12-03T11:49:06.536 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.535+0000 7f3f54137800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:49:06.536 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.535+0000 7f3f54137800 20 rados->read ofs=0 len=0 2023-12-03T11:49:06.536 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.535+0000 7f3f54137800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:49:06.537 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.535+0000 7f3f54137800 20 searching for the correct realm 2023-12-03T11:49:06.547 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.545+0000 7f3f4fe6f640 0 -- 172.21.15.3:0/351597498 >> [v2:172.21.15.37:6805/1692844418,v1:172.21.15.37:6807/1692844418] conn(0x555576d2b000 msgr2=0x555576d2d3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-03T11:49:06.548 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.546+0000 7f3f54137800 20 RGWRados::pool_iterate: got zone_info.83aabb46-04b5-4c96-9933-c6bfb1173a73 2023-12-03T11:49:06.548 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.546+0000 7f3f54137800 20 RGWRados::pool_iterate: got zonegroup_info.6a811aad-435d-4fdd-93c9-b7e0b50de429 2023-12-03T11:49:06.548 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.546+0000 7f3f54137800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:49:06.548 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.546+0000 7f3f54137800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:49:06.548 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.546+0000 7f3f54137800 20 rados->read ofs=0 len=0 2023-12-03T11:49:06.548 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.547+0000 7f3f54137800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:06.548 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.547+0000 7f3f54137800 20 rados->read ofs=0 len=0 2023-12-03T11:49:06.548 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.547+0000 7f3f54137800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:49:06.549 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.547+0000 7f3f54137800 20 rados->read ofs=0 len=0 2023-12-03T11:49:06.550 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.547+0000 7f3f54137800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:49:06.550 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.547+0000 7f3f54137800 20 zone default found 2023-12-03T11:49:06.550 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.547+0000 7f3f54137800 4 Realm: () 2023-12-03T11:49:06.550 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.547+0000 7f3f54137800 4 ZoneGroup: default (6a811aad-435d-4fdd-93c9-b7e0b50de429) 2023-12-03T11:49:06.550 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.547+0000 7f3f54137800 4 Zone: default (83aabb46-04b5-4c96-9933-c6bfb1173a73) 2023-12-03T11:49:06.550 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.547+0000 7f3f54137800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:49:06.550 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.547+0000 7f3f54137800 20 zonegroup default 2023-12-03T11:49:06.550 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.547+0000 7f3f54137800 20 rados->read ofs=0 len=0 2023-12-03T11:49:06.550 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.547+0000 7f3f54137800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:06.550 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.547+0000 7f3f54137800 20 rados->read ofs=0 len=0 2023-12-03T11:49:06.550 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.548+0000 7f3f54137800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:06.550 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.548+0000 7f3f54137800 20 rados->read ofs=0 len=0 2023-12-03T11:49:06.550 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.548+0000 7f3f54137800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:06.551 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.548+0000 7f3f54137800 20 started sync module instance, tier type = 2023-12-03T11:49:06.551 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.548+0000 7f3f54137800 20 started zone id=83aabb46-04b5-4c96-9933-c6bfb1173a73 (name=default) with tier type = 2023-12-03T11:49:06.557 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.555+0000 7f3f4f66e640 0 -- 172.21.15.3:0/351597498 >> [v2:172.21.15.3:6817/3356208405,v1:172.21.15.3:6819/3356208405] conn(0x555576d30010 msgr2=0x555576d32400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:49:06.558 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.557+0000 7f3f54137800 20 add_watcher() i=0 2023-12-03T11:49:06.558 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.557+0000 7f3f54137800 20 add_watcher() i=1 2023-12-03T11:49:06.558 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.557+0000 7f3f54137800 20 add_watcher() i=2 2023-12-03T11:49:06.558 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.557+0000 7f3f54137800 20 add_watcher() i=3 2023-12-03T11:49:06.558 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.557+0000 7f3f54137800 20 add_watcher() i=4 2023-12-03T11:49:06.558 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.557+0000 7f3f54137800 20 add_watcher() i=5 2023-12-03T11:49:06.559 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.557+0000 7f3f54137800 20 add_watcher() i=6 2023-12-03T11:49:06.559 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.558+0000 7f3f54137800 20 add_watcher() i=7 2023-12-03T11:49:06.559 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.558+0000 7f3f54137800 2 all 8 watchers are set, enabling cache 2023-12-03T11:49:06.561 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.560+0000 7f3f15fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:49:06.561 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.560+0000 7f3f54137800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:49:06.561 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.560+0000 7f3f54137800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:49:06.568 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.566+0000 7f3f54137800 5 note: GC not initialized 2023-12-03T11:49:06.568 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.566+0000 7f3e8cff9640 20 reqs_thread_entry: start 2023-12-03T11:49:06.568 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.566+0000 7f3f54137800 20 init_complete bucket index max shards: 11 2023-12-03T11:49:06.568 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.566+0000 7f3f54137800 20 Filter name: none 2023-12-03T11:49:06.568 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.566+0000 7f3e827fc640 20 reqs_thread_entry: start 2023-12-03T11:49:06.568 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.567+0000 7f3f54137800 20 rados->read ofs=0 len=0 2023-12-03T11:49:06.569 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.567+0000 7f3f54137800 20 rados_obj.operate() r=0 bl.length=221 2023-12-03T11:49:06.569 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.567+0000 7f3f54137800 20 rados->read ofs=0 len=0 2023-12-03T11:49:06.569 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.567+0000 7f3f54137800 20 rados_obj.operate() r=0 bl.length=425 2023-12-03T11:49:06.570 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.568+0000 7f3f54137800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:49:06.570 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.568+0000 7f3f54137800 20 rados->read ofs=0 len=0 2023-12-03T11:49:06.570 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.568+0000 7f3f54137800 20 rados_obj.operate() r=0 bl.length=221 2023-12-03T11:49:06.570 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.568+0000 7f3f54137800 20 rados->read ofs=0 len=0 2023-12-03T11:49:06.570 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.568+0000 7f3f54137800 20 rados_obj.operate() r=0 bl.length=425 2023-12-03T11:49:06.570 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.568+0000 7f3f54137800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:49:06.570 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.569+0000 7f3f54137800 20 rados->read ofs=0 len=0 2023-12-03T11:49:06.570 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.569+0000 7f3f54137800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:06.571 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.570+0000 7f3f15fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:49:06.574 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.573+0000 7f3f54137800 20 remove_watcher() i=0 2023-12-03T11:49:06.574 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.573+0000 7f3f54137800 2 removed watcher, disabling cache 2023-12-03T11:49:06.575 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.574+0000 7f3f54137800 20 remove_watcher() i=1 2023-12-03T11:49:06.576 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.575+0000 7f3f54137800 20 remove_watcher() i=2 2023-12-03T11:49:06.577 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.576+0000 7f3f54137800 20 remove_watcher() i=3 2023-12-03T11:49:06.578 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.577+0000 7f3f54137800 20 remove_watcher() i=4 2023-12-03T11:49:06.579 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.578+0000 7f3f54137800 20 remove_watcher() i=5 2023-12-03T11:49:06.580 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.579+0000 7f3f54137800 20 remove_watcher() i=6 2023-12-03T11:49:06.581 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.580+0000 7f3f54137800 20 remove_watcher() i=7 2023-12-03T11:49:06.586 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:49:06.586 INFO:tasks.workunit.client.0.smithi003.stderr:BUCKET_STATS: 2023-12-03T11:49:06.586 INFO:tasks.workunit.client.0.smithi003.stderr:bucket: error-at-commit-target-layout id: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.24 num_objects: 20 size_kb: 1 num_shards: 11 2023-12-03T11:49:06.586 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:49:06.669 INFO:tasks.workunit.client.0.smithi003.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2023-12-03T11:49:06.700 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:49:06.700 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:49:06.714 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.713+0000 7f524c324800 20 rados->read ofs=0 len=0 2023-12-03T11:49:06.716 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.715+0000 7f524c324800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:06.716 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.715+0000 7f524c324800 20 realm 2023-12-03T11:49:06.716 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.715+0000 7f524c324800 20 rados->read ofs=0 len=0 2023-12-03T11:49:06.716 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.715+0000 7f524c324800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:06.716 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.715+0000 7f524c324800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:49:06.716 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.715+0000 7f524c324800 20 rados->read ofs=0 len=0 2023-12-03T11:49:06.717 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.715+0000 7f524c324800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:06.717 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.715+0000 7f524c324800 20 rados->read ofs=0 len=0 2023-12-03T11:49:06.717 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.716+0000 7f524c324800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:49:06.717 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.716+0000 7f524c324800 20 rados->read ofs=0 len=0 2023-12-03T11:49:06.717 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.716+0000 7f524c324800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:49:06.717 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.716+0000 7f524c324800 20 searching for the correct realm 2023-12-03T11:49:06.727 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.726+0000 7f524807e640 0 -- 172.21.15.3:0/2654550421 >> [v2:172.21.15.3:6800/2373485412,v1:172.21.15.3:6801/2373485412] conn(0x7f524006d040 msgr2=0x7f524006d930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:49:06.729 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.727+0000 7f524c324800 20 RGWRados::pool_iterate: got zone_info.83aabb46-04b5-4c96-9933-c6bfb1173a73 2023-12-03T11:49:06.729 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.727+0000 7f524c324800 20 RGWRados::pool_iterate: got zonegroup_info.6a811aad-435d-4fdd-93c9-b7e0b50de429 2023-12-03T11:49:06.729 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.727+0000 7f524c324800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:49:06.729 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.727+0000 7f524c324800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:49:06.729 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.727+0000 7f524c324800 20 rados->read ofs=0 len=0 2023-12-03T11:49:06.729 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.728+0000 7f524c324800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:06.729 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.728+0000 7f524c324800 20 rados->read ofs=0 len=0 2023-12-03T11:49:06.730 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.728+0000 7f524c324800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:49:06.730 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.728+0000 7f524c324800 20 rados->read ofs=0 len=0 2023-12-03T11:49:06.731 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.728+0000 7f524c324800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:49:06.731 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.728+0000 7f524c324800 20 zone default found 2023-12-03T11:49:06.731 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.728+0000 7f524c324800 4 Realm: () 2023-12-03T11:49:06.731 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.728+0000 7f524c324800 4 ZoneGroup: default (6a811aad-435d-4fdd-93c9-b7e0b50de429) 2023-12-03T11:49:06.731 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.728+0000 7f524c324800 4 Zone: default (83aabb46-04b5-4c96-9933-c6bfb1173a73) 2023-12-03T11:49:06.731 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.728+0000 7f524c324800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:49:06.731 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.728+0000 7f524c324800 20 zonegroup default 2023-12-03T11:49:06.731 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.728+0000 7f524c324800 20 rados->read ofs=0 len=0 2023-12-03T11:49:06.731 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.728+0000 7f524c324800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:06.732 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.728+0000 7f524c324800 20 rados->read ofs=0 len=0 2023-12-03T11:49:06.732 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.729+0000 7f524c324800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:06.732 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.729+0000 7f524c324800 20 rados->read ofs=0 len=0 2023-12-03T11:49:06.732 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.729+0000 7f524c324800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:06.732 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.729+0000 7f524c324800 20 started sync module instance, tier type = 2023-12-03T11:49:06.732 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.729+0000 7f524c324800 20 started zone id=83aabb46-04b5-4c96-9933-c6bfb1173a73 (name=default) with tier type = 2023-12-03T11:49:06.736 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.735+0000 7f524807e640 0 -- 172.21.15.3:0/2654550421 >> [v2:172.21.15.3:6800/2373485412,v1:172.21.15.3:6801/2373485412] conn(0x7f5224079e10 msgr2=0x7f522407c240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:49:06.740 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.738+0000 7f524c324800 20 add_watcher() i=0 2023-12-03T11:49:06.740 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.738+0000 7f524c324800 20 add_watcher() i=1 2023-12-03T11:49:06.740 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.738+0000 7f524c324800 20 add_watcher() i=2 2023-12-03T11:49:06.740 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.738+0000 7f524c324800 20 add_watcher() i=3 2023-12-03T11:49:06.740 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.738+0000 7f524c324800 20 add_watcher() i=4 2023-12-03T11:49:06.740 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.738+0000 7f524c324800 20 add_watcher() i=5 2023-12-03T11:49:06.740 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.738+0000 7f524c324800 20 add_watcher() i=6 2023-12-03T11:49:06.740 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.739+0000 7f524c324800 20 add_watcher() i=7 2023-12-03T11:49:06.741 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.739+0000 7f524c324800 2 all 8 watchers are set, enabling cache 2023-12-03T11:49:06.742 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.741+0000 7f520e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:49:06.742 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.741+0000 7f524c324800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:49:06.743 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.741+0000 7f524c324800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:49:06.749 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.747+0000 7f524c324800 5 note: GC not initialized 2023-12-03T11:49:06.749 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.747+0000 7f517d7fa640 20 reqs_thread_entry: start 2023-12-03T11:49:06.749 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.747+0000 7f524c324800 20 init_complete bucket index max shards: 11 2023-12-03T11:49:06.749 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.748+0000 7f524c324800 20 Filter name: none 2023-12-03T11:49:06.749 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.748+0000 7f5176ffd640 20 reqs_thread_entry: start 2023-12-03T11:49:06.749 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.748+0000 7f524c324800 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2023-12-03T11:49:06.749 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.748+0000 7f524c324800 20 rados->read ofs=0 len=0 2023-12-03T11:49:06.750 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.748+0000 7f524c324800 20 rados_obj.operate() r=0 bl.length=221 2023-12-03T11:49:06.750 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.748+0000 7f524c324800 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2023-12-03T11:49:06.750 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.748+0000 7f524c324800 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2023-12-03T11:49:06.750 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.748+0000 7f524c324800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.24 : miss 2023-12-03T11:49:06.751 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.748+0000 7f524c324800 20 rados->read ofs=0 len=0 2023-12-03T11:49:06.751 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.748+0000 7f524c324800 20 rados_obj.operate() r=0 bl.length=425 2023-12-03T11:49:06.751 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.748+0000 7f524c324800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.24 info.flags=0x17 2023-12-03T11:49:06.751 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.748+0000 7f524c324800 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.24 to cache LRU end 2023-12-03T11:49:06.751 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.748+0000 7f524c324800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:49:06.751 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.748+0000 7f524c324800 10 updating xattr: name=user.rgw.acl bl.length()=265 2023-12-03T11:49:06.751 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.749+0000 7f524c324800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.24 2023-12-03T11:49:06.751 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.750+0000 7f524c324800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2023-12-03T11:49:06.759 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.757+0000 7f524c324800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.24 info.flags=0x17 2023-12-03T11:49:06.759 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.757+0000 7f524c324800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.24 to cache LRU end 2023-12-03T11:49:06.759 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.757+0000 7f524c324800 10 updating xattr: name=user.rgw.acl bl.length()=265 2023-12-03T11:49:06.759 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.757+0000 7f524c324800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.24, ofs0, ns] 2023-12-03T11:49:06.759 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.757+0000 7f522effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660501 cookie 94732853620304 notifier 6560 bl.length()=965 2023-12-03T11:49:06.759 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.757+0000 7f522effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.24 info.flags=0x17 2023-12-03T11:49:06.759 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.757+0000 7f522effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.24 to cache LRU end 2023-12-03T11:49:06.759 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.757+0000 7f522effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2023-12-03T11:49:06.760 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.759+0000 7f524c324800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.24]): orig_sources= new_sources= 2023-12-03T11:49:06.760 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.759+0000 7f524c324800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.24]): potential sources added=[] removed=[] 2023-12-03T11:49:06.761 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.759+0000 7f524c324800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.24]): orig_dests= new_dests= 2023-12-03T11:49:06.761 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.759+0000 7f524c324800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.24]): potential dests added=[] removed=[] 2023-12-03T11:49:06.763 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.762+0000 7f524c324800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.24.2.0 2023-12-03T11:49:06.763 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.762+0000 7f524c324800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.24.2.0 2023-12-03T11:49:06.763 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.762+0000 7f524c324800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.24.2.1 2023-12-03T11:49:06.763 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.762+0000 7f524c324800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.24.2.1 2023-12-03T11:49:06.763 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.762+0000 7f524c324800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.24.2.2 2023-12-03T11:49:06.763 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.762+0000 7f524c324800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.24.2.2 2023-12-03T11:49:06.763 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.762+0000 7f524c324800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.24.2.3 2023-12-03T11:49:06.764 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.762+0000 7f524c324800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.24.2.3 2023-12-03T11:49:06.764 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.762+0000 7f524c324800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.24.2.4 2023-12-03T11:49:06.764 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.762+0000 7f524c324800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.24.2.4 2023-12-03T11:49:06.764 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.762+0000 7f524c324800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.24.2.5 2023-12-03T11:49:06.764 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.762+0000 7f524c324800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.24.2.5 2023-12-03T11:49:06.764 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.762+0000 7f524c324800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.24.2.6 2023-12-03T11:49:06.764 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.762+0000 7f524c324800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.24.2.6 2023-12-03T11:49:06.764 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.762+0000 7f524c324800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.24.2.7 2023-12-03T11:49:06.764 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.762+0000 7f524c324800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.24.2.7 2023-12-03T11:49:06.764 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.762+0000 7f524c324800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.24.2.8 2023-12-03T11:49:06.764 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.762+0000 7f524c324800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.24.2.8 2023-12-03T11:49:06.764 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.762+0000 7f524c324800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.24.2.9 2023-12-03T11:49:06.764 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.762+0000 7f524c324800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.24.2.9 2023-12-03T11:49:06.764 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.762+0000 7f524c324800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.24.2.10 2023-12-03T11:49:06.764 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.762+0000 7f524c324800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.24.2.10 2023-12-03T11:49:06.765 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.762+0000 7f524c324800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.24.2.11 2023-12-03T11:49:06.765 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.762+0000 7f524c324800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.24.2.11 2023-12-03T11:49:06.765 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.762+0000 7f524c324800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.24.0 2023-12-03T11:49:06.765 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.762+0000 7f524c324800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.24.1 2023-12-03T11:49:06.765 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.763+0000 7f524c324800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.24.2 2023-12-03T11:49:06.766 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.763+0000 7f524c324800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.24.3 2023-12-03T11:49:06.766 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.764+0000 7f524c324800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.24.4 2023-12-03T11:49:06.766 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.764+0000 7f524c324800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.24.5 2023-12-03T11:49:06.766 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.765+0000 7f524c324800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.24.6 2023-12-03T11:49:06.766 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.765+0000 7f524c324800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.24.7 2023-12-03T11:49:06.767 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.765+0000 7f524c324800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.24.8 2023-12-03T11:49:06.767 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.766+0000 7f524c324800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.24.9 2023-12-03T11:49:06.767 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.766+0000 7f524c324800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.24.10 2023-12-03T11:49:06.770 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.769+0000 7f524c324800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.24 : hit (requested=0x17, cached=0x17) 2023-12-03T11:49:06.770 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.769+0000 7f524c324800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.24 2023-12-03T11:49:06.772 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.770+0000 7f524c324800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.24 info.flags=0x17 2023-12-03T11:49:06.772 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.770+0000 7f524c324800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.24 to cache LRU end 2023-12-03T11:49:06.772 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.770+0000 7f524c324800 10 updating xattr: name=user.rgw.acl bl.length()=265 2023-12-03T11:49:06.772 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.770+0000 7f524c324800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.24, ofs0, ns] 2023-12-03T11:49:06.772 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.770+0000 7f522e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660502 cookie 94732853620304 notifier 6560 bl.length()=933 2023-12-03T11:49:06.772 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.770+0000 7f522e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.24 info.flags=0x17 2023-12-03T11:49:06.772 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.770+0000 7f522e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.24 to cache LRU end 2023-12-03T11:49:06.772 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.770+0000 7f522e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2023-12-03T11:49:06.773 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.772+0000 7f524c324800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.24]): orig_sources= new_sources= 2023-12-03T11:49:06.773 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.772+0000 7f524c324800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.24]): potential sources added=[] removed=[] 2023-12-03T11:49:06.773 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.772+0000 7f524c324800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.24]): orig_dests= new_dests= 2023-12-03T11:49:06.773 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.772+0000 7f524c324800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.24]): potential dests added=[] removed=[] 2023-12-03T11:49:06.776 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.774+0000 7f524c324800 1 execute INFO: reshard of bucket "error-at-commit-target-layout" completed successfully 2023-12-03T11:49:06.777 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.776+0000 7f520e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:49:06.779 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.778+0000 7f524c324800 20 remove_watcher() i=0 2023-12-03T11:49:06.779 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.778+0000 7f524c324800 2 removed watcher, disabling cache 2023-12-03T11:49:06.781 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.779+0000 7f524c324800 20 remove_watcher() i=1 2023-12-03T11:49:06.782 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.781+0000 7f524c324800 20 remove_watcher() i=2 2023-12-03T11:49:06.783 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.782+0000 7f524c324800 20 remove_watcher() i=3 2023-12-03T11:49:06.784 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.783+0000 7f524c324800 20 remove_watcher() i=4 2023-12-03T11:49:06.785 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.784+0000 7f524c324800 20 remove_watcher() i=5 2023-12-03T11:49:06.786 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.785+0000 7f524c324800 20 remove_watcher() i=6 2023-12-03T11:49:06.787 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.786+0000 7f524c324800 20 remove_watcher() i=7 2023-12-03T11:49:06.793 INFO:tasks.workunit.client.0.smithi003.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2023-12-03T11:49:06.821 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:49:06.821 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:49:06.836 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.835+0000 7f7dc680f800 20 rados->read ofs=0 len=0 2023-12-03T11:49:06.838 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.836+0000 7f7dc680f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:06.838 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.836+0000 7f7dc680f800 20 realm 2023-12-03T11:49:06.838 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.836+0000 7f7dc680f800 20 rados->read ofs=0 len=0 2023-12-03T11:49:06.838 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.836+0000 7f7dc680f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:06.838 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.836+0000 7f7dc680f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:49:06.838 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.836+0000 7f7dc680f800 20 rados->read ofs=0 len=0 2023-12-03T11:49:06.838 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.837+0000 7f7dc680f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:06.838 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.837+0000 7f7dc680f800 20 rados->read ofs=0 len=0 2023-12-03T11:49:06.839 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.837+0000 7f7dc680f800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:49:06.839 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.837+0000 7f7dc680f800 20 rados->read ofs=0 len=0 2023-12-03T11:49:06.839 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.838+0000 7f7dc680f800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:49:06.839 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.838+0000 7f7dc680f800 20 searching for the correct realm 2023-12-03T11:49:06.847 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.845+0000 7f7dc2748640 0 -- 172.21.15.3:0/3720900903 >> [v2:172.21.15.3:6816/2638197404,v1:172.21.15.3:6818/2638197404] conn(0x555d6132c870 msgr2=0x555d6132ec60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:49:06.850 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.848+0000 7f7dc680f800 20 RGWRados::pool_iterate: got zone_info.83aabb46-04b5-4c96-9933-c6bfb1173a73 2023-12-03T11:49:06.850 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.848+0000 7f7dc680f800 20 RGWRados::pool_iterate: got zonegroup_info.6a811aad-435d-4fdd-93c9-b7e0b50de429 2023-12-03T11:49:06.850 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.848+0000 7f7dc680f800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:49:06.850 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.848+0000 7f7dc680f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:49:06.850 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.848+0000 7f7dc680f800 20 rados->read ofs=0 len=0 2023-12-03T11:49:06.850 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.849+0000 7f7dc680f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:06.850 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.849+0000 7f7dc680f800 20 rados->read ofs=0 len=0 2023-12-03T11:49:06.852 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.849+0000 7f7dc680f800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:49:06.852 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.849+0000 7f7dc680f800 20 rados->read ofs=0 len=0 2023-12-03T11:49:06.852 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.849+0000 7f7dc680f800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:49:06.852 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.849+0000 7f7dc680f800 20 zone default found 2023-12-03T11:49:06.852 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.849+0000 7f7dc680f800 4 Realm: () 2023-12-03T11:49:06.852 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.849+0000 7f7dc680f800 4 ZoneGroup: default (6a811aad-435d-4fdd-93c9-b7e0b50de429) 2023-12-03T11:49:06.852 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.849+0000 7f7dc680f800 4 Zone: default (83aabb46-04b5-4c96-9933-c6bfb1173a73) 2023-12-03T11:49:06.852 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.849+0000 7f7dc680f800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:49:06.852 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.849+0000 7f7dc680f800 20 zonegroup default 2023-12-03T11:49:06.852 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.849+0000 7f7dc680f800 20 rados->read ofs=0 len=0 2023-12-03T11:49:06.852 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.849+0000 7f7dc680f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:06.853 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.849+0000 7f7dc680f800 20 rados->read ofs=0 len=0 2023-12-03T11:49:06.853 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.850+0000 7f7dc680f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:06.853 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.850+0000 7f7dc680f800 20 rados->read ofs=0 len=0 2023-12-03T11:49:06.853 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.850+0000 7f7dc1746640 0 -- 172.21.15.3:0/3720900903 >> [v2:172.21.15.3:6817/3356208405,v1:172.21.15.3:6819/3356208405] conn(0x555d61335720 msgr2=0x555d61337b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:49:06.853 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.850+0000 7f7dc680f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:06.853 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.850+0000 7f7dc680f800 20 started sync module instance, tier type = 2023-12-03T11:49:06.853 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.850+0000 7f7dc680f800 20 started zone id=83aabb46-04b5-4c96-9933-c6bfb1173a73 (name=default) with tier type = 2023-12-03T11:49:06.860 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.859+0000 7f7dc680f800 20 add_watcher() i=0 2023-12-03T11:49:06.860 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.859+0000 7f7dc680f800 20 add_watcher() i=1 2023-12-03T11:49:06.860 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.859+0000 7f7dc680f800 20 add_watcher() i=2 2023-12-03T11:49:06.860 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.859+0000 7f7dc680f800 20 add_watcher() i=3 2023-12-03T11:49:06.860 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.859+0000 7f7dc680f800 20 add_watcher() i=4 2023-12-03T11:49:06.860 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.859+0000 7f7dc680f800 20 add_watcher() i=5 2023-12-03T11:49:06.860 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.859+0000 7f7dc680f800 20 add_watcher() i=6 2023-12-03T11:49:06.861 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.860+0000 7f7dc680f800 20 add_watcher() i=7 2023-12-03T11:49:06.861 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.860+0000 7f7dc680f800 2 all 8 watchers are set, enabling cache 2023-12-03T11:49:06.863 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.862+0000 7f7d877e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:49:06.863 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.862+0000 7f7dc680f800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:49:06.863 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.862+0000 7f7dc680f800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:49:06.869 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.868+0000 7f7dc680f800 5 note: GC not initialized 2023-12-03T11:49:06.869 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.868+0000 7f7cf67fc640 20 reqs_thread_entry: start 2023-12-03T11:49:06.870 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.868+0000 7f7dc680f800 20 init_complete bucket index max shards: 11 2023-12-03T11:49:06.870 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.868+0000 7f7dc680f800 20 Filter name: none 2023-12-03T11:49:06.870 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.868+0000 7f7ce7fff640 20 reqs_thread_entry: start 2023-12-03T11:49:06.870 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.868+0000 7f7dc680f800 20 rados->read ofs=0 len=0 2023-12-03T11:49:06.871 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.869+0000 7f7dc680f800 20 rados_obj.operate() r=0 bl.length=221 2023-12-03T11:49:06.871 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.869+0000 7f7dc680f800 20 rados->read ofs=0 len=0 2023-12-03T11:49:06.871 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.869+0000 7f7dc680f800 20 rados_obj.operate() r=0 bl.length=393 2023-12-03T11:49:06.871 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.869+0000 7f7dc680f800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:49:06.871 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.869+0000 7f7dc680f800 20 rados->read ofs=0 len=0 2023-12-03T11:49:06.871 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.870+0000 7f7dc680f800 20 rados_obj.operate() r=0 bl.length=221 2023-12-03T11:49:06.871 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.870+0000 7f7dc680f800 20 rados->read ofs=0 len=0 2023-12-03T11:49:06.871 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.870+0000 7f7dc680f800 20 rados_obj.operate() r=0 bl.length=393 2023-12-03T11:49:06.871 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.870+0000 7f7dc680f800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:49:06.872 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.871+0000 7f7dc680f800 20 rados->read ofs=0 len=0 2023-12-03T11:49:06.872 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.871+0000 7f7dc680f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:06.873 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.872+0000 7f7d877e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:49:06.875 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.874+0000 7f7dc680f800 20 remove_watcher() i=0 2023-12-03T11:49:06.875 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.874+0000 7f7dc680f800 2 removed watcher, disabling cache 2023-12-03T11:49:06.876 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.875+0000 7f7dc680f800 20 remove_watcher() i=1 2023-12-03T11:49:06.877 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.876+0000 7f7dc680f800 20 remove_watcher() i=2 2023-12-03T11:49:06.878 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.877+0000 7f7dc680f800 20 remove_watcher() i=3 2023-12-03T11:49:06.881 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.878+0000 7f7dc680f800 20 remove_watcher() i=4 2023-12-03T11:49:06.881 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.879+0000 7f7dc680f800 20 remove_watcher() i=5 2023-12-03T11:49:06.881 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.880+0000 7f7dc680f800 20 remove_watcher() i=6 2023-12-03T11:49:06.882 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:06.881+0000 7f7dc680f800 20 remove_watcher() i=7 2023-12-03T11:49:06.887 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:49:06.887 INFO:tasks.workunit.client.0.smithi003.stderr:BUCKET_STATS: 2023-12-03T11:49:06.887 INFO:tasks.workunit.client.0.smithi003.stderr:bucket: error-at-commit-target-layout id: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.24 num_objects: 19 size_kb: 1 num_shards: 12 2023-12-03T11:49:06.887 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:49:07.192 INFO:tasks.workunit.client.0.smithi003.stderr:TEST: reshard bucket with ECANCELED injected at commit_target_layout 2023-12-03T11:49:07.192 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:49:07.886 INFO:tasks.workunit.client.0.smithi003.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2023-12-03T11:49:07.913 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:49:07.914 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:49:07.928 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:07.926+0000 7feef4413800 20 rados->read ofs=0 len=0 2023-12-03T11:49:07.930 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:07.928+0000 7feef4413800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:07.930 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:07.928+0000 7feef4413800 20 realm 2023-12-03T11:49:07.930 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:07.928+0000 7feef4413800 20 rados->read ofs=0 len=0 2023-12-03T11:49:07.930 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:07.928+0000 7feef4413800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:07.930 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:07.928+0000 7feef4413800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:49:07.930 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:07.928+0000 7feef4413800 20 rados->read ofs=0 len=0 2023-12-03T11:49:07.930 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:07.929+0000 7feef4413800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:07.930 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:07.929+0000 7feef4413800 20 rados->read ofs=0 len=0 2023-12-03T11:49:07.931 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:07.929+0000 7feef4413800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:49:07.931 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:07.929+0000 7feef4413800 20 rados->read ofs=0 len=0 2023-12-03T11:49:07.931 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:07.930+0000 7feef4413800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:49:07.931 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:07.930+0000 7feef4413800 20 searching for the correct realm 2023-12-03T11:49:07.942 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:07.940+0000 7feef1712640 0 -- 172.21.15.3:0/292713269 >> [v2:172.21.15.3:6817/3356208405,v1:172.21.15.3:6819/3356208405] conn(0x5630f8e44fe0 msgr2=0x5630f8e473d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:49:07.942 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:07.941+0000 7feef4413800 20 RGWRados::pool_iterate: got zone_info.83aabb46-04b5-4c96-9933-c6bfb1173a73 2023-12-03T11:49:07.942 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:07.941+0000 7feef4413800 20 RGWRados::pool_iterate: got zonegroup_info.6a811aad-435d-4fdd-93c9-b7e0b50de429 2023-12-03T11:49:07.943 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:07.941+0000 7feef4413800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:49:07.943 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:07.941+0000 7feef4413800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:49:07.943 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:07.941+0000 7feef4413800 20 rados->read ofs=0 len=0 2023-12-03T11:49:07.943 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:07.941+0000 7feef4413800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:07.943 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:07.941+0000 7feef4413800 20 rados->read ofs=0 len=0 2023-12-03T11:49:07.944 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:07.941+0000 7feef4413800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:49:07.944 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:07.941+0000 7feef4413800 20 rados->read ofs=0 len=0 2023-12-03T11:49:07.944 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:07.942+0000 7feef4413800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:49:07.944 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:07.942+0000 7feef4413800 20 zone default found 2023-12-03T11:49:07.944 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:07.942+0000 7feef4413800 4 Realm: () 2023-12-03T11:49:07.944 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:07.942+0000 7feef4413800 4 ZoneGroup: default (6a811aad-435d-4fdd-93c9-b7e0b50de429) 2023-12-03T11:49:07.944 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:07.942+0000 7feef4413800 4 Zone: default (83aabb46-04b5-4c96-9933-c6bfb1173a73) 2023-12-03T11:49:07.944 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:07.942+0000 7feef4413800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:49:07.944 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:07.942+0000 7feef4413800 20 zonegroup default 2023-12-03T11:49:07.944 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:07.942+0000 7feef4413800 20 rados->read ofs=0 len=0 2023-12-03T11:49:07.945 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:07.942+0000 7feef4413800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:07.945 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:07.942+0000 7feef4413800 20 rados->read ofs=0 len=0 2023-12-03T11:49:07.945 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:07.942+0000 7feef4413800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:07.945 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:07.942+0000 7feef4413800 20 rados->read ofs=0 len=0 2023-12-03T11:49:07.945 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:07.943+0000 7feef4413800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:07.945 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:07.943+0000 7feef4413800 20 started sync module instance, tier type = 2023-12-03T11:49:07.945 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:07.943+0000 7feef4413800 20 started zone id=83aabb46-04b5-4c96-9933-c6bfb1173a73 (name=default) with tier type = 2023-12-03T11:49:07.952 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:07.951+0000 7feef1712640 0 -- 172.21.15.3:0/292713269 >> [v2:172.21.15.3:6817/3356208405,v1:172.21.15.3:6819/3356208405] conn(0x7feecc079d90 msgr2=0x7feecc07c1c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:49:07.953 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:07.952+0000 7feef4413800 20 add_watcher() i=0 2023-12-03T11:49:07.953 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:07.952+0000 7feef4413800 20 add_watcher() i=1 2023-12-03T11:49:07.954 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:07.952+0000 7feef4413800 20 add_watcher() i=2 2023-12-03T11:49:07.954 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:07.952+0000 7feef4413800 20 add_watcher() i=3 2023-12-03T11:49:07.954 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:07.952+0000 7feef4413800 20 add_watcher() i=4 2023-12-03T11:49:07.954 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:07.952+0000 7feef4413800 20 add_watcher() i=5 2023-12-03T11:49:07.955 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:07.953+0000 7feef4413800 20 add_watcher() i=6 2023-12-03T11:49:07.955 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:07.953+0000 7feef4413800 20 add_watcher() i=7 2023-12-03T11:49:07.955 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:07.953+0000 7feef4413800 2 all 8 watchers are set, enabling cache 2023-12-03T11:49:07.956 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:07.955+0000 7feeb77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:49:07.956 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:07.955+0000 7feef4413800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:49:07.956 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:07.955+0000 7feef4413800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:49:07.963 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:07.961+0000 7feef4413800 5 note: GC not initialized 2023-12-03T11:49:07.963 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:07.962+0000 7fee267fc640 20 reqs_thread_entry: start 2023-12-03T11:49:07.963 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:07.962+0000 7feef4413800 20 init_complete bucket index max shards: 11 2023-12-03T11:49:07.963 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:07.962+0000 7feef4413800 20 Filter name: none 2023-12-03T11:49:07.963 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:07.962+0000 7fee17fff640 20 reqs_thread_entry: start 2023-12-03T11:49:07.964 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:07.962+0000 7feef4413800 20 rados->read ofs=0 len=0 2023-12-03T11:49:07.964 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:07.963+0000 7feef4413800 20 rados_obj.operate() r=0 bl.length=221 2023-12-03T11:49:07.965 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:07.963+0000 7feef4413800 20 rados->read ofs=0 len=0 2023-12-03T11:49:07.965 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:07.963+0000 7feef4413800 20 rados_obj.operate() r=0 bl.length=393 2023-12-03T11:49:07.965 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:07.963+0000 7feef4413800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:49:07.965 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:07.963+0000 7feef4413800 20 rados->read ofs=0 len=0 2023-12-03T11:49:07.966 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:07.964+0000 7feef4413800 20 rados_obj.operate() r=0 bl.length=221 2023-12-03T11:49:07.966 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:07.964+0000 7feef4413800 20 rados->read ofs=0 len=0 2023-12-03T11:49:07.966 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:07.964+0000 7feef4413800 20 rados_obj.operate() r=0 bl.length=393 2023-12-03T11:49:07.966 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:07.964+0000 7feef4413800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:49:07.967 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:07.965+0000 7feef4413800 20 rados->read ofs=0 len=0 2023-12-03T11:49:07.967 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:07.965+0000 7feef4413800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:07.967 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:07.966+0000 7feeb77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:49:07.969 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:07.968+0000 7feef4413800 20 remove_watcher() i=0 2023-12-03T11:49:07.969 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:07.968+0000 7feef4413800 2 removed watcher, disabling cache 2023-12-03T11:49:07.970 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:07.969+0000 7feef4413800 20 remove_watcher() i=1 2023-12-03T11:49:07.971 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:07.970+0000 7feef4413800 20 remove_watcher() i=2 2023-12-03T11:49:07.972 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:07.971+0000 7feef4413800 20 remove_watcher() i=3 2023-12-03T11:49:07.973 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:07.972+0000 7feef4413800 20 remove_watcher() i=4 2023-12-03T11:49:07.974 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:07.973+0000 7feef4413800 20 remove_watcher() i=5 2023-12-03T11:49:07.975 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:07.974+0000 7feef4413800 20 remove_watcher() i=6 2023-12-03T11:49:07.976 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:07.975+0000 7feef4413800 20 remove_watcher() i=7 2023-12-03T11:49:07.981 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:49:07.981 INFO:tasks.workunit.client.0.smithi003.stderr:BUCKET_STATS: 2023-12-03T11:49:07.981 INFO:tasks.workunit.client.0.smithi003.stderr:bucket: error-at-commit-target-layout id: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.25 num_objects: 20 size_kb: 1 num_shards: 11 2023-12-03T11:49:07.981 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:49:07.983 INFO:tasks.workunit.client.0.smithi003.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at commit_target_layout --inject-error-code 125 2023-12-03T11:49:08.018 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:49:08.018 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:49:08.033 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.031+0000 7fe98bf26800 20 rados->read ofs=0 len=0 2023-12-03T11:49:08.035 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.033+0000 7fe98bf26800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:08.035 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.033+0000 7fe98bf26800 20 realm 2023-12-03T11:49:08.035 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.033+0000 7fe98bf26800 20 rados->read ofs=0 len=0 2023-12-03T11:49:08.035 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.033+0000 7fe98bf26800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:08.035 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.034+0000 7fe98bf26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:49:08.035 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.034+0000 7fe98bf26800 20 rados->read ofs=0 len=0 2023-12-03T11:49:08.035 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.034+0000 7fe98bf26800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:08.035 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.034+0000 7fe98bf26800 20 rados->read ofs=0 len=0 2023-12-03T11:49:08.036 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.035+0000 7fe98bf26800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:49:08.036 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.035+0000 7fe98bf26800 20 rados->read ofs=0 len=0 2023-12-03T11:49:08.036 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.035+0000 7fe98bf26800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:49:08.036 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.035+0000 7fe98bf26800 20 searching for the correct realm 2023-12-03T11:49:08.046 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.045+0000 7fe987bd0640 0 -- 172.21.15.3:0/3198301366 >> [v2:172.21.15.37:6805/1692844418,v1:172.21.15.37:6807/1692844418] conn(0x55f3c6a33060 msgr2=0x55f3c6a35450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:49:08.048 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.046+0000 7fe98bf26800 20 RGWRados::pool_iterate: got zone_info.83aabb46-04b5-4c96-9933-c6bfb1173a73 2023-12-03T11:49:08.048 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.046+0000 7fe98bf26800 20 RGWRados::pool_iterate: got zonegroup_info.6a811aad-435d-4fdd-93c9-b7e0b50de429 2023-12-03T11:49:08.048 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.046+0000 7fe98bf26800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:49:08.048 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.046+0000 7fe98bf26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:49:08.048 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.046+0000 7fe98bf26800 20 rados->read ofs=0 len=0 2023-12-03T11:49:08.048 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.046+0000 7fe98bf26800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:08.048 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.047+0000 7fe98bf26800 20 rados->read ofs=0 len=0 2023-12-03T11:49:08.049 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.047+0000 7fe98bf26800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:49:08.049 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.047+0000 7fe98bf26800 20 rados->read ofs=0 len=0 2023-12-03T11:49:08.049 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.047+0000 7fe98bf26800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:49:08.049 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.047+0000 7fe98bf26800 20 zone default found 2023-12-03T11:49:08.050 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.047+0000 7fe98bf26800 4 Realm: () 2023-12-03T11:49:08.050 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.047+0000 7fe98bf26800 4 ZoneGroup: default (6a811aad-435d-4fdd-93c9-b7e0b50de429) 2023-12-03T11:49:08.050 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.047+0000 7fe98bf26800 4 Zone: default (83aabb46-04b5-4c96-9933-c6bfb1173a73) 2023-12-03T11:49:08.050 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.047+0000 7fe98bf26800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:49:08.050 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.047+0000 7fe98bf26800 20 zonegroup default 2023-12-03T11:49:08.050 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.047+0000 7fe98bf26800 20 rados->read ofs=0 len=0 2023-12-03T11:49:08.050 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.047+0000 7fe98bf26800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:08.051 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.047+0000 7fe98bf26800 20 rados->read ofs=0 len=0 2023-12-03T11:49:08.051 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.048+0000 7fe98bf26800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:08.051 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.048+0000 7fe98bf26800 20 rados->read ofs=0 len=0 2023-12-03T11:49:08.051 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.048+0000 7fe98bf26800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:08.051 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.048+0000 7fe98bf26800 20 started sync module instance, tier type = 2023-12-03T11:49:08.051 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.048+0000 7fe98bf26800 20 started zone id=83aabb46-04b5-4c96-9933-c6bfb1173a73 (name=default) with tier type = 2023-12-03T11:49:08.056 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.055+0000 7fe9883d1640 0 -- 172.21.15.3:0/3198301366 >> [v2:172.21.15.37:6816/3770469300,v1:172.21.15.37:6818/3770469300] conn(0x7fe97c01b440 msgr2=0x7fe97c01b8a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:49:08.059 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.057+0000 7fe98bf26800 20 add_watcher() i=0 2023-12-03T11:49:08.059 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.057+0000 7fe98bf26800 20 add_watcher() i=1 2023-12-03T11:49:08.059 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.057+0000 7fe98bf26800 20 add_watcher() i=2 2023-12-03T11:49:08.059 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.057+0000 7fe98bf26800 20 add_watcher() i=3 2023-12-03T11:49:08.059 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.057+0000 7fe98bf26800 20 add_watcher() i=4 2023-12-03T11:49:08.059 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.057+0000 7fe98bf26800 20 add_watcher() i=5 2023-12-03T11:49:08.059 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.057+0000 7fe98bf26800 20 add_watcher() i=6 2023-12-03T11:49:08.059 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.058+0000 7fe98bf26800 20 add_watcher() i=7 2023-12-03T11:49:08.059 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.058+0000 7fe98bf26800 2 all 8 watchers are set, enabling cache 2023-12-03T11:49:08.061 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.060+0000 7fe94dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:49:08.061 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.060+0000 7fe98bf26800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:49:08.061 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.060+0000 7fe98bf26800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:49:08.068 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.066+0000 7fe98bf26800 5 note: GC not initialized 2023-12-03T11:49:08.068 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.066+0000 7fe8c4ff9640 20 reqs_thread_entry: start 2023-12-03T11:49:08.068 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.066+0000 7fe98bf26800 20 init_complete bucket index max shards: 11 2023-12-03T11:49:08.068 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.067+0000 7fe98bf26800 20 Filter name: none 2023-12-03T11:49:08.068 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.067+0000 7fe8ba7fc640 20 reqs_thread_entry: start 2023-12-03T11:49:08.068 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.067+0000 7fe98bf26800 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2023-12-03T11:49:08.068 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.067+0000 7fe98bf26800 20 rados->read ofs=0 len=0 2023-12-03T11:49:08.069 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.067+0000 7fe98bf26800 20 rados_obj.operate() r=0 bl.length=221 2023-12-03T11:49:08.069 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.067+0000 7fe98bf26800 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2023-12-03T11:49:08.069 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.067+0000 7fe98bf26800 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2023-12-03T11:49:08.069 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.067+0000 7fe98bf26800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.25 : miss 2023-12-03T11:49:08.069 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.067+0000 7fe98bf26800 20 rados->read ofs=0 len=0 2023-12-03T11:49:08.070 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.068+0000 7fe98bf26800 20 rados_obj.operate() r=0 bl.length=393 2023-12-03T11:49:08.070 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.068+0000 7fe98bf26800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.25 info.flags=0x17 2023-12-03T11:49:08.070 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.068+0000 7fe98bf26800 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.25 to cache LRU end 2023-12-03T11:49:08.070 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.068+0000 7fe98bf26800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:49:08.070 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.068+0000 7fe98bf26800 10 updating xattr: name=user.rgw.acl bl.length()=265 2023-12-03T11:49:08.070 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.068+0000 7fe98bf26800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.25 2023-12-03T11:49:08.074 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.073+0000 7fe98bf26800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.25 info.flags=0x17 2023-12-03T11:49:08.074 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.073+0000 7fe98bf26800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.25 to cache LRU end 2023-12-03T11:49:08.074 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.073+0000 7fe98bf26800 10 updating xattr: name=user.rgw.acl bl.length()=265 2023-12-03T11:49:08.074 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.073+0000 7fe98bf26800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.25, ofs0, ns] 2023-12-03T11:49:08.075 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.073+0000 7fe96dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660505 cookie 94505498049488 notifier 6620 bl.length()=965 2023-12-03T11:49:08.075 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.073+0000 7fe96dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.25 info.flags=0x17 2023-12-03T11:49:08.075 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.073+0000 7fe96dffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.25 to cache LRU end 2023-12-03T11:49:08.075 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.073+0000 7fe96dffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2023-12-03T11:49:08.076 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.075+0000 7fe98bf26800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.25]): orig_sources= new_sources= 2023-12-03T11:49:08.076 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.075+0000 7fe98bf26800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.25]): potential sources added=[] removed=[] 2023-12-03T11:49:08.076 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.075+0000 7fe98bf26800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.25]): orig_dests= new_dests= 2023-12-03T11:49:08.076 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.075+0000 7fe98bf26800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.25]): potential dests added=[] removed=[] 2023-12-03T11:49:08.079 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.077+0000 7fe98bf26800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.25.1.0 2023-12-03T11:49:08.079 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.077+0000 7fe98bf26800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.25.1.0 2023-12-03T11:49:08.079 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.078+0000 7fe98bf26800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.25.1.1 2023-12-03T11:49:08.079 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.078+0000 7fe98bf26800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.25.1.1 2023-12-03T11:49:08.079 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.078+0000 7fe98bf26800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.25.1.2 2023-12-03T11:49:08.079 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.078+0000 7fe98bf26800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.25.1.2 2023-12-03T11:49:08.079 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.078+0000 7fe98bf26800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.25.1.3 2023-12-03T11:49:08.079 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.078+0000 7fe98bf26800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.25.1.3 2023-12-03T11:49:08.079 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.078+0000 7fe98bf26800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.25.1.4 2023-12-03T11:49:08.080 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.078+0000 7fe98bf26800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.25.1.4 2023-12-03T11:49:08.080 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.078+0000 7fe98bf26800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.25.1.5 2023-12-03T11:49:08.080 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.078+0000 7fe98bf26800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.25.1.5 2023-12-03T11:49:08.080 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.078+0000 7fe98bf26800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.25.1.6 2023-12-03T11:49:08.080 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.078+0000 7fe98bf26800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.25.1.6 2023-12-03T11:49:08.080 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.078+0000 7fe98bf26800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.25.1.7 2023-12-03T11:49:08.080 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.078+0000 7fe98bf26800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.25.1.7 2023-12-03T11:49:08.080 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.078+0000 7fe98bf26800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.25.1.8 2023-12-03T11:49:08.080 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.078+0000 7fe98bf26800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.25.1.8 2023-12-03T11:49:08.080 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.078+0000 7fe98bf26800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.25.1.9 2023-12-03T11:49:08.080 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.078+0000 7fe98bf26800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.25.1.9 2023-12-03T11:49:08.080 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.078+0000 7fe98bf26800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.25.1.10 2023-12-03T11:49:08.080 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.078+0000 7fe98bf26800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.25.1.10 2023-12-03T11:49:08.080 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.078+0000 7fe98bf26800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.25.1.11 2023-12-03T11:49:08.081 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.078+0000 7fe98bf26800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.25.1.11 2023-12-03T11:49:08.081 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.078+0000 7fe98bf26800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.25.0 2023-12-03T11:49:08.081 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.078+0000 7fe98bf26800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.25.1 2023-12-03T11:49:08.081 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.078+0000 7fe98bf26800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.25.2 2023-12-03T11:49:08.081 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.079+0000 7fe98bf26800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.25.3 2023-12-03T11:49:08.082 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.080+0000 7fe98bf26800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.25.4 2023-12-03T11:49:08.082 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.080+0000 7fe98bf26800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.25.5 2023-12-03T11:49:08.082 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.081+0000 7fe98bf26800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.25.6 2023-12-03T11:49:08.082 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.081+0000 7fe98bf26800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.25.7 2023-12-03T11:49:08.083 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.082+0000 7fe98bf26800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.25.8 2023-12-03T11:49:08.083 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.082+0000 7fe98bf26800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.25.9 2023-12-03T11:49:08.084 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.083+0000 7fe98bf26800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.25.10 2023-12-03T11:49:08.087 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.086+0000 7fe98bf26800 -1 Injecting error=-125 at location=commit_target_layout 2023-12-03T11:49:08.087 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.086+0000 7fe98bf26800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.25 : hit (requested=0x17, cached=0x17) 2023-12-03T11:49:08.087 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.086+0000 7fe98bf26800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.25 2023-12-03T11:49:08.088 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.087+0000 7fe98bf26800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.25 info.flags=0x17 2023-12-03T11:49:08.088 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.087+0000 7fe98bf26800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.25 to cache LRU end 2023-12-03T11:49:08.088 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.087+0000 7fe98bf26800 10 updating xattr: name=user.rgw.acl bl.length()=265 2023-12-03T11:49:08.088 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.087+0000 7fe98bf26800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.25, ofs0, ns] 2023-12-03T11:49:08.089 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.087+0000 7fe96e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660506 cookie 94505498049488 notifier 6620 bl.length()=933 2023-12-03T11:49:08.089 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.087+0000 7fe96e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.25 info.flags=0x17 2023-12-03T11:49:08.089 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.087+0000 7fe96e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.25 to cache LRU end 2023-12-03T11:49:08.089 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.087+0000 7fe96e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2023-12-03T11:49:08.090 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.089+0000 7fe98bf26800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.25]): orig_sources= new_sources= 2023-12-03T11:49:08.090 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.089+0000 7fe98bf26800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.25]): potential sources added=[] removed=[] 2023-12-03T11:49:08.090 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.089+0000 7fe98bf26800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.25]): orig_dests= new_dests= 2023-12-03T11:49:08.090 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.089+0000 7fe98bf26800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.25]): potential dests added=[] removed=[] 2023-12-03T11:49:08.092 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.091+0000 7fe98bf26800 1 execute INFO: reshard of bucket "error-at-commit-target-layout" completed successfully 2023-12-03T11:49:08.094 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.093+0000 7fe94dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:49:08.096 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.095+0000 7fe98bf26800 20 remove_watcher() i=0 2023-12-03T11:49:08.096 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.095+0000 7fe98bf26800 2 removed watcher, disabling cache 2023-12-03T11:49:08.097 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.096+0000 7fe98bf26800 20 remove_watcher() i=1 2023-12-03T11:49:08.098 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.097+0000 7fe98bf26800 20 remove_watcher() i=2 2023-12-03T11:49:08.099 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.098+0000 7fe98bf26800 20 remove_watcher() i=3 2023-12-03T11:49:08.101 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.099+0000 7fe98bf26800 20 remove_watcher() i=4 2023-12-03T11:49:08.102 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.101+0000 7fe98bf26800 20 remove_watcher() i=5 2023-12-03T11:49:08.103 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.101+0000 7fe98bf26800 20 remove_watcher() i=6 2023-12-03T11:49:08.104 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.103+0000 7fe98bf26800 20 remove_watcher() i=7 2023-12-03T11:49:08.114 INFO:tasks.workunit.client.0.smithi003.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2023-12-03T11:49:08.138 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:49:08.138 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:49:08.153 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.152+0000 7f5cc6d2c800 20 rados->read ofs=0 len=0 2023-12-03T11:49:08.154 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.153+0000 7f5cc6d2c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:08.155 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.153+0000 7f5cc6d2c800 20 realm 2023-12-03T11:49:08.155 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.153+0000 7f5cc6d2c800 20 rados->read ofs=0 len=0 2023-12-03T11:49:08.155 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.154+0000 7f5cc6d2c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:08.155 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.154+0000 7f5cc6d2c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:49:08.155 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.154+0000 7f5cc6d2c800 20 rados->read ofs=0 len=0 2023-12-03T11:49:08.155 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.154+0000 7f5cc6d2c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:08.155 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.154+0000 7f5cc6d2c800 20 rados->read ofs=0 len=0 2023-12-03T11:49:08.156 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.155+0000 7f5cc6d2c800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:49:08.156 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.155+0000 7f5cc6d2c800 20 rados->read ofs=0 len=0 2023-12-03T11:49:08.156 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.155+0000 7f5cc6d2c800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:49:08.156 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.155+0000 7f5cc6d2c800 20 searching for the correct realm 2023-12-03T11:49:08.164 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.163+0000 7f5cc2af0640 0 -- 172.21.15.3:0/3276679233 >> [v2:172.21.15.37:6805/1692844418,v1:172.21.15.37:6807/1692844418] conn(0x555cbca18350 msgr2=0x555cbca1a740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:49:08.167 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.166+0000 7f5cc6d2c800 20 RGWRados::pool_iterate: got zone_info.83aabb46-04b5-4c96-9933-c6bfb1173a73 2023-12-03T11:49:08.167 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.166+0000 7f5cc6d2c800 20 RGWRados::pool_iterate: got zonegroup_info.6a811aad-435d-4fdd-93c9-b7e0b50de429 2023-12-03T11:49:08.167 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.166+0000 7f5cc6d2c800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:49:08.167 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.166+0000 7f5cc6d2c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:49:08.167 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.166+0000 7f5cc6d2c800 20 rados->read ofs=0 len=0 2023-12-03T11:49:08.167 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.166+0000 7f5cc6d2c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:08.167 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.166+0000 7f5cc6d2c800 20 rados->read ofs=0 len=0 2023-12-03T11:49:08.169 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.166+0000 7f5cc6d2c800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:49:08.169 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.166+0000 7f5cc6d2c800 20 rados->read ofs=0 len=0 2023-12-03T11:49:08.169 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.166+0000 7f5cc6d2c800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:49:08.169 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.166+0000 7f5cc6d2c800 20 zone default found 2023-12-03T11:49:08.169 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.166+0000 7f5cc6d2c800 4 Realm: () 2023-12-03T11:49:08.169 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.166+0000 7f5cc6d2c800 4 ZoneGroup: default (6a811aad-435d-4fdd-93c9-b7e0b50de429) 2023-12-03T11:49:08.169 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.166+0000 7f5cc6d2c800 4 Zone: default (83aabb46-04b5-4c96-9933-c6bfb1173a73) 2023-12-03T11:49:08.169 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.166+0000 7f5cc6d2c800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:49:08.169 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.166+0000 7f5cc6d2c800 20 zonegroup default 2023-12-03T11:49:08.169 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.166+0000 7f5cc6d2c800 20 rados->read ofs=0 len=0 2023-12-03T11:49:08.169 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.167+0000 7f5cc6d2c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:08.169 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.167+0000 7f5cc6d2c800 20 rados->read ofs=0 len=0 2023-12-03T11:49:08.169 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.167+0000 7f5cc6d2c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:08.169 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.167+0000 7f5cc6d2c800 20 rados->read ofs=0 len=0 2023-12-03T11:49:08.169 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.167+0000 7f5cc6d2c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:08.170 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.167+0000 7f5cc6d2c800 20 started sync module instance, tier type = 2023-12-03T11:49:08.170 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.167+0000 7f5cc6d2c800 20 started zone id=83aabb46-04b5-4c96-9933-c6bfb1173a73 (name=default) with tier type = 2023-12-03T11:49:08.171 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.169+0000 7f5cc32f1640 0 -- 172.21.15.3:0/3276679233 >> [v2:172.21.15.37:6816/3770469300,v1:172.21.15.37:6818/3770469300] conn(0x7f5cb803d430 msgr2=0x7f5cb803d8b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:49:08.178 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.176+0000 7f5cc6d2c800 20 add_watcher() i=0 2023-12-03T11:49:08.178 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.176+0000 7f5cc6d2c800 20 add_watcher() i=1 2023-12-03T11:49:08.178 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.176+0000 7f5cc6d2c800 20 add_watcher() i=2 2023-12-03T11:49:08.178 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.176+0000 7f5cc6d2c800 20 add_watcher() i=3 2023-12-03T11:49:08.178 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.176+0000 7f5cc6d2c800 20 add_watcher() i=4 2023-12-03T11:49:08.178 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.176+0000 7f5cc6d2c800 20 add_watcher() i=5 2023-12-03T11:49:08.178 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.176+0000 7f5cc6d2c800 20 add_watcher() i=6 2023-12-03T11:49:08.179 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.177+0000 7f5cc6d2c800 20 add_watcher() i=7 2023-12-03T11:49:08.179 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.177+0000 7f5cc6d2c800 2 all 8 watchers are set, enabling cache 2023-12-03T11:49:08.180 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.179+0000 7f5c03fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:49:08.180 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.179+0000 7f5cc6d2c800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:49:08.180 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.179+0000 7f5cc6d2c800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:49:08.187 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.185+0000 7f5cc6d2c800 5 note: GC not initialized 2023-12-03T11:49:08.187 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.186+0000 7f5bf2ffd640 20 reqs_thread_entry: start 2023-12-03T11:49:08.187 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.186+0000 7f5cc6d2c800 20 init_complete bucket index max shards: 11 2023-12-03T11:49:08.187 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.186+0000 7f5cc6d2c800 20 Filter name: none 2023-12-03T11:49:08.187 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.186+0000 7f5bf0ff9640 20 reqs_thread_entry: start 2023-12-03T11:49:08.187 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.186+0000 7f5cc6d2c800 20 rados->read ofs=0 len=0 2023-12-03T11:49:08.188 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.186+0000 7f5cc6d2c800 20 rados_obj.operate() r=0 bl.length=221 2023-12-03T11:49:08.188 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.186+0000 7f5cc6d2c800 20 rados->read ofs=0 len=0 2023-12-03T11:49:08.188 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.187+0000 7f5cc6d2c800 20 rados_obj.operate() r=0 bl.length=393 2023-12-03T11:49:08.189 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.187+0000 7f5cc6d2c800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:49:08.189 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.187+0000 7f5cc6d2c800 20 rados->read ofs=0 len=0 2023-12-03T11:49:08.189 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.188+0000 7f5cc6d2c800 20 rados_obj.operate() r=0 bl.length=221 2023-12-03T11:49:08.189 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.188+0000 7f5cc6d2c800 20 rados->read ofs=0 len=0 2023-12-03T11:49:08.189 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.188+0000 7f5cc6d2c800 20 rados_obj.operate() r=0 bl.length=393 2023-12-03T11:49:08.189 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.188+0000 7f5cc6d2c800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:49:08.190 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.189+0000 7f5cc6d2c800 20 rados->read ofs=0 len=0 2023-12-03T11:49:08.191 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.189+0000 7f5cc6d2c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:08.191 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.190+0000 7f5c03fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:49:08.194 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.193+0000 7f5cc6d2c800 20 remove_watcher() i=0 2023-12-03T11:49:08.194 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.193+0000 7f5cc6d2c800 2 removed watcher, disabling cache 2023-12-03T11:49:08.195 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.193+0000 7f5cc6d2c800 20 remove_watcher() i=1 2023-12-03T11:49:08.196 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.194+0000 7f5cc6d2c800 20 remove_watcher() i=2 2023-12-03T11:49:08.197 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.196+0000 7f5cc6d2c800 20 remove_watcher() i=3 2023-12-03T11:49:08.198 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.197+0000 7f5cc6d2c800 20 remove_watcher() i=4 2023-12-03T11:49:08.199 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.198+0000 7f5cc6d2c800 20 remove_watcher() i=5 2023-12-03T11:49:08.200 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.198+0000 7f5cc6d2c800 20 remove_watcher() i=6 2023-12-03T11:49:08.201 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:08.199+0000 7f5cc6d2c800 20 remove_watcher() i=7 2023-12-03T11:49:08.205 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:49:08.205 INFO:tasks.workunit.client.0.smithi003.stderr:BUCKET_STATS: 2023-12-03T11:49:08.206 INFO:tasks.workunit.client.0.smithi003.stderr:bucket: error-at-commit-target-layout id: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.25 num_objects: 20 size_kb: 1 num_shards: 12 2023-12-03T11:49:08.206 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:49:08.520 INFO:tasks.workunit.client.0.smithi003.stderr:TEST: reshard bucket with abort at commit_target_layout 2023-12-03T11:49:08.520 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:49:09.259 INFO:tasks.workunit.client.0.smithi003.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2023-12-03T11:49:09.286 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:49:09.286 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:49:09.300 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.299+0000 7f3e2de16800 20 rados->read ofs=0 len=0 2023-12-03T11:49:09.302 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.300+0000 7f3e2de16800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:09.302 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.300+0000 7f3e2de16800 20 realm 2023-12-03T11:49:09.302 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.300+0000 7f3e2de16800 20 rados->read ofs=0 len=0 2023-12-03T11:49:09.302 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.301+0000 7f3e2de16800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:09.303 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.301+0000 7f3e2de16800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:49:09.303 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.301+0000 7f3e2de16800 20 rados->read ofs=0 len=0 2023-12-03T11:49:09.303 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.301+0000 7f3e2de16800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:09.303 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.301+0000 7f3e2de16800 20 rados->read ofs=0 len=0 2023-12-03T11:49:09.303 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.302+0000 7f3e2de16800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:49:09.304 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.302+0000 7f3e2de16800 20 rados->read ofs=0 len=0 2023-12-03T11:49:09.304 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.302+0000 7f3e2de16800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:49:09.304 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.302+0000 7f3e2de16800 20 searching for the correct realm 2023-12-03T11:49:09.314 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.313+0000 7f3e28c92640 0 -- 172.21.15.3:0/1719448798 >> [v2:172.21.15.3:6817/3356208405,v1:172.21.15.3:6819/3356208405] conn(0x557fdd84c680 msgr2=0x557fdd84ea90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:49:09.315 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.313+0000 7f3e2de16800 20 RGWRados::pool_iterate: got zone_info.83aabb46-04b5-4c96-9933-c6bfb1173a73 2023-12-03T11:49:09.315 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.313+0000 7f3e2de16800 20 RGWRados::pool_iterate: got zonegroup_info.6a811aad-435d-4fdd-93c9-b7e0b50de429 2023-12-03T11:49:09.315 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.313+0000 7f3e2de16800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:49:09.315 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.313+0000 7f3e2de16800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:49:09.315 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.313+0000 7f3e2de16800 20 rados->read ofs=0 len=0 2023-12-03T11:49:09.315 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.314+0000 7f3e2de16800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:09.315 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.314+0000 7f3e2de16800 20 rados->read ofs=0 len=0 2023-12-03T11:49:09.316 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.314+0000 7f3e2de16800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:49:09.316 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.314+0000 7f3e2de16800 20 rados->read ofs=0 len=0 2023-12-03T11:49:09.317 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.314+0000 7f3e2de16800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:49:09.317 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.314+0000 7f3e2de16800 20 zone default found 2023-12-03T11:49:09.317 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.314+0000 7f3e2de16800 4 Realm: () 2023-12-03T11:49:09.317 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.314+0000 7f3e2de16800 4 ZoneGroup: default (6a811aad-435d-4fdd-93c9-b7e0b50de429) 2023-12-03T11:49:09.317 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.314+0000 7f3e2de16800 4 Zone: default (83aabb46-04b5-4c96-9933-c6bfb1173a73) 2023-12-03T11:49:09.317 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.314+0000 7f3e2de16800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:49:09.317 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.314+0000 7f3e2de16800 20 zonegroup default 2023-12-03T11:49:09.317 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.314+0000 7f3e2de16800 20 rados->read ofs=0 len=0 2023-12-03T11:49:09.317 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.314+0000 7f3e2de16800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:09.317 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.315+0000 7f3e2de16800 20 rados->read ofs=0 len=0 2023-12-03T11:49:09.317 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.315+0000 7f3e2de16800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:09.317 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.315+0000 7f3e2de16800 20 rados->read ofs=0 len=0 2023-12-03T11:49:09.317 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.315+0000 7f3e2de16800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:09.318 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.315+0000 7f3e2de16800 20 started sync module instance, tier type = 2023-12-03T11:49:09.318 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.315+0000 7f3e2de16800 20 started zone id=83aabb46-04b5-4c96-9933-c6bfb1173a73 (name=default) with tier type = 2023-12-03T11:49:09.324 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.323+0000 7f3e29c94640 0 -- 172.21.15.3:0/1719448798 >> [v2:172.21.15.37:6816/3770469300,v1:172.21.15.37:6818/3770469300] conn(0x7f3e20057060 msgr2=0x7f3e2006b580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:49:09.327 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.325+0000 7f3e2de16800 20 add_watcher() i=0 2023-12-03T11:49:09.327 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.325+0000 7f3e2de16800 20 add_watcher() i=1 2023-12-03T11:49:09.327 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.325+0000 7f3e2de16800 20 add_watcher() i=2 2023-12-03T11:49:09.327 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.325+0000 7f3e2de16800 20 add_watcher() i=3 2023-12-03T11:49:09.327 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.325+0000 7f3e2de16800 20 add_watcher() i=4 2023-12-03T11:49:09.327 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.325+0000 7f3e2de16800 20 add_watcher() i=5 2023-12-03T11:49:09.327 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.325+0000 7f3e2de16800 20 add_watcher() i=6 2023-12-03T11:49:09.328 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.326+0000 7f3e2de16800 20 add_watcher() i=7 2023-12-03T11:49:09.328 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.326+0000 7f3e2de16800 2 all 8 watchers are set, enabling cache 2023-12-03T11:49:09.330 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.328+0000 7f3deefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:49:09.330 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.329+0000 7f3e2de16800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:49:09.330 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.329+0000 7f3e2de16800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:49:09.337 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.335+0000 7f3e2de16800 5 note: GC not initialized 2023-12-03T11:49:09.337 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.335+0000 7f3d5dffb640 20 reqs_thread_entry: start 2023-12-03T11:49:09.337 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.335+0000 7f3e2de16800 20 init_complete bucket index max shards: 11 2023-12-03T11:49:09.337 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.335+0000 7f3e2de16800 20 Filter name: none 2023-12-03T11:49:09.337 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.335+0000 7f3d4f7fe640 20 reqs_thread_entry: start 2023-12-03T11:49:09.337 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.336+0000 7f3e2de16800 20 rados->read ofs=0 len=0 2023-12-03T11:49:09.338 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.336+0000 7f3e2de16800 20 rados_obj.operate() r=0 bl.length=221 2023-12-03T11:49:09.338 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.336+0000 7f3e2de16800 20 rados->read ofs=0 len=0 2023-12-03T11:49:09.338 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.337+0000 7f3e2de16800 20 rados_obj.operate() r=0 bl.length=393 2023-12-03T11:49:09.338 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.337+0000 7f3e2de16800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:49:09.339 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.337+0000 7f3e2de16800 20 rados->read ofs=0 len=0 2023-12-03T11:49:09.340 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.337+0000 7f3e2de16800 20 rados_obj.operate() r=0 bl.length=221 2023-12-03T11:49:09.340 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.337+0000 7f3e2de16800 20 rados->read ofs=0 len=0 2023-12-03T11:49:09.341 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.337+0000 7f3e2de16800 20 rados_obj.operate() r=0 bl.length=393 2023-12-03T11:49:09.341 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.337+0000 7f3e2de16800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:49:09.341 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.339+0000 7f3e2de16800 20 rados->read ofs=0 len=0 2023-12-03T11:49:09.342 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.339+0000 7f3e2de16800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:09.342 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.340+0000 7f3deefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:49:09.345 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.342+0000 7f3e2de16800 20 remove_watcher() i=0 2023-12-03T11:49:09.345 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.342+0000 7f3e2de16800 2 removed watcher, disabling cache 2023-12-03T11:49:09.346 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.343+0000 7f3e2de16800 20 remove_watcher() i=1 2023-12-03T11:49:09.346 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.344+0000 7f3e2de16800 20 remove_watcher() i=2 2023-12-03T11:49:09.346 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.345+0000 7f3e2de16800 20 remove_watcher() i=3 2023-12-03T11:49:09.348 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.346+0000 7f3e2de16800 20 remove_watcher() i=4 2023-12-03T11:49:09.349 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.347+0000 7f3e2de16800 20 remove_watcher() i=5 2023-12-03T11:49:09.350 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.348+0000 7f3e2de16800 20 remove_watcher() i=6 2023-12-03T11:49:09.351 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.349+0000 7f3e2de16800 20 remove_watcher() i=7 2023-12-03T11:49:09.355 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:49:09.355 INFO:tasks.workunit.client.0.smithi003.stderr:BUCKET_STATS: 2023-12-03T11:49:09.355 INFO:tasks.workunit.client.0.smithi003.stderr:bucket: abort-at-commit-target-layout id: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26 num_objects: 20 size_kb: 1 num_shards: 11 2023-12-03T11:49:09.356 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:49:09.357 INFO:tasks.workunit.client.0.smithi003.stderr:radosgw-admin bucket reshard --bucket abort-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at commit_target_layout 2023-12-03T11:49:09.390 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:49:09.391 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:49:09.406 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.405+0000 7f81245ab800 20 rados->read ofs=0 len=0 2023-12-03T11:49:09.408 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.406+0000 7f81245ab800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:09.408 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.406+0000 7f81245ab800 20 realm 2023-12-03T11:49:09.408 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.406+0000 7f81245ab800 20 rados->read ofs=0 len=0 2023-12-03T11:49:09.408 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.406+0000 7f81245ab800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:09.408 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.406+0000 7f81245ab800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:49:09.408 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.406+0000 7f81245ab800 20 rados->read ofs=0 len=0 2023-12-03T11:49:09.408 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.407+0000 7f81245ab800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:09.408 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.407+0000 7f81245ab800 20 rados->read ofs=0 len=0 2023-12-03T11:49:09.409 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.408+0000 7f81245ab800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:49:09.409 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.408+0000 7f81245ab800 20 rados->read ofs=0 len=0 2023-12-03T11:49:09.409 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.408+0000 7f81245ab800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:49:09.409 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.408+0000 7f81245ab800 20 searching for the correct realm 2023-12-03T11:49:09.420 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.419+0000 7f81220ab640 0 -- 172.21.15.3:0/2013709418 >> [v2:172.21.15.37:6805/1692844418,v1:172.21.15.37:6807/1692844418] conn(0x5632d4bb9e30 msgr2=0x5632d4bbc220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:49:09.421 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.420+0000 7f81245ab800 20 RGWRados::pool_iterate: got zone_info.83aabb46-04b5-4c96-9933-c6bfb1173a73 2023-12-03T11:49:09.421 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.420+0000 7f81245ab800 20 RGWRados::pool_iterate: got zonegroup_info.6a811aad-435d-4fdd-93c9-b7e0b50de429 2023-12-03T11:49:09.421 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.420+0000 7f81245ab800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:49:09.422 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.420+0000 7f81245ab800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:49:09.422 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.420+0000 7f81245ab800 20 rados->read ofs=0 len=0 2023-12-03T11:49:09.422 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.420+0000 7f81245ab800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:09.422 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.420+0000 7f81245ab800 20 rados->read ofs=0 len=0 2023-12-03T11:49:09.423 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.421+0000 7f81245ab800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:49:09.423 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.421+0000 7f81245ab800 20 rados->read ofs=0 len=0 2023-12-03T11:49:09.423 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.421+0000 7f81245ab800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:49:09.423 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.421+0000 7f81245ab800 20 zone default found 2023-12-03T11:49:09.423 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.421+0000 7f81245ab800 4 Realm: () 2023-12-03T11:49:09.423 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.421+0000 7f81245ab800 4 ZoneGroup: default (6a811aad-435d-4fdd-93c9-b7e0b50de429) 2023-12-03T11:49:09.423 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.421+0000 7f81245ab800 4 Zone: default (83aabb46-04b5-4c96-9933-c6bfb1173a73) 2023-12-03T11:49:09.423 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.421+0000 7f81245ab800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:49:09.423 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.421+0000 7f81245ab800 20 zonegroup default 2023-12-03T11:49:09.423 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.421+0000 7f81245ab800 20 rados->read ofs=0 len=0 2023-12-03T11:49:09.423 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.421+0000 7f81245ab800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:09.423 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.421+0000 7f81245ab800 20 rados->read ofs=0 len=0 2023-12-03T11:49:09.423 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.422+0000 7f81245ab800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:09.424 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.422+0000 7f81245ab800 20 rados->read ofs=0 len=0 2023-12-03T11:49:09.424 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.422+0000 7f81245ab800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:09.424 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.422+0000 7f81245ab800 20 started sync module instance, tier type = 2023-12-03T11:49:09.424 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.422+0000 7f81245ab800 20 started zone id=83aabb46-04b5-4c96-9933-c6bfb1173a73 (name=default) with tier type = 2023-12-03T11:49:09.430 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.429+0000 7f81228ac640 0 -- 172.21.15.3:0/2013709418 >> [v2:172.21.15.37:6816/3770469300,v1:172.21.15.37:6818/3770469300] conn(0x7f811802e040 msgr2=0x7f811802e420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:49:09.433 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.431+0000 7f81245ab800 20 add_watcher() i=0 2023-12-03T11:49:09.433 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.431+0000 7f81245ab800 20 add_watcher() i=1 2023-12-03T11:49:09.433 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.431+0000 7f81245ab800 20 add_watcher() i=2 2023-12-03T11:49:09.433 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.431+0000 7f81245ab800 20 add_watcher() i=3 2023-12-03T11:49:09.433 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.431+0000 7f81245ab800 20 add_watcher() i=4 2023-12-03T11:49:09.433 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.431+0000 7f81245ab800 20 add_watcher() i=5 2023-12-03T11:49:09.433 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.431+0000 7f81245ab800 20 add_watcher() i=6 2023-12-03T11:49:09.434 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.433+0000 7f81245ab800 20 add_watcher() i=7 2023-12-03T11:49:09.434 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.433+0000 7f81245ab800 2 all 8 watchers are set, enabling cache 2023-12-03T11:49:09.435 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.434+0000 7f80e7fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:49:09.435 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.434+0000 7f81245ab800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:49:09.436 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.434+0000 7f81245ab800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:49:09.442 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.440+0000 7f81245ab800 5 note: GC not initialized 2023-12-03T11:49:09.442 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.441+0000 7f8056ffd640 20 reqs_thread_entry: start 2023-12-03T11:49:09.442 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.441+0000 7f81245ab800 20 init_complete bucket index max shards: 11 2023-12-03T11:49:09.442 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.441+0000 7f81245ab800 20 Filter name: none 2023-12-03T11:49:09.442 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.441+0000 7f8054ff9640 20 reqs_thread_entry: start 2023-12-03T11:49:09.442 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.441+0000 7f81245ab800 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2023-12-03T11:49:09.443 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.441+0000 7f81245ab800 20 rados->read ofs=0 len=0 2023-12-03T11:49:09.443 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.441+0000 7f81245ab800 20 rados_obj.operate() r=0 bl.length=221 2023-12-03T11:49:09.443 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.441+0000 7f81245ab800 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2023-12-03T11:49:09.443 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.441+0000 7f81245ab800 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2023-12-03T11:49:09.443 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.441+0000 7f81245ab800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26 : miss 2023-12-03T11:49:09.444 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.441+0000 7f81245ab800 20 rados->read ofs=0 len=0 2023-12-03T11:49:09.444 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.442+0000 7f81245ab800 20 rados_obj.operate() r=0 bl.length=393 2023-12-03T11:49:09.444 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.442+0000 7f81245ab800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26 info.flags=0x17 2023-12-03T11:49:09.444 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.442+0000 7f81245ab800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26 to cache LRU end 2023-12-03T11:49:09.444 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.442+0000 7f81245ab800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:49:09.444 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.442+0000 7f81245ab800 10 updating xattr: name=user.rgw.acl bl.length()=265 2023-12-03T11:49:09.444 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.442+0000 7f81245ab800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26 2023-12-03T11:49:09.449 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.447+0000 7f81245ab800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26 info.flags=0x17 2023-12-03T11:49:09.449 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.447+0000 7f81245ab800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26 to cache LRU end 2023-12-03T11:49:09.449 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.447+0000 7f81245ab800 10 updating xattr: name=user.rgw.acl bl.length()=265 2023-12-03T11:49:09.449 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.447+0000 7f81245ab800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26, ofs0, ns] 2023-12-03T11:49:09.449 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.448+0000 7f8110ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660573 cookie 94776317469120 notifier 6680 bl.length()=965 2023-12-03T11:49:09.449 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.448+0000 7f8110ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26 info.flags=0x17 2023-12-03T11:49:09.449 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.448+0000 7f8110ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26 to cache LRU end 2023-12-03T11:49:09.450 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.448+0000 7f8110ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2023-12-03T11:49:09.450 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.449+0000 7f81245ab800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26]): orig_sources= new_sources= 2023-12-03T11:49:09.451 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.449+0000 7f81245ab800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26]): potential sources added=[] removed=[] 2023-12-03T11:49:09.451 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.449+0000 7f81245ab800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26]): orig_dests= new_dests= 2023-12-03T11:49:09.451 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.449+0000 7f81245ab800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26]): potential dests added=[] removed=[] 2023-12-03T11:49:09.453 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.452+0000 7f81245ab800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26.1.0 2023-12-03T11:49:09.453 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.452+0000 7f81245ab800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26.1.0 2023-12-03T11:49:09.453 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.452+0000 7f81245ab800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26.1.1 2023-12-03T11:49:09.453 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.452+0000 7f81245ab800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26.1.1 2023-12-03T11:49:09.454 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.452+0000 7f81245ab800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26.1.2 2023-12-03T11:49:09.454 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.452+0000 7f81245ab800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26.1.2 2023-12-03T11:49:09.454 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.452+0000 7f81245ab800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26.1.3 2023-12-03T11:49:09.454 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.452+0000 7f81245ab800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26.1.3 2023-12-03T11:49:09.454 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.452+0000 7f81245ab800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26.1.4 2023-12-03T11:49:09.454 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.452+0000 7f81245ab800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26.1.4 2023-12-03T11:49:09.454 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.452+0000 7f81245ab800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26.1.5 2023-12-03T11:49:09.454 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.452+0000 7f81245ab800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26.1.5 2023-12-03T11:49:09.454 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.452+0000 7f81245ab800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26.1.6 2023-12-03T11:49:09.454 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.452+0000 7f81245ab800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26.1.6 2023-12-03T11:49:09.454 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.452+0000 7f81245ab800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26.1.7 2023-12-03T11:49:09.454 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.452+0000 7f81245ab800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26.1.7 2023-12-03T11:49:09.454 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.452+0000 7f81245ab800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26.1.8 2023-12-03T11:49:09.454 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.452+0000 7f81245ab800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26.1.8 2023-12-03T11:49:09.455 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.452+0000 7f81245ab800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26.1.9 2023-12-03T11:49:09.455 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.452+0000 7f81245ab800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26.1.9 2023-12-03T11:49:09.455 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.452+0000 7f81245ab800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26.1.10 2023-12-03T11:49:09.455 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.452+0000 7f81245ab800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26.1.10 2023-12-03T11:49:09.455 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.452+0000 7f81245ab800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26.1.11 2023-12-03T11:49:09.455 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.452+0000 7f81245ab800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26.1.11 2023-12-03T11:49:09.455 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.452+0000 7f81245ab800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26.0 2023-12-03T11:49:09.456 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.452+0000 7f81245ab800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26.1 2023-12-03T11:49:09.456 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.453+0000 7f81245ab800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26.2 2023-12-03T11:49:09.456 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.453+0000 7f81245ab800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26.3 2023-12-03T11:49:09.456 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.454+0000 7f81245ab800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26.4 2023-12-03T11:49:09.456 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.454+0000 7f81245ab800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26.5 2023-12-03T11:49:09.456 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.455+0000 7f81245ab800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26.6 2023-12-03T11:49:09.457 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.455+0000 7f81245ab800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26.7 2023-12-03T11:49:09.457 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.456+0000 7f81245ab800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26.8 2023-12-03T11:49:09.457 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.456+0000 7f81245ab800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26.9 2023-12-03T11:49:09.458 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.457+0000 7f81245ab800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26.10 2023-12-03T11:49:09.460 INFO:tasks.workunit.client.0.smithi003.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7537-gbcbf278c/rpm/el9/BUILD/ceph-18.0.0-7537-gbcbf278c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f81245ab800 time 2023-12-03T11:49:09.460738+0000 2023-12-03T11:49:09.460 INFO:tasks.workunit.client.0.smithi003.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7537-gbcbf278c/rpm/el9/BUILD/ceph-18.0.0-7537-gbcbf278c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2023-12-03T11:49:09.461 INFO:tasks.workunit.client.0.smithi003.stderr: ceph version 18.0.0-7537-gbcbf278c (bcbf278cf395873c2a482f5a7b2345faf2160319) reef (dev) 2023-12-03T11:49:09.461 INFO:tasks.workunit.client.0.smithi003.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f8128f6eef8] 2023-12-03T11:49:09.461 INFO:tasks.workunit.client.0.smithi003.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f0b6) [0x7f8128f6f0b6] 2023-12-03T11:49:09.461 INFO:tasks.workunit.client.0.smithi003.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5632d4144a71] 2023-12-03T11:49:09.462 INFO:tasks.workunit.client.0.smithi003.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x5b8) [0x5632d41511d8] 2023-12-03T11:49:09.462 INFO:tasks.workunit.client.0.smithi003.stderr: 5: main() 2023-12-03T11:49:09.462 INFO:tasks.workunit.client.0.smithi003.stderr: 6: /lib64/libc.so.6(+0x3feb0) [0x7f812683feb0] 2023-12-03T11:49:09.462 INFO:tasks.workunit.client.0.smithi003.stderr: 7: __libc_start_main() 2023-12-03T11:49:09.462 INFO:tasks.workunit.client.0.smithi003.stderr: 8: _start() 2023-12-03T11:49:09.462 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.460+0000 7f81245ab800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7537-gbcbf278c/rpm/el9/BUILD/ceph-18.0.0-7537-gbcbf278c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f81245ab800 time 2023-12-03T11:49:09.460738+0000 2023-12-03T11:49:09.462 INFO:tasks.workunit.client.0.smithi003.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7537-gbcbf278c/rpm/el9/BUILD/ceph-18.0.0-7537-gbcbf278c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2023-12-03T11:49:09.462 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:49:09.463 INFO:tasks.workunit.client.0.smithi003.stderr: ceph version 18.0.0-7537-gbcbf278c (bcbf278cf395873c2a482f5a7b2345faf2160319) reef (dev) 2023-12-03T11:49:09.463 INFO:tasks.workunit.client.0.smithi003.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f8128f6eef8] 2023-12-03T11:49:09.463 INFO:tasks.workunit.client.0.smithi003.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f0b6) [0x7f8128f6f0b6] 2023-12-03T11:49:09.463 INFO:tasks.workunit.client.0.smithi003.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5632d4144a71] 2023-12-03T11:49:09.463 INFO:tasks.workunit.client.0.smithi003.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x5b8) [0x5632d41511d8] 2023-12-03T11:49:09.463 INFO:tasks.workunit.client.0.smithi003.stderr: 5: main() 2023-12-03T11:49:09.464 INFO:tasks.workunit.client.0.smithi003.stderr: 6: /lib64/libc.so.6(+0x3feb0) [0x7f812683feb0] 2023-12-03T11:49:09.464 INFO:tasks.workunit.client.0.smithi003.stderr: 7: __libc_start_main() 2023-12-03T11:49:09.464 INFO:tasks.workunit.client.0.smithi003.stderr: 8: _start() 2023-12-03T11:49:09.464 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:49:09.464 INFO:tasks.workunit.client.0.smithi003.stderr:*** Caught signal (Aborted) ** 2023-12-03T11:49:09.464 INFO:tasks.workunit.client.0.smithi003.stderr: in thread 7f81245ab800 thread_name:radosgw-admin 2023-12-03T11:49:09.478 INFO:tasks.workunit.client.0.smithi003.stderr: ceph version 18.0.0-7537-gbcbf278c (bcbf278cf395873c2a482f5a7b2345faf2160319) reef (dev) 2023-12-03T11:49:09.479 INFO:tasks.workunit.client.0.smithi003.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f8126854db0] 2023-12-03T11:49:09.479 INFO:tasks.workunit.client.0.smithi003.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f81268a154c] 2023-12-03T11:49:09.479 INFO:tasks.workunit.client.0.smithi003.stderr: 3: raise() 2023-12-03T11:49:09.479 INFO:tasks.workunit.client.0.smithi003.stderr: 4: abort() 2023-12-03T11:49:09.479 INFO:tasks.workunit.client.0.smithi003.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f8128f6ef52] 2023-12-03T11:49:09.479 INFO:tasks.workunit.client.0.smithi003.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f0b6) [0x7f8128f6f0b6] 2023-12-03T11:49:09.479 INFO:tasks.workunit.client.0.smithi003.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5632d4144a71] 2023-12-03T11:49:09.479 INFO:tasks.workunit.client.0.smithi003.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x5b8) [0x5632d41511d8] 2023-12-03T11:49:09.479 INFO:tasks.workunit.client.0.smithi003.stderr: 9: main() 2023-12-03T11:49:09.479 INFO:tasks.workunit.client.0.smithi003.stderr: 10: /lib64/libc.so.6(+0x3feb0) [0x7f812683feb0] 2023-12-03T11:49:09.479 INFO:tasks.workunit.client.0.smithi003.stderr: 11: __libc_start_main() 2023-12-03T11:49:09.480 INFO:tasks.workunit.client.0.smithi003.stderr: 12: _start() 2023-12-03T11:49:09.480 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.461+0000 7f81245ab800 -1 *** Caught signal (Aborted) ** 2023-12-03T11:49:09.480 INFO:tasks.workunit.client.0.smithi003.stderr: in thread 7f81245ab800 thread_name:radosgw-admin 2023-12-03T11:49:09.480 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:49:09.480 INFO:tasks.workunit.client.0.smithi003.stderr: ceph version 18.0.0-7537-gbcbf278c (bcbf278cf395873c2a482f5a7b2345faf2160319) reef (dev) 2023-12-03T11:49:09.480 INFO:tasks.workunit.client.0.smithi003.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f8126854db0] 2023-12-03T11:49:09.480 INFO:tasks.workunit.client.0.smithi003.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f81268a154c] 2023-12-03T11:49:09.480 INFO:tasks.workunit.client.0.smithi003.stderr: 3: raise() 2023-12-03T11:49:09.480 INFO:tasks.workunit.client.0.smithi003.stderr: 4: abort() 2023-12-03T11:49:09.480 INFO:tasks.workunit.client.0.smithi003.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f8128f6ef52] 2023-12-03T11:49:09.480 INFO:tasks.workunit.client.0.smithi003.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f0b6) [0x7f8128f6f0b6] 2023-12-03T11:49:09.480 INFO:tasks.workunit.client.0.smithi003.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5632d4144a71] 2023-12-03T11:49:09.480 INFO:tasks.workunit.client.0.smithi003.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x5b8) [0x5632d41511d8] 2023-12-03T11:49:09.480 INFO:tasks.workunit.client.0.smithi003.stderr: 9: main() 2023-12-03T11:49:09.481 INFO:tasks.workunit.client.0.smithi003.stderr: 10: /lib64/libc.so.6(+0x3feb0) [0x7f812683feb0] 2023-12-03T11:49:09.481 INFO:tasks.workunit.client.0.smithi003.stderr: 11: __libc_start_main() 2023-12-03T11:49:09.481 INFO:tasks.workunit.client.0.smithi003.stderr: 12: _start() 2023-12-03T11:49:09.481 INFO:tasks.workunit.client.0.smithi003.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-12-03T11:49:09.481 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:49:09.481 INFO:tasks.workunit.client.0.smithi003.stderr:--- begin dump of recent events --- 2023-12-03T11:49:09.481 INFO:tasks.workunit.client.0.smithi003.stderr: -499> 2023-12-03T11:49:09.400+0000 7f81245ab800 5 AuthRegistry(0x7ffe91b1fd30) adding auth protocol: cephx 2023-12-03T11:49:09.481 INFO:tasks.workunit.client.0.smithi003.stderr: -498> 2023-12-03T11:49:09.400+0000 7f81245ab800 5 AuthRegistry(0x7ffe91b1fd30) adding auth protocol: cephx 2023-12-03T11:49:09.481 INFO:tasks.workunit.client.0.smithi003.stderr: -497> 2023-12-03T11:49:09.400+0000 7f81245ab800 5 AuthRegistry(0x7ffe91b1fd30) adding con mode: secure 2023-12-03T11:49:09.481 INFO:tasks.workunit.client.0.smithi003.stderr: -496> 2023-12-03T11:49:09.400+0000 7f81245ab800 5 AuthRegistry(0x7ffe91b1fd30) adding con mode: crc 2023-12-03T11:49:09.481 INFO:tasks.workunit.client.0.smithi003.stderr: -495> 2023-12-03T11:49:09.400+0000 7f81245ab800 5 AuthRegistry(0x7ffe91b1fd30) adding con mode: secure 2023-12-03T11:49:09.481 INFO:tasks.workunit.client.0.smithi003.stderr: -494> 2023-12-03T11:49:09.400+0000 7f81245ab800 5 AuthRegistry(0x7ffe91b1fd30) adding con mode: crc 2023-12-03T11:49:09.481 INFO:tasks.workunit.client.0.smithi003.stderr: -493> 2023-12-03T11:49:09.400+0000 7f81245ab800 5 AuthRegistry(0x7ffe91b1fd30) adding con mode: secure 2023-12-03T11:49:09.481 INFO:tasks.workunit.client.0.smithi003.stderr: -492> 2023-12-03T11:49:09.400+0000 7f81245ab800 5 AuthRegistry(0x7ffe91b1fd30) adding con mode: crc 2023-12-03T11:49:09.481 INFO:tasks.workunit.client.0.smithi003.stderr: -491> 2023-12-03T11:49:09.400+0000 7f81245ab800 5 AuthRegistry(0x7ffe91b1fd30) adding con mode: crc 2023-12-03T11:49:09.482 INFO:tasks.workunit.client.0.smithi003.stderr: -490> 2023-12-03T11:49:09.400+0000 7f81245ab800 5 AuthRegistry(0x7ffe91b1fd30) adding con mode: secure 2023-12-03T11:49:09.482 INFO:tasks.workunit.client.0.smithi003.stderr: -489> 2023-12-03T11:49:09.400+0000 7f81245ab800 5 AuthRegistry(0x7ffe91b1fd30) adding con mode: crc 2023-12-03T11:49:09.482 INFO:tasks.workunit.client.0.smithi003.stderr: -488> 2023-12-03T11:49:09.400+0000 7f81245ab800 5 AuthRegistry(0x7ffe91b1fd30) adding con mode: secure 2023-12-03T11:49:09.482 INFO:tasks.workunit.client.0.smithi003.stderr: -487> 2023-12-03T11:49:09.400+0000 7f81245ab800 5 AuthRegistry(0x7ffe91b1fd30) adding con mode: crc 2023-12-03T11:49:09.482 INFO:tasks.workunit.client.0.smithi003.stderr: -486> 2023-12-03T11:49:09.400+0000 7f81245ab800 5 AuthRegistry(0x7ffe91b1fd30) adding con mode: secure 2023-12-03T11:49:09.482 INFO:tasks.workunit.client.0.smithi003.stderr: -485> 2023-12-03T11:49:09.400+0000 7f81245ab800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:49:09.482 INFO:tasks.workunit.client.0.smithi003.stderr: -484> 2023-12-03T11:49:09.401+0000 7f81245ab800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:49:09.482 INFO:tasks.workunit.client.0.smithi003.stderr: -483> 2023-12-03T11:49:09.401+0000 7f81245ab800 5 asok(0x5632d495ea10) register_command rotate-key cmddesc rotate-key hook 0x7ffe91b1fe78 EEXIST 2023-12-03T11:49:09.482 INFO:tasks.workunit.client.0.smithi003.stderr: -482> 2023-12-03T11:49:09.401+0000 7f81245ab800 10 monclient: _reopen_session rank -1 2023-12-03T11:49:09.482 INFO:tasks.workunit.client.0.smithi003.stderr: -481> 2023-12-03T11:49:09.401+0000 7f81245ab800 10 monclient: _add_conns ranks=[1,0,2] 2023-12-03T11:49:09.482 INFO:tasks.workunit.client.0.smithi003.stderr: -480> 2023-12-03T11:49:09.401+0000 7f81245ab800 10 monclient(hunting): picked mon.noname-b con 0x5632d4b9df20 addr [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] 2023-12-03T11:49:09.482 INFO:tasks.workunit.client.0.smithi003.stderr: -479> 2023-12-03T11:49:09.401+0000 7f81245ab800 10 monclient(hunting): picked mon.noname-a con 0x5632d4b9e300 addr [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] 2023-12-03T11:49:09.482 INFO:tasks.workunit.client.0.smithi003.stderr: -478> 2023-12-03T11:49:09.401+0000 7f81245ab800 10 monclient(hunting): picked mon.noname-c con 0x5632d4b99e80 addr [v2:172.21.15.3:3301/0,v1:172.21.15.3:6790/0] 2023-12-03T11:49:09.482 INFO:tasks.workunit.client.0.smithi003.stderr: -477> 2023-12-03T11:49:09.401+0000 7f81245ab800 10 monclient(hunting): start opening mon connection 2023-12-03T11:49:09.483 INFO:tasks.workunit.client.0.smithi003.stderr: -476> 2023-12-03T11:49:09.401+0000 7f81245ab800 10 monclient(hunting): start opening mon connection 2023-12-03T11:49:09.483 INFO:tasks.workunit.client.0.smithi003.stderr: -475> 2023-12-03T11:49:09.401+0000 7f81245ab800 10 monclient(hunting): start opening mon connection 2023-12-03T11:49:09.483 INFO:tasks.workunit.client.0.smithi003.stderr: -474> 2023-12-03T11:49:09.401+0000 7f81245ab800 10 monclient(hunting): _renew_subs 2023-12-03T11:49:09.483 INFO:tasks.workunit.client.0.smithi003.stderr: -473> 2023-12-03T11:49:09.401+0000 7f81245ab800 10 monclient(hunting): authenticate will time out at 1771.639444s 2023-12-03T11:49:09.483 INFO:tasks.workunit.client.0.smithi003.stderr: -472> 2023-12-03T11:49:09.401+0000 7f81220ab640 10 monclient(hunting): get_auth_request con 0x5632d4b9e300 auth_method 0 2023-12-03T11:49:09.483 INFO:tasks.workunit.client.0.smithi003.stderr: -471> 2023-12-03T11:49:09.401+0000 7f81220ab640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:49:09.483 INFO:tasks.workunit.client.0.smithi003.stderr: -470> 2023-12-03T11:49:09.401+0000 7f81220ab640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:49:09.483 INFO:tasks.workunit.client.0.smithi003.stderr: -469> 2023-12-03T11:49:09.401+0000 7f81220ab640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:49:09.483 INFO:tasks.workunit.client.0.smithi003.stderr: -468> 2023-12-03T11:49:09.401+0000 7f81218aa640 10 monclient(hunting): get_auth_request con 0x5632d4b99e80 auth_method 0 2023-12-03T11:49:09.483 INFO:tasks.workunit.client.0.smithi003.stderr: -467> 2023-12-03T11:49:09.401+0000 7f81218aa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:49:09.483 INFO:tasks.workunit.client.0.smithi003.stderr: -466> 2023-12-03T11:49:09.401+0000 7f81218aa640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:49:09.483 INFO:tasks.workunit.client.0.smithi003.stderr: -465> 2023-12-03T11:49:09.401+0000 7f81218aa640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:49:09.483 INFO:tasks.workunit.client.0.smithi003.stderr: -464> 2023-12-03T11:49:09.401+0000 7f81220ab640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:49:09.484 INFO:tasks.workunit.client.0.smithi003.stderr: -463> 2023-12-03T11:49:09.401+0000 7f81220ab640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:49:09.484 INFO:tasks.workunit.client.0.smithi003.stderr: -462> 2023-12-03T11:49:09.401+0000 7f81137fe640 4 mgrc handle_mgr_map Got map version 5 2023-12-03T11:49:09.484 INFO:tasks.workunit.client.0.smithi003.stderr: -461> 2023-12-03T11:49:09.401+0000 7f81137fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.37:6832/2165065416,v1:172.21.15.37:6833/2165065416] 2023-12-03T11:49:09.484 INFO:tasks.workunit.client.0.smithi003.stderr: -460> 2023-12-03T11:49:09.401+0000 7f81220ab640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:49:09.484 INFO:tasks.workunit.client.0.smithi003.stderr: -459> 2023-12-03T11:49:09.401+0000 7f81218aa640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:49:09.484 INFO:tasks.workunit.client.0.smithi003.stderr: -458> 2023-12-03T11:49:09.401+0000 7f81137fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.37:6832/2165065416,v1:172.21.15.37:6833/2165065416] 2023-12-03T11:49:09.484 INFO:tasks.workunit.client.0.smithi003.stderr: -457> 2023-12-03T11:49:09.401+0000 7f81218aa640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:49:09.484 INFO:tasks.workunit.client.0.smithi003.stderr: -456> 2023-12-03T11:49:09.401+0000 7f81218aa640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:49:09.484 INFO:tasks.workunit.client.0.smithi003.stderr: -455> 2023-12-03T11:49:09.401+0000 7f81228ac640 10 monclient(hunting): get_auth_request con 0x5632d4b9df20 auth_method 0 2023-12-03T11:49:09.484 INFO:tasks.workunit.client.0.smithi003.stderr: -454> 2023-12-03T11:49:09.401+0000 7f81228ac640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:49:09.484 INFO:tasks.workunit.client.0.smithi003.stderr: -453> 2023-12-03T11:49:09.401+0000 7f81228ac640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:49:09.485 INFO:tasks.workunit.client.0.smithi003.stderr: -452> 2023-12-03T11:49:09.401+0000 7f81228ac640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:49:09.485 INFO:tasks.workunit.client.0.smithi003.stderr: -451> 2023-12-03T11:49:09.401+0000 7f81228ac640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:49:09.485 INFO:tasks.workunit.client.0.smithi003.stderr: -450> 2023-12-03T11:49:09.401+0000 7f81228ac640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:49:09.485 INFO:tasks.workunit.client.0.smithi003.stderr: -449> 2023-12-03T11:49:09.401+0000 7f81228ac640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:49:09.485 INFO:tasks.workunit.client.0.smithi003.stderr: -448> 2023-12-03T11:49:09.401+0000 7f81220ab640 10 monclient(hunting): handle_auth_done global_id 7080 payload 274 2023-12-03T11:49:09.485 INFO:tasks.workunit.client.0.smithi003.stderr: -447> 2023-12-03T11:49:09.401+0000 7f81220ab640 10 monclient: _finish_hunting 0 2023-12-03T11:49:09.485 INFO:tasks.workunit.client.0.smithi003.stderr: -446> 2023-12-03T11:49:09.401+0000 7f81220ab640 1 monclient: found mon.noname-a 2023-12-03T11:49:09.485 INFO:tasks.workunit.client.0.smithi003.stderr: -445> 2023-12-03T11:49:09.401+0000 7f81220ab640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.3:3300/0 2023-12-03T11:49:09.485 INFO:tasks.workunit.client.0.smithi003.stderr: -444> 2023-12-03T11:49:09.401+0000 7f81228ac640 10 monclient: get_auth_request con 0x7f8104069820 auth_method 0 2023-12-03T11:49:09.485 INFO:tasks.workunit.client.0.smithi003.stderr: -443> 2023-12-03T11:49:09.401+0000 7f8110ff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:49:09.485 INFO:tasks.workunit.client.0.smithi003.stderr: -442> 2023-12-03T11:49:09.401+0000 7f8110ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-12-03T11:49:09.485 INFO:tasks.workunit.client.0.smithi003.stderr: -441> 2023-12-03T11:49:09.401+0000 7f8110ff9640 10 monclient: dump: 2023-12-03T11:49:09.485 INFO:tasks.workunit.client.0.smithi003.stderr:epoch 1 2023-12-03T11:49:09.485 INFO:tasks.workunit.client.0.smithi003.stderr:fsid 296556de-a4fc-4095-9b6d-0fe813c2865c 2023-12-03T11:49:09.486 INFO:tasks.workunit.client.0.smithi003.stderr:last_changed 2023-12-03T11:33:18.862564+0000 2023-12-03T11:49:09.486 INFO:tasks.workunit.client.0.smithi003.stderr:created 2023-12-03T11:33:18.862564+0000 2023-12-03T11:49:09.486 INFO:tasks.workunit.client.0.smithi003.stderr:min_mon_release 18 (reef) 2023-12-03T11:49:09.486 INFO:tasks.workunit.client.0.smithi003.stderr:election_strategy: 1 2023-12-03T11:49:09.486 INFO:tasks.workunit.client.0.smithi003.stderr:0: [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] mon.a 2023-12-03T11:49:09.486 INFO:tasks.workunit.client.0.smithi003.stderr:1: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.b 2023-12-03T11:49:09.486 INFO:tasks.workunit.client.0.smithi003.stderr:2: [v2:172.21.15.3:3301/0,v1:172.21.15.3:6790/0] mon.c 2023-12-03T11:49:09.486 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:49:09.486 INFO:tasks.workunit.client.0.smithi003.stderr: -440> 2023-12-03T11:49:09.401+0000 7f8110ff9640 10 monclient: _finish_auth 0 2023-12-03T11:49:09.486 INFO:tasks.workunit.client.0.smithi003.stderr: -439> 2023-12-03T11:49:09.401+0000 7f8110ff9640 10 monclient: _check_auth_tickets 2023-12-03T11:49:09.486 INFO:tasks.workunit.client.0.smithi003.stderr: -438> 2023-12-03T11:49:09.401+0000 7f8110ff9640 10 monclient: handle_config config(0 keys) v1 2023-12-03T11:49:09.486 INFO:tasks.workunit.client.0.smithi003.stderr: -437> 2023-12-03T11:49:09.401+0000 7f81245ab800 5 monclient: authenticate success, global_id 7080 2023-12-03T11:49:09.486 INFO:tasks.workunit.client.0.smithi003.stderr: -436> 2023-12-03T11:49:09.401+0000 7f81245ab800 10 monclient: get_monmap_and_config success 2023-12-03T11:49:09.486 INFO:tasks.workunit.client.0.smithi003.stderr: -435> 2023-12-03T11:49:09.401+0000 7f81245ab800 4 set_mon_vals no callback set 2023-12-03T11:49:09.487 INFO:tasks.workunit.client.0.smithi003.stderr: -434> 2023-12-03T11:49:09.401+0000 7f8110ff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:49:09.487 INFO:tasks.workunit.client.0.smithi003.stderr: -433> 2023-12-03T11:49:09.401+0000 7f8110ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-12-03T11:49:09.487 INFO:tasks.workunit.client.0.smithi003.stderr: -432> 2023-12-03T11:49:09.401+0000 7f8110ff9640 10 monclient: dump: 2023-12-03T11:49:09.487 INFO:tasks.workunit.client.0.smithi003.stderr:epoch 1 2023-12-03T11:49:09.487 INFO:tasks.workunit.client.0.smithi003.stderr:fsid 296556de-a4fc-4095-9b6d-0fe813c2865c 2023-12-03T11:49:09.487 INFO:tasks.workunit.client.0.smithi003.stderr:last_changed 2023-12-03T11:33:18.862564+0000 2023-12-03T11:49:09.487 INFO:tasks.workunit.client.0.smithi003.stderr:created 2023-12-03T11:33:18.862564+0000 2023-12-03T11:49:09.487 INFO:tasks.workunit.client.0.smithi003.stderr:min_mon_release 18 (reef) 2023-12-03T11:49:09.487 INFO:tasks.workunit.client.0.smithi003.stderr:election_strategy: 1 2023-12-03T11:49:09.487 INFO:tasks.workunit.client.0.smithi003.stderr:0: [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] mon.a 2023-12-03T11:49:09.487 INFO:tasks.workunit.client.0.smithi003.stderr:1: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.b 2023-12-03T11:49:09.487 INFO:tasks.workunit.client.0.smithi003.stderr:2: [v2:172.21.15.3:3301/0,v1:172.21.15.3:6790/0] mon.c 2023-12-03T11:49:09.487 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:49:09.487 INFO:tasks.workunit.client.0.smithi003.stderr: -431> 2023-12-03T11:49:09.402+0000 7f81245ab800 10 monclient: shutdown 2023-12-03T11:49:09.487 INFO:tasks.workunit.client.0.smithi003.stderr: -430> 2023-12-03T11:49:09.402+0000 7f81245ab800 10 monclient: build_initial_monmap 2023-12-03T11:49:09.488 INFO:tasks.workunit.client.0.smithi003.stderr: -429> 2023-12-03T11:49:09.402+0000 7f81245ab800 1 build_initial for_mkfs: 0 2023-12-03T11:49:09.488 INFO:tasks.workunit.client.0.smithi003.stderr: -428> 2023-12-03T11:49:09.402+0000 7f81245ab800 10 monclient: monmap: 2023-12-03T11:49:09.488 INFO:tasks.workunit.client.0.smithi003.stderr:epoch 0 2023-12-03T11:49:09.488 INFO:tasks.workunit.client.0.smithi003.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-12-03T11:49:09.488 INFO:tasks.workunit.client.0.smithi003.stderr:last_changed 0.000000 2023-12-03T11:49:09.488 INFO:tasks.workunit.client.0.smithi003.stderr:created 0.000000 2023-12-03T11:49:09.488 INFO:tasks.workunit.client.0.smithi003.stderr:min_mon_release 0 (unknown) 2023-12-03T11:49:09.488 INFO:tasks.workunit.client.0.smithi003.stderr:election_strategy: 1 2023-12-03T11:49:09.488 INFO:tasks.workunit.client.0.smithi003.stderr:0: [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] mon.noname-a 2023-12-03T11:49:09.488 INFO:tasks.workunit.client.0.smithi003.stderr:1: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.noname-b 2023-12-03T11:49:09.488 INFO:tasks.workunit.client.0.smithi003.stderr:2: [v2:172.21.15.3:3301/0,v1:172.21.15.3:6790/0] mon.noname-c 2023-12-03T11:49:09.488 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:49:09.488 INFO:tasks.workunit.client.0.smithi003.stderr: -427> 2023-12-03T11:49:09.402+0000 7f81245ab800 5 AuthRegistry(0x5632d4b6dc90) adding auth protocol: cephx 2023-12-03T11:49:09.488 INFO:tasks.workunit.client.0.smithi003.stderr: -426> 2023-12-03T11:49:09.402+0000 7f81245ab800 5 AuthRegistry(0x5632d4b6dc90) adding auth protocol: cephx 2023-12-03T11:49:09.488 INFO:tasks.workunit.client.0.smithi003.stderr: -425> 2023-12-03T11:49:09.402+0000 7f81245ab800 5 AuthRegistry(0x5632d4b6dc90) adding auth protocol: cephx 2023-12-03T11:49:09.489 INFO:tasks.workunit.client.0.smithi003.stderr: -424> 2023-12-03T11:49:09.402+0000 7f81245ab800 5 AuthRegistry(0x5632d4b6dc90) adding con mode: secure 2023-12-03T11:49:09.489 INFO:tasks.workunit.client.0.smithi003.stderr: -423> 2023-12-03T11:49:09.402+0000 7f81245ab800 5 AuthRegistry(0x5632d4b6dc90) adding con mode: crc 2023-12-03T11:49:09.489 INFO:tasks.workunit.client.0.smithi003.stderr: -422> 2023-12-03T11:49:09.402+0000 7f81245ab800 5 AuthRegistry(0x5632d4b6dc90) adding con mode: secure 2023-12-03T11:49:09.489 INFO:tasks.workunit.client.0.smithi003.stderr: -421> 2023-12-03T11:49:09.402+0000 7f81245ab800 5 AuthRegistry(0x5632d4b6dc90) adding con mode: crc 2023-12-03T11:49:09.489 INFO:tasks.workunit.client.0.smithi003.stderr: -420> 2023-12-03T11:49:09.402+0000 7f81245ab800 5 AuthRegistry(0x5632d4b6dc90) adding con mode: secure 2023-12-03T11:49:09.489 INFO:tasks.workunit.client.0.smithi003.stderr: -419> 2023-12-03T11:49:09.402+0000 7f81245ab800 5 AuthRegistry(0x5632d4b6dc90) adding con mode: crc 2023-12-03T11:49:09.489 INFO:tasks.workunit.client.0.smithi003.stderr: -418> 2023-12-03T11:49:09.402+0000 7f81245ab800 5 AuthRegistry(0x5632d4b6dc90) adding con mode: crc 2023-12-03T11:49:09.489 INFO:tasks.workunit.client.0.smithi003.stderr: -417> 2023-12-03T11:49:09.402+0000 7f81245ab800 5 AuthRegistry(0x5632d4b6dc90) adding con mode: secure 2023-12-03T11:49:09.489 INFO:tasks.workunit.client.0.smithi003.stderr: -416> 2023-12-03T11:49:09.402+0000 7f81245ab800 5 AuthRegistry(0x5632d4b6dc90) adding con mode: crc 2023-12-03T11:49:09.489 INFO:tasks.workunit.client.0.smithi003.stderr: -415> 2023-12-03T11:49:09.402+0000 7f81245ab800 5 AuthRegistry(0x5632d4b6dc90) adding con mode: secure 2023-12-03T11:49:09.489 INFO:tasks.workunit.client.0.smithi003.stderr: -414> 2023-12-03T11:49:09.402+0000 7f81245ab800 5 AuthRegistry(0x5632d4b6dc90) adding con mode: crc 2023-12-03T11:49:09.489 INFO:tasks.workunit.client.0.smithi003.stderr: -413> 2023-12-03T11:49:09.402+0000 7f81245ab800 5 AuthRegistry(0x5632d4b6dc90) adding con mode: secure 2023-12-03T11:49:09.489 INFO:tasks.workunit.client.0.smithi003.stderr: -412> 2023-12-03T11:49:09.402+0000 7f81245ab800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:49:09.489 INFO:tasks.workunit.client.0.smithi003.stderr: -411> 2023-12-03T11:49:09.402+0000 7f81245ab800 1 librados: starting msgr at 2023-12-03T11:49:09.489 INFO:tasks.workunit.client.0.smithi003.stderr: -410> 2023-12-03T11:49:09.402+0000 7f81245ab800 1 librados: starting objecter 2023-12-03T11:49:09.490 INFO:tasks.workunit.client.0.smithi003.stderr: -409> 2023-12-03T11:49:09.402+0000 7f81245ab800 5 asok(0x5632d495ea10) register_command objecter_requests cmddesc objecter_requests hook 0x5632d4b70400 EEXIST 2023-12-03T11:49:09.490 INFO:tasks.workunit.client.0.smithi003.stderr: -408> 2023-12-03T11:49:09.402+0000 7f81245ab800 1 librados: setting wanted keys 2023-12-03T11:49:09.490 INFO:tasks.workunit.client.0.smithi003.stderr: -407> 2023-12-03T11:49:09.402+0000 7f81245ab800 1 librados: calling monclient init 2023-12-03T11:49:09.490 INFO:tasks.workunit.client.0.smithi003.stderr: -406> 2023-12-03T11:49:09.402+0000 7f81245ab800 10 monclient: init 2023-12-03T11:49:09.490 INFO:tasks.workunit.client.0.smithi003.stderr: -405> 2023-12-03T11:49:09.402+0000 7f81245ab800 5 AuthRegistry(0x5632d4b67958) adding auth protocol: cephx 2023-12-03T11:49:09.490 INFO:tasks.workunit.client.0.smithi003.stderr: -404> 2023-12-03T11:49:09.402+0000 7f81245ab800 5 AuthRegistry(0x5632d4b67958) adding auth protocol: cephx 2023-12-03T11:49:09.490 INFO:tasks.workunit.client.0.smithi003.stderr: -403> 2023-12-03T11:49:09.402+0000 7f81245ab800 5 AuthRegistry(0x5632d4b67958) adding auth protocol: cephx 2023-12-03T11:49:09.490 INFO:tasks.workunit.client.0.smithi003.stderr: -402> 2023-12-03T11:49:09.402+0000 7f81245ab800 5 AuthRegistry(0x5632d4b67958) adding con mode: secure 2023-12-03T11:49:09.490 INFO:tasks.workunit.client.0.smithi003.stderr: -401> 2023-12-03T11:49:09.402+0000 7f81245ab800 5 AuthRegistry(0x5632d4b67958) adding con mode: crc 2023-12-03T11:49:09.490 INFO:tasks.workunit.client.0.smithi003.stderr: -400> 2023-12-03T11:49:09.402+0000 7f81245ab800 5 AuthRegistry(0x5632d4b67958) adding con mode: secure 2023-12-03T11:49:09.490 INFO:tasks.workunit.client.0.smithi003.stderr: -399> 2023-12-03T11:49:09.402+0000 7f81245ab800 5 AuthRegistry(0x5632d4b67958) adding con mode: crc 2023-12-03T11:49:09.490 INFO:tasks.workunit.client.0.smithi003.stderr: -398> 2023-12-03T11:49:09.402+0000 7f81245ab800 5 AuthRegistry(0x5632d4b67958) adding con mode: secure 2023-12-03T11:49:09.490 INFO:tasks.workunit.client.0.smithi003.stderr: -397> 2023-12-03T11:49:09.402+0000 7f81245ab800 5 AuthRegistry(0x5632d4b67958) adding con mode: crc 2023-12-03T11:49:09.490 INFO:tasks.workunit.client.0.smithi003.stderr: -396> 2023-12-03T11:49:09.402+0000 7f81245ab800 5 AuthRegistry(0x5632d4b67958) adding con mode: crc 2023-12-03T11:49:09.491 INFO:tasks.workunit.client.0.smithi003.stderr: -395> 2023-12-03T11:49:09.402+0000 7f81245ab800 5 AuthRegistry(0x5632d4b67958) adding con mode: secure 2023-12-03T11:49:09.491 INFO:tasks.workunit.client.0.smithi003.stderr: -394> 2023-12-03T11:49:09.402+0000 7f81245ab800 5 AuthRegistry(0x5632d4b67958) adding con mode: crc 2023-12-03T11:49:09.491 INFO:tasks.workunit.client.0.smithi003.stderr: -393> 2023-12-03T11:49:09.402+0000 7f81245ab800 5 AuthRegistry(0x5632d4b67958) adding con mode: secure 2023-12-03T11:49:09.491 INFO:tasks.workunit.client.0.smithi003.stderr: -392> 2023-12-03T11:49:09.402+0000 7f81245ab800 5 AuthRegistry(0x5632d4b67958) adding con mode: crc 2023-12-03T11:49:09.491 INFO:tasks.workunit.client.0.smithi003.stderr: -391> 2023-12-03T11:49:09.402+0000 7f81245ab800 5 AuthRegistry(0x5632d4b67958) adding con mode: secure 2023-12-03T11:49:09.491 INFO:tasks.workunit.client.0.smithi003.stderr: -390> 2023-12-03T11:49:09.403+0000 7f81245ab800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:49:09.491 INFO:tasks.workunit.client.0.smithi003.stderr: -389> 2023-12-03T11:49:09.403+0000 7f81245ab800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:49:09.491 INFO:tasks.workunit.client.0.smithi003.stderr: -388> 2023-12-03T11:49:09.403+0000 7f81245ab800 5 asok(0x5632d495ea10) register_command rotate-key cmddesc rotate-key hook 0x5632d4b67aa0 EEXIST 2023-12-03T11:49:09.491 INFO:tasks.workunit.client.0.smithi003.stderr: -387> 2023-12-03T11:49:09.403+0000 7f81245ab800 10 monclient: _reopen_session rank -1 2023-12-03T11:49:09.491 INFO:tasks.workunit.client.0.smithi003.stderr: -386> 2023-12-03T11:49:09.403+0000 7f81245ab800 10 monclient: _add_conns ranks=[2,0,1] 2023-12-03T11:49:09.491 INFO:tasks.workunit.client.0.smithi003.stderr: -385> 2023-12-03T11:49:09.403+0000 7f81245ab800 10 monclient(hunting): picked mon.noname-c con 0x5632d4b99e80 addr [v2:172.21.15.3:3301/0,v1:172.21.15.3:6790/0] 2023-12-03T11:49:09.491 INFO:tasks.workunit.client.0.smithi003.stderr: -384> 2023-12-03T11:49:09.403+0000 7f81245ab800 10 monclient(hunting): picked mon.noname-a con 0x5632d4b9df20 addr [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] 2023-12-03T11:49:09.491 INFO:tasks.workunit.client.0.smithi003.stderr: -383> 2023-12-03T11:49:09.403+0000 7f81245ab800 10 monclient(hunting): picked mon.noname-b con 0x5632d4b9b730 addr [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] 2023-12-03T11:49:09.491 INFO:tasks.workunit.client.0.smithi003.stderr: -382> 2023-12-03T11:49:09.403+0000 7f81245ab800 10 monclient(hunting): start opening mon connection 2023-12-03T11:49:09.491 INFO:tasks.workunit.client.0.smithi003.stderr: -381> 2023-12-03T11:49:09.403+0000 7f81245ab800 10 monclient(hunting): start opening mon connection 2023-12-03T11:49:09.492 INFO:tasks.workunit.client.0.smithi003.stderr: -380> 2023-12-03T11:49:09.403+0000 7f81245ab800 10 monclient(hunting): start opening mon connection 2023-12-03T11:49:09.492 INFO:tasks.workunit.client.0.smithi003.stderr: -379> 2023-12-03T11:49:09.403+0000 7f81245ab800 10 monclient(hunting): _renew_subs 2023-12-03T11:49:09.492 INFO:tasks.workunit.client.0.smithi003.stderr: -378> 2023-12-03T11:49:09.403+0000 7f81245ab800 10 monclient(hunting): authenticate will time out at 1771.641736s 2023-12-03T11:49:09.492 INFO:tasks.workunit.client.0.smithi003.stderr: -377> 2023-12-03T11:49:09.403+0000 7f81220ab640 10 monclient(hunting): get_auth_request con 0x5632d4b99e80 auth_method 0 2023-12-03T11:49:09.492 INFO:tasks.workunit.client.0.smithi003.stderr: -376> 2023-12-03T11:49:09.403+0000 7f81220ab640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:49:09.492 INFO:tasks.workunit.client.0.smithi003.stderr: -375> 2023-12-03T11:49:09.403+0000 7f81220ab640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:49:09.492 INFO:tasks.workunit.client.0.smithi003.stderr: -374> 2023-12-03T11:49:09.403+0000 7f81220ab640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:49:09.492 INFO:tasks.workunit.client.0.smithi003.stderr: -373> 2023-12-03T11:49:09.403+0000 7f81218aa640 10 monclient(hunting): get_auth_request con 0x5632d4b9df20 auth_method 0 2023-12-03T11:49:09.492 INFO:tasks.workunit.client.0.smithi003.stderr: -372> 2023-12-03T11:49:09.403+0000 7f81218aa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:49:09.492 INFO:tasks.workunit.client.0.smithi003.stderr: -371> 2023-12-03T11:49:09.403+0000 7f81218aa640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:49:09.492 INFO:tasks.workunit.client.0.smithi003.stderr: -370> 2023-12-03T11:49:09.403+0000 7f81218aa640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:49:09.492 INFO:tasks.workunit.client.0.smithi003.stderr: -369> 2023-12-03T11:49:09.403+0000 7f81220ab640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:49:09.492 INFO:tasks.workunit.client.0.smithi003.stderr: -368> 2023-12-03T11:49:09.403+0000 7f81220ab640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:49:09.492 INFO:tasks.workunit.client.0.smithi003.stderr: -367> 2023-12-03T11:49:09.403+0000 7f81220ab640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:49:09.492 INFO:tasks.workunit.client.0.smithi003.stderr: -366> 2023-12-03T11:49:09.403+0000 7f81218aa640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:49:09.493 INFO:tasks.workunit.client.0.smithi003.stderr: -365> 2023-12-03T11:49:09.403+0000 7f81218aa640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:49:09.493 INFO:tasks.workunit.client.0.smithi003.stderr: -364> 2023-12-03T11:49:09.403+0000 7f81218aa640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:49:09.493 INFO:tasks.workunit.client.0.smithi003.stderr: -363> 2023-12-03T11:49:09.403+0000 7f81228ac640 10 monclient(hunting): get_auth_request con 0x5632d4b9b730 auth_method 0 2023-12-03T11:49:09.493 INFO:tasks.workunit.client.0.smithi003.stderr: -362> 2023-12-03T11:49:09.403+0000 7f81228ac640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:49:09.493 INFO:tasks.workunit.client.0.smithi003.stderr: -361> 2023-12-03T11:49:09.403+0000 7f81228ac640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:49:09.493 INFO:tasks.workunit.client.0.smithi003.stderr: -360> 2023-12-03T11:49:09.403+0000 7f81228ac640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:49:09.493 INFO:tasks.workunit.client.0.smithi003.stderr: -359> 2023-12-03T11:49:09.403+0000 7f81220ab640 10 monclient(hunting): handle_auth_done global_id 6680 payload 824 2023-12-03T11:49:09.493 INFO:tasks.workunit.client.0.smithi003.stderr: -358> 2023-12-03T11:49:09.403+0000 7f81220ab640 10 monclient: _finish_hunting 0 2023-12-03T11:49:09.493 INFO:tasks.workunit.client.0.smithi003.stderr: -357> 2023-12-03T11:49:09.403+0000 7f81220ab640 1 monclient: found mon.noname-c 2023-12-03T11:49:09.493 INFO:tasks.workunit.client.0.smithi003.stderr: -356> 2023-12-03T11:49:09.403+0000 7f81220ab640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.3:3301/0 2023-12-03T11:49:09.493 INFO:tasks.workunit.client.0.smithi003.stderr: -355> 2023-12-03T11:49:09.404+0000 7f8102ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:49:09.493 INFO:tasks.workunit.client.0.smithi003.stderr: -354> 2023-12-03T11:49:09.404+0000 7f8102ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-12-03T11:49:09.493 INFO:tasks.workunit.client.0.smithi003.stderr: -353> 2023-12-03T11:49:09.404+0000 7f8102ffd640 10 monclient: dump: 2023-12-03T11:49:09.493 INFO:tasks.workunit.client.0.smithi003.stderr:epoch 1 2023-12-03T11:49:09.493 INFO:tasks.workunit.client.0.smithi003.stderr:fsid 296556de-a4fc-4095-9b6d-0fe813c2865c 2023-12-03T11:49:09.494 INFO:tasks.workunit.client.0.smithi003.stderr:last_changed 2023-12-03T11:33:18.862564+0000 2023-12-03T11:49:09.494 INFO:tasks.workunit.client.0.smithi003.stderr:created 2023-12-03T11:33:18.862564+0000 2023-12-03T11:49:09.494 INFO:tasks.workunit.client.0.smithi003.stderr:min_mon_release 18 (reef) 2023-12-03T11:49:09.494 INFO:tasks.workunit.client.0.smithi003.stderr:election_strategy: 1 2023-12-03T11:49:09.494 INFO:tasks.workunit.client.0.smithi003.stderr:0: [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] mon.a 2023-12-03T11:49:09.494 INFO:tasks.workunit.client.0.smithi003.stderr:1: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.b 2023-12-03T11:49:09.494 INFO:tasks.workunit.client.0.smithi003.stderr:2: [v2:172.21.15.3:3301/0,v1:172.21.15.3:6790/0] mon.c 2023-12-03T11:49:09.494 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:49:09.494 INFO:tasks.workunit.client.0.smithi003.stderr: -352> 2023-12-03T11:49:09.404+0000 7f8102ffd640 10 monclient: _finish_auth 0 2023-12-03T11:49:09.495 INFO:tasks.workunit.client.0.smithi003.stderr: -351> 2023-12-03T11:49:09.404+0000 7f8102ffd640 10 monclient: _check_auth_tickets 2023-12-03T11:49:09.495 INFO:tasks.workunit.client.0.smithi003.stderr: -350> 2023-12-03T11:49:09.404+0000 7f8102ffd640 10 monclient: handle_config config(0 keys) v1 2023-12-03T11:49:09.495 INFO:tasks.workunit.client.0.smithi003.stderr: -349> 2023-12-03T11:49:09.404+0000 7f8102ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:49:09.495 INFO:tasks.workunit.client.0.smithi003.stderr: -348> 2023-12-03T11:49:09.404+0000 7f8102ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-12-03T11:49:09.495 INFO:tasks.workunit.client.0.smithi003.stderr: -347> 2023-12-03T11:49:09.404+0000 7f8102ffd640 10 monclient: dump: 2023-12-03T11:49:09.495 INFO:tasks.workunit.client.0.smithi003.stderr:epoch 1 2023-12-03T11:49:09.495 INFO:tasks.workunit.client.0.smithi003.stderr:fsid 296556de-a4fc-4095-9b6d-0fe813c2865c 2023-12-03T11:49:09.495 INFO:tasks.workunit.client.0.smithi003.stderr:last_changed 2023-12-03T11:33:18.862564+0000 2023-12-03T11:49:09.495 INFO:tasks.workunit.client.0.smithi003.stderr:created 2023-12-03T11:33:18.862564+0000 2023-12-03T11:49:09.495 INFO:tasks.workunit.client.0.smithi003.stderr:min_mon_release 18 (reef) 2023-12-03T11:49:09.495 INFO:tasks.workunit.client.0.smithi003.stderr:election_strategy: 1 2023-12-03T11:49:09.495 INFO:tasks.workunit.client.0.smithi003.stderr:0: [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] mon.a 2023-12-03T11:49:09.495 INFO:tasks.workunit.client.0.smithi003.stderr:1: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.b 2023-12-03T11:49:09.495 INFO:tasks.workunit.client.0.smithi003.stderr:2: [v2:172.21.15.3:3301/0,v1:172.21.15.3:6790/0] mon.c 2023-12-03T11:49:09.495 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:49:09.496 INFO:tasks.workunit.client.0.smithi003.stderr: -346> 2023-12-03T11:49:09.404+0000 7f81245ab800 5 monclient: authenticate success, global_id 6680 2023-12-03T11:49:09.496 INFO:tasks.workunit.client.0.smithi003.stderr: -345> 2023-12-03T11:49:09.404+0000 7f81245ab800 10 monclient: _renew_subs 2023-12-03T11:49:09.496 INFO:tasks.workunit.client.0.smithi003.stderr: -344> 2023-12-03T11:49:09.404+0000 7f8110ff9640 4 set_mon_vals no callback set 2023-12-03T11:49:09.496 INFO:tasks.workunit.client.0.smithi003.stderr: -343> 2023-12-03T11:49:09.404+0000 7f81245ab800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.3:3301/0 2023-12-03T11:49:09.496 INFO:tasks.workunit.client.0.smithi003.stderr: -342> 2023-12-03T11:49:09.404+0000 7f81245ab800 10 monclient: _renew_subs 2023-12-03T11:49:09.496 INFO:tasks.workunit.client.0.smithi003.stderr: -341> 2023-12-03T11:49:09.404+0000 7f81245ab800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.3:3301/0 2023-12-03T11:49:09.496 INFO:tasks.workunit.client.0.smithi003.stderr: -340> 2023-12-03T11:49:09.404+0000 7f81245ab800 1 librados: init done 2023-12-03T11:49:09.496 INFO:tasks.workunit.client.0.smithi003.stderr: -339> 2023-12-03T11:49:09.405+0000 7f81245ab800 20 rados->read ofs=0 len=0 2023-12-03T11:49:09.496 INFO:tasks.workunit.client.0.smithi003.stderr: -338> 2023-12-03T11:49:09.405+0000 7f8102ffd640 4 mgrc handle_mgr_map Got map version 5 2023-12-03T11:49:09.496 INFO:tasks.workunit.client.0.smithi003.stderr: -337> 2023-12-03T11:49:09.405+0000 7f8102ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.37:6832/2165065416,v1:172.21.15.37:6833/2165065416] 2023-12-03T11:49:09.496 INFO:tasks.workunit.client.0.smithi003.stderr: -336> 2023-12-03T11:49:09.405+0000 7f8102ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.37:6832/2165065416,v1:172.21.15.37:6833/2165065416] 2023-12-03T11:49:09.496 INFO:tasks.workunit.client.0.smithi003.stderr: -335> 2023-12-03T11:49:09.406+0000 7f81228ac640 10 monclient: get_auth_request con 0x5632d4bb5cd0 auth_method 0 2023-12-03T11:49:09.496 INFO:tasks.workunit.client.0.smithi003.stderr: -334> 2023-12-03T11:49:09.406+0000 7f81218aa640 10 monclient: get_auth_request con 0x7f80fc069850 auth_method 0 2023-12-03T11:49:09.496 INFO:tasks.workunit.client.0.smithi003.stderr: -333> 2023-12-03T11:49:09.406+0000 7f81245ab800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:09.496 INFO:tasks.workunit.client.0.smithi003.stderr: -332> 2023-12-03T11:49:09.406+0000 7f81245ab800 20 realm 2023-12-03T11:49:09.497 INFO:tasks.workunit.client.0.smithi003.stderr: -331> 2023-12-03T11:49:09.406+0000 7f81245ab800 20 rados->read ofs=0 len=0 2023-12-03T11:49:09.497 INFO:tasks.workunit.client.0.smithi003.stderr: -330> 2023-12-03T11:49:09.406+0000 7f81245ab800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:09.497 INFO:tasks.workunit.client.0.smithi003.stderr: -329> 2023-12-03T11:49:09.406+0000 7f81245ab800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:49:09.497 INFO:tasks.workunit.client.0.smithi003.stderr: -328> 2023-12-03T11:49:09.406+0000 7f81245ab800 20 rados->read ofs=0 len=0 2023-12-03T11:49:09.497 INFO:tasks.workunit.client.0.smithi003.stderr: -327> 2023-12-03T11:49:09.407+0000 7f81245ab800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:09.497 INFO:tasks.workunit.client.0.smithi003.stderr: -326> 2023-12-03T11:49:09.407+0000 7f81245ab800 20 rados->read ofs=0 len=0 2023-12-03T11:49:09.497 INFO:tasks.workunit.client.0.smithi003.stderr: -325> 2023-12-03T11:49:09.407+0000 7f81220ab640 10 monclient: get_auth_request con 0x5632d4bb9e30 auth_method 0 2023-12-03T11:49:09.497 INFO:tasks.workunit.client.0.smithi003.stderr: -324> 2023-12-03T11:49:09.408+0000 7f81245ab800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:49:09.497 INFO:tasks.workunit.client.0.smithi003.stderr: -323> 2023-12-03T11:49:09.408+0000 7f81245ab800 20 rados->read ofs=0 len=0 2023-12-03T11:49:09.497 INFO:tasks.workunit.client.0.smithi003.stderr: -322> 2023-12-03T11:49:09.408+0000 7f81245ab800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:49:09.497 INFO:tasks.workunit.client.0.smithi003.stderr: -321> 2023-12-03T11:49:09.408+0000 7f81245ab800 20 searching for the correct realm 2023-12-03T11:49:09.498 INFO:tasks.workunit.client.0.smithi003.stderr: -320> 2023-12-03T11:49:09.408+0000 7f81218aa640 10 monclient: get_auth_request con 0x5632d4bbec80 auth_method 0 2023-12-03T11:49:09.498 INFO:tasks.workunit.client.0.smithi003.stderr: -319> 2023-12-03T11:49:09.409+0000 7f81228ac640 10 monclient: get_auth_request con 0x7f811801c040 auth_method 0 2023-12-03T11:49:09.498 INFO:tasks.workunit.client.0.smithi003.stderr: -318> 2023-12-03T11:49:09.409+0000 7f81220ab640 10 monclient: get_auth_request con 0x7f811c01c040 auth_method 0 2023-12-03T11:49:09.498 INFO:tasks.workunit.client.0.smithi003.stderr: -317> 2023-12-03T11:49:09.410+0000 7f81218aa640 10 monclient: get_auth_request con 0x7f8114073020 auth_method 0 2023-12-03T11:49:09.498 INFO:tasks.workunit.client.0.smithi003.stderr: -316> 2023-12-03T11:49:09.412+0000 7f81228ac640 10 monclient: get_auth_request con 0x7f811802e040 auth_method 0 2023-12-03T11:49:09.498 INFO:tasks.workunit.client.0.smithi003.stderr: -315> 2023-12-03T11:49:09.415+0000 7f81220ab640 10 monclient: get_auth_request con 0x7f811801eb90 auth_method 0 2023-12-03T11:49:09.498 INFO:tasks.workunit.client.0.smithi003.stderr: -314> 2023-12-03T11:49:09.419+0000 7f81220ab640 0 -- 172.21.15.3:0/2013709418 >> [v2:172.21.15.37:6805/1692844418,v1:172.21.15.37:6807/1692844418] conn(0x5632d4bb9e30 msgr2=0x5632d4bbc220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:49:09.498 INFO:tasks.workunit.client.0.smithi003.stderr: -313> 2023-12-03T11:49:09.419+0000 7f8102ffd640 1 client.6680.objecter ms_handle_reset 0x5632d4bb9e30 session 0x5632d4927320 osd.5 2023-12-03T11:49:09.498 INFO:tasks.workunit.client.0.smithi003.stderr: -312> 2023-12-03T11:49:09.419+0000 7f8102ffd640 10 monclient: _renew_subs 2023-12-03T11:49:09.498 INFO:tasks.workunit.client.0.smithi003.stderr: -311> 2023-12-03T11:49:09.419+0000 7f8102ffd640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.3:3301/0 2023-12-03T11:49:09.498 INFO:tasks.workunit.client.0.smithi003.stderr: -310> 2023-12-03T11:49:09.419+0000 7f81220ab640 10 monclient: get_auth_request con 0x7f80fc079e40 auth_method 0 2023-12-03T11:49:09.498 INFO:tasks.workunit.client.0.smithi003.stderr: -309> 2023-12-03T11:49:09.420+0000 7f81245ab800 20 RGWRados::pool_iterate: got zone_info.83aabb46-04b5-4c96-9933-c6bfb1173a73 2023-12-03T11:49:09.498 INFO:tasks.workunit.client.0.smithi003.stderr: -308> 2023-12-03T11:49:09.420+0000 7f81245ab800 20 RGWRados::pool_iterate: got zonegroup_info.6a811aad-435d-4fdd-93c9-b7e0b50de429 2023-12-03T11:49:09.498 INFO:tasks.workunit.client.0.smithi003.stderr: -307> 2023-12-03T11:49:09.420+0000 7f81245ab800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:49:09.499 INFO:tasks.workunit.client.0.smithi003.stderr: -306> 2023-12-03T11:49:09.420+0000 7f81245ab800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:49:09.499 INFO:tasks.workunit.client.0.smithi003.stderr: -305> 2023-12-03T11:49:09.420+0000 7f81245ab800 20 rados->read ofs=0 len=0 2023-12-03T11:49:09.499 INFO:tasks.workunit.client.0.smithi003.stderr: -304> 2023-12-03T11:49:09.420+0000 7f81245ab800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:09.499 INFO:tasks.workunit.client.0.smithi003.stderr: -303> 2023-12-03T11:49:09.420+0000 7f81245ab800 20 rados->read ofs=0 len=0 2023-12-03T11:49:09.499 INFO:tasks.workunit.client.0.smithi003.stderr: -302> 2023-12-03T11:49:09.421+0000 7f81245ab800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:49:09.499 INFO:tasks.workunit.client.0.smithi003.stderr: -301> 2023-12-03T11:49:09.421+0000 7f81245ab800 20 rados->read ofs=0 len=0 2023-12-03T11:49:09.499 INFO:tasks.workunit.client.0.smithi003.stderr: -300> 2023-12-03T11:49:09.421+0000 7f81245ab800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:49:09.499 INFO:tasks.workunit.client.0.smithi003.stderr: -299> 2023-12-03T11:49:09.421+0000 7f81245ab800 20 zone default found 2023-12-03T11:49:09.499 INFO:tasks.workunit.client.0.smithi003.stderr: -298> 2023-12-03T11:49:09.421+0000 7f81245ab800 4 Realm: () 2023-12-03T11:49:09.499 INFO:tasks.workunit.client.0.smithi003.stderr: -297> 2023-12-03T11:49:09.421+0000 7f81245ab800 4 ZoneGroup: default (6a811aad-435d-4fdd-93c9-b7e0b50de429) 2023-12-03T11:49:09.499 INFO:tasks.workunit.client.0.smithi003.stderr: -296> 2023-12-03T11:49:09.421+0000 7f81245ab800 4 Zone: default (83aabb46-04b5-4c96-9933-c6bfb1173a73) 2023-12-03T11:49:09.499 INFO:tasks.workunit.client.0.smithi003.stderr: -295> 2023-12-03T11:49:09.421+0000 7f81245ab800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:49:09.499 INFO:tasks.workunit.client.0.smithi003.stderr: -294> 2023-12-03T11:49:09.421+0000 7f81245ab800 20 zonegroup default 2023-12-03T11:49:09.499 INFO:tasks.workunit.client.0.smithi003.stderr: -293> 2023-12-03T11:49:09.421+0000 7f81245ab800 20 rados->read ofs=0 len=0 2023-12-03T11:49:09.499 INFO:tasks.workunit.client.0.smithi003.stderr: -292> 2023-12-03T11:49:09.421+0000 7f81245ab800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:09.500 INFO:tasks.workunit.client.0.smithi003.stderr: -291> 2023-12-03T11:49:09.421+0000 7f81245ab800 20 rados->read ofs=0 len=0 2023-12-03T11:49:09.500 INFO:tasks.workunit.client.0.smithi003.stderr: -290> 2023-12-03T11:49:09.422+0000 7f81245ab800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:09.500 INFO:tasks.workunit.client.0.smithi003.stderr: -289> 2023-12-03T11:49:09.422+0000 7f81245ab800 20 rados->read ofs=0 len=0 2023-12-03T11:49:09.500 INFO:tasks.workunit.client.0.smithi003.stderr: -288> 2023-12-03T11:49:09.422+0000 7f81245ab800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:09.500 INFO:tasks.workunit.client.0.smithi003.stderr: -287> 2023-12-03T11:49:09.422+0000 7f81245ab800 20 started sync module instance, tier type = 2023-12-03T11:49:09.500 INFO:tasks.workunit.client.0.smithi003.stderr: -286> 2023-12-03T11:49:09.422+0000 7f81245ab800 20 started zone id=83aabb46-04b5-4c96-9933-c6bfb1173a73 (name=default) with tier type = 2023-12-03T11:49:09.500 INFO:tasks.workunit.client.0.smithi003.stderr: -285> 2023-12-03T11:49:09.429+0000 7f81228ac640 0 -- 172.21.15.3:0/2013709418 >> [v2:172.21.15.37:6816/3770469300,v1:172.21.15.37:6818/3770469300] conn(0x7f811802e040 msgr2=0x7f811802e420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:49:09.500 INFO:tasks.workunit.client.0.smithi003.stderr: -284> 2023-12-03T11:49:09.429+0000 7f8102ffd640 1 client.6680.objecter ms_handle_reset 0x7f811802e040 session 0x7f811801e690 osd.6 2023-12-03T11:49:09.500 INFO:tasks.workunit.client.0.smithi003.stderr: -283> 2023-12-03T11:49:09.429+0000 7f81228ac640 10 monclient: get_auth_request con 0x5632d4bb9e30 auth_method 0 2023-12-03T11:49:09.500 INFO:tasks.workunit.client.0.smithi003.stderr: -282> 2023-12-03T11:49:09.431+0000 7f81245ab800 20 add_watcher() i=0 2023-12-03T11:49:09.500 INFO:tasks.workunit.client.0.smithi003.stderr: -281> 2023-12-03T11:49:09.431+0000 7f81245ab800 20 add_watcher() i=1 2023-12-03T11:49:09.500 INFO:tasks.workunit.client.0.smithi003.stderr: -280> 2023-12-03T11:49:09.431+0000 7f81245ab800 20 add_watcher() i=2 2023-12-03T11:49:09.500 INFO:tasks.workunit.client.0.smithi003.stderr: -279> 2023-12-03T11:49:09.431+0000 7f81245ab800 20 add_watcher() i=3 2023-12-03T11:49:09.500 INFO:tasks.workunit.client.0.smithi003.stderr: -278> 2023-12-03T11:49:09.431+0000 7f81245ab800 20 add_watcher() i=4 2023-12-03T11:49:09.500 INFO:tasks.workunit.client.0.smithi003.stderr: -277> 2023-12-03T11:49:09.431+0000 7f81245ab800 20 add_watcher() i=5 2023-12-03T11:49:09.501 INFO:tasks.workunit.client.0.smithi003.stderr: -276> 2023-12-03T11:49:09.431+0000 7f81245ab800 20 add_watcher() i=6 2023-12-03T11:49:09.501 INFO:tasks.workunit.client.0.smithi003.stderr: -275> 2023-12-03T11:49:09.433+0000 7f81245ab800 20 add_watcher() i=7 2023-12-03T11:49:09.501 INFO:tasks.workunit.client.0.smithi003.stderr: -274> 2023-12-03T11:49:09.433+0000 7f81245ab800 2 all 8 watchers are set, enabling cache 2023-12-03T11:49:09.501 INFO:tasks.workunit.client.0.smithi003.stderr: -273> 2023-12-03T11:49:09.434+0000 7f81245ab800 5 AuthRegistry(0x7ffe91b20760) adding auth protocol: cephx 2023-12-03T11:49:09.501 INFO:tasks.workunit.client.0.smithi003.stderr: -272> 2023-12-03T11:49:09.434+0000 7f81245ab800 5 AuthRegistry(0x7ffe91b20760) adding auth protocol: cephx 2023-12-03T11:49:09.501 INFO:tasks.workunit.client.0.smithi003.stderr: -271> 2023-12-03T11:49:09.434+0000 7f81245ab800 5 AuthRegistry(0x7ffe91b20760) adding auth protocol: cephx 2023-12-03T11:49:09.501 INFO:tasks.workunit.client.0.smithi003.stderr: -270> 2023-12-03T11:49:09.434+0000 7f81245ab800 5 AuthRegistry(0x7ffe91b20760) adding con mode: secure 2023-12-03T11:49:09.501 INFO:tasks.workunit.client.0.smithi003.stderr: -269> 2023-12-03T11:49:09.434+0000 7f81245ab800 5 AuthRegistry(0x7ffe91b20760) adding con mode: crc 2023-12-03T11:49:09.501 INFO:tasks.workunit.client.0.smithi003.stderr: -268> 2023-12-03T11:49:09.434+0000 7f81245ab800 5 AuthRegistry(0x7ffe91b20760) adding con mode: secure 2023-12-03T11:49:09.501 INFO:tasks.workunit.client.0.smithi003.stderr: -267> 2023-12-03T11:49:09.434+0000 7f81245ab800 5 AuthRegistry(0x7ffe91b20760) adding con mode: crc 2023-12-03T11:49:09.501 INFO:tasks.workunit.client.0.smithi003.stderr: -266> 2023-12-03T11:49:09.434+0000 7f81245ab800 5 AuthRegistry(0x7ffe91b20760) adding con mode: secure 2023-12-03T11:49:09.501 INFO:tasks.workunit.client.0.smithi003.stderr: -265> 2023-12-03T11:49:09.434+0000 7f81245ab800 5 AuthRegistry(0x7ffe91b20760) adding con mode: crc 2023-12-03T11:49:09.501 INFO:tasks.workunit.client.0.smithi003.stderr: -264> 2023-12-03T11:49:09.434+0000 7f80e7fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:49:09.501 INFO:tasks.workunit.client.0.smithi003.stderr: -263> 2023-12-03T11:49:09.434+0000 7f81245ab800 5 AuthRegistry(0x7ffe91b20760) adding con mode: crc 2023-12-03T11:49:09.502 INFO:tasks.workunit.client.0.smithi003.stderr: -262> 2023-12-03T11:49:09.434+0000 7f81245ab800 5 AuthRegistry(0x7ffe91b20760) adding con mode: secure 2023-12-03T11:49:09.502 INFO:tasks.workunit.client.0.smithi003.stderr: -261> 2023-12-03T11:49:09.434+0000 7f81245ab800 5 AuthRegistry(0x7ffe91b20760) adding con mode: crc 2023-12-03T11:49:09.502 INFO:tasks.workunit.client.0.smithi003.stderr: -260> 2023-12-03T11:49:09.434+0000 7f81245ab800 5 AuthRegistry(0x7ffe91b20760) adding con mode: secure 2023-12-03T11:49:09.502 INFO:tasks.workunit.client.0.smithi003.stderr: -259> 2023-12-03T11:49:09.434+0000 7f81245ab800 5 AuthRegistry(0x7ffe91b20760) adding con mode: crc 2023-12-03T11:49:09.502 INFO:tasks.workunit.client.0.smithi003.stderr: -258> 2023-12-03T11:49:09.434+0000 7f81245ab800 5 AuthRegistry(0x7ffe91b20760) adding con mode: secure 2023-12-03T11:49:09.502 INFO:tasks.workunit.client.0.smithi003.stderr: -257> 2023-12-03T11:49:09.434+0000 7f81245ab800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:49:09.502 INFO:tasks.workunit.client.0.smithi003.stderr: -256> 2023-12-03T11:49:09.434+0000 7f81245ab800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:49:09.502 INFO:tasks.workunit.client.0.smithi003.stderr: -255> 2023-12-03T11:49:09.434+0000 7f81245ab800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:49:09.502 INFO:tasks.workunit.client.0.smithi003.stderr: -254> 2023-12-03T11:49:09.434+0000 7f81245ab800 5 asok(0x5632d495ea10) register_command cache list hook 0x5632d4b5d510 2023-12-03T11:49:09.502 INFO:tasks.workunit.client.0.smithi003.stderr: -253> 2023-12-03T11:49:09.434+0000 7f81245ab800 5 asok(0x5632d495ea10) register_command cache inspect hook 0x5632d4b5d510 2023-12-03T11:49:09.502 INFO:tasks.workunit.client.0.smithi003.stderr: -252> 2023-12-03T11:49:09.434+0000 7f81245ab800 5 asok(0x5632d495ea10) register_command cache erase hook 0x5632d4b5d510 2023-12-03T11:49:09.502 INFO:tasks.workunit.client.0.smithi003.stderr: -251> 2023-12-03T11:49:09.434+0000 7f81245ab800 5 asok(0x5632d495ea10) register_command cache zap hook 0x5632d4b5d510 2023-12-03T11:49:09.502 INFO:tasks.workunit.client.0.smithi003.stderr: -250> 2023-12-03T11:49:09.434+0000 7f81245ab800 10 monclient: get_monmap_and_config 2023-12-03T11:49:09.502 INFO:tasks.workunit.client.0.smithi003.stderr: -249> 2023-12-03T11:49:09.434+0000 7f81245ab800 10 monclient: build_initial_monmap 2023-12-03T11:49:09.502 INFO:tasks.workunit.client.0.smithi003.stderr: -248> 2023-12-03T11:49:09.434+0000 7f81245ab800 1 build_initial for_mkfs: 0 2023-12-03T11:49:09.503 INFO:tasks.workunit.client.0.smithi003.stderr: -247> 2023-12-03T11:49:09.434+0000 7f81245ab800 10 monclient: monmap: 2023-12-03T11:49:09.503 INFO:tasks.workunit.client.0.smithi003.stderr:epoch 0 2023-12-03T11:49:09.503 INFO:tasks.workunit.client.0.smithi003.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-12-03T11:49:09.503 INFO:tasks.workunit.client.0.smithi003.stderr:last_changed 0.000000 2023-12-03T11:49:09.503 INFO:tasks.workunit.client.0.smithi003.stderr:created 0.000000 2023-12-03T11:49:09.503 INFO:tasks.workunit.client.0.smithi003.stderr:min_mon_release 0 (unknown) 2023-12-03T11:49:09.503 INFO:tasks.workunit.client.0.smithi003.stderr:election_strategy: 1 2023-12-03T11:49:09.503 INFO:tasks.workunit.client.0.smithi003.stderr:0: [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] mon.noname-a 2023-12-03T11:49:09.503 INFO:tasks.workunit.client.0.smithi003.stderr:1: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.noname-b 2023-12-03T11:49:09.503 INFO:tasks.workunit.client.0.smithi003.stderr:2: [v2:172.21.15.3:3301/0,v1:172.21.15.3:6790/0] mon.noname-c 2023-12-03T11:49:09.503 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:49:09.503 INFO:tasks.workunit.client.0.smithi003.stderr: -246> 2023-12-03T11:49:09.434+0000 7f81245ab800 5 AuthRegistry(0x5632d4bf9e00) adding auth protocol: cephx 2023-12-03T11:49:09.503 INFO:tasks.workunit.client.0.smithi003.stderr: -245> 2023-12-03T11:49:09.434+0000 7f81245ab800 5 AuthRegistry(0x5632d4bf9e00) adding auth protocol: cephx 2023-12-03T11:49:09.503 INFO:tasks.workunit.client.0.smithi003.stderr: -244> 2023-12-03T11:49:09.434+0000 7f81245ab800 5 AuthRegistry(0x5632d4bf9e00) adding auth protocol: cephx 2023-12-03T11:49:09.503 INFO:tasks.workunit.client.0.smithi003.stderr: -243> 2023-12-03T11:49:09.434+0000 7f81245ab800 5 AuthRegistry(0x5632d4bf9e00) adding con mode: secure 2023-12-03T11:49:09.504 INFO:tasks.workunit.client.0.smithi003.stderr: -242> 2023-12-03T11:49:09.434+0000 7f81245ab800 5 AuthRegistry(0x5632d4bf9e00) adding con mode: crc 2023-12-03T11:49:09.504 INFO:tasks.workunit.client.0.smithi003.stderr: -241> 2023-12-03T11:49:09.434+0000 7f81245ab800 5 AuthRegistry(0x5632d4bf9e00) adding con mode: secure 2023-12-03T11:49:09.504 INFO:tasks.workunit.client.0.smithi003.stderr: -240> 2023-12-03T11:49:09.434+0000 7f81245ab800 5 AuthRegistry(0x5632d4bf9e00) adding con mode: crc 2023-12-03T11:49:09.504 INFO:tasks.workunit.client.0.smithi003.stderr: -239> 2023-12-03T11:49:09.434+0000 7f81245ab800 5 AuthRegistry(0x5632d4bf9e00) adding con mode: secure 2023-12-03T11:49:09.504 INFO:tasks.workunit.client.0.smithi003.stderr: -238> 2023-12-03T11:49:09.434+0000 7f81245ab800 5 AuthRegistry(0x5632d4bf9e00) adding con mode: crc 2023-12-03T11:49:09.504 INFO:tasks.workunit.client.0.smithi003.stderr: -237> 2023-12-03T11:49:09.434+0000 7f81245ab800 5 AuthRegistry(0x5632d4bf9e00) adding con mode: crc 2023-12-03T11:49:09.504 INFO:tasks.workunit.client.0.smithi003.stderr: -236> 2023-12-03T11:49:09.434+0000 7f81245ab800 5 AuthRegistry(0x5632d4bf9e00) adding con mode: secure 2023-12-03T11:49:09.504 INFO:tasks.workunit.client.0.smithi003.stderr: -235> 2023-12-03T11:49:09.434+0000 7f81245ab800 5 AuthRegistry(0x5632d4bf9e00) adding con mode: crc 2023-12-03T11:49:09.504 INFO:tasks.workunit.client.0.smithi003.stderr: -234> 2023-12-03T11:49:09.434+0000 7f81245ab800 5 AuthRegistry(0x5632d4bf9e00) adding con mode: secure 2023-12-03T11:49:09.505 INFO:tasks.workunit.client.0.smithi003.stderr: -233> 2023-12-03T11:49:09.434+0000 7f81245ab800 5 AuthRegistry(0x5632d4bf9e00) adding con mode: crc 2023-12-03T11:49:09.505 INFO:tasks.workunit.client.0.smithi003.stderr: -232> 2023-12-03T11:49:09.434+0000 7f81245ab800 5 AuthRegistry(0x5632d4bf9e00) adding con mode: secure 2023-12-03T11:49:09.505 INFO:tasks.workunit.client.0.smithi003.stderr: -231> 2023-12-03T11:49:09.435+0000 7f81245ab800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:49:09.505 INFO:tasks.workunit.client.0.smithi003.stderr: -230> 2023-12-03T11:49:09.435+0000 7f81245ab800 10 monclient: init 2023-12-03T11:49:09.505 INFO:tasks.workunit.client.0.smithi003.stderr: -229> 2023-12-03T11:49:09.435+0000 7f81245ab800 5 AuthRegistry(0x7ffe91b202b0) adding auth protocol: cephx 2023-12-03T11:49:09.505 INFO:tasks.workunit.client.0.smithi003.stderr: -228> 2023-12-03T11:49:09.435+0000 7f81245ab800 5 AuthRegistry(0x7ffe91b202b0) adding auth protocol: cephx 2023-12-03T11:49:09.505 INFO:tasks.workunit.client.0.smithi003.stderr: -227> 2023-12-03T11:49:09.435+0000 7f81245ab800 5 AuthRegistry(0x7ffe91b202b0) adding auth protocol: cephx 2023-12-03T11:49:09.505 INFO:tasks.workunit.client.0.smithi003.stderr: -226> 2023-12-03T11:49:09.435+0000 7f81245ab800 5 AuthRegistry(0x7ffe91b202b0) adding con mode: secure 2023-12-03T11:49:09.505 INFO:tasks.workunit.client.0.smithi003.stderr: -225> 2023-12-03T11:49:09.435+0000 7f81245ab800 5 AuthRegistry(0x7ffe91b202b0) adding con mode: crc 2023-12-03T11:49:09.505 INFO:tasks.workunit.client.0.smithi003.stderr: -224> 2023-12-03T11:49:09.435+0000 7f81245ab800 5 AuthRegistry(0x7ffe91b202b0) adding con mode: secure 2023-12-03T11:49:09.505 INFO:tasks.workunit.client.0.smithi003.stderr: -223> 2023-12-03T11:49:09.435+0000 7f81245ab800 5 AuthRegistry(0x7ffe91b202b0) adding con mode: crc 2023-12-03T11:49:09.505 INFO:tasks.workunit.client.0.smithi003.stderr: -222> 2023-12-03T11:49:09.435+0000 7f81245ab800 5 AuthRegistry(0x7ffe91b202b0) adding con mode: secure 2023-12-03T11:49:09.506 INFO:tasks.workunit.client.0.smithi003.stderr: -221> 2023-12-03T11:49:09.435+0000 7f81245ab800 5 AuthRegistry(0x7ffe91b202b0) adding con mode: crc 2023-12-03T11:49:09.506 INFO:tasks.workunit.client.0.smithi003.stderr: -220> 2023-12-03T11:49:09.435+0000 7f81245ab800 5 AuthRegistry(0x7ffe91b202b0) adding con mode: crc 2023-12-03T11:49:09.506 INFO:tasks.workunit.client.0.smithi003.stderr: -219> 2023-12-03T11:49:09.435+0000 7f81245ab800 5 AuthRegistry(0x7ffe91b202b0) adding con mode: secure 2023-12-03T11:49:09.506 INFO:tasks.workunit.client.0.smithi003.stderr: -218> 2023-12-03T11:49:09.435+0000 7f81245ab800 5 AuthRegistry(0x7ffe91b202b0) adding con mode: crc 2023-12-03T11:49:09.506 INFO:tasks.workunit.client.0.smithi003.stderr: -217> 2023-12-03T11:49:09.435+0000 7f81245ab800 5 AuthRegistry(0x7ffe91b202b0) adding con mode: secure 2023-12-03T11:49:09.506 INFO:tasks.workunit.client.0.smithi003.stderr: -216> 2023-12-03T11:49:09.435+0000 7f81245ab800 5 AuthRegistry(0x7ffe91b202b0) adding con mode: crc 2023-12-03T11:49:09.506 INFO:tasks.workunit.client.0.smithi003.stderr: -215> 2023-12-03T11:49:09.435+0000 7f81245ab800 5 AuthRegistry(0x7ffe91b202b0) adding con mode: secure 2023-12-03T11:49:09.506 INFO:tasks.workunit.client.0.smithi003.stderr: -214> 2023-12-03T11:49:09.435+0000 7f81245ab800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:49:09.506 INFO:tasks.workunit.client.0.smithi003.stderr: -213> 2023-12-03T11:49:09.435+0000 7f81245ab800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:49:09.506 INFO:tasks.workunit.client.0.smithi003.stderr: -212> 2023-12-03T11:49:09.435+0000 7f81245ab800 5 asok(0x5632d495ea10) register_command rotate-key cmddesc rotate-key hook 0x7ffe91b203f8 EEXIST 2023-12-03T11:49:09.506 INFO:tasks.workunit.client.0.smithi003.stderr: -211> 2023-12-03T11:49:09.435+0000 7f81245ab800 10 monclient: _reopen_session rank -1 2023-12-03T11:49:09.506 INFO:tasks.workunit.client.0.smithi003.stderr: -210> 2023-12-03T11:49:09.435+0000 7f81245ab800 10 monclient: _add_conns ranks=[2,1,0] 2023-12-03T11:49:09.506 INFO:tasks.workunit.client.0.smithi003.stderr: -209> 2023-12-03T11:49:09.435+0000 7f81245ab800 10 monclient(hunting): picked mon.noname-c con 0x5632d4bf8540 addr [v2:172.21.15.3:3301/0,v1:172.21.15.3:6790/0] 2023-12-03T11:49:09.506 INFO:tasks.workunit.client.0.smithi003.stderr: -208> 2023-12-03T11:49:09.435+0000 7f81245ab800 10 monclient(hunting): picked mon.noname-b con 0x5632d4bf95b0 addr [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] 2023-12-03T11:49:09.507 INFO:tasks.workunit.client.0.smithi003.stderr: -207> 2023-12-03T11:49:09.435+0000 7f81245ab800 10 monclient(hunting): picked mon.noname-a con 0x5632d4bfcbd0 addr [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] 2023-12-03T11:49:09.507 INFO:tasks.workunit.client.0.smithi003.stderr: -206> 2023-12-03T11:49:09.435+0000 7f81245ab800 10 monclient(hunting): start opening mon connection 2023-12-03T11:49:09.507 INFO:tasks.workunit.client.0.smithi003.stderr: -205> 2023-12-03T11:49:09.435+0000 7f81245ab800 10 monclient(hunting): start opening mon connection 2023-12-03T11:49:09.507 INFO:tasks.workunit.client.0.smithi003.stderr: -204> 2023-12-03T11:49:09.435+0000 7f81245ab800 10 monclient(hunting): start opening mon connection 2023-12-03T11:49:09.507 INFO:tasks.workunit.client.0.smithi003.stderr: -203> 2023-12-03T11:49:09.435+0000 7f81245ab800 10 monclient(hunting): _renew_subs 2023-12-03T11:49:09.507 INFO:tasks.workunit.client.0.smithi003.stderr: -202> 2023-12-03T11:49:09.435+0000 7f81245ab800 10 monclient(hunting): authenticate will time out at 1771.674107s 2023-12-03T11:49:09.507 INFO:tasks.workunit.client.0.smithi003.stderr: -201> 2023-12-03T11:49:09.435+0000 7f81228ac640 10 monclient(hunting): get_auth_request con 0x5632d4bf8540 auth_method 0 2023-12-03T11:49:09.507 INFO:tasks.workunit.client.0.smithi003.stderr: -200> 2023-12-03T11:49:09.435+0000 7f81228ac640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:49:09.507 INFO:tasks.workunit.client.0.smithi003.stderr: -199> 2023-12-03T11:49:09.435+0000 7f81228ac640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:49:09.507 INFO:tasks.workunit.client.0.smithi003.stderr: -198> 2023-12-03T11:49:09.435+0000 7f81228ac640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:49:09.507 INFO:tasks.workunit.client.0.smithi003.stderr: -197> 2023-12-03T11:49:09.435+0000 7f81218aa640 10 monclient(hunting): get_auth_request con 0x5632d4bfcbd0 auth_method 0 2023-12-03T11:49:09.507 INFO:tasks.workunit.client.0.smithi003.stderr: -196> 2023-12-03T11:49:09.435+0000 7f81218aa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:49:09.507 INFO:tasks.workunit.client.0.smithi003.stderr: -195> 2023-12-03T11:49:09.435+0000 7f81218aa640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:49:09.508 INFO:tasks.workunit.client.0.smithi003.stderr: -194> 2023-12-03T11:49:09.435+0000 7f81218aa640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:49:09.508 INFO:tasks.workunit.client.0.smithi003.stderr: -193> 2023-12-03T11:49:09.436+0000 7f81228ac640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:49:09.508 INFO:tasks.workunit.client.0.smithi003.stderr: -192> 2023-12-03T11:49:09.436+0000 7f81228ac640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:49:09.508 INFO:tasks.workunit.client.0.smithi003.stderr: -191> 2023-12-03T11:49:09.436+0000 7f81228ac640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:49:09.508 INFO:tasks.workunit.client.0.smithi003.stderr: -190> 2023-12-03T11:49:09.436+0000 7f81218aa640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:49:09.508 INFO:tasks.workunit.client.0.smithi003.stderr: -189> 2023-12-03T11:49:09.436+0000 7f81218aa640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:49:09.508 INFO:tasks.workunit.client.0.smithi003.stderr: -188> 2023-12-03T11:49:09.436+0000 7f81218aa640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:49:09.508 INFO:tasks.workunit.client.0.smithi003.stderr: -187> 2023-12-03T11:49:09.436+0000 7f81218aa640 10 monclient(hunting): handle_auth_done global_id 7086 payload 274 2023-12-03T11:49:09.508 INFO:tasks.workunit.client.0.smithi003.stderr: -186> 2023-12-03T11:49:09.436+0000 7f81218aa640 10 monclient: _finish_hunting 0 2023-12-03T11:49:09.508 INFO:tasks.workunit.client.0.smithi003.stderr: -185> 2023-12-03T11:49:09.436+0000 7f81218aa640 1 monclient: found mon.noname-a 2023-12-03T11:49:09.508 INFO:tasks.workunit.client.0.smithi003.stderr: -184> 2023-12-03T11:49:09.436+0000 7f81218aa640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.3:3300/0 2023-12-03T11:49:09.508 INFO:tasks.workunit.client.0.smithi003.stderr: -183> 2023-12-03T11:49:09.436+0000 7f80e77e6640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:49:09.508 INFO:tasks.workunit.client.0.smithi003.stderr: -182> 2023-12-03T11:49:09.436+0000 7f80e77e6640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-12-03T11:49:09.508 INFO:tasks.workunit.client.0.smithi003.stderr: -181> 2023-12-03T11:49:09.436+0000 7f80e77e6640 10 monclient: dump: 2023-12-03T11:49:09.509 INFO:tasks.workunit.client.0.smithi003.stderr:epoch 1 2023-12-03T11:49:09.509 INFO:tasks.workunit.client.0.smithi003.stderr:fsid 296556de-a4fc-4095-9b6d-0fe813c2865c 2023-12-03T11:49:09.509 INFO:tasks.workunit.client.0.smithi003.stderr:last_changed 2023-12-03T11:33:18.862564+0000 2023-12-03T11:49:09.509 INFO:tasks.workunit.client.0.smithi003.stderr:created 2023-12-03T11:33:18.862564+0000 2023-12-03T11:49:09.509 INFO:tasks.workunit.client.0.smithi003.stderr:min_mon_release 18 (reef) 2023-12-03T11:49:09.509 INFO:tasks.workunit.client.0.smithi003.stderr:election_strategy: 1 2023-12-03T11:49:09.509 INFO:tasks.workunit.client.0.smithi003.stderr:0: [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] mon.a 2023-12-03T11:49:09.509 INFO:tasks.workunit.client.0.smithi003.stderr:1: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.b 2023-12-03T11:49:09.509 INFO:tasks.workunit.client.0.smithi003.stderr:2: [v2:172.21.15.3:3301/0,v1:172.21.15.3:6790/0] mon.c 2023-12-03T11:49:09.509 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:49:09.509 INFO:tasks.workunit.client.0.smithi003.stderr: -180> 2023-12-03T11:49:09.436+0000 7f80e77e6640 10 monclient: _finish_auth 0 2023-12-03T11:49:09.509 INFO:tasks.workunit.client.0.smithi003.stderr: -179> 2023-12-03T11:49:09.436+0000 7f80e77e6640 10 monclient: _check_auth_tickets 2023-12-03T11:49:09.509 INFO:tasks.workunit.client.0.smithi003.stderr: -178> 2023-12-03T11:49:09.436+0000 7f80e77e6640 10 monclient: handle_config config(0 keys) v1 2023-12-03T11:49:09.509 INFO:tasks.workunit.client.0.smithi003.stderr: -177> 2023-12-03T11:49:09.436+0000 7f80e77e6640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:49:09.510 INFO:tasks.workunit.client.0.smithi003.stderr: -176> 2023-12-03T11:49:09.436+0000 7f80e77e6640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-12-03T11:49:09.510 INFO:tasks.workunit.client.0.smithi003.stderr: -175> 2023-12-03T11:49:09.436+0000 7f80e77e6640 10 monclient: dump: 2023-12-03T11:49:09.510 INFO:tasks.workunit.client.0.smithi003.stderr:epoch 1 2023-12-03T11:49:09.510 INFO:tasks.workunit.client.0.smithi003.stderr:fsid 296556de-a4fc-4095-9b6d-0fe813c2865c 2023-12-03T11:49:09.510 INFO:tasks.workunit.client.0.smithi003.stderr:last_changed 2023-12-03T11:33:18.862564+0000 2023-12-03T11:49:09.510 INFO:tasks.workunit.client.0.smithi003.stderr:created 2023-12-03T11:33:18.862564+0000 2023-12-03T11:49:09.510 INFO:tasks.workunit.client.0.smithi003.stderr:min_mon_release 18 (reef) 2023-12-03T11:49:09.510 INFO:tasks.workunit.client.0.smithi003.stderr:election_strategy: 1 2023-12-03T11:49:09.510 INFO:tasks.workunit.client.0.smithi003.stderr:0: [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] mon.a 2023-12-03T11:49:09.510 INFO:tasks.workunit.client.0.smithi003.stderr:1: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.b 2023-12-03T11:49:09.510 INFO:tasks.workunit.client.0.smithi003.stderr:2: [v2:172.21.15.3:3301/0,v1:172.21.15.3:6790/0] mon.c 2023-12-03T11:49:09.510 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:49:09.510 INFO:tasks.workunit.client.0.smithi003.stderr: -174> 2023-12-03T11:49:09.436+0000 7f81245ab800 5 monclient: authenticate success, global_id 7086 2023-12-03T11:49:09.511 INFO:tasks.workunit.client.0.smithi003.stderr: -173> 2023-12-03T11:49:09.436+0000 7f81245ab800 10 monclient: get_monmap_and_config success 2023-12-03T11:49:09.511 INFO:tasks.workunit.client.0.smithi003.stderr: -172> 2023-12-03T11:49:09.436+0000 7f81245ab800 4 set_mon_vals no callback set 2023-12-03T11:49:09.511 INFO:tasks.workunit.client.0.smithi003.stderr: -171> 2023-12-03T11:49:09.437+0000 7f81245ab800 10 monclient: shutdown 2023-12-03T11:49:09.511 INFO:tasks.workunit.client.0.smithi003.stderr: -170> 2023-12-03T11:49:09.437+0000 7f81245ab800 10 monclient: build_initial_monmap 2023-12-03T11:49:09.511 INFO:tasks.workunit.client.0.smithi003.stderr: -169> 2023-12-03T11:49:09.437+0000 7f81245ab800 1 build_initial for_mkfs: 0 2023-12-03T11:49:09.511 INFO:tasks.workunit.client.0.smithi003.stderr: -168> 2023-12-03T11:49:09.437+0000 7f81245ab800 10 monclient: monmap: 2023-12-03T11:49:09.511 INFO:tasks.workunit.client.0.smithi003.stderr:epoch 0 2023-12-03T11:49:09.511 INFO:tasks.workunit.client.0.smithi003.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-12-03T11:49:09.511 INFO:tasks.workunit.client.0.smithi003.stderr:last_changed 0.000000 2023-12-03T11:49:09.511 INFO:tasks.workunit.client.0.smithi003.stderr:created 0.000000 2023-12-03T11:49:09.511 INFO:tasks.workunit.client.0.smithi003.stderr:min_mon_release 0 (unknown) 2023-12-03T11:49:09.511 INFO:tasks.workunit.client.0.smithi003.stderr:election_strategy: 1 2023-12-03T11:49:09.511 INFO:tasks.workunit.client.0.smithi003.stderr:0: [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] mon.noname-a 2023-12-03T11:49:09.512 INFO:tasks.workunit.client.0.smithi003.stderr:1: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.noname-b 2023-12-03T11:49:09.512 INFO:tasks.workunit.client.0.smithi003.stderr:2: [v2:172.21.15.3:3301/0,v1:172.21.15.3:6790/0] mon.noname-c 2023-12-03T11:49:09.512 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:49:09.512 INFO:tasks.workunit.client.0.smithi003.stderr: -167> 2023-12-03T11:49:09.437+0000 7f81245ab800 5 AuthRegistry(0x5632d4c03c90) adding auth protocol: cephx 2023-12-03T11:49:09.512 INFO:tasks.workunit.client.0.smithi003.stderr: -166> 2023-12-03T11:49:09.437+0000 7f81245ab800 5 AuthRegistry(0x5632d4c03c90) adding auth protocol: cephx 2023-12-03T11:49:09.512 INFO:tasks.workunit.client.0.smithi003.stderr: -165> 2023-12-03T11:49:09.437+0000 7f81245ab800 5 AuthRegistry(0x5632d4c03c90) adding auth protocol: cephx 2023-12-03T11:49:09.512 INFO:tasks.workunit.client.0.smithi003.stderr: -164> 2023-12-03T11:49:09.437+0000 7f81245ab800 5 AuthRegistry(0x5632d4c03c90) adding con mode: secure 2023-12-03T11:49:09.512 INFO:tasks.workunit.client.0.smithi003.stderr: -163> 2023-12-03T11:49:09.437+0000 7f81245ab800 5 AuthRegistry(0x5632d4c03c90) adding con mode: crc 2023-12-03T11:49:09.512 INFO:tasks.workunit.client.0.smithi003.stderr: -162> 2023-12-03T11:49:09.437+0000 7f81245ab800 5 AuthRegistry(0x5632d4c03c90) adding con mode: secure 2023-12-03T11:49:09.512 INFO:tasks.workunit.client.0.smithi003.stderr: -161> 2023-12-03T11:49:09.437+0000 7f81245ab800 5 AuthRegistry(0x5632d4c03c90) adding con mode: crc 2023-12-03T11:49:09.512 INFO:tasks.workunit.client.0.smithi003.stderr: -160> 2023-12-03T11:49:09.437+0000 7f81245ab800 5 AuthRegistry(0x5632d4c03c90) adding con mode: secure 2023-12-03T11:49:09.512 INFO:tasks.workunit.client.0.smithi003.stderr: -159> 2023-12-03T11:49:09.437+0000 7f81245ab800 5 AuthRegistry(0x5632d4c03c90) adding con mode: crc 2023-12-03T11:49:09.512 INFO:tasks.workunit.client.0.smithi003.stderr: -158> 2023-12-03T11:49:09.437+0000 7f81245ab800 5 AuthRegistry(0x5632d4c03c90) adding con mode: crc 2023-12-03T11:49:09.512 INFO:tasks.workunit.client.0.smithi003.stderr: -157> 2023-12-03T11:49:09.437+0000 7f81245ab800 5 AuthRegistry(0x5632d4c03c90) adding con mode: secure 2023-12-03T11:49:09.513 INFO:tasks.workunit.client.0.smithi003.stderr: -156> 2023-12-03T11:49:09.437+0000 7f81245ab800 5 AuthRegistry(0x5632d4c03c90) adding con mode: crc 2023-12-03T11:49:09.513 INFO:tasks.workunit.client.0.smithi003.stderr: -155> 2023-12-03T11:49:09.437+0000 7f81245ab800 5 AuthRegistry(0x5632d4c03c90) adding con mode: secure 2023-12-03T11:49:09.513 INFO:tasks.workunit.client.0.smithi003.stderr: -154> 2023-12-03T11:49:09.437+0000 7f81245ab800 5 AuthRegistry(0x5632d4c03c90) adding con mode: crc 2023-12-03T11:49:09.513 INFO:tasks.workunit.client.0.smithi003.stderr: -153> 2023-12-03T11:49:09.437+0000 7f81245ab800 5 AuthRegistry(0x5632d4c03c90) adding con mode: secure 2023-12-03T11:49:09.513 INFO:tasks.workunit.client.0.smithi003.stderr: -152> 2023-12-03T11:49:09.437+0000 7f81245ab800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:49:09.513 INFO:tasks.workunit.client.0.smithi003.stderr: -151> 2023-12-03T11:49:09.437+0000 7f81245ab800 1 librados: starting msgr at 2023-12-03T11:49:09.513 INFO:tasks.workunit.client.0.smithi003.stderr: -150> 2023-12-03T11:49:09.437+0000 7f81245ab800 1 librados: starting objecter 2023-12-03T11:49:09.513 INFO:tasks.workunit.client.0.smithi003.stderr: -149> 2023-12-03T11:49:09.437+0000 7f81245ab800 5 asok(0x5632d495ea10) register_command objecter_requests cmddesc objecter_requests hook 0x5632d4bf8ac0 EEXIST 2023-12-03T11:49:09.513 INFO:tasks.workunit.client.0.smithi003.stderr: -148> 2023-12-03T11:49:09.437+0000 7f81245ab800 1 librados: setting wanted keys 2023-12-03T11:49:09.513 INFO:tasks.workunit.client.0.smithi003.stderr: -147> 2023-12-03T11:49:09.437+0000 7f81245ab800 1 librados: calling monclient init 2023-12-03T11:49:09.513 INFO:tasks.workunit.client.0.smithi003.stderr: -146> 2023-12-03T11:49:09.437+0000 7f81245ab800 10 monclient: init 2023-12-03T11:49:09.513 INFO:tasks.workunit.client.0.smithi003.stderr: -145> 2023-12-03T11:49:09.437+0000 7f81245ab800 5 AuthRegistry(0x5632d4bfd318) adding auth protocol: cephx 2023-12-03T11:49:09.513 INFO:tasks.workunit.client.0.smithi003.stderr: -144> 2023-12-03T11:49:09.437+0000 7f81245ab800 5 AuthRegistry(0x5632d4bfd318) adding auth protocol: cephx 2023-12-03T11:49:09.514 INFO:tasks.workunit.client.0.smithi003.stderr: -143> 2023-12-03T11:49:09.437+0000 7f81245ab800 5 AuthRegistry(0x5632d4bfd318) adding auth protocol: cephx 2023-12-03T11:49:09.514 INFO:tasks.workunit.client.0.smithi003.stderr: -142> 2023-12-03T11:49:09.437+0000 7f81245ab800 5 AuthRegistry(0x5632d4bfd318) adding con mode: secure 2023-12-03T11:49:09.514 INFO:tasks.workunit.client.0.smithi003.stderr: -141> 2023-12-03T11:49:09.437+0000 7f81245ab800 5 AuthRegistry(0x5632d4bfd318) adding con mode: crc 2023-12-03T11:49:09.514 INFO:tasks.workunit.client.0.smithi003.stderr: -140> 2023-12-03T11:49:09.437+0000 7f81245ab800 5 AuthRegistry(0x5632d4bfd318) adding con mode: secure 2023-12-03T11:49:09.514 INFO:tasks.workunit.client.0.smithi003.stderr: -139> 2023-12-03T11:49:09.437+0000 7f81245ab800 5 AuthRegistry(0x5632d4bfd318) adding con mode: crc 2023-12-03T11:49:09.514 INFO:tasks.workunit.client.0.smithi003.stderr: -138> 2023-12-03T11:49:09.437+0000 7f81245ab800 5 AuthRegistry(0x5632d4bfd318) adding con mode: secure 2023-12-03T11:49:09.514 INFO:tasks.workunit.client.0.smithi003.stderr: -137> 2023-12-03T11:49:09.437+0000 7f81245ab800 5 AuthRegistry(0x5632d4bfd318) adding con mode: crc 2023-12-03T11:49:09.514 INFO:tasks.workunit.client.0.smithi003.stderr: -136> 2023-12-03T11:49:09.437+0000 7f81245ab800 5 AuthRegistry(0x5632d4bfd318) adding con mode: crc 2023-12-03T11:49:09.514 INFO:tasks.workunit.client.0.smithi003.stderr: -135> 2023-12-03T11:49:09.437+0000 7f81245ab800 5 AuthRegistry(0x5632d4bfd318) adding con mode: secure 2023-12-03T11:49:09.514 INFO:tasks.workunit.client.0.smithi003.stderr: -134> 2023-12-03T11:49:09.437+0000 7f81245ab800 5 AuthRegistry(0x5632d4bfd318) adding con mode: crc 2023-12-03T11:49:09.514 INFO:tasks.workunit.client.0.smithi003.stderr: -133> 2023-12-03T11:49:09.437+0000 7f81245ab800 5 AuthRegistry(0x5632d4bfd318) adding con mode: secure 2023-12-03T11:49:09.514 INFO:tasks.workunit.client.0.smithi003.stderr: -132> 2023-12-03T11:49:09.437+0000 7f81245ab800 5 AuthRegistry(0x5632d4bfd318) adding con mode: crc 2023-12-03T11:49:09.514 INFO:tasks.workunit.client.0.smithi003.stderr: -131> 2023-12-03T11:49:09.437+0000 7f81245ab800 5 AuthRegistry(0x5632d4bfd318) adding con mode: secure 2023-12-03T11:49:09.515 INFO:tasks.workunit.client.0.smithi003.stderr: -130> 2023-12-03T11:49:09.438+0000 7f81245ab800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:49:09.515 INFO:tasks.workunit.client.0.smithi003.stderr: -129> 2023-12-03T11:49:09.438+0000 7f81245ab800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:49:09.515 INFO:tasks.workunit.client.0.smithi003.stderr: -128> 2023-12-03T11:49:09.438+0000 7f81245ab800 5 asok(0x5632d495ea10) register_command rotate-key cmddesc rotate-key hook 0x5632d4bfd460 EEXIST 2023-12-03T11:49:09.515 INFO:tasks.workunit.client.0.smithi003.stderr: -127> 2023-12-03T11:49:09.438+0000 7f81245ab800 10 monclient: _reopen_session rank -1 2023-12-03T11:49:09.515 INFO:tasks.workunit.client.0.smithi003.stderr: -126> 2023-12-03T11:49:09.438+0000 7f81245ab800 10 monclient: _add_conns ranks=[0,1,2] 2023-12-03T11:49:09.515 INFO:tasks.workunit.client.0.smithi003.stderr: -125> 2023-12-03T11:49:09.438+0000 7f81245ab800 10 monclient(hunting): picked mon.noname-a con 0x5632d4bf8540 addr [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] 2023-12-03T11:49:09.515 INFO:tasks.workunit.client.0.smithi003.stderr: -124> 2023-12-03T11:49:09.438+0000 7f81245ab800 10 monclient(hunting): picked mon.noname-b con 0x5632d4bf95b0 addr [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] 2023-12-03T11:49:09.515 INFO:tasks.workunit.client.0.smithi003.stderr: -123> 2023-12-03T11:49:09.438+0000 7f81245ab800 10 monclient(hunting): picked mon.noname-c con 0x5632d4bfcbd0 addr [v2:172.21.15.3:3301/0,v1:172.21.15.3:6790/0] 2023-12-03T11:49:09.515 INFO:tasks.workunit.client.0.smithi003.stderr: -122> 2023-12-03T11:49:09.438+0000 7f81245ab800 10 monclient(hunting): start opening mon connection 2023-12-03T11:49:09.515 INFO:tasks.workunit.client.0.smithi003.stderr: -121> 2023-12-03T11:49:09.438+0000 7f81245ab800 10 monclient(hunting): start opening mon connection 2023-12-03T11:49:09.515 INFO:tasks.workunit.client.0.smithi003.stderr: -120> 2023-12-03T11:49:09.438+0000 7f81245ab800 10 monclient(hunting): start opening mon connection 2023-12-03T11:49:09.515 INFO:tasks.workunit.client.0.smithi003.stderr: -119> 2023-12-03T11:49:09.438+0000 7f81245ab800 10 monclient(hunting): _renew_subs 2023-12-03T11:49:09.515 INFO:tasks.workunit.client.0.smithi003.stderr: -118> 2023-12-03T11:49:09.438+0000 7f81245ab800 10 monclient(hunting): authenticate will time out at 1771.676633s 2023-12-03T11:49:09.515 INFO:tasks.workunit.client.0.smithi003.stderr: -117> 2023-12-03T11:49:09.438+0000 7f81228ac640 10 monclient(hunting): get_auth_request con 0x5632d4bf8540 auth_method 0 2023-12-03T11:49:09.515 INFO:tasks.workunit.client.0.smithi003.stderr: -116> 2023-12-03T11:49:09.438+0000 7f81228ac640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:49:09.516 INFO:tasks.workunit.client.0.smithi003.stderr: -115> 2023-12-03T11:49:09.438+0000 7f81228ac640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:49:09.516 INFO:tasks.workunit.client.0.smithi003.stderr: -114> 2023-12-03T11:49:09.438+0000 7f81228ac640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:49:09.516 INFO:tasks.workunit.client.0.smithi003.stderr: -113> 2023-12-03T11:49:09.438+0000 7f81218aa640 10 monclient(hunting): get_auth_request con 0x5632d4bfcbd0 auth_method 0 2023-12-03T11:49:09.516 INFO:tasks.workunit.client.0.smithi003.stderr: -112> 2023-12-03T11:49:09.438+0000 7f81218aa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:49:09.516 INFO:tasks.workunit.client.0.smithi003.stderr: -111> 2023-12-03T11:49:09.438+0000 7f81218aa640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:49:09.516 INFO:tasks.workunit.client.0.smithi003.stderr: -110> 2023-12-03T11:49:09.438+0000 7f81218aa640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:49:09.516 INFO:tasks.workunit.client.0.smithi003.stderr: -109> 2023-12-03T11:49:09.438+0000 7f81228ac640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:49:09.516 INFO:tasks.workunit.client.0.smithi003.stderr: -108> 2023-12-03T11:49:09.438+0000 7f81228ac640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:49:09.516 INFO:tasks.workunit.client.0.smithi003.stderr: -107> 2023-12-03T11:49:09.438+0000 7f81228ac640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:49:09.516 INFO:tasks.workunit.client.0.smithi003.stderr: -106> 2023-12-03T11:49:09.438+0000 7f81218aa640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:49:09.516 INFO:tasks.workunit.client.0.smithi003.stderr: -105> 2023-12-03T11:49:09.438+0000 7f81218aa640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:49:09.516 INFO:tasks.workunit.client.0.smithi003.stderr: -104> 2023-12-03T11:49:09.438+0000 7f81218aa640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:49:09.516 INFO:tasks.workunit.client.0.smithi003.stderr: -103> 2023-12-03T11:49:09.438+0000 7f81220ab640 10 monclient(hunting): get_auth_request con 0x5632d4bf95b0 auth_method 0 2023-12-03T11:49:09.517 INFO:tasks.workunit.client.0.smithi003.stderr: -102> 2023-12-03T11:49:09.438+0000 7f81220ab640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:49:09.517 INFO:tasks.workunit.client.0.smithi003.stderr: -101> 2023-12-03T11:49:09.438+0000 7f81220ab640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:49:09.517 INFO:tasks.workunit.client.0.smithi003.stderr: -100> 2023-12-03T11:49:09.438+0000 7f81220ab640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:49:09.517 INFO:tasks.workunit.client.0.smithi003.stderr: -99> 2023-12-03T11:49:09.438+0000 7f81220ab640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:49:09.517 INFO:tasks.workunit.client.0.smithi003.stderr: -98> 2023-12-03T11:49:09.438+0000 7f81220ab640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:49:09.517 INFO:tasks.workunit.client.0.smithi003.stderr: -97> 2023-12-03T11:49:09.438+0000 7f81220ab640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:49:09.517 INFO:tasks.workunit.client.0.smithi003.stderr: -96> 2023-12-03T11:49:09.438+0000 7f81228ac640 10 monclient(hunting): handle_auth_done global_id 7089 payload 824 2023-12-03T11:49:09.517 INFO:tasks.workunit.client.0.smithi003.stderr: -95> 2023-12-03T11:49:09.438+0000 7f81228ac640 10 monclient: _finish_hunting 0 2023-12-03T11:49:09.517 INFO:tasks.workunit.client.0.smithi003.stderr: -94> 2023-12-03T11:49:09.438+0000 7f81228ac640 1 monclient: found mon.noname-a 2023-12-03T11:49:09.517 INFO:tasks.workunit.client.0.smithi003.stderr: -93> 2023-12-03T11:49:09.438+0000 7f81228ac640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.3:3300/0 2023-12-03T11:49:09.517 INFO:tasks.workunit.client.0.smithi003.stderr: -92> 2023-12-03T11:49:09.438+0000 7f80e5fe3640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:49:09.517 INFO:tasks.workunit.client.0.smithi003.stderr: -91> 2023-12-03T11:49:09.438+0000 7f80e5fe3640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-12-03T11:49:09.518 INFO:tasks.workunit.client.0.smithi003.stderr: -90> 2023-12-03T11:49:09.438+0000 7f80e5fe3640 10 monclient: dump: 2023-12-03T11:49:09.518 INFO:tasks.workunit.client.0.smithi003.stderr:epoch 1 2023-12-03T11:49:09.518 INFO:tasks.workunit.client.0.smithi003.stderr:fsid 296556de-a4fc-4095-9b6d-0fe813c2865c 2023-12-03T11:49:09.518 INFO:tasks.workunit.client.0.smithi003.stderr:last_changed 2023-12-03T11:33:18.862564+0000 2023-12-03T11:49:09.518 INFO:tasks.workunit.client.0.smithi003.stderr:created 2023-12-03T11:33:18.862564+0000 2023-12-03T11:49:09.518 INFO:tasks.workunit.client.0.smithi003.stderr:min_mon_release 18 (reef) 2023-12-03T11:49:09.518 INFO:tasks.workunit.client.0.smithi003.stderr:election_strategy: 1 2023-12-03T11:49:09.518 INFO:tasks.workunit.client.0.smithi003.stderr:0: [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] mon.a 2023-12-03T11:49:09.518 INFO:tasks.workunit.client.0.smithi003.stderr:1: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.b 2023-12-03T11:49:09.518 INFO:tasks.workunit.client.0.smithi003.stderr:2: [v2:172.21.15.3:3301/0,v1:172.21.15.3:6790/0] mon.c 2023-12-03T11:49:09.518 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:49:09.518 INFO:tasks.workunit.client.0.smithi003.stderr: -89> 2023-12-03T11:49:09.438+0000 7f80e5fe3640 10 monclient: _finish_auth 0 2023-12-03T11:49:09.518 INFO:tasks.workunit.client.0.smithi003.stderr: -88> 2023-12-03T11:49:09.438+0000 7f80e5fe3640 10 monclient: _check_auth_tickets 2023-12-03T11:49:09.518 INFO:tasks.workunit.client.0.smithi003.stderr: -87> 2023-12-03T11:49:09.438+0000 7f80e5fe3640 10 monclient: handle_config config(0 keys) v1 2023-12-03T11:49:09.519 INFO:tasks.workunit.client.0.smithi003.stderr: -86> 2023-12-03T11:49:09.438+0000 7f80e5fe3640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:49:09.519 INFO:tasks.workunit.client.0.smithi003.stderr: -85> 2023-12-03T11:49:09.438+0000 7f80e5fe3640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-12-03T11:49:09.519 INFO:tasks.workunit.client.0.smithi003.stderr: -84> 2023-12-03T11:49:09.438+0000 7f80e5fe3640 10 monclient: dump: 2023-12-03T11:49:09.519 INFO:tasks.workunit.client.0.smithi003.stderr:epoch 1 2023-12-03T11:49:09.519 INFO:tasks.workunit.client.0.smithi003.stderr:fsid 296556de-a4fc-4095-9b6d-0fe813c2865c 2023-12-03T11:49:09.519 INFO:tasks.workunit.client.0.smithi003.stderr:last_changed 2023-12-03T11:33:18.862564+0000 2023-12-03T11:49:09.519 INFO:tasks.workunit.client.0.smithi003.stderr:created 2023-12-03T11:33:18.862564+0000 2023-12-03T11:49:09.519 INFO:tasks.workunit.client.0.smithi003.stderr:min_mon_release 18 (reef) 2023-12-03T11:49:09.519 INFO:tasks.workunit.client.0.smithi003.stderr:election_strategy: 1 2023-12-03T11:49:09.519 INFO:tasks.workunit.client.0.smithi003.stderr:0: [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] mon.a 2023-12-03T11:49:09.519 INFO:tasks.workunit.client.0.smithi003.stderr:1: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.b 2023-12-03T11:49:09.519 INFO:tasks.workunit.client.0.smithi003.stderr:2: [v2:172.21.15.3:3301/0,v1:172.21.15.3:6790/0] mon.c 2023-12-03T11:49:09.519 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:49:09.519 INFO:tasks.workunit.client.0.smithi003.stderr: -83> 2023-12-03T11:49:09.439+0000 7f81245ab800 5 monclient: authenticate success, global_id 7089 2023-12-03T11:49:09.519 INFO:tasks.workunit.client.0.smithi003.stderr: -82> 2023-12-03T11:49:09.438+0000 7f80e77e6640 4 set_mon_vals no callback set 2023-12-03T11:49:09.520 INFO:tasks.workunit.client.0.smithi003.stderr: -81> 2023-12-03T11:49:09.439+0000 7f81245ab800 10 monclient: _renew_subs 2023-12-03T11:49:09.520 INFO:tasks.workunit.client.0.smithi003.stderr: -80> 2023-12-03T11:49:09.439+0000 7f81245ab800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.3:3300/0 2023-12-03T11:49:09.520 INFO:tasks.workunit.client.0.smithi003.stderr: -79> 2023-12-03T11:49:09.439+0000 7f81245ab800 10 monclient: _renew_subs 2023-12-03T11:49:09.520 INFO:tasks.workunit.client.0.smithi003.stderr: -78> 2023-12-03T11:49:09.439+0000 7f81245ab800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.3:3300/0 2023-12-03T11:49:09.520 INFO:tasks.workunit.client.0.smithi003.stderr: -77> 2023-12-03T11:49:09.439+0000 7f81245ab800 1 librados: init done 2023-12-03T11:49:09.520 INFO:tasks.workunit.client.0.smithi003.stderr: -76> 2023-12-03T11:49:09.439+0000 7f81245ab800 5 asok(0x5632d495ea10) register_command cr dump hook 0x5632d4befd48 2023-12-03T11:49:09.520 INFO:tasks.workunit.client.0.smithi003.stderr: -75> 2023-12-03T11:49:09.440+0000 7f80e5fe3640 4 mgrc handle_mgr_map Got map version 5 2023-12-03T11:49:09.520 INFO:tasks.workunit.client.0.smithi003.stderr: -74> 2023-12-03T11:49:09.440+0000 7f80e5fe3640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.37:6832/2165065416,v1:172.21.15.37:6833/2165065416] 2023-12-03T11:49:09.520 INFO:tasks.workunit.client.0.smithi003.stderr: -73> 2023-12-03T11:49:09.440+0000 7f80e5fe3640 4 mgrc reconnect Starting new session with [v2:172.21.15.37:6832/2165065416,v1:172.21.15.37:6833/2165065416] 2023-12-03T11:49:09.520 INFO:tasks.workunit.client.0.smithi003.stderr: -72> 2023-12-03T11:49:09.440+0000 7f81245ab800 5 note: GC not initialized 2023-12-03T11:49:09.520 INFO:tasks.workunit.client.0.smithi003.stderr: -71> 2023-12-03T11:49:09.440+0000 7f81220ab640 10 monclient: get_auth_request con 0x7f805c069820 auth_method 0 2023-12-03T11:49:09.520 INFO:tasks.workunit.client.0.smithi003.stderr: -70> 2023-12-03T11:49:09.441+0000 7f8056ffd640 20 reqs_thread_entry: start 2023-12-03T11:49:09.520 INFO:tasks.workunit.client.0.smithi003.stderr: -69> 2023-12-03T11:49:09.441+0000 7f81245ab800 5 asok(0x5632d495ea10) register_command sync trace show hook 0x7f81140043a0 2023-12-03T11:49:09.520 INFO:tasks.workunit.client.0.smithi003.stderr: -68> 2023-12-03T11:49:09.441+0000 7f81245ab800 5 asok(0x5632d495ea10) register_command sync trace history hook 0x7f81140043a0 2023-12-03T11:49:09.521 INFO:tasks.workunit.client.0.smithi003.stderr: -67> 2023-12-03T11:49:09.441+0000 7f81245ab800 5 asok(0x5632d495ea10) register_command sync trace active hook 0x7f81140043a0 2023-12-03T11:49:09.521 INFO:tasks.workunit.client.0.smithi003.stderr: -66> 2023-12-03T11:49:09.441+0000 7f81245ab800 5 asok(0x5632d495ea10) register_command sync trace active_short hook 0x7f81140043a0 2023-12-03T11:49:09.521 INFO:tasks.workunit.client.0.smithi003.stderr: -65> 2023-12-03T11:49:09.441+0000 7f81245ab800 20 init_complete bucket index max shards: 11 2023-12-03T11:49:09.521 INFO:tasks.workunit.client.0.smithi003.stderr: -64> 2023-12-03T11:49:09.441+0000 7f81245ab800 20 Filter name: none 2023-12-03T11:49:09.521 INFO:tasks.workunit.client.0.smithi003.stderr: -63> 2023-12-03T11:49:09.441+0000 7f8054ff9640 20 reqs_thread_entry: start 2023-12-03T11:49:09.521 INFO:tasks.workunit.client.0.smithi003.stderr: -62> 2023-12-03T11:49:09.441+0000 7f81245ab800 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2023-12-03T11:49:09.521 INFO:tasks.workunit.client.0.smithi003.stderr: -61> 2023-12-03T11:49:09.441+0000 7f81245ab800 20 rados->read ofs=0 len=0 2023-12-03T11:49:09.521 INFO:tasks.workunit.client.0.smithi003.stderr: -60> 2023-12-03T11:49:09.441+0000 7f81245ab800 20 rados_obj.operate() r=0 bl.length=221 2023-12-03T11:49:09.521 INFO:tasks.workunit.client.0.smithi003.stderr: -59> 2023-12-03T11:49:09.441+0000 7f81245ab800 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2023-12-03T11:49:09.521 INFO:tasks.workunit.client.0.smithi003.stderr: -58> 2023-12-03T11:49:09.441+0000 7f81245ab800 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2023-12-03T11:49:09.521 INFO:tasks.workunit.client.0.smithi003.stderr: -57> 2023-12-03T11:49:09.441+0000 7f81245ab800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26 : miss 2023-12-03T11:49:09.521 INFO:tasks.workunit.client.0.smithi003.stderr: -56> 2023-12-03T11:49:09.441+0000 7f81245ab800 20 rados->read ofs=0 len=0 2023-12-03T11:49:09.521 INFO:tasks.workunit.client.0.smithi003.stderr: -55> 2023-12-03T11:49:09.442+0000 7f81245ab800 20 rados_obj.operate() r=0 bl.length=393 2023-12-03T11:49:09.522 INFO:tasks.workunit.client.0.smithi003.stderr: -54> 2023-12-03T11:49:09.442+0000 7f81245ab800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26 info.flags=0x17 2023-12-03T11:49:09.522 INFO:tasks.workunit.client.0.smithi003.stderr: -53> 2023-12-03T11:49:09.442+0000 7f81245ab800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26 to cache LRU end 2023-12-03T11:49:09.522 INFO:tasks.workunit.client.0.smithi003.stderr: -52> 2023-12-03T11:49:09.442+0000 7f81245ab800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:49:09.522 INFO:tasks.workunit.client.0.smithi003.stderr: -51> 2023-12-03T11:49:09.442+0000 7f81245ab800 10 updating xattr: name=user.rgw.acl bl.length()=265 2023-12-03T11:49:09.522 INFO:tasks.workunit.client.0.smithi003.stderr: -50> 2023-12-03T11:49:09.442+0000 7f81245ab800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26 2023-12-03T11:49:09.522 INFO:tasks.workunit.client.0.smithi003.stderr: -49> 2023-12-03T11:49:09.442+0000 7f81218aa640 10 monclient: get_auth_request con 0x5632d4c4ac10 auth_method 0 2023-12-03T11:49:09.522 INFO:tasks.workunit.client.0.smithi003.stderr: -48> 2023-12-03T11:49:09.447+0000 7f81245ab800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26 info.flags=0x17 2023-12-03T11:49:09.522 INFO:tasks.workunit.client.0.smithi003.stderr: -47> 2023-12-03T11:49:09.447+0000 7f81245ab800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26 to cache LRU end 2023-12-03T11:49:09.522 INFO:tasks.workunit.client.0.smithi003.stderr: -46> 2023-12-03T11:49:09.447+0000 7f81245ab800 10 updating xattr: name=user.rgw.acl bl.length()=265 2023-12-03T11:49:09.522 INFO:tasks.workunit.client.0.smithi003.stderr: -45> 2023-12-03T11:49:09.447+0000 7f81245ab800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26, ofs0, ns] 2023-12-03T11:49:09.522 INFO:tasks.workunit.client.0.smithi003.stderr: -44> 2023-12-03T11:49:09.448+0000 7f8110ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660573 cookie 94776317469120 notifier 6680 bl.length()=965 2023-12-03T11:49:09.522 INFO:tasks.workunit.client.0.smithi003.stderr: -43> 2023-12-03T11:49:09.448+0000 7f8110ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26 info.flags=0x17 2023-12-03T11:49:09.522 INFO:tasks.workunit.client.0.smithi003.stderr: -42> 2023-12-03T11:49:09.448+0000 7f8110ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26 to cache LRU end 2023-12-03T11:49:09.522 INFO:tasks.workunit.client.0.smithi003.stderr: -41> 2023-12-03T11:49:09.448+0000 7f8110ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2023-12-03T11:49:09.523 INFO:tasks.workunit.client.0.smithi003.stderr: -40> 2023-12-03T11:49:09.449+0000 7f81245ab800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26]): orig_sources= new_sources= 2023-12-03T11:49:09.523 INFO:tasks.workunit.client.0.smithi003.stderr: -39> 2023-12-03T11:49:09.449+0000 7f81245ab800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26]): potential sources added=[] removed=[] 2023-12-03T11:49:09.523 INFO:tasks.workunit.client.0.smithi003.stderr: -38> 2023-12-03T11:49:09.449+0000 7f81245ab800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26]): orig_dests= new_dests= 2023-12-03T11:49:09.523 INFO:tasks.workunit.client.0.smithi003.stderr: -37> 2023-12-03T11:49:09.449+0000 7f81245ab800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26]): potential dests added=[] removed=[] 2023-12-03T11:49:09.523 INFO:tasks.workunit.client.0.smithi003.stderr: -36> 2023-12-03T11:49:09.452+0000 7f81245ab800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26.1.0 2023-12-03T11:49:09.523 INFO:tasks.workunit.client.0.smithi003.stderr: -35> 2023-12-03T11:49:09.452+0000 7f81245ab800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26.1.0 2023-12-03T11:49:09.523 INFO:tasks.workunit.client.0.smithi003.stderr: -34> 2023-12-03T11:49:09.452+0000 7f81245ab800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26.1.1 2023-12-03T11:49:09.523 INFO:tasks.workunit.client.0.smithi003.stderr: -33> 2023-12-03T11:49:09.452+0000 7f81245ab800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26.1.1 2023-12-03T11:49:09.523 INFO:tasks.workunit.client.0.smithi003.stderr: -32> 2023-12-03T11:49:09.452+0000 7f81245ab800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26.1.2 2023-12-03T11:49:09.523 INFO:tasks.workunit.client.0.smithi003.stderr: -31> 2023-12-03T11:49:09.452+0000 7f81245ab800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26.1.2 2023-12-03T11:49:09.523 INFO:tasks.workunit.client.0.smithi003.stderr: -30> 2023-12-03T11:49:09.452+0000 7f81245ab800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26.1.3 2023-12-03T11:49:09.523 INFO:tasks.workunit.client.0.smithi003.stderr: -29> 2023-12-03T11:49:09.452+0000 7f81245ab800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26.1.3 2023-12-03T11:49:09.523 INFO:tasks.workunit.client.0.smithi003.stderr: -28> 2023-12-03T11:49:09.452+0000 7f81245ab800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26.1.4 2023-12-03T11:49:09.523 INFO:tasks.workunit.client.0.smithi003.stderr: -27> 2023-12-03T11:49:09.452+0000 7f81245ab800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26.1.4 2023-12-03T11:49:09.524 INFO:tasks.workunit.client.0.smithi003.stderr: -26> 2023-12-03T11:49:09.452+0000 7f81245ab800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26.1.5 2023-12-03T11:49:09.524 INFO:tasks.workunit.client.0.smithi003.stderr: -25> 2023-12-03T11:49:09.452+0000 7f81245ab800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26.1.5 2023-12-03T11:49:09.524 INFO:tasks.workunit.client.0.smithi003.stderr: -24> 2023-12-03T11:49:09.452+0000 7f81245ab800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26.1.6 2023-12-03T11:49:09.524 INFO:tasks.workunit.client.0.smithi003.stderr: -23> 2023-12-03T11:49:09.452+0000 7f81245ab800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26.1.6 2023-12-03T11:49:09.524 INFO:tasks.workunit.client.0.smithi003.stderr: -22> 2023-12-03T11:49:09.452+0000 7f81245ab800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26.1.7 2023-12-03T11:49:09.524 INFO:tasks.workunit.client.0.smithi003.stderr: -21> 2023-12-03T11:49:09.452+0000 7f81245ab800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26.1.7 2023-12-03T11:49:09.524 INFO:tasks.workunit.client.0.smithi003.stderr: -20> 2023-12-03T11:49:09.452+0000 7f81245ab800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26.1.8 2023-12-03T11:49:09.524 INFO:tasks.workunit.client.0.smithi003.stderr: -19> 2023-12-03T11:49:09.452+0000 7f81245ab800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26.1.8 2023-12-03T11:49:09.524 INFO:tasks.workunit.client.0.smithi003.stderr: -18> 2023-12-03T11:49:09.452+0000 7f81245ab800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26.1.9 2023-12-03T11:49:09.524 INFO:tasks.workunit.client.0.smithi003.stderr: -17> 2023-12-03T11:49:09.452+0000 7f81245ab800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26.1.9 2023-12-03T11:49:09.524 INFO:tasks.workunit.client.0.smithi003.stderr: -16> 2023-12-03T11:49:09.452+0000 7f81245ab800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26.1.10 2023-12-03T11:49:09.524 INFO:tasks.workunit.client.0.smithi003.stderr: -15> 2023-12-03T11:49:09.452+0000 7f81245ab800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26.1.10 2023-12-03T11:49:09.524 INFO:tasks.workunit.client.0.smithi003.stderr: -14> 2023-12-03T11:49:09.452+0000 7f81245ab800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26.1.11 2023-12-03T11:49:09.524 INFO:tasks.workunit.client.0.smithi003.stderr: -13> 2023-12-03T11:49:09.452+0000 7f81245ab800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26.1.11 2023-12-03T11:49:09.524 INFO:tasks.workunit.client.0.smithi003.stderr: -12> 2023-12-03T11:49:09.452+0000 7f81245ab800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26.0 2023-12-03T11:49:09.525 INFO:tasks.workunit.client.0.smithi003.stderr: -11> 2023-12-03T11:49:09.452+0000 7f81245ab800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26.1 2023-12-03T11:49:09.525 INFO:tasks.workunit.client.0.smithi003.stderr: -10> 2023-12-03T11:49:09.453+0000 7f81245ab800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26.2 2023-12-03T11:49:09.525 INFO:tasks.workunit.client.0.smithi003.stderr: -9> 2023-12-03T11:49:09.453+0000 7f81245ab800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26.3 2023-12-03T11:49:09.525 INFO:tasks.workunit.client.0.smithi003.stderr: -8> 2023-12-03T11:49:09.454+0000 7f81245ab800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26.4 2023-12-03T11:49:09.525 INFO:tasks.workunit.client.0.smithi003.stderr: -7> 2023-12-03T11:49:09.454+0000 7f81245ab800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26.5 2023-12-03T11:49:09.525 INFO:tasks.workunit.client.0.smithi003.stderr: -6> 2023-12-03T11:49:09.455+0000 7f81245ab800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26.6 2023-12-03T11:49:09.525 INFO:tasks.workunit.client.0.smithi003.stderr: -5> 2023-12-03T11:49:09.455+0000 7f81245ab800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26.7 2023-12-03T11:49:09.525 INFO:tasks.workunit.client.0.smithi003.stderr: -4> 2023-12-03T11:49:09.456+0000 7f81245ab800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26.8 2023-12-03T11:49:09.525 INFO:tasks.workunit.client.0.smithi003.stderr: -3> 2023-12-03T11:49:09.456+0000 7f81245ab800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26.9 2023-12-03T11:49:09.525 INFO:tasks.workunit.client.0.smithi003.stderr: -2> 2023-12-03T11:49:09.457+0000 7f81245ab800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26.10 2023-12-03T11:49:09.525 INFO:tasks.workunit.client.0.smithi003.stderr: -1> 2023-12-03T11:49:09.460+0000 7f81245ab800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7537-gbcbf278c/rpm/el9/BUILD/ceph-18.0.0-7537-gbcbf278c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f81245ab800 time 2023-12-03T11:49:09.460738+0000 2023-12-03T11:49:09.525 INFO:tasks.workunit.client.0.smithi003.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7537-gbcbf278c/rpm/el9/BUILD/ceph-18.0.0-7537-gbcbf278c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2023-12-03T11:49:09.526 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:49:09.526 INFO:tasks.workunit.client.0.smithi003.stderr: ceph version 18.0.0-7537-gbcbf278c (bcbf278cf395873c2a482f5a7b2345faf2160319) reef (dev) 2023-12-03T11:49:09.526 INFO:tasks.workunit.client.0.smithi003.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f8128f6eef8] 2023-12-03T11:49:09.526 INFO:tasks.workunit.client.0.smithi003.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f0b6) [0x7f8128f6f0b6] 2023-12-03T11:49:09.526 INFO:tasks.workunit.client.0.smithi003.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5632d4144a71] 2023-12-03T11:49:09.526 INFO:tasks.workunit.client.0.smithi003.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x5b8) [0x5632d41511d8] 2023-12-03T11:49:09.526 INFO:tasks.workunit.client.0.smithi003.stderr: 5: main() 2023-12-03T11:49:09.526 INFO:tasks.workunit.client.0.smithi003.stderr: 6: /lib64/libc.so.6(+0x3feb0) [0x7f812683feb0] 2023-12-03T11:49:09.526 INFO:tasks.workunit.client.0.smithi003.stderr: 7: __libc_start_main() 2023-12-03T11:49:09.526 INFO:tasks.workunit.client.0.smithi003.stderr: 8: _start() 2023-12-03T11:49:09.526 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:49:09.526 INFO:tasks.workunit.client.0.smithi003.stderr: 0> 2023-12-03T11:49:09.461+0000 7f81245ab800 -1 *** Caught signal (Aborted) ** 2023-12-03T11:49:09.526 INFO:tasks.workunit.client.0.smithi003.stderr: in thread 7f81245ab800 thread_name:radosgw-admin 2023-12-03T11:49:09.527 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:49:09.527 INFO:tasks.workunit.client.0.smithi003.stderr: ceph version 18.0.0-7537-gbcbf278c (bcbf278cf395873c2a482f5a7b2345faf2160319) reef (dev) 2023-12-03T11:49:09.527 INFO:tasks.workunit.client.0.smithi003.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f8126854db0] 2023-12-03T11:49:09.527 INFO:tasks.workunit.client.0.smithi003.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f81268a154c] 2023-12-03T11:49:09.527 INFO:tasks.workunit.client.0.smithi003.stderr: 3: raise() 2023-12-03T11:49:09.527 INFO:tasks.workunit.client.0.smithi003.stderr: 4: abort() 2023-12-03T11:49:09.527 INFO:tasks.workunit.client.0.smithi003.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f8128f6ef52] 2023-12-03T11:49:09.527 INFO:tasks.workunit.client.0.smithi003.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f0b6) [0x7f8128f6f0b6] 2023-12-03T11:49:09.527 INFO:tasks.workunit.client.0.smithi003.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5632d4144a71] 2023-12-03T11:49:09.527 INFO:tasks.workunit.client.0.smithi003.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x5b8) [0x5632d41511d8] 2023-12-03T11:49:09.527 INFO:tasks.workunit.client.0.smithi003.stderr: 9: main() 2023-12-03T11:49:09.527 INFO:tasks.workunit.client.0.smithi003.stderr: 10: /lib64/libc.so.6(+0x3feb0) [0x7f812683feb0] 2023-12-03T11:49:09.527 INFO:tasks.workunit.client.0.smithi003.stderr: 11: __libc_start_main() 2023-12-03T11:49:09.528 INFO:tasks.workunit.client.0.smithi003.stderr: 12: _start() 2023-12-03T11:49:09.528 INFO:tasks.workunit.client.0.smithi003.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-12-03T11:49:09.528 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:49:09.528 INFO:tasks.workunit.client.0.smithi003.stderr:--- logging levels --- 2023-12-03T11:49:09.528 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 none 2023-12-03T11:49:09.528 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 1 lockdep 2023-12-03T11:49:09.528 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 1 context 2023-12-03T11:49:09.528 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 1 crush 2023-12-03T11:49:09.528 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 mds 2023-12-03T11:49:09.528 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 mds_balancer 2023-12-03T11:49:09.528 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 mds_locker 2023-12-03T11:49:09.528 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 mds_log 2023-12-03T11:49:09.528 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 mds_log_expire 2023-12-03T11:49:09.528 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 mds_migrator 2023-12-03T11:49:09.528 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 1 buffer 2023-12-03T11:49:09.529 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 1 timer 2023-12-03T11:49:09.529 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 1 filer 2023-12-03T11:49:09.529 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 1 striper 2023-12-03T11:49:09.529 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 1 objecter 2023-12-03T11:49:09.529 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 rados 2023-12-03T11:49:09.529 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 rbd 2023-12-03T11:49:09.529 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 rbd_mirror 2023-12-03T11:49:09.529 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 rbd_replay 2023-12-03T11:49:09.529 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 rbd_pwl 2023-12-03T11:49:09.529 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 journaler 2023-12-03T11:49:09.529 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 objectcacher 2023-12-03T11:49:09.529 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 immutable_obj_cache 2023-12-03T11:49:09.529 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 client 2023-12-03T11:49:09.529 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 osd 2023-12-03T11:49:09.529 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 optracker 2023-12-03T11:49:09.530 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 objclass 2023-12-03T11:49:09.530 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 3 filestore 2023-12-03T11:49:09.530 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 3 journal 2023-12-03T11:49:09.530 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 0 ms 2023-12-03T11:49:09.530 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 mon 2023-12-03T11:49:09.530 INFO:tasks.workunit.client.0.smithi003.stderr: 0/10 monc 2023-12-03T11:49:09.530 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 paxos 2023-12-03T11:49:09.530 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 tp 2023-12-03T11:49:09.530 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 auth 2023-12-03T11:49:09.530 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 crypto 2023-12-03T11:49:09.530 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 1 finisher 2023-12-03T11:49:09.530 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 1 reserver 2023-12-03T11:49:09.531 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 heartbeatmap 2023-12-03T11:49:09.531 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 perfcounter 2023-12-03T11:49:09.531 INFO:tasks.workunit.client.0.smithi003.stderr: 20/20 rgw 2023-12-03T11:49:09.531 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 rgw_sync 2023-12-03T11:49:09.531 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 rgw_datacache 2023-12-03T11:49:09.531 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 rgw_access 2023-12-03T11:49:09.531 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 rgw_dbstore 2023-12-03T11:49:09.531 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 rgw_flight 2023-12-03T11:49:09.531 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 javaclient 2023-12-03T11:49:09.531 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 asok 2023-12-03T11:49:09.531 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 1 throttle 2023-12-03T11:49:09.531 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 0 refs 2023-12-03T11:49:09.531 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 compressor 2023-12-03T11:49:09.532 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 bluestore 2023-12-03T11:49:09.532 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 bluefs 2023-12-03T11:49:09.532 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 3 bdev 2023-12-03T11:49:09.532 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 kstore 2023-12-03T11:49:09.532 INFO:tasks.workunit.client.0.smithi003.stderr: 4/ 5 rocksdb 2023-12-03T11:49:09.532 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 fuse 2023-12-03T11:49:09.532 INFO:tasks.workunit.client.0.smithi003.stderr: 2/ 5 mgr 2023-12-03T11:49:09.532 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 mgrc 2023-12-03T11:49:09.532 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 dpdk 2023-12-03T11:49:09.532 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 eventtrace 2023-12-03T11:49:09.532 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 prioritycache 2023-12-03T11:49:09.532 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 test 2023-12-03T11:49:09.532 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 cephfs_mirror 2023-12-03T11:49:09.532 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 cephsqlite 2023-12-03T11:49:09.532 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 crimson_interrupt 2023-12-03T11:49:09.533 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 seastore 2023-12-03T11:49:09.533 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 seastore_onode 2023-12-03T11:49:09.533 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 seastore_odata 2023-12-03T11:49:09.533 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 seastore_omap 2023-12-03T11:49:09.533 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 seastore_tm 2023-12-03T11:49:09.533 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 seastore_t 2023-12-03T11:49:09.533 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 seastore_cleaner 2023-12-03T11:49:09.533 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 seastore_epm 2023-12-03T11:49:09.533 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 seastore_lba 2023-12-03T11:49:09.533 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 seastore_fixedkv_tree 2023-12-03T11:49:09.533 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 seastore_cache 2023-12-03T11:49:09.533 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 seastore_journal 2023-12-03T11:49:09.533 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 seastore_device 2023-12-03T11:49:09.533 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 seastore_backref 2023-12-03T11:49:09.534 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 alienstore 2023-12-03T11:49:09.534 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 mclock 2023-12-03T11:49:09.534 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 cyanstore 2023-12-03T11:49:09.534 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 ceph_exporter 2023-12-03T11:49:09.534 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 memstore 2023-12-03T11:49:09.534 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 trace 2023-12-03T11:49:09.534 INFO:tasks.workunit.client.0.smithi003.stderr: -2/-2 (syslog threshold) 2023-12-03T11:49:09.534 INFO:tasks.workunit.client.0.smithi003.stderr: 99/99 (stderr threshold) 2023-12-03T11:49:09.534 INFO:tasks.workunit.client.0.smithi003.stderr:--- pthread ID / name mapping for recent threads --- 2023-12-03T11:49:09.534 INFO:tasks.workunit.client.0.smithi003.stderr: 7f8054ff9640 / http_manager 2023-12-03T11:49:09.534 INFO:tasks.workunit.client.0.smithi003.stderr: 7f8056ffd640 / http_manager 2023-12-03T11:49:09.534 INFO:tasks.workunit.client.0.smithi003.stderr: 7f80e5fe3640 / ms_dispatch 2023-12-03T11:49:09.534 INFO:tasks.workunit.client.0.smithi003.stderr: 7f80e77e6640 / io_context_pool 2023-12-03T11:49:09.534 INFO:tasks.workunit.client.0.smithi003.stderr: 7f80e7fe7640 / rgw_dt_lg_renew 2023-12-03T11:49:09.535 INFO:tasks.workunit.client.0.smithi003.stderr: 7f8102ffd640 / ms_dispatch 2023-12-03T11:49:09.535 INFO:tasks.workunit.client.0.smithi003.stderr: 7f8110ff9640 / io_context_pool 2023-12-03T11:49:09.535 INFO:tasks.workunit.client.0.smithi003.stderr: 7f81137fe640 / ms_dispatch 2023-12-03T11:49:09.535 INFO:tasks.workunit.client.0.smithi003.stderr: 7f81218aa640 / msgr-worker-2 2023-12-03T11:49:09.535 INFO:tasks.workunit.client.0.smithi003.stderr: 7f81220ab640 / msgr-worker-1 2023-12-03T11:49:09.535 INFO:tasks.workunit.client.0.smithi003.stderr: 7f81228ac640 / msgr-worker-0 2023-12-03T11:49:09.535 INFO:tasks.workunit.client.0.smithi003.stderr: 7f81245ab800 / radosgw-admin 2023-12-03T11:49:09.535 INFO:tasks.workunit.client.0.smithi003.stderr: max_recent 500 2023-12-03T11:49:09.535 INFO:tasks.workunit.client.0.smithi003.stderr: max_new 1000 2023-12-03T11:49:09.535 INFO:tasks.workunit.client.0.smithi003.stderr: log_file /var/log/ceph/ceph-client.admin.104190.log 2023-12-03T11:49:09.535 INFO:tasks.workunit.client.0.smithi003.stderr:--- end dump of recent events --- 2023-12-03T11:49:09.535 INFO:tasks.workunit.client.0.smithi003.stderr:--- begin dump of recent events --- 2023-12-03T11:49:09.535 INFO:tasks.workunit.client.0.smithi003.stderr: -499> 2023-12-03T11:49:09.400+0000 7f81245ab800 5 AuthRegistry(0x7ffe91b1fd30) adding auth protocol: cephx 2023-12-03T11:49:09.535 INFO:tasks.workunit.client.0.smithi003.stderr: -498> 2023-12-03T11:49:09.400+0000 7f81245ab800 5 AuthRegistry(0x7ffe91b1fd30) adding auth protocol: cephx 2023-12-03T11:49:09.535 INFO:tasks.workunit.client.0.smithi003.stderr: -497> 2023-12-03T11:49:09.400+0000 7f81245ab800 5 AuthRegistry(0x7ffe91b1fd30) adding con mode: secure 2023-12-03T11:49:09.535 INFO:tasks.workunit.client.0.smithi003.stderr: -496> 2023-12-03T11:49:09.400+0000 7f81245ab800 5 AuthRegistry(0x7ffe91b1fd30) adding con mode: crc 2023-12-03T11:49:09.535 INFO:tasks.workunit.client.0.smithi003.stderr: -495> 2023-12-03T11:49:09.400+0000 7f81245ab800 5 AuthRegistry(0x7ffe91b1fd30) adding con mode: secure 2023-12-03T11:49:09.536 INFO:tasks.workunit.client.0.smithi003.stderr: -494> 2023-12-03T11:49:09.400+0000 7f81245ab800 5 AuthRegistry(0x7ffe91b1fd30) adding con mode: crc 2023-12-03T11:49:09.536 INFO:tasks.workunit.client.0.smithi003.stderr: -493> 2023-12-03T11:49:09.400+0000 7f81245ab800 5 AuthRegistry(0x7ffe91b1fd30) adding con mode: secure 2023-12-03T11:49:09.536 INFO:tasks.workunit.client.0.smithi003.stderr: -492> 2023-12-03T11:49:09.400+0000 7f81245ab800 5 AuthRegistry(0x7ffe91b1fd30) adding con mode: crc 2023-12-03T11:49:09.536 INFO:tasks.workunit.client.0.smithi003.stderr: -491> 2023-12-03T11:49:09.400+0000 7f81245ab800 5 AuthRegistry(0x7ffe91b1fd30) adding con mode: crc 2023-12-03T11:49:09.536 INFO:tasks.workunit.client.0.smithi003.stderr: -490> 2023-12-03T11:49:09.400+0000 7f81245ab800 5 AuthRegistry(0x7ffe91b1fd30) adding con mode: secure 2023-12-03T11:49:09.536 INFO:tasks.workunit.client.0.smithi003.stderr: -489> 2023-12-03T11:49:09.400+0000 7f81245ab800 5 AuthRegistry(0x7ffe91b1fd30) adding con mode: crc 2023-12-03T11:49:09.536 INFO:tasks.workunit.client.0.smithi003.stderr: -488> 2023-12-03T11:49:09.400+0000 7f81245ab800 5 AuthRegistry(0x7ffe91b1fd30) adding con mode: secure 2023-12-03T11:49:09.536 INFO:tasks.workunit.client.0.smithi003.stderr: -487> 2023-12-03T11:49:09.400+0000 7f81245ab800 5 AuthRegistry(0x7ffe91b1fd30) adding con mode: crc 2023-12-03T11:49:09.536 INFO:tasks.workunit.client.0.smithi003.stderr: -486> 2023-12-03T11:49:09.400+0000 7f81245ab800 5 AuthRegistry(0x7ffe91b1fd30) adding con mode: secure 2023-12-03T11:49:09.536 INFO:tasks.workunit.client.0.smithi003.stderr: -485> 2023-12-03T11:49:09.400+0000 7f81245ab800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:49:09.536 INFO:tasks.workunit.client.0.smithi003.stderr: -484> 2023-12-03T11:49:09.401+0000 7f81245ab800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:49:09.536 INFO:tasks.workunit.client.0.smithi003.stderr: -483> 2023-12-03T11:49:09.401+0000 7f81245ab800 5 asok(0x5632d495ea10) register_command rotate-key cmddesc rotate-key hook 0x7ffe91b1fe78 EEXIST 2023-12-03T11:49:09.536 INFO:tasks.workunit.client.0.smithi003.stderr: -482> 2023-12-03T11:49:09.401+0000 7f81245ab800 10 monclient: _reopen_session rank -1 2023-12-03T11:49:09.536 INFO:tasks.workunit.client.0.smithi003.stderr: -481> 2023-12-03T11:49:09.401+0000 7f81245ab800 10 monclient: _add_conns ranks=[1,0,2] 2023-12-03T11:49:09.536 INFO:tasks.workunit.client.0.smithi003.stderr: -480> 2023-12-03T11:49:09.401+0000 7f81245ab800 10 monclient(hunting): picked mon.noname-b con 0x5632d4b9df20 addr [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] 2023-12-03T11:49:09.537 INFO:tasks.workunit.client.0.smithi003.stderr: -479> 2023-12-03T11:49:09.401+0000 7f81245ab800 10 monclient(hunting): picked mon.noname-a con 0x5632d4b9e300 addr [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] 2023-12-03T11:49:09.537 INFO:tasks.workunit.client.0.smithi003.stderr: -478> 2023-12-03T11:49:09.401+0000 7f81245ab800 10 monclient(hunting): picked mon.noname-c con 0x5632d4b99e80 addr [v2:172.21.15.3:3301/0,v1:172.21.15.3:6790/0] 2023-12-03T11:49:09.537 INFO:tasks.workunit.client.0.smithi003.stderr: -477> 2023-12-03T11:49:09.401+0000 7f81245ab800 10 monclient(hunting): start opening mon connection 2023-12-03T11:49:09.537 INFO:tasks.workunit.client.0.smithi003.stderr: -476> 2023-12-03T11:49:09.401+0000 7f81245ab800 10 monclient(hunting): start opening mon connection 2023-12-03T11:49:09.537 INFO:tasks.workunit.client.0.smithi003.stderr: -475> 2023-12-03T11:49:09.401+0000 7f81245ab800 10 monclient(hunting): start opening mon connection 2023-12-03T11:49:09.537 INFO:tasks.workunit.client.0.smithi003.stderr: -474> 2023-12-03T11:49:09.401+0000 7f81245ab800 10 monclient(hunting): _renew_subs 2023-12-03T11:49:09.537 INFO:tasks.workunit.client.0.smithi003.stderr: -473> 2023-12-03T11:49:09.401+0000 7f81245ab800 10 monclient(hunting): authenticate will time out at 1771.639444s 2023-12-03T11:49:09.537 INFO:tasks.workunit.client.0.smithi003.stderr: -472> 2023-12-03T11:49:09.401+0000 7f81220ab640 10 monclient(hunting): get_auth_request con 0x5632d4b9e300 auth_method 0 2023-12-03T11:49:09.537 INFO:tasks.workunit.client.0.smithi003.stderr: -471> 2023-12-03T11:49:09.401+0000 7f81220ab640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:49:09.537 INFO:tasks.workunit.client.0.smithi003.stderr: -470> 2023-12-03T11:49:09.401+0000 7f81220ab640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:49:09.537 INFO:tasks.workunit.client.0.smithi003.stderr: -469> 2023-12-03T11:49:09.401+0000 7f81220ab640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:49:09.537 INFO:tasks.workunit.client.0.smithi003.stderr: -468> 2023-12-03T11:49:09.401+0000 7f81218aa640 10 monclient(hunting): get_auth_request con 0x5632d4b99e80 auth_method 0 2023-12-03T11:49:09.537 INFO:tasks.workunit.client.0.smithi003.stderr: -467> 2023-12-03T11:49:09.401+0000 7f81218aa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:49:09.538 INFO:tasks.workunit.client.0.smithi003.stderr: -466> 2023-12-03T11:49:09.401+0000 7f81218aa640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:49:09.538 INFO:tasks.workunit.client.0.smithi003.stderr: -465> 2023-12-03T11:49:09.401+0000 7f81218aa640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:49:09.538 INFO:tasks.workunit.client.0.smithi003.stderr: -464> 2023-12-03T11:49:09.401+0000 7f81220ab640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:49:09.538 INFO:tasks.workunit.client.0.smithi003.stderr: -463> 2023-12-03T11:49:09.401+0000 7f81220ab640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:49:09.538 INFO:tasks.workunit.client.0.smithi003.stderr: -462> 2023-12-03T11:49:09.401+0000 7f81137fe640 4 mgrc handle_mgr_map Got map version 5 2023-12-03T11:49:09.538 INFO:tasks.workunit.client.0.smithi003.stderr: -461> 2023-12-03T11:49:09.401+0000 7f81137fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.37:6832/2165065416,v1:172.21.15.37:6833/2165065416] 2023-12-03T11:49:09.538 INFO:tasks.workunit.client.0.smithi003.stderr: -460> 2023-12-03T11:49:09.401+0000 7f81220ab640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:49:09.538 INFO:tasks.workunit.client.0.smithi003.stderr: -459> 2023-12-03T11:49:09.401+0000 7f81218aa640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:49:09.538 INFO:tasks.workunit.client.0.smithi003.stderr: -458> 2023-12-03T11:49:09.401+0000 7f81137fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.37:6832/2165065416,v1:172.21.15.37:6833/2165065416] 2023-12-03T11:49:09.538 INFO:tasks.workunit.client.0.smithi003.stderr: -457> 2023-12-03T11:49:09.401+0000 7f81218aa640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:49:09.538 INFO:tasks.workunit.client.0.smithi003.stderr: -456> 2023-12-03T11:49:09.401+0000 7f81218aa640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:49:09.538 INFO:tasks.workunit.client.0.smithi003.stderr: -455> 2023-12-03T11:49:09.401+0000 7f81228ac640 10 monclient(hunting): get_auth_request con 0x5632d4b9df20 auth_method 0 2023-12-03T11:49:09.538 INFO:tasks.workunit.client.0.smithi003.stderr: -454> 2023-12-03T11:49:09.401+0000 7f81228ac640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:49:09.539 INFO:tasks.workunit.client.0.smithi003.stderr: -453> 2023-12-03T11:49:09.401+0000 7f81228ac640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:49:09.539 INFO:tasks.workunit.client.0.smithi003.stderr: -452> 2023-12-03T11:49:09.401+0000 7f81228ac640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:49:09.539 INFO:tasks.workunit.client.0.smithi003.stderr: -451> 2023-12-03T11:49:09.401+0000 7f81228ac640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:49:09.539 INFO:tasks.workunit.client.0.smithi003.stderr: -450> 2023-12-03T11:49:09.401+0000 7f81228ac640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:49:09.539 INFO:tasks.workunit.client.0.smithi003.stderr: -449> 2023-12-03T11:49:09.401+0000 7f81228ac640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:49:09.539 INFO:tasks.workunit.client.0.smithi003.stderr: -448> 2023-12-03T11:49:09.401+0000 7f81220ab640 10 monclient(hunting): handle_auth_done global_id 7080 payload 274 2023-12-03T11:49:09.539 INFO:tasks.workunit.client.0.smithi003.stderr: -447> 2023-12-03T11:49:09.401+0000 7f81220ab640 10 monclient: _finish_hunting 0 2023-12-03T11:49:09.539 INFO:tasks.workunit.client.0.smithi003.stderr: -446> 2023-12-03T11:49:09.401+0000 7f81220ab640 1 monclient: found mon.noname-a 2023-12-03T11:49:09.539 INFO:tasks.workunit.client.0.smithi003.stderr: -445> 2023-12-03T11:49:09.401+0000 7f81220ab640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.3:3300/0 2023-12-03T11:49:09.539 INFO:tasks.workunit.client.0.smithi003.stderr: -444> 2023-12-03T11:49:09.401+0000 7f81228ac640 10 monclient: get_auth_request con 0x7f8104069820 auth_method 0 2023-12-03T11:49:09.539 INFO:tasks.workunit.client.0.smithi003.stderr: -443> 2023-12-03T11:49:09.401+0000 7f8110ff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:49:09.539 INFO:tasks.workunit.client.0.smithi003.stderr: -442> 2023-12-03T11:49:09.401+0000 7f8110ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-12-03T11:49:09.539 INFO:tasks.workunit.client.0.smithi003.stderr: -441> 2023-12-03T11:49:09.401+0000 7f8110ff9640 10 monclient: dump: 2023-12-03T11:49:09.540 INFO:tasks.workunit.client.0.smithi003.stderr:epoch 1 2023-12-03T11:49:09.540 INFO:tasks.workunit.client.0.smithi003.stderr:fsid 296556de-a4fc-4095-9b6d-0fe813c2865c 2023-12-03T11:49:09.540 INFO:tasks.workunit.client.0.smithi003.stderr:last_changed 2023-12-03T11:33:18.862564+0000 2023-12-03T11:49:09.540 INFO:tasks.workunit.client.0.smithi003.stderr:created 2023-12-03T11:33:18.862564+0000 2023-12-03T11:49:09.540 INFO:tasks.workunit.client.0.smithi003.stderr:min_mon_release 18 (reef) 2023-12-03T11:49:09.540 INFO:tasks.workunit.client.0.smithi003.stderr:election_strategy: 1 2023-12-03T11:49:09.540 INFO:tasks.workunit.client.0.smithi003.stderr:0: [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] mon.a 2023-12-03T11:49:09.540 INFO:tasks.workunit.client.0.smithi003.stderr:1: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.b 2023-12-03T11:49:09.540 INFO:tasks.workunit.client.0.smithi003.stderr:2: [v2:172.21.15.3:3301/0,v1:172.21.15.3:6790/0] mon.c 2023-12-03T11:49:09.540 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:49:09.540 INFO:tasks.workunit.client.0.smithi003.stderr: -440> 2023-12-03T11:49:09.401+0000 7f8110ff9640 10 monclient: _finish_auth 0 2023-12-03T11:49:09.540 INFO:tasks.workunit.client.0.smithi003.stderr: -439> 2023-12-03T11:49:09.401+0000 7f8110ff9640 10 monclient: _check_auth_tickets 2023-12-03T11:49:09.540 INFO:tasks.workunit.client.0.smithi003.stderr: -438> 2023-12-03T11:49:09.401+0000 7f8110ff9640 10 monclient: handle_config config(0 keys) v1 2023-12-03T11:49:09.540 INFO:tasks.workunit.client.0.smithi003.stderr: -437> 2023-12-03T11:49:09.401+0000 7f81245ab800 5 monclient: authenticate success, global_id 7080 2023-12-03T11:49:09.540 INFO:tasks.workunit.client.0.smithi003.stderr: -436> 2023-12-03T11:49:09.401+0000 7f81245ab800 10 monclient: get_monmap_and_config success 2023-12-03T11:49:09.540 INFO:tasks.workunit.client.0.smithi003.stderr: -435> 2023-12-03T11:49:09.401+0000 7f81245ab800 4 set_mon_vals no callback set 2023-12-03T11:49:09.540 INFO:tasks.workunit.client.0.smithi003.stderr: -434> 2023-12-03T11:49:09.401+0000 7f8110ff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:49:09.541 INFO:tasks.workunit.client.0.smithi003.stderr: -433> 2023-12-03T11:49:09.401+0000 7f8110ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-12-03T11:49:09.541 INFO:tasks.workunit.client.0.smithi003.stderr: -432> 2023-12-03T11:49:09.401+0000 7f8110ff9640 10 monclient: dump: 2023-12-03T11:49:09.541 INFO:tasks.workunit.client.0.smithi003.stderr:epoch 1 2023-12-03T11:49:09.541 INFO:tasks.workunit.client.0.smithi003.stderr:fsid 296556de-a4fc-4095-9b6d-0fe813c2865c 2023-12-03T11:49:09.541 INFO:tasks.workunit.client.0.smithi003.stderr:last_changed 2023-12-03T11:33:18.862564+0000 2023-12-03T11:49:09.541 INFO:tasks.workunit.client.0.smithi003.stderr:created 2023-12-03T11:33:18.862564+0000 2023-12-03T11:49:09.541 INFO:tasks.workunit.client.0.smithi003.stderr:min_mon_release 18 (reef) 2023-12-03T11:49:09.541 INFO:tasks.workunit.client.0.smithi003.stderr:election_strategy: 1 2023-12-03T11:49:09.541 INFO:tasks.workunit.client.0.smithi003.stderr:0: [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] mon.a 2023-12-03T11:49:09.541 INFO:tasks.workunit.client.0.smithi003.stderr:1: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.b 2023-12-03T11:49:09.541 INFO:tasks.workunit.client.0.smithi003.stderr:2: [v2:172.21.15.3:3301/0,v1:172.21.15.3:6790/0] mon.c 2023-12-03T11:49:09.541 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:49:09.541 INFO:tasks.workunit.client.0.smithi003.stderr: -431> 2023-12-03T11:49:09.402+0000 7f81245ab800 10 monclient: shutdown 2023-12-03T11:49:09.541 INFO:tasks.workunit.client.0.smithi003.stderr: -430> 2023-12-03T11:49:09.402+0000 7f81245ab800 10 monclient: build_initial_monmap 2023-12-03T11:49:09.541 INFO:tasks.workunit.client.0.smithi003.stderr: -429> 2023-12-03T11:49:09.402+0000 7f81245ab800 1 build_initial for_mkfs: 0 2023-12-03T11:49:09.542 INFO:tasks.workunit.client.0.smithi003.stderr: -428> 2023-12-03T11:49:09.402+0000 7f81245ab800 10 monclient: monmap: 2023-12-03T11:49:09.542 INFO:tasks.workunit.client.0.smithi003.stderr:epoch 0 2023-12-03T11:49:09.542 INFO:tasks.workunit.client.0.smithi003.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-12-03T11:49:09.542 INFO:tasks.workunit.client.0.smithi003.stderr:last_changed 0.000000 2023-12-03T11:49:09.542 INFO:tasks.workunit.client.0.smithi003.stderr:created 0.000000 2023-12-03T11:49:09.542 INFO:tasks.workunit.client.0.smithi003.stderr:min_mon_release 0 (unknown) 2023-12-03T11:49:09.542 INFO:tasks.workunit.client.0.smithi003.stderr:election_strategy: 1 2023-12-03T11:49:09.542 INFO:tasks.workunit.client.0.smithi003.stderr:0: [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] mon.noname-a 2023-12-03T11:49:09.542 INFO:tasks.workunit.client.0.smithi003.stderr:1: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.noname-b 2023-12-03T11:49:09.542 INFO:tasks.workunit.client.0.smithi003.stderr:2: [v2:172.21.15.3:3301/0,v1:172.21.15.3:6790/0] mon.noname-c 2023-12-03T11:49:09.542 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:49:09.542 INFO:tasks.workunit.client.0.smithi003.stderr: -427> 2023-12-03T11:49:09.402+0000 7f81245ab800 5 AuthRegistry(0x5632d4b6dc90) adding auth protocol: cephx 2023-12-03T11:49:09.542 INFO:tasks.workunit.client.0.smithi003.stderr: -426> 2023-12-03T11:49:09.402+0000 7f81245ab800 5 AuthRegistry(0x5632d4b6dc90) adding auth protocol: cephx 2023-12-03T11:49:09.542 INFO:tasks.workunit.client.0.smithi003.stderr: -425> 2023-12-03T11:49:09.402+0000 7f81245ab800 5 AuthRegistry(0x5632d4b6dc90) adding auth protocol: cephx 2023-12-03T11:49:09.542 INFO:tasks.workunit.client.0.smithi003.stderr: -424> 2023-12-03T11:49:09.402+0000 7f81245ab800 5 AuthRegistry(0x5632d4b6dc90) adding con mode: secure 2023-12-03T11:49:09.542 INFO:tasks.workunit.client.0.smithi003.stderr: -423> 2023-12-03T11:49:09.402+0000 7f81245ab800 5 AuthRegistry(0x5632d4b6dc90) adding con mode: crc 2023-12-03T11:49:09.543 INFO:tasks.workunit.client.0.smithi003.stderr: -422> 2023-12-03T11:49:09.402+0000 7f81245ab800 5 AuthRegistry(0x5632d4b6dc90) adding con mode: secure 2023-12-03T11:49:09.543 INFO:tasks.workunit.client.0.smithi003.stderr: -421> 2023-12-03T11:49:09.402+0000 7f81245ab800 5 AuthRegistry(0x5632d4b6dc90) adding con mode: crc 2023-12-03T11:49:09.543 INFO:tasks.workunit.client.0.smithi003.stderr: -420> 2023-12-03T11:49:09.402+0000 7f81245ab800 5 AuthRegistry(0x5632d4b6dc90) adding con mode: secure 2023-12-03T11:49:09.543 INFO:tasks.workunit.client.0.smithi003.stderr: -419> 2023-12-03T11:49:09.402+0000 7f81245ab800 5 AuthRegistry(0x5632d4b6dc90) adding con mode: crc 2023-12-03T11:49:09.543 INFO:tasks.workunit.client.0.smithi003.stderr: -418> 2023-12-03T11:49:09.402+0000 7f81245ab800 5 AuthRegistry(0x5632d4b6dc90) adding con mode: crc 2023-12-03T11:49:09.543 INFO:tasks.workunit.client.0.smithi003.stderr: -417> 2023-12-03T11:49:09.402+0000 7f81245ab800 5 AuthRegistry(0x5632d4b6dc90) adding con mode: secure 2023-12-03T11:49:09.543 INFO:tasks.workunit.client.0.smithi003.stderr: -416> 2023-12-03T11:49:09.402+0000 7f81245ab800 5 AuthRegistry(0x5632d4b6dc90) adding con mode: crc 2023-12-03T11:49:09.543 INFO:tasks.workunit.client.0.smithi003.stderr: -415> 2023-12-03T11:49:09.402+0000 7f81245ab800 5 AuthRegistry(0x5632d4b6dc90) adding con mode: secure 2023-12-03T11:49:09.543 INFO:tasks.workunit.client.0.smithi003.stderr: -414> 2023-12-03T11:49:09.402+0000 7f81245ab800 5 AuthRegistry(0x5632d4b6dc90) adding con mode: crc 2023-12-03T11:49:09.543 INFO:tasks.workunit.client.0.smithi003.stderr: -413> 2023-12-03T11:49:09.402+0000 7f81245ab800 5 AuthRegistry(0x5632d4b6dc90) adding con mode: secure 2023-12-03T11:49:09.543 INFO:tasks.workunit.client.0.smithi003.stderr: -412> 2023-12-03T11:49:09.402+0000 7f81245ab800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:49:09.543 INFO:tasks.workunit.client.0.smithi003.stderr: -411> 2023-12-03T11:49:09.402+0000 7f81245ab800 1 librados: starting msgr at 2023-12-03T11:49:09.543 INFO:tasks.workunit.client.0.smithi003.stderr: -410> 2023-12-03T11:49:09.402+0000 7f81245ab800 1 librados: starting objecter 2023-12-03T11:49:09.543 INFO:tasks.workunit.client.0.smithi003.stderr: -409> 2023-12-03T11:49:09.402+0000 7f81245ab800 5 asok(0x5632d495ea10) register_command objecter_requests cmddesc objecter_requests hook 0x5632d4b70400 EEXIST 2023-12-03T11:49:09.543 INFO:tasks.workunit.client.0.smithi003.stderr: -408> 2023-12-03T11:49:09.402+0000 7f81245ab800 1 librados: setting wanted keys 2023-12-03T11:49:09.543 INFO:tasks.workunit.client.0.smithi003.stderr: -407> 2023-12-03T11:49:09.402+0000 7f81245ab800 1 librados: calling monclient init 2023-12-03T11:49:09.544 INFO:tasks.workunit.client.0.smithi003.stderr: -406> 2023-12-03T11:49:09.402+0000 7f81245ab800 10 monclient: init 2023-12-03T11:49:09.544 INFO:tasks.workunit.client.0.smithi003.stderr: -405> 2023-12-03T11:49:09.402+0000 7f81245ab800 5 AuthRegistry(0x5632d4b67958) adding auth protocol: cephx 2023-12-03T11:49:09.544 INFO:tasks.workunit.client.0.smithi003.stderr: -404> 2023-12-03T11:49:09.402+0000 7f81245ab800 5 AuthRegistry(0x5632d4b67958) adding auth protocol: cephx 2023-12-03T11:49:09.544 INFO:tasks.workunit.client.0.smithi003.stderr: -403> 2023-12-03T11:49:09.402+0000 7f81245ab800 5 AuthRegistry(0x5632d4b67958) adding auth protocol: cephx 2023-12-03T11:49:09.544 INFO:tasks.workunit.client.0.smithi003.stderr: -402> 2023-12-03T11:49:09.402+0000 7f81245ab800 5 AuthRegistry(0x5632d4b67958) adding con mode: secure 2023-12-03T11:49:09.544 INFO:tasks.workunit.client.0.smithi003.stderr: -401> 2023-12-03T11:49:09.402+0000 7f81245ab800 5 AuthRegistry(0x5632d4b67958) adding con mode: crc 2023-12-03T11:49:09.544 INFO:tasks.workunit.client.0.smithi003.stderr: -400> 2023-12-03T11:49:09.402+0000 7f81245ab800 5 AuthRegistry(0x5632d4b67958) adding con mode: secure 2023-12-03T11:49:09.544 INFO:tasks.workunit.client.0.smithi003.stderr: -399> 2023-12-03T11:49:09.402+0000 7f81245ab800 5 AuthRegistry(0x5632d4b67958) adding con mode: crc 2023-12-03T11:49:09.544 INFO:tasks.workunit.client.0.smithi003.stderr: -398> 2023-12-03T11:49:09.402+0000 7f81245ab800 5 AuthRegistry(0x5632d4b67958) adding con mode: secure 2023-12-03T11:49:09.544 INFO:tasks.workunit.client.0.smithi003.stderr: -397> 2023-12-03T11:49:09.402+0000 7f81245ab800 5 AuthRegistry(0x5632d4b67958) adding con mode: crc 2023-12-03T11:49:09.544 INFO:tasks.workunit.client.0.smithi003.stderr: -396> 2023-12-03T11:49:09.402+0000 7f81245ab800 5 AuthRegistry(0x5632d4b67958) adding con mode: crc 2023-12-03T11:49:09.544 INFO:tasks.workunit.client.0.smithi003.stderr: -395> 2023-12-03T11:49:09.402+0000 7f81245ab800 5 AuthRegistry(0x5632d4b67958) adding con mode: secure 2023-12-03T11:49:09.544 INFO:tasks.workunit.client.0.smithi003.stderr: -394> 2023-12-03T11:49:09.402+0000 7f81245ab800 5 AuthRegistry(0x5632d4b67958) adding con mode: crc 2023-12-03T11:49:09.545 INFO:tasks.workunit.client.0.smithi003.stderr: -393> 2023-12-03T11:49:09.402+0000 7f81245ab800 5 AuthRegistry(0x5632d4b67958) adding con mode: secure 2023-12-03T11:49:09.545 INFO:tasks.workunit.client.0.smithi003.stderr: -392> 2023-12-03T11:49:09.402+0000 7f81245ab800 5 AuthRegistry(0x5632d4b67958) adding con mode: crc 2023-12-03T11:49:09.545 INFO:tasks.workunit.client.0.smithi003.stderr: -391> 2023-12-03T11:49:09.402+0000 7f81245ab800 5 AuthRegistry(0x5632d4b67958) adding con mode: secure 2023-12-03T11:49:09.545 INFO:tasks.workunit.client.0.smithi003.stderr: -390> 2023-12-03T11:49:09.403+0000 7f81245ab800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:49:09.545 INFO:tasks.workunit.client.0.smithi003.stderr: -389> 2023-12-03T11:49:09.403+0000 7f81245ab800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:49:09.545 INFO:tasks.workunit.client.0.smithi003.stderr: -388> 2023-12-03T11:49:09.403+0000 7f81245ab800 5 asok(0x5632d495ea10) register_command rotate-key cmddesc rotate-key hook 0x5632d4b67aa0 EEXIST 2023-12-03T11:49:09.545 INFO:tasks.workunit.client.0.smithi003.stderr: -387> 2023-12-03T11:49:09.403+0000 7f81245ab800 10 monclient: _reopen_session rank -1 2023-12-03T11:49:09.545 INFO:tasks.workunit.client.0.smithi003.stderr: -386> 2023-12-03T11:49:09.403+0000 7f81245ab800 10 monclient: _add_conns ranks=[2,0,1] 2023-12-03T11:49:09.545 INFO:tasks.workunit.client.0.smithi003.stderr: -385> 2023-12-03T11:49:09.403+0000 7f81245ab800 10 monclient(hunting): picked mon.noname-c con 0x5632d4b99e80 addr [v2:172.21.15.3:3301/0,v1:172.21.15.3:6790/0] 2023-12-03T11:49:09.545 INFO:tasks.workunit.client.0.smithi003.stderr: -384> 2023-12-03T11:49:09.403+0000 7f81245ab800 10 monclient(hunting): picked mon.noname-a con 0x5632d4b9df20 addr [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] 2023-12-03T11:49:09.545 INFO:tasks.workunit.client.0.smithi003.stderr: -383> 2023-12-03T11:49:09.403+0000 7f81245ab800 10 monclient(hunting): picked mon.noname-b con 0x5632d4b9b730 addr [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] 2023-12-03T11:49:09.545 INFO:tasks.workunit.client.0.smithi003.stderr: -382> 2023-12-03T11:49:09.403+0000 7f81245ab800 10 monclient(hunting): start opening mon connection 2023-12-03T11:49:09.545 INFO:tasks.workunit.client.0.smithi003.stderr: -381> 2023-12-03T11:49:09.403+0000 7f81245ab800 10 monclient(hunting): start opening mon connection 2023-12-03T11:49:09.545 INFO:tasks.workunit.client.0.smithi003.stderr: -380> 2023-12-03T11:49:09.403+0000 7f81245ab800 10 monclient(hunting): start opening mon connection 2023-12-03T11:49:09.546 INFO:tasks.workunit.client.0.smithi003.stderr: -379> 2023-12-03T11:49:09.403+0000 7f81245ab800 10 monclient(hunting): _renew_subs 2023-12-03T11:49:09.546 INFO:tasks.workunit.client.0.smithi003.stderr: -378> 2023-12-03T11:49:09.403+0000 7f81245ab800 10 monclient(hunting): authenticate will time out at 1771.641736s 2023-12-03T11:49:09.546 INFO:tasks.workunit.client.0.smithi003.stderr: -377> 2023-12-03T11:49:09.403+0000 7f81220ab640 10 monclient(hunting): get_auth_request con 0x5632d4b99e80 auth_method 0 2023-12-03T11:49:09.546 INFO:tasks.workunit.client.0.smithi003.stderr: -376> 2023-12-03T11:49:09.403+0000 7f81220ab640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:49:09.546 INFO:tasks.workunit.client.0.smithi003.stderr: -375> 2023-12-03T11:49:09.403+0000 7f81220ab640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:49:09.546 INFO:tasks.workunit.client.0.smithi003.stderr: -374> 2023-12-03T11:49:09.403+0000 7f81220ab640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:49:09.546 INFO:tasks.workunit.client.0.smithi003.stderr: -373> 2023-12-03T11:49:09.403+0000 7f81218aa640 10 monclient(hunting): get_auth_request con 0x5632d4b9df20 auth_method 0 2023-12-03T11:49:09.546 INFO:tasks.workunit.client.0.smithi003.stderr: -372> 2023-12-03T11:49:09.403+0000 7f81218aa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:49:09.546 INFO:tasks.workunit.client.0.smithi003.stderr: -371> 2023-12-03T11:49:09.403+0000 7f81218aa640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:49:09.546 INFO:tasks.workunit.client.0.smithi003.stderr: -370> 2023-12-03T11:49:09.403+0000 7f81218aa640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:49:09.546 INFO:tasks.workunit.client.0.smithi003.stderr: -369> 2023-12-03T11:49:09.403+0000 7f81220ab640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:49:09.547 INFO:tasks.workunit.client.0.smithi003.stderr: -368> 2023-12-03T11:49:09.403+0000 7f81220ab640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:49:09.547 INFO:tasks.workunit.client.0.smithi003.stderr: -367> 2023-12-03T11:49:09.403+0000 7f81220ab640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:49:09.547 INFO:tasks.workunit.client.0.smithi003.stderr: -366> 2023-12-03T11:49:09.403+0000 7f81218aa640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:49:09.547 INFO:tasks.workunit.client.0.smithi003.stderr: -365> 2023-12-03T11:49:09.403+0000 7f81218aa640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:49:09.547 INFO:tasks.workunit.client.0.smithi003.stderr: -364> 2023-12-03T11:49:09.403+0000 7f81218aa640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:49:09.547 INFO:tasks.workunit.client.0.smithi003.stderr: -363> 2023-12-03T11:49:09.403+0000 7f81228ac640 10 monclient(hunting): get_auth_request con 0x5632d4b9b730 auth_method 0 2023-12-03T11:49:09.547 INFO:tasks.workunit.client.0.smithi003.stderr: -362> 2023-12-03T11:49:09.403+0000 7f81228ac640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:49:09.547 INFO:tasks.workunit.client.0.smithi003.stderr: -361> 2023-12-03T11:49:09.403+0000 7f81228ac640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:49:09.547 INFO:tasks.workunit.client.0.smithi003.stderr: -360> 2023-12-03T11:49:09.403+0000 7f81228ac640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:49:09.547 INFO:tasks.workunit.client.0.smithi003.stderr: -359> 2023-12-03T11:49:09.403+0000 7f81220ab640 10 monclient(hunting): handle_auth_done global_id 6680 payload 824 2023-12-03T11:49:09.547 INFO:tasks.workunit.client.0.smithi003.stderr: -358> 2023-12-03T11:49:09.403+0000 7f81220ab640 10 monclient: _finish_hunting 0 2023-12-03T11:49:09.547 INFO:tasks.workunit.client.0.smithi003.stderr: -357> 2023-12-03T11:49:09.403+0000 7f81220ab640 1 monclient: found mon.noname-c 2023-12-03T11:49:09.547 INFO:tasks.workunit.client.0.smithi003.stderr: -356> 2023-12-03T11:49:09.403+0000 7f81220ab640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.3:3301/0 2023-12-03T11:49:09.548 INFO:tasks.workunit.client.0.smithi003.stderr: -355> 2023-12-03T11:49:09.404+0000 7f8102ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:49:09.548 INFO:tasks.workunit.client.0.smithi003.stderr: -354> 2023-12-03T11:49:09.404+0000 7f8102ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-12-03T11:49:09.548 INFO:tasks.workunit.client.0.smithi003.stderr: -353> 2023-12-03T11:49:09.404+0000 7f8102ffd640 10 monclient: dump: 2023-12-03T11:49:09.548 INFO:tasks.workunit.client.0.smithi003.stderr:epoch 1 2023-12-03T11:49:09.548 INFO:tasks.workunit.client.0.smithi003.stderr:fsid 296556de-a4fc-4095-9b6d-0fe813c2865c 2023-12-03T11:49:09.548 INFO:tasks.workunit.client.0.smithi003.stderr:last_changed 2023-12-03T11:33:18.862564+0000 2023-12-03T11:49:09.548 INFO:tasks.workunit.client.0.smithi003.stderr:created 2023-12-03T11:33:18.862564+0000 2023-12-03T11:49:09.548 INFO:tasks.workunit.client.0.smithi003.stderr:min_mon_release 18 (reef) 2023-12-03T11:49:09.548 INFO:tasks.workunit.client.0.smithi003.stderr:election_strategy: 1 2023-12-03T11:49:09.548 INFO:tasks.workunit.client.0.smithi003.stderr:0: [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] mon.a 2023-12-03T11:49:09.548 INFO:tasks.workunit.client.0.smithi003.stderr:1: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.b 2023-12-03T11:49:09.548 INFO:tasks.workunit.client.0.smithi003.stderr:2: [v2:172.21.15.3:3301/0,v1:172.21.15.3:6790/0] mon.c 2023-12-03T11:49:09.549 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:49:09.549 INFO:tasks.workunit.client.0.smithi003.stderr: -352> 2023-12-03T11:49:09.404+0000 7f8102ffd640 10 monclient: _finish_auth 0 2023-12-03T11:49:09.549 INFO:tasks.workunit.client.0.smithi003.stderr: -351> 2023-12-03T11:49:09.404+0000 7f8102ffd640 10 monclient: _check_auth_tickets 2023-12-03T11:49:09.549 INFO:tasks.workunit.client.0.smithi003.stderr: -350> 2023-12-03T11:49:09.404+0000 7f8102ffd640 10 monclient: handle_config config(0 keys) v1 2023-12-03T11:49:09.549 INFO:tasks.workunit.client.0.smithi003.stderr: -349> 2023-12-03T11:49:09.404+0000 7f8102ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:49:09.549 INFO:tasks.workunit.client.0.smithi003.stderr: -348> 2023-12-03T11:49:09.404+0000 7f8102ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-12-03T11:49:09.549 INFO:tasks.workunit.client.0.smithi003.stderr: -347> 2023-12-03T11:49:09.404+0000 7f8102ffd640 10 monclient: dump: 2023-12-03T11:49:09.549 INFO:tasks.workunit.client.0.smithi003.stderr:epoch 1 2023-12-03T11:49:09.549 INFO:tasks.workunit.client.0.smithi003.stderr:fsid 296556de-a4fc-4095-9b6d-0fe813c2865c 2023-12-03T11:49:09.549 INFO:tasks.workunit.client.0.smithi003.stderr:last_changed 2023-12-03T11:33:18.862564+0000 2023-12-03T11:49:09.549 INFO:tasks.workunit.client.0.smithi003.stderr:created 2023-12-03T11:33:18.862564+0000 2023-12-03T11:49:09.549 INFO:tasks.workunit.client.0.smithi003.stderr:min_mon_release 18 (reef) 2023-12-03T11:49:09.549 INFO:tasks.workunit.client.0.smithi003.stderr:election_strategy: 1 2023-12-03T11:49:09.549 INFO:tasks.workunit.client.0.smithi003.stderr:0: [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] mon.a 2023-12-03T11:49:09.550 INFO:tasks.workunit.client.0.smithi003.stderr:1: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.b 2023-12-03T11:49:09.550 INFO:tasks.workunit.client.0.smithi003.stderr:2: [v2:172.21.15.3:3301/0,v1:172.21.15.3:6790/0] mon.c 2023-12-03T11:49:09.550 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:49:09.550 INFO:tasks.workunit.client.0.smithi003.stderr: -346> 2023-12-03T11:49:09.404+0000 7f81245ab800 5 monclient: authenticate success, global_id 6680 2023-12-03T11:49:09.550 INFO:tasks.workunit.client.0.smithi003.stderr: -345> 2023-12-03T11:49:09.404+0000 7f81245ab800 10 monclient: _renew_subs 2023-12-03T11:49:09.550 INFO:tasks.workunit.client.0.smithi003.stderr: -344> 2023-12-03T11:49:09.404+0000 7f8110ff9640 4 set_mon_vals no callback set 2023-12-03T11:49:09.550 INFO:tasks.workunit.client.0.smithi003.stderr: -343> 2023-12-03T11:49:09.404+0000 7f81245ab800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.3:3301/0 2023-12-03T11:49:09.550 INFO:tasks.workunit.client.0.smithi003.stderr: -342> 2023-12-03T11:49:09.404+0000 7f81245ab800 10 monclient: _renew_subs 2023-12-03T11:49:09.550 INFO:tasks.workunit.client.0.smithi003.stderr: -341> 2023-12-03T11:49:09.404+0000 7f81245ab800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.3:3301/0 2023-12-03T11:49:09.550 INFO:tasks.workunit.client.0.smithi003.stderr: -340> 2023-12-03T11:49:09.404+0000 7f81245ab800 1 librados: init done 2023-12-03T11:49:09.550 INFO:tasks.workunit.client.0.smithi003.stderr: -339> 2023-12-03T11:49:09.405+0000 7f81245ab800 20 rados->read ofs=0 len=0 2023-12-03T11:49:09.550 INFO:tasks.workunit.client.0.smithi003.stderr: -338> 2023-12-03T11:49:09.405+0000 7f8102ffd640 4 mgrc handle_mgr_map Got map version 5 2023-12-03T11:49:09.550 INFO:tasks.workunit.client.0.smithi003.stderr: -337> 2023-12-03T11:49:09.405+0000 7f8102ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.37:6832/2165065416,v1:172.21.15.37:6833/2165065416] 2023-12-03T11:49:09.550 INFO:tasks.workunit.client.0.smithi003.stderr: -336> 2023-12-03T11:49:09.405+0000 7f8102ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.37:6832/2165065416,v1:172.21.15.37:6833/2165065416] 2023-12-03T11:49:09.551 INFO:tasks.workunit.client.0.smithi003.stderr: -335> 2023-12-03T11:49:09.406+0000 7f81228ac640 10 monclient: get_auth_request con 0x5632d4bb5cd0 auth_method 0 2023-12-03T11:49:09.551 INFO:tasks.workunit.client.0.smithi003.stderr: -334> 2023-12-03T11:49:09.406+0000 7f81218aa640 10 monclient: get_auth_request con 0x7f80fc069850 auth_method 0 2023-12-03T11:49:09.551 INFO:tasks.workunit.client.0.smithi003.stderr: -333> 2023-12-03T11:49:09.406+0000 7f81245ab800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:09.551 INFO:tasks.workunit.client.0.smithi003.stderr: -332> 2023-12-03T11:49:09.406+0000 7f81245ab800 20 realm 2023-12-03T11:49:09.551 INFO:tasks.workunit.client.0.smithi003.stderr: -331> 2023-12-03T11:49:09.406+0000 7f81245ab800 20 rados->read ofs=0 len=0 2023-12-03T11:49:09.551 INFO:tasks.workunit.client.0.smithi003.stderr: -330> 2023-12-03T11:49:09.406+0000 7f81245ab800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:09.551 INFO:tasks.workunit.client.0.smithi003.stderr: -329> 2023-12-03T11:49:09.406+0000 7f81245ab800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:49:09.551 INFO:tasks.workunit.client.0.smithi003.stderr: -328> 2023-12-03T11:49:09.406+0000 7f81245ab800 20 rados->read ofs=0 len=0 2023-12-03T11:49:09.551 INFO:tasks.workunit.client.0.smithi003.stderr: -327> 2023-12-03T11:49:09.407+0000 7f81245ab800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:09.551 INFO:tasks.workunit.client.0.smithi003.stderr: -326> 2023-12-03T11:49:09.407+0000 7f81245ab800 20 rados->read ofs=0 len=0 2023-12-03T11:49:09.551 INFO:tasks.workunit.client.0.smithi003.stderr: -325> 2023-12-03T11:49:09.407+0000 7f81220ab640 10 monclient: get_auth_request con 0x5632d4bb9e30 auth_method 0 2023-12-03T11:49:09.551 INFO:tasks.workunit.client.0.smithi003.stderr: -324> 2023-12-03T11:49:09.408+0000 7f81245ab800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:49:09.553 INFO:tasks.workunit.client.0.smithi003.stderr: -323> 2023-12-03T11:49:09.408+0000 7f81245ab800 20 rados->read ofs=0 len=0 2023-12-03T11:49:09.553 INFO:tasks.workunit.client.0.smithi003.stderr: -322> 2023-12-03T11:49:09.408+0000 7f81245ab800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:49:09.553 INFO:tasks.workunit.client.0.smithi003.stderr: -321> 2023-12-03T11:49:09.408+0000 7f81245ab800 20 searching for the correct realm 2023-12-03T11:49:09.553 INFO:tasks.workunit.client.0.smithi003.stderr: -320> 2023-12-03T11:49:09.408+0000 7f81218aa640 10 monclient: get_auth_request con 0x5632d4bbec80 auth_method 0 2023-12-03T11:49:09.553 INFO:tasks.workunit.client.0.smithi003.stderr: -319> 2023-12-03T11:49:09.409+0000 7f81228ac640 10 monclient: get_auth_request con 0x7f811801c040 auth_method 0 2023-12-03T11:49:09.553 INFO:tasks.workunit.client.0.smithi003.stderr: -318> 2023-12-03T11:49:09.409+0000 7f81220ab640 10 monclient: get_auth_request con 0x7f811c01c040 auth_method 0 2023-12-03T11:49:09.553 INFO:tasks.workunit.client.0.smithi003.stderr: -317> 2023-12-03T11:49:09.410+0000 7f81218aa640 10 monclient: get_auth_request con 0x7f8114073020 auth_method 0 2023-12-03T11:49:09.553 INFO:tasks.workunit.client.0.smithi003.stderr: -316> 2023-12-03T11:49:09.412+0000 7f81228ac640 10 monclient: get_auth_request con 0x7f811802e040 auth_method 0 2023-12-03T11:49:09.554 INFO:tasks.workunit.client.0.smithi003.stderr: -315> 2023-12-03T11:49:09.415+0000 7f81220ab640 10 monclient: get_auth_request con 0x7f811801eb90 auth_method 0 2023-12-03T11:49:09.554 INFO:tasks.workunit.client.0.smithi003.stderr: -314> 2023-12-03T11:49:09.419+0000 7f81220ab640 0 -- 172.21.15.3:0/2013709418 >> [v2:172.21.15.37:6805/1692844418,v1:172.21.15.37:6807/1692844418] conn(0x5632d4bb9e30 msgr2=0x5632d4bbc220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:49:09.554 INFO:tasks.workunit.client.0.smithi003.stderr: -313> 2023-12-03T11:49:09.419+0000 7f8102ffd640 1 client.6680.objecter ms_handle_reset 0x5632d4bb9e30 session 0x5632d4927320 osd.5 2023-12-03T11:49:09.554 INFO:tasks.workunit.client.0.smithi003.stderr: -312> 2023-12-03T11:49:09.419+0000 7f8102ffd640 10 monclient: _renew_subs 2023-12-03T11:49:09.554 INFO:tasks.workunit.client.0.smithi003.stderr: -311> 2023-12-03T11:49:09.419+0000 7f8102ffd640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.3:3301/0 2023-12-03T11:49:09.554 INFO:tasks.workunit.client.0.smithi003.stderr: -310> 2023-12-03T11:49:09.419+0000 7f81220ab640 10 monclient: get_auth_request con 0x7f80fc079e40 auth_method 0 2023-12-03T11:49:09.554 INFO:tasks.workunit.client.0.smithi003.stderr: -309> 2023-12-03T11:49:09.420+0000 7f81245ab800 20 RGWRados::pool_iterate: got zone_info.83aabb46-04b5-4c96-9933-c6bfb1173a73 2023-12-03T11:49:09.554 INFO:tasks.workunit.client.0.smithi003.stderr: -308> 2023-12-03T11:49:09.420+0000 7f81245ab800 20 RGWRados::pool_iterate: got zonegroup_info.6a811aad-435d-4fdd-93c9-b7e0b50de429 2023-12-03T11:49:09.554 INFO:tasks.workunit.client.0.smithi003.stderr: -307> 2023-12-03T11:49:09.420+0000 7f81245ab800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:49:09.554 INFO:tasks.workunit.client.0.smithi003.stderr: -306> 2023-12-03T11:49:09.420+0000 7f81245ab800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:49:09.554 INFO:tasks.workunit.client.0.smithi003.stderr: -305> 2023-12-03T11:49:09.420+0000 7f81245ab800 20 rados->read ofs=0 len=0 2023-12-03T11:49:09.554 INFO:tasks.workunit.client.0.smithi003.stderr: -304> 2023-12-03T11:49:09.420+0000 7f81245ab800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:09.554 INFO:tasks.workunit.client.0.smithi003.stderr: -303> 2023-12-03T11:49:09.420+0000 7f81245ab800 20 rados->read ofs=0 len=0 2023-12-03T11:49:09.555 INFO:tasks.workunit.client.0.smithi003.stderr: -302> 2023-12-03T11:49:09.421+0000 7f81245ab800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:49:09.555 INFO:tasks.workunit.client.0.smithi003.stderr: -301> 2023-12-03T11:49:09.421+0000 7f81245ab800 20 rados->read ofs=0 len=0 2023-12-03T11:49:09.555 INFO:tasks.workunit.client.0.smithi003.stderr: -300> 2023-12-03T11:49:09.421+0000 7f81245ab800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:49:09.555 INFO:tasks.workunit.client.0.smithi003.stderr: -299> 2023-12-03T11:49:09.421+0000 7f81245ab800 20 zone default found 2023-12-03T11:49:09.555 INFO:tasks.workunit.client.0.smithi003.stderr: -298> 2023-12-03T11:49:09.421+0000 7f81245ab800 4 Realm: () 2023-12-03T11:49:09.555 INFO:tasks.workunit.client.0.smithi003.stderr: -297> 2023-12-03T11:49:09.421+0000 7f81245ab800 4 ZoneGroup: default (6a811aad-435d-4fdd-93c9-b7e0b50de429) 2023-12-03T11:49:09.555 INFO:tasks.workunit.client.0.smithi003.stderr: -296> 2023-12-03T11:49:09.421+0000 7f81245ab800 4 Zone: default (83aabb46-04b5-4c96-9933-c6bfb1173a73) 2023-12-03T11:49:09.555 INFO:tasks.workunit.client.0.smithi003.stderr: -295> 2023-12-03T11:49:09.421+0000 7f81245ab800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:49:09.555 INFO:tasks.workunit.client.0.smithi003.stderr: -294> 2023-12-03T11:49:09.421+0000 7f81245ab800 20 zonegroup default 2023-12-03T11:49:09.555 INFO:tasks.workunit.client.0.smithi003.stderr: -293> 2023-12-03T11:49:09.421+0000 7f81245ab800 20 rados->read ofs=0 len=0 2023-12-03T11:49:09.556 INFO:tasks.workunit.client.0.smithi003.stderr: -292> 2023-12-03T11:49:09.421+0000 7f81245ab800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:09.556 INFO:tasks.workunit.client.0.smithi003.stderr: -291> 2023-12-03T11:49:09.421+0000 7f81245ab800 20 rados->read ofs=0 len=0 2023-12-03T11:49:09.556 INFO:tasks.workunit.client.0.smithi003.stderr: -290> 2023-12-03T11:49:09.422+0000 7f81245ab800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:09.556 INFO:tasks.workunit.client.0.smithi003.stderr: -289> 2023-12-03T11:49:09.422+0000 7f81245ab800 20 rados->read ofs=0 len=0 2023-12-03T11:49:09.556 INFO:tasks.workunit.client.0.smithi003.stderr: -288> 2023-12-03T11:49:09.422+0000 7f81245ab800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:09.556 INFO:tasks.workunit.client.0.smithi003.stderr: -287> 2023-12-03T11:49:09.422+0000 7f81245ab800 20 started sync module instance, tier type = 2023-12-03T11:49:09.556 INFO:tasks.workunit.client.0.smithi003.stderr: -286> 2023-12-03T11:49:09.422+0000 7f81245ab800 20 started zone id=83aabb46-04b5-4c96-9933-c6bfb1173a73 (name=default) with tier type = 2023-12-03T11:49:09.556 INFO:tasks.workunit.client.0.smithi003.stderr: -285> 2023-12-03T11:49:09.429+0000 7f81228ac640 0 -- 172.21.15.3:0/2013709418 >> [v2:172.21.15.37:6816/3770469300,v1:172.21.15.37:6818/3770469300] conn(0x7f811802e040 msgr2=0x7f811802e420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:49:09.556 INFO:tasks.workunit.client.0.smithi003.stderr: -284> 2023-12-03T11:49:09.429+0000 7f8102ffd640 1 client.6680.objecter ms_handle_reset 0x7f811802e040 session 0x7f811801e690 osd.6 2023-12-03T11:49:09.556 INFO:tasks.workunit.client.0.smithi003.stderr: -283> 2023-12-03T11:49:09.429+0000 7f81228ac640 10 monclient: get_auth_request con 0x5632d4bb9e30 auth_method 0 2023-12-03T11:49:09.556 INFO:tasks.workunit.client.0.smithi003.stderr: -282> 2023-12-03T11:49:09.431+0000 7f81245ab800 20 add_watcher() i=0 2023-12-03T11:49:09.557 INFO:tasks.workunit.client.0.smithi003.stderr: -281> 2023-12-03T11:49:09.431+0000 7f81245ab800 20 add_watcher() i=1 2023-12-03T11:49:09.557 INFO:tasks.workunit.client.0.smithi003.stderr: -280> 2023-12-03T11:49:09.431+0000 7f81245ab800 20 add_watcher() i=2 2023-12-03T11:49:09.557 INFO:tasks.workunit.client.0.smithi003.stderr: -279> 2023-12-03T11:49:09.431+0000 7f81245ab800 20 add_watcher() i=3 2023-12-03T11:49:09.557 INFO:tasks.workunit.client.0.smithi003.stderr: -278> 2023-12-03T11:49:09.431+0000 7f81245ab800 20 add_watcher() i=4 2023-12-03T11:49:09.557 INFO:tasks.workunit.client.0.smithi003.stderr: -277> 2023-12-03T11:49:09.431+0000 7f81245ab800 20 add_watcher() i=5 2023-12-03T11:49:09.557 INFO:tasks.workunit.client.0.smithi003.stderr: -276> 2023-12-03T11:49:09.431+0000 7f81245ab800 20 add_watcher() i=6 2023-12-03T11:49:09.557 INFO:tasks.workunit.client.0.smithi003.stderr: -275> 2023-12-03T11:49:09.433+0000 7f81245ab800 20 add_watcher() i=7 2023-12-03T11:49:09.557 INFO:tasks.workunit.client.0.smithi003.stderr: -274> 2023-12-03T11:49:09.433+0000 7f81245ab800 2 all 8 watchers are set, enabling cache 2023-12-03T11:49:09.557 INFO:tasks.workunit.client.0.smithi003.stderr: -273> 2023-12-03T11:49:09.434+0000 7f81245ab800 5 AuthRegistry(0x7ffe91b20760) adding auth protocol: cephx 2023-12-03T11:49:09.557 INFO:tasks.workunit.client.0.smithi003.stderr: -272> 2023-12-03T11:49:09.434+0000 7f81245ab800 5 AuthRegistry(0x7ffe91b20760) adding auth protocol: cephx 2023-12-03T11:49:09.558 INFO:tasks.workunit.client.0.smithi003.stderr: -271> 2023-12-03T11:49:09.434+0000 7f81245ab800 5 AuthRegistry(0x7ffe91b20760) adding auth protocol: cephx 2023-12-03T11:49:09.558 INFO:tasks.workunit.client.0.smithi003.stderr: -270> 2023-12-03T11:49:09.434+0000 7f81245ab800 5 AuthRegistry(0x7ffe91b20760) adding con mode: secure 2023-12-03T11:49:09.558 INFO:tasks.workunit.client.0.smithi003.stderr: -269> 2023-12-03T11:49:09.434+0000 7f81245ab800 5 AuthRegistry(0x7ffe91b20760) adding con mode: crc 2023-12-03T11:49:09.558 INFO:tasks.workunit.client.0.smithi003.stderr: -268> 2023-12-03T11:49:09.434+0000 7f81245ab800 5 AuthRegistry(0x7ffe91b20760) adding con mode: secure 2023-12-03T11:49:09.558 INFO:tasks.workunit.client.0.smithi003.stderr: -267> 2023-12-03T11:49:09.434+0000 7f81245ab800 5 AuthRegistry(0x7ffe91b20760) adding con mode: crc 2023-12-03T11:49:09.558 INFO:tasks.workunit.client.0.smithi003.stderr: -266> 2023-12-03T11:49:09.434+0000 7f81245ab800 5 AuthRegistry(0x7ffe91b20760) adding con mode: secure 2023-12-03T11:49:09.558 INFO:tasks.workunit.client.0.smithi003.stderr: -265> 2023-12-03T11:49:09.434+0000 7f81245ab800 5 AuthRegistry(0x7ffe91b20760) adding con mode: crc 2023-12-03T11:49:09.558 INFO:tasks.workunit.client.0.smithi003.stderr: -264> 2023-12-03T11:49:09.434+0000 7f80e7fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:49:09.558 INFO:tasks.workunit.client.0.smithi003.stderr: -263> 2023-12-03T11:49:09.434+0000 7f81245ab800 5 AuthRegistry(0x7ffe91b20760) adding con mode: crc 2023-12-03T11:49:09.558 INFO:tasks.workunit.client.0.smithi003.stderr: -262> 2023-12-03T11:49:09.434+0000 7f81245ab800 5 AuthRegistry(0x7ffe91b20760) adding con mode: secure 2023-12-03T11:49:09.558 INFO:tasks.workunit.client.0.smithi003.stderr: -261> 2023-12-03T11:49:09.434+0000 7f81245ab800 5 AuthRegistry(0x7ffe91b20760) adding con mode: crc 2023-12-03T11:49:09.558 INFO:tasks.workunit.client.0.smithi003.stderr: -260> 2023-12-03T11:49:09.434+0000 7f81245ab800 5 AuthRegistry(0x7ffe91b20760) adding con mode: secure 2023-12-03T11:49:09.559 INFO:tasks.workunit.client.0.smithi003.stderr: -259> 2023-12-03T11:49:09.434+0000 7f81245ab800 5 AuthRegistry(0x7ffe91b20760) adding con mode: crc 2023-12-03T11:49:09.559 INFO:tasks.workunit.client.0.smithi003.stderr: -258> 2023-12-03T11:49:09.434+0000 7f81245ab800 5 AuthRegistry(0x7ffe91b20760) adding con mode: secure 2023-12-03T11:49:09.559 INFO:tasks.workunit.client.0.smithi003.stderr: -257> 2023-12-03T11:49:09.434+0000 7f81245ab800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:49:09.559 INFO:tasks.workunit.client.0.smithi003.stderr: -256> 2023-12-03T11:49:09.434+0000 7f81245ab800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:49:09.559 INFO:tasks.workunit.client.0.smithi003.stderr: -255> 2023-12-03T11:49:09.434+0000 7f81245ab800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:49:09.559 INFO:tasks.workunit.client.0.smithi003.stderr: -254> 2023-12-03T11:49:09.434+0000 7f81245ab800 5 asok(0x5632d495ea10) register_command cache list hook 0x5632d4b5d510 2023-12-03T11:49:09.559 INFO:tasks.workunit.client.0.smithi003.stderr: -253> 2023-12-03T11:49:09.434+0000 7f81245ab800 5 asok(0x5632d495ea10) register_command cache inspect hook 0x5632d4b5d510 2023-12-03T11:49:09.559 INFO:tasks.workunit.client.0.smithi003.stderr: -252> 2023-12-03T11:49:09.434+0000 7f81245ab800 5 asok(0x5632d495ea10) register_command cache erase hook 0x5632d4b5d510 2023-12-03T11:49:09.559 INFO:tasks.workunit.client.0.smithi003.stderr: -251> 2023-12-03T11:49:09.434+0000 7f81245ab800 5 asok(0x5632d495ea10) register_command cache zap hook 0x5632d4b5d510 2023-12-03T11:49:09.559 INFO:tasks.workunit.client.0.smithi003.stderr: -250> 2023-12-03T11:49:09.434+0000 7f81245ab800 10 monclient: get_monmap_and_config 2023-12-03T11:49:09.559 INFO:tasks.workunit.client.0.smithi003.stderr: -249> 2023-12-03T11:49:09.434+0000 7f81245ab800 10 monclient: build_initial_monmap 2023-12-03T11:49:09.559 INFO:tasks.workunit.client.0.smithi003.stderr: -248> 2023-12-03T11:49:09.434+0000 7f81245ab800 1 build_initial for_mkfs: 0 2023-12-03T11:49:09.559 INFO:tasks.workunit.client.0.smithi003.stderr: -247> 2023-12-03T11:49:09.434+0000 7f81245ab800 10 monclient: monmap: 2023-12-03T11:49:09.559 INFO:tasks.workunit.client.0.smithi003.stderr:epoch 0 2023-12-03T11:49:09.560 INFO:tasks.workunit.client.0.smithi003.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-12-03T11:49:09.560 INFO:tasks.workunit.client.0.smithi003.stderr:last_changed 0.000000 2023-12-03T11:49:09.560 INFO:tasks.workunit.client.0.smithi003.stderr:created 0.000000 2023-12-03T11:49:09.560 INFO:tasks.workunit.client.0.smithi003.stderr:min_mon_release 0 (unknown) 2023-12-03T11:49:09.560 INFO:tasks.workunit.client.0.smithi003.stderr:election_strategy: 1 2023-12-03T11:49:09.560 INFO:tasks.workunit.client.0.smithi003.stderr:0: [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] mon.noname-a 2023-12-03T11:49:09.560 INFO:tasks.workunit.client.0.smithi003.stderr:1: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.noname-b 2023-12-03T11:49:09.560 INFO:tasks.workunit.client.0.smithi003.stderr:2: [v2:172.21.15.3:3301/0,v1:172.21.15.3:6790/0] mon.noname-c 2023-12-03T11:49:09.560 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:49:09.560 INFO:tasks.workunit.client.0.smithi003.stderr: -246> 2023-12-03T11:49:09.434+0000 7f81245ab800 5 AuthRegistry(0x5632d4bf9e00) adding auth protocol: cephx 2023-12-03T11:49:09.560 INFO:tasks.workunit.client.0.smithi003.stderr: -245> 2023-12-03T11:49:09.434+0000 7f81245ab800 5 AuthRegistry(0x5632d4bf9e00) adding auth protocol: cephx 2023-12-03T11:49:09.560 INFO:tasks.workunit.client.0.smithi003.stderr: -244> 2023-12-03T11:49:09.434+0000 7f81245ab800 5 AuthRegistry(0x5632d4bf9e00) adding auth protocol: cephx 2023-12-03T11:49:09.560 INFO:tasks.workunit.client.0.smithi003.stderr: -243> 2023-12-03T11:49:09.434+0000 7f81245ab800 5 AuthRegistry(0x5632d4bf9e00) adding con mode: secure 2023-12-03T11:49:09.560 INFO:tasks.workunit.client.0.smithi003.stderr: -242> 2023-12-03T11:49:09.434+0000 7f81245ab800 5 AuthRegistry(0x5632d4bf9e00) adding con mode: crc 2023-12-03T11:49:09.561 INFO:tasks.workunit.client.0.smithi003.stderr: -241> 2023-12-03T11:49:09.434+0000 7f81245ab800 5 AuthRegistry(0x5632d4bf9e00) adding con mode: secure 2023-12-03T11:49:09.561 INFO:tasks.workunit.client.0.smithi003.stderr: -240> 2023-12-03T11:49:09.434+0000 7f81245ab800 5 AuthRegistry(0x5632d4bf9e00) adding con mode: crc 2023-12-03T11:49:09.561 INFO:tasks.workunit.client.0.smithi003.stderr: -239> 2023-12-03T11:49:09.434+0000 7f81245ab800 5 AuthRegistry(0x5632d4bf9e00) adding con mode: secure 2023-12-03T11:49:09.561 INFO:tasks.workunit.client.0.smithi003.stderr: -238> 2023-12-03T11:49:09.434+0000 7f81245ab800 5 AuthRegistry(0x5632d4bf9e00) adding con mode: crc 2023-12-03T11:49:09.561 INFO:tasks.workunit.client.0.smithi003.stderr: -237> 2023-12-03T11:49:09.434+0000 7f81245ab800 5 AuthRegistry(0x5632d4bf9e00) adding con mode: crc 2023-12-03T11:49:09.561 INFO:tasks.workunit.client.0.smithi003.stderr: -236> 2023-12-03T11:49:09.434+0000 7f81245ab800 5 AuthRegistry(0x5632d4bf9e00) adding con mode: secure 2023-12-03T11:49:09.561 INFO:tasks.workunit.client.0.smithi003.stderr: -235> 2023-12-03T11:49:09.434+0000 7f81245ab800 5 AuthRegistry(0x5632d4bf9e00) adding con mode: crc 2023-12-03T11:49:09.561 INFO:tasks.workunit.client.0.smithi003.stderr: -234> 2023-12-03T11:49:09.434+0000 7f81245ab800 5 AuthRegistry(0x5632d4bf9e00) adding con mode: secure 2023-12-03T11:49:09.561 INFO:tasks.workunit.client.0.smithi003.stderr: -233> 2023-12-03T11:49:09.434+0000 7f81245ab800 5 AuthRegistry(0x5632d4bf9e00) adding con mode: crc 2023-12-03T11:49:09.561 INFO:tasks.workunit.client.0.smithi003.stderr: -232> 2023-12-03T11:49:09.434+0000 7f81245ab800 5 AuthRegistry(0x5632d4bf9e00) adding con mode: secure 2023-12-03T11:49:09.561 INFO:tasks.workunit.client.0.smithi003.stderr: -231> 2023-12-03T11:49:09.435+0000 7f81245ab800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:49:09.561 INFO:tasks.workunit.client.0.smithi003.stderr: -230> 2023-12-03T11:49:09.435+0000 7f81245ab800 10 monclient: init 2023-12-03T11:49:09.561 INFO:tasks.workunit.client.0.smithi003.stderr: -229> 2023-12-03T11:49:09.435+0000 7f81245ab800 5 AuthRegistry(0x7ffe91b202b0) adding auth protocol: cephx 2023-12-03T11:49:09.561 INFO:tasks.workunit.client.0.smithi003.stderr: -228> 2023-12-03T11:49:09.435+0000 7f81245ab800 5 AuthRegistry(0x7ffe91b202b0) adding auth protocol: cephx 2023-12-03T11:49:09.562 INFO:tasks.workunit.client.0.smithi003.stderr: -227> 2023-12-03T11:49:09.435+0000 7f81245ab800 5 AuthRegistry(0x7ffe91b202b0) adding auth protocol: cephx 2023-12-03T11:49:09.562 INFO:tasks.workunit.client.0.smithi003.stderr: -226> 2023-12-03T11:49:09.435+0000 7f81245ab800 5 AuthRegistry(0x7ffe91b202b0) adding con mode: secure 2023-12-03T11:49:09.562 INFO:tasks.workunit.client.0.smithi003.stderr: -225> 2023-12-03T11:49:09.435+0000 7f81245ab800 5 AuthRegistry(0x7ffe91b202b0) adding con mode: crc 2023-12-03T11:49:09.562 INFO:tasks.workunit.client.0.smithi003.stderr: -224> 2023-12-03T11:49:09.435+0000 7f81245ab800 5 AuthRegistry(0x7ffe91b202b0) adding con mode: secure 2023-12-03T11:49:09.562 INFO:tasks.workunit.client.0.smithi003.stderr: -223> 2023-12-03T11:49:09.435+0000 7f81245ab800 5 AuthRegistry(0x7ffe91b202b0) adding con mode: crc 2023-12-03T11:49:09.562 INFO:tasks.workunit.client.0.smithi003.stderr: -222> 2023-12-03T11:49:09.435+0000 7f81245ab800 5 AuthRegistry(0x7ffe91b202b0) adding con mode: secure 2023-12-03T11:49:09.562 INFO:tasks.workunit.client.0.smithi003.stderr: -221> 2023-12-03T11:49:09.435+0000 7f81245ab800 5 AuthRegistry(0x7ffe91b202b0) adding con mode: crc 2023-12-03T11:49:09.562 INFO:tasks.workunit.client.0.smithi003.stderr: -220> 2023-12-03T11:49:09.435+0000 7f81245ab800 5 AuthRegistry(0x7ffe91b202b0) adding con mode: crc 2023-12-03T11:49:09.562 INFO:tasks.workunit.client.0.smithi003.stderr: -219> 2023-12-03T11:49:09.435+0000 7f81245ab800 5 AuthRegistry(0x7ffe91b202b0) adding con mode: secure 2023-12-03T11:49:09.562 INFO:tasks.workunit.client.0.smithi003.stderr: -218> 2023-12-03T11:49:09.435+0000 7f81245ab800 5 AuthRegistry(0x7ffe91b202b0) adding con mode: crc 2023-12-03T11:49:09.562 INFO:tasks.workunit.client.0.smithi003.stderr: -217> 2023-12-03T11:49:09.435+0000 7f81245ab800 5 AuthRegistry(0x7ffe91b202b0) adding con mode: secure 2023-12-03T11:49:09.562 INFO:tasks.workunit.client.0.smithi003.stderr: -216> 2023-12-03T11:49:09.435+0000 7f81245ab800 5 AuthRegistry(0x7ffe91b202b0) adding con mode: crc 2023-12-03T11:49:09.562 INFO:tasks.workunit.client.0.smithi003.stderr: -215> 2023-12-03T11:49:09.435+0000 7f81245ab800 5 AuthRegistry(0x7ffe91b202b0) adding con mode: secure 2023-12-03T11:49:09.562 INFO:tasks.workunit.client.0.smithi003.stderr: -214> 2023-12-03T11:49:09.435+0000 7f81245ab800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:49:09.562 INFO:tasks.workunit.client.0.smithi003.stderr: -213> 2023-12-03T11:49:09.435+0000 7f81245ab800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:49:09.563 INFO:tasks.workunit.client.0.smithi003.stderr: -212> 2023-12-03T11:49:09.435+0000 7f81245ab800 5 asok(0x5632d495ea10) register_command rotate-key cmddesc rotate-key hook 0x7ffe91b203f8 EEXIST 2023-12-03T11:49:09.563 INFO:tasks.workunit.client.0.smithi003.stderr: -211> 2023-12-03T11:49:09.435+0000 7f81245ab800 10 monclient: _reopen_session rank -1 2023-12-03T11:49:09.563 INFO:tasks.workunit.client.0.smithi003.stderr: -210> 2023-12-03T11:49:09.435+0000 7f81245ab800 10 monclient: _add_conns ranks=[2,1,0] 2023-12-03T11:49:09.563 INFO:tasks.workunit.client.0.smithi003.stderr: -209> 2023-12-03T11:49:09.435+0000 7f81245ab800 10 monclient(hunting): picked mon.noname-c con 0x5632d4bf8540 addr [v2:172.21.15.3:3301/0,v1:172.21.15.3:6790/0] 2023-12-03T11:49:09.563 INFO:tasks.workunit.client.0.smithi003.stderr: -208> 2023-12-03T11:49:09.435+0000 7f81245ab800 10 monclient(hunting): picked mon.noname-b con 0x5632d4bf95b0 addr [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] 2023-12-03T11:49:09.563 INFO:tasks.workunit.client.0.smithi003.stderr: -207> 2023-12-03T11:49:09.435+0000 7f81245ab800 10 monclient(hunting): picked mon.noname-a con 0x5632d4bfcbd0 addr [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] 2023-12-03T11:49:09.563 INFO:tasks.workunit.client.0.smithi003.stderr: -206> 2023-12-03T11:49:09.435+0000 7f81245ab800 10 monclient(hunting): start opening mon connection 2023-12-03T11:49:09.563 INFO:tasks.workunit.client.0.smithi003.stderr: -205> 2023-12-03T11:49:09.435+0000 7f81245ab800 10 monclient(hunting): start opening mon connection 2023-12-03T11:49:09.563 INFO:tasks.workunit.client.0.smithi003.stderr: -204> 2023-12-03T11:49:09.435+0000 7f81245ab800 10 monclient(hunting): start opening mon connection 2023-12-03T11:49:09.563 INFO:tasks.workunit.client.0.smithi003.stderr: -203> 2023-12-03T11:49:09.435+0000 7f81245ab800 10 monclient(hunting): _renew_subs 2023-12-03T11:49:09.563 INFO:tasks.workunit.client.0.smithi003.stderr: -202> 2023-12-03T11:49:09.435+0000 7f81245ab800 10 monclient(hunting): authenticate will time out at 1771.674107s 2023-12-03T11:49:09.563 INFO:tasks.workunit.client.0.smithi003.stderr: -201> 2023-12-03T11:49:09.435+0000 7f81228ac640 10 monclient(hunting): get_auth_request con 0x5632d4bf8540 auth_method 0 2023-12-03T11:49:09.563 INFO:tasks.workunit.client.0.smithi003.stderr: -200> 2023-12-03T11:49:09.435+0000 7f81228ac640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:49:09.563 INFO:tasks.workunit.client.0.smithi003.stderr: -199> 2023-12-03T11:49:09.435+0000 7f81228ac640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:49:09.564 INFO:tasks.workunit.client.0.smithi003.stderr: -198> 2023-12-03T11:49:09.435+0000 7f81228ac640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:49:09.564 INFO:tasks.workunit.client.0.smithi003.stderr: -197> 2023-12-03T11:49:09.435+0000 7f81218aa640 10 monclient(hunting): get_auth_request con 0x5632d4bfcbd0 auth_method 0 2023-12-03T11:49:09.564 INFO:tasks.workunit.client.0.smithi003.stderr: -196> 2023-12-03T11:49:09.435+0000 7f81218aa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:49:09.564 INFO:tasks.workunit.client.0.smithi003.stderr: -195> 2023-12-03T11:49:09.435+0000 7f81218aa640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:49:09.564 INFO:tasks.workunit.client.0.smithi003.stderr: -194> 2023-12-03T11:49:09.435+0000 7f81218aa640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:49:09.564 INFO:tasks.workunit.client.0.smithi003.stderr: -193> 2023-12-03T11:49:09.436+0000 7f81228ac640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:49:09.564 INFO:tasks.workunit.client.0.smithi003.stderr: -192> 2023-12-03T11:49:09.436+0000 7f81228ac640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:49:09.564 INFO:tasks.workunit.client.0.smithi003.stderr: -191> 2023-12-03T11:49:09.436+0000 7f81228ac640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:49:09.564 INFO:tasks.workunit.client.0.smithi003.stderr: -190> 2023-12-03T11:49:09.436+0000 7f81218aa640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:49:09.564 INFO:tasks.workunit.client.0.smithi003.stderr: -189> 2023-12-03T11:49:09.436+0000 7f81218aa640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:49:09.564 INFO:tasks.workunit.client.0.smithi003.stderr: -188> 2023-12-03T11:49:09.436+0000 7f81218aa640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:49:09.564 INFO:tasks.workunit.client.0.smithi003.stderr: -187> 2023-12-03T11:49:09.436+0000 7f81218aa640 10 monclient(hunting): handle_auth_done global_id 7086 payload 274 2023-12-03T11:49:09.565 INFO:tasks.workunit.client.0.smithi003.stderr: -186> 2023-12-03T11:49:09.436+0000 7f81218aa640 10 monclient: _finish_hunting 0 2023-12-03T11:49:09.565 INFO:tasks.workunit.client.0.smithi003.stderr: -185> 2023-12-03T11:49:09.436+0000 7f81218aa640 1 monclient: found mon.noname-a 2023-12-03T11:49:09.565 INFO:tasks.workunit.client.0.smithi003.stderr: -184> 2023-12-03T11:49:09.436+0000 7f81218aa640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.3:3300/0 2023-12-03T11:49:09.565 INFO:tasks.workunit.client.0.smithi003.stderr: -183> 2023-12-03T11:49:09.436+0000 7f80e77e6640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:49:09.565 INFO:tasks.workunit.client.0.smithi003.stderr: -182> 2023-12-03T11:49:09.436+0000 7f80e77e6640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-12-03T11:49:09.565 INFO:tasks.workunit.client.0.smithi003.stderr: -181> 2023-12-03T11:49:09.436+0000 7f80e77e6640 10 monclient: dump: 2023-12-03T11:49:09.565 INFO:tasks.workunit.client.0.smithi003.stderr:epoch 1 2023-12-03T11:49:09.565 INFO:tasks.workunit.client.0.smithi003.stderr:fsid 296556de-a4fc-4095-9b6d-0fe813c2865c 2023-12-03T11:49:09.565 INFO:tasks.workunit.client.0.smithi003.stderr:last_changed 2023-12-03T11:33:18.862564+0000 2023-12-03T11:49:09.565 INFO:tasks.workunit.client.0.smithi003.stderr:created 2023-12-03T11:33:18.862564+0000 2023-12-03T11:49:09.565 INFO:tasks.workunit.client.0.smithi003.stderr:min_mon_release 18 (reef) 2023-12-03T11:49:09.565 INFO:tasks.workunit.client.0.smithi003.stderr:election_strategy: 1 2023-12-03T11:49:09.565 INFO:tasks.workunit.client.0.smithi003.stderr:0: [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] mon.a 2023-12-03T11:49:09.565 INFO:tasks.workunit.client.0.smithi003.stderr:1: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.b 2023-12-03T11:49:09.566 INFO:tasks.workunit.client.0.smithi003.stderr:2: [v2:172.21.15.3:3301/0,v1:172.21.15.3:6790/0] mon.c 2023-12-03T11:49:09.566 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:49:09.566 INFO:tasks.workunit.client.0.smithi003.stderr: -180> 2023-12-03T11:49:09.436+0000 7f80e77e6640 10 monclient: _finish_auth 0 2023-12-03T11:49:09.566 INFO:tasks.workunit.client.0.smithi003.stderr: -179> 2023-12-03T11:49:09.436+0000 7f80e77e6640 10 monclient: _check_auth_tickets 2023-12-03T11:49:09.566 INFO:tasks.workunit.client.0.smithi003.stderr: -178> 2023-12-03T11:49:09.436+0000 7f80e77e6640 10 monclient: handle_config config(0 keys) v1 2023-12-03T11:49:09.566 INFO:tasks.workunit.client.0.smithi003.stderr: -177> 2023-12-03T11:49:09.436+0000 7f80e77e6640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:49:09.566 INFO:tasks.workunit.client.0.smithi003.stderr: -176> 2023-12-03T11:49:09.436+0000 7f80e77e6640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-12-03T11:49:09.566 INFO:tasks.workunit.client.0.smithi003.stderr: -175> 2023-12-03T11:49:09.436+0000 7f80e77e6640 10 monclient: dump: 2023-12-03T11:49:09.566 INFO:tasks.workunit.client.0.smithi003.stderr:epoch 1 2023-12-03T11:49:09.566 INFO:tasks.workunit.client.0.smithi003.stderr:fsid 296556de-a4fc-4095-9b6d-0fe813c2865c 2023-12-03T11:49:09.566 INFO:tasks.workunit.client.0.smithi003.stderr:last_changed 2023-12-03T11:33:18.862564+0000 2023-12-03T11:49:09.566 INFO:tasks.workunit.client.0.smithi003.stderr:created 2023-12-03T11:33:18.862564+0000 2023-12-03T11:49:09.566 INFO:tasks.workunit.client.0.smithi003.stderr:min_mon_release 18 (reef) 2023-12-03T11:49:09.566 INFO:tasks.workunit.client.0.smithi003.stderr:election_strategy: 1 2023-12-03T11:49:09.567 INFO:tasks.workunit.client.0.smithi003.stderr:0: [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] mon.a 2023-12-03T11:49:09.567 INFO:tasks.workunit.client.0.smithi003.stderr:1: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.b 2023-12-03T11:49:09.567 INFO:tasks.workunit.client.0.smithi003.stderr:2: [v2:172.21.15.3:3301/0,v1:172.21.15.3:6790/0] mon.c 2023-12-03T11:49:09.567 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:49:09.567 INFO:tasks.workunit.client.0.smithi003.stderr: -174> 2023-12-03T11:49:09.436+0000 7f81245ab800 5 monclient: authenticate success, global_id 7086 2023-12-03T11:49:09.567 INFO:tasks.workunit.client.0.smithi003.stderr: -173> 2023-12-03T11:49:09.436+0000 7f81245ab800 10 monclient: get_monmap_and_config success 2023-12-03T11:49:09.567 INFO:tasks.workunit.client.0.smithi003.stderr: -172> 2023-12-03T11:49:09.436+0000 7f81245ab800 4 set_mon_vals no callback set 2023-12-03T11:49:09.567 INFO:tasks.workunit.client.0.smithi003.stderr: -171> 2023-12-03T11:49:09.437+0000 7f81245ab800 10 monclient: shutdown 2023-12-03T11:49:09.567 INFO:tasks.workunit.client.0.smithi003.stderr: -170> 2023-12-03T11:49:09.437+0000 7f81245ab800 10 monclient: build_initial_monmap 2023-12-03T11:49:09.567 INFO:tasks.workunit.client.0.smithi003.stderr: -169> 2023-12-03T11:49:09.437+0000 7f81245ab800 1 build_initial for_mkfs: 0 2023-12-03T11:49:09.567 INFO:tasks.workunit.client.0.smithi003.stderr: -168> 2023-12-03T11:49:09.437+0000 7f81245ab800 10 monclient: monmap: 2023-12-03T11:49:09.567 INFO:tasks.workunit.client.0.smithi003.stderr:epoch 0 2023-12-03T11:49:09.567 INFO:tasks.workunit.client.0.smithi003.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-12-03T11:49:09.567 INFO:tasks.workunit.client.0.smithi003.stderr:last_changed 0.000000 2023-12-03T11:49:09.567 INFO:tasks.workunit.client.0.smithi003.stderr:created 0.000000 2023-12-03T11:49:09.567 INFO:tasks.workunit.client.0.smithi003.stderr:min_mon_release 0 (unknown) 2023-12-03T11:49:09.568 INFO:tasks.workunit.client.0.smithi003.stderr:election_strategy: 1 2023-12-03T11:49:09.568 INFO:tasks.workunit.client.0.smithi003.stderr:0: [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] mon.noname-a 2023-12-03T11:49:09.568 INFO:tasks.workunit.client.0.smithi003.stderr:1: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.noname-b 2023-12-03T11:49:09.568 INFO:tasks.workunit.client.0.smithi003.stderr:2: [v2:172.21.15.3:3301/0,v1:172.21.15.3:6790/0] mon.noname-c 2023-12-03T11:49:09.568 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:49:09.568 INFO:tasks.workunit.client.0.smithi003.stderr: -167> 2023-12-03T11:49:09.437+0000 7f81245ab800 5 AuthRegistry(0x5632d4c03c90) adding auth protocol: cephx 2023-12-03T11:49:09.568 INFO:tasks.workunit.client.0.smithi003.stderr: -166> 2023-12-03T11:49:09.437+0000 7f81245ab800 5 AuthRegistry(0x5632d4c03c90) adding auth protocol: cephx 2023-12-03T11:49:09.568 INFO:tasks.workunit.client.0.smithi003.stderr: -165> 2023-12-03T11:49:09.437+0000 7f81245ab800 5 AuthRegistry(0x5632d4c03c90) adding auth protocol: cephx 2023-12-03T11:49:09.568 INFO:tasks.workunit.client.0.smithi003.stderr: -164> 2023-12-03T11:49:09.437+0000 7f81245ab800 5 AuthRegistry(0x5632d4c03c90) adding con mode: secure 2023-12-03T11:49:09.568 INFO:tasks.workunit.client.0.smithi003.stderr: -163> 2023-12-03T11:49:09.437+0000 7f81245ab800 5 AuthRegistry(0x5632d4c03c90) adding con mode: crc 2023-12-03T11:49:09.568 INFO:tasks.workunit.client.0.smithi003.stderr: -162> 2023-12-03T11:49:09.437+0000 7f81245ab800 5 AuthRegistry(0x5632d4c03c90) adding con mode: secure 2023-12-03T11:49:09.568 INFO:tasks.workunit.client.0.smithi003.stderr: -161> 2023-12-03T11:49:09.437+0000 7f81245ab800 5 AuthRegistry(0x5632d4c03c90) adding con mode: crc 2023-12-03T11:49:09.568 INFO:tasks.workunit.client.0.smithi003.stderr: -160> 2023-12-03T11:49:09.437+0000 7f81245ab800 5 AuthRegistry(0x5632d4c03c90) adding con mode: secure 2023-12-03T11:49:09.569 INFO:tasks.workunit.client.0.smithi003.stderr: -159> 2023-12-03T11:49:09.437+0000 7f81245ab800 5 AuthRegistry(0x5632d4c03c90) adding con mode: crc 2023-12-03T11:49:09.569 INFO:tasks.workunit.client.0.smithi003.stderr: -158> 2023-12-03T11:49:09.437+0000 7f81245ab800 5 AuthRegistry(0x5632d4c03c90) adding con mode: crc 2023-12-03T11:49:09.569 INFO:tasks.workunit.client.0.smithi003.stderr: -157> 2023-12-03T11:49:09.437+0000 7f81245ab800 5 AuthRegistry(0x5632d4c03c90) adding con mode: secure 2023-12-03T11:49:09.569 INFO:tasks.workunit.client.0.smithi003.stderr: -156> 2023-12-03T11:49:09.437+0000 7f81245ab800 5 AuthRegistry(0x5632d4c03c90) adding con mode: crc 2023-12-03T11:49:09.569 INFO:tasks.workunit.client.0.smithi003.stderr: -155> 2023-12-03T11:49:09.437+0000 7f81245ab800 5 AuthRegistry(0x5632d4c03c90) adding con mode: secure 2023-12-03T11:49:09.569 INFO:tasks.workunit.client.0.smithi003.stderr: -154> 2023-12-03T11:49:09.437+0000 7f81245ab800 5 AuthRegistry(0x5632d4c03c90) adding con mode: crc 2023-12-03T11:49:09.569 INFO:tasks.workunit.client.0.smithi003.stderr: -153> 2023-12-03T11:49:09.437+0000 7f81245ab800 5 AuthRegistry(0x5632d4c03c90) adding con mode: secure 2023-12-03T11:49:09.569 INFO:tasks.workunit.client.0.smithi003.stderr: -152> 2023-12-03T11:49:09.437+0000 7f81245ab800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:49:09.569 INFO:tasks.workunit.client.0.smithi003.stderr: -151> 2023-12-03T11:49:09.437+0000 7f81245ab800 1 librados: starting msgr at 2023-12-03T11:49:09.569 INFO:tasks.workunit.client.0.smithi003.stderr: -150> 2023-12-03T11:49:09.437+0000 7f81245ab800 1 librados: starting objecter 2023-12-03T11:49:09.569 INFO:tasks.workunit.client.0.smithi003.stderr: -149> 2023-12-03T11:49:09.437+0000 7f81245ab800 5 asok(0x5632d495ea10) register_command objecter_requests cmddesc objecter_requests hook 0x5632d4bf8ac0 EEXIST 2023-12-03T11:49:09.569 INFO:tasks.workunit.client.0.smithi003.stderr: -148> 2023-12-03T11:49:09.437+0000 7f81245ab800 1 librados: setting wanted keys 2023-12-03T11:49:09.569 INFO:tasks.workunit.client.0.smithi003.stderr: -147> 2023-12-03T11:49:09.437+0000 7f81245ab800 1 librados: calling monclient init 2023-12-03T11:49:09.569 INFO:tasks.workunit.client.0.smithi003.stderr: -146> 2023-12-03T11:49:09.437+0000 7f81245ab800 10 monclient: init 2023-12-03T11:49:09.570 INFO:tasks.workunit.client.0.smithi003.stderr: -145> 2023-12-03T11:49:09.437+0000 7f81245ab800 5 AuthRegistry(0x5632d4bfd318) adding auth protocol: cephx 2023-12-03T11:49:09.570 INFO:tasks.workunit.client.0.smithi003.stderr: -144> 2023-12-03T11:49:09.437+0000 7f81245ab800 5 AuthRegistry(0x5632d4bfd318) adding auth protocol: cephx 2023-12-03T11:49:09.570 INFO:tasks.workunit.client.0.smithi003.stderr: -143> 2023-12-03T11:49:09.437+0000 7f81245ab800 5 AuthRegistry(0x5632d4bfd318) adding auth protocol: cephx 2023-12-03T11:49:09.570 INFO:tasks.workunit.client.0.smithi003.stderr: -142> 2023-12-03T11:49:09.437+0000 7f81245ab800 5 AuthRegistry(0x5632d4bfd318) adding con mode: secure 2023-12-03T11:49:09.570 INFO:tasks.workunit.client.0.smithi003.stderr: -141> 2023-12-03T11:49:09.437+0000 7f81245ab800 5 AuthRegistry(0x5632d4bfd318) adding con mode: crc 2023-12-03T11:49:09.570 INFO:tasks.workunit.client.0.smithi003.stderr: -140> 2023-12-03T11:49:09.437+0000 7f81245ab800 5 AuthRegistry(0x5632d4bfd318) adding con mode: secure 2023-12-03T11:49:09.570 INFO:tasks.workunit.client.0.smithi003.stderr: -139> 2023-12-03T11:49:09.437+0000 7f81245ab800 5 AuthRegistry(0x5632d4bfd318) adding con mode: crc 2023-12-03T11:49:09.570 INFO:tasks.workunit.client.0.smithi003.stderr: -138> 2023-12-03T11:49:09.437+0000 7f81245ab800 5 AuthRegistry(0x5632d4bfd318) adding con mode: secure 2023-12-03T11:49:09.570 INFO:tasks.workunit.client.0.smithi003.stderr: -137> 2023-12-03T11:49:09.437+0000 7f81245ab800 5 AuthRegistry(0x5632d4bfd318) adding con mode: crc 2023-12-03T11:49:09.570 INFO:tasks.workunit.client.0.smithi003.stderr: -136> 2023-12-03T11:49:09.437+0000 7f81245ab800 5 AuthRegistry(0x5632d4bfd318) adding con mode: crc 2023-12-03T11:49:09.570 INFO:tasks.workunit.client.0.smithi003.stderr: -135> 2023-12-03T11:49:09.437+0000 7f81245ab800 5 AuthRegistry(0x5632d4bfd318) adding con mode: secure 2023-12-03T11:49:09.570 INFO:tasks.workunit.client.0.smithi003.stderr: -134> 2023-12-03T11:49:09.437+0000 7f81245ab800 5 AuthRegistry(0x5632d4bfd318) adding con mode: crc 2023-12-03T11:49:09.570 INFO:tasks.workunit.client.0.smithi003.stderr: -133> 2023-12-03T11:49:09.437+0000 7f81245ab800 5 AuthRegistry(0x5632d4bfd318) adding con mode: secure 2023-12-03T11:49:09.570 INFO:tasks.workunit.client.0.smithi003.stderr: -132> 2023-12-03T11:49:09.437+0000 7f81245ab800 5 AuthRegistry(0x5632d4bfd318) adding con mode: crc 2023-12-03T11:49:09.570 INFO:tasks.workunit.client.0.smithi003.stderr: -131> 2023-12-03T11:49:09.437+0000 7f81245ab800 5 AuthRegistry(0x5632d4bfd318) adding con mode: secure 2023-12-03T11:49:09.571 INFO:tasks.workunit.client.0.smithi003.stderr: -130> 2023-12-03T11:49:09.438+0000 7f81245ab800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:49:09.571 INFO:tasks.workunit.client.0.smithi003.stderr: -129> 2023-12-03T11:49:09.438+0000 7f81245ab800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:49:09.571 INFO:tasks.workunit.client.0.smithi003.stderr: -128> 2023-12-03T11:49:09.438+0000 7f81245ab800 5 asok(0x5632d495ea10) register_command rotate-key cmddesc rotate-key hook 0x5632d4bfd460 EEXIST 2023-12-03T11:49:09.571 INFO:tasks.workunit.client.0.smithi003.stderr: -127> 2023-12-03T11:49:09.438+0000 7f81245ab800 10 monclient: _reopen_session rank -1 2023-12-03T11:49:09.571 INFO:tasks.workunit.client.0.smithi003.stderr: -126> 2023-12-03T11:49:09.438+0000 7f81245ab800 10 monclient: _add_conns ranks=[0,1,2] 2023-12-03T11:49:09.571 INFO:tasks.workunit.client.0.smithi003.stderr: -125> 2023-12-03T11:49:09.438+0000 7f81245ab800 10 monclient(hunting): picked mon.noname-a con 0x5632d4bf8540 addr [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] 2023-12-03T11:49:09.571 INFO:tasks.workunit.client.0.smithi003.stderr: -124> 2023-12-03T11:49:09.438+0000 7f81245ab800 10 monclient(hunting): picked mon.noname-b con 0x5632d4bf95b0 addr [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] 2023-12-03T11:49:09.571 INFO:tasks.workunit.client.0.smithi003.stderr: -123> 2023-12-03T11:49:09.438+0000 7f81245ab800 10 monclient(hunting): picked mon.noname-c con 0x5632d4bfcbd0 addr [v2:172.21.15.3:3301/0,v1:172.21.15.3:6790/0] 2023-12-03T11:49:09.571 INFO:tasks.workunit.client.0.smithi003.stderr: -122> 2023-12-03T11:49:09.438+0000 7f81245ab800 10 monclient(hunting): start opening mon connection 2023-12-03T11:49:09.571 INFO:tasks.workunit.client.0.smithi003.stderr: -121> 2023-12-03T11:49:09.438+0000 7f81245ab800 10 monclient(hunting): start opening mon connection 2023-12-03T11:49:09.571 INFO:tasks.workunit.client.0.smithi003.stderr: -120> 2023-12-03T11:49:09.438+0000 7f81245ab800 10 monclient(hunting): start opening mon connection 2023-12-03T11:49:09.571 INFO:tasks.workunit.client.0.smithi003.stderr: -119> 2023-12-03T11:49:09.438+0000 7f81245ab800 10 monclient(hunting): _renew_subs 2023-12-03T11:49:09.571 INFO:tasks.workunit.client.0.smithi003.stderr: -118> 2023-12-03T11:49:09.438+0000 7f81245ab800 10 monclient(hunting): authenticate will time out at 1771.676633s 2023-12-03T11:49:09.571 INFO:tasks.workunit.client.0.smithi003.stderr: -117> 2023-12-03T11:49:09.438+0000 7f81228ac640 10 monclient(hunting): get_auth_request con 0x5632d4bf8540 auth_method 0 2023-12-03T11:49:09.572 INFO:tasks.workunit.client.0.smithi003.stderr: -116> 2023-12-03T11:49:09.438+0000 7f81228ac640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:49:09.572 INFO:tasks.workunit.client.0.smithi003.stderr: -115> 2023-12-03T11:49:09.438+0000 7f81228ac640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:49:09.572 INFO:tasks.workunit.client.0.smithi003.stderr: -114> 2023-12-03T11:49:09.438+0000 7f81228ac640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:49:09.572 INFO:tasks.workunit.client.0.smithi003.stderr: -113> 2023-12-03T11:49:09.438+0000 7f81218aa640 10 monclient(hunting): get_auth_request con 0x5632d4bfcbd0 auth_method 0 2023-12-03T11:49:09.572 INFO:tasks.workunit.client.0.smithi003.stderr: -112> 2023-12-03T11:49:09.438+0000 7f81218aa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:49:09.572 INFO:tasks.workunit.client.0.smithi003.stderr: -111> 2023-12-03T11:49:09.438+0000 7f81218aa640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:49:09.572 INFO:tasks.workunit.client.0.smithi003.stderr: -110> 2023-12-03T11:49:09.438+0000 7f81218aa640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:49:09.572 INFO:tasks.workunit.client.0.smithi003.stderr: -109> 2023-12-03T11:49:09.438+0000 7f81228ac640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:49:09.572 INFO:tasks.workunit.client.0.smithi003.stderr: -108> 2023-12-03T11:49:09.438+0000 7f81228ac640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:49:09.572 INFO:tasks.workunit.client.0.smithi003.stderr: -107> 2023-12-03T11:49:09.438+0000 7f81228ac640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:49:09.572 INFO:tasks.workunit.client.0.smithi003.stderr: -106> 2023-12-03T11:49:09.438+0000 7f81218aa640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:49:09.572 INFO:tasks.workunit.client.0.smithi003.stderr: -105> 2023-12-03T11:49:09.438+0000 7f81218aa640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:49:09.572 INFO:tasks.workunit.client.0.smithi003.stderr: -104> 2023-12-03T11:49:09.438+0000 7f81218aa640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:49:09.572 INFO:tasks.workunit.client.0.smithi003.stderr: -103> 2023-12-03T11:49:09.438+0000 7f81220ab640 10 monclient(hunting): get_auth_request con 0x5632d4bf95b0 auth_method 0 2023-12-03T11:49:09.572 INFO:tasks.workunit.client.0.smithi003.stderr: -102> 2023-12-03T11:49:09.438+0000 7f81220ab640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:49:09.573 INFO:tasks.workunit.client.0.smithi003.stderr: -101> 2023-12-03T11:49:09.438+0000 7f81220ab640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:49:09.573 INFO:tasks.workunit.client.0.smithi003.stderr: -100> 2023-12-03T11:49:09.438+0000 7f81220ab640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:49:09.573 INFO:tasks.workunit.client.0.smithi003.stderr: -99> 2023-12-03T11:49:09.438+0000 7f81220ab640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:49:09.573 INFO:tasks.workunit.client.0.smithi003.stderr: -98> 2023-12-03T11:49:09.438+0000 7f81220ab640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:49:09.573 INFO:tasks.workunit.client.0.smithi003.stderr: -97> 2023-12-03T11:49:09.438+0000 7f81220ab640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:49:09.573 INFO:tasks.workunit.client.0.smithi003.stderr: -96> 2023-12-03T11:49:09.438+0000 7f81228ac640 10 monclient(hunting): handle_auth_done global_id 7089 payload 824 2023-12-03T11:49:09.573 INFO:tasks.workunit.client.0.smithi003.stderr: -95> 2023-12-03T11:49:09.438+0000 7f81228ac640 10 monclient: _finish_hunting 0 2023-12-03T11:49:09.573 INFO:tasks.workunit.client.0.smithi003.stderr: -94> 2023-12-03T11:49:09.438+0000 7f81228ac640 1 monclient: found mon.noname-a 2023-12-03T11:49:09.573 INFO:tasks.workunit.client.0.smithi003.stderr: -93> 2023-12-03T11:49:09.438+0000 7f81228ac640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.3:3300/0 2023-12-03T11:49:09.573 INFO:tasks.workunit.client.0.smithi003.stderr: -92> 2023-12-03T11:49:09.438+0000 7f80e5fe3640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:49:09.573 INFO:tasks.workunit.client.0.smithi003.stderr: -91> 2023-12-03T11:49:09.438+0000 7f80e5fe3640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-12-03T11:49:09.573 INFO:tasks.workunit.client.0.smithi003.stderr: -90> 2023-12-03T11:49:09.438+0000 7f80e5fe3640 10 monclient: dump: 2023-12-03T11:49:09.573 INFO:tasks.workunit.client.0.smithi003.stderr:epoch 1 2023-12-03T11:49:09.573 INFO:tasks.workunit.client.0.smithi003.stderr:fsid 296556de-a4fc-4095-9b6d-0fe813c2865c 2023-12-03T11:49:09.573 INFO:tasks.workunit.client.0.smithi003.stderr:last_changed 2023-12-03T11:33:18.862564+0000 2023-12-03T11:49:09.574 INFO:tasks.workunit.client.0.smithi003.stderr:created 2023-12-03T11:33:18.862564+0000 2023-12-03T11:49:09.574 INFO:tasks.workunit.client.0.smithi003.stderr:min_mon_release 18 (reef) 2023-12-03T11:49:09.574 INFO:tasks.workunit.client.0.smithi003.stderr:election_strategy: 1 2023-12-03T11:49:09.574 INFO:tasks.workunit.client.0.smithi003.stderr:0: [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] mon.a 2023-12-03T11:49:09.574 INFO:tasks.workunit.client.0.smithi003.stderr:1: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.b 2023-12-03T11:49:09.574 INFO:tasks.workunit.client.0.smithi003.stderr:2: [v2:172.21.15.3:3301/0,v1:172.21.15.3:6790/0] mon.c 2023-12-03T11:49:09.574 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:49:09.574 INFO:tasks.workunit.client.0.smithi003.stderr: -89> 2023-12-03T11:49:09.438+0000 7f80e5fe3640 10 monclient: _finish_auth 0 2023-12-03T11:49:09.574 INFO:tasks.workunit.client.0.smithi003.stderr: -88> 2023-12-03T11:49:09.438+0000 7f80e5fe3640 10 monclient: _check_auth_tickets 2023-12-03T11:49:09.574 INFO:tasks.workunit.client.0.smithi003.stderr: -87> 2023-12-03T11:49:09.438+0000 7f80e5fe3640 10 monclient: handle_config config(0 keys) v1 2023-12-03T11:49:09.574 INFO:tasks.workunit.client.0.smithi003.stderr: -86> 2023-12-03T11:49:09.438+0000 7f80e5fe3640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:49:09.574 INFO:tasks.workunit.client.0.smithi003.stderr: -85> 2023-12-03T11:49:09.438+0000 7f80e5fe3640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-12-03T11:49:09.574 INFO:tasks.workunit.client.0.smithi003.stderr: -84> 2023-12-03T11:49:09.438+0000 7f80e5fe3640 10 monclient: dump: 2023-12-03T11:49:09.575 INFO:tasks.workunit.client.0.smithi003.stderr:epoch 1 2023-12-03T11:49:09.575 INFO:tasks.workunit.client.0.smithi003.stderr:fsid 296556de-a4fc-4095-9b6d-0fe813c2865c 2023-12-03T11:49:09.575 INFO:tasks.workunit.client.0.smithi003.stderr:last_changed 2023-12-03T11:33:18.862564+0000 2023-12-03T11:49:09.575 INFO:tasks.workunit.client.0.smithi003.stderr:created 2023-12-03T11:33:18.862564+0000 2023-12-03T11:49:09.575 INFO:tasks.workunit.client.0.smithi003.stderr:min_mon_release 18 (reef) 2023-12-03T11:49:09.575 INFO:tasks.workunit.client.0.smithi003.stderr:election_strategy: 1 2023-12-03T11:49:09.575 INFO:tasks.workunit.client.0.smithi003.stderr:0: [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] mon.a 2023-12-03T11:49:09.575 INFO:tasks.workunit.client.0.smithi003.stderr:1: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.b 2023-12-03T11:49:09.575 INFO:tasks.workunit.client.0.smithi003.stderr:2: [v2:172.21.15.3:3301/0,v1:172.21.15.3:6790/0] mon.c 2023-12-03T11:49:09.575 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:49:09.575 INFO:tasks.workunit.client.0.smithi003.stderr: -83> 2023-12-03T11:49:09.439+0000 7f81245ab800 5 monclient: authenticate success, global_id 7089 2023-12-03T11:49:09.575 INFO:tasks.workunit.client.0.smithi003.stderr: -82> 2023-12-03T11:49:09.438+0000 7f80e77e6640 4 set_mon_vals no callback set 2023-12-03T11:49:09.575 INFO:tasks.workunit.client.0.smithi003.stderr: -81> 2023-12-03T11:49:09.439+0000 7f81245ab800 10 monclient: _renew_subs 2023-12-03T11:49:09.576 INFO:tasks.workunit.client.0.smithi003.stderr: -80> 2023-12-03T11:49:09.439+0000 7f81245ab800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.3:3300/0 2023-12-03T11:49:09.576 INFO:tasks.workunit.client.0.smithi003.stderr: -79> 2023-12-03T11:49:09.439+0000 7f81245ab800 10 monclient: _renew_subs 2023-12-03T11:49:09.576 INFO:tasks.workunit.client.0.smithi003.stderr: -78> 2023-12-03T11:49:09.439+0000 7f81245ab800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.3:3300/0 2023-12-03T11:49:09.576 INFO:tasks.workunit.client.0.smithi003.stderr: -77> 2023-12-03T11:49:09.439+0000 7f81245ab800 1 librados: init done 2023-12-03T11:49:09.576 INFO:tasks.workunit.client.0.smithi003.stderr: -76> 2023-12-03T11:49:09.439+0000 7f81245ab800 5 asok(0x5632d495ea10) register_command cr dump hook 0x5632d4befd48 2023-12-03T11:49:09.576 INFO:tasks.workunit.client.0.smithi003.stderr: -75> 2023-12-03T11:49:09.440+0000 7f80e5fe3640 4 mgrc handle_mgr_map Got map version 5 2023-12-03T11:49:09.576 INFO:tasks.workunit.client.0.smithi003.stderr: -74> 2023-12-03T11:49:09.440+0000 7f80e5fe3640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.37:6832/2165065416,v1:172.21.15.37:6833/2165065416] 2023-12-03T11:49:09.576 INFO:tasks.workunit.client.0.smithi003.stderr: -73> 2023-12-03T11:49:09.440+0000 7f80e5fe3640 4 mgrc reconnect Starting new session with [v2:172.21.15.37:6832/2165065416,v1:172.21.15.37:6833/2165065416] 2023-12-03T11:49:09.576 INFO:tasks.workunit.client.0.smithi003.stderr: -72> 2023-12-03T11:49:09.440+0000 7f81245ab800 5 note: GC not initialized 2023-12-03T11:49:09.576 INFO:tasks.workunit.client.0.smithi003.stderr: -71> 2023-12-03T11:49:09.440+0000 7f81220ab640 10 monclient: get_auth_request con 0x7f805c069820 auth_method 0 2023-12-03T11:49:09.576 INFO:tasks.workunit.client.0.smithi003.stderr: -70> 2023-12-03T11:49:09.441+0000 7f8056ffd640 20 reqs_thread_entry: start 2023-12-03T11:49:09.576 INFO:tasks.workunit.client.0.smithi003.stderr: -69> 2023-12-03T11:49:09.441+0000 7f81245ab800 5 asok(0x5632d495ea10) register_command sync trace show hook 0x7f81140043a0 2023-12-03T11:49:09.576 INFO:tasks.workunit.client.0.smithi003.stderr: -68> 2023-12-03T11:49:09.441+0000 7f81245ab800 5 asok(0x5632d495ea10) register_command sync trace history hook 0x7f81140043a0 2023-12-03T11:49:09.576 INFO:tasks.workunit.client.0.smithi003.stderr: -67> 2023-12-03T11:49:09.441+0000 7f81245ab800 5 asok(0x5632d495ea10) register_command sync trace active hook 0x7f81140043a0 2023-12-03T11:49:09.577 INFO:tasks.workunit.client.0.smithi003.stderr: -66> 2023-12-03T11:49:09.441+0000 7f81245ab800 5 asok(0x5632d495ea10) register_command sync trace active_short hook 0x7f81140043a0 2023-12-03T11:49:09.577 INFO:tasks.workunit.client.0.smithi003.stderr: -65> 2023-12-03T11:49:09.441+0000 7f81245ab800 20 init_complete bucket index max shards: 11 2023-12-03T11:49:09.577 INFO:tasks.workunit.client.0.smithi003.stderr: -64> 2023-12-03T11:49:09.441+0000 7f81245ab800 20 Filter name: none 2023-12-03T11:49:09.577 INFO:tasks.workunit.client.0.smithi003.stderr: -63> 2023-12-03T11:49:09.441+0000 7f8054ff9640 20 reqs_thread_entry: start 2023-12-03T11:49:09.577 INFO:tasks.workunit.client.0.smithi003.stderr: -62> 2023-12-03T11:49:09.441+0000 7f81245ab800 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2023-12-03T11:49:09.577 INFO:tasks.workunit.client.0.smithi003.stderr: -61> 2023-12-03T11:49:09.441+0000 7f81245ab800 20 rados->read ofs=0 len=0 2023-12-03T11:49:09.577 INFO:tasks.workunit.client.0.smithi003.stderr: -60> 2023-12-03T11:49:09.441+0000 7f81245ab800 20 rados_obj.operate() r=0 bl.length=221 2023-12-03T11:49:09.577 INFO:tasks.workunit.client.0.smithi003.stderr: -59> 2023-12-03T11:49:09.441+0000 7f81245ab800 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2023-12-03T11:49:09.577 INFO:tasks.workunit.client.0.smithi003.stderr: -58> 2023-12-03T11:49:09.441+0000 7f81245ab800 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2023-12-03T11:49:09.577 INFO:tasks.workunit.client.0.smithi003.stderr: -57> 2023-12-03T11:49:09.441+0000 7f81245ab800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26 : miss 2023-12-03T11:49:09.577 INFO:tasks.workunit.client.0.smithi003.stderr: -56> 2023-12-03T11:49:09.441+0000 7f81245ab800 20 rados->read ofs=0 len=0 2023-12-03T11:49:09.577 INFO:tasks.workunit.client.0.smithi003.stderr: -55> 2023-12-03T11:49:09.442+0000 7f81245ab800 20 rados_obj.operate() r=0 bl.length=393 2023-12-03T11:49:09.577 INFO:tasks.workunit.client.0.smithi003.stderr: -54> 2023-12-03T11:49:09.442+0000 7f81245ab800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26 info.flags=0x17 2023-12-03T11:49:09.577 INFO:tasks.workunit.client.0.smithi003.stderr: -53> 2023-12-03T11:49:09.442+0000 7f81245ab800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26 to cache LRU end 2023-12-03T11:49:09.578 INFO:tasks.workunit.client.0.smithi003.stderr: -52> 2023-12-03T11:49:09.442+0000 7f81245ab800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:49:09.578 INFO:tasks.workunit.client.0.smithi003.stderr: -51> 2023-12-03T11:49:09.442+0000 7f81245ab800 10 updating xattr: name=user.rgw.acl bl.length()=265 2023-12-03T11:49:09.578 INFO:tasks.workunit.client.0.smithi003.stderr: -50> 2023-12-03T11:49:09.442+0000 7f81245ab800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26 2023-12-03T11:49:09.578 INFO:tasks.workunit.client.0.smithi003.stderr: -49> 2023-12-03T11:49:09.442+0000 7f81218aa640 10 monclient: get_auth_request con 0x5632d4c4ac10 auth_method 0 2023-12-03T11:49:09.578 INFO:tasks.workunit.client.0.smithi003.stderr: -48> 2023-12-03T11:49:09.447+0000 7f81245ab800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26 info.flags=0x17 2023-12-03T11:49:09.578 INFO:tasks.workunit.client.0.smithi003.stderr: -47> 2023-12-03T11:49:09.447+0000 7f81245ab800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26 to cache LRU end 2023-12-03T11:49:09.578 INFO:tasks.workunit.client.0.smithi003.stderr: -46> 2023-12-03T11:49:09.447+0000 7f81245ab800 10 updating xattr: name=user.rgw.acl bl.length()=265 2023-12-03T11:49:09.578 INFO:tasks.workunit.client.0.smithi003.stderr: -45> 2023-12-03T11:49:09.447+0000 7f81245ab800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26, ofs0, ns] 2023-12-03T11:49:09.578 INFO:tasks.workunit.client.0.smithi003.stderr: -44> 2023-12-03T11:49:09.448+0000 7f8110ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660573 cookie 94776317469120 notifier 6680 bl.length()=965 2023-12-03T11:49:09.578 INFO:tasks.workunit.client.0.smithi003.stderr: -43> 2023-12-03T11:49:09.448+0000 7f8110ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26 info.flags=0x17 2023-12-03T11:49:09.578 INFO:tasks.workunit.client.0.smithi003.stderr: -42> 2023-12-03T11:49:09.448+0000 7f8110ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26 to cache LRU end 2023-12-03T11:49:09.578 INFO:tasks.workunit.client.0.smithi003.stderr: -41> 2023-12-03T11:49:09.448+0000 7f8110ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2023-12-03T11:49:09.578 INFO:tasks.workunit.client.0.smithi003.stderr: -40> 2023-12-03T11:49:09.449+0000 7f81245ab800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26]): orig_sources= new_sources= 2023-12-03T11:49:09.579 INFO:tasks.workunit.client.0.smithi003.stderr: -39> 2023-12-03T11:49:09.449+0000 7f81245ab800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26]): potential sources added=[] removed=[] 2023-12-03T11:49:09.579 INFO:tasks.workunit.client.0.smithi003.stderr: -38> 2023-12-03T11:49:09.449+0000 7f81245ab800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26]): orig_dests= new_dests= 2023-12-03T11:49:09.579 INFO:tasks.workunit.client.0.smithi003.stderr: -37> 2023-12-03T11:49:09.449+0000 7f81245ab800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26]): potential dests added=[] removed=[] 2023-12-03T11:49:09.579 INFO:tasks.workunit.client.0.smithi003.stderr: -36> 2023-12-03T11:49:09.452+0000 7f81245ab800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26.1.0 2023-12-03T11:49:09.579 INFO:tasks.workunit.client.0.smithi003.stderr: -35> 2023-12-03T11:49:09.452+0000 7f81245ab800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26.1.0 2023-12-03T11:49:09.579 INFO:tasks.workunit.client.0.smithi003.stderr: -34> 2023-12-03T11:49:09.452+0000 7f81245ab800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26.1.1 2023-12-03T11:49:09.579 INFO:tasks.workunit.client.0.smithi003.stderr: -33> 2023-12-03T11:49:09.452+0000 7f81245ab800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26.1.1 2023-12-03T11:49:09.579 INFO:tasks.workunit.client.0.smithi003.stderr: -32> 2023-12-03T11:49:09.452+0000 7f81245ab800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26.1.2 2023-12-03T11:49:09.579 INFO:tasks.workunit.client.0.smithi003.stderr: -31> 2023-12-03T11:49:09.452+0000 7f81245ab800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26.1.2 2023-12-03T11:49:09.579 INFO:tasks.workunit.client.0.smithi003.stderr: -30> 2023-12-03T11:49:09.452+0000 7f81245ab800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26.1.3 2023-12-03T11:49:09.579 INFO:tasks.workunit.client.0.smithi003.stderr: -29> 2023-12-03T11:49:09.452+0000 7f81245ab800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26.1.3 2023-12-03T11:49:09.579 INFO:tasks.workunit.client.0.smithi003.stderr: -28> 2023-12-03T11:49:09.452+0000 7f81245ab800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26.1.4 2023-12-03T11:49:09.579 INFO:tasks.workunit.client.0.smithi003.stderr: -27> 2023-12-03T11:49:09.452+0000 7f81245ab800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26.1.4 2023-12-03T11:49:09.579 INFO:tasks.workunit.client.0.smithi003.stderr: -26> 2023-12-03T11:49:09.452+0000 7f81245ab800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26.1.5 2023-12-03T11:49:09.580 INFO:tasks.workunit.client.0.smithi003.stderr: -25> 2023-12-03T11:49:09.452+0000 7f81245ab800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26.1.5 2023-12-03T11:49:09.580 INFO:tasks.workunit.client.0.smithi003.stderr: -24> 2023-12-03T11:49:09.452+0000 7f81245ab800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26.1.6 2023-12-03T11:49:09.580 INFO:tasks.workunit.client.0.smithi003.stderr: -23> 2023-12-03T11:49:09.452+0000 7f81245ab800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26.1.6 2023-12-03T11:49:09.580 INFO:tasks.workunit.client.0.smithi003.stderr: -22> 2023-12-03T11:49:09.452+0000 7f81245ab800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26.1.7 2023-12-03T11:49:09.580 INFO:tasks.workunit.client.0.smithi003.stderr: -21> 2023-12-03T11:49:09.452+0000 7f81245ab800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26.1.7 2023-12-03T11:49:09.580 INFO:tasks.workunit.client.0.smithi003.stderr: -20> 2023-12-03T11:49:09.452+0000 7f81245ab800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26.1.8 2023-12-03T11:49:09.580 INFO:tasks.workunit.client.0.smithi003.stderr: -19> 2023-12-03T11:49:09.452+0000 7f81245ab800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26.1.8 2023-12-03T11:49:09.580 INFO:tasks.workunit.client.0.smithi003.stderr: -18> 2023-12-03T11:49:09.452+0000 7f81245ab800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26.1.9 2023-12-03T11:49:09.580 INFO:tasks.workunit.client.0.smithi003.stderr: -17> 2023-12-03T11:49:09.452+0000 7f81245ab800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26.1.9 2023-12-03T11:49:09.580 INFO:tasks.workunit.client.0.smithi003.stderr: -16> 2023-12-03T11:49:09.452+0000 7f81245ab800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26.1.10 2023-12-03T11:49:09.580 INFO:tasks.workunit.client.0.smithi003.stderr: -15> 2023-12-03T11:49:09.452+0000 7f81245ab800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26.1.10 2023-12-03T11:49:09.580 INFO:tasks.workunit.client.0.smithi003.stderr: -14> 2023-12-03T11:49:09.452+0000 7f81245ab800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26.1.11 2023-12-03T11:49:09.580 INFO:tasks.workunit.client.0.smithi003.stderr: -13> 2023-12-03T11:49:09.452+0000 7f81245ab800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26.1.11 2023-12-03T11:49:09.581 INFO:tasks.workunit.client.0.smithi003.stderr: -12> 2023-12-03T11:49:09.452+0000 7f81245ab800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26.0 2023-12-03T11:49:09.581 INFO:tasks.workunit.client.0.smithi003.stderr: -11> 2023-12-03T11:49:09.452+0000 7f81245ab800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26.1 2023-12-03T11:49:09.581 INFO:tasks.workunit.client.0.smithi003.stderr: -10> 2023-12-03T11:49:09.453+0000 7f81245ab800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26.2 2023-12-03T11:49:09.581 INFO:tasks.workunit.client.0.smithi003.stderr: -9> 2023-12-03T11:49:09.453+0000 7f81245ab800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26.3 2023-12-03T11:49:09.581 INFO:tasks.workunit.client.0.smithi003.stderr: -8> 2023-12-03T11:49:09.454+0000 7f81245ab800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26.4 2023-12-03T11:49:09.581 INFO:tasks.workunit.client.0.smithi003.stderr: -7> 2023-12-03T11:49:09.454+0000 7f81245ab800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26.5 2023-12-03T11:49:09.581 INFO:tasks.workunit.client.0.smithi003.stderr: -6> 2023-12-03T11:49:09.455+0000 7f81245ab800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26.6 2023-12-03T11:49:09.581 INFO:tasks.workunit.client.0.smithi003.stderr: -5> 2023-12-03T11:49:09.455+0000 7f81245ab800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26.7 2023-12-03T11:49:09.581 INFO:tasks.workunit.client.0.smithi003.stderr: -4> 2023-12-03T11:49:09.456+0000 7f81245ab800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26.8 2023-12-03T11:49:09.581 INFO:tasks.workunit.client.0.smithi003.stderr: -3> 2023-12-03T11:49:09.456+0000 7f81245ab800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26.9 2023-12-03T11:49:09.581 INFO:tasks.workunit.client.0.smithi003.stderr: -2> 2023-12-03T11:49:09.457+0000 7f81245ab800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26.10 2023-12-03T11:49:09.581 INFO:tasks.workunit.client.0.smithi003.stderr: -1> 2023-12-03T11:49:09.460+0000 7f81245ab800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7537-gbcbf278c/rpm/el9/BUILD/ceph-18.0.0-7537-gbcbf278c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f81245ab800 time 2023-12-03T11:49:09.460738+0000 2023-12-03T11:49:09.581 INFO:tasks.workunit.client.0.smithi003.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7537-gbcbf278c/rpm/el9/BUILD/ceph-18.0.0-7537-gbcbf278c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2023-12-03T11:49:09.581 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:49:09.582 INFO:tasks.workunit.client.0.smithi003.stderr: ceph version 18.0.0-7537-gbcbf278c (bcbf278cf395873c2a482f5a7b2345faf2160319) reef (dev) 2023-12-03T11:49:09.582 INFO:tasks.workunit.client.0.smithi003.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f8128f6eef8] 2023-12-03T11:49:09.582 INFO:tasks.workunit.client.0.smithi003.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f0b6) [0x7f8128f6f0b6] 2023-12-03T11:49:09.582 INFO:tasks.workunit.client.0.smithi003.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5632d4144a71] 2023-12-03T11:49:09.582 INFO:tasks.workunit.client.0.smithi003.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x5b8) [0x5632d41511d8] 2023-12-03T11:49:09.582 INFO:tasks.workunit.client.0.smithi003.stderr: 5: main() 2023-12-03T11:49:09.582 INFO:tasks.workunit.client.0.smithi003.stderr: 6: /lib64/libc.so.6(+0x3feb0) [0x7f812683feb0] 2023-12-03T11:49:09.582 INFO:tasks.workunit.client.0.smithi003.stderr: 7: __libc_start_main() 2023-12-03T11:49:09.582 INFO:tasks.workunit.client.0.smithi003.stderr: 8: _start() 2023-12-03T11:49:09.582 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:49:09.582 INFO:tasks.workunit.client.0.smithi003.stderr: 0> 2023-12-03T11:49:09.461+0000 7f81245ab800 -1 *** Caught signal (Aborted) ** 2023-12-03T11:49:09.582 INFO:tasks.workunit.client.0.smithi003.stderr: in thread 7f81245ab800 thread_name:radosgw-admin 2023-12-03T11:49:09.582 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:49:09.583 INFO:tasks.workunit.client.0.smithi003.stderr: ceph version 18.0.0-7537-gbcbf278c (bcbf278cf395873c2a482f5a7b2345faf2160319) reef (dev) 2023-12-03T11:49:09.583 INFO:tasks.workunit.client.0.smithi003.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f8126854db0] 2023-12-03T11:49:09.583 INFO:tasks.workunit.client.0.smithi003.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f81268a154c] 2023-12-03T11:49:09.583 INFO:tasks.workunit.client.0.smithi003.stderr: 3: raise() 2023-12-03T11:49:09.583 INFO:tasks.workunit.client.0.smithi003.stderr: 4: abort() 2023-12-03T11:49:09.583 INFO:tasks.workunit.client.0.smithi003.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f8128f6ef52] 2023-12-03T11:49:09.583 INFO:tasks.workunit.client.0.smithi003.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f0b6) [0x7f8128f6f0b6] 2023-12-03T11:49:09.583 INFO:tasks.workunit.client.0.smithi003.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5632d4144a71] 2023-12-03T11:49:09.583 INFO:tasks.workunit.client.0.smithi003.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x5b8) [0x5632d41511d8] 2023-12-03T11:49:09.583 INFO:tasks.workunit.client.0.smithi003.stderr: 9: main() 2023-12-03T11:49:09.583 INFO:tasks.workunit.client.0.smithi003.stderr: 10: /lib64/libc.so.6(+0x3feb0) [0x7f812683feb0] 2023-12-03T11:49:09.583 INFO:tasks.workunit.client.0.smithi003.stderr: 11: __libc_start_main() 2023-12-03T11:49:09.583 INFO:tasks.workunit.client.0.smithi003.stderr: 12: _start() 2023-12-03T11:49:09.583 INFO:tasks.workunit.client.0.smithi003.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-12-03T11:49:09.583 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:49:09.584 INFO:tasks.workunit.client.0.smithi003.stderr:--- logging levels --- 2023-12-03T11:49:09.584 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 none 2023-12-03T11:49:09.584 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 1 lockdep 2023-12-03T11:49:09.584 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 1 context 2023-12-03T11:49:09.584 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 1 crush 2023-12-03T11:49:09.584 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 mds 2023-12-03T11:49:09.584 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 mds_balancer 2023-12-03T11:49:09.584 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 mds_locker 2023-12-03T11:49:09.584 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 mds_log 2023-12-03T11:49:09.584 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 mds_log_expire 2023-12-03T11:49:09.584 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 mds_migrator 2023-12-03T11:49:09.584 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 1 buffer 2023-12-03T11:49:09.585 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 1 timer 2023-12-03T11:49:09.585 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 1 filer 2023-12-03T11:49:09.585 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 1 striper 2023-12-03T11:49:09.585 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 1 objecter 2023-12-03T11:49:09.585 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 rados 2023-12-03T11:49:09.585 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 rbd 2023-12-03T11:49:09.585 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 rbd_mirror 2023-12-03T11:49:09.585 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 rbd_replay 2023-12-03T11:49:09.585 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 rbd_pwl 2023-12-03T11:49:09.585 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 journaler 2023-12-03T11:49:09.585 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 objectcacher 2023-12-03T11:49:09.585 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 immutable_obj_cache 2023-12-03T11:49:09.585 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 client 2023-12-03T11:49:09.585 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 osd 2023-12-03T11:49:09.585 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 optracker 2023-12-03T11:49:09.586 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 objclass 2023-12-03T11:49:09.586 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 3 filestore 2023-12-03T11:49:09.586 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 3 journal 2023-12-03T11:49:09.586 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 0 ms 2023-12-03T11:49:09.586 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 mon 2023-12-03T11:49:09.586 INFO:tasks.workunit.client.0.smithi003.stderr: 0/10 monc 2023-12-03T11:49:09.586 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 paxos 2023-12-03T11:49:09.586 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 tp 2023-12-03T11:49:09.586 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 auth 2023-12-03T11:49:09.586 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 crypto 2023-12-03T11:49:09.586 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 1 finisher 2023-12-03T11:49:09.586 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 1 reserver 2023-12-03T11:49:09.586 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 heartbeatmap 2023-12-03T11:49:09.586 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 perfcounter 2023-12-03T11:49:09.586 INFO:tasks.workunit.client.0.smithi003.stderr: 20/20 rgw 2023-12-03T11:49:09.587 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 rgw_sync 2023-12-03T11:49:09.587 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 rgw_datacache 2023-12-03T11:49:09.587 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 rgw_access 2023-12-03T11:49:09.587 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 rgw_dbstore 2023-12-03T11:49:09.587 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 rgw_flight 2023-12-03T11:49:09.587 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 javaclient 2023-12-03T11:49:09.587 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 asok 2023-12-03T11:49:09.587 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 1 throttle 2023-12-03T11:49:09.587 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 0 refs 2023-12-03T11:49:09.587 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 compressor 2023-12-03T11:49:09.588 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 bluestore 2023-12-03T11:49:09.588 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 bluefs 2023-12-03T11:49:09.588 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 3 bdev 2023-12-03T11:49:09.588 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 kstore 2023-12-03T11:49:09.588 INFO:tasks.workunit.client.0.smithi003.stderr: 4/ 5 rocksdb 2023-12-03T11:49:09.588 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 fuse 2023-12-03T11:49:09.588 INFO:tasks.workunit.client.0.smithi003.stderr: 2/ 5 mgr 2023-12-03T11:49:09.588 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 mgrc 2023-12-03T11:49:09.588 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 dpdk 2023-12-03T11:49:09.588 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 eventtrace 2023-12-03T11:49:09.588 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 prioritycache 2023-12-03T11:49:09.588 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 test 2023-12-03T11:49:09.588 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 cephfs_mirror 2023-12-03T11:49:09.588 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 cephsqlite 2023-12-03T11:49:09.588 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 crimson_interrupt 2023-12-03T11:49:09.589 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 seastore 2023-12-03T11:49:09.589 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 seastore_onode 2023-12-03T11:49:09.589 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 seastore_odata 2023-12-03T11:49:09.589 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 seastore_omap 2023-12-03T11:49:09.589 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 seastore_tm 2023-12-03T11:49:09.589 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 seastore_t 2023-12-03T11:49:09.589 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 seastore_cleaner 2023-12-03T11:49:09.589 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 seastore_epm 2023-12-03T11:49:09.589 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 seastore_lba 2023-12-03T11:49:09.589 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 seastore_fixedkv_tree 2023-12-03T11:49:09.589 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 seastore_cache 2023-12-03T11:49:09.589 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 seastore_journal 2023-12-03T11:49:09.589 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 seastore_device 2023-12-03T11:49:09.589 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 seastore_backref 2023-12-03T11:49:09.589 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 alienstore 2023-12-03T11:49:09.590 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 mclock 2023-12-03T11:49:09.590 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 cyanstore 2023-12-03T11:49:09.590 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 ceph_exporter 2023-12-03T11:49:09.590 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 memstore 2023-12-03T11:49:09.590 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 trace 2023-12-03T11:49:09.590 INFO:tasks.workunit.client.0.smithi003.stderr: -2/-2 (syslog threshold) 2023-12-03T11:49:09.590 INFO:tasks.workunit.client.0.smithi003.stderr: 99/99 (stderr threshold) 2023-12-03T11:49:09.590 INFO:tasks.workunit.client.0.smithi003.stderr:--- pthread ID / name mapping for recent threads --- 2023-12-03T11:49:09.590 INFO:tasks.workunit.client.0.smithi003.stderr: 7f8054ff9640 / http_manager 2023-12-03T11:49:09.590 INFO:tasks.workunit.client.0.smithi003.stderr: 7f8056ffd640 / http_manager 2023-12-03T11:49:09.590 INFO:tasks.workunit.client.0.smithi003.stderr: 7f80e5fe3640 / ms_dispatch 2023-12-03T11:49:09.590 INFO:tasks.workunit.client.0.smithi003.stderr: 7f80e77e6640 / io_context_pool 2023-12-03T11:49:09.590 INFO:tasks.workunit.client.0.smithi003.stderr: 7f80e7fe7640 / rgw_dt_lg_renew 2023-12-03T11:49:09.590 INFO:tasks.workunit.client.0.smithi003.stderr: 7f8102ffd640 / ms_dispatch 2023-12-03T11:49:09.591 INFO:tasks.workunit.client.0.smithi003.stderr: 7f8110ff9640 / io_context_pool 2023-12-03T11:49:09.591 INFO:tasks.workunit.client.0.smithi003.stderr: 7f81137fe640 / ms_dispatch 2023-12-03T11:49:09.591 INFO:tasks.workunit.client.0.smithi003.stderr: 7f81218aa640 / msgr-worker-2 2023-12-03T11:49:09.591 INFO:tasks.workunit.client.0.smithi003.stderr: 7f81220ab640 / msgr-worker-1 2023-12-03T11:49:09.591 INFO:tasks.workunit.client.0.smithi003.stderr: 7f81228ac640 / msgr-worker-0 2023-12-03T11:49:09.591 INFO:tasks.workunit.client.0.smithi003.stderr: 7f81245ab800 / radosgw-admin 2023-12-03T11:49:09.591 INFO:tasks.workunit.client.0.smithi003.stderr: max_recent 500 2023-12-03T11:49:09.591 INFO:tasks.workunit.client.0.smithi003.stderr: max_new 1000 2023-12-03T11:49:09.591 INFO:tasks.workunit.client.0.smithi003.stderr: log_file /var/lib/ceph/crash/2023-12-03T11:49:09.462109Z_865effb9-198d-4ae3-afef-a3e88c4762d5/log 2023-12-03T11:49:09.591 INFO:tasks.workunit.client.0.smithi003.stderr:--- end dump of recent events --- 2023-12-03T11:49:09.591 INFO:tasks.workunit.client.0.smithi003.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2023-12-03T11:49:09.596 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:49:09.596 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:49:09.597 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.509+0000 7fe203d3e800 20 rados->read ofs=0 len=0 2023-12-03T11:49:09.597 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.510+0000 7fe203d3e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:09.597 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.510+0000 7fe203d3e800 20 realm 2023-12-03T11:49:09.597 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.510+0000 7fe203d3e800 20 rados->read ofs=0 len=0 2023-12-03T11:49:09.597 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.511+0000 7fe203d3e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:09.597 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.511+0000 7fe203d3e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:49:09.597 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.511+0000 7fe203d3e800 20 rados->read ofs=0 len=0 2023-12-03T11:49:09.597 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.511+0000 7fe203d3e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:09.597 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.511+0000 7fe203d3e800 20 rados->read ofs=0 len=0 2023-12-03T11:49:09.597 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.512+0000 7fe203d3e800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:49:09.597 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.512+0000 7fe203d3e800 20 rados->read ofs=0 len=0 2023-12-03T11:49:09.597 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.512+0000 7fe203d3e800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:49:09.597 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.512+0000 7fe203d3e800 20 searching for the correct realm 2023-12-03T11:49:09.597 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.522+0000 7fe1ffb03640 0 -- 172.21.15.3:0/3557440694 >> [v2:172.21.15.37:6805/1692844418,v1:172.21.15.37:6807/1692844418] conn(0x55848a00f8f0 msgr2=0x55848a011ce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:49:09.598 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.524+0000 7fe203d3e800 20 RGWRados::pool_iterate: got zone_info.83aabb46-04b5-4c96-9933-c6bfb1173a73 2023-12-03T11:49:09.598 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.524+0000 7fe203d3e800 20 RGWRados::pool_iterate: got zonegroup_info.6a811aad-435d-4fdd-93c9-b7e0b50de429 2023-12-03T11:49:09.598 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.524+0000 7fe203d3e800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:49:09.598 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.524+0000 7fe203d3e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:49:09.598 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.524+0000 7fe203d3e800 20 rados->read ofs=0 len=0 2023-12-03T11:49:09.598 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.524+0000 7fe203d3e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:09.598 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.524+0000 7fe203d3e800 20 rados->read ofs=0 len=0 2023-12-03T11:49:09.598 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.525+0000 7fe203d3e800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:49:09.598 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.525+0000 7fe203d3e800 20 rados->read ofs=0 len=0 2023-12-03T11:49:09.598 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.525+0000 7fe203d3e800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:49:09.598 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.525+0000 7fe203d3e800 20 zone default found 2023-12-03T11:49:09.598 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.525+0000 7fe203d3e800 4 Realm: () 2023-12-03T11:49:09.598 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.525+0000 7fe203d3e800 4 ZoneGroup: default (6a811aad-435d-4fdd-93c9-b7e0b50de429) 2023-12-03T11:49:09.598 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.525+0000 7fe203d3e800 4 Zone: default (83aabb46-04b5-4c96-9933-c6bfb1173a73) 2023-12-03T11:49:09.599 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.525+0000 7fe203d3e800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:49:09.599 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.525+0000 7fe203d3e800 20 zonegroup default 2023-12-03T11:49:09.599 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.525+0000 7fe203d3e800 20 rados->read ofs=0 len=0 2023-12-03T11:49:09.599 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.525+0000 7fe203d3e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:09.599 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.525+0000 7fe203d3e800 20 rados->read ofs=0 len=0 2023-12-03T11:49:09.599 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.526+0000 7fe203d3e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:09.599 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.526+0000 7fe203d3e800 20 rados->read ofs=0 len=0 2023-12-03T11:49:09.599 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.526+0000 7fe203d3e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:09.599 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.526+0000 7fe203d3e800 20 started sync module instance, tier type = 2023-12-03T11:49:09.599 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.526+0000 7fe203d3e800 20 started zone id=83aabb46-04b5-4c96-9933-c6bfb1173a73 (name=default) with tier type = 2023-12-03T11:49:09.599 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.532+0000 7fe200304640 0 -- 172.21.15.3:0/3557440694 >> [v2:172.21.15.37:6816/3770469300,v1:172.21.15.37:6818/3770469300] conn(0x7fe1f4037040 msgr2=0x7fe1f4026450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:49:09.599 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.536+0000 7fe203d3e800 20 add_watcher() i=0 2023-12-03T11:49:09.599 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.536+0000 7fe203d3e800 20 add_watcher() i=1 2023-12-03T11:49:09.599 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.536+0000 7fe203d3e800 20 add_watcher() i=2 2023-12-03T11:49:09.599 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.536+0000 7fe203d3e800 20 add_watcher() i=3 2023-12-03T11:49:09.600 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.536+0000 7fe203d3e800 20 add_watcher() i=4 2023-12-03T11:49:09.600 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.536+0000 7fe203d3e800 20 add_watcher() i=5 2023-12-03T11:49:09.600 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.536+0000 7fe203d3e800 20 add_watcher() i=6 2023-12-03T11:49:09.600 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.536+0000 7fe203d3e800 20 add_watcher() i=7 2023-12-03T11:49:09.600 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.536+0000 7fe203d3e800 2 all 8 watchers are set, enabling cache 2023-12-03T11:49:09.600 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.538+0000 7fe1c5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:49:09.600 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.538+0000 7fe203d3e800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:49:09.600 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.538+0000 7fe203d3e800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:49:09.600 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.545+0000 7fe203d3e800 5 note: GC not initialized 2023-12-03T11:49:09.600 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.545+0000 7fe13cff9640 20 reqs_thread_entry: start 2023-12-03T11:49:09.600 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.545+0000 7fe203d3e800 20 init_complete bucket index max shards: 11 2023-12-03T11:49:09.600 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.545+0000 7fe203d3e800 20 Filter name: none 2023-12-03T11:49:09.600 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.545+0000 7fe1327fc640 20 reqs_thread_entry: start 2023-12-03T11:49:09.600 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.545+0000 7fe203d3e800 20 rados->read ofs=0 len=0 2023-12-03T11:49:09.600 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.546+0000 7fe203d3e800 20 rados_obj.operate() r=0 bl.length=221 2023-12-03T11:49:09.601 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.546+0000 7fe203d3e800 20 rados->read ofs=0 len=0 2023-12-03T11:49:09.601 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.546+0000 7fe203d3e800 20 rados_obj.operate() r=0 bl.length=425 2023-12-03T11:49:09.601 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.546+0000 7fe203d3e800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:49:09.601 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.546+0000 7fe203d3e800 20 rados->read ofs=0 len=0 2023-12-03T11:49:09.601 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.547+0000 7fe203d3e800 20 rados_obj.operate() r=0 bl.length=221 2023-12-03T11:49:09.601 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.547+0000 7fe203d3e800 20 rados->read ofs=0 len=0 2023-12-03T11:49:09.601 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.547+0000 7fe203d3e800 20 rados_obj.operate() r=0 bl.length=425 2023-12-03T11:49:09.601 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.547+0000 7fe203d3e800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:49:09.601 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.548+0000 7fe203d3e800 20 rados->read ofs=0 len=0 2023-12-03T11:49:09.601 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.548+0000 7fe203d3e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:09.601 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.549+0000 7fe1c5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:49:09.601 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.551+0000 7fe203d3e800 20 remove_watcher() i=0 2023-12-03T11:49:09.601 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.551+0000 7fe203d3e800 2 removed watcher, disabling cache 2023-12-03T11:49:09.601 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.552+0000 7fe203d3e800 20 remove_watcher() i=1 2023-12-03T11:49:09.602 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.554+0000 7fe203d3e800 20 remove_watcher() i=2 2023-12-03T11:49:09.602 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.555+0000 7fe203d3e800 20 remove_watcher() i=3 2023-12-03T11:49:09.602 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.556+0000 7fe203d3e800 20 remove_watcher() i=4 2023-12-03T11:49:09.602 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.557+0000 7fe203d3e800 20 remove_watcher() i=5 2023-12-03T11:49:09.602 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.558+0000 7fe203d3e800 20 remove_watcher() i=6 2023-12-03T11:49:09.602 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:09.559+0000 7fe203d3e800 20 remove_watcher() i=7 2023-12-03T11:49:09.602 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:49:09.602 INFO:tasks.workunit.client.0.smithi003.stderr:BUCKET_STATS: 2023-12-03T11:49:09.602 INFO:tasks.workunit.client.0.smithi003.stderr:bucket: abort-at-commit-target-layout id: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26 num_objects: 20 size_kb: 1 num_shards: 11 2023-12-03T11:49:09.602 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:49:39.759 INFO:tasks.workunit.client.0.smithi003.stderr:radosgw-admin bucket reshard --bucket abort-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2023-12-03T11:49:39.790 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:49:39.791 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:49:39.806 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.805+0000 7f115a137800 20 rados->read ofs=0 len=0 2023-12-03T11:49:39.808 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.806+0000 7f115a137800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:39.808 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.806+0000 7f115a137800 20 realm 2023-12-03T11:49:39.808 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.806+0000 7f115a137800 20 rados->read ofs=0 len=0 2023-12-03T11:49:39.808 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.806+0000 7f115a137800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:39.808 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.806+0000 7f115a137800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:49:39.808 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.806+0000 7f115a137800 20 rados->read ofs=0 len=0 2023-12-03T11:49:39.808 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.807+0000 7f115a137800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:39.808 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.807+0000 7f115a137800 20 rados->read ofs=0 len=0 2023-12-03T11:49:39.809 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.808+0000 7f115a137800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:49:39.809 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.808+0000 7f115a137800 20 rados->read ofs=0 len=0 2023-12-03T11:49:39.809 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.808+0000 7f115a137800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:49:39.809 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.808+0000 7f115a137800 20 searching for the correct realm 2023-12-03T11:49:39.821 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.820+0000 7f11556cc640 0 -- 172.21.15.3:0/2773005999 >> [v2:172.21.15.3:6817/3356208405,v1:172.21.15.3:6819/3356208405] conn(0x55f663cf3090 msgr2=0x55f663cf54e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:49:39.822 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.821+0000 7f115a137800 20 RGWRados::pool_iterate: got zone_info.83aabb46-04b5-4c96-9933-c6bfb1173a73 2023-12-03T11:49:39.822 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.821+0000 7f115a137800 20 RGWRados::pool_iterate: got zonegroup_info.6a811aad-435d-4fdd-93c9-b7e0b50de429 2023-12-03T11:49:39.822 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.821+0000 7f115a137800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:49:39.822 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.821+0000 7f115a137800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:49:39.822 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.821+0000 7f115a137800 20 rados->read ofs=0 len=0 2023-12-03T11:49:39.823 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.821+0000 7f115a137800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:39.823 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.821+0000 7f115a137800 20 rados->read ofs=0 len=0 2023-12-03T11:49:39.825 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.821+0000 7f115a137800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:49:39.825 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.821+0000 7f115a137800 20 rados->read ofs=0 len=0 2023-12-03T11:49:39.825 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.822+0000 7f115a137800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:49:39.825 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.822+0000 7f115a137800 20 zone default found 2023-12-03T11:49:39.825 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.822+0000 7f115a137800 4 Realm: () 2023-12-03T11:49:39.825 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.822+0000 7f115a137800 4 ZoneGroup: default (6a811aad-435d-4fdd-93c9-b7e0b50de429) 2023-12-03T11:49:39.825 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.822+0000 7f115a137800 4 Zone: default (83aabb46-04b5-4c96-9933-c6bfb1173a73) 2023-12-03T11:49:39.825 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.822+0000 7f115a137800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:49:39.825 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.822+0000 7f115a137800 20 zonegroup default 2023-12-03T11:49:39.825 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.822+0000 7f115a137800 20 rados->read ofs=0 len=0 2023-12-03T11:49:39.825 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.822+0000 7f115a137800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:39.825 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.822+0000 7f115a137800 20 rados->read ofs=0 len=0 2023-12-03T11:49:39.826 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.822+0000 7f115a137800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:39.826 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.822+0000 7f115a137800 20 rados->read ofs=0 len=0 2023-12-03T11:49:39.826 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.823+0000 7f115a137800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:39.826 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.823+0000 7f115a137800 20 started sync module instance, tier type = 2023-12-03T11:49:39.826 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.823+0000 7f115a137800 20 started zone id=83aabb46-04b5-4c96-9933-c6bfb1173a73 (name=default) with tier type = 2023-12-03T11:49:39.832 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.831+0000 7f11556cc640 0 -- 172.21.15.3:0/2773005999 >> [v2:172.21.15.3:6817/3356208405,v1:172.21.15.3:6819/3356208405] conn(0x7f1130079e40 msgr2=0x7f113007c270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:49:39.835 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.834+0000 7f115a137800 20 add_watcher() i=0 2023-12-03T11:49:39.835 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.834+0000 7f115a137800 20 add_watcher() i=1 2023-12-03T11:49:39.835 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.834+0000 7f115a137800 20 add_watcher() i=2 2023-12-03T11:49:39.835 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.834+0000 7f115a137800 20 add_watcher() i=3 2023-12-03T11:49:39.835 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.834+0000 7f115a137800 20 add_watcher() i=4 2023-12-03T11:49:39.835 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.834+0000 7f115a137800 20 add_watcher() i=5 2023-12-03T11:49:39.835 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.834+0000 7f115a137800 20 add_watcher() i=6 2023-12-03T11:49:39.836 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.835+0000 7f115a137800 20 add_watcher() i=7 2023-12-03T11:49:39.836 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.835+0000 7f115a137800 2 all 8 watchers are set, enabling cache 2023-12-03T11:49:39.837 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.836+0000 7f111b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:49:39.838 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.837+0000 7f115a137800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:49:39.838 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.837+0000 7f115a137800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:49:39.845 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.843+0000 7f115a137800 5 note: GC not initialized 2023-12-03T11:49:39.845 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.843+0000 7f108a7fc640 20 reqs_thread_entry: start 2023-12-03T11:49:39.845 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.843+0000 7f115a137800 20 init_complete bucket index max shards: 11 2023-12-03T11:49:39.845 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.843+0000 7f115a137800 20 Filter name: none 2023-12-03T11:49:39.845 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.844+0000 7f107bfff640 20 reqs_thread_entry: start 2023-12-03T11:49:39.845 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.844+0000 7f115a137800 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2023-12-03T11:49:39.845 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.844+0000 7f115a137800 20 rados->read ofs=0 len=0 2023-12-03T11:49:39.846 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.844+0000 7f115a137800 20 rados_obj.operate() r=0 bl.length=221 2023-12-03T11:49:39.846 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.844+0000 7f115a137800 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2023-12-03T11:49:39.847 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.844+0000 7f115a137800 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2023-12-03T11:49:39.847 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.844+0000 7f115a137800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26 : miss 2023-12-03T11:49:39.847 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.844+0000 7f115a137800 20 rados->read ofs=0 len=0 2023-12-03T11:49:39.847 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.845+0000 7f115a137800 20 rados_obj.operate() r=0 bl.length=393 2023-12-03T11:49:39.847 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.845+0000 7f115a137800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26 info.flags=0x17 2023-12-03T11:49:39.847 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.845+0000 7f115a137800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26 to cache LRU end 2023-12-03T11:49:39.847 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.845+0000 7f115a137800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:49:39.847 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.845+0000 7f115a137800 10 updating xattr: name=user.rgw.acl bl.length()=265 2023-12-03T11:49:39.847 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.845+0000 7f115a137800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26 2023-12-03T11:49:39.852 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.850+0000 7f115a137800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26 info.flags=0x17 2023-12-03T11:49:39.852 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.851+0000 7f115a137800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26 to cache LRU end 2023-12-03T11:49:39.852 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.851+0000 7f115a137800 10 updating xattr: name=user.rgw.acl bl.length()=265 2023-12-03T11:49:39.852 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.851+0000 7f115a137800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26, ofs0, ns] 2023-12-03T11:49:39.852 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.851+0000 7f1137fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660575 cookie 94516724869120 notifier 6722 bl.length()=965 2023-12-03T11:49:39.853 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.851+0000 7f1137fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26 info.flags=0x17 2023-12-03T11:49:39.853 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.851+0000 7f1137fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26 to cache LRU end 2023-12-03T11:49:39.853 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.851+0000 7f1137fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2023-12-03T11:49:39.854 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.852+0000 7f115a137800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26]): orig_sources= new_sources= 2023-12-03T11:49:39.854 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.852+0000 7f115a137800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26]): potential sources added=[] removed=[] 2023-12-03T11:49:39.854 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.852+0000 7f115a137800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26]): orig_dests= new_dests= 2023-12-03T11:49:39.854 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.852+0000 7f115a137800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26]): potential dests added=[] removed=[] 2023-12-03T11:49:39.857 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.855+0000 7f115a137800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26.1.0 2023-12-03T11:49:39.857 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.855+0000 7f115a137800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26.1.0 2023-12-03T11:49:39.857 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.855+0000 7f115a137800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26.1.1 2023-12-03T11:49:39.857 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.855+0000 7f115a137800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26.1.1 2023-12-03T11:49:39.857 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.855+0000 7f115a137800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26.1.2 2023-12-03T11:49:39.857 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.855+0000 7f115a137800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26.1.2 2023-12-03T11:49:39.858 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.855+0000 7f115a137800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26.1.3 2023-12-03T11:49:39.858 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.855+0000 7f115a137800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26.1.3 2023-12-03T11:49:39.858 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.855+0000 7f115a137800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26.1.4 2023-12-03T11:49:39.858 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.855+0000 7f115a137800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26.1.4 2023-12-03T11:49:39.858 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.855+0000 7f115a137800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26.1.5 2023-12-03T11:49:39.858 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.855+0000 7f115a137800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26.1.5 2023-12-03T11:49:39.858 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.855+0000 7f115a137800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26.1.6 2023-12-03T11:49:39.858 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.855+0000 7f115a137800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26.1.6 2023-12-03T11:49:39.858 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.855+0000 7f115a137800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26.1.7 2023-12-03T11:49:39.858 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.855+0000 7f115a137800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26.1.7 2023-12-03T11:49:39.858 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.855+0000 7f115a137800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26.1.8 2023-12-03T11:49:39.859 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.855+0000 7f115a137800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26.1.8 2023-12-03T11:49:39.859 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.855+0000 7f115a137800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26.1.9 2023-12-03T11:49:39.859 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.855+0000 7f115a137800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26.1.9 2023-12-03T11:49:39.859 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.855+0000 7f115a137800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26.1.10 2023-12-03T11:49:39.859 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.855+0000 7f115a137800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26.1.10 2023-12-03T11:49:39.859 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.855+0000 7f115a137800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26.1.11 2023-12-03T11:49:39.859 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.855+0000 7f115a137800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26.1.11 2023-12-03T11:49:39.859 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.855+0000 7f115a137800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26.0 2023-12-03T11:49:39.859 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.856+0000 7f115a137800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26.1 2023-12-03T11:49:39.860 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.856+0000 7f115a137800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26.2 2023-12-03T11:49:39.860 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.857+0000 7f115a137800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26.3 2023-12-03T11:49:39.860 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.857+0000 7f115a137800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26.4 2023-12-03T11:49:39.860 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.858+0000 7f115a137800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26.5 2023-12-03T11:49:39.861 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.859+0000 7f115a137800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26.6 2023-12-03T11:49:39.861 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.859+0000 7f115a137800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26.7 2023-12-03T11:49:39.862 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.859+0000 7f115a137800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26.8 2023-12-03T11:49:39.862 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.860+0000 7f115a137800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26.9 2023-12-03T11:49:39.862 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.860+0000 7f115a137800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26.10 2023-12-03T11:49:39.864 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.863+0000 7f115a137800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26 : hit (requested=0x17, cached=0x17) 2023-12-03T11:49:39.865 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.863+0000 7f115a137800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26 2023-12-03T11:49:39.866 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.865+0000 7f115a137800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26 info.flags=0x17 2023-12-03T11:49:39.866 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.865+0000 7f115a137800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26 to cache LRU end 2023-12-03T11:49:39.866 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.865+0000 7f115a137800 10 updating xattr: name=user.rgw.acl bl.length()=265 2023-12-03T11:49:39.866 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.865+0000 7f115a137800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26, ofs0, ns] 2023-12-03T11:49:39.866 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.865+0000 7f11377fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660576 cookie 94516724869120 notifier 6722 bl.length()=933 2023-12-03T11:49:39.867 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.865+0000 7f11377fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26 info.flags=0x17 2023-12-03T11:49:39.867 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.865+0000 7f11377fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26 to cache LRU end 2023-12-03T11:49:39.867 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.865+0000 7f11377fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2023-12-03T11:49:39.868 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.866+0000 7f115a137800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26]): orig_sources= new_sources= 2023-12-03T11:49:39.868 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.866+0000 7f115a137800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26]): potential sources added=[] removed=[] 2023-12-03T11:49:39.868 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.866+0000 7f115a137800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26]): orig_dests= new_dests= 2023-12-03T11:49:39.868 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.866+0000 7f115a137800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26]): potential dests added=[] removed=[] 2023-12-03T11:49:39.870 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.869+0000 7f115a137800 1 execute INFO: reshard of bucket "abort-at-commit-target-layout" completed successfully 2023-12-03T11:49:39.872 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.871+0000 7f111b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:49:39.874 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.873+0000 7f115a137800 20 remove_watcher() i=0 2023-12-03T11:49:39.875 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.873+0000 7f115a137800 2 removed watcher, disabling cache 2023-12-03T11:49:39.876 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.874+0000 7f115a137800 20 remove_watcher() i=1 2023-12-03T11:49:39.877 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.876+0000 7f115a137800 20 remove_watcher() i=2 2023-12-03T11:49:39.878 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.877+0000 7f115a137800 20 remove_watcher() i=3 2023-12-03T11:49:39.880 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.878+0000 7f115a137800 20 remove_watcher() i=4 2023-12-03T11:49:39.881 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.879+0000 7f115a137800 20 remove_watcher() i=5 2023-12-03T11:49:39.882 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.881+0000 7f115a137800 20 remove_watcher() i=6 2023-12-03T11:49:39.883 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.882+0000 7f115a137800 20 remove_watcher() i=7 2023-12-03T11:49:39.890 INFO:tasks.workunit.client.0.smithi003.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2023-12-03T11:49:39.917 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:49:39.917 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:49:39.932 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.931+0000 7f5789a12800 20 rados->read ofs=0 len=0 2023-12-03T11:49:39.934 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.933+0000 7f5789a12800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:39.934 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.933+0000 7f5789a12800 20 realm 2023-12-03T11:49:39.935 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.933+0000 7f5789a12800 20 rados->read ofs=0 len=0 2023-12-03T11:49:39.935 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.933+0000 7f5789a12800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:39.935 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.933+0000 7f5789a12800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:49:39.935 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.933+0000 7f5789a12800 20 rados->read ofs=0 len=0 2023-12-03T11:49:39.935 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.933+0000 7f5789a12800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:39.935 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.933+0000 7f5789a12800 20 rados->read ofs=0 len=0 2023-12-03T11:49:39.935 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.934+0000 7f5789a12800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:49:39.936 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.934+0000 7f5789a12800 20 rados->read ofs=0 len=0 2023-12-03T11:49:39.936 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.934+0000 7f5789a12800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:49:39.936 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.934+0000 7f5789a12800 20 searching for the correct realm 2023-12-03T11:49:39.946 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.945+0000 7f5784929640 0 -- 172.21.15.3:0/244569097 >> [v2:172.21.15.3:6817/3356208405,v1:172.21.15.3:6819/3356208405] conn(0x5619e8d8bbb0 msgr2=0x5619e8d8dfa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-03T11:49:39.947 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.946+0000 7f5789a12800 20 RGWRados::pool_iterate: got zone_info.83aabb46-04b5-4c96-9933-c6bfb1173a73 2023-12-03T11:49:39.947 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.946+0000 7f5789a12800 20 RGWRados::pool_iterate: got zonegroup_info.6a811aad-435d-4fdd-93c9-b7e0b50de429 2023-12-03T11:49:39.948 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.946+0000 7f5789a12800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:49:39.948 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.946+0000 7f5789a12800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:49:39.948 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.946+0000 7f5789a12800 20 rados->read ofs=0 len=0 2023-12-03T11:49:39.948 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.946+0000 7f5789a12800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:39.948 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.946+0000 7f5789a12800 20 rados->read ofs=0 len=0 2023-12-03T11:49:39.949 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.947+0000 7f5789a12800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:49:39.949 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.947+0000 7f5789a12800 20 rados->read ofs=0 len=0 2023-12-03T11:49:39.949 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.947+0000 7f5789a12800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:49:39.949 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.947+0000 7f5789a12800 20 zone default found 2023-12-03T11:49:39.949 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.947+0000 7f5789a12800 4 Realm: () 2023-12-03T11:49:39.949 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.947+0000 7f5789a12800 4 ZoneGroup: default (6a811aad-435d-4fdd-93c9-b7e0b50de429) 2023-12-03T11:49:39.949 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.947+0000 7f5789a12800 4 Zone: default (83aabb46-04b5-4c96-9933-c6bfb1173a73) 2023-12-03T11:49:39.949 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.947+0000 7f5789a12800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:49:39.949 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.947+0000 7f5789a12800 20 zonegroup default 2023-12-03T11:49:39.949 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.947+0000 7f5789a12800 20 rados->read ofs=0 len=0 2023-12-03T11:49:39.949 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.947+0000 7f5789a12800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:39.949 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.947+0000 7f5789a12800 20 rados->read ofs=0 len=0 2023-12-03T11:49:39.950 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.948+0000 7f5789a12800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:39.950 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.948+0000 7f5789a12800 20 rados->read ofs=0 len=0 2023-12-03T11:49:39.950 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.948+0000 7f5789a12800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:39.950 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.948+0000 7f5789a12800 20 started sync module instance, tier type = 2023-12-03T11:49:39.950 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.948+0000 7f5789a12800 20 started zone id=83aabb46-04b5-4c96-9933-c6bfb1173a73 (name=default) with tier type = 2023-12-03T11:49:39.956 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.955+0000 7f578592b640 0 -- 172.21.15.3:0/244569097 >> [v2:172.21.15.37:6816/3770469300,v1:172.21.15.37:6818/3770469300] conn(0x7f577c05aff0 msgr2=0x7f577c06f7a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:49:39.958 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.957+0000 7f5789a12800 20 add_watcher() i=0 2023-12-03T11:49:39.959 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.957+0000 7f5789a12800 20 add_watcher() i=1 2023-12-03T11:49:39.959 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.957+0000 7f5789a12800 20 add_watcher() i=2 2023-12-03T11:49:39.959 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.957+0000 7f5789a12800 20 add_watcher() i=3 2023-12-03T11:49:39.959 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.957+0000 7f5789a12800 20 add_watcher() i=4 2023-12-03T11:49:39.959 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.957+0000 7f5789a12800 20 add_watcher() i=5 2023-12-03T11:49:39.959 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.957+0000 7f5789a12800 20 add_watcher() i=6 2023-12-03T11:49:39.960 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.958+0000 7f5789a12800 20 add_watcher() i=7 2023-12-03T11:49:39.960 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.958+0000 7f5789a12800 2 all 8 watchers are set, enabling cache 2023-12-03T11:49:39.961 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.960+0000 7f574afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:49:39.961 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.960+0000 7f5789a12800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:49:39.961 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.960+0000 7f5789a12800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:49:39.968 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.966+0000 7f5789a12800 5 note: GC not initialized 2023-12-03T11:49:39.968 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.966+0000 7f56b9ffb640 20 reqs_thread_entry: start 2023-12-03T11:49:39.968 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.966+0000 7f5789a12800 20 init_complete bucket index max shards: 11 2023-12-03T11:49:39.968 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.966+0000 7f5789a12800 20 Filter name: none 2023-12-03T11:49:39.968 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.967+0000 7f56ab7fe640 20 reqs_thread_entry: start 2023-12-03T11:49:39.968 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.967+0000 7f5789a12800 20 rados->read ofs=0 len=0 2023-12-03T11:49:39.969 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.967+0000 7f5789a12800 20 rados_obj.operate() r=0 bl.length=221 2023-12-03T11:49:39.969 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.967+0000 7f5789a12800 20 rados->read ofs=0 len=0 2023-12-03T11:49:39.969 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.968+0000 7f5789a12800 20 rados_obj.operate() r=0 bl.length=393 2023-12-03T11:49:39.969 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.968+0000 7f5789a12800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:49:39.969 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.968+0000 7f5789a12800 20 rados->read ofs=0 len=0 2023-12-03T11:49:39.970 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.968+0000 7f5789a12800 20 rados_obj.operate() r=0 bl.length=221 2023-12-03T11:49:39.970 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.968+0000 7f5789a12800 20 rados->read ofs=0 len=0 2023-12-03T11:49:39.970 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.969+0000 7f5789a12800 20 rados_obj.operate() r=0 bl.length=393 2023-12-03T11:49:39.970 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.969+0000 7f5789a12800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:49:39.971 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.970+0000 7f5789a12800 20 rados->read ofs=0 len=0 2023-12-03T11:49:39.971 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.970+0000 7f5789a12800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:39.972 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.971+0000 7f574afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:49:39.974 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.973+0000 7f5789a12800 20 remove_watcher() i=0 2023-12-03T11:49:39.974 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.973+0000 7f5789a12800 2 removed watcher, disabling cache 2023-12-03T11:49:39.975 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.974+0000 7f5789a12800 20 remove_watcher() i=1 2023-12-03T11:49:39.976 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.975+0000 7f5789a12800 20 remove_watcher() i=2 2023-12-03T11:49:39.977 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.976+0000 7f5789a12800 20 remove_watcher() i=3 2023-12-03T11:49:39.978 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.977+0000 7f5789a12800 20 remove_watcher() i=4 2023-12-03T11:49:39.979 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.978+0000 7f5789a12800 20 remove_watcher() i=5 2023-12-03T11:49:39.980 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.979+0000 7f5789a12800 20 remove_watcher() i=6 2023-12-03T11:49:39.981 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:39.980+0000 7f5789a12800 20 remove_watcher() i=7 2023-12-03T11:49:39.986 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:49:39.986 INFO:tasks.workunit.client.0.smithi003.stderr:BUCKET_STATS: 2023-12-03T11:49:39.986 INFO:tasks.workunit.client.0.smithi003.stderr:bucket: abort-at-commit-target-layout id: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.26 num_objects: 19 size_kb: 1 num_shards: 12 2023-12-03T11:49:39.986 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:49:40.292 INFO:tasks.workunit.client.0.smithi003.stderr:TEST: reshard bucket with EIO injected at do_reshard 2023-12-03T11:49:40.292 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:49:40.992 INFO:tasks.workunit.client.0.smithi003.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2023-12-03T11:49:41.019 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:49:41.020 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:49:41.034 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.033+0000 7f47cd520800 20 rados->read ofs=0 len=0 2023-12-03T11:49:41.036 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.034+0000 7f47cd520800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:41.036 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.034+0000 7f47cd520800 20 realm 2023-12-03T11:49:41.036 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.034+0000 7f47cd520800 20 rados->read ofs=0 len=0 2023-12-03T11:49:41.036 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.034+0000 7f47cd520800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:41.036 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.034+0000 7f47cd520800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:49:41.036 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.034+0000 7f47cd520800 20 rados->read ofs=0 len=0 2023-12-03T11:49:41.036 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.035+0000 7f47cd520800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:41.036 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.035+0000 7f47cd520800 20 rados->read ofs=0 len=0 2023-12-03T11:49:41.037 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.035+0000 7f47cd520800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:49:41.037 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.035+0000 7f47cd520800 20 rados->read ofs=0 len=0 2023-12-03T11:49:41.037 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.036+0000 7f47cd520800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:49:41.037 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.036+0000 7f47cd520800 20 searching for the correct realm 2023-12-03T11:49:41.047 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.046+0000 7f47c911c640 0 -- 172.21.15.3:0/3546758619 >> [v2:172.21.15.37:6805/1692844418,v1:172.21.15.37:6807/1692844418] conn(0x5623a3b464d0 msgr2=0x5623a3b488c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-03T11:49:41.049 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.048+0000 7f47cd520800 20 RGWRados::pool_iterate: got zone_info.83aabb46-04b5-4c96-9933-c6bfb1173a73 2023-12-03T11:49:41.049 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.048+0000 7f47cd520800 20 RGWRados::pool_iterate: got zonegroup_info.6a811aad-435d-4fdd-93c9-b7e0b50de429 2023-12-03T11:49:41.049 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.048+0000 7f47cd520800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:49:41.049 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.048+0000 7f47cd520800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:49:41.049 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.048+0000 7f47cd520800 20 rados->read ofs=0 len=0 2023-12-03T11:49:41.050 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.048+0000 7f47cd520800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:41.050 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.048+0000 7f47cd520800 20 rados->read ofs=0 len=0 2023-12-03T11:49:41.051 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.048+0000 7f47cd520800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:49:41.051 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.048+0000 7f47cd520800 20 rados->read ofs=0 len=0 2023-12-03T11:49:41.051 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.049+0000 7f47cd520800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:49:41.051 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.049+0000 7f47cd520800 20 zone default found 2023-12-03T11:49:41.051 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.049+0000 7f47cd520800 4 Realm: () 2023-12-03T11:49:41.051 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.049+0000 7f47cd520800 4 ZoneGroup: default (6a811aad-435d-4fdd-93c9-b7e0b50de429) 2023-12-03T11:49:41.051 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.049+0000 7f47cd520800 4 Zone: default (83aabb46-04b5-4c96-9933-c6bfb1173a73) 2023-12-03T11:49:41.051 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.049+0000 7f47cd520800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:49:41.051 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.049+0000 7f47cd520800 20 zonegroup default 2023-12-03T11:49:41.051 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.049+0000 7f47cd520800 20 rados->read ofs=0 len=0 2023-12-03T11:49:41.051 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.049+0000 7f47cd520800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:41.051 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.049+0000 7f47cd520800 20 rados->read ofs=0 len=0 2023-12-03T11:49:41.052 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.049+0000 7f47cd520800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:41.052 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.049+0000 7f47cd520800 20 rados->read ofs=0 len=0 2023-12-03T11:49:41.052 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.050+0000 7f47cd520800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:41.052 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.050+0000 7f47cd520800 20 started sync module instance, tier type = 2023-12-03T11:49:41.052 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.050+0000 7f47cd520800 20 started zone id=83aabb46-04b5-4c96-9933-c6bfb1173a73 (name=default) with tier type = 2023-12-03T11:49:41.058 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.056+0000 7f47c891b640 0 -- 172.21.15.3:0/3546758619 >> [v2:172.21.15.3:6817/3356208405,v1:172.21.15.3:6819/3356208405] conn(0x5623a3b4b4b0 msgr2=0x5623a3b4d8a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:49:41.060 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.059+0000 7f47cd520800 20 add_watcher() i=0 2023-12-03T11:49:41.061 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.059+0000 7f47cd520800 20 add_watcher() i=1 2023-12-03T11:49:41.061 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.059+0000 7f47cd520800 20 add_watcher() i=2 2023-12-03T11:49:41.061 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.059+0000 7f47cd520800 20 add_watcher() i=3 2023-12-03T11:49:41.061 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.059+0000 7f47cd520800 20 add_watcher() i=4 2023-12-03T11:49:41.061 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.059+0000 7f47cd520800 20 add_watcher() i=5 2023-12-03T11:49:41.061 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.059+0000 7f47cd520800 20 add_watcher() i=6 2023-12-03T11:49:41.061 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.060+0000 7f47cd520800 20 add_watcher() i=7 2023-12-03T11:49:41.061 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.060+0000 7f47cd520800 2 all 8 watchers are set, enabling cache 2023-12-03T11:49:41.063 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.062+0000 7f478efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:49:41.063 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.062+0000 7f47cd520800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:49:41.063 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.062+0000 7f47cd520800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:49:41.070 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.068+0000 7f47cd520800 5 note: GC not initialized 2023-12-03T11:49:41.070 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.068+0000 7f46fdffb640 20 reqs_thread_entry: start 2023-12-03T11:49:41.070 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.068+0000 7f47cd520800 20 init_complete bucket index max shards: 11 2023-12-03T11:49:41.070 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.068+0000 7f47cd520800 20 Filter name: none 2023-12-03T11:49:41.070 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.068+0000 7f46ef7fe640 20 reqs_thread_entry: start 2023-12-03T11:49:41.070 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.068+0000 7f47cd520800 20 rados->read ofs=0 len=0 2023-12-03T11:49:41.071 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.069+0000 7f47cd520800 20 rados_obj.operate() r=0 bl.length=211 2023-12-03T11:49:41.071 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.069+0000 7f47cd520800 20 rados->read ofs=0 len=0 2023-12-03T11:49:41.071 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.069+0000 7f47cd520800 20 rados_obj.operate() r=0 bl.length=383 2023-12-03T11:49:41.071 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.069+0000 7f47cd520800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:49:41.071 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.069+0000 7f47cd520800 20 rados->read ofs=0 len=0 2023-12-03T11:49:41.071 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.070+0000 7f47cd520800 20 rados_obj.operate() r=0 bl.length=211 2023-12-03T11:49:41.071 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.070+0000 7f47cd520800 20 rados->read ofs=0 len=0 2023-12-03T11:49:41.072 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.070+0000 7f47cd520800 20 rados_obj.operate() r=0 bl.length=383 2023-12-03T11:49:41.072 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.070+0000 7f47cd520800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:49:41.072 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.071+0000 7f47cd520800 20 rados->read ofs=0 len=0 2023-12-03T11:49:41.072 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.071+0000 7f47cd520800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:41.073 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.072+0000 7f478efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:49:41.076 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.074+0000 7f47cd520800 20 remove_watcher() i=0 2023-12-03T11:49:41.076 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.074+0000 7f47cd520800 2 removed watcher, disabling cache 2023-12-03T11:49:41.077 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.075+0000 7f47cd520800 20 remove_watcher() i=1 2023-12-03T11:49:41.078 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.077+0000 7f47cd520800 20 remove_watcher() i=2 2023-12-03T11:49:41.079 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.078+0000 7f47cd520800 20 remove_watcher() i=3 2023-12-03T11:49:41.081 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.079+0000 7f47cd520800 20 remove_watcher() i=4 2023-12-03T11:49:41.082 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.080+0000 7f47cd520800 20 remove_watcher() i=5 2023-12-03T11:49:41.083 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.081+0000 7f47cd520800 20 remove_watcher() i=6 2023-12-03T11:49:41.084 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.082+0000 7f47cd520800 20 remove_watcher() i=7 2023-12-03T11:49:41.088 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:49:41.089 INFO:tasks.workunit.client.0.smithi003.stderr:BUCKET_STATS: 2023-12-03T11:49:41.089 INFO:tasks.workunit.client.0.smithi003.stderr:bucket: error-at-do-reshard id: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.27 num_objects: 20 size_kb: 1 num_shards: 11 2023-12-03T11:49:41.089 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:49:41.090 INFO:tasks.workunit.client.0.smithi003.stderr:radosgw-admin bucket reshard --bucket error-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at do_reshard 2023-12-03T11:49:41.123 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:49:41.125 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:49:41.137 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.136+0000 7f9fece33800 20 rados->read ofs=0 len=0 2023-12-03T11:49:41.340 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.338+0000 7f9fece33800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:41.340 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.338+0000 7f9fece33800 20 realm 2023-12-03T11:49:41.340 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.338+0000 7f9fece33800 20 rados->read ofs=0 len=0 2023-12-03T11:49:41.340 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.338+0000 7f9fece33800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:41.340 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.338+0000 7f9fece33800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:49:41.340 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.338+0000 7f9fece33800 20 rados->read ofs=0 len=0 2023-12-03T11:49:41.340 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.339+0000 7f9fece33800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:41.340 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.339+0000 7f9fece33800 20 rados->read ofs=0 len=0 2023-12-03T11:49:41.341 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.340+0000 7f9fece33800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:49:41.341 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.340+0000 7f9fece33800 20 rados->read ofs=0 len=0 2023-12-03T11:49:41.341 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.340+0000 7f9fece33800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:49:41.341 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.340+0000 7f9fece33800 20 searching for the correct realm 2023-12-03T11:49:41.351 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.350+0000 7f9fea933640 0 -- 172.21.15.3:0/787961261 >> [v2:172.21.15.3:6800/2373485412,v1:172.21.15.3:6801/2373485412] conn(0x7f9fe4002bc0 msgr2=0x7f9fe4015420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:49:41.354 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.352+0000 7f9fece33800 20 RGWRados::pool_iterate: got zone_info.83aabb46-04b5-4c96-9933-c6bfb1173a73 2023-12-03T11:49:41.354 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.352+0000 7f9fece33800 20 RGWRados::pool_iterate: got zonegroup_info.6a811aad-435d-4fdd-93c9-b7e0b50de429 2023-12-03T11:49:41.354 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.352+0000 7f9fece33800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:49:41.354 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.352+0000 7f9fece33800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:49:41.354 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.352+0000 7f9fece33800 20 rados->read ofs=0 len=0 2023-12-03T11:49:41.354 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.352+0000 7f9fece33800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:41.354 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.352+0000 7f9fece33800 20 rados->read ofs=0 len=0 2023-12-03T11:49:41.354 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.352+0000 7f9fece33800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:49:41.354 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.352+0000 7f9fece33800 20 rados->read ofs=0 len=0 2023-12-03T11:49:41.355 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.353+0000 7f9fece33800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:49:41.356 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.353+0000 7f9fece33800 20 zone default found 2023-12-03T11:49:41.356 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.353+0000 7f9fece33800 4 Realm: () 2023-12-03T11:49:41.356 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.353+0000 7f9fece33800 4 ZoneGroup: default (6a811aad-435d-4fdd-93c9-b7e0b50de429) 2023-12-03T11:49:41.356 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.353+0000 7f9fece33800 4 Zone: default (83aabb46-04b5-4c96-9933-c6bfb1173a73) 2023-12-03T11:49:41.356 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.353+0000 7f9fece33800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:49:41.356 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.353+0000 7f9fece33800 20 zonegroup default 2023-12-03T11:49:41.356 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.353+0000 7f9fece33800 20 rados->read ofs=0 len=0 2023-12-03T11:49:41.356 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.353+0000 7f9fece33800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:41.356 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.353+0000 7f9fece33800 20 rados->read ofs=0 len=0 2023-12-03T11:49:41.356 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.353+0000 7f9fece33800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:41.356 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.353+0000 7f9fece33800 20 rados->read ofs=0 len=0 2023-12-03T11:49:41.356 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.354+0000 7f9fece33800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:41.356 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.354+0000 7f9fece33800 20 started sync module instance, tier type = 2023-12-03T11:49:41.357 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.354+0000 7f9fece33800 20 started zone id=83aabb46-04b5-4c96-9933-c6bfb1173a73 (name=default) with tier type = 2023-12-03T11:49:41.362 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.361+0000 7f9fea933640 0 -- 172.21.15.3:0/787961261 >> [v2:172.21.15.3:6800/2373485412,v1:172.21.15.3:6801/2373485412] conn(0x7f9fc4079e40 msgr2=0x7f9fc407c270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:49:41.365 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.364+0000 7f9fece33800 20 add_watcher() i=0 2023-12-03T11:49:41.366 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.364+0000 7f9fece33800 20 add_watcher() i=1 2023-12-03T11:49:41.366 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.364+0000 7f9fece33800 20 add_watcher() i=2 2023-12-03T11:49:41.366 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.364+0000 7f9fece33800 20 add_watcher() i=3 2023-12-03T11:49:41.366 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.364+0000 7f9fece33800 20 add_watcher() i=4 2023-12-03T11:49:41.366 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.364+0000 7f9fece33800 20 add_watcher() i=5 2023-12-03T11:49:41.366 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.364+0000 7f9fece33800 20 add_watcher() i=6 2023-12-03T11:49:41.366 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.365+0000 7f9fece33800 20 add_watcher() i=7 2023-12-03T11:49:41.366 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.365+0000 7f9fece33800 2 all 8 watchers are set, enabling cache 2023-12-03T11:49:41.368 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.367+0000 7f9f2bfff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:49:41.369 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.367+0000 7f9fece33800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:49:41.369 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.367+0000 7f9fece33800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:49:41.376 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.374+0000 7f9fece33800 5 note: GC not initialized 2023-12-03T11:49:41.376 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.374+0000 7f9f22ffd640 20 reqs_thread_entry: start 2023-12-03T11:49:41.376 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.374+0000 7f9fece33800 20 init_complete bucket index max shards: 11 2023-12-03T11:49:41.376 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.374+0000 7f9fece33800 20 Filter name: none 2023-12-03T11:49:41.376 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.374+0000 7f9f20ff9640 20 reqs_thread_entry: start 2023-12-03T11:49:41.376 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.374+0000 7f9fece33800 10 cache get: name=default.rgw.meta+root+error-at-do-reshard : miss 2023-12-03T11:49:41.376 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.374+0000 7f9fece33800 20 rados->read ofs=0 len=0 2023-12-03T11:49:41.377 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.375+0000 7f9fece33800 20 rados_obj.operate() r=0 bl.length=211 2023-12-03T11:49:41.377 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.375+0000 7f9fece33800 10 cache put: name=default.rgw.meta+root+error-at-do-reshard info.flags=0x11 2023-12-03T11:49:41.377 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.375+0000 7f9fece33800 10 adding default.rgw.meta+root+error-at-do-reshard to cache LRU end 2023-12-03T11:49:41.377 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.375+0000 7f9fece33800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.27 : miss 2023-12-03T11:49:41.377 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.375+0000 7f9fece33800 20 rados->read ofs=0 len=0 2023-12-03T11:49:41.377 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.375+0000 7f9fece33800 20 rados_obj.operate() r=0 bl.length=383 2023-12-03T11:49:41.377 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.375+0000 7f9fece33800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.27 info.flags=0x17 2023-12-03T11:49:41.378 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.375+0000 7f9fece33800 10 adding default.rgw.meta+root+.bucket.meta.error-at-do-reshard:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.27 to cache LRU end 2023-12-03T11:49:41.378 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.375+0000 7f9fece33800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:49:41.378 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.375+0000 7f9fece33800 10 updating xattr: name=user.rgw.acl bl.length()=265 2023-12-03T11:49:41.378 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.375+0000 7f9fece33800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.27 2023-12-03T11:49:41.382 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.381+0000 7f9fece33800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.27 info.flags=0x17 2023-12-03T11:49:41.382 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.381+0000 7f9fece33800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.27 to cache LRU end 2023-12-03T11:49:41.383 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.381+0000 7f9fece33800 10 updating xattr: name=user.rgw.acl bl.length()=265 2023-12-03T11:49:41.383 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.381+0000 7f9fece33800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.27, ofs0, ns] 2023-12-03T11:49:41.383 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.381+0000 7f9fd17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660514 cookie 94672794624992 notifier 6785 bl.length()=945 2023-12-03T11:49:41.383 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.381+0000 7f9fd17fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.27 info.flags=0x17 2023-12-03T11:49:41.383 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.381+0000 7f9fd17fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.27 to cache LRU end 2023-12-03T11:49:41.383 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.381+0000 7f9fd17fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2023-12-03T11:49:41.384 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.383+0000 7f9fece33800 20 handle_bi_update(): bucket=:error-at-do-reshard[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.27]): orig_sources= new_sources= 2023-12-03T11:49:41.384 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.383+0000 7f9fece33800 20 handle_bi_update(): bucket=:error-at-do-reshard[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.27]): potential sources added=[] removed=[] 2023-12-03T11:49:41.384 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.383+0000 7f9fece33800 20 handle_bi_update(): bucket=:error-at-do-reshard[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.27]): orig_dests= new_dests= 2023-12-03T11:49:41.384 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.383+0000 7f9fece33800 20 handle_bi_update(): bucket=:error-at-do-reshard[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.27]): potential dests added=[] removed=[] 2023-12-03T11:49:41.389 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.387+0000 7f9fece33800 -1 Injecting error=-5 at location=do_reshard 2023-12-03T11:49:41.395 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.394+0000 7f9fece33800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.27 : hit (requested=0x17, cached=0x17) 2023-12-03T11:49:41.395 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.394+0000 7f9fece33800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.27 2023-12-03T11:49:41.397 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.395+0000 7f9fece33800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.27 info.flags=0x17 2023-12-03T11:49:41.397 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.395+0000 7f9fece33800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.27 to cache LRU end 2023-12-03T11:49:41.397 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.395+0000 7f9fece33800 10 updating xattr: name=user.rgw.acl bl.length()=265 2023-12-03T11:49:41.397 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.395+0000 7f9fece33800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.27, ofs0, ns] 2023-12-03T11:49:41.397 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.396+0000 7f9fd17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660515 cookie 94672794624992 notifier 6785 bl.length()=913 2023-12-03T11:49:41.397 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.396+0000 7f9fd17fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.27 info.flags=0x17 2023-12-03T11:49:41.397 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.396+0000 7f9fd17fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.27 to cache LRU end 2023-12-03T11:49:41.397 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.396+0000 7f9fd17fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2023-12-03T11:49:41.398 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.397+0000 7f9fece33800 20 handle_bi_update(): bucket=:error-at-do-reshard[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.27]): orig_sources= new_sources= 2023-12-03T11:49:41.399 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.397+0000 7f9fece33800 20 handle_bi_update(): bucket=:error-at-do-reshard[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.27]): potential sources added=[] removed=[] 2023-12-03T11:49:41.399 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.397+0000 7f9fece33800 20 handle_bi_update(): bucket=:error-at-do-reshard[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.27]): orig_dests= new_dests= 2023-12-03T11:49:41.399 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.397+0000 7f9fece33800 20 handle_bi_update(): bucket=:error-at-do-reshard[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.27]): potential dests added=[] removed=[] 2023-12-03T11:49:41.399 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.397+0000 7f9fece33800 1 execute INFO: reshard of bucket "error-at-do-reshard" canceled due to errors 2023-12-03T11:49:41.401 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.400+0000 7f9f2bfff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:49:41.403 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.402+0000 7f9fece33800 20 remove_watcher() i=0 2023-12-03T11:49:41.403 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.402+0000 7f9fece33800 2 removed watcher, disabling cache 2023-12-03T11:49:41.404 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.403+0000 7f9fece33800 20 remove_watcher() i=1 2023-12-03T11:49:41.405 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.404+0000 7f9fece33800 20 remove_watcher() i=2 2023-12-03T11:49:41.406 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.405+0000 7f9fece33800 20 remove_watcher() i=3 2023-12-03T11:49:41.407 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.406+0000 7f9fece33800 20 remove_watcher() i=4 2023-12-03T11:49:41.408 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.407+0000 7f9fece33800 20 remove_watcher() i=5 2023-12-03T11:49:41.410 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.408+0000 7f9fece33800 20 remove_watcher() i=6 2023-12-03T11:49:41.411 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.410+0000 7f9fece33800 20 remove_watcher() i=7 2023-12-03T11:49:41.417 INFO:tasks.workunit.client.0.smithi003.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2023-12-03T11:49:41.445 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:49:41.445 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:49:41.459 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.458+0000 7f74a43ad800 20 rados->read ofs=0 len=0 2023-12-03T11:49:41.461 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.459+0000 7f74a43ad800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:41.461 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.459+0000 7f74a43ad800 20 realm 2023-12-03T11:49:41.461 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.459+0000 7f74a43ad800 20 rados->read ofs=0 len=0 2023-12-03T11:49:41.461 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.459+0000 7f74a43ad800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:41.461 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.459+0000 7f74a43ad800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:49:41.461 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.459+0000 7f74a43ad800 20 rados->read ofs=0 len=0 2023-12-03T11:49:41.461 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.460+0000 7f74a43ad800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:41.461 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.460+0000 7f74a43ad800 20 rados->read ofs=0 len=0 2023-12-03T11:49:41.462 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.461+0000 7f74a43ad800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:49:41.462 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.461+0000 7f74a43ad800 20 rados->read ofs=0 len=0 2023-12-03T11:49:41.462 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.461+0000 7f74a43ad800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:49:41.462 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.461+0000 7f74a43ad800 20 searching for the correct realm 2023-12-03T11:49:41.473 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.472+0000 7f74a1ead640 0 -- 172.21.15.3:0/2922704478 >> [v2:172.21.15.37:6805/1692844418,v1:172.21.15.37:6807/1692844418] conn(0x55c517e1e790 msgr2=0x55c517e20b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:49:41.474 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.472+0000 7f74a43ad800 20 RGWRados::pool_iterate: got zone_info.83aabb46-04b5-4c96-9933-c6bfb1173a73 2023-12-03T11:49:41.474 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.472+0000 7f74a43ad800 20 RGWRados::pool_iterate: got zonegroup_info.6a811aad-435d-4fdd-93c9-b7e0b50de429 2023-12-03T11:49:41.474 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.472+0000 7f74a43ad800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:49:41.474 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.472+0000 7f74a43ad800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:49:41.474 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.472+0000 7f74a43ad800 20 rados->read ofs=0 len=0 2023-12-03T11:49:41.474 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.472+0000 7f74a43ad800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:41.474 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.472+0000 7f74a43ad800 20 rados->read ofs=0 len=0 2023-12-03T11:49:41.474 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.473+0000 7f74a43ad800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:49:41.474 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.473+0000 7f74a43ad800 20 rados->read ofs=0 len=0 2023-12-03T11:49:41.475 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.473+0000 7f74a43ad800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:49:41.475 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.473+0000 7f74a43ad800 20 zone default found 2023-12-03T11:49:41.475 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.473+0000 7f74a43ad800 4 Realm: () 2023-12-03T11:49:41.475 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.473+0000 7f74a43ad800 4 ZoneGroup: default (6a811aad-435d-4fdd-93c9-b7e0b50de429) 2023-12-03T11:49:41.476 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.473+0000 7f74a43ad800 4 Zone: default (83aabb46-04b5-4c96-9933-c6bfb1173a73) 2023-12-03T11:49:41.476 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.473+0000 7f74a43ad800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:49:41.476 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.473+0000 7f74a43ad800 20 zonegroup default 2023-12-03T11:49:41.476 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.473+0000 7f74a43ad800 20 rados->read ofs=0 len=0 2023-12-03T11:49:41.476 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.473+0000 7f74a43ad800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:41.476 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.473+0000 7f74a43ad800 20 rados->read ofs=0 len=0 2023-12-03T11:49:41.476 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.474+0000 7f74a43ad800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:41.476 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.474+0000 7f74a43ad800 20 rados->read ofs=0 len=0 2023-12-03T11:49:41.476 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.474+0000 7f74a43ad800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:41.476 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.474+0000 7f74a43ad800 20 started sync module instance, tier type = 2023-12-03T11:49:41.476 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.474+0000 7f74a43ad800 20 started zone id=83aabb46-04b5-4c96-9933-c6bfb1173a73 (name=default) with tier type = 2023-12-03T11:49:41.483 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.482+0000 7f74a16ac640 0 -- 172.21.15.3:0/2922704478 >> [v2:172.21.15.3:6817/3356208405,v1:172.21.15.3:6819/3356208405] conn(0x55c517e23690 msgr2=0x55c517e25a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:49:41.485 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.484+0000 7f74a43ad800 20 add_watcher() i=0 2023-12-03T11:49:41.485 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.484+0000 7f74a43ad800 20 add_watcher() i=1 2023-12-03T11:49:41.485 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.484+0000 7f74a43ad800 20 add_watcher() i=2 2023-12-03T11:49:41.486 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.484+0000 7f74a43ad800 20 add_watcher() i=3 2023-12-03T11:49:41.486 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.484+0000 7f74a43ad800 20 add_watcher() i=4 2023-12-03T11:49:41.486 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.484+0000 7f74a43ad800 20 add_watcher() i=5 2023-12-03T11:49:41.486 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.484+0000 7f74a43ad800 20 add_watcher() i=6 2023-12-03T11:49:41.487 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.485+0000 7f74a43ad800 20 add_watcher() i=7 2023-12-03T11:49:41.487 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.485+0000 7f74a43ad800 2 all 8 watchers are set, enabling cache 2023-12-03T11:49:41.488 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.487+0000 7f74677e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:49:41.489 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.488+0000 7f74a43ad800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:49:41.489 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.488+0000 7f74a43ad800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:49:41.496 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.494+0000 7f74a43ad800 5 note: GC not initialized 2023-12-03T11:49:41.496 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.494+0000 7f73d67fc640 20 reqs_thread_entry: start 2023-12-03T11:49:41.496 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.494+0000 7f74a43ad800 20 init_complete bucket index max shards: 11 2023-12-03T11:49:41.496 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.494+0000 7f74a43ad800 20 Filter name: none 2023-12-03T11:49:41.496 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.495+0000 7f73c7fff640 20 reqs_thread_entry: start 2023-12-03T11:49:41.496 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.495+0000 7f74a43ad800 20 rados->read ofs=0 len=0 2023-12-03T11:49:41.497 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.495+0000 7f74a43ad800 20 rados_obj.operate() r=0 bl.length=211 2023-12-03T11:49:41.497 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.495+0000 7f74a43ad800 20 rados->read ofs=0 len=0 2023-12-03T11:49:41.497 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.496+0000 7f74a43ad800 20 rados_obj.operate() r=0 bl.length=383 2023-12-03T11:49:41.497 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.496+0000 7f74a43ad800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:49:41.497 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.496+0000 7f74a43ad800 20 rados->read ofs=0 len=0 2023-12-03T11:49:41.498 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.496+0000 7f74a43ad800 20 rados_obj.operate() r=0 bl.length=211 2023-12-03T11:49:41.498 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.496+0000 7f74a43ad800 20 rados->read ofs=0 len=0 2023-12-03T11:49:41.498 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.496+0000 7f74a43ad800 20 rados_obj.operate() r=0 bl.length=383 2023-12-03T11:49:41.498 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.496+0000 7f74a43ad800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:49:41.498 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.497+0000 7f74a43ad800 20 rados->read ofs=0 len=0 2023-12-03T11:49:41.498 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.497+0000 7f74a43ad800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:41.499 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.498+0000 7f74677e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:49:41.502 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.501+0000 7f74a43ad800 20 remove_watcher() i=0 2023-12-03T11:49:41.502 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.501+0000 7f74a43ad800 2 removed watcher, disabling cache 2023-12-03T11:49:41.503 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.502+0000 7f74a43ad800 20 remove_watcher() i=1 2023-12-03T11:49:41.505 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.503+0000 7f74a43ad800 20 remove_watcher() i=2 2023-12-03T11:49:41.505 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.504+0000 7f74a43ad800 20 remove_watcher() i=3 2023-12-03T11:49:41.507 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.506+0000 7f74a43ad800 20 remove_watcher() i=4 2023-12-03T11:49:41.508 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.507+0000 7f74a43ad800 20 remove_watcher() i=5 2023-12-03T11:49:41.509 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.508+0000 7f74a43ad800 20 remove_watcher() i=6 2023-12-03T11:49:41.510 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.509+0000 7f74a43ad800 20 remove_watcher() i=7 2023-12-03T11:49:41.515 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:49:41.515 INFO:tasks.workunit.client.0.smithi003.stderr:BUCKET_STATS: 2023-12-03T11:49:41.515 INFO:tasks.workunit.client.0.smithi003.stderr:bucket: error-at-do-reshard id: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.27 num_objects: 20 size_kb: 1 num_shards: 11 2023-12-03T11:49:41.515 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:49:41.598 INFO:tasks.workunit.client.0.smithi003.stderr:radosgw-admin bucket reshard --bucket error-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2023-12-03T11:49:41.629 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:49:41.629 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:49:41.644 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.643+0000 7f2696fab800 20 rados->read ofs=0 len=0 2023-12-03T11:49:41.646 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.644+0000 7f2696fab800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:41.646 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.644+0000 7f2696fab800 20 realm 2023-12-03T11:49:41.646 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.644+0000 7f2696fab800 20 rados->read ofs=0 len=0 2023-12-03T11:49:41.646 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.645+0000 7f2696fab800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:41.646 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.645+0000 7f2696fab800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:49:41.646 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.645+0000 7f2696fab800 20 rados->read ofs=0 len=0 2023-12-03T11:49:41.646 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.645+0000 7f2696fab800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:41.647 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.645+0000 7f2696fab800 20 rados->read ofs=0 len=0 2023-12-03T11:49:41.647 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.646+0000 7f2696fab800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:49:41.647 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.646+0000 7f2696fab800 20 rados->read ofs=0 len=0 2023-12-03T11:49:41.647 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.646+0000 7f2696fab800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:49:41.647 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.646+0000 7f2696fab800 20 searching for the correct realm 2023-12-03T11:49:41.657 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.656+0000 7f26942aa640 0 -- 172.21.15.3:0/1246778787 >> [v2:172.21.15.3:6817/3356208405,v1:172.21.15.3:6819/3356208405] conn(0x55cbabb4ad40 msgr2=0x55cbabb4d130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:49:41.659 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.658+0000 7f2696fab800 20 RGWRados::pool_iterate: got zone_info.83aabb46-04b5-4c96-9933-c6bfb1173a73 2023-12-03T11:49:41.659 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.658+0000 7f2696fab800 20 RGWRados::pool_iterate: got zonegroup_info.6a811aad-435d-4fdd-93c9-b7e0b50de429 2023-12-03T11:49:41.659 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.658+0000 7f2696fab800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:49:41.659 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.658+0000 7f2696fab800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:49:41.659 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.658+0000 7f2696fab800 20 rados->read ofs=0 len=0 2023-12-03T11:49:41.659 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.658+0000 7f2696fab800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:41.659 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.658+0000 7f2696fab800 20 rados->read ofs=0 len=0 2023-12-03T11:49:41.660 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.658+0000 7f2696fab800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:49:41.661 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.658+0000 7f2696fab800 20 rados->read ofs=0 len=0 2023-12-03T11:49:41.661 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.659+0000 7f2696fab800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:49:41.661 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.659+0000 7f2696fab800 20 zone default found 2023-12-03T11:49:41.661 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.659+0000 7f2696fab800 4 Realm: () 2023-12-03T11:49:41.661 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.659+0000 7f2696fab800 4 ZoneGroup: default (6a811aad-435d-4fdd-93c9-b7e0b50de429) 2023-12-03T11:49:41.661 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.659+0000 7f2696fab800 4 Zone: default (83aabb46-04b5-4c96-9933-c6bfb1173a73) 2023-12-03T11:49:41.661 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.659+0000 7f2696fab800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:49:41.661 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.659+0000 7f2696fab800 20 zonegroup default 2023-12-03T11:49:41.661 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.659+0000 7f2696fab800 20 rados->read ofs=0 len=0 2023-12-03T11:49:41.661 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.659+0000 7f2696fab800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:41.661 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.659+0000 7f2696fab800 20 rados->read ofs=0 len=0 2023-12-03T11:49:41.661 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.659+0000 7f2696fab800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:41.662 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.659+0000 7f2696fab800 20 rados->read ofs=0 len=0 2023-12-03T11:49:41.662 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.660+0000 7f2696fab800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:41.662 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.660+0000 7f2696fab800 20 started sync module instance, tier type = 2023-12-03T11:49:41.662 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.660+0000 7f2696fab800 20 started zone id=83aabb46-04b5-4c96-9933-c6bfb1173a73 (name=default) with tier type = 2023-12-03T11:49:41.666 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.664+0000 7f26952ac640 0 -- 172.21.15.3:0/1246778787 >> [v2:172.21.15.37:6817/511039327,v1:172.21.15.37:6819/511039327] conn(0x7f2688082040 msgr2=0x7f268805e960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:49:41.670 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.669+0000 7f2696fab800 20 add_watcher() i=0 2023-12-03T11:49:41.670 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.669+0000 7f2696fab800 20 add_watcher() i=1 2023-12-03T11:49:41.670 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.669+0000 7f2696fab800 20 add_watcher() i=2 2023-12-03T11:49:41.670 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.669+0000 7f2696fab800 20 add_watcher() i=3 2023-12-03T11:49:41.670 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.669+0000 7f2696fab800 20 add_watcher() i=4 2023-12-03T11:49:41.671 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.669+0000 7f2696fab800 20 add_watcher() i=5 2023-12-03T11:49:41.671 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.669+0000 7f2696fab800 20 add_watcher() i=6 2023-12-03T11:49:41.671 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.670+0000 7f2696fab800 20 add_watcher() i=7 2023-12-03T11:49:41.671 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.670+0000 7f2696fab800 2 all 8 watchers are set, enabling cache 2023-12-03T11:49:41.673 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.672+0000 7f265afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:49:41.673 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.672+0000 7f2696fab800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:49:41.673 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.672+0000 7f2696fab800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:49:41.681 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.679+0000 7f2696fab800 5 note: GC not initialized 2023-12-03T11:49:41.681 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.679+0000 7f25c9ffb640 20 reqs_thread_entry: start 2023-12-03T11:49:41.681 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.679+0000 7f2696fab800 20 init_complete bucket index max shards: 11 2023-12-03T11:49:41.681 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.679+0000 7f2696fab800 20 Filter name: none 2023-12-03T11:49:41.681 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.680+0000 7f25bb7fe640 20 reqs_thread_entry: start 2023-12-03T11:49:41.681 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.680+0000 7f2696fab800 10 cache get: name=default.rgw.meta+root+error-at-do-reshard : miss 2023-12-03T11:49:41.681 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.680+0000 7f2696fab800 20 rados->read ofs=0 len=0 2023-12-03T11:49:41.682 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.680+0000 7f2696fab800 20 rados_obj.operate() r=0 bl.length=211 2023-12-03T11:49:41.682 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.680+0000 7f2696fab800 10 cache put: name=default.rgw.meta+root+error-at-do-reshard info.flags=0x11 2023-12-03T11:49:41.682 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.680+0000 7f2696fab800 10 adding default.rgw.meta+root+error-at-do-reshard to cache LRU end 2023-12-03T11:49:41.682 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.680+0000 7f2696fab800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.27 : miss 2023-12-03T11:49:41.683 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.680+0000 7f2696fab800 20 rados->read ofs=0 len=0 2023-12-03T11:49:41.683 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.681+0000 7f2696fab800 20 rados_obj.operate() r=0 bl.length=383 2023-12-03T11:49:41.683 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.681+0000 7f2696fab800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.27 info.flags=0x17 2023-12-03T11:49:41.683 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.681+0000 7f2696fab800 10 adding default.rgw.meta+root+.bucket.meta.error-at-do-reshard:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.27 to cache LRU end 2023-12-03T11:49:41.683 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.681+0000 7f2696fab800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:49:41.683 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.681+0000 7f2696fab800 10 updating xattr: name=user.rgw.acl bl.length()=265 2023-12-03T11:49:41.683 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.681+0000 7f2696fab800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.27 2023-12-03T11:49:41.687 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.686+0000 7f2696fab800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.27 info.flags=0x17 2023-12-03T11:49:41.688 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.686+0000 7f2696fab800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.27 to cache LRU end 2023-12-03T11:49:41.688 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.686+0000 7f2696fab800 10 updating xattr: name=user.rgw.acl bl.length()=265 2023-12-03T11:49:41.688 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.686+0000 7f2696fab800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.27, ofs0, ns] 2023-12-03T11:49:41.688 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.686+0000 7f267b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660516 cookie 94333247485616 notifier 6824 bl.length()=945 2023-12-03T11:49:41.688 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.686+0000 7f267b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.27 info.flags=0x17 2023-12-03T11:49:41.688 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.686+0000 7f267b7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.27 to cache LRU end 2023-12-03T11:49:41.689 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.686+0000 7f267b7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2023-12-03T11:49:41.689 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.688+0000 7f2696fab800 20 handle_bi_update(): bucket=:error-at-do-reshard[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.27]): orig_sources= new_sources= 2023-12-03T11:49:41.689 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.688+0000 7f2696fab800 20 handle_bi_update(): bucket=:error-at-do-reshard[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.27]): potential sources added=[] removed=[] 2023-12-03T11:49:41.689 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.688+0000 7f2696fab800 20 handle_bi_update(): bucket=:error-at-do-reshard[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.27]): orig_dests= new_dests= 2023-12-03T11:49:41.689 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.688+0000 7f2696fab800 20 handle_bi_update(): bucket=:error-at-do-reshard[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.27]): potential dests added=[] removed=[] 2023-12-03T11:49:41.693 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.691+0000 7f2696fab800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.27.1.0 2023-12-03T11:49:41.693 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.691+0000 7f2696fab800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.27.1.0 2023-12-03T11:49:41.693 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.691+0000 7f2696fab800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.27.1.1 2023-12-03T11:49:41.693 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.691+0000 7f2696fab800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.27.1.1 2023-12-03T11:49:41.693 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.691+0000 7f2696fab800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.27.1.2 2023-12-03T11:49:41.693 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.691+0000 7f2696fab800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.27.1.2 2023-12-03T11:49:41.693 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.691+0000 7f2696fab800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.27.1.3 2023-12-03T11:49:41.693 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.691+0000 7f2696fab800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.27.1.3 2023-12-03T11:49:41.693 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.691+0000 7f2696fab800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.27.1.4 2023-12-03T11:49:41.694 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.691+0000 7f2696fab800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.27.1.4 2023-12-03T11:49:41.694 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.691+0000 7f2696fab800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.27.1.5 2023-12-03T11:49:41.694 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.691+0000 7f2696fab800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.27.1.5 2023-12-03T11:49:41.694 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.691+0000 7f2696fab800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.27.1.6 2023-12-03T11:49:41.694 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.691+0000 7f2696fab800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.27.1.6 2023-12-03T11:49:41.694 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.691+0000 7f2696fab800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.27.1.7 2023-12-03T11:49:41.694 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.691+0000 7f2696fab800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.27.1.7 2023-12-03T11:49:41.694 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.691+0000 7f2696fab800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.27.1.8 2023-12-03T11:49:41.694 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.691+0000 7f2696fab800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.27.1.8 2023-12-03T11:49:41.694 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.691+0000 7f2696fab800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.27.1.9 2023-12-03T11:49:41.694 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.691+0000 7f2696fab800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.27.1.9 2023-12-03T11:49:41.694 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.691+0000 7f2696fab800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.27.1.10 2023-12-03T11:49:41.694 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.691+0000 7f2696fab800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.27.1.10 2023-12-03T11:49:41.695 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.691+0000 7f2696fab800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.27.1.11 2023-12-03T11:49:41.695 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.691+0000 7f2696fab800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.27.1.11 2023-12-03T11:49:41.695 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.691+0000 7f2696fab800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.27.0 2023-12-03T11:49:41.695 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.692+0000 7f2696fab800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.27.1 2023-12-03T11:49:41.696 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.692+0000 7f2696fab800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.27.2 2023-12-03T11:49:41.696 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.693+0000 7f2696fab800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.27.3 2023-12-03T11:49:41.696 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.693+0000 7f2696fab800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.27.4 2023-12-03T11:49:41.696 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.694+0000 7f2696fab800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.27.5 2023-12-03T11:49:41.696 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.694+0000 7f2696fab800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.27.6 2023-12-03T11:49:41.696 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.695+0000 7f2696fab800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.27.7 2023-12-03T11:49:41.697 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.696+0000 7f2696fab800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.27.8 2023-12-03T11:49:41.697 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.696+0000 7f2696fab800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.27.9 2023-12-03T11:49:41.698 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.697+0000 7f2696fab800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.27.10 2023-12-03T11:49:41.702 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.701+0000 7f2696fab800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.27 : hit (requested=0x17, cached=0x17) 2023-12-03T11:49:41.702 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.701+0000 7f2696fab800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.27 2023-12-03T11:49:41.703 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.702+0000 7f2696fab800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.27 info.flags=0x17 2023-12-03T11:49:41.703 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.702+0000 7f2696fab800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.27 to cache LRU end 2023-12-03T11:49:41.704 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.702+0000 7f2696fab800 10 updating xattr: name=user.rgw.acl bl.length()=265 2023-12-03T11:49:41.704 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.702+0000 7f2696fab800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.27, ofs0, ns] 2023-12-03T11:49:41.704 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.702+0000 7f267affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660517 cookie 94333247485616 notifier 6824 bl.length()=913 2023-12-03T11:49:41.704 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.702+0000 7f267affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.27 info.flags=0x17 2023-12-03T11:49:41.704 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.702+0000 7f267affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.27 to cache LRU end 2023-12-03T11:49:41.704 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.702+0000 7f267affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2023-12-03T11:49:41.705 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.704+0000 7f2696fab800 20 handle_bi_update(): bucket=:error-at-do-reshard[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.27]): orig_sources= new_sources= 2023-12-03T11:49:41.705 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.704+0000 7f2696fab800 20 handle_bi_update(): bucket=:error-at-do-reshard[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.27]): potential sources added=[] removed=[] 2023-12-03T11:49:41.705 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.704+0000 7f2696fab800 20 handle_bi_update(): bucket=:error-at-do-reshard[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.27]): orig_dests= new_dests= 2023-12-03T11:49:41.705 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.704+0000 7f2696fab800 20 handle_bi_update(): bucket=:error-at-do-reshard[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.27]): potential dests added=[] removed=[] 2023-12-03T11:49:41.707 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.706+0000 7f2696fab800 1 execute INFO: reshard of bucket "error-at-do-reshard" completed successfully 2023-12-03T11:49:41.709 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.708+0000 7f265afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:49:41.711 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.710+0000 7f2696fab800 20 remove_watcher() i=0 2023-12-03T11:49:41.712 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.710+0000 7f2696fab800 2 removed watcher, disabling cache 2023-12-03T11:49:41.713 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.712+0000 7f2696fab800 20 remove_watcher() i=1 2023-12-03T11:49:41.714 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.713+0000 7f2696fab800 20 remove_watcher() i=2 2023-12-03T11:49:41.715 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.714+0000 7f2696fab800 20 remove_watcher() i=3 2023-12-03T11:49:41.716 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.715+0000 7f2696fab800 20 remove_watcher() i=4 2023-12-03T11:49:41.717 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.716+0000 7f2696fab800 20 remove_watcher() i=5 2023-12-03T11:49:41.718 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.717+0000 7f2696fab800 20 remove_watcher() i=6 2023-12-03T11:49:41.719 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.718+0000 7f2696fab800 20 remove_watcher() i=7 2023-12-03T11:49:41.725 INFO:tasks.workunit.client.0.smithi003.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2023-12-03T11:49:41.753 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:49:41.753 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:49:41.768 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.766+0000 7fd98bb22800 20 rados->read ofs=0 len=0 2023-12-03T11:49:41.769 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.768+0000 7fd98bb22800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:41.770 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.768+0000 7fd98bb22800 20 realm 2023-12-03T11:49:41.770 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.768+0000 7fd98bb22800 20 rados->read ofs=0 len=0 2023-12-03T11:49:41.770 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.768+0000 7fd98bb22800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:41.770 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.768+0000 7fd98bb22800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:49:41.770 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.768+0000 7fd98bb22800 20 rados->read ofs=0 len=0 2023-12-03T11:49:41.770 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.768+0000 7fd98bb22800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:41.770 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.768+0000 7fd98bb22800 20 rados->read ofs=0 len=0 2023-12-03T11:49:41.771 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.769+0000 7fd98bb22800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:49:41.771 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.769+0000 7fd98bb22800 20 rados->read ofs=0 len=0 2023-12-03T11:49:41.771 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.770+0000 7fd98bb22800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:49:41.771 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.770+0000 7fd98bb22800 20 searching for the correct realm 2023-12-03T11:49:41.779 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.778+0000 7fd98807f640 0 -- 172.21.15.3:0/1426549866 >> [v2:172.21.15.3:6816/2638197404,v1:172.21.15.3:6818/2638197404] conn(0x55aa8f184b20 msgr2=0x55aa8f186f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:49:41.782 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.781+0000 7fd98bb22800 20 RGWRados::pool_iterate: got zone_info.83aabb46-04b5-4c96-9933-c6bfb1173a73 2023-12-03T11:49:41.782 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.781+0000 7fd98bb22800 20 RGWRados::pool_iterate: got zonegroup_info.6a811aad-435d-4fdd-93c9-b7e0b50de429 2023-12-03T11:49:41.782 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.781+0000 7fd98bb22800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:49:41.782 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.781+0000 7fd98bb22800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:49:41.783 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.781+0000 7fd98bb22800 20 rados->read ofs=0 len=0 2023-12-03T11:49:41.783 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.781+0000 7fd98bb22800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:41.783 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.781+0000 7fd98bb22800 20 rados->read ofs=0 len=0 2023-12-03T11:49:41.784 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.781+0000 7fd98bb22800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:49:41.784 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.781+0000 7fd98bb22800 20 rados->read ofs=0 len=0 2023-12-03T11:49:41.784 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.782+0000 7fd98bb22800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:49:41.784 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.782+0000 7fd98bb22800 20 zone default found 2023-12-03T11:49:41.784 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.782+0000 7fd98bb22800 4 Realm: () 2023-12-03T11:49:41.784 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.782+0000 7fd98bb22800 4 ZoneGroup: default (6a811aad-435d-4fdd-93c9-b7e0b50de429) 2023-12-03T11:49:41.784 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.782+0000 7fd98bb22800 4 Zone: default (83aabb46-04b5-4c96-9933-c6bfb1173a73) 2023-12-03T11:49:41.784 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.782+0000 7fd98bb22800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:49:41.784 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.782+0000 7fd98bb22800 20 zonegroup default 2023-12-03T11:49:41.785 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.782+0000 7fd98bb22800 20 rados->read ofs=0 len=0 2023-12-03T11:49:41.785 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.782+0000 7fd98bb22800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:41.785 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.782+0000 7fd98bb22800 20 rados->read ofs=0 len=0 2023-12-03T11:49:41.785 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.782+0000 7fd98bb22800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:41.785 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.782+0000 7fd98bb22800 20 rados->read ofs=0 len=0 2023-12-03T11:49:41.785 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.783+0000 7fd98bb22800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:41.785 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.783+0000 7fd98bb22800 20 started sync module instance, tier type = 2023-12-03T11:49:41.785 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.783+0000 7fd98bb22800 20 started zone id=83aabb46-04b5-4c96-9933-c6bfb1173a73 (name=default) with tier type = 2023-12-03T11:49:41.785 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.783+0000 7fd98807f640 0 -- 172.21.15.3:0/1426549866 >> [v2:172.21.15.37:6816/3770469300,v1:172.21.15.37:6818/3770469300] conn(0x7fd97c04d420 msgr2=0x7fd97c04d8a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-03T11:49:41.793 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.792+0000 7fd98bb22800 20 add_watcher() i=0 2023-12-03T11:49:41.793 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.792+0000 7fd98bb22800 20 add_watcher() i=1 2023-12-03T11:49:41.793 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.792+0000 7fd98bb22800 20 add_watcher() i=2 2023-12-03T11:49:41.793 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.792+0000 7fd98bb22800 20 add_watcher() i=3 2023-12-03T11:49:41.793 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.792+0000 7fd98bb22800 20 add_watcher() i=4 2023-12-03T11:49:41.794 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.792+0000 7fd98bb22800 20 add_watcher() i=5 2023-12-03T11:49:41.794 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.792+0000 7fd98bb22800 20 add_watcher() i=6 2023-12-03T11:49:41.794 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.792+0000 7fd98bb22800 20 add_watcher() i=7 2023-12-03T11:49:41.794 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.792+0000 7fd98bb22800 2 all 8 watchers are set, enabling cache 2023-12-03T11:49:41.795 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.794+0000 7fd94dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:49:41.796 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.795+0000 7fd98bb22800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:49:41.796 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.795+0000 7fd98bb22800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:49:41.803 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.801+0000 7fd98bb22800 5 note: GC not initialized 2023-12-03T11:49:41.803 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.801+0000 7fd8c4ff9640 20 reqs_thread_entry: start 2023-12-03T11:49:41.803 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.801+0000 7fd98bb22800 20 init_complete bucket index max shards: 11 2023-12-03T11:49:41.803 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.801+0000 7fd98bb22800 20 Filter name: none 2023-12-03T11:49:41.803 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.801+0000 7fd8ba7fc640 20 reqs_thread_entry: start 2023-12-03T11:49:41.803 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.801+0000 7fd98bb22800 20 rados->read ofs=0 len=0 2023-12-03T11:49:41.803 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.802+0000 7fd98bb22800 20 rados_obj.operate() r=0 bl.length=211 2023-12-03T11:49:41.803 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.802+0000 7fd98bb22800 20 rados->read ofs=0 len=0 2023-12-03T11:49:41.804 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.802+0000 7fd98bb22800 20 rados_obj.operate() r=0 bl.length=383 2023-12-03T11:49:41.804 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.802+0000 7fd98bb22800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:49:41.804 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.802+0000 7fd98bb22800 20 rados->read ofs=0 len=0 2023-12-03T11:49:41.804 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.802+0000 7fd98bb22800 20 rados_obj.operate() r=0 bl.length=211 2023-12-03T11:49:41.804 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.802+0000 7fd98bb22800 20 rados->read ofs=0 len=0 2023-12-03T11:49:41.804 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.803+0000 7fd98bb22800 20 rados_obj.operate() r=0 bl.length=383 2023-12-03T11:49:41.804 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.803+0000 7fd98bb22800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:49:41.805 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.804+0000 7fd98bb22800 20 rados->read ofs=0 len=0 2023-12-03T11:49:41.805 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.804+0000 7fd98bb22800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:41.806 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.805+0000 7fd94dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:49:41.808 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.807+0000 7fd98bb22800 20 remove_watcher() i=0 2023-12-03T11:49:41.808 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.807+0000 7fd98bb22800 2 removed watcher, disabling cache 2023-12-03T11:49:41.809 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.807+0000 7fd98bb22800 20 remove_watcher() i=1 2023-12-03T11:49:41.810 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.809+0000 7fd98bb22800 20 remove_watcher() i=2 2023-12-03T11:49:41.811 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.809+0000 7fd98bb22800 20 remove_watcher() i=3 2023-12-03T11:49:41.812 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.810+0000 7fd98bb22800 20 remove_watcher() i=4 2023-12-03T11:49:41.813 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.811+0000 7fd98bb22800 20 remove_watcher() i=5 2023-12-03T11:49:41.814 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.812+0000 7fd98bb22800 20 remove_watcher() i=6 2023-12-03T11:49:41.814 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:41.813+0000 7fd98bb22800 20 remove_watcher() i=7 2023-12-03T11:49:41.820 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:49:41.820 INFO:tasks.workunit.client.0.smithi003.stderr:BUCKET_STATS: 2023-12-03T11:49:41.820 INFO:tasks.workunit.client.0.smithi003.stderr:bucket: error-at-do-reshard id: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.27 num_objects: 19 size_kb: 1 num_shards: 12 2023-12-03T11:49:41.820 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:49:42.126 INFO:tasks.workunit.client.0.smithi003.stderr:TEST: reshard bucket with abort at do_reshard 2023-12-03T11:49:42.126 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:49:42.821 INFO:tasks.workunit.client.0.smithi003.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2023-12-03T11:49:42.849 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:49:42.849 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:49:42.863 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:42.862+0000 7f43c153b800 20 rados->read ofs=0 len=0 2023-12-03T11:49:42.865 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:42.864+0000 7f43c153b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:42.865 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:42.864+0000 7f43c153b800 20 realm 2023-12-03T11:49:42.866 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:42.864+0000 7f43c153b800 20 rados->read ofs=0 len=0 2023-12-03T11:49:42.866 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:42.864+0000 7f43c153b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:42.866 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:42.864+0000 7f43c153b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:49:42.866 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:42.864+0000 7f43c153b800 20 rados->read ofs=0 len=0 2023-12-03T11:49:42.866 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:42.864+0000 7f43c153b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:42.866 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:42.864+0000 7f43c153b800 20 rados->read ofs=0 len=0 2023-12-03T11:49:42.866 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:42.865+0000 7f43c153b800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:49:42.867 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:42.865+0000 7f43c153b800 20 rados->read ofs=0 len=0 2023-12-03T11:49:42.867 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:42.865+0000 7f43c153b800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:49:42.867 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:42.865+0000 7f43c153b800 20 searching for the correct realm 2023-12-03T11:49:42.877 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:42.875+0000 7f43bca3f640 0 -- 172.21.15.3:0/920766383 >> [v2:172.21.15.3:6817/3356208405,v1:172.21.15.3:6819/3356208405] conn(0x5603249e7070 msgr2=0x5603249e9460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-03T11:49:42.878 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:42.877+0000 7f43c153b800 20 RGWRados::pool_iterate: got zone_info.83aabb46-04b5-4c96-9933-c6bfb1173a73 2023-12-03T11:49:42.878 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:42.877+0000 7f43c153b800 20 RGWRados::pool_iterate: got zonegroup_info.6a811aad-435d-4fdd-93c9-b7e0b50de429 2023-12-03T11:49:42.878 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:42.877+0000 7f43c153b800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:49:42.878 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:42.877+0000 7f43c153b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:49:42.878 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:42.877+0000 7f43c153b800 20 rados->read ofs=0 len=0 2023-12-03T11:49:42.878 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:42.877+0000 7f43c153b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:42.878 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:42.877+0000 7f43c153b800 20 rados->read ofs=0 len=0 2023-12-03T11:49:42.880 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:42.877+0000 7f43c153b800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:49:42.880 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:42.877+0000 7f43c153b800 20 rados->read ofs=0 len=0 2023-12-03T11:49:42.880 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:42.878+0000 7f43c153b800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:49:42.880 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:42.878+0000 7f43c153b800 20 zone default found 2023-12-03T11:49:42.880 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:42.878+0000 7f43c153b800 4 Realm: () 2023-12-03T11:49:42.880 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:42.878+0000 7f43c153b800 4 ZoneGroup: default (6a811aad-435d-4fdd-93c9-b7e0b50de429) 2023-12-03T11:49:42.880 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:42.878+0000 7f43c153b800 4 Zone: default (83aabb46-04b5-4c96-9933-c6bfb1173a73) 2023-12-03T11:49:42.880 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:42.878+0000 7f43c153b800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:49:42.880 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:42.878+0000 7f43c153b800 20 zonegroup default 2023-12-03T11:49:42.880 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:42.878+0000 7f43c153b800 20 rados->read ofs=0 len=0 2023-12-03T11:49:42.880 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:42.878+0000 7f43c153b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:42.880 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:42.878+0000 7f43c153b800 20 rados->read ofs=0 len=0 2023-12-03T11:49:42.880 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:42.878+0000 7f43c153b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:42.880 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:42.878+0000 7f43c153b800 20 rados->read ofs=0 len=0 2023-12-03T11:49:42.881 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:42.879+0000 7f43c153b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:42.881 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:42.879+0000 7f43c153b800 20 started sync module instance, tier type = 2023-12-03T11:49:42.881 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:42.879+0000 7f43c153b800 20 started zone id=83aabb46-04b5-4c96-9933-c6bfb1173a73 (name=default) with tier type = 2023-12-03T11:49:42.886 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:42.885+0000 7f43bda41640 0 -- 172.21.15.3:0/920766383 >> [v2:172.21.15.37:6816/3770469300,v1:172.21.15.37:6818/3770469300] conn(0x7f43b4008030 msgr2=0x7f43b4088040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:49:42.889 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:42.888+0000 7f43c153b800 20 add_watcher() i=0 2023-12-03T11:49:42.889 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:42.888+0000 7f43c153b800 20 add_watcher() i=1 2023-12-03T11:49:42.889 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:42.888+0000 7f43c153b800 20 add_watcher() i=2 2023-12-03T11:49:42.889 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:42.888+0000 7f43c153b800 20 add_watcher() i=3 2023-12-03T11:49:42.889 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:42.888+0000 7f43c153b800 20 add_watcher() i=4 2023-12-03T11:49:42.889 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:42.888+0000 7f43c153b800 20 add_watcher() i=5 2023-12-03T11:49:42.889 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:42.888+0000 7f43c153b800 20 add_watcher() i=6 2023-12-03T11:49:42.890 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:42.889+0000 7f43c153b800 20 add_watcher() i=7 2023-12-03T11:49:42.890 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:42.889+0000 7f43c153b800 2 all 8 watchers are set, enabling cache 2023-12-03T11:49:42.891 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:42.890+0000 7f4382fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:49:42.892 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:42.891+0000 7f43c153b800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:49:42.892 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:42.891+0000 7f43c153b800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:49:42.898 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:42.897+0000 7f43c153b800 5 note: GC not initialized 2023-12-03T11:49:42.898 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:42.897+0000 7f42f1ffb640 20 reqs_thread_entry: start 2023-12-03T11:49:42.899 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:42.897+0000 7f43c153b800 20 init_complete bucket index max shards: 11 2023-12-03T11:49:42.899 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:42.897+0000 7f43c153b800 20 Filter name: none 2023-12-03T11:49:42.899 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:42.897+0000 7f42e37fe640 20 reqs_thread_entry: start 2023-12-03T11:49:42.899 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:42.897+0000 7f43c153b800 20 rados->read ofs=0 len=0 2023-12-03T11:49:42.899 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:42.898+0000 7f43c153b800 20 rados_obj.operate() r=0 bl.length=211 2023-12-03T11:49:42.899 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:42.898+0000 7f43c153b800 20 rados->read ofs=0 len=0 2023-12-03T11:49:42.900 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:42.899+0000 7f43c153b800 20 rados_obj.operate() r=0 bl.length=383 2023-12-03T11:49:42.900 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:42.899+0000 7f43c153b800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:49:42.900 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:42.899+0000 7f43c153b800 20 rados->read ofs=0 len=0 2023-12-03T11:49:42.900 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:42.899+0000 7f43c153b800 20 rados_obj.operate() r=0 bl.length=211 2023-12-03T11:49:42.900 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:42.899+0000 7f43c153b800 20 rados->read ofs=0 len=0 2023-12-03T11:49:42.901 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:42.899+0000 7f43c153b800 20 rados_obj.operate() r=0 bl.length=383 2023-12-03T11:49:42.901 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:42.899+0000 7f43c153b800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:49:42.901 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:42.900+0000 7f43c153b800 20 rados->read ofs=0 len=0 2023-12-03T11:49:42.902 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:42.900+0000 7f43c153b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:42.902 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:42.901+0000 7f4382fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:49:42.905 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:42.904+0000 7f43c153b800 20 remove_watcher() i=0 2023-12-03T11:49:42.905 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:42.904+0000 7f43c153b800 2 removed watcher, disabling cache 2023-12-03T11:49:42.906 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:42.904+0000 7f43c153b800 20 remove_watcher() i=1 2023-12-03T11:49:42.907 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:42.905+0000 7f43c153b800 20 remove_watcher() i=2 2023-12-03T11:49:42.908 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:42.907+0000 7f43c153b800 20 remove_watcher() i=3 2023-12-03T11:49:42.909 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:42.908+0000 7f43c153b800 20 remove_watcher() i=4 2023-12-03T11:49:42.910 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:42.909+0000 7f43c153b800 20 remove_watcher() i=5 2023-12-03T11:49:42.911 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:42.910+0000 7f43c153b800 20 remove_watcher() i=6 2023-12-03T11:49:42.912 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:42.911+0000 7f43c153b800 20 remove_watcher() i=7 2023-12-03T11:49:42.917 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:49:42.917 INFO:tasks.workunit.client.0.smithi003.stderr:BUCKET_STATS: 2023-12-03T11:49:42.917 INFO:tasks.workunit.client.0.smithi003.stderr:bucket: abort-at-do-reshard id: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.28 num_objects: 20 size_kb: 1 num_shards: 11 2023-12-03T11:49:42.917 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:49:42.918 INFO:tasks.workunit.client.0.smithi003.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2023-12-03T11:49:42.953 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:49:42.953 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:49:42.966 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:42.965+0000 7f7ab7d21800 20 rados->read ofs=0 len=0 2023-12-03T11:49:42.968 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:42.966+0000 7f7ab7d21800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:42.968 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:42.966+0000 7f7ab7d21800 20 realm 2023-12-03T11:49:42.968 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:42.966+0000 7f7ab7d21800 20 rados->read ofs=0 len=0 2023-12-03T11:49:42.968 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:42.967+0000 7f7ab7d21800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:42.968 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:42.967+0000 7f7ab7d21800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:49:42.968 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:42.967+0000 7f7ab7d21800 20 rados->read ofs=0 len=0 2023-12-03T11:49:42.969 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:42.967+0000 7f7ab7d21800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:42.969 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:42.967+0000 7f7ab7d21800 20 rados->read ofs=0 len=0 2023-12-03T11:49:42.969 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:42.968+0000 7f7ab7d21800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:49:42.969 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:42.968+0000 7f7ab7d21800 20 rados->read ofs=0 len=0 2023-12-03T11:49:42.969 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:42.968+0000 7f7ab7d21800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:49:42.969 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:42.968+0000 7f7ab7d21800 20 searching for the correct realm 2023-12-03T11:49:42.980 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:42.979+0000 7f7ab32b7640 0 -- 172.21.15.3:0/439359597 >> [v2:172.21.15.3:6817/3356208405,v1:172.21.15.3:6819/3356208405] conn(0x55afbf7e63b0 msgr2=0x55afbf7e87a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:49:42.981 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:42.979+0000 7f7ab7d21800 20 RGWRados::pool_iterate: got zone_info.83aabb46-04b5-4c96-9933-c6bfb1173a73 2023-12-03T11:49:42.981 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:42.979+0000 7f7ab7d21800 20 RGWRados::pool_iterate: got zonegroup_info.6a811aad-435d-4fdd-93c9-b7e0b50de429 2023-12-03T11:49:42.981 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:42.979+0000 7f7ab7d21800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:49:42.981 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:42.979+0000 7f7ab7d21800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:49:42.981 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:42.979+0000 7f7ab7d21800 20 rados->read ofs=0 len=0 2023-12-03T11:49:42.981 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:42.980+0000 7f7ab7d21800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:42.981 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:42.980+0000 7f7ab7d21800 20 rados->read ofs=0 len=0 2023-12-03T11:49:42.982 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:42.980+0000 7f7ab7d21800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:49:42.983 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:42.980+0000 7f7ab7d21800 20 rados->read ofs=0 len=0 2023-12-03T11:49:42.983 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:42.980+0000 7f7ab7d21800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:49:42.983 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:42.980+0000 7f7ab7d21800 20 zone default found 2023-12-03T11:49:42.983 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:42.980+0000 7f7ab7d21800 4 Realm: () 2023-12-03T11:49:42.983 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:42.980+0000 7f7ab7d21800 4 ZoneGroup: default (6a811aad-435d-4fdd-93c9-b7e0b50de429) 2023-12-03T11:49:42.983 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:42.980+0000 7f7ab7d21800 4 Zone: default (83aabb46-04b5-4c96-9933-c6bfb1173a73) 2023-12-03T11:49:42.983 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:42.980+0000 7f7ab7d21800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:49:42.983 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:42.980+0000 7f7ab7d21800 20 zonegroup default 2023-12-03T11:49:42.983 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:42.980+0000 7f7ab7d21800 20 rados->read ofs=0 len=0 2023-12-03T11:49:42.983 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:42.980+0000 7f7ab7d21800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:42.983 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:42.980+0000 7f7ab7d21800 20 rados->read ofs=0 len=0 2023-12-03T11:49:42.983 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:42.981+0000 7f7ab7d21800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:42.983 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:42.981+0000 7f7ab7d21800 20 rados->read ofs=0 len=0 2023-12-03T11:49:42.984 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:42.981+0000 7f7ab7d21800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:42.984 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:42.981+0000 7f7ab7d21800 20 started sync module instance, tier type = 2023-12-03T11:49:42.984 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:42.981+0000 7f7ab7d21800 20 started zone id=83aabb46-04b5-4c96-9933-c6bfb1173a73 (name=default) with tier type = 2023-12-03T11:49:42.990 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:42.989+0000 7f7ab32b7640 0 -- 172.21.15.3:0/439359597 >> [v2:172.21.15.3:6817/3356208405,v1:172.21.15.3:6819/3356208405] conn(0x7f7a8c079d90 msgr2=0x7f7a8c07c1c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:49:42.992 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:42.991+0000 7f7ab7d21800 20 add_watcher() i=0 2023-12-03T11:49:42.992 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:42.991+0000 7f7ab7d21800 20 add_watcher() i=1 2023-12-03T11:49:42.992 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:42.991+0000 7f7ab7d21800 20 add_watcher() i=2 2023-12-03T11:49:42.993 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:42.991+0000 7f7ab7d21800 20 add_watcher() i=3 2023-12-03T11:49:42.993 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:42.991+0000 7f7ab7d21800 20 add_watcher() i=4 2023-12-03T11:49:42.993 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:42.991+0000 7f7ab7d21800 20 add_watcher() i=5 2023-12-03T11:49:42.993 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:42.991+0000 7f7ab7d21800 20 add_watcher() i=6 2023-12-03T11:49:42.993 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:42.991+0000 7f7ab7d21800 20 add_watcher() i=7 2023-12-03T11:49:42.993 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:42.991+0000 7f7ab7d21800 2 all 8 watchers are set, enabling cache 2023-12-03T11:49:42.994 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:42.993+0000 7f7a79fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:49:42.995 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:42.994+0000 7f7ab7d21800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:49:42.995 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:42.994+0000 7f7ab7d21800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:49:43.002 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:43.000+0000 7f7ab7d21800 5 note: GC not initialized 2023-12-03T11:49:43.002 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:43.000+0000 7f79f0ff9640 20 reqs_thread_entry: start 2023-12-03T11:49:43.002 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:43.000+0000 7f7ab7d21800 20 init_complete bucket index max shards: 11 2023-12-03T11:49:43.002 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:43.000+0000 7f7ab7d21800 20 Filter name: none 2023-12-03T11:49:43.002 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:43.000+0000 7f79e67fc640 20 reqs_thread_entry: start 2023-12-03T11:49:43.002 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:43.000+0000 7f7ab7d21800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2023-12-03T11:49:43.002 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:43.000+0000 7f7ab7d21800 20 rados->read ofs=0 len=0 2023-12-03T11:49:43.002 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:43.000+0000 7f7ab7d21800 20 rados_obj.operate() r=0 bl.length=211 2023-12-03T11:49:43.002 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:43.000+0000 7f7ab7d21800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2023-12-03T11:49:43.003 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:43.000+0000 7f7ab7d21800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2023-12-03T11:49:43.003 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:43.000+0000 7f7ab7d21800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.28 : miss 2023-12-03T11:49:43.003 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:43.000+0000 7f7ab7d21800 20 rados->read ofs=0 len=0 2023-12-03T11:49:43.003 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:43.001+0000 7f7ab7d21800 20 rados_obj.operate() r=0 bl.length=383 2023-12-03T11:49:43.003 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:43.001+0000 7f7ab7d21800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.28 info.flags=0x17 2023-12-03T11:49:43.004 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:43.001+0000 7f7ab7d21800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.28 to cache LRU end 2023-12-03T11:49:43.004 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:43.001+0000 7f7ab7d21800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:49:43.004 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:43.001+0000 7f7ab7d21800 10 updating xattr: name=user.rgw.acl bl.length()=265 2023-12-03T11:49:43.004 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:43.001+0000 7f7ab7d21800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.28 2023-12-03T11:49:43.008 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:43.007+0000 7f7ab7d21800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.28 info.flags=0x17 2023-12-03T11:49:43.008 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:43.007+0000 7f7ab7d21800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.28 to cache LRU end 2023-12-03T11:49:43.008 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:43.007+0000 7f7ab7d21800 10 updating xattr: name=user.rgw.acl bl.length()=265 2023-12-03T11:49:43.008 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:43.007+0000 7f7ab7d21800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.28, ofs0, ns] 2023-12-03T11:49:43.009 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:43.007+0000 7f7a99ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660506 cookie 94213320384208 notifier 7290 bl.length()=945 2023-12-03T11:49:43.009 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:43.007+0000 7f7a99ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.28 info.flags=0x17 2023-12-03T11:49:43.009 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:43.007+0000 7f7a99ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.28 to cache LRU end 2023-12-03T11:49:43.009 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:43.007+0000 7f7a99ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2023-12-03T11:49:43.010 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:43.009+0000 7f7ab7d21800 20 handle_bi_update(): bucket=:abort-at-do-reshard[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.28]): orig_sources= new_sources= 2023-12-03T11:49:43.010 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:43.009+0000 7f7ab7d21800 20 handle_bi_update(): bucket=:abort-at-do-reshard[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.28]): potential sources added=[] removed=[] 2023-12-03T11:49:43.010 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:43.009+0000 7f7ab7d21800 20 handle_bi_update(): bucket=:abort-at-do-reshard[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.28]): orig_dests= new_dests= 2023-12-03T11:49:43.010 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:43.009+0000 7f7ab7d21800 20 handle_bi_update(): bucket=:abort-at-do-reshard[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.28]): potential dests added=[] removed=[] 2023-12-03T11:49:43.012 INFO:tasks.workunit.client.0.smithi003.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7537-gbcbf278c/rpm/el9/BUILD/ceph-18.0.0-7537-gbcbf278c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f7ab7d21800 time 2023-12-03T11:49:43.012468+0000 2023-12-03T11:49:43.013 INFO:tasks.workunit.client.0.smithi003.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7537-gbcbf278c/rpm/el9/BUILD/ceph-18.0.0-7537-gbcbf278c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2023-12-03T11:49:43.029 INFO:tasks.workunit.client.0.smithi003.stderr: ceph version 18.0.0-7537-gbcbf278c (bcbf278cf395873c2a482f5a7b2345faf2160319) reef (dev) 2023-12-03T11:49:43.029 INFO:tasks.workunit.client.0.smithi003.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f7aba96eef8] 2023-12-03T11:49:43.029 INFO:tasks.workunit.client.0.smithi003.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f0b6) [0x7f7aba96f0b6] 2023-12-03T11:49:43.029 INFO:tasks.workunit.client.0.smithi003.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55afbce67a71] 2023-12-03T11:49:43.029 INFO:tasks.workunit.client.0.smithi003.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x314) [0x55afbce73f34] 2023-12-03T11:49:43.029 INFO:tasks.workunit.client.0.smithi003.stderr: 5: main() 2023-12-03T11:49:43.029 INFO:tasks.workunit.client.0.smithi003.stderr: 6: /lib64/libc.so.6(+0x3feb0) [0x7f7ab823feb0] 2023-12-03T11:49:43.029 INFO:tasks.workunit.client.0.smithi003.stderr: 7: __libc_start_main() 2023-12-03T11:49:43.029 INFO:tasks.workunit.client.0.smithi003.stderr: 8: _start() 2023-12-03T11:49:43.029 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:43.012+0000 7f7ab7d21800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7537-gbcbf278c/rpm/el9/BUILD/ceph-18.0.0-7537-gbcbf278c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f7ab7d21800 time 2023-12-03T11:49:43.012468+0000 2023-12-03T11:49:43.029 INFO:tasks.workunit.client.0.smithi003.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7537-gbcbf278c/rpm/el9/BUILD/ceph-18.0.0-7537-gbcbf278c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2023-12-03T11:49:43.030 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:49:43.030 INFO:tasks.workunit.client.0.smithi003.stderr: ceph version 18.0.0-7537-gbcbf278c (bcbf278cf395873c2a482f5a7b2345faf2160319) reef (dev) 2023-12-03T11:49:43.030 INFO:tasks.workunit.client.0.smithi003.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f7aba96eef8] 2023-12-03T11:49:43.030 INFO:tasks.workunit.client.0.smithi003.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f0b6) [0x7f7aba96f0b6] 2023-12-03T11:49:43.030 INFO:tasks.workunit.client.0.smithi003.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55afbce67a71] 2023-12-03T11:49:43.030 INFO:tasks.workunit.client.0.smithi003.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x314) [0x55afbce73f34] 2023-12-03T11:49:43.030 INFO:tasks.workunit.client.0.smithi003.stderr: 5: main() 2023-12-03T11:49:43.030 INFO:tasks.workunit.client.0.smithi003.stderr: 6: /lib64/libc.so.6(+0x3feb0) [0x7f7ab823feb0] 2023-12-03T11:49:43.030 INFO:tasks.workunit.client.0.smithi003.stderr: 7: __libc_start_main() 2023-12-03T11:49:43.030 INFO:tasks.workunit.client.0.smithi003.stderr: 8: _start() 2023-12-03T11:49:43.030 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:49:43.030 INFO:tasks.workunit.client.0.smithi003.stderr:*** Caught signal (Aborted) ** 2023-12-03T11:49:43.030 INFO:tasks.workunit.client.0.smithi003.stderr: in thread 7f7ab7d21800 thread_name:radosgw-admin 2023-12-03T11:49:43.030 INFO:tasks.workunit.client.0.smithi003.stderr: ceph version 18.0.0-7537-gbcbf278c (bcbf278cf395873c2a482f5a7b2345faf2160319) reef (dev) 2023-12-03T11:49:43.031 INFO:tasks.workunit.client.0.smithi003.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f7ab8254db0] 2023-12-03T11:49:43.031 INFO:tasks.workunit.client.0.smithi003.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f7ab82a154c] 2023-12-03T11:49:43.031 INFO:tasks.workunit.client.0.smithi003.stderr: 3: raise() 2023-12-03T11:49:43.031 INFO:tasks.workunit.client.0.smithi003.stderr: 4: abort() 2023-12-03T11:49:43.031 INFO:tasks.workunit.client.0.smithi003.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f7aba96ef52] 2023-12-03T11:49:43.031 INFO:tasks.workunit.client.0.smithi003.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f0b6) [0x7f7aba96f0b6] 2023-12-03T11:49:43.031 INFO:tasks.workunit.client.0.smithi003.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55afbce67a71] 2023-12-03T11:49:43.031 INFO:tasks.workunit.client.0.smithi003.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x314) [0x55afbce73f34] 2023-12-03T11:49:43.031 INFO:tasks.workunit.client.0.smithi003.stderr: 9: main() 2023-12-03T11:49:43.031 INFO:tasks.workunit.client.0.smithi003.stderr: 10: /lib64/libc.so.6(+0x3feb0) [0x7f7ab823feb0] 2023-12-03T11:49:43.031 INFO:tasks.workunit.client.0.smithi003.stderr: 11: __libc_start_main() 2023-12-03T11:49:43.031 INFO:tasks.workunit.client.0.smithi003.stderr: 12: _start() 2023-12-03T11:49:43.031 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:43.012+0000 7f7ab7d21800 -1 *** Caught signal (Aborted) ** 2023-12-03T11:49:43.031 INFO:tasks.workunit.client.0.smithi003.stderr: in thread 7f7ab7d21800 thread_name:radosgw-admin 2023-12-03T11:49:43.031 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:49:43.032 INFO:tasks.workunit.client.0.smithi003.stderr: ceph version 18.0.0-7537-gbcbf278c (bcbf278cf395873c2a482f5a7b2345faf2160319) reef (dev) 2023-12-03T11:49:43.032 INFO:tasks.workunit.client.0.smithi003.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f7ab8254db0] 2023-12-03T11:49:43.032 INFO:tasks.workunit.client.0.smithi003.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f7ab82a154c] 2023-12-03T11:49:43.032 INFO:tasks.workunit.client.0.smithi003.stderr: 3: raise() 2023-12-03T11:49:43.032 INFO:tasks.workunit.client.0.smithi003.stderr: 4: abort() 2023-12-03T11:49:43.032 INFO:tasks.workunit.client.0.smithi003.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f7aba96ef52] 2023-12-03T11:49:43.032 INFO:tasks.workunit.client.0.smithi003.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f0b6) [0x7f7aba96f0b6] 2023-12-03T11:49:43.032 INFO:tasks.workunit.client.0.smithi003.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55afbce67a71] 2023-12-03T11:49:43.032 INFO:tasks.workunit.client.0.smithi003.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x314) [0x55afbce73f34] 2023-12-03T11:49:43.032 INFO:tasks.workunit.client.0.smithi003.stderr: 9: main() 2023-12-03T11:49:43.032 INFO:tasks.workunit.client.0.smithi003.stderr: 10: /lib64/libc.so.6(+0x3feb0) [0x7f7ab823feb0] 2023-12-03T11:49:43.032 INFO:tasks.workunit.client.0.smithi003.stderr: 11: __libc_start_main() 2023-12-03T11:49:43.032 INFO:tasks.workunit.client.0.smithi003.stderr: 12: _start() 2023-12-03T11:49:43.032 INFO:tasks.workunit.client.0.smithi003.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-12-03T11:49:43.032 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:49:43.032 INFO:tasks.workunit.client.0.smithi003.stderr:--- begin dump of recent events --- 2023-12-03T11:49:43.033 INFO:tasks.workunit.client.0.smithi003.stderr: -499> 2023-12-03T11:49:42.959+0000 7f7ab7d21800 10 monclient: _renew_subs 2023-12-03T11:49:43.033 INFO:tasks.workunit.client.0.smithi003.stderr: -498> 2023-12-03T11:49:42.959+0000 7f7ab7d21800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.3:3300/0 2023-12-03T11:49:43.033 INFO:tasks.workunit.client.0.smithi003.stderr: -497> 2023-12-03T11:49:42.959+0000 7f7ab7d21800 1 librados: init done 2023-12-03T11:49:43.033 INFO:tasks.workunit.client.0.smithi003.stderr: -496> 2023-12-03T11:49:42.959+0000 7f7ab7d21800 10 monclient: get_monmap_and_config 2023-12-03T11:49:43.033 INFO:tasks.workunit.client.0.smithi003.stderr: -495> 2023-12-03T11:49:42.959+0000 7f7ab7d21800 10 monclient: build_initial_monmap 2023-12-03T11:49:43.033 INFO:tasks.workunit.client.0.smithi003.stderr: -494> 2023-12-03T11:49:42.959+0000 7f7ab7d21800 1 build_initial for_mkfs: 0 2023-12-03T11:49:43.033 INFO:tasks.workunit.client.0.smithi003.stderr: -493> 2023-12-03T11:49:42.959+0000 7f7ab7d21800 10 monclient: monmap: 2023-12-03T11:49:43.033 INFO:tasks.workunit.client.0.smithi003.stderr:epoch 0 2023-12-03T11:49:43.033 INFO:tasks.workunit.client.0.smithi003.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-12-03T11:49:43.033 INFO:tasks.workunit.client.0.smithi003.stderr:last_changed 0.000000 2023-12-03T11:49:43.033 INFO:tasks.workunit.client.0.smithi003.stderr:created 0.000000 2023-12-03T11:49:43.033 INFO:tasks.workunit.client.0.smithi003.stderr:min_mon_release 0 (unknown) 2023-12-03T11:49:43.033 INFO:tasks.workunit.client.0.smithi003.stderr:election_strategy: 1 2023-12-03T11:49:43.033 INFO:tasks.workunit.client.0.smithi003.stderr:0: [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] mon.noname-a 2023-12-03T11:49:43.033 INFO:tasks.workunit.client.0.smithi003.stderr:1: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.noname-b 2023-12-03T11:49:43.034 INFO:tasks.workunit.client.0.smithi003.stderr:2: [v2:172.21.15.3:3301/0,v1:172.21.15.3:6790/0] mon.noname-c 2023-12-03T11:49:43.034 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:49:43.034 INFO:tasks.workunit.client.0.smithi003.stderr: -492> 2023-12-03T11:49:42.959+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf7905b0) adding auth protocol: cephx 2023-12-03T11:49:43.034 INFO:tasks.workunit.client.0.smithi003.stderr: -491> 2023-12-03T11:49:42.959+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf7905b0) adding auth protocol: cephx 2023-12-03T11:49:43.034 INFO:tasks.workunit.client.0.smithi003.stderr: -490> 2023-12-03T11:49:42.959+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf7905b0) adding auth protocol: cephx 2023-12-03T11:49:43.034 INFO:tasks.workunit.client.0.smithi003.stderr: -489> 2023-12-03T11:49:42.959+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf7905b0) adding con mode: secure 2023-12-03T11:49:43.034 INFO:tasks.workunit.client.0.smithi003.stderr: -488> 2023-12-03T11:49:42.959+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf7905b0) adding con mode: crc 2023-12-03T11:49:43.034 INFO:tasks.workunit.client.0.smithi003.stderr: -487> 2023-12-03T11:49:42.959+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf7905b0) adding con mode: secure 2023-12-03T11:49:43.034 INFO:tasks.workunit.client.0.smithi003.stderr: -486> 2023-12-03T11:49:42.959+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf7905b0) adding con mode: crc 2023-12-03T11:49:43.034 INFO:tasks.workunit.client.0.smithi003.stderr: -485> 2023-12-03T11:49:42.959+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf7905b0) adding con mode: secure 2023-12-03T11:49:43.034 INFO:tasks.workunit.client.0.smithi003.stderr: -484> 2023-12-03T11:49:42.959+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf7905b0) adding con mode: crc 2023-12-03T11:49:43.034 INFO:tasks.workunit.client.0.smithi003.stderr: -483> 2023-12-03T11:49:42.959+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf7905b0) adding con mode: crc 2023-12-03T11:49:43.034 INFO:tasks.workunit.client.0.smithi003.stderr: -482> 2023-12-03T11:49:42.959+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf7905b0) adding con mode: secure 2023-12-03T11:49:43.034 INFO:tasks.workunit.client.0.smithi003.stderr: -481> 2023-12-03T11:49:42.959+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf7905b0) adding con mode: crc 2023-12-03T11:49:43.035 INFO:tasks.workunit.client.0.smithi003.stderr: -480> 2023-12-03T11:49:42.959+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf7905b0) adding con mode: secure 2023-12-03T11:49:43.035 INFO:tasks.workunit.client.0.smithi003.stderr: -479> 2023-12-03T11:49:42.959+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf7905b0) adding con mode: crc 2023-12-03T11:49:43.035 INFO:tasks.workunit.client.0.smithi003.stderr: -478> 2023-12-03T11:49:42.959+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf7905b0) adding con mode: secure 2023-12-03T11:49:43.035 INFO:tasks.workunit.client.0.smithi003.stderr: -477> 2023-12-03T11:49:42.959+0000 7f7ab7d21800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:49:43.035 INFO:tasks.workunit.client.0.smithi003.stderr: -476> 2023-12-03T11:49:42.960+0000 7f7ab7d21800 10 monclient: init 2023-12-03T11:49:43.035 INFO:tasks.workunit.client.0.smithi003.stderr: -475> 2023-12-03T11:49:42.960+0000 7f7ab7d21800 5 AuthRegistry(0x7ffee04d5e70) adding auth protocol: cephx 2023-12-03T11:49:43.035 INFO:tasks.workunit.client.0.smithi003.stderr: -474> 2023-12-03T11:49:42.960+0000 7f7ab7d21800 5 AuthRegistry(0x7ffee04d5e70) adding auth protocol: cephx 2023-12-03T11:49:43.035 INFO:tasks.workunit.client.0.smithi003.stderr: -473> 2023-12-03T11:49:42.960+0000 7f7ab7d21800 5 AuthRegistry(0x7ffee04d5e70) adding auth protocol: cephx 2023-12-03T11:49:43.035 INFO:tasks.workunit.client.0.smithi003.stderr: -472> 2023-12-03T11:49:42.960+0000 7f7ab7d21800 5 AuthRegistry(0x7ffee04d5e70) adding con mode: secure 2023-12-03T11:49:43.035 INFO:tasks.workunit.client.0.smithi003.stderr: -471> 2023-12-03T11:49:42.960+0000 7f7ab7d21800 5 AuthRegistry(0x7ffee04d5e70) adding con mode: crc 2023-12-03T11:49:43.035 INFO:tasks.workunit.client.0.smithi003.stderr: -470> 2023-12-03T11:49:42.960+0000 7f7ab7d21800 5 AuthRegistry(0x7ffee04d5e70) adding con mode: secure 2023-12-03T11:49:43.035 INFO:tasks.workunit.client.0.smithi003.stderr: -469> 2023-12-03T11:49:42.960+0000 7f7ab7d21800 5 AuthRegistry(0x7ffee04d5e70) adding con mode: crc 2023-12-03T11:49:43.035 INFO:tasks.workunit.client.0.smithi003.stderr: -468> 2023-12-03T11:49:42.960+0000 7f7ab7d21800 5 AuthRegistry(0x7ffee04d5e70) adding con mode: secure 2023-12-03T11:49:43.035 INFO:tasks.workunit.client.0.smithi003.stderr: -467> 2023-12-03T11:49:42.960+0000 7f7ab7d21800 5 AuthRegistry(0x7ffee04d5e70) adding con mode: crc 2023-12-03T11:49:43.035 INFO:tasks.workunit.client.0.smithi003.stderr: -466> 2023-12-03T11:49:42.960+0000 7f7ab7d21800 5 AuthRegistry(0x7ffee04d5e70) adding con mode: crc 2023-12-03T11:49:43.035 INFO:tasks.workunit.client.0.smithi003.stderr: -465> 2023-12-03T11:49:42.960+0000 7f7ab7d21800 5 AuthRegistry(0x7ffee04d5e70) adding con mode: secure 2023-12-03T11:49:43.036 INFO:tasks.workunit.client.0.smithi003.stderr: -464> 2023-12-03T11:49:42.960+0000 7f7ab7d21800 5 AuthRegistry(0x7ffee04d5e70) adding con mode: crc 2023-12-03T11:49:43.036 INFO:tasks.workunit.client.0.smithi003.stderr: -463> 2023-12-03T11:49:42.960+0000 7f7ab7d21800 5 AuthRegistry(0x7ffee04d5e70) adding con mode: secure 2023-12-03T11:49:43.036 INFO:tasks.workunit.client.0.smithi003.stderr: -462> 2023-12-03T11:49:42.960+0000 7f7ab7d21800 5 AuthRegistry(0x7ffee04d5e70) adding con mode: crc 2023-12-03T11:49:43.036 INFO:tasks.workunit.client.0.smithi003.stderr: -461> 2023-12-03T11:49:42.960+0000 7f7ab7d21800 5 AuthRegistry(0x7ffee04d5e70) adding con mode: secure 2023-12-03T11:49:43.036 INFO:tasks.workunit.client.0.smithi003.stderr: -460> 2023-12-03T11:49:42.960+0000 7f7ab12b3640 4 mgrc handle_mgr_map Got map version 5 2023-12-03T11:49:43.036 INFO:tasks.workunit.client.0.smithi003.stderr: -459> 2023-12-03T11:49:42.960+0000 7f7ab12b3640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.37:6832/2165065416,v1:172.21.15.37:6833/2165065416] 2023-12-03T11:49:43.036 INFO:tasks.workunit.client.0.smithi003.stderr: -458> 2023-12-03T11:49:42.960+0000 7f7ab12b3640 4 mgrc reconnect Starting new session with [v2:172.21.15.37:6832/2165065416,v1:172.21.15.37:6833/2165065416] 2023-12-03T11:49:43.036 INFO:tasks.workunit.client.0.smithi003.stderr: -457> 2023-12-03T11:49:42.960+0000 7f7ab7d21800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:49:43.036 INFO:tasks.workunit.client.0.smithi003.stderr: -456> 2023-12-03T11:49:42.961+0000 7f7ab32b7640 10 monclient: get_auth_request con 0x7f7aa0069820 auth_method 0 2023-12-03T11:49:43.036 INFO:tasks.workunit.client.0.smithi003.stderr: -455> 2023-12-03T11:49:42.961+0000 7f7ab7d21800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:49:43.036 INFO:tasks.workunit.client.0.smithi003.stderr: -454> 2023-12-03T11:49:42.961+0000 7f7ab7d21800 5 asok(0x55afbf585a10) register_command rotate-key cmddesc rotate-key hook 0x7ffee04d5fb8 EEXIST 2023-12-03T11:49:43.036 INFO:tasks.workunit.client.0.smithi003.stderr: -453> 2023-12-03T11:49:42.961+0000 7f7ab7d21800 10 monclient: _reopen_session rank -1 2023-12-03T11:49:43.036 INFO:tasks.workunit.client.0.smithi003.stderr: -452> 2023-12-03T11:49:42.961+0000 7f7ab7d21800 10 monclient: _add_conns ranks=[0,2,1] 2023-12-03T11:49:43.036 INFO:tasks.workunit.client.0.smithi003.stderr: -451> 2023-12-03T11:49:42.961+0000 7f7ab7d21800 10 monclient(hunting): picked mon.noname-a con 0x55afbf7bf200 addr [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] 2023-12-03T11:49:43.036 INFO:tasks.workunit.client.0.smithi003.stderr: -450> 2023-12-03T11:49:42.961+0000 7f7ab7d21800 10 monclient(hunting): picked mon.noname-c con 0x55afbf7bf5e0 addr [v2:172.21.15.3:3301/0,v1:172.21.15.3:6790/0] 2023-12-03T11:49:43.037 INFO:tasks.workunit.client.0.smithi003.stderr: -449> 2023-12-03T11:49:42.961+0000 7f7ab7d21800 10 monclient(hunting): picked mon.noname-b con 0x55afbf7c1f90 addr [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] 2023-12-03T11:49:43.037 INFO:tasks.workunit.client.0.smithi003.stderr: -448> 2023-12-03T11:49:42.961+0000 7f7ab7d21800 10 monclient(hunting): start opening mon connection 2023-12-03T11:49:43.037 INFO:tasks.workunit.client.0.smithi003.stderr: -447> 2023-12-03T11:49:42.961+0000 7f7ab7d21800 10 monclient(hunting): start opening mon connection 2023-12-03T11:49:43.037 INFO:tasks.workunit.client.0.smithi003.stderr: -446> 2023-12-03T11:49:42.961+0000 7f7ab7d21800 10 monclient(hunting): start opening mon connection 2023-12-03T11:49:43.037 INFO:tasks.workunit.client.0.smithi003.stderr: -445> 2023-12-03T11:49:42.961+0000 7f7ab7d21800 10 monclient(hunting): _renew_subs 2023-12-03T11:49:43.037 INFO:tasks.workunit.client.0.smithi003.stderr: -444> 2023-12-03T11:49:42.961+0000 7f7ab7d21800 10 monclient(hunting): authenticate will time out at 1805.199456s 2023-12-03T11:49:43.037 INFO:tasks.workunit.client.0.smithi003.stderr: -443> 2023-12-03T11:49:42.961+0000 7f7ab3ab8640 10 monclient(hunting): get_auth_request con 0x55afbf7bf200 auth_method 0 2023-12-03T11:49:43.037 INFO:tasks.workunit.client.0.smithi003.stderr: -442> 2023-12-03T11:49:42.961+0000 7f7ab3ab8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:49:43.037 INFO:tasks.workunit.client.0.smithi003.stderr: -441> 2023-12-03T11:49:42.961+0000 7f7ab3ab8640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:49:43.037 INFO:tasks.workunit.client.0.smithi003.stderr: -440> 2023-12-03T11:49:42.961+0000 7f7ab3ab8640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:49:43.037 INFO:tasks.workunit.client.0.smithi003.stderr: -439> 2023-12-03T11:49:42.961+0000 7f7ab42b9640 10 monclient(hunting): get_auth_request con 0x55afbf7c1f90 auth_method 0 2023-12-03T11:49:43.037 INFO:tasks.workunit.client.0.smithi003.stderr: -438> 2023-12-03T11:49:42.961+0000 7f7ab42b9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:49:43.037 INFO:tasks.workunit.client.0.smithi003.stderr: -437> 2023-12-03T11:49:42.961+0000 7f7ab42b9640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:49:43.037 INFO:tasks.workunit.client.0.smithi003.stderr: -436> 2023-12-03T11:49:42.961+0000 7f7ab42b9640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:49:43.037 INFO:tasks.workunit.client.0.smithi003.stderr: -435> 2023-12-03T11:49:42.961+0000 7f7ab3ab8640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:49:43.037 INFO:tasks.workunit.client.0.smithi003.stderr: -434> 2023-12-03T11:49:42.961+0000 7f7ab3ab8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:49:43.038 INFO:tasks.workunit.client.0.smithi003.stderr: -433> 2023-12-03T11:49:42.961+0000 7f7ab3ab8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:49:43.038 INFO:tasks.workunit.client.0.smithi003.stderr: -432> 2023-12-03T11:49:42.961+0000 7f7ab32b7640 10 monclient(hunting): get_auth_request con 0x55afbf7bf5e0 auth_method 0 2023-12-03T11:49:43.038 INFO:tasks.workunit.client.0.smithi003.stderr: -431> 2023-12-03T11:49:42.961+0000 7f7ab32b7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:49:43.038 INFO:tasks.workunit.client.0.smithi003.stderr: -430> 2023-12-03T11:49:42.961+0000 7f7ab32b7640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:49:43.038 INFO:tasks.workunit.client.0.smithi003.stderr: -429> 2023-12-03T11:49:42.961+0000 7f7ab32b7640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:49:43.038 INFO:tasks.workunit.client.0.smithi003.stderr: -428> 2023-12-03T11:49:42.961+0000 7f7ab42b9640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:49:43.038 INFO:tasks.workunit.client.0.smithi003.stderr: -427> 2023-12-03T11:49:42.961+0000 7f7ab42b9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:49:43.038 INFO:tasks.workunit.client.0.smithi003.stderr: -426> 2023-12-03T11:49:42.961+0000 7f7ab42b9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:49:43.038 INFO:tasks.workunit.client.0.smithi003.stderr: -425> 2023-12-03T11:49:42.961+0000 7f7ab32b7640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:49:43.038 INFO:tasks.workunit.client.0.smithi003.stderr: -424> 2023-12-03T11:49:42.961+0000 7f7ab32b7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:49:43.038 INFO:tasks.workunit.client.0.smithi003.stderr: -423> 2023-12-03T11:49:42.961+0000 7f7ab32b7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:49:43.038 INFO:tasks.workunit.client.0.smithi003.stderr: -422> 2023-12-03T11:49:42.961+0000 7f7ab3ab8640 10 monclient(hunting): handle_auth_done global_id 7287 payload 274 2023-12-03T11:49:43.038 INFO:tasks.workunit.client.0.smithi003.stderr: -421> 2023-12-03T11:49:42.961+0000 7f7ab3ab8640 10 monclient: _finish_hunting 0 2023-12-03T11:49:43.038 INFO:tasks.workunit.client.0.smithi003.stderr: -420> 2023-12-03T11:49:42.961+0000 7f7ab3ab8640 1 monclient: found mon.noname-a 2023-12-03T11:49:43.038 INFO:tasks.workunit.client.0.smithi003.stderr: -419> 2023-12-03T11:49:42.961+0000 7f7ab3ab8640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.3:3300/0 2023-12-03T11:49:43.039 INFO:tasks.workunit.client.0.smithi003.stderr: -418> 2023-12-03T11:49:42.961+0000 7f7a9a7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:49:43.039 INFO:tasks.workunit.client.0.smithi003.stderr: -417> 2023-12-03T11:49:42.961+0000 7f7a9a7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-12-03T11:49:43.039 INFO:tasks.workunit.client.0.smithi003.stderr: -416> 2023-12-03T11:49:42.961+0000 7f7a9a7fc640 10 monclient: dump: 2023-12-03T11:49:43.039 INFO:tasks.workunit.client.0.smithi003.stderr:epoch 1 2023-12-03T11:49:43.039 INFO:tasks.workunit.client.0.smithi003.stderr:fsid 296556de-a4fc-4095-9b6d-0fe813c2865c 2023-12-03T11:49:43.039 INFO:tasks.workunit.client.0.smithi003.stderr:last_changed 2023-12-03T11:33:18.862564+0000 2023-12-03T11:49:43.039 INFO:tasks.workunit.client.0.smithi003.stderr:created 2023-12-03T11:33:18.862564+0000 2023-12-03T11:49:43.039 INFO:tasks.workunit.client.0.smithi003.stderr:min_mon_release 18 (reef) 2023-12-03T11:49:43.039 INFO:tasks.workunit.client.0.smithi003.stderr:election_strategy: 1 2023-12-03T11:49:43.039 INFO:tasks.workunit.client.0.smithi003.stderr:0: [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] mon.a 2023-12-03T11:49:43.039 INFO:tasks.workunit.client.0.smithi003.stderr:1: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.b 2023-12-03T11:49:43.039 INFO:tasks.workunit.client.0.smithi003.stderr:2: [v2:172.21.15.3:3301/0,v1:172.21.15.3:6790/0] mon.c 2023-12-03T11:49:43.039 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:49:43.039 INFO:tasks.workunit.client.0.smithi003.stderr: -415> 2023-12-03T11:49:42.961+0000 7f7a9a7fc640 10 monclient: _finish_auth 0 2023-12-03T11:49:43.039 INFO:tasks.workunit.client.0.smithi003.stderr: -414> 2023-12-03T11:49:42.961+0000 7f7a9a7fc640 10 monclient: _check_auth_tickets 2023-12-03T11:49:43.040 INFO:tasks.workunit.client.0.smithi003.stderr: -413> 2023-12-03T11:49:42.961+0000 7f7a9a7fc640 10 monclient: handle_config config(0 keys) v1 2023-12-03T11:49:43.040 INFO:tasks.workunit.client.0.smithi003.stderr: -412> 2023-12-03T11:49:42.961+0000 7f7ab7d21800 5 monclient: authenticate success, global_id 7287 2023-12-03T11:49:43.040 INFO:tasks.workunit.client.0.smithi003.stderr: -411> 2023-12-03T11:49:42.961+0000 7f7ab7d21800 10 monclient: get_monmap_and_config success 2023-12-03T11:49:43.040 INFO:tasks.workunit.client.0.smithi003.stderr: -410> 2023-12-03T11:49:42.961+0000 7f7ab7d21800 4 set_mon_vals no callback set 2023-12-03T11:49:43.040 INFO:tasks.workunit.client.0.smithi003.stderr: -409> 2023-12-03T11:49:42.961+0000 7f7a9a7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:49:43.040 INFO:tasks.workunit.client.0.smithi003.stderr: -408> 2023-12-03T11:49:42.961+0000 7f7a9a7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-12-03T11:49:43.040 INFO:tasks.workunit.client.0.smithi003.stderr: -407> 2023-12-03T11:49:42.961+0000 7f7a9a7fc640 10 monclient: dump: 2023-12-03T11:49:43.040 INFO:tasks.workunit.client.0.smithi003.stderr:epoch 1 2023-12-03T11:49:43.040 INFO:tasks.workunit.client.0.smithi003.stderr:fsid 296556de-a4fc-4095-9b6d-0fe813c2865c 2023-12-03T11:49:43.040 INFO:tasks.workunit.client.0.smithi003.stderr:last_changed 2023-12-03T11:33:18.862564+0000 2023-12-03T11:49:43.040 INFO:tasks.workunit.client.0.smithi003.stderr:created 2023-12-03T11:33:18.862564+0000 2023-12-03T11:49:43.040 INFO:tasks.workunit.client.0.smithi003.stderr:min_mon_release 18 (reef) 2023-12-03T11:49:43.040 INFO:tasks.workunit.client.0.smithi003.stderr:election_strategy: 1 2023-12-03T11:49:43.040 INFO:tasks.workunit.client.0.smithi003.stderr:0: [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] mon.a 2023-12-03T11:49:43.041 INFO:tasks.workunit.client.0.smithi003.stderr:1: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.b 2023-12-03T11:49:43.041 INFO:tasks.workunit.client.0.smithi003.stderr:2: [v2:172.21.15.3:3301/0,v1:172.21.15.3:6790/0] mon.c 2023-12-03T11:49:43.041 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:49:43.041 INFO:tasks.workunit.client.0.smithi003.stderr: -406> 2023-12-03T11:49:42.962+0000 7f7ab7d21800 10 monclient: shutdown 2023-12-03T11:49:43.041 INFO:tasks.workunit.client.0.smithi003.stderr: -405> 2023-12-03T11:49:42.962+0000 7f7ab7d21800 10 monclient: build_initial_monmap 2023-12-03T11:49:43.041 INFO:tasks.workunit.client.0.smithi003.stderr: -404> 2023-12-03T11:49:42.962+0000 7f7ab7d21800 1 build_initial for_mkfs: 0 2023-12-03T11:49:43.041 INFO:tasks.workunit.client.0.smithi003.stderr: -403> 2023-12-03T11:49:42.962+0000 7f7ab7d21800 10 monclient: monmap: 2023-12-03T11:49:43.041 INFO:tasks.workunit.client.0.smithi003.stderr:epoch 0 2023-12-03T11:49:43.041 INFO:tasks.workunit.client.0.smithi003.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-12-03T11:49:43.041 INFO:tasks.workunit.client.0.smithi003.stderr:last_changed 0.000000 2023-12-03T11:49:43.041 INFO:tasks.workunit.client.0.smithi003.stderr:created 0.000000 2023-12-03T11:49:43.041 INFO:tasks.workunit.client.0.smithi003.stderr:min_mon_release 0 (unknown) 2023-12-03T11:49:43.041 INFO:tasks.workunit.client.0.smithi003.stderr:election_strategy: 1 2023-12-03T11:49:43.041 INFO:tasks.workunit.client.0.smithi003.stderr:0: [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] mon.noname-a 2023-12-03T11:49:43.041 INFO:tasks.workunit.client.0.smithi003.stderr:1: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.noname-b 2023-12-03T11:49:43.042 INFO:tasks.workunit.client.0.smithi003.stderr:2: [v2:172.21.15.3:3301/0,v1:172.21.15.3:6790/0] mon.noname-c 2023-12-03T11:49:43.042 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:49:43.042 INFO:tasks.workunit.client.0.smithi003.stderr: -402> 2023-12-03T11:49:42.962+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf790480) adding auth protocol: cephx 2023-12-03T11:49:43.042 INFO:tasks.workunit.client.0.smithi003.stderr: -401> 2023-12-03T11:49:42.962+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf790480) adding auth protocol: cephx 2023-12-03T11:49:43.042 INFO:tasks.workunit.client.0.smithi003.stderr: -400> 2023-12-03T11:49:42.962+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf790480) adding auth protocol: cephx 2023-12-03T11:49:43.042 INFO:tasks.workunit.client.0.smithi003.stderr: -399> 2023-12-03T11:49:42.962+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf790480) adding con mode: secure 2023-12-03T11:49:43.042 INFO:tasks.workunit.client.0.smithi003.stderr: -398> 2023-12-03T11:49:42.962+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf790480) adding con mode: crc 2023-12-03T11:49:43.042 INFO:tasks.workunit.client.0.smithi003.stderr: -397> 2023-12-03T11:49:42.962+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf790480) adding con mode: secure 2023-12-03T11:49:43.042 INFO:tasks.workunit.client.0.smithi003.stderr: -396> 2023-12-03T11:49:42.962+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf790480) adding con mode: crc 2023-12-03T11:49:43.042 INFO:tasks.workunit.client.0.smithi003.stderr: -395> 2023-12-03T11:49:42.962+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf790480) adding con mode: secure 2023-12-03T11:49:43.042 INFO:tasks.workunit.client.0.smithi003.stderr: -394> 2023-12-03T11:49:42.962+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf790480) adding con mode: crc 2023-12-03T11:49:43.042 INFO:tasks.workunit.client.0.smithi003.stderr: -393> 2023-12-03T11:49:42.962+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf790480) adding con mode: crc 2023-12-03T11:49:43.042 INFO:tasks.workunit.client.0.smithi003.stderr: -392> 2023-12-03T11:49:42.962+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf790480) adding con mode: secure 2023-12-03T11:49:43.042 INFO:tasks.workunit.client.0.smithi003.stderr: -391> 2023-12-03T11:49:42.962+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf790480) adding con mode: crc 2023-12-03T11:49:43.042 INFO:tasks.workunit.client.0.smithi003.stderr: -390> 2023-12-03T11:49:42.962+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf790480) adding con mode: secure 2023-12-03T11:49:43.043 INFO:tasks.workunit.client.0.smithi003.stderr: -389> 2023-12-03T11:49:42.962+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf790480) adding con mode: crc 2023-12-03T11:49:43.043 INFO:tasks.workunit.client.0.smithi003.stderr: -388> 2023-12-03T11:49:42.962+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf790480) adding con mode: secure 2023-12-03T11:49:43.043 INFO:tasks.workunit.client.0.smithi003.stderr: -387> 2023-12-03T11:49:42.962+0000 7f7ab7d21800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:49:43.043 INFO:tasks.workunit.client.0.smithi003.stderr: -386> 2023-12-03T11:49:42.962+0000 7f7ab7d21800 1 librados: starting msgr at 2023-12-03T11:49:43.043 INFO:tasks.workunit.client.0.smithi003.stderr: -385> 2023-12-03T11:49:42.962+0000 7f7ab7d21800 1 librados: starting objecter 2023-12-03T11:49:43.043 INFO:tasks.workunit.client.0.smithi003.stderr: -384> 2023-12-03T11:49:42.962+0000 7f7ab7d21800 5 asok(0x55afbf585a10) register_command objecter_requests cmddesc objecter_requests hook 0x55afbf7c2370 EEXIST 2023-12-03T11:49:43.043 INFO:tasks.workunit.client.0.smithi003.stderr: -383> 2023-12-03T11:49:42.962+0000 7f7ab7d21800 1 librados: setting wanted keys 2023-12-03T11:49:43.043 INFO:tasks.workunit.client.0.smithi003.stderr: -382> 2023-12-03T11:49:42.962+0000 7f7ab7d21800 1 librados: calling monclient init 2023-12-03T11:49:43.043 INFO:tasks.workunit.client.0.smithi003.stderr: -381> 2023-12-03T11:49:42.962+0000 7f7ab7d21800 10 monclient: init 2023-12-03T11:49:43.043 INFO:tasks.workunit.client.0.smithi003.stderr: -380> 2023-12-03T11:49:42.962+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf78e9b8) adding auth protocol: cephx 2023-12-03T11:49:43.043 INFO:tasks.workunit.client.0.smithi003.stderr: -379> 2023-12-03T11:49:42.962+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf78e9b8) adding auth protocol: cephx 2023-12-03T11:49:43.043 INFO:tasks.workunit.client.0.smithi003.stderr: -378> 2023-12-03T11:49:42.962+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf78e9b8) adding auth protocol: cephx 2023-12-03T11:49:43.043 INFO:tasks.workunit.client.0.smithi003.stderr: -377> 2023-12-03T11:49:42.962+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf78e9b8) adding con mode: secure 2023-12-03T11:49:43.043 INFO:tasks.workunit.client.0.smithi003.stderr: -376> 2023-12-03T11:49:42.962+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf78e9b8) adding con mode: crc 2023-12-03T11:49:43.043 INFO:tasks.workunit.client.0.smithi003.stderr: -375> 2023-12-03T11:49:42.962+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf78e9b8) adding con mode: secure 2023-12-03T11:49:43.044 INFO:tasks.workunit.client.0.smithi003.stderr: -374> 2023-12-03T11:49:42.962+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf78e9b8) adding con mode: crc 2023-12-03T11:49:43.044 INFO:tasks.workunit.client.0.smithi003.stderr: -373> 2023-12-03T11:49:42.962+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf78e9b8) adding con mode: secure 2023-12-03T11:49:43.044 INFO:tasks.workunit.client.0.smithi003.stderr: -372> 2023-12-03T11:49:42.962+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf78e9b8) adding con mode: crc 2023-12-03T11:49:43.044 INFO:tasks.workunit.client.0.smithi003.stderr: -371> 2023-12-03T11:49:42.962+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf78e9b8) adding con mode: crc 2023-12-03T11:49:43.044 INFO:tasks.workunit.client.0.smithi003.stderr: -370> 2023-12-03T11:49:42.962+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf78e9b8) adding con mode: secure 2023-12-03T11:49:43.044 INFO:tasks.workunit.client.0.smithi003.stderr: -369> 2023-12-03T11:49:42.962+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf78e9b8) adding con mode: crc 2023-12-03T11:49:43.044 INFO:tasks.workunit.client.0.smithi003.stderr: -368> 2023-12-03T11:49:42.962+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf78e9b8) adding con mode: secure 2023-12-03T11:49:43.044 INFO:tasks.workunit.client.0.smithi003.stderr: -367> 2023-12-03T11:49:42.962+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf78e9b8) adding con mode: crc 2023-12-03T11:49:43.044 INFO:tasks.workunit.client.0.smithi003.stderr: -366> 2023-12-03T11:49:42.962+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf78e9b8) adding con mode: secure 2023-12-03T11:49:43.044 INFO:tasks.workunit.client.0.smithi003.stderr: -365> 2023-12-03T11:49:42.963+0000 7f7ab7d21800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:49:43.044 INFO:tasks.workunit.client.0.smithi003.stderr: -364> 2023-12-03T11:49:42.963+0000 7f7ab7d21800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:49:43.044 INFO:tasks.workunit.client.0.smithi003.stderr: -363> 2023-12-03T11:49:42.963+0000 7f7ab7d21800 5 asok(0x55afbf585a10) register_command rotate-key cmddesc rotate-key hook 0x55afbf78eb00 EEXIST 2023-12-03T11:49:43.044 INFO:tasks.workunit.client.0.smithi003.stderr: -362> 2023-12-03T11:49:42.963+0000 7f7ab7d21800 10 monclient: _reopen_session rank -1 2023-12-03T11:49:43.044 INFO:tasks.workunit.client.0.smithi003.stderr: -361> 2023-12-03T11:49:42.963+0000 7f7ab7d21800 10 monclient: _add_conns ranks=[2,0,1] 2023-12-03T11:49:43.044 INFO:tasks.workunit.client.0.smithi003.stderr: -360> 2023-12-03T11:49:42.963+0000 7f7ab7d21800 10 monclient(hunting): picked mon.noname-c con 0x55afbf7bf200 addr [v2:172.21.15.3:3301/0,v1:172.21.15.3:6790/0] 2023-12-03T11:49:43.045 INFO:tasks.workunit.client.0.smithi003.stderr: -359> 2023-12-03T11:49:42.963+0000 7f7ab7d21800 10 monclient(hunting): picked mon.noname-a con 0x55afbf7c1f90 addr [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] 2023-12-03T11:49:43.045 INFO:tasks.workunit.client.0.smithi003.stderr: -358> 2023-12-03T11:49:42.963+0000 7f7ab7d21800 10 monclient(hunting): picked mon.noname-b con 0x55afbf7b4b20 addr [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] 2023-12-03T11:49:43.045 INFO:tasks.workunit.client.0.smithi003.stderr: -357> 2023-12-03T11:49:42.963+0000 7f7ab7d21800 10 monclient(hunting): start opening mon connection 2023-12-03T11:49:43.045 INFO:tasks.workunit.client.0.smithi003.stderr: -356> 2023-12-03T11:49:42.963+0000 7f7ab7d21800 10 monclient(hunting): start opening mon connection 2023-12-03T11:49:43.045 INFO:tasks.workunit.client.0.smithi003.stderr: -355> 2023-12-03T11:49:42.963+0000 7f7ab7d21800 10 monclient(hunting): start opening mon connection 2023-12-03T11:49:43.045 INFO:tasks.workunit.client.0.smithi003.stderr: -354> 2023-12-03T11:49:42.963+0000 7f7ab7d21800 10 monclient(hunting): _renew_subs 2023-12-03T11:49:43.045 INFO:tasks.workunit.client.0.smithi003.stderr: -353> 2023-12-03T11:49:42.963+0000 7f7ab7d21800 10 monclient(hunting): authenticate will time out at 1805.201628s 2023-12-03T11:49:43.045 INFO:tasks.workunit.client.0.smithi003.stderr: -352> 2023-12-03T11:49:42.963+0000 7f7ab32b7640 10 monclient(hunting): get_auth_request con 0x55afbf7c1f90 auth_method 0 2023-12-03T11:49:43.045 INFO:tasks.workunit.client.0.smithi003.stderr: -351> 2023-12-03T11:49:42.963+0000 7f7ab32b7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:49:43.045 INFO:tasks.workunit.client.0.smithi003.stderr: -350> 2023-12-03T11:49:42.963+0000 7f7ab32b7640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:49:43.045 INFO:tasks.workunit.client.0.smithi003.stderr: -349> 2023-12-03T11:49:42.963+0000 7f7ab32b7640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:49:43.045 INFO:tasks.workunit.client.0.smithi003.stderr: -348> 2023-12-03T11:49:42.963+0000 7f7ab3ab8640 10 monclient(hunting): get_auth_request con 0x55afbf7bf200 auth_method 0 2023-12-03T11:49:43.045 INFO:tasks.workunit.client.0.smithi003.stderr: -347> 2023-12-03T11:49:42.963+0000 7f7ab3ab8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:49:43.045 INFO:tasks.workunit.client.0.smithi003.stderr: -346> 2023-12-03T11:49:42.963+0000 7f7ab3ab8640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:49:43.045 INFO:tasks.workunit.client.0.smithi003.stderr: -345> 2023-12-03T11:49:42.963+0000 7f7ab3ab8640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:49:43.046 INFO:tasks.workunit.client.0.smithi003.stderr: -344> 2023-12-03T11:49:42.963+0000 7f7ab32b7640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:49:43.046 INFO:tasks.workunit.client.0.smithi003.stderr: -343> 2023-12-03T11:49:42.963+0000 7f7ab32b7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:49:43.046 INFO:tasks.workunit.client.0.smithi003.stderr: -342> 2023-12-03T11:49:42.963+0000 7f7ab32b7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:49:43.046 INFO:tasks.workunit.client.0.smithi003.stderr: -341> 2023-12-03T11:49:42.963+0000 7f7ab3ab8640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:49:43.046 INFO:tasks.workunit.client.0.smithi003.stderr: -340> 2023-12-03T11:49:42.963+0000 7f7ab3ab8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:49:43.046 INFO:tasks.workunit.client.0.smithi003.stderr: -339> 2023-12-03T11:49:42.963+0000 7f7ab3ab8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:49:43.046 INFO:tasks.workunit.client.0.smithi003.stderr: -338> 2023-12-03T11:49:42.963+0000 7f7ab42b9640 10 monclient(hunting): get_auth_request con 0x55afbf7b4b20 auth_method 0 2023-12-03T11:49:43.046 INFO:tasks.workunit.client.0.smithi003.stderr: -337> 2023-12-03T11:49:42.963+0000 7f7ab42b9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:49:43.046 INFO:tasks.workunit.client.0.smithi003.stderr: -336> 2023-12-03T11:49:42.963+0000 7f7ab42b9640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:49:43.046 INFO:tasks.workunit.client.0.smithi003.stderr: -335> 2023-12-03T11:49:42.963+0000 7f7ab42b9640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:49:43.046 INFO:tasks.workunit.client.0.smithi003.stderr: -334> 2023-12-03T11:49:42.963+0000 7f7ab42b9640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:49:43.046 INFO:tasks.workunit.client.0.smithi003.stderr: -333> 2023-12-03T11:49:42.963+0000 7f7ab42b9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:49:43.046 INFO:tasks.workunit.client.0.smithi003.stderr: -332> 2023-12-03T11:49:42.963+0000 7f7ab42b9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:49:43.046 INFO:tasks.workunit.client.0.smithi003.stderr: -331> 2023-12-03T11:49:42.963+0000 7f7ab32b7640 10 monclient(hunting): handle_auth_done global_id 7290 payload 824 2023-12-03T11:49:43.047 INFO:tasks.workunit.client.0.smithi003.stderr: -330> 2023-12-03T11:49:42.963+0000 7f7ab32b7640 10 monclient: _finish_hunting 0 2023-12-03T11:49:43.047 INFO:tasks.workunit.client.0.smithi003.stderr: -329> 2023-12-03T11:49:42.963+0000 7f7ab32b7640 1 monclient: found mon.noname-a 2023-12-03T11:49:43.047 INFO:tasks.workunit.client.0.smithi003.stderr: -328> 2023-12-03T11:49:42.963+0000 7f7ab32b7640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.3:3300/0 2023-12-03T11:49:43.047 INFO:tasks.workunit.client.0.smithi003.stderr: -327> 2023-12-03T11:49:42.963+0000 7f7a98ff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:49:43.047 INFO:tasks.workunit.client.0.smithi003.stderr: -326> 2023-12-03T11:49:42.963+0000 7f7a98ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-12-03T11:49:43.047 INFO:tasks.workunit.client.0.smithi003.stderr: -325> 2023-12-03T11:49:42.963+0000 7f7a98ff9640 10 monclient: dump: 2023-12-03T11:49:43.047 INFO:tasks.workunit.client.0.smithi003.stderr:epoch 1 2023-12-03T11:49:43.047 INFO:tasks.workunit.client.0.smithi003.stderr:fsid 296556de-a4fc-4095-9b6d-0fe813c2865c 2023-12-03T11:49:43.047 INFO:tasks.workunit.client.0.smithi003.stderr:last_changed 2023-12-03T11:33:18.862564+0000 2023-12-03T11:49:43.047 INFO:tasks.workunit.client.0.smithi003.stderr:created 2023-12-03T11:33:18.862564+0000 2023-12-03T11:49:43.047 INFO:tasks.workunit.client.0.smithi003.stderr:min_mon_release 18 (reef) 2023-12-03T11:49:43.047 INFO:tasks.workunit.client.0.smithi003.stderr:election_strategy: 1 2023-12-03T11:49:43.047 INFO:tasks.workunit.client.0.smithi003.stderr:0: [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] mon.a 2023-12-03T11:49:43.047 INFO:tasks.workunit.client.0.smithi003.stderr:1: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.b 2023-12-03T11:49:43.047 INFO:tasks.workunit.client.0.smithi003.stderr:2: [v2:172.21.15.3:3301/0,v1:172.21.15.3:6790/0] mon.c 2023-12-03T11:49:43.048 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:49:43.048 INFO:tasks.workunit.client.0.smithi003.stderr: -324> 2023-12-03T11:49:42.963+0000 7f7a98ff9640 10 monclient: _finish_auth 0 2023-12-03T11:49:43.048 INFO:tasks.workunit.client.0.smithi003.stderr: -323> 2023-12-03T11:49:42.963+0000 7f7a98ff9640 10 monclient: _check_auth_tickets 2023-12-03T11:49:43.048 INFO:tasks.workunit.client.0.smithi003.stderr: -322> 2023-12-03T11:49:42.963+0000 7f7a98ff9640 10 monclient: handle_config config(0 keys) v1 2023-12-03T11:49:43.048 INFO:tasks.workunit.client.0.smithi003.stderr: -321> 2023-12-03T11:49:42.963+0000 7f7a98ff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:49:43.048 INFO:tasks.workunit.client.0.smithi003.stderr: -320> 2023-12-03T11:49:42.963+0000 7f7a98ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-12-03T11:49:43.048 INFO:tasks.workunit.client.0.smithi003.stderr: -319> 2023-12-03T11:49:42.963+0000 7f7a98ff9640 10 monclient: dump: 2023-12-03T11:49:43.048 INFO:tasks.workunit.client.0.smithi003.stderr:epoch 1 2023-12-03T11:49:43.048 INFO:tasks.workunit.client.0.smithi003.stderr:fsid 296556de-a4fc-4095-9b6d-0fe813c2865c 2023-12-03T11:49:43.048 INFO:tasks.workunit.client.0.smithi003.stderr:last_changed 2023-12-03T11:33:18.862564+0000 2023-12-03T11:49:43.048 INFO:tasks.workunit.client.0.smithi003.stderr:created 2023-12-03T11:33:18.862564+0000 2023-12-03T11:49:43.048 INFO:tasks.workunit.client.0.smithi003.stderr:min_mon_release 18 (reef) 2023-12-03T11:49:43.048 INFO:tasks.workunit.client.0.smithi003.stderr:election_strategy: 1 2023-12-03T11:49:43.048 INFO:tasks.workunit.client.0.smithi003.stderr:0: [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] mon.a 2023-12-03T11:49:43.048 INFO:tasks.workunit.client.0.smithi003.stderr:1: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.b 2023-12-03T11:49:43.048 INFO:tasks.workunit.client.0.smithi003.stderr:2: [v2:172.21.15.3:3301/0,v1:172.21.15.3:6790/0] mon.c 2023-12-03T11:49:43.049 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:49:43.049 INFO:tasks.workunit.client.0.smithi003.stderr: -318> 2023-12-03T11:49:42.963+0000 7f7ab7d21800 5 monclient: authenticate success, global_id 7290 2023-12-03T11:49:43.049 INFO:tasks.workunit.client.0.smithi003.stderr: -317> 2023-12-03T11:49:42.963+0000 7f7a9a7fc640 4 set_mon_vals no callback set 2023-12-03T11:49:43.049 INFO:tasks.workunit.client.0.smithi003.stderr: -316> 2023-12-03T11:49:42.963+0000 7f7ab7d21800 10 monclient: _renew_subs 2023-12-03T11:49:43.049 INFO:tasks.workunit.client.0.smithi003.stderr: -315> 2023-12-03T11:49:42.964+0000 7f7ab7d21800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.3:3300/0 2023-12-03T11:49:43.049 INFO:tasks.workunit.client.0.smithi003.stderr: -314> 2023-12-03T11:49:42.964+0000 7f7ab7d21800 10 monclient: _renew_subs 2023-12-03T11:49:43.049 INFO:tasks.workunit.client.0.smithi003.stderr: -313> 2023-12-03T11:49:42.964+0000 7f7ab7d21800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.3:3300/0 2023-12-03T11:49:43.049 INFO:tasks.workunit.client.0.smithi003.stderr: -312> 2023-12-03T11:49:42.964+0000 7f7ab7d21800 1 librados: init done 2023-12-03T11:49:43.049 INFO:tasks.workunit.client.0.smithi003.stderr: -311> 2023-12-03T11:49:42.965+0000 7f7ab7d21800 20 rados->read ofs=0 len=0 2023-12-03T11:49:43.049 INFO:tasks.workunit.client.0.smithi003.stderr: -310> 2023-12-03T11:49:42.966+0000 7f7a98ff9640 4 mgrc handle_mgr_map Got map version 5 2023-12-03T11:49:43.049 INFO:tasks.workunit.client.0.smithi003.stderr: -309> 2023-12-03T11:49:42.966+0000 7f7a98ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.37:6832/2165065416,v1:172.21.15.37:6833/2165065416] 2023-12-03T11:49:43.049 INFO:tasks.workunit.client.0.smithi003.stderr: -308> 2023-12-03T11:49:42.966+0000 7f7a98ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.37:6832/2165065416,v1:172.21.15.37:6833/2165065416] 2023-12-03T11:49:43.049 INFO:tasks.workunit.client.0.smithi003.stderr: -307> 2023-12-03T11:49:42.966+0000 7f7ab3ab8640 10 monclient: get_auth_request con 0x7f7a8c069820 auth_method 0 2023-12-03T11:49:43.049 INFO:tasks.workunit.client.0.smithi003.stderr: -306> 2023-12-03T11:49:42.966+0000 7f7ab42b9640 10 monclient: get_auth_request con 0x55afbf7dd540 auth_method 0 2023-12-03T11:49:43.049 INFO:tasks.workunit.client.0.smithi003.stderr: -305> 2023-12-03T11:49:42.966+0000 7f7ab7d21800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:43.049 INFO:tasks.workunit.client.0.smithi003.stderr: -304> 2023-12-03T11:49:42.966+0000 7f7ab7d21800 20 realm 2023-12-03T11:49:43.050 INFO:tasks.workunit.client.0.smithi003.stderr: -303> 2023-12-03T11:49:42.966+0000 7f7ab7d21800 20 rados->read ofs=0 len=0 2023-12-03T11:49:43.050 INFO:tasks.workunit.client.0.smithi003.stderr: -302> 2023-12-03T11:49:42.967+0000 7f7ab7d21800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:43.050 INFO:tasks.workunit.client.0.smithi003.stderr: -301> 2023-12-03T11:49:42.967+0000 7f7ab7d21800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:49:43.050 INFO:tasks.workunit.client.0.smithi003.stderr: -300> 2023-12-03T11:49:42.967+0000 7f7ab7d21800 20 rados->read ofs=0 len=0 2023-12-03T11:49:43.050 INFO:tasks.workunit.client.0.smithi003.stderr: -299> 2023-12-03T11:49:42.967+0000 7f7ab7d21800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:43.050 INFO:tasks.workunit.client.0.smithi003.stderr: -298> 2023-12-03T11:49:42.967+0000 7f7ab7d21800 20 rados->read ofs=0 len=0 2023-12-03T11:49:43.050 INFO:tasks.workunit.client.0.smithi003.stderr: -297> 2023-12-03T11:49:42.967+0000 7f7ab3ab8640 10 monclient: get_auth_request con 0x55afbf7e13b0 auth_method 0 2023-12-03T11:49:43.050 INFO:tasks.workunit.client.0.smithi003.stderr: -296> 2023-12-03T11:49:42.968+0000 7f7ab7d21800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:49:43.050 INFO:tasks.workunit.client.0.smithi003.stderr: -295> 2023-12-03T11:49:42.968+0000 7f7ab7d21800 20 rados->read ofs=0 len=0 2023-12-03T11:49:43.050 INFO:tasks.workunit.client.0.smithi003.stderr: -294> 2023-12-03T11:49:42.968+0000 7f7ab7d21800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:49:43.050 INFO:tasks.workunit.client.0.smithi003.stderr: -293> 2023-12-03T11:49:42.968+0000 7f7ab7d21800 20 searching for the correct realm 2023-12-03T11:49:43.051 INFO:tasks.workunit.client.0.smithi003.stderr: -292> 2023-12-03T11:49:42.968+0000 7f7ab32b7640 10 monclient: get_auth_request con 0x55afbf7e63b0 auth_method 0 2023-12-03T11:49:43.051 INFO:tasks.workunit.client.0.smithi003.stderr: -291> 2023-12-03T11:49:42.969+0000 7f7ab42b9640 10 monclient: get_auth_request con 0x7f7aa802c020 auth_method 0 2023-12-03T11:49:43.051 INFO:tasks.workunit.client.0.smithi003.stderr: -290> 2023-12-03T11:49:42.970+0000 7f7ab3ab8640 10 monclient: get_auth_request con 0x7f7aac067070 auth_method 0 2023-12-03T11:49:43.051 INFO:tasks.workunit.client.0.smithi003.stderr: -289> 2023-12-03T11:49:42.970+0000 7f7ab32b7640 10 monclient: get_auth_request con 0x7f7aa4022070 auth_method 0 2023-12-03T11:49:43.051 INFO:tasks.workunit.client.0.smithi003.stderr: -288> 2023-12-03T11:49:42.972+0000 7f7ab42b9640 10 monclient: get_auth_request con 0x7f7aa800b040 auth_method 0 2023-12-03T11:49:43.051 INFO:tasks.workunit.client.0.smithi003.stderr: -287> 2023-12-03T11:49:42.974+0000 7f7ab3ab8640 10 monclient: get_auth_request con 0x7f7aa808e3e0 auth_method 0 2023-12-03T11:49:43.051 INFO:tasks.workunit.client.0.smithi003.stderr: -286> 2023-12-03T11:49:42.979+0000 7f7ab32b7640 0 -- 172.21.15.3:0/439359597 >> [v2:172.21.15.3:6817/3356208405,v1:172.21.15.3:6819/3356208405] conn(0x55afbf7e63b0 msgr2=0x55afbf7e87a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:49:43.051 INFO:tasks.workunit.client.0.smithi003.stderr: -285> 2023-12-03T11:49:42.979+0000 7f7a98ff9640 1 client.7290.objecter ms_handle_reset 0x55afbf7e63b0 session 0x55afbf572060 osd.3 2023-12-03T11:49:43.051 INFO:tasks.workunit.client.0.smithi003.stderr: -284> 2023-12-03T11:49:42.979+0000 7f7a98ff9640 10 monclient: _renew_subs 2023-12-03T11:49:43.051 INFO:tasks.workunit.client.0.smithi003.stderr: -283> 2023-12-03T11:49:42.979+0000 7f7a98ff9640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.3:3300/0 2023-12-03T11:49:43.051 INFO:tasks.workunit.client.0.smithi003.stderr: -282> 2023-12-03T11:49:42.979+0000 7f7ab32b7640 10 monclient: get_auth_request con 0x7f7a8c079d90 auth_method 0 2023-12-03T11:49:43.051 INFO:tasks.workunit.client.0.smithi003.stderr: -281> 2023-12-03T11:49:42.979+0000 7f7ab7d21800 20 RGWRados::pool_iterate: got zone_info.83aabb46-04b5-4c96-9933-c6bfb1173a73 2023-12-03T11:49:43.051 INFO:tasks.workunit.client.0.smithi003.stderr: -280> 2023-12-03T11:49:42.979+0000 7f7ab7d21800 20 RGWRados::pool_iterate: got zonegroup_info.6a811aad-435d-4fdd-93c9-b7e0b50de429 2023-12-03T11:49:43.051 INFO:tasks.workunit.client.0.smithi003.stderr: -279> 2023-12-03T11:49:42.979+0000 7f7ab7d21800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:49:43.051 INFO:tasks.workunit.client.0.smithi003.stderr: -278> 2023-12-03T11:49:42.979+0000 7f7ab7d21800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:49:43.052 INFO:tasks.workunit.client.0.smithi003.stderr: -277> 2023-12-03T11:49:42.979+0000 7f7ab7d21800 20 rados->read ofs=0 len=0 2023-12-03T11:49:43.052 INFO:tasks.workunit.client.0.smithi003.stderr: -276> 2023-12-03T11:49:42.980+0000 7f7ab7d21800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:43.052 INFO:tasks.workunit.client.0.smithi003.stderr: -275> 2023-12-03T11:49:42.980+0000 7f7ab7d21800 20 rados->read ofs=0 len=0 2023-12-03T11:49:43.052 INFO:tasks.workunit.client.0.smithi003.stderr: -274> 2023-12-03T11:49:42.980+0000 7f7ab7d21800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:49:43.052 INFO:tasks.workunit.client.0.smithi003.stderr: -273> 2023-12-03T11:49:42.980+0000 7f7ab7d21800 20 rados->read ofs=0 len=0 2023-12-03T11:49:43.052 INFO:tasks.workunit.client.0.smithi003.stderr: -272> 2023-12-03T11:49:42.980+0000 7f7ab7d21800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:49:43.052 INFO:tasks.workunit.client.0.smithi003.stderr: -271> 2023-12-03T11:49:42.980+0000 7f7ab7d21800 20 zone default found 2023-12-03T11:49:43.052 INFO:tasks.workunit.client.0.smithi003.stderr: -270> 2023-12-03T11:49:42.980+0000 7f7ab7d21800 4 Realm: () 2023-12-03T11:49:43.052 INFO:tasks.workunit.client.0.smithi003.stderr: -269> 2023-12-03T11:49:42.980+0000 7f7ab7d21800 4 ZoneGroup: default (6a811aad-435d-4fdd-93c9-b7e0b50de429) 2023-12-03T11:49:43.052 INFO:tasks.workunit.client.0.smithi003.stderr: -268> 2023-12-03T11:49:42.980+0000 7f7ab7d21800 4 Zone: default (83aabb46-04b5-4c96-9933-c6bfb1173a73) 2023-12-03T11:49:43.052 INFO:tasks.workunit.client.0.smithi003.stderr: -267> 2023-12-03T11:49:42.980+0000 7f7ab7d21800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:49:43.052 INFO:tasks.workunit.client.0.smithi003.stderr: -266> 2023-12-03T11:49:42.980+0000 7f7ab7d21800 20 zonegroup default 2023-12-03T11:49:43.052 INFO:tasks.workunit.client.0.smithi003.stderr: -265> 2023-12-03T11:49:42.980+0000 7f7ab7d21800 20 rados->read ofs=0 len=0 2023-12-03T11:49:43.052 INFO:tasks.workunit.client.0.smithi003.stderr: -264> 2023-12-03T11:49:42.980+0000 7f7ab7d21800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:43.053 INFO:tasks.workunit.client.0.smithi003.stderr: -263> 2023-12-03T11:49:42.980+0000 7f7ab7d21800 20 rados->read ofs=0 len=0 2023-12-03T11:49:43.053 INFO:tasks.workunit.client.0.smithi003.stderr: -262> 2023-12-03T11:49:42.981+0000 7f7ab7d21800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:43.053 INFO:tasks.workunit.client.0.smithi003.stderr: -261> 2023-12-03T11:49:42.981+0000 7f7ab7d21800 20 rados->read ofs=0 len=0 2023-12-03T11:49:43.053 INFO:tasks.workunit.client.0.smithi003.stderr: -260> 2023-12-03T11:49:42.981+0000 7f7ab7d21800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:43.053 INFO:tasks.workunit.client.0.smithi003.stderr: -259> 2023-12-03T11:49:42.981+0000 7f7ab7d21800 20 started sync module instance, tier type = 2023-12-03T11:49:43.053 INFO:tasks.workunit.client.0.smithi003.stderr: -258> 2023-12-03T11:49:42.981+0000 7f7ab7d21800 20 started zone id=83aabb46-04b5-4c96-9933-c6bfb1173a73 (name=default) with tier type = 2023-12-03T11:49:43.053 INFO:tasks.workunit.client.0.smithi003.stderr: -257> 2023-12-03T11:49:42.989+0000 7f7ab32b7640 0 -- 172.21.15.3:0/439359597 >> [v2:172.21.15.3:6817/3356208405,v1:172.21.15.3:6819/3356208405] conn(0x7f7a8c079d90 msgr2=0x7f7a8c07c1c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:49:43.053 INFO:tasks.workunit.client.0.smithi003.stderr: -256> 2023-12-03T11:49:42.989+0000 7f7a98ff9640 1 client.7290.objecter ms_handle_reset 0x7f7a8c079d90 session 0x55afbf572060 osd.3 2023-12-03T11:49:43.053 INFO:tasks.workunit.client.0.smithi003.stderr: -255> 2023-12-03T11:49:42.989+0000 7f7ab32b7640 10 monclient: get_auth_request con 0x55afbf7e63b0 auth_method 0 2023-12-03T11:49:43.053 INFO:tasks.workunit.client.0.smithi003.stderr: -254> 2023-12-03T11:49:42.991+0000 7f7ab7d21800 20 add_watcher() i=0 2023-12-03T11:49:43.053 INFO:tasks.workunit.client.0.smithi003.stderr: -253> 2023-12-03T11:49:42.991+0000 7f7ab7d21800 20 add_watcher() i=1 2023-12-03T11:49:43.053 INFO:tasks.workunit.client.0.smithi003.stderr: -252> 2023-12-03T11:49:42.991+0000 7f7ab7d21800 20 add_watcher() i=2 2023-12-03T11:49:43.053 INFO:tasks.workunit.client.0.smithi003.stderr: -251> 2023-12-03T11:49:42.991+0000 7f7ab7d21800 20 add_watcher() i=3 2023-12-03T11:49:43.053 INFO:tasks.workunit.client.0.smithi003.stderr: -250> 2023-12-03T11:49:42.991+0000 7f7ab7d21800 20 add_watcher() i=4 2023-12-03T11:49:43.053 INFO:tasks.workunit.client.0.smithi003.stderr: -249> 2023-12-03T11:49:42.991+0000 7f7ab7d21800 20 add_watcher() i=5 2023-12-03T11:49:43.054 INFO:tasks.workunit.client.0.smithi003.stderr: -248> 2023-12-03T11:49:42.991+0000 7f7ab7d21800 20 add_watcher() i=6 2023-12-03T11:49:43.054 INFO:tasks.workunit.client.0.smithi003.stderr: -247> 2023-12-03T11:49:42.991+0000 7f7ab7d21800 20 add_watcher() i=7 2023-12-03T11:49:43.054 INFO:tasks.workunit.client.0.smithi003.stderr: -246> 2023-12-03T11:49:42.991+0000 7f7ab7d21800 2 all 8 watchers are set, enabling cache 2023-12-03T11:49:43.054 INFO:tasks.workunit.client.0.smithi003.stderr: -245> 2023-12-03T11:49:42.993+0000 7f7ab7d21800 5 AuthRegistry(0x7ffee04d68a0) adding auth protocol: cephx 2023-12-03T11:49:43.054 INFO:tasks.workunit.client.0.smithi003.stderr: -244> 2023-12-03T11:49:42.993+0000 7f7ab7d21800 5 AuthRegistry(0x7ffee04d68a0) adding auth protocol: cephx 2023-12-03T11:49:43.054 INFO:tasks.workunit.client.0.smithi003.stderr: -243> 2023-12-03T11:49:42.993+0000 7f7ab7d21800 5 AuthRegistry(0x7ffee04d68a0) adding auth protocol: cephx 2023-12-03T11:49:43.054 INFO:tasks.workunit.client.0.smithi003.stderr: -242> 2023-12-03T11:49:42.993+0000 7f7ab7d21800 5 AuthRegistry(0x7ffee04d68a0) adding con mode: secure 2023-12-03T11:49:43.054 INFO:tasks.workunit.client.0.smithi003.stderr: -241> 2023-12-03T11:49:42.993+0000 7f7ab7d21800 5 AuthRegistry(0x7ffee04d68a0) adding con mode: crc 2023-12-03T11:49:43.054 INFO:tasks.workunit.client.0.smithi003.stderr: -240> 2023-12-03T11:49:42.993+0000 7f7ab7d21800 5 AuthRegistry(0x7ffee04d68a0) adding con mode: secure 2023-12-03T11:49:43.054 INFO:tasks.workunit.client.0.smithi003.stderr: -239> 2023-12-03T11:49:42.993+0000 7f7ab7d21800 5 AuthRegistry(0x7ffee04d68a0) adding con mode: crc 2023-12-03T11:49:43.054 INFO:tasks.workunit.client.0.smithi003.stderr: -238> 2023-12-03T11:49:42.993+0000 7f7ab7d21800 5 AuthRegistry(0x7ffee04d68a0) adding con mode: secure 2023-12-03T11:49:43.054 INFO:tasks.workunit.client.0.smithi003.stderr: -237> 2023-12-03T11:49:42.993+0000 7f7ab7d21800 5 AuthRegistry(0x7ffee04d68a0) adding con mode: crc 2023-12-03T11:49:43.054 INFO:tasks.workunit.client.0.smithi003.stderr: -236> 2023-12-03T11:49:42.993+0000 7f7ab7d21800 5 AuthRegistry(0x7ffee04d68a0) adding con mode: crc 2023-12-03T11:49:43.054 INFO:tasks.workunit.client.0.smithi003.stderr: -235> 2023-12-03T11:49:42.993+0000 7f7ab7d21800 5 AuthRegistry(0x7ffee04d68a0) adding con mode: secure 2023-12-03T11:49:43.054 INFO:tasks.workunit.client.0.smithi003.stderr: -234> 2023-12-03T11:49:42.993+0000 7f7ab7d21800 5 AuthRegistry(0x7ffee04d68a0) adding con mode: crc 2023-12-03T11:49:43.055 INFO:tasks.workunit.client.0.smithi003.stderr: -233> 2023-12-03T11:49:42.993+0000 7f7ab7d21800 5 AuthRegistry(0x7ffee04d68a0) adding con mode: secure 2023-12-03T11:49:43.055 INFO:tasks.workunit.client.0.smithi003.stderr: -232> 2023-12-03T11:49:42.993+0000 7f7a79fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:49:43.055 INFO:tasks.workunit.client.0.smithi003.stderr: -231> 2023-12-03T11:49:42.993+0000 7f7ab7d21800 5 AuthRegistry(0x7ffee04d68a0) adding con mode: crc 2023-12-03T11:49:43.055 INFO:tasks.workunit.client.0.smithi003.stderr: -230> 2023-12-03T11:49:42.993+0000 7f7ab7d21800 5 AuthRegistry(0x7ffee04d68a0) adding con mode: secure 2023-12-03T11:49:43.055 INFO:tasks.workunit.client.0.smithi003.stderr: -229> 2023-12-03T11:49:42.994+0000 7f7ab7d21800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:49:43.055 INFO:tasks.workunit.client.0.smithi003.stderr: -228> 2023-12-03T11:49:42.994+0000 7f7ab7d21800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:49:43.055 INFO:tasks.workunit.client.0.smithi003.stderr: -227> 2023-12-03T11:49:42.994+0000 7f7ab7d21800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:49:43.055 INFO:tasks.workunit.client.0.smithi003.stderr: -226> 2023-12-03T11:49:42.994+0000 7f7ab7d21800 5 asok(0x55afbf585a10) register_command cache list hook 0x55afbf76a200 2023-12-03T11:49:43.055 INFO:tasks.workunit.client.0.smithi003.stderr: -225> 2023-12-03T11:49:42.994+0000 7f7ab7d21800 5 asok(0x55afbf585a10) register_command cache inspect hook 0x55afbf76a200 2023-12-03T11:49:43.055 INFO:tasks.workunit.client.0.smithi003.stderr: -224> 2023-12-03T11:49:42.994+0000 7f7ab7d21800 5 asok(0x55afbf585a10) register_command cache erase hook 0x55afbf76a200 2023-12-03T11:49:43.055 INFO:tasks.workunit.client.0.smithi003.stderr: -223> 2023-12-03T11:49:42.994+0000 7f7ab7d21800 5 asok(0x55afbf585a10) register_command cache zap hook 0x55afbf76a200 2023-12-03T11:49:43.055 INFO:tasks.workunit.client.0.smithi003.stderr: -222> 2023-12-03T11:49:42.994+0000 7f7ab7d21800 10 monclient: get_monmap_and_config 2023-12-03T11:49:43.055 INFO:tasks.workunit.client.0.smithi003.stderr: -221> 2023-12-03T11:49:42.994+0000 7f7ab7d21800 10 monclient: build_initial_monmap 2023-12-03T11:49:43.055 INFO:tasks.workunit.client.0.smithi003.stderr: -220> 2023-12-03T11:49:42.994+0000 7f7ab7d21800 1 build_initial for_mkfs: 0 2023-12-03T11:49:43.055 INFO:tasks.workunit.client.0.smithi003.stderr: -219> 2023-12-03T11:49:42.994+0000 7f7ab7d21800 10 monclient: monmap: 2023-12-03T11:49:43.055 INFO:tasks.workunit.client.0.smithi003.stderr:epoch 0 2023-12-03T11:49:43.056 INFO:tasks.workunit.client.0.smithi003.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-12-03T11:49:43.056 INFO:tasks.workunit.client.0.smithi003.stderr:last_changed 0.000000 2023-12-03T11:49:43.056 INFO:tasks.workunit.client.0.smithi003.stderr:created 0.000000 2023-12-03T11:49:43.056 INFO:tasks.workunit.client.0.smithi003.stderr:min_mon_release 0 (unknown) 2023-12-03T11:49:43.056 INFO:tasks.workunit.client.0.smithi003.stderr:election_strategy: 1 2023-12-03T11:49:43.056 INFO:tasks.workunit.client.0.smithi003.stderr:0: [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] mon.noname-a 2023-12-03T11:49:43.056 INFO:tasks.workunit.client.0.smithi003.stderr:1: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.noname-b 2023-12-03T11:49:43.056 INFO:tasks.workunit.client.0.smithi003.stderr:2: [v2:172.21.15.3:3301/0,v1:172.21.15.3:6790/0] mon.noname-c 2023-12-03T11:49:43.056 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:49:43.056 INFO:tasks.workunit.client.0.smithi003.stderr: -218> 2023-12-03T11:49:42.994+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf821a90) adding auth protocol: cephx 2023-12-03T11:49:43.056 INFO:tasks.workunit.client.0.smithi003.stderr: -217> 2023-12-03T11:49:42.994+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf821a90) adding auth protocol: cephx 2023-12-03T11:49:43.057 INFO:tasks.workunit.client.0.smithi003.stderr: -216> 2023-12-03T11:49:42.994+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf821a90) adding auth protocol: cephx 2023-12-03T11:49:43.057 INFO:tasks.workunit.client.0.smithi003.stderr: -215> 2023-12-03T11:49:42.994+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf821a90) adding con mode: secure 2023-12-03T11:49:43.057 INFO:tasks.workunit.client.0.smithi003.stderr: -214> 2023-12-03T11:49:42.994+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf821a90) adding con mode: crc 2023-12-03T11:49:43.057 INFO:tasks.workunit.client.0.smithi003.stderr: -213> 2023-12-03T11:49:42.994+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf821a90) adding con mode: secure 2023-12-03T11:49:43.057 INFO:tasks.workunit.client.0.smithi003.stderr: -212> 2023-12-03T11:49:42.994+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf821a90) adding con mode: crc 2023-12-03T11:49:43.057 INFO:tasks.workunit.client.0.smithi003.stderr: -211> 2023-12-03T11:49:42.994+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf821a90) adding con mode: secure 2023-12-03T11:49:43.057 INFO:tasks.workunit.client.0.smithi003.stderr: -210> 2023-12-03T11:49:42.994+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf821a90) adding con mode: crc 2023-12-03T11:49:43.057 INFO:tasks.workunit.client.0.smithi003.stderr: -209> 2023-12-03T11:49:42.994+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf821a90) adding con mode: crc 2023-12-03T11:49:43.057 INFO:tasks.workunit.client.0.smithi003.stderr: -208> 2023-12-03T11:49:42.994+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf821a90) adding con mode: secure 2023-12-03T11:49:43.057 INFO:tasks.workunit.client.0.smithi003.stderr: -207> 2023-12-03T11:49:42.994+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf821a90) adding con mode: crc 2023-12-03T11:49:43.057 INFO:tasks.workunit.client.0.smithi003.stderr: -206> 2023-12-03T11:49:42.994+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf821a90) adding con mode: secure 2023-12-03T11:49:43.057 INFO:tasks.workunit.client.0.smithi003.stderr: -205> 2023-12-03T11:49:42.994+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf821a90) adding con mode: crc 2023-12-03T11:49:43.057 INFO:tasks.workunit.client.0.smithi003.stderr: -204> 2023-12-03T11:49:42.994+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf821a90) adding con mode: secure 2023-12-03T11:49:43.057 INFO:tasks.workunit.client.0.smithi003.stderr: -203> 2023-12-03T11:49:42.994+0000 7f7ab7d21800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:49:43.057 INFO:tasks.workunit.client.0.smithi003.stderr: -202> 2023-12-03T11:49:42.994+0000 7f7ab7d21800 10 monclient: init 2023-12-03T11:49:43.057 INFO:tasks.workunit.client.0.smithi003.stderr: -201> 2023-12-03T11:49:42.994+0000 7f7ab7d21800 5 AuthRegistry(0x7ffee04d63f0) adding auth protocol: cephx 2023-12-03T11:49:43.058 INFO:tasks.workunit.client.0.smithi003.stderr: -200> 2023-12-03T11:49:42.994+0000 7f7ab7d21800 5 AuthRegistry(0x7ffee04d63f0) adding auth protocol: cephx 2023-12-03T11:49:43.058 INFO:tasks.workunit.client.0.smithi003.stderr: -199> 2023-12-03T11:49:42.994+0000 7f7ab7d21800 5 AuthRegistry(0x7ffee04d63f0) adding auth protocol: cephx 2023-12-03T11:49:43.058 INFO:tasks.workunit.client.0.smithi003.stderr: -198> 2023-12-03T11:49:42.994+0000 7f7ab7d21800 5 AuthRegistry(0x7ffee04d63f0) adding con mode: secure 2023-12-03T11:49:43.058 INFO:tasks.workunit.client.0.smithi003.stderr: -197> 2023-12-03T11:49:42.994+0000 7f7ab7d21800 5 AuthRegistry(0x7ffee04d63f0) adding con mode: crc 2023-12-03T11:49:43.058 INFO:tasks.workunit.client.0.smithi003.stderr: -196> 2023-12-03T11:49:42.994+0000 7f7ab7d21800 5 AuthRegistry(0x7ffee04d63f0) adding con mode: secure 2023-12-03T11:49:43.058 INFO:tasks.workunit.client.0.smithi003.stderr: -195> 2023-12-03T11:49:42.994+0000 7f7ab7d21800 5 AuthRegistry(0x7ffee04d63f0) adding con mode: crc 2023-12-03T11:49:43.058 INFO:tasks.workunit.client.0.smithi003.stderr: -194> 2023-12-03T11:49:42.994+0000 7f7ab7d21800 5 AuthRegistry(0x7ffee04d63f0) adding con mode: secure 2023-12-03T11:49:43.058 INFO:tasks.workunit.client.0.smithi003.stderr: -193> 2023-12-03T11:49:42.994+0000 7f7ab7d21800 5 AuthRegistry(0x7ffee04d63f0) adding con mode: crc 2023-12-03T11:49:43.058 INFO:tasks.workunit.client.0.smithi003.stderr: -192> 2023-12-03T11:49:42.994+0000 7f7ab7d21800 5 AuthRegistry(0x7ffee04d63f0) adding con mode: crc 2023-12-03T11:49:43.058 INFO:tasks.workunit.client.0.smithi003.stderr: -191> 2023-12-03T11:49:42.994+0000 7f7ab7d21800 5 AuthRegistry(0x7ffee04d63f0) adding con mode: secure 2023-12-03T11:49:43.058 INFO:tasks.workunit.client.0.smithi003.stderr: -190> 2023-12-03T11:49:42.994+0000 7f7ab7d21800 5 AuthRegistry(0x7ffee04d63f0) adding con mode: crc 2023-12-03T11:49:43.058 INFO:tasks.workunit.client.0.smithi003.stderr: -189> 2023-12-03T11:49:42.994+0000 7f7ab7d21800 5 AuthRegistry(0x7ffee04d63f0) adding con mode: secure 2023-12-03T11:49:43.058 INFO:tasks.workunit.client.0.smithi003.stderr: -188> 2023-12-03T11:49:42.994+0000 7f7ab7d21800 5 AuthRegistry(0x7ffee04d63f0) adding con mode: crc 2023-12-03T11:49:43.058 INFO:tasks.workunit.client.0.smithi003.stderr: -187> 2023-12-03T11:49:42.994+0000 7f7ab7d21800 5 AuthRegistry(0x7ffee04d63f0) adding con mode: secure 2023-12-03T11:49:43.059 INFO:tasks.workunit.client.0.smithi003.stderr: -186> 2023-12-03T11:49:42.994+0000 7f7ab7d21800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:49:43.059 INFO:tasks.workunit.client.0.smithi003.stderr: -185> 2023-12-03T11:49:42.994+0000 7f7ab7d21800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:49:43.059 INFO:tasks.workunit.client.0.smithi003.stderr: -184> 2023-12-03T11:49:42.994+0000 7f7ab7d21800 5 asok(0x55afbf585a10) register_command rotate-key cmddesc rotate-key hook 0x7ffee04d6538 EEXIST 2023-12-03T11:49:43.059 INFO:tasks.workunit.client.0.smithi003.stderr: -183> 2023-12-03T11:49:42.994+0000 7f7ab7d21800 10 monclient: _reopen_session rank -1 2023-12-03T11:49:43.059 INFO:tasks.workunit.client.0.smithi003.stderr: -182> 2023-12-03T11:49:42.994+0000 7f7ab7d21800 10 monclient: _add_conns ranks=[0,1,2] 2023-12-03T11:49:43.059 INFO:tasks.workunit.client.0.smithi003.stderr: -181> 2023-12-03T11:49:42.994+0000 7f7ab7d21800 10 monclient(hunting): picked mon.noname-a con 0x55afbf824380 addr [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] 2023-12-03T11:49:43.059 INFO:tasks.workunit.client.0.smithi003.stderr: -180> 2023-12-03T11:49:42.995+0000 7f7ab7d21800 10 monclient(hunting): picked mon.noname-b con 0x55afbf8212e0 addr [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] 2023-12-03T11:49:43.059 INFO:tasks.workunit.client.0.smithi003.stderr: -179> 2023-12-03T11:49:42.995+0000 7f7ab7d21800 10 monclient(hunting): picked mon.noname-c con 0x55afbf81dfb0 addr [v2:172.21.15.3:3301/0,v1:172.21.15.3:6790/0] 2023-12-03T11:49:43.059 INFO:tasks.workunit.client.0.smithi003.stderr: -178> 2023-12-03T11:49:42.995+0000 7f7ab7d21800 10 monclient(hunting): start opening mon connection 2023-12-03T11:49:43.059 INFO:tasks.workunit.client.0.smithi003.stderr: -177> 2023-12-03T11:49:42.995+0000 7f7ab7d21800 10 monclient(hunting): start opening mon connection 2023-12-03T11:49:43.059 INFO:tasks.workunit.client.0.smithi003.stderr: -176> 2023-12-03T11:49:42.995+0000 7f7ab7d21800 10 monclient(hunting): start opening mon connection 2023-12-03T11:49:43.059 INFO:tasks.workunit.client.0.smithi003.stderr: -175> 2023-12-03T11:49:42.995+0000 7f7ab7d21800 10 monclient(hunting): _renew_subs 2023-12-03T11:49:43.059 INFO:tasks.workunit.client.0.smithi003.stderr: -174> 2023-12-03T11:49:42.995+0000 7f7ab7d21800 10 monclient(hunting): authenticate will time out at 1805.233332s 2023-12-03T11:49:43.059 INFO:tasks.workunit.client.0.smithi003.stderr: -173> 2023-12-03T11:49:42.995+0000 7f7ab42b9640 10 monclient(hunting): get_auth_request con 0x55afbf824380 auth_method 0 2023-12-03T11:49:43.059 INFO:tasks.workunit.client.0.smithi003.stderr: -172> 2023-12-03T11:49:42.995+0000 7f7ab42b9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:49:43.060 INFO:tasks.workunit.client.0.smithi003.stderr: -171> 2023-12-03T11:49:42.995+0000 7f7ab42b9640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:49:43.060 INFO:tasks.workunit.client.0.smithi003.stderr: -170> 2023-12-03T11:49:42.995+0000 7f7ab42b9640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:49:43.060 INFO:tasks.workunit.client.0.smithi003.stderr: -169> 2023-12-03T11:49:42.995+0000 7f7ab32b7640 10 monclient(hunting): get_auth_request con 0x55afbf81dfb0 auth_method 0 2023-12-03T11:49:43.060 INFO:tasks.workunit.client.0.smithi003.stderr: -168> 2023-12-03T11:49:42.995+0000 7f7ab32b7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:49:43.060 INFO:tasks.workunit.client.0.smithi003.stderr: -167> 2023-12-03T11:49:42.995+0000 7f7ab32b7640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:49:43.060 INFO:tasks.workunit.client.0.smithi003.stderr: -166> 2023-12-03T11:49:42.995+0000 7f7ab32b7640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:49:43.060 INFO:tasks.workunit.client.0.smithi003.stderr: -165> 2023-12-03T11:49:42.995+0000 7f7ab3ab8640 10 monclient(hunting): get_auth_request con 0x55afbf8212e0 auth_method 0 2023-12-03T11:49:43.060 INFO:tasks.workunit.client.0.smithi003.stderr: -164> 2023-12-03T11:49:42.995+0000 7f7ab3ab8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:49:43.060 INFO:tasks.workunit.client.0.smithi003.stderr: -163> 2023-12-03T11:49:42.995+0000 7f7ab3ab8640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:49:43.060 INFO:tasks.workunit.client.0.smithi003.stderr: -162> 2023-12-03T11:49:42.995+0000 7f7ab3ab8640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:49:43.060 INFO:tasks.workunit.client.0.smithi003.stderr: -161> 2023-12-03T11:49:42.995+0000 7f7ab42b9640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:49:43.060 INFO:tasks.workunit.client.0.smithi003.stderr: -160> 2023-12-03T11:49:42.995+0000 7f7ab42b9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:49:43.060 INFO:tasks.workunit.client.0.smithi003.stderr: -159> 2023-12-03T11:49:42.995+0000 7f7ab42b9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:49:43.060 INFO:tasks.workunit.client.0.smithi003.stderr: -158> 2023-12-03T11:49:42.995+0000 7f7ab32b7640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:49:43.060 INFO:tasks.workunit.client.0.smithi003.stderr: -157> 2023-12-03T11:49:42.995+0000 7f7ab32b7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:49:43.060 INFO:tasks.workunit.client.0.smithi003.stderr: -156> 2023-12-03T11:49:42.995+0000 7f7ab32b7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:49:43.061 INFO:tasks.workunit.client.0.smithi003.stderr: -155> 2023-12-03T11:49:42.995+0000 7f7ab3ab8640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:49:43.061 INFO:tasks.workunit.client.0.smithi003.stderr: -154> 2023-12-03T11:49:42.995+0000 7f7ab3ab8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:49:43.061 INFO:tasks.workunit.client.0.smithi003.stderr: -153> 2023-12-03T11:49:42.995+0000 7f7ab3ab8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:49:43.061 INFO:tasks.workunit.client.0.smithi003.stderr: -152> 2023-12-03T11:49:42.995+0000 7f7ab42b9640 10 monclient(hunting): handle_auth_done global_id 7293 payload 274 2023-12-03T11:49:43.061 INFO:tasks.workunit.client.0.smithi003.stderr: -151> 2023-12-03T11:49:42.995+0000 7f7ab42b9640 10 monclient: _finish_hunting 0 2023-12-03T11:49:43.061 INFO:tasks.workunit.client.0.smithi003.stderr: -150> 2023-12-03T11:49:42.995+0000 7f7ab42b9640 1 monclient: found mon.noname-a 2023-12-03T11:49:43.061 INFO:tasks.workunit.client.0.smithi003.stderr: -149> 2023-12-03T11:49:42.995+0000 7f7ab42b9640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.3:3300/0 2023-12-03T11:49:43.061 INFO:tasks.workunit.client.0.smithi003.stderr: -148> 2023-12-03T11:49:42.995+0000 7f7a797e2640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:49:43.061 INFO:tasks.workunit.client.0.smithi003.stderr: -147> 2023-12-03T11:49:42.995+0000 7f7a797e2640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-12-03T11:49:43.061 INFO:tasks.workunit.client.0.smithi003.stderr: -146> 2023-12-03T11:49:42.995+0000 7f7a797e2640 10 monclient: dump: 2023-12-03T11:49:43.061 INFO:tasks.workunit.client.0.smithi003.stderr:epoch 1 2023-12-03T11:49:43.061 INFO:tasks.workunit.client.0.smithi003.stderr:fsid 296556de-a4fc-4095-9b6d-0fe813c2865c 2023-12-03T11:49:43.061 INFO:tasks.workunit.client.0.smithi003.stderr:last_changed 2023-12-03T11:33:18.862564+0000 2023-12-03T11:49:43.061 INFO:tasks.workunit.client.0.smithi003.stderr:created 2023-12-03T11:33:18.862564+0000 2023-12-03T11:49:43.061 INFO:tasks.workunit.client.0.smithi003.stderr:min_mon_release 18 (reef) 2023-12-03T11:49:43.062 INFO:tasks.workunit.client.0.smithi003.stderr:election_strategy: 1 2023-12-03T11:49:43.062 INFO:tasks.workunit.client.0.smithi003.stderr:0: [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] mon.a 2023-12-03T11:49:43.062 INFO:tasks.workunit.client.0.smithi003.stderr:1: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.b 2023-12-03T11:49:43.062 INFO:tasks.workunit.client.0.smithi003.stderr:2: [v2:172.21.15.3:3301/0,v1:172.21.15.3:6790/0] mon.c 2023-12-03T11:49:43.062 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:49:43.062 INFO:tasks.workunit.client.0.smithi003.stderr: -145> 2023-12-03T11:49:42.995+0000 7f7a797e2640 10 monclient: _finish_auth 0 2023-12-03T11:49:43.062 INFO:tasks.workunit.client.0.smithi003.stderr: -144> 2023-12-03T11:49:42.995+0000 7f7a797e2640 10 monclient: _check_auth_tickets 2023-12-03T11:49:43.062 INFO:tasks.workunit.client.0.smithi003.stderr: -143> 2023-12-03T11:49:42.995+0000 7f7a797e2640 10 monclient: handle_config config(0 keys) v1 2023-12-03T11:49:43.062 INFO:tasks.workunit.client.0.smithi003.stderr: -142> 2023-12-03T11:49:42.995+0000 7f7a797e2640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:49:43.062 INFO:tasks.workunit.client.0.smithi003.stderr: -141> 2023-12-03T11:49:42.995+0000 7f7a797e2640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-12-03T11:49:43.062 INFO:tasks.workunit.client.0.smithi003.stderr: -140> 2023-12-03T11:49:42.995+0000 7f7a797e2640 10 monclient: dump: 2023-12-03T11:49:43.062 INFO:tasks.workunit.client.0.smithi003.stderr:epoch 1 2023-12-03T11:49:43.062 INFO:tasks.workunit.client.0.smithi003.stderr:fsid 296556de-a4fc-4095-9b6d-0fe813c2865c 2023-12-03T11:49:43.062 INFO:tasks.workunit.client.0.smithi003.stderr:last_changed 2023-12-03T11:33:18.862564+0000 2023-12-03T11:49:43.062 INFO:tasks.workunit.client.0.smithi003.stderr:created 2023-12-03T11:33:18.862564+0000 2023-12-03T11:49:43.063 INFO:tasks.workunit.client.0.smithi003.stderr:min_mon_release 18 (reef) 2023-12-03T11:49:43.063 INFO:tasks.workunit.client.0.smithi003.stderr:election_strategy: 1 2023-12-03T11:49:43.063 INFO:tasks.workunit.client.0.smithi003.stderr:0: [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] mon.a 2023-12-03T11:49:43.063 INFO:tasks.workunit.client.0.smithi003.stderr:1: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.b 2023-12-03T11:49:43.063 INFO:tasks.workunit.client.0.smithi003.stderr:2: [v2:172.21.15.3:3301/0,v1:172.21.15.3:6790/0] mon.c 2023-12-03T11:49:43.063 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:49:43.063 INFO:tasks.workunit.client.0.smithi003.stderr: -139> 2023-12-03T11:49:42.995+0000 7f7ab7d21800 5 monclient: authenticate success, global_id 7293 2023-12-03T11:49:43.063 INFO:tasks.workunit.client.0.smithi003.stderr: -138> 2023-12-03T11:49:42.995+0000 7f7ab7d21800 10 monclient: get_monmap_and_config success 2023-12-03T11:49:43.063 INFO:tasks.workunit.client.0.smithi003.stderr: -137> 2023-12-03T11:49:42.995+0000 7f7ab7d21800 4 set_mon_vals no callback set 2023-12-03T11:49:43.063 INFO:tasks.workunit.client.0.smithi003.stderr: -136> 2023-12-03T11:49:42.996+0000 7f7ab7d21800 10 monclient: shutdown 2023-12-03T11:49:43.063 INFO:tasks.workunit.client.0.smithi003.stderr: -135> 2023-12-03T11:49:42.996+0000 7f7ab7d21800 10 monclient: build_initial_monmap 2023-12-03T11:49:43.063 INFO:tasks.workunit.client.0.smithi003.stderr: -134> 2023-12-03T11:49:42.996+0000 7f7ab7d21800 1 build_initial for_mkfs: 0 2023-12-03T11:49:43.063 INFO:tasks.workunit.client.0.smithi003.stderr: -133> 2023-12-03T11:49:42.996+0000 7f7ab7d21800 10 monclient: monmap: 2023-12-03T11:49:43.063 INFO:tasks.workunit.client.0.smithi003.stderr:epoch 0 2023-12-03T11:49:43.063 INFO:tasks.workunit.client.0.smithi003.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-12-03T11:49:43.063 INFO:tasks.workunit.client.0.smithi003.stderr:last_changed 0.000000 2023-12-03T11:49:43.064 INFO:tasks.workunit.client.0.smithi003.stderr:created 0.000000 2023-12-03T11:49:43.064 INFO:tasks.workunit.client.0.smithi003.stderr:min_mon_release 0 (unknown) 2023-12-03T11:49:43.064 INFO:tasks.workunit.client.0.smithi003.stderr:election_strategy: 1 2023-12-03T11:49:43.064 INFO:tasks.workunit.client.0.smithi003.stderr:0: [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] mon.noname-a 2023-12-03T11:49:43.064 INFO:tasks.workunit.client.0.smithi003.stderr:1: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.noname-b 2023-12-03T11:49:43.064 INFO:tasks.workunit.client.0.smithi003.stderr:2: [v2:172.21.15.3:3301/0,v1:172.21.15.3:6790/0] mon.noname-c 2023-12-03T11:49:43.064 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:49:43.064 INFO:tasks.workunit.client.0.smithi003.stderr: -132> 2023-12-03T11:49:42.996+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf823990) adding auth protocol: cephx 2023-12-03T11:49:43.064 INFO:tasks.workunit.client.0.smithi003.stderr: -131> 2023-12-03T11:49:42.996+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf823990) adding auth protocol: cephx 2023-12-03T11:49:43.064 INFO:tasks.workunit.client.0.smithi003.stderr: -130> 2023-12-03T11:49:42.996+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf823990) adding auth protocol: cephx 2023-12-03T11:49:43.064 INFO:tasks.workunit.client.0.smithi003.stderr: -129> 2023-12-03T11:49:42.996+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf823990) adding con mode: secure 2023-12-03T11:49:43.064 INFO:tasks.workunit.client.0.smithi003.stderr: -128> 2023-12-03T11:49:42.996+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf823990) adding con mode: crc 2023-12-03T11:49:43.065 INFO:tasks.workunit.client.0.smithi003.stderr: -127> 2023-12-03T11:49:42.996+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf823990) adding con mode: secure 2023-12-03T11:49:43.065 INFO:tasks.workunit.client.0.smithi003.stderr: -126> 2023-12-03T11:49:42.996+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf823990) adding con mode: crc 2023-12-03T11:49:43.065 INFO:tasks.workunit.client.0.smithi003.stderr: -125> 2023-12-03T11:49:42.996+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf823990) adding con mode: secure 2023-12-03T11:49:43.065 INFO:tasks.workunit.client.0.smithi003.stderr: -124> 2023-12-03T11:49:42.996+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf823990) adding con mode: crc 2023-12-03T11:49:43.065 INFO:tasks.workunit.client.0.smithi003.stderr: -123> 2023-12-03T11:49:42.996+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf823990) adding con mode: crc 2023-12-03T11:49:43.065 INFO:tasks.workunit.client.0.smithi003.stderr: -122> 2023-12-03T11:49:42.996+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf823990) adding con mode: secure 2023-12-03T11:49:43.065 INFO:tasks.workunit.client.0.smithi003.stderr: -121> 2023-12-03T11:49:42.996+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf823990) adding con mode: crc 2023-12-03T11:49:43.065 INFO:tasks.workunit.client.0.smithi003.stderr: -120> 2023-12-03T11:49:42.996+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf823990) adding con mode: secure 2023-12-03T11:49:43.065 INFO:tasks.workunit.client.0.smithi003.stderr: -119> 2023-12-03T11:49:42.996+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf823990) adding con mode: crc 2023-12-03T11:49:43.065 INFO:tasks.workunit.client.0.smithi003.stderr: -118> 2023-12-03T11:49:42.996+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf823990) adding con mode: secure 2023-12-03T11:49:43.065 INFO:tasks.workunit.client.0.smithi003.stderr: -117> 2023-12-03T11:49:42.996+0000 7f7ab7d21800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:49:43.065 INFO:tasks.workunit.client.0.smithi003.stderr: -116> 2023-12-03T11:49:42.996+0000 7f7ab7d21800 1 librados: starting msgr at 2023-12-03T11:49:43.065 INFO:tasks.workunit.client.0.smithi003.stderr: -115> 2023-12-03T11:49:42.996+0000 7f7ab7d21800 1 librados: starting objecter 2023-12-03T11:49:43.065 INFO:tasks.workunit.client.0.smithi003.stderr: -114> 2023-12-03T11:49:42.996+0000 7f7ab7d21800 5 asok(0x55afbf585a10) register_command objecter_requests cmddesc objecter_requests hook 0x55afbf7ea7c0 EEXIST 2023-12-03T11:49:43.066 INFO:tasks.workunit.client.0.smithi003.stderr: -113> 2023-12-03T11:49:42.997+0000 7f7ab7d21800 1 librados: setting wanted keys 2023-12-03T11:49:43.066 INFO:tasks.workunit.client.0.smithi003.stderr: -112> 2023-12-03T11:49:42.997+0000 7f7ab7d21800 1 librados: calling monclient init 2023-12-03T11:49:43.066 INFO:tasks.workunit.client.0.smithi003.stderr: -111> 2023-12-03T11:49:42.997+0000 7f7ab7d21800 10 monclient: init 2023-12-03T11:49:43.066 INFO:tasks.workunit.client.0.smithi003.stderr: -110> 2023-12-03T11:49:42.997+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf824fa8) adding auth protocol: cephx 2023-12-03T11:49:43.066 INFO:tasks.workunit.client.0.smithi003.stderr: -109> 2023-12-03T11:49:42.997+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf824fa8) adding auth protocol: cephx 2023-12-03T11:49:43.066 INFO:tasks.workunit.client.0.smithi003.stderr: -108> 2023-12-03T11:49:42.997+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf824fa8) adding auth protocol: cephx 2023-12-03T11:49:43.066 INFO:tasks.workunit.client.0.smithi003.stderr: -107> 2023-12-03T11:49:42.997+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf824fa8) adding con mode: secure 2023-12-03T11:49:43.066 INFO:tasks.workunit.client.0.smithi003.stderr: -106> 2023-12-03T11:49:42.997+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf824fa8) adding con mode: crc 2023-12-03T11:49:43.066 INFO:tasks.workunit.client.0.smithi003.stderr: -105> 2023-12-03T11:49:42.997+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf824fa8) adding con mode: secure 2023-12-03T11:49:43.066 INFO:tasks.workunit.client.0.smithi003.stderr: -104> 2023-12-03T11:49:42.997+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf824fa8) adding con mode: crc 2023-12-03T11:49:43.066 INFO:tasks.workunit.client.0.smithi003.stderr: -103> 2023-12-03T11:49:42.997+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf824fa8) adding con mode: secure 2023-12-03T11:49:43.066 INFO:tasks.workunit.client.0.smithi003.stderr: -102> 2023-12-03T11:49:42.997+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf824fa8) adding con mode: crc 2023-12-03T11:49:43.066 INFO:tasks.workunit.client.0.smithi003.stderr: -101> 2023-12-03T11:49:42.997+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf824fa8) adding con mode: crc 2023-12-03T11:49:43.066 INFO:tasks.workunit.client.0.smithi003.stderr: -100> 2023-12-03T11:49:42.997+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf824fa8) adding con mode: secure 2023-12-03T11:49:43.066 INFO:tasks.workunit.client.0.smithi003.stderr: -99> 2023-12-03T11:49:42.997+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf824fa8) adding con mode: crc 2023-12-03T11:49:43.067 INFO:tasks.workunit.client.0.smithi003.stderr: -98> 2023-12-03T11:49:42.997+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf824fa8) adding con mode: secure 2023-12-03T11:49:43.067 INFO:tasks.workunit.client.0.smithi003.stderr: -97> 2023-12-03T11:49:42.997+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf824fa8) adding con mode: crc 2023-12-03T11:49:43.067 INFO:tasks.workunit.client.0.smithi003.stderr: -96> 2023-12-03T11:49:42.997+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf824fa8) adding con mode: secure 2023-12-03T11:49:43.067 INFO:tasks.workunit.client.0.smithi003.stderr: -95> 2023-12-03T11:49:42.997+0000 7f7ab7d21800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:49:43.067 INFO:tasks.workunit.client.0.smithi003.stderr: -94> 2023-12-03T11:49:42.997+0000 7f7ab7d21800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:49:43.067 INFO:tasks.workunit.client.0.smithi003.stderr: -93> 2023-12-03T11:49:42.997+0000 7f7ab7d21800 5 asok(0x55afbf585a10) register_command rotate-key cmddesc rotate-key hook 0x55afbf8250f0 EEXIST 2023-12-03T11:49:43.067 INFO:tasks.workunit.client.0.smithi003.stderr: -92> 2023-12-03T11:49:42.997+0000 7f7ab7d21800 10 monclient: _reopen_session rank -1 2023-12-03T11:49:43.067 INFO:tasks.workunit.client.0.smithi003.stderr: -91> 2023-12-03T11:49:42.997+0000 7f7ab7d21800 10 monclient: _add_conns ranks=[0,2,1] 2023-12-03T11:49:43.067 INFO:tasks.workunit.client.0.smithi003.stderr: -90> 2023-12-03T11:49:42.997+0000 7f7ab7d21800 10 monclient(hunting): picked mon.noname-a con 0x55afbf81dfb0 addr [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] 2023-12-03T11:49:43.067 INFO:tasks.workunit.client.0.smithi003.stderr: -89> 2023-12-03T11:49:42.997+0000 7f7ab7d21800 10 monclient(hunting): picked mon.noname-c con 0x55afbf8212e0 addr [v2:172.21.15.3:3301/0,v1:172.21.15.3:6790/0] 2023-12-03T11:49:43.067 INFO:tasks.workunit.client.0.smithi003.stderr: -88> 2023-12-03T11:49:42.997+0000 7f7ab7d21800 10 monclient(hunting): picked mon.noname-b con 0x55afbf824380 addr [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] 2023-12-03T11:49:43.067 INFO:tasks.workunit.client.0.smithi003.stderr: -87> 2023-12-03T11:49:42.997+0000 7f7ab7d21800 10 monclient(hunting): start opening mon connection 2023-12-03T11:49:43.067 INFO:tasks.workunit.client.0.smithi003.stderr: -86> 2023-12-03T11:49:42.997+0000 7f7ab7d21800 10 monclient(hunting): start opening mon connection 2023-12-03T11:49:43.067 INFO:tasks.workunit.client.0.smithi003.stderr: -85> 2023-12-03T11:49:42.997+0000 7f7ab7d21800 10 monclient(hunting): start opening mon connection 2023-12-03T11:49:43.067 INFO:tasks.workunit.client.0.smithi003.stderr: -84> 2023-12-03T11:49:42.997+0000 7f7ab7d21800 10 monclient(hunting): _renew_subs 2023-12-03T11:49:43.068 INFO:tasks.workunit.client.0.smithi003.stderr: -83> 2023-12-03T11:49:42.997+0000 7f7ab7d21800 10 monclient(hunting): authenticate will time out at 1805.235852s 2023-12-03T11:49:43.068 INFO:tasks.workunit.client.0.smithi003.stderr: -82> 2023-12-03T11:49:42.997+0000 7f7ab42b9640 10 monclient(hunting): get_auth_request con 0x55afbf81dfb0 auth_method 0 2023-12-03T11:49:43.068 INFO:tasks.workunit.client.0.smithi003.stderr: -81> 2023-12-03T11:49:42.997+0000 7f7ab42b9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:49:43.068 INFO:tasks.workunit.client.0.smithi003.stderr: -80> 2023-12-03T11:49:42.997+0000 7f7ab42b9640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:49:43.068 INFO:tasks.workunit.client.0.smithi003.stderr: -79> 2023-12-03T11:49:42.997+0000 7f7ab42b9640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:49:43.068 INFO:tasks.workunit.client.0.smithi003.stderr: -78> 2023-12-03T11:49:42.997+0000 7f7ab3ab8640 10 monclient(hunting): get_auth_request con 0x55afbf8212e0 auth_method 0 2023-12-03T11:49:43.068 INFO:tasks.workunit.client.0.smithi003.stderr: -77> 2023-12-03T11:49:42.997+0000 7f7ab3ab8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:49:43.068 INFO:tasks.workunit.client.0.smithi003.stderr: -76> 2023-12-03T11:49:42.997+0000 7f7ab3ab8640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:49:43.068 INFO:tasks.workunit.client.0.smithi003.stderr: -75> 2023-12-03T11:49:42.997+0000 7f7ab3ab8640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:49:43.068 INFO:tasks.workunit.client.0.smithi003.stderr: -74> 2023-12-03T11:49:42.997+0000 7f7ab42b9640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:49:43.068 INFO:tasks.workunit.client.0.smithi003.stderr: -73> 2023-12-03T11:49:42.997+0000 7f7ab42b9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:49:43.068 INFO:tasks.workunit.client.0.smithi003.stderr: -72> 2023-12-03T11:49:42.997+0000 7f7ab42b9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:49:43.068 INFO:tasks.workunit.client.0.smithi003.stderr: -71> 2023-12-03T11:49:42.997+0000 7f7ab3ab8640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:49:43.068 INFO:tasks.workunit.client.0.smithi003.stderr: -70> 2023-12-03T11:49:42.997+0000 7f7ab3ab8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:49:43.068 INFO:tasks.workunit.client.0.smithi003.stderr: -69> 2023-12-03T11:49:42.997+0000 7f7ab3ab8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:49:43.068 INFO:tasks.workunit.client.0.smithi003.stderr: -68> 2023-12-03T11:49:42.997+0000 7f7ab32b7640 10 monclient(hunting): get_auth_request con 0x55afbf824380 auth_method 0 2023-12-03T11:49:43.069 INFO:tasks.workunit.client.0.smithi003.stderr: -67> 2023-12-03T11:49:42.997+0000 7f7ab32b7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:49:43.069 INFO:tasks.workunit.client.0.smithi003.stderr: -66> 2023-12-03T11:49:42.997+0000 7f7ab32b7640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:49:43.069 INFO:tasks.workunit.client.0.smithi003.stderr: -65> 2023-12-03T11:49:42.997+0000 7f7ab32b7640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:49:43.069 INFO:tasks.workunit.client.0.smithi003.stderr: -64> 2023-12-03T11:49:42.997+0000 7f7ab32b7640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:49:43.069 INFO:tasks.workunit.client.0.smithi003.stderr: -63> 2023-12-03T11:49:42.997+0000 7f7ab32b7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:49:43.069 INFO:tasks.workunit.client.0.smithi003.stderr: -62> 2023-12-03T11:49:42.997+0000 7f7ab32b7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:49:43.069 INFO:tasks.workunit.client.0.smithi003.stderr: -61> 2023-12-03T11:49:42.997+0000 7f7ab42b9640 10 monclient(hunting): handle_auth_done global_id 7296 payload 824 2023-12-03T11:49:43.069 INFO:tasks.workunit.client.0.smithi003.stderr: -60> 2023-12-03T11:49:42.997+0000 7f7ab42b9640 10 monclient: _finish_hunting 0 2023-12-03T11:49:43.069 INFO:tasks.workunit.client.0.smithi003.stderr: -59> 2023-12-03T11:49:42.997+0000 7f7ab42b9640 1 monclient: found mon.noname-a 2023-12-03T11:49:43.069 INFO:tasks.workunit.client.0.smithi003.stderr: -58> 2023-12-03T11:49:42.997+0000 7f7ab42b9640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.3:3300/0 2023-12-03T11:49:43.069 INFO:tasks.workunit.client.0.smithi003.stderr: -57> 2023-12-03T11:49:42.998+0000 7f79f37fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:49:43.069 INFO:tasks.workunit.client.0.smithi003.stderr: -56> 2023-12-03T11:49:42.998+0000 7f79f37fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-12-03T11:49:43.069 INFO:tasks.workunit.client.0.smithi003.stderr: -55> 2023-12-03T11:49:42.998+0000 7f79f37fe640 10 monclient: dump: 2023-12-03T11:49:43.069 INFO:tasks.workunit.client.0.smithi003.stderr:epoch 1 2023-12-03T11:49:43.069 INFO:tasks.workunit.client.0.smithi003.stderr:fsid 296556de-a4fc-4095-9b6d-0fe813c2865c 2023-12-03T11:49:43.070 INFO:tasks.workunit.client.0.smithi003.stderr:last_changed 2023-12-03T11:33:18.862564+0000 2023-12-03T11:49:43.070 INFO:tasks.workunit.client.0.smithi003.stderr:created 2023-12-03T11:33:18.862564+0000 2023-12-03T11:49:43.070 INFO:tasks.workunit.client.0.smithi003.stderr:min_mon_release 18 (reef) 2023-12-03T11:49:43.070 INFO:tasks.workunit.client.0.smithi003.stderr:election_strategy: 1 2023-12-03T11:49:43.070 INFO:tasks.workunit.client.0.smithi003.stderr:0: [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] mon.a 2023-12-03T11:49:43.070 INFO:tasks.workunit.client.0.smithi003.stderr:1: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.b 2023-12-03T11:49:43.070 INFO:tasks.workunit.client.0.smithi003.stderr:2: [v2:172.21.15.3:3301/0,v1:172.21.15.3:6790/0] mon.c 2023-12-03T11:49:43.070 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:49:43.070 INFO:tasks.workunit.client.0.smithi003.stderr: -54> 2023-12-03T11:49:42.998+0000 7f79f37fe640 10 monclient: _finish_auth 0 2023-12-03T11:49:43.070 INFO:tasks.workunit.client.0.smithi003.stderr: -53> 2023-12-03T11:49:42.998+0000 7f79f37fe640 10 monclient: _check_auth_tickets 2023-12-03T11:49:43.070 INFO:tasks.workunit.client.0.smithi003.stderr: -52> 2023-12-03T11:49:42.998+0000 7f79f37fe640 10 monclient: handle_config config(0 keys) v1 2023-12-03T11:49:43.070 INFO:tasks.workunit.client.0.smithi003.stderr: -51> 2023-12-03T11:49:42.998+0000 7f79f37fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:49:43.070 INFO:tasks.workunit.client.0.smithi003.stderr: -50> 2023-12-03T11:49:42.998+0000 7f79f37fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-12-03T11:49:43.070 INFO:tasks.workunit.client.0.smithi003.stderr: -49> 2023-12-03T11:49:42.998+0000 7f79f37fe640 10 monclient: dump: 2023-12-03T11:49:43.071 INFO:tasks.workunit.client.0.smithi003.stderr:epoch 1 2023-12-03T11:49:43.071 INFO:tasks.workunit.client.0.smithi003.stderr:fsid 296556de-a4fc-4095-9b6d-0fe813c2865c 2023-12-03T11:49:43.071 INFO:tasks.workunit.client.0.smithi003.stderr:last_changed 2023-12-03T11:33:18.862564+0000 2023-12-03T11:49:43.071 INFO:tasks.workunit.client.0.smithi003.stderr:created 2023-12-03T11:33:18.862564+0000 2023-12-03T11:49:43.071 INFO:tasks.workunit.client.0.smithi003.stderr:min_mon_release 18 (reef) 2023-12-03T11:49:43.071 INFO:tasks.workunit.client.0.smithi003.stderr:election_strategy: 1 2023-12-03T11:49:43.071 INFO:tasks.workunit.client.0.smithi003.stderr:0: [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] mon.a 2023-12-03T11:49:43.071 INFO:tasks.workunit.client.0.smithi003.stderr:1: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.b 2023-12-03T11:49:43.071 INFO:tasks.workunit.client.0.smithi003.stderr:2: [v2:172.21.15.3:3301/0,v1:172.21.15.3:6790/0] mon.c 2023-12-03T11:49:43.071 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:49:43.071 INFO:tasks.workunit.client.0.smithi003.stderr: -48> 2023-12-03T11:49:42.998+0000 7f7ab7d21800 5 monclient: authenticate success, global_id 7296 2023-12-03T11:49:43.071 INFO:tasks.workunit.client.0.smithi003.stderr: -47> 2023-12-03T11:49:42.998+0000 7f7a797e2640 4 set_mon_vals no callback set 2023-12-03T11:49:43.071 INFO:tasks.workunit.client.0.smithi003.stderr: -46> 2023-12-03T11:49:42.998+0000 7f7ab7d21800 10 monclient: _renew_subs 2023-12-03T11:49:43.072 INFO:tasks.workunit.client.0.smithi003.stderr: -45> 2023-12-03T11:49:42.998+0000 7f7ab7d21800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.3:3300/0 2023-12-03T11:49:43.072 INFO:tasks.workunit.client.0.smithi003.stderr: -44> 2023-12-03T11:49:42.998+0000 7f7ab7d21800 10 monclient: _renew_subs 2023-12-03T11:49:43.072 INFO:tasks.workunit.client.0.smithi003.stderr: -43> 2023-12-03T11:49:42.998+0000 7f7ab7d21800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.3:3300/0 2023-12-03T11:49:43.072 INFO:tasks.workunit.client.0.smithi003.stderr: -42> 2023-12-03T11:49:42.998+0000 7f7ab7d21800 1 librados: init done 2023-12-03T11:49:43.072 INFO:tasks.workunit.client.0.smithi003.stderr: -41> 2023-12-03T11:49:42.998+0000 7f7ab7d21800 5 asok(0x55afbf585a10) register_command cr dump hook 0x55afbf8273e8 2023-12-03T11:49:43.072 INFO:tasks.workunit.client.0.smithi003.stderr: -40> 2023-12-03T11:49:42.999+0000 7f79f37fe640 4 mgrc handle_mgr_map Got map version 5 2023-12-03T11:49:43.072 INFO:tasks.workunit.client.0.smithi003.stderr: -39> 2023-12-03T11:49:42.999+0000 7f79f37fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.37:6832/2165065416,v1:172.21.15.37:6833/2165065416] 2023-12-03T11:49:43.072 INFO:tasks.workunit.client.0.smithi003.stderr: -38> 2023-12-03T11:49:42.999+0000 7f79f37fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.37:6832/2165065416,v1:172.21.15.37:6833/2165065416] 2023-12-03T11:49:43.072 INFO:tasks.workunit.client.0.smithi003.stderr: -37> 2023-12-03T11:49:42.999+0000 7f7ab3ab8640 10 monclient: get_auth_request con 0x7f79e8069820 auth_method 0 2023-12-03T11:49:43.072 INFO:tasks.workunit.client.0.smithi003.stderr: -36> 2023-12-03T11:49:43.000+0000 7f7ab7d21800 5 note: GC not initialized 2023-12-03T11:49:43.072 INFO:tasks.workunit.client.0.smithi003.stderr: -35> 2023-12-03T11:49:43.000+0000 7f79f0ff9640 20 reqs_thread_entry: start 2023-12-03T11:49:43.072 INFO:tasks.workunit.client.0.smithi003.stderr: -34> 2023-12-03T11:49:43.000+0000 7f7ab7d21800 5 asok(0x55afbf585a10) register_command sync trace show hook 0x7f7aac0047e0 2023-12-03T11:49:43.072 INFO:tasks.workunit.client.0.smithi003.stderr: -33> 2023-12-03T11:49:43.000+0000 7f7ab7d21800 5 asok(0x55afbf585a10) register_command sync trace history hook 0x7f7aac0047e0 2023-12-03T11:49:43.072 INFO:tasks.workunit.client.0.smithi003.stderr: -32> 2023-12-03T11:49:43.000+0000 7f7ab7d21800 5 asok(0x55afbf585a10) register_command sync trace active hook 0x7f7aac0047e0 2023-12-03T11:49:43.072 INFO:tasks.workunit.client.0.smithi003.stderr: -31> 2023-12-03T11:49:43.000+0000 7f7ab7d21800 5 asok(0x55afbf585a10) register_command sync trace active_short hook 0x7f7aac0047e0 2023-12-03T11:49:43.073 INFO:tasks.workunit.client.0.smithi003.stderr: -30> 2023-12-03T11:49:43.000+0000 7f7ab7d21800 20 init_complete bucket index max shards: 11 2023-12-03T11:49:43.073 INFO:tasks.workunit.client.0.smithi003.stderr: -29> 2023-12-03T11:49:43.000+0000 7f7ab7d21800 20 Filter name: none 2023-12-03T11:49:43.073 INFO:tasks.workunit.client.0.smithi003.stderr: -28> 2023-12-03T11:49:43.000+0000 7f79e67fc640 20 reqs_thread_entry: start 2023-12-03T11:49:43.073 INFO:tasks.workunit.client.0.smithi003.stderr: -27> 2023-12-03T11:49:43.000+0000 7f7ab7d21800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2023-12-03T11:49:43.073 INFO:tasks.workunit.client.0.smithi003.stderr: -26> 2023-12-03T11:49:43.000+0000 7f7ab7d21800 20 rados->read ofs=0 len=0 2023-12-03T11:49:43.073 INFO:tasks.workunit.client.0.smithi003.stderr: -25> 2023-12-03T11:49:43.000+0000 7f7ab7d21800 20 rados_obj.operate() r=0 bl.length=211 2023-12-03T11:49:43.073 INFO:tasks.workunit.client.0.smithi003.stderr: -24> 2023-12-03T11:49:43.000+0000 7f7ab7d21800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2023-12-03T11:49:43.073 INFO:tasks.workunit.client.0.smithi003.stderr: -23> 2023-12-03T11:49:43.000+0000 7f7ab7d21800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2023-12-03T11:49:43.073 INFO:tasks.workunit.client.0.smithi003.stderr: -22> 2023-12-03T11:49:43.000+0000 7f7ab7d21800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.28 : miss 2023-12-03T11:49:43.073 INFO:tasks.workunit.client.0.smithi003.stderr: -21> 2023-12-03T11:49:43.000+0000 7f7ab7d21800 20 rados->read ofs=0 len=0 2023-12-03T11:49:43.073 INFO:tasks.workunit.client.0.smithi003.stderr: -20> 2023-12-03T11:49:43.001+0000 7f7ab7d21800 20 rados_obj.operate() r=0 bl.length=383 2023-12-03T11:49:43.073 INFO:tasks.workunit.client.0.smithi003.stderr: -19> 2023-12-03T11:49:43.001+0000 7f7ab7d21800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.28 info.flags=0x17 2023-12-03T11:49:43.073 INFO:tasks.workunit.client.0.smithi003.stderr: -18> 2023-12-03T11:49:43.001+0000 7f7ab7d21800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.28 to cache LRU end 2023-12-03T11:49:43.073 INFO:tasks.workunit.client.0.smithi003.stderr: -17> 2023-12-03T11:49:43.001+0000 7f7ab7d21800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:49:43.073 INFO:tasks.workunit.client.0.smithi003.stderr: -16> 2023-12-03T11:49:43.001+0000 7f7ab7d21800 10 updating xattr: name=user.rgw.acl bl.length()=265 2023-12-03T11:49:43.073 INFO:tasks.workunit.client.0.smithi003.stderr: -15> 2023-12-03T11:49:43.001+0000 7f7ab7d21800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.28 2023-12-03T11:49:43.074 INFO:tasks.workunit.client.0.smithi003.stderr: -14> 2023-12-03T11:49:43.001+0000 7f7ab32b7640 10 monclient: get_auth_request con 0x55afbf871a10 auth_method 0 2023-12-03T11:49:43.074 INFO:tasks.workunit.client.0.smithi003.stderr: -13> 2023-12-03T11:49:43.007+0000 7f7ab7d21800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.28 info.flags=0x17 2023-12-03T11:49:43.074 INFO:tasks.workunit.client.0.smithi003.stderr: -12> 2023-12-03T11:49:43.007+0000 7f7ab7d21800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.28 to cache LRU end 2023-12-03T11:49:43.074 INFO:tasks.workunit.client.0.smithi003.stderr: -11> 2023-12-03T11:49:43.007+0000 7f7ab7d21800 10 updating xattr: name=user.rgw.acl bl.length()=265 2023-12-03T11:49:43.074 INFO:tasks.workunit.client.0.smithi003.stderr: -10> 2023-12-03T11:49:43.007+0000 7f7ab7d21800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.28, ofs0, ns] 2023-12-03T11:49:43.074 INFO:tasks.workunit.client.0.smithi003.stderr: -9> 2023-12-03T11:49:43.007+0000 7f7a99ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660506 cookie 94213320384208 notifier 7290 bl.length()=945 2023-12-03T11:49:43.074 INFO:tasks.workunit.client.0.smithi003.stderr: -8> 2023-12-03T11:49:43.007+0000 7f7a99ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.28 info.flags=0x17 2023-12-03T11:49:43.074 INFO:tasks.workunit.client.0.smithi003.stderr: -7> 2023-12-03T11:49:43.007+0000 7f7a99ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.28 to cache LRU end 2023-12-03T11:49:43.074 INFO:tasks.workunit.client.0.smithi003.stderr: -6> 2023-12-03T11:49:43.007+0000 7f7a99ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2023-12-03T11:49:43.074 INFO:tasks.workunit.client.0.smithi003.stderr: -5> 2023-12-03T11:49:43.009+0000 7f7ab7d21800 20 handle_bi_update(): bucket=:abort-at-do-reshard[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.28]): orig_sources= new_sources= 2023-12-03T11:49:43.074 INFO:tasks.workunit.client.0.smithi003.stderr: -4> 2023-12-03T11:49:43.009+0000 7f7ab7d21800 20 handle_bi_update(): bucket=:abort-at-do-reshard[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.28]): potential sources added=[] removed=[] 2023-12-03T11:49:43.074 INFO:tasks.workunit.client.0.smithi003.stderr: -3> 2023-12-03T11:49:43.009+0000 7f7ab7d21800 20 handle_bi_update(): bucket=:abort-at-do-reshard[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.28]): orig_dests= new_dests= 2023-12-03T11:49:43.074 INFO:tasks.workunit.client.0.smithi003.stderr: -2> 2023-12-03T11:49:43.009+0000 7f7ab7d21800 20 handle_bi_update(): bucket=:abort-at-do-reshard[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.28]): potential dests added=[] removed=[] 2023-12-03T11:49:43.074 INFO:tasks.workunit.client.0.smithi003.stderr: -1> 2023-12-03T11:49:43.012+0000 7f7ab7d21800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7537-gbcbf278c/rpm/el9/BUILD/ceph-18.0.0-7537-gbcbf278c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f7ab7d21800 time 2023-12-03T11:49:43.012468+0000 2023-12-03T11:49:43.075 INFO:tasks.workunit.client.0.smithi003.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7537-gbcbf278c/rpm/el9/BUILD/ceph-18.0.0-7537-gbcbf278c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2023-12-03T11:49:43.075 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:49:43.075 INFO:tasks.workunit.client.0.smithi003.stderr: ceph version 18.0.0-7537-gbcbf278c (bcbf278cf395873c2a482f5a7b2345faf2160319) reef (dev) 2023-12-03T11:49:43.075 INFO:tasks.workunit.client.0.smithi003.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f7aba96eef8] 2023-12-03T11:49:43.075 INFO:tasks.workunit.client.0.smithi003.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f0b6) [0x7f7aba96f0b6] 2023-12-03T11:49:43.075 INFO:tasks.workunit.client.0.smithi003.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55afbce67a71] 2023-12-03T11:49:43.075 INFO:tasks.workunit.client.0.smithi003.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x314) [0x55afbce73f34] 2023-12-03T11:49:43.075 INFO:tasks.workunit.client.0.smithi003.stderr: 5: main() 2023-12-03T11:49:43.075 INFO:tasks.workunit.client.0.smithi003.stderr: 6: /lib64/libc.so.6(+0x3feb0) [0x7f7ab823feb0] 2023-12-03T11:49:43.075 INFO:tasks.workunit.client.0.smithi003.stderr: 7: __libc_start_main() 2023-12-03T11:49:43.075 INFO:tasks.workunit.client.0.smithi003.stderr: 8: _start() 2023-12-03T11:49:43.075 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:49:43.075 INFO:tasks.workunit.client.0.smithi003.stderr: 0> 2023-12-03T11:49:43.012+0000 7f7ab7d21800 -1 *** Caught signal (Aborted) ** 2023-12-03T11:49:43.075 INFO:tasks.workunit.client.0.smithi003.stderr: in thread 7f7ab7d21800 thread_name:radosgw-admin 2023-12-03T11:49:43.075 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:49:43.076 INFO:tasks.workunit.client.0.smithi003.stderr: ceph version 18.0.0-7537-gbcbf278c (bcbf278cf395873c2a482f5a7b2345faf2160319) reef (dev) 2023-12-03T11:49:43.076 INFO:tasks.workunit.client.0.smithi003.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f7ab8254db0] 2023-12-03T11:49:43.076 INFO:tasks.workunit.client.0.smithi003.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f7ab82a154c] 2023-12-03T11:49:43.076 INFO:tasks.workunit.client.0.smithi003.stderr: 3: raise() 2023-12-03T11:49:43.076 INFO:tasks.workunit.client.0.smithi003.stderr: 4: abort() 2023-12-03T11:49:43.076 INFO:tasks.workunit.client.0.smithi003.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f7aba96ef52] 2023-12-03T11:49:43.076 INFO:tasks.workunit.client.0.smithi003.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f0b6) [0x7f7aba96f0b6] 2023-12-03T11:49:43.076 INFO:tasks.workunit.client.0.smithi003.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55afbce67a71] 2023-12-03T11:49:43.076 INFO:tasks.workunit.client.0.smithi003.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x314) [0x55afbce73f34] 2023-12-03T11:49:43.076 INFO:tasks.workunit.client.0.smithi003.stderr: 9: main() 2023-12-03T11:49:43.076 INFO:tasks.workunit.client.0.smithi003.stderr: 10: /lib64/libc.so.6(+0x3feb0) [0x7f7ab823feb0] 2023-12-03T11:49:43.076 INFO:tasks.workunit.client.0.smithi003.stderr: 11: __libc_start_main() 2023-12-03T11:49:43.076 INFO:tasks.workunit.client.0.smithi003.stderr: 12: _start() 2023-12-03T11:49:43.076 INFO:tasks.workunit.client.0.smithi003.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-12-03T11:49:43.077 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:49:43.077 INFO:tasks.workunit.client.0.smithi003.stderr:--- logging levels --- 2023-12-03T11:49:43.077 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 none 2023-12-03T11:49:43.077 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 1 lockdep 2023-12-03T11:49:43.077 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 1 context 2023-12-03T11:49:43.077 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 1 crush 2023-12-03T11:49:43.077 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 mds 2023-12-03T11:49:43.077 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 mds_balancer 2023-12-03T11:49:43.077 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 mds_locker 2023-12-03T11:49:43.077 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 mds_log 2023-12-03T11:49:43.077 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 mds_log_expire 2023-12-03T11:49:43.077 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 mds_migrator 2023-12-03T11:49:43.077 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 1 buffer 2023-12-03T11:49:43.077 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 1 timer 2023-12-03T11:49:43.077 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 1 filer 2023-12-03T11:49:43.078 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 1 striper 2023-12-03T11:49:43.078 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 1 objecter 2023-12-03T11:49:43.078 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 rados 2023-12-03T11:49:43.078 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 rbd 2023-12-03T11:49:43.078 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 rbd_mirror 2023-12-03T11:49:43.078 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 rbd_replay 2023-12-03T11:49:43.078 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 rbd_pwl 2023-12-03T11:49:43.078 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 journaler 2023-12-03T11:49:43.078 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 objectcacher 2023-12-03T11:49:43.078 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 immutable_obj_cache 2023-12-03T11:49:43.078 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 client 2023-12-03T11:49:43.078 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 osd 2023-12-03T11:49:43.078 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 optracker 2023-12-03T11:49:43.078 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 objclass 2023-12-03T11:49:43.078 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 3 filestore 2023-12-03T11:49:43.078 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 3 journal 2023-12-03T11:49:43.079 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 0 ms 2023-12-03T11:49:43.079 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 mon 2023-12-03T11:49:43.079 INFO:tasks.workunit.client.0.smithi003.stderr: 0/10 monc 2023-12-03T11:49:43.079 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 paxos 2023-12-03T11:49:43.079 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 tp 2023-12-03T11:49:43.079 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 auth 2023-12-03T11:49:43.079 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 crypto 2023-12-03T11:49:43.079 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 1 finisher 2023-12-03T11:49:43.079 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 1 reserver 2023-12-03T11:49:43.079 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 heartbeatmap 2023-12-03T11:49:43.079 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 perfcounter 2023-12-03T11:49:43.079 INFO:tasks.workunit.client.0.smithi003.stderr: 20/20 rgw 2023-12-03T11:49:43.079 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 rgw_sync 2023-12-03T11:49:43.079 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 rgw_datacache 2023-12-03T11:49:43.079 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 rgw_access 2023-12-03T11:49:43.080 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 rgw_dbstore 2023-12-03T11:49:43.080 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 rgw_flight 2023-12-03T11:49:43.080 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 javaclient 2023-12-03T11:49:43.080 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 asok 2023-12-03T11:49:43.080 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 1 throttle 2023-12-03T11:49:43.080 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 0 refs 2023-12-03T11:49:43.080 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 compressor 2023-12-03T11:49:43.080 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 bluestore 2023-12-03T11:49:43.080 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 bluefs 2023-12-03T11:49:43.080 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 3 bdev 2023-12-03T11:49:43.080 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 kstore 2023-12-03T11:49:43.080 INFO:tasks.workunit.client.0.smithi003.stderr: 4/ 5 rocksdb 2023-12-03T11:49:43.080 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 fuse 2023-12-03T11:49:43.080 INFO:tasks.workunit.client.0.smithi003.stderr: 2/ 5 mgr 2023-12-03T11:49:43.080 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 mgrc 2023-12-03T11:49:43.080 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 dpdk 2023-12-03T11:49:43.081 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 eventtrace 2023-12-03T11:49:43.081 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 prioritycache 2023-12-03T11:49:43.081 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 test 2023-12-03T11:49:43.081 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 cephfs_mirror 2023-12-03T11:49:43.081 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 cephsqlite 2023-12-03T11:49:43.081 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 crimson_interrupt 2023-12-03T11:49:43.081 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 seastore 2023-12-03T11:49:43.081 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 seastore_onode 2023-12-03T11:49:43.081 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 seastore_odata 2023-12-03T11:49:43.081 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 seastore_omap 2023-12-03T11:49:43.081 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 seastore_tm 2023-12-03T11:49:43.081 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 seastore_t 2023-12-03T11:49:43.081 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 seastore_cleaner 2023-12-03T11:49:43.081 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 seastore_epm 2023-12-03T11:49:43.081 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 seastore_lba 2023-12-03T11:49:43.081 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 seastore_fixedkv_tree 2023-12-03T11:49:43.082 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 seastore_cache 2023-12-03T11:49:43.082 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 seastore_journal 2023-12-03T11:49:43.082 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 seastore_device 2023-12-03T11:49:43.082 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 seastore_backref 2023-12-03T11:49:43.082 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 alienstore 2023-12-03T11:49:43.082 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 mclock 2023-12-03T11:49:43.082 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 cyanstore 2023-12-03T11:49:43.082 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 ceph_exporter 2023-12-03T11:49:43.082 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 memstore 2023-12-03T11:49:43.082 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 trace 2023-12-03T11:49:43.082 INFO:tasks.workunit.client.0.smithi003.stderr: -2/-2 (syslog threshold) 2023-12-03T11:49:43.082 INFO:tasks.workunit.client.0.smithi003.stderr: 99/99 (stderr threshold) 2023-12-03T11:49:43.082 INFO:tasks.workunit.client.0.smithi003.stderr:--- pthread ID / name mapping for recent threads --- 2023-12-03T11:49:43.082 INFO:tasks.workunit.client.0.smithi003.stderr: 7f79e67fc640 / http_manager 2023-12-03T11:49:43.082 INFO:tasks.workunit.client.0.smithi003.stderr: 7f79f0ff9640 / http_manager 2023-12-03T11:49:43.083 INFO:tasks.workunit.client.0.smithi003.stderr: 7f79f37fe640 / ms_dispatch 2023-12-03T11:49:43.083 INFO:tasks.workunit.client.0.smithi003.stderr: 7f7a797e2640 / io_context_pool 2023-12-03T11:49:43.083 INFO:tasks.workunit.client.0.smithi003.stderr: 7f7a79fe3640 / rgw_dt_lg_renew 2023-12-03T11:49:43.083 INFO:tasks.workunit.client.0.smithi003.stderr: 7f7a98ff9640 / ms_dispatch 2023-12-03T11:49:43.083 INFO:tasks.workunit.client.0.smithi003.stderr: 7f7a99ffb640 / io_context_pool 2023-12-03T11:49:43.083 INFO:tasks.workunit.client.0.smithi003.stderr: 7f7a9a7fc640 / io_context_pool 2023-12-03T11:49:43.083 INFO:tasks.workunit.client.0.smithi003.stderr: 7f7ab12b3640 / ms_dispatch 2023-12-03T11:49:43.083 INFO:tasks.workunit.client.0.smithi003.stderr: 7f7ab32b7640 / msgr-worker-2 2023-12-03T11:49:43.083 INFO:tasks.workunit.client.0.smithi003.stderr: 7f7ab3ab8640 / msgr-worker-1 2023-12-03T11:49:43.083 INFO:tasks.workunit.client.0.smithi003.stderr: 7f7ab42b9640 / msgr-worker-0 2023-12-03T11:49:43.083 INFO:tasks.workunit.client.0.smithi003.stderr: 7f7ab7d21800 / radosgw-admin 2023-12-03T11:49:43.083 INFO:tasks.workunit.client.0.smithi003.stderr: max_recent 500 2023-12-03T11:49:43.083 INFO:tasks.workunit.client.0.smithi003.stderr: max_new 1000 2023-12-03T11:49:43.083 INFO:tasks.workunit.client.0.smithi003.stderr: log_file /var/log/ceph/ceph-client.admin.105010.log 2023-12-03T11:49:43.083 INFO:tasks.workunit.client.0.smithi003.stderr:--- end dump of recent events --- 2023-12-03T11:49:43.083 INFO:tasks.workunit.client.0.smithi003.stderr:--- begin dump of recent events --- 2023-12-03T11:49:43.084 INFO:tasks.workunit.client.0.smithi003.stderr: -499> 2023-12-03T11:49:42.959+0000 7f7ab7d21800 10 monclient: _renew_subs 2023-12-03T11:49:43.084 INFO:tasks.workunit.client.0.smithi003.stderr: -498> 2023-12-03T11:49:42.959+0000 7f7ab7d21800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.3:3300/0 2023-12-03T11:49:43.084 INFO:tasks.workunit.client.0.smithi003.stderr: -497> 2023-12-03T11:49:42.959+0000 7f7ab7d21800 1 librados: init done 2023-12-03T11:49:43.084 INFO:tasks.workunit.client.0.smithi003.stderr: -496> 2023-12-03T11:49:42.959+0000 7f7ab7d21800 10 monclient: get_monmap_and_config 2023-12-03T11:49:43.084 INFO:tasks.workunit.client.0.smithi003.stderr: -495> 2023-12-03T11:49:42.959+0000 7f7ab7d21800 10 monclient: build_initial_monmap 2023-12-03T11:49:43.084 INFO:tasks.workunit.client.0.smithi003.stderr: -494> 2023-12-03T11:49:42.959+0000 7f7ab7d21800 1 build_initial for_mkfs: 0 2023-12-03T11:49:43.084 INFO:tasks.workunit.client.0.smithi003.stderr: -493> 2023-12-03T11:49:42.959+0000 7f7ab7d21800 10 monclient: monmap: 2023-12-03T11:49:43.084 INFO:tasks.workunit.client.0.smithi003.stderr:epoch 0 2023-12-03T11:49:43.084 INFO:tasks.workunit.client.0.smithi003.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-12-03T11:49:43.084 INFO:tasks.workunit.client.0.smithi003.stderr:last_changed 0.000000 2023-12-03T11:49:43.084 INFO:tasks.workunit.client.0.smithi003.stderr:created 0.000000 2023-12-03T11:49:43.084 INFO:tasks.workunit.client.0.smithi003.stderr:min_mon_release 0 (unknown) 2023-12-03T11:49:43.084 INFO:tasks.workunit.client.0.smithi003.stderr:election_strategy: 1 2023-12-03T11:49:43.084 INFO:tasks.workunit.client.0.smithi003.stderr:0: [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] mon.noname-a 2023-12-03T11:49:43.084 INFO:tasks.workunit.client.0.smithi003.stderr:1: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.noname-b 2023-12-03T11:49:43.085 INFO:tasks.workunit.client.0.smithi003.stderr:2: [v2:172.21.15.3:3301/0,v1:172.21.15.3:6790/0] mon.noname-c 2023-12-03T11:49:43.085 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:49:43.085 INFO:tasks.workunit.client.0.smithi003.stderr: -492> 2023-12-03T11:49:42.959+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf7905b0) adding auth protocol: cephx 2023-12-03T11:49:43.085 INFO:tasks.workunit.client.0.smithi003.stderr: -491> 2023-12-03T11:49:42.959+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf7905b0) adding auth protocol: cephx 2023-12-03T11:49:43.085 INFO:tasks.workunit.client.0.smithi003.stderr: -490> 2023-12-03T11:49:42.959+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf7905b0) adding auth protocol: cephx 2023-12-03T11:49:43.085 INFO:tasks.workunit.client.0.smithi003.stderr: -489> 2023-12-03T11:49:42.959+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf7905b0) adding con mode: secure 2023-12-03T11:49:43.085 INFO:tasks.workunit.client.0.smithi003.stderr: -488> 2023-12-03T11:49:42.959+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf7905b0) adding con mode: crc 2023-12-03T11:49:43.085 INFO:tasks.workunit.client.0.smithi003.stderr: -487> 2023-12-03T11:49:42.959+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf7905b0) adding con mode: secure 2023-12-03T11:49:43.085 INFO:tasks.workunit.client.0.smithi003.stderr: -486> 2023-12-03T11:49:42.959+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf7905b0) adding con mode: crc 2023-12-03T11:49:43.085 INFO:tasks.workunit.client.0.smithi003.stderr: -485> 2023-12-03T11:49:42.959+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf7905b0) adding con mode: secure 2023-12-03T11:49:43.085 INFO:tasks.workunit.client.0.smithi003.stderr: -484> 2023-12-03T11:49:42.959+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf7905b0) adding con mode: crc 2023-12-03T11:49:43.085 INFO:tasks.workunit.client.0.smithi003.stderr: -483> 2023-12-03T11:49:42.959+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf7905b0) adding con mode: crc 2023-12-03T11:49:43.085 INFO:tasks.workunit.client.0.smithi003.stderr: -482> 2023-12-03T11:49:42.959+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf7905b0) adding con mode: secure 2023-12-03T11:49:43.085 INFO:tasks.workunit.client.0.smithi003.stderr: -481> 2023-12-03T11:49:42.959+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf7905b0) adding con mode: crc 2023-12-03T11:49:43.085 INFO:tasks.workunit.client.0.smithi003.stderr: -480> 2023-12-03T11:49:42.959+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf7905b0) adding con mode: secure 2023-12-03T11:49:43.086 INFO:tasks.workunit.client.0.smithi003.stderr: -479> 2023-12-03T11:49:42.959+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf7905b0) adding con mode: crc 2023-12-03T11:49:43.086 INFO:tasks.workunit.client.0.smithi003.stderr: -478> 2023-12-03T11:49:42.959+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf7905b0) adding con mode: secure 2023-12-03T11:49:43.086 INFO:tasks.workunit.client.0.smithi003.stderr: -477> 2023-12-03T11:49:42.959+0000 7f7ab7d21800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:49:43.086 INFO:tasks.workunit.client.0.smithi003.stderr: -476> 2023-12-03T11:49:42.960+0000 7f7ab7d21800 10 monclient: init 2023-12-03T11:49:43.086 INFO:tasks.workunit.client.0.smithi003.stderr: -475> 2023-12-03T11:49:42.960+0000 7f7ab7d21800 5 AuthRegistry(0x7ffee04d5e70) adding auth protocol: cephx 2023-12-03T11:49:43.086 INFO:tasks.workunit.client.0.smithi003.stderr: -474> 2023-12-03T11:49:42.960+0000 7f7ab7d21800 5 AuthRegistry(0x7ffee04d5e70) adding auth protocol: cephx 2023-12-03T11:49:43.086 INFO:tasks.workunit.client.0.smithi003.stderr: -473> 2023-12-03T11:49:42.960+0000 7f7ab7d21800 5 AuthRegistry(0x7ffee04d5e70) adding auth protocol: cephx 2023-12-03T11:49:43.086 INFO:tasks.workunit.client.0.smithi003.stderr: -472> 2023-12-03T11:49:42.960+0000 7f7ab7d21800 5 AuthRegistry(0x7ffee04d5e70) adding con mode: secure 2023-12-03T11:49:43.086 INFO:tasks.workunit.client.0.smithi003.stderr: -471> 2023-12-03T11:49:42.960+0000 7f7ab7d21800 5 AuthRegistry(0x7ffee04d5e70) adding con mode: crc 2023-12-03T11:49:43.086 INFO:tasks.workunit.client.0.smithi003.stderr: -470> 2023-12-03T11:49:42.960+0000 7f7ab7d21800 5 AuthRegistry(0x7ffee04d5e70) adding con mode: secure 2023-12-03T11:49:43.086 INFO:tasks.workunit.client.0.smithi003.stderr: -469> 2023-12-03T11:49:42.960+0000 7f7ab7d21800 5 AuthRegistry(0x7ffee04d5e70) adding con mode: crc 2023-12-03T11:49:43.086 INFO:tasks.workunit.client.0.smithi003.stderr: -468> 2023-12-03T11:49:42.960+0000 7f7ab7d21800 5 AuthRegistry(0x7ffee04d5e70) adding con mode: secure 2023-12-03T11:49:43.086 INFO:tasks.workunit.client.0.smithi003.stderr: -467> 2023-12-03T11:49:42.960+0000 7f7ab7d21800 5 AuthRegistry(0x7ffee04d5e70) adding con mode: crc 2023-12-03T11:49:43.086 INFO:tasks.workunit.client.0.smithi003.stderr: -466> 2023-12-03T11:49:42.960+0000 7f7ab7d21800 5 AuthRegistry(0x7ffee04d5e70) adding con mode: crc 2023-12-03T11:49:43.086 INFO:tasks.workunit.client.0.smithi003.stderr: -465> 2023-12-03T11:49:42.960+0000 7f7ab7d21800 5 AuthRegistry(0x7ffee04d5e70) adding con mode: secure 2023-12-03T11:49:43.087 INFO:tasks.workunit.client.0.smithi003.stderr: -464> 2023-12-03T11:49:42.960+0000 7f7ab7d21800 5 AuthRegistry(0x7ffee04d5e70) adding con mode: crc 2023-12-03T11:49:43.087 INFO:tasks.workunit.client.0.smithi003.stderr: -463> 2023-12-03T11:49:42.960+0000 7f7ab7d21800 5 AuthRegistry(0x7ffee04d5e70) adding con mode: secure 2023-12-03T11:49:43.087 INFO:tasks.workunit.client.0.smithi003.stderr: -462> 2023-12-03T11:49:42.960+0000 7f7ab7d21800 5 AuthRegistry(0x7ffee04d5e70) adding con mode: crc 2023-12-03T11:49:43.087 INFO:tasks.workunit.client.0.smithi003.stderr: -461> 2023-12-03T11:49:42.960+0000 7f7ab7d21800 5 AuthRegistry(0x7ffee04d5e70) adding con mode: secure 2023-12-03T11:49:43.087 INFO:tasks.workunit.client.0.smithi003.stderr: -460> 2023-12-03T11:49:42.960+0000 7f7ab12b3640 4 mgrc handle_mgr_map Got map version 5 2023-12-03T11:49:43.087 INFO:tasks.workunit.client.0.smithi003.stderr: -459> 2023-12-03T11:49:42.960+0000 7f7ab12b3640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.37:6832/2165065416,v1:172.21.15.37:6833/2165065416] 2023-12-03T11:49:43.087 INFO:tasks.workunit.client.0.smithi003.stderr: -458> 2023-12-03T11:49:42.960+0000 7f7ab12b3640 4 mgrc reconnect Starting new session with [v2:172.21.15.37:6832/2165065416,v1:172.21.15.37:6833/2165065416] 2023-12-03T11:49:43.087 INFO:tasks.workunit.client.0.smithi003.stderr: -457> 2023-12-03T11:49:42.960+0000 7f7ab7d21800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:49:43.087 INFO:tasks.workunit.client.0.smithi003.stderr: -456> 2023-12-03T11:49:42.961+0000 7f7ab32b7640 10 monclient: get_auth_request con 0x7f7aa0069820 auth_method 0 2023-12-03T11:49:43.087 INFO:tasks.workunit.client.0.smithi003.stderr: -455> 2023-12-03T11:49:42.961+0000 7f7ab7d21800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:49:43.087 INFO:tasks.workunit.client.0.smithi003.stderr: -454> 2023-12-03T11:49:42.961+0000 7f7ab7d21800 5 asok(0x55afbf585a10) register_command rotate-key cmddesc rotate-key hook 0x7ffee04d5fb8 EEXIST 2023-12-03T11:49:43.087 INFO:tasks.workunit.client.0.smithi003.stderr: -453> 2023-12-03T11:49:42.961+0000 7f7ab7d21800 10 monclient: _reopen_session rank -1 2023-12-03T11:49:43.087 INFO:tasks.workunit.client.0.smithi003.stderr: -452> 2023-12-03T11:49:42.961+0000 7f7ab7d21800 10 monclient: _add_conns ranks=[0,2,1] 2023-12-03T11:49:43.087 INFO:tasks.workunit.client.0.smithi003.stderr: -451> 2023-12-03T11:49:42.961+0000 7f7ab7d21800 10 monclient(hunting): picked mon.noname-a con 0x55afbf7bf200 addr [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] 2023-12-03T11:49:43.087 INFO:tasks.workunit.client.0.smithi003.stderr: -450> 2023-12-03T11:49:42.961+0000 7f7ab7d21800 10 monclient(hunting): picked mon.noname-c con 0x55afbf7bf5e0 addr [v2:172.21.15.3:3301/0,v1:172.21.15.3:6790/0] 2023-12-03T11:49:43.088 INFO:tasks.workunit.client.0.smithi003.stderr: -449> 2023-12-03T11:49:42.961+0000 7f7ab7d21800 10 monclient(hunting): picked mon.noname-b con 0x55afbf7c1f90 addr [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] 2023-12-03T11:49:43.088 INFO:tasks.workunit.client.0.smithi003.stderr: -448> 2023-12-03T11:49:42.961+0000 7f7ab7d21800 10 monclient(hunting): start opening mon connection 2023-12-03T11:49:43.088 INFO:tasks.workunit.client.0.smithi003.stderr: -447> 2023-12-03T11:49:42.961+0000 7f7ab7d21800 10 monclient(hunting): start opening mon connection 2023-12-03T11:49:43.088 INFO:tasks.workunit.client.0.smithi003.stderr: -446> 2023-12-03T11:49:42.961+0000 7f7ab7d21800 10 monclient(hunting): start opening mon connection 2023-12-03T11:49:43.088 INFO:tasks.workunit.client.0.smithi003.stderr: -445> 2023-12-03T11:49:42.961+0000 7f7ab7d21800 10 monclient(hunting): _renew_subs 2023-12-03T11:49:43.088 INFO:tasks.workunit.client.0.smithi003.stderr: -444> 2023-12-03T11:49:42.961+0000 7f7ab7d21800 10 monclient(hunting): authenticate will time out at 1805.199456s 2023-12-03T11:49:43.088 INFO:tasks.workunit.client.0.smithi003.stderr: -443> 2023-12-03T11:49:42.961+0000 7f7ab3ab8640 10 monclient(hunting): get_auth_request con 0x55afbf7bf200 auth_method 0 2023-12-03T11:49:43.088 INFO:tasks.workunit.client.0.smithi003.stderr: -442> 2023-12-03T11:49:42.961+0000 7f7ab3ab8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:49:43.088 INFO:tasks.workunit.client.0.smithi003.stderr: -441> 2023-12-03T11:49:42.961+0000 7f7ab3ab8640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:49:43.088 INFO:tasks.workunit.client.0.smithi003.stderr: -440> 2023-12-03T11:49:42.961+0000 7f7ab3ab8640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:49:43.088 INFO:tasks.workunit.client.0.smithi003.stderr: -439> 2023-12-03T11:49:42.961+0000 7f7ab42b9640 10 monclient(hunting): get_auth_request con 0x55afbf7c1f90 auth_method 0 2023-12-03T11:49:43.088 INFO:tasks.workunit.client.0.smithi003.stderr: -438> 2023-12-03T11:49:42.961+0000 7f7ab42b9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:49:43.088 INFO:tasks.workunit.client.0.smithi003.stderr: -437> 2023-12-03T11:49:42.961+0000 7f7ab42b9640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:49:43.088 INFO:tasks.workunit.client.0.smithi003.stderr: -436> 2023-12-03T11:49:42.961+0000 7f7ab42b9640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:49:43.088 INFO:tasks.workunit.client.0.smithi003.stderr: -435> 2023-12-03T11:49:42.961+0000 7f7ab3ab8640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:49:43.089 INFO:tasks.workunit.client.0.smithi003.stderr: -434> 2023-12-03T11:49:42.961+0000 7f7ab3ab8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:49:43.089 INFO:tasks.workunit.client.0.smithi003.stderr: -433> 2023-12-03T11:49:42.961+0000 7f7ab3ab8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:49:43.089 INFO:tasks.workunit.client.0.smithi003.stderr: -432> 2023-12-03T11:49:42.961+0000 7f7ab32b7640 10 monclient(hunting): get_auth_request con 0x55afbf7bf5e0 auth_method 0 2023-12-03T11:49:43.089 INFO:tasks.workunit.client.0.smithi003.stderr: -431> 2023-12-03T11:49:42.961+0000 7f7ab32b7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:49:43.089 INFO:tasks.workunit.client.0.smithi003.stderr: -430> 2023-12-03T11:49:42.961+0000 7f7ab32b7640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:49:43.089 INFO:tasks.workunit.client.0.smithi003.stderr: -429> 2023-12-03T11:49:42.961+0000 7f7ab32b7640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:49:43.089 INFO:tasks.workunit.client.0.smithi003.stderr: -428> 2023-12-03T11:49:42.961+0000 7f7ab42b9640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:49:43.089 INFO:tasks.workunit.client.0.smithi003.stderr: -427> 2023-12-03T11:49:42.961+0000 7f7ab42b9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:49:43.089 INFO:tasks.workunit.client.0.smithi003.stderr: -426> 2023-12-03T11:49:42.961+0000 7f7ab42b9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:49:43.089 INFO:tasks.workunit.client.0.smithi003.stderr: -425> 2023-12-03T11:49:42.961+0000 7f7ab32b7640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:49:43.089 INFO:tasks.workunit.client.0.smithi003.stderr: -424> 2023-12-03T11:49:42.961+0000 7f7ab32b7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:49:43.089 INFO:tasks.workunit.client.0.smithi003.stderr: -423> 2023-12-03T11:49:42.961+0000 7f7ab32b7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:49:43.089 INFO:tasks.workunit.client.0.smithi003.stderr: -422> 2023-12-03T11:49:42.961+0000 7f7ab3ab8640 10 monclient(hunting): handle_auth_done global_id 7287 payload 274 2023-12-03T11:49:43.089 INFO:tasks.workunit.client.0.smithi003.stderr: -421> 2023-12-03T11:49:42.961+0000 7f7ab3ab8640 10 monclient: _finish_hunting 0 2023-12-03T11:49:43.089 INFO:tasks.workunit.client.0.smithi003.stderr: -420> 2023-12-03T11:49:42.961+0000 7f7ab3ab8640 1 monclient: found mon.noname-a 2023-12-03T11:49:43.089 INFO:tasks.workunit.client.0.smithi003.stderr: -419> 2023-12-03T11:49:42.961+0000 7f7ab3ab8640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.3:3300/0 2023-12-03T11:49:43.090 INFO:tasks.workunit.client.0.smithi003.stderr: -418> 2023-12-03T11:49:42.961+0000 7f7a9a7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:49:43.090 INFO:tasks.workunit.client.0.smithi003.stderr: -417> 2023-12-03T11:49:42.961+0000 7f7a9a7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-12-03T11:49:43.090 INFO:tasks.workunit.client.0.smithi003.stderr: -416> 2023-12-03T11:49:42.961+0000 7f7a9a7fc640 10 monclient: dump: 2023-12-03T11:49:43.090 INFO:tasks.workunit.client.0.smithi003.stderr:epoch 1 2023-12-03T11:49:43.090 INFO:tasks.workunit.client.0.smithi003.stderr:fsid 296556de-a4fc-4095-9b6d-0fe813c2865c 2023-12-03T11:49:43.090 INFO:tasks.workunit.client.0.smithi003.stderr:last_changed 2023-12-03T11:33:18.862564+0000 2023-12-03T11:49:43.090 INFO:tasks.workunit.client.0.smithi003.stderr:created 2023-12-03T11:33:18.862564+0000 2023-12-03T11:49:43.090 INFO:tasks.workunit.client.0.smithi003.stderr:min_mon_release 18 (reef) 2023-12-03T11:49:43.090 INFO:tasks.workunit.client.0.smithi003.stderr:election_strategy: 1 2023-12-03T11:49:43.090 INFO:tasks.workunit.client.0.smithi003.stderr:0: [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] mon.a 2023-12-03T11:49:43.090 INFO:tasks.workunit.client.0.smithi003.stderr:1: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.b 2023-12-03T11:49:43.090 INFO:tasks.workunit.client.0.smithi003.stderr:2: [v2:172.21.15.3:3301/0,v1:172.21.15.3:6790/0] mon.c 2023-12-03T11:49:43.090 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:49:43.090 INFO:tasks.workunit.client.0.smithi003.stderr: -415> 2023-12-03T11:49:42.961+0000 7f7a9a7fc640 10 monclient: _finish_auth 0 2023-12-03T11:49:43.090 INFO:tasks.workunit.client.0.smithi003.stderr: -414> 2023-12-03T11:49:42.961+0000 7f7a9a7fc640 10 monclient: _check_auth_tickets 2023-12-03T11:49:43.091 INFO:tasks.workunit.client.0.smithi003.stderr: -413> 2023-12-03T11:49:42.961+0000 7f7a9a7fc640 10 monclient: handle_config config(0 keys) v1 2023-12-03T11:49:43.091 INFO:tasks.workunit.client.0.smithi003.stderr: -412> 2023-12-03T11:49:42.961+0000 7f7ab7d21800 5 monclient: authenticate success, global_id 7287 2023-12-03T11:49:43.091 INFO:tasks.workunit.client.0.smithi003.stderr: -411> 2023-12-03T11:49:42.961+0000 7f7ab7d21800 10 monclient: get_monmap_and_config success 2023-12-03T11:49:43.091 INFO:tasks.workunit.client.0.smithi003.stderr: -410> 2023-12-03T11:49:42.961+0000 7f7ab7d21800 4 set_mon_vals no callback set 2023-12-03T11:49:43.091 INFO:tasks.workunit.client.0.smithi003.stderr: -409> 2023-12-03T11:49:42.961+0000 7f7a9a7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:49:43.091 INFO:tasks.workunit.client.0.smithi003.stderr: -408> 2023-12-03T11:49:42.961+0000 7f7a9a7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-12-03T11:49:43.091 INFO:tasks.workunit.client.0.smithi003.stderr: -407> 2023-12-03T11:49:42.961+0000 7f7a9a7fc640 10 monclient: dump: 2023-12-03T11:49:43.091 INFO:tasks.workunit.client.0.smithi003.stderr:epoch 1 2023-12-03T11:49:43.091 INFO:tasks.workunit.client.0.smithi003.stderr:fsid 296556de-a4fc-4095-9b6d-0fe813c2865c 2023-12-03T11:49:43.091 INFO:tasks.workunit.client.0.smithi003.stderr:last_changed 2023-12-03T11:33:18.862564+0000 2023-12-03T11:49:43.091 INFO:tasks.workunit.client.0.smithi003.stderr:created 2023-12-03T11:33:18.862564+0000 2023-12-03T11:49:43.091 INFO:tasks.workunit.client.0.smithi003.stderr:min_mon_release 18 (reef) 2023-12-03T11:49:43.091 INFO:tasks.workunit.client.0.smithi003.stderr:election_strategy: 1 2023-12-03T11:49:43.091 INFO:tasks.workunit.client.0.smithi003.stderr:0: [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] mon.a 2023-12-03T11:49:43.091 INFO:tasks.workunit.client.0.smithi003.stderr:1: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.b 2023-12-03T11:49:43.092 INFO:tasks.workunit.client.0.smithi003.stderr:2: [v2:172.21.15.3:3301/0,v1:172.21.15.3:6790/0] mon.c 2023-12-03T11:49:43.092 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:49:43.092 INFO:tasks.workunit.client.0.smithi003.stderr: -406> 2023-12-03T11:49:42.962+0000 7f7ab7d21800 10 monclient: shutdown 2023-12-03T11:49:43.092 INFO:tasks.workunit.client.0.smithi003.stderr: -405> 2023-12-03T11:49:42.962+0000 7f7ab7d21800 10 monclient: build_initial_monmap 2023-12-03T11:49:43.092 INFO:tasks.workunit.client.0.smithi003.stderr: -404> 2023-12-03T11:49:42.962+0000 7f7ab7d21800 1 build_initial for_mkfs: 0 2023-12-03T11:49:43.092 INFO:tasks.workunit.client.0.smithi003.stderr: -403> 2023-12-03T11:49:42.962+0000 7f7ab7d21800 10 monclient: monmap: 2023-12-03T11:49:43.092 INFO:tasks.workunit.client.0.smithi003.stderr:epoch 0 2023-12-03T11:49:43.092 INFO:tasks.workunit.client.0.smithi003.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-12-03T11:49:43.092 INFO:tasks.workunit.client.0.smithi003.stderr:last_changed 0.000000 2023-12-03T11:49:43.092 INFO:tasks.workunit.client.0.smithi003.stderr:created 0.000000 2023-12-03T11:49:43.092 INFO:tasks.workunit.client.0.smithi003.stderr:min_mon_release 0 (unknown) 2023-12-03T11:49:43.092 INFO:tasks.workunit.client.0.smithi003.stderr:election_strategy: 1 2023-12-03T11:49:43.092 INFO:tasks.workunit.client.0.smithi003.stderr:0: [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] mon.noname-a 2023-12-03T11:49:43.092 INFO:tasks.workunit.client.0.smithi003.stderr:1: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.noname-b 2023-12-03T11:49:43.092 INFO:tasks.workunit.client.0.smithi003.stderr:2: [v2:172.21.15.3:3301/0,v1:172.21.15.3:6790/0] mon.noname-c 2023-12-03T11:49:43.092 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:49:43.093 INFO:tasks.workunit.client.0.smithi003.stderr: -402> 2023-12-03T11:49:42.962+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf790480) adding auth protocol: cephx 2023-12-03T11:49:43.093 INFO:tasks.workunit.client.0.smithi003.stderr: -401> 2023-12-03T11:49:42.962+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf790480) adding auth protocol: cephx 2023-12-03T11:49:43.093 INFO:tasks.workunit.client.0.smithi003.stderr: -400> 2023-12-03T11:49:42.962+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf790480) adding auth protocol: cephx 2023-12-03T11:49:43.093 INFO:tasks.workunit.client.0.smithi003.stderr: -399> 2023-12-03T11:49:42.962+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf790480) adding con mode: secure 2023-12-03T11:49:43.093 INFO:tasks.workunit.client.0.smithi003.stderr: -398> 2023-12-03T11:49:42.962+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf790480) adding con mode: crc 2023-12-03T11:49:43.093 INFO:tasks.workunit.client.0.smithi003.stderr: -397> 2023-12-03T11:49:42.962+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf790480) adding con mode: secure 2023-12-03T11:49:43.093 INFO:tasks.workunit.client.0.smithi003.stderr: -396> 2023-12-03T11:49:42.962+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf790480) adding con mode: crc 2023-12-03T11:49:43.093 INFO:tasks.workunit.client.0.smithi003.stderr: -395> 2023-12-03T11:49:42.962+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf790480) adding con mode: secure 2023-12-03T11:49:43.093 INFO:tasks.workunit.client.0.smithi003.stderr: -394> 2023-12-03T11:49:42.962+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf790480) adding con mode: crc 2023-12-03T11:49:43.093 INFO:tasks.workunit.client.0.smithi003.stderr: -393> 2023-12-03T11:49:42.962+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf790480) adding con mode: crc 2023-12-03T11:49:43.093 INFO:tasks.workunit.client.0.smithi003.stderr: -392> 2023-12-03T11:49:42.962+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf790480) adding con mode: secure 2023-12-03T11:49:43.093 INFO:tasks.workunit.client.0.smithi003.stderr: -391> 2023-12-03T11:49:42.962+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf790480) adding con mode: crc 2023-12-03T11:49:43.093 INFO:tasks.workunit.client.0.smithi003.stderr: -390> 2023-12-03T11:49:42.962+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf790480) adding con mode: secure 2023-12-03T11:49:43.093 INFO:tasks.workunit.client.0.smithi003.stderr: -389> 2023-12-03T11:49:42.962+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf790480) adding con mode: crc 2023-12-03T11:49:43.094 INFO:tasks.workunit.client.0.smithi003.stderr: -388> 2023-12-03T11:49:42.962+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf790480) adding con mode: secure 2023-12-03T11:49:43.094 INFO:tasks.workunit.client.0.smithi003.stderr: -387> 2023-12-03T11:49:42.962+0000 7f7ab7d21800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:49:43.094 INFO:tasks.workunit.client.0.smithi003.stderr: -386> 2023-12-03T11:49:42.962+0000 7f7ab7d21800 1 librados: starting msgr at 2023-12-03T11:49:43.094 INFO:tasks.workunit.client.0.smithi003.stderr: -385> 2023-12-03T11:49:42.962+0000 7f7ab7d21800 1 librados: starting objecter 2023-12-03T11:49:43.094 INFO:tasks.workunit.client.0.smithi003.stderr: -384> 2023-12-03T11:49:42.962+0000 7f7ab7d21800 5 asok(0x55afbf585a10) register_command objecter_requests cmddesc objecter_requests hook 0x55afbf7c2370 EEXIST 2023-12-03T11:49:43.094 INFO:tasks.workunit.client.0.smithi003.stderr: -383> 2023-12-03T11:49:42.962+0000 7f7ab7d21800 1 librados: setting wanted keys 2023-12-03T11:49:43.094 INFO:tasks.workunit.client.0.smithi003.stderr: -382> 2023-12-03T11:49:42.962+0000 7f7ab7d21800 1 librados: calling monclient init 2023-12-03T11:49:43.094 INFO:tasks.workunit.client.0.smithi003.stderr: -381> 2023-12-03T11:49:42.962+0000 7f7ab7d21800 10 monclient: init 2023-12-03T11:49:43.094 INFO:tasks.workunit.client.0.smithi003.stderr: -380> 2023-12-03T11:49:42.962+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf78e9b8) adding auth protocol: cephx 2023-12-03T11:49:43.094 INFO:tasks.workunit.client.0.smithi003.stderr: -379> 2023-12-03T11:49:42.962+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf78e9b8) adding auth protocol: cephx 2023-12-03T11:49:43.094 INFO:tasks.workunit.client.0.smithi003.stderr: -378> 2023-12-03T11:49:42.962+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf78e9b8) adding auth protocol: cephx 2023-12-03T11:49:43.094 INFO:tasks.workunit.client.0.smithi003.stderr: -377> 2023-12-03T11:49:42.962+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf78e9b8) adding con mode: secure 2023-12-03T11:49:43.094 INFO:tasks.workunit.client.0.smithi003.stderr: -376> 2023-12-03T11:49:42.962+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf78e9b8) adding con mode: crc 2023-12-03T11:49:43.094 INFO:tasks.workunit.client.0.smithi003.stderr: -375> 2023-12-03T11:49:42.962+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf78e9b8) adding con mode: secure 2023-12-03T11:49:43.094 INFO:tasks.workunit.client.0.smithi003.stderr: -374> 2023-12-03T11:49:42.962+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf78e9b8) adding con mode: crc 2023-12-03T11:49:43.095 INFO:tasks.workunit.client.0.smithi003.stderr: -373> 2023-12-03T11:49:42.962+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf78e9b8) adding con mode: secure 2023-12-03T11:49:43.095 INFO:tasks.workunit.client.0.smithi003.stderr: -372> 2023-12-03T11:49:42.962+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf78e9b8) adding con mode: crc 2023-12-03T11:49:43.095 INFO:tasks.workunit.client.0.smithi003.stderr: -371> 2023-12-03T11:49:42.962+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf78e9b8) adding con mode: crc 2023-12-03T11:49:43.095 INFO:tasks.workunit.client.0.smithi003.stderr: -370> 2023-12-03T11:49:42.962+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf78e9b8) adding con mode: secure 2023-12-03T11:49:43.095 INFO:tasks.workunit.client.0.smithi003.stderr: -369> 2023-12-03T11:49:42.962+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf78e9b8) adding con mode: crc 2023-12-03T11:49:43.095 INFO:tasks.workunit.client.0.smithi003.stderr: -368> 2023-12-03T11:49:42.962+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf78e9b8) adding con mode: secure 2023-12-03T11:49:43.095 INFO:tasks.workunit.client.0.smithi003.stderr: -367> 2023-12-03T11:49:42.962+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf78e9b8) adding con mode: crc 2023-12-03T11:49:43.095 INFO:tasks.workunit.client.0.smithi003.stderr: -366> 2023-12-03T11:49:42.962+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf78e9b8) adding con mode: secure 2023-12-03T11:49:43.095 INFO:tasks.workunit.client.0.smithi003.stderr: -365> 2023-12-03T11:49:42.963+0000 7f7ab7d21800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:49:43.095 INFO:tasks.workunit.client.0.smithi003.stderr: -364> 2023-12-03T11:49:42.963+0000 7f7ab7d21800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:49:43.095 INFO:tasks.workunit.client.0.smithi003.stderr: -363> 2023-12-03T11:49:42.963+0000 7f7ab7d21800 5 asok(0x55afbf585a10) register_command rotate-key cmddesc rotate-key hook 0x55afbf78eb00 EEXIST 2023-12-03T11:49:43.095 INFO:tasks.workunit.client.0.smithi003.stderr: -362> 2023-12-03T11:49:42.963+0000 7f7ab7d21800 10 monclient: _reopen_session rank -1 2023-12-03T11:49:43.095 INFO:tasks.workunit.client.0.smithi003.stderr: -361> 2023-12-03T11:49:42.963+0000 7f7ab7d21800 10 monclient: _add_conns ranks=[2,0,1] 2023-12-03T11:49:43.095 INFO:tasks.workunit.client.0.smithi003.stderr: -360> 2023-12-03T11:49:42.963+0000 7f7ab7d21800 10 monclient(hunting): picked mon.noname-c con 0x55afbf7bf200 addr [v2:172.21.15.3:3301/0,v1:172.21.15.3:6790/0] 2023-12-03T11:49:43.095 INFO:tasks.workunit.client.0.smithi003.stderr: -359> 2023-12-03T11:49:42.963+0000 7f7ab7d21800 10 monclient(hunting): picked mon.noname-a con 0x55afbf7c1f90 addr [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] 2023-12-03T11:49:43.096 INFO:tasks.workunit.client.0.smithi003.stderr: -358> 2023-12-03T11:49:42.963+0000 7f7ab7d21800 10 monclient(hunting): picked mon.noname-b con 0x55afbf7b4b20 addr [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] 2023-12-03T11:49:43.096 INFO:tasks.workunit.client.0.smithi003.stderr: -357> 2023-12-03T11:49:42.963+0000 7f7ab7d21800 10 monclient(hunting): start opening mon connection 2023-12-03T11:49:43.096 INFO:tasks.workunit.client.0.smithi003.stderr: -356> 2023-12-03T11:49:42.963+0000 7f7ab7d21800 10 monclient(hunting): start opening mon connection 2023-12-03T11:49:43.096 INFO:tasks.workunit.client.0.smithi003.stderr: -355> 2023-12-03T11:49:42.963+0000 7f7ab7d21800 10 monclient(hunting): start opening mon connection 2023-12-03T11:49:43.096 INFO:tasks.workunit.client.0.smithi003.stderr: -354> 2023-12-03T11:49:42.963+0000 7f7ab7d21800 10 monclient(hunting): _renew_subs 2023-12-03T11:49:43.096 INFO:tasks.workunit.client.0.smithi003.stderr: -353> 2023-12-03T11:49:42.963+0000 7f7ab7d21800 10 monclient(hunting): authenticate will time out at 1805.201628s 2023-12-03T11:49:43.096 INFO:tasks.workunit.client.0.smithi003.stderr: -352> 2023-12-03T11:49:42.963+0000 7f7ab32b7640 10 monclient(hunting): get_auth_request con 0x55afbf7c1f90 auth_method 0 2023-12-03T11:49:43.096 INFO:tasks.workunit.client.0.smithi003.stderr: -351> 2023-12-03T11:49:42.963+0000 7f7ab32b7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:49:43.096 INFO:tasks.workunit.client.0.smithi003.stderr: -350> 2023-12-03T11:49:42.963+0000 7f7ab32b7640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:49:43.096 INFO:tasks.workunit.client.0.smithi003.stderr: -349> 2023-12-03T11:49:42.963+0000 7f7ab32b7640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:49:43.096 INFO:tasks.workunit.client.0.smithi003.stderr: -348> 2023-12-03T11:49:42.963+0000 7f7ab3ab8640 10 monclient(hunting): get_auth_request con 0x55afbf7bf200 auth_method 0 2023-12-03T11:49:43.096 INFO:tasks.workunit.client.0.smithi003.stderr: -347> 2023-12-03T11:49:42.963+0000 7f7ab3ab8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:49:43.096 INFO:tasks.workunit.client.0.smithi003.stderr: -346> 2023-12-03T11:49:42.963+0000 7f7ab3ab8640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:49:43.096 INFO:tasks.workunit.client.0.smithi003.stderr: -345> 2023-12-03T11:49:42.963+0000 7f7ab3ab8640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:49:43.096 INFO:tasks.workunit.client.0.smithi003.stderr: -344> 2023-12-03T11:49:42.963+0000 7f7ab32b7640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:49:43.096 INFO:tasks.workunit.client.0.smithi003.stderr: -343> 2023-12-03T11:49:42.963+0000 7f7ab32b7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:49:43.097 INFO:tasks.workunit.client.0.smithi003.stderr: -342> 2023-12-03T11:49:42.963+0000 7f7ab32b7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:49:43.097 INFO:tasks.workunit.client.0.smithi003.stderr: -341> 2023-12-03T11:49:42.963+0000 7f7ab3ab8640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:49:43.097 INFO:tasks.workunit.client.0.smithi003.stderr: -340> 2023-12-03T11:49:42.963+0000 7f7ab3ab8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:49:43.097 INFO:tasks.workunit.client.0.smithi003.stderr: -339> 2023-12-03T11:49:42.963+0000 7f7ab3ab8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:49:43.097 INFO:tasks.workunit.client.0.smithi003.stderr: -338> 2023-12-03T11:49:42.963+0000 7f7ab42b9640 10 monclient(hunting): get_auth_request con 0x55afbf7b4b20 auth_method 0 2023-12-03T11:49:43.097 INFO:tasks.workunit.client.0.smithi003.stderr: -337> 2023-12-03T11:49:42.963+0000 7f7ab42b9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:49:43.097 INFO:tasks.workunit.client.0.smithi003.stderr: -336> 2023-12-03T11:49:42.963+0000 7f7ab42b9640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:49:43.097 INFO:tasks.workunit.client.0.smithi003.stderr: -335> 2023-12-03T11:49:42.963+0000 7f7ab42b9640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:49:43.097 INFO:tasks.workunit.client.0.smithi003.stderr: -334> 2023-12-03T11:49:42.963+0000 7f7ab42b9640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:49:43.097 INFO:tasks.workunit.client.0.smithi003.stderr: -333> 2023-12-03T11:49:42.963+0000 7f7ab42b9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:49:43.097 INFO:tasks.workunit.client.0.smithi003.stderr: -332> 2023-12-03T11:49:42.963+0000 7f7ab42b9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:49:43.097 INFO:tasks.workunit.client.0.smithi003.stderr: -331> 2023-12-03T11:49:42.963+0000 7f7ab32b7640 10 monclient(hunting): handle_auth_done global_id 7290 payload 824 2023-12-03T11:49:43.097 INFO:tasks.workunit.client.0.smithi003.stderr: -330> 2023-12-03T11:49:42.963+0000 7f7ab32b7640 10 monclient: _finish_hunting 0 2023-12-03T11:49:43.097 INFO:tasks.workunit.client.0.smithi003.stderr: -329> 2023-12-03T11:49:42.963+0000 7f7ab32b7640 1 monclient: found mon.noname-a 2023-12-03T11:49:43.097 INFO:tasks.workunit.client.0.smithi003.stderr: -328> 2023-12-03T11:49:42.963+0000 7f7ab32b7640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.3:3300/0 2023-12-03T11:49:43.098 INFO:tasks.workunit.client.0.smithi003.stderr: -327> 2023-12-03T11:49:42.963+0000 7f7a98ff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:49:43.098 INFO:tasks.workunit.client.0.smithi003.stderr: -326> 2023-12-03T11:49:42.963+0000 7f7a98ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-12-03T11:49:43.098 INFO:tasks.workunit.client.0.smithi003.stderr: -325> 2023-12-03T11:49:42.963+0000 7f7a98ff9640 10 monclient: dump: 2023-12-03T11:49:43.098 INFO:tasks.workunit.client.0.smithi003.stderr:epoch 1 2023-12-03T11:49:43.098 INFO:tasks.workunit.client.0.smithi003.stderr:fsid 296556de-a4fc-4095-9b6d-0fe813c2865c 2023-12-03T11:49:43.098 INFO:tasks.workunit.client.0.smithi003.stderr:last_changed 2023-12-03T11:33:18.862564+0000 2023-12-03T11:49:43.098 INFO:tasks.workunit.client.0.smithi003.stderr:created 2023-12-03T11:33:18.862564+0000 2023-12-03T11:49:43.098 INFO:tasks.workunit.client.0.smithi003.stderr:min_mon_release 18 (reef) 2023-12-03T11:49:43.098 INFO:tasks.workunit.client.0.smithi003.stderr:election_strategy: 1 2023-12-03T11:49:43.098 INFO:tasks.workunit.client.0.smithi003.stderr:0: [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] mon.a 2023-12-03T11:49:43.098 INFO:tasks.workunit.client.0.smithi003.stderr:1: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.b 2023-12-03T11:49:43.098 INFO:tasks.workunit.client.0.smithi003.stderr:2: [v2:172.21.15.3:3301/0,v1:172.21.15.3:6790/0] mon.c 2023-12-03T11:49:43.098 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:49:43.098 INFO:tasks.workunit.client.0.smithi003.stderr: -324> 2023-12-03T11:49:42.963+0000 7f7a98ff9640 10 monclient: _finish_auth 0 2023-12-03T11:49:43.098 INFO:tasks.workunit.client.0.smithi003.stderr: -323> 2023-12-03T11:49:42.963+0000 7f7a98ff9640 10 monclient: _check_auth_tickets 2023-12-03T11:49:43.099 INFO:tasks.workunit.client.0.smithi003.stderr: -322> 2023-12-03T11:49:42.963+0000 7f7a98ff9640 10 monclient: handle_config config(0 keys) v1 2023-12-03T11:49:43.099 INFO:tasks.workunit.client.0.smithi003.stderr: -321> 2023-12-03T11:49:42.963+0000 7f7a98ff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:49:43.099 INFO:tasks.workunit.client.0.smithi003.stderr: -320> 2023-12-03T11:49:42.963+0000 7f7a98ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-12-03T11:49:43.099 INFO:tasks.workunit.client.0.smithi003.stderr: -319> 2023-12-03T11:49:42.963+0000 7f7a98ff9640 10 monclient: dump: 2023-12-03T11:49:43.099 INFO:tasks.workunit.client.0.smithi003.stderr:epoch 1 2023-12-03T11:49:43.099 INFO:tasks.workunit.client.0.smithi003.stderr:fsid 296556de-a4fc-4095-9b6d-0fe813c2865c 2023-12-03T11:49:43.099 INFO:tasks.workunit.client.0.smithi003.stderr:last_changed 2023-12-03T11:33:18.862564+0000 2023-12-03T11:49:43.099 INFO:tasks.workunit.client.0.smithi003.stderr:created 2023-12-03T11:33:18.862564+0000 2023-12-03T11:49:43.099 INFO:tasks.workunit.client.0.smithi003.stderr:min_mon_release 18 (reef) 2023-12-03T11:49:43.099 INFO:tasks.workunit.client.0.smithi003.stderr:election_strategy: 1 2023-12-03T11:49:43.099 INFO:tasks.workunit.client.0.smithi003.stderr:0: [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] mon.a 2023-12-03T11:49:43.099 INFO:tasks.workunit.client.0.smithi003.stderr:1: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.b 2023-12-03T11:49:43.099 INFO:tasks.workunit.client.0.smithi003.stderr:2: [v2:172.21.15.3:3301/0,v1:172.21.15.3:6790/0] mon.c 2023-12-03T11:49:43.099 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:49:43.099 INFO:tasks.workunit.client.0.smithi003.stderr: -318> 2023-12-03T11:49:42.963+0000 7f7ab7d21800 5 monclient: authenticate success, global_id 7290 2023-12-03T11:49:43.100 INFO:tasks.workunit.client.0.smithi003.stderr: -317> 2023-12-03T11:49:42.963+0000 7f7a9a7fc640 4 set_mon_vals no callback set 2023-12-03T11:49:43.100 INFO:tasks.workunit.client.0.smithi003.stderr: -316> 2023-12-03T11:49:42.963+0000 7f7ab7d21800 10 monclient: _renew_subs 2023-12-03T11:49:43.100 INFO:tasks.workunit.client.0.smithi003.stderr: -315> 2023-12-03T11:49:42.964+0000 7f7ab7d21800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.3:3300/0 2023-12-03T11:49:43.100 INFO:tasks.workunit.client.0.smithi003.stderr: -314> 2023-12-03T11:49:42.964+0000 7f7ab7d21800 10 monclient: _renew_subs 2023-12-03T11:49:43.100 INFO:tasks.workunit.client.0.smithi003.stderr: -313> 2023-12-03T11:49:42.964+0000 7f7ab7d21800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.3:3300/0 2023-12-03T11:49:43.100 INFO:tasks.workunit.client.0.smithi003.stderr: -312> 2023-12-03T11:49:42.964+0000 7f7ab7d21800 1 librados: init done 2023-12-03T11:49:43.100 INFO:tasks.workunit.client.0.smithi003.stderr: -311> 2023-12-03T11:49:42.965+0000 7f7ab7d21800 20 rados->read ofs=0 len=0 2023-12-03T11:49:43.100 INFO:tasks.workunit.client.0.smithi003.stderr: -310> 2023-12-03T11:49:42.966+0000 7f7a98ff9640 4 mgrc handle_mgr_map Got map version 5 2023-12-03T11:49:43.100 INFO:tasks.workunit.client.0.smithi003.stderr: -309> 2023-12-03T11:49:42.966+0000 7f7a98ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.37:6832/2165065416,v1:172.21.15.37:6833/2165065416] 2023-12-03T11:49:43.100 INFO:tasks.workunit.client.0.smithi003.stderr: -308> 2023-12-03T11:49:42.966+0000 7f7a98ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.37:6832/2165065416,v1:172.21.15.37:6833/2165065416] 2023-12-03T11:49:43.100 INFO:tasks.workunit.client.0.smithi003.stderr: -307> 2023-12-03T11:49:42.966+0000 7f7ab3ab8640 10 monclient: get_auth_request con 0x7f7a8c069820 auth_method 0 2023-12-03T11:49:43.100 INFO:tasks.workunit.client.0.smithi003.stderr: -306> 2023-12-03T11:49:42.966+0000 7f7ab42b9640 10 monclient: get_auth_request con 0x55afbf7dd540 auth_method 0 2023-12-03T11:49:43.100 INFO:tasks.workunit.client.0.smithi003.stderr: -305> 2023-12-03T11:49:42.966+0000 7f7ab7d21800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:43.100 INFO:tasks.workunit.client.0.smithi003.stderr: -304> 2023-12-03T11:49:42.966+0000 7f7ab7d21800 20 realm 2023-12-03T11:49:43.100 INFO:tasks.workunit.client.0.smithi003.stderr: -303> 2023-12-03T11:49:42.966+0000 7f7ab7d21800 20 rados->read ofs=0 len=0 2023-12-03T11:49:43.100 INFO:tasks.workunit.client.0.smithi003.stderr: -302> 2023-12-03T11:49:42.967+0000 7f7ab7d21800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:43.101 INFO:tasks.workunit.client.0.smithi003.stderr: -301> 2023-12-03T11:49:42.967+0000 7f7ab7d21800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:49:43.101 INFO:tasks.workunit.client.0.smithi003.stderr: -300> 2023-12-03T11:49:42.967+0000 7f7ab7d21800 20 rados->read ofs=0 len=0 2023-12-03T11:49:43.101 INFO:tasks.workunit.client.0.smithi003.stderr: -299> 2023-12-03T11:49:42.967+0000 7f7ab7d21800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:43.101 INFO:tasks.workunit.client.0.smithi003.stderr: -298> 2023-12-03T11:49:42.967+0000 7f7ab7d21800 20 rados->read ofs=0 len=0 2023-12-03T11:49:43.101 INFO:tasks.workunit.client.0.smithi003.stderr: -297> 2023-12-03T11:49:42.967+0000 7f7ab3ab8640 10 monclient: get_auth_request con 0x55afbf7e13b0 auth_method 0 2023-12-03T11:49:43.101 INFO:tasks.workunit.client.0.smithi003.stderr: -296> 2023-12-03T11:49:42.968+0000 7f7ab7d21800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:49:43.101 INFO:tasks.workunit.client.0.smithi003.stderr: -295> 2023-12-03T11:49:42.968+0000 7f7ab7d21800 20 rados->read ofs=0 len=0 2023-12-03T11:49:43.101 INFO:tasks.workunit.client.0.smithi003.stderr: -294> 2023-12-03T11:49:42.968+0000 7f7ab7d21800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:49:43.101 INFO:tasks.workunit.client.0.smithi003.stderr: -293> 2023-12-03T11:49:42.968+0000 7f7ab7d21800 20 searching for the correct realm 2023-12-03T11:49:43.101 INFO:tasks.workunit.client.0.smithi003.stderr: -292> 2023-12-03T11:49:42.968+0000 7f7ab32b7640 10 monclient: get_auth_request con 0x55afbf7e63b0 auth_method 0 2023-12-03T11:49:43.101 INFO:tasks.workunit.client.0.smithi003.stderr: -291> 2023-12-03T11:49:42.969+0000 7f7ab42b9640 10 monclient: get_auth_request con 0x7f7aa802c020 auth_method 0 2023-12-03T11:49:43.101 INFO:tasks.workunit.client.0.smithi003.stderr: -290> 2023-12-03T11:49:42.970+0000 7f7ab3ab8640 10 monclient: get_auth_request con 0x7f7aac067070 auth_method 0 2023-12-03T11:49:43.101 INFO:tasks.workunit.client.0.smithi003.stderr: -289> 2023-12-03T11:49:42.970+0000 7f7ab32b7640 10 monclient: get_auth_request con 0x7f7aa4022070 auth_method 0 2023-12-03T11:49:43.101 INFO:tasks.workunit.client.0.smithi003.stderr: -288> 2023-12-03T11:49:42.972+0000 7f7ab42b9640 10 monclient: get_auth_request con 0x7f7aa800b040 auth_method 0 2023-12-03T11:49:43.101 INFO:tasks.workunit.client.0.smithi003.stderr: -287> 2023-12-03T11:49:42.974+0000 7f7ab3ab8640 10 monclient: get_auth_request con 0x7f7aa808e3e0 auth_method 0 2023-12-03T11:49:43.102 INFO:tasks.workunit.client.0.smithi003.stderr: -286> 2023-12-03T11:49:42.979+0000 7f7ab32b7640 0 -- 172.21.15.3:0/439359597 >> [v2:172.21.15.3:6817/3356208405,v1:172.21.15.3:6819/3356208405] conn(0x55afbf7e63b0 msgr2=0x55afbf7e87a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:49:43.102 INFO:tasks.workunit.client.0.smithi003.stderr: -285> 2023-12-03T11:49:42.979+0000 7f7a98ff9640 1 client.7290.objecter ms_handle_reset 0x55afbf7e63b0 session 0x55afbf572060 osd.3 2023-12-03T11:49:43.102 INFO:tasks.workunit.client.0.smithi003.stderr: -284> 2023-12-03T11:49:42.979+0000 7f7a98ff9640 10 monclient: _renew_subs 2023-12-03T11:49:43.102 INFO:tasks.workunit.client.0.smithi003.stderr: -283> 2023-12-03T11:49:42.979+0000 7f7a98ff9640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.3:3300/0 2023-12-03T11:49:43.102 INFO:tasks.workunit.client.0.smithi003.stderr: -282> 2023-12-03T11:49:42.979+0000 7f7ab32b7640 10 monclient: get_auth_request con 0x7f7a8c079d90 auth_method 0 2023-12-03T11:49:43.102 INFO:tasks.workunit.client.0.smithi003.stderr: -281> 2023-12-03T11:49:42.979+0000 7f7ab7d21800 20 RGWRados::pool_iterate: got zone_info.83aabb46-04b5-4c96-9933-c6bfb1173a73 2023-12-03T11:49:43.102 INFO:tasks.workunit.client.0.smithi003.stderr: -280> 2023-12-03T11:49:42.979+0000 7f7ab7d21800 20 RGWRados::pool_iterate: got zonegroup_info.6a811aad-435d-4fdd-93c9-b7e0b50de429 2023-12-03T11:49:43.102 INFO:tasks.workunit.client.0.smithi003.stderr: -279> 2023-12-03T11:49:42.979+0000 7f7ab7d21800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:49:43.102 INFO:tasks.workunit.client.0.smithi003.stderr: -278> 2023-12-03T11:49:42.979+0000 7f7ab7d21800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:49:43.102 INFO:tasks.workunit.client.0.smithi003.stderr: -277> 2023-12-03T11:49:42.979+0000 7f7ab7d21800 20 rados->read ofs=0 len=0 2023-12-03T11:49:43.102 INFO:tasks.workunit.client.0.smithi003.stderr: -276> 2023-12-03T11:49:42.980+0000 7f7ab7d21800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:43.102 INFO:tasks.workunit.client.0.smithi003.stderr: -275> 2023-12-03T11:49:42.980+0000 7f7ab7d21800 20 rados->read ofs=0 len=0 2023-12-03T11:49:43.102 INFO:tasks.workunit.client.0.smithi003.stderr: -274> 2023-12-03T11:49:42.980+0000 7f7ab7d21800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:49:43.102 INFO:tasks.workunit.client.0.smithi003.stderr: -273> 2023-12-03T11:49:42.980+0000 7f7ab7d21800 20 rados->read ofs=0 len=0 2023-12-03T11:49:43.102 INFO:tasks.workunit.client.0.smithi003.stderr: -272> 2023-12-03T11:49:42.980+0000 7f7ab7d21800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:49:43.103 INFO:tasks.workunit.client.0.smithi003.stderr: -271> 2023-12-03T11:49:42.980+0000 7f7ab7d21800 20 zone default found 2023-12-03T11:49:43.103 INFO:tasks.workunit.client.0.smithi003.stderr: -270> 2023-12-03T11:49:42.980+0000 7f7ab7d21800 4 Realm: () 2023-12-03T11:49:43.103 INFO:tasks.workunit.client.0.smithi003.stderr: -269> 2023-12-03T11:49:42.980+0000 7f7ab7d21800 4 ZoneGroup: default (6a811aad-435d-4fdd-93c9-b7e0b50de429) 2023-12-03T11:49:43.103 INFO:tasks.workunit.client.0.smithi003.stderr: -268> 2023-12-03T11:49:42.980+0000 7f7ab7d21800 4 Zone: default (83aabb46-04b5-4c96-9933-c6bfb1173a73) 2023-12-03T11:49:43.103 INFO:tasks.workunit.client.0.smithi003.stderr: -267> 2023-12-03T11:49:42.980+0000 7f7ab7d21800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:49:43.103 INFO:tasks.workunit.client.0.smithi003.stderr: -266> 2023-12-03T11:49:42.980+0000 7f7ab7d21800 20 zonegroup default 2023-12-03T11:49:43.103 INFO:tasks.workunit.client.0.smithi003.stderr: -265> 2023-12-03T11:49:42.980+0000 7f7ab7d21800 20 rados->read ofs=0 len=0 2023-12-03T11:49:43.103 INFO:tasks.workunit.client.0.smithi003.stderr: -264> 2023-12-03T11:49:42.980+0000 7f7ab7d21800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:43.103 INFO:tasks.workunit.client.0.smithi003.stderr: -263> 2023-12-03T11:49:42.980+0000 7f7ab7d21800 20 rados->read ofs=0 len=0 2023-12-03T11:49:43.103 INFO:tasks.workunit.client.0.smithi003.stderr: -262> 2023-12-03T11:49:42.981+0000 7f7ab7d21800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:43.103 INFO:tasks.workunit.client.0.smithi003.stderr: -261> 2023-12-03T11:49:42.981+0000 7f7ab7d21800 20 rados->read ofs=0 len=0 2023-12-03T11:49:43.103 INFO:tasks.workunit.client.0.smithi003.stderr: -260> 2023-12-03T11:49:42.981+0000 7f7ab7d21800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:43.103 INFO:tasks.workunit.client.0.smithi003.stderr: -259> 2023-12-03T11:49:42.981+0000 7f7ab7d21800 20 started sync module instance, tier type = 2023-12-03T11:49:43.103 INFO:tasks.workunit.client.0.smithi003.stderr: -258> 2023-12-03T11:49:42.981+0000 7f7ab7d21800 20 started zone id=83aabb46-04b5-4c96-9933-c6bfb1173a73 (name=default) with tier type = 2023-12-03T11:49:43.104 INFO:tasks.workunit.client.0.smithi003.stderr: -257> 2023-12-03T11:49:42.989+0000 7f7ab32b7640 0 -- 172.21.15.3:0/439359597 >> [v2:172.21.15.3:6817/3356208405,v1:172.21.15.3:6819/3356208405] conn(0x7f7a8c079d90 msgr2=0x7f7a8c07c1c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:49:43.104 INFO:tasks.workunit.client.0.smithi003.stderr: -256> 2023-12-03T11:49:42.989+0000 7f7a98ff9640 1 client.7290.objecter ms_handle_reset 0x7f7a8c079d90 session 0x55afbf572060 osd.3 2023-12-03T11:49:43.104 INFO:tasks.workunit.client.0.smithi003.stderr: -255> 2023-12-03T11:49:42.989+0000 7f7ab32b7640 10 monclient: get_auth_request con 0x55afbf7e63b0 auth_method 0 2023-12-03T11:49:43.104 INFO:tasks.workunit.client.0.smithi003.stderr: -254> 2023-12-03T11:49:42.991+0000 7f7ab7d21800 20 add_watcher() i=0 2023-12-03T11:49:43.104 INFO:tasks.workunit.client.0.smithi003.stderr: -253> 2023-12-03T11:49:42.991+0000 7f7ab7d21800 20 add_watcher() i=1 2023-12-03T11:49:43.104 INFO:tasks.workunit.client.0.smithi003.stderr: -252> 2023-12-03T11:49:42.991+0000 7f7ab7d21800 20 add_watcher() i=2 2023-12-03T11:49:43.104 INFO:tasks.workunit.client.0.smithi003.stderr: -251> 2023-12-03T11:49:42.991+0000 7f7ab7d21800 20 add_watcher() i=3 2023-12-03T11:49:43.104 INFO:tasks.workunit.client.0.smithi003.stderr: -250> 2023-12-03T11:49:42.991+0000 7f7ab7d21800 20 add_watcher() i=4 2023-12-03T11:49:43.104 INFO:tasks.workunit.client.0.smithi003.stderr: -249> 2023-12-03T11:49:42.991+0000 7f7ab7d21800 20 add_watcher() i=5 2023-12-03T11:49:43.104 INFO:tasks.workunit.client.0.smithi003.stderr: -248> 2023-12-03T11:49:42.991+0000 7f7ab7d21800 20 add_watcher() i=6 2023-12-03T11:49:43.104 INFO:tasks.workunit.client.0.smithi003.stderr: -247> 2023-12-03T11:49:42.991+0000 7f7ab7d21800 20 add_watcher() i=7 2023-12-03T11:49:43.104 INFO:tasks.workunit.client.0.smithi003.stderr: -246> 2023-12-03T11:49:42.991+0000 7f7ab7d21800 2 all 8 watchers are set, enabling cache 2023-12-03T11:49:43.104 INFO:tasks.workunit.client.0.smithi003.stderr: -245> 2023-12-03T11:49:42.993+0000 7f7ab7d21800 5 AuthRegistry(0x7ffee04d68a0) adding auth protocol: cephx 2023-12-03T11:49:43.104 INFO:tasks.workunit.client.0.smithi003.stderr: -244> 2023-12-03T11:49:42.993+0000 7f7ab7d21800 5 AuthRegistry(0x7ffee04d68a0) adding auth protocol: cephx 2023-12-03T11:49:43.104 INFO:tasks.workunit.client.0.smithi003.stderr: -243> 2023-12-03T11:49:42.993+0000 7f7ab7d21800 5 AuthRegistry(0x7ffee04d68a0) adding auth protocol: cephx 2023-12-03T11:49:43.105 INFO:tasks.workunit.client.0.smithi003.stderr: -242> 2023-12-03T11:49:42.993+0000 7f7ab7d21800 5 AuthRegistry(0x7ffee04d68a0) adding con mode: secure 2023-12-03T11:49:43.105 INFO:tasks.workunit.client.0.smithi003.stderr: -241> 2023-12-03T11:49:42.993+0000 7f7ab7d21800 5 AuthRegistry(0x7ffee04d68a0) adding con mode: crc 2023-12-03T11:49:43.105 INFO:tasks.workunit.client.0.smithi003.stderr: -240> 2023-12-03T11:49:42.993+0000 7f7ab7d21800 5 AuthRegistry(0x7ffee04d68a0) adding con mode: secure 2023-12-03T11:49:43.105 INFO:tasks.workunit.client.0.smithi003.stderr: -239> 2023-12-03T11:49:42.993+0000 7f7ab7d21800 5 AuthRegistry(0x7ffee04d68a0) adding con mode: crc 2023-12-03T11:49:43.105 INFO:tasks.workunit.client.0.smithi003.stderr: -238> 2023-12-03T11:49:42.993+0000 7f7ab7d21800 5 AuthRegistry(0x7ffee04d68a0) adding con mode: secure 2023-12-03T11:49:43.105 INFO:tasks.workunit.client.0.smithi003.stderr: -237> 2023-12-03T11:49:42.993+0000 7f7ab7d21800 5 AuthRegistry(0x7ffee04d68a0) adding con mode: crc 2023-12-03T11:49:43.105 INFO:tasks.workunit.client.0.smithi003.stderr: -236> 2023-12-03T11:49:42.993+0000 7f7ab7d21800 5 AuthRegistry(0x7ffee04d68a0) adding con mode: crc 2023-12-03T11:49:43.105 INFO:tasks.workunit.client.0.smithi003.stderr: -235> 2023-12-03T11:49:42.993+0000 7f7ab7d21800 5 AuthRegistry(0x7ffee04d68a0) adding con mode: secure 2023-12-03T11:49:43.105 INFO:tasks.workunit.client.0.smithi003.stderr: -234> 2023-12-03T11:49:42.993+0000 7f7ab7d21800 5 AuthRegistry(0x7ffee04d68a0) adding con mode: crc 2023-12-03T11:49:43.105 INFO:tasks.workunit.client.0.smithi003.stderr: -233> 2023-12-03T11:49:42.993+0000 7f7ab7d21800 5 AuthRegistry(0x7ffee04d68a0) adding con mode: secure 2023-12-03T11:49:43.105 INFO:tasks.workunit.client.0.smithi003.stderr: -232> 2023-12-03T11:49:42.993+0000 7f7a79fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:49:43.105 INFO:tasks.workunit.client.0.smithi003.stderr: -231> 2023-12-03T11:49:42.993+0000 7f7ab7d21800 5 AuthRegistry(0x7ffee04d68a0) adding con mode: crc 2023-12-03T11:49:43.105 INFO:tasks.workunit.client.0.smithi003.stderr: -230> 2023-12-03T11:49:42.993+0000 7f7ab7d21800 5 AuthRegistry(0x7ffee04d68a0) adding con mode: secure 2023-12-03T11:49:43.105 INFO:tasks.workunit.client.0.smithi003.stderr: -229> 2023-12-03T11:49:42.994+0000 7f7ab7d21800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:49:43.105 INFO:tasks.workunit.client.0.smithi003.stderr: -228> 2023-12-03T11:49:42.994+0000 7f7ab7d21800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:49:43.106 INFO:tasks.workunit.client.0.smithi003.stderr: -227> 2023-12-03T11:49:42.994+0000 7f7ab7d21800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:49:43.106 INFO:tasks.workunit.client.0.smithi003.stderr: -226> 2023-12-03T11:49:42.994+0000 7f7ab7d21800 5 asok(0x55afbf585a10) register_command cache list hook 0x55afbf76a200 2023-12-03T11:49:43.106 INFO:tasks.workunit.client.0.smithi003.stderr: -225> 2023-12-03T11:49:42.994+0000 7f7ab7d21800 5 asok(0x55afbf585a10) register_command cache inspect hook 0x55afbf76a200 2023-12-03T11:49:43.106 INFO:tasks.workunit.client.0.smithi003.stderr: -224> 2023-12-03T11:49:42.994+0000 7f7ab7d21800 5 asok(0x55afbf585a10) register_command cache erase hook 0x55afbf76a200 2023-12-03T11:49:43.106 INFO:tasks.workunit.client.0.smithi003.stderr: -223> 2023-12-03T11:49:42.994+0000 7f7ab7d21800 5 asok(0x55afbf585a10) register_command cache zap hook 0x55afbf76a200 2023-12-03T11:49:43.106 INFO:tasks.workunit.client.0.smithi003.stderr: -222> 2023-12-03T11:49:42.994+0000 7f7ab7d21800 10 monclient: get_monmap_and_config 2023-12-03T11:49:43.106 INFO:tasks.workunit.client.0.smithi003.stderr: -221> 2023-12-03T11:49:42.994+0000 7f7ab7d21800 10 monclient: build_initial_monmap 2023-12-03T11:49:43.106 INFO:tasks.workunit.client.0.smithi003.stderr: -220> 2023-12-03T11:49:42.994+0000 7f7ab7d21800 1 build_initial for_mkfs: 0 2023-12-03T11:49:43.106 INFO:tasks.workunit.client.0.smithi003.stderr: -219> 2023-12-03T11:49:42.994+0000 7f7ab7d21800 10 monclient: monmap: 2023-12-03T11:49:43.106 INFO:tasks.workunit.client.0.smithi003.stderr:epoch 0 2023-12-03T11:49:43.106 INFO:tasks.workunit.client.0.smithi003.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-12-03T11:49:43.106 INFO:tasks.workunit.client.0.smithi003.stderr:last_changed 0.000000 2023-12-03T11:49:43.106 INFO:tasks.workunit.client.0.smithi003.stderr:created 0.000000 2023-12-03T11:49:43.106 INFO:tasks.workunit.client.0.smithi003.stderr:min_mon_release 0 (unknown) 2023-12-03T11:49:43.107 INFO:tasks.workunit.client.0.smithi003.stderr:election_strategy: 1 2023-12-03T11:49:43.107 INFO:tasks.workunit.client.0.smithi003.stderr:0: [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] mon.noname-a 2023-12-03T11:49:43.107 INFO:tasks.workunit.client.0.smithi003.stderr:1: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.noname-b 2023-12-03T11:49:43.107 INFO:tasks.workunit.client.0.smithi003.stderr:2: [v2:172.21.15.3:3301/0,v1:172.21.15.3:6790/0] mon.noname-c 2023-12-03T11:49:43.107 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:49:43.107 INFO:tasks.workunit.client.0.smithi003.stderr: -218> 2023-12-03T11:49:42.994+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf821a90) adding auth protocol: cephx 2023-12-03T11:49:43.107 INFO:tasks.workunit.client.0.smithi003.stderr: -217> 2023-12-03T11:49:42.994+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf821a90) adding auth protocol: cephx 2023-12-03T11:49:43.107 INFO:tasks.workunit.client.0.smithi003.stderr: -216> 2023-12-03T11:49:42.994+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf821a90) adding auth protocol: cephx 2023-12-03T11:49:43.107 INFO:tasks.workunit.client.0.smithi003.stderr: -215> 2023-12-03T11:49:42.994+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf821a90) adding con mode: secure 2023-12-03T11:49:43.107 INFO:tasks.workunit.client.0.smithi003.stderr: -214> 2023-12-03T11:49:42.994+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf821a90) adding con mode: crc 2023-12-03T11:49:43.107 INFO:tasks.workunit.client.0.smithi003.stderr: -213> 2023-12-03T11:49:42.994+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf821a90) adding con mode: secure 2023-12-03T11:49:43.107 INFO:tasks.workunit.client.0.smithi003.stderr: -212> 2023-12-03T11:49:42.994+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf821a90) adding con mode: crc 2023-12-03T11:49:43.107 INFO:tasks.workunit.client.0.smithi003.stderr: -211> 2023-12-03T11:49:42.994+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf821a90) adding con mode: secure 2023-12-03T11:49:43.107 INFO:tasks.workunit.client.0.smithi003.stderr: -210> 2023-12-03T11:49:42.994+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf821a90) adding con mode: crc 2023-12-03T11:49:43.107 INFO:tasks.workunit.client.0.smithi003.stderr: -209> 2023-12-03T11:49:42.994+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf821a90) adding con mode: crc 2023-12-03T11:49:43.108 INFO:tasks.workunit.client.0.smithi003.stderr: -208> 2023-12-03T11:49:42.994+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf821a90) adding con mode: secure 2023-12-03T11:49:43.108 INFO:tasks.workunit.client.0.smithi003.stderr: -207> 2023-12-03T11:49:42.994+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf821a90) adding con mode: crc 2023-12-03T11:49:43.108 INFO:tasks.workunit.client.0.smithi003.stderr: -206> 2023-12-03T11:49:42.994+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf821a90) adding con mode: secure 2023-12-03T11:49:43.108 INFO:tasks.workunit.client.0.smithi003.stderr: -205> 2023-12-03T11:49:42.994+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf821a90) adding con mode: crc 2023-12-03T11:49:43.108 INFO:tasks.workunit.client.0.smithi003.stderr: -204> 2023-12-03T11:49:42.994+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf821a90) adding con mode: secure 2023-12-03T11:49:43.108 INFO:tasks.workunit.client.0.smithi003.stderr: -203> 2023-12-03T11:49:42.994+0000 7f7ab7d21800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:49:43.108 INFO:tasks.workunit.client.0.smithi003.stderr: -202> 2023-12-03T11:49:42.994+0000 7f7ab7d21800 10 monclient: init 2023-12-03T11:49:43.108 INFO:tasks.workunit.client.0.smithi003.stderr: -201> 2023-12-03T11:49:42.994+0000 7f7ab7d21800 5 AuthRegistry(0x7ffee04d63f0) adding auth protocol: cephx 2023-12-03T11:49:43.108 INFO:tasks.workunit.client.0.smithi003.stderr: -200> 2023-12-03T11:49:42.994+0000 7f7ab7d21800 5 AuthRegistry(0x7ffee04d63f0) adding auth protocol: cephx 2023-12-03T11:49:43.108 INFO:tasks.workunit.client.0.smithi003.stderr: -199> 2023-12-03T11:49:42.994+0000 7f7ab7d21800 5 AuthRegistry(0x7ffee04d63f0) adding auth protocol: cephx 2023-12-03T11:49:43.108 INFO:tasks.workunit.client.0.smithi003.stderr: -198> 2023-12-03T11:49:42.994+0000 7f7ab7d21800 5 AuthRegistry(0x7ffee04d63f0) adding con mode: secure 2023-12-03T11:49:43.108 INFO:tasks.workunit.client.0.smithi003.stderr: -197> 2023-12-03T11:49:42.994+0000 7f7ab7d21800 5 AuthRegistry(0x7ffee04d63f0) adding con mode: crc 2023-12-03T11:49:43.108 INFO:tasks.workunit.client.0.smithi003.stderr: -196> 2023-12-03T11:49:42.994+0000 7f7ab7d21800 5 AuthRegistry(0x7ffee04d63f0) adding con mode: secure 2023-12-03T11:49:43.108 INFO:tasks.workunit.client.0.smithi003.stderr: -195> 2023-12-03T11:49:42.994+0000 7f7ab7d21800 5 AuthRegistry(0x7ffee04d63f0) adding con mode: crc 2023-12-03T11:49:43.108 INFO:tasks.workunit.client.0.smithi003.stderr: -194> 2023-12-03T11:49:42.994+0000 7f7ab7d21800 5 AuthRegistry(0x7ffee04d63f0) adding con mode: secure 2023-12-03T11:49:43.109 INFO:tasks.workunit.client.0.smithi003.stderr: -193> 2023-12-03T11:49:42.994+0000 7f7ab7d21800 5 AuthRegistry(0x7ffee04d63f0) adding con mode: crc 2023-12-03T11:49:43.109 INFO:tasks.workunit.client.0.smithi003.stderr: -192> 2023-12-03T11:49:42.994+0000 7f7ab7d21800 5 AuthRegistry(0x7ffee04d63f0) adding con mode: crc 2023-12-03T11:49:43.109 INFO:tasks.workunit.client.0.smithi003.stderr: -191> 2023-12-03T11:49:42.994+0000 7f7ab7d21800 5 AuthRegistry(0x7ffee04d63f0) adding con mode: secure 2023-12-03T11:49:43.109 INFO:tasks.workunit.client.0.smithi003.stderr: -190> 2023-12-03T11:49:42.994+0000 7f7ab7d21800 5 AuthRegistry(0x7ffee04d63f0) adding con mode: crc 2023-12-03T11:49:43.109 INFO:tasks.workunit.client.0.smithi003.stderr: -189> 2023-12-03T11:49:42.994+0000 7f7ab7d21800 5 AuthRegistry(0x7ffee04d63f0) adding con mode: secure 2023-12-03T11:49:43.109 INFO:tasks.workunit.client.0.smithi003.stderr: -188> 2023-12-03T11:49:42.994+0000 7f7ab7d21800 5 AuthRegistry(0x7ffee04d63f0) adding con mode: crc 2023-12-03T11:49:43.109 INFO:tasks.workunit.client.0.smithi003.stderr: -187> 2023-12-03T11:49:42.994+0000 7f7ab7d21800 5 AuthRegistry(0x7ffee04d63f0) adding con mode: secure 2023-12-03T11:49:43.109 INFO:tasks.workunit.client.0.smithi003.stderr: -186> 2023-12-03T11:49:42.994+0000 7f7ab7d21800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:49:43.109 INFO:tasks.workunit.client.0.smithi003.stderr: -185> 2023-12-03T11:49:42.994+0000 7f7ab7d21800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:49:43.109 INFO:tasks.workunit.client.0.smithi003.stderr: -184> 2023-12-03T11:49:42.994+0000 7f7ab7d21800 5 asok(0x55afbf585a10) register_command rotate-key cmddesc rotate-key hook 0x7ffee04d6538 EEXIST 2023-12-03T11:49:43.109 INFO:tasks.workunit.client.0.smithi003.stderr: -183> 2023-12-03T11:49:42.994+0000 7f7ab7d21800 10 monclient: _reopen_session rank -1 2023-12-03T11:49:43.109 INFO:tasks.workunit.client.0.smithi003.stderr: -182> 2023-12-03T11:49:42.994+0000 7f7ab7d21800 10 monclient: _add_conns ranks=[0,1,2] 2023-12-03T11:49:43.110 INFO:tasks.workunit.client.0.smithi003.stderr: -181> 2023-12-03T11:49:42.994+0000 7f7ab7d21800 10 monclient(hunting): picked mon.noname-a con 0x55afbf824380 addr [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] 2023-12-03T11:49:43.110 INFO:tasks.workunit.client.0.smithi003.stderr: -180> 2023-12-03T11:49:42.995+0000 7f7ab7d21800 10 monclient(hunting): picked mon.noname-b con 0x55afbf8212e0 addr [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] 2023-12-03T11:49:43.110 INFO:tasks.workunit.client.0.smithi003.stderr: -179> 2023-12-03T11:49:42.995+0000 7f7ab7d21800 10 monclient(hunting): picked mon.noname-c con 0x55afbf81dfb0 addr [v2:172.21.15.3:3301/0,v1:172.21.15.3:6790/0] 2023-12-03T11:49:43.110 INFO:tasks.workunit.client.0.smithi003.stderr: -178> 2023-12-03T11:49:42.995+0000 7f7ab7d21800 10 monclient(hunting): start opening mon connection 2023-12-03T11:49:43.110 INFO:tasks.workunit.client.0.smithi003.stderr: -177> 2023-12-03T11:49:42.995+0000 7f7ab7d21800 10 monclient(hunting): start opening mon connection 2023-12-03T11:49:43.110 INFO:tasks.workunit.client.0.smithi003.stderr: -176> 2023-12-03T11:49:42.995+0000 7f7ab7d21800 10 monclient(hunting): start opening mon connection 2023-12-03T11:49:43.110 INFO:tasks.workunit.client.0.smithi003.stderr: -175> 2023-12-03T11:49:42.995+0000 7f7ab7d21800 10 monclient(hunting): _renew_subs 2023-12-03T11:49:43.110 INFO:tasks.workunit.client.0.smithi003.stderr: -174> 2023-12-03T11:49:42.995+0000 7f7ab7d21800 10 monclient(hunting): authenticate will time out at 1805.233332s 2023-12-03T11:49:43.110 INFO:tasks.workunit.client.0.smithi003.stderr: -173> 2023-12-03T11:49:42.995+0000 7f7ab42b9640 10 monclient(hunting): get_auth_request con 0x55afbf824380 auth_method 0 2023-12-03T11:49:43.110 INFO:tasks.workunit.client.0.smithi003.stderr: -172> 2023-12-03T11:49:42.995+0000 7f7ab42b9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:49:43.111 INFO:tasks.workunit.client.0.smithi003.stderr: -171> 2023-12-03T11:49:42.995+0000 7f7ab42b9640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:49:43.111 INFO:tasks.workunit.client.0.smithi003.stderr: -170> 2023-12-03T11:49:42.995+0000 7f7ab42b9640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:49:43.111 INFO:tasks.workunit.client.0.smithi003.stderr: -169> 2023-12-03T11:49:42.995+0000 7f7ab32b7640 10 monclient(hunting): get_auth_request con 0x55afbf81dfb0 auth_method 0 2023-12-03T11:49:43.111 INFO:tasks.workunit.client.0.smithi003.stderr: -168> 2023-12-03T11:49:42.995+0000 7f7ab32b7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:49:43.111 INFO:tasks.workunit.client.0.smithi003.stderr: -167> 2023-12-03T11:49:42.995+0000 7f7ab32b7640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:49:43.111 INFO:tasks.workunit.client.0.smithi003.stderr: -166> 2023-12-03T11:49:42.995+0000 7f7ab32b7640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:49:43.111 INFO:tasks.workunit.client.0.smithi003.stderr: -165> 2023-12-03T11:49:42.995+0000 7f7ab3ab8640 10 monclient(hunting): get_auth_request con 0x55afbf8212e0 auth_method 0 2023-12-03T11:49:43.111 INFO:tasks.workunit.client.0.smithi003.stderr: -164> 2023-12-03T11:49:42.995+0000 7f7ab3ab8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:49:43.111 INFO:tasks.workunit.client.0.smithi003.stderr: -163> 2023-12-03T11:49:42.995+0000 7f7ab3ab8640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:49:43.111 INFO:tasks.workunit.client.0.smithi003.stderr: -162> 2023-12-03T11:49:42.995+0000 7f7ab3ab8640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:49:43.111 INFO:tasks.workunit.client.0.smithi003.stderr: -161> 2023-12-03T11:49:42.995+0000 7f7ab42b9640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:49:43.111 INFO:tasks.workunit.client.0.smithi003.stderr: -160> 2023-12-03T11:49:42.995+0000 7f7ab42b9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:49:43.111 INFO:tasks.workunit.client.0.smithi003.stderr: -159> 2023-12-03T11:49:42.995+0000 7f7ab42b9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:49:43.111 INFO:tasks.workunit.client.0.smithi003.stderr: -158> 2023-12-03T11:49:42.995+0000 7f7ab32b7640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:49:43.112 INFO:tasks.workunit.client.0.smithi003.stderr: -157> 2023-12-03T11:49:42.995+0000 7f7ab32b7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:49:43.112 INFO:tasks.workunit.client.0.smithi003.stderr: -156> 2023-12-03T11:49:42.995+0000 7f7ab32b7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:49:43.112 INFO:tasks.workunit.client.0.smithi003.stderr: -155> 2023-12-03T11:49:42.995+0000 7f7ab3ab8640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:49:43.112 INFO:tasks.workunit.client.0.smithi003.stderr: -154> 2023-12-03T11:49:42.995+0000 7f7ab3ab8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:49:43.112 INFO:tasks.workunit.client.0.smithi003.stderr: -153> 2023-12-03T11:49:42.995+0000 7f7ab3ab8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:49:43.112 INFO:tasks.workunit.client.0.smithi003.stderr: -152> 2023-12-03T11:49:42.995+0000 7f7ab42b9640 10 monclient(hunting): handle_auth_done global_id 7293 payload 274 2023-12-03T11:49:43.112 INFO:tasks.workunit.client.0.smithi003.stderr: -151> 2023-12-03T11:49:42.995+0000 7f7ab42b9640 10 monclient: _finish_hunting 0 2023-12-03T11:49:43.112 INFO:tasks.workunit.client.0.smithi003.stderr: -150> 2023-12-03T11:49:42.995+0000 7f7ab42b9640 1 monclient: found mon.noname-a 2023-12-03T11:49:43.112 INFO:tasks.workunit.client.0.smithi003.stderr: -149> 2023-12-03T11:49:42.995+0000 7f7ab42b9640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.3:3300/0 2023-12-03T11:49:43.112 INFO:tasks.workunit.client.0.smithi003.stderr: -148> 2023-12-03T11:49:42.995+0000 7f7a797e2640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:49:43.112 INFO:tasks.workunit.client.0.smithi003.stderr: -147> 2023-12-03T11:49:42.995+0000 7f7a797e2640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-12-03T11:49:43.112 INFO:tasks.workunit.client.0.smithi003.stderr: -146> 2023-12-03T11:49:42.995+0000 7f7a797e2640 10 monclient: dump: 2023-12-03T11:49:43.112 INFO:tasks.workunit.client.0.smithi003.stderr:epoch 1 2023-12-03T11:49:43.112 INFO:tasks.workunit.client.0.smithi003.stderr:fsid 296556de-a4fc-4095-9b6d-0fe813c2865c 2023-12-03T11:49:43.112 INFO:tasks.workunit.client.0.smithi003.stderr:last_changed 2023-12-03T11:33:18.862564+0000 2023-12-03T11:49:43.113 INFO:tasks.workunit.client.0.smithi003.stderr:created 2023-12-03T11:33:18.862564+0000 2023-12-03T11:49:43.113 INFO:tasks.workunit.client.0.smithi003.stderr:min_mon_release 18 (reef) 2023-12-03T11:49:43.113 INFO:tasks.workunit.client.0.smithi003.stderr:election_strategy: 1 2023-12-03T11:49:43.113 INFO:tasks.workunit.client.0.smithi003.stderr:0: [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] mon.a 2023-12-03T11:49:43.113 INFO:tasks.workunit.client.0.smithi003.stderr:1: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.b 2023-12-03T11:49:43.113 INFO:tasks.workunit.client.0.smithi003.stderr:2: [v2:172.21.15.3:3301/0,v1:172.21.15.3:6790/0] mon.c 2023-12-03T11:49:43.113 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:49:43.113 INFO:tasks.workunit.client.0.smithi003.stderr: -145> 2023-12-03T11:49:42.995+0000 7f7a797e2640 10 monclient: _finish_auth 0 2023-12-03T11:49:43.113 INFO:tasks.workunit.client.0.smithi003.stderr: -144> 2023-12-03T11:49:42.995+0000 7f7a797e2640 10 monclient: _check_auth_tickets 2023-12-03T11:49:43.113 INFO:tasks.workunit.client.0.smithi003.stderr: -143> 2023-12-03T11:49:42.995+0000 7f7a797e2640 10 monclient: handle_config config(0 keys) v1 2023-12-03T11:49:43.113 INFO:tasks.workunit.client.0.smithi003.stderr: -142> 2023-12-03T11:49:42.995+0000 7f7a797e2640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:49:43.113 INFO:tasks.workunit.client.0.smithi003.stderr: -141> 2023-12-03T11:49:42.995+0000 7f7a797e2640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-12-03T11:49:43.113 INFO:tasks.workunit.client.0.smithi003.stderr: -140> 2023-12-03T11:49:42.995+0000 7f7a797e2640 10 monclient: dump: 2023-12-03T11:49:43.113 INFO:tasks.workunit.client.0.smithi003.stderr:epoch 1 2023-12-03T11:49:43.113 INFO:tasks.workunit.client.0.smithi003.stderr:fsid 296556de-a4fc-4095-9b6d-0fe813c2865c 2023-12-03T11:49:43.114 INFO:tasks.workunit.client.0.smithi003.stderr:last_changed 2023-12-03T11:33:18.862564+0000 2023-12-03T11:49:43.114 INFO:tasks.workunit.client.0.smithi003.stderr:created 2023-12-03T11:33:18.862564+0000 2023-12-03T11:49:43.114 INFO:tasks.workunit.client.0.smithi003.stderr:min_mon_release 18 (reef) 2023-12-03T11:49:43.114 INFO:tasks.workunit.client.0.smithi003.stderr:election_strategy: 1 2023-12-03T11:49:43.114 INFO:tasks.workunit.client.0.smithi003.stderr:0: [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] mon.a 2023-12-03T11:49:43.114 INFO:tasks.workunit.client.0.smithi003.stderr:1: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.b 2023-12-03T11:49:43.114 INFO:tasks.workunit.client.0.smithi003.stderr:2: [v2:172.21.15.3:3301/0,v1:172.21.15.3:6790/0] mon.c 2023-12-03T11:49:43.114 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:49:43.114 INFO:tasks.workunit.client.0.smithi003.stderr: -139> 2023-12-03T11:49:42.995+0000 7f7ab7d21800 5 monclient: authenticate success, global_id 7293 2023-12-03T11:49:43.114 INFO:tasks.workunit.client.0.smithi003.stderr: -138> 2023-12-03T11:49:42.995+0000 7f7ab7d21800 10 monclient: get_monmap_and_config success 2023-12-03T11:49:43.114 INFO:tasks.workunit.client.0.smithi003.stderr: -137> 2023-12-03T11:49:42.995+0000 7f7ab7d21800 4 set_mon_vals no callback set 2023-12-03T11:49:43.114 INFO:tasks.workunit.client.0.smithi003.stderr: -136> 2023-12-03T11:49:42.996+0000 7f7ab7d21800 10 monclient: shutdown 2023-12-03T11:49:43.114 INFO:tasks.workunit.client.0.smithi003.stderr: -135> 2023-12-03T11:49:42.996+0000 7f7ab7d21800 10 monclient: build_initial_monmap 2023-12-03T11:49:43.114 INFO:tasks.workunit.client.0.smithi003.stderr: -134> 2023-12-03T11:49:42.996+0000 7f7ab7d21800 1 build_initial for_mkfs: 0 2023-12-03T11:49:43.115 INFO:tasks.workunit.client.0.smithi003.stderr: -133> 2023-12-03T11:49:42.996+0000 7f7ab7d21800 10 monclient: monmap: 2023-12-03T11:49:43.115 INFO:tasks.workunit.client.0.smithi003.stderr:epoch 0 2023-12-03T11:49:43.115 INFO:tasks.workunit.client.0.smithi003.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-12-03T11:49:43.115 INFO:tasks.workunit.client.0.smithi003.stderr:last_changed 0.000000 2023-12-03T11:49:43.115 INFO:tasks.workunit.client.0.smithi003.stderr:created 0.000000 2023-12-03T11:49:43.115 INFO:tasks.workunit.client.0.smithi003.stderr:min_mon_release 0 (unknown) 2023-12-03T11:49:43.115 INFO:tasks.workunit.client.0.smithi003.stderr:election_strategy: 1 2023-12-03T11:49:43.115 INFO:tasks.workunit.client.0.smithi003.stderr:0: [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] mon.noname-a 2023-12-03T11:49:43.115 INFO:tasks.workunit.client.0.smithi003.stderr:1: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.noname-b 2023-12-03T11:49:43.115 INFO:tasks.workunit.client.0.smithi003.stderr:2: [v2:172.21.15.3:3301/0,v1:172.21.15.3:6790/0] mon.noname-c 2023-12-03T11:49:43.115 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:49:43.115 INFO:tasks.workunit.client.0.smithi003.stderr: -132> 2023-12-03T11:49:42.996+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf823990) adding auth protocol: cephx 2023-12-03T11:49:43.115 INFO:tasks.workunit.client.0.smithi003.stderr: -131> 2023-12-03T11:49:42.996+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf823990) adding auth protocol: cephx 2023-12-03T11:49:43.115 INFO:tasks.workunit.client.0.smithi003.stderr: -130> 2023-12-03T11:49:42.996+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf823990) adding auth protocol: cephx 2023-12-03T11:49:43.115 INFO:tasks.workunit.client.0.smithi003.stderr: -129> 2023-12-03T11:49:42.996+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf823990) adding con mode: secure 2023-12-03T11:49:43.115 INFO:tasks.workunit.client.0.smithi003.stderr: -128> 2023-12-03T11:49:42.996+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf823990) adding con mode: crc 2023-12-03T11:49:43.116 INFO:tasks.workunit.client.0.smithi003.stderr: -127> 2023-12-03T11:49:42.996+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf823990) adding con mode: secure 2023-12-03T11:49:43.116 INFO:tasks.workunit.client.0.smithi003.stderr: -126> 2023-12-03T11:49:42.996+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf823990) adding con mode: crc 2023-12-03T11:49:43.116 INFO:tasks.workunit.client.0.smithi003.stderr: -125> 2023-12-03T11:49:42.996+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf823990) adding con mode: secure 2023-12-03T11:49:43.116 INFO:tasks.workunit.client.0.smithi003.stderr: -124> 2023-12-03T11:49:42.996+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf823990) adding con mode: crc 2023-12-03T11:49:43.116 INFO:tasks.workunit.client.0.smithi003.stderr: -123> 2023-12-03T11:49:42.996+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf823990) adding con mode: crc 2023-12-03T11:49:43.116 INFO:tasks.workunit.client.0.smithi003.stderr: -122> 2023-12-03T11:49:42.996+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf823990) adding con mode: secure 2023-12-03T11:49:43.116 INFO:tasks.workunit.client.0.smithi003.stderr: -121> 2023-12-03T11:49:42.996+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf823990) adding con mode: crc 2023-12-03T11:49:43.116 INFO:tasks.workunit.client.0.smithi003.stderr: -120> 2023-12-03T11:49:42.996+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf823990) adding con mode: secure 2023-12-03T11:49:43.116 INFO:tasks.workunit.client.0.smithi003.stderr: -119> 2023-12-03T11:49:42.996+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf823990) adding con mode: crc 2023-12-03T11:49:43.116 INFO:tasks.workunit.client.0.smithi003.stderr: -118> 2023-12-03T11:49:42.996+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf823990) adding con mode: secure 2023-12-03T11:49:43.116 INFO:tasks.workunit.client.0.smithi003.stderr: -117> 2023-12-03T11:49:42.996+0000 7f7ab7d21800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:49:43.116 INFO:tasks.workunit.client.0.smithi003.stderr: -116> 2023-12-03T11:49:42.996+0000 7f7ab7d21800 1 librados: starting msgr at 2023-12-03T11:49:43.116 INFO:tasks.workunit.client.0.smithi003.stderr: -115> 2023-12-03T11:49:42.996+0000 7f7ab7d21800 1 librados: starting objecter 2023-12-03T11:49:43.116 INFO:tasks.workunit.client.0.smithi003.stderr: -114> 2023-12-03T11:49:42.996+0000 7f7ab7d21800 5 asok(0x55afbf585a10) register_command objecter_requests cmddesc objecter_requests hook 0x55afbf7ea7c0 EEXIST 2023-12-03T11:49:43.116 INFO:tasks.workunit.client.0.smithi003.stderr: -113> 2023-12-03T11:49:42.997+0000 7f7ab7d21800 1 librados: setting wanted keys 2023-12-03T11:49:43.117 INFO:tasks.workunit.client.0.smithi003.stderr: -112> 2023-12-03T11:49:42.997+0000 7f7ab7d21800 1 librados: calling monclient init 2023-12-03T11:49:43.117 INFO:tasks.workunit.client.0.smithi003.stderr: -111> 2023-12-03T11:49:42.997+0000 7f7ab7d21800 10 monclient: init 2023-12-03T11:49:43.117 INFO:tasks.workunit.client.0.smithi003.stderr: -110> 2023-12-03T11:49:42.997+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf824fa8) adding auth protocol: cephx 2023-12-03T11:49:43.117 INFO:tasks.workunit.client.0.smithi003.stderr: -109> 2023-12-03T11:49:42.997+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf824fa8) adding auth protocol: cephx 2023-12-03T11:49:43.117 INFO:tasks.workunit.client.0.smithi003.stderr: -108> 2023-12-03T11:49:42.997+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf824fa8) adding auth protocol: cephx 2023-12-03T11:49:43.117 INFO:tasks.workunit.client.0.smithi003.stderr: -107> 2023-12-03T11:49:42.997+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf824fa8) adding con mode: secure 2023-12-03T11:49:43.117 INFO:tasks.workunit.client.0.smithi003.stderr: -106> 2023-12-03T11:49:42.997+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf824fa8) adding con mode: crc 2023-12-03T11:49:43.117 INFO:tasks.workunit.client.0.smithi003.stderr: -105> 2023-12-03T11:49:42.997+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf824fa8) adding con mode: secure 2023-12-03T11:49:43.117 INFO:tasks.workunit.client.0.smithi003.stderr: -104> 2023-12-03T11:49:42.997+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf824fa8) adding con mode: crc 2023-12-03T11:49:43.117 INFO:tasks.workunit.client.0.smithi003.stderr: -103> 2023-12-03T11:49:42.997+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf824fa8) adding con mode: secure 2023-12-03T11:49:43.117 INFO:tasks.workunit.client.0.smithi003.stderr: -102> 2023-12-03T11:49:42.997+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf824fa8) adding con mode: crc 2023-12-03T11:49:43.117 INFO:tasks.workunit.client.0.smithi003.stderr: -101> 2023-12-03T11:49:42.997+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf824fa8) adding con mode: crc 2023-12-03T11:49:43.117 INFO:tasks.workunit.client.0.smithi003.stderr: -100> 2023-12-03T11:49:42.997+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf824fa8) adding con mode: secure 2023-12-03T11:49:43.117 INFO:tasks.workunit.client.0.smithi003.stderr: -99> 2023-12-03T11:49:42.997+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf824fa8) adding con mode: crc 2023-12-03T11:49:43.117 INFO:tasks.workunit.client.0.smithi003.stderr: -98> 2023-12-03T11:49:42.997+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf824fa8) adding con mode: secure 2023-12-03T11:49:43.118 INFO:tasks.workunit.client.0.smithi003.stderr: -97> 2023-12-03T11:49:42.997+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf824fa8) adding con mode: crc 2023-12-03T11:49:43.118 INFO:tasks.workunit.client.0.smithi003.stderr: -96> 2023-12-03T11:49:42.997+0000 7f7ab7d21800 5 AuthRegistry(0x55afbf824fa8) adding con mode: secure 2023-12-03T11:49:43.118 INFO:tasks.workunit.client.0.smithi003.stderr: -95> 2023-12-03T11:49:42.997+0000 7f7ab7d21800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:49:43.118 INFO:tasks.workunit.client.0.smithi003.stderr: -94> 2023-12-03T11:49:42.997+0000 7f7ab7d21800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:49:43.118 INFO:tasks.workunit.client.0.smithi003.stderr: -93> 2023-12-03T11:49:42.997+0000 7f7ab7d21800 5 asok(0x55afbf585a10) register_command rotate-key cmddesc rotate-key hook 0x55afbf8250f0 EEXIST 2023-12-03T11:49:43.118 INFO:tasks.workunit.client.0.smithi003.stderr: -92> 2023-12-03T11:49:42.997+0000 7f7ab7d21800 10 monclient: _reopen_session rank -1 2023-12-03T11:49:43.118 INFO:tasks.workunit.client.0.smithi003.stderr: -91> 2023-12-03T11:49:42.997+0000 7f7ab7d21800 10 monclient: _add_conns ranks=[0,2,1] 2023-12-03T11:49:43.118 INFO:tasks.workunit.client.0.smithi003.stderr: -90> 2023-12-03T11:49:42.997+0000 7f7ab7d21800 10 monclient(hunting): picked mon.noname-a con 0x55afbf81dfb0 addr [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] 2023-12-03T11:49:43.118 INFO:tasks.workunit.client.0.smithi003.stderr: -89> 2023-12-03T11:49:42.997+0000 7f7ab7d21800 10 monclient(hunting): picked mon.noname-c con 0x55afbf8212e0 addr [v2:172.21.15.3:3301/0,v1:172.21.15.3:6790/0] 2023-12-03T11:49:43.118 INFO:tasks.workunit.client.0.smithi003.stderr: -88> 2023-12-03T11:49:42.997+0000 7f7ab7d21800 10 monclient(hunting): picked mon.noname-b con 0x55afbf824380 addr [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] 2023-12-03T11:49:43.118 INFO:tasks.workunit.client.0.smithi003.stderr: -87> 2023-12-03T11:49:42.997+0000 7f7ab7d21800 10 monclient(hunting): start opening mon connection 2023-12-03T11:49:43.118 INFO:tasks.workunit.client.0.smithi003.stderr: -86> 2023-12-03T11:49:42.997+0000 7f7ab7d21800 10 monclient(hunting): start opening mon connection 2023-12-03T11:49:43.118 INFO:tasks.workunit.client.0.smithi003.stderr: -85> 2023-12-03T11:49:42.997+0000 7f7ab7d21800 10 monclient(hunting): start opening mon connection 2023-12-03T11:49:43.118 INFO:tasks.workunit.client.0.smithi003.stderr: -84> 2023-12-03T11:49:42.997+0000 7f7ab7d21800 10 monclient(hunting): _renew_subs 2023-12-03T11:49:43.118 INFO:tasks.workunit.client.0.smithi003.stderr: -83> 2023-12-03T11:49:42.997+0000 7f7ab7d21800 10 monclient(hunting): authenticate will time out at 1805.235852s 2023-12-03T11:49:43.119 INFO:tasks.workunit.client.0.smithi003.stderr: -82> 2023-12-03T11:49:42.997+0000 7f7ab42b9640 10 monclient(hunting): get_auth_request con 0x55afbf81dfb0 auth_method 0 2023-12-03T11:49:43.119 INFO:tasks.workunit.client.0.smithi003.stderr: -81> 2023-12-03T11:49:42.997+0000 7f7ab42b9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:49:43.119 INFO:tasks.workunit.client.0.smithi003.stderr: -80> 2023-12-03T11:49:42.997+0000 7f7ab42b9640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:49:43.119 INFO:tasks.workunit.client.0.smithi003.stderr: -79> 2023-12-03T11:49:42.997+0000 7f7ab42b9640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:49:43.119 INFO:tasks.workunit.client.0.smithi003.stderr: -78> 2023-12-03T11:49:42.997+0000 7f7ab3ab8640 10 monclient(hunting): get_auth_request con 0x55afbf8212e0 auth_method 0 2023-12-03T11:49:43.119 INFO:tasks.workunit.client.0.smithi003.stderr: -77> 2023-12-03T11:49:42.997+0000 7f7ab3ab8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:49:43.119 INFO:tasks.workunit.client.0.smithi003.stderr: -76> 2023-12-03T11:49:42.997+0000 7f7ab3ab8640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:49:43.119 INFO:tasks.workunit.client.0.smithi003.stderr: -75> 2023-12-03T11:49:42.997+0000 7f7ab3ab8640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:49:43.119 INFO:tasks.workunit.client.0.smithi003.stderr: -74> 2023-12-03T11:49:42.997+0000 7f7ab42b9640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:49:43.119 INFO:tasks.workunit.client.0.smithi003.stderr: -73> 2023-12-03T11:49:42.997+0000 7f7ab42b9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:49:43.119 INFO:tasks.workunit.client.0.smithi003.stderr: -72> 2023-12-03T11:49:42.997+0000 7f7ab42b9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:49:43.119 INFO:tasks.workunit.client.0.smithi003.stderr: -71> 2023-12-03T11:49:42.997+0000 7f7ab3ab8640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:49:43.119 INFO:tasks.workunit.client.0.smithi003.stderr: -70> 2023-12-03T11:49:42.997+0000 7f7ab3ab8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:49:43.119 INFO:tasks.workunit.client.0.smithi003.stderr: -69> 2023-12-03T11:49:42.997+0000 7f7ab3ab8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:49:43.119 INFO:tasks.workunit.client.0.smithi003.stderr: -68> 2023-12-03T11:49:42.997+0000 7f7ab32b7640 10 monclient(hunting): get_auth_request con 0x55afbf824380 auth_method 0 2023-12-03T11:49:43.119 INFO:tasks.workunit.client.0.smithi003.stderr: -67> 2023-12-03T11:49:42.997+0000 7f7ab32b7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:49:43.120 INFO:tasks.workunit.client.0.smithi003.stderr: -66> 2023-12-03T11:49:42.997+0000 7f7ab32b7640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:49:43.120 INFO:tasks.workunit.client.0.smithi003.stderr: -65> 2023-12-03T11:49:42.997+0000 7f7ab32b7640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:49:43.120 INFO:tasks.workunit.client.0.smithi003.stderr: -64> 2023-12-03T11:49:42.997+0000 7f7ab32b7640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:49:43.120 INFO:tasks.workunit.client.0.smithi003.stderr: -63> 2023-12-03T11:49:42.997+0000 7f7ab32b7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:49:43.120 INFO:tasks.workunit.client.0.smithi003.stderr: -62> 2023-12-03T11:49:42.997+0000 7f7ab32b7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:49:43.120 INFO:tasks.workunit.client.0.smithi003.stderr: -61> 2023-12-03T11:49:42.997+0000 7f7ab42b9640 10 monclient(hunting): handle_auth_done global_id 7296 payload 824 2023-12-03T11:49:43.120 INFO:tasks.workunit.client.0.smithi003.stderr: -60> 2023-12-03T11:49:42.997+0000 7f7ab42b9640 10 monclient: _finish_hunting 0 2023-12-03T11:49:43.120 INFO:tasks.workunit.client.0.smithi003.stderr: -59> 2023-12-03T11:49:42.997+0000 7f7ab42b9640 1 monclient: found mon.noname-a 2023-12-03T11:49:43.120 INFO:tasks.workunit.client.0.smithi003.stderr: -58> 2023-12-03T11:49:42.997+0000 7f7ab42b9640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.3:3300/0 2023-12-03T11:49:43.120 INFO:tasks.workunit.client.0.smithi003.stderr: -57> 2023-12-03T11:49:42.998+0000 7f79f37fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:49:43.120 INFO:tasks.workunit.client.0.smithi003.stderr: -56> 2023-12-03T11:49:42.998+0000 7f79f37fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-12-03T11:49:43.120 INFO:tasks.workunit.client.0.smithi003.stderr: -55> 2023-12-03T11:49:42.998+0000 7f79f37fe640 10 monclient: dump: 2023-12-03T11:49:43.120 INFO:tasks.workunit.client.0.smithi003.stderr:epoch 1 2023-12-03T11:49:43.120 INFO:tasks.workunit.client.0.smithi003.stderr:fsid 296556de-a4fc-4095-9b6d-0fe813c2865c 2023-12-03T11:49:43.121 INFO:tasks.workunit.client.0.smithi003.stderr:last_changed 2023-12-03T11:33:18.862564+0000 2023-12-03T11:49:43.121 INFO:tasks.workunit.client.0.smithi003.stderr:created 2023-12-03T11:33:18.862564+0000 2023-12-03T11:49:43.121 INFO:tasks.workunit.client.0.smithi003.stderr:min_mon_release 18 (reef) 2023-12-03T11:49:43.121 INFO:tasks.workunit.client.0.smithi003.stderr:election_strategy: 1 2023-12-03T11:49:43.121 INFO:tasks.workunit.client.0.smithi003.stderr:0: [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] mon.a 2023-12-03T11:49:43.121 INFO:tasks.workunit.client.0.smithi003.stderr:1: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.b 2023-12-03T11:49:43.121 INFO:tasks.workunit.client.0.smithi003.stderr:2: [v2:172.21.15.3:3301/0,v1:172.21.15.3:6790/0] mon.c 2023-12-03T11:49:43.121 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:49:43.121 INFO:tasks.workunit.client.0.smithi003.stderr: -54> 2023-12-03T11:49:42.998+0000 7f79f37fe640 10 monclient: _finish_auth 0 2023-12-03T11:49:43.121 INFO:tasks.workunit.client.0.smithi003.stderr: -53> 2023-12-03T11:49:42.998+0000 7f79f37fe640 10 monclient: _check_auth_tickets 2023-12-03T11:49:43.121 INFO:tasks.workunit.client.0.smithi003.stderr: -52> 2023-12-03T11:49:42.998+0000 7f79f37fe640 10 monclient: handle_config config(0 keys) v1 2023-12-03T11:49:43.121 INFO:tasks.workunit.client.0.smithi003.stderr: -51> 2023-12-03T11:49:42.998+0000 7f79f37fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:49:43.121 INFO:tasks.workunit.client.0.smithi003.stderr: -50> 2023-12-03T11:49:42.998+0000 7f79f37fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-12-03T11:49:43.121 INFO:tasks.workunit.client.0.smithi003.stderr: -49> 2023-12-03T11:49:42.998+0000 7f79f37fe640 10 monclient: dump: 2023-12-03T11:49:43.121 INFO:tasks.workunit.client.0.smithi003.stderr:epoch 1 2023-12-03T11:49:43.121 INFO:tasks.workunit.client.0.smithi003.stderr:fsid 296556de-a4fc-4095-9b6d-0fe813c2865c 2023-12-03T11:49:43.122 INFO:tasks.workunit.client.0.smithi003.stderr:last_changed 2023-12-03T11:33:18.862564+0000 2023-12-03T11:49:43.122 INFO:tasks.workunit.client.0.smithi003.stderr:created 2023-12-03T11:33:18.862564+0000 2023-12-03T11:49:43.122 INFO:tasks.workunit.client.0.smithi003.stderr:min_mon_release 18 (reef) 2023-12-03T11:49:43.122 INFO:tasks.workunit.client.0.smithi003.stderr:election_strategy: 1 2023-12-03T11:49:43.122 INFO:tasks.workunit.client.0.smithi003.stderr:0: [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] mon.a 2023-12-03T11:49:43.122 INFO:tasks.workunit.client.0.smithi003.stderr:1: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.b 2023-12-03T11:49:43.122 INFO:tasks.workunit.client.0.smithi003.stderr:2: [v2:172.21.15.3:3301/0,v1:172.21.15.3:6790/0] mon.c 2023-12-03T11:49:43.122 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:49:43.122 INFO:tasks.workunit.client.0.smithi003.stderr: -48> 2023-12-03T11:49:42.998+0000 7f7ab7d21800 5 monclient: authenticate success, global_id 7296 2023-12-03T11:49:43.122 INFO:tasks.workunit.client.0.smithi003.stderr: -47> 2023-12-03T11:49:42.998+0000 7f7a797e2640 4 set_mon_vals no callback set 2023-12-03T11:49:43.122 INFO:tasks.workunit.client.0.smithi003.stderr: -46> 2023-12-03T11:49:42.998+0000 7f7ab7d21800 10 monclient: _renew_subs 2023-12-03T11:49:43.122 INFO:tasks.workunit.client.0.smithi003.stderr: -45> 2023-12-03T11:49:42.998+0000 7f7ab7d21800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.3:3300/0 2023-12-03T11:49:43.122 INFO:tasks.workunit.client.0.smithi003.stderr: -44> 2023-12-03T11:49:42.998+0000 7f7ab7d21800 10 monclient: _renew_subs 2023-12-03T11:49:43.122 INFO:tasks.workunit.client.0.smithi003.stderr: -43> 2023-12-03T11:49:42.998+0000 7f7ab7d21800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.3:3300/0 2023-12-03T11:49:43.122 INFO:tasks.workunit.client.0.smithi003.stderr: -42> 2023-12-03T11:49:42.998+0000 7f7ab7d21800 1 librados: init done 2023-12-03T11:49:43.123 INFO:tasks.workunit.client.0.smithi003.stderr: -41> 2023-12-03T11:49:42.998+0000 7f7ab7d21800 5 asok(0x55afbf585a10) register_command cr dump hook 0x55afbf8273e8 2023-12-03T11:49:43.123 INFO:tasks.workunit.client.0.smithi003.stderr: -40> 2023-12-03T11:49:42.999+0000 7f79f37fe640 4 mgrc handle_mgr_map Got map version 5 2023-12-03T11:49:43.123 INFO:tasks.workunit.client.0.smithi003.stderr: -39> 2023-12-03T11:49:42.999+0000 7f79f37fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.37:6832/2165065416,v1:172.21.15.37:6833/2165065416] 2023-12-03T11:49:43.123 INFO:tasks.workunit.client.0.smithi003.stderr: -38> 2023-12-03T11:49:42.999+0000 7f79f37fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.37:6832/2165065416,v1:172.21.15.37:6833/2165065416] 2023-12-03T11:49:43.123 INFO:tasks.workunit.client.0.smithi003.stderr: -37> 2023-12-03T11:49:42.999+0000 7f7ab3ab8640 10 monclient: get_auth_request con 0x7f79e8069820 auth_method 0 2023-12-03T11:49:43.123 INFO:tasks.workunit.client.0.smithi003.stderr: -36> 2023-12-03T11:49:43.000+0000 7f7ab7d21800 5 note: GC not initialized 2023-12-03T11:49:43.123 INFO:tasks.workunit.client.0.smithi003.stderr: -35> 2023-12-03T11:49:43.000+0000 7f79f0ff9640 20 reqs_thread_entry: start 2023-12-03T11:49:43.123 INFO:tasks.workunit.client.0.smithi003.stderr: -34> 2023-12-03T11:49:43.000+0000 7f7ab7d21800 5 asok(0x55afbf585a10) register_command sync trace show hook 0x7f7aac0047e0 2023-12-03T11:49:43.123 INFO:tasks.workunit.client.0.smithi003.stderr: -33> 2023-12-03T11:49:43.000+0000 7f7ab7d21800 5 asok(0x55afbf585a10) register_command sync trace history hook 0x7f7aac0047e0 2023-12-03T11:49:43.123 INFO:tasks.workunit.client.0.smithi003.stderr: -32> 2023-12-03T11:49:43.000+0000 7f7ab7d21800 5 asok(0x55afbf585a10) register_command sync trace active hook 0x7f7aac0047e0 2023-12-03T11:49:43.123 INFO:tasks.workunit.client.0.smithi003.stderr: -31> 2023-12-03T11:49:43.000+0000 7f7ab7d21800 5 asok(0x55afbf585a10) register_command sync trace active_short hook 0x7f7aac0047e0 2023-12-03T11:49:43.123 INFO:tasks.workunit.client.0.smithi003.stderr: -30> 2023-12-03T11:49:43.000+0000 7f7ab7d21800 20 init_complete bucket index max shards: 11 2023-12-03T11:49:43.123 INFO:tasks.workunit.client.0.smithi003.stderr: -29> 2023-12-03T11:49:43.000+0000 7f7ab7d21800 20 Filter name: none 2023-12-03T11:49:43.123 INFO:tasks.workunit.client.0.smithi003.stderr: -28> 2023-12-03T11:49:43.000+0000 7f79e67fc640 20 reqs_thread_entry: start 2023-12-03T11:49:43.123 INFO:tasks.workunit.client.0.smithi003.stderr: -27> 2023-12-03T11:49:43.000+0000 7f7ab7d21800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2023-12-03T11:49:43.124 INFO:tasks.workunit.client.0.smithi003.stderr: -26> 2023-12-03T11:49:43.000+0000 7f7ab7d21800 20 rados->read ofs=0 len=0 2023-12-03T11:49:43.124 INFO:tasks.workunit.client.0.smithi003.stderr: -25> 2023-12-03T11:49:43.000+0000 7f7ab7d21800 20 rados_obj.operate() r=0 bl.length=211 2023-12-03T11:49:43.124 INFO:tasks.workunit.client.0.smithi003.stderr: -24> 2023-12-03T11:49:43.000+0000 7f7ab7d21800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2023-12-03T11:49:43.124 INFO:tasks.workunit.client.0.smithi003.stderr: -23> 2023-12-03T11:49:43.000+0000 7f7ab7d21800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2023-12-03T11:49:43.124 INFO:tasks.workunit.client.0.smithi003.stderr: -22> 2023-12-03T11:49:43.000+0000 7f7ab7d21800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.28 : miss 2023-12-03T11:49:43.124 INFO:tasks.workunit.client.0.smithi003.stderr: -21> 2023-12-03T11:49:43.000+0000 7f7ab7d21800 20 rados->read ofs=0 len=0 2023-12-03T11:49:43.124 INFO:tasks.workunit.client.0.smithi003.stderr: -20> 2023-12-03T11:49:43.001+0000 7f7ab7d21800 20 rados_obj.operate() r=0 bl.length=383 2023-12-03T11:49:43.124 INFO:tasks.workunit.client.0.smithi003.stderr: -19> 2023-12-03T11:49:43.001+0000 7f7ab7d21800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.28 info.flags=0x17 2023-12-03T11:49:43.124 INFO:tasks.workunit.client.0.smithi003.stderr: -18> 2023-12-03T11:49:43.001+0000 7f7ab7d21800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.28 to cache LRU end 2023-12-03T11:49:43.124 INFO:tasks.workunit.client.0.smithi003.stderr: -17> 2023-12-03T11:49:43.001+0000 7f7ab7d21800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:49:43.124 INFO:tasks.workunit.client.0.smithi003.stderr: -16> 2023-12-03T11:49:43.001+0000 7f7ab7d21800 10 updating xattr: name=user.rgw.acl bl.length()=265 2023-12-03T11:49:43.124 INFO:tasks.workunit.client.0.smithi003.stderr: -15> 2023-12-03T11:49:43.001+0000 7f7ab7d21800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.28 2023-12-03T11:49:43.124 INFO:tasks.workunit.client.0.smithi003.stderr: -14> 2023-12-03T11:49:43.001+0000 7f7ab32b7640 10 monclient: get_auth_request con 0x55afbf871a10 auth_method 0 2023-12-03T11:49:43.124 INFO:tasks.workunit.client.0.smithi003.stderr: -13> 2023-12-03T11:49:43.007+0000 7f7ab7d21800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.28 info.flags=0x17 2023-12-03T11:49:43.124 INFO:tasks.workunit.client.0.smithi003.stderr: -12> 2023-12-03T11:49:43.007+0000 7f7ab7d21800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.28 to cache LRU end 2023-12-03T11:49:43.125 INFO:tasks.workunit.client.0.smithi003.stderr: -11> 2023-12-03T11:49:43.007+0000 7f7ab7d21800 10 updating xattr: name=user.rgw.acl bl.length()=265 2023-12-03T11:49:43.125 INFO:tasks.workunit.client.0.smithi003.stderr: -10> 2023-12-03T11:49:43.007+0000 7f7ab7d21800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.28, ofs0, ns] 2023-12-03T11:49:43.125 INFO:tasks.workunit.client.0.smithi003.stderr: -9> 2023-12-03T11:49:43.007+0000 7f7a99ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660506 cookie 94213320384208 notifier 7290 bl.length()=945 2023-12-03T11:49:43.125 INFO:tasks.workunit.client.0.smithi003.stderr: -8> 2023-12-03T11:49:43.007+0000 7f7a99ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.28 info.flags=0x17 2023-12-03T11:49:43.125 INFO:tasks.workunit.client.0.smithi003.stderr: -7> 2023-12-03T11:49:43.007+0000 7f7a99ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.28 to cache LRU end 2023-12-03T11:49:43.125 INFO:tasks.workunit.client.0.smithi003.stderr: -6> 2023-12-03T11:49:43.007+0000 7f7a99ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2023-12-03T11:49:43.125 INFO:tasks.workunit.client.0.smithi003.stderr: -5> 2023-12-03T11:49:43.009+0000 7f7ab7d21800 20 handle_bi_update(): bucket=:abort-at-do-reshard[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.28]): orig_sources= new_sources= 2023-12-03T11:49:43.125 INFO:tasks.workunit.client.0.smithi003.stderr: -4> 2023-12-03T11:49:43.009+0000 7f7ab7d21800 20 handle_bi_update(): bucket=:abort-at-do-reshard[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.28]): potential sources added=[] removed=[] 2023-12-03T11:49:43.125 INFO:tasks.workunit.client.0.smithi003.stderr: -3> 2023-12-03T11:49:43.009+0000 7f7ab7d21800 20 handle_bi_update(): bucket=:abort-at-do-reshard[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.28]): orig_dests= new_dests= 2023-12-03T11:49:43.125 INFO:tasks.workunit.client.0.smithi003.stderr: -2> 2023-12-03T11:49:43.009+0000 7f7ab7d21800 20 handle_bi_update(): bucket=:abort-at-do-reshard[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.28]): potential dests added=[] removed=[] 2023-12-03T11:49:43.125 INFO:tasks.workunit.client.0.smithi003.stderr: -1> 2023-12-03T11:49:43.012+0000 7f7ab7d21800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7537-gbcbf278c/rpm/el9/BUILD/ceph-18.0.0-7537-gbcbf278c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f7ab7d21800 time 2023-12-03T11:49:43.012468+0000 2023-12-03T11:49:43.125 INFO:tasks.workunit.client.0.smithi003.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7537-gbcbf278c/rpm/el9/BUILD/ceph-18.0.0-7537-gbcbf278c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2023-12-03T11:49:43.125 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:49:43.125 INFO:tasks.workunit.client.0.smithi003.stderr: ceph version 18.0.0-7537-gbcbf278c (bcbf278cf395873c2a482f5a7b2345faf2160319) reef (dev) 2023-12-03T11:49:43.125 INFO:tasks.workunit.client.0.smithi003.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f7aba96eef8] 2023-12-03T11:49:43.126 INFO:tasks.workunit.client.0.smithi003.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f0b6) [0x7f7aba96f0b6] 2023-12-03T11:49:43.126 INFO:tasks.workunit.client.0.smithi003.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55afbce67a71] 2023-12-03T11:49:43.126 INFO:tasks.workunit.client.0.smithi003.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x314) [0x55afbce73f34] 2023-12-03T11:49:43.126 INFO:tasks.workunit.client.0.smithi003.stderr: 5: main() 2023-12-03T11:49:43.126 INFO:tasks.workunit.client.0.smithi003.stderr: 6: /lib64/libc.so.6(+0x3feb0) [0x7f7ab823feb0] 2023-12-03T11:49:43.126 INFO:tasks.workunit.client.0.smithi003.stderr: 7: __libc_start_main() 2023-12-03T11:49:43.126 INFO:tasks.workunit.client.0.smithi003.stderr: 8: _start() 2023-12-03T11:49:43.126 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:49:43.126 INFO:tasks.workunit.client.0.smithi003.stderr: 0> 2023-12-03T11:49:43.012+0000 7f7ab7d21800 -1 *** Caught signal (Aborted) ** 2023-12-03T11:49:43.126 INFO:tasks.workunit.client.0.smithi003.stderr: in thread 7f7ab7d21800 thread_name:radosgw-admin 2023-12-03T11:49:43.126 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:49:43.126 INFO:tasks.workunit.client.0.smithi003.stderr: ceph version 18.0.0-7537-gbcbf278c (bcbf278cf395873c2a482f5a7b2345faf2160319) reef (dev) 2023-12-03T11:49:43.126 INFO:tasks.workunit.client.0.smithi003.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f7ab8254db0] 2023-12-03T11:49:43.126 INFO:tasks.workunit.client.0.smithi003.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f7ab82a154c] 2023-12-03T11:49:43.127 INFO:tasks.workunit.client.0.smithi003.stderr: 3: raise() 2023-12-03T11:49:43.127 INFO:tasks.workunit.client.0.smithi003.stderr: 4: abort() 2023-12-03T11:49:43.127 INFO:tasks.workunit.client.0.smithi003.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f7aba96ef52] 2023-12-03T11:49:43.127 INFO:tasks.workunit.client.0.smithi003.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f0b6) [0x7f7aba96f0b6] 2023-12-03T11:49:43.127 INFO:tasks.workunit.client.0.smithi003.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55afbce67a71] 2023-12-03T11:49:43.127 INFO:tasks.workunit.client.0.smithi003.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x314) [0x55afbce73f34] 2023-12-03T11:49:43.127 INFO:tasks.workunit.client.0.smithi003.stderr: 9: main() 2023-12-03T11:49:43.127 INFO:tasks.workunit.client.0.smithi003.stderr: 10: /lib64/libc.so.6(+0x3feb0) [0x7f7ab823feb0] 2023-12-03T11:49:43.127 INFO:tasks.workunit.client.0.smithi003.stderr: 11: __libc_start_main() 2023-12-03T11:49:43.127 INFO:tasks.workunit.client.0.smithi003.stderr: 12: _start() 2023-12-03T11:49:43.127 INFO:tasks.workunit.client.0.smithi003.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-12-03T11:49:43.127 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:49:43.127 INFO:tasks.workunit.client.0.smithi003.stderr:--- logging levels --- 2023-12-03T11:49:43.127 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 none 2023-12-03T11:49:43.127 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 1 lockdep 2023-12-03T11:49:43.128 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 1 context 2023-12-03T11:49:43.128 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 1 crush 2023-12-03T11:49:43.128 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 mds 2023-12-03T11:49:43.128 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 mds_balancer 2023-12-03T11:49:43.128 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 mds_locker 2023-12-03T11:49:43.128 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 mds_log 2023-12-03T11:49:43.128 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 mds_log_expire 2023-12-03T11:49:43.128 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 mds_migrator 2023-12-03T11:49:43.128 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 1 buffer 2023-12-03T11:49:43.128 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 1 timer 2023-12-03T11:49:43.128 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 1 filer 2023-12-03T11:49:43.128 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 1 striper 2023-12-03T11:49:43.128 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 1 objecter 2023-12-03T11:49:43.128 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 rados 2023-12-03T11:49:43.128 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 rbd 2023-12-03T11:49:43.129 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 rbd_mirror 2023-12-03T11:49:43.129 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 rbd_replay 2023-12-03T11:49:43.129 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 rbd_pwl 2023-12-03T11:49:43.129 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 journaler 2023-12-03T11:49:43.129 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 objectcacher 2023-12-03T11:49:43.129 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 immutable_obj_cache 2023-12-03T11:49:43.129 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 client 2023-12-03T11:49:43.129 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 osd 2023-12-03T11:49:43.129 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 optracker 2023-12-03T11:49:43.129 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 objclass 2023-12-03T11:49:43.129 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 3 filestore 2023-12-03T11:49:43.129 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 3 journal 2023-12-03T11:49:43.129 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 0 ms 2023-12-03T11:49:43.129 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 mon 2023-12-03T11:49:43.129 INFO:tasks.workunit.client.0.smithi003.stderr: 0/10 monc 2023-12-03T11:49:43.129 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 paxos 2023-12-03T11:49:43.130 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 tp 2023-12-03T11:49:43.130 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 auth 2023-12-03T11:49:43.130 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 crypto 2023-12-03T11:49:43.130 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 1 finisher 2023-12-03T11:49:43.130 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 1 reserver 2023-12-03T11:49:43.130 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 heartbeatmap 2023-12-03T11:49:43.130 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 perfcounter 2023-12-03T11:49:43.130 INFO:tasks.workunit.client.0.smithi003.stderr: 20/20 rgw 2023-12-03T11:49:43.130 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 rgw_sync 2023-12-03T11:49:43.130 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 rgw_datacache 2023-12-03T11:49:43.130 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 rgw_access 2023-12-03T11:49:43.130 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 rgw_dbstore 2023-12-03T11:49:43.130 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 rgw_flight 2023-12-03T11:49:43.130 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 javaclient 2023-12-03T11:49:43.130 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 asok 2023-12-03T11:49:43.131 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 1 throttle 2023-12-03T11:49:43.131 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 0 refs 2023-12-03T11:49:43.131 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 compressor 2023-12-03T11:49:43.131 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 bluestore 2023-12-03T11:49:43.131 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 bluefs 2023-12-03T11:49:43.131 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 3 bdev 2023-12-03T11:49:43.131 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 kstore 2023-12-03T11:49:43.131 INFO:tasks.workunit.client.0.smithi003.stderr: 4/ 5 rocksdb 2023-12-03T11:49:43.131 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 fuse 2023-12-03T11:49:43.131 INFO:tasks.workunit.client.0.smithi003.stderr: 2/ 5 mgr 2023-12-03T11:49:43.131 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 mgrc 2023-12-03T11:49:43.131 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 dpdk 2023-12-03T11:49:43.131 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 eventtrace 2023-12-03T11:49:43.131 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 prioritycache 2023-12-03T11:49:43.131 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 test 2023-12-03T11:49:43.131 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 cephfs_mirror 2023-12-03T11:49:43.132 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 cephsqlite 2023-12-03T11:49:43.132 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 crimson_interrupt 2023-12-03T11:49:43.132 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 seastore 2023-12-03T11:49:43.132 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 seastore_onode 2023-12-03T11:49:43.132 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 seastore_odata 2023-12-03T11:49:43.132 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 seastore_omap 2023-12-03T11:49:43.132 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 seastore_tm 2023-12-03T11:49:43.132 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 seastore_t 2023-12-03T11:49:43.132 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 seastore_cleaner 2023-12-03T11:49:43.132 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 seastore_epm 2023-12-03T11:49:43.132 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 seastore_lba 2023-12-03T11:49:43.132 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 seastore_fixedkv_tree 2023-12-03T11:49:43.132 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 seastore_cache 2023-12-03T11:49:43.132 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 seastore_journal 2023-12-03T11:49:43.132 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 seastore_device 2023-12-03T11:49:43.132 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 seastore_backref 2023-12-03T11:49:43.133 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 alienstore 2023-12-03T11:49:43.133 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 mclock 2023-12-03T11:49:43.133 INFO:tasks.workunit.client.0.smithi003.stderr: 0/ 5 cyanstore 2023-12-03T11:49:43.133 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 ceph_exporter 2023-12-03T11:49:43.133 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 memstore 2023-12-03T11:49:43.133 INFO:tasks.workunit.client.0.smithi003.stderr: 1/ 5 trace 2023-12-03T11:49:43.133 INFO:tasks.workunit.client.0.smithi003.stderr: -2/-2 (syslog threshold) 2023-12-03T11:49:43.133 INFO:tasks.workunit.client.0.smithi003.stderr: 99/99 (stderr threshold) 2023-12-03T11:49:43.133 INFO:tasks.workunit.client.0.smithi003.stderr:--- pthread ID / name mapping for recent threads --- 2023-12-03T11:49:43.133 INFO:tasks.workunit.client.0.smithi003.stderr: 7f79e67fc640 / http_manager 2023-12-03T11:49:43.133 INFO:tasks.workunit.client.0.smithi003.stderr: 7f79f0ff9640 / http_manager 2023-12-03T11:49:43.133 INFO:tasks.workunit.client.0.smithi003.stderr: 7f79f37fe640 / ms_dispatch 2023-12-03T11:49:43.133 INFO:tasks.workunit.client.0.smithi003.stderr: 7f7a797e2640 / io_context_pool 2023-12-03T11:49:43.133 INFO:tasks.workunit.client.0.smithi003.stderr: 7f7a79fe3640 / rgw_dt_lg_renew 2023-12-03T11:49:43.133 INFO:tasks.workunit.client.0.smithi003.stderr: 7f7a98ff9640 / ms_dispatch 2023-12-03T11:49:43.133 INFO:tasks.workunit.client.0.smithi003.stderr: 7f7a99ffb640 / io_context_pool 2023-12-03T11:49:43.134 INFO:tasks.workunit.client.0.smithi003.stderr: 7f7a9a7fc640 / io_context_pool 2023-12-03T11:49:43.134 INFO:tasks.workunit.client.0.smithi003.stderr: 7f7ab12b3640 / ms_dispatch 2023-12-03T11:49:43.134 INFO:tasks.workunit.client.0.smithi003.stderr: 7f7ab32b7640 / msgr-worker-2 2023-12-03T11:49:43.134 INFO:tasks.workunit.client.0.smithi003.stderr: 7f7ab3ab8640 / msgr-worker-1 2023-12-03T11:49:43.134 INFO:tasks.workunit.client.0.smithi003.stderr: 7f7ab42b9640 / msgr-worker-0 2023-12-03T11:49:43.134 INFO:tasks.workunit.client.0.smithi003.stderr: 7f7ab7d21800 / radosgw-admin 2023-12-03T11:49:43.134 INFO:tasks.workunit.client.0.smithi003.stderr: max_recent 500 2023-12-03T11:49:43.134 INFO:tasks.workunit.client.0.smithi003.stderr: max_new 1000 2023-12-03T11:49:43.134 INFO:tasks.workunit.client.0.smithi003.stderr: log_file /var/lib/ceph/crash/2023-12-03T11:49:43.013816Z_233b54e6-e3ea-497c-9d2a-cd202538bd3d/log 2023-12-03T11:49:43.134 INFO:tasks.workunit.client.0.smithi003.stderr:--- end dump of recent events --- 2023-12-03T11:49:43.134 INFO:tasks.workunit.client.0.smithi003.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2023-12-03T11:49:43.139 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:49:43.139 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:49:43.139 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:43.061+0000 7f0799433800 20 rados->read ofs=0 len=0 2023-12-03T11:49:43.139 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:43.062+0000 7f0799433800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:43.140 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:43.062+0000 7f0799433800 20 realm 2023-12-03T11:49:43.140 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:43.062+0000 7f0799433800 20 rados->read ofs=0 len=0 2023-12-03T11:49:43.140 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:43.062+0000 7f0799433800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:43.140 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:43.062+0000 7f0799433800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:49:43.140 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:43.062+0000 7f0799433800 20 rados->read ofs=0 len=0 2023-12-03T11:49:43.140 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:43.063+0000 7f0799433800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:43.140 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:43.063+0000 7f0799433800 20 rados->read ofs=0 len=0 2023-12-03T11:49:43.140 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:43.063+0000 7f0799433800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:49:43.140 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:43.063+0000 7f0799433800 20 rados->read ofs=0 len=0 2023-12-03T11:49:43.140 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:43.064+0000 7f0799433800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:49:43.140 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:43.064+0000 7f0799433800 20 searching for the correct realm 2023-12-03T11:49:43.140 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:43.074+0000 7f0796f33640 0 -- 172.21.15.3:0/2965731143 >> [v2:172.21.15.37:6805/1692844418,v1:172.21.15.37:6807/1692844418] conn(0x5627e371cf30 msgr2=0x5627e371f320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:49:43.140 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:43.075+0000 7f0799433800 20 RGWRados::pool_iterate: got zone_info.83aabb46-04b5-4c96-9933-c6bfb1173a73 2023-12-03T11:49:43.140 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:43.075+0000 7f0799433800 20 RGWRados::pool_iterate: got zonegroup_info.6a811aad-435d-4fdd-93c9-b7e0b50de429 2023-12-03T11:49:43.140 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:43.075+0000 7f0799433800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:49:43.141 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:43.075+0000 7f0799433800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:49:43.141 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:43.075+0000 7f0799433800 20 rados->read ofs=0 len=0 2023-12-03T11:49:43.141 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:43.075+0000 7f0799433800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:43.141 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:43.075+0000 7f0799433800 20 rados->read ofs=0 len=0 2023-12-03T11:49:43.141 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:43.076+0000 7f0799433800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:49:43.141 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:43.076+0000 7f0799433800 20 rados->read ofs=0 len=0 2023-12-03T11:49:43.141 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:43.076+0000 7f0799433800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:49:43.141 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:43.076+0000 7f0799433800 20 zone default found 2023-12-03T11:49:43.141 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:43.076+0000 7f0799433800 4 Realm: () 2023-12-03T11:49:43.141 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:43.076+0000 7f0799433800 4 ZoneGroup: default (6a811aad-435d-4fdd-93c9-b7e0b50de429) 2023-12-03T11:49:43.141 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:43.076+0000 7f0799433800 4 Zone: default (83aabb46-04b5-4c96-9933-c6bfb1173a73) 2023-12-03T11:49:43.141 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:43.076+0000 7f0799433800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:49:43.141 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:43.076+0000 7f0799433800 20 zonegroup default 2023-12-03T11:49:43.141 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:43.076+0000 7f0799433800 20 rados->read ofs=0 len=0 2023-12-03T11:49:43.141 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:43.076+0000 7f0799433800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:43.142 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:43.076+0000 7f0799433800 20 rados->read ofs=0 len=0 2023-12-03T11:49:43.142 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:43.076+0000 7f0799433800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:43.142 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:43.076+0000 7f0799433800 20 rados->read ofs=0 len=0 2023-12-03T11:49:43.142 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:43.077+0000 7f0799433800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:43.142 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:43.077+0000 7f0799433800 20 started sync module instance, tier type = 2023-12-03T11:49:43.142 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:43.077+0000 7f0799433800 20 started zone id=83aabb46-04b5-4c96-9933-c6bfb1173a73 (name=default) with tier type = 2023-12-03T11:49:43.142 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:43.082+0000 7f0796f33640 0 -- 172.21.15.3:0/2965731143 >> [v2:172.21.15.3:6800/2373485412,v1:172.21.15.3:6801/2373485412] conn(0x7f079005e070 msgr2=0x7f0790053550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:49:43.142 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:43.086+0000 7f0799433800 20 add_watcher() i=0 2023-12-03T11:49:43.142 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:43.086+0000 7f0799433800 20 add_watcher() i=1 2023-12-03T11:49:43.142 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:43.086+0000 7f0799433800 20 add_watcher() i=2 2023-12-03T11:49:43.142 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:43.086+0000 7f0799433800 20 add_watcher() i=3 2023-12-03T11:49:43.142 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:43.086+0000 7f0799433800 20 add_watcher() i=4 2023-12-03T11:49:43.142 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:43.086+0000 7f0799433800 20 add_watcher() i=5 2023-12-03T11:49:43.142 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:43.086+0000 7f0799433800 20 add_watcher() i=6 2023-12-03T11:49:43.142 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:43.087+0000 7f0799433800 20 add_watcher() i=7 2023-12-03T11:49:43.143 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:43.087+0000 7f0799433800 2 all 8 watchers are set, enabling cache 2023-12-03T11:49:43.143 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:43.088+0000 7f06d7fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:49:43.143 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:43.089+0000 7f0799433800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:49:43.143 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:43.089+0000 7f0799433800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:49:43.143 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:43.095+0000 7f0799433800 5 note: GC not initialized 2023-12-03T11:49:43.143 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:43.095+0000 7f06c6ffd640 20 reqs_thread_entry: start 2023-12-03T11:49:43.143 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:43.095+0000 7f0799433800 20 init_complete bucket index max shards: 11 2023-12-03T11:49:43.143 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:43.095+0000 7f0799433800 20 Filter name: none 2023-12-03T11:49:43.143 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:43.095+0000 7f06c4ff9640 20 reqs_thread_entry: start 2023-12-03T11:49:43.143 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:43.095+0000 7f0799433800 20 rados->read ofs=0 len=0 2023-12-03T11:49:43.143 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:43.095+0000 7f0799433800 20 rados_obj.operate() r=0 bl.length=211 2023-12-03T11:49:43.143 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:43.096+0000 7f0799433800 20 rados->read ofs=0 len=0 2023-12-03T11:49:43.143 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:43.096+0000 7f0799433800 20 rados_obj.operate() r=0 bl.length=415 2023-12-03T11:49:43.143 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:43.096+0000 7f0799433800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:49:43.143 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:43.096+0000 7f0799433800 20 rados->read ofs=0 len=0 2023-12-03T11:49:43.144 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:43.096+0000 7f0799433800 20 rados_obj.operate() r=0 bl.length=211 2023-12-03T11:49:43.144 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:43.096+0000 7f0799433800 20 rados->read ofs=0 len=0 2023-12-03T11:49:43.144 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:43.097+0000 7f0799433800 20 rados_obj.operate() r=0 bl.length=415 2023-12-03T11:49:43.144 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:43.097+0000 7f0799433800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:49:43.144 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:43.098+0000 7f0799433800 20 rados->read ofs=0 len=0 2023-12-03T11:49:43.144 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:43.098+0000 7f0799433800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:49:43.144 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:43.099+0000 7f06d7fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:49:43.144 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:43.102+0000 7f0799433800 20 remove_watcher() i=0 2023-12-03T11:49:43.144 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:43.102+0000 7f0799433800 2 removed watcher, disabling cache 2023-12-03T11:49:43.144 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:43.103+0000 7f0799433800 20 remove_watcher() i=1 2023-12-03T11:49:43.144 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:43.104+0000 7f0799433800 20 remove_watcher() i=2 2023-12-03T11:49:43.144 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:43.105+0000 7f0799433800 20 remove_watcher() i=3 2023-12-03T11:49:43.144 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:43.106+0000 7f0799433800 20 remove_watcher() i=4 2023-12-03T11:49:43.144 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:43.107+0000 7f0799433800 20 remove_watcher() i=5 2023-12-03T11:49:43.144 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:43.108+0000 7f0799433800 20 remove_watcher() i=6 2023-12-03T11:49:43.145 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:49:43.109+0000 7f0799433800 20 remove_watcher() i=7 2023-12-03T11:49:43.145 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:49:43.145 INFO:tasks.workunit.client.0.smithi003.stderr:BUCKET_STATS: 2023-12-03T11:49:43.145 INFO:tasks.workunit.client.0.smithi003.stderr:bucket: abort-at-do-reshard id: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.28 num_objects: 20 size_kb: 1 num_shards: 11 2023-12-03T11:49:43.145 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:50:13.292 INFO:tasks.workunit.client.0.smithi003.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2023-12-03T11:50:13.324 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:50:13.324 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:50:13.340 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.339+0000 7f8216326800 20 rados->read ofs=0 len=0 2023-12-03T11:50:13.342 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.340+0000 7f8216326800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:50:13.342 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.340+0000 7f8216326800 20 realm 2023-12-03T11:50:13.342 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.340+0000 7f8216326800 20 rados->read ofs=0 len=0 2023-12-03T11:50:13.342 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.340+0000 7f8216326800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:50:13.342 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.340+0000 7f8216326800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:50:13.342 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.340+0000 7f8216326800 20 rados->read ofs=0 len=0 2023-12-03T11:50:13.342 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.340+0000 7f8216326800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:50:13.342 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.340+0000 7f8216326800 20 rados->read ofs=0 len=0 2023-12-03T11:50:13.343 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.341+0000 7f8216326800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:50:13.343 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.341+0000 7f8216326800 20 rados->read ofs=0 len=0 2023-12-03T11:50:13.343 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.342+0000 7f8216326800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:50:13.343 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.342+0000 7f8216326800 20 searching for the correct realm 2023-12-03T11:50:13.355 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.353+0000 7f821179b640 0 -- 172.21.15.3:0/559992215 >> [v2:172.21.15.3:6817/3356208405,v1:172.21.15.3:6819/3356208405] conn(0x5617950b1ba0 msgr2=0x5617950b3f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:50:13.355 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.354+0000 7f8216326800 20 RGWRados::pool_iterate: got zone_info.83aabb46-04b5-4c96-9933-c6bfb1173a73 2023-12-03T11:50:13.355 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.354+0000 7f8216326800 20 RGWRados::pool_iterate: got zonegroup_info.6a811aad-435d-4fdd-93c9-b7e0b50de429 2023-12-03T11:50:13.355 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.354+0000 7f8216326800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:50:13.356 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.354+0000 7f8216326800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:50:13.356 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.354+0000 7f8216326800 20 rados->read ofs=0 len=0 2023-12-03T11:50:13.357 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.354+0000 7f8216326800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:50:13.357 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.354+0000 7f8216326800 20 rados->read ofs=0 len=0 2023-12-03T11:50:13.357 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.355+0000 7f8216326800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:50:13.357 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.355+0000 7f8216326800 20 rados->read ofs=0 len=0 2023-12-03T11:50:13.357 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.355+0000 7f8216326800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:50:13.357 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.355+0000 7f8216326800 20 zone default found 2023-12-03T11:50:13.357 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.355+0000 7f8216326800 4 Realm: () 2023-12-03T11:50:13.357 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.355+0000 7f8216326800 4 ZoneGroup: default (6a811aad-435d-4fdd-93c9-b7e0b50de429) 2023-12-03T11:50:13.357 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.355+0000 7f8216326800 4 Zone: default (83aabb46-04b5-4c96-9933-c6bfb1173a73) 2023-12-03T11:50:13.357 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.355+0000 7f8216326800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:50:13.357 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.355+0000 7f8216326800 20 zonegroup default 2023-12-03T11:50:13.357 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.355+0000 7f8216326800 20 rados->read ofs=0 len=0 2023-12-03T11:50:13.357 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.355+0000 7f8216326800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:50:13.357 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.355+0000 7f8216326800 20 rados->read ofs=0 len=0 2023-12-03T11:50:13.358 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.356+0000 7f8216326800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:50:13.358 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.356+0000 7f8216326800 20 rados->read ofs=0 len=0 2023-12-03T11:50:13.358 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.356+0000 7f8216326800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:50:13.358 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.356+0000 7f8216326800 20 started sync module instance, tier type = 2023-12-03T11:50:13.359 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.356+0000 7f8216326800 20 started zone id=83aabb46-04b5-4c96-9933-c6bfb1173a73 (name=default) with tier type = 2023-12-03T11:50:13.365 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.364+0000 7f821179b640 0 -- 172.21.15.3:0/559992215 >> [v2:172.21.15.3:6817/3356208405,v1:172.21.15.3:6819/3356208405] conn(0x7f81ec079d90 msgr2=0x7f81ec07c1c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-03T11:50:13.368 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.366+0000 7f8216326800 20 add_watcher() i=0 2023-12-03T11:50:13.368 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.366+0000 7f8216326800 20 add_watcher() i=1 2023-12-03T11:50:13.368 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.366+0000 7f8216326800 20 add_watcher() i=2 2023-12-03T11:50:13.368 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.366+0000 7f8216326800 20 add_watcher() i=3 2023-12-03T11:50:13.368 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.366+0000 7f8216326800 20 add_watcher() i=4 2023-12-03T11:50:13.368 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.366+0000 7f8216326800 20 add_watcher() i=5 2023-12-03T11:50:13.368 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.366+0000 7f8216326800 20 add_watcher() i=6 2023-12-03T11:50:13.368 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.367+0000 7f8216326800 20 add_watcher() i=7 2023-12-03T11:50:13.368 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.367+0000 7f8216326800 2 all 8 watchers are set, enabling cache 2023-12-03T11:50:13.370 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.369+0000 7f81d77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:50:13.370 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.369+0000 7f8216326800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:50:13.370 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.369+0000 7f8216326800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:50:13.378 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.375+0000 7f8216326800 5 note: GC not initialized 2023-12-03T11:50:13.378 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.376+0000 7f81467fc640 20 reqs_thread_entry: start 2023-12-03T11:50:13.378 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.376+0000 7f8216326800 20 init_complete bucket index max shards: 11 2023-12-03T11:50:13.378 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.376+0000 7f8216326800 20 Filter name: none 2023-12-03T11:50:13.378 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.376+0000 7f8137fff640 20 reqs_thread_entry: start 2023-12-03T11:50:13.378 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.376+0000 7f8216326800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2023-12-03T11:50:13.378 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.376+0000 7f8216326800 20 rados->read ofs=0 len=0 2023-12-03T11:50:13.378 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.376+0000 7f8216326800 20 rados_obj.operate() r=0 bl.length=211 2023-12-03T11:50:13.378 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.376+0000 7f8216326800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2023-12-03T11:50:13.378 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.376+0000 7f8216326800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2023-12-03T11:50:13.378 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.376+0000 7f8216326800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.28 : miss 2023-12-03T11:50:13.378 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.376+0000 7f8216326800 20 rados->read ofs=0 len=0 2023-12-03T11:50:13.379 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.377+0000 7f8216326800 20 rados_obj.operate() r=0 bl.length=383 2023-12-03T11:50:13.379 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.377+0000 7f8216326800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.28 info.flags=0x17 2023-12-03T11:50:13.379 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.377+0000 7f8216326800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.28 to cache LRU end 2023-12-03T11:50:13.379 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.377+0000 7f8216326800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:50:13.379 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.377+0000 7f8216326800 10 updating xattr: name=user.rgw.acl bl.length()=265 2023-12-03T11:50:13.379 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.377+0000 7f8216326800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.28 2023-12-03T11:50:13.384 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.383+0000 7f8216326800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.28 info.flags=0x17 2023-12-03T11:50:13.384 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.383+0000 7f8216326800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.28 to cache LRU end 2023-12-03T11:50:13.384 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.383+0000 7f8216326800 10 updating xattr: name=user.rgw.acl bl.length()=265 2023-12-03T11:50:13.384 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.383+0000 7f8216326800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.28, ofs0, ns] 2023-12-03T11:50:13.385 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.383+0000 7f81f3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660508 cookie 94659284786864 notifier 7329 bl.length()=945 2023-12-03T11:50:13.385 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.383+0000 7f81f3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.28 info.flags=0x17 2023-12-03T11:50:13.385 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.383+0000 7f81f3fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.28 to cache LRU end 2023-12-03T11:50:13.385 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.383+0000 7f81f3fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2023-12-03T11:50:13.386 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.385+0000 7f8216326800 20 handle_bi_update(): bucket=:abort-at-do-reshard[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.28]): orig_sources= new_sources= 2023-12-03T11:50:13.386 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.385+0000 7f8216326800 20 handle_bi_update(): bucket=:abort-at-do-reshard[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.28]): potential sources added=[] removed=[] 2023-12-03T11:50:13.386 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.385+0000 7f8216326800 20 handle_bi_update(): bucket=:abort-at-do-reshard[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.28]): orig_dests= new_dests= 2023-12-03T11:50:13.386 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.385+0000 7f8216326800 20 handle_bi_update(): bucket=:abort-at-do-reshard[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.28]): potential dests added=[] removed=[] 2023-12-03T11:50:13.389 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.388+0000 7f8216326800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.28.1.0 2023-12-03T11:50:13.390 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.388+0000 7f8216326800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.28.1.0 2023-12-03T11:50:13.390 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.388+0000 7f8216326800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.28.1.1 2023-12-03T11:50:13.390 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.388+0000 7f8216326800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.28.1.1 2023-12-03T11:50:13.390 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.388+0000 7f8216326800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.28.1.2 2023-12-03T11:50:13.390 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.388+0000 7f8216326800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.28.1.2 2023-12-03T11:50:13.390 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.388+0000 7f8216326800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.28.1.3 2023-12-03T11:50:13.390 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.388+0000 7f8216326800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.28.1.3 2023-12-03T11:50:13.390 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.388+0000 7f8216326800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.28.1.4 2023-12-03T11:50:13.390 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.388+0000 7f8216326800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.28.1.4 2023-12-03T11:50:13.390 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.388+0000 7f8216326800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.28.1.5 2023-12-03T11:50:13.390 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.388+0000 7f8216326800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.28.1.5 2023-12-03T11:50:13.390 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.388+0000 7f8216326800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.28.1.6 2023-12-03T11:50:13.390 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.388+0000 7f8216326800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.28.1.6 2023-12-03T11:50:13.390 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.388+0000 7f8216326800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.28.1.7 2023-12-03T11:50:13.391 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.388+0000 7f8216326800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.28.1.7 2023-12-03T11:50:13.391 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.388+0000 7f8216326800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.28.1.8 2023-12-03T11:50:13.391 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.388+0000 7f8216326800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.28.1.8 2023-12-03T11:50:13.391 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.388+0000 7f8216326800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.28.1.9 2023-12-03T11:50:13.391 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.388+0000 7f8216326800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.28.1.9 2023-12-03T11:50:13.391 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.388+0000 7f8216326800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.28.1.10 2023-12-03T11:50:13.391 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.388+0000 7f8216326800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.28.1.10 2023-12-03T11:50:13.391 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.388+0000 7f8216326800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.28.1.11 2023-12-03T11:50:13.391 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.388+0000 7f8216326800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.28.1.11 2023-12-03T11:50:13.391 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.388+0000 7f8216326800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.28.0 2023-12-03T11:50:13.391 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.388+0000 7f8216326800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.28.1 2023-12-03T11:50:13.392 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.389+0000 7f8216326800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.28.2 2023-12-03T11:50:13.392 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.389+0000 7f8216326800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.28.3 2023-12-03T11:50:13.392 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.389+0000 7f8216326800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.28.4 2023-12-03T11:50:13.392 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.390+0000 7f8216326800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.28.5 2023-12-03T11:50:13.392 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.390+0000 7f8216326800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.28.6 2023-12-03T11:50:13.392 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.391+0000 7f8216326800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.28.7 2023-12-03T11:50:13.393 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.392+0000 7f8216326800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.28.8 2023-12-03T11:50:13.393 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.392+0000 7f8216326800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.28.9 2023-12-03T11:50:13.394 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.393+0000 7f8216326800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.28.10 2023-12-03T11:50:13.397 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.396+0000 7f8216326800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.28 : hit (requested=0x17, cached=0x17) 2023-12-03T11:50:13.397 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.396+0000 7f8216326800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.28 2023-12-03T11:50:13.398 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.397+0000 7f8216326800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.28 info.flags=0x17 2023-12-03T11:50:13.398 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.397+0000 7f8216326800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.28 to cache LRU end 2023-12-03T11:50:13.399 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.397+0000 7f8216326800 10 updating xattr: name=user.rgw.acl bl.length()=265 2023-12-03T11:50:13.399 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.397+0000 7f8216326800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.28, ofs0, ns] 2023-12-03T11:50:13.399 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.397+0000 7f81f3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660509 cookie 94659284786864 notifier 7329 bl.length()=913 2023-12-03T11:50:13.399 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.397+0000 7f81f3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.28 info.flags=0x17 2023-12-03T11:50:13.399 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.397+0000 7f81f3fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.28 to cache LRU end 2023-12-03T11:50:13.399 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.397+0000 7f81f3fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2023-12-03T11:50:13.400 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.399+0000 7f8216326800 20 handle_bi_update(): bucket=:abort-at-do-reshard[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.28]): orig_sources= new_sources= 2023-12-03T11:50:13.400 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.399+0000 7f8216326800 20 handle_bi_update(): bucket=:abort-at-do-reshard[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.28]): potential sources added=[] removed=[] 2023-12-03T11:50:13.400 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.399+0000 7f8216326800 20 handle_bi_update(): bucket=:abort-at-do-reshard[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.28]): orig_dests= new_dests= 2023-12-03T11:50:13.401 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.399+0000 7f8216326800 20 handle_bi_update(): bucket=:abort-at-do-reshard[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.28]): potential dests added=[] removed=[] 2023-12-03T11:50:13.403 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.401+0000 7f8216326800 1 execute INFO: reshard of bucket "abort-at-do-reshard" completed successfully 2023-12-03T11:50:13.404 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.403+0000 7f81d77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:50:13.407 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.407+0000 7f8216326800 20 remove_watcher() i=0 2023-12-03T11:50:13.407 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.407+0000 7f8216326800 2 removed watcher, disabling cache 2023-12-03T11:50:13.408 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.407+0000 7f8216326800 20 remove_watcher() i=1 2023-12-03T11:50:13.409 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.408+0000 7f8216326800 20 remove_watcher() i=2 2023-12-03T11:50:13.410 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.409+0000 7f8216326800 20 remove_watcher() i=3 2023-12-03T11:50:13.411 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.410+0000 7f8216326800 20 remove_watcher() i=4 2023-12-03T11:50:13.412 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.411+0000 7f8216326800 20 remove_watcher() i=5 2023-12-03T11:50:13.413 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.412+0000 7f8216326800 20 remove_watcher() i=6 2023-12-03T11:50:13.414 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.413+0000 7f8216326800 20 remove_watcher() i=7 2023-12-03T11:50:13.420 INFO:tasks.workunit.client.0.smithi003.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2023-12-03T11:50:13.448 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:50:13.448 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:50:13.462 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.461+0000 7f0ca2335800 20 rados->read ofs=0 len=0 2023-12-03T11:50:13.464 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.462+0000 7f0ca2335800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:50:13.464 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.462+0000 7f0ca2335800 20 realm 2023-12-03T11:50:13.464 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.462+0000 7f0ca2335800 20 rados->read ofs=0 len=0 2023-12-03T11:50:13.464 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.463+0000 7f0ca2335800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:50:13.464 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.463+0000 7f0ca2335800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:50:13.464 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.463+0000 7f0ca2335800 20 rados->read ofs=0 len=0 2023-12-03T11:50:13.464 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.463+0000 7f0ca2335800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:50:13.465 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.463+0000 7f0ca2335800 20 rados->read ofs=0 len=0 2023-12-03T11:50:13.465 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.464+0000 7f0ca2335800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:50:13.465 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.464+0000 7f0ca2335800 20 rados->read ofs=0 len=0 2023-12-03T11:50:13.465 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.464+0000 7f0ca2335800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:50:13.466 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.464+0000 7f0ca2335800 20 searching for the correct realm 2023-12-03T11:50:13.476 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.475+0000 7f0c957dd640 0 -- 172.21.15.3:0/4118321605 >> [v2:172.21.15.3:6817/3356208405,v1:172.21.15.3:6819/3356208405] conn(0x56120a8ec9c0 msgr2=0x56120a8eee30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:50:13.477 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.476+0000 7f0ca2335800 20 RGWRados::pool_iterate: got zone_info.83aabb46-04b5-4c96-9933-c6bfb1173a73 2023-12-03T11:50:13.477 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.476+0000 7f0ca2335800 20 RGWRados::pool_iterate: got zonegroup_info.6a811aad-435d-4fdd-93c9-b7e0b50de429 2023-12-03T11:50:13.477 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.476+0000 7f0ca2335800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:50:13.477 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.476+0000 7f0ca2335800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:50:13.477 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.476+0000 7f0ca2335800 20 rados->read ofs=0 len=0 2023-12-03T11:50:13.477 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.476+0000 7f0ca2335800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:50:13.477 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.476+0000 7f0ca2335800 20 rados->read ofs=0 len=0 2023-12-03T11:50:13.478 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.476+0000 7f0ca2335800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:50:13.479 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.476+0000 7f0ca2335800 20 rados->read ofs=0 len=0 2023-12-03T11:50:13.479 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.476+0000 7f0ca2335800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:50:13.479 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.476+0000 7f0ca2335800 20 zone default found 2023-12-03T11:50:13.479 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.476+0000 7f0ca2335800 4 Realm: () 2023-12-03T11:50:13.479 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.476+0000 7f0ca2335800 4 ZoneGroup: default (6a811aad-435d-4fdd-93c9-b7e0b50de429) 2023-12-03T11:50:13.479 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.476+0000 7f0ca2335800 4 Zone: default (83aabb46-04b5-4c96-9933-c6bfb1173a73) 2023-12-03T11:50:13.479 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.476+0000 7f0ca2335800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:50:13.479 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.476+0000 7f0ca2335800 20 zonegroup default 2023-12-03T11:50:13.479 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.476+0000 7f0ca2335800 20 rados->read ofs=0 len=0 2023-12-03T11:50:13.479 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.477+0000 7f0ca2335800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:50:13.479 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.477+0000 7f0ca2335800 20 rados->read ofs=0 len=0 2023-12-03T11:50:13.479 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.477+0000 7f0ca2335800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:50:13.479 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.477+0000 7f0ca2335800 20 rados->read ofs=0 len=0 2023-12-03T11:50:13.479 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.477+0000 7f0ca2335800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:50:13.480 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.477+0000 7f0ca2335800 20 started sync module instance, tier type = 2023-12-03T11:50:13.480 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.477+0000 7f0ca2335800 20 started zone id=83aabb46-04b5-4c96-9933-c6bfb1173a73 (name=default) with tier type = 2023-12-03T11:50:13.486 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.485+0000 7f0c957dd640 0 -- 172.21.15.3:0/4118321605 >> [v2:172.21.15.3:6817/3356208405,v1:172.21.15.3:6819/3356208405] conn(0x7f0c78079d90 msgr2=0x7f0c7807c1c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:50:13.488 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.487+0000 7f0ca2335800 20 add_watcher() i=0 2023-12-03T11:50:13.488 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.487+0000 7f0ca2335800 20 add_watcher() i=1 2023-12-03T11:50:13.488 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.487+0000 7f0ca2335800 20 add_watcher() i=2 2023-12-03T11:50:13.488 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.487+0000 7f0ca2335800 20 add_watcher() i=3 2023-12-03T11:50:13.488 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.487+0000 7f0ca2335800 20 add_watcher() i=4 2023-12-03T11:50:13.488 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.487+0000 7f0ca2335800 20 add_watcher() i=5 2023-12-03T11:50:13.489 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.487+0000 7f0ca2335800 20 add_watcher() i=6 2023-12-03T11:50:13.489 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.488+0000 7f0ca2335800 20 add_watcher() i=7 2023-12-03T11:50:13.489 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.488+0000 7f0ca2335800 2 all 8 watchers are set, enabling cache 2023-12-03T11:50:13.491 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.490+0000 7f0c637e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:50:13.491 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.490+0000 7f0ca2335800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:50:13.491 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.490+0000 7f0ca2335800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:50:13.501 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.498+0000 7f0ca2335800 5 note: GC not initialized 2023-12-03T11:50:13.501 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.499+0000 7f0bd27fc640 20 reqs_thread_entry: start 2023-12-03T11:50:13.501 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.499+0000 7f0ca2335800 20 init_complete bucket index max shards: 11 2023-12-03T11:50:13.501 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.499+0000 7f0ca2335800 20 Filter name: none 2023-12-03T11:50:13.501 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.499+0000 7f0bc3fff640 20 reqs_thread_entry: start 2023-12-03T11:50:13.501 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.499+0000 7f0ca2335800 20 rados->read ofs=0 len=0 2023-12-03T11:50:13.501 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.499+0000 7f0ca2335800 20 rados_obj.operate() r=0 bl.length=211 2023-12-03T11:50:13.501 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.499+0000 7f0ca2335800 20 rados->read ofs=0 len=0 2023-12-03T11:50:13.502 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.500+0000 7f0ca2335800 20 rados_obj.operate() r=0 bl.length=383 2023-12-03T11:50:13.502 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.500+0000 7f0ca2335800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:50:13.502 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.500+0000 7f0ca2335800 20 rados->read ofs=0 len=0 2023-12-03T11:50:13.502 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.500+0000 7f0ca2335800 20 rados_obj.operate() r=0 bl.length=211 2023-12-03T11:50:13.503 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.500+0000 7f0ca2335800 20 rados->read ofs=0 len=0 2023-12-03T11:50:13.503 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.501+0000 7f0ca2335800 20 rados_obj.operate() r=0 bl.length=383 2023-12-03T11:50:13.503 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.501+0000 7f0ca2335800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:50:13.506 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.502+0000 7f0ca2335800 20 rados->read ofs=0 len=0 2023-12-03T11:50:13.506 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.502+0000 7f0ca2335800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:50:13.506 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.503+0000 7f0c637e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:50:13.507 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.506+0000 7f0ca2335800 20 remove_watcher() i=0 2023-12-03T11:50:13.507 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.506+0000 7f0ca2335800 2 removed watcher, disabling cache 2023-12-03T11:50:13.507 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.507+0000 7f0ca2335800 20 remove_watcher() i=1 2023-12-03T11:50:13.508 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.508+0000 7f0ca2335800 20 remove_watcher() i=2 2023-12-03T11:50:13.509 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.508+0000 7f0ca2335800 20 remove_watcher() i=3 2023-12-03T11:50:13.511 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.509+0000 7f0ca2335800 20 remove_watcher() i=4 2023-12-03T11:50:13.512 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.511+0000 7f0ca2335800 20 remove_watcher() i=5 2023-12-03T11:50:13.513 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.512+0000 7f0ca2335800 20 remove_watcher() i=6 2023-12-03T11:50:13.514 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.513+0000 7f0ca2335800 20 remove_watcher() i=7 2023-12-03T11:50:13.518 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:50:13.518 INFO:tasks.workunit.client.0.smithi003.stderr:BUCKET_STATS: 2023-12-03T11:50:13.519 INFO:tasks.workunit.client.0.smithi003.stderr:bucket: abort-at-do-reshard id: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.28 num_objects: 19 size_kb: 1 num_shards: 12 2023-12-03T11:50:13.519 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:50:13.824 INFO:tasks.workunit.client.0.smithi003.stderr: test: reshard versioned bucket 2023-12-03T11:50:13.825 INFO:tasks.workunit.client.0.smithi003.stderr:radosgw-admin bucket stats --bucket myver 2023-12-03T11:50:13.853 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:50:13.853 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:50:13.867 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.866+0000 7f2473938800 20 rados->read ofs=0 len=0 2023-12-03T11:50:13.869 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.868+0000 7f2473938800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:50:13.870 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.868+0000 7f2473938800 20 realm 2023-12-03T11:50:13.870 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.868+0000 7f2473938800 20 rados->read ofs=0 len=0 2023-12-03T11:50:13.870 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.868+0000 7f2473938800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:50:13.870 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.868+0000 7f2473938800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:50:13.870 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.868+0000 7f2473938800 20 rados->read ofs=0 len=0 2023-12-03T11:50:13.870 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.868+0000 7f2473938800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:50:13.870 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.868+0000 7f2473938800 20 rados->read ofs=0 len=0 2023-12-03T11:50:13.870 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.869+0000 7f2473938800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:50:13.870 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.869+0000 7f2473938800 20 rados->read ofs=0 len=0 2023-12-03T11:50:13.871 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.870+0000 7f2473938800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:50:13.871 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.870+0000 7f2473938800 20 searching for the correct realm 2023-12-03T11:50:13.880 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.879+0000 7f246f606640 0 -- 172.21.15.3:0/3667671131 >> [v2:172.21.15.3:6800/2373485412,v1:172.21.15.3:6801/2373485412] conn(0x7f2468057b70 msgr2=0x7f246801aa70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-03T11:50:13.882 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.880+0000 7f2473938800 20 RGWRados::pool_iterate: got zone_info.83aabb46-04b5-4c96-9933-c6bfb1173a73 2023-12-03T11:50:13.882 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.880+0000 7f2473938800 20 RGWRados::pool_iterate: got zonegroup_info.6a811aad-435d-4fdd-93c9-b7e0b50de429 2023-12-03T11:50:13.882 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.880+0000 7f2473938800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:50:13.882 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.880+0000 7f2473938800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:50:13.882 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.880+0000 7f2473938800 20 rados->read ofs=0 len=0 2023-12-03T11:50:13.882 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.881+0000 7f2473938800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:50:13.882 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.881+0000 7f2473938800 20 rados->read ofs=0 len=0 2023-12-03T11:50:13.883 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.881+0000 7f2473938800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:50:13.883 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.881+0000 7f2473938800 20 rados->read ofs=0 len=0 2023-12-03T11:50:13.883 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.881+0000 7f2473938800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:50:13.883 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.882+0000 7f2473938800 20 zone default found 2023-12-03T11:50:13.883 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.882+0000 7f2473938800 4 Realm: () 2023-12-03T11:50:13.883 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.882+0000 7f2473938800 4 ZoneGroup: default (6a811aad-435d-4fdd-93c9-b7e0b50de429) 2023-12-03T11:50:13.883 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.882+0000 7f2473938800 4 Zone: default (83aabb46-04b5-4c96-9933-c6bfb1173a73) 2023-12-03T11:50:13.884 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.882+0000 7f2473938800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:50:13.884 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.882+0000 7f2473938800 20 zonegroup default 2023-12-03T11:50:13.884 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.882+0000 7f2473938800 20 rados->read ofs=0 len=0 2023-12-03T11:50:13.884 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.882+0000 7f2473938800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:50:13.884 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.882+0000 7f2473938800 20 rados->read ofs=0 len=0 2023-12-03T11:50:13.884 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.882+0000 7f2473938800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:50:13.884 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.882+0000 7f2473938800 20 rados->read ofs=0 len=0 2023-12-03T11:50:13.885 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.882+0000 7f2473938800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:50:13.885 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.882+0000 7f2473938800 20 started sync module instance, tier type = 2023-12-03T11:50:13.885 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.882+0000 7f2473938800 20 started zone id=83aabb46-04b5-4c96-9933-c6bfb1173a73 (name=default) with tier type = 2023-12-03T11:50:13.888 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.887+0000 7f246fe07640 0 -- 172.21.15.3:0/3667671131 >> [v2:172.21.15.37:6816/3770469300,v1:172.21.15.37:6818/3770469300] conn(0x7f2464053030 msgr2=0x7f246407d3e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-03T11:50:13.893 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.892+0000 7f2473938800 20 add_watcher() i=0 2023-12-03T11:50:13.893 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.892+0000 7f2473938800 20 add_watcher() i=1 2023-12-03T11:50:13.893 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.892+0000 7f2473938800 20 add_watcher() i=2 2023-12-03T11:50:13.893 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.892+0000 7f2473938800 20 add_watcher() i=3 2023-12-03T11:50:13.893 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.892+0000 7f2473938800 20 add_watcher() i=4 2023-12-03T11:50:13.893 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.892+0000 7f2473938800 20 add_watcher() i=5 2023-12-03T11:50:13.893 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.892+0000 7f2473938800 20 add_watcher() i=6 2023-12-03T11:50:13.894 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.893+0000 7f2473938800 20 add_watcher() i=7 2023-12-03T11:50:13.894 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.893+0000 7f2473938800 2 all 8 watchers are set, enabling cache 2023-12-03T11:50:13.896 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.894+0000 7f24357e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:50:13.896 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.895+0000 7f2473938800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:50:13.896 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.895+0000 7f2473938800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:50:13.902 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.901+0000 7f2473938800 5 note: GC not initialized 2023-12-03T11:50:13.902 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.901+0000 7f23a3fff640 20 reqs_thread_entry: start 2023-12-03T11:50:13.903 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.901+0000 7f2473938800 20 init_complete bucket index max shards: 11 2023-12-03T11:50:13.903 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.901+0000 7f2473938800 20 Filter name: none 2023-12-03T11:50:13.903 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.901+0000 7f23a1ffb640 20 reqs_thread_entry: start 2023-12-03T11:50:13.903 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.901+0000 7f2473938800 20 rados->read ofs=0 len=0 2023-12-03T11:50:13.903 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.902+0000 7f2473938800 20 rados_obj.operate() r=0 bl.length=197 2023-12-03T11:50:13.903 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.902+0000 7f2473938800 20 rados->read ofs=0 len=0 2023-12-03T11:50:13.904 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.902+0000 7f2473938800 20 rados_obj.operate() r=0 bl.length=369 2023-12-03T11:50:13.904 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.902+0000 7f2473938800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:50:13.904 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.902+0000 7f2473938800 20 rados->read ofs=0 len=0 2023-12-03T11:50:13.904 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.903+0000 7f2473938800 20 rados_obj.operate() r=0 bl.length=197 2023-12-03T11:50:13.904 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.903+0000 7f2473938800 20 rados->read ofs=0 len=0 2023-12-03T11:50:13.905 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.903+0000 7f2473938800 20 rados_obj.operate() r=0 bl.length=369 2023-12-03T11:50:13.905 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.903+0000 7f2473938800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:50:13.905 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.904+0000 7f2473938800 20 rados->read ofs=0 len=0 2023-12-03T11:50:13.905 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.904+0000 7f2473938800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:50:13.906 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.905+0000 7f24357e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:50:13.908 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.907+0000 7f2473938800 20 remove_watcher() i=0 2023-12-03T11:50:13.908 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.907+0000 7f2473938800 2 removed watcher, disabling cache 2023-12-03T11:50:13.909 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.908+0000 7f2473938800 20 remove_watcher() i=1 2023-12-03T11:50:13.911 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.909+0000 7f2473938800 20 remove_watcher() i=2 2023-12-03T11:50:13.911 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.910+0000 7f2473938800 20 remove_watcher() i=3 2023-12-03T11:50:13.913 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.911+0000 7f2473938800 20 remove_watcher() i=4 2023-12-03T11:50:13.913 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.912+0000 7f2473938800 20 remove_watcher() i=5 2023-12-03T11:50:13.915 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.914+0000 7f2473938800 20 remove_watcher() i=6 2023-12-03T11:50:13.916 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.915+0000 7f2473938800 20 remove_watcher() i=7 2023-12-03T11:50:13.920 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:50:13.920 INFO:tasks.workunit.client.0.smithi003.stderr:BUCKET_STATS: 2023-12-03T11:50:13.921 INFO:tasks.workunit.client.0.smithi003.stderr:bucket: myver id: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18 num_objects: 0 size_kb: 0 num_shards: 11 2023-12-03T11:50:13.921 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:50:13.922 INFO:tasks.workunit.client.0.smithi003.stderr:radosgw-admin bucket reshard --bucket myver --num-shards 12 2023-12-03T11:50:13.952 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:50:13.952 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:50:13.966 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.964+0000 7f237d72c800 20 rados->read ofs=0 len=0 2023-12-03T11:50:13.968 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.966+0000 7f237d72c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:50:13.968 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.966+0000 7f237d72c800 20 realm 2023-12-03T11:50:13.968 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.966+0000 7f237d72c800 20 rados->read ofs=0 len=0 2023-12-03T11:50:13.968 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.966+0000 7f237d72c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:50:13.968 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.966+0000 7f237d72c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:50:13.968 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.966+0000 7f237d72c800 20 rados->read ofs=0 len=0 2023-12-03T11:50:13.968 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.967+0000 7f237d72c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:50:13.968 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.967+0000 7f237d72c800 20 rados->read ofs=0 len=0 2023-12-03T11:50:13.969 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.967+0000 7f237d72c800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:50:13.969 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.967+0000 7f237d72c800 20 rados->read ofs=0 len=0 2023-12-03T11:50:13.969 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.968+0000 7f237d72c800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:50:13.969 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:13.968+0000 7f237d72c800 20 searching for the correct realm 2023-12-03T11:50:14.181 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.179+0000 7f23794c3640 0 -- 172.21.15.3:0/188942143 >> [v2:172.21.15.37:6805/1692844418,v1:172.21.15.37:6807/1692844418] conn(0x5582bbbbc8b0 msgr2=0x5582bbbbecc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:50:14.183 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.181+0000 7f237d72c800 20 RGWRados::pool_iterate: got zone_info.83aabb46-04b5-4c96-9933-c6bfb1173a73 2023-12-03T11:50:14.183 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.181+0000 7f237d72c800 20 RGWRados::pool_iterate: got zonegroup_info.6a811aad-435d-4fdd-93c9-b7e0b50de429 2023-12-03T11:50:14.183 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.181+0000 7f237d72c800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:50:14.183 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.181+0000 7f237d72c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:50:14.183 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.181+0000 7f237d72c800 20 rados->read ofs=0 len=0 2023-12-03T11:50:14.183 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.181+0000 7f237d72c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:50:14.183 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.181+0000 7f237d72c800 20 rados->read ofs=0 len=0 2023-12-03T11:50:14.184 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.182+0000 7f237d72c800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:50:14.184 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.182+0000 7f237d72c800 20 rados->read ofs=0 len=0 2023-12-03T11:50:14.184 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.182+0000 7f237d72c800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:50:14.184 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.182+0000 7f237d72c800 20 zone default found 2023-12-03T11:50:14.185 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.182+0000 7f237d72c800 4 Realm: () 2023-12-03T11:50:14.185 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.182+0000 7f237d72c800 4 ZoneGroup: default (6a811aad-435d-4fdd-93c9-b7e0b50de429) 2023-12-03T11:50:14.185 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.182+0000 7f237d72c800 4 Zone: default (83aabb46-04b5-4c96-9933-c6bfb1173a73) 2023-12-03T11:50:14.185 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.182+0000 7f237d72c800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:50:14.185 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.182+0000 7f237d72c800 20 zonegroup default 2023-12-03T11:50:14.185 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.182+0000 7f237d72c800 20 rados->read ofs=0 len=0 2023-12-03T11:50:14.185 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.182+0000 7f237d72c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:50:14.185 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.182+0000 7f237d72c800 20 rados->read ofs=0 len=0 2023-12-03T11:50:14.185 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.183+0000 7f237d72c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:50:14.185 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.183+0000 7f237d72c800 20 rados->read ofs=0 len=0 2023-12-03T11:50:14.185 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.183+0000 7f237d72c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:50:14.185 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.183+0000 7f237d72c800 20 started sync module instance, tier type = 2023-12-03T11:50:14.185 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.183+0000 7f237d72c800 20 started zone id=83aabb46-04b5-4c96-9933-c6bfb1173a73 (name=default) with tier type = 2023-12-03T11:50:14.190 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.189+0000 7f2379cc4640 0 -- 172.21.15.3:0/188942143 >> [v2:172.21.15.37:6816/3770469300,v1:172.21.15.37:6818/3770469300] conn(0x7f237009a0c0 msgr2=0x7f23700ba780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:50:14.193 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.192+0000 7f237d72c800 20 add_watcher() i=0 2023-12-03T11:50:14.194 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.192+0000 7f237d72c800 20 add_watcher() i=1 2023-12-03T11:50:14.194 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.192+0000 7f237d72c800 20 add_watcher() i=2 2023-12-03T11:50:14.194 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.192+0000 7f237d72c800 20 add_watcher() i=3 2023-12-03T11:50:14.194 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.192+0000 7f237d72c800 20 add_watcher() i=4 2023-12-03T11:50:14.194 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.192+0000 7f237d72c800 20 add_watcher() i=5 2023-12-03T11:50:14.194 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.192+0000 7f237d72c800 20 add_watcher() i=6 2023-12-03T11:50:14.194 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.193+0000 7f237d72c800 20 add_watcher() i=7 2023-12-03T11:50:14.194 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.193+0000 7f237d72c800 2 all 8 watchers are set, enabling cache 2023-12-03T11:50:14.196 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.195+0000 7f233efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:50:14.196 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.195+0000 7f237d72c800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:50:14.196 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.195+0000 7f237d72c800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:50:14.202 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.201+0000 7f237d72c800 5 note: GC not initialized 2023-12-03T11:50:14.203 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.201+0000 7f22adffb640 20 reqs_thread_entry: start 2023-12-03T11:50:14.203 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.201+0000 7f237d72c800 20 init_complete bucket index max shards: 11 2023-12-03T11:50:14.203 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.202+0000 7f237d72c800 20 Filter name: none 2023-12-03T11:50:14.203 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.202+0000 7f229f7fe640 20 reqs_thread_entry: start 2023-12-03T11:50:14.203 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.202+0000 7f237d72c800 10 cache get: name=default.rgw.meta+root+myver : miss 2023-12-03T11:50:14.203 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.202+0000 7f237d72c800 20 rados->read ofs=0 len=0 2023-12-03T11:50:14.204 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.202+0000 7f237d72c800 20 rados_obj.operate() r=0 bl.length=197 2023-12-03T11:50:14.204 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.202+0000 7f237d72c800 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2023-12-03T11:50:14.204 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.202+0000 7f237d72c800 10 adding default.rgw.meta+root+myver to cache LRU end 2023-12-03T11:50:14.204 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.202+0000 7f237d72c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18 : miss 2023-12-03T11:50:14.204 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.202+0000 7f237d72c800 20 rados->read ofs=0 len=0 2023-12-03T11:50:14.205 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.203+0000 7f237d72c800 20 rados_obj.operate() r=0 bl.length=369 2023-12-03T11:50:14.205 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.203+0000 7f237d72c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18 info.flags=0x17 2023-12-03T11:50:14.205 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.203+0000 7f237d72c800 10 adding default.rgw.meta+root+.bucket.meta.myver:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18 to cache LRU end 2023-12-03T11:50:14.205 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.203+0000 7f237d72c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:50:14.205 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.203+0000 7f237d72c800 10 updating xattr: name=user.rgw.acl bl.length()=203 2023-12-03T11:50:14.205 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.203+0000 7f237d72c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18 2023-12-03T11:50:14.209 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.208+0000 7f237d72c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18 info.flags=0x17 2023-12-03T11:50:14.210 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.208+0000 7f237d72c800 10 moving default.rgw.meta+root+.bucket.meta.myver:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18 to cache LRU end 2023-12-03T11:50:14.210 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.208+0000 7f237d72c800 10 updating xattr: name=user.rgw.acl bl.length()=203 2023-12-03T11:50:14.210 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.208+0000 7f237d72c800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18, ofs0, ns] 2023-12-03T11:50:14.213 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.209+0000 7f235b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660509 cookie 94019983809376 notifier 7395 bl.length()=855 2023-12-03T11:50:14.213 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.209+0000 7f235b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18 info.flags=0x17 2023-12-03T11:50:14.213 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.209+0000 7f235b7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18 to cache LRU end 2023-12-03T11:50:14.213 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.209+0000 7f235b7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2023-12-03T11:50:14.213 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.210+0000 7f237d72c800 20 handle_bi_update(): bucket=:myver[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18]): orig_sources= new_sources= 2023-12-03T11:50:14.214 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.210+0000 7f237d72c800 20 handle_bi_update(): bucket=:myver[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18]): potential sources added=[] removed=[] 2023-12-03T11:50:14.214 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.210+0000 7f237d72c800 20 handle_bi_update(): bucket=:myver[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18]): orig_dests= new_dests= 2023-12-03T11:50:14.214 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.210+0000 7f237d72c800 20 handle_bi_update(): bucket=:myver[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18]): potential dests added=[] removed=[] 2023-12-03T11:50:14.215 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.213+0000 7f237d72c800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.1.0 2023-12-03T11:50:14.215 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.213+0000 7f237d72c800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.1.0 2023-12-03T11:50:14.215 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.213+0000 7f237d72c800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.1.1 2023-12-03T11:50:14.215 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.213+0000 7f237d72c800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.1.1 2023-12-03T11:50:14.215 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.213+0000 7f237d72c800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.1.2 2023-12-03T11:50:14.215 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.213+0000 7f237d72c800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.1.2 2023-12-03T11:50:14.215 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.213+0000 7f237d72c800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.1.3 2023-12-03T11:50:14.215 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.213+0000 7f237d72c800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.1.3 2023-12-03T11:50:14.215 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.213+0000 7f237d72c800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.1.4 2023-12-03T11:50:14.216 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.213+0000 7f237d72c800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.1.4 2023-12-03T11:50:14.216 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.213+0000 7f237d72c800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.1.5 2023-12-03T11:50:14.216 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.213+0000 7f237d72c800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.1.5 2023-12-03T11:50:14.216 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.213+0000 7f237d72c800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.1.6 2023-12-03T11:50:14.216 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.213+0000 7f237d72c800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.1.6 2023-12-03T11:50:14.216 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.213+0000 7f237d72c800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.1.7 2023-12-03T11:50:14.216 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.213+0000 7f237d72c800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.1.7 2023-12-03T11:50:14.216 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.213+0000 7f237d72c800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.1.8 2023-12-03T11:50:14.216 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.213+0000 7f237d72c800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.1.8 2023-12-03T11:50:14.216 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.213+0000 7f237d72c800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.1.9 2023-12-03T11:50:14.216 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.213+0000 7f237d72c800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.1.9 2023-12-03T11:50:14.216 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.213+0000 7f237d72c800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.1.10 2023-12-03T11:50:14.216 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.213+0000 7f237d72c800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.1.10 2023-12-03T11:50:14.216 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.213+0000 7f237d72c800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.1.11 2023-12-03T11:50:14.216 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.213+0000 7f237d72c800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.1.11 2023-12-03T11:50:14.217 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.213+0000 7f237d72c800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.0 2023-12-03T11:50:14.217 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.214+0000 7f237d72c800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.1 2023-12-03T11:50:14.217 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.214+0000 7f237d72c800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.2 2023-12-03T11:50:14.217 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.215+0000 7f237d72c800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.3 2023-12-03T11:50:14.217 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.216+0000 7f237d72c800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.4 2023-12-03T11:50:14.218 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.216+0000 7f237d72c800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.5 2023-12-03T11:50:14.218 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.217+0000 7f237d72c800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.6 2023-12-03T11:50:14.218 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.217+0000 7f237d72c800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.7 2023-12-03T11:50:14.219 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.218+0000 7f237d72c800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.8 2023-12-03T11:50:14.219 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.218+0000 7f237d72c800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.9 2023-12-03T11:50:14.219 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.218+0000 7f237d72c800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.10 2023-12-03T11:50:14.220 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.219+0000 7f237d72c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18 : hit (requested=0x17, cached=0x17) 2023-12-03T11:50:14.220 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.219+0000 7f237d72c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18 2023-12-03T11:50:14.222 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.220+0000 7f237d72c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18 info.flags=0x17 2023-12-03T11:50:14.222 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.220+0000 7f237d72c800 10 moving default.rgw.meta+root+.bucket.meta.myver:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18 to cache LRU end 2023-12-03T11:50:14.222 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.220+0000 7f237d72c800 10 updating xattr: name=user.rgw.acl bl.length()=203 2023-12-03T11:50:14.222 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.220+0000 7f237d72c800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18, ofs0, ns] 2023-12-03T11:50:14.222 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.220+0000 7f235b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660510 cookie 94019983809376 notifier 7395 bl.length()=823 2023-12-03T11:50:14.222 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.220+0000 7f235b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18 info.flags=0x17 2023-12-03T11:50:14.222 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.220+0000 7f235b7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18 to cache LRU end 2023-12-03T11:50:14.222 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.220+0000 7f235b7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2023-12-03T11:50:14.223 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.222+0000 7f237d72c800 20 handle_bi_update(): bucket=:myver[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18]): orig_sources= new_sources= 2023-12-03T11:50:14.223 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.222+0000 7f237d72c800 20 handle_bi_update(): bucket=:myver[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18]): potential sources added=[] removed=[] 2023-12-03T11:50:14.223 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.222+0000 7f237d72c800 20 handle_bi_update(): bucket=:myver[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18]): orig_dests= new_dests= 2023-12-03T11:50:14.223 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.222+0000 7f237d72c800 20 handle_bi_update(): bucket=:myver[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18]): potential dests added=[] removed=[] 2023-12-03T11:50:14.228 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.227+0000 7f237d72c800 1 execute INFO: reshard of bucket "myver" completed successfully 2023-12-03T11:50:14.230 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.229+0000 7f233efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:50:14.232 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.231+0000 7f237d72c800 20 remove_watcher() i=0 2023-12-03T11:50:14.233 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.231+0000 7f237d72c800 2 removed watcher, disabling cache 2023-12-03T11:50:14.234 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.232+0000 7f237d72c800 20 remove_watcher() i=1 2023-12-03T11:50:14.235 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.234+0000 7f237d72c800 20 remove_watcher() i=2 2023-12-03T11:50:14.236 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.235+0000 7f237d72c800 20 remove_watcher() i=3 2023-12-03T11:50:14.237 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.236+0000 7f237d72c800 20 remove_watcher() i=4 2023-12-03T11:50:14.238 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.237+0000 7f237d72c800 20 remove_watcher() i=5 2023-12-03T11:50:14.239 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.238+0000 7f237d72c800 20 remove_watcher() i=6 2023-12-03T11:50:14.240 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.239+0000 7f237d72c800 20 remove_watcher() i=7 2023-12-03T11:50:14.246 INFO:tasks.workunit.client.0.smithi003.stderr:radosgw-admin bucket stats --bucket myver 2023-12-03T11:50:14.274 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:50:14.274 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:50:14.288 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.287+0000 7f2c1ff1e800 20 rados->read ofs=0 len=0 2023-12-03T11:50:14.290 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.289+0000 7f2c1ff1e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:50:14.290 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.289+0000 7f2c1ff1e800 20 realm 2023-12-03T11:50:14.290 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.289+0000 7f2c1ff1e800 20 rados->read ofs=0 len=0 2023-12-03T11:50:14.290 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.289+0000 7f2c1ff1e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:50:14.290 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.289+0000 7f2c1ff1e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:50:14.291 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.289+0000 7f2c1ff1e800 20 rados->read ofs=0 len=0 2023-12-03T11:50:14.291 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.289+0000 7f2c1ff1e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:50:14.291 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.289+0000 7f2c1ff1e800 20 rados->read ofs=0 len=0 2023-12-03T11:50:14.291 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.290+0000 7f2c1ff1e800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:50:14.291 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.290+0000 7f2c1ff1e800 20 rados->read ofs=0 len=0 2023-12-03T11:50:14.291 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.290+0000 7f2c1ff1e800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:50:14.292 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.290+0000 7f2c1ff1e800 20 searching for the correct realm 2023-12-03T11:50:14.301 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.300+0000 7f2c1da25640 0 -- 172.21.15.3:0/807496384 >> [v2:172.21.15.37:6805/1692844418,v1:172.21.15.37:6807/1692844418] conn(0x55dbb4a45bc0 msgr2=0x55dbb4a47fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:50:14.303 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.301+0000 7f2c1ff1e800 20 RGWRados::pool_iterate: got zone_info.83aabb46-04b5-4c96-9933-c6bfb1173a73 2023-12-03T11:50:14.303 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.301+0000 7f2c1ff1e800 20 RGWRados::pool_iterate: got zonegroup_info.6a811aad-435d-4fdd-93c9-b7e0b50de429 2023-12-03T11:50:14.303 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.301+0000 7f2c1ff1e800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:50:14.303 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.301+0000 7f2c1ff1e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:50:14.303 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.301+0000 7f2c1ff1e800 20 rados->read ofs=0 len=0 2023-12-03T11:50:14.303 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.302+0000 7f2c1ff1e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:50:14.303 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.302+0000 7f2c1ff1e800 20 rados->read ofs=0 len=0 2023-12-03T11:50:14.303 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.302+0000 7f2c1ff1e800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:50:14.303 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.302+0000 7f2c1ff1e800 20 rados->read ofs=0 len=0 2023-12-03T11:50:14.304 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.302+0000 7f2c1ff1e800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:50:14.304 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.302+0000 7f2c1ff1e800 20 zone default found 2023-12-03T11:50:14.305 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.302+0000 7f2c1ff1e800 4 Realm: () 2023-12-03T11:50:14.305 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.302+0000 7f2c1ff1e800 4 ZoneGroup: default (6a811aad-435d-4fdd-93c9-b7e0b50de429) 2023-12-03T11:50:14.305 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.302+0000 7f2c1ff1e800 4 Zone: default (83aabb46-04b5-4c96-9933-c6bfb1173a73) 2023-12-03T11:50:14.305 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.302+0000 7f2c1ff1e800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:50:14.305 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.302+0000 7f2c1ff1e800 20 zonegroup default 2023-12-03T11:50:14.305 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.302+0000 7f2c1ff1e800 20 rados->read ofs=0 len=0 2023-12-03T11:50:14.305 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.302+0000 7f2c1ff1e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:50:14.305 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.302+0000 7f2c1ff1e800 20 rados->read ofs=0 len=0 2023-12-03T11:50:14.305 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.303+0000 7f2c1ff1e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:50:14.305 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.303+0000 7f2c1ff1e800 20 rados->read ofs=0 len=0 2023-12-03T11:50:14.305 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.303+0000 7f2c1ff1e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:50:14.305 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.303+0000 7f2c1ff1e800 20 started sync module instance, tier type = 2023-12-03T11:50:14.305 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.303+0000 7f2c1ff1e800 20 started zone id=83aabb46-04b5-4c96-9933-c6bfb1173a73 (name=default) with tier type = 2023-12-03T11:50:14.311 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.310+0000 7f2c1e226640 0 -- 172.21.15.3:0/807496384 >> [v2:172.21.15.37:6816/3770469300,v1:172.21.15.37:6818/3770469300] conn(0x7f2c14043920 msgr2=0x7f2c14033410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:50:14.314 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.312+0000 7f2c1ff1e800 20 add_watcher() i=0 2023-12-03T11:50:14.314 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.312+0000 7f2c1ff1e800 20 add_watcher() i=1 2023-12-03T11:50:14.314 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.312+0000 7f2c1ff1e800 20 add_watcher() i=2 2023-12-03T11:50:14.314 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.312+0000 7f2c1ff1e800 20 add_watcher() i=3 2023-12-03T11:50:14.314 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.312+0000 7f2c1ff1e800 20 add_watcher() i=4 2023-12-03T11:50:14.314 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.312+0000 7f2c1ff1e800 20 add_watcher() i=5 2023-12-03T11:50:14.314 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.312+0000 7f2c1ff1e800 20 add_watcher() i=6 2023-12-03T11:50:14.315 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.313+0000 7f2c1ff1e800 20 add_watcher() i=7 2023-12-03T11:50:14.315 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.313+0000 7f2c1ff1e800 2 all 8 watchers are set, enabling cache 2023-12-03T11:50:14.316 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.315+0000 7f2be37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:50:14.316 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.315+0000 7f2c1ff1e800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:50:14.316 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.315+0000 7f2c1ff1e800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:50:14.323 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.321+0000 7f2c1ff1e800 5 note: GC not initialized 2023-12-03T11:50:14.323 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.321+0000 7f2b527fc640 20 reqs_thread_entry: start 2023-12-03T11:50:14.323 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.321+0000 7f2c1ff1e800 20 init_complete bucket index max shards: 11 2023-12-03T11:50:14.323 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.321+0000 7f2c1ff1e800 20 Filter name: none 2023-12-03T11:50:14.323 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.321+0000 7f2b43fff640 20 reqs_thread_entry: start 2023-12-03T11:50:14.323 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.321+0000 7f2c1ff1e800 20 rados->read ofs=0 len=0 2023-12-03T11:50:14.324 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.322+0000 7f2c1ff1e800 20 rados_obj.operate() r=0 bl.length=197 2023-12-03T11:50:14.324 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.322+0000 7f2c1ff1e800 20 rados->read ofs=0 len=0 2023-12-03T11:50:14.324 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.322+0000 7f2c1ff1e800 20 rados_obj.operate() r=0 bl.length=369 2023-12-03T11:50:14.324 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.322+0000 7f2c1ff1e800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:50:14.324 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.322+0000 7f2c1ff1e800 20 rados->read ofs=0 len=0 2023-12-03T11:50:14.324 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.323+0000 7f2c1ff1e800 20 rados_obj.operate() r=0 bl.length=197 2023-12-03T11:50:14.325 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.323+0000 7f2c1ff1e800 20 rados->read ofs=0 len=0 2023-12-03T11:50:14.325 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.323+0000 7f2c1ff1e800 20 rados_obj.operate() r=0 bl.length=369 2023-12-03T11:50:14.325 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.323+0000 7f2c1ff1e800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:50:14.326 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.325+0000 7f2c1ff1e800 20 rados->read ofs=0 len=0 2023-12-03T11:50:14.326 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.325+0000 7f2c1ff1e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:50:14.327 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.326+0000 7f2be37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:50:14.329 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.328+0000 7f2c1ff1e800 20 remove_watcher() i=0 2023-12-03T11:50:14.329 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.328+0000 7f2c1ff1e800 2 removed watcher, disabling cache 2023-12-03T11:50:14.330 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.329+0000 7f2c1ff1e800 20 remove_watcher() i=1 2023-12-03T11:50:14.331 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.330+0000 7f2c1ff1e800 20 remove_watcher() i=2 2023-12-03T11:50:14.332 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.331+0000 7f2c1ff1e800 20 remove_watcher() i=3 2023-12-03T11:50:14.333 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.332+0000 7f2c1ff1e800 20 remove_watcher() i=4 2023-12-03T11:50:14.334 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.333+0000 7f2c1ff1e800 20 remove_watcher() i=5 2023-12-03T11:50:14.335 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.334+0000 7f2c1ff1e800 20 remove_watcher() i=6 2023-12-03T11:50:14.336 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.335+0000 7f2c1ff1e800 20 remove_watcher() i=7 2023-12-03T11:50:14.341 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:50:14.341 INFO:tasks.workunit.client.0.smithi003.stderr:BUCKET_STATS: 2023-12-03T11:50:14.341 INFO:tasks.workunit.client.0.smithi003.stderr:bucket: myver id: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18 num_objects: 0 size_kb: 0 num_shards: 12 2023-12-03T11:50:14.341 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:50:14.413 INFO:tasks.workunit.client.0.smithi003.stderr: test: reshard removes olh entries with empty name 2023-12-03T11:50:14.562 INFO:tasks.workunit.client.0.smithi003.stderr:radosgw-admin bucket stats --bucket a-bucket 2023-12-03T11:50:14.590 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:50:14.590 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:50:14.604 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.603+0000 7faa8bd48800 20 rados->read ofs=0 len=0 2023-12-03T11:50:14.607 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.605+0000 7faa8bd48800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:50:14.607 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.605+0000 7faa8bd48800 20 realm 2023-12-03T11:50:14.607 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.605+0000 7faa8bd48800 20 rados->read ofs=0 len=0 2023-12-03T11:50:14.607 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.605+0000 7faa8bd48800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:50:14.607 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.605+0000 7faa8bd48800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:50:14.607 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.605+0000 7faa8bd48800 20 rados->read ofs=0 len=0 2023-12-03T11:50:14.607 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.605+0000 7faa8bd48800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:50:14.608 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.605+0000 7faa8bd48800 20 rados->read ofs=0 len=0 2023-12-03T11:50:14.608 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.606+0000 7faa8bd48800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:50:14.609 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.606+0000 7faa8bd48800 20 rados->read ofs=0 len=0 2023-12-03T11:50:14.609 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.606+0000 7faa8bd48800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:50:14.609 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.606+0000 7faa8bd48800 20 searching for the correct realm 2023-12-03T11:50:14.618 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.616+0000 7faa87b0e640 0 -- 172.21.15.3:0/3274345875 >> [v2:172.21.15.37:6805/1692844418,v1:172.21.15.37:6807/1692844418] conn(0x560f94e7fd90 msgr2=0x560f94e821a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:50:14.619 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.618+0000 7faa8bd48800 20 RGWRados::pool_iterate: got zone_info.83aabb46-04b5-4c96-9933-c6bfb1173a73 2023-12-03T11:50:14.620 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.618+0000 7faa8bd48800 20 RGWRados::pool_iterate: got zonegroup_info.6a811aad-435d-4fdd-93c9-b7e0b50de429 2023-12-03T11:50:14.620 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.618+0000 7faa8bd48800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:50:14.620 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.618+0000 7faa8bd48800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:50:14.620 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.618+0000 7faa8bd48800 20 rados->read ofs=0 len=0 2023-12-03T11:50:14.620 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.618+0000 7faa8bd48800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:50:14.620 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.618+0000 7faa8bd48800 20 rados->read ofs=0 len=0 2023-12-03T11:50:14.620 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.618+0000 7faa8bd48800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:50:14.620 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.618+0000 7faa8bd48800 20 rados->read ofs=0 len=0 2023-12-03T11:50:14.621 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.619+0000 7faa8bd48800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:50:14.621 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.619+0000 7faa8bd48800 20 zone default found 2023-12-03T11:50:14.621 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.619+0000 7faa8bd48800 4 Realm: () 2023-12-03T11:50:14.621 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.619+0000 7faa8bd48800 4 ZoneGroup: default (6a811aad-435d-4fdd-93c9-b7e0b50de429) 2023-12-03T11:50:14.622 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.619+0000 7faa8bd48800 4 Zone: default (83aabb46-04b5-4c96-9933-c6bfb1173a73) 2023-12-03T11:50:14.622 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.619+0000 7faa8bd48800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:50:14.622 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.619+0000 7faa8bd48800 20 zonegroup default 2023-12-03T11:50:14.622 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.619+0000 7faa8bd48800 20 rados->read ofs=0 len=0 2023-12-03T11:50:14.622 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.619+0000 7faa8bd48800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:50:14.622 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.619+0000 7faa8bd48800 20 rados->read ofs=0 len=0 2023-12-03T11:50:14.622 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.619+0000 7faa8bd48800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:50:14.622 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.619+0000 7faa8bd48800 20 rados->read ofs=0 len=0 2023-12-03T11:50:14.622 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.619+0000 7faa8bd48800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:50:14.622 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.619+0000 7faa8bd48800 20 started sync module instance, tier type = 2023-12-03T11:50:14.622 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.620+0000 7faa8bd48800 20 started zone id=83aabb46-04b5-4c96-9933-c6bfb1173a73 (name=default) with tier type = 2023-12-03T11:50:14.626 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.625+0000 7faa87b0e640 0 -- 172.21.15.3:0/3274345875 >> [v2:172.21.15.3:6800/2373485412,v1:172.21.15.3:6801/2373485412] conn(0x7faa8008b2d0 msgr2=0x7faa8005d120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:50:14.629 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.628+0000 7faa8bd48800 20 add_watcher() i=0 2023-12-03T11:50:14.630 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.628+0000 7faa8bd48800 20 add_watcher() i=1 2023-12-03T11:50:14.630 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.628+0000 7faa8bd48800 20 add_watcher() i=2 2023-12-03T11:50:14.630 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.628+0000 7faa8bd48800 20 add_watcher() i=3 2023-12-03T11:50:14.630 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.628+0000 7faa8bd48800 20 add_watcher() i=4 2023-12-03T11:50:14.630 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.628+0000 7faa8bd48800 20 add_watcher() i=5 2023-12-03T11:50:14.630 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.628+0000 7faa8bd48800 20 add_watcher() i=6 2023-12-03T11:50:14.631 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.629+0000 7faa8bd48800 20 add_watcher() i=7 2023-12-03T11:50:14.631 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.629+0000 7faa8bd48800 2 all 8 watchers are set, enabling cache 2023-12-03T11:50:14.632 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.631+0000 7faa4dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:50:14.632 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.631+0000 7faa8bd48800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:50:14.632 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.631+0000 7faa8bd48800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:50:14.639 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.637+0000 7faa8bd48800 5 note: GC not initialized 2023-12-03T11:50:14.639 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.637+0000 7fa9c4ff9640 20 reqs_thread_entry: start 2023-12-03T11:50:14.639 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.637+0000 7faa8bd48800 20 init_complete bucket index max shards: 11 2023-12-03T11:50:14.639 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.637+0000 7faa8bd48800 20 Filter name: none 2023-12-03T11:50:14.639 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.637+0000 7fa9ba7fc640 20 reqs_thread_entry: start 2023-12-03T11:50:14.639 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.637+0000 7faa8bd48800 20 rados->read ofs=0 len=0 2023-12-03T11:50:14.640 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.638+0000 7faa8bd48800 20 rados_obj.operate() r=0 bl.length=200 2023-12-03T11:50:14.640 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.638+0000 7faa8bd48800 20 rados->read ofs=0 len=0 2023-12-03T11:50:14.640 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.638+0000 7faa8bd48800 20 rados_obj.operate() r=0 bl.length=372 2023-12-03T11:50:14.640 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.638+0000 7faa8bd48800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:50:14.640 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.638+0000 7faa8bd48800 20 rados->read ofs=0 len=0 2023-12-03T11:50:14.640 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.639+0000 7faa8bd48800 20 rados_obj.operate() r=0 bl.length=200 2023-12-03T11:50:14.640 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.639+0000 7faa8bd48800 20 rados->read ofs=0 len=0 2023-12-03T11:50:14.641 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.639+0000 7faa8bd48800 20 rados_obj.operate() r=0 bl.length=372 2023-12-03T11:50:14.641 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.639+0000 7faa8bd48800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:50:14.641 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.640+0000 7faa8bd48800 20 rados->read ofs=0 len=0 2023-12-03T11:50:14.641 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.640+0000 7faa8bd48800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:50:14.642 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.641+0000 7faa4dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:50:14.644 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.643+0000 7faa8bd48800 20 remove_watcher() i=0 2023-12-03T11:50:14.645 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.643+0000 7faa8bd48800 2 removed watcher, disabling cache 2023-12-03T11:50:14.646 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.644+0000 7faa8bd48800 20 remove_watcher() i=1 2023-12-03T11:50:14.646 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.645+0000 7faa8bd48800 20 remove_watcher() i=2 2023-12-03T11:50:14.647 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.646+0000 7faa8bd48800 20 remove_watcher() i=3 2023-12-03T11:50:14.648 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.647+0000 7faa8bd48800 20 remove_watcher() i=4 2023-12-03T11:50:14.649 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.648+0000 7faa8bd48800 20 remove_watcher() i=5 2023-12-03T11:50:14.651 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.650+0000 7faa8bd48800 20 remove_watcher() i=6 2023-12-03T11:50:14.652 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.651+0000 7faa8bd48800 20 remove_watcher() i=7 2023-12-03T11:50:14.656 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:50:14.656 INFO:tasks.workunit.client.0.smithi003.stderr:BUCKET_STATS: 2023-12-03T11:50:14.656 INFO:tasks.workunit.client.0.smithi003.stderr:bucket: a-bucket id: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17 num_objects: 0 size_kb: 0 num_shards: 13 2023-12-03T11:50:14.657 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:50:14.658 INFO:tasks.workunit.client.0.smithi003.stderr:radosgw-admin bucket layout --bucket a-bucket 2023-12-03T11:50:14.686 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:50:14.686 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:50:14.701 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.699+0000 7f847c69d800 20 rados->read ofs=0 len=0 2023-12-03T11:50:14.702 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.701+0000 7f847c69d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:50:14.702 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.701+0000 7f847c69d800 20 realm 2023-12-03T11:50:14.703 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.701+0000 7f847c69d800 20 rados->read ofs=0 len=0 2023-12-03T11:50:14.703 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.701+0000 7f847c69d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:50:14.703 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.701+0000 7f847c69d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:50:14.703 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.701+0000 7f847c69d800 20 rados->read ofs=0 len=0 2023-12-03T11:50:14.703 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.701+0000 7f847c69d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:50:14.703 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.701+0000 7f847c69d800 20 rados->read ofs=0 len=0 2023-12-03T11:50:14.704 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.702+0000 7f847c69d800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:50:14.704 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.702+0000 7f847c69d800 20 rados->read ofs=0 len=0 2023-12-03T11:50:14.704 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.702+0000 7f847c69d800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:50:14.704 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.702+0000 7f847c69d800 20 searching for the correct realm 2023-12-03T11:50:14.714 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.713+0000 7f84799a3640 0 -- 172.21.15.3:0/245507845 >> [v2:172.21.15.3:6817/3356208405,v1:172.21.15.3:6819/3356208405] conn(0x55e2c4896b50 msgr2=0x55e2c4898f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-03T11:50:14.715 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.714+0000 7f847c69d800 20 RGWRados::pool_iterate: got zone_info.83aabb46-04b5-4c96-9933-c6bfb1173a73 2023-12-03T11:50:14.715 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.714+0000 7f847c69d800 20 RGWRados::pool_iterate: got zonegroup_info.6a811aad-435d-4fdd-93c9-b7e0b50de429 2023-12-03T11:50:14.715 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.714+0000 7f847c69d800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:50:14.715 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.714+0000 7f847c69d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:50:14.715 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.714+0000 7f847c69d800 20 rados->read ofs=0 len=0 2023-12-03T11:50:14.715 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.714+0000 7f847c69d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:50:14.716 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.714+0000 7f847c69d800 20 rados->read ofs=0 len=0 2023-12-03T11:50:14.717 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.714+0000 7f847c69d800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:50:14.717 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.714+0000 7f847c69d800 20 rados->read ofs=0 len=0 2023-12-03T11:50:14.717 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.715+0000 7f847c69d800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:50:14.717 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.715+0000 7f847c69d800 20 zone default found 2023-12-03T11:50:14.717 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.715+0000 7f847c69d800 4 Realm: () 2023-12-03T11:50:14.717 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.715+0000 7f847c69d800 4 ZoneGroup: default (6a811aad-435d-4fdd-93c9-b7e0b50de429) 2023-12-03T11:50:14.717 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.715+0000 7f847c69d800 4 Zone: default (83aabb46-04b5-4c96-9933-c6bfb1173a73) 2023-12-03T11:50:14.717 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.715+0000 7f847c69d800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:50:14.717 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.715+0000 7f847c69d800 20 zonegroup default 2023-12-03T11:50:14.718 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.715+0000 7f847c69d800 20 rados->read ofs=0 len=0 2023-12-03T11:50:14.718 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.715+0000 7f847c69d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:50:14.718 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.715+0000 7f847c69d800 20 rados->read ofs=0 len=0 2023-12-03T11:50:14.718 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.715+0000 7f847c69d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:50:14.718 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.715+0000 7f847c69d800 20 rados->read ofs=0 len=0 2023-12-03T11:50:14.718 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.715+0000 7f847c69d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:50:14.718 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.715+0000 7f847c69d800 20 started sync module instance, tier type = 2023-12-03T11:50:14.718 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.715+0000 7f847c69d800 20 started zone id=83aabb46-04b5-4c96-9933-c6bfb1173a73 (name=default) with tier type = 2023-12-03T11:50:14.723 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.722+0000 7f847a9a5640 0 -- 172.21.15.3:0/245507845 >> [v2:172.21.15.37:6816/3770469300,v1:172.21.15.37:6818/3770469300] conn(0x7f847004e5d0 msgr2=0x7f8470084430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:50:14.726 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.725+0000 7f847c69d800 20 add_watcher() i=0 2023-12-03T11:50:14.726 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.725+0000 7f847c69d800 20 add_watcher() i=1 2023-12-03T11:50:14.726 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.725+0000 7f847c69d800 20 add_watcher() i=2 2023-12-03T11:50:14.726 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.725+0000 7f847c69d800 20 add_watcher() i=3 2023-12-03T11:50:14.726 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.725+0000 7f847c69d800 20 add_watcher() i=4 2023-12-03T11:50:14.726 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.725+0000 7f847c69d800 20 add_watcher() i=5 2023-12-03T11:50:14.726 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.725+0000 7f847c69d800 20 add_watcher() i=6 2023-12-03T11:50:14.727 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.725+0000 7f847c69d800 20 add_watcher() i=7 2023-12-03T11:50:14.727 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.725+0000 7f847c69d800 2 all 8 watchers are set, enabling cache 2023-12-03T11:50:14.728 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.727+0000 7f843ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:50:14.728 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.727+0000 7f847c69d800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:50:14.728 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.727+0000 7f847c69d800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:50:14.735 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.733+0000 7f847c69d800 5 note: GC not initialized 2023-12-03T11:50:14.735 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.733+0000 7f83aeffd640 20 reqs_thread_entry: start 2023-12-03T11:50:14.735 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.733+0000 7f847c69d800 20 init_complete bucket index max shards: 11 2023-12-03T11:50:14.735 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.734+0000 7f847c69d800 20 Filter name: none 2023-12-03T11:50:14.735 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.734+0000 7f83acff9640 20 reqs_thread_entry: start 2023-12-03T11:50:14.735 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.734+0000 7f847c69d800 20 rados->read ofs=0 len=0 2023-12-03T11:50:14.736 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.734+0000 7f847c69d800 20 rados_obj.operate() r=0 bl.length=200 2023-12-03T11:50:14.736 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.734+0000 7f847c69d800 20 rados->read ofs=0 len=0 2023-12-03T11:50:14.736 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.734+0000 7f847c69d800 20 rados_obj.operate() r=0 bl.length=372 2023-12-03T11:50:14.736 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.734+0000 7f847c69d800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:50:14.736 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.735+0000 7f843ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:50:14.739 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.737+0000 7f847c69d800 20 remove_watcher() i=0 2023-12-03T11:50:14.739 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.737+0000 7f847c69d800 2 removed watcher, disabling cache 2023-12-03T11:50:14.740 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.738+0000 7f847c69d800 20 remove_watcher() i=1 2023-12-03T11:50:14.741 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.739+0000 7f847c69d800 20 remove_watcher() i=2 2023-12-03T11:50:14.742 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.741+0000 7f847c69d800 20 remove_watcher() i=3 2023-12-03T11:50:14.743 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.741+0000 7f847c69d800 20 remove_watcher() i=4 2023-12-03T11:50:14.744 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.743+0000 7f847c69d800 20 remove_watcher() i=5 2023-12-03T11:50:14.745 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.744+0000 7f847c69d800 20 remove_watcher() i=6 2023-12-03T11:50:14.746 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.745+0000 7f847c69d800 20 remove_watcher() i=7 2023-12-03T11:50:14.752 INFO:tasks.workunit.client.0.smithi003.stderr:rados -p default.rgw.buckets.index setomapval .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.2.0 --omap-key-file /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/olh_noname_key < /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/olh_noname_val 2023-12-03T11:50:14.776 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:50:14.777 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:50:14.793 INFO:tasks.workunit.client.0.smithi003.stderr:radosgw-admin bi list --bucket a-bucket 2023-12-03T11:50:14.820 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:50:14.820 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:50:14.834 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.833+0000 7fe44af22800 20 rados->read ofs=0 len=0 2023-12-03T11:50:14.837 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.835+0000 7fe44af22800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:50:14.837 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.835+0000 7fe44af22800 20 realm 2023-12-03T11:50:14.837 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.835+0000 7fe44af22800 20 rados->read ofs=0 len=0 2023-12-03T11:50:14.837 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.835+0000 7fe44af22800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:50:14.837 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.835+0000 7fe44af22800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:50:14.837 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.835+0000 7fe44af22800 20 rados->read ofs=0 len=0 2023-12-03T11:50:14.837 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.835+0000 7fe44af22800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:50:14.837 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.835+0000 7fe44af22800 20 rados->read ofs=0 len=0 2023-12-03T11:50:14.838 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.836+0000 7fe44af22800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:50:14.838 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.836+0000 7fe44af22800 20 rados->read ofs=0 len=0 2023-12-03T11:50:14.838 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.836+0000 7fe44af22800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:50:14.838 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.836+0000 7fe44af22800 20 searching for the correct realm 2023-12-03T11:50:14.848 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.846+0000 7fe446c7e640 0 -- 172.21.15.3:0/716878191 >> [v2:172.21.15.37:6805/1692844418,v1:172.21.15.37:6807/1692844418] conn(0x561c9df83fb0 msgr2=0x561c9df863a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:50:14.849 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.848+0000 7fe44af22800 20 RGWRados::pool_iterate: got zone_info.83aabb46-04b5-4c96-9933-c6bfb1173a73 2023-12-03T11:50:14.849 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.848+0000 7fe44af22800 20 RGWRados::pool_iterate: got zonegroup_info.6a811aad-435d-4fdd-93c9-b7e0b50de429 2023-12-03T11:50:14.849 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.848+0000 7fe44af22800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:50:14.849 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.848+0000 7fe44af22800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:50:14.849 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.848+0000 7fe44af22800 20 rados->read ofs=0 len=0 2023-12-03T11:50:14.849 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.848+0000 7fe44af22800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:50:14.850 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.848+0000 7fe44af22800 20 rados->read ofs=0 len=0 2023-12-03T11:50:14.851 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.848+0000 7fe44af22800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:50:14.851 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.848+0000 7fe44af22800 20 rados->read ofs=0 len=0 2023-12-03T11:50:14.851 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.849+0000 7fe44af22800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:50:14.851 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.849+0000 7fe44af22800 20 zone default found 2023-12-03T11:50:14.851 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.849+0000 7fe44af22800 4 Realm: () 2023-12-03T11:50:14.851 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.849+0000 7fe44af22800 4 ZoneGroup: default (6a811aad-435d-4fdd-93c9-b7e0b50de429) 2023-12-03T11:50:14.851 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.849+0000 7fe44af22800 4 Zone: default (83aabb46-04b5-4c96-9933-c6bfb1173a73) 2023-12-03T11:50:14.851 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.849+0000 7fe44af22800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:50:14.851 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.849+0000 7fe44af22800 20 zonegroup default 2023-12-03T11:50:14.851 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.849+0000 7fe44af22800 20 rados->read ofs=0 len=0 2023-12-03T11:50:14.851 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.849+0000 7fe44af22800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:50:14.851 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.849+0000 7fe44af22800 20 rados->read ofs=0 len=0 2023-12-03T11:50:14.851 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.849+0000 7fe44af22800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:50:14.851 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.849+0000 7fe44af22800 20 rados->read ofs=0 len=0 2023-12-03T11:50:14.852 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.849+0000 7fe44af22800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:50:14.852 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.849+0000 7fe44af22800 20 started sync module instance, tier type = 2023-12-03T11:50:14.852 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.849+0000 7fe44af22800 20 started zone id=83aabb46-04b5-4c96-9933-c6bfb1173a73 (name=default) with tier type = 2023-12-03T11:50:14.856 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.855+0000 7fe44747f640 0 -- 172.21.15.3:0/716878191 >> [v2:172.21.15.37:6816/3770469300,v1:172.21.15.37:6818/3770469300] conn(0x7fe43002c3c0 msgr2=0x7fe43002c840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:50:14.860 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.859+0000 7fe44af22800 20 add_watcher() i=0 2023-12-03T11:50:14.860 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.859+0000 7fe44af22800 20 add_watcher() i=1 2023-12-03T11:50:14.860 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.859+0000 7fe44af22800 20 add_watcher() i=2 2023-12-03T11:50:14.860 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.859+0000 7fe44af22800 20 add_watcher() i=3 2023-12-03T11:50:14.860 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.859+0000 7fe44af22800 20 add_watcher() i=4 2023-12-03T11:50:14.860 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.859+0000 7fe44af22800 20 add_watcher() i=5 2023-12-03T11:50:14.860 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.859+0000 7fe44af22800 20 add_watcher() i=6 2023-12-03T11:50:14.861 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.859+0000 7fe44af22800 20 add_watcher() i=7 2023-12-03T11:50:14.861 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.859+0000 7fe44af22800 2 all 8 watchers are set, enabling cache 2023-12-03T11:50:14.862 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.861+0000 7fe387fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:50:14.863 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.862+0000 7fe44af22800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:50:14.863 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.862+0000 7fe44af22800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:50:14.869 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.868+0000 7fe44af22800 5 note: GC not initialized 2023-12-03T11:50:14.869 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.868+0000 7fe376ffd640 20 reqs_thread_entry: start 2023-12-03T11:50:14.869 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.868+0000 7fe44af22800 20 init_complete bucket index max shards: 11 2023-12-03T11:50:14.869 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.868+0000 7fe44af22800 20 Filter name: none 2023-12-03T11:50:14.870 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.868+0000 7fe374ff9640 20 reqs_thread_entry: start 2023-12-03T11:50:14.870 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.868+0000 7fe44af22800 20 rados->read ofs=0 len=0 2023-12-03T11:50:14.871 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.868+0000 7fe44af22800 20 rados_obj.operate() r=0 bl.length=200 2023-12-03T11:50:14.871 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.868+0000 7fe44af22800 20 rados->read ofs=0 len=0 2023-12-03T11:50:14.871 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.869+0000 7fe44af22800 20 rados_obj.operate() r=0 bl.length=372 2023-12-03T11:50:14.871 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.869+0000 7fe44af22800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:50:14.871 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.869+0000 7fe44af22800 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2023-12-03T11:50:14.871 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.869+0000 7fe44af22800 20 INFO: main: starting shard=0 2023-12-03T11:50:14.872 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.869+0000 7fe44af22800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.2.0 2023-12-03T11:50:14.872 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.869+0000 7fe44af22800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.2.0 2023-12-03T11:50:14.872 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.869+0000 7fe44af22800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2023-12-03T11:50:14.872 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.869+0000 7fe44af22800 20 INFO: main: starting shard=1 2023-12-03T11:50:14.872 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.869+0000 7fe44af22800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.2.1 2023-12-03T11:50:14.872 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.869+0000 7fe44af22800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.2.1 2023-12-03T11:50:14.872 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.870+0000 7fe44af22800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:50:14.872 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.870+0000 7fe44af22800 20 INFO: main: starting shard=2 2023-12-03T11:50:14.872 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.870+0000 7fe44af22800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.2.2 2023-12-03T11:50:14.872 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.870+0000 7fe44af22800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.2.2 2023-12-03T11:50:14.873 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.870+0000 7fe44af22800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:50:14.873 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.870+0000 7fe44af22800 20 INFO: main: starting shard=3 2023-12-03T11:50:14.874 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.870+0000 7fe44af22800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.2.3 2023-12-03T11:50:14.874 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.870+0000 7fe44af22800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.2.3 2023-12-03T11:50:14.874 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.871+0000 7fe44af22800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:50:14.874 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.871+0000 7fe44af22800 20 INFO: main: starting shard=4 2023-12-03T11:50:14.874 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.871+0000 7fe44af22800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.2.4 2023-12-03T11:50:14.874 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.871+0000 7fe44af22800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.2.4 2023-12-03T11:50:14.874 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.871+0000 7fe44af22800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:50:14.874 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.871+0000 7fe44af22800 20 INFO: main: starting shard=5 2023-12-03T11:50:14.874 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.871+0000 7fe44af22800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.2.5 2023-12-03T11:50:14.874 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.871+0000 7fe44af22800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.2.5 2023-12-03T11:50:14.874 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.872+0000 7fe44af22800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:50:14.874 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.872+0000 7fe44af22800 20 INFO: main: starting shard=6 2023-12-03T11:50:14.874 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.872+0000 7fe44af22800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.2.6 2023-12-03T11:50:14.875 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.872+0000 7fe44af22800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.2.6 2023-12-03T11:50:14.875 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.872+0000 7fe44af22800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:50:14.875 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.872+0000 7fe44af22800 20 INFO: main: starting shard=7 2023-12-03T11:50:14.875 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.872+0000 7fe44af22800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.2.7 2023-12-03T11:50:14.875 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.872+0000 7fe44af22800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.2.7 2023-12-03T11:50:14.876 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.873+0000 7fe44af22800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:50:14.876 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.873+0000 7fe44af22800 20 INFO: main: starting shard=8 2023-12-03T11:50:14.876 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.873+0000 7fe44af22800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.2.8 2023-12-03T11:50:14.876 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.873+0000 7fe44af22800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.2.8 2023-12-03T11:50:14.877 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.873+0000 7fe44af22800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:50:14.877 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.873+0000 7fe44af22800 20 INFO: main: starting shard=9 2023-12-03T11:50:14.877 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.873+0000 7fe44af22800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.2.9 2023-12-03T11:50:14.877 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.873+0000 7fe44af22800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.2.9 2023-12-03T11:50:14.877 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.873+0000 7fe44af22800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:50:14.877 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.873+0000 7fe44af22800 20 INFO: main: starting shard=10 2023-12-03T11:50:14.877 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.873+0000 7fe44af22800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.2.10 2023-12-03T11:50:14.877 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.873+0000 7fe44af22800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.2.10 2023-12-03T11:50:14.877 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.874+0000 7fe44af22800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:50:14.877 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.874+0000 7fe44af22800 20 INFO: main: starting shard=11 2023-12-03T11:50:14.877 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.874+0000 7fe44af22800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.2.11 2023-12-03T11:50:14.877 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.874+0000 7fe44af22800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.2.11 2023-12-03T11:50:14.877 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.874+0000 7fe44af22800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:50:14.877 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.874+0000 7fe44af22800 20 INFO: main: starting shard=12 2023-12-03T11:50:14.878 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.874+0000 7fe44af22800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.2.12 2023-12-03T11:50:14.878 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.874+0000 7fe44af22800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.2.12 2023-12-03T11:50:14.878 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.875+0000 7fe44af22800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:50:14.878 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.875+0000 7fe44af22800 20 INFO: main: done 2023-12-03T11:50:14.878 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.875+0000 7fe387fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:50:14.879 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.878+0000 7fe44af22800 20 remove_watcher() i=0 2023-12-03T11:50:14.879 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.878+0000 7fe44af22800 2 removed watcher, disabling cache 2023-12-03T11:50:14.880 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.879+0000 7fe44af22800 20 remove_watcher() i=1 2023-12-03T11:50:14.881 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.880+0000 7fe44af22800 20 remove_watcher() i=2 2023-12-03T11:50:14.882 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.881+0000 7fe44af22800 20 remove_watcher() i=3 2023-12-03T11:50:14.883 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.882+0000 7fe44af22800 20 remove_watcher() i=4 2023-12-03T11:50:14.884 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.883+0000 7fe44af22800 20 remove_watcher() i=5 2023-12-03T11:50:14.885 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.884+0000 7fe44af22800 20 remove_watcher() i=6 2023-12-03T11:50:14.886 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.885+0000 7fe44af22800 20 remove_watcher() i=7 2023-12-03T11:50:14.892 INFO:tasks.workunit.client.0.smithi003.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 1 --yes-i-really-mean-it 2023-12-03T11:50:14.923 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:50:14.923 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:50:14.938 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.937+0000 7f8f7d012800 20 rados->read ofs=0 len=0 2023-12-03T11:50:14.943 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.938+0000 7f8f7d012800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:50:14.943 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.938+0000 7f8f7d012800 20 realm 2023-12-03T11:50:14.943 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.938+0000 7f8f7d012800 20 rados->read ofs=0 len=0 2023-12-03T11:50:14.944 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.938+0000 7f8f7d012800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:50:14.944 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.938+0000 7f8f7d012800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:50:14.944 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.938+0000 7f8f7d012800 20 rados->read ofs=0 len=0 2023-12-03T11:50:14.944 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.939+0000 7f8f7d012800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:50:14.944 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.939+0000 7f8f7d012800 20 rados->read ofs=0 len=0 2023-12-03T11:50:14.944 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.940+0000 7f8f7d012800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:50:14.944 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.940+0000 7f8f7d012800 20 rados->read ofs=0 len=0 2023-12-03T11:50:14.945 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.940+0000 7f8f7d012800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:50:14.945 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.940+0000 7f8f7d012800 20 searching for the correct realm 2023-12-03T11:50:14.951 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.950+0000 7f8f77f29640 0 -- 172.21.15.3:0/4228369275 >> [v2:172.21.15.3:6817/3356208405,v1:172.21.15.3:6819/3356208405] conn(0x55633c7e3a50 msgr2=0x55633c7e5e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:50:14.952 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.951+0000 7f8f7d012800 20 RGWRados::pool_iterate: got zone_info.83aabb46-04b5-4c96-9933-c6bfb1173a73 2023-12-03T11:50:14.952 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.951+0000 7f8f7d012800 20 RGWRados::pool_iterate: got zonegroup_info.6a811aad-435d-4fdd-93c9-b7e0b50de429 2023-12-03T11:50:14.952 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.951+0000 7f8f7d012800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:50:14.952 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.951+0000 7f8f7d012800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:50:14.952 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.951+0000 7f8f7d012800 20 rados->read ofs=0 len=0 2023-12-03T11:50:14.952 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.951+0000 7f8f7d012800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:50:14.952 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.951+0000 7f8f7d012800 20 rados->read ofs=0 len=0 2023-12-03T11:50:14.954 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.951+0000 7f8f7d012800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:50:14.954 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.951+0000 7f8f7d012800 20 rados->read ofs=0 len=0 2023-12-03T11:50:14.954 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.952+0000 7f8f7d012800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:50:14.954 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.952+0000 7f8f7d012800 20 zone default found 2023-12-03T11:50:14.954 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.952+0000 7f8f7d012800 4 Realm: () 2023-12-03T11:50:14.955 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.952+0000 7f8f7d012800 4 ZoneGroup: default (6a811aad-435d-4fdd-93c9-b7e0b50de429) 2023-12-03T11:50:14.955 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.952+0000 7f8f7d012800 4 Zone: default (83aabb46-04b5-4c96-9933-c6bfb1173a73) 2023-12-03T11:50:14.955 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.952+0000 7f8f7d012800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:50:14.955 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.952+0000 7f8f7d012800 20 zonegroup default 2023-12-03T11:50:14.955 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.952+0000 7f8f7d012800 20 rados->read ofs=0 len=0 2023-12-03T11:50:14.955 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.952+0000 7f8f7d012800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:50:14.955 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.952+0000 7f8f7d012800 20 rados->read ofs=0 len=0 2023-12-03T11:50:14.955 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.952+0000 7f8f7d012800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:50:14.955 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.952+0000 7f8f7d012800 20 rados->read ofs=0 len=0 2023-12-03T11:50:14.955 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.952+0000 7f8f7d012800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:50:14.955 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.952+0000 7f8f7d012800 20 started sync module instance, tier type = 2023-12-03T11:50:14.956 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.952+0000 7f8f7d012800 20 started zone id=83aabb46-04b5-4c96-9933-c6bfb1173a73 (name=default) with tier type = 2023-12-03T11:50:14.961 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.960+0000 7f8f77f29640 0 -- 172.21.15.3:0/4228369275 >> [v2:172.21.15.3:6817/3356208405,v1:172.21.15.3:6819/3356208405] conn(0x7f8f54079dc0 msgr2=0x7f8f5407c1f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:50:14.962 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.961+0000 7f8f7d012800 20 add_watcher() i=0 2023-12-03T11:50:14.962 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.961+0000 7f8f7d012800 20 add_watcher() i=1 2023-12-03T11:50:14.962 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.961+0000 7f8f7d012800 20 add_watcher() i=2 2023-12-03T11:50:14.962 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.961+0000 7f8f7d012800 20 add_watcher() i=3 2023-12-03T11:50:14.963 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.961+0000 7f8f7d012800 20 add_watcher() i=4 2023-12-03T11:50:14.963 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.962+0000 7f8f7d012800 20 add_watcher() i=5 2023-12-03T11:50:14.963 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.962+0000 7f8f7d012800 20 add_watcher() i=6 2023-12-03T11:50:14.963 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.962+0000 7f8f7d012800 20 add_watcher() i=7 2023-12-03T11:50:14.964 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.962+0000 7f8f7d012800 2 all 8 watchers are set, enabling cache 2023-12-03T11:50:14.965 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.964+0000 7f8f3e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:50:14.965 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.964+0000 7f8f7d012800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:50:14.965 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.964+0000 7f8f7d012800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:50:14.972 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.970+0000 7f8f7d012800 5 note: GC not initialized 2023-12-03T11:50:14.972 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.971+0000 7f8ead7fa640 20 reqs_thread_entry: start 2023-12-03T11:50:14.973 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.971+0000 7f8f7d012800 20 init_complete bucket index max shards: 11 2023-12-03T11:50:14.973 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.971+0000 7f8f7d012800 20 Filter name: none 2023-12-03T11:50:14.973 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.971+0000 7f8ea6ffd640 20 reqs_thread_entry: start 2023-12-03T11:50:14.973 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.971+0000 7f8f7d012800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2023-12-03T11:50:14.973 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.971+0000 7f8f7d012800 20 rados->read ofs=0 len=0 2023-12-03T11:50:14.974 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.971+0000 7f8f7d012800 20 rados_obj.operate() r=0 bl.length=200 2023-12-03T11:50:14.974 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.971+0000 7f8f7d012800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2023-12-03T11:50:14.974 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.971+0000 7f8f7d012800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2023-12-03T11:50:14.974 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.971+0000 7f8f7d012800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17 : miss 2023-12-03T11:50:14.974 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.971+0000 7f8f7d012800 20 rados->read ofs=0 len=0 2023-12-03T11:50:14.974 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.972+0000 7f8f7d012800 20 rados_obj.operate() r=0 bl.length=372 2023-12-03T11:50:14.974 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.972+0000 7f8f7d012800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17 info.flags=0x17 2023-12-03T11:50:14.974 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.972+0000 7f8f7d012800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17 to cache LRU end 2023-12-03T11:50:14.974 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.972+0000 7f8f7d012800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:50:14.974 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.972+0000 7f8f7d012800 10 updating xattr: name=user.rgw.acl bl.length()=203 2023-12-03T11:50:14.974 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.972+0000 7f8f7d012800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17 2023-12-03T11:50:14.977 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.976+0000 7f8f7d012800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17 info.flags=0x17 2023-12-03T11:50:14.977 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.976+0000 7f8f7d012800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17 to cache LRU end 2023-12-03T11:50:14.978 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.976+0000 7f8f7d012800 10 updating xattr: name=user.rgw.acl bl.length()=203 2023-12-03T11:50:14.978 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.976+0000 7f8f7d012800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17, ofs0, ns] 2023-12-03T11:50:14.978 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.976+0000 7f8f5e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660580 cookie 93884705057984 notifier 7082 bl.length()=861 2023-12-03T11:50:14.978 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.976+0000 7f8f5e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17 info.flags=0x17 2023-12-03T11:50:14.978 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.976+0000 7f8f5e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17 to cache LRU end 2023-12-03T11:50:14.978 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.976+0000 7f8f5e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2023-12-03T11:50:14.979 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.978+0000 7f8f7d012800 20 handle_bi_update(): bucket=:a-bucket[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17]): orig_sources= new_sources= 2023-12-03T11:50:14.979 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.978+0000 7f8f7d012800 20 handle_bi_update(): bucket=:a-bucket[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17]): potential sources added=[] removed=[] 2023-12-03T11:50:14.979 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.978+0000 7f8f7d012800 20 handle_bi_update(): bucket=:a-bucket[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17]): orig_dests= new_dests= 2023-12-03T11:50:14.980 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.978+0000 7f8f7d012800 20 handle_bi_update(): bucket=:a-bucket[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17]): potential dests added=[] removed=[] 2023-12-03T11:50:14.982 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.980+0000 7f8f7d012800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.3.0 2023-12-03T11:50:14.982 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.980+0000 7f8f7d012800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.3.0 2023-12-03T11:50:14.982 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.981+0000 7f8f7d012800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.2.0 2023-12-03T11:50:14.982 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.981+0000 7f8f7d012800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.2.0 2023-12-03T11:50:14.984 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.981+0000 7f8f7d012800 10 Dropping entry with empty name, idx=�1001_04/57/0457f727ec113e418d5b16d206b200ed068c0533554883ce811df7c932a3df68/2018_12_11/2889999/3386469/metadata.gz 2023-12-03T11:50:14.984 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.981+0000 7f8f7d012800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.2.1 2023-12-03T11:50:14.984 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.981+0000 7f8f7d012800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.2.1 2023-12-03T11:50:14.984 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.981+0000 7f8f7d012800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.2.2 2023-12-03T11:50:14.984 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.981+0000 7f8f7d012800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.2.2 2023-12-03T11:50:14.984 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.982+0000 7f8f7d012800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.2.3 2023-12-03T11:50:14.984 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.982+0000 7f8f7d012800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.2.3 2023-12-03T11:50:14.984 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.982+0000 7f8f7d012800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.2.4 2023-12-03T11:50:14.984 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.982+0000 7f8f7d012800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.2.4 2023-12-03T11:50:14.985 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.983+0000 7f8f7d012800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.2.5 2023-12-03T11:50:14.985 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.983+0000 7f8f7d012800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.2.5 2023-12-03T11:50:14.985 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.983+0000 7f8f7d012800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.2.6 2023-12-03T11:50:14.985 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.983+0000 7f8f7d012800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.2.6 2023-12-03T11:50:14.985 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.984+0000 7f8f7d012800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.2.7 2023-12-03T11:50:14.985 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.984+0000 7f8f7d012800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.2.7 2023-12-03T11:50:14.986 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.984+0000 7f8f7d012800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.2.8 2023-12-03T11:50:14.986 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.984+0000 7f8f7d012800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.2.8 2023-12-03T11:50:14.986 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.985+0000 7f8f7d012800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.2.9 2023-12-03T11:50:14.986 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.985+0000 7f8f7d012800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.2.9 2023-12-03T11:50:14.986 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.985+0000 7f8f7d012800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.2.10 2023-12-03T11:50:14.987 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.985+0000 7f8f7d012800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.2.10 2023-12-03T11:50:14.987 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.986+0000 7f8f7d012800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.2.11 2023-12-03T11:50:14.987 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.986+0000 7f8f7d012800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.2.11 2023-12-03T11:50:14.987 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.986+0000 7f8f7d012800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.2.12 2023-12-03T11:50:14.987 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.986+0000 7f8f7d012800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.2.12 2023-12-03T11:50:14.988 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.987+0000 7f8f7d012800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17 : hit (requested=0x17, cached=0x17) 2023-12-03T11:50:14.988 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.987+0000 7f8f7d012800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17 2023-12-03T11:50:14.989 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.988+0000 7f8f7d012800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17 info.flags=0x17 2023-12-03T11:50:14.989 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.988+0000 7f8f7d012800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17 to cache LRU end 2023-12-03T11:50:14.989 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.988+0000 7f8f7d012800 10 updating xattr: name=user.rgw.acl bl.length()=203 2023-12-03T11:50:14.990 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.988+0000 7f8f7d012800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17, ofs0, ns] 2023-12-03T11:50:14.990 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.988+0000 7f8f5e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660581 cookie 93884705057984 notifier 7082 bl.length()=829 2023-12-03T11:50:14.990 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.988+0000 7f8f5e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17 info.flags=0x17 2023-12-03T11:50:14.990 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.988+0000 7f8f5e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17 to cache LRU end 2023-12-03T11:50:14.990 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.988+0000 7f8f5e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2023-12-03T11:50:14.991 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.990+0000 7f8f7d012800 20 handle_bi_update(): bucket=:a-bucket[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17]): orig_sources= new_sources= 2023-12-03T11:50:14.991 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.990+0000 7f8f7d012800 20 handle_bi_update(): bucket=:a-bucket[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17]): potential sources added=[] removed=[] 2023-12-03T11:50:14.991 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.990+0000 7f8f7d012800 20 handle_bi_update(): bucket=:a-bucket[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17]): orig_dests= new_dests= 2023-12-03T11:50:14.991 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.990+0000 7f8f7d012800 20 handle_bi_update(): bucket=:a-bucket[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17]): potential dests added=[] removed=[] 2023-12-03T11:50:14.993 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.992+0000 7f8f7d012800 1 execute INFO: reshard of bucket "a-bucket" completed successfully 2023-12-03T11:50:14.995 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.994+0000 7f8f3e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:50:14.997 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.996+0000 7f8f7d012800 20 remove_watcher() i=0 2023-12-03T11:50:14.997 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.996+0000 7f8f7d012800 2 removed watcher, disabling cache 2023-12-03T11:50:14.998 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.997+0000 7f8f7d012800 20 remove_watcher() i=1 2023-12-03T11:50:14.999 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.998+0000 7f8f7d012800 20 remove_watcher() i=2 2023-12-03T11:50:15.000 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:14.999+0000 7f8f7d012800 20 remove_watcher() i=3 2023-12-03T11:50:15.001 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.000+0000 7f8f7d012800 20 remove_watcher() i=4 2023-12-03T11:50:15.002 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.001+0000 7f8f7d012800 20 remove_watcher() i=5 2023-12-03T11:50:15.003 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.002+0000 7f8f7d012800 20 remove_watcher() i=6 2023-12-03T11:50:15.004 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.003+0000 7f8f7d012800 20 remove_watcher() i=7 2023-12-03T11:50:15.010 INFO:tasks.workunit.client.0.smithi003.stderr:radosgw-admin bi list --bucket a-bucket 2023-12-03T11:50:15.038 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:50:15.038 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:50:15.052 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.051+0000 7f5b4711f800 20 rados->read ofs=0 len=0 2023-12-03T11:50:15.054 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.052+0000 7f5b4711f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:50:15.054 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.053+0000 7f5b4711f800 20 realm 2023-12-03T11:50:15.054 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.053+0000 7f5b4711f800 20 rados->read ofs=0 len=0 2023-12-03T11:50:15.054 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.053+0000 7f5b4711f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:50:15.054 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.053+0000 7f5b4711f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:50:15.054 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.053+0000 7f5b4711f800 20 rados->read ofs=0 len=0 2023-12-03T11:50:15.054 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.053+0000 7f5b4711f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:50:15.055 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.053+0000 7f5b4711f800 20 rados->read ofs=0 len=0 2023-12-03T11:50:15.055 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.054+0000 7f5b4711f800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:50:15.055 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.054+0000 7f5b4711f800 20 rados->read ofs=0 len=0 2023-12-03T11:50:15.055 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.054+0000 7f5b4711f800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:50:15.055 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.054+0000 7f5b4711f800 20 searching for the correct realm 2023-12-03T11:50:15.066 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.064+0000 7f5b42eb8640 0 -- 172.21.15.3:0/694162205 >> [v2:172.21.15.37:6805/1692844418,v1:172.21.15.37:6807/1692844418] conn(0x559d80aa0a70 msgr2=0x559d80aa2e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:50:15.067 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.066+0000 7f5b4711f800 20 RGWRados::pool_iterate: got zone_info.83aabb46-04b5-4c96-9933-c6bfb1173a73 2023-12-03T11:50:15.067 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.066+0000 7f5b4711f800 20 RGWRados::pool_iterate: got zonegroup_info.6a811aad-435d-4fdd-93c9-b7e0b50de429 2023-12-03T11:50:15.068 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.066+0000 7f5b4711f800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:50:15.068 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.066+0000 7f5b4711f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:50:15.068 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.066+0000 7f5b4711f800 20 rados->read ofs=0 len=0 2023-12-03T11:50:15.068 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.066+0000 7f5b4711f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:50:15.068 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.066+0000 7f5b4711f800 20 rados->read ofs=0 len=0 2023-12-03T11:50:15.069 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.067+0000 7f5b4711f800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:50:15.069 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.067+0000 7f5b4711f800 20 rados->read ofs=0 len=0 2023-12-03T11:50:15.069 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.067+0000 7f5b4711f800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:50:15.070 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.067+0000 7f5b4711f800 20 zone default found 2023-12-03T11:50:15.070 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.067+0000 7f5b4711f800 4 Realm: () 2023-12-03T11:50:15.070 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.067+0000 7f5b4711f800 4 ZoneGroup: default (6a811aad-435d-4fdd-93c9-b7e0b50de429) 2023-12-03T11:50:15.070 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.067+0000 7f5b4711f800 4 Zone: default (83aabb46-04b5-4c96-9933-c6bfb1173a73) 2023-12-03T11:50:15.070 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.067+0000 7f5b4711f800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:50:15.070 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.067+0000 7f5b4711f800 20 zonegroup default 2023-12-03T11:50:15.070 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.067+0000 7f5b4711f800 20 rados->read ofs=0 len=0 2023-12-03T11:50:15.070 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.067+0000 7f5b4711f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:50:15.070 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.067+0000 7f5b4711f800 20 rados->read ofs=0 len=0 2023-12-03T11:50:15.070 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.068+0000 7f5b4711f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:50:15.070 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.068+0000 7f5b4711f800 20 rados->read ofs=0 len=0 2023-12-03T11:50:15.070 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.068+0000 7f5b4711f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:50:15.071 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.068+0000 7f5b4711f800 20 started sync module instance, tier type = 2023-12-03T11:50:15.071 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.068+0000 7f5b4711f800 20 started zone id=83aabb46-04b5-4c96-9933-c6bfb1173a73 (name=default) with tier type = 2023-12-03T11:50:15.076 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.075+0000 7f5b3bfff640 0 -- 172.21.15.3:0/694162205 >> [v2:172.21.15.3:6817/3356208405,v1:172.21.15.3:6819/3356208405] conn(0x559d80aa5a50 msgr2=0x559d80aa7e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:50:15.079 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.077+0000 7f5b4711f800 20 add_watcher() i=0 2023-12-03T11:50:15.079 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.077+0000 7f5b4711f800 20 add_watcher() i=1 2023-12-03T11:50:15.079 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.077+0000 7f5b4711f800 20 add_watcher() i=2 2023-12-03T11:50:15.079 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.077+0000 7f5b4711f800 20 add_watcher() i=3 2023-12-03T11:50:15.079 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.077+0000 7f5b4711f800 20 add_watcher() i=4 2023-12-03T11:50:15.079 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.077+0000 7f5b4711f800 20 add_watcher() i=5 2023-12-03T11:50:15.079 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.077+0000 7f5b4711f800 20 add_watcher() i=6 2023-12-03T11:50:15.079 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.078+0000 7f5b4711f800 20 add_watcher() i=7 2023-12-03T11:50:15.079 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.078+0000 7f5b4711f800 2 all 8 watchers are set, enabling cache 2023-12-03T11:50:15.081 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.080+0000 7f5a83fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:50:15.081 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.080+0000 7f5b4711f800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:50:15.081 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.080+0000 7f5b4711f800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:50:15.088 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.086+0000 7f5b4711f800 5 note: GC not initialized 2023-12-03T11:50:15.088 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.086+0000 7f5a72ffd640 20 reqs_thread_entry: start 2023-12-03T11:50:15.088 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.086+0000 7f5b4711f800 20 init_complete bucket index max shards: 11 2023-12-03T11:50:15.088 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.086+0000 7f5b4711f800 20 Filter name: none 2023-12-03T11:50:15.088 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.087+0000 7f5a70ff9640 20 reqs_thread_entry: start 2023-12-03T11:50:15.088 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.087+0000 7f5b4711f800 20 rados->read ofs=0 len=0 2023-12-03T11:50:15.089 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.087+0000 7f5b4711f800 20 rados_obj.operate() r=0 bl.length=200 2023-12-03T11:50:15.089 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.087+0000 7f5b4711f800 20 rados->read ofs=0 len=0 2023-12-03T11:50:15.089 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.088+0000 7f5b4711f800 20 rados_obj.operate() r=0 bl.length=372 2023-12-03T11:50:15.089 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.088+0000 7f5b4711f800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:50:15.089 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.088+0000 7f5b4711f800 20 INFO: main: max_entries=1000, index=gen=3, max_shards=1 2023-12-03T11:50:15.089 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.088+0000 7f5b4711f800 20 INFO: main: starting shard=0 2023-12-03T11:50:15.090 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.088+0000 7f5b4711f800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.3.0 2023-12-03T11:50:15.090 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.088+0000 7f5b4711f800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.17.3.0 2023-12-03T11:50:15.090 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.088+0000 7f5b4711f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:50:15.090 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.088+0000 7f5b4711f800 20 INFO: main: done 2023-12-03T11:50:15.090 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.089+0000 7f5a83fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:50:15.092 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.091+0000 7f5b4711f800 20 remove_watcher() i=0 2023-12-03T11:50:15.092 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.091+0000 7f5b4711f800 2 removed watcher, disabling cache 2023-12-03T11:50:15.093 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.092+0000 7f5b4711f800 20 remove_watcher() i=1 2023-12-03T11:50:15.094 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.093+0000 7f5b4711f800 20 remove_watcher() i=2 2023-12-03T11:50:15.095 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.094+0000 7f5b4711f800 20 remove_watcher() i=3 2023-12-03T11:50:15.096 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.095+0000 7f5b4711f800 20 remove_watcher() i=4 2023-12-03T11:50:15.097 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.096+0000 7f5b4711f800 20 remove_watcher() i=5 2023-12-03T11:50:15.098 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.097+0000 7f5b4711f800 20 remove_watcher() i=6 2023-12-03T11:50:15.099 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.098+0000 7f5b4711f800 20 remove_watcher() i=7 2023-12-03T11:50:15.104 INFO:tasks.workunit.client.0.smithi003.stderr: test: PUT succeeds during reshard 2023-12-03T11:50:15.105 INFO:tasks.workunit.client.0.smithi003.stderr:radosgw-admin bucket stats --bucket myver 2023-12-03T11:50:15.133 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:50:15.133 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:50:15.147 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.146+0000 7f2177233800 20 rados->read ofs=0 len=0 2023-12-03T11:50:15.149 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.147+0000 7f2177233800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:50:15.149 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.147+0000 7f2177233800 20 realm 2023-12-03T11:50:15.149 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.147+0000 7f2177233800 20 rados->read ofs=0 len=0 2023-12-03T11:50:15.149 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.148+0000 7f2177233800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:50:15.149 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.148+0000 7f2177233800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:50:15.149 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.148+0000 7f2177233800 20 rados->read ofs=0 len=0 2023-12-03T11:50:15.150 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.148+0000 7f2177233800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:50:15.150 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.148+0000 7f2177233800 20 rados->read ofs=0 len=0 2023-12-03T11:50:15.150 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.149+0000 7f2177233800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:50:15.150 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.149+0000 7f2177233800 20 rados->read ofs=0 len=0 2023-12-03T11:50:15.150 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.149+0000 7f2177233800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:50:15.151 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.149+0000 7f2177233800 20 searching for the correct realm 2023-12-03T11:50:15.160 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.159+0000 7f2174d33640 0 -- 172.21.15.3:0/2822204721 >> [v2:172.21.15.37:6805/1692844418,v1:172.21.15.37:6807/1692844418] conn(0x55df31e388e0 msgr2=0x55df31e3acd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:50:15.162 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.160+0000 7f2177233800 20 RGWRados::pool_iterate: got zone_info.83aabb46-04b5-4c96-9933-c6bfb1173a73 2023-12-03T11:50:15.162 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.160+0000 7f2177233800 20 RGWRados::pool_iterate: got zonegroup_info.6a811aad-435d-4fdd-93c9-b7e0b50de429 2023-12-03T11:50:15.162 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.160+0000 7f2177233800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:50:15.162 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.160+0000 7f2177233800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:50:15.162 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.161+0000 7f2177233800 20 rados->read ofs=0 len=0 2023-12-03T11:50:15.162 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.161+0000 7f2177233800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:50:15.162 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.161+0000 7f2177233800 20 rados->read ofs=0 len=0 2023-12-03T11:50:15.163 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.161+0000 7f2177233800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:50:15.163 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.161+0000 7f2177233800 20 rados->read ofs=0 len=0 2023-12-03T11:50:15.163 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.161+0000 7f2177233800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:50:15.163 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.161+0000 7f2177233800 20 zone default found 2023-12-03T11:50:15.164 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.161+0000 7f2177233800 4 Realm: () 2023-12-03T11:50:15.164 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.161+0000 7f2177233800 4 ZoneGroup: default (6a811aad-435d-4fdd-93c9-b7e0b50de429) 2023-12-03T11:50:15.164 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.161+0000 7f2177233800 4 Zone: default (83aabb46-04b5-4c96-9933-c6bfb1173a73) 2023-12-03T11:50:15.164 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.161+0000 7f2177233800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:50:15.164 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.161+0000 7f2177233800 20 zonegroup default 2023-12-03T11:50:15.164 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.161+0000 7f2177233800 20 rados->read ofs=0 len=0 2023-12-03T11:50:15.164 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.161+0000 7f2177233800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:50:15.164 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.161+0000 7f2177233800 20 rados->read ofs=0 len=0 2023-12-03T11:50:15.164 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.162+0000 7f2177233800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:50:15.164 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.162+0000 7f2177233800 20 rados->read ofs=0 len=0 2023-12-03T11:50:15.164 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.162+0000 7f2177233800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:50:15.164 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.162+0000 7f2177233800 20 started sync module instance, tier type = 2023-12-03T11:50:15.164 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.162+0000 7f2177233800 20 started zone id=83aabb46-04b5-4c96-9933-c6bfb1173a73 (name=default) with tier type = 2023-12-03T11:50:15.169 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.168+0000 7f2174d33640 0 -- 172.21.15.3:0/2822204721 >> [v2:172.21.15.3:6800/2373485412,v1:172.21.15.3:6801/2373485412] conn(0x7f216c03a450 msgr2=0x7f216c03a870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:50:15.177 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.175+0000 7f2177233800 20 add_watcher() i=0 2023-12-03T11:50:15.177 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.175+0000 7f2177233800 20 add_watcher() i=1 2023-12-03T11:50:15.177 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.175+0000 7f2177233800 20 add_watcher() i=2 2023-12-03T11:50:15.177 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.175+0000 7f2177233800 20 add_watcher() i=3 2023-12-03T11:50:15.177 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.175+0000 7f2177233800 20 add_watcher() i=4 2023-12-03T11:50:15.177 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.175+0000 7f2177233800 20 add_watcher() i=5 2023-12-03T11:50:15.177 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.175+0000 7f2177233800 20 add_watcher() i=6 2023-12-03T11:50:15.178 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.176+0000 7f2177233800 20 add_watcher() i=7 2023-12-03T11:50:15.178 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.176+0000 7f2177233800 2 all 8 watchers are set, enabling cache 2023-12-03T11:50:15.180 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.178+0000 7f213b7de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:50:15.180 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.178+0000 7f2177233800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:50:15.180 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.178+0000 7f2177233800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:50:15.186 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.184+0000 7f2177233800 5 note: GC not initialized 2023-12-03T11:50:15.186 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.185+0000 7f20aa7fc640 20 reqs_thread_entry: start 2023-12-03T11:50:15.186 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.185+0000 7f2177233800 20 init_complete bucket index max shards: 11 2023-12-03T11:50:15.187 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.185+0000 7f2177233800 20 Filter name: none 2023-12-03T11:50:15.187 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.185+0000 7f209bfff640 20 reqs_thread_entry: start 2023-12-03T11:50:15.187 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.185+0000 7f2177233800 20 rados->read ofs=0 len=0 2023-12-03T11:50:15.188 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.186+0000 7f2177233800 20 rados_obj.operate() r=0 bl.length=197 2023-12-03T11:50:15.188 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.186+0000 7f2177233800 20 rados->read ofs=0 len=0 2023-12-03T11:50:15.188 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.186+0000 7f2177233800 20 rados_obj.operate() r=0 bl.length=369 2023-12-03T11:50:15.188 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.186+0000 7f2177233800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:50:15.188 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.186+0000 7f2177233800 20 rados->read ofs=0 len=0 2023-12-03T11:50:15.188 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.186+0000 7f2177233800 20 rados_obj.operate() r=0 bl.length=197 2023-12-03T11:50:15.188 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.186+0000 7f2177233800 20 rados->read ofs=0 len=0 2023-12-03T11:50:15.188 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.187+0000 7f2177233800 20 rados_obj.operate() r=0 bl.length=369 2023-12-03T11:50:15.188 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.187+0000 7f2177233800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:50:15.189 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.188+0000 7f2177233800 20 rados->read ofs=0 len=0 2023-12-03T11:50:15.189 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.188+0000 7f2177233800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:50:15.190 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.189+0000 7f213b7de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:50:15.192 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.191+0000 7f2177233800 20 remove_watcher() i=0 2023-12-03T11:50:15.192 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.191+0000 7f2177233800 2 removed watcher, disabling cache 2023-12-03T11:50:15.193 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.192+0000 7f2177233800 20 remove_watcher() i=1 2023-12-03T11:50:15.194 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.193+0000 7f2177233800 20 remove_watcher() i=2 2023-12-03T11:50:15.195 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.194+0000 7f2177233800 20 remove_watcher() i=3 2023-12-03T11:50:15.196 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.195+0000 7f2177233800 20 remove_watcher() i=4 2023-12-03T11:50:15.197 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.196+0000 7f2177233800 20 remove_watcher() i=5 2023-12-03T11:50:15.198 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.197+0000 7f2177233800 20 remove_watcher() i=6 2023-12-03T11:50:15.199 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.198+0000 7f2177233800 20 remove_watcher() i=7 2023-12-03T11:50:15.203 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:50:15.203 INFO:tasks.workunit.client.0.smithi003.stderr:BUCKET_STATS: 2023-12-03T11:50:15.203 INFO:tasks.workunit.client.0.smithi003.stderr:bucket: myver id: 83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18 num_objects: 0 size_kb: 0 num_shards: 12 2023-12-03T11:50:15.204 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:50:15.205 INFO:tasks.workunit.client.0.smithi003.stderr:radosgw-admin --inject-delay-at=do_reshard --inject-delay-ms=5000 bucket reshard --bucket myver --num-shards 13 2023-12-03T11:50:15.237 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:50:15.237 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:50:15.251 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.250+0000 7fa938a16800 20 rados->read ofs=0 len=0 2023-12-03T11:50:15.454 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.452+0000 7fa938a16800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:50:15.454 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.452+0000 7fa938a16800 20 realm 2023-12-03T11:50:15.454 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.452+0000 7fa938a16800 20 rados->read ofs=0 len=0 2023-12-03T11:50:15.454 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.452+0000 7fa938a16800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:50:15.454 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.452+0000 7fa938a16800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:50:15.454 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.452+0000 7fa938a16800 20 rados->read ofs=0 len=0 2023-12-03T11:50:15.454 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.453+0000 7fa938a16800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:50:15.454 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.453+0000 7fa938a16800 20 rados->read ofs=0 len=0 2023-12-03T11:50:15.455 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.454+0000 7fa938a16800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:50:15.455 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.454+0000 7fa938a16800 20 rados->read ofs=0 len=0 2023-12-03T11:50:15.455 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.454+0000 7fa938a16800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:50:15.455 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.454+0000 7fa938a16800 20 searching for the correct realm 2023-12-03T11:50:15.464 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.463+0000 7fa934894640 0 -- 172.21.15.3:0/2803978806 >> [v2:172.21.15.3:6816/2638197404,v1:172.21.15.3:6818/2638197404] conn(0x5590c9e5d2f0 msgr2=0x5590c9e5f6e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:50:15.466 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.465+0000 7fa938a16800 20 RGWRados::pool_iterate: got zone_info.83aabb46-04b5-4c96-9933-c6bfb1173a73 2023-12-03T11:50:15.467 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.465+0000 7fa938a16800 20 RGWRados::pool_iterate: got zonegroup_info.6a811aad-435d-4fdd-93c9-b7e0b50de429 2023-12-03T11:50:15.467 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.465+0000 7fa938a16800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:50:15.467 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.465+0000 7fa938a16800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:50:15.467 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.465+0000 7fa938a16800 20 rados->read ofs=0 len=0 2023-12-03T11:50:15.467 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.465+0000 7fa938a16800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:50:15.467 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.465+0000 7fa938a16800 20 rados->read ofs=0 len=0 2023-12-03T11:50:15.468 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.466+0000 7fa938a16800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:50:15.468 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.466+0000 7fa938a16800 20 rados->read ofs=0 len=0 2023-12-03T11:50:15.468 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.466+0000 7fa938a16800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:50:15.468 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.466+0000 7fa938a16800 20 zone default found 2023-12-03T11:50:15.468 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.466+0000 7fa938a16800 4 Realm: () 2023-12-03T11:50:15.469 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.466+0000 7fa938a16800 4 ZoneGroup: default (6a811aad-435d-4fdd-93c9-b7e0b50de429) 2023-12-03T11:50:15.469 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.466+0000 7fa938a16800 4 Zone: default (83aabb46-04b5-4c96-9933-c6bfb1173a73) 2023-12-03T11:50:15.469 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.466+0000 7fa938a16800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:50:15.469 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.466+0000 7fa938a16800 20 zonegroup default 2023-12-03T11:50:15.469 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.466+0000 7fa938a16800 20 rados->read ofs=0 len=0 2023-12-03T11:50:15.469 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.466+0000 7fa938a16800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:50:15.469 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.466+0000 7fa938a16800 20 rados->read ofs=0 len=0 2023-12-03T11:50:15.469 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.467+0000 7fa938a16800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:50:15.469 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.467+0000 7fa938a16800 20 rados->read ofs=0 len=0 2023-12-03T11:50:15.469 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.467+0000 7fa938a16800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:50:15.469 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.467+0000 7fa938a16800 20 started sync module instance, tier type = 2023-12-03T11:50:15.469 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.467+0000 7fa938a16800 20 started zone id=83aabb46-04b5-4c96-9933-c6bfb1173a73 (name=default) with tier type = 2023-12-03T11:50:15.472 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.471+0000 7fa934093640 0 -- 172.21.15.3:0/2803978806 >> [v2:172.21.15.37:6805/1692844418,v1:172.21.15.37:6807/1692844418] conn(0x5590c9e613d0 msgr2=0x5590c9e637c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:50:15.477 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.476+0000 7fa938a16800 20 add_watcher() i=0 2023-12-03T11:50:15.477 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.476+0000 7fa938a16800 20 add_watcher() i=1 2023-12-03T11:50:15.477 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.476+0000 7fa938a16800 20 add_watcher() i=2 2023-12-03T11:50:15.477 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.476+0000 7fa938a16800 20 add_watcher() i=3 2023-12-03T11:50:15.477 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.476+0000 7fa938a16800 20 add_watcher() i=4 2023-12-03T11:50:15.477 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.476+0000 7fa938a16800 20 add_watcher() i=5 2023-12-03T11:50:15.478 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.476+0000 7fa938a16800 20 add_watcher() i=6 2023-12-03T11:50:15.478 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.477+0000 7fa938a16800 20 add_watcher() i=7 2023-12-03T11:50:15.478 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.477+0000 7fa938a16800 2 all 8 watchers are set, enabling cache 2023-12-03T11:50:15.480 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.478+0000 7fa8fa7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:50:15.480 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.479+0000 7fa938a16800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:50:15.480 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.479+0000 7fa938a16800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:50:15.486 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.485+0000 7fa938a16800 5 note: GC not initialized 2023-12-03T11:50:15.486 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.485+0000 7fa8697fa640 20 reqs_thread_entry: start 2023-12-03T11:50:15.486 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.485+0000 7fa938a16800 20 init_complete bucket index max shards: 11 2023-12-03T11:50:15.487 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.485+0000 7fa938a16800 20 Filter name: none 2023-12-03T11:50:15.487 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.485+0000 7fa862ffd640 20 reqs_thread_entry: start 2023-12-03T11:50:15.487 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.485+0000 7fa938a16800 10 cache get: name=default.rgw.meta+root+myver : miss 2023-12-03T11:50:15.487 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.485+0000 7fa938a16800 20 rados->read ofs=0 len=0 2023-12-03T11:50:15.487 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.486+0000 7fa938a16800 20 rados_obj.operate() r=0 bl.length=197 2023-12-03T11:50:15.488 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.486+0000 7fa938a16800 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2023-12-03T11:50:15.488 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.486+0000 7fa938a16800 10 adding default.rgw.meta+root+myver to cache LRU end 2023-12-03T11:50:15.488 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.486+0000 7fa938a16800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18 : miss 2023-12-03T11:50:15.488 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.486+0000 7fa938a16800 20 rados->read ofs=0 len=0 2023-12-03T11:50:15.488 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.486+0000 7fa938a16800 20 rados_obj.operate() r=0 bl.length=369 2023-12-03T11:50:15.488 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.486+0000 7fa938a16800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18 info.flags=0x17 2023-12-03T11:50:15.488 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.486+0000 7fa938a16800 10 adding default.rgw.meta+root+.bucket.meta.myver:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18 to cache LRU end 2023-12-03T11:50:15.488 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.486+0000 7fa938a16800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:50:15.488 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.486+0000 7fa938a16800 10 updating xattr: name=user.rgw.acl bl.length()=203 2023-12-03T11:50:15.488 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.486+0000 7fa938a16800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18 2023-12-03T11:50:15.496 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.494+0000 7fa938a16800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18 info.flags=0x17 2023-12-03T11:50:15.496 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.494+0000 7fa938a16800 10 moving default.rgw.meta+root+.bucket.meta.myver:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18 to cache LRU end 2023-12-03T11:50:15.496 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.494+0000 7fa938a16800 10 updating xattr: name=user.rgw.acl bl.length()=203 2023-12-03T11:50:15.496 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.494+0000 7fa938a16800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18, ofs0, ns] 2023-12-03T11:50:15.496 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.494+0000 7fa91a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660511 cookie 94080350954080 notifier 7142 bl.length()=855 2023-12-03T11:50:15.496 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.494+0000 7fa91a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18 info.flags=0x17 2023-12-03T11:50:15.496 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.494+0000 7fa91a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18 to cache LRU end 2023-12-03T11:50:15.496 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.494+0000 7fa91a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2023-12-03T11:50:15.497 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.496+0000 7fa938a16800 20 handle_bi_update(): bucket=:myver[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18]): orig_sources= new_sources= 2023-12-03T11:50:15.498 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.496+0000 7fa938a16800 20 handle_bi_update(): bucket=:myver[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18]): potential sources added=[] removed=[] 2023-12-03T11:50:15.498 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.496+0000 7fa938a16800 20 handle_bi_update(): bucket=:myver[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18]): orig_dests= new_dests= 2023-12-03T11:50:15.498 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.496+0000 7fa938a16800 20 handle_bi_update(): bucket=:myver[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18]): potential dests added=[] removed=[] 2023-12-03T11:50:15.500 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:15.499+0000 7fa938a16800 -1 Injecting delay=5.000000000s at location=do_reshard 2023-12-03T11:50:20.501 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:20.499+0000 7fa938a16800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.2.0 2023-12-03T11:50:20.501 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:20.499+0000 7fa938a16800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.2.0 2023-12-03T11:50:20.501 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:20.499+0000 7fa938a16800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.2.1 2023-12-03T11:50:20.501 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:20.499+0000 7fa938a16800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.2.1 2023-12-03T11:50:20.501 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:20.499+0000 7fa938a16800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.2.2 2023-12-03T11:50:20.501 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:20.499+0000 7fa938a16800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.2.2 2023-12-03T11:50:20.501 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:20.499+0000 7fa938a16800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.2.3 2023-12-03T11:50:20.501 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:20.499+0000 7fa938a16800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.2.3 2023-12-03T11:50:20.501 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:20.499+0000 7fa938a16800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.2.4 2023-12-03T11:50:20.501 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:20.499+0000 7fa938a16800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.2.4 2023-12-03T11:50:20.502 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:20.499+0000 7fa938a16800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.2.5 2023-12-03T11:50:20.502 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:20.499+0000 7fa938a16800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.2.5 2023-12-03T11:50:20.502 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:20.499+0000 7fa938a16800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.2.6 2023-12-03T11:50:20.502 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:20.499+0000 7fa938a16800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.2.6 2023-12-03T11:50:20.502 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:20.499+0000 7fa938a16800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.2.7 2023-12-03T11:50:20.502 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:20.499+0000 7fa938a16800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.2.7 2023-12-03T11:50:20.502 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:20.499+0000 7fa938a16800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.2.8 2023-12-03T11:50:20.502 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:20.499+0000 7fa938a16800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.2.8 2023-12-03T11:50:20.502 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:20.499+0000 7fa938a16800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.2.9 2023-12-03T11:50:20.502 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:20.499+0000 7fa938a16800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.2.9 2023-12-03T11:50:20.502 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:20.499+0000 7fa938a16800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.2.10 2023-12-03T11:50:20.502 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:20.499+0000 7fa938a16800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.2.10 2023-12-03T11:50:20.502 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:20.499+0000 7fa938a16800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.2.11 2023-12-03T11:50:20.502 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:20.499+0000 7fa938a16800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.2.11 2023-12-03T11:50:20.503 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:20.499+0000 7fa938a16800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.2.12 2023-12-03T11:50:20.503 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:20.499+0000 7fa938a16800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.2.12 2023-12-03T11:50:20.503 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:20.499+0000 7fa938a16800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.1.0 2023-12-03T11:50:20.503 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:20.499+0000 7fa938a16800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.1.0 2023-12-03T11:50:20.503 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:20.500+0000 7fa938a16800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.1.1 2023-12-03T11:50:20.503 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:20.500+0000 7fa938a16800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.1.1 2023-12-03T11:50:20.503 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:20.500+0000 7fa938a16800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.1.2 2023-12-03T11:50:20.503 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:20.500+0000 7fa938a16800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.1.2 2023-12-03T11:50:20.504 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:20.501+0000 7fa938a16800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.1.3 2023-12-03T11:50:20.504 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:20.501+0000 7fa938a16800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.1.3 2023-12-03T11:50:20.504 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:20.502+0000 7fa938a16800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.1.4 2023-12-03T11:50:20.504 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:20.502+0000 7fa938a16800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.1.4 2023-12-03T11:50:20.504 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:20.503+0000 7fa938a16800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.1.5 2023-12-03T11:50:20.504 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:20.503+0000 7fa938a16800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.1.5 2023-12-03T11:50:20.504 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:20.503+0000 7fa938a16800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.1.6 2023-12-03T11:50:20.505 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:20.503+0000 7fa938a16800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.1.6 2023-12-03T11:50:20.505 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:20.504+0000 7fa938a16800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.1.7 2023-12-03T11:50:20.505 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:20.504+0000 7fa938a16800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.1.7 2023-12-03T11:50:20.505 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:20.504+0000 7fa938a16800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.1.8 2023-12-03T11:50:20.506 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:20.504+0000 7fa938a16800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.1.8 2023-12-03T11:50:20.506 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:20.505+0000 7fa938a16800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.1.9 2023-12-03T11:50:20.506 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:20.505+0000 7fa938a16800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.1.9 2023-12-03T11:50:20.507 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:20.506+0000 7fa938a16800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.1.10 2023-12-03T11:50:20.507 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:20.506+0000 7fa938a16800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.1.10 2023-12-03T11:50:20.508 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:20.506+0000 7fa938a16800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.1.11 2023-12-03T11:50:20.508 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:20.506+0000 7fa938a16800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.1.11 2023-12-03T11:50:20.508 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:20.507+0000 7fa938a16800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18 : hit (requested=0x17, cached=0x17) 2023-12-03T11:50:20.508 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:20.507+0000 7fa938a16800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18 2023-12-03T11:50:20.510 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:20.509+0000 7fa938a16800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18 info.flags=0x17 2023-12-03T11:50:20.510 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:20.509+0000 7fa938a16800 10 moving default.rgw.meta+root+.bucket.meta.myver:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18 to cache LRU end 2023-12-03T11:50:20.511 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:20.509+0000 7fa938a16800 10 updating xattr: name=user.rgw.acl bl.length()=203 2023-12-03T11:50:20.511 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:20.509+0000 7fa938a16800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18, ofs0, ns] 2023-12-03T11:50:20.511 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:20.510+0000 7fa91a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660512 cookie 94080350954080 notifier 7142 bl.length()=823 2023-12-03T11:50:20.511 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:20.510+0000 7fa91a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18 info.flags=0x17 2023-12-03T11:50:20.511 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:20.510+0000 7fa91a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18 to cache LRU end 2023-12-03T11:50:20.511 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:20.510+0000 7fa91a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2023-12-03T11:50:20.513 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:20.512+0000 7fa938a16800 20 handle_bi_update(): bucket=:myver[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18]): orig_sources= new_sources= 2023-12-03T11:50:20.513 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:20.512+0000 7fa938a16800 20 handle_bi_update(): bucket=:myver[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18]): potential sources added=[] removed=[] 2023-12-03T11:50:20.513 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:20.512+0000 7fa938a16800 20 handle_bi_update(): bucket=:myver[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18]): orig_dests= new_dests= 2023-12-03T11:50:20.513 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:20.512+0000 7fa938a16800 20 handle_bi_update(): bucket=:myver[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18]): potential dests added=[] removed=[] 2023-12-03T11:50:20.516 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:20.515+0000 7fa938a16800 1 execute INFO: reshard of bucket "myver" completed successfully 2023-12-03T11:50:20.518 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:20.517+0000 7fa8fa7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:50:20.521 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:20.520+0000 7fa938a16800 20 remove_watcher() i=0 2023-12-03T11:50:20.521 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:20.520+0000 7fa938a16800 2 removed watcher, disabling cache 2023-12-03T11:50:20.522 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:20.521+0000 7fa938a16800 20 remove_watcher() i=1 2023-12-03T11:50:20.523 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:20.522+0000 7fa938a16800 20 remove_watcher() i=2 2023-12-03T11:50:20.525 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:20.524+0000 7fa938a16800 20 remove_watcher() i=3 2023-12-03T11:50:20.526 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:20.525+0000 7fa938a16800 20 remove_watcher() i=4 2023-12-03T11:50:20.527 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:20.526+0000 7fa938a16800 20 remove_watcher() i=5 2023-12-03T11:50:20.528 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:20.527+0000 7fa938a16800 20 remove_watcher() i=6 2023-12-03T11:50:20.530 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:20.529+0000 7fa938a16800 20 remove_watcher() i=7 2023-12-03T11:50:21.303 INFO:tasks.workunit.client.0.smithi003.stderr:put object successful 2023-12-03T11:50:21.303 INFO:tasks.workunit.client.0.smithi003.stderr:TEST: check that bucket stats are correct after reshard with unlinked entries 2023-12-03T11:50:21.303 INFO:tasks.workunit.client.0.smithi003.stderr: 2023-12-03T11:50:21.646 INFO:tasks.workunit.client.0.smithi003.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2023-12-03T11:50:22.036 INFO:tasks.workunit.client.0.smithi003.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2023-12-03T11:50:23.514 INFO:tasks.workunit.client.0.smithi003.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2023-12-03T11:50:23.515 INFO:tasks.workunit.client.0.smithi003.stderr:radosgw-admin bi list --bucket myver --object x 2023-12-03T11:50:23.549 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:50:23.549 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:50:23.565 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.564+0000 7fb3b0911800 20 rados->read ofs=0 len=0 2023-12-03T11:50:23.567 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.566+0000 7fb3b0911800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:50:23.567 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.566+0000 7fb3b0911800 20 realm 2023-12-03T11:50:23.567 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.566+0000 7fb3b0911800 20 rados->read ofs=0 len=0 2023-12-03T11:50:23.567 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.566+0000 7fb3b0911800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:50:23.567 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.566+0000 7fb3b0911800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:50:23.567 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.566+0000 7fb3b0911800 20 rados->read ofs=0 len=0 2023-12-03T11:50:23.568 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.566+0000 7fb3b0911800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:50:23.568 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.566+0000 7fb3b0911800 20 rados->read ofs=0 len=0 2023-12-03T11:50:23.568 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.567+0000 7fb3b0911800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:50:23.568 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.567+0000 7fb3b0911800 20 rados->read ofs=0 len=0 2023-12-03T11:50:23.569 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.567+0000 7fb3b0911800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:50:23.569 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.567+0000 7fb3b0911800 20 searching for the correct realm 2023-12-03T11:50:23.580 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.579+0000 7fb3ae411640 0 -- 172.21.15.3:0/2622913749 >> [v2:172.21.15.37:6805/1692844418,v1:172.21.15.37:6807/1692844418] conn(0x5617aae43a60 msgr2=0x5617aae45e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:50:23.582 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.581+0000 7fb3b0911800 20 RGWRados::pool_iterate: got zone_info.83aabb46-04b5-4c96-9933-c6bfb1173a73 2023-12-03T11:50:23.582 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.581+0000 7fb3b0911800 20 RGWRados::pool_iterate: got zonegroup_info.6a811aad-435d-4fdd-93c9-b7e0b50de429 2023-12-03T11:50:23.582 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.581+0000 7fb3b0911800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:50:23.582 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.581+0000 7fb3b0911800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:50:23.582 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.581+0000 7fb3b0911800 20 rados->read ofs=0 len=0 2023-12-03T11:50:23.583 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.581+0000 7fb3b0911800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:50:23.583 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.581+0000 7fb3b0911800 20 rados->read ofs=0 len=0 2023-12-03T11:50:23.583 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.581+0000 7fb3b0911800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:50:23.584 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.581+0000 7fb3b0911800 20 rados->read ofs=0 len=0 2023-12-03T11:50:23.584 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.582+0000 7fb3b0911800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:50:23.584 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.582+0000 7fb3b0911800 20 zone default found 2023-12-03T11:50:23.584 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.582+0000 7fb3b0911800 4 Realm: () 2023-12-03T11:50:23.584 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.582+0000 7fb3b0911800 4 ZoneGroup: default (6a811aad-435d-4fdd-93c9-b7e0b50de429) 2023-12-03T11:50:23.584 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.582+0000 7fb3b0911800 4 Zone: default (83aabb46-04b5-4c96-9933-c6bfb1173a73) 2023-12-03T11:50:23.584 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.582+0000 7fb3b0911800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:50:23.584 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.582+0000 7fb3b0911800 20 zonegroup default 2023-12-03T11:50:23.584 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.582+0000 7fb3b0911800 20 rados->read ofs=0 len=0 2023-12-03T11:50:23.584 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.582+0000 7fb3b0911800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:50:23.584 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.582+0000 7fb3b0911800 20 rados->read ofs=0 len=0 2023-12-03T11:50:23.585 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.583+0000 7fb3b0911800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:50:23.585 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.583+0000 7fb3b0911800 20 rados->read ofs=0 len=0 2023-12-03T11:50:23.585 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.583+0000 7fb3b0911800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:50:23.585 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.583+0000 7fb3b0911800 20 started sync module instance, tier type = 2023-12-03T11:50:23.585 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.583+0000 7fb3b0911800 20 started zone id=83aabb46-04b5-4c96-9933-c6bfb1173a73 (name=default) with tier type = 2023-12-03T11:50:23.592 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.591+0000 7fb3adc10640 0 -- 172.21.15.3:0/2622913749 >> [v2:172.21.15.3:6817/3356208405,v1:172.21.15.3:6819/3356208405] conn(0x5617aae48ab0 msgr2=0x5617aae4aea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:50:23.595 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.594+0000 7fb3b0911800 20 add_watcher() i=0 2023-12-03T11:50:23.595 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.594+0000 7fb3b0911800 20 add_watcher() i=1 2023-12-03T11:50:23.595 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.594+0000 7fb3b0911800 20 add_watcher() i=2 2023-12-03T11:50:23.595 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.594+0000 7fb3b0911800 20 add_watcher() i=3 2023-12-03T11:50:23.595 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.594+0000 7fb3b0911800 20 add_watcher() i=4 2023-12-03T11:50:23.595 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.594+0000 7fb3b0911800 20 add_watcher() i=5 2023-12-03T11:50:23.595 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.594+0000 7fb3b0911800 20 add_watcher() i=6 2023-12-03T11:50:23.596 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.595+0000 7fb3b0911800 20 add_watcher() i=7 2023-12-03T11:50:23.596 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.595+0000 7fb3b0911800 2 all 8 watchers are set, enabling cache 2023-12-03T11:50:23.598 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.597+0000 7fb373fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:50:23.598 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.597+0000 7fb3b0911800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:50:23.598 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.597+0000 7fb3b0911800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:50:23.605 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.603+0000 7fb3b0911800 5 note: GC not initialized 2023-12-03T11:50:23.605 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.603+0000 7fb2e2ffd640 20 reqs_thread_entry: start 2023-12-03T11:50:23.605 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.604+0000 7fb3b0911800 20 init_complete bucket index max shards: 11 2023-12-03T11:50:23.605 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.604+0000 7fb3b0911800 20 Filter name: none 2023-12-03T11:50:23.605 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.604+0000 7fb2e0ff9640 20 reqs_thread_entry: start 2023-12-03T11:50:23.605 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.604+0000 7fb3b0911800 20 rados->read ofs=0 len=0 2023-12-03T11:50:23.606 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.604+0000 7fb3b0911800 20 rados_obj.operate() r=0 bl.length=197 2023-12-03T11:50:23.607 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.604+0000 7fb3b0911800 20 rados->read ofs=0 len=0 2023-12-03T11:50:23.607 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.605+0000 7fb3b0911800 20 rados_obj.operate() r=0 bl.length=369 2023-12-03T11:50:23.607 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.605+0000 7fb3b0911800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:50:23.607 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.605+0000 7fb3b0911800 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2023-12-03T11:50:23.607 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.605+0000 7fb3b0911800 20 INFO: main: starting shard=0 2023-12-03T11:50:23.607 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.605+0000 7fb3b0911800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.2.0 2023-12-03T11:50:23.607 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.605+0000 7fb3b0911800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.2.0 2023-12-03T11:50:23.609 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.606+0000 7fb3b0911800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:50:23.609 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.606+0000 7fb3b0911800 20 INFO: main: starting shard=1 2023-12-03T11:50:23.609 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.606+0000 7fb3b0911800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.2.1 2023-12-03T11:50:23.609 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.606+0000 7fb3b0911800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.2.1 2023-12-03T11:50:23.609 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.606+0000 7fb3b0911800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:50:23.609 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.606+0000 7fb3b0911800 20 INFO: main: starting shard=2 2023-12-03T11:50:23.609 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.606+0000 7fb3b0911800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.2.2 2023-12-03T11:50:23.609 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.606+0000 7fb3b0911800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.2.2 2023-12-03T11:50:23.609 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.607+0000 7fb3b0911800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:50:23.609 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.607+0000 7fb3b0911800 20 INFO: main: starting shard=3 2023-12-03T11:50:23.609 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.607+0000 7fb3b0911800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.2.3 2023-12-03T11:50:23.610 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.607+0000 7fb3b0911800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.2.3 2023-12-03T11:50:23.610 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.607+0000 7fb3b0911800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:50:23.610 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.607+0000 7fb3b0911800 20 INFO: main: starting shard=4 2023-12-03T11:50:23.610 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.607+0000 7fb3b0911800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.2.4 2023-12-03T11:50:23.610 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.607+0000 7fb3b0911800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.2.4 2023-12-03T11:50:23.610 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.608+0000 7fb3b0911800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:50:23.610 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.608+0000 7fb3b0911800 20 INFO: main: starting shard=5 2023-12-03T11:50:23.610 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.608+0000 7fb3b0911800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.2.5 2023-12-03T11:50:23.610 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.608+0000 7fb3b0911800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.2.5 2023-12-03T11:50:23.611 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.608+0000 7fb3b0911800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2023-12-03T11:50:23.611 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.608+0000 7fb3b0911800 20 INFO: main: starting shard=6 2023-12-03T11:50:23.611 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.608+0000 7fb3b0911800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.2.6 2023-12-03T11:50:23.611 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.608+0000 7fb3b0911800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.2.6 2023-12-03T11:50:23.611 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.609+0000 7fb3b0911800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:50:23.611 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.609+0000 7fb3b0911800 20 INFO: main: starting shard=7 2023-12-03T11:50:23.611 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.609+0000 7fb3b0911800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.2.7 2023-12-03T11:50:23.611 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.609+0000 7fb3b0911800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.2.7 2023-12-03T11:50:23.611 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.610+0000 7fb3b0911800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:50:23.611 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.610+0000 7fb3b0911800 20 INFO: main: starting shard=8 2023-12-03T11:50:23.611 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.610+0000 7fb3b0911800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.2.8 2023-12-03T11:50:23.612 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.610+0000 7fb3b0911800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.2.8 2023-12-03T11:50:23.612 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.610+0000 7fb3b0911800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:50:23.612 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.610+0000 7fb3b0911800 20 INFO: main: starting shard=9 2023-12-03T11:50:23.612 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.610+0000 7fb3b0911800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.2.9 2023-12-03T11:50:23.612 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.610+0000 7fb3b0911800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.2.9 2023-12-03T11:50:23.612 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.611+0000 7fb3b0911800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:50:23.612 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.611+0000 7fb3b0911800 20 INFO: main: starting shard=10 2023-12-03T11:50:23.612 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.611+0000 7fb3b0911800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.2.10 2023-12-03T11:50:23.613 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.611+0000 7fb3b0911800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.2.10 2023-12-03T11:50:23.613 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.611+0000 7fb3b0911800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:50:23.613 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.611+0000 7fb3b0911800 20 INFO: main: starting shard=11 2023-12-03T11:50:23.613 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.611+0000 7fb3b0911800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.2.11 2023-12-03T11:50:23.613 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.611+0000 7fb3b0911800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.2.11 2023-12-03T11:50:23.613 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.612+0000 7fb3b0911800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:50:23.613 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.612+0000 7fb3b0911800 20 INFO: main: starting shard=12 2023-12-03T11:50:23.614 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.612+0000 7fb3b0911800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.2.12 2023-12-03T11:50:23.614 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.612+0000 7fb3b0911800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.2.12 2023-12-03T11:50:23.614 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.613+0000 7fb3b0911800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:50:23.614 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.613+0000 7fb3b0911800 20 INFO: main: done 2023-12-03T11:50:23.615 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.613+0000 7fb373fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:50:23.617 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.616+0000 7fb3b0911800 20 remove_watcher() i=0 2023-12-03T11:50:23.617 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.616+0000 7fb3b0911800 2 removed watcher, disabling cache 2023-12-03T11:50:23.619 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.617+0000 7fb3b0911800 20 remove_watcher() i=1 2023-12-03T11:50:23.620 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.619+0000 7fb3b0911800 20 remove_watcher() i=2 2023-12-03T11:50:23.621 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.620+0000 7fb3b0911800 20 remove_watcher() i=3 2023-12-03T11:50:23.622 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.621+0000 7fb3b0911800 20 remove_watcher() i=4 2023-12-03T11:50:23.623 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.622+0000 7fb3b0911800 20 remove_watcher() i=5 2023-12-03T11:50:23.624 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.623+0000 7fb3b0911800 20 remove_watcher() i=6 2023-12-03T11:50:23.625 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.624+0000 7fb3b0911800 20 remove_watcher() i=7 2023-12-03T11:50:23.730 INFO:tasks.workunit.client.0.smithi003.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2023-12-03T11:50:23.732 INFO:tasks.workunit.client.0.smithi003.stderr:radosgw-admin bi list --bucket myver --object y 2023-12-03T11:50:23.763 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:50:23.764 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:50:23.778 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.776+0000 7f1e2ed20800 20 rados->read ofs=0 len=0 2023-12-03T11:50:23.780 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.778+0000 7f1e2ed20800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:50:23.780 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.778+0000 7f1e2ed20800 20 realm 2023-12-03T11:50:23.780 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.778+0000 7f1e2ed20800 20 rados->read ofs=0 len=0 2023-12-03T11:50:23.780 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.778+0000 7f1e2ed20800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:50:23.780 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.778+0000 7f1e2ed20800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:50:23.780 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.778+0000 7f1e2ed20800 20 rados->read ofs=0 len=0 2023-12-03T11:50:23.780 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.779+0000 7f1e2ed20800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:50:23.780 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.779+0000 7f1e2ed20800 20 rados->read ofs=0 len=0 2023-12-03T11:50:23.781 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.780+0000 7f1e2ed20800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:50:23.781 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.780+0000 7f1e2ed20800 20 rados->read ofs=0 len=0 2023-12-03T11:50:23.781 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.780+0000 7f1e2ed20800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:50:23.781 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.780+0000 7f1e2ed20800 20 searching for the correct realm 2023-12-03T11:50:23.791 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.790+0000 7f1e2a9ed640 0 -- 172.21.15.3:0/113594249 >> [v2:172.21.15.37:6805/1692844418,v1:172.21.15.37:6807/1692844418] conn(0x55ac8cfa4700 msgr2=0x55ac8cfa6af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:50:23.793 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.792+0000 7f1e2ed20800 20 RGWRados::pool_iterate: got zone_info.83aabb46-04b5-4c96-9933-c6bfb1173a73 2023-12-03T11:50:23.793 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.792+0000 7f1e2ed20800 20 RGWRados::pool_iterate: got zonegroup_info.6a811aad-435d-4fdd-93c9-b7e0b50de429 2023-12-03T11:50:23.793 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.792+0000 7f1e2ed20800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:50:23.793 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.792+0000 7f1e2ed20800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:50:23.793 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.792+0000 7f1e2ed20800 20 rados->read ofs=0 len=0 2023-12-03T11:50:23.793 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.792+0000 7f1e2ed20800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:50:23.793 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.792+0000 7f1e2ed20800 20 rados->read ofs=0 len=0 2023-12-03T11:50:23.795 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.792+0000 7f1e2ed20800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:50:23.795 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.792+0000 7f1e2ed20800 20 rados->read ofs=0 len=0 2023-12-03T11:50:23.795 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.793+0000 7f1e2ed20800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:50:23.795 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.793+0000 7f1e2ed20800 20 zone default found 2023-12-03T11:50:23.795 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.793+0000 7f1e2ed20800 4 Realm: () 2023-12-03T11:50:23.795 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.793+0000 7f1e2ed20800 4 ZoneGroup: default (6a811aad-435d-4fdd-93c9-b7e0b50de429) 2023-12-03T11:50:23.795 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.793+0000 7f1e2ed20800 4 Zone: default (83aabb46-04b5-4c96-9933-c6bfb1173a73) 2023-12-03T11:50:23.795 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.793+0000 7f1e2ed20800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:50:23.796 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.793+0000 7f1e2ed20800 20 zonegroup default 2023-12-03T11:50:23.796 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.793+0000 7f1e2ed20800 20 rados->read ofs=0 len=0 2023-12-03T11:50:23.796 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.793+0000 7f1e2ed20800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:50:23.796 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.793+0000 7f1e2ed20800 20 rados->read ofs=0 len=0 2023-12-03T11:50:23.796 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.794+0000 7f1e2ed20800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:50:23.796 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.794+0000 7f1e2ed20800 20 rados->read ofs=0 len=0 2023-12-03T11:50:23.796 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.794+0000 7f1e2ed20800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:50:23.796 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.794+0000 7f1e2ed20800 20 started sync module instance, tier type = 2023-12-03T11:50:23.796 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.794+0000 7f1e2ed20800 20 started zone id=83aabb46-04b5-4c96-9933-c6bfb1173a73 (name=default) with tier type = 2023-12-03T11:50:23.801 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.800+0000 7f1e2b1ee640 0 -- 172.21.15.3:0/113594249 >> [v2:172.21.15.37:6816/3770469300,v1:172.21.15.37:6818/3770469300] conn(0x7f1e200999e0 msgr2=0x7f1e200c9210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:50:23.805 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.803+0000 7f1e2ed20800 20 add_watcher() i=0 2023-12-03T11:50:23.805 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.803+0000 7f1e2ed20800 20 add_watcher() i=1 2023-12-03T11:50:23.805 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.803+0000 7f1e2ed20800 20 add_watcher() i=2 2023-12-03T11:50:23.805 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.803+0000 7f1e2ed20800 20 add_watcher() i=3 2023-12-03T11:50:23.805 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.803+0000 7f1e2ed20800 20 add_watcher() i=4 2023-12-03T11:50:23.805 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.803+0000 7f1e2ed20800 20 add_watcher() i=5 2023-12-03T11:50:23.805 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.803+0000 7f1e2ed20800 20 add_watcher() i=6 2023-12-03T11:50:23.806 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.804+0000 7f1e2ed20800 20 add_watcher() i=7 2023-12-03T11:50:23.806 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.804+0000 7f1e2ed20800 2 all 8 watchers are set, enabling cache 2023-12-03T11:50:23.807 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.806+0000 7f1d6bfff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:50:23.807 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.806+0000 7f1e2ed20800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:50:23.808 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.806+0000 7f1e2ed20800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:50:23.814 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.812+0000 7f1e2ed20800 5 note: GC not initialized 2023-12-03T11:50:23.815 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.813+0000 7f1d5affd640 20 reqs_thread_entry: start 2023-12-03T11:50:23.815 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.813+0000 7f1e2ed20800 20 init_complete bucket index max shards: 11 2023-12-03T11:50:23.815 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.813+0000 7f1e2ed20800 20 Filter name: none 2023-12-03T11:50:23.815 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.813+0000 7f1d58ff9640 20 reqs_thread_entry: start 2023-12-03T11:50:23.815 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.813+0000 7f1e2ed20800 20 rados->read ofs=0 len=0 2023-12-03T11:50:23.815 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.813+0000 7f1e2ed20800 20 rados_obj.operate() r=0 bl.length=197 2023-12-03T11:50:23.815 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.813+0000 7f1e2ed20800 20 rados->read ofs=0 len=0 2023-12-03T11:50:23.816 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.814+0000 7f1e2ed20800 20 rados_obj.operate() r=0 bl.length=369 2023-12-03T11:50:23.816 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.814+0000 7f1e2ed20800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:50:23.816 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.814+0000 7f1e2ed20800 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2023-12-03T11:50:23.816 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.814+0000 7f1e2ed20800 20 INFO: main: starting shard=0 2023-12-03T11:50:23.816 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.814+0000 7f1e2ed20800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.2.0 2023-12-03T11:50:23.816 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.814+0000 7f1e2ed20800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.2.0 2023-12-03T11:50:23.816 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.814+0000 7f1e2ed20800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:50:23.816 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.814+0000 7f1e2ed20800 20 INFO: main: starting shard=1 2023-12-03T11:50:23.817 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.814+0000 7f1e2ed20800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.2.1 2023-12-03T11:50:23.817 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.814+0000 7f1e2ed20800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.2.1 2023-12-03T11:50:23.817 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.815+0000 7f1e2ed20800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:50:23.817 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.815+0000 7f1e2ed20800 20 INFO: main: starting shard=2 2023-12-03T11:50:23.817 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.815+0000 7f1e2ed20800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.2.2 2023-12-03T11:50:23.817 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.815+0000 7f1e2ed20800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.2.2 2023-12-03T11:50:23.818 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.815+0000 7f1e2ed20800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:50:23.818 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.815+0000 7f1e2ed20800 20 INFO: main: starting shard=3 2023-12-03T11:50:23.818 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.815+0000 7f1e2ed20800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.2.3 2023-12-03T11:50:23.818 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.815+0000 7f1e2ed20800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.2.3 2023-12-03T11:50:23.818 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.816+0000 7f1e2ed20800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:50:23.818 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.816+0000 7f1e2ed20800 20 INFO: main: starting shard=4 2023-12-03T11:50:23.818 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.816+0000 7f1e2ed20800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.2.4 2023-12-03T11:50:23.818 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.816+0000 7f1e2ed20800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.2.4 2023-12-03T11:50:23.818 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.816+0000 7f1e2ed20800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:50:23.818 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.816+0000 7f1e2ed20800 20 INFO: main: starting shard=5 2023-12-03T11:50:23.819 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.816+0000 7f1e2ed20800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.2.5 2023-12-03T11:50:23.819 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.816+0000 7f1e2ed20800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.2.5 2023-12-03T11:50:23.819 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.817+0000 7f1e2ed20800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:50:23.819 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.817+0000 7f1e2ed20800 20 INFO: main: starting shard=6 2023-12-03T11:50:23.819 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.817+0000 7f1e2ed20800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.2.6 2023-12-03T11:50:23.819 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.817+0000 7f1e2ed20800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.2.6 2023-12-03T11:50:23.819 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.817+0000 7f1e2ed20800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:50:23.819 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.817+0000 7f1e2ed20800 20 INFO: main: starting shard=7 2023-12-03T11:50:23.820 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.817+0000 7f1e2ed20800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.2.7 2023-12-03T11:50:23.820 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.817+0000 7f1e2ed20800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.2.7 2023-12-03T11:50:23.820 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.818+0000 7f1e2ed20800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:50:23.820 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.818+0000 7f1e2ed20800 20 INFO: main: starting shard=8 2023-12-03T11:50:23.820 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.818+0000 7f1e2ed20800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.2.8 2023-12-03T11:50:23.820 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.818+0000 7f1e2ed20800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.2.8 2023-12-03T11:50:23.820 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.818+0000 7f1e2ed20800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:50:23.820 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.818+0000 7f1e2ed20800 20 INFO: main: starting shard=9 2023-12-03T11:50:23.820 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.818+0000 7f1e2ed20800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.2.9 2023-12-03T11:50:23.820 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.818+0000 7f1e2ed20800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.2.9 2023-12-03T11:50:23.821 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.819+0000 7f1e2ed20800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2023-12-03T11:50:23.821 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.819+0000 7f1e2ed20800 20 INFO: main: starting shard=10 2023-12-03T11:50:23.821 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.819+0000 7f1e2ed20800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.2.10 2023-12-03T11:50:23.821 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.819+0000 7f1e2ed20800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.2.10 2023-12-03T11:50:23.821 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.819+0000 7f1e2ed20800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:50:23.821 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.820+0000 7f1e2ed20800 20 INFO: main: starting shard=11 2023-12-03T11:50:23.821 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.820+0000 7f1e2ed20800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.2.11 2023-12-03T11:50:23.821 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.820+0000 7f1e2ed20800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.2.11 2023-12-03T11:50:23.822 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.820+0000 7f1e2ed20800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:50:23.822 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.820+0000 7f1e2ed20800 20 INFO: main: starting shard=12 2023-12-03T11:50:23.822 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.820+0000 7f1e2ed20800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.2.12 2023-12-03T11:50:23.822 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.820+0000 7f1e2ed20800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.2.12 2023-12-03T11:50:23.822 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.821+0000 7f1e2ed20800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:50:23.822 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.821+0000 7f1e2ed20800 20 INFO: main: done 2023-12-03T11:50:23.823 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.822+0000 7f1d6bfff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:50:23.825 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.824+0000 7f1e2ed20800 20 remove_watcher() i=0 2023-12-03T11:50:23.825 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.824+0000 7f1e2ed20800 2 removed watcher, disabling cache 2023-12-03T11:50:23.826 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.825+0000 7f1e2ed20800 20 remove_watcher() i=1 2023-12-03T11:50:23.827 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.826+0000 7f1e2ed20800 20 remove_watcher() i=2 2023-12-03T11:50:23.829 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.827+0000 7f1e2ed20800 20 remove_watcher() i=3 2023-12-03T11:50:23.830 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.828+0000 7f1e2ed20800 20 remove_watcher() i=4 2023-12-03T11:50:23.831 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.830+0000 7f1e2ed20800 20 remove_watcher() i=5 2023-12-03T11:50:23.832 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.831+0000 7f1e2ed20800 20 remove_watcher() i=6 2023-12-03T11:50:23.833 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.832+0000 7f1e2ed20800 20 remove_watcher() i=7 2023-12-03T11:50:23.936 INFO:tasks.workunit.client.0.smithi003.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2023-12-03T11:50:23.937 INFO:tasks.workunit.client.0.smithi003.stderr:radosgw-admin bi list --bucket myver --object z 2023-12-03T11:50:23.968 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:50:23.968 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:50:23.982 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.981+0000 7fe80552f800 20 rados->read ofs=0 len=0 2023-12-03T11:50:23.984 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.982+0000 7fe80552f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:50:23.984 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.982+0000 7fe80552f800 20 realm 2023-12-03T11:50:23.984 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.982+0000 7fe80552f800 20 rados->read ofs=0 len=0 2023-12-03T11:50:23.984 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.983+0000 7fe80552f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:50:23.984 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.983+0000 7fe80552f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:50:23.984 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.983+0000 7fe80552f800 20 rados->read ofs=0 len=0 2023-12-03T11:50:23.984 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.983+0000 7fe80552f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:50:23.984 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.983+0000 7fe80552f800 20 rados->read ofs=0 len=0 2023-12-03T11:50:23.985 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.984+0000 7fe80552f800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:50:23.985 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.984+0000 7fe80552f800 20 rados->read ofs=0 len=0 2023-12-03T11:50:23.985 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.984+0000 7fe80552f800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:50:23.985 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.984+0000 7fe80552f800 20 searching for the correct realm 2023-12-03T11:50:23.996 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.995+0000 7fe801a69640 0 -- 172.21.15.3:0/4259770058 >> [v2:172.21.15.37:6816/3770469300,v1:172.21.15.37:6818/3770469300] conn(0x7fe7f800b040 msgr2=0x7fe7f803c910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-03T11:50:23.997 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.996+0000 7fe80552f800 20 RGWRados::pool_iterate: got zone_info.83aabb46-04b5-4c96-9933-c6bfb1173a73 2023-12-03T11:50:23.998 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.996+0000 7fe80552f800 20 RGWRados::pool_iterate: got zonegroup_info.6a811aad-435d-4fdd-93c9-b7e0b50de429 2023-12-03T11:50:23.998 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.996+0000 7fe80552f800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:50:23.998 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.996+0000 7fe80552f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:50:23.998 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.996+0000 7fe80552f800 20 rados->read ofs=0 len=0 2023-12-03T11:50:23.998 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.996+0000 7fe80552f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:50:23.998 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.996+0000 7fe80552f800 20 rados->read ofs=0 len=0 2023-12-03T11:50:23.999 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.997+0000 7fe80552f800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:50:23.999 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.997+0000 7fe80552f800 20 rados->read ofs=0 len=0 2023-12-03T11:50:23.999 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.997+0000 7fe80552f800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:50:23.999 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.997+0000 7fe80552f800 20 zone default found 2023-12-03T11:50:23.999 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.997+0000 7fe80552f800 4 Realm: () 2023-12-03T11:50:23.999 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.997+0000 7fe80552f800 4 ZoneGroup: default (6a811aad-435d-4fdd-93c9-b7e0b50de429) 2023-12-03T11:50:24.000 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.997+0000 7fe80552f800 4 Zone: default (83aabb46-04b5-4c96-9933-c6bfb1173a73) 2023-12-03T11:50:24.000 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.997+0000 7fe80552f800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:50:24.000 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.997+0000 7fe80552f800 20 zonegroup default 2023-12-03T11:50:24.000 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.997+0000 7fe80552f800 20 rados->read ofs=0 len=0 2023-12-03T11:50:24.000 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.997+0000 7fe80552f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:50:24.000 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.997+0000 7fe80552f800 20 rados->read ofs=0 len=0 2023-12-03T11:50:24.000 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.998+0000 7fe80552f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:50:24.000 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.998+0000 7fe80552f800 20 rados->read ofs=0 len=0 2023-12-03T11:50:24.000 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.998+0000 7fe80552f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:50:24.000 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.998+0000 7fe80552f800 20 started sync module instance, tier type = 2023-12-03T11:50:24.000 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:23.998+0000 7fe80552f800 20 started zone id=83aabb46-04b5-4c96-9933-c6bfb1173a73 (name=default) with tier type = 2023-12-03T11:50:24.007 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.006+0000 7fe800a67640 0 -- 172.21.15.3:0/4259770058 >> [v2:172.21.15.3:6817/3356208405,v1:172.21.15.3:6819/3356208405] conn(0x55dd55a53040 msgr2=0x55dd55a55430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:50:24.009 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.007+0000 7fe80552f800 20 add_watcher() i=0 2023-12-03T11:50:24.009 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.007+0000 7fe80552f800 20 add_watcher() i=1 2023-12-03T11:50:24.009 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.007+0000 7fe80552f800 20 add_watcher() i=2 2023-12-03T11:50:24.009 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.007+0000 7fe80552f800 20 add_watcher() i=3 2023-12-03T11:50:24.009 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.007+0000 7fe80552f800 20 add_watcher() i=4 2023-12-03T11:50:24.009 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.007+0000 7fe80552f800 20 add_watcher() i=5 2023-12-03T11:50:24.009 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.008+0000 7fe80552f800 20 add_watcher() i=6 2023-12-03T11:50:24.009 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.008+0000 7fe80552f800 20 add_watcher() i=7 2023-12-03T11:50:24.010 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.008+0000 7fe80552f800 2 all 8 watchers are set, enabling cache 2023-12-03T11:50:24.011 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.010+0000 7fe7c6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:50:24.012 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.010+0000 7fe80552f800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:50:24.012 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.010+0000 7fe80552f800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:50:24.018 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.016+0000 7fe80552f800 5 note: GC not initialized 2023-12-03T11:50:24.018 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.017+0000 7fe735ffb640 20 reqs_thread_entry: start 2023-12-03T11:50:24.018 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.017+0000 7fe80552f800 20 init_complete bucket index max shards: 11 2023-12-03T11:50:24.018 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.017+0000 7fe80552f800 20 Filter name: none 2023-12-03T11:50:24.018 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.017+0000 7fe7277fe640 20 reqs_thread_entry: start 2023-12-03T11:50:24.018 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.017+0000 7fe80552f800 20 rados->read ofs=0 len=0 2023-12-03T11:50:24.019 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.017+0000 7fe80552f800 20 rados_obj.operate() r=0 bl.length=197 2023-12-03T11:50:24.019 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.017+0000 7fe80552f800 20 rados->read ofs=0 len=0 2023-12-03T11:50:24.019 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.018+0000 7fe80552f800 20 rados_obj.operate() r=0 bl.length=369 2023-12-03T11:50:24.020 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.018+0000 7fe80552f800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:50:24.020 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.018+0000 7fe80552f800 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2023-12-03T11:50:24.020 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.018+0000 7fe80552f800 20 INFO: main: starting shard=0 2023-12-03T11:50:24.020 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.018+0000 7fe80552f800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.2.0 2023-12-03T11:50:24.020 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.018+0000 7fe80552f800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.2.0 2023-12-03T11:50:24.021 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.019+0000 7fe80552f800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2023-12-03T11:50:24.021 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.019+0000 7fe80552f800 20 INFO: main: starting shard=1 2023-12-03T11:50:24.021 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.019+0000 7fe80552f800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.2.1 2023-12-03T11:50:24.021 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.019+0000 7fe80552f800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.2.1 2023-12-03T11:50:24.021 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.019+0000 7fe80552f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:50:24.021 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.019+0000 7fe80552f800 20 INFO: main: starting shard=2 2023-12-03T11:50:24.021 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.019+0000 7fe80552f800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.2.2 2023-12-03T11:50:24.021 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.019+0000 7fe80552f800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.2.2 2023-12-03T11:50:24.022 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.020+0000 7fe80552f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:50:24.022 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.020+0000 7fe80552f800 20 INFO: main: starting shard=3 2023-12-03T11:50:24.022 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.020+0000 7fe80552f800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.2.3 2023-12-03T11:50:24.022 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.020+0000 7fe80552f800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.2.3 2023-12-03T11:50:24.023 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.021+0000 7fe80552f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:50:24.023 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.021+0000 7fe80552f800 20 INFO: main: starting shard=4 2023-12-03T11:50:24.023 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.021+0000 7fe80552f800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.2.4 2023-12-03T11:50:24.024 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.021+0000 7fe80552f800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.2.4 2023-12-03T11:50:24.024 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.021+0000 7fe80552f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:50:24.024 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.021+0000 7fe80552f800 20 INFO: main: starting shard=5 2023-12-03T11:50:24.024 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.021+0000 7fe80552f800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.2.5 2023-12-03T11:50:24.024 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.021+0000 7fe80552f800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.2.5 2023-12-03T11:50:24.024 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.022+0000 7fe80552f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:50:24.024 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.022+0000 7fe80552f800 20 INFO: main: starting shard=6 2023-12-03T11:50:24.024 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.022+0000 7fe80552f800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.2.6 2023-12-03T11:50:24.024 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.022+0000 7fe80552f800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.2.6 2023-12-03T11:50:24.024 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.022+0000 7fe80552f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:50:24.025 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.022+0000 7fe80552f800 20 INFO: main: starting shard=7 2023-12-03T11:50:24.026 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.022+0000 7fe80552f800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.2.7 2023-12-03T11:50:24.026 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.022+0000 7fe80552f800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.2.7 2023-12-03T11:50:24.027 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.023+0000 7fe80552f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:50:24.027 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.023+0000 7fe80552f800 20 INFO: main: starting shard=8 2023-12-03T11:50:24.027 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.023+0000 7fe80552f800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.2.8 2023-12-03T11:50:24.027 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.023+0000 7fe80552f800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.2.8 2023-12-03T11:50:24.027 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.023+0000 7fe80552f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:50:24.027 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.023+0000 7fe80552f800 20 INFO: main: starting shard=9 2023-12-03T11:50:24.027 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.023+0000 7fe80552f800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.2.9 2023-12-03T11:50:24.027 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.023+0000 7fe80552f800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.2.9 2023-12-03T11:50:24.027 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.024+0000 7fe80552f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:50:24.028 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.024+0000 7fe80552f800 20 INFO: main: starting shard=10 2023-12-03T11:50:24.028 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.024+0000 7fe80552f800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.2.10 2023-12-03T11:50:24.028 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.024+0000 7fe80552f800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.2.10 2023-12-03T11:50:24.028 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.024+0000 7fe80552f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:50:24.028 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.024+0000 7fe80552f800 20 INFO: main: starting shard=11 2023-12-03T11:50:24.028 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.024+0000 7fe80552f800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.2.11 2023-12-03T11:50:24.028 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.024+0000 7fe80552f800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.2.11 2023-12-03T11:50:24.028 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.025+0000 7fe80552f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:50:24.028 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.025+0000 7fe80552f800 20 INFO: main: starting shard=12 2023-12-03T11:50:24.028 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.025+0000 7fe80552f800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.2.12 2023-12-03T11:50:24.028 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.025+0000 7fe80552f800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.2.12 2023-12-03T11:50:24.028 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.025+0000 7fe80552f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:50:24.028 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.025+0000 7fe80552f800 20 INFO: main: done 2023-12-03T11:50:24.029 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.026+0000 7fe7c6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:50:24.030 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.029+0000 7fe80552f800 20 remove_watcher() i=0 2023-12-03T11:50:24.030 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.029+0000 7fe80552f800 2 removed watcher, disabling cache 2023-12-03T11:50:24.031 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.030+0000 7fe80552f800 20 remove_watcher() i=1 2023-12-03T11:50:24.032 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.031+0000 7fe80552f800 20 remove_watcher() i=2 2023-12-03T11:50:24.033 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.032+0000 7fe80552f800 20 remove_watcher() i=3 2023-12-03T11:50:24.034 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.033+0000 7fe80552f800 20 remove_watcher() i=4 2023-12-03T11:50:24.035 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.034+0000 7fe80552f800 20 remove_watcher() i=5 2023-12-03T11:50:24.036 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.035+0000 7fe80552f800 20 remove_watcher() i=6 2023-12-03T11:50:24.037 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.036+0000 7fe80552f800 20 remove_watcher() i=7 2023-12-03T11:50:24.064 INFO:tasks.workunit.client.0.smithi003.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2023-12-03T11:50:24.464 INFO:tasks.workunit.client.0.smithi003.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2023-12-03T11:50:24.864 INFO:tasks.workunit.client.0.smithi003.stderr:radosgw-admin bucket reshard --bucket myver --num-shards 17 --yes-i-really-mean-it 2023-12-03T11:50:24.896 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:50:24.896 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:50:24.910 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.909+0000 7f62b82ba800 20 rados->read ofs=0 len=0 2023-12-03T11:50:24.912 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.911+0000 7f62b82ba800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:50:24.912 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.911+0000 7f62b82ba800 20 realm 2023-12-03T11:50:24.913 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.911+0000 7f62b82ba800 20 rados->read ofs=0 len=0 2023-12-03T11:50:24.913 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.911+0000 7f62b82ba800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:50:24.913 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.911+0000 7f62b82ba800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:50:24.913 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.911+0000 7f62b82ba800 20 rados->read ofs=0 len=0 2023-12-03T11:50:24.913 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.911+0000 7f62b82ba800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:50:24.913 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.911+0000 7f62b82ba800 20 rados->read ofs=0 len=0 2023-12-03T11:50:24.913 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.912+0000 7f62b82ba800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:50:24.913 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.912+0000 7f62b82ba800 20 rados->read ofs=0 len=0 2023-12-03T11:50:24.914 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.913+0000 7f62b82ba800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:50:24.914 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.913+0000 7f62b82ba800 20 searching for the correct realm 2023-12-03T11:50:24.925 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.924+0000 7f62b55b9640 0 -- 172.21.15.3:0/2133629895 >> [v2:172.21.15.3:6817/3356208405,v1:172.21.15.3:6819/3356208405] conn(0x5615730f29f0 msgr2=0x5615730f4de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:50:24.926 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.925+0000 7f62b82ba800 20 RGWRados::pool_iterate: got zone_info.83aabb46-04b5-4c96-9933-c6bfb1173a73 2023-12-03T11:50:24.926 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.925+0000 7f62b82ba800 20 RGWRados::pool_iterate: got zonegroup_info.6a811aad-435d-4fdd-93c9-b7e0b50de429 2023-12-03T11:50:24.926 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.925+0000 7f62b82ba800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:50:24.927 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.925+0000 7f62b82ba800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:50:24.927 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.925+0000 7f62b82ba800 20 rados->read ofs=0 len=0 2023-12-03T11:50:24.927 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.925+0000 7f62b82ba800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:50:24.927 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.925+0000 7f62b82ba800 20 rados->read ofs=0 len=0 2023-12-03T11:50:24.928 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.925+0000 7f62b82ba800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:50:24.928 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.925+0000 7f62b82ba800 20 rados->read ofs=0 len=0 2023-12-03T11:50:24.928 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.926+0000 7f62b82ba800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:50:24.928 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.926+0000 7f62b82ba800 20 zone default found 2023-12-03T11:50:24.928 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.926+0000 7f62b82ba800 4 Realm: () 2023-12-03T11:50:24.928 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.926+0000 7f62b82ba800 4 ZoneGroup: default (6a811aad-435d-4fdd-93c9-b7e0b50de429) 2023-12-03T11:50:24.928 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.926+0000 7f62b82ba800 4 Zone: default (83aabb46-04b5-4c96-9933-c6bfb1173a73) 2023-12-03T11:50:24.928 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.926+0000 7f62b82ba800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:50:24.929 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.926+0000 7f62b82ba800 20 zonegroup default 2023-12-03T11:50:24.929 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.926+0000 7f62b82ba800 20 rados->read ofs=0 len=0 2023-12-03T11:50:24.929 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.926+0000 7f62b82ba800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:50:24.929 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.926+0000 7f62b82ba800 20 rados->read ofs=0 len=0 2023-12-03T11:50:24.929 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.926+0000 7f62b82ba800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:50:24.929 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.926+0000 7f62b82ba800 20 rados->read ofs=0 len=0 2023-12-03T11:50:24.929 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.927+0000 7f62b82ba800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:50:24.929 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.927+0000 7f62b82ba800 20 started sync module instance, tier type = 2023-12-03T11:50:24.929 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.927+0000 7f62b82ba800 20 started zone id=83aabb46-04b5-4c96-9933-c6bfb1173a73 (name=default) with tier type = 2023-12-03T11:50:24.935 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.934+0000 7f62b65bb640 0 -- 172.21.15.3:0/2133629895 >> [v2:172.21.15.37:6816/3770469300,v1:172.21.15.37:6818/3770469300] conn(0x7f62a000b040 msgr2=0x7f62a00829b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:50:24.938 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.937+0000 7f62b82ba800 20 add_watcher() i=0 2023-12-03T11:50:24.938 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.937+0000 7f62b82ba800 20 add_watcher() i=1 2023-12-03T11:50:24.938 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.937+0000 7f62b82ba800 20 add_watcher() i=2 2023-12-03T11:50:24.938 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.937+0000 7f62b82ba800 20 add_watcher() i=3 2023-12-03T11:50:24.938 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.937+0000 7f62b82ba800 20 add_watcher() i=4 2023-12-03T11:50:24.938 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.937+0000 7f62b82ba800 20 add_watcher() i=5 2023-12-03T11:50:24.938 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.937+0000 7f62b82ba800 20 add_watcher() i=6 2023-12-03T11:50:24.939 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.937+0000 7f62b82ba800 20 add_watcher() i=7 2023-12-03T11:50:24.939 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.937+0000 7f62b82ba800 2 all 8 watchers are set, enabling cache 2023-12-03T11:50:24.940 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.939+0000 7f627b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:50:24.940 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.939+0000 7f62b82ba800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:50:24.941 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.939+0000 7f62b82ba800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:50:24.946 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.945+0000 7f62b82ba800 5 note: GC not initialized 2023-12-03T11:50:24.947 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.946+0000 7f61ea7fc640 20 reqs_thread_entry: start 2023-12-03T11:50:24.947 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.946+0000 7f62b82ba800 20 init_complete bucket index max shards: 11 2023-12-03T11:50:24.947 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.946+0000 7f62b82ba800 20 Filter name: none 2023-12-03T11:50:24.947 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.946+0000 7f61dbfff640 20 reqs_thread_entry: start 2023-12-03T11:50:24.947 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.946+0000 7f62b82ba800 10 cache get: name=default.rgw.meta+root+myver : miss 2023-12-03T11:50:24.948 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.946+0000 7f62b82ba800 20 rados->read ofs=0 len=0 2023-12-03T11:50:24.948 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.946+0000 7f62b82ba800 20 rados_obj.operate() r=0 bl.length=197 2023-12-03T11:50:24.948 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.946+0000 7f62b82ba800 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2023-12-03T11:50:24.948 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.946+0000 7f62b82ba800 10 adding default.rgw.meta+root+myver to cache LRU end 2023-12-03T11:50:24.948 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.947+0000 7f62b82ba800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18 : miss 2023-12-03T11:50:24.949 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.947+0000 7f62b82ba800 20 rados->read ofs=0 len=0 2023-12-03T11:50:24.949 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.947+0000 7f62b82ba800 20 rados_obj.operate() r=0 bl.length=369 2023-12-03T11:50:24.949 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.947+0000 7f62b82ba800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18 info.flags=0x17 2023-12-03T11:50:24.949 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.947+0000 7f62b82ba800 10 adding default.rgw.meta+root+.bucket.meta.myver:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18 to cache LRU end 2023-12-03T11:50:24.949 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.947+0000 7f62b82ba800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:50:24.949 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.947+0000 7f62b82ba800 10 updating xattr: name=user.rgw.acl bl.length()=203 2023-12-03T11:50:24.949 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.947+0000 7f62b82ba800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18 2023-12-03T11:50:24.955 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.954+0000 7f62b82ba800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18 info.flags=0x17 2023-12-03T11:50:24.955 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.954+0000 7f62b82ba800 10 moving default.rgw.meta+root+.bucket.meta.myver:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18 to cache LRU end 2023-12-03T11:50:24.955 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.954+0000 7f62b82ba800 10 updating xattr: name=user.rgw.acl bl.length()=203 2023-12-03T11:50:24.955 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.954+0000 7f62b82ba800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18, ofs0, ns] 2023-12-03T11:50:24.956 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.954+0000 7f62977fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660513 cookie 94650124709136 notifier 7698 bl.length()=855 2023-12-03T11:50:24.956 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.954+0000 7f62977fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18 info.flags=0x17 2023-12-03T11:50:24.956 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.954+0000 7f62977fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18 to cache LRU end 2023-12-03T11:50:24.956 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.954+0000 7f62977fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2023-12-03T11:50:24.957 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.956+0000 7f62b82ba800 20 handle_bi_update(): bucket=:myver[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18]): orig_sources= new_sources= 2023-12-03T11:50:24.957 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.956+0000 7f62b82ba800 20 handle_bi_update(): bucket=:myver[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18]): potential sources added=[] removed=[] 2023-12-03T11:50:24.957 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.956+0000 7f62b82ba800 20 handle_bi_update(): bucket=:myver[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18]): orig_dests= new_dests= 2023-12-03T11:50:24.957 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.956+0000 7f62b82ba800 20 handle_bi_update(): bucket=:myver[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18]): potential dests added=[] removed=[] 2023-12-03T11:50:24.961 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.959+0000 7f62b82ba800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.3.0 2023-12-03T11:50:24.961 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.959+0000 7f62b82ba800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.3.0 2023-12-03T11:50:24.961 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.959+0000 7f62b82ba800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.3.1 2023-12-03T11:50:24.961 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.959+0000 7f62b82ba800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.3.1 2023-12-03T11:50:24.961 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.959+0000 7f62b82ba800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.3.2 2023-12-03T11:50:24.961 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.959+0000 7f62b82ba800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.3.2 2023-12-03T11:50:24.961 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.959+0000 7f62b82ba800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.3.3 2023-12-03T11:50:24.961 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.959+0000 7f62b82ba800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.3.3 2023-12-03T11:50:24.961 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.959+0000 7f62b82ba800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.3.4 2023-12-03T11:50:24.961 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.959+0000 7f62b82ba800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.3.4 2023-12-03T11:50:24.961 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.959+0000 7f62b82ba800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.3.5 2023-12-03T11:50:24.961 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.959+0000 7f62b82ba800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.3.5 2023-12-03T11:50:24.961 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.959+0000 7f62b82ba800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.3.6 2023-12-03T11:50:24.961 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.959+0000 7f62b82ba800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.3.6 2023-12-03T11:50:24.962 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.959+0000 7f62b82ba800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.3.7 2023-12-03T11:50:24.962 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.959+0000 7f62b82ba800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.3.7 2023-12-03T11:50:24.962 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.959+0000 7f62b82ba800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.3.8 2023-12-03T11:50:24.962 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.959+0000 7f62b82ba800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.3.8 2023-12-03T11:50:24.962 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.959+0000 7f62b82ba800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.3.9 2023-12-03T11:50:24.962 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.959+0000 7f62b82ba800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.3.9 2023-12-03T11:50:24.962 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.959+0000 7f62b82ba800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.3.10 2023-12-03T11:50:24.962 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.959+0000 7f62b82ba800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.3.10 2023-12-03T11:50:24.962 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.959+0000 7f62b82ba800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.3.11 2023-12-03T11:50:24.962 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.959+0000 7f62b82ba800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.3.11 2023-12-03T11:50:24.962 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.959+0000 7f62b82ba800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.3.12 2023-12-03T11:50:24.962 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.959+0000 7f62b82ba800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.3.12 2023-12-03T11:50:24.962 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.959+0000 7f62b82ba800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.3.13 2023-12-03T11:50:24.963 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.959+0000 7f62b82ba800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.3.13 2023-12-03T11:50:24.963 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.959+0000 7f62b82ba800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.3.14 2023-12-03T11:50:24.963 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.959+0000 7f62b82ba800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.3.14 2023-12-03T11:50:24.963 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.959+0000 7f62b82ba800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.3.15 2023-12-03T11:50:24.963 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.959+0000 7f62b82ba800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.3.15 2023-12-03T11:50:24.963 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.959+0000 7f62b82ba800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.3.16 2023-12-03T11:50:24.963 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.959+0000 7f62b82ba800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.3.16 2023-12-03T11:50:24.963 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.959+0000 7f62b82ba800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.2.0 2023-12-03T11:50:24.963 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.959+0000 7f62b82ba800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.2.0 2023-12-03T11:50:24.963 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.959+0000 7f62b82ba800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.2.1 2023-12-03T11:50:24.963 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.959+0000 7f62b82ba800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.2.1 2023-12-03T11:50:24.964 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.960+0000 7f62b82ba800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.2.2 2023-12-03T11:50:24.964 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.960+0000 7f62b82ba800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.2.2 2023-12-03T11:50:24.964 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.960+0000 7f62b82ba800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.2.3 2023-12-03T11:50:24.964 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.960+0000 7f62b82ba800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.2.3 2023-12-03T11:50:24.964 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.961+0000 7f62b82ba800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.2.4 2023-12-03T11:50:24.964 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.961+0000 7f62b82ba800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.2.4 2023-12-03T11:50:24.964 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.961+0000 7f62b82ba800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.2.5 2023-12-03T11:50:24.965 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.961+0000 7f62b82ba800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.2.5 2023-12-03T11:50:24.965 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.961+0000 7f62b82ba800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.2.6 2023-12-03T11:50:24.965 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.961+0000 7f62b82ba800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.2.6 2023-12-03T11:50:24.965 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.962+0000 7f62b82ba800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.2.7 2023-12-03T11:50:24.965 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.962+0000 7f62b82ba800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.2.7 2023-12-03T11:50:24.965 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.963+0000 7f62b82ba800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.2.8 2023-12-03T11:50:24.965 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.963+0000 7f62b82ba800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.2.8 2023-12-03T11:50:24.965 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.963+0000 7f62b82ba800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.2.9 2023-12-03T11:50:24.965 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.963+0000 7f62b82ba800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.2.9 2023-12-03T11:50:24.965 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.964+0000 7f62b82ba800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.2.10 2023-12-03T11:50:24.966 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.964+0000 7f62b82ba800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.2.10 2023-12-03T11:50:24.966 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.964+0000 7f62b82ba800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.2.11 2023-12-03T11:50:24.966 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.964+0000 7f62b82ba800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.2.11 2023-12-03T11:50:24.966 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.965+0000 7f62b82ba800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.2.12 2023-12-03T11:50:24.966 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.965+0000 7f62b82ba800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.2.12 2023-12-03T11:50:24.969 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.968+0000 7f62b82ba800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18 : hit (requested=0x17, cached=0x17) 2023-12-03T11:50:24.969 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.968+0000 7f62b82ba800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18 2023-12-03T11:50:24.973 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.969+0000 7f62b82ba800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18 info.flags=0x17 2023-12-03T11:50:24.973 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.969+0000 7f62b82ba800 10 moving default.rgw.meta+root+.bucket.meta.myver:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18 to cache LRU end 2023-12-03T11:50:24.974 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.969+0000 7f62b82ba800 10 updating xattr: name=user.rgw.acl bl.length()=203 2023-12-03T11:50:24.974 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.969+0000 7f62b82ba800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18, ofs0, ns] 2023-12-03T11:50:24.974 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.969+0000 7f62977fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660514 cookie 94650124709136 notifier 7698 bl.length()=823 2023-12-03T11:50:24.974 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.969+0000 7f62977fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18 info.flags=0x17 2023-12-03T11:50:24.974 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.969+0000 7f62977fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18 to cache LRU end 2023-12-03T11:50:24.974 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.969+0000 7f62977fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2023-12-03T11:50:24.974 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.971+0000 7f62b82ba800 20 handle_bi_update(): bucket=:myver[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18]): orig_sources= new_sources= 2023-12-03T11:50:24.974 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.971+0000 7f62b82ba800 20 handle_bi_update(): bucket=:myver[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18]): potential sources added=[] removed=[] 2023-12-03T11:50:24.975 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.971+0000 7f62b82ba800 20 handle_bi_update(): bucket=:myver[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18]): orig_dests= new_dests= 2023-12-03T11:50:24.975 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.971+0000 7f62b82ba800 20 handle_bi_update(): bucket=:myver[83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18]): potential dests added=[] removed=[] 2023-12-03T11:50:24.975 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.974+0000 7f62b82ba800 1 execute INFO: reshard of bucket "myver" completed successfully 2023-12-03T11:50:24.977 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.976+0000 7f627b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:50:24.979 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.978+0000 7f62b82ba800 20 remove_watcher() i=0 2023-12-03T11:50:24.979 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.978+0000 7f62b82ba800 2 removed watcher, disabling cache 2023-12-03T11:50:24.980 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.979+0000 7f62b82ba800 20 remove_watcher() i=1 2023-12-03T11:50:24.981 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.980+0000 7f62b82ba800 20 remove_watcher() i=2 2023-12-03T11:50:24.982 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.981+0000 7f62b82ba800 20 remove_watcher() i=3 2023-12-03T11:50:24.983 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.982+0000 7f62b82ba800 20 remove_watcher() i=4 2023-12-03T11:50:24.984 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.983+0000 7f62b82ba800 20 remove_watcher() i=5 2023-12-03T11:50:24.985 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.984+0000 7f62b82ba800 20 remove_watcher() i=6 2023-12-03T11:50:24.986 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:24.985+0000 7f62b82ba800 20 remove_watcher() i=7 2023-12-03T11:50:24.993 INFO:tasks.workunit.client.0.smithi003.stderr:radosgw-admin bucket check unlinked --bucket myver --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2023-12-03T11:50:25.026 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:50:25.026 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:50:25.041 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.040+0000 7f4eb773d800 20 rados->read ofs=0 len=0 2023-12-03T11:50:25.043 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.041+0000 7f4eb773d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:50:25.043 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.041+0000 7f4eb773d800 20 realm 2023-12-03T11:50:25.043 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.041+0000 7f4eb773d800 20 rados->read ofs=0 len=0 2023-12-03T11:50:25.043 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.041+0000 7f4eb773d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:50:25.043 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.041+0000 7f4eb773d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:50:25.043 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.041+0000 7f4eb773d800 20 rados->read ofs=0 len=0 2023-12-03T11:50:25.043 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.042+0000 7f4eb773d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:50:25.043 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.042+0000 7f4eb773d800 20 rados->read ofs=0 len=0 2023-12-03T11:50:25.044 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.042+0000 7f4eb773d800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:50:25.044 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.042+0000 7f4eb773d800 20 rados->read ofs=0 len=0 2023-12-03T11:50:25.044 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.043+0000 7f4eb773d800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:50:25.044 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.043+0000 7f4eb773d800 20 searching for the correct realm 2023-12-03T11:50:25.055 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.054+0000 7f4eb34a3640 0 -- 172.21.15.3:0/3509063009 >> [v2:172.21.15.37:6805/1692844418,v1:172.21.15.37:6807/1692844418] conn(0x55a303f560d0 msgr2=0x55a303f584c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:50:25.055 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.054+0000 7f4eb773d800 20 RGWRados::pool_iterate: got zone_info.83aabb46-04b5-4c96-9933-c6bfb1173a73 2023-12-03T11:50:25.056 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.054+0000 7f4eb773d800 20 RGWRados::pool_iterate: got zonegroup_info.6a811aad-435d-4fdd-93c9-b7e0b50de429 2023-12-03T11:50:25.056 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.054+0000 7f4eb773d800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:50:25.056 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.054+0000 7f4eb773d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:50:25.056 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.054+0000 7f4eb773d800 20 rados->read ofs=0 len=0 2023-12-03T11:50:25.056 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.054+0000 7f4eb773d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:50:25.056 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.054+0000 7f4eb773d800 20 rados->read ofs=0 len=0 2023-12-03T11:50:25.056 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.054+0000 7f4eb773d800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:50:25.056 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.054+0000 7f4eb773d800 20 rados->read ofs=0 len=0 2023-12-03T11:50:25.057 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.055+0000 7f4eb773d800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:50:25.057 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.055+0000 7f4eb773d800 20 zone default found 2023-12-03T11:50:25.057 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.055+0000 7f4eb773d800 4 Realm: () 2023-12-03T11:50:25.057 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.055+0000 7f4eb773d800 4 ZoneGroup: default (6a811aad-435d-4fdd-93c9-b7e0b50de429) 2023-12-03T11:50:25.057 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.055+0000 7f4eb773d800 4 Zone: default (83aabb46-04b5-4c96-9933-c6bfb1173a73) 2023-12-03T11:50:25.058 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.055+0000 7f4eb773d800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:50:25.058 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.055+0000 7f4eb773d800 20 zonegroup default 2023-12-03T11:50:25.058 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.055+0000 7f4eb773d800 20 rados->read ofs=0 len=0 2023-12-03T11:50:25.058 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.055+0000 7f4eb773d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:50:25.058 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.055+0000 7f4eb773d800 20 rados->read ofs=0 len=0 2023-12-03T11:50:25.058 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.055+0000 7f4eb773d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:50:25.058 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.055+0000 7f4eb773d800 20 rados->read ofs=0 len=0 2023-12-03T11:50:25.058 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.056+0000 7f4eb773d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:50:25.058 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.056+0000 7f4eb773d800 20 started sync module instance, tier type = 2023-12-03T11:50:25.058 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.056+0000 7f4eb773d800 20 started zone id=83aabb46-04b5-4c96-9933-c6bfb1173a73 (name=default) with tier type = 2023-12-03T11:50:25.065 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.064+0000 7f4eb2ca2640 0 -- 172.21.15.3:0/3509063009 >> [v2:172.21.15.3:6817/3356208405,v1:172.21.15.3:6819/3356208405] conn(0x55a303f5b0e0 msgr2=0x55a303f5d4d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:50:25.067 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.065+0000 7f4eb773d800 20 add_watcher() i=0 2023-12-03T11:50:25.067 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.065+0000 7f4eb773d800 20 add_watcher() i=1 2023-12-03T11:50:25.067 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.065+0000 7f4eb773d800 20 add_watcher() i=2 2023-12-03T11:50:25.067 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.065+0000 7f4eb773d800 20 add_watcher() i=3 2023-12-03T11:50:25.067 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.065+0000 7f4eb773d800 20 add_watcher() i=4 2023-12-03T11:50:25.067 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.065+0000 7f4eb773d800 20 add_watcher() i=5 2023-12-03T11:50:25.068 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.066+0000 7f4eb773d800 20 add_watcher() i=6 2023-12-03T11:50:25.068 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.067+0000 7f4eb773d800 20 add_watcher() i=7 2023-12-03T11:50:25.068 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.067+0000 7f4eb773d800 2 all 8 watchers are set, enabling cache 2023-12-03T11:50:25.070 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.068+0000 7f4e797e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:50:25.070 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.069+0000 7f4eb773d800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:50:25.070 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.069+0000 7f4eb773d800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:50:25.076 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.075+0000 7f4eb773d800 5 note: GC not initialized 2023-12-03T11:50:25.077 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.075+0000 7f4de7fff640 20 reqs_thread_entry: start 2023-12-03T11:50:25.077 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.075+0000 7f4eb773d800 20 init_complete bucket index max shards: 11 2023-12-03T11:50:25.077 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.075+0000 7f4eb773d800 20 Filter name: none 2023-12-03T11:50:25.077 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.075+0000 7f4de5ffb640 20 reqs_thread_entry: start 2023-12-03T11:50:25.077 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.075+0000 7f4eb773d800 10 cache get: name=default.rgw.meta+root+myver : miss 2023-12-03T11:50:25.077 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.075+0000 7f4eb773d800 20 rados->read ofs=0 len=0 2023-12-03T11:50:25.078 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.076+0000 7f4eb773d800 20 rados_obj.operate() r=0 bl.length=197 2023-12-03T11:50:25.078 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.076+0000 7f4eb773d800 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2023-12-03T11:50:25.078 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.076+0000 7f4eb773d800 10 adding default.rgw.meta+root+myver to cache LRU end 2023-12-03T11:50:25.078 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.076+0000 7f4eb773d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18 : miss 2023-12-03T11:50:25.078 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.076+0000 7f4eb773d800 20 rados->read ofs=0 len=0 2023-12-03T11:50:25.078 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.076+0000 7f4eb773d800 20 rados_obj.operate() r=0 bl.length=369 2023-12-03T11:50:25.078 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.076+0000 7f4eb773d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18 info.flags=0x17 2023-12-03T11:50:25.078 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.076+0000 7f4eb773d800 10 adding default.rgw.meta+root+.bucket.meta.myver:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18 to cache LRU end 2023-12-03T11:50:25.078 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.076+0000 7f4eb773d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:50:25.079 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.076+0000 7f4eb773d800 10 updating xattr: name=user.rgw.acl bl.length()=203 2023-12-03T11:50:25.079 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.076+0000 7f4eb773d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18 2023-12-03T11:50:25.079 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.076+0000 7f4eb773d800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.3.0 2023-12-03T11:50:25.079 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.076+0000 7f4eb773d800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.3.0 2023-12-03T11:50:25.079 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.077+0000 7f4eb773d800 1 NOTICE: finished shard 0 (0 entries removed) 2023-12-03T11:50:25.080 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.077+0000 7f4eb773d800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.3.1 2023-12-03T11:50:25.080 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.077+0000 7f4eb773d800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.3.1 2023-12-03T11:50:25.080 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.078+0000 7f4eb773d800 1 NOTICE: finished shard 1 (0 entries removed) 2023-12-03T11:50:25.080 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.078+0000 7f4eb773d800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.3.2 2023-12-03T11:50:25.080 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.078+0000 7f4eb773d800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.3.2 2023-12-03T11:50:25.080 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.078+0000 7f4eb773d800 1 NOTICE: finished shard 2 (0 entries removed) 2023-12-03T11:50:25.080 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.078+0000 7f4eb773d800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.3.3 2023-12-03T11:50:25.080 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.078+0000 7f4eb773d800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.3.3 2023-12-03T11:50:25.080 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.078+0000 7f4eb773d800 1 NOTICE: finished shard 3 (0 entries removed) 2023-12-03T11:50:25.080 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.078+0000 7f4eb773d800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.3.4 2023-12-03T11:50:25.080 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.078+0000 7f4eb773d800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.3.4 2023-12-03T11:50:25.081 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.079+0000 7f4eb773d800 1 NOTICE: finished shard 4 (0 entries removed) 2023-12-03T11:50:25.081 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.079+0000 7f4eb773d800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.3.5 2023-12-03T11:50:25.081 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.079+0000 7f4eb773d800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.3.5 2023-12-03T11:50:25.081 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.079+0000 7f4eb773d800 1 NOTICE: finished shard 5 (0 entries removed) 2023-12-03T11:50:25.081 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.079+0000 7f4eb773d800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.3.6 2023-12-03T11:50:25.081 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.079+0000 7f4eb773d800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.3.6 2023-12-03T11:50:25.082 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.079+0000 7f4eb773d800 1 NOTICE: finished shard 6 (0 entries removed) 2023-12-03T11:50:25.082 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.079+0000 7f4eb773d800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.3.7 2023-12-03T11:50:25.082 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.079+0000 7f4eb773d800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.3.7 2023-12-03T11:50:25.082 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.080+0000 7f4eb773d800 1 NOTICE: finished shard 7 (0 entries removed) 2023-12-03T11:50:25.082 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.080+0000 7f4eb773d800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.3.8 2023-12-03T11:50:25.082 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.080+0000 7f4eb773d800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.3.8 2023-12-03T11:50:25.082 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.080+0000 7f4eb773d800 1 NOTICE: finished shard 8 (0 entries removed) 2023-12-03T11:50:25.083 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.080+0000 7f4eb773d800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.3.9 2023-12-03T11:50:25.083 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.080+0000 7f4eb773d800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.3.9 2023-12-03T11:50:25.083 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.081+0000 7f4eb773d800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.3.10 2023-12-03T11:50:25.083 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.081+0000 7f4eb773d800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.3.10 2023-12-03T11:50:25.083 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.081+0000 7f4eb773d800 1 NOTICE: finished shard 10 (0 entries removed) 2023-12-03T11:50:25.083 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.081+0000 7f4eb773d800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.3.11 2023-12-03T11:50:25.083 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.081+0000 7f4eb773d800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.3.11 2023-12-03T11:50:25.083 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.082+0000 7f4eb773d800 1 NOTICE: finished shard 11 (0 entries removed) 2023-12-03T11:50:25.084 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.082+0000 7f4eb773d800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.3.12 2023-12-03T11:50:25.084 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.082+0000 7f4eb773d800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.3.12 2023-12-03T11:50:25.084 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.082+0000 7f4eb773d800 1 NOTICE: finished shard 12 (0 entries removed) 2023-12-03T11:50:25.084 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.082+0000 7f4eb773d800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.3.13 2023-12-03T11:50:25.084 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.082+0000 7f4eb773d800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.3.13 2023-12-03T11:50:25.084 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.083+0000 7f4eb773d800 1 NOTICE: finished shard 13 (0 entries removed) 2023-12-03T11:50:25.084 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.083+0000 7f4eb773d800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.3.14 2023-12-03T11:50:25.084 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.083+0000 7f4eb773d800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.3.14 2023-12-03T11:50:25.085 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.083+0000 7f4eb773d800 1 NOTICE: finished shard 14 (0 entries removed) 2023-12-03T11:50:25.085 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.083+0000 7f4eb773d800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.3.15 2023-12-03T11:50:25.085 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.083+0000 7f4eb773d800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.3.15 2023-12-03T11:50:25.085 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.084+0000 7f4eb773d800 1 NOTICE: finished shard 15 (0 entries removed) 2023-12-03T11:50:25.086 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.084+0000 7f4eb773d800 10 bucket_obj is .dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.3.16 2023-12-03T11:50:25.086 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.084+0000 7f4eb773d800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.3.16 2023-12-03T11:50:25.086 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.084+0000 7f4eb773d800 1 NOTICE: finished shard 16 (0 entries removed) 2023-12-03T11:50:25.086 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.084+0000 7f4eb773d800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.3.9 2023-12-03T11:50:25.086 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.084+0000 7f4eb773d800 20 get_obj_state: octx=0x7f4ea4059ae0 obj=myver:x state=0x55a304006ea8 s->prefetch_data=0 2023-12-03T11:50:25.086 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.085+0000 7f4eb773d800 20 get_obj_state: setting s->obj_tag to 3wh60o5hse5qxwehw1efff75wv2jnnmg 2023-12-03T11:50:25.086 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.085+0000 7f4eb773d800 20 get_obj_state_impl: setting s->olh_tag to 03sivdpmjck3cwjur2vmdw5nmmb52ny1 2023-12-03T11:50:25.086 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.085+0000 7f4eb773d800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=03sivdpmjck3cwjur2vmdw5nmmb52ny1 2023-12-03T11:50:25.087 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.086+0000 7f4eb773d800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.3.9 2023-12-03T11:50:25.088 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.087+0000 7f4eb773d800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.3.9 2023-12-03T11:50:25.089 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.088+0000 7f4eb773d800 20 olh_log_entry: epoch=2 op=2 key=x[] 2023-12-03T11:50:25.089 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.088+0000 7f4eb773d800 20 olh_log_entry: epoch=2 op=3 key=x[805.p4wMZnI7Rs2DiymW7DP.PCiCtIj] 2023-12-03T11:50:25.089 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.088+0000 7f4eb773d800 20 get_obj_state: octx=0x7f4ea4059ae0 obj=myver:_:805.p4wMZnI7Rs2DiymW7DP.PCiCtIj_x state=0x55a3040111a8 s->prefetch_data=0 2023-12-03T11:50:25.089 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.088+0000 7f4eb773d800 10 manifest: total_size = 11 2023-12-03T11:50:25.089 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.088+0000 7f4eb773d800 20 get_obj_state: setting s->obj_tag to 83aabb46-04b5-4c96-9933-c6bfb1173a73.4653.4088710198097380227 2023-12-03T11:50:25.090 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.088+0000 7f4eb773d800 20 get_obj_state: octx=0x7f4ea4059ae0 obj=myver:_:805.p4wMZnI7Rs2DiymW7DP.PCiCtIj_x state=0x55a3040111a8 s->prefetch_data=0 2023-12-03T11:50:25.090 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.088+0000 7f4eb773d800 20 prepare_atomic_modification: state is not atomic. state=0x55a3040111a8 2023-12-03T11:50:25.090 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.088+0000 7f4eb773d800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.3.9 2023-12-03T11:50:25.093 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.092+0000 7f4e99ffb640 20 handle_completion(): completion ok for obj=x[805.p4wMZnI7Rs2DiymW7DP.PCiCtIj] 2023-12-03T11:50:25.093 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.092+0000 7f4eb773d800 20 get_obj_state: octx=0x7f4ea4059ae0 obj=myver:x state=0x55a304006ea8 s->prefetch_data=0 2023-12-03T11:50:25.093 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.092+0000 7f4eb773d800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=03sivdpmjck3cwjur2vmdw5nmmb52ny1 2023-12-03T11:50:25.096 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.094+0000 7f4eb773d800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.3.9 2023-12-03T11:50:25.097 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.096+0000 7f4eb773d800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.3.9 2023-12-03T11:50:25.097 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.096+0000 7f4eb773d800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.3.9 2023-12-03T11:50:25.097 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.096+0000 7f4eb773d800 20 get_obj_state: octx=0x7f4ea4059ae0 obj=myver:y state=0x55a304006ea8 s->prefetch_data=0 2023-12-03T11:50:25.098 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.097+0000 7f4eb773d800 20 get_obj_state: setting s->obj_tag to rob26vqgqykfjig21h638w44ss3hrqqn 2023-12-03T11:50:25.098 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.097+0000 7f4eb773d800 20 get_obj_state_impl: setting s->olh_tag to gh3e51ahqiz5gxlgvqmf2k1bp5gy5atz 2023-12-03T11:50:25.098 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.097+0000 7f4eb773d800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=gh3e51ahqiz5gxlgvqmf2k1bp5gy5atz 2023-12-03T11:50:25.099 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.098+0000 7f4eb773d800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.3.9 2023-12-03T11:50:25.100 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.099+0000 7f4eb773d800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.3.9 2023-12-03T11:50:25.101 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.100+0000 7f4eb773d800 20 olh_log_entry: epoch=2 op=2 key=y[] 2023-12-03T11:50:25.101 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.100+0000 7f4eb773d800 20 olh_log_entry: epoch=2 op=3 key=y[9VVa2IDEYA2S2WYvnqdWhdHbuuCL8LW] 2023-12-03T11:50:25.101 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.100+0000 7f4eb773d800 20 get_obj_state: octx=0x7f4ea4059ae0 obj=myver:_:9VVa2IDEYA2S2WYvnqdWhdHbuuCL8LW_y state=0x55a3040121b8 s->prefetch_data=0 2023-12-03T11:50:25.101 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.100+0000 7f4eb773d800 10 manifest: total_size = 22 2023-12-03T11:50:25.102 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.100+0000 7f4eb773d800 20 get_obj_state: setting s->obj_tag to 83aabb46-04b5-4c96-9933-c6bfb1173a73.4653.2464336478742765493 2023-12-03T11:50:25.102 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.100+0000 7f4eb773d800 20 get_obj_state: octx=0x7f4ea4059ae0 obj=myver:_:9VVa2IDEYA2S2WYvnqdWhdHbuuCL8LW_y state=0x55a3040121b8 s->prefetch_data=0 2023-12-03T11:50:25.102 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.100+0000 7f4eb773d800 20 prepare_atomic_modification: state is not atomic. state=0x55a3040121b8 2023-12-03T11:50:25.102 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.100+0000 7f4eb773d800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.3.9 2023-12-03T11:50:25.105 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.104+0000 7f4e997fa640 20 handle_completion(): completion ok for obj=y[9VVa2IDEYA2S2WYvnqdWhdHbuuCL8LW] 2023-12-03T11:50:25.105 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.104+0000 7f4eb773d800 20 get_obj_state: octx=0x7f4ea4059ae0 obj=myver:y state=0x55a304006ea8 s->prefetch_data=0 2023-12-03T11:50:25.106 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.104+0000 7f4eb773d800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=gh3e51ahqiz5gxlgvqmf2k1bp5gy5atz 2023-12-03T11:50:25.108 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.107+0000 7f4eb773d800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.3.9 2023-12-03T11:50:25.110 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.108+0000 7f4eb773d800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.3.9 2023-12-03T11:50:25.110 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.109+0000 7f4eb773d800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.3.9 2023-12-03T11:50:25.110 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.109+0000 7f4eb773d800 20 get_obj_state: octx=0x55a303fe5b50 obj=myver:z state=0x55a304006ea8 s->prefetch_data=0 2023-12-03T11:50:25.111 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.110+0000 7f4eb773d800 20 get_obj_state: setting s->obj_tag to zlxyp2xyw3022mot8h2glk85z8b1iqz5 2023-12-03T11:50:25.111 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.110+0000 7f4eb773d800 20 get_obj_state_impl: setting s->olh_tag to mrw1h9dct28uc0y9wy5p2qvppj6y6lq8 2023-12-03T11:50:25.111 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.110+0000 7f4eb773d800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=mrw1h9dct28uc0y9wy5p2qvppj6y6lq8 2023-12-03T11:50:25.112 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.111+0000 7f4eb773d800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.3.9 2023-12-03T11:50:25.113 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.112+0000 7f4eb773d800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.3.9 2023-12-03T11:50:25.114 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.112+0000 7f4eb773d800 20 olh_log_entry: epoch=2 op=2 key=z[] 2023-12-03T11:50:25.114 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.112+0000 7f4eb773d800 20 olh_log_entry: epoch=2 op=3 key=z[CL7axM4y7MY-8s7BrVTpZT9OB0z4pex] 2023-12-03T11:50:25.114 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.112+0000 7f4eb773d800 20 get_obj_state: octx=0x55a303fe5b50 obj=myver:_:CL7axM4y7MY-8s7BrVTpZT9OB0z4pex_z state=0x55a30400e178 s->prefetch_data=0 2023-12-03T11:50:25.114 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.113+0000 7f4eb773d800 10 manifest: total_size = 22 2023-12-03T11:50:25.114 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.113+0000 7f4eb773d800 20 get_obj_state: setting s->obj_tag to 83aabb46-04b5-4c96-9933-c6bfb1173a73.4653.17043960785616699153 2023-12-03T11:50:25.114 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.113+0000 7f4eb773d800 20 get_obj_state: octx=0x55a303fe5b50 obj=myver:_:CL7axM4y7MY-8s7BrVTpZT9OB0z4pex_z state=0x55a30400e178 s->prefetch_data=0 2023-12-03T11:50:25.114 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.113+0000 7f4eb773d800 20 prepare_atomic_modification: state is not atomic. state=0x55a30400e178 2023-12-03T11:50:25.114 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.113+0000 7f4eb773d800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.3.9 2023-12-03T11:50:25.118 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.116+0000 7f4e99ffb640 20 handle_completion(): completion ok for obj=z[CL7axM4y7MY-8s7BrVTpZT9OB0z4pex] 2023-12-03T11:50:25.118 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.117+0000 7f4eb773d800 20 get_obj_state: octx=0x55a303fe5b50 obj=myver:z state=0x55a304006ea8 s->prefetch_data=0 2023-12-03T11:50:25.118 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.117+0000 7f4eb773d800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=mrw1h9dct28uc0y9wy5p2qvppj6y6lq8 2023-12-03T11:50:25.120 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.119+0000 7f4eb773d800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.3.9 2023-12-03T11:50:25.121 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.120+0000 7f4eb773d800 20 bucket index object: default.rgw.buckets.index:.dir.83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.18.3.9 2023-12-03T11:50:25.122 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.120+0000 7f4eb773d800 1 NOTICE: finished shard 9 (3 entries removed) 2023-12-03T11:50:25.122 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.120+0000 7f4eb773d800 1 NOTICE: finished all shards (3 entries removed) 2023-12-03T11:50:25.122 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.121+0000 7f4e797e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:50:25.125 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.124+0000 7f4eb773d800 20 remove_watcher() i=0 2023-12-03T11:50:25.125 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.124+0000 7f4eb773d800 2 removed watcher, disabling cache 2023-12-03T11:50:25.126 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.125+0000 7f4eb773d800 20 remove_watcher() i=1 2023-12-03T11:50:25.127 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.126+0000 7f4eb773d800 20 remove_watcher() i=2 2023-12-03T11:50:25.129 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.127+0000 7f4eb773d800 20 remove_watcher() i=3 2023-12-03T11:50:25.129 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.128+0000 7f4eb773d800 20 remove_watcher() i=4 2023-12-03T11:50:25.130 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.129+0000 7f4eb773d800 20 remove_watcher() i=5 2023-12-03T11:50:25.132 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.130+0000 7f4eb773d800 20 remove_watcher() i=6 2023-12-03T11:50:25.132 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.131+0000 7f4eb773d800 20 remove_watcher() i=7 2023-12-03T11:50:25.257 INFO:tasks.workunit.client.0.smithi003.stderr:radosgw-admin bucket stats --bucket myver 2023-12-03T11:50:25.285 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:50:25.285 INFO:tasks.workunit.client.0.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:50:25.300 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.298+0000 7f8226d35800 20 rados->read ofs=0 len=0 2023-12-03T11:50:25.302 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.300+0000 7f8226d35800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:50:25.302 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.300+0000 7f8226d35800 20 realm 2023-12-03T11:50:25.302 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.300+0000 7f8226d35800 20 rados->read ofs=0 len=0 2023-12-03T11:50:25.302 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.300+0000 7f8226d35800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:50:25.302 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.300+0000 7f8226d35800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:50:25.302 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.300+0000 7f8226d35800 20 rados->read ofs=0 len=0 2023-12-03T11:50:25.302 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.300+0000 7f8226d35800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:50:25.302 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.300+0000 7f8226d35800 20 rados->read ofs=0 len=0 2023-12-03T11:50:25.303 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.301+0000 7f8226d35800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:50:25.303 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.301+0000 7f8226d35800 20 rados->read ofs=0 len=0 2023-12-03T11:50:25.303 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.301+0000 7f8226d35800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:50:25.303 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.301+0000 7f8226d35800 20 searching for the correct realm 2023-12-03T11:50:25.312 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.310+0000 7f82229de640 0 -- 172.21.15.3:0/200382525 >> [v2:172.21.15.3:6800/2373485412,v1:172.21.15.3:6801/2373485412] conn(0x7f821c059f30 msgr2=0x7f821c058c30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-03T11:50:25.314 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.313+0000 7f8226d35800 20 RGWRados::pool_iterate: got zone_info.83aabb46-04b5-4c96-9933-c6bfb1173a73 2023-12-03T11:50:25.314 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.313+0000 7f8226d35800 20 RGWRados::pool_iterate: got zonegroup_info.6a811aad-435d-4fdd-93c9-b7e0b50de429 2023-12-03T11:50:25.314 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.313+0000 7f8226d35800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:50:25.314 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.313+0000 7f8226d35800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:50:25.315 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.313+0000 7f8226d35800 20 rados->read ofs=0 len=0 2023-12-03T11:50:25.315 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.313+0000 7f8226d35800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:50:25.315 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.313+0000 7f8226d35800 20 rados->read ofs=0 len=0 2023-12-03T11:50:25.315 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.313+0000 7f8226d35800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:50:25.315 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.313+0000 7f8226d35800 20 rados->read ofs=0 len=0 2023-12-03T11:50:25.316 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.313+0000 7f8226d35800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:50:25.316 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.313+0000 7f8226d35800 20 zone default found 2023-12-03T11:50:25.316 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.313+0000 7f8226d35800 4 Realm: () 2023-12-03T11:50:25.316 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.313+0000 7f8226d35800 4 ZoneGroup: default (6a811aad-435d-4fdd-93c9-b7e0b50de429) 2023-12-03T11:50:25.316 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.313+0000 7f8226d35800 4 Zone: default (83aabb46-04b5-4c96-9933-c6bfb1173a73) 2023-12-03T11:50:25.316 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.313+0000 7f8226d35800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:50:25.317 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.313+0000 7f8226d35800 20 zonegroup default 2023-12-03T11:50:25.317 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.313+0000 7f8226d35800 20 rados->read ofs=0 len=0 2023-12-03T11:50:25.317 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.314+0000 7f8226d35800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:50:25.317 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.314+0000 7f8226d35800 20 rados->read ofs=0 len=0 2023-12-03T11:50:25.317 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.314+0000 7f8226d35800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:50:25.317 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.314+0000 7f8226d35800 20 rados->read ofs=0 len=0 2023-12-03T11:50:25.317 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.314+0000 7f8226d35800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:50:25.317 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.314+0000 7f8226d35800 20 started sync module instance, tier type = 2023-12-03T11:50:25.317 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.314+0000 7f8226d35800 20 started zone id=83aabb46-04b5-4c96-9933-c6bfb1173a73 (name=default) with tier type = 2023-12-03T11:50:25.320 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.319+0000 7f82229de640 0 -- 172.21.15.3:0/200382525 >> [v2:172.21.15.3:6800/2373485412,v1:172.21.15.3:6801/2373485412] conn(0x7f81fc079d90 msgr2=0x7f81fc07c1c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-03T11:50:25.324 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.323+0000 7f8226d35800 20 add_watcher() i=0 2023-12-03T11:50:25.325 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.323+0000 7f8226d35800 20 add_watcher() i=1 2023-12-03T11:50:25.325 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.323+0000 7f8226d35800 20 add_watcher() i=2 2023-12-03T11:50:25.325 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.323+0000 7f8226d35800 20 add_watcher() i=3 2023-12-03T11:50:25.325 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.323+0000 7f8226d35800 20 add_watcher() i=4 2023-12-03T11:50:25.325 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.323+0000 7f8226d35800 20 add_watcher() i=5 2023-12-03T11:50:25.325 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.323+0000 7f8226d35800 20 add_watcher() i=6 2023-12-03T11:50:25.325 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.324+0000 7f8226d35800 20 add_watcher() i=7 2023-12-03T11:50:25.325 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.324+0000 7f8226d35800 2 all 8 watchers are set, enabling cache 2023-12-03T11:50:25.327 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.326+0000 7f8163fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:50:25.327 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.326+0000 7f8226d35800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:50:25.327 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.326+0000 7f8226d35800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:50:25.334 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.332+0000 7f8226d35800 5 note: GC not initialized 2023-12-03T11:50:25.334 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.332+0000 7f8152ffd640 20 reqs_thread_entry: start 2023-12-03T11:50:25.334 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.332+0000 7f8226d35800 20 init_complete bucket index max shards: 11 2023-12-03T11:50:25.334 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.332+0000 7f8226d35800 20 Filter name: none 2023-12-03T11:50:25.334 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.332+0000 7f8150ff9640 20 reqs_thread_entry: start 2023-12-03T11:50:25.334 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.332+0000 7f8226d35800 20 rados->read ofs=0 len=0 2023-12-03T11:50:25.335 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.333+0000 7f8226d35800 20 rados_obj.operate() r=0 bl.length=197 2023-12-03T11:50:25.335 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.333+0000 7f8226d35800 20 rados->read ofs=0 len=0 2023-12-03T11:50:25.335 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.333+0000 7f8226d35800 20 rados_obj.operate() r=0 bl.length=369 2023-12-03T11:50:25.335 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.333+0000 7f8226d35800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:50:25.335 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.333+0000 7f8226d35800 20 rados->read ofs=0 len=0 2023-12-03T11:50:25.335 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.334+0000 7f8226d35800 20 rados_obj.operate() r=0 bl.length=197 2023-12-03T11:50:25.335 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.334+0000 7f8226d35800 20 rados->read ofs=0 len=0 2023-12-03T11:50:25.336 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.334+0000 7f8226d35800 20 rados_obj.operate() r=0 bl.length=369 2023-12-03T11:50:25.336 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.334+0000 7f8226d35800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:50:25.336 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.335+0000 7f8226d35800 20 rados->read ofs=0 len=0 2023-12-03T11:50:25.337 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.335+0000 7f8226d35800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:50:25.337 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.336+0000 7f8163fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:50:25.339 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.338+0000 7f8226d35800 20 remove_watcher() i=0 2023-12-03T11:50:25.339 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.338+0000 7f8226d35800 2 removed watcher, disabling cache 2023-12-03T11:50:25.340 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.339+0000 7f8226d35800 20 remove_watcher() i=1 2023-12-03T11:50:25.341 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.340+0000 7f8226d35800 20 remove_watcher() i=2 2023-12-03T11:50:25.342 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.341+0000 7f8226d35800 20 remove_watcher() i=3 2023-12-03T11:50:25.343 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.342+0000 7f8226d35800 20 remove_watcher() i=4 2023-12-03T11:50:25.344 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.343+0000 7f8226d35800 20 remove_watcher() i=5 2023-12-03T11:50:25.345 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.344+0000 7f8226d35800 20 remove_watcher() i=6 2023-12-03T11:50:25.346 INFO:tasks.workunit.client.0.smithi003.stderr:2023-12-03T11:50:25.345+0000 7f8226d35800 20 remove_watcher() i=7 2023-12-03T11:50:25.351 INFO:tasks.workunit.client.0.smithi003.stderr:{'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}} 2023-12-03T11:50:25.351 INFO:tasks.workunit.client.0.smithi003.stderr:Deleting bucket a-bucket 2023-12-03T11:50:25.423 INFO:tasks.workunit.client.0.smithi003.stderr:Deleting bucket myver 2023-12-03T11:50:25.650 INFO:tasks.workunit.client.0.smithi003.stderr:Completed resharding tests 2023-12-03T11:50:25.651 INFO:tasks.workunit.client.0.smithi003.stdout:connected to http://localhost:80 2023-12-03T11:50:25.715 INFO:tasks.workunit.client.0.smithi003.stderr:+ deactivate 2023-12-03T11:50:25.715 INFO:tasks.workunit.client.0.smithi003.stderr:+ '[' -n /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin ']' 2023-12-03T11:50:25.715 INFO:tasks.workunit.client.0.smithi003.stderr:+ PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2023-12-03T11:50:25.715 INFO:tasks.workunit.client.0.smithi003.stderr:+ export PATH 2023-12-03T11:50:25.715 INFO:tasks.workunit.client.0.smithi003.stderr:+ unset _OLD_VIRTUAL_PATH 2023-12-03T11:50:25.715 INFO:tasks.workunit.client.0.smithi003.stderr:+ '[' -n '' ']' 2023-12-03T11:50:25.715 INFO:tasks.workunit.client.0.smithi003.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2023-12-03T11:50:25.715 INFO:tasks.workunit.client.0.smithi003.stderr:+ hash -r 2023-12-03T11:50:25.715 INFO:tasks.workunit.client.0.smithi003.stderr:+ '[' -n '' ']' 2023-12-03T11:50:25.715 INFO:tasks.workunit.client.0.smithi003.stderr:+ unset VIRTUAL_ENV 2023-12-03T11:50:25.715 INFO:tasks.workunit.client.0.smithi003.stderr:+ '[' '!' '' = nondestructive ']' 2023-12-03T11:50:25.716 INFO:tasks.workunit.client.0.smithi003.stderr:+ unset -f deactivate 2023-12-03T11:50:25.716 INFO:tasks.workunit.client.0.smithi003.stderr:+ echo OK. 2023-12-03T11:50:25.716 INFO:tasks.workunit.client.0.smithi003.stdout:OK. 2023-12-03T11:50:25.717 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-12-03T11:50:25.717 DEBUG:teuthology.orchestra.run.smithi003:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-12-03T11:50:25.788 INFO:tasks.workunit:Stopping ['rgw/run-reshard.sh'] on client.0... 2023-12-03T11:50:25.788 DEBUG:teuthology.orchestra.run.smithi003:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2023-12-03T11:50:26.185 DEBUG:teuthology.parallel:result is None 2023-12-03T11:50:26.185 DEBUG:teuthology.orchestra.run.smithi003:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2023-12-03T11:50:26.219 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2023-12-03T11:50:26.219 DEBUG:teuthology.orchestra.run.smithi003:> rmdir -- /home/ubuntu/cephtest/mnt.0 2023-12-03T11:50:26.274 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2023-12-03T11:50:26.274 INFO:teuthology.run_tasks:Running task s3tests-java... 2023-12-03T11:50:26.287 DEBUG:tasks.s3tests_java:S3 Tests Java: __INIT__ 2023-12-03T11:50:26.288 DEBUG:tasks.s3tests_java:S3 Tests Java: SETUP 2023-12-03T11:50:26.288 INFO:tasks.s3tests_java:S3 Tests Java: Downloading test suite... 2023-12-03T11:50:26.288 DEBUG:teuthology.orchestra.run.smithi003:> git clone -b ceph-master https://github.com/ceph/java_s3tests.git /home/ubuntu/cephtest/s3-tests-java 2023-12-03T11:50:26.329 INFO:teuthology.orchestra.run.smithi003.stderr:Cloning into '/home/ubuntu/cephtest/s3-tests-java'... 2023-12-03T11:50:30.925 INFO:tasks.s3tests_java:S3 Tests Java: Installing required packages... 2023-12-03T11:50:30.925 DEBUG:teuthology.orchestra.run.smithi003:> /home/ubuntu/cephtest/s3-tests-java/bootstrap.sh 2023-12-03T11:50:34.059 INFO:teuthology.orchestra.run.smithi003.stderr:/home/ubuntu/cephtest/s3-tests-java/bootstrap.sh: missing required RPM packages. Installing via sudo. 2023-12-03T11:50:34.662 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:18:37 ago on Sun 03 Dec 2023 11:31:57 AM UTC. 2023-12-03T11:50:34.837 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2023-12-03T11:50:34.845 INFO:teuthology.orchestra.run.smithi003.stdout:====================================================================================================== 2023-12-03T11:50:34.845 INFO:teuthology.orchestra.run.smithi003.stdout: Package Arch Version Repository Size 2023-12-03T11:50:34.845 INFO:teuthology.orchestra.run.smithi003.stdout:====================================================================================================== 2023-12-03T11:50:34.845 INFO:teuthology.orchestra.run.smithi003.stdout:Installing: 2023-12-03T11:50:34.845 INFO:teuthology.orchestra.run.smithi003.stdout: java-1.8.0-openjdk x86_64 1:1.8.0.362.b09-4.el9 CentOS-AppStream 424 k 2023-12-03T11:50:34.845 INFO:teuthology.orchestra.run.smithi003.stdout: java-1.8.0-openjdk-devel x86_64 1:1.8.0.362.b09-4.el9 CentOS-AppStream 9.3 M 2023-12-03T11:50:34.845 INFO:teuthology.orchestra.run.smithi003.stdout:Installing dependencies: 2023-12-03T11:50:34.846 INFO:teuthology.orchestra.run.smithi003.stdout: ModemManager-glib x86_64 1.20.2-1.el9 CentOS-BaseOS 334 k 2023-12-03T11:50:34.846 INFO:teuthology.orchestra.run.smithi003.stdout: adwaita-cursor-theme noarch 40.1.1-3.el9 CentOS-AppStream 625 k 2023-12-03T11:50:34.846 INFO:teuthology.orchestra.run.smithi003.stdout: adwaita-icon-theme noarch 40.1.1-3.el9 CentOS-AppStream 11 M 2023-12-03T11:50:34.846 INFO:teuthology.orchestra.run.smithi003.stdout: alsa-lib x86_64 1.2.9-1.el9 CentOS-AppStream 499 k 2023-12-03T11:50:34.846 INFO:teuthology.orchestra.run.smithi003.stdout: at-spi2-atk x86_64 2.38.0-4.el9 CentOS-AppStream 86 k 2023-12-03T11:50:34.846 INFO:teuthology.orchestra.run.smithi003.stdout: at-spi2-core x86_64 2.40.3-1.el9 CentOS-AppStream 176 k 2023-12-03T11:50:34.847 INFO:teuthology.orchestra.run.smithi003.stdout: atk x86_64 2.36.0-5.el9 CentOS-AppStream 270 k 2023-12-03T11:50:34.847 INFO:teuthology.orchestra.run.smithi003.stdout: avahi-glib x86_64 0.8-12.el9 appstream 15 k 2023-12-03T11:50:34.847 INFO:teuthology.orchestra.run.smithi003.stdout: bluez-libs x86_64 5.64-1.el9 CentOS-BaseOS 83 k 2023-12-03T11:50:34.847 INFO:teuthology.orchestra.run.smithi003.stdout: bubblewrap x86_64 0.4.1-6.el9 CentOS-BaseOS 49 k 2023-12-03T11:50:34.847 INFO:teuthology.orchestra.run.smithi003.stdout: colord-libs x86_64 1.4.5-4.el9 CentOS-AppStream 228 k 2023-12-03T11:50:34.847 INFO:teuthology.orchestra.run.smithi003.stdout: copy-jdk-configs noarch 4.0-3.el9 CentOS-AppStream 27 k 2023-12-03T11:50:34.847 INFO:teuthology.orchestra.run.smithi003.stdout: cups-libs x86_64 1:2.3.3op2-22.el9 CentOS-BaseOS 262 k 2023-12-03T11:50:34.847 INFO:teuthology.orchestra.run.smithi003.stdout: exempi x86_64 2.6.0-0.2.20211007gite23c213.el9 CentOS-AppStream 524 k 2023-12-03T11:50:34.847 INFO:teuthology.orchestra.run.smithi003.stdout: exiv2-libs x86_64 0.27.5-2.el9 CentOS-AppStream 780 k 2023-12-03T11:50:34.847 INFO:teuthology.orchestra.run.smithi003.stdout: fdk-aac-free x86_64 2.0.0-8.el9 CentOS-AppStream 324 k 2023-12-03T11:50:34.847 INFO:teuthology.orchestra.run.smithi003.stdout: flac-libs x86_64 1.3.3-12.el9 appstream 218 k 2023-12-03T11:50:34.847 INFO:teuthology.orchestra.run.smithi003.stdout: flatpak-selinux noarch 1.12.8-1.el9 CentOS-AppStream 20 k 2023-12-03T11:50:34.847 INFO:teuthology.orchestra.run.smithi003.stdout: flatpak-session-helper x86_64 1.12.8-1.el9 CentOS-AppStream 73 k 2023-12-03T11:50:34.847 INFO:teuthology.orchestra.run.smithi003.stdout: gdk-pixbuf2-modules x86_64 2.42.6-3.el9 CentOS-AppStream 84 k 2023-12-03T11:50:34.848 INFO:teuthology.orchestra.run.smithi003.stdout: geoclue2 x86_64 2.6.0-7.el9 CentOS-AppStream 122 k 2023-12-03T11:50:34.848 INFO:teuthology.orchestra.run.smithi003.stdout: giflib x86_64 5.2.1-9.el9 CentOS-AppStream 47 k 2023-12-03T11:50:34.848 INFO:teuthology.orchestra.run.smithi003.stdout: graphene x86_64 1.10.6-2.el9 CentOS-AppStream 63 k 2023-12-03T11:50:34.848 INFO:teuthology.orchestra.run.smithi003.stdout: gsm x86_64 1.0.19-6.el9 CentOS-AppStream 33 k 2023-12-03T11:50:34.848 INFO:teuthology.orchestra.run.smithi003.stdout: gstreamer1 x86_64 1.22.1-2.el9 CentOS-AppStream 1.4 M 2023-12-03T11:50:34.848 INFO:teuthology.orchestra.run.smithi003.stdout: gstreamer1-plugins-base x86_64 1.22.1-1.el9 CentOS-AppStream 2.2 M 2023-12-03T11:50:34.848 INFO:teuthology.orchestra.run.smithi003.stdout: gtk-update-icon-cache x86_64 3.24.31-2.el9 CentOS-AppStream 34 k 2023-12-03T11:50:34.848 INFO:teuthology.orchestra.run.smithi003.stdout: gtk3 x86_64 3.24.31-2.el9 CentOS-AppStream 4.8 M 2023-12-03T11:50:34.848 INFO:teuthology.orchestra.run.smithi003.stdout: hicolor-icon-theme noarch 0.17-13.el9 CentOS-AppStream 65 k 2023-12-03T11:50:34.848 INFO:teuthology.orchestra.run.smithi003.stdout: iso-codes noarch 4.6.0-3.el9 CentOS-AppStream 3.3 M 2023-12-03T11:50:34.848 INFO:teuthology.orchestra.run.smithi003.stdout: java-1.8.0-openjdk-headless x86_64 1:1.8.0.362.b09-4.el9 CentOS-AppStream 32 M 2023-12-03T11:50:34.848 INFO:teuthology.orchestra.run.smithi003.stdout: javapackages-filesystem noarch 6.0.0-4.el9 CentOS-AppStream 10 k 2023-12-03T11:50:34.848 INFO:teuthology.orchestra.run.smithi003.stdout: jbigkit-libs x86_64 2.1-23.el9 CentOS-AppStream 52 k 2023-12-03T11:50:34.848 INFO:teuthology.orchestra.run.smithi003.stdout: lcms2 x86_64 2.12-3.el9 CentOS-AppStream 166 k 2023-12-03T11:50:34.848 INFO:teuthology.orchestra.run.smithi003.stdout: libX11-xcb x86_64 1.7.0-8.el9 appstream 11 k 2023-12-03T11:50:34.849 INFO:teuthology.orchestra.run.smithi003.stdout: libXcomposite x86_64 0.4.5-7.el9 CentOS-AppStream 23 k 2023-12-03T11:50:34.849 INFO:teuthology.orchestra.run.smithi003.stdout: libXcursor x86_64 1.2.0-7.el9 CentOS-AppStream 30 k 2023-12-03T11:50:34.849 INFO:teuthology.orchestra.run.smithi003.stdout: libXdamage x86_64 1.1.5-7.el9 CentOS-AppStream 22 k 2023-12-03T11:50:34.849 INFO:teuthology.orchestra.run.smithi003.stdout: libXfixes x86_64 5.0.3-16.el9 CentOS-AppStream 19 k 2023-12-03T11:50:34.849 INFO:teuthology.orchestra.run.smithi003.stdout: libXi x86_64 1.7.10-8.el9 CentOS-AppStream 38 k 2023-12-03T11:50:34.849 INFO:teuthology.orchestra.run.smithi003.stdout: libXinerama x86_64 1.1.4-10.el9 CentOS-AppStream 14 k 2023-12-03T11:50:34.849 INFO:teuthology.orchestra.run.smithi003.stdout: libXrandr x86_64 1.5.2-8.el9 CentOS-AppStream 27 k 2023-12-03T11:50:34.849 INFO:teuthology.orchestra.run.smithi003.stdout: libXtst x86_64 1.2.3-16.el9 CentOS-AppStream 20 k 2023-12-03T11:50:34.849 INFO:teuthology.orchestra.run.smithi003.stdout: libXv x86_64 1.0.11-16.el9 CentOS-AppStream 18 k 2023-12-03T11:50:34.849 INFO:teuthology.orchestra.run.smithi003.stdout: libXxf86vm x86_64 1.1.4-18.el9 CentOS-AppStream 18 k 2023-12-03T11:50:34.849 INFO:teuthology.orchestra.run.smithi003.stdout: libasyncns x86_64 0.8-22.el9 CentOS-AppStream 29 k 2023-12-03T11:50:34.849 INFO:teuthology.orchestra.run.smithi003.stdout: libcanberra x86_64 0.30-27.el9 CentOS-AppStream 85 k 2023-12-03T11:50:34.849 INFO:teuthology.orchestra.run.smithi003.stdout: libcanberra-gtk3 x86_64 0.30-27.el9 CentOS-AppStream 31 k 2023-12-03T11:50:34.849 INFO:teuthology.orchestra.run.smithi003.stdout: libdrm x86_64 2.4.117-1.el9 CentOS-AppStream 158 k 2023-12-03T11:50:34.850 INFO:teuthology.orchestra.run.smithi003.stdout: libepoxy x86_64 1.5.5-4.el9 CentOS-AppStream 240 k 2023-12-03T11:50:34.850 INFO:teuthology.orchestra.run.smithi003.stdout: libexif x86_64 0.6.22-6.el9 CentOS-AppStream 431 k 2023-12-03T11:50:34.850 INFO:teuthology.orchestra.run.smithi003.stdout: libfontenc x86_64 1.1.3-17.el9 CentOS-AppStream 30 k 2023-12-03T11:50:34.850 INFO:teuthology.orchestra.run.smithi003.stdout: libgexiv2 x86_64 0.12.3-1.el9 CentOS-AppStream 82 k 2023-12-03T11:50:34.850 INFO:teuthology.orchestra.run.smithi003.stdout: libglvnd x86_64 1:1.3.4-1.el9 CentOS-AppStream 134 k 2023-12-03T11:50:34.850 INFO:teuthology.orchestra.run.smithi003.stdout: libglvnd-egl x86_64 1:1.3.4-1.el9 CentOS-AppStream 36 k 2023-12-03T11:50:34.850 INFO:teuthology.orchestra.run.smithi003.stdout: libglvnd-glx x86_64 1:1.3.4-1.el9 CentOS-AppStream 141 k 2023-12-03T11:50:34.850 INFO:teuthology.orchestra.run.smithi003.stdout: libgsf x86_64 1.14.47-5.el9 CentOS-AppStream 245 k 2023-12-03T11:50:34.850 INFO:teuthology.orchestra.run.smithi003.stdout: libgxps x86_64 0.3.2-3.el9 CentOS-AppStream 78 k 2023-12-03T11:50:34.850 INFO:teuthology.orchestra.run.smithi003.stdout: libiptcdata x86_64 1.0.5-9.el9 CentOS-AppStream 61 k 2023-12-03T11:50:34.850 INFO:teuthology.orchestra.run.smithi003.stdout: libldac x86_64 2.0.2.3-10.el9 CentOS-AppStream 40 k 2023-12-03T11:50:34.850 INFO:teuthology.orchestra.run.smithi003.stdout: libnotify x86_64 0.7.9-8.el9 CentOS-AppStream 43 k 2023-12-03T11:50:34.850 INFO:teuthology.orchestra.run.smithi003.stdout: libogg x86_64 2:1.3.4-6.el9 CentOS-AppStream 32 k 2023-12-03T11:50:34.850 INFO:teuthology.orchestra.run.smithi003.stdout: libosinfo x86_64 1.10.0-1.el9 CentOS-AppStream 312 k 2023-12-03T11:50:34.850 INFO:teuthology.orchestra.run.smithi003.stdout: libpciaccess x86_64 0.16-6.el9 CentOS-BaseOS 27 k 2023-12-03T11:50:34.851 INFO:teuthology.orchestra.run.smithi003.stdout: libsbc x86_64 1.4-9.el9 CentOS-AppStream 44 k 2023-12-03T11:50:34.851 INFO:teuthology.orchestra.run.smithi003.stdout: libsndfile x86_64 1.0.31-8.el9 CentOS-AppStream 205 k 2023-12-03T11:50:34.851 INFO:teuthology.orchestra.run.smithi003.stdout: libtheora x86_64 1:1.1.1-31.el9 CentOS-AppStream 163 k 2023-12-03T11:50:34.851 INFO:teuthology.orchestra.run.smithi003.stdout: libtiff x86_64 4.4.0-10.el9 CentOS-AppStream 196 k 2023-12-03T11:50:34.851 INFO:teuthology.orchestra.run.smithi003.stdout: libtool-ltdl x86_64 2.4.6-45.el9 CentOS-AppStream 36 k 2023-12-03T11:50:34.851 INFO:teuthology.orchestra.run.smithi003.stdout: libtracker-sparql x86_64 3.1.2-3.el9 CentOS-AppStream 316 k 2023-12-03T11:50:34.851 INFO:teuthology.orchestra.run.smithi003.stdout: libvisual x86_64 1:0.4.0-34.el9 CentOS-AppStream 143 k 2023-12-03T11:50:34.851 INFO:teuthology.orchestra.run.smithi003.stdout: libvorbis x86_64 1:1.3.7-5.el9 CentOS-AppStream 192 k 2023-12-03T11:50:34.851 INFO:teuthology.orchestra.run.smithi003.stdout: libwayland-client x86_64 1.21.0-1.el9 CentOS-AppStream 32 k 2023-12-03T11:50:34.851 INFO:teuthology.orchestra.run.smithi003.stdout: libwayland-cursor x86_64 1.21.0-1.el9 CentOS-AppStream 18 k 2023-12-03T11:50:34.851 INFO:teuthology.orchestra.run.smithi003.stdout: libwayland-egl x86_64 1.21.0-1.el9 CentOS-AppStream 12 k 2023-12-03T11:50:34.852 INFO:teuthology.orchestra.run.smithi003.stdout: libwayland-server x86_64 1.21.0-1.el9 CentOS-AppStream 41 k 2023-12-03T11:50:34.852 INFO:teuthology.orchestra.run.smithi003.stdout: libwebp x86_64 1.2.0-8.el9 CentOS-AppStream 276 k 2023-12-03T11:50:34.852 INFO:teuthology.orchestra.run.smithi003.stdout: libxkbcommon x86_64 1.0.3-4.el9 CentOS-AppStream 132 k 2023-12-03T11:50:34.852 INFO:teuthology.orchestra.run.smithi003.stdout: libxshmfence x86_64 1.3-10.el9 CentOS-AppStream 12 k 2023-12-03T11:50:34.852 INFO:teuthology.orchestra.run.smithi003.stdout: lksctp-tools x86_64 1.0.19-2.el9 CentOS-BaseOS 90 k 2023-12-03T11:50:34.852 INFO:teuthology.orchestra.run.smithi003.stdout: low-memory-monitor x86_64 2.1-4.el9 CentOS-AppStream 35 k 2023-12-03T11:50:34.852 INFO:teuthology.orchestra.run.smithi003.stdout: lua-posix x86_64 35.0-8.el9 CentOS-AppStream 131 k 2023-12-03T11:50:34.852 INFO:teuthology.orchestra.run.smithi003.stdout: mesa-libEGL x86_64 23.3.0~rc2-1.el9 CentOS-AppStream 126 k 2023-12-03T11:50:34.852 INFO:teuthology.orchestra.run.smithi003.stdout: mesa-libGL x86_64 23.3.0~rc2-1.el9 CentOS-AppStream 167 k 2023-12-03T11:50:34.852 INFO:teuthology.orchestra.run.smithi003.stdout: mesa-libgbm x86_64 23.3.0~rc2-1.el9 CentOS-AppStream 36 k 2023-12-03T11:50:34.852 INFO:teuthology.orchestra.run.smithi003.stdout: mesa-libglapi x86_64 23.3.0~rc2-1.el9 CentOS-AppStream 44 k 2023-12-03T11:50:34.852 INFO:teuthology.orchestra.run.smithi003.stdout: mesa-vulkan-drivers x86_64 23.3.0~rc2-1.el9 CentOS-AppStream 9.7 M 2023-12-03T11:50:34.852 INFO:teuthology.orchestra.run.smithi003.stdout: mkfontscale x86_64 1.2.1-3.el9 CentOS-AppStream 31 k 2023-12-03T11:50:34.852 INFO:teuthology.orchestra.run.smithi003.stdout: openjpeg2 x86_64 2.4.0-7.el9 CentOS-AppStream 162 k 2023-12-03T11:50:34.852 INFO:teuthology.orchestra.run.smithi003.stdout: opus x86_64 1.3.1-10.el9 CentOS-AppStream 199 k 2023-12-03T11:50:34.853 INFO:teuthology.orchestra.run.smithi003.stdout: orc x86_64 0.4.31-6.el9 CentOS-AppStream 183 k 2023-12-03T11:50:34.853 INFO:teuthology.orchestra.run.smithi003.stdout: osinfo-db noarch 20230518-1.el9 CentOS-AppStream 273 k 2023-12-03T11:50:34.853 INFO:teuthology.orchestra.run.smithi003.stdout: osinfo-db-tools x86_64 1.10.0-1.el9 CentOS-AppStream 68 k 2023-12-03T11:50:34.853 INFO:teuthology.orchestra.run.smithi003.stdout: ostree-libs x86_64 2023.7-2.el9 CentOS-AppStream 477 k 2023-12-03T11:50:34.853 INFO:teuthology.orchestra.run.smithi003.stdout: pipewire-libs x86_64 0.3.67-2.el9 CentOS-AppStream 1.7 M 2023-12-03T11:50:34.853 INFO:teuthology.orchestra.run.smithi003.stdout: poppler x86_64 21.01.0-19.el9 CentOS-AppStream 1.1 M 2023-12-03T11:50:34.853 INFO:teuthology.orchestra.run.smithi003.stdout: poppler-data noarch 0.4.9-9.el9 CentOS-AppStream 1.8 M 2023-12-03T11:50:34.853 INFO:teuthology.orchestra.run.smithi003.stdout: poppler-glib x86_64 21.01.0-19.el9 CentOS-AppStream 151 k 2023-12-03T11:50:34.853 INFO:teuthology.orchestra.run.smithi003.stdout: pulseaudio-libs x86_64 15.0-2.el9 CentOS-AppStream 666 k 2023-12-03T11:50:34.853 INFO:teuthology.orchestra.run.smithi003.stdout: pulseaudio-utils x86_64 15.0-2.el9 CentOS-AppStream 72 k 2023-12-03T11:50:34.853 INFO:teuthology.orchestra.run.smithi003.stdout: rtkit x86_64 0.11-28.el9 CentOS-AppStream 55 k 2023-12-03T11:50:34.853 INFO:teuthology.orchestra.run.smithi003.stdout: sound-theme-freedesktop noarch 0.8-17.el9 CentOS-AppStream 377 k 2023-12-03T11:50:34.853 INFO:teuthology.orchestra.run.smithi003.stdout: totem-pl-parser x86_64 3.26.6-2.el9 CentOS-AppStream 130 k 2023-12-03T11:50:34.853 INFO:teuthology.orchestra.run.smithi003.stdout: ttmkfdir x86_64 3.0.9-65.el9 CentOS-AppStream 52 k 2023-12-03T11:50:34.853 INFO:teuthology.orchestra.run.smithi003.stdout: tzdata-java noarch 2023c-1.el9 CentOS-AppStream 149 k 2023-12-03T11:50:34.853 INFO:teuthology.orchestra.run.smithi003.stdout: upower x86_64 0.99.11-11.el9 CentOS-AppStream 168 k 2023-12-03T11:50:34.854 INFO:teuthology.orchestra.run.smithi003.stdout: vulkan-loader x86_64 1.3.250.1-1.el9 CentOS-AppStream 140 k 2023-12-03T11:50:34.854 INFO:teuthology.orchestra.run.smithi003.stdout: webrtc-audio-processing x86_64 0.3.1-8.el9 CentOS-AppStream 305 k 2023-12-03T11:50:34.854 INFO:teuthology.orchestra.run.smithi003.stdout: wireplumber x86_64 0.4.14-1.el9 CentOS-AppStream 83 k 2023-12-03T11:50:34.854 INFO:teuthology.orchestra.run.smithi003.stdout: wireplumber-libs x86_64 0.4.14-1.el9 CentOS-AppStream 337 k 2023-12-03T11:50:34.854 INFO:teuthology.orchestra.run.smithi003.stdout: xdg-dbus-proxy x86_64 0.1.3-1.el9 CentOS-AppStream 41 k 2023-12-03T11:50:34.854 INFO:teuthology.orchestra.run.smithi003.stdout: xdg-desktop-portal x86_64 1.12.4-1.el9 CentOS-AppStream 365 k 2023-12-03T11:50:34.854 INFO:teuthology.orchestra.run.smithi003.stdout: xkeyboard-config noarch 2.33-2.el9 CentOS-AppStream 780 k 2023-12-03T11:50:34.854 INFO:teuthology.orchestra.run.smithi003.stdout: xorg-x11-fonts-Type1 noarch 7.5-33.el9 CentOS-AppStream 499 k 2023-12-03T11:50:34.854 INFO:teuthology.orchestra.run.smithi003.stdout:Installing weak dependencies: 2023-12-03T11:50:34.855 INFO:teuthology.orchestra.run.smithi003.stdout: dconf x86_64 0.40.0-6.el9 CentOS-AppStream 108 k 2023-12-03T11:50:34.855 INFO:teuthology.orchestra.run.smithi003.stdout: exiv2 x86_64 0.27.5-2.el9 CentOS-AppStream 978 k 2023-12-03T11:50:34.855 INFO:teuthology.orchestra.run.smithi003.stdout: flatpak x86_64 1.12.8-1.el9 CentOS-AppStream 1.7 M 2023-12-03T11:50:34.855 INFO:teuthology.orchestra.run.smithi003.stdout: gtk2 x86_64 2.24.33-8.el9 CentOS-AppStream 3.5 M 2023-12-03T11:50:34.855 INFO:teuthology.orchestra.run.smithi003.stdout: libcanberra-gtk2 x86_64 0.30-27.el9 CentOS-AppStream 25 k 2023-12-03T11:50:34.855 INFO:teuthology.orchestra.run.smithi003.stdout: p11-kit-server x86_64 0.24.1-2.el9 CentOS-AppStream 198 k 2023-12-03T11:50:34.856 INFO:teuthology.orchestra.run.smithi003.stdout: pipewire x86_64 0.3.67-2.el9 CentOS-AppStream 86 k 2023-12-03T11:50:34.856 INFO:teuthology.orchestra.run.smithi003.stdout: pipewire-alsa x86_64 0.3.67-2.el9 CentOS-AppStream 55 k 2023-12-03T11:50:34.856 INFO:teuthology.orchestra.run.smithi003.stdout: pipewire-jack-audio-connection-kit x86_64 0.3.67-2.el9 CentOS-AppStream 126 k 2023-12-03T11:50:34.856 INFO:teuthology.orchestra.run.smithi003.stdout: pipewire-pulseaudio x86_64 0.3.67-2.el9 CentOS-AppStream 18 k 2023-12-03T11:50:34.856 INFO:teuthology.orchestra.run.smithi003.stdout: tracker x86_64 3.1.2-3.el9 CentOS-AppStream 537 k 2023-12-03T11:50:34.856 INFO:teuthology.orchestra.run.smithi003.stdout: tracker-miners x86_64 3.1.2-3.el9 CentOS-AppStream 887 k 2023-12-03T11:50:34.856 INFO:teuthology.orchestra.run.smithi003.stdout: xdg-desktop-portal-gtk x86_64 1.12.0-3.el9 CentOS-AppStream 130 k 2023-12-03T11:50:34.856 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:50:34.856 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction Summary 2023-12-03T11:50:34.856 INFO:teuthology.orchestra.run.smithi003.stdout:====================================================================================================== 2023-12-03T11:50:34.856 INFO:teuthology.orchestra.run.smithi003.stdout:Install 129 Packages 2023-12-03T11:50:34.856 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:50:34.857 INFO:teuthology.orchestra.run.smithi003.stdout:Total download size: 102 M 2023-12-03T11:50:34.857 INFO:teuthology.orchestra.run.smithi003.stdout:Installed size: 381 M 2023-12-03T11:50:34.857 INFO:teuthology.orchestra.run.smithi003.stdout:Downloading Packages: 2023-12-03T11:50:35.460 INFO:teuthology.orchestra.run.smithi003.stdout:(1/129): adwaita-cursor-theme-40.1.1-3.el9.noar 1.3 MB/s | 625 kB 00:00 2023-12-03T11:50:35.485 INFO:teuthology.orchestra.run.smithi003.stdout:(2/129): alsa-lib-1.2.9-1.el9.x86_64.rpm 1.0 MB/s | 499 kB 00:00 2023-12-03T11:50:35.552 INFO:teuthology.orchestra.run.smithi003.stdout:(3/129): at-spi2-atk-2.38.0-4.el9.x86_64.rpm 935 kB/s | 86 kB 00:00 2023-12-03T11:50:35.627 INFO:teuthology.orchestra.run.smithi003.stdout:(4/129): at-spi2-core-2.40.3-1.el9.x86_64.rpm 1.2 MB/s | 176 kB 00:00 2023-12-03T11:50:35.736 INFO:teuthology.orchestra.run.smithi003.stdout:(5/129): atk-2.36.0-5.el9.x86_64.rpm 1.4 MB/s | 270 kB 00:00 2023-12-03T11:50:35.836 INFO:teuthology.orchestra.run.smithi003.stdout:(6/129): colord-libs-1.4.5-4.el9.x86_64.rpm 1.1 MB/s | 228 kB 00:00 2023-12-03T11:50:35.853 INFO:teuthology.orchestra.run.smithi003.stdout:(7/129): copy-jdk-configs-4.0-3.el9.noarch.rpm 232 kB/s | 27 kB 00:00 2023-12-03T11:50:35.936 INFO:teuthology.orchestra.run.smithi003.stdout:(8/129): dconf-0.40.0-6.el9.x86_64.rpm 1.1 MB/s | 108 kB 00:00 2023-12-03T11:50:36.070 INFO:teuthology.orchestra.run.smithi003.stdout:(9/129): exempi-2.6.0-0.2.20211007gite23c213.el 2.4 MB/s | 524 kB 00:00 2023-12-03T11:50:36.187 INFO:teuthology.orchestra.run.smithi003.stdout:(10/129): exiv2-0.27.5-2.el9.x86_64.rpm 3.8 MB/s | 978 kB 00:00 2023-12-03T11:50:36.254 INFO:teuthology.orchestra.run.smithi003.stdout:(11/129): exiv2-libs-0.27.5-2.el9.x86_64.rpm 4.2 MB/s | 780 kB 00:00 2023-12-03T11:50:36.279 INFO:teuthology.orchestra.run.smithi003.stdout:(12/129): fdk-aac-free-2.0.0-8.el9.x86_64.rpm 3.5 MB/s | 324 kB 00:00 2023-12-03T11:50:36.405 INFO:teuthology.orchestra.run.smithi003.stdout:(13/129): flatpak-1.12.8-1.el9.x86_64.rpm 11 MB/s | 1.7 MB 00:00 2023-12-03T11:50:36.430 INFO:teuthology.orchestra.run.smithi003.stdout:(14/129): flatpak-selinux-1.12.8-1.el9.noarch.r 136 kB/s | 20 kB 00:00 2023-12-03T11:50:36.455 INFO:teuthology.orchestra.run.smithi003.stdout:(15/129): flatpak-session-helper-1.12.8-1.el9.x 1.5 MB/s | 73 kB 00:00 2023-12-03T11:50:36.581 INFO:teuthology.orchestra.run.smithi003.stdout:(16/129): adwaita-icon-theme-40.1.1-3.el9.noarc 6.7 MB/s | 11 MB 00:01 2023-12-03T11:50:36.606 INFO:teuthology.orchestra.run.smithi003.stdout:(17/129): gdk-pixbuf2-modules-2.42.6-3.el9.x86_ 481 kB/s | 84 kB 00:00 2023-12-03T11:50:36.631 INFO:teuthology.orchestra.run.smithi003.stdout:(18/129): geoclue2-2.6.0-7.el9.x86_64.rpm 705 kB/s | 122 kB 00:00 2023-12-03T11:50:36.656 INFO:teuthology.orchestra.run.smithi003.stdout:(19/129): giflib-5.2.1-9.el9.x86_64.rpm 952 kB/s | 47 kB 00:00 2023-12-03T11:50:36.681 INFO:teuthology.orchestra.run.smithi003.stdout:(20/129): graphene-1.10.6-2.el9.x86_64.rpm 847 kB/s | 63 kB 00:00 2023-12-03T11:50:36.706 INFO:teuthology.orchestra.run.smithi003.stdout:(21/129): gsm-1.0.19-6.el9.x86_64.rpm 438 kB/s | 33 kB 00:00 2023-12-03T11:50:36.832 INFO:teuthology.orchestra.run.smithi003.stdout:(22/129): gstreamer1-1.22.1-2.el9.x86_64.rpm 9.4 MB/s | 1.4 MB 00:00 2023-12-03T11:50:36.857 INFO:teuthology.orchestra.run.smithi003.stdout:(23/129): gtk-update-icon-cache-3.24.31-2.el9.x 229 kB/s | 34 kB 00:00 2023-12-03T11:50:36.899 INFO:teuthology.orchestra.run.smithi003.stdout:(24/129): gstreamer1-plugins-base-1.22.1-1.el9. 10 MB/s | 2.2 MB 00:00 2023-12-03T11:50:37.008 INFO:teuthology.orchestra.run.smithi003.stdout:(25/129): gtk2-2.24.33-8.el9.x86_64.rpm 20 MB/s | 3.5 MB 00:00 2023-12-03T11:50:37.150 INFO:teuthology.orchestra.run.smithi003.stdout:(26/129): gtk3-3.24.31-2.el9.x86_64.rpm 17 MB/s | 4.8 MB 00:00 2023-12-03T11:50:37.176 INFO:teuthology.orchestra.run.smithi003.stdout:(27/129): hicolor-icon-theme-0.17-13.el9.noarch 239 kB/s | 65 kB 00:00 2023-12-03T11:50:37.234 INFO:teuthology.orchestra.run.smithi003.stdout:(28/129): iso-codes-4.6.0-3.el9.noarch.rpm 15 MB/s | 3.3 MB 00:00 2023-12-03T11:50:37.259 INFO:teuthology.orchestra.run.smithi003.stdout:(29/129): java-1.8.0-openjdk-1.8.0.362.b09-4.el 3.9 MB/s | 424 kB 00:00 2023-12-03T11:50:37.551 INFO:teuthology.orchestra.run.smithi003.stdout:(30/129): java-1.8.0-openjdk-devel-1.8.0.362.b0 25 MB/s | 9.3 MB 00:00 2023-12-03T11:50:37.568 INFO:teuthology.orchestra.run.smithi003.stdout:(31/129): javapackages-filesystem-6.0.0-4.el9.n 34 kB/s | 10 kB 00:00 2023-12-03T11:50:37.860 INFO:teuthology.orchestra.run.smithi003.stdout:(32/129): jbigkit-libs-2.1-23.el9.x86_64.rpm 168 kB/s | 52 kB 00:00 2023-12-03T11:50:37.885 INFO:teuthology.orchestra.run.smithi003.stdout:(33/129): lcms2-2.12-3.el9.x86_64.rpm 529 kB/s | 166 kB 00:00 2023-12-03T11:50:38.144 INFO:teuthology.orchestra.run.smithi003.stdout:(34/129): libXcomposite-0.4.5-7.el9.x86_64.rpm 81 kB/s | 23 kB 00:00 2023-12-03T11:50:38.219 INFO:teuthology.orchestra.run.smithi003.stdout:(35/129): libXcursor-1.2.0-7.el9.x86_64.rpm 89 kB/s | 30 kB 00:00 2023-12-03T11:50:38.378 INFO:teuthology.orchestra.run.smithi003.stdout:(36/129): libXdamage-1.1.5-7.el9.x86_64.rpm 94 kB/s | 22 kB 00:00 2023-12-03T11:50:38.695 INFO:teuthology.orchestra.run.smithi003.stdout:(37/129): java-1.8.0-openjdk-headless-1.8.0.362 23 MB/s | 32 MB 00:01 2023-12-03T11:50:38.720 INFO:teuthology.orchestra.run.smithi003.stdout:(38/129): libXfixes-5.0.3-16.el9.x86_64.rpm 37 kB/s | 19 kB 00:00 2023-12-03T11:50:38.745 INFO:teuthology.orchestra.run.smithi003.stdout:(39/129): libXi-1.7.10-8.el9.x86_64.rpm 105 kB/s | 38 kB 00:00 2023-12-03T11:50:38.770 INFO:teuthology.orchestra.run.smithi003.stdout:(40/129): libXinerama-1.1.4-10.el9.x86_64.rpm 281 kB/s | 14 kB 00:00 2023-12-03T11:50:38.795 INFO:teuthology.orchestra.run.smithi003.stdout:(41/129): libXrandr-1.5.2-8.el9.x86_64.rpm 366 kB/s | 27 kB 00:00 2023-12-03T11:50:38.821 INFO:teuthology.orchestra.run.smithi003.stdout:(42/129): libXtst-1.2.3-16.el9.x86_64.rpm 271 kB/s | 20 kB 00:00 2023-12-03T11:50:38.846 INFO:teuthology.orchestra.run.smithi003.stdout:(43/129): libXv-1.0.11-16.el9.x86_64.rpm 359 kB/s | 18 kB 00:00 2023-12-03T11:50:38.871 INFO:teuthology.orchestra.run.smithi003.stdout:(44/129): libXxf86vm-1.1.4-18.el9.x86_64.rpm 235 kB/s | 18 kB 00:00 2023-12-03T11:50:38.897 INFO:teuthology.orchestra.run.smithi003.stdout:(45/129): libasyncns-0.8-22.el9.x86_64.rpm 389 kB/s | 29 kB 00:00 2023-12-03T11:50:38.922 INFO:teuthology.orchestra.run.smithi003.stdout:(46/129): libcanberra-0.30-27.el9.x86_64.rpm 1.7 MB/s | 85 kB 00:00 2023-12-03T11:50:38.947 INFO:teuthology.orchestra.run.smithi003.stdout:(47/129): libcanberra-gtk2-0.30-27.el9.x86_64.r 329 kB/s | 25 kB 00:00 2023-12-03T11:50:38.972 INFO:teuthology.orchestra.run.smithi003.stdout:(48/129): libcanberra-gtk3-0.30-27.el9.x86_64.r 407 kB/s | 31 kB 00:00 2023-12-03T11:50:38.998 INFO:teuthology.orchestra.run.smithi003.stdout:(49/129): libdrm-2.4.117-1.el9.x86_64.rpm 2.0 MB/s | 158 kB 00:00 2023-12-03T11:50:39.023 INFO:teuthology.orchestra.run.smithi003.stdout:(50/129): libepoxy-1.5.5-4.el9.x86_64.rpm 3.1 MB/s | 240 kB 00:00 2023-12-03T11:50:39.048 INFO:teuthology.orchestra.run.smithi003.stdout:(51/129): libexif-0.6.22-6.el9.x86_64.rpm 5.6 MB/s | 431 kB 00:00 2023-12-03T11:50:39.073 INFO:teuthology.orchestra.run.smithi003.stdout:(52/129): libfontenc-1.1.3-17.el9.x86_64.rpm 609 kB/s | 30 kB 00:00 2023-12-03T11:50:39.098 INFO:teuthology.orchestra.run.smithi003.stdout:(53/129): libgexiv2-0.12.3-1.el9.x86_64.rpm 1.1 MB/s | 82 kB 00:00 2023-12-03T11:50:39.124 INFO:teuthology.orchestra.run.smithi003.stdout:(54/129): libglvnd-1.3.4-1.el9.x86_64.rpm 1.8 MB/s | 134 kB 00:00 2023-12-03T11:50:39.149 INFO:teuthology.orchestra.run.smithi003.stdout:(55/129): libglvnd-egl-1.3.4-1.el9.x86_64.rpm 712 kB/s | 36 kB 00:00 2023-12-03T11:50:39.174 INFO:teuthology.orchestra.run.smithi003.stdout:(56/129): libglvnd-glx-1.3.4-1.el9.x86_64.rpm 1.8 MB/s | 141 kB 00:00 2023-12-03T11:50:39.200 INFO:teuthology.orchestra.run.smithi003.stdout:(57/129): libgsf-1.14.47-5.el9.x86_64.rpm 3.2 MB/s | 245 kB 00:00 2023-12-03T11:50:39.233 INFO:teuthology.orchestra.run.smithi003.stdout:(58/129): libgxps-0.3.2-3.el9.x86_64.rpm 1.3 MB/s | 78 kB 00:00 2023-12-03T11:50:39.250 INFO:teuthology.orchestra.run.smithi003.stdout:(59/129): libiptcdata-1.0.5-9.el9.x86_64.rpm 811 kB/s | 61 kB 00:00 2023-12-03T11:50:39.267 INFO:teuthology.orchestra.run.smithi003.stdout:(60/129): libldac-2.0.2.3-10.el9.x86_64.rpm 601 kB/s | 40 kB 00:00 2023-12-03T11:50:39.284 INFO:teuthology.orchestra.run.smithi003.stdout:(61/129): libnotify-0.7.9-8.el9.x86_64.rpm 1.2 MB/s | 43 kB 00:00 2023-12-03T11:50:39.301 INFO:teuthology.orchestra.run.smithi003.stdout:(62/129): libogg-1.3.4-6.el9.x86_64.rpm 648 kB/s | 32 kB 00:00 2023-12-03T11:50:39.327 INFO:teuthology.orchestra.run.smithi003.stdout:(63/129): libosinfo-1.10.0-1.el9.x86_64.rpm 5.2 MB/s | 312 kB 00:00 2023-12-03T11:50:39.343 INFO:teuthology.orchestra.run.smithi003.stdout:(64/129): libsbc-1.4-9.el9.x86_64.rpm 1.0 MB/s | 44 kB 00:00 2023-12-03T11:50:39.368 INFO:teuthology.orchestra.run.smithi003.stdout:(65/129): libsndfile-1.0.31-8.el9.x86_64.rpm 3.0 MB/s | 205 kB 00:00 2023-12-03T11:50:39.394 INFO:teuthology.orchestra.run.smithi003.stdout:(66/129): libtheora-1.1.1-31.el9.x86_64.rpm 2.4 MB/s | 163 kB 00:00 2023-12-03T11:50:39.453 INFO:teuthology.orchestra.run.smithi003.stdout:(67/129): libtiff-4.4.0-10.el9.x86_64.rpm 2.3 MB/s | 196 kB 00:00 2023-12-03T11:50:39.478 INFO:teuthology.orchestra.run.smithi003.stdout:(68/129): libtool-ltdl-2.4.6-45.el9.x86_64.rpm 333 kB/s | 36 kB 00:00 2023-12-03T11:50:39.503 INFO:teuthology.orchestra.run.smithi003.stdout:(69/129): libtracker-sparql-3.1.2-3.el9.x86_64. 2.9 MB/s | 316 kB 00:00 2023-12-03T11:50:39.528 INFO:teuthology.orchestra.run.smithi003.stdout:(70/129): libvisual-0.4.0-34.el9.x86_64.rpm 2.8 MB/s | 143 kB 00:00 2023-12-03T11:50:39.553 INFO:teuthology.orchestra.run.smithi003.stdout:(71/129): libvorbis-1.3.7-5.el9.x86_64.rpm 2.5 MB/s | 192 kB 00:00 2023-12-03T11:50:39.579 INFO:teuthology.orchestra.run.smithi003.stdout:(72/129): libwayland-client-1.21.0-1.el9.x86_64 432 kB/s | 32 kB 00:00 2023-12-03T11:50:39.604 INFO:teuthology.orchestra.run.smithi003.stdout:(73/129): libwayland-cursor-1.21.0-1.el9.x86_64 367 kB/s | 18 kB 00:00 2023-12-03T11:50:39.629 INFO:teuthology.orchestra.run.smithi003.stdout:(74/129): libwayland-egl-1.21.0-1.el9.x86_64.rp 157 kB/s | 12 kB 00:00 2023-12-03T11:50:39.654 INFO:teuthology.orchestra.run.smithi003.stdout:(75/129): libwayland-server-1.21.0-1.el9.x86_64 542 kB/s | 41 kB 00:00 2023-12-03T11:50:39.679 INFO:teuthology.orchestra.run.smithi003.stdout:(76/129): libwebp-1.2.0-8.el9.x86_64.rpm 5.4 MB/s | 276 kB 00:00 2023-12-03T11:50:39.705 INFO:teuthology.orchestra.run.smithi003.stdout:(77/129): libxkbcommon-1.0.3-4.el9.x86_64.rpm 1.7 MB/s | 132 kB 00:00 2023-12-03T11:50:39.730 INFO:teuthology.orchestra.run.smithi003.stdout:(78/129): libxshmfence-1.3-10.el9.x86_64.rpm 154 kB/s | 12 kB 00:00 2023-12-03T11:50:39.755 INFO:teuthology.orchestra.run.smithi003.stdout:(79/129): low-memory-monitor-2.1-4.el9.x86_64.r 697 kB/s | 35 kB 00:00 2023-12-03T11:50:39.781 INFO:teuthology.orchestra.run.smithi003.stdout:(80/129): lua-posix-35.0-8.el9.x86_64.rpm 1.7 MB/s | 131 kB 00:00 2023-12-03T11:50:39.806 INFO:teuthology.orchestra.run.smithi003.stdout:(81/129): mesa-libEGL-23.3.0~rc2-1.el9.x86_64.r 1.6 MB/s | 126 kB 00:00 2023-12-03T11:50:39.831 INFO:teuthology.orchestra.run.smithi003.stdout:(82/129): mesa-libgbm-23.3.0~rc2-1.el9.x86_64.r 732 kB/s | 36 kB 00:00 2023-12-03T11:50:39.856 INFO:teuthology.orchestra.run.smithi003.stdout:(83/129): mesa-libGL-23.3.0~rc2-1.el9.x86_64.rp 2.2 MB/s | 167 kB 00:00 2023-12-03T11:50:39.882 INFO:teuthology.orchestra.run.smithi003.stdout:(84/129): mesa-libglapi-23.3.0~rc2-1.el9.x86_64 582 kB/s | 44 kB 00:00 2023-12-03T11:50:40.174 INFO:teuthology.orchestra.run.smithi003.stdout:(85/129): mesa-vulkan-drivers-23.3.0~rc2-1.el9. 28 MB/s | 9.7 MB 00:00 2023-12-03T11:50:40.199 INFO:teuthology.orchestra.run.smithi003.stdout:(86/129): mkfontscale-1.2.1-3.el9.x86_64.rpm 99 kB/s | 31 kB 00:00 2023-12-03T11:50:40.224 INFO:teuthology.orchestra.run.smithi003.stdout:(87/129): openjpeg2-2.4.0-7.el9.x86_64.rpm 479 kB/s | 162 kB 00:00 2023-12-03T11:50:40.249 INFO:teuthology.orchestra.run.smithi003.stdout:(88/129): opus-1.3.1-10.el9.x86_64.rpm 2.6 MB/s | 199 kB 00:00 2023-12-03T11:50:40.274 INFO:teuthology.orchestra.run.smithi003.stdout:(89/129): osinfo-db-20230518-1.el9.noarch.rpm 5.4 MB/s | 273 kB 00:00 2023-12-03T11:50:40.300 INFO:teuthology.orchestra.run.smithi003.stdout:(90/129): orc-0.4.31-6.el9.x86_64.rpm 2.4 MB/s | 183 kB 00:00 2023-12-03T11:50:40.325 INFO:teuthology.orchestra.run.smithi003.stdout:(91/129): osinfo-db-tools-1.10.0-1.el9.x86_64.r 904 kB/s | 68 kB 00:00 2023-12-03T11:50:40.351 INFO:teuthology.orchestra.run.smithi003.stdout:(92/129): ostree-libs-2023.7-2.el9.x86_64.rpm 6.2 MB/s | 477 kB 00:00 2023-12-03T11:50:40.376 INFO:teuthology.orchestra.run.smithi003.stdout:(93/129): pipewire-0.3.67-2.el9.x86_64.rpm 1.7 MB/s | 86 kB 00:00 2023-12-03T11:50:40.401 INFO:teuthology.orchestra.run.smithi003.stdout:(94/129): p11-kit-server-0.24.1-2.el9.x86_64.rp 2.6 MB/s | 198 kB 00:00 2023-12-03T11:50:40.426 INFO:teuthology.orchestra.run.smithi003.stdout:(95/129): pipewire-alsa-0.3.67-2.el9.x86_64.rpm 726 kB/s | 55 kB 00:00 2023-12-03T11:50:40.452 INFO:teuthology.orchestra.run.smithi003.stdout:(96/129): pipewire-jack-audio-connection-kit-0. 1.6 MB/s | 126 kB 00:00 2023-12-03T11:50:40.477 INFO:teuthology.orchestra.run.smithi003.stdout:(97/129): pipewire-pulseaudio-0.3.67-2.el9.x86_ 359 kB/s | 18 kB 00:00 2023-12-03T11:50:40.536 INFO:teuthology.orchestra.run.smithi003.stdout:(98/129): pipewire-libs-0.3.67-2.el9.x86_64.rpm 16 MB/s | 1.7 MB 00:00 2023-12-03T11:50:40.569 INFO:teuthology.orchestra.run.smithi003.stdout:(99/129): poppler-21.01.0-19.el9.x86_64.rpm 9.1 MB/s | 1.1 MB 00:00 2023-12-03T11:50:40.611 INFO:teuthology.orchestra.run.smithi003.stdout:(100/129): poppler-data-0.4.9-9.el9.noarch.rpm 14 MB/s | 1.8 MB 00:00 2023-12-03T11:50:40.636 INFO:teuthology.orchestra.run.smithi003.stdout:(101/129): poppler-glib-21.01.0-19.el9.x86_64.r 1.5 MB/s | 151 kB 00:00 2023-12-03T11:50:40.662 INFO:teuthology.orchestra.run.smithi003.stdout:(102/129): pulseaudio-libs-15.0-2.el9.x86_64.rp 7.2 MB/s | 666 kB 00:00 2023-12-03T11:50:40.687 INFO:teuthology.orchestra.run.smithi003.stdout:(103/129): pulseaudio-utils-15.0-2.el9.x86_64.r 971 kB/s | 72 kB 00:00 2023-12-03T11:50:40.737 INFO:teuthology.orchestra.run.smithi003.stdout:(104/129): rtkit-0.11-28.el9.x86_64.rpm 730 kB/s | 55 kB 00:00 2023-12-03T11:50:40.762 INFO:teuthology.orchestra.run.smithi003.stdout:(105/129): sound-theme-freedesktop-0.8-17.el9.n 3.7 MB/s | 377 kB 00:00 2023-12-03T11:50:40.787 INFO:teuthology.orchestra.run.smithi003.stdout:(106/129): totem-pl-parser-3.26.6-2.el9.x86_64. 1.3 MB/s | 130 kB 00:00 2023-12-03T11:50:40.838 INFO:teuthology.orchestra.run.smithi003.stdout:(107/129): tracker-3.1.2-3.el9.x86_64.rpm 7.0 MB/s | 537 kB 00:00 2023-12-03T11:50:40.872 INFO:teuthology.orchestra.run.smithi003.stdout:(108/129): tracker-miners-3.1.2-3.el9.x86_64.rp 8.0 MB/s | 887 kB 00:00 2023-12-03T11:50:40.897 INFO:teuthology.orchestra.run.smithi003.stdout:(109/129): ttmkfdir-3.0.9-65.el9.x86_64.rpm 481 kB/s | 52 kB 00:00 2023-12-03T11:50:40.922 INFO:teuthology.orchestra.run.smithi003.stdout:(110/129): tzdata-java-2023c-1.el9.noarch.rpm 1.8 MB/s | 149 kB 00:00 2023-12-03T11:50:40.947 INFO:teuthology.orchestra.run.smithi003.stdout:(111/129): vulkan-loader-1.3.250.1-1.el9.x86_64 2.8 MB/s | 140 kB 00:00 2023-12-03T11:50:40.973 INFO:teuthology.orchestra.run.smithi003.stdout:(112/129): upower-0.99.11-11.el9.x86_64.rpm 2.2 MB/s | 168 kB 00:00 2023-12-03T11:50:40.998 INFO:teuthology.orchestra.run.smithi003.stdout:(113/129): webrtc-audio-processing-0.3.1-8.el9. 4.0 MB/s | 305 kB 00:00 2023-12-03T11:50:41.023 INFO:teuthology.orchestra.run.smithi003.stdout:(114/129): wireplumber-0.4.14-1.el9.x86_64.rpm 1.1 MB/s | 83 kB 00:00 2023-12-03T11:50:41.048 INFO:teuthology.orchestra.run.smithi003.stdout:(115/129): wireplumber-libs-0.4.14-1.el9.x86_64 4.4 MB/s | 337 kB 00:00 2023-12-03T11:50:41.073 INFO:teuthology.orchestra.run.smithi003.stdout:(116/129): xdg-dbus-proxy-0.1.3-1.el9.x86_64.rp 839 kB/s | 41 kB 00:00 2023-12-03T11:50:41.098 INFO:teuthology.orchestra.run.smithi003.stdout:(117/129): xdg-desktop-portal-1.12.4-1.el9.x86_ 4.8 MB/s | 365 kB 00:00 2023-12-03T11:50:41.124 INFO:teuthology.orchestra.run.smithi003.stdout:(118/129): xdg-desktop-portal-gtk-1.12.0-3.el9. 1.7 MB/s | 130 kB 00:00 2023-12-03T11:50:41.166 INFO:teuthology.orchestra.run.smithi003.stdout:(119/129): xkeyboard-config-2.33-2.el9.noarch.r 8.3 MB/s | 780 kB 00:00 2023-12-03T11:50:41.200 INFO:teuthology.orchestra.run.smithi003.stdout:(120/129): xorg-x11-fonts-Type1-7.5-33.el9.noar 4.8 MB/s | 499 kB 00:00 2023-12-03T11:50:41.225 INFO:teuthology.orchestra.run.smithi003.stdout:(121/129): ModemManager-glib-1.20.2-1.el9.x86_6 3.3 MB/s | 334 kB 00:00 2023-12-03T11:50:41.250 INFO:teuthology.orchestra.run.smithi003.stdout:(122/129): bluez-libs-5.64-1.el9.x86_64.rpm 999 kB/s | 83 kB 00:00 2023-12-03T11:50:41.275 INFO:teuthology.orchestra.run.smithi003.stdout:(123/129): bubblewrap-0.4.1-6.el9.x86_64.rpm 654 kB/s | 49 kB 00:00 2023-12-03T11:50:41.301 INFO:teuthology.orchestra.run.smithi003.stdout:(124/129): cups-libs-2.3.3op2-22.el9.x86_64.rpm 3.4 MB/s | 262 kB 00:00 2023-12-03T11:50:41.326 INFO:teuthology.orchestra.run.smithi003.stdout:(125/129): libpciaccess-0.16-6.el9.x86_64.rpm 353 kB/s | 27 kB 00:00 2023-12-03T11:50:41.351 INFO:teuthology.orchestra.run.smithi003.stdout:(126/129): lksctp-tools-1.0.19-2.el9.x86_64.rpm 1.2 MB/s | 90 kB 00:00 2023-12-03T11:50:41.418 INFO:teuthology.orchestra.run.smithi003.stdout:(127/129): libX11-xcb-1.7.0-8.el9.x86_64.rpm 163 kB/s | 11 kB 00:00 2023-12-03T11:50:41.444 INFO:teuthology.orchestra.run.smithi003.stdout:(128/129): avahi-glib-0.8-12.el9.x86_64.rpm 127 kB/s | 15 kB 00:00 2023-12-03T11:50:41.510 INFO:teuthology.orchestra.run.smithi003.stdout:(129/129): flac-libs-1.3.3-12.el9.x86_64.rpm 1.2 MB/s | 218 kB 00:00 2023-12-03T11:50:41.513 INFO:teuthology.orchestra.run.smithi003.stdout:-------------------------------------------------------------------------------- 2023-12-03T11:50:41.513 INFO:teuthology.orchestra.run.smithi003.stdout:Total 15 MB/s | 102 MB 00:06 2023-12-03T11:50:41.549 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction check 2023-12-03T11:50:41.653 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction check succeeded. 2023-12-03T11:50:41.654 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction test 2023-12-03T11:50:42.679 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction test succeeded. 2023-12-03T11:50:42.679 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction 2023-12-03T11:50:46.868 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: copy-jdk-configs-4.0-3.el9.noarch 1/1 2023-12-03T11:50:46.935 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 1/1 2023-12-03T11:50:47.093 INFO:teuthology.orchestra.run.smithi003.stdout: Preparing : 1/1 2023-12-03T11:50:47.164 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libXi-1.7.10-8.el9.x86_64 1/129 2023-12-03T11:50:47.198 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libwayland-client-1.21.0-1.el9.x86_64 2/129 2023-12-03T11:50:47.237 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libogg-2:1.3.4-6.el9.x86_64 3/129 2023-12-03T11:50:47.275 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libvorbis-1:1.3.7-5.el9.x86_64 4/129 2023-12-03T11:50:47.412 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libXfixes-5.0.3-16.el9.x86_64 5/129 2023-12-03T11:50:47.490 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : atk-2.36.0-5.el9.x86_64 6/129 2023-12-03T11:50:47.529 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : alsa-lib-1.2.9-1.el9.x86_64 7/129 2023-12-03T11:50:47.559 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libX11-xcb-1.7.0-8.el9.x86_64 8/129 2023-12-03T11:50:47.590 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : cups-libs-1:2.3.3op2-22.el9.x86_64 9/129 2023-12-03T11:50:47.614 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : opus-1.3.1-10.el9.x86_64 10/129 2023-12-03T11:50:47.640 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libxshmfence-1.3-10.el9.x86_64 11/129 2023-12-03T11:50:47.667 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libtool-ltdl-2.4.6-45.el9.x86_64 12/129 2023-12-03T11:50:47.693 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libXcomposite-0.4.5-7.el9.x86_64 13/129 2023-12-03T11:50:47.784 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : lcms2-2.12-3.el9.x86_64 14/129 2023-12-03T11:50:47.839 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : gstreamer1-1.22.1-2.el9.x86_64 15/129 2023-12-03T11:50:47.872 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libXcursor-1.2.0-7.el9.x86_64 16/129 2023-12-03T11:50:47.905 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libXdamage-1.1.5-7.el9.x86_64 17/129 2023-12-03T11:50:47.930 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libwayland-cursor-1.21.0-1.el9.x86_64 18/129 2023-12-03T11:50:47.956 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libXtst-1.2.3-16.el9.x86_64 19/129 2023-12-03T11:50:47.981 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : mesa-libglapi-23.3.0~rc2-1.el9.x86_64 20/129 2023-12-03T11:50:48.007 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libwayland-server-1.21.0-1.el9.x86_64 21/129 2023-12-03T11:50:48.035 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libwayland-egl-1.21.0-1.el9.x86_64 22/129 2023-12-03T11:50:48.067 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libglvnd-1:1.3.4-1.el9.x86_64 23/129 2023-12-03T11:50:48.092 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libXrandr-1.5.2-8.el9.x86_64 24/129 2023-12-03T11:50:48.209 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libXinerama-1.1.4-10.el9.x86_64 25/129 2023-12-03T11:50:48.263 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : hicolor-icon-theme-0.17-13.el9.noarch 26/129 2023-12-03T11:50:48.316 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : gtk-update-icon-cache-3.24.31-2.el9.x86_64 27/129 2023-12-03T11:50:48.367 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : dconf-0.40.0-6.el9.x86_64 28/129 2023-12-03T11:50:48.431 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: dconf-0.40.0-6.el9.x86_64 28/129 2023-12-03T11:50:48.468 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : at-spi2-core-2.40.3-1.el9.x86_64 29/129 2023-12-03T11:50:48.505 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : at-spi2-atk-2.38.0-4.el9.x86_64 30/129 2023-12-03T11:50:48.536 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : colord-libs-1.4.5-4.el9.x86_64 31/129 2023-12-03T11:50:48.573 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libtheora-1:1.1.1-31.el9.x86_64 32/129 2023-12-03T11:50:48.613 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : flac-libs-1.3.3-12.el9.x86_64 33/129 2023-12-03T11:50:48.671 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : exiv2-libs-0.27.5-2.el9.x86_64 34/129 2023-12-03T11:50:48.706 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : exiv2-0.27.5-2.el9.x86_64 35/129 2023-12-03T11:50:48.736 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libgexiv2-0.12.3-1.el9.x86_64 36/129 2023-12-03T11:50:48.777 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : avahi-glib-0.8-12.el9.x86_64 37/129 2023-12-03T11:50:48.814 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 38/129 2023-12-03T11:50:48.844 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libpciaccess-0.16-6.el9.x86_64 39/129 2023-12-03T11:50:48.872 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libdrm-2.4.117-1.el9.x86_64 40/129 2023-12-03T11:50:48.898 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : mesa-libgbm-23.3.0~rc2-1.el9.x86_64 41/129 2023-12-03T11:50:48.925 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libglvnd-egl-1:1.3.4-1.el9.x86_64 42/129 2023-12-03T11:50:48.953 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : mesa-libEGL-23.3.0~rc2-1.el9.x86_64 43/129 2023-12-03T11:50:49.189 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : vulkan-loader-1.3.250.1-1.el9.x86_64 44/129 2023-12-03T11:50:49.228 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : mesa-vulkan-drivers-23.3.0~rc2-1.el9.x86_64 45/129 2023-12-03T11:50:49.253 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : bubblewrap-0.4.1-6.el9.x86_64 46/129 2023-12-03T11:50:49.284 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : bluez-libs-5.64-1.el9.x86_64 47/129 2023-12-03T11:50:49.490 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ModemManager-glib-1.20.2-1.el9.x86_64 48/129 2023-12-03T11:50:49.533 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : xkeyboard-config-2.33-2.el9.noarch 49/129 2023-12-03T11:50:49.565 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libxkbcommon-1.0.3-4.el9.x86_64 50/129 2023-12-03T11:50:49.595 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : xdg-dbus-proxy-0.1.3-1.el9.x86_64 51/129 2023-12-03T11:50:49.636 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : webrtc-audio-processing-0.3.1-8.el9.x86_64 52/129 2023-12-03T11:50:49.711 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : upower-0.99.11-11.el9.x86_64 53/129 2023-12-03T11:50:49.724 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: upower-0.99.11-11.el9.x86_64 53/129 2023-12-03T11:50:49.725 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/graphical.target.wants/upower.service → /usr/lib/systemd/system/upower.service. 2023-12-03T11:50:49.725 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:50:49.945 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : tzdata-java-2023c-1.el9.noarch 54/129 2023-12-03T11:50:50.014 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ttmkfdir-3.0.9-65.el9.x86_64 55/129 2023-12-03T11:50:50.074 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : totem-pl-parser-3.26.6-2.el9.x86_64 56/129 2023-12-03T11:50:50.097 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : sound-theme-freedesktop-0.8-17.el9.noarch 57/129 2023-12-03T11:50:50.104 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: sound-theme-freedesktop-0.8-17.el9.noarch 57/129 2023-12-03T11:50:50.480 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: rtkit-0.11-28.el9.x86_64 58/129 2023-12-03T11:50:50.511 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : rtkit-0.11-28.el9.x86_64 58/129 2023-12-03T11:50:50.525 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: rtkit-0.11-28.el9.x86_64 58/129 2023-12-03T11:50:50.525 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/graphical.target.wants/rtkit-daemon.service → /usr/lib/systemd/system/rtkit-daemon.service. 2023-12-03T11:50:50.525 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:50:50.737 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : poppler-data-0.4.9-9.el9.noarch 59/129 2023-12-03T11:50:50.770 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : p11-kit-server-0.24.1-2.el9.x86_64 60/129 2023-12-03T11:50:50.811 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ostree-libs-2023.7-2.el9.x86_64 61/129 2023-12-03T11:50:51.310 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : osinfo-db-tools-1.10.0-1.el9.x86_64 62/129 2023-12-03T11:50:51.365 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : osinfo-db-20230518-1.el9.noarch 63/129 2023-12-03T11:50:51.403 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libosinfo-1.10.0-1.el9.x86_64 64/129 2023-12-03T11:50:51.436 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : orc-0.4.31-6.el9.x86_64 65/129 2023-12-03T11:50:51.491 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : openjpeg2-2.4.0-7.el9.x86_64 66/129 2023-12-03T11:50:51.534 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : lua-posix-35.0-8.el9.x86_64 67/129 2023-12-03T11:50:51.562 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : copy-jdk-configs-4.0-3.el9.noarch 68/129 2023-12-03T11:50:51.583 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : low-memory-monitor-2.1-4.el9.x86_64 69/129 2023-12-03T11:50:51.595 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: low-memory-monitor-2.1-4.el9.x86_64 69/129 2023-12-03T11:50:51.595 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/basic.target.wants/low-memory-monitor.service → /usr/lib/systemd/system/low-memory-monitor.service. 2023-12-03T11:50:51.595 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:50:51.642 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libwebp-1.2.0-8.el9.x86_64 70/129 2023-12-03T11:50:51.671 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libvisual-1:0.4.0-34.el9.x86_64 71/129 2023-12-03T11:50:51.699 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libsbc-1.4-9.el9.x86_64 72/129 2023-12-03T11:50:51.728 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libnotify-0.7.9-8.el9.x86_64 73/129 2023-12-03T11:50:52.162 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: geoclue2-2.6.0-7.el9.x86_64 74/129 2023-12-03T11:50:52.199 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : geoclue2-2.6.0-7.el9.x86_64 74/129 2023-12-03T11:50:52.219 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: geoclue2-2.6.0-7.el9.x86_64 74/129 2023-12-03T11:50:52.266 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libldac-2.0.2.3-10.el9.x86_64 75/129 2023-12-03T11:50:52.337 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libiptcdata-1.0.5-9.el9.x86_64 76/129 2023-12-03T11:50:52.374 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libgsf-1.14.47-5.el9.x86_64 77/129 2023-12-03T11:50:52.399 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libfontenc-1.1.3-17.el9.x86_64 78/129 2023-12-03T11:50:52.444 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : mkfontscale-1.2.1-3.el9.x86_64 79/129 2023-12-03T11:50:52.480 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : xorg-x11-fonts-Type1-7.5-33.el9.noarch 80/129 2023-12-03T11:50:52.758 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: xorg-x11-fonts-Type1-7.5-33.el9.noarch 80/129 2023-12-03T11:50:52.807 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libexif-0.6.22-6.el9.x86_64 81/129 2023-12-03T11:50:52.835 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libepoxy-1.5.5-4.el9.x86_64 82/129 2023-12-03T11:50:52.861 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libasyncns-0.8-22.el9.x86_64 83/129 2023-12-03T11:50:52.889 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libXxf86vm-1.1.4-18.el9.x86_64 84/129 2023-12-03T11:50:52.921 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libglvnd-glx-1:1.3.4-1.el9.x86_64 85/129 2023-12-03T11:50:52.945 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : mesa-libGL-23.3.0~rc2-1.el9.x86_64 86/129 2023-12-03T11:50:52.973 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libXv-1.0.11-16.el9.x86_64 87/129 2023-12-03T11:50:53.010 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : jbigkit-libs-2.1-23.el9.x86_64 88/129 2023-12-03T11:50:53.047 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libtiff-4.4.0-10.el9.x86_64 89/129 2023-12-03T11:50:53.076 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : gdk-pixbuf2-modules-2.42.6-3.el9.x86_64 90/129 2023-12-03T11:50:53.125 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libgxps-0.3.2-3.el9.x86_64 91/129 2023-12-03T11:50:53.160 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : poppler-21.01.0-19.el9.x86_64 92/129 2023-12-03T11:50:53.193 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : poppler-glib-21.01.0-19.el9.x86_64 93/129 2023-12-03T11:50:53.818 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : javapackages-filesystem-6.0.0-4.el9.noarch 94/129 2023-12-03T11:50:53.854 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el 95/129 2023-12-03T11:50:54.536 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el 95/129 2023-12-03T11:50:54.590 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : iso-codes-4.6.0-3.el9.noarch 96/129 2023-12-03T11:50:54.617 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : gsm-1.0.19-6.el9.x86_64 97/129 2023-12-03T11:50:54.686 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libsndfile-1.0.31-8.el9.x86_64 98/129 2023-12-03T11:50:54.725 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : pulseaudio-libs-15.0-2.el9.x86_64 99/129 2023-12-03T11:50:54.749 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libcanberra-0.30-27.el9.x86_64 100/129 2023-12-03T11:50:54.774 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: libcanberra-0.30-27.el9.x86_64 100/129 2023-12-03T11:50:54.804 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : pulseaudio-utils-15.0-2.el9.x86_64 101/129 2023-12-03T11:50:54.916 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : graphene-1.10.6-2.el9.x86_64 102/129 2023-12-03T11:50:54.959 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : gstreamer1-plugins-base-1.22.1-1.el9.x86_64 103/129 2023-12-03T11:50:54.992 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : giflib-5.2.1-9.el9.x86_64 104/129 2023-12-03T11:50:55.024 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : flatpak-session-helper-1.12.8-1.el9.x86_64 105/129 2023-12-03T11:50:55.047 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : flatpak-selinux-1.12.8-1.el9.noarch 106/129 2023-12-03T11:51:05.598 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: flatpak-selinux-1.12.8-1.el9.noarch 106/129 2023-12-03T11:51:05.629 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : fdk-aac-free-2.0.0-8.el9.x86_64 107/129 2023-12-03T11:51:06.059 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: pipewire-0.3.67-2.el9.x86_64 108/129 2023-12-03T11:51:06.083 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : pipewire-0.3.67-2.el9.x86_64 108/129 2023-12-03T11:51:06.099 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: pipewire-0.3.67-2.el9.x86_64 108/129 2023-12-03T11:51:06.099 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/user/sockets.target.wants/pipewire.socket → /usr/lib/systemd/user/pipewire.socket. 2023-12-03T11:51:06.099 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:51:06.317 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : pipewire-libs-0.3.67-2.el9.x86_64 109/129 2023-12-03T11:51:06.386 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : wireplumber-0.4.14-1.el9.x86_64 110/129 2023-12-03T11:51:06.418 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : wireplumber-libs-0.4.14-1.el9.x86_64 111/129 2023-12-03T11:51:06.915 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: flatpak-1.12.8-1.el9.x86_64 112/129 2023-12-03T11:51:07.001 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : flatpak-1.12.8-1.el9.x86_64 112/129 2023-12-03T11:51:07.056 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : xdg-desktop-portal-1.12.4-1.el9.x86_64 113/129 2023-12-03T11:51:07.088 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: xdg-desktop-portal-1.12.4-1.el9.x86_64 113/129 2023-12-03T11:51:07.138 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 114/129 2023-12-03T11:51:07.215 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libtracker-sparql-3.1.2-3.el9.x86_64 115/129 2023-12-03T11:51:07.244 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : tracker-3.1.2-3.el9.x86_64 116/129 2023-12-03T11:51:07.354 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: tracker-3.1.2-3.el9.x86_64 116/129 2023-12-03T11:51:07.399 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : tracker-miners-3.1.2-3.el9.x86_64 117/129 2023-12-03T11:51:07.490 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: tracker-miners-3.1.2-3.el9.x86_64 117/129 2023-12-03T11:51:10.448 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : adwaita-cursor-theme-40.1.1-3.el9.noarch 118/129 2023-12-03T11:51:10.535 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : adwaita-icon-theme-40.1.1-3.el9.noarch 119/129 2023-12-03T11:51:10.578 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libcanberra-gtk3-0.30-27.el9.x86_64 120/129 2023-12-03T11:51:10.606 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 121/129 2023-12-03T11:51:10.791 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 121/129 2023-12-03T11:51:10.944 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : gtk3-3.24.31-2.el9.x86_64 122/129 2023-12-03T11:51:10.995 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : gtk2-2.24.33-8.el9.x86_64 123/129 2023-12-03T11:51:11.030 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libcanberra-gtk2-0.30-27.el9.x86_64 124/129 2023-12-03T11:51:11.052 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 125/129 2023-12-03T11:51:11.310 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 125/129 2023-12-03T11:51:11.349 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x 126/129 2023-12-03T11:51:11.360 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x 126/129 2023-12-03T11:51:11.406 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : pipewire-alsa-0.3.67-2.el9.x86_64 127/129 2023-12-03T11:51:11.437 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : pipewire-jack-audio-connection-kit-0.3.67-2.el9. 128/129 2023-12-03T11:51:11.459 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : pipewire-pulseaudio-0.3.67-2.el9.x86_64 129/129 2023-12-03T11:51:11.475 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: pipewire-pulseaudio-0.3.67-2.el9.x86_64 129/129 2023-12-03T11:51:11.475 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/user/sockets.target.wants/pipewire-pulse.socket → /usr/lib/systemd/user/pipewire-pulse.socket. 2023-12-03T11:51:11.475 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:51:11.493 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: dconf-0.40.0-6.el9.x86_64 129/129 2023-12-03T11:51:11.500 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: copy-jdk-configs-4.0-3.el9.noarch 129/129 2023-12-03T11:51:11.526 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el 129/129 2023-12-03T11:51:11.537 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: wireplumber-0.4.14-1.el9.x86_64 129/129 2023-12-03T11:51:11.537 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/user/pipewire-session-manager.service → /usr/lib/systemd/user/wireplumber.service. 2023-12-03T11:51:11.537 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/user/pipewire.service.wants/wireplumber.service → /usr/lib/systemd/user/wireplumber.service. 2023-12-03T11:51:11.537 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:51:11.614 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 129/129 2023-12-03T11:51:11.690 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x 129/129 2023-12-03T11:51:15.286 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: pipewire-pulseaudio-0.3.67-2.el9.x86_64 129/129 2023-12-03T11:51:15.286 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : adwaita-cursor-theme-40.1.1-3.el9.noarch 1/129 2023-12-03T11:51:15.286 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : adwaita-icon-theme-40.1.1-3.el9.noarch 2/129 2023-12-03T11:51:15.286 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : alsa-lib-1.2.9-1.el9.x86_64 3/129 2023-12-03T11:51:15.286 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : at-spi2-atk-2.38.0-4.el9.x86_64 4/129 2023-12-03T11:51:15.286 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : at-spi2-core-2.40.3-1.el9.x86_64 5/129 2023-12-03T11:51:15.286 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : atk-2.36.0-5.el9.x86_64 6/129 2023-12-03T11:51:15.286 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : colord-libs-1.4.5-4.el9.x86_64 7/129 2023-12-03T11:51:15.286 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : copy-jdk-configs-4.0-3.el9.noarch 8/129 2023-12-03T11:51:15.286 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : dconf-0.40.0-6.el9.x86_64 9/129 2023-12-03T11:51:15.286 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 10/129 2023-12-03T11:51:15.287 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : exiv2-0.27.5-2.el9.x86_64 11/129 2023-12-03T11:51:15.287 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : exiv2-libs-0.27.5-2.el9.x86_64 12/129 2023-12-03T11:51:15.287 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : fdk-aac-free-2.0.0-8.el9.x86_64 13/129 2023-12-03T11:51:15.287 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : flatpak-1.12.8-1.el9.x86_64 14/129 2023-12-03T11:51:15.287 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : flatpak-selinux-1.12.8-1.el9.noarch 15/129 2023-12-03T11:51:15.287 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : flatpak-session-helper-1.12.8-1.el9.x86_64 16/129 2023-12-03T11:51:15.287 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : gdk-pixbuf2-modules-2.42.6-3.el9.x86_64 17/129 2023-12-03T11:51:15.287 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : geoclue2-2.6.0-7.el9.x86_64 18/129 2023-12-03T11:51:15.287 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : giflib-5.2.1-9.el9.x86_64 19/129 2023-12-03T11:51:15.287 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : graphene-1.10.6-2.el9.x86_64 20/129 2023-12-03T11:51:15.287 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : gsm-1.0.19-6.el9.x86_64 21/129 2023-12-03T11:51:15.287 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : gstreamer1-1.22.1-2.el9.x86_64 22/129 2023-12-03T11:51:15.287 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : gstreamer1-plugins-base-1.22.1-1.el9.x86_64 23/129 2023-12-03T11:51:15.287 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : gtk-update-icon-cache-3.24.31-2.el9.x86_64 24/129 2023-12-03T11:51:15.288 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : gtk2-2.24.33-8.el9.x86_64 25/129 2023-12-03T11:51:15.288 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : gtk3-3.24.31-2.el9.x86_64 26/129 2023-12-03T11:51:15.288 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : hicolor-icon-theme-0.17-13.el9.noarch 27/129 2023-12-03T11:51:15.288 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : iso-codes-4.6.0-3.el9.noarch 28/129 2023-12-03T11:51:15.288 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 29/129 2023-12-03T11:51:15.288 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x 30/129 2023-12-03T11:51:15.288 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el 31/129 2023-12-03T11:51:15.288 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : javapackages-filesystem-6.0.0-4.el9.noarch 32/129 2023-12-03T11:51:15.288 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : jbigkit-libs-2.1-23.el9.x86_64 33/129 2023-12-03T11:51:15.288 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : lcms2-2.12-3.el9.x86_64 34/129 2023-12-03T11:51:15.288 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libXcomposite-0.4.5-7.el9.x86_64 35/129 2023-12-03T11:51:15.288 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libXcursor-1.2.0-7.el9.x86_64 36/129 2023-12-03T11:51:15.288 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libXdamage-1.1.5-7.el9.x86_64 37/129 2023-12-03T11:51:15.288 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libXfixes-5.0.3-16.el9.x86_64 38/129 2023-12-03T11:51:15.288 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libXi-1.7.10-8.el9.x86_64 39/129 2023-12-03T11:51:15.288 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libXinerama-1.1.4-10.el9.x86_64 40/129 2023-12-03T11:51:15.289 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libXrandr-1.5.2-8.el9.x86_64 41/129 2023-12-03T11:51:15.289 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libXtst-1.2.3-16.el9.x86_64 42/129 2023-12-03T11:51:15.289 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libXv-1.0.11-16.el9.x86_64 43/129 2023-12-03T11:51:15.289 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libXxf86vm-1.1.4-18.el9.x86_64 44/129 2023-12-03T11:51:15.289 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libasyncns-0.8-22.el9.x86_64 45/129 2023-12-03T11:51:15.289 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libcanberra-0.30-27.el9.x86_64 46/129 2023-12-03T11:51:15.289 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libcanberra-gtk2-0.30-27.el9.x86_64 47/129 2023-12-03T11:51:15.289 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libcanberra-gtk3-0.30-27.el9.x86_64 48/129 2023-12-03T11:51:15.289 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libdrm-2.4.117-1.el9.x86_64 49/129 2023-12-03T11:51:15.289 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libepoxy-1.5.5-4.el9.x86_64 50/129 2023-12-03T11:51:15.289 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libexif-0.6.22-6.el9.x86_64 51/129 2023-12-03T11:51:15.289 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libfontenc-1.1.3-17.el9.x86_64 52/129 2023-12-03T11:51:15.289 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libgexiv2-0.12.3-1.el9.x86_64 53/129 2023-12-03T11:51:15.289 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libglvnd-1:1.3.4-1.el9.x86_64 54/129 2023-12-03T11:51:15.289 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libglvnd-egl-1:1.3.4-1.el9.x86_64 55/129 2023-12-03T11:51:15.290 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libglvnd-glx-1:1.3.4-1.el9.x86_64 56/129 2023-12-03T11:51:15.290 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libgsf-1.14.47-5.el9.x86_64 57/129 2023-12-03T11:51:15.290 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libgxps-0.3.2-3.el9.x86_64 58/129 2023-12-03T11:51:15.290 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libiptcdata-1.0.5-9.el9.x86_64 59/129 2023-12-03T11:51:15.290 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libldac-2.0.2.3-10.el9.x86_64 60/129 2023-12-03T11:51:15.290 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libnotify-0.7.9-8.el9.x86_64 61/129 2023-12-03T11:51:15.290 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libogg-2:1.3.4-6.el9.x86_64 62/129 2023-12-03T11:51:15.290 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libosinfo-1.10.0-1.el9.x86_64 63/129 2023-12-03T11:51:15.290 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libsbc-1.4-9.el9.x86_64 64/129 2023-12-03T11:51:15.290 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libsndfile-1.0.31-8.el9.x86_64 65/129 2023-12-03T11:51:15.290 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libtheora-1:1.1.1-31.el9.x86_64 66/129 2023-12-03T11:51:15.290 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libtiff-4.4.0-10.el9.x86_64 67/129 2023-12-03T11:51:15.290 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libtool-ltdl-2.4.6-45.el9.x86_64 68/129 2023-12-03T11:51:15.290 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libtracker-sparql-3.1.2-3.el9.x86_64 69/129 2023-12-03T11:51:15.291 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libvisual-1:0.4.0-34.el9.x86_64 70/129 2023-12-03T11:51:15.291 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libvorbis-1:1.3.7-5.el9.x86_64 71/129 2023-12-03T11:51:15.291 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libwayland-client-1.21.0-1.el9.x86_64 72/129 2023-12-03T11:51:15.291 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libwayland-cursor-1.21.0-1.el9.x86_64 73/129 2023-12-03T11:51:15.291 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libwayland-egl-1.21.0-1.el9.x86_64 74/129 2023-12-03T11:51:15.291 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libwayland-server-1.21.0-1.el9.x86_64 75/129 2023-12-03T11:51:15.291 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libwebp-1.2.0-8.el9.x86_64 76/129 2023-12-03T11:51:15.291 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libxkbcommon-1.0.3-4.el9.x86_64 77/129 2023-12-03T11:51:15.291 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libxshmfence-1.3-10.el9.x86_64 78/129 2023-12-03T11:51:15.291 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : low-memory-monitor-2.1-4.el9.x86_64 79/129 2023-12-03T11:51:15.291 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : lua-posix-35.0-8.el9.x86_64 80/129 2023-12-03T11:51:15.291 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : mesa-libEGL-23.3.0~rc2-1.el9.x86_64 81/129 2023-12-03T11:51:15.291 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : mesa-libGL-23.3.0~rc2-1.el9.x86_64 82/129 2023-12-03T11:51:15.291 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : mesa-libgbm-23.3.0~rc2-1.el9.x86_64 83/129 2023-12-03T11:51:15.291 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : mesa-libglapi-23.3.0~rc2-1.el9.x86_64 84/129 2023-12-03T11:51:15.292 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : mesa-vulkan-drivers-23.3.0~rc2-1.el9.x86_64 85/129 2023-12-03T11:51:15.292 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : mkfontscale-1.2.1-3.el9.x86_64 86/129 2023-12-03T11:51:15.292 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : openjpeg2-2.4.0-7.el9.x86_64 87/129 2023-12-03T11:51:15.292 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : opus-1.3.1-10.el9.x86_64 88/129 2023-12-03T11:51:15.292 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : orc-0.4.31-6.el9.x86_64 89/129 2023-12-03T11:51:15.292 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : osinfo-db-20230518-1.el9.noarch 90/129 2023-12-03T11:51:15.292 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : osinfo-db-tools-1.10.0-1.el9.x86_64 91/129 2023-12-03T11:51:15.292 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ostree-libs-2023.7-2.el9.x86_64 92/129 2023-12-03T11:51:15.292 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : p11-kit-server-0.24.1-2.el9.x86_64 93/129 2023-12-03T11:51:15.292 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : pipewire-0.3.67-2.el9.x86_64 94/129 2023-12-03T11:51:15.292 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : pipewire-alsa-0.3.67-2.el9.x86_64 95/129 2023-12-03T11:51:15.292 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : pipewire-jack-audio-connection-kit-0.3.67-2.el9. 96/129 2023-12-03T11:51:15.292 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : pipewire-libs-0.3.67-2.el9.x86_64 97/129 2023-12-03T11:51:15.292 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : pipewire-pulseaudio-0.3.67-2.el9.x86_64 98/129 2023-12-03T11:51:15.292 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : poppler-21.01.0-19.el9.x86_64 99/129 2023-12-03T11:51:15.293 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : poppler-data-0.4.9-9.el9.noarch 100/129 2023-12-03T11:51:15.293 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : poppler-glib-21.01.0-19.el9.x86_64 101/129 2023-12-03T11:51:15.293 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : pulseaudio-libs-15.0-2.el9.x86_64 102/129 2023-12-03T11:51:15.293 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : pulseaudio-utils-15.0-2.el9.x86_64 103/129 2023-12-03T11:51:15.293 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : rtkit-0.11-28.el9.x86_64 104/129 2023-12-03T11:51:15.293 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : sound-theme-freedesktop-0.8-17.el9.noarch 105/129 2023-12-03T11:51:15.293 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : totem-pl-parser-3.26.6-2.el9.x86_64 106/129 2023-12-03T11:51:15.293 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : tracker-3.1.2-3.el9.x86_64 107/129 2023-12-03T11:51:15.293 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : tracker-miners-3.1.2-3.el9.x86_64 108/129 2023-12-03T11:51:15.293 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ttmkfdir-3.0.9-65.el9.x86_64 109/129 2023-12-03T11:51:15.293 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : tzdata-java-2023c-1.el9.noarch 110/129 2023-12-03T11:51:15.293 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : upower-0.99.11-11.el9.x86_64 111/129 2023-12-03T11:51:15.293 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : vulkan-loader-1.3.250.1-1.el9.x86_64 112/129 2023-12-03T11:51:15.293 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : webrtc-audio-processing-0.3.1-8.el9.x86_64 113/129 2023-12-03T11:51:15.293 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : wireplumber-0.4.14-1.el9.x86_64 114/129 2023-12-03T11:51:15.294 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : wireplumber-libs-0.4.14-1.el9.x86_64 115/129 2023-12-03T11:51:15.294 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : xdg-dbus-proxy-0.1.3-1.el9.x86_64 116/129 2023-12-03T11:51:15.294 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : xdg-desktop-portal-1.12.4-1.el9.x86_64 117/129 2023-12-03T11:51:15.294 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 118/129 2023-12-03T11:51:15.294 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : xkeyboard-config-2.33-2.el9.noarch 119/129 2023-12-03T11:51:15.294 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : xorg-x11-fonts-Type1-7.5-33.el9.noarch 120/129 2023-12-03T11:51:15.294 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ModemManager-glib-1.20.2-1.el9.x86_64 121/129 2023-12-03T11:51:15.294 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : bluez-libs-5.64-1.el9.x86_64 122/129 2023-12-03T11:51:15.294 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : bubblewrap-0.4.1-6.el9.x86_64 123/129 2023-12-03T11:51:15.294 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : cups-libs-1:2.3.3op2-22.el9.x86_64 124/129 2023-12-03T11:51:15.294 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libpciaccess-0.16-6.el9.x86_64 125/129 2023-12-03T11:51:15.294 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 126/129 2023-12-03T11:51:15.294 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : avahi-glib-0.8-12.el9.x86_64 127/129 2023-12-03T11:51:15.295 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : flac-libs-1.3.3-12.el9.x86_64 128/129 2023-12-03T11:51:17.555 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libX11-xcb-1.7.0-8.el9.x86_64 129/129 2023-12-03T11:51:17.555 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:51:17.556 INFO:teuthology.orchestra.run.smithi003.stdout:Installed: 2023-12-03T11:51:17.556 INFO:teuthology.orchestra.run.smithi003.stdout: ModemManager-glib-1.20.2-1.el9.x86_64 2023-12-03T11:51:17.556 INFO:teuthology.orchestra.run.smithi003.stdout: adwaita-cursor-theme-40.1.1-3.el9.noarch 2023-12-03T11:51:17.556 INFO:teuthology.orchestra.run.smithi003.stdout: adwaita-icon-theme-40.1.1-3.el9.noarch 2023-12-03T11:51:17.556 INFO:teuthology.orchestra.run.smithi003.stdout: alsa-lib-1.2.9-1.el9.x86_64 2023-12-03T11:51:17.556 INFO:teuthology.orchestra.run.smithi003.stdout: at-spi2-atk-2.38.0-4.el9.x86_64 2023-12-03T11:51:17.556 INFO:teuthology.orchestra.run.smithi003.stdout: at-spi2-core-2.40.3-1.el9.x86_64 2023-12-03T11:51:17.556 INFO:teuthology.orchestra.run.smithi003.stdout: atk-2.36.0-5.el9.x86_64 2023-12-03T11:51:17.556 INFO:teuthology.orchestra.run.smithi003.stdout: avahi-glib-0.8-12.el9.x86_64 2023-12-03T11:51:17.556 INFO:teuthology.orchestra.run.smithi003.stdout: bluez-libs-5.64-1.el9.x86_64 2023-12-03T11:51:17.557 INFO:teuthology.orchestra.run.smithi003.stdout: bubblewrap-0.4.1-6.el9.x86_64 2023-12-03T11:51:17.557 INFO:teuthology.orchestra.run.smithi003.stdout: colord-libs-1.4.5-4.el9.x86_64 2023-12-03T11:51:17.557 INFO:teuthology.orchestra.run.smithi003.stdout: copy-jdk-configs-4.0-3.el9.noarch 2023-12-03T11:51:17.557 INFO:teuthology.orchestra.run.smithi003.stdout: cups-libs-1:2.3.3op2-22.el9.x86_64 2023-12-03T11:51:17.557 INFO:teuthology.orchestra.run.smithi003.stdout: dconf-0.40.0-6.el9.x86_64 2023-12-03T11:51:17.557 INFO:teuthology.orchestra.run.smithi003.stdout: exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 2023-12-03T11:51:17.557 INFO:teuthology.orchestra.run.smithi003.stdout: exiv2-0.27.5-2.el9.x86_64 2023-12-03T11:51:17.557 INFO:teuthology.orchestra.run.smithi003.stdout: exiv2-libs-0.27.5-2.el9.x86_64 2023-12-03T11:51:17.557 INFO:teuthology.orchestra.run.smithi003.stdout: fdk-aac-free-2.0.0-8.el9.x86_64 2023-12-03T11:51:17.557 INFO:teuthology.orchestra.run.smithi003.stdout: flac-libs-1.3.3-12.el9.x86_64 2023-12-03T11:51:17.557 INFO:teuthology.orchestra.run.smithi003.stdout: flatpak-1.12.8-1.el9.x86_64 2023-12-03T11:51:17.557 INFO:teuthology.orchestra.run.smithi003.stdout: flatpak-selinux-1.12.8-1.el9.noarch 2023-12-03T11:51:17.557 INFO:teuthology.orchestra.run.smithi003.stdout: flatpak-session-helper-1.12.8-1.el9.x86_64 2023-12-03T11:51:17.557 INFO:teuthology.orchestra.run.smithi003.stdout: gdk-pixbuf2-modules-2.42.6-3.el9.x86_64 2023-12-03T11:51:17.557 INFO:teuthology.orchestra.run.smithi003.stdout: geoclue2-2.6.0-7.el9.x86_64 2023-12-03T11:51:17.558 INFO:teuthology.orchestra.run.smithi003.stdout: giflib-5.2.1-9.el9.x86_64 2023-12-03T11:51:17.558 INFO:teuthology.orchestra.run.smithi003.stdout: graphene-1.10.6-2.el9.x86_64 2023-12-03T11:51:17.558 INFO:teuthology.orchestra.run.smithi003.stdout: gsm-1.0.19-6.el9.x86_64 2023-12-03T11:51:17.558 INFO:teuthology.orchestra.run.smithi003.stdout: gstreamer1-1.22.1-2.el9.x86_64 2023-12-03T11:51:17.558 INFO:teuthology.orchestra.run.smithi003.stdout: gstreamer1-plugins-base-1.22.1-1.el9.x86_64 2023-12-03T11:51:17.558 INFO:teuthology.orchestra.run.smithi003.stdout: gtk-update-icon-cache-3.24.31-2.el9.x86_64 2023-12-03T11:51:17.558 INFO:teuthology.orchestra.run.smithi003.stdout: gtk2-2.24.33-8.el9.x86_64 2023-12-03T11:51:17.558 INFO:teuthology.orchestra.run.smithi003.stdout: gtk3-3.24.31-2.el9.x86_64 2023-12-03T11:51:17.558 INFO:teuthology.orchestra.run.smithi003.stdout: hicolor-icon-theme-0.17-13.el9.noarch 2023-12-03T11:51:17.558 INFO:teuthology.orchestra.run.smithi003.stdout: iso-codes-4.6.0-3.el9.noarch 2023-12-03T11:51:17.558 INFO:teuthology.orchestra.run.smithi003.stdout: java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 2023-12-03T11:51:17.558 INFO:teuthology.orchestra.run.smithi003.stdout: java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_64 2023-12-03T11:51:17.558 INFO:teuthology.orchestra.run.smithi003.stdout: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x86_64 2023-12-03T11:51:17.559 INFO:teuthology.orchestra.run.smithi003.stdout: javapackages-filesystem-6.0.0-4.el9.noarch 2023-12-03T11:51:17.559 INFO:teuthology.orchestra.run.smithi003.stdout: jbigkit-libs-2.1-23.el9.x86_64 2023-12-03T11:51:17.559 INFO:teuthology.orchestra.run.smithi003.stdout: lcms2-2.12-3.el9.x86_64 2023-12-03T11:51:17.559 INFO:teuthology.orchestra.run.smithi003.stdout: libX11-xcb-1.7.0-8.el9.x86_64 2023-12-03T11:51:17.559 INFO:teuthology.orchestra.run.smithi003.stdout: libXcomposite-0.4.5-7.el9.x86_64 2023-12-03T11:51:17.559 INFO:teuthology.orchestra.run.smithi003.stdout: libXcursor-1.2.0-7.el9.x86_64 2023-12-03T11:51:17.559 INFO:teuthology.orchestra.run.smithi003.stdout: libXdamage-1.1.5-7.el9.x86_64 2023-12-03T11:51:17.559 INFO:teuthology.orchestra.run.smithi003.stdout: libXfixes-5.0.3-16.el9.x86_64 2023-12-03T11:51:17.559 INFO:teuthology.orchestra.run.smithi003.stdout: libXi-1.7.10-8.el9.x86_64 2023-12-03T11:51:17.559 INFO:teuthology.orchestra.run.smithi003.stdout: libXinerama-1.1.4-10.el9.x86_64 2023-12-03T11:51:17.559 INFO:teuthology.orchestra.run.smithi003.stdout: libXrandr-1.5.2-8.el9.x86_64 2023-12-03T11:51:17.559 INFO:teuthology.orchestra.run.smithi003.stdout: libXtst-1.2.3-16.el9.x86_64 2023-12-03T11:51:17.559 INFO:teuthology.orchestra.run.smithi003.stdout: libXv-1.0.11-16.el9.x86_64 2023-12-03T11:51:17.559 INFO:teuthology.orchestra.run.smithi003.stdout: libXxf86vm-1.1.4-18.el9.x86_64 2023-12-03T11:51:17.560 INFO:teuthology.orchestra.run.smithi003.stdout: libasyncns-0.8-22.el9.x86_64 2023-12-03T11:51:17.560 INFO:teuthology.orchestra.run.smithi003.stdout: libcanberra-0.30-27.el9.x86_64 2023-12-03T11:51:17.560 INFO:teuthology.orchestra.run.smithi003.stdout: libcanberra-gtk2-0.30-27.el9.x86_64 2023-12-03T11:51:17.560 INFO:teuthology.orchestra.run.smithi003.stdout: libcanberra-gtk3-0.30-27.el9.x86_64 2023-12-03T11:51:17.560 INFO:teuthology.orchestra.run.smithi003.stdout: libdrm-2.4.117-1.el9.x86_64 2023-12-03T11:51:17.560 INFO:teuthology.orchestra.run.smithi003.stdout: libepoxy-1.5.5-4.el9.x86_64 2023-12-03T11:51:17.560 INFO:teuthology.orchestra.run.smithi003.stdout: libexif-0.6.22-6.el9.x86_64 2023-12-03T11:51:17.560 INFO:teuthology.orchestra.run.smithi003.stdout: libfontenc-1.1.3-17.el9.x86_64 2023-12-03T11:51:17.560 INFO:teuthology.orchestra.run.smithi003.stdout: libgexiv2-0.12.3-1.el9.x86_64 2023-12-03T11:51:17.560 INFO:teuthology.orchestra.run.smithi003.stdout: libglvnd-1:1.3.4-1.el9.x86_64 2023-12-03T11:51:17.560 INFO:teuthology.orchestra.run.smithi003.stdout: libglvnd-egl-1:1.3.4-1.el9.x86_64 2023-12-03T11:51:17.560 INFO:teuthology.orchestra.run.smithi003.stdout: libglvnd-glx-1:1.3.4-1.el9.x86_64 2023-12-03T11:51:17.560 INFO:teuthology.orchestra.run.smithi003.stdout: libgsf-1.14.47-5.el9.x86_64 2023-12-03T11:51:17.560 INFO:teuthology.orchestra.run.smithi003.stdout: libgxps-0.3.2-3.el9.x86_64 2023-12-03T11:51:17.560 INFO:teuthology.orchestra.run.smithi003.stdout: libiptcdata-1.0.5-9.el9.x86_64 2023-12-03T11:51:17.560 INFO:teuthology.orchestra.run.smithi003.stdout: libldac-2.0.2.3-10.el9.x86_64 2023-12-03T11:51:17.561 INFO:teuthology.orchestra.run.smithi003.stdout: libnotify-0.7.9-8.el9.x86_64 2023-12-03T11:51:17.561 INFO:teuthology.orchestra.run.smithi003.stdout: libogg-2:1.3.4-6.el9.x86_64 2023-12-03T11:51:17.561 INFO:teuthology.orchestra.run.smithi003.stdout: libosinfo-1.10.0-1.el9.x86_64 2023-12-03T11:51:17.561 INFO:teuthology.orchestra.run.smithi003.stdout: libpciaccess-0.16-6.el9.x86_64 2023-12-03T11:51:17.561 INFO:teuthology.orchestra.run.smithi003.stdout: libsbc-1.4-9.el9.x86_64 2023-12-03T11:51:17.561 INFO:teuthology.orchestra.run.smithi003.stdout: libsndfile-1.0.31-8.el9.x86_64 2023-12-03T11:51:17.561 INFO:teuthology.orchestra.run.smithi003.stdout: libtheora-1:1.1.1-31.el9.x86_64 2023-12-03T11:51:17.561 INFO:teuthology.orchestra.run.smithi003.stdout: libtiff-4.4.0-10.el9.x86_64 2023-12-03T11:51:17.561 INFO:teuthology.orchestra.run.smithi003.stdout: libtool-ltdl-2.4.6-45.el9.x86_64 2023-12-03T11:51:17.561 INFO:teuthology.orchestra.run.smithi003.stdout: libtracker-sparql-3.1.2-3.el9.x86_64 2023-12-03T11:51:17.561 INFO:teuthology.orchestra.run.smithi003.stdout: libvisual-1:0.4.0-34.el9.x86_64 2023-12-03T11:51:17.561 INFO:teuthology.orchestra.run.smithi003.stdout: libvorbis-1:1.3.7-5.el9.x86_64 2023-12-03T11:51:17.562 INFO:teuthology.orchestra.run.smithi003.stdout: libwayland-client-1.21.0-1.el9.x86_64 2023-12-03T11:51:17.562 INFO:teuthology.orchestra.run.smithi003.stdout: libwayland-cursor-1.21.0-1.el9.x86_64 2023-12-03T11:51:17.562 INFO:teuthology.orchestra.run.smithi003.stdout: libwayland-egl-1.21.0-1.el9.x86_64 2023-12-03T11:51:17.562 INFO:teuthology.orchestra.run.smithi003.stdout: libwayland-server-1.21.0-1.el9.x86_64 2023-12-03T11:51:17.562 INFO:teuthology.orchestra.run.smithi003.stdout: libwebp-1.2.0-8.el9.x86_64 2023-12-03T11:51:17.562 INFO:teuthology.orchestra.run.smithi003.stdout: libxkbcommon-1.0.3-4.el9.x86_64 2023-12-03T11:51:17.562 INFO:teuthology.orchestra.run.smithi003.stdout: libxshmfence-1.3-10.el9.x86_64 2023-12-03T11:51:17.562 INFO:teuthology.orchestra.run.smithi003.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2023-12-03T11:51:17.562 INFO:teuthology.orchestra.run.smithi003.stdout: low-memory-monitor-2.1-4.el9.x86_64 2023-12-03T11:51:17.562 INFO:teuthology.orchestra.run.smithi003.stdout: lua-posix-35.0-8.el9.x86_64 2023-12-03T11:51:17.562 INFO:teuthology.orchestra.run.smithi003.stdout: mesa-libEGL-23.3.0~rc2-1.el9.x86_64 2023-12-03T11:51:17.562 INFO:teuthology.orchestra.run.smithi003.stdout: mesa-libGL-23.3.0~rc2-1.el9.x86_64 2023-12-03T11:51:17.562 INFO:teuthology.orchestra.run.smithi003.stdout: mesa-libgbm-23.3.0~rc2-1.el9.x86_64 2023-12-03T11:51:17.563 INFO:teuthology.orchestra.run.smithi003.stdout: mesa-libglapi-23.3.0~rc2-1.el9.x86_64 2023-12-03T11:51:17.563 INFO:teuthology.orchestra.run.smithi003.stdout: mesa-vulkan-drivers-23.3.0~rc2-1.el9.x86_64 2023-12-03T11:51:17.563 INFO:teuthology.orchestra.run.smithi003.stdout: mkfontscale-1.2.1-3.el9.x86_64 2023-12-03T11:51:17.563 INFO:teuthology.orchestra.run.smithi003.stdout: openjpeg2-2.4.0-7.el9.x86_64 2023-12-03T11:51:17.563 INFO:teuthology.orchestra.run.smithi003.stdout: opus-1.3.1-10.el9.x86_64 2023-12-03T11:51:17.563 INFO:teuthology.orchestra.run.smithi003.stdout: orc-0.4.31-6.el9.x86_64 2023-12-03T11:51:17.563 INFO:teuthology.orchestra.run.smithi003.stdout: osinfo-db-20230518-1.el9.noarch 2023-12-03T11:51:17.563 INFO:teuthology.orchestra.run.smithi003.stdout: osinfo-db-tools-1.10.0-1.el9.x86_64 2023-12-03T11:51:17.563 INFO:teuthology.orchestra.run.smithi003.stdout: ostree-libs-2023.7-2.el9.x86_64 2023-12-03T11:51:17.563 INFO:teuthology.orchestra.run.smithi003.stdout: p11-kit-server-0.24.1-2.el9.x86_64 2023-12-03T11:51:17.563 INFO:teuthology.orchestra.run.smithi003.stdout: pipewire-0.3.67-2.el9.x86_64 2023-12-03T11:51:17.563 INFO:teuthology.orchestra.run.smithi003.stdout: pipewire-alsa-0.3.67-2.el9.x86_64 2023-12-03T11:51:17.563 INFO:teuthology.orchestra.run.smithi003.stdout: pipewire-jack-audio-connection-kit-0.3.67-2.el9.x86_64 2023-12-03T11:51:17.564 INFO:teuthology.orchestra.run.smithi003.stdout: pipewire-libs-0.3.67-2.el9.x86_64 2023-12-03T11:51:17.564 INFO:teuthology.orchestra.run.smithi003.stdout: pipewire-pulseaudio-0.3.67-2.el9.x86_64 2023-12-03T11:51:17.564 INFO:teuthology.orchestra.run.smithi003.stdout: poppler-21.01.0-19.el9.x86_64 2023-12-03T11:51:17.564 INFO:teuthology.orchestra.run.smithi003.stdout: poppler-data-0.4.9-9.el9.noarch 2023-12-03T11:51:17.564 INFO:teuthology.orchestra.run.smithi003.stdout: poppler-glib-21.01.0-19.el9.x86_64 2023-12-03T11:51:17.564 INFO:teuthology.orchestra.run.smithi003.stdout: pulseaudio-libs-15.0-2.el9.x86_64 2023-12-03T11:51:17.564 INFO:teuthology.orchestra.run.smithi003.stdout: pulseaudio-utils-15.0-2.el9.x86_64 2023-12-03T11:51:17.564 INFO:teuthology.orchestra.run.smithi003.stdout: rtkit-0.11-28.el9.x86_64 2023-12-03T11:51:17.564 INFO:teuthology.orchestra.run.smithi003.stdout: sound-theme-freedesktop-0.8-17.el9.noarch 2023-12-03T11:51:17.564 INFO:teuthology.orchestra.run.smithi003.stdout: totem-pl-parser-3.26.6-2.el9.x86_64 2023-12-03T11:51:17.564 INFO:teuthology.orchestra.run.smithi003.stdout: tracker-3.1.2-3.el9.x86_64 2023-12-03T11:51:17.564 INFO:teuthology.orchestra.run.smithi003.stdout: tracker-miners-3.1.2-3.el9.x86_64 2023-12-03T11:51:17.564 INFO:teuthology.orchestra.run.smithi003.stdout: ttmkfdir-3.0.9-65.el9.x86_64 2023-12-03T11:51:17.564 INFO:teuthology.orchestra.run.smithi003.stdout: tzdata-java-2023c-1.el9.noarch 2023-12-03T11:51:17.564 INFO:teuthology.orchestra.run.smithi003.stdout: upower-0.99.11-11.el9.x86_64 2023-12-03T11:51:17.564 INFO:teuthology.orchestra.run.smithi003.stdout: vulkan-loader-1.3.250.1-1.el9.x86_64 2023-12-03T11:51:17.565 INFO:teuthology.orchestra.run.smithi003.stdout: webrtc-audio-processing-0.3.1-8.el9.x86_64 2023-12-03T11:51:17.565 INFO:teuthology.orchestra.run.smithi003.stdout: wireplumber-0.4.14-1.el9.x86_64 2023-12-03T11:51:17.565 INFO:teuthology.orchestra.run.smithi003.stdout: wireplumber-libs-0.4.14-1.el9.x86_64 2023-12-03T11:51:17.565 INFO:teuthology.orchestra.run.smithi003.stdout: xdg-dbus-proxy-0.1.3-1.el9.x86_64 2023-12-03T11:51:17.565 INFO:teuthology.orchestra.run.smithi003.stdout: xdg-desktop-portal-1.12.4-1.el9.x86_64 2023-12-03T11:51:17.565 INFO:teuthology.orchestra.run.smithi003.stdout: xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 2023-12-03T11:51:17.565 INFO:teuthology.orchestra.run.smithi003.stdout: xkeyboard-config-2.33-2.el9.noarch 2023-12-03T11:51:17.565 INFO:teuthology.orchestra.run.smithi003.stdout: xorg-x11-fonts-Type1-7.5-33.el9.noarch 2023-12-03T11:51:17.565 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:51:17.566 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2023-12-03T11:51:17.884 INFO:teuthology.orchestra.run.smithi003.stdout: Gradle will be installed under /opt/gradle 2023-12-03T11:51:17.928 INFO:teuthology.orchestra.run.smithi003.stderr:--2023-12-03 11:51:17-- https://services.gradle.org/distributions/gradle-6.0.1-bin.zip 2023-12-03T11:51:18.098 INFO:teuthology.orchestra.run.smithi003.stderr:Resolving services.gradle.org (services.gradle.org)... 104.17.128.37, 104.17.129.37, 2606:4700::6811:8125, ... 2023-12-03T11:51:18.108 INFO:teuthology.orchestra.run.smithi003.stderr:Connecting to services.gradle.org (services.gradle.org)|104.17.128.37|:443... connected. 2023-12-03T11:51:18.180 INFO:teuthology.orchestra.run.smithi003.stderr:HTTP request sent, awaiting response... 301 Moved Permanently 2023-12-03T11:51:18.180 INFO:teuthology.orchestra.run.smithi003.stderr:Location: https://github.com/gradle/gradle-distributions/releases/download/v6.0.1/gradle-6.0.1-bin.zip [following] 2023-12-03T11:51:18.180 INFO:teuthology.orchestra.run.smithi003.stderr:--2023-12-03 11:51:18-- https://github.com/gradle/gradle-distributions/releases/download/v6.0.1/gradle-6.0.1-bin.zip 2023-12-03T11:51:18.180 INFO:teuthology.orchestra.run.smithi003.stderr:Resolving github.com (github.com)... 140.82.112.3 2023-12-03T11:51:18.191 INFO:teuthology.orchestra.run.smithi003.stderr:Connecting to github.com (github.com)|140.82.112.3|:443... connected. 2023-12-03T11:51:18.283 INFO:teuthology.orchestra.run.smithi003.stderr:HTTP request sent, awaiting response... 302 Found 2023-12-03T11:51:18.283 INFO:teuthology.orchestra.run.smithi003.stderr:Location: https://objects.githubusercontent.com/github-production-release-asset-2e65be/696192900/8f418ba1-c336-448c-95c6-5180382113cb?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAIWNJYAX4CSVEH53A%2F20231203%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20231203T115040Z&X-Amz-Expires=300&X-Amz-Signature=5a07032919c3b6eb456228fa04bce13c3cc401cada37cd87929c553b0c9bd529&X-Amz-SignedHeaders=host&actor_id=0&key_id=0&repo_id=696192900&response-content-disposition=attachment%3B%20filename%3Dgradle-6.0.1-bin.zip&response-content-type=application%2Foctet-stream [following] 2023-12-03T11:51:18.283 INFO:teuthology.orchestra.run.smithi003.stderr:--2023-12-03 11:51:18-- https://objects.githubusercontent.com/github-production-release-asset-2e65be/696192900/8f418ba1-c336-448c-95c6-5180382113cb?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAIWNJYAX4CSVEH53A%2F20231203%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20231203T115040Z&X-Amz-Expires=300&X-Amz-Signature=5a07032919c3b6eb456228fa04bce13c3cc401cada37cd87929c553b0c9bd529&X-Amz-SignedHeaders=host&actor_id=0&key_id=0&repo_id=696192900&response-content-disposition=attachment%3B%20filename%3Dgradle-6.0.1-bin.zip&response-content-type=application%2Foctet-stream 2023-12-03T11:51:18.284 INFO:teuthology.orchestra.run.smithi003.stderr:Resolving objects.githubusercontent.com (objects.githubusercontent.com)... 185.199.108.133, 185.199.110.133, 185.199.109.133, ... 2023-12-03T11:51:18.378 INFO:teuthology.orchestra.run.smithi003.stderr:Connecting to objects.githubusercontent.com (objects.githubusercontent.com)|185.199.108.133|:443... connected. 2023-12-03T11:51:18.863 INFO:teuthology.orchestra.run.smithi003.stderr:HTTP request sent, awaiting response... 200 OK 2023-12-03T11:51:18.863 INFO:teuthology.orchestra.run.smithi003.stderr:Length: 95129672 (91M) [application/octet-stream] 2023-12-03T11:51:18.863 INFO:teuthology.orchestra.run.smithi003.stderr:Saving to: ‘gradle-6.0.1-bin.zip’ 2023-12-03T11:51:18.863 INFO:teuthology.orchestra.run.smithi003.stderr: 2023-12-03T11:51:18.955 INFO:teuthology.orchestra.run.smithi003.stderr: 0K .......... .......... .......... .......... .......... 0% 562K 2m45s 2023-12-03T11:51:19.046 INFO:teuthology.orchestra.run.smithi003.stderr: 50K .......... .......... .......... .......... .......... 0% 530K 2m50s 2023-12-03T11:51:19.114 INFO:teuthology.orchestra.run.smithi003.stderr: 100K .......... .......... .......... .......... .......... 0% 741K 2m35s 2023-12-03T11:51:19.136 INFO:teuthology.orchestra.run.smithi003.stderr: 150K .......... .......... .......... .......... .......... 0% 2.14M 2m7s 2023-12-03T11:51:19.171 INFO:teuthology.orchestra.run.smithi003.stderr: 200K .......... .......... .......... .......... .......... 0% 1.42M 1m54s 2023-12-03T11:51:19.232 INFO:teuthology.orchestra.run.smithi003.stderr: 250K .......... .......... .......... .......... .......... 0% 815K 1m54s 2023-12-03T11:51:19.273 INFO:teuthology.orchestra.run.smithi003.stderr: 300K .......... .......... .......... .......... .......... 0% 1.72M 1m45s 2023-12-03T11:51:19.333 INFO:teuthology.orchestra.run.smithi003.stderr: 350K .......... .......... .......... .......... .......... 0% 697K 1m49s 2023-12-03T11:51:19.367 INFO:teuthology.orchestra.run.smithi003.stderr: 400K .......... .......... .......... .......... .......... 0% 1.40M 1m44s 2023-12-03T11:51:19.402 INFO:teuthology.orchestra.run.smithi003.stderr: 450K .......... .......... .......... .......... .......... 0% 1.39M 1m40s 2023-12-03T11:51:19.448 INFO:teuthology.orchestra.run.smithi003.stderr: 500K .......... .......... .......... .......... .......... 0% 1.08M 98s 2023-12-03T11:51:19.486 INFO:teuthology.orchestra.run.smithi003.stderr: 550K .......... .......... .......... .......... .......... 0% 1.27M 96s 2023-12-03T11:51:19.515 INFO:teuthology.orchestra.run.smithi003.stderr: 600K .......... .......... .......... .......... .......... 0% 1.66M 93s 2023-12-03T11:51:19.559 INFO:teuthology.orchestra.run.smithi003.stderr: 650K .......... .......... .......... .......... .......... 0% 1.13M 92s 2023-12-03T11:51:19.605 INFO:teuthology.orchestra.run.smithi003.stderr: 700K .......... .......... .......... .......... .......... 0% 1.43M 90s 2023-12-03T11:51:19.633 INFO:teuthology.orchestra.run.smithi003.stderr: 750K .......... .......... .......... .......... .......... 0% 1.19M 89s 2023-12-03T11:51:19.669 INFO:teuthology.orchestra.run.smithi003.stderr: 800K .......... .......... .......... .......... .......... 0% 1.39M 87s 2023-12-03T11:51:19.700 INFO:teuthology.orchestra.run.smithi003.stderr: 850K .......... .......... .......... .......... .......... 0% 1.58M 86s 2023-12-03T11:51:19.721 INFO:teuthology.orchestra.run.smithi003.stderr: 900K .......... .......... .......... .......... .......... 1% 2.30M 83s 2023-12-03T11:51:19.747 INFO:teuthology.orchestra.run.smithi003.stderr: 950K .......... .......... .......... .......... .......... 1% 1.85M 81s 2023-12-03T11:51:19.777 INFO:teuthology.orchestra.run.smithi003.stderr: 1000K .......... .......... .......... .......... .......... 1% 1.61M 80s 2023-12-03T11:51:19.804 INFO:teuthology.orchestra.run.smithi003.stderr: 1050K .......... .......... .......... .......... .......... 1% 1.84M 79s 2023-12-03T11:51:19.836 INFO:teuthology.orchestra.run.smithi003.stderr: 1100K .......... .......... .......... .......... .......... 1% 2.03M 77s 2023-12-03T11:51:19.860 INFO:teuthology.orchestra.run.smithi003.stderr: 1150K .......... .......... .......... .......... .......... 1% 1.55M 76s 2023-12-03T11:51:19.889 INFO:teuthology.orchestra.run.smithi003.stderr: 1200K .......... .......... .......... .......... .......... 1% 1.63M 75s 2023-12-03T11:51:19.910 INFO:teuthology.orchestra.run.smithi003.stderr: 1250K .......... .......... .......... .......... .......... 1% 2.41M 74s 2023-12-03T11:51:19.929 INFO:teuthology.orchestra.run.smithi003.stderr: 1300K .......... .......... .......... .......... .......... 1% 2.55M 72s 2023-12-03T11:51:19.960 INFO:teuthology.orchestra.run.smithi003.stderr: 1350K .......... .......... .......... .......... .......... 1% 1.57M 72s 2023-12-03T11:51:19.984 INFO:teuthology.orchestra.run.smithi003.stderr: 1400K .......... .......... .......... .......... .......... 1% 2.00M 71s 2023-12-03T11:51:20.007 INFO:teuthology.orchestra.run.smithi003.stderr: 1450K .......... .......... .......... .......... .......... 1% 2.16M 70s 2023-12-03T11:51:20.040 INFO:teuthology.orchestra.run.smithi003.stderr: 1500K .......... .......... .......... .......... .......... 1% 2.00M 69s 2023-12-03T11:51:20.071 INFO:teuthology.orchestra.run.smithi003.stderr: 1550K .......... .......... .......... .......... .......... 1% 1.23M 69s 2023-12-03T11:51:20.090 INFO:teuthology.orchestra.run.smithi003.stderr: 1600K .......... .......... .......... .......... .......... 1% 2.56M 68s 2023-12-03T11:51:20.114 INFO:teuthology.orchestra.run.smithi003.stderr: 1650K .......... .......... .......... .......... .......... 1% 2.05M 67s 2023-12-03T11:51:20.140 INFO:teuthology.orchestra.run.smithi003.stderr: 1700K .......... .......... .......... .......... .......... 1% 1.93M 67s 2023-12-03T11:51:20.173 INFO:teuthology.orchestra.run.smithi003.stderr: 1750K .......... .......... .......... .......... .......... 1% 1.80M 66s 2023-12-03T11:51:20.193 INFO:teuthology.orchestra.run.smithi003.stderr: 1800K .......... .......... .......... .......... .......... 1% 1.85M 65s 2023-12-03T11:51:20.215 INFO:teuthology.orchestra.run.smithi003.stderr: 1850K .......... .......... .......... .......... .......... 2% 2.26M 65s 2023-12-03T11:51:20.240 INFO:teuthology.orchestra.run.smithi003.stderr: 1900K .......... .......... .......... .......... .......... 2% 1.90M 64s 2023-12-03T11:51:20.269 INFO:teuthology.orchestra.run.smithi003.stderr: 1950K .......... .......... .......... .......... .......... 2% 1.72M 64s 2023-12-03T11:51:20.291 INFO:teuthology.orchestra.run.smithi003.stderr: 2000K .......... .......... .......... .......... .......... 2% 2.20M 63s 2023-12-03T11:51:20.311 INFO:teuthology.orchestra.run.smithi003.stderr: 2050K .......... .......... .......... .......... .......... 2% 2.47M 63s 2023-12-03T11:51:20.327 INFO:teuthology.orchestra.run.smithi003.stderr: 2100K .......... .......... .......... .......... .......... 2% 3.06M 62s 2023-12-03T11:51:20.363 INFO:teuthology.orchestra.run.smithi003.stderr: 2150K .......... .......... .......... .......... .......... 2% 1.77M 62s 2023-12-03T11:51:20.382 INFO:teuthology.orchestra.run.smithi003.stderr: 2200K .......... .......... .......... .......... .......... 2% 1.74M 61s 2023-12-03T11:51:20.400 INFO:teuthology.orchestra.run.smithi003.stderr: 2250K .......... .......... .......... .......... .......... 2% 2.75M 61s 2023-12-03T11:51:20.421 INFO:teuthology.orchestra.run.smithi003.stderr: 2300K .......... .......... .......... .......... .......... 2% 2.33M 60s 2023-12-03T11:51:20.437 INFO:teuthology.orchestra.run.smithi003.stderr: 2350K .......... .......... .......... .......... .......... 2% 3.00M 59s 2023-12-03T11:51:20.461 INFO:teuthology.orchestra.run.smithi003.stderr: 2400K .......... .......... .......... .......... .......... 2% 2.10M 59s 2023-12-03T11:51:20.478 INFO:teuthology.orchestra.run.smithi003.stderr: 2450K .......... .......... .......... .......... .......... 2% 2.83M 58s 2023-12-03T11:51:20.494 INFO:teuthology.orchestra.run.smithi003.stderr: 2500K .......... .......... .......... .......... .......... 2% 3.08M 58s 2023-12-03T11:51:20.519 INFO:teuthology.orchestra.run.smithi003.stderr: 2550K .......... .......... .......... .......... .......... 2% 1.96M 58s 2023-12-03T11:51:20.540 INFO:teuthology.orchestra.run.smithi003.stderr: 2600K .......... .......... .......... .......... .......... 2% 2.32M 57s 2023-12-03T11:51:20.559 INFO:teuthology.orchestra.run.smithi003.stderr: 2650K .......... .......... .......... .......... .......... 2% 2.47M 57s 2023-12-03T11:51:20.577 INFO:teuthology.orchestra.run.smithi003.stderr: 2700K .......... .......... .......... .......... .......... 2% 2.77M 56s 2023-12-03T11:51:20.594 INFO:teuthology.orchestra.run.smithi003.stderr: 2750K .......... .......... .......... .......... .......... 3% 2.82M 56s 2023-12-03T11:51:20.614 INFO:teuthology.orchestra.run.smithi003.stderr: 2800K .......... .......... .......... .......... .......... 3% 2.48M 55s 2023-12-03T11:51:20.645 INFO:teuthology.orchestra.run.smithi003.stderr: 2850K .......... .......... .......... .......... .......... 3% 1.61M 55s 2023-12-03T11:51:20.662 INFO:teuthology.orchestra.run.smithi003.stderr: 2900K .......... .......... .......... .......... .......... 3% 2.82M 55s 2023-12-03T11:51:20.681 INFO:teuthology.orchestra.run.smithi003.stderr: 2950K .......... .......... .......... .......... .......... 3% 2.53M 54s 2023-12-03T11:51:20.700 INFO:teuthology.orchestra.run.smithi003.stderr: 3000K .......... .......... .......... .......... .......... 3% 2.56M 54s 2023-12-03T11:51:20.721 INFO:teuthology.orchestra.run.smithi003.stderr: 3050K .......... .......... .......... .......... .......... 3% 2.35M 54s 2023-12-03T11:51:20.743 INFO:teuthology.orchestra.run.smithi003.stderr: 3100K .......... .......... .......... .......... .......... 3% 2.20M 54s 2023-12-03T11:51:20.766 INFO:teuthology.orchestra.run.smithi003.stderr: 3150K .......... .......... .......... .......... .......... 3% 2.14M 53s 2023-12-03T11:51:20.784 INFO:teuthology.orchestra.run.smithi003.stderr: 3200K .......... .......... .......... .......... .......... 3% 2.66M 53s 2023-12-03T11:51:20.802 INFO:teuthology.orchestra.run.smithi003.stderr: 3250K .......... .......... .......... .......... .......... 3% 2.76M 53s 2023-12-03T11:51:20.818 INFO:teuthology.orchestra.run.smithi003.stderr: 3300K .......... .......... .......... .......... .......... 3% 3.03M 52s 2023-12-03T11:51:20.843 INFO:teuthology.orchestra.run.smithi003.stderr: 3350K .......... .......... .......... .......... .......... 3% 2.43M 52s 2023-12-03T11:51:20.869 INFO:teuthology.orchestra.run.smithi003.stderr: 3400K .......... .......... .......... .......... .......... 3% 1.60M 52s 2023-12-03T11:51:20.887 INFO:teuthology.orchestra.run.smithi003.stderr: 3450K .......... .......... .......... .......... .......... 3% 2.72M 52s 2023-12-03T11:51:20.903 INFO:teuthology.orchestra.run.smithi003.stderr: 3500K .......... .......... .......... .......... .......... 3% 3.03M 51s 2023-12-03T11:51:20.923 INFO:teuthology.orchestra.run.smithi003.stderr: 3550K .......... .......... .......... .......... .......... 3% 2.45M 51s 2023-12-03T11:51:20.938 INFO:teuthology.orchestra.run.smithi003.stderr: 3600K .......... .......... .......... .......... .......... 3% 3.19M 51s 2023-12-03T11:51:20.955 INFO:teuthology.orchestra.run.smithi003.stderr: 3650K .......... .......... .......... .......... .......... 3% 2.84M 50s 2023-12-03T11:51:20.982 INFO:teuthology.orchestra.run.smithi003.stderr: 3700K .......... .......... .......... .......... .......... 4% 1.84M 50s 2023-12-03T11:51:21.002 INFO:teuthology.orchestra.run.smithi003.stderr: 3750K .......... .......... .......... .......... .......... 4% 2.36M 50s 2023-12-03T11:51:21.021 INFO:teuthology.orchestra.run.smithi003.stderr: 3800K .......... .......... .......... .......... .......... 4% 2.66M 50s 2023-12-03T11:51:21.040 INFO:teuthology.orchestra.run.smithi003.stderr: 3850K .......... .......... .......... .......... .......... 4% 2.50M 50s 2023-12-03T11:51:21.058 INFO:teuthology.orchestra.run.smithi003.stderr: 3900K .......... .......... .......... .......... .......... 4% 2.73M 49s 2023-12-03T11:51:21.074 INFO:teuthology.orchestra.run.smithi003.stderr: 3950K .......... .......... .......... .......... .......... 4% 3.08M 49s 2023-12-03T11:51:21.105 INFO:teuthology.orchestra.run.smithi003.stderr: 4000K .......... .......... .......... .......... .......... 4% 1.95M 49s 2023-12-03T11:51:21.119 INFO:teuthology.orchestra.run.smithi003.stderr: 4050K .......... .......... .......... .......... .......... 4% 2.42M 49s 2023-12-03T11:51:21.138 INFO:teuthology.orchestra.run.smithi003.stderr: 4100K .......... .......... .......... .......... .......... 4% 2.68M 49s 2023-12-03T11:51:21.157 INFO:teuthology.orchestra.run.smithi003.stderr: 4150K .......... .......... .......... .......... .......... 4% 2.48M 48s 2023-12-03T11:51:21.172 INFO:teuthology.orchestra.run.smithi003.stderr: 4200K .......... .......... .......... .......... .......... 4% 3.37M 48s 2023-12-03T11:51:21.186 INFO:teuthology.orchestra.run.smithi003.stderr: 4250K .......... .......... .......... .......... .......... 4% 3.35M 48s 2023-12-03T11:51:21.216 INFO:teuthology.orchestra.run.smithi003.stderr: 4300K .......... .......... .......... .......... .......... 4% 1.66M 48s 2023-12-03T11:51:21.230 INFO:teuthology.orchestra.run.smithi003.stderr: 4350K .......... .......... .......... .......... .......... 4% 3.36M 48s 2023-12-03T11:51:21.246 INFO:teuthology.orchestra.run.smithi003.stderr: 4400K .......... .......... .......... .......... .......... 4% 3.09M 47s 2023-12-03T11:51:21.259 INFO:teuthology.orchestra.run.smithi003.stderr: 4450K .......... .......... .......... .......... .......... 4% 3.69M 47s 2023-12-03T11:51:21.275 INFO:teuthology.orchestra.run.smithi003.stderr: 4500K .......... .......... .......... .......... .......... 4% 3.07M 47s 2023-12-03T11:51:21.290 INFO:teuthology.orchestra.run.smithi003.stderr: 4550K .......... .......... .......... .......... .......... 4% 4.55M 47s 2023-12-03T11:51:21.305 INFO:teuthology.orchestra.run.smithi003.stderr: 4600K .......... .......... .......... .......... .......... 5% 2.51M 46s 2023-12-03T11:51:21.324 INFO:teuthology.orchestra.run.smithi003.stderr: 4650K .......... .......... .......... .......... .......... 5% 2.63M 46s 2023-12-03T11:51:21.336 INFO:teuthology.orchestra.run.smithi003.stderr: 4700K .......... .......... .......... .......... .......... 5% 4.08M 46s 2023-12-03T11:51:21.348 INFO:teuthology.orchestra.run.smithi003.stderr: 4750K .......... .......... .......... .......... .......... 5% 3.99M 46s 2023-12-03T11:51:21.361 INFO:teuthology.orchestra.run.smithi003.stderr: 4800K .......... .......... .......... .......... .......... 5% 3.87M 45s 2023-12-03T11:51:21.374 INFO:teuthology.orchestra.run.smithi003.stderr: 4850K .......... .......... .......... .......... .......... 5% 3.58M 45s 2023-12-03T11:51:21.387 INFO:teuthology.orchestra.run.smithi003.stderr: 4900K .......... .......... .......... .......... .......... 5% 3.73M 45s 2023-12-03T11:51:21.409 INFO:teuthology.orchestra.run.smithi003.stderr: 4950K .......... .......... .......... .......... .......... 5% 3.23M 45s 2023-12-03T11:51:21.424 INFO:teuthology.orchestra.run.smithi003.stderr: 5000K .......... .......... .......... .......... .......... 5% 2.24M 45s 2023-12-03T11:51:21.435 INFO:teuthology.orchestra.run.smithi003.stderr: 5050K .......... .......... .......... .......... .......... 5% 4.47M 44s 2023-12-03T11:51:21.446 INFO:teuthology.orchestra.run.smithi003.stderr: 5100K .......... .......... .......... .......... .......... 5% 4.75M 44s 2023-12-03T11:51:21.456 INFO:teuthology.orchestra.run.smithi003.stderr: 5150K .......... .......... .......... .......... .......... 5% 4.51M 44s 2023-12-03T11:51:21.468 INFO:teuthology.orchestra.run.smithi003.stderr: 5200K .......... .......... .......... .......... .......... 5% 4.17M 44s 2023-12-03T11:51:21.481 INFO:teuthology.orchestra.run.smithi003.stderr: 5250K .......... .......... .......... .......... .......... 5% 3.71M 43s 2023-12-03T11:51:21.492 INFO:teuthology.orchestra.run.smithi003.stderr: 5300K .......... .......... .......... .......... .......... 5% 4.64M 43s 2023-12-03T11:51:21.517 INFO:teuthology.orchestra.run.smithi003.stderr: 5350K .......... .......... .......... .......... .......... 5% 2.60M 43s 2023-12-03T11:51:21.529 INFO:teuthology.orchestra.run.smithi003.stderr: 5400K .......... .......... .......... .......... .......... 5% 2.59M 43s 2023-12-03T11:51:21.540 INFO:teuthology.orchestra.run.smithi003.stderr: 5450K .......... .......... .......... .......... .......... 5% 4.68M 43s 2023-12-03T11:51:21.550 INFO:teuthology.orchestra.run.smithi003.stderr: 5500K .......... .......... .......... .......... .......... 5% 4.68M 42s 2023-12-03T11:51:21.562 INFO:teuthology.orchestra.run.smithi003.stderr: 5550K .......... .......... .......... .......... .......... 6% 4.09M 42s 2023-12-03T11:51:21.572 INFO:teuthology.orchestra.run.smithi003.stderr: 5600K .......... .......... .......... .......... .......... 6% 4.82M 42s 2023-12-03T11:51:21.582 INFO:teuthology.orchestra.run.smithi003.stderr: 5650K .......... .......... .......... .......... .......... 6% 5.17M 42s 2023-12-03T11:51:21.593 INFO:teuthology.orchestra.run.smithi003.stderr: 5700K .......... .......... .......... .......... .......... 6% 4.29M 41s 2023-12-03T11:51:21.615 INFO:teuthology.orchestra.run.smithi003.stderr: 5750K .......... .......... .......... .......... .......... 6% 2.68M 41s 2023-12-03T11:51:21.627 INFO:teuthology.orchestra.run.smithi003.stderr: 5800K .......... .......... .......... .......... .......... 6% 3.14M 41s 2023-12-03T11:51:21.636 INFO:teuthology.orchestra.run.smithi003.stderr: 5850K .......... .......... .......... .......... .......... 6% 5.54M 41s 2023-12-03T11:51:21.646 INFO:teuthology.orchestra.run.smithi003.stderr: 5900K .......... .......... .......... .......... .......... 6% 4.96M 41s 2023-12-03T11:51:21.657 INFO:teuthology.orchestra.run.smithi003.stderr: 5950K .......... .......... .......... .......... .......... 6% 4.31M 40s 2023-12-03T11:51:21.668 INFO:teuthology.orchestra.run.smithi003.stderr: 6000K .......... .......... .......... .......... .......... 6% 4.50M 40s 2023-12-03T11:51:21.680 INFO:teuthology.orchestra.run.smithi003.stderr: 6050K .......... .......... .......... .......... .......... 6% 4.03M 40s 2023-12-03T11:51:21.691 INFO:teuthology.orchestra.run.smithi003.stderr: 6100K .......... .......... .......... .......... .......... 6% 4.24M 40s 2023-12-03T11:51:21.708 INFO:teuthology.orchestra.run.smithi003.stderr: 6150K .......... .......... .......... .......... .......... 6% 3.04M 40s 2023-12-03T11:51:21.721 INFO:teuthology.orchestra.run.smithi003.stderr: 6200K .......... .......... .......... .......... .......... 6% 3.67M 40s 2023-12-03T11:51:21.731 INFO:teuthology.orchestra.run.smithi003.stderr: 6250K .......... .......... .......... .......... .......... 6% 4.87M 39s 2023-12-03T11:51:21.744 INFO:teuthology.orchestra.run.smithi003.stderr: 6300K .......... .......... .......... .......... .......... 6% 4.97M 39s 2023-12-03T11:51:21.754 INFO:teuthology.orchestra.run.smithi003.stderr: 6350K .......... .......... .......... .......... .......... 6% 3.63M 39s 2023-12-03T11:51:21.765 INFO:teuthology.orchestra.run.smithi003.stderr: 6400K .......... .......... .......... .......... .......... 6% 4.49M 39s 2023-12-03T11:51:21.776 INFO:teuthology.orchestra.run.smithi003.stderr: 6450K .......... .......... .......... .......... .......... 6% 4.36M 39s 2023-12-03T11:51:21.787 INFO:teuthology.orchestra.run.smithi003.stderr: 6500K .......... .......... .......... .......... .......... 7% 4.63M 39s 2023-12-03T11:51:21.801 INFO:teuthology.orchestra.run.smithi003.stderr: 6550K .......... .......... .......... .......... .......... 7% 3.41M 38s 2023-12-03T11:51:21.815 INFO:teuthology.orchestra.run.smithi003.stderr: 6600K .......... .......... .......... .......... .......... 7% 3.37M 38s 2023-12-03T11:51:21.825 INFO:teuthology.orchestra.run.smithi003.stderr: 6650K .......... .......... .......... .......... .......... 7% 5.01M 38s 2023-12-03T11:51:21.844 INFO:teuthology.orchestra.run.smithi003.stderr: 6700K .......... .......... .......... .......... .......... 7% 3.86M 38s 2023-12-03T11:51:21.862 INFO:teuthology.orchestra.run.smithi003.stderr: 6750K .......... .......... .......... .......... .......... 7% 2.05M 38s 2023-12-03T11:51:21.876 INFO:teuthology.orchestra.run.smithi003.stderr: 6800K .......... .......... .......... .......... .......... 7% 3.46M 38s 2023-12-03T11:51:21.888 INFO:teuthology.orchestra.run.smithi003.stderr: 6850K .......... .......... .......... .......... .......... 7% 4.18M 38s 2023-12-03T11:51:21.899 INFO:teuthology.orchestra.run.smithi003.stderr: 6900K .......... .......... .......... .......... .......... 7% 4.41M 38s 2023-12-03T11:51:21.908 INFO:teuthology.orchestra.run.smithi003.stderr: 6950K .......... .......... .......... .......... .......... 7% 5.02M 37s 2023-12-03T11:51:21.922 INFO:teuthology.orchestra.run.smithi003.stderr: 7000K .......... .......... .......... .......... .......... 7% 3.51M 37s 2023-12-03T11:51:21.941 INFO:teuthology.orchestra.run.smithi003.stderr: 7050K .......... .......... .......... .......... .......... 7% 2.96M 37s 2023-12-03T11:51:21.951 INFO:teuthology.orchestra.run.smithi003.stderr: 7100K .......... .......... .......... .......... .......... 7% 3.87M 37s 2023-12-03T11:51:21.964 INFO:teuthology.orchestra.run.smithi003.stderr: 7150K .......... .......... .......... .......... .......... 7% 3.99M 37s 2023-12-03T11:51:21.980 INFO:teuthology.orchestra.run.smithi003.stderr: 7200K .......... .......... .......... .......... .......... 7% 3.06M 37s 2023-12-03T11:51:21.998 INFO:teuthology.orchestra.run.smithi003.stderr: 7250K .......... .......... .......... .......... .......... 7% 2.72M 37s 2023-12-03T11:51:22.006 INFO:teuthology.orchestra.run.smithi003.stderr: 7300K .......... .......... .......... .......... .......... 7% 6.05M 37s 2023-12-03T11:51:22.016 INFO:teuthology.orchestra.run.smithi003.stderr: 7350K .......... .......... .......... .......... .......... 7% 4.73M 36s 2023-12-03T11:51:22.020 INFO:teuthology.orchestra.run.smithi003.stderr: 7400K .......... .......... .......... .......... .......... 8% 13.7M 36s 2023-12-03T11:51:22.027 INFO:teuthology.orchestra.run.smithi003.stderr: 7450K .......... .......... .......... .......... .......... 8% 6.25M 36s 2023-12-03T11:51:22.040 INFO:teuthology.orchestra.run.smithi003.stderr: 7500K .......... .......... .......... .......... .......... 8% 3.89M 36s 2023-12-03T11:51:22.047 INFO:teuthology.orchestra.run.smithi003.stderr: 7550K .......... .......... .......... .......... .......... 8% 7.09M 36s 2023-12-03T11:51:22.063 INFO:teuthology.orchestra.run.smithi003.stderr: 7600K .......... .......... .......... .......... .......... 8% 2.99M 36s 2023-12-03T11:51:22.069 INFO:teuthology.orchestra.run.smithi003.stderr: 7650K .......... .......... .......... .......... .......... 8% 7.56M 35s 2023-12-03T11:51:22.091 INFO:teuthology.orchestra.run.smithi003.stderr: 7700K .......... .......... .......... .......... .......... 8% 2.28M 35s 2023-12-03T11:51:22.096 INFO:teuthology.orchestra.run.smithi003.stderr: 7750K .......... .......... .......... .......... .......... 8% 8.98M 35s 2023-12-03T11:51:22.107 INFO:teuthology.orchestra.run.smithi003.stderr: 7800K .......... .......... .......... .......... .......... 8% 7.26M 35s 2023-12-03T11:51:22.113 INFO:teuthology.orchestra.run.smithi003.stderr: 7850K .......... .......... .......... .......... .......... 8% 4.93M 35s 2023-12-03T11:51:22.123 INFO:teuthology.orchestra.run.smithi003.stderr: 7900K .......... .......... .......... .......... .......... 8% 16.4M 35s 2023-12-03T11:51:22.128 INFO:teuthology.orchestra.run.smithi003.stderr: 7950K .......... .......... .......... .......... .......... 8% 3.93M 35s 2023-12-03T11:51:22.135 INFO:teuthology.orchestra.run.smithi003.stderr: 8000K .......... .......... .......... .......... .......... 8% 7.23M 34s 2023-12-03T11:51:22.145 INFO:teuthology.orchestra.run.smithi003.stderr: 8050K .......... .......... .......... .......... .......... 8% 4.77M 34s 2023-12-03T11:51:22.152 INFO:teuthology.orchestra.run.smithi003.stderr: 8100K .......... .......... .......... .......... .......... 8% 7.38M 34s 2023-12-03T11:51:22.159 INFO:teuthology.orchestra.run.smithi003.stderr: 8150K .......... .......... .......... .......... .......... 8% 7.36M 34s 2023-12-03T11:51:22.172 INFO:teuthology.orchestra.run.smithi003.stderr: 8200K .......... .......... .......... .......... .......... 8% 3.51M 34s 2023-12-03T11:51:22.196 INFO:teuthology.orchestra.run.smithi003.stderr: 8250K .......... .......... .......... .......... .......... 8% 2.08M 34s 2023-12-03T11:51:22.200 INFO:teuthology.orchestra.run.smithi003.stderr: 8300K .......... .......... .......... .......... .......... 8% 14.6M 34s 2023-12-03T11:51:22.206 INFO:teuthology.orchestra.run.smithi003.stderr: 8350K .......... .......... .......... .......... .......... 9% 8.77M 34s 2023-12-03T11:51:22.208 INFO:teuthology.orchestra.run.smithi003.stderr: 8400K .......... .......... .......... .......... .......... 9% 17.0M 33s 2023-12-03T11:51:22.212 INFO:teuthology.orchestra.run.smithi003.stderr: 8450K .......... .......... .......... .......... .......... 9% 11.6M 33s 2023-12-03T11:51:22.217 INFO:teuthology.orchestra.run.smithi003.stderr: 8500K .......... .......... .......... .......... .......... 9% 10.6M 33s 2023-12-03T11:51:22.234 INFO:teuthology.orchestra.run.smithi003.stderr: 8550K .......... .......... .......... .......... .......... 9% 2.73M 33s 2023-12-03T11:51:22.240 INFO:teuthology.orchestra.run.smithi003.stderr: 8600K .......... .......... .......... .......... .......... 9% 8.40M 33s 2023-12-03T11:51:22.245 INFO:teuthology.orchestra.run.smithi003.stderr: 8650K .......... .......... .......... .......... .......... 9% 11.5M 33s 2023-12-03T11:51:22.253 INFO:teuthology.orchestra.run.smithi003.stderr: 8700K .......... .......... .......... .......... .......... 9% 5.74M 33s 2023-12-03T11:51:22.276 INFO:teuthology.orchestra.run.smithi003.stderr: 8750K .......... .......... .......... .......... .......... 9% 2.14M 33s 2023-12-03T11:51:22.299 INFO:teuthology.orchestra.run.smithi003.stderr: 8800K .......... .......... .......... .......... .......... 9% 2.09M 33s 2023-12-03T11:51:22.310 INFO:teuthology.orchestra.run.smithi003.stderr: 8850K .......... .......... .......... .......... .......... 9% 4.52M 33s 2023-12-03T11:51:22.315 INFO:teuthology.orchestra.run.smithi003.stderr: 8900K .......... .......... .......... .......... .......... 9% 9.78M 32s 2023-12-03T11:51:22.334 INFO:teuthology.orchestra.run.smithi003.stderr: 8950K .......... .......... .......... .......... .......... 9% 3.20M 32s 2023-12-03T11:51:22.341 INFO:teuthology.orchestra.run.smithi003.stderr: 9000K .......... .......... .......... .......... .......... 9% 4.75M 32s 2023-12-03T11:51:22.343 INFO:teuthology.orchestra.run.smithi003.stderr: 9050K .......... .......... .......... .......... .......... 9% 22.4M 32s 2023-12-03T11:51:22.352 INFO:teuthology.orchestra.run.smithi003.stderr: 9100K .......... .......... .......... .......... .......... 9% 5.30M 32s 2023-12-03T11:51:22.359 INFO:teuthology.orchestra.run.smithi003.stderr: 9150K .......... .......... .......... .......... .......... 9% 6.93M 32s 2023-12-03T11:51:22.366 INFO:teuthology.orchestra.run.smithi003.stderr: 9200K .......... .......... .......... .......... .......... 9% 6.37M 32s 2023-12-03T11:51:22.372 INFO:teuthology.orchestra.run.smithi003.stderr: 9250K .......... .......... .......... .......... .......... 10% 9.90M 32s 2023-12-03T11:51:22.389 INFO:teuthology.orchestra.run.smithi003.stderr: 9300K .......... .......... .......... .......... .......... 10% 2.86M 32s 2023-12-03T11:51:22.400 INFO:teuthology.orchestra.run.smithi003.stderr: 9350K .......... .......... .......... .......... .......... 10% 4.51M 31s 2023-12-03T11:51:22.408 INFO:teuthology.orchestra.run.smithi003.stderr: 9400K .......... .......... .......... .......... .......... 10% 5.90M 31s 2023-12-03T11:51:22.414 INFO:teuthology.orchestra.run.smithi003.stderr: 9450K .......... .......... .......... .......... .......... 10% 8.10M 31s 2023-12-03T11:51:22.424 INFO:teuthology.orchestra.run.smithi003.stderr: 9500K .......... .......... .......... .......... .......... 10% 4.91M 31s 2023-12-03T11:51:22.432 INFO:teuthology.orchestra.run.smithi003.stderr: 9550K .......... .......... .......... .......... .......... 10% 5.63M 31s 2023-12-03T11:51:22.436 INFO:teuthology.orchestra.run.smithi003.stderr: 9600K .......... .......... .......... .......... .......... 10% 12.2M 31s 2023-12-03T11:51:22.448 INFO:teuthology.orchestra.run.smithi003.stderr: 9650K .......... .......... .......... .......... .......... 10% 4.19M 31s 2023-12-03T11:51:22.460 INFO:teuthology.orchestra.run.smithi003.stderr: 9700K .......... .......... .......... .......... .......... 10% 4.19M 31s 2023-12-03T11:51:22.463 INFO:teuthology.orchestra.run.smithi003.stderr: 9750K .......... .......... .......... .......... .......... 10% 14.6M 31s 2023-12-03T11:51:22.469 INFO:teuthology.orchestra.run.smithi003.stderr: 9800K .......... .......... .......... .......... .......... 10% 8.52M 30s 2023-12-03T11:51:22.478 INFO:teuthology.orchestra.run.smithi003.stderr: 9850K .......... .......... .......... .......... .......... 10% 5.54M 30s 2023-12-03T11:51:22.490 INFO:teuthology.orchestra.run.smithi003.stderr: 9900K .......... .......... .......... .......... .......... 10% 3.80M 30s 2023-12-03T11:51:22.497 INFO:teuthology.orchestra.run.smithi003.stderr: 9950K .......... .......... .......... .......... .......... 10% 7.53M 30s 2023-12-03T11:51:22.503 INFO:teuthology.orchestra.run.smithi003.stderr: 10000K .......... .......... .......... .......... .......... 10% 8.00M 30s 2023-12-03T11:51:22.510 INFO:teuthology.orchestra.run.smithi003.stderr: 10050K .......... .......... .......... .......... .......... 10% 6.73M 30s 2023-12-03T11:51:22.517 INFO:teuthology.orchestra.run.smithi003.stderr: 10100K .......... .......... .......... .......... .......... 10% 7.20M 30s 2023-12-03T11:51:22.532 INFO:teuthology.orchestra.run.smithi003.stderr: 10150K .......... .......... .......... .......... .......... 10% 4.20M 30s 2023-12-03T11:51:22.536 INFO:teuthology.orchestra.run.smithi003.stderr: 10200K .......... .......... .......... .......... .......... 11% 6.43M 30s 2023-12-03T11:51:22.549 INFO:teuthology.orchestra.run.smithi003.stderr: 10250K .......... .......... .......... .......... .......... 11% 3.84M 30s 2023-12-03T11:51:22.556 INFO:teuthology.orchestra.run.smithi003.stderr: 10300K .......... .......... .......... .......... .......... 11% 7.05M 29s 2023-12-03T11:51:22.563 INFO:teuthology.orchestra.run.smithi003.stderr: 10350K .......... .......... .......... .......... .......... 11% 7.13M 29s 2023-12-03T11:51:22.568 INFO:teuthology.orchestra.run.smithi003.stderr: 10400K .......... .......... .......... .......... .......... 11% 9.56M 29s 2023-12-03T11:51:22.575 INFO:teuthology.orchestra.run.smithi003.stderr: 10450K .......... .......... .......... .......... .......... 11% 7.11M 29s 2023-12-03T11:51:22.585 INFO:teuthology.orchestra.run.smithi003.stderr: 10500K .......... .......... .......... .......... .......... 11% 4.60M 29s 2023-12-03T11:51:22.593 INFO:teuthology.orchestra.run.smithi003.stderr: 10550K .......... .......... .......... .......... .......... 11% 6.52M 29s 2023-12-03T11:51:22.601 INFO:teuthology.orchestra.run.smithi003.stderr: 10600K .......... .......... .......... .......... .......... 11% 6.25M 29s 2023-12-03T11:51:22.610 INFO:teuthology.orchestra.run.smithi003.stderr: 10650K .......... .......... .......... .......... .......... 11% 5.47M 29s 2023-12-03T11:51:22.623 INFO:teuthology.orchestra.run.smithi003.stderr: 10700K .......... .......... .......... .......... .......... 11% 3.77M 29s 2023-12-03T11:51:22.632 INFO:teuthology.orchestra.run.smithi003.stderr: 10750K .......... .......... .......... .......... .......... 11% 5.38M 29s 2023-12-03T11:51:22.634 INFO:teuthology.orchestra.run.smithi003.stderr: 10800K .......... .......... .......... .......... .......... 11% 18.2M 29s 2023-12-03T11:51:22.644 INFO:teuthology.orchestra.run.smithi003.stderr: 10850K .......... .......... .......... .......... .......... 11% 5.18M 28s 2023-12-03T11:51:22.649 INFO:teuthology.orchestra.run.smithi003.stderr: 10900K .......... .......... .......... .......... .......... 11% 9.90M 28s 2023-12-03T11:51:22.661 INFO:teuthology.orchestra.run.smithi003.stderr: 10950K .......... .......... .......... .......... .......... 11% 4.68M 28s 2023-12-03T11:51:22.665 INFO:teuthology.orchestra.run.smithi003.stderr: 11000K .......... .......... .......... .......... .......... 11% 8.49M 28s 2023-12-03T11:51:22.670 INFO:teuthology.orchestra.run.smithi003.stderr: 11050K .......... .......... .......... .......... .......... 11% 9.62M 28s 2023-12-03T11:51:22.681 INFO:teuthology.orchestra.run.smithi003.stderr: 11100K .......... .......... .......... .......... .......... 12% 4.31M 28s 2023-12-03T11:51:22.692 INFO:teuthology.orchestra.run.smithi003.stderr: 11150K .......... .......... .......... .......... .......... 12% 4.33M 28s 2023-12-03T11:51:22.703 INFO:teuthology.orchestra.run.smithi003.stderr: 11200K .......... .......... .......... .......... .......... 12% 4.80M 28s 2023-12-03T11:51:22.708 INFO:teuthology.orchestra.run.smithi003.stderr: 11250K .......... .......... .......... .......... .......... 12% 9.98M 28s 2023-12-03T11:51:22.723 INFO:teuthology.orchestra.run.smithi003.stderr: 11300K .......... .......... .......... .......... .......... 12% 3.10M 28s 2023-12-03T11:51:22.728 INFO:teuthology.orchestra.run.smithi003.stderr: 11350K .......... .......... .......... .......... .......... 12% 10.3M 28s 2023-12-03T11:51:22.734 INFO:teuthology.orchestra.run.smithi003.stderr: 11400K .......... .......... .......... .......... .......... 12% 8.22M 28s 2023-12-03T11:51:22.736 INFO:teuthology.orchestra.run.smithi003.stderr: 11450K .......... .......... .......... .......... .......... 12% 39.6M 27s 2023-12-03T11:51:22.741 INFO:teuthology.orchestra.run.smithi003.stderr: 11500K .......... .......... .......... .......... .......... 12% 8.30M 27s 2023-12-03T11:51:22.749 INFO:teuthology.orchestra.run.smithi003.stderr: 11550K .......... .......... .......... .......... .......... 12% 6.17M 27s 2023-12-03T11:51:22.758 INFO:teuthology.orchestra.run.smithi003.stderr: 11600K .......... .......... .......... .......... .......... 12% 7.32M 27s 2023-12-03T11:51:22.759 INFO:teuthology.orchestra.run.smithi003.stderr: 11650K .......... .......... .......... .......... .......... 12% 14.8M 27s 2023-12-03T11:51:22.764 INFO:teuthology.orchestra.run.smithi003.stderr: 11700K .......... .......... .......... .......... .......... 12% 9.83M 27s 2023-12-03T11:51:22.768 INFO:teuthology.orchestra.run.smithi003.stderr: 11750K .......... .......... .......... .......... .......... 12% 11.2M 27s 2023-12-03T11:51:22.776 INFO:teuthology.orchestra.run.smithi003.stderr: 11800K .......... .......... .......... .......... .......... 12% 6.26M 27s 2023-12-03T11:51:22.781 INFO:teuthology.orchestra.run.smithi003.stderr: 11850K .......... .......... .......... .......... .......... 12% 10.3M 27s 2023-12-03T11:51:22.789 INFO:teuthology.orchestra.run.smithi003.stderr: 11900K .......... .......... .......... .......... .......... 12% 6.38M 27s 2023-12-03T11:51:22.794 INFO:teuthology.orchestra.run.smithi003.stderr: 11950K .......... .......... .......... .......... .......... 12% 9.07M 27s 2023-12-03T11:51:22.806 INFO:teuthology.orchestra.run.smithi003.stderr: 12000K .......... .......... .......... .......... .......... 12% 4.12M 26s 2023-12-03T11:51:22.817 INFO:teuthology.orchestra.run.smithi003.stderr: 12050K .......... .......... .......... .......... .......... 13% 4.33M 26s 2023-12-03T11:51:22.823 INFO:teuthology.orchestra.run.smithi003.stderr: 12100K .......... .......... .......... .......... .......... 13% 8.84M 26s 2023-12-03T11:51:22.825 INFO:teuthology.orchestra.run.smithi003.stderr: 12150K .......... .......... .......... .......... .......... 13% 18.2M 26s 2023-12-03T11:51:22.833 INFO:teuthology.orchestra.run.smithi003.stderr: 12200K .......... .......... .......... .......... .......... 13% 6.06M 26s 2023-12-03T11:51:22.847 INFO:teuthology.orchestra.run.smithi003.stderr: 12250K .......... .......... .......... .......... .......... 13% 3.64M 26s 2023-12-03T11:51:22.858 INFO:teuthology.orchestra.run.smithi003.stderr: 12300K .......... .......... .......... .......... .......... 13% 4.22M 26s 2023-12-03T11:51:22.859 INFO:teuthology.orchestra.run.smithi003.stderr: 12350K .......... .......... .......... .......... .......... 13% 56.2M 26s 2023-12-03T11:51:22.863 INFO:teuthology.orchestra.run.smithi003.stderr: 12400K .......... .......... .......... .......... .......... 13% 11.8M 26s 2023-12-03T11:51:22.868 INFO:teuthology.orchestra.run.smithi003.stderr: 12450K .......... .......... .......... .......... .......... 13% 31.9M 26s 2023-12-03T11:51:22.876 INFO:teuthology.orchestra.run.smithi003.stderr: 12500K .......... .......... .......... .......... .......... 13% 4.49M 26s 2023-12-03T11:51:22.880 INFO:teuthology.orchestra.run.smithi003.stderr: 12550K .......... .......... .......... .......... .......... 13% 12.5M 26s 2023-12-03T11:51:22.891 INFO:teuthology.orchestra.run.smithi003.stderr: 12600K .......... .......... .......... .......... .......... 13% 4.34M 26s 2023-12-03T11:51:22.893 INFO:teuthology.orchestra.run.smithi003.stderr: 12650K .......... .......... .......... .......... .......... 13% 24.6M 25s 2023-12-03T11:51:22.895 INFO:teuthology.orchestra.run.smithi003.stderr: 12700K .......... .......... .......... .......... .......... 13% 27.0M 25s 2023-12-03T11:51:22.908 INFO:teuthology.orchestra.run.smithi003.stderr: 12750K .......... .......... .......... .......... .......... 13% 3.68M 25s 2023-12-03T11:51:22.911 INFO:teuthology.orchestra.run.smithi003.stderr: 12800K .......... .......... .......... .......... .......... 13% 15.7M 25s 2023-12-03T11:51:22.914 INFO:teuthology.orchestra.run.smithi003.stderr: 12850K .......... .......... .......... .......... .......... 13% 19.2M 25s 2023-12-03T11:51:22.916 INFO:teuthology.orchestra.run.smithi003.stderr: 12900K .......... .......... .......... .......... .......... 13% 21.6M 25s 2023-12-03T11:51:22.927 INFO:teuthology.orchestra.run.smithi003.stderr: 12950K .......... .......... .......... .......... .......... 13% 4.63M 25s 2023-12-03T11:51:23.012 INFO:teuthology.orchestra.run.smithi003.stderr: 13000K .......... .......... .......... .......... .......... 14% 4.35M 25s 2023-12-03T11:51:23.012 INFO:teuthology.orchestra.run.smithi003.stderr: 13050K .......... .......... .......... .......... .......... 14% 763K 25s 2023-12-03T11:51:23.012 INFO:teuthology.orchestra.run.smithi003.stderr: 13100K .......... .......... .......... .......... .......... 14% 226M 25s 2023-12-03T11:51:23.012 INFO:teuthology.orchestra.run.smithi003.stderr: 13150K .......... .......... .......... .......... .......... 14% 279M 25s 2023-12-03T11:51:23.012 INFO:teuthology.orchestra.run.smithi003.stderr: 13200K .......... .......... .......... .......... .......... 14% 228M 25s 2023-12-03T11:51:23.013 INFO:teuthology.orchestra.run.smithi003.stderr: 13250K .......... .......... .......... .......... .......... 14% 267M 25s 2023-12-03T11:51:23.013 INFO:teuthology.orchestra.run.smithi003.stderr: 13300K .......... .......... .......... .......... .......... 14% 226M 25s 2023-12-03T11:51:23.013 INFO:teuthology.orchestra.run.smithi003.stderr: 13350K .......... .......... .......... .......... .......... 14% 276M 25s 2023-12-03T11:51:23.013 INFO:teuthology.orchestra.run.smithi003.stderr: 13400K .......... .......... .......... .......... .......... 14% 298M 24s 2023-12-03T11:51:23.013 INFO:teuthology.orchestra.run.smithi003.stderr: 13450K .......... .......... .......... .......... .......... 14% 270M 24s 2023-12-03T11:51:23.013 INFO:teuthology.orchestra.run.smithi003.stderr: 13500K .......... .......... .......... .......... .......... 14% 265M 24s 2023-12-03T11:51:23.013 INFO:teuthology.orchestra.run.smithi003.stderr: 13550K .......... .......... .......... .......... .......... 14% 7.95M 24s 2023-12-03T11:51:23.014 INFO:teuthology.orchestra.run.smithi003.stderr: 13600K .......... .......... .......... .......... .......... 14% 15.2M 24s 2023-12-03T11:51:23.019 INFO:teuthology.orchestra.run.smithi003.stderr: 13650K .......... .......... .......... .......... .......... 14% 10.3M 24s 2023-12-03T11:51:23.025 INFO:teuthology.orchestra.run.smithi003.stderr: 13700K .......... .......... .......... .......... .......... 14% 8.47M 24s 2023-12-03T11:51:23.031 INFO:teuthology.orchestra.run.smithi003.stderr: 13750K .......... .......... .......... .......... .......... 14% 7.98M 24s 2023-12-03T11:51:23.073 INFO:teuthology.orchestra.run.smithi003.stderr: 13800K .......... .......... .......... .......... .......... 14% 1.17M 24s 2023-12-03T11:51:23.078 INFO:teuthology.orchestra.run.smithi003.stderr: 13850K .......... .......... .......... .......... .......... 14% 8.83M 24s 2023-12-03T11:51:23.082 INFO:teuthology.orchestra.run.smithi003.stderr: 13900K .......... .......... .......... .......... .......... 15% 13.7M 24s 2023-12-03T11:51:23.088 INFO:teuthology.orchestra.run.smithi003.stderr: 13950K .......... .......... .......... .......... .......... 15% 7.36M 24s 2023-12-03T11:51:23.093 INFO:teuthology.orchestra.run.smithi003.stderr: 14000K .......... .......... .......... .......... .......... 15% 9.38M 24s 2023-12-03T11:51:23.108 INFO:teuthology.orchestra.run.smithi003.stderr: 14050K .......... .......... .......... .......... .......... 15% 3.31M 24s 2023-12-03T11:51:23.113 INFO:teuthology.orchestra.run.smithi003.stderr: 14100K .......... .......... .......... .......... .......... 15% 11.3M 24s 2023-12-03T11:51:23.118 INFO:teuthology.orchestra.run.smithi003.stderr: 14150K .......... .......... .......... .......... .......... 15% 9.89M 24s 2023-12-03T11:51:23.123 INFO:teuthology.orchestra.run.smithi003.stderr: 14200K .......... .......... .......... .......... .......... 15% 9.29M 24s 2023-12-03T11:51:23.129 INFO:teuthology.orchestra.run.smithi003.stderr: 14250K .......... .......... .......... .......... .......... 15% 7.85M 23s 2023-12-03T11:51:23.134 INFO:teuthology.orchestra.run.smithi003.stderr: 14300K .......... .......... .......... .......... .......... 15% 10.3M 23s 2023-12-03T11:51:23.138 INFO:teuthology.orchestra.run.smithi003.stderr: 14350K .......... .......... .......... .......... .......... 15% 10.9M 23s 2023-12-03T11:51:23.149 INFO:teuthology.orchestra.run.smithi003.stderr: 14400K .......... .......... .......... .......... .......... 15% 4.62M 23s 2023-12-03T11:51:23.154 INFO:teuthology.orchestra.run.smithi003.stderr: 14450K .......... .......... .......... .......... .......... 15% 8.81M 23s 2023-12-03T11:51:23.164 INFO:teuthology.orchestra.run.smithi003.stderr: 14500K .......... .......... .......... .......... .......... 15% 5.26M 23s 2023-12-03T11:51:23.173 INFO:teuthology.orchestra.run.smithi003.stderr: 14550K .......... .......... .......... .......... .......... 15% 7.49M 23s 2023-12-03T11:51:23.181 INFO:teuthology.orchestra.run.smithi003.stderr: 14600K .......... .......... .......... .......... .......... 15% 4.72M 23s 2023-12-03T11:51:23.187 INFO:teuthology.orchestra.run.smithi003.stderr: 14650K .......... .......... .......... .......... .......... 15% 8.07M 23s 2023-12-03T11:51:23.195 INFO:teuthology.orchestra.run.smithi003.stderr: 14700K .......... .......... .......... .......... .......... 15% 6.18M 23s 2023-12-03T11:51:23.197 INFO:teuthology.orchestra.run.smithi003.stderr: 14750K .......... .......... .......... .......... .......... 15% 23.4M 23s 2023-12-03T11:51:23.200 INFO:teuthology.orchestra.run.smithi003.stderr: 14800K .......... .......... .......... .......... .......... 15% 13.8M 23s 2023-12-03T11:51:23.209 INFO:teuthology.orchestra.run.smithi003.stderr: 14850K .......... .......... .......... .......... .......... 16% 5.74M 23s 2023-12-03T11:51:23.213 INFO:teuthology.orchestra.run.smithi003.stderr: 14900K .......... .......... .......... .......... .......... 16% 11.2M 23s 2023-12-03T11:51:23.218 INFO:teuthology.orchestra.run.smithi003.stderr: 14950K .......... .......... .......... .......... .......... 16% 10.3M 23s 2023-12-03T11:51:23.223 INFO:teuthology.orchestra.run.smithi003.stderr: 15000K .......... .......... .......... .......... .......... 16% 9.37M 23s 2023-12-03T11:51:23.234 INFO:teuthology.orchestra.run.smithi003.stderr: 15050K .......... .......... .......... .......... .......... 16% 4.20M 23s 2023-12-03T11:51:23.239 INFO:teuthology.orchestra.run.smithi003.stderr: 15100K .......... .......... .......... .......... .......... 16% 10.7M 22s 2023-12-03T11:51:23.243 INFO:teuthology.orchestra.run.smithi003.stderr: 15150K .......... .......... .......... .......... .......... 16% 14.8M 22s 2023-12-03T11:51:23.245 INFO:teuthology.orchestra.run.smithi003.stderr: 15200K .......... .......... .......... .......... .......... 16% 24.2M 22s 2023-12-03T11:51:23.251 INFO:teuthology.orchestra.run.smithi003.stderr: 15250K .......... .......... .......... .......... .......... 16% 7.50M 22s 2023-12-03T11:51:23.258 INFO:teuthology.orchestra.run.smithi003.stderr: 15300K .......... .......... .......... .......... .......... 16% 6.71M 22s 2023-12-03T11:51:23.264 INFO:teuthology.orchestra.run.smithi003.stderr: 15350K .......... .......... .......... .......... .......... 16% 8.99M 22s 2023-12-03T11:51:23.269 INFO:teuthology.orchestra.run.smithi003.stderr: 15400K .......... .......... .......... .......... .......... 16% 8.86M 22s 2023-12-03T11:51:23.283 INFO:teuthology.orchestra.run.smithi003.stderr: 15450K .......... .......... .......... .......... .......... 16% 3.42M 22s 2023-12-03T11:51:23.286 INFO:teuthology.orchestra.run.smithi003.stderr: 15500K .......... .......... .......... .......... .......... 16% 20.2M 22s 2023-12-03T11:51:23.290 INFO:teuthology.orchestra.run.smithi003.stderr: 15550K .......... .......... .......... .......... .......... 16% 10.8M 22s 2023-12-03T11:51:23.297 INFO:teuthology.orchestra.run.smithi003.stderr: 15600K .......... .......... .......... .......... .......... 16% 8.01M 22s 2023-12-03T11:51:23.301 INFO:teuthology.orchestra.run.smithi003.stderr: 15650K .......... .......... .......... .......... .......... 16% 11.8M 22s 2023-12-03T11:51:23.306 INFO:teuthology.orchestra.run.smithi003.stderr: 15700K .......... .......... .......... .......... .......... 16% 10.2M 22s 2023-12-03T11:51:23.310 INFO:teuthology.orchestra.run.smithi003.stderr: 15750K .......... .......... .......... .......... .......... 17% 10.7M 22s 2023-12-03T11:51:23.315 INFO:teuthology.orchestra.run.smithi003.stderr: 15800K .......... .......... .......... .......... .......... 17% 9.58M 22s 2023-12-03T11:51:23.319 INFO:teuthology.orchestra.run.smithi003.stderr: 15850K .......... .......... .......... .......... .......... 17% 12.1M 22s 2023-12-03T11:51:23.327 INFO:teuthology.orchestra.run.smithi003.stderr: 15900K .......... .......... .......... .......... .......... 17% 6.14M 22s 2023-12-03T11:51:23.342 INFO:teuthology.orchestra.run.smithi003.stderr: 15950K .......... .......... .......... .......... .......... 17% 3.21M 22s 2023-12-03T11:51:23.347 INFO:teuthology.orchestra.run.smithi003.stderr: 16000K .......... .......... .......... .......... .......... 17% 10.2M 21s 2023-12-03T11:51:23.351 INFO:teuthology.orchestra.run.smithi003.stderr: 16050K .......... .......... .......... .......... .......... 17% 12.2M 21s 2023-12-03T11:51:23.356 INFO:teuthology.orchestra.run.smithi003.stderr: 16100K .......... .......... .......... .......... .......... 17% 11.2M 21s 2023-12-03T11:51:23.359 INFO:teuthology.orchestra.run.smithi003.stderr: 16150K .......... .......... .......... .......... .......... 17% 14.8M 21s 2023-12-03T11:51:23.364 INFO:teuthology.orchestra.run.smithi003.stderr: 16200K .......... .......... .......... .......... .......... 17% 8.49M 21s 2023-12-03T11:51:23.381 INFO:teuthology.orchestra.run.smithi003.stderr: 16250K .......... .......... .......... .......... .......... 17% 3.49M 21s 2023-12-03T11:51:23.382 INFO:teuthology.orchestra.run.smithi003.stderr: 16300K .......... .......... .......... .......... .......... 17% 13.2M 21s 2023-12-03T11:51:23.390 INFO:teuthology.orchestra.run.smithi003.stderr: 16350K .......... .......... .......... .......... .......... 17% 6.80M 21s 2023-12-03T11:51:23.395 INFO:teuthology.orchestra.run.smithi003.stderr: 16400K .......... .......... .......... .......... .......... 17% 8.18M 21s 2023-12-03T11:51:23.399 INFO:teuthology.orchestra.run.smithi003.stderr: 16450K .......... .......... .......... .......... .......... 17% 13.3M 21s 2023-12-03T11:51:23.404 INFO:teuthology.orchestra.run.smithi003.stderr: 16500K .......... .......... .......... .......... .......... 17% 9.53M 21s 2023-12-03T11:51:23.408 INFO:teuthology.orchestra.run.smithi003.stderr: 16550K .......... .......... .......... .......... .......... 17% 13.2M 21s 2023-12-03T11:51:23.412 INFO:teuthology.orchestra.run.smithi003.stderr: 16600K .......... .......... .......... .......... .......... 17% 11.3M 21s 2023-12-03T11:51:23.419 INFO:teuthology.orchestra.run.smithi003.stderr: 16650K .......... .......... .......... .......... .......... 17% 7.23M 21s 2023-12-03T11:51:23.430 INFO:teuthology.orchestra.run.smithi003.stderr: 16700K .......... .......... .......... .......... .......... 18% 4.52M 21s 2023-12-03T11:51:23.443 INFO:teuthology.orchestra.run.smithi003.stderr: 16750K .......... .......... .......... .......... .......... 18% 3.83M 21s 2023-12-03T11:51:23.449 INFO:teuthology.orchestra.run.smithi003.stderr: 16800K .......... .......... .......... .......... .......... 18% 8.03M 21s 2023-12-03T11:51:23.453 INFO:teuthology.orchestra.run.smithi003.stderr: 16850K .......... .......... .......... .......... .......... 18% 11.4M 21s 2023-12-03T11:51:23.463 INFO:teuthology.orchestra.run.smithi003.stderr: 16900K .......... .......... .......... .......... .......... 18% 4.93M 21s 2023-12-03T11:51:23.466 INFO:teuthology.orchestra.run.smithi003.stderr: 16950K .......... .......... .......... .......... .......... 18% 18.0M 21s 2023-12-03T11:51:23.468 INFO:teuthology.orchestra.run.smithi003.stderr: 17000K .......... .......... .......... .......... .......... 18% 15.8M 20s 2023-12-03T11:51:23.472 INFO:teuthology.orchestra.run.smithi003.stderr: 17050K .......... .......... .......... .......... .......... 18% 15.3M 20s 2023-12-03T11:51:23.475 INFO:teuthology.orchestra.run.smithi003.stderr: 17100K .......... .......... .......... .......... .......... 18% 14.1M 20s 2023-12-03T11:51:23.485 INFO:teuthology.orchestra.run.smithi003.stderr: 17150K .......... .......... .......... .......... .......... 18% 6.48M 20s 2023-12-03T11:51:23.488 INFO:teuthology.orchestra.run.smithi003.stderr: 17200K .......... .......... .......... .......... .......... 18% 9.02M 20s 2023-12-03T11:51:23.495 INFO:teuthology.orchestra.run.smithi003.stderr: 17250K .......... .......... .......... .......... .......... 18% 7.41M 20s 2023-12-03T11:51:23.504 INFO:teuthology.orchestra.run.smithi003.stderr: 17300K .......... .......... .......... .......... .......... 18% 5.20M 20s 2023-12-03T11:51:23.512 INFO:teuthology.orchestra.run.smithi003.stderr: 17350K .......... .......... .......... .......... .......... 18% 6.01M 20s 2023-12-03T11:51:23.518 INFO:teuthology.orchestra.run.smithi003.stderr: 17400K .......... .......... .......... .......... .......... 18% 8.16M 20s 2023-12-03T11:51:23.524 INFO:teuthology.orchestra.run.smithi003.stderr: 17450K .......... .......... .......... .......... .......... 18% 8.28M 20s 2023-12-03T11:51:23.531 INFO:teuthology.orchestra.run.smithi003.stderr: 17500K .......... .......... .......... .......... .......... 18% 6.79M 20s 2023-12-03T11:51:23.539 INFO:teuthology.orchestra.run.smithi003.stderr: 17550K .......... .......... .......... .......... .......... 18% 9.11M 20s 2023-12-03T11:51:23.543 INFO:teuthology.orchestra.run.smithi003.stderr: 17600K .......... .......... .......... .......... .......... 18% 8.17M 20s 2023-12-03T11:51:23.551 INFO:teuthology.orchestra.run.smithi003.stderr: 17650K .......... .......... .......... .......... .......... 19% 5.81M 20s 2023-12-03T11:51:23.559 INFO:teuthology.orchestra.run.smithi003.stderr: 17700K .......... .......... .......... .......... .......... 19% 5.97M 20s 2023-12-03T11:51:23.563 INFO:teuthology.orchestra.run.smithi003.stderr: 17750K .......... .......... .......... .......... .......... 19% 13.2M 20s 2023-12-03T11:51:23.567 INFO:teuthology.orchestra.run.smithi003.stderr: 17800K .......... .......... .......... .......... .......... 19% 11.0M 20s 2023-12-03T11:51:23.575 INFO:teuthology.orchestra.run.smithi003.stderr: 17850K .......... .......... .......... .......... .......... 19% 7.13M 20s 2023-12-03T11:51:23.580 INFO:teuthology.orchestra.run.smithi003.stderr: 17900K .......... .......... .......... .......... .......... 19% 8.76M 20s 2023-12-03T11:51:23.586 INFO:teuthology.orchestra.run.smithi003.stderr: 17950K .......... .......... .......... .......... .......... 19% 7.48M 20s 2023-12-03T11:51:23.594 INFO:teuthology.orchestra.run.smithi003.stderr: 18000K .......... .......... .......... .......... .......... 19% 6.82M 20s 2023-12-03T11:51:23.598 INFO:teuthology.orchestra.run.smithi003.stderr: 18050K .......... .......... .......... .......... .......... 19% 11.4M 20s 2023-12-03T11:51:23.605 INFO:teuthology.orchestra.run.smithi003.stderr: 18100K .......... .......... .......... .......... .......... 19% 10.3M 20s 2023-12-03T11:51:23.609 INFO:teuthology.orchestra.run.smithi003.stderr: 18150K .......... .......... .......... .......... .......... 19% 7.09M 19s 2023-12-03T11:51:23.615 INFO:teuthology.orchestra.run.smithi003.stderr: 18200K .......... .......... .......... .......... .......... 19% 9.20M 19s 2023-12-03T11:51:23.620 INFO:teuthology.orchestra.run.smithi003.stderr: 18250K .......... .......... .......... .......... .......... 19% 10.4M 19s 2023-12-03T11:51:23.627 INFO:teuthology.orchestra.run.smithi003.stderr: 18300K .......... .......... .......... .......... .......... 19% 6.22M 19s 2023-12-03T11:51:23.635 INFO:teuthology.orchestra.run.smithi003.stderr: 18350K .......... .......... .......... .......... .......... 19% 5.93M 19s 2023-12-03T11:51:23.640 INFO:teuthology.orchestra.run.smithi003.stderr: 18400K .......... .......... .......... .......... .......... 19% 10.3M 19s 2023-12-03T11:51:23.647 INFO:teuthology.orchestra.run.smithi003.stderr: 18450K .......... .......... .......... .......... .......... 19% 7.19M 19s 2023-12-03T11:51:23.652 INFO:teuthology.orchestra.run.smithi003.stderr: 18500K .......... .......... .......... .......... .......... 19% 10.8M 19s 2023-12-03T11:51:23.655 INFO:teuthology.orchestra.run.smithi003.stderr: 18550K .......... .......... .......... .......... .......... 20% 12.5M 19s 2023-12-03T11:51:23.658 INFO:teuthology.orchestra.run.smithi003.stderr: 18600K .......... .......... .......... .......... .......... 20% 17.6M 19s 2023-12-03T11:51:23.663 INFO:teuthology.orchestra.run.smithi003.stderr: 18650K .......... .......... .......... .......... .......... 20% 10.1M 19s 2023-12-03T11:51:23.674 INFO:teuthology.orchestra.run.smithi003.stderr: 18700K .......... .......... .......... .......... .......... 20% 4.67M 19s 2023-12-03T11:51:23.680 INFO:teuthology.orchestra.run.smithi003.stderr: 18750K .......... .......... .......... .......... .......... 20% 7.44M 19s 2023-12-03T11:51:23.686 INFO:teuthology.orchestra.run.smithi003.stderr: 18800K .......... .......... .......... .......... .......... 20% 8.16M 19s 2023-12-03T11:51:23.695 INFO:teuthology.orchestra.run.smithi003.stderr: 18850K .......... .......... .......... .......... .......... 20% 5.46M 19s 2023-12-03T11:51:23.700 INFO:teuthology.orchestra.run.smithi003.stderr: 18900K .......... .......... .......... .......... .......... 20% 8.72M 19s 2023-12-03T11:51:23.707 INFO:teuthology.orchestra.run.smithi003.stderr: 18950K .......... .......... .......... .......... .......... 20% 7.29M 19s 2023-12-03T11:51:23.716 INFO:teuthology.orchestra.run.smithi003.stderr: 19000K .......... .......... .......... .......... .......... 20% 5.45M 19s 2023-12-03T11:51:23.721 INFO:teuthology.orchestra.run.smithi003.stderr: 19050K .......... .......... .......... .......... .......... 20% 10.1M 19s 2023-12-03T11:51:23.726 INFO:teuthology.orchestra.run.smithi003.stderr: 19100K .......... .......... .......... .......... .......... 20% 10.1M 19s 2023-12-03T11:51:23.732 INFO:teuthology.orchestra.run.smithi003.stderr: 19150K .......... .......... .......... .......... .......... 20% 7.71M 19s 2023-12-03T11:51:23.738 INFO:teuthology.orchestra.run.smithi003.stderr: 19200K .......... .......... .......... .......... .......... 20% 8.37M 19s 2023-12-03T11:51:23.741 INFO:teuthology.orchestra.run.smithi003.stderr: 19250K .......... .......... .......... .......... .......... 20% 14.0M 19s 2023-12-03T11:51:23.746 INFO:teuthology.orchestra.run.smithi003.stderr: 19300K .......... .......... .......... .......... .......... 20% 11.0M 19s 2023-12-03T11:51:23.752 INFO:teuthology.orchestra.run.smithi003.stderr: 19350K .......... .......... .......... .......... .......... 20% 8.36M 19s 2023-12-03T11:51:23.755 INFO:teuthology.orchestra.run.smithi003.stderr: 19400K .......... .......... .......... .......... .......... 20% 13.7M 18s 2023-12-03T11:51:23.759 INFO:teuthology.orchestra.run.smithi003.stderr: 19450K .......... .......... .......... .......... .......... 20% 12.8M 18s 2023-12-03T11:51:23.762 INFO:teuthology.orchestra.run.smithi003.stderr: 19500K .......... .......... .......... .......... .......... 21% 14.9M 18s 2023-12-03T11:51:23.767 INFO:teuthology.orchestra.run.smithi003.stderr: 19550K .......... .......... .......... .......... .......... 21% 9.92M 18s 2023-12-03T11:51:23.772 INFO:teuthology.orchestra.run.smithi003.stderr: 19600K .......... .......... .......... .......... .......... 21% 11.1M 18s 2023-12-03T11:51:23.778 INFO:teuthology.orchestra.run.smithi003.stderr: 19650K .......... .......... .......... .......... .......... 21% 7.98M 18s 2023-12-03T11:51:23.783 INFO:teuthology.orchestra.run.smithi003.stderr: 19700K .......... .......... .......... .......... .......... 21% 9.29M 18s 2023-12-03T11:51:23.788 INFO:teuthology.orchestra.run.smithi003.stderr: 19750K .......... .......... .......... .......... .......... 21% 10.5M 18s 2023-12-03T11:51:23.796 INFO:teuthology.orchestra.run.smithi003.stderr: 19800K .......... .......... .......... .......... .......... 21% 5.89M 18s 2023-12-03T11:51:23.804 INFO:teuthology.orchestra.run.smithi003.stderr: 19850K .......... .......... .......... .......... .......... 21% 5.90M 18s 2023-12-03T11:51:23.814 INFO:teuthology.orchestra.run.smithi003.stderr: 19900K .......... .......... .......... .......... .......... 21% 4.97M 18s 2023-12-03T11:51:23.822 INFO:teuthology.orchestra.run.smithi003.stderr: 19950K .......... .......... .......... .......... .......... 21% 6.45M 18s 2023-12-03T11:51:23.826 INFO:teuthology.orchestra.run.smithi003.stderr: 20000K .......... .......... .......... .......... .......... 21% 11.3M 18s 2023-12-03T11:51:23.838 INFO:teuthology.orchestra.run.smithi003.stderr: 20050K .......... .......... .......... .......... .......... 21% 4.16M 18s 2023-12-03T11:51:23.845 INFO:teuthology.orchestra.run.smithi003.stderr: 20100K .......... .......... .......... .......... .......... 21% 6.64M 18s 2023-12-03T11:51:23.851 INFO:teuthology.orchestra.run.smithi003.stderr: 20150K .......... .......... .......... .......... .......... 21% 8.02M 18s 2023-12-03T11:51:23.855 INFO:teuthology.orchestra.run.smithi003.stderr: 20200K .......... .......... .......... .......... .......... 21% 12.7M 18s 2023-12-03T11:51:23.859 INFO:teuthology.orchestra.run.smithi003.stderr: 20250K .......... .......... .......... .......... .......... 21% 13.6M 18s 2023-12-03T11:51:23.862 INFO:teuthology.orchestra.run.smithi003.stderr: 20300K .......... .......... .......... .......... .......... 21% 14.2M 18s 2023-12-03T11:51:23.867 INFO:teuthology.orchestra.run.smithi003.stderr: 20350K .......... .......... .......... .......... .......... 21% 9.86M 18s 2023-12-03T11:51:23.872 INFO:teuthology.orchestra.run.smithi003.stderr: 20400K .......... .......... .......... .......... .......... 22% 10.2M 18s 2023-12-03T11:51:23.877 INFO:teuthology.orchestra.run.smithi003.stderr: 20450K .......... .......... .......... .......... .......... 22% 8.76M 18s 2023-12-03T11:51:23.882 INFO:teuthology.orchestra.run.smithi003.stderr: 20500K .......... .......... .......... .......... .......... 22% 10.9M 18s 2023-12-03T11:51:23.887 INFO:teuthology.orchestra.run.smithi003.stderr: 20550K .......... .......... .......... .......... .......... 22% 10.1M 18s 2023-12-03T11:51:23.891 INFO:teuthology.orchestra.run.smithi003.stderr: 20600K .......... .......... .......... .......... .......... 22% 11.1M 18s 2023-12-03T11:51:23.898 INFO:teuthology.orchestra.run.smithi003.stderr: 20650K .......... .......... .......... .......... .......... 22% 7.18M 18s 2023-12-03T11:51:23.902 INFO:teuthology.orchestra.run.smithi003.stderr: 20700K .......... .......... .......... .......... .......... 22% 11.8M 18s 2023-12-03T11:51:23.907 INFO:teuthology.orchestra.run.smithi003.stderr: 20750K .......... .......... .......... .......... .......... 22% 10.4M 17s 2023-12-03T11:51:23.911 INFO:teuthology.orchestra.run.smithi003.stderr: 20800K .......... .......... .......... .......... .......... 22% 10.7M 17s 2023-12-03T11:51:23.916 INFO:teuthology.orchestra.run.smithi003.stderr: 20850K .......... .......... .......... .......... .......... 22% 10.2M 17s 2023-12-03T11:51:23.923 INFO:teuthology.orchestra.run.smithi003.stderr: 20900K .......... .......... .......... .......... .......... 22% 7.23M 17s 2023-12-03T11:51:23.931 INFO:teuthology.orchestra.run.smithi003.stderr: 20950K .......... .......... .......... .......... .......... 22% 6.04M 17s 2023-12-03T11:51:23.939 INFO:teuthology.orchestra.run.smithi003.stderr: 21000K .......... .......... .......... .......... .......... 22% 5.81M 17s 2023-12-03T11:51:23.946 INFO:teuthology.orchestra.run.smithi003.stderr: 21050K .......... .......... .......... .......... .......... 22% 7.46M 17s 2023-12-03T11:51:23.950 INFO:teuthology.orchestra.run.smithi003.stderr: 21100K .......... .......... .......... .......... .......... 22% 11.1M 17s 2023-12-03T11:51:23.956 INFO:teuthology.orchestra.run.smithi003.stderr: 21150K .......... .......... .......... .......... .......... 22% 7.68M 17s 2023-12-03T11:51:23.963 INFO:teuthology.orchestra.run.smithi003.stderr: 21200K .......... .......... .......... .......... .......... 22% 7.50M 17s 2023-12-03T11:51:23.970 INFO:teuthology.orchestra.run.smithi003.stderr: 21250K .......... .......... .......... .......... .......... 22% 13.1M 17s 2023-12-03T11:51:23.973 INFO:teuthology.orchestra.run.smithi003.stderr: 21300K .......... .......... .......... .......... .......... 22% 8.00M 17s 2023-12-03T11:51:23.977 INFO:teuthology.orchestra.run.smithi003.stderr: 21350K .......... .......... .......... .......... .......... 23% 11.1M 17s 2023-12-03T11:51:23.981 INFO:teuthology.orchestra.run.smithi003.stderr: 21400K .......... .......... .......... .......... .......... 23% 13.4M 17s 2023-12-03T11:51:23.985 INFO:teuthology.orchestra.run.smithi003.stderr: 21450K .......... .......... .......... .......... .......... 23% 13.0M 17s 2023-12-03T11:51:23.990 INFO:teuthology.orchestra.run.smithi003.stderr: 21500K .......... .......... .......... .......... .......... 23% 11.5M 17s 2023-12-03T11:51:23.994 INFO:teuthology.orchestra.run.smithi003.stderr: 21550K .......... .......... .......... .......... .......... 23% 9.66M 17s 2023-12-03T11:51:23.998 INFO:teuthology.orchestra.run.smithi003.stderr: 21600K .......... .......... .......... .......... .......... 23% 11.5M 17s 2023-12-03T11:51:24.003 INFO:teuthology.orchestra.run.smithi003.stderr: 21650K .......... .......... .......... .......... .......... 23% 10.6M 17s 2023-12-03T11:51:24.006 INFO:teuthology.orchestra.run.smithi003.stderr: 21700K .......... .......... .......... .......... .......... 23% 14.4M 17s 2023-12-03T11:51:24.010 INFO:teuthology.orchestra.run.smithi003.stderr: 21750K .......... .......... .......... .......... .......... 23% 13.5M 17s 2023-12-03T11:51:24.015 INFO:teuthology.orchestra.run.smithi003.stderr: 21800K .......... .......... .......... .......... .......... 23% 9.35M 17s 2023-12-03T11:51:24.020 INFO:teuthology.orchestra.run.smithi003.stderr: 21850K .......... .......... .......... .......... .......... 23% 9.52M 17s 2023-12-03T11:51:24.025 INFO:teuthology.orchestra.run.smithi003.stderr: 21900K .......... .......... .......... .......... .......... 23% 12.5M 17s 2023-12-03T11:51:24.029 INFO:teuthology.orchestra.run.smithi003.stderr: 21950K .......... .......... .......... .......... .......... 23% 10.1M 17s 2023-12-03T11:51:24.032 INFO:teuthology.orchestra.run.smithi003.stderr: 22000K .......... .......... .......... .......... .......... 23% 15.5M 17s 2023-12-03T11:51:24.039 INFO:teuthology.orchestra.run.smithi003.stderr: 22050K .......... .......... .......... .......... .......... 23% 7.26M 17s 2023-12-03T11:51:24.046 INFO:teuthology.orchestra.run.smithi003.stderr: 22100K .......... .......... .......... .......... .......... 23% 6.63M 17s 2023-12-03T11:51:24.055 INFO:teuthology.orchestra.run.smithi003.stderr: 22150K .......... .......... .......... .......... .......... 23% 5.54M 17s 2023-12-03T11:51:24.059 INFO:teuthology.orchestra.run.smithi003.stderr: 22200K .......... .......... .......... .......... .......... 23% 12.0M 17s 2023-12-03T11:51:24.064 INFO:teuthology.orchestra.run.smithi003.stderr: 22250K .......... .......... .......... .......... .......... 24% 9.95M 16s 2023-12-03T11:51:24.072 INFO:teuthology.orchestra.run.smithi003.stderr: 22300K .......... .......... .......... .......... .......... 24% 5.88M 16s 2023-12-03T11:51:24.079 INFO:teuthology.orchestra.run.smithi003.stderr: 22350K .......... .......... .......... .......... .......... 24% 7.84M 16s 2023-12-03T11:51:24.082 INFO:teuthology.orchestra.run.smithi003.stderr: 22400K .......... .......... .......... .......... .......... 24% 15.9M 16s 2023-12-03T11:51:24.087 INFO:teuthology.orchestra.run.smithi003.stderr: 22450K .......... .......... .......... .......... .......... 24% 9.95M 16s 2023-12-03T11:51:24.090 INFO:teuthology.orchestra.run.smithi003.stderr: 22500K .......... .......... .......... .......... .......... 24% 13.2M 16s 2023-12-03T11:51:24.096 INFO:teuthology.orchestra.run.smithi003.stderr: 22550K .......... .......... .......... .......... .......... 24% 9.03M 16s 2023-12-03T11:51:24.100 INFO:teuthology.orchestra.run.smithi003.stderr: 22600K .......... .......... .......... .......... .......... 24% 13.3M 16s 2023-12-03T11:51:24.104 INFO:teuthology.orchestra.run.smithi003.stderr: 22650K .......... .......... .......... .......... .......... 24% 12.2M 16s 2023-12-03T11:51:24.107 INFO:teuthology.orchestra.run.smithi003.stderr: 22700K .......... .......... .......... .......... .......... 24% 13.3M 16s 2023-12-03T11:51:24.112 INFO:teuthology.orchestra.run.smithi003.stderr: 22750K .......... .......... .......... .......... .......... 24% 9.46M 16s 2023-12-03T11:51:24.116 INFO:teuthology.orchestra.run.smithi003.stderr: 22800K .......... .......... .......... .......... .......... 24% 13.0M 16s 2023-12-03T11:51:24.121 INFO:teuthology.orchestra.run.smithi003.stderr: 22850K .......... .......... .......... .......... .......... 24% 10.0M 16s 2023-12-03T11:51:24.127 INFO:teuthology.orchestra.run.smithi003.stderr: 22900K .......... .......... .......... .......... .......... 24% 11.1M 16s 2023-12-03T11:51:24.131 INFO:teuthology.orchestra.run.smithi003.stderr: 22950K .......... .......... .......... .......... .......... 24% 7.78M 16s 2023-12-03T11:51:24.136 INFO:teuthology.orchestra.run.smithi003.stderr: 23000K .......... .......... .......... .......... .......... 24% 10.2M 16s 2023-12-03T11:51:24.142 INFO:teuthology.orchestra.run.smithi003.stderr: 23050K .......... .......... .......... .......... .......... 24% 9.25M 16s 2023-12-03T11:51:24.145 INFO:teuthology.orchestra.run.smithi003.stderr: 23100K .......... .......... .......... .......... .......... 24% 13.1M 16s 2023-12-03T11:51:24.149 INFO:teuthology.orchestra.run.smithi003.stderr: 23150K .......... .......... .......... .......... .......... 24% 14.6M 16s 2023-12-03T11:51:24.152 INFO:teuthology.orchestra.run.smithi003.stderr: 23200K .......... .......... .......... .......... .......... 25% 13.2M 16s 2023-12-03T11:51:24.157 INFO:teuthology.orchestra.run.smithi003.stderr: 23250K .......... .......... .......... .......... .......... 25% 10.1M 16s 2023-12-03T11:51:24.165 INFO:teuthology.orchestra.run.smithi003.stderr: 23300K .......... .......... .......... .......... .......... 25% 8.84M 16s 2023-12-03T11:51:24.174 INFO:teuthology.orchestra.run.smithi003.stderr: 23350K .......... .......... .......... .......... .......... 25% 4.39M 16s 2023-12-03T11:51:24.177 INFO:teuthology.orchestra.run.smithi003.stderr: 23400K .......... .......... .......... .......... .......... 25% 12.8M 16s 2023-12-03T11:51:24.184 INFO:teuthology.orchestra.run.smithi003.stderr: 23450K .......... .......... .......... .......... .......... 25% 8.23M 16s 2023-12-03T11:51:24.190 INFO:teuthology.orchestra.run.smithi003.stderr: 23500K .......... .......... .......... .......... .......... 25% 7.41M 16s 2023-12-03T11:51:24.196 INFO:teuthology.orchestra.run.smithi003.stderr: 23550K .......... .......... .......... .......... .......... 25% 8.59M 16s 2023-12-03T11:51:24.199 INFO:teuthology.orchestra.run.smithi003.stderr: 23600K .......... .......... .......... .......... .......... 25% 16.1M 16s 2023-12-03T11:51:24.203 INFO:teuthology.orchestra.run.smithi003.stderr: 23650K .......... .......... .......... .......... .......... 25% 11.2M 16s 2023-12-03T11:51:24.206 INFO:teuthology.orchestra.run.smithi003.stderr: 23700K .......... .......... .......... .......... .......... 25% 17.7M 16s 2023-12-03T11:51:24.209 INFO:teuthology.orchestra.run.smithi003.stderr: 23750K .......... .......... .......... .......... .......... 25% 18.4M 16s 2023-12-03T11:51:24.212 INFO:teuthology.orchestra.run.smithi003.stderr: 23800K .......... .......... .......... .......... .......... 25% 15.4M 15s 2023-12-03T11:51:24.214 INFO:teuthology.orchestra.run.smithi003.stderr: 23850K .......... .......... .......... .......... .......... 25% 23.3M 15s 2023-12-03T11:51:24.217 INFO:teuthology.orchestra.run.smithi003.stderr: 23900K .......... .......... .......... .......... .......... 25% 15.4M 15s 2023-12-03T11:51:24.221 INFO:teuthology.orchestra.run.smithi003.stderr: 23950K .......... .......... .......... .......... .......... 25% 12.4M 15s 2023-12-03T11:51:24.225 INFO:teuthology.orchestra.run.smithi003.stderr: 24000K .......... .......... .......... .......... .......... 25% 13.2M 15s 2023-12-03T11:51:24.229 INFO:teuthology.orchestra.run.smithi003.stderr: 24050K .......... .......... .......... .......... .......... 25% 10.0M 15s 2023-12-03T11:51:24.234 INFO:teuthology.orchestra.run.smithi003.stderr: 24100K .......... .......... .......... .......... .......... 25% 16.2M 15s 2023-12-03T11:51:24.238 INFO:teuthology.orchestra.run.smithi003.stderr: 24150K .......... .......... .......... .......... .......... 26% 8.90M 15s 2023-12-03T11:51:24.241 INFO:teuthology.orchestra.run.smithi003.stderr: 24200K .......... .......... .......... .......... .......... 26% 14.7M 15s 2023-12-03T11:51:24.247 INFO:teuthology.orchestra.run.smithi003.stderr: 24250K .......... .......... .......... .......... .......... 26% 9.09M 15s 2023-12-03T11:51:24.251 INFO:teuthology.orchestra.run.smithi003.stderr: 24300K .......... .......... .......... .......... .......... 26% 11.5M 15s 2023-12-03T11:51:24.256 INFO:teuthology.orchestra.run.smithi003.stderr: 24350K .......... .......... .......... .......... .......... 26% 10.7M 15s 2023-12-03T11:51:24.261 INFO:teuthology.orchestra.run.smithi003.stderr: 24400K .......... .......... .......... .......... .......... 26% 9.44M 15s 2023-12-03T11:51:24.265 INFO:teuthology.orchestra.run.smithi003.stderr: 24450K .......... .......... .......... .......... .......... 26% 11.4M 15s 2023-12-03T11:51:24.268 INFO:teuthology.orchestra.run.smithi003.stderr: 24500K .......... .......... .......... .......... .......... 26% 15.1M 15s 2023-12-03T11:51:24.272 INFO:teuthology.orchestra.run.smithi003.stderr: 24550K .......... .......... .......... .......... .......... 26% 12.5M 15s 2023-12-03T11:51:24.278 INFO:teuthology.orchestra.run.smithi003.stderr: 24600K .......... .......... .......... .......... .......... 26% 8.90M 15s 2023-12-03T11:51:24.284 INFO:teuthology.orchestra.run.smithi003.stderr: 24650K .......... .......... .......... .......... .......... 26% 7.58M 15s 2023-12-03T11:51:24.289 INFO:teuthology.orchestra.run.smithi003.stderr: 24700K .......... .......... .......... .......... .......... 26% 9.86M 15s 2023-12-03T11:51:24.292 INFO:teuthology.orchestra.run.smithi003.stderr: 24750K .......... .......... .......... .......... .......... 26% 15.8M 15s 2023-12-03T11:51:24.296 INFO:teuthology.orchestra.run.smithi003.stderr: 24800K .......... .......... .......... .......... .......... 26% 12.6M 15s 2023-12-03T11:51:24.300 INFO:teuthology.orchestra.run.smithi003.stderr: 24850K .......... .......... .......... .......... .......... 26% 18.1M 15s 2023-12-03T11:51:24.302 INFO:teuthology.orchestra.run.smithi003.stderr: 24900K .......... .......... .......... .......... .......... 26% 15.3M 15s 2023-12-03T11:51:24.304 INFO:teuthology.orchestra.run.smithi003.stderr: 24950K .......... .......... .......... .......... .......... 26% 23.2M 15s 2023-12-03T11:51:24.306 INFO:teuthology.orchestra.run.smithi003.stderr: 25000K .......... .......... .......... .......... .......... 26% 23.5M 15s 2023-12-03T11:51:24.309 INFO:teuthology.orchestra.run.smithi003.stderr: 25050K .......... .......... .......... .......... .......... 27% 15.2M 15s 2023-12-03T11:51:24.314 INFO:teuthology.orchestra.run.smithi003.stderr: 25100K .......... .......... .......... .......... .......... 27% 10.1M 15s 2023-12-03T11:51:24.318 INFO:teuthology.orchestra.run.smithi003.stderr: 25150K .......... .......... .......... .......... .......... 27% 12.1M 15s 2023-12-03T11:51:24.321 INFO:teuthology.orchestra.run.smithi003.stderr: 25200K .......... .......... .......... .......... .......... 27% 15.3M 15s 2023-12-03T11:51:24.324 INFO:teuthology.orchestra.run.smithi003.stderr: 25250K .......... .......... .......... .......... .......... 27% 15.5M 15s 2023-12-03T11:51:24.329 INFO:teuthology.orchestra.run.smithi003.stderr: 25300K .......... .......... .......... .......... .......... 27% 12.2M 15s 2023-12-03T11:51:24.332 INFO:teuthology.orchestra.run.smithi003.stderr: 25350K .......... .......... .......... .......... .......... 27% 14.4M 15s 2023-12-03T11:51:24.335 INFO:teuthology.orchestra.run.smithi003.stderr: 25400K .......... .......... .......... .......... .......... 27% 16.6M 15s 2023-12-03T11:51:24.338 INFO:teuthology.orchestra.run.smithi003.stderr: 25450K .......... .......... .......... .......... .......... 27% 14.4M 14s 2023-12-03T11:51:24.343 INFO:teuthology.orchestra.run.smithi003.stderr: 25500K .......... .......... .......... .......... .......... 27% 10.8M 14s 2023-12-03T11:51:24.346 INFO:teuthology.orchestra.run.smithi003.stderr: 25550K .......... .......... .......... .......... .......... 27% 13.2M 14s 2023-12-03T11:51:24.350 INFO:teuthology.orchestra.run.smithi003.stderr: 25600K .......... .......... .......... .......... .......... 27% 14.1M 14s 2023-12-03T11:51:24.353 INFO:teuthology.orchestra.run.smithi003.stderr: 25650K .......... .......... .......... .......... .......... 27% 13.6M 14s 2023-12-03T11:51:24.356 INFO:teuthology.orchestra.run.smithi003.stderr: 25700K .......... .......... .......... .......... .......... 27% 16.5M 14s 2023-12-03T11:51:24.360 INFO:teuthology.orchestra.run.smithi003.stderr: 25750K .......... .......... .......... .......... .......... 27% 12.6M 14s 2023-12-03T11:51:24.365 INFO:teuthology.orchestra.run.smithi003.stderr: 25800K .......... .......... .......... .......... .......... 27% 13.9M 14s 2023-12-03T11:51:24.369 INFO:teuthology.orchestra.run.smithi003.stderr: 25850K .......... .......... .......... .......... .......... 27% 9.66M 14s 2023-12-03T11:51:24.372 INFO:teuthology.orchestra.run.smithi003.stderr: 25900K .......... .......... .......... .......... .......... 27% 16.8M 14s 2023-12-03T11:51:24.378 INFO:teuthology.orchestra.run.smithi003.stderr: 25950K .......... .......... .......... .......... .......... 27% 8.05M 14s 2023-12-03T11:51:24.385 INFO:teuthology.orchestra.run.smithi003.stderr: 26000K .......... .......... .......... .......... .......... 28% 6.89M 14s 2023-12-03T11:51:24.389 INFO:teuthology.orchestra.run.smithi003.stderr: 26050K .......... .......... .......... .......... .......... 28% 12.8M 14s 2023-12-03T11:51:24.393 INFO:teuthology.orchestra.run.smithi003.stderr: 26100K .......... .......... .......... .......... .......... 28% 12.2M 14s 2023-12-03T11:51:24.395 INFO:teuthology.orchestra.run.smithi003.stderr: 26150K .......... .......... .......... .......... .......... 28% 21.4M 14s 2023-12-03T11:51:24.399 INFO:teuthology.orchestra.run.smithi003.stderr: 26200K .......... .......... .......... .......... .......... 28% 13.9M 14s 2023-12-03T11:51:24.403 INFO:teuthology.orchestra.run.smithi003.stderr: 26250K .......... .......... .......... .......... .......... 28% 12.1M 14s 2023-12-03T11:51:24.405 INFO:teuthology.orchestra.run.smithi003.stderr: 26300K .......... .......... .......... .......... .......... 28% 17.7M 14s 2023-12-03T11:51:24.409 INFO:teuthology.orchestra.run.smithi003.stderr: 26350K .......... .......... .......... .......... .......... 28% 13.5M 14s 2023-12-03T11:51:24.412 INFO:teuthology.orchestra.run.smithi003.stderr: 26400K .......... .......... .......... .......... .......... 28% 18.6M 14s 2023-12-03T11:51:24.415 INFO:teuthology.orchestra.run.smithi003.stderr: 26450K .......... .......... .......... .......... .......... 28% 13.9M 14s 2023-12-03T11:51:24.417 INFO:teuthology.orchestra.run.smithi003.stderr: 26500K .......... .......... .......... .......... .......... 28% 20.5M 14s 2023-12-03T11:51:24.421 INFO:teuthology.orchestra.run.smithi003.stderr: 26550K .......... .......... .......... .......... .......... 28% 13.8M 14s 2023-12-03T11:51:24.423 INFO:teuthology.orchestra.run.smithi003.stderr: 26600K .......... .......... .......... .......... .......... 28% 25.3M 14s 2023-12-03T11:51:24.430 INFO:teuthology.orchestra.run.smithi003.stderr: 26650K .......... .......... .......... .......... .......... 28% 8.24M 14s 2023-12-03T11:51:24.430 INFO:teuthology.orchestra.run.smithi003.stderr: 26700K .......... .......... .......... .......... .......... 28% 92.6M 14s 2023-12-03T11:51:24.434 INFO:teuthology.orchestra.run.smithi003.stderr: 26750K .......... .......... .......... .......... .......... 28% 11.3M 14s 2023-12-03T11:51:24.436 INFO:teuthology.orchestra.run.smithi003.stderr: 26800K .......... .......... .......... .......... .......... 28% 21.4M 14s 2023-12-03T11:51:24.440 INFO:teuthology.orchestra.run.smithi003.stderr: 26850K .......... .......... .......... .......... .......... 28% 12.5M 14s 2023-12-03T11:51:24.443 INFO:teuthology.orchestra.run.smithi003.stderr: 26900K .......... .......... .......... .......... .......... 29% 14.3M 14s 2023-12-03T11:51:24.447 INFO:teuthology.orchestra.run.smithi003.stderr: 26950K .......... .......... .......... .......... .......... 29% 14.4M 14s 2023-12-03T11:51:24.451 INFO:teuthology.orchestra.run.smithi003.stderr: 27000K .......... .......... .......... .......... .......... 29% 11.5M 14s 2023-12-03T11:51:24.453 INFO:teuthology.orchestra.run.smithi003.stderr: 27050K .......... .......... .......... .......... .......... 29% 22.9M 14s 2023-12-03T11:51:24.458 INFO:teuthology.orchestra.run.smithi003.stderr: 27100K .......... .......... .......... .......... .......... 29% 14.8M 14s 2023-12-03T11:51:24.461 INFO:teuthology.orchestra.run.smithi003.stderr: 27150K .......... .......... .......... .......... .......... 29% 10.4M 14s 2023-12-03T11:51:24.463 INFO:teuthology.orchestra.run.smithi003.stderr: 27200K .......... .......... .......... .......... .......... 29% 22.8M 13s 2023-12-03T11:51:24.467 INFO:teuthology.orchestra.run.smithi003.stderr: 27250K .......... .......... .......... .......... .......... 29% 12.2M 13s 2023-12-03T11:51:24.470 INFO:teuthology.orchestra.run.smithi003.stderr: 27300K .......... .......... .......... .......... .......... 29% 18.0M 13s 2023-12-03T11:51:24.476 INFO:teuthology.orchestra.run.smithi003.stderr: 27350K .......... .......... .......... .......... .......... 29% 8.13M 13s 2023-12-03T11:51:24.484 INFO:teuthology.orchestra.run.smithi003.stderr: 27400K .......... .......... .......... .......... .......... 29% 6.47M 13s 2023-12-03T11:51:24.486 INFO:teuthology.orchestra.run.smithi003.stderr: 27450K .......... .......... .......... .......... .......... 29% 18.7M 13s 2023-12-03T11:51:24.491 INFO:teuthology.orchestra.run.smithi003.stderr: 27500K .......... .......... .......... .......... .......... 29% 10.9M 13s 2023-12-03T11:51:24.492 INFO:teuthology.orchestra.run.smithi003.stderr: 27550K .......... .......... .......... .......... .......... 29% 25.9M 13s 2023-12-03T11:51:24.495 INFO:teuthology.orchestra.run.smithi003.stderr: 27600K .......... .......... .......... .......... .......... 29% 16.6M 13s 2023-12-03T11:51:24.499 INFO:teuthology.orchestra.run.smithi003.stderr: 27650K .......... .......... .......... .......... .......... 29% 12.1M 13s 2023-12-03T11:51:24.503 INFO:teuthology.orchestra.run.smithi003.stderr: 27700K .......... .......... .......... .......... .......... 29% 14.2M 13s 2023-12-03T11:51:24.506 INFO:teuthology.orchestra.run.smithi003.stderr: 27750K .......... .......... .......... .......... .......... 29% 15.6M 13s 2023-12-03T11:51:24.510 INFO:teuthology.orchestra.run.smithi003.stderr: 27800K .......... .......... .......... .......... .......... 29% 13.0M 13s 2023-12-03T11:51:24.513 INFO:teuthology.orchestra.run.smithi003.stderr: 27850K .......... .......... .......... .......... .......... 30% 16.5M 13s 2023-12-03T11:51:24.516 INFO:teuthology.orchestra.run.smithi003.stderr: 27900K .......... .......... .......... .......... .......... 30% 12.9M 13s 2023-12-03T11:51:24.519 INFO:teuthology.orchestra.run.smithi003.stderr: 27950K .......... .......... .......... .......... .......... 30% 17.5M 13s 2023-12-03T11:51:24.522 INFO:teuthology.orchestra.run.smithi003.stderr: 28000K .......... .......... .......... .......... .......... 30% 17.6M 13s 2023-12-03T11:51:24.525 INFO:teuthology.orchestra.run.smithi003.stderr: 28050K .......... .......... .......... .......... .......... 30% 17.3M 13s 2023-12-03T11:51:24.530 INFO:teuthology.orchestra.run.smithi003.stderr: 28100K .......... .......... .......... .......... .......... 30% 9.37M 13s 2023-12-03T11:51:24.533 INFO:teuthology.orchestra.run.smithi003.stderr: 28150K .......... .......... .......... .......... .......... 30% 16.9M 13s 2023-12-03T11:51:24.536 INFO:teuthology.orchestra.run.smithi003.stderr: 28200K .......... .......... .......... .......... .......... 30% 16.8M 13s 2023-12-03T11:51:24.539 INFO:teuthology.orchestra.run.smithi003.stderr: 28250K .......... .......... .......... .......... .......... 30% 17.4M 13s 2023-12-03T11:51:24.543 INFO:teuthology.orchestra.run.smithi003.stderr: 28300K .......... .......... .......... .......... .......... 30% 12.7M 13s 2023-12-03T11:51:24.546 INFO:teuthology.orchestra.run.smithi003.stderr: 28350K .......... .......... .......... .......... .......... 30% 17.2M 13s 2023-12-03T11:51:24.548 INFO:teuthology.orchestra.run.smithi003.stderr: 28400K .......... .......... .......... .......... .......... 30% 17.6M 13s 2023-12-03T11:51:24.551 INFO:teuthology.orchestra.run.smithi003.stderr: 28450K .......... .......... .......... .......... .......... 30% 16.2M 13s 2023-12-03T11:51:24.554 INFO:teuthology.orchestra.run.smithi003.stderr: 28500K .......... .......... .......... .......... .......... 30% 17.1M 13s 2023-12-03T11:51:24.557 INFO:teuthology.orchestra.run.smithi003.stderr: 28550K .......... .......... .......... .......... .......... 30% 17.2M 13s 2023-12-03T11:51:24.559 INFO:teuthology.orchestra.run.smithi003.stderr: 28600K .......... .......... .......... .......... .......... 30% 17.8M 13s 2023-12-03T11:51:24.563 INFO:teuthology.orchestra.run.smithi003.stderr: 28650K .......... .......... .......... .......... .......... 30% 13.4M 13s 2023-12-03T11:51:24.567 INFO:teuthology.orchestra.run.smithi003.stderr: 28700K .......... .......... .......... .......... .......... 30% 12.6M 13s 2023-12-03T11:51:24.572 INFO:teuthology.orchestra.run.smithi003.stderr: 28750K .......... .......... .......... .......... .......... 31% 10.2M 13s 2023-12-03T11:51:24.577 INFO:teuthology.orchestra.run.smithi003.stderr: 28800K .......... .......... .......... .......... .......... 31% 10.3M 13s 2023-12-03T11:51:24.582 INFO:teuthology.orchestra.run.smithi003.stderr: 28850K .......... .......... .......... .......... .......... 31% 9.48M 13s 2023-12-03T11:51:24.587 INFO:teuthology.orchestra.run.smithi003.stderr: 28900K .......... .......... .......... .......... .......... 31% 9.92M 13s 2023-12-03T11:51:24.589 INFO:teuthology.orchestra.run.smithi003.stderr: 28950K .......... .......... .......... .......... .......... 31% 17.6M 13s 2023-12-03T11:51:24.594 INFO:teuthology.orchestra.run.smithi003.stderr: 29000K .......... .......... .......... .......... .......... 31% 14.3M 13s 2023-12-03T11:51:24.596 INFO:teuthology.orchestra.run.smithi003.stderr: 29050K .......... .......... .......... .......... .......... 31% 14.2M 13s 2023-12-03T11:51:24.599 INFO:teuthology.orchestra.run.smithi003.stderr: 29100K .......... .......... .......... .......... .......... 31% 21.4M 13s 2023-12-03T11:51:24.601 INFO:teuthology.orchestra.run.smithi003.stderr: 29150K .......... .......... .......... .......... .......... 31% 17.6M 13s 2023-12-03T11:51:24.604 INFO:teuthology.orchestra.run.smithi003.stderr: 29200K .......... .......... .......... .......... .......... 31% 16.1M 12s 2023-12-03T11:51:24.607 INFO:teuthology.orchestra.run.smithi003.stderr: 29250K .......... .......... .......... .......... .......... 31% 18.0M 12s 2023-12-03T11:51:24.612 INFO:teuthology.orchestra.run.smithi003.stderr: 29300K .......... .......... .......... .......... .......... 31% 10.7M 12s 2023-12-03T11:51:24.614 INFO:teuthology.orchestra.run.smithi003.stderr: 29350K .......... .......... .......... .......... .......... 31% 18.3M 12s 2023-12-03T11:51:24.616 INFO:teuthology.orchestra.run.smithi003.stderr: 29400K .......... .......... .......... .......... .......... 31% 27.3M 12s 2023-12-03T11:51:24.619 INFO:teuthology.orchestra.run.smithi003.stderr: 29450K .......... .......... .......... .......... .......... 31% 14.2M 12s 2023-12-03T11:51:24.622 INFO:teuthology.orchestra.run.smithi003.stderr: 29500K .......... .......... .......... .......... .......... 31% 22.9M 12s 2023-12-03T11:51:24.624 INFO:teuthology.orchestra.run.smithi003.stderr: 29550K .......... .......... .......... .......... .......... 31% 20.9M 12s 2023-12-03T11:51:24.629 INFO:teuthology.orchestra.run.smithi003.stderr: 29600K .......... .......... .......... .......... .......... 31% 10.1M 12s 2023-12-03T11:51:24.632 INFO:teuthology.orchestra.run.smithi003.stderr: 29650K .......... .......... .......... .......... .......... 31% 20.0M 12s 2023-12-03T11:51:24.634 INFO:teuthology.orchestra.run.smithi003.stderr: 29700K .......... .......... .......... .......... .......... 32% 19.0M 12s 2023-12-03T11:51:24.638 INFO:teuthology.orchestra.run.smithi003.stderr: 29750K .......... .......... .......... .......... .......... 32% 12.7M 12s 2023-12-03T11:51:24.640 INFO:teuthology.orchestra.run.smithi003.stderr: 29800K .......... .......... .......... .......... .......... 32% 23.0M 12s 2023-12-03T11:51:24.642 INFO:teuthology.orchestra.run.smithi003.stderr: 29850K .......... .......... .......... .......... .......... 32% 22.9M 12s 2023-12-03T11:51:24.645 INFO:teuthology.orchestra.run.smithi003.stderr: 29900K .......... .......... .......... .......... .......... 32% 17.9M 12s 2023-12-03T11:51:24.648 INFO:teuthology.orchestra.run.smithi003.stderr: 29950K .......... .......... .......... .......... .......... 32% 14.8M 12s 2023-12-03T11:51:24.651 INFO:teuthology.orchestra.run.smithi003.stderr: 30000K .......... .......... .......... .......... .......... 32% 17.4M 12s 2023-12-03T11:51:24.653 INFO:teuthology.orchestra.run.smithi003.stderr: 30050K .......... .......... .......... .......... .......... 32% 21.0M 12s 2023-12-03T11:51:24.656 INFO:teuthology.orchestra.run.smithi003.stderr: 30100K .......... .......... .......... .......... .......... 32% 15.5M 12s 2023-12-03T11:51:24.659 INFO:teuthology.orchestra.run.smithi003.stderr: 30150K .......... .......... .......... .......... .......... 32% 19.1M 12s 2023-12-03T11:51:24.662 INFO:teuthology.orchestra.run.smithi003.stderr: 30200K .......... .......... .......... .......... .......... 32% 14.1M 12s 2023-12-03T11:51:24.665 INFO:teuthology.orchestra.run.smithi003.stderr: 30250K .......... .......... .......... .......... .......... 32% 17.9M 12s 2023-12-03T11:51:24.669 INFO:teuthology.orchestra.run.smithi003.stderr: 30300K .......... .......... .......... .......... .......... 32% 11.3M 12s 2023-12-03T11:51:24.675 INFO:teuthology.orchestra.run.smithi003.stderr: 30350K .......... .......... .......... .......... .......... 32% 10.3M 12s 2023-12-03T11:51:24.679 INFO:teuthology.orchestra.run.smithi003.stderr: 30400K .......... .......... .......... .......... .......... 32% 9.50M 12s 2023-12-03T11:51:24.684 INFO:teuthology.orchestra.run.smithi003.stderr: 30450K .......... .......... .......... .......... .......... 32% 9.22M 12s 2023-12-03T11:51:24.687 INFO:teuthology.orchestra.run.smithi003.stderr: 30500K .......... .......... .......... .......... .......... 32% 16.6M 12s 2023-12-03T11:51:24.691 INFO:teuthology.orchestra.run.smithi003.stderr: 30550K .......... .......... .......... .......... .......... 32% 12.9M 12s 2023-12-03T11:51:24.694 INFO:teuthology.orchestra.run.smithi003.stderr: 30600K .......... .......... .......... .......... .......... 32% 17.3M 12s 2023-12-03T11:51:24.697 INFO:teuthology.orchestra.run.smithi003.stderr: 30650K .......... .......... .......... .......... .......... 33% 17.5M 12s 2023-12-03T11:51:24.699 INFO:teuthology.orchestra.run.smithi003.stderr: 30700K .......... .......... .......... .......... .......... 33% 18.7M 12s 2023-12-03T11:51:24.703 INFO:teuthology.orchestra.run.smithi003.stderr: 30750K .......... .......... .......... .......... .......... 33% 12.7M 12s 2023-12-03T11:51:24.706 INFO:teuthology.orchestra.run.smithi003.stderr: 30800K .......... .......... .......... .......... .......... 33% 15.3M 12s 2023-12-03T11:51:24.710 INFO:teuthology.orchestra.run.smithi003.stderr: 30850K .......... .......... .......... .......... .......... 33% 13.8M 12s 2023-12-03T11:51:24.713 INFO:teuthology.orchestra.run.smithi003.stderr: 30900K .......... .......... .......... .......... .......... 33% 19.0M 12s 2023-12-03T11:51:24.715 INFO:teuthology.orchestra.run.smithi003.stderr: 30950K .......... .......... .......... .......... .......... 33% 18.0M 12s 2023-12-03T11:51:24.718 INFO:teuthology.orchestra.run.smithi003.stderr: 31000K .......... .......... .......... .......... .......... 33% 20.2M 12s 2023-12-03T11:51:24.720 INFO:teuthology.orchestra.run.smithi003.stderr: 31050K .......... .......... .......... .......... .......... 33% 20.9M 12s 2023-12-03T11:51:24.723 INFO:teuthology.orchestra.run.smithi003.stderr: 31100K .......... .......... .......... .......... .......... 33% 17.7M 12s 2023-12-03T11:51:24.726 INFO:teuthology.orchestra.run.smithi003.stderr: 31150K .......... .......... .......... .......... .......... 33% 20.7M 12s 2023-12-03T11:51:24.730 INFO:teuthology.orchestra.run.smithi003.stderr: 31200K .......... .......... .......... .......... .......... 33% 11.2M 12s 2023-12-03T11:51:24.732 INFO:teuthology.orchestra.run.smithi003.stderr: 31250K .......... .......... .......... .......... .......... 33% 18.8M 12s 2023-12-03T11:51:24.735 INFO:teuthology.orchestra.run.smithi003.stderr: 31300K .......... .......... .......... .......... .......... 33% 17.1M 12s 2023-12-03T11:51:24.738 INFO:teuthology.orchestra.run.smithi003.stderr: 31350K .......... .......... .......... .......... .......... 33% 17.4M 12s 2023-12-03T11:51:24.742 INFO:teuthology.orchestra.run.smithi003.stderr: 31400K .......... .......... .......... .......... .......... 33% 22.7M 11s 2023-12-03T11:51:24.743 INFO:teuthology.orchestra.run.smithi003.stderr: 31450K .......... .......... .......... .......... .......... 33% 17.6M 11s 2023-12-03T11:51:24.745 INFO:teuthology.orchestra.run.smithi003.stderr: 31500K .......... .......... .......... .......... .......... 33% 20.6M 11s 2023-12-03T11:51:24.747 INFO:teuthology.orchestra.run.smithi003.stderr: 31550K .......... .......... .......... .......... .......... 34% 27.1M 11s 2023-12-03T11:51:24.749 INFO:teuthology.orchestra.run.smithi003.stderr: 31600K .......... .......... .......... .......... .......... 34% 21.3M 11s 2023-12-03T11:51:24.752 INFO:teuthology.orchestra.run.smithi003.stderr: 31650K .......... .......... .......... .......... .......... 34% 16.9M 11s 2023-12-03T11:51:24.756 INFO:teuthology.orchestra.run.smithi003.stderr: 31700K .......... .......... .......... .......... .......... 34% 15.1M 11s 2023-12-03T11:51:24.758 INFO:teuthology.orchestra.run.smithi003.stderr: 31750K .......... .......... .......... .......... .......... 34% 20.3M 11s 2023-12-03T11:51:24.760 INFO:teuthology.orchestra.run.smithi003.stderr: 31800K .......... .......... .......... .......... .......... 34% 19.9M 11s 2023-12-03T11:51:24.762 INFO:teuthology.orchestra.run.smithi003.stderr: 31850K .......... .......... .......... .......... .......... 34% 27.1M 11s 2023-12-03T11:51:24.766 INFO:teuthology.orchestra.run.smithi003.stderr: 31900K .......... .......... .......... .......... .......... 34% 19.4M 11s 2023-12-03T11:51:24.769 INFO:teuthology.orchestra.run.smithi003.stderr: 31950K .......... .......... .......... .......... .......... 34% 11.4M 11s 2023-12-03T11:51:24.773 INFO:teuthology.orchestra.run.smithi003.stderr: 32000K .......... .......... .......... .......... .......... 34% 11.0M 11s 2023-12-03T11:51:24.778 INFO:teuthology.orchestra.run.smithi003.stderr: 32050K .......... .......... .......... .......... .......... 34% 9.94M 11s 2023-12-03T11:51:24.782 INFO:teuthology.orchestra.run.smithi003.stderr: 32100K .......... .......... .......... .......... .......... 34% 13.5M 11s 2023-12-03T11:51:24.785 INFO:teuthology.orchestra.run.smithi003.stderr: 32150K .......... .......... .......... .......... .......... 34% 16.6M 11s 2023-12-03T11:51:24.790 INFO:teuthology.orchestra.run.smithi003.stderr: 32200K .......... .......... .......... .......... .......... 34% 11.3M 11s 2023-12-03T11:51:24.791 INFO:teuthology.orchestra.run.smithi003.stderr: 32250K .......... .......... .......... .......... .......... 34% 26.4M 11s 2023-12-03T11:51:24.794 INFO:teuthology.orchestra.run.smithi003.stderr: 32300K .......... .......... .......... .......... .......... 34% 20.0M 11s 2023-12-03T11:51:24.797 INFO:teuthology.orchestra.run.smithi003.stderr: 32350K .......... .......... .......... .......... .......... 34% 13.8M 11s 2023-12-03T11:51:24.800 INFO:teuthology.orchestra.run.smithi003.stderr: 32400K .......... .......... .......... .......... .......... 34% 15.4M 11s 2023-12-03T11:51:24.803 INFO:teuthology.orchestra.run.smithi003.stderr: 32450K .......... .......... .......... .......... .......... 34% 16.5M 11s 2023-12-03T11:51:24.806 INFO:teuthology.orchestra.run.smithi003.stderr: 32500K .......... .......... .......... .......... .......... 35% 16.4M 11s 2023-12-03T11:51:24.808 INFO:teuthology.orchestra.run.smithi003.stderr: 32550K .......... .......... .......... .......... .......... 35% 22.4M 11s 2023-12-03T11:51:24.812 INFO:teuthology.orchestra.run.smithi003.stderr: 32600K .......... .......... .......... .......... .......... 35% 14.3M 11s 2023-12-03T11:51:24.813 INFO:teuthology.orchestra.run.smithi003.stderr: 32650K .......... .......... .......... .......... .......... 35% 27.3M 11s 2023-12-03T11:51:24.816 INFO:teuthology.orchestra.run.smithi003.stderr: 32700K .......... .......... .......... .......... .......... 35% 19.1M 11s 2023-12-03T11:51:24.819 INFO:teuthology.orchestra.run.smithi003.stderr: 32750K .......... .......... .......... .......... .......... 35% 15.1M 11s 2023-12-03T11:51:24.822 INFO:teuthology.orchestra.run.smithi003.stderr: 32800K .......... .......... .......... .......... .......... 35% 19.8M 11s 2023-12-03T11:51:24.825 INFO:teuthology.orchestra.run.smithi003.stderr: 32850K .......... .......... .......... .......... .......... 35% 13.9M 11s 2023-12-03T11:51:24.827 INFO:teuthology.orchestra.run.smithi003.stderr: 32900K .......... .......... .......... .......... .......... 35% 25.6M 11s 2023-12-03T11:51:24.830 INFO:teuthology.orchestra.run.smithi003.stderr: 32950K .......... .......... .......... .......... .......... 35% 18.5M 11s 2023-12-03T11:51:24.832 INFO:teuthology.orchestra.run.smithi003.stderr: 33000K .......... .......... .......... .......... .......... 35% 18.0M 11s 2023-12-03T11:51:24.836 INFO:teuthology.orchestra.run.smithi003.stderr: 33050K .......... .......... .......... .......... .......... 35% 14.4M 11s 2023-12-03T11:51:24.839 INFO:teuthology.orchestra.run.smithi003.stderr: 33100K .......... .......... .......... .......... .......... 35% 16.2M 11s 2023-12-03T11:51:24.841 INFO:teuthology.orchestra.run.smithi003.stderr: 33150K .......... .......... .......... .......... .......... 35% 21.1M 11s 2023-12-03T11:51:24.844 INFO:teuthology.orchestra.run.smithi003.stderr: 33200K .......... .......... .......... .......... .......... 35% 20.4M 11s 2023-12-03T11:51:24.847 INFO:teuthology.orchestra.run.smithi003.stderr: 33250K .......... .......... .......... .......... .......... 35% 15.7M 11s 2023-12-03T11:51:24.849 INFO:teuthology.orchestra.run.smithi003.stderr: 33300K .......... .......... .......... .......... .......... 35% 22.3M 11s 2023-12-03T11:51:24.851 INFO:teuthology.orchestra.run.smithi003.stderr: 33350K .......... .......... .......... .......... .......... 35% 23.6M 11s 2023-12-03T11:51:24.853 INFO:teuthology.orchestra.run.smithi003.stderr: 33400K .......... .......... .......... .......... .......... 36% 21.4M 11s 2023-12-03T11:51:24.856 INFO:teuthology.orchestra.run.smithi003.stderr: 33450K .......... .......... .......... .......... .......... 36% 16.4M 11s 2023-12-03T11:51:24.858 INFO:teuthology.orchestra.run.smithi003.stderr: 33500K .......... .......... .......... .......... .......... 36% 20.9M 11s 2023-12-03T11:51:24.862 INFO:teuthology.orchestra.run.smithi003.stderr: 33550K .......... .......... .......... .......... .......... 36% 15.3M 11s 2023-12-03T11:51:24.864 INFO:teuthology.orchestra.run.smithi003.stderr: 33600K .......... .......... .......... .......... .......... 36% 18.2M 11s 2023-12-03T11:51:24.866 INFO:teuthology.orchestra.run.smithi003.stderr: 33650K .......... .......... .......... .......... .......... 36% 20.4M 11s 2023-12-03T11:51:24.871 INFO:teuthology.orchestra.run.smithi003.stderr: 33700K .......... .......... .......... .......... .......... 36% 10.8M 11s 2023-12-03T11:51:24.876 INFO:teuthology.orchestra.run.smithi003.stderr: 33750K .......... .......... .......... .......... .......... 36% 10.1M 11s 2023-12-03T11:51:24.881 INFO:teuthology.orchestra.run.smithi003.stderr: 33800K .......... .......... .......... .......... .......... 36% 11.2M 10s 2023-12-03T11:51:24.883 INFO:teuthology.orchestra.run.smithi003.stderr: 33850K .......... .......... .......... .......... .......... 36% 17.6M 10s 2023-12-03T11:51:24.886 INFO:teuthology.orchestra.run.smithi003.stderr: 33900K .......... .......... .......... .......... .......... 36% 15.1M 10s 2023-12-03T11:51:24.889 INFO:teuthology.orchestra.run.smithi003.stderr: 33950K .......... .......... .......... .......... .......... 36% 21.1M 10s 2023-12-03T11:51:24.892 INFO:teuthology.orchestra.run.smithi003.stderr: 34000K .......... .......... .......... .......... .......... 36% 13.4M 10s 2023-12-03T11:51:24.894 INFO:teuthology.orchestra.run.smithi003.stderr: 34050K .......... .......... .......... .......... .......... 36% 26.7M 10s 2023-12-03T11:51:24.897 INFO:teuthology.orchestra.run.smithi003.stderr: 34100K .......... .......... .......... .......... .......... 36% 16.7M 10s 2023-12-03T11:51:24.901 INFO:teuthology.orchestra.run.smithi003.stderr: 34150K .......... .......... .......... .......... .......... 36% 11.7M 10s 2023-12-03T11:51:24.904 INFO:teuthology.orchestra.run.smithi003.stderr: 34200K .......... .......... .......... .......... .......... 36% 20.3M 10s 2023-12-03T11:51:24.906 INFO:teuthology.orchestra.run.smithi003.stderr: 34250K .......... .......... .......... .......... .......... 36% 21.2M 10s 2023-12-03T11:51:24.908 INFO:teuthology.orchestra.run.smithi003.stderr: 34300K .......... .......... .......... .......... .......... 36% 26.7M 10s 2023-12-03T11:51:24.910 INFO:teuthology.orchestra.run.smithi003.stderr: 34350K .......... .......... .......... .......... .......... 37% 21.1M 10s 2023-12-03T11:51:24.913 INFO:teuthology.orchestra.run.smithi003.stderr: 34400K .......... .......... .......... .......... .......... 37% 16.9M 10s 2023-12-03T11:51:24.915 INFO:teuthology.orchestra.run.smithi003.stderr: 34450K .......... .......... .......... .......... .......... 37% 27.3M 10s 2023-12-03T11:51:24.918 INFO:teuthology.orchestra.run.smithi003.stderr: 34500K .......... .......... .......... .......... .......... 37% 17.6M 10s 2023-12-03T11:51:24.920 INFO:teuthology.orchestra.run.smithi003.stderr: 34550K .......... .......... .......... .......... .......... 37% 21.3M 10s 2023-12-03T11:51:24.922 INFO:teuthology.orchestra.run.smithi003.stderr: 34600K .......... .......... .......... .......... .......... 37% 17.9M 10s 2023-12-03T11:51:24.926 INFO:teuthology.orchestra.run.smithi003.stderr: 34650K .......... .......... .......... .......... .......... 37% 16.4M 10s 2023-12-03T11:51:24.929 INFO:teuthology.orchestra.run.smithi003.stderr: 34700K .......... .......... .......... .......... .......... 37% 15.0M 10s 2023-12-03T11:51:24.931 INFO:teuthology.orchestra.run.smithi003.stderr: 34750K .......... .......... .......... .......... .......... 37% 28.4M 10s 2023-12-03T11:51:24.933 INFO:teuthology.orchestra.run.smithi003.stderr: 34800K .......... .......... .......... .......... .......... 37% 20.3M 10s 2023-12-03T11:51:24.936 INFO:teuthology.orchestra.run.smithi003.stderr: 34850K .......... .......... .......... .......... .......... 37% 17.4M 10s 2023-12-03T11:51:24.938 INFO:teuthology.orchestra.run.smithi003.stderr: 34900K .......... .......... .......... .......... .......... 37% 18.3M 10s 2023-12-03T11:51:24.941 INFO:teuthology.orchestra.run.smithi003.stderr: 34950K .......... .......... .......... .......... .......... 37% 16.3M 10s 2023-12-03T11:51:24.944 INFO:teuthology.orchestra.run.smithi003.stderr: 35000K .......... .......... .......... .......... .......... 37% 23.4M 10s 2023-12-03T11:51:24.947 INFO:teuthology.orchestra.run.smithi003.stderr: 35050K .......... .......... .......... .......... .......... 37% 15.6M 10s 2023-12-03T11:51:24.949 INFO:teuthology.orchestra.run.smithi003.stderr: 35100K .......... .......... .......... .......... .......... 37% 18.8M 10s 2023-12-03T11:51:24.951 INFO:teuthology.orchestra.run.smithi003.stderr: 35150K .......... .......... .......... .......... .......... 37% 26.9M 10s 2023-12-03T11:51:24.953 INFO:teuthology.orchestra.run.smithi003.stderr: 35200K .......... .......... .......... .......... .......... 37% 23.8M 10s 2023-12-03T11:51:24.956 INFO:teuthology.orchestra.run.smithi003.stderr: 35250K .......... .......... .......... .......... .......... 37% 17.1M 10s 2023-12-03T11:51:24.958 INFO:teuthology.orchestra.run.smithi003.stderr: 35300K .......... .......... .......... .......... .......... 38% 20.6M 10s 2023-12-03T11:51:24.961 INFO:teuthology.orchestra.run.smithi003.stderr: 35350K .......... .......... .......... .......... .......... 38% 16.0M 10s 2023-12-03T11:51:24.965 INFO:teuthology.orchestra.run.smithi003.stderr: 35400K .......... .......... .......... .......... .......... 38% 14.4M 10s 2023-12-03T11:51:24.966 INFO:teuthology.orchestra.run.smithi003.stderr: 35450K .......... .......... .......... .......... .......... 38% 29.6M 10s 2023-12-03T11:51:24.971 INFO:teuthology.orchestra.run.smithi003.stderr: 35500K .......... .......... .......... .......... .......... 38% 12.8M 10s 2023-12-03T11:51:24.975 INFO:teuthology.orchestra.run.smithi003.stderr: 35550K .......... .......... .......... .......... .......... 38% 10.0M 10s 2023-12-03T11:51:24.978 INFO:teuthology.orchestra.run.smithi003.stderr: 35600K .......... .......... .......... .......... .......... 38% 14.2M 10s 2023-12-03T11:51:24.982 INFO:teuthology.orchestra.run.smithi003.stderr: 35650K .......... .......... .......... .......... .......... 38% 13.7M 10s 2023-12-03T11:51:24.985 INFO:teuthology.orchestra.run.smithi003.stderr: 35700K .......... .......... .......... .......... .......... 38% 14.2M 10s 2023-12-03T11:51:24.988 INFO:teuthology.orchestra.run.smithi003.stderr: 35750K .......... .......... .......... .......... .......... 38% 21.2M 10s 2023-12-03T11:51:24.990 INFO:teuthology.orchestra.run.smithi003.stderr: 35800K .......... .......... .......... .......... .......... 38% 24.4M 10s 2023-12-03T11:51:24.994 INFO:teuthology.orchestra.run.smithi003.stderr: 35850K .......... .......... .......... .......... .......... 38% 12.8M 10s 2023-12-03T11:51:24.997 INFO:teuthology.orchestra.run.smithi003.stderr: 35900K .......... .......... .......... .......... .......... 38% 13.7M 10s 2023-12-03T11:51:24.999 INFO:teuthology.orchestra.run.smithi003.stderr: 35950K .......... .......... .......... .......... .......... 38% 25.3M 10s 2023-12-03T11:51:25.002 INFO:teuthology.orchestra.run.smithi003.stderr: 36000K .......... .......... .......... .......... .......... 38% 16.2M 10s 2023-12-03T11:51:25.004 INFO:teuthology.orchestra.run.smithi003.stderr: 36050K .......... .......... .......... .......... .......... 38% 22.2M 10s 2023-12-03T11:51:25.008 INFO:teuthology.orchestra.run.smithi003.stderr: 36100K .......... .......... .......... .......... .......... 38% 16.2M 10s 2023-12-03T11:51:25.009 INFO:teuthology.orchestra.run.smithi003.stderr: 36150K .......... .......... .......... .......... .......... 38% 23.5M 10s 2023-12-03T11:51:25.012 INFO:teuthology.orchestra.run.smithi003.stderr: 36200K .......... .......... .......... .......... .......... 39% 23.3M 10s 2023-12-03T11:51:25.015 INFO:teuthology.orchestra.run.smithi003.stderr: 36250K .......... .......... .......... .......... .......... 39% 23.0M 10s 2023-12-03T11:51:25.019 INFO:teuthology.orchestra.run.smithi003.stderr: 36300K .......... .......... .......... .......... .......... 39% 9.94M 10s 2023-12-03T11:51:25.020 INFO:teuthology.orchestra.run.smithi003.stderr: 36350K .......... .......... .......... .......... .......... 39% 28.2M 10s 2023-12-03T11:51:25.022 INFO:teuthology.orchestra.run.smithi003.stderr: 36400K .......... .......... .......... .......... .......... 39% 22.4M 10s 2023-12-03T11:51:25.026 INFO:teuthology.orchestra.run.smithi003.stderr: 36450K .......... .......... .......... .......... .......... 39% 15.9M 10s 2023-12-03T11:51:25.027 INFO:teuthology.orchestra.run.smithi003.stderr: 36500K .......... .......... .......... .......... .......... 39% 25.1M 10s 2023-12-03T11:51:25.031 INFO:teuthology.orchestra.run.smithi003.stderr: 36550K .......... .......... .......... .......... .......... 39% 15.7M 9s 2023-12-03T11:51:25.033 INFO:teuthology.orchestra.run.smithi003.stderr: 36600K .......... .......... .......... .......... .......... 39% 19.1M 9s 2023-12-03T11:51:25.036 INFO:teuthology.orchestra.run.smithi003.stderr: 36650K .......... .......... .......... .......... .......... 39% 19.0M 9s 2023-12-03T11:51:25.038 INFO:teuthology.orchestra.run.smithi003.stderr: 36700K .......... .......... .......... .......... .......... 39% 25.3M 9s 2023-12-03T11:51:25.040 INFO:teuthology.orchestra.run.smithi003.stderr: 36750K .......... .......... .......... .......... .......... 39% 18.2M 9s 2023-12-03T11:51:25.043 INFO:teuthology.orchestra.run.smithi003.stderr: 36800K .......... .......... .......... .......... .......... 39% 15.5M 9s 2023-12-03T11:51:25.045 INFO:teuthology.orchestra.run.smithi003.stderr: 36850K .......... .......... .......... .......... .......... 39% 26.1M 9s 2023-12-03T11:51:25.047 INFO:teuthology.orchestra.run.smithi003.stderr: 36900K .......... .......... .......... .......... .......... 39% 29.2M 9s 2023-12-03T11:51:25.050 INFO:teuthology.orchestra.run.smithi003.stderr: 36950K .......... .......... .......... .......... .......... 39% 13.7M 9s 2023-12-03T11:51:25.052 INFO:teuthology.orchestra.run.smithi003.stderr: 37000K .......... .......... .......... .......... .......... 39% 26.6M 9s 2023-12-03T11:51:25.055 INFO:teuthology.orchestra.run.smithi003.stderr: 37050K .......... .......... .......... .......... .......... 39% 17.7M 9s 2023-12-03T11:51:25.057 INFO:teuthology.orchestra.run.smithi003.stderr: 37100K .......... .......... .......... .......... .......... 39% 24.3M 9s 2023-12-03T11:51:25.060 INFO:teuthology.orchestra.run.smithi003.stderr: 37150K .......... .......... .......... .......... .......... 40% 19.5M 9s 2023-12-03T11:51:25.064 INFO:teuthology.orchestra.run.smithi003.stderr: 37200K .......... .......... .......... .......... .......... 40% 14.9M 9s 2023-12-03T11:51:25.065 INFO:teuthology.orchestra.run.smithi003.stderr: 37250K .......... .......... .......... .......... .......... 40% 19.6M 9s 2023-12-03T11:51:25.068 INFO:teuthology.orchestra.run.smithi003.stderr: 37300K .......... .......... .......... .......... .......... 40% 20.3M 9s 2023-12-03T11:51:25.072 INFO:teuthology.orchestra.run.smithi003.stderr: 37350K .......... .......... .......... .......... .......... 40% 11.9M 9s 2023-12-03T11:51:25.074 INFO:teuthology.orchestra.run.smithi003.stderr: 37400K .......... .......... .......... .......... .......... 40% 25.0M 9s 2023-12-03T11:51:25.081 INFO:teuthology.orchestra.run.smithi003.stderr: 37450K .......... .......... .......... .......... .......... 40% 10.8M 9s 2023-12-03T11:51:25.084 INFO:teuthology.orchestra.run.smithi003.stderr: 37500K .......... .......... .......... .......... .......... 40% 9.57M 9s 2023-12-03T11:51:25.086 INFO:teuthology.orchestra.run.smithi003.stderr: 37550K .......... .......... .......... .......... .......... 40% 19.1M 9s 2023-12-03T11:51:25.090 INFO:teuthology.orchestra.run.smithi003.stderr: 37600K .......... .......... .......... .......... .......... 40% 13.2M 9s 2023-12-03T11:51:25.093 INFO:teuthology.orchestra.run.smithi003.stderr: 37650K .......... .......... .......... .......... .......... 40% 15.0M 9s 2023-12-03T11:51:25.096 INFO:teuthology.orchestra.run.smithi003.stderr: 37700K .......... .......... .......... .......... .......... 40% 16.9M 9s 2023-12-03T11:51:25.099 INFO:teuthology.orchestra.run.smithi003.stderr: 37750K .......... .......... .......... .......... .......... 40% 19.1M 9s 2023-12-03T11:51:25.102 INFO:teuthology.orchestra.run.smithi003.stderr: 37800K .......... .......... .......... .......... .......... 40% 15.1M 9s 2023-12-03T11:51:25.104 INFO:teuthology.orchestra.run.smithi003.stderr: 37850K .......... .......... .......... .......... .......... 40% 24.5M 9s 2023-12-03T11:51:25.107 INFO:teuthology.orchestra.run.smithi003.stderr: 37900K .......... .......... .......... .......... .......... 40% 16.5M 9s 2023-12-03T11:51:25.110 INFO:teuthology.orchestra.run.smithi003.stderr: 37950K .......... .......... .......... .......... .......... 40% 15.1M 9s 2023-12-03T11:51:25.112 INFO:teuthology.orchestra.run.smithi003.stderr: 38000K .......... .......... .......... .......... .......... 40% 20.9M 9s 2023-12-03T11:51:25.116 INFO:teuthology.orchestra.run.smithi003.stderr: 38050K .......... .......... .......... .......... .......... 41% 15.4M 9s 2023-12-03T11:51:25.118 INFO:teuthology.orchestra.run.smithi003.stderr: 38100K .......... .......... .......... .......... .......... 41% 19.9M 9s 2023-12-03T11:51:25.120 INFO:teuthology.orchestra.run.smithi003.stderr: 38150K .......... .......... .......... .......... .......... 41% 19.4M 9s 2023-12-03T11:51:25.123 INFO:teuthology.orchestra.run.smithi003.stderr: 38200K .......... .......... .......... .......... .......... 41% 27.3M 9s 2023-12-03T11:51:25.126 INFO:teuthology.orchestra.run.smithi003.stderr: 38250K .......... .......... .......... .......... .......... 41% 11.8M 9s 2023-12-03T11:51:25.129 INFO:teuthology.orchestra.run.smithi003.stderr: 38300K .......... .......... .......... .......... .......... 41% 20.2M 9s 2023-12-03T11:51:25.133 INFO:teuthology.orchestra.run.smithi003.stderr: 38350K .......... .......... .......... .......... .......... 41% 10.6M 9s 2023-12-03T11:51:25.135 INFO:teuthology.orchestra.run.smithi003.stderr: 38400K .......... .......... .......... .......... .......... 41% 21.5M 9s 2023-12-03T11:51:25.139 INFO:teuthology.orchestra.run.smithi003.stderr: 38450K .......... .......... .......... .......... .......... 41% 21.8M 9s 2023-12-03T11:51:25.142 INFO:teuthology.orchestra.run.smithi003.stderr: 38500K .......... .......... .......... .......... .......... 41% 13.9M 9s 2023-12-03T11:51:25.143 INFO:teuthology.orchestra.run.smithi003.stderr: 38550K .......... .......... .......... .......... .......... 41% 23.6M 9s 2023-12-03T11:51:25.146 INFO:teuthology.orchestra.run.smithi003.stderr: 38600K .......... .......... .......... .......... .......... 41% 16.2M 9s 2023-12-03T11:51:25.149 INFO:teuthology.orchestra.run.smithi003.stderr: 38650K .......... .......... .......... .......... .......... 41% 17.7M 9s 2023-12-03T11:51:25.153 INFO:teuthology.orchestra.run.smithi003.stderr: 38700K .......... .......... .......... .......... .......... 41% 20.1M 9s 2023-12-03T11:51:25.155 INFO:teuthology.orchestra.run.smithi003.stderr: 38750K .......... .......... .......... .......... .......... 41% 14.1M 9s 2023-12-03T11:51:25.157 INFO:teuthology.orchestra.run.smithi003.stderr: 38800K .......... .......... .......... .......... .......... 41% 24.8M 9s 2023-12-03T11:51:25.160 INFO:teuthology.orchestra.run.smithi003.stderr: 38850K .......... .......... .......... .......... .......... 41% 17.5M 9s 2023-12-03T11:51:25.162 INFO:teuthology.orchestra.run.smithi003.stderr: 38900K .......... .......... .......... .......... .......... 41% 19.0M 9s 2023-12-03T11:51:25.165 INFO:teuthology.orchestra.run.smithi003.stderr: 38950K .......... .......... .......... .......... .......... 41% 21.6M 9s 2023-12-03T11:51:25.166 INFO:teuthology.orchestra.run.smithi003.stderr: 39000K .......... .......... .......... .......... .......... 42% 26.8M 9s 2023-12-03T11:51:25.170 INFO:teuthology.orchestra.run.smithi003.stderr: 39050K .......... .......... .......... .......... .......... 42% 19.0M 9s 2023-12-03T11:51:25.171 INFO:teuthology.orchestra.run.smithi003.stderr: 39100K .......... .......... .......... .......... .......... 42% 28.0M 9s 2023-12-03T11:51:25.174 INFO:teuthology.orchestra.run.smithi003.stderr: 39150K .......... .......... .......... .......... .......... 42% 14.0M 9s 2023-12-03T11:51:25.177 INFO:teuthology.orchestra.run.smithi003.stderr: 39200K .......... .......... .......... .......... .......... 42% 19.1M 9s 2023-12-03T11:51:25.181 INFO:teuthology.orchestra.run.smithi003.stderr: 39250K .......... .......... .......... .......... .......... 42% 12.6M 9s 2023-12-03T11:51:25.183 INFO:teuthology.orchestra.run.smithi003.stderr: 39300K .......... .......... .......... .......... .......... 42% 26.7M 9s 2023-12-03T11:51:25.187 INFO:teuthology.orchestra.run.smithi003.stderr: 39350K .......... .......... .......... .......... .......... 42% 11.0M 9s 2023-12-03T11:51:25.192 INFO:teuthology.orchestra.run.smithi003.stderr: 39400K .......... .......... .......... .......... .......... 42% 9.57M 9s 2023-12-03T11:51:25.197 INFO:teuthology.orchestra.run.smithi003.stderr: 39450K .......... .......... .......... .......... .......... 42% 10.5M 9s 2023-12-03T11:51:25.199 INFO:teuthology.orchestra.run.smithi003.stderr: 39500K .......... .......... .......... .......... .......... 42% 18.8M 9s 2023-12-03T11:51:25.201 INFO:teuthology.orchestra.run.smithi003.stderr: 39550K .......... .......... .......... .......... .......... 42% 24.3M 9s 2023-12-03T11:51:25.207 INFO:teuthology.orchestra.run.smithi003.stderr: 39600K .......... .......... .......... .......... .......... 42% 8.68M 9s 2023-12-03T11:51:25.211 INFO:teuthology.orchestra.run.smithi003.stderr: 39650K .......... .......... .......... .......... .......... 42% 14.0M 9s 2023-12-03T11:51:25.214 INFO:teuthology.orchestra.run.smithi003.stderr: 39700K .......... .......... .......... .......... .......... 42% 17.3M 8s 2023-12-03T11:51:25.215 INFO:teuthology.orchestra.run.smithi003.stderr: 39750K .......... .......... .......... .......... .......... 42% 26.6M 8s 2023-12-03T11:51:25.218 INFO:teuthology.orchestra.run.smithi003.stderr: 39800K .......... .......... .......... .......... .......... 42% 16.2M 8s 2023-12-03T11:51:25.220 INFO:teuthology.orchestra.run.smithi003.stderr: 39850K .......... .......... .......... .......... .......... 42% 21.5M 8s 2023-12-03T11:51:25.225 INFO:teuthology.orchestra.run.smithi003.stderr: 39900K .......... .......... .......... .......... .......... 43% 12.8M 8s 2023-12-03T11:51:25.227 INFO:teuthology.orchestra.run.smithi003.stderr: 39950K .......... .......... .......... .......... .......... 43% 18.5M 8s 2023-12-03T11:51:25.230 INFO:teuthology.orchestra.run.smithi003.stderr: 40000K .......... .......... .......... .......... .......... 43% 19.1M 8s 2023-12-03T11:51:25.232 INFO:teuthology.orchestra.run.smithi003.stderr: 40050K .......... .......... .......... .......... .......... 43% 19.0M 8s 2023-12-03T11:51:25.236 INFO:teuthology.orchestra.run.smithi003.stderr: 40100K .......... .......... .......... .......... .......... 43% 19.9M 8s 2023-12-03T11:51:25.237 INFO:teuthology.orchestra.run.smithi003.stderr: 40150K .......... .......... .......... .......... .......... 43% 19.1M 8s 2023-12-03T11:51:25.238 INFO:teuthology.orchestra.run.smithi003.stderr: 40200K .......... .......... .......... .......... .......... 43% 30.0M 8s 2023-12-03T11:51:25.241 INFO:teuthology.orchestra.run.smithi003.stderr: 40250K .......... .......... .......... .......... .......... 43% 19.6M 8s 2023-12-03T11:51:25.245 INFO:teuthology.orchestra.run.smithi003.stderr: 40300K .......... .......... .......... .......... .......... 43% 13.2M 8s 2023-12-03T11:51:25.248 INFO:teuthology.orchestra.run.smithi003.stderr: 40350K .......... .......... .......... .......... .......... 43% 16.5M 8s 2023-12-03T11:51:25.251 INFO:teuthology.orchestra.run.smithi003.stderr: 40400K .......... .......... .......... .......... .......... 43% 13.6M 8s 2023-12-03T11:51:25.254 INFO:teuthology.orchestra.run.smithi003.stderr: 40450K .......... .......... .......... .......... .......... 43% 25.5M 8s 2023-12-03T11:51:25.255 INFO:teuthology.orchestra.run.smithi003.stderr: 40500K .......... .......... .......... .......... .......... 43% 26.2M 8s 2023-12-03T11:51:25.257 INFO:teuthology.orchestra.run.smithi003.stderr: 40550K .......... .......... .......... .......... .......... 43% 20.8M 8s 2023-12-03T11:51:25.261 INFO:teuthology.orchestra.run.smithi003.stderr: 40600K .......... .......... .......... .......... .......... 43% 14.8M 8s 2023-12-03T11:51:25.264 INFO:teuthology.orchestra.run.smithi003.stderr: 40650K .......... .......... .......... .......... .......... 43% 17.6M 8s 2023-12-03T11:51:25.265 INFO:teuthology.orchestra.run.smithi003.stderr: 40700K .......... .......... .......... .......... .......... 43% 28.4M 8s 2023-12-03T11:51:25.267 INFO:teuthology.orchestra.run.smithi003.stderr: 40750K .......... .......... .......... .......... .......... 43% 21.5M 8s 2023-12-03T11:51:25.270 INFO:teuthology.orchestra.run.smithi003.stderr: 40800K .......... .......... .......... .......... .......... 43% 18.5M 8s 2023-12-03T11:51:25.273 INFO:teuthology.orchestra.run.smithi003.stderr: 40850K .......... .......... .......... .......... .......... 44% 21.9M 8s 2023-12-03T11:51:25.274 INFO:teuthology.orchestra.run.smithi003.stderr: 40900K .......... .......... .......... .......... .......... 44% 25.4M 8s 2023-12-03T11:51:25.278 INFO:teuthology.orchestra.run.smithi003.stderr: 40950K .......... .......... .......... .......... .......... 44% 14.3M 8s 2023-12-03T11:51:25.280 INFO:teuthology.orchestra.run.smithi003.stderr: 41000K .......... .......... .......... .......... .......... 44% 28.8M 8s 2023-12-03T11:51:25.283 INFO:teuthology.orchestra.run.smithi003.stderr: 41050K .......... .......... .......... .......... .......... 44% 17.2M 8s 2023-12-03T11:51:25.284 INFO:teuthology.orchestra.run.smithi003.stderr: 41100K .......... .......... .......... .......... .......... 44% 24.9M 8s 2023-12-03T11:51:25.286 INFO:teuthology.orchestra.run.smithi003.stderr: 41150K .......... .......... .......... .......... .......... 44% 26.3M 8s 2023-12-03T11:51:25.289 INFO:teuthology.orchestra.run.smithi003.stderr: 41200K .......... .......... .......... .......... .......... 44% 20.2M 8s 2023-12-03T11:51:25.291 INFO:teuthology.orchestra.run.smithi003.stderr: 41250K .......... .......... .......... .......... .......... 44% 20.8M 8s 2023-12-03T11:51:25.296 INFO:teuthology.orchestra.run.smithi003.stderr: 41300K .......... .......... .......... .......... .......... 44% 10.8M 8s 2023-12-03T11:51:25.298 INFO:teuthology.orchestra.run.smithi003.stderr: 41350K .......... .......... .......... .......... .......... 44% 17.6M 8s 2023-12-03T11:51:25.301 INFO:teuthology.orchestra.run.smithi003.stderr: 41400K .......... .......... .......... .......... .......... 44% 19.8M 8s 2023-12-03T11:51:25.303 INFO:teuthology.orchestra.run.smithi003.stderr: 41450K .......... .......... .......... .......... .......... 44% 17.2M 8s 2023-12-03T11:51:25.309 INFO:teuthology.orchestra.run.smithi003.stderr: 41500K .......... .......... .......... .......... .......... 44% 8.53M 8s 2023-12-03T11:51:25.314 INFO:teuthology.orchestra.run.smithi003.stderr: 41550K .......... .......... .......... .......... .......... 44% 10.7M 8s 2023-12-03T11:51:25.315 INFO:teuthology.orchestra.run.smithi003.stderr: 41600K .......... .......... .......... .......... .......... 44% 34.3M 8s 2023-12-03T11:51:25.320 INFO:teuthology.orchestra.run.smithi003.stderr: 41650K .......... .......... .......... .......... .......... 44% 10.9M 8s 2023-12-03T11:51:25.323 INFO:teuthology.orchestra.run.smithi003.stderr: 41700K .......... .......... .......... .......... .......... 44% 15.0M 8s 2023-12-03T11:51:25.324 INFO:teuthology.orchestra.run.smithi003.stderr: 41750K .......... .......... .......... .......... .......... 44% 32.2M 8s 2023-12-03T11:51:25.329 INFO:teuthology.orchestra.run.smithi003.stderr: 41800K .......... .......... .......... .......... .......... 45% 14.2M 8s 2023-12-03T11:51:25.331 INFO:teuthology.orchestra.run.smithi003.stderr: 41850K .......... .......... .......... .......... .......... 45% 21.0M 8s 2023-12-03T11:51:25.335 INFO:teuthology.orchestra.run.smithi003.stderr: 41900K .......... .......... .......... .......... .......... 45% 14.1M 8s 2023-12-03T11:51:25.336 INFO:teuthology.orchestra.run.smithi003.stderr: 41950K .......... .......... .......... .......... .......... 45% 21.4M 8s 2023-12-03T11:51:25.339 INFO:teuthology.orchestra.run.smithi003.stderr: 42000K .......... .......... .......... .......... .......... 45% 21.0M 8s 2023-12-03T11:51:25.341 INFO:teuthology.orchestra.run.smithi003.stderr: 42050K .......... .......... .......... .......... .......... 45% 24.5M 8s 2023-12-03T11:51:25.344 INFO:teuthology.orchestra.run.smithi003.stderr: 42100K .......... .......... .......... .......... .......... 45% 17.1M 8s 2023-12-03T11:51:25.346 INFO:teuthology.orchestra.run.smithi003.stderr: 42150K .......... .......... .......... .......... .......... 45% 19.7M 8s 2023-12-03T11:51:25.348 INFO:teuthology.orchestra.run.smithi003.stderr: 42200K .......... .......... .......... .......... .......... 45% 21.6M 8s 2023-12-03T11:51:25.351 INFO:teuthology.orchestra.run.smithi003.stderr: 42250K .......... .......... .......... .......... .......... 45% 22.6M 8s 2023-12-03T11:51:25.352 INFO:teuthology.orchestra.run.smithi003.stderr: 42300K .......... .......... .......... .......... .......... 45% 33.2M 8s 2023-12-03T11:51:25.354 INFO:teuthology.orchestra.run.smithi003.stderr: 42350K .......... .......... .......... .......... .......... 45% 24.1M 8s 2023-12-03T11:51:25.358 INFO:teuthology.orchestra.run.smithi003.stderr: 42400K .......... .......... .......... .......... .......... 45% 15.2M 8s 2023-12-03T11:51:25.361 INFO:teuthology.orchestra.run.smithi003.stderr: 42450K .......... .......... .......... .......... .......... 45% 20.6M 8s 2023-12-03T11:51:25.363 INFO:teuthology.orchestra.run.smithi003.stderr: 42500K .......... .......... .......... .......... .......... 45% 15.0M 8s 2023-12-03T11:51:25.365 INFO:teuthology.orchestra.run.smithi003.stderr: 42550K .......... .......... .......... .......... .......... 45% 24.3M 8s 2023-12-03T11:51:25.367 INFO:teuthology.orchestra.run.smithi003.stderr: 42600K .......... .......... .......... .......... .......... 45% 26.4M 8s 2023-12-03T11:51:25.369 INFO:teuthology.orchestra.run.smithi003.stderr: 42650K .......... .......... .......... .......... .......... 45% 20.2M 8s 2023-12-03T11:51:25.370 INFO:teuthology.orchestra.run.smithi003.stderr: 42700K .......... .......... .......... .......... .......... 46% 27.7M 8s 2023-12-03T11:51:25.373 INFO:teuthology.orchestra.run.smithi003.stderr: 42750K .......... .......... .......... .......... .......... 46% 16.7M 8s 2023-12-03T11:51:25.375 INFO:teuthology.orchestra.run.smithi003.stderr: 42800K .......... .......... .......... .......... .......... 46% 28.7M 8s 2023-12-03T11:51:25.377 INFO:teuthology.orchestra.run.smithi003.stderr: 42850K .......... .......... .......... .......... .......... 46% 28.6M 8s 2023-12-03T11:51:25.378 INFO:teuthology.orchestra.run.smithi003.stderr: 42900K .......... .......... .......... .......... .......... 46% 28.2M 8s 2023-12-03T11:51:25.380 INFO:teuthology.orchestra.run.smithi003.stderr: 42950K .......... .......... .......... .......... .......... 46% 30.3M 8s 2023-12-03T11:51:25.383 INFO:teuthology.orchestra.run.smithi003.stderr: 43000K .......... .......... .......... .......... .......... 46% 16.0M 8s 2023-12-03T11:51:25.385 INFO:teuthology.orchestra.run.smithi003.stderr: 43050K .......... .......... .......... .......... .......... 46% 34.7M 8s 2023-12-03T11:51:25.389 INFO:teuthology.orchestra.run.smithi003.stderr: 43100K .......... .......... .......... .......... .......... 46% 13.9M 8s 2023-12-03T11:51:25.389 INFO:teuthology.orchestra.run.smithi003.stderr: 43150K .......... .......... .......... .......... .......... 46% 37.5M 8s 2023-12-03T11:51:25.392 INFO:teuthology.orchestra.run.smithi003.stderr: 43200K .......... .......... .......... .......... .......... 46% 28.1M 7s 2023-12-03T11:51:25.394 INFO:teuthology.orchestra.run.smithi003.stderr: 43250K .......... .......... .......... .......... .......... 46% 18.2M 7s 2023-12-03T11:51:25.396 INFO:teuthology.orchestra.run.smithi003.stderr: 43300K .......... .......... .......... .......... .......... 46% 18.7M 7s 2023-12-03T11:51:25.398 INFO:teuthology.orchestra.run.smithi003.stderr: 43350K .......... .......... .......... .......... .......... 46% 27.0M 7s 2023-12-03T11:51:25.400 INFO:teuthology.orchestra.run.smithi003.stderr: 43400K .......... .......... .......... .......... .......... 46% 28.9M 7s 2023-12-03T11:51:25.402 INFO:teuthology.orchestra.run.smithi003.stderr: 43450K .......... .......... .......... .......... .......... 46% 28.1M 7s 2023-12-03T11:51:25.406 INFO:teuthology.orchestra.run.smithi003.stderr: 43500K .......... .......... .......... .......... .......... 46% 12.1M 7s 2023-12-03T11:51:25.407 INFO:teuthology.orchestra.run.smithi003.stderr: 43550K .......... .......... .......... .......... .......... 46% 31.6M 7s 2023-12-03T11:51:25.409 INFO:teuthology.orchestra.run.smithi003.stderr: 43600K .......... .......... .......... .......... .......... 46% 32.1M 7s 2023-12-03T11:51:25.414 INFO:teuthology.orchestra.run.smithi003.stderr: 43650K .......... .......... .......... .......... .......... 47% 10.3M 7s 2023-12-03T11:51:25.419 INFO:teuthology.orchestra.run.smithi003.stderr: 43700K .......... .......... .......... .......... .......... 47% 10.4M 7s 2023-12-03T11:51:25.421 INFO:teuthology.orchestra.run.smithi003.stderr: 43750K .......... .......... .......... .......... .......... 47% 18.2M 7s 2023-12-03T11:51:25.423 INFO:teuthology.orchestra.run.smithi003.stderr: 43800K .......... .......... .......... .......... .......... 47% 23.9M 7s 2023-12-03T11:51:25.434 INFO:teuthology.orchestra.run.smithi003.stderr: 43850K .......... .......... .......... .......... .......... 47% 10.4M 7s 2023-12-03T11:51:25.435 INFO:teuthology.orchestra.run.smithi003.stderr: 43900K .......... .......... .......... .......... .......... 47% 33.8M 7s 2023-12-03T11:51:25.435 INFO:teuthology.orchestra.run.smithi003.stderr: 43950K .......... .......... .......... .......... .......... 47% 25.2M 7s 2023-12-03T11:51:25.435 INFO:teuthology.orchestra.run.smithi003.stderr: 44000K .......... .......... .......... .......... .......... 47% 19.0M 7s 2023-12-03T11:51:25.437 INFO:teuthology.orchestra.run.smithi003.stderr: 44050K .......... .......... .......... .......... .......... 47% 28.0M 7s 2023-12-03T11:51:25.438 INFO:teuthology.orchestra.run.smithi003.stderr: 44100K .......... .......... .......... .......... .......... 47% 21.9M 7s 2023-12-03T11:51:25.441 INFO:teuthology.orchestra.run.smithi003.stderr: 44150K .......... .......... .......... .......... .......... 47% 15.6M 7s 2023-12-03T11:51:25.442 INFO:teuthology.orchestra.run.smithi003.stderr: 44200K .......... .......... .......... .......... .......... 47% 25.2M 7s 2023-12-03T11:51:25.444 INFO:teuthology.orchestra.run.smithi003.stderr: 44250K .......... .......... .......... .......... .......... 47% 27.5M 7s 2023-12-03T11:51:25.446 INFO:teuthology.orchestra.run.smithi003.stderr: 44300K .......... .......... .......... .......... .......... 47% 27.2M 7s 2023-12-03T11:51:25.448 INFO:teuthology.orchestra.run.smithi003.stderr: 44350K .......... .......... .......... .......... .......... 47% 24.6M 7s 2023-12-03T11:51:25.451 INFO:teuthology.orchestra.run.smithi003.stderr: 44400K .......... .......... .......... .......... .......... 47% 18.4M 7s 2023-12-03T11:51:25.453 INFO:teuthology.orchestra.run.smithi003.stderr: 44450K .......... .......... .......... .......... .......... 47% 19.1M 7s 2023-12-03T11:51:25.455 INFO:teuthology.orchestra.run.smithi003.stderr: 44500K .......... .......... .......... .......... .......... 47% 28.2M 7s 2023-12-03T11:51:25.457 INFO:teuthology.orchestra.run.smithi003.stderr: 44550K .......... .......... .......... .......... .......... 48% 26.0M 7s 2023-12-03T11:51:25.459 INFO:teuthology.orchestra.run.smithi003.stderr: 44600K .......... .......... .......... .......... .......... 48% 30.6M 7s 2023-12-03T11:51:25.461 INFO:teuthology.orchestra.run.smithi003.stderr: 44650K .......... .......... .......... .......... .......... 48% 19.0M 7s 2023-12-03T11:51:25.465 INFO:teuthology.orchestra.run.smithi003.stderr: 44700K .......... .......... .......... .......... .......... 48% 12.5M 7s 2023-12-03T11:51:25.467 INFO:teuthology.orchestra.run.smithi003.stderr: 44750K .......... .......... .......... .......... .......... 48% 29.2M 7s 2023-12-03T11:51:25.468 INFO:teuthology.orchestra.run.smithi003.stderr: 44800K .......... .......... .......... .......... .......... 48% 31.0M 7s 2023-12-03T11:51:25.470 INFO:teuthology.orchestra.run.smithi003.stderr: 44850K .......... .......... .......... .......... .......... 48% 26.9M 7s 2023-12-03T11:51:25.473 INFO:teuthology.orchestra.run.smithi003.stderr: 44900K .......... .......... .......... .......... .......... 48% 19.2M 7s 2023-12-03T11:51:25.474 INFO:teuthology.orchestra.run.smithi003.stderr: 44950K .......... .......... .......... .......... .......... 48% 29.3M 7s 2023-12-03T11:51:25.476 INFO:teuthology.orchestra.run.smithi003.stderr: 45000K .......... .......... .......... .......... .......... 48% 24.2M 7s 2023-12-03T11:51:25.479 INFO:teuthology.orchestra.run.smithi003.stderr: 45050K .......... .......... .......... .......... .......... 48% 28.4M 7s 2023-12-03T11:51:25.481 INFO:teuthology.orchestra.run.smithi003.stderr: 45100K .......... .......... .......... .......... .......... 48% 19.3M 7s 2023-12-03T11:51:25.483 INFO:teuthology.orchestra.run.smithi003.stderr: 45150K .......... .......... .......... .......... .......... 48% 20.1M 7s 2023-12-03T11:51:25.485 INFO:teuthology.orchestra.run.smithi003.stderr: 45200K .......... .......... .......... .......... .......... 48% 29.4M 7s 2023-12-03T11:51:25.487 INFO:teuthology.orchestra.run.smithi003.stderr: 45250K .......... .......... .......... .......... .......... 48% 23.5M 7s 2023-12-03T11:51:25.489 INFO:teuthology.orchestra.run.smithi003.stderr: 45300K .......... .......... .......... .......... .......... 48% 27.7M 7s 2023-12-03T11:51:25.491 INFO:teuthology.orchestra.run.smithi003.stderr: 45350K .......... .......... .......... .......... .......... 48% 18.8M 7s 2023-12-03T11:51:25.494 INFO:teuthology.orchestra.run.smithi003.stderr: 45400K .......... .......... .......... .......... .......... 48% 19.3M 7s 2023-12-03T11:51:25.495 INFO:teuthology.orchestra.run.smithi003.stderr: 45450K .......... .......... .......... .......... .......... 48% 29.6M 7s 2023-12-03T11:51:25.497 INFO:teuthology.orchestra.run.smithi003.stderr: 45500K .......... .......... .......... .......... .......... 49% 23.6M 7s 2023-12-03T11:51:25.499 INFO:teuthology.orchestra.run.smithi003.stderr: 45550K .......... .......... .......... .......... .......... 49% 26.9M 7s 2023-12-03T11:51:25.501 INFO:teuthology.orchestra.run.smithi003.stderr: 45600K .......... .......... .......... .......... .......... 49% 30.5M 7s 2023-12-03T11:51:25.503 INFO:teuthology.orchestra.run.smithi003.stderr: 45650K .......... .......... .......... .......... .......... 49% 17.8M 7s 2023-12-03T11:51:25.506 INFO:teuthology.orchestra.run.smithi003.stderr: 45700K .......... .......... .......... .......... .......... 49% 19.5M 7s 2023-12-03T11:51:25.508 INFO:teuthology.orchestra.run.smithi003.stderr: 45750K .......... .......... .......... .......... .......... 49% 25.9M 7s 2023-12-03T11:51:25.510 INFO:teuthology.orchestra.run.smithi003.stderr: 45800K .......... .......... .......... .......... .......... 49% 21.3M 7s 2023-12-03T11:51:25.512 INFO:teuthology.orchestra.run.smithi003.stderr: 45850K .......... .......... .......... .......... .......... 49% 33.0M 7s 2023-12-03T11:51:25.514 INFO:teuthology.orchestra.run.smithi003.stderr: 45900K .......... .......... .......... .......... .......... 49% 19.8M 7s 2023-12-03T11:51:25.517 INFO:teuthology.orchestra.run.smithi003.stderr: 45950K .......... .......... .......... .......... .......... 49% 14.2M 7s 2023-12-03T11:51:25.523 INFO:teuthology.orchestra.run.smithi003.stderr: 46000K .......... .......... .......... .......... .......... 49% 9.04M 7s 2023-12-03T11:51:25.525 INFO:teuthology.orchestra.run.smithi003.stderr: 46050K .......... .......... .......... .......... .......... 49% 21.9M 7s 2023-12-03T11:51:25.527 INFO:teuthology.orchestra.run.smithi003.stderr: 46100K .......... .......... .......... .......... .......... 49% 27.4M 7s 2023-12-03T11:51:25.533 INFO:teuthology.orchestra.run.smithi003.stderr: 46150K .......... .......... .......... .......... .......... 49% 8.63M 7s 2023-12-03T11:51:25.534 INFO:teuthology.orchestra.run.smithi003.stderr: 46200K .......... .......... .......... .......... .......... 49% 26.2M 7s 2023-12-03T11:51:25.537 INFO:teuthology.orchestra.run.smithi003.stderr: 46250K .......... .......... .......... .......... .......... 49% 29.7M 7s 2023-12-03T11:51:25.539 INFO:teuthology.orchestra.run.smithi003.stderr: 46300K .......... .......... .......... .......... .......... 49% 20.7M 7s 2023-12-03T11:51:25.540 INFO:teuthology.orchestra.run.smithi003.stderr: 46350K .......... .......... .......... .......... .......... 49% 33.1M 7s 2023-12-03T11:51:25.542 INFO:teuthology.orchestra.run.smithi003.stderr: 46400K .......... .......... .......... .......... .......... 49% 22.4M 7s 2023-12-03T11:51:25.543 INFO:teuthology.orchestra.run.smithi003.stderr: 46450K .......... .......... .......... .......... .......... 50% 43.9M 7s 2023-12-03T11:51:25.546 INFO:teuthology.orchestra.run.smithi003.stderr: 46500K .......... .......... .......... .......... .......... 50% 21.0M 7s 2023-12-03T11:51:25.547 INFO:teuthology.orchestra.run.smithi003.stderr: 46550K .......... .......... .......... .......... .......... 50% 31.6M 7s 2023-12-03T11:51:25.550 INFO:teuthology.orchestra.run.smithi003.stderr: 46600K .......... .......... .......... .......... .......... 50% 20.5M 7s 2023-12-03T11:51:25.552 INFO:teuthology.orchestra.run.smithi003.stderr: 46650K .......... .......... .......... .......... .......... 50% 42.3M 7s 2023-12-03T11:51:25.554 INFO:teuthology.orchestra.run.smithi003.stderr: 46700K .......... .......... .......... .......... .......... 50% 16.6M 7s 2023-12-03T11:51:25.556 INFO:teuthology.orchestra.run.smithi003.stderr: 46750K .......... .......... .......... .......... .......... 50% 24.1M 7s 2023-12-03T11:51:25.557 INFO:teuthology.orchestra.run.smithi003.stderr: 46800K .......... .......... .......... .......... .......... 50% 51.5M 7s 2023-12-03T11:51:25.559 INFO:teuthology.orchestra.run.smithi003.stderr: 46850K .......... .......... .......... .......... .......... 50% 22.8M 7s 2023-12-03T11:51:25.561 INFO:teuthology.orchestra.run.smithi003.stderr: 46900K .......... .......... .......... .......... .......... 50% 21.6M 7s 2023-12-03T11:51:25.562 INFO:teuthology.orchestra.run.smithi003.stderr: 46950K .......... .......... .......... .......... .......... 50% 48.9M 7s 2023-12-03T11:51:25.564 INFO:teuthology.orchestra.run.smithi003.stderr: 47000K .......... .......... .......... .......... .......... 50% 30.5M 7s 2023-12-03T11:51:25.567 INFO:teuthology.orchestra.run.smithi003.stderr: 47050K .......... .......... .......... .......... .......... 50% 14.2M 7s 2023-12-03T11:51:25.569 INFO:teuthology.orchestra.run.smithi003.stderr: 47100K .......... .......... .......... .......... .......... 50% 28.3M 7s 2023-12-03T11:51:25.571 INFO:teuthology.orchestra.run.smithi003.stderr: 47150K .......... .......... .......... .......... .......... 50% 32.3M 6s 2023-12-03T11:51:25.572 INFO:teuthology.orchestra.run.smithi003.stderr: 47200K .......... .......... .......... .......... .......... 50% 27.1M 6s 2023-12-03T11:51:25.574 INFO:teuthology.orchestra.run.smithi003.stderr: 47250K .......... .......... .......... .......... .......... 50% 22.2M 6s 2023-12-03T11:51:25.576 INFO:teuthology.orchestra.run.smithi003.stderr: 47300K .......... .......... .......... .......... .......... 50% 24.7M 6s 2023-12-03T11:51:25.577 INFO:teuthology.orchestra.run.smithi003.stderr: 47350K .......... .......... .......... .......... .......... 51% 42.9M 6s 2023-12-03T11:51:25.579 INFO:teuthology.orchestra.run.smithi003.stderr: 47400K .......... .......... .......... .......... .......... 51% 29.1M 6s 2023-12-03T11:51:25.581 INFO:teuthology.orchestra.run.smithi003.stderr: 47450K .......... .......... .......... .......... .......... 51% 25.3M 6s 2023-12-03T11:51:25.582 INFO:teuthology.orchestra.run.smithi003.stderr: 47500K .......... .......... .......... .......... .......... 51% 35.5M 6s 2023-12-03T11:51:25.584 INFO:teuthology.orchestra.run.smithi003.stderr: 47550K .......... .......... .......... .......... .......... 51% 36.9M 6s 2023-12-03T11:51:25.586 INFO:teuthology.orchestra.run.smithi003.stderr: 47600K .......... .......... .......... .......... .......... 51% 18.6M 6s 2023-12-03T11:51:25.588 INFO:teuthology.orchestra.run.smithi003.stderr: 47650K .......... .......... .......... .......... .......... 51% 23.7M 6s 2023-12-03T11:51:25.591 INFO:teuthology.orchestra.run.smithi003.stderr: 47700K .......... .......... .......... .......... .......... 51% 20.0M 6s 2023-12-03T11:51:25.592 INFO:teuthology.orchestra.run.smithi003.stderr: 47750K .......... .......... .......... .......... .......... 51% 43.3M 6s 2023-12-03T11:51:25.595 INFO:teuthology.orchestra.run.smithi003.stderr: 47800K .......... .......... .......... .......... .......... 51% 19.6M 6s 2023-12-03T11:51:25.595 INFO:teuthology.orchestra.run.smithi003.stderr: 47850K .......... .......... .......... .......... .......... 51% 47.0M 6s 2023-12-03T11:51:25.598 INFO:teuthology.orchestra.run.smithi003.stderr: 47900K .......... .......... .......... .......... .......... 51% 19.5M 6s 2023-12-03T11:51:25.600 INFO:teuthology.orchestra.run.smithi003.stderr: 47950K .......... .......... .......... .......... .......... 51% 28.0M 6s 2023-12-03T11:51:25.601 INFO:teuthology.orchestra.run.smithi003.stderr: 48000K .......... .......... .......... .......... .......... 51% 29.8M 6s 2023-12-03T11:51:25.603 INFO:teuthology.orchestra.run.smithi003.stderr: 48050K .......... .......... .......... .......... .......... 51% 26.0M 6s 2023-12-03T11:51:25.605 INFO:teuthology.orchestra.run.smithi003.stderr: 48100K .......... .......... .......... .......... .......... 51% 24.0M 6s 2023-12-03T11:51:25.609 INFO:teuthology.orchestra.run.smithi003.stderr: 48150K .......... .......... .......... .......... .......... 51% 14.5M 6s 2023-12-03T11:51:25.610 INFO:teuthology.orchestra.run.smithi003.stderr: 48200K .......... .......... .......... .......... .......... 51% 56.7M 6s 2023-12-03T11:51:25.612 INFO:teuthology.orchestra.run.smithi003.stderr: 48250K .......... .......... .......... .......... .......... 51% 21.6M 6s 2023-12-03T11:51:25.613 INFO:teuthology.orchestra.run.smithi003.stderr: 48300K .......... .......... .......... .......... .......... 52% 28.6M 6s 2023-12-03T11:51:25.617 INFO:teuthology.orchestra.run.smithi003.stderr: 48350K .......... .......... .......... .......... .......... 52% 15.2M 6s 2023-12-03T11:51:25.622 INFO:teuthology.orchestra.run.smithi003.stderr: 48400K .......... .......... .......... .......... .......... 52% 10.0M 6s 2023-12-03T11:51:25.624 INFO:teuthology.orchestra.run.smithi003.stderr: 48450K .......... .......... .......... .......... .......... 52% 20.4M 6s 2023-12-03T11:51:25.626 INFO:teuthology.orchestra.run.smithi003.stderr: 48500K .......... .......... .......... .......... .......... 52% 28.7M 6s 2023-12-03T11:51:25.630 INFO:teuthology.orchestra.run.smithi003.stderr: 48550K .......... .......... .......... .......... .......... 52% 10.1M 6s 2023-12-03T11:51:25.632 INFO:teuthology.orchestra.run.smithi003.stderr: 48600K .......... .......... .......... .......... .......... 52% 29.3M 6s 2023-12-03T11:51:25.634 INFO:teuthology.orchestra.run.smithi003.stderr: 48650K .......... .......... .......... .......... .......... 52% 28.7M 6s 2023-12-03T11:51:25.636 INFO:teuthology.orchestra.run.smithi003.stderr: 48700K .......... .......... .......... .......... .......... 52% 20.5M 6s 2023-12-03T11:51:25.638 INFO:teuthology.orchestra.run.smithi003.stderr: 48750K .......... .......... .......... .......... .......... 52% 33.1M 6s 2023-12-03T11:51:25.639 INFO:teuthology.orchestra.run.smithi003.stderr: 48800K .......... .......... .......... .......... .......... 52% 27.4M 6s 2023-12-03T11:51:25.641 INFO:teuthology.orchestra.run.smithi003.stderr: 48850K .......... .......... .......... .......... .......... 52% 22.8M 6s 2023-12-03T11:51:25.643 INFO:teuthology.orchestra.run.smithi003.stderr: 48900K .......... .......... .......... .......... .......... 52% 39.5M 6s 2023-12-03T11:51:25.645 INFO:teuthology.orchestra.run.smithi003.stderr: 48950K .......... .......... .......... .......... .......... 52% 21.8M 6s 2023-12-03T11:51:25.646 INFO:teuthology.orchestra.run.smithi003.stderr: 49000K .......... .......... .......... .......... .......... 52% 34.0M 6s 2023-12-03T11:51:25.648 INFO:teuthology.orchestra.run.smithi003.stderr: 49050K .......... .......... .......... .......... .......... 52% 35.4M 6s 2023-12-03T11:51:25.651 INFO:teuthology.orchestra.run.smithi003.stderr: 49100K .......... .......... .......... .......... .......... 52% 20.3M 6s 2023-12-03T11:51:25.652 INFO:teuthology.orchestra.run.smithi003.stderr: 49150K .......... .......... .......... .......... .......... 52% 39.6M 6s 2023-12-03T11:51:25.654 INFO:teuthology.orchestra.run.smithi003.stderr: 49200K .......... .......... .......... .......... .......... 53% 21.3M 6s 2023-12-03T11:51:25.655 INFO:teuthology.orchestra.run.smithi003.stderr: 49250K .......... .......... .......... .......... .......... 53% 77.5M 6s 2023-12-03T11:51:25.657 INFO:teuthology.orchestra.run.smithi003.stderr: 49300K .......... .......... .......... .......... .......... 53% 22.4M 6s 2023-12-03T11:51:25.659 INFO:teuthology.orchestra.run.smithi003.stderr: 49350K .......... .......... .......... .......... .......... 53% 38.4M 6s 2023-12-03T11:51:25.660 INFO:teuthology.orchestra.run.smithi003.stderr: 49400K .......... .......... .......... .......... .......... 53% 21.3M 6s 2023-12-03T11:51:25.663 INFO:teuthology.orchestra.run.smithi003.stderr: 49450K .......... .......... .......... .......... .......... 53% 21.9M 6s 2023-12-03T11:51:25.665 INFO:teuthology.orchestra.run.smithi003.stderr: 49500K .......... .......... .......... .......... .......... 53% 18.5M 6s 2023-12-03T11:51:25.667 INFO:teuthology.orchestra.run.smithi003.stderr: 49550K .......... .......... .......... .......... .......... 53% 27.4M 6s 2023-12-03T11:51:25.668 INFO:teuthology.orchestra.run.smithi003.stderr: 49600K .......... .......... .......... .......... .......... 53% 32.4M 6s 2023-12-03T11:51:25.670 INFO:teuthology.orchestra.run.smithi003.stderr: 49650K .......... .......... .......... .......... .......... 53% 24.5M 6s 2023-12-03T11:51:25.671 INFO:teuthology.orchestra.run.smithi003.stderr: 49700K .......... .......... .......... .......... .......... 53% 37.0M 6s 2023-12-03T11:51:25.674 INFO:teuthology.orchestra.run.smithi003.stderr: 49750K .......... .......... .......... .......... .......... 53% 19.9M 6s 2023-12-03T11:51:25.676 INFO:teuthology.orchestra.run.smithi003.stderr: 49800K .......... .......... .......... .......... .......... 53% 22.3M 6s 2023-12-03T11:51:25.678 INFO:teuthology.orchestra.run.smithi003.stderr: 49850K .......... .......... .......... .......... .......... 53% 35.1M 6s 2023-12-03T11:51:25.680 INFO:teuthology.orchestra.run.smithi003.stderr: 49900K .......... .......... .......... .......... .......... 53% 24.8M 6s 2023-12-03T11:51:25.681 INFO:teuthology.orchestra.run.smithi003.stderr: 49950K .......... .......... .......... .......... .......... 53% 35.8M 6s 2023-12-03T11:51:25.683 INFO:teuthology.orchestra.run.smithi003.stderr: 50000K .......... .......... .......... .......... .......... 53% 23.4M 6s 2023-12-03T11:51:25.686 INFO:teuthology.orchestra.run.smithi003.stderr: 50050K .......... .......... .......... .......... .......... 53% 22.2M 6s 2023-12-03T11:51:25.687 INFO:teuthology.orchestra.run.smithi003.stderr: 50100K .......... .......... .......... .......... .......... 53% 31.5M 6s 2023-12-03T11:51:25.688 INFO:teuthology.orchestra.run.smithi003.stderr: 50150K .......... .......... .......... .......... .......... 54% 43.9M 6s 2023-12-03T11:51:25.691 INFO:teuthology.orchestra.run.smithi003.stderr: 50200K .......... .......... .......... .......... .......... 54% 20.2M 6s 2023-12-03T11:51:25.692 INFO:teuthology.orchestra.run.smithi003.stderr: 50250K .......... .......... .......... .......... .......... 54% 35.4M 6s 2023-12-03T11:51:25.694 INFO:teuthology.orchestra.run.smithi003.stderr: 50300K .......... .......... .......... .......... .......... 54% 21.1M 6s 2023-12-03T11:51:25.696 INFO:teuthology.orchestra.run.smithi003.stderr: 50350K .......... .......... .......... .......... .......... 54% 27.5M 6s 2023-12-03T11:51:25.697 INFO:teuthology.orchestra.run.smithi003.stderr: 50400K .......... .......... .......... .......... .......... 54% 44.3M 6s 2023-12-03T11:51:25.700 INFO:teuthology.orchestra.run.smithi003.stderr: 50450K .......... .......... .......... .......... .......... 54% 18.8M 6s 2023-12-03T11:51:25.702 INFO:teuthology.orchestra.run.smithi003.stderr: 50500K .......... .......... .......... .......... .......... 54% 32.4M 6s 2023-12-03T11:51:25.703 INFO:teuthology.orchestra.run.smithi003.stderr: 50550K .......... .......... .......... .......... .......... 54% 23.8M 6s 2023-12-03T11:51:25.706 INFO:teuthology.orchestra.run.smithi003.stderr: 50600K .......... .......... .......... .......... .......... 54% 18.3M 6s 2023-12-03T11:51:25.708 INFO:teuthology.orchestra.run.smithi003.stderr: 50650K .......... .......... .......... .......... .......... 54% 29.8M 6s 2023-12-03T11:51:25.710 INFO:teuthology.orchestra.run.smithi003.stderr: 50700K .......... .......... .......... .......... .......... 54% 19.5M 6s 2023-12-03T11:51:25.712 INFO:teuthology.orchestra.run.smithi003.stderr: 50750K .......... .......... .......... .......... .......... 54% 24.5M 6s 2023-12-03T11:51:25.714 INFO:teuthology.orchestra.run.smithi003.stderr: 50800K .......... .......... .......... .......... .......... 54% 28.0M 6s 2023-12-03T11:51:25.716 INFO:teuthology.orchestra.run.smithi003.stderr: 50850K .......... .......... .......... .......... .......... 54% 25.5M 6s 2023-12-03T11:51:25.722 INFO:teuthology.orchestra.run.smithi003.stderr: 50900K .......... .......... .......... .......... .......... 54% 11.1M 6s 2023-12-03T11:51:25.725 INFO:teuthology.orchestra.run.smithi003.stderr: 50950K .......... .......... .......... .......... .......... 54% 10.4M 6s 2023-12-03T11:51:25.726 INFO:teuthology.orchestra.run.smithi003.stderr: 51000K .......... .......... .......... .......... .......... 54% 51.2M 6s 2023-12-03T11:51:25.732 INFO:teuthology.orchestra.run.smithi003.stderr: 51050K .......... .......... .......... .......... .......... 55% 9.16M 6s 2023-12-03T11:51:25.732 INFO:teuthology.orchestra.run.smithi003.stderr: 51100K .......... .......... .......... .......... .......... 55% 70.2M 6s 2023-12-03T11:51:25.734 INFO:teuthology.orchestra.run.smithi003.stderr: 51150K .......... .......... .......... .......... .......... 55% 23.0M 6s 2023-12-03T11:51:25.735 INFO:teuthology.orchestra.run.smithi003.stderr: 51200K .......... .......... .......... .......... .......... 55% 44.0M 6s 2023-12-03T11:51:25.737 INFO:teuthology.orchestra.run.smithi003.stderr: 51250K .......... .......... .......... .......... .......... 55% 20.4M 6s 2023-12-03T11:51:25.740 INFO:teuthology.orchestra.run.smithi003.stderr: 51300K .......... .......... .......... .......... .......... 55% 21.4M 6s 2023-12-03T11:51:25.741 INFO:teuthology.orchestra.run.smithi003.stderr: 51350K .......... .......... .......... .......... .......... 55% 54.0M 6s 2023-12-03T11:51:25.743 INFO:teuthology.orchestra.run.smithi003.stderr: 51400K .......... .......... .......... .......... .......... 55% 22.2M 6s 2023-12-03T11:51:25.744 INFO:teuthology.orchestra.run.smithi003.stderr: 51450K .......... .......... .......... .......... .......... 55% 46.9M 6s 2023-12-03T11:51:25.746 INFO:teuthology.orchestra.run.smithi003.stderr: 51500K .......... .......... .......... .......... .......... 55% 18.8M 6s 2023-12-03T11:51:25.748 INFO:teuthology.orchestra.run.smithi003.stderr: 51550K .......... .......... .......... .......... .......... 55% 29.0M 6s 2023-12-03T11:51:25.749 INFO:teuthology.orchestra.run.smithi003.stderr: 51600K .......... .......... .......... .......... .......... 55% 54.4M 5s 2023-12-03T11:51:25.752 INFO:teuthology.orchestra.run.smithi003.stderr: 51650K .......... .......... .......... .......... .......... 55% 17.7M 5s 2023-12-03T11:51:25.753 INFO:teuthology.orchestra.run.smithi003.stderr: 51700K .......... .......... .......... .......... .......... 55% 36.6M 5s 2023-12-03T11:51:25.755 INFO:teuthology.orchestra.run.smithi003.stderr: 51750K .......... .......... .......... .......... .......... 55% 25.3M 5s 2023-12-03T11:51:25.756 INFO:teuthology.orchestra.run.smithi003.stderr: 51800K .......... .......... .......... .......... .......... 55% 42.7M 5s 2023-12-03T11:51:25.758 INFO:teuthology.orchestra.run.smithi003.stderr: 51850K .......... .......... .......... .......... .......... 55% 24.2M 5s 2023-12-03T11:51:25.760 INFO:teuthology.orchestra.run.smithi003.stderr: 51900K .......... .......... .......... .......... .......... 55% 23.0M 5s 2023-12-03T11:51:25.761 INFO:teuthology.orchestra.run.smithi003.stderr: 51950K .......... .......... .......... .......... .......... 55% 42.9M 5s 2023-12-03T11:51:25.764 INFO:teuthology.orchestra.run.smithi003.stderr: 52000K .......... .......... .......... .......... .......... 56% 23.0M 5s 2023-12-03T11:51:25.765 INFO:teuthology.orchestra.run.smithi003.stderr: 52050K .......... .......... .......... .......... .......... 56% 43.1M 5s 2023-12-03T11:51:25.767 INFO:teuthology.orchestra.run.smithi003.stderr: 52100K .......... .......... .......... .......... .......... 56% 18.5M 5s 2023-12-03T11:51:25.769 INFO:teuthology.orchestra.run.smithi003.stderr: 52150K .......... .......... .......... .......... .......... 56% 30.2M 5s 2023-12-03T11:51:25.771 INFO:teuthology.orchestra.run.smithi003.stderr: 52200K .......... .......... .......... .......... .......... 56% 27.0M 5s 2023-12-03T11:51:25.773 INFO:teuthology.orchestra.run.smithi003.stderr: 52250K .......... .......... .......... .......... .......... 56% 30.1M 5s 2023-12-03T11:51:25.775 INFO:teuthology.orchestra.run.smithi003.stderr: 52300K .......... .......... .......... .......... .......... 56% 20.7M 5s 2023-12-03T11:51:25.777 INFO:teuthology.orchestra.run.smithi003.stderr: 52350K .......... .......... .......... .......... .......... 56% 26.6M 5s 2023-12-03T11:51:25.778 INFO:teuthology.orchestra.run.smithi003.stderr: 52400K .......... .......... .......... .......... .......... 56% 35.0M 5s 2023-12-03T11:51:25.780 INFO:teuthology.orchestra.run.smithi003.stderr: 52450K .......... .......... .......... .......... .......... 56% 29.9M 5s 2023-12-03T11:51:25.781 INFO:teuthology.orchestra.run.smithi003.stderr: 52500K .......... .......... .......... .......... .......... 56% 26.4M 5s 2023-12-03T11:51:25.783 INFO:teuthology.orchestra.run.smithi003.stderr: 52550K .......... .......... .......... .......... .......... 56% 34.3M 5s 2023-12-03T11:51:25.784 INFO:teuthology.orchestra.run.smithi003.stderr: 52600K .......... .......... .......... .......... .......... 56% 36.3M 5s 2023-12-03T11:51:25.786 INFO:teuthology.orchestra.run.smithi003.stderr: 52650K .......... .......... .......... .......... .......... 56% 22.5M 5s 2023-12-03T11:51:25.788 INFO:teuthology.orchestra.run.smithi003.stderr: 52700K .......... .......... .......... .......... .......... 56% 26.8M 5s 2023-12-03T11:51:25.791 INFO:teuthology.orchestra.run.smithi003.stderr: 52750K .......... .......... .......... .......... .......... 56% 18.7M 5s 2023-12-03T11:51:25.794 INFO:teuthology.orchestra.run.smithi003.stderr: 52800K .......... .......... .......... .......... .......... 56% 17.9M 5s 2023-12-03T11:51:25.796 INFO:teuthology.orchestra.run.smithi003.stderr: 52850K .......... .......... .......... .......... .......... 56% 20.9M 5s 2023-12-03T11:51:25.797 INFO:teuthology.orchestra.run.smithi003.stderr: 52900K .......... .......... .......... .......... .......... 56% 28.7M 5s 2023-12-03T11:51:25.800 INFO:teuthology.orchestra.run.smithi003.stderr: 52950K .......... .......... .......... .......... .......... 57% 25.0M 5s 2023-12-03T11:51:25.801 INFO:teuthology.orchestra.run.smithi003.stderr: 53000K .......... .......... .......... .......... .......... 57% 31.3M 5s 2023-12-03T11:51:25.804 INFO:teuthology.orchestra.run.smithi003.stderr: 53050K .......... .......... .......... .......... .......... 57% 16.9M 5s 2023-12-03T11:51:25.805 INFO:teuthology.orchestra.run.smithi003.stderr: 53100K .......... .......... .......... .......... .......... 57% 61.8M 5s 2023-12-03T11:51:25.808 INFO:teuthology.orchestra.run.smithi003.stderr: 53150K .......... .......... .......... .......... .......... 57% 18.5M 5s 2023-12-03T11:51:25.810 INFO:teuthology.orchestra.run.smithi003.stderr: 53200K .......... .......... .......... .......... .......... 57% 36.2M 5s 2023-12-03T11:51:25.812 INFO:teuthology.orchestra.run.smithi003.stderr: 53250K .......... .......... .......... .......... .......... 57% 16.8M 5s 2023-12-03T11:51:25.816 INFO:teuthology.orchestra.run.smithi003.stderr: 53300K .......... .......... .......... .......... .......... 57% 13.9M 5s 2023-12-03T11:51:25.816 INFO:teuthology.orchestra.run.smithi003.stderr: 53350K .......... .......... .......... .......... .......... 57% 51.9M 5s 2023-12-03T11:51:25.819 INFO:teuthology.orchestra.run.smithi003.stderr: 53400K .......... .......... .......... .......... .......... 57% 18.4M 5s 2023-12-03T11:51:25.820 INFO:teuthology.orchestra.run.smithi003.stderr: 53450K .......... .......... .......... .......... .......... 57% 42.1M 5s 2023-12-03T11:51:25.822 INFO:teuthology.orchestra.run.smithi003.stderr: 53500K .......... .......... .......... .......... .......... 57% 22.8M 5s 2023-12-03T11:51:25.825 INFO:teuthology.orchestra.run.smithi003.stderr: 53550K .......... .......... .......... .......... .......... 57% 14.7M 5s 2023-12-03T11:51:25.828 INFO:teuthology.orchestra.run.smithi003.stderr: 53600K .......... .......... .......... .......... .......... 57% 20.6M 5s 2023-12-03T11:51:25.829 INFO:teuthology.orchestra.run.smithi003.stderr: 53650K .......... .......... .......... .......... .......... 57% 35.7M 5s 2023-12-03T11:51:25.833 INFO:teuthology.orchestra.run.smithi003.stderr: 53700K .......... .......... .......... .......... .......... 57% 33.0M 5s 2023-12-03T11:51:25.835 INFO:teuthology.orchestra.run.smithi003.stderr: 53750K .......... .......... .......... .......... .......... 57% 12.1M 5s 2023-12-03T11:51:25.836 INFO:teuthology.orchestra.run.smithi003.stderr: 53800K .......... .......... .......... .......... .......... 57% 40.5M 5s 2023-12-03T11:51:25.837 INFO:teuthology.orchestra.run.smithi003.stderr: 53850K .......... .......... .......... .......... .......... 58% 39.4M 5s 2023-12-03T11:51:25.839 INFO:teuthology.orchestra.run.smithi003.stderr: 53900K .......... .......... .......... .......... .......... 58% 21.8M 5s 2023-12-03T11:51:25.840 INFO:teuthology.orchestra.run.smithi003.stderr: 53950K .......... .......... .......... .......... .......... 58% 42.1M 5s 2023-12-03T11:51:25.843 INFO:teuthology.orchestra.run.smithi003.stderr: 54000K .......... .......... .......... .......... .......... 58% 21.3M 5s 2023-12-03T11:51:25.844 INFO:teuthology.orchestra.run.smithi003.stderr: 54050K .......... .......... .......... .......... .......... 58% 29.8M 5s 2023-12-03T11:51:25.846 INFO:teuthology.orchestra.run.smithi003.stderr: 54100K .......... .......... .......... .......... .......... 58% 34.2M 5s 2023-12-03T11:51:25.847 INFO:teuthology.orchestra.run.smithi003.stderr: 54150K .......... .......... .......... .......... .......... 58% 34.8M 5s 2023-12-03T11:51:25.850 INFO:teuthology.orchestra.run.smithi003.stderr: 54200K .......... .......... .......... .......... .......... 58% 19.0M 5s 2023-12-03T11:51:25.851 INFO:teuthology.orchestra.run.smithi003.stderr: 54250K .......... .......... .......... .......... .......... 58% 39.0M 5s 2023-12-03T11:51:25.857 INFO:teuthology.orchestra.run.smithi003.stderr: 54300K .......... .......... .......... .......... .......... 58% 10.2M 5s 2023-12-03T11:51:25.857 INFO:teuthology.orchestra.run.smithi003.stderr: 54350K .......... .......... .......... .......... .......... 58% 132M 5s 2023-12-03T11:51:25.857 INFO:teuthology.orchestra.run.smithi003.stderr: 54400K .......... .......... .......... .......... .......... 58% 61.2M 5s 2023-12-03T11:51:25.860 INFO:teuthology.orchestra.run.smithi003.stderr: 54450K .......... .......... .......... .......... .......... 58% 21.9M 5s 2023-12-03T11:51:25.860 INFO:teuthology.orchestra.run.smithi003.stderr: 54500K .......... .......... .......... .......... .......... 58% 83.6M 5s 2023-12-03T11:51:25.862 INFO:teuthology.orchestra.run.smithi003.stderr: 54550K .......... .......... .......... .......... .......... 58% 28.7M 5s 2023-12-03T11:51:25.863 INFO:teuthology.orchestra.run.smithi003.stderr: 54600K .......... .......... .......... .......... .......... 58% 39.7M 5s 2023-12-03T11:51:25.865 INFO:teuthology.orchestra.run.smithi003.stderr: 54650K .......... .......... .......... .......... .......... 58% 25.9M 5s 2023-12-03T11:51:25.866 INFO:teuthology.orchestra.run.smithi003.stderr: 54700K .......... .......... .......... .......... .......... 58% 40.7M 5s 2023-12-03T11:51:25.868 INFO:teuthology.orchestra.run.smithi003.stderr: 54750K .......... .......... .......... .......... .......... 58% 20.9M 5s 2023-12-03T11:51:25.870 INFO:teuthology.orchestra.run.smithi003.stderr: 54800K .......... .......... .......... .......... .......... 59% 23.2M 5s 2023-12-03T11:51:25.872 INFO:teuthology.orchestra.run.smithi003.stderr: 54850K .......... .......... .......... .......... .......... 59% 24.8M 5s 2023-12-03T11:51:25.874 INFO:teuthology.orchestra.run.smithi003.stderr: 54900K .......... .......... .......... .......... .......... 59% 26.3M 5s 2023-12-03T11:51:25.876 INFO:teuthology.orchestra.run.smithi003.stderr: 54950K .......... .......... .......... .......... .......... 59% 29.0M 5s 2023-12-03T11:51:25.879 INFO:teuthology.orchestra.run.smithi003.stderr: 55000K .......... .......... .......... .......... .......... 59% 16.2M 5s 2023-12-03T11:51:25.880 INFO:teuthology.orchestra.run.smithi003.stderr: 55050K .......... .......... .......... .......... .......... 59% 48.7M 5s 2023-12-03T11:51:25.881 INFO:teuthology.orchestra.run.smithi003.stderr: 55100K .......... .......... .......... .......... .......... 59% 43.5M 5s 2023-12-03T11:51:25.882 INFO:teuthology.orchestra.run.smithi003.stderr: 55150K .......... .......... .......... .......... .......... 59% 43.8M 5s 2023-12-03T11:51:25.884 INFO:teuthology.orchestra.run.smithi003.stderr: 55200K .......... .......... .......... .......... .......... 59% 25.2M 5s 2023-12-03T11:51:25.886 INFO:teuthology.orchestra.run.smithi003.stderr: 55250K .......... .......... .......... .......... .......... 59% 21.6M 5s 2023-12-03T11:51:25.887 INFO:teuthology.orchestra.run.smithi003.stderr: 55300K .......... .......... .......... .......... .......... 59% 43.7M 5s 2023-12-03T11:51:25.893 INFO:teuthology.orchestra.run.smithi003.stderr: 55350K .......... .......... .......... .......... .......... 59% 9.66M 5s 2023-12-03T11:51:25.893 INFO:teuthology.orchestra.run.smithi003.stderr: 55400K .......... .......... .......... .......... .......... 59% 46.1M 5s 2023-12-03T11:51:25.896 INFO:teuthology.orchestra.run.smithi003.stderr: 55450K .......... .......... .......... .......... .......... 59% 17.0M 5s 2023-12-03T11:51:25.899 INFO:teuthology.orchestra.run.smithi003.stderr: 55500K .......... .......... .......... .......... .......... 59% 21.5M 5s 2023-12-03T11:51:25.900 INFO:teuthology.orchestra.run.smithi003.stderr: 55550K .......... .......... .......... .......... .......... 59% 32.1M 5s 2023-12-03T11:51:25.902 INFO:teuthology.orchestra.run.smithi003.stderr: 55600K .......... .......... .......... .......... .......... 59% 34.7M 5s 2023-12-03T11:51:25.903 INFO:teuthology.orchestra.run.smithi003.stderr: 55650K .......... .......... .......... .......... .......... 59% 116M 5s 2023-12-03T11:51:25.904 INFO:teuthology.orchestra.run.smithi003.stderr: 55700K .......... .......... .......... .......... .......... 60% 27.1M 5s 2023-12-03T11:51:25.905 INFO:teuthology.orchestra.run.smithi003.stderr: 55750K .......... .......... .......... .......... .......... 60% 33.9M 5s 2023-12-03T11:51:25.908 INFO:teuthology.orchestra.run.smithi003.stderr: 55800K .......... .......... .......... .......... .......... 60% 24.8M 5s 2023-12-03T11:51:25.908 INFO:teuthology.orchestra.run.smithi003.stderr: 55850K .......... .......... .......... .......... .......... 60% 63.8M 5s 2023-12-03T11:51:25.910 INFO:teuthology.orchestra.run.smithi003.stderr: 55900K .......... .......... .......... .......... .......... 60% 27.4M 5s 2023-12-03T11:51:25.912 INFO:teuthology.orchestra.run.smithi003.stderr: 55950K .......... .......... .......... .......... .......... 60% 19.6M 5s 2023-12-03T11:51:25.913 INFO:teuthology.orchestra.run.smithi003.stderr: 56000K .......... .......... .......... .......... .......... 60% 35.7M 5s 2023-12-03T11:51:25.917 INFO:teuthology.orchestra.run.smithi003.stderr: 56050K .......... .......... .......... .......... .......... 60% 14.2M 5s 2023-12-03T11:51:25.919 INFO:teuthology.orchestra.run.smithi003.stderr: 56100K .......... .......... .......... .......... .......... 60% 29.2M 5s 2023-12-03T11:51:25.922 INFO:teuthology.orchestra.run.smithi003.stderr: 56150K .......... .......... .......... .......... .......... 60% 16.4M 5s 2023-12-03T11:51:25.924 INFO:teuthology.orchestra.run.smithi003.stderr: 56200K .......... .......... .......... .......... .......... 60% 26.3M 5s 2023-12-03T11:51:25.924 INFO:teuthology.orchestra.run.smithi003.stderr: 56250K .......... .......... .......... .......... .......... 60% 51.4M 5s 2023-12-03T11:51:25.928 INFO:teuthology.orchestra.run.smithi003.stderr: 56300K .......... .......... .......... .......... .......... 60% 13.9M 5s 2023-12-03T11:51:25.929 INFO:teuthology.orchestra.run.smithi003.stderr: 56350K .......... .......... .......... .......... .......... 60% 33.8M 5s 2023-12-03T11:51:25.934 INFO:teuthology.orchestra.run.smithi003.stderr: 56400K .......... .......... .......... .......... .......... 60% 14.7M 5s 2023-12-03T11:51:25.934 INFO:teuthology.orchestra.run.smithi003.stderr: 56450K .......... .......... .......... .......... .......... 60% 50.6M 5s 2023-12-03T11:51:25.935 INFO:teuthology.orchestra.run.smithi003.stderr: 56500K .......... .......... .......... .......... .......... 60% 40.0M 5s 2023-12-03T11:51:25.939 INFO:teuthology.orchestra.run.smithi003.stderr: 56550K .......... .......... .......... .......... .......... 60% 18.2M 5s 2023-12-03T11:51:25.939 INFO:teuthology.orchestra.run.smithi003.stderr: 56600K .......... .......... .......... .......... .......... 60% 106M 5s 2023-12-03T11:51:25.940 INFO:teuthology.orchestra.run.smithi003.stderr: 56650K .......... .......... .......... .......... .......... 61% 23.3M 5s 2023-12-03T11:51:25.941 INFO:teuthology.orchestra.run.smithi003.stderr: 56700K .......... .......... .......... .......... .......... 61% 49.5M 5s 2023-12-03T11:51:25.943 INFO:teuthology.orchestra.run.smithi003.stderr: 56750K .......... .......... .......... .......... .......... 61% 38.3M 4s 2023-12-03T11:51:25.944 INFO:teuthology.orchestra.run.smithi003.stderr: 56800K .......... .......... .......... .......... .......... 61% 32.2M 4s 2023-12-03T11:51:25.946 INFO:teuthology.orchestra.run.smithi003.stderr: 56850K .......... .......... .......... .......... .......... 61% 18.8M 4s 2023-12-03T11:51:25.948 INFO:teuthology.orchestra.run.smithi003.stderr: 56900K .......... .......... .......... .......... .......... 61% 33.2M 4s 2023-12-03T11:51:25.949 INFO:teuthology.orchestra.run.smithi003.stderr: 56950K .......... .......... .......... .......... .......... 61% 35.0M 4s 2023-12-03T11:51:25.952 INFO:teuthology.orchestra.run.smithi003.stderr: 57000K .......... .......... .......... .......... .......... 61% 22.1M 4s 2023-12-03T11:51:25.953 INFO:teuthology.orchestra.run.smithi003.stderr: 57050K .......... .......... .......... .......... .......... 61% 36.4M 4s 2023-12-03T11:51:25.959 INFO:teuthology.orchestra.run.smithi003.stderr: 57100K .......... .......... .......... .......... .......... 61% 8.76M 4s 2023-12-03T11:51:25.960 INFO:teuthology.orchestra.run.smithi003.stderr: 57150K .......... .......... .......... .......... .......... 61% 40.9M 4s 2023-12-03T11:51:25.961 INFO:teuthology.orchestra.run.smithi003.stderr: 57200K .......... .......... .......... .......... .......... 61% 45.1M 4s 2023-12-03T11:51:25.964 INFO:teuthology.orchestra.run.smithi003.stderr: 57250K .......... .......... .......... .......... .......... 61% 18.2M 4s 2023-12-03T11:51:25.965 INFO:teuthology.orchestra.run.smithi003.stderr: 57300K .......... .......... .......... .......... .......... 61% 33.0M 4s 2023-12-03T11:51:25.966 INFO:teuthology.orchestra.run.smithi003.stderr: 57350K .......... .......... .......... .......... .......... 61% 31.3M 4s 2023-12-03T11:51:25.968 INFO:teuthology.orchestra.run.smithi003.stderr: 57400K .......... .......... .......... .......... .......... 61% 32.2M 4s 2023-12-03T11:51:25.970 INFO:teuthology.orchestra.run.smithi003.stderr: 57450K .......... .......... .......... .......... .......... 61% 32.4M 4s 2023-12-03T11:51:25.971 INFO:teuthology.orchestra.run.smithi003.stderr: 57500K .......... .......... .......... .......... .......... 61% 32.0M 4s 2023-12-03T11:51:25.973 INFO:teuthology.orchestra.run.smithi003.stderr: 57550K .......... .......... .......... .......... .......... 62% 26.3M 4s 2023-12-03T11:51:25.975 INFO:teuthology.orchestra.run.smithi003.stderr: 57600K .......... .......... .......... .......... .......... 62% 23.9M 4s 2023-12-03T11:51:25.977 INFO:teuthology.orchestra.run.smithi003.stderr: 57650K .......... .......... .......... .......... .......... 62% 52.0M 4s 2023-12-03T11:51:25.977 INFO:teuthology.orchestra.run.smithi003.stderr: 57700K .......... .......... .......... .......... .......... 62% 114M 4s 2023-12-03T11:51:25.978 INFO:teuthology.orchestra.run.smithi003.stderr: 57750K .......... .......... .......... .......... .......... 62% 31.3M 4s 2023-12-03T11:51:25.979 INFO:teuthology.orchestra.run.smithi003.stderr: 57800K .......... .......... .......... .......... .......... 62% 52.2M 4s 2023-12-03T11:51:25.979 INFO:teuthology.orchestra.run.smithi003.stderr: 57850K .......... .......... .......... .......... .......... 62% 103M 4s 2023-12-03T11:51:25.981 INFO:teuthology.orchestra.run.smithi003.stderr: 57900K .......... .......... .......... .......... .......... 62% 31.2M 4s 2023-12-03T11:51:25.982 INFO:teuthology.orchestra.run.smithi003.stderr: 57950K .......... .......... .......... .......... .......... 62% 76.9M 4s 2023-12-03T11:51:25.984 INFO:teuthology.orchestra.run.smithi003.stderr: 58000K .......... .......... .......... .......... .......... 62% 21.9M 4s 2023-12-03T11:51:25.985 INFO:teuthology.orchestra.run.smithi003.stderr: 58050K .......... .......... .......... .......... .......... 62% 41.6M 4s 2023-12-03T11:51:25.987 INFO:teuthology.orchestra.run.smithi003.stderr: 58100K .......... .......... .......... .......... .......... 62% 23.7M 4s 2023-12-03T11:51:25.989 INFO:teuthology.orchestra.run.smithi003.stderr: 58150K .......... .......... .......... .......... .......... 62% 46.1M 4s 2023-12-03T11:51:25.989 INFO:teuthology.orchestra.run.smithi003.stderr: 58200K .......... .......... .......... .......... .......... 62% 77.4M 4s 2023-12-03T11:51:25.993 INFO:teuthology.orchestra.run.smithi003.stderr: 58250K .......... .......... .......... .......... .......... 62% 13.2M 4s 2023-12-03T11:51:25.995 INFO:teuthology.orchestra.run.smithi003.stderr: 58300K .......... .......... .......... .......... .......... 62% 33.5M 4s 2023-12-03T11:51:25.996 INFO:teuthology.orchestra.run.smithi003.stderr: 58350K .......... .......... .......... .......... .......... 62% 21.7M 4s 2023-12-03T11:51:25.999 INFO:teuthology.orchestra.run.smithi003.stderr: 58400K .......... .......... .......... .......... .......... 62% 18.5M 4s 2023-12-03T11:51:26.000 INFO:teuthology.orchestra.run.smithi003.stderr: 58450K .......... .......... .......... .......... .......... 62% 48.4M 4s 2023-12-03T11:51:26.002 INFO:teuthology.orchestra.run.smithi003.stderr: 58500K .......... .......... .......... .......... .......... 63% 22.2M 4s 2023-12-03T11:51:26.004 INFO:teuthology.orchestra.run.smithi003.stderr: 58550K .......... .......... .......... .......... .......... 63% 36.8M 4s 2023-12-03T11:51:26.004 INFO:teuthology.orchestra.run.smithi003.stderr: 58600K .......... .......... .......... .......... .......... 63% 63.4M 4s 2023-12-03T11:51:26.007 INFO:teuthology.orchestra.run.smithi003.stderr: 58650K .......... .......... .......... .......... .......... 63% 22.3M 4s 2023-12-03T11:51:26.009 INFO:teuthology.orchestra.run.smithi003.stderr: 58700K .......... .......... .......... .......... .......... 63% 45.4M 4s 2023-12-03T11:51:26.009 INFO:teuthology.orchestra.run.smithi003.stderr: 58750K .......... .......... .......... .......... .......... 63% 118M 4s 2023-12-03T11:51:26.010 INFO:teuthology.orchestra.run.smithi003.stderr: 58800K .......... .......... .......... .......... .......... 63% 31.7M 4s 2023-12-03T11:51:26.010 INFO:teuthology.orchestra.run.smithi003.stderr: 58850K .......... .......... .......... .......... .......... 63% 48.9M 4s 2023-12-03T11:51:26.011 INFO:teuthology.orchestra.run.smithi003.stderr: 58900K .......... .......... .......... .......... .......... 63% 45.5M 4s 2023-12-03T11:51:26.014 INFO:teuthology.orchestra.run.smithi003.stderr: 58950K .......... .......... .......... .......... .......... 63% 19.7M 4s 2023-12-03T11:51:26.017 INFO:teuthology.orchestra.run.smithi003.stderr: 59000K .......... .......... .......... .......... .......... 63% 16.6M 4s 2023-12-03T11:51:26.019 INFO:teuthology.orchestra.run.smithi003.stderr: 59050K .......... .......... .......... .......... .......... 63% 27.3M 4s 2023-12-03T11:51:26.020 INFO:teuthology.orchestra.run.smithi003.stderr: 59100K .......... .......... .......... .......... .......... 63% 34.9M 4s 2023-12-03T11:51:26.021 INFO:teuthology.orchestra.run.smithi003.stderr: 59150K .......... .......... .......... .......... .......... 63% 35.5M 4s 2023-12-03T11:51:26.023 INFO:teuthology.orchestra.run.smithi003.stderr: 59200K .......... .......... .......... .......... .......... 63% 36.9M 4s 2023-12-03T11:51:26.027 INFO:teuthology.orchestra.run.smithi003.stderr: 59250K .......... .......... .......... .......... .......... 63% 11.8M 4s 2023-12-03T11:51:26.028 INFO:teuthology.orchestra.run.smithi003.stderr: 59300K .......... .......... .......... .......... .......... 63% 34.4M 4s 2023-12-03T11:51:26.030 INFO:teuthology.orchestra.run.smithi003.stderr: 59350K .......... .......... .......... .......... .......... 63% 23.9M 4s 2023-12-03T11:51:26.032 INFO:teuthology.orchestra.run.smithi003.stderr: 59400K .......... .......... .......... .......... .......... 63% 37.6M 4s 2023-12-03T11:51:26.035 INFO:teuthology.orchestra.run.smithi003.stderr: 59450K .......... .......... .......... .......... .......... 64% 17.8M 4s 2023-12-03T11:51:26.039 INFO:teuthology.orchestra.run.smithi003.stderr: 59500K .......... .......... .......... .......... .......... 64% 63.4M 4s 2023-12-03T11:51:26.039 INFO:teuthology.orchestra.run.smithi003.stderr: 59550K .......... .......... .......... .......... .......... 64% 36.6M 4s 2023-12-03T11:51:26.039 INFO:teuthology.orchestra.run.smithi003.stderr: 59600K .......... .......... .......... .......... .......... 64% 55.4M 4s 2023-12-03T11:51:26.040 INFO:teuthology.orchestra.run.smithi003.stderr: 59650K .......... .......... .......... .......... .......... 64% 26.9M 4s 2023-12-03T11:51:26.041 INFO:teuthology.orchestra.run.smithi003.stderr: 59700K .......... .......... .......... .......... .......... 64% 22.2M 4s 2023-12-03T11:51:26.042 INFO:teuthology.orchestra.run.smithi003.stderr: 59750K .......... .......... .......... .......... .......... 64% 50.6M 4s 2023-12-03T11:51:26.043 INFO:teuthology.orchestra.run.smithi003.stderr: 59800K .......... .......... .......... .......... .......... 64% 39.6M 4s 2023-12-03T11:51:26.045 INFO:teuthology.orchestra.run.smithi003.stderr: 59850K .......... .......... .......... .......... .......... 64% 42.8M 4s 2023-12-03T11:51:26.046 INFO:teuthology.orchestra.run.smithi003.stderr: 59900K .......... .......... .......... .......... .......... 64% 31.0M 4s 2023-12-03T11:51:26.047 INFO:teuthology.orchestra.run.smithi003.stderr: 59950K .......... .......... .......... .......... .......... 64% 37.1M 4s 2023-12-03T11:51:26.050 INFO:teuthology.orchestra.run.smithi003.stderr: 60000K .......... .......... .......... .......... .......... 64% 27.1M 4s 2023-12-03T11:51:26.056 INFO:teuthology.orchestra.run.smithi003.stderr: 60050K .......... .......... .......... .......... .......... 64% 8.26M 4s 2023-12-03T11:51:26.056 INFO:teuthology.orchestra.run.smithi003.stderr: 60100K .......... .......... .......... .......... .......... 64% 115M 4s 2023-12-03T11:51:26.058 INFO:teuthology.orchestra.run.smithi003.stderr: 60150K .......... .......... .......... .......... .......... 64% 21.9M 4s 2023-12-03T11:51:26.059 INFO:teuthology.orchestra.run.smithi003.stderr: 60200K .......... .......... .......... .......... .......... 64% 51.1M 4s 2023-12-03T11:51:26.061 INFO:teuthology.orchestra.run.smithi003.stderr: 60250K .......... .......... .......... .......... .......... 64% 20.3M 4s 2023-12-03T11:51:26.064 INFO:teuthology.orchestra.run.smithi003.stderr: 60300K .......... .......... .......... .......... .......... 64% 23.5M 4s 2023-12-03T11:51:26.064 INFO:teuthology.orchestra.run.smithi003.stderr: 60350K .......... .......... .......... .......... .......... 65% 37.8M 4s 2023-12-03T11:51:26.066 INFO:teuthology.orchestra.run.smithi003.stderr: 60400K .......... .......... .......... .......... .......... 65% 29.6M 4s 2023-12-03T11:51:26.068 INFO:teuthology.orchestra.run.smithi003.stderr: 60450K .......... .......... .......... .......... .......... 65% 24.9M 4s 2023-12-03T11:51:26.071 INFO:teuthology.orchestra.run.smithi003.stderr: 60500K .......... .......... .......... .......... .......... 65% 35.1M 4s 2023-12-03T11:51:26.071 INFO:teuthology.orchestra.run.smithi003.stderr: 60550K .......... .......... .......... .......... .......... 65% 47.7M 4s 2023-12-03T11:51:26.073 INFO:teuthology.orchestra.run.smithi003.stderr: 60600K .......... .......... .......... .......... .......... 65% 19.8M 4s 2023-12-03T11:51:26.074 INFO:teuthology.orchestra.run.smithi003.stderr: 60650K .......... .......... .......... .......... .......... 65% 41.2M 4s 2023-12-03T11:51:26.075 INFO:teuthology.orchestra.run.smithi003.stderr: 60700K .......... .......... .......... .......... .......... 65% 39.7M 4s 2023-12-03T11:51:26.077 INFO:teuthology.orchestra.run.smithi003.stderr: 60750K .......... .......... .......... .......... .......... 65% 32.0M 4s 2023-12-03T11:51:26.079 INFO:teuthology.orchestra.run.smithi003.stderr: 60800K .......... .......... .......... .......... .......... 65% 33.9M 4s 2023-12-03T11:51:26.081 INFO:teuthology.orchestra.run.smithi003.stderr: 60850K .......... .......... .......... .......... .......... 65% 26.0M 4s 2023-12-03T11:51:26.082 INFO:teuthology.orchestra.run.smithi003.stderr: 60900K .......... .......... .......... .......... .......... 65% 39.7M 4s 2023-12-03T11:51:26.085 INFO:teuthology.orchestra.run.smithi003.stderr: 60950K .......... .......... .......... .......... .......... 65% 18.7M 4s 2023-12-03T11:51:26.085 INFO:teuthology.orchestra.run.smithi003.stderr: 61000K .......... .......... .......... .......... .......... 65% 122M 4s 2023-12-03T11:51:26.086 INFO:teuthology.orchestra.run.smithi003.stderr: 61050K .......... .......... .......... .......... .......... 65% 31.1M 4s 2023-12-03T11:51:26.088 INFO:teuthology.orchestra.run.smithi003.stderr: 61100K .......... .......... .......... .......... .......... 65% 28.6M 4s 2023-12-03T11:51:26.089 INFO:teuthology.orchestra.run.smithi003.stderr: 61150K .......... .......... .......... .......... .......... 65% 43.8M 4s 2023-12-03T11:51:26.091 INFO:teuthology.orchestra.run.smithi003.stderr: 61200K .......... .......... .......... .......... .......... 65% 26.2M 4s 2023-12-03T11:51:26.092 INFO:teuthology.orchestra.run.smithi003.stderr: 61250K .......... .......... .......... .......... .......... 65% 51.0M 4s 2023-12-03T11:51:26.094 INFO:teuthology.orchestra.run.smithi003.stderr: 61300K .......... .......... .......... .......... .......... 66% 21.0M 4s 2023-12-03T11:51:26.095 INFO:teuthology.orchestra.run.smithi003.stderr: 61350K .......... .......... .......... .......... .......... 66% 49.3M 4s 2023-12-03T11:51:26.097 INFO:teuthology.orchestra.run.smithi003.stderr: 61400K .......... .......... .......... .......... .......... 66% 20.3M 4s 2023-12-03T11:51:26.098 INFO:teuthology.orchestra.run.smithi003.stderr: 61450K .......... .......... .......... .......... .......... 66% 52.7M 4s 2023-12-03T11:51:26.101 INFO:teuthology.orchestra.run.smithi003.stderr: 61500K .......... .......... .......... .......... .......... 66% 19.2M 4s 2023-12-03T11:51:26.103 INFO:teuthology.orchestra.run.smithi003.stderr: 61550K .......... .......... .......... .......... .......... 66% 23.6M 4s 2023-12-03T11:51:26.105 INFO:teuthology.orchestra.run.smithi003.stderr: 61600K .......... .......... .......... .......... .......... 66% 28.7M 4s 2023-12-03T11:51:26.107 INFO:teuthology.orchestra.run.smithi003.stderr: 61650K .......... .......... .......... .......... .......... 66% 23.3M 4s 2023-12-03T11:51:26.108 INFO:teuthology.orchestra.run.smithi003.stderr: 61700K .......... .......... .......... .......... .......... 66% 115M 4s 2023-12-03T11:51:26.109 INFO:teuthology.orchestra.run.smithi003.stderr: 61750K .......... .......... .......... .......... .......... 66% 29.3M 4s 2023-12-03T11:51:26.110 INFO:teuthology.orchestra.run.smithi003.stderr: 61800K .......... .......... .......... .......... .......... 66% 39.3M 4s 2023-12-03T11:51:26.112 INFO:teuthology.orchestra.run.smithi003.stderr: 61850K .......... .......... .......... .......... .......... 66% 30.4M 4s 2023-12-03T11:51:26.114 INFO:teuthology.orchestra.run.smithi003.stderr: 61900K .......... .......... .......... .......... .......... 66% 27.7M 4s 2023-12-03T11:51:26.115 INFO:teuthology.orchestra.run.smithi003.stderr: 61950K .......... .......... .......... .......... .......... 66% 28.4M 4s 2023-12-03T11:51:26.117 INFO:teuthology.orchestra.run.smithi003.stderr: 62000K .......... .......... .......... .......... .......... 66% 48.6M 4s 2023-12-03T11:51:26.118 INFO:teuthology.orchestra.run.smithi003.stderr: 62050K .......... .......... .......... .......... .......... 66% 26.7M 4s 2023-12-03T11:51:26.120 INFO:teuthology.orchestra.run.smithi003.stderr: 62100K .......... .......... .......... .......... .......... 66% 20.8M 4s 2023-12-03T11:51:26.123 INFO:teuthology.orchestra.run.smithi003.stderr: 62150K .......... .......... .......... .......... .......... 66% 27.0M 4s 2023-12-03T11:51:26.127 INFO:teuthology.orchestra.run.smithi003.stderr: 62200K .......... .......... .......... .......... .......... 67% 12.7M 4s 2023-12-03T11:51:26.127 INFO:teuthology.orchestra.run.smithi003.stderr: 62250K .......... .......... .......... .......... .......... 67% 132M 4s 2023-12-03T11:51:26.129 INFO:teuthology.orchestra.run.smithi003.stderr: 62300K .......... .......... .......... .......... .......... 67% 22.1M 4s 2023-12-03T11:51:26.131 INFO:teuthology.orchestra.run.smithi003.stderr: 62350K .......... .......... .......... .......... .......... 67% 19.2M 4s 2023-12-03T11:51:26.133 INFO:teuthology.orchestra.run.smithi003.stderr: 62400K .......... .......... .......... .......... .......... 67% 27.2M 4s 2023-12-03T11:51:26.135 INFO:teuthology.orchestra.run.smithi003.stderr: 62450K .......... .......... .......... .......... .......... 67% 24.8M 4s 2023-12-03T11:51:26.137 INFO:teuthology.orchestra.run.smithi003.stderr: 62500K .......... .......... .......... .......... .......... 67% 23.5M 4s 2023-12-03T11:51:26.141 INFO:teuthology.orchestra.run.smithi003.stderr: 62550K .......... .......... .......... .......... .......... 67% 20.6M 4s 2023-12-03T11:51:26.141 INFO:teuthology.orchestra.run.smithi003.stderr: 62600K .......... .......... .......... .......... .......... 67% 52.8M 4s 2023-12-03T11:51:26.142 INFO:teuthology.orchestra.run.smithi003.stderr: 62650K .......... .......... .......... .......... .......... 67% 33.1M 4s 2023-12-03T11:51:26.143 INFO:teuthology.orchestra.run.smithi003.stderr: 62700K .......... .......... .......... .......... .......... 67% 43.8M 3s 2023-12-03T11:51:26.144 INFO:teuthology.orchestra.run.smithi003.stderr: 62750K .......... .......... .......... .......... .......... 67% 43.4M 3s 2023-12-03T11:51:26.147 INFO:teuthology.orchestra.run.smithi003.stderr: 62800K .......... .......... .......... .......... .......... 67% 18.8M 3s 2023-12-03T11:51:26.149 INFO:teuthology.orchestra.run.smithi003.stderr: 62850K .......... .......... .......... .......... .......... 67% 26.1M 3s 2023-12-03T11:51:26.149 INFO:teuthology.orchestra.run.smithi003.stderr: 62900K .......... .......... .......... .......... .......... 67% 63.2M 3s 2023-12-03T11:51:26.151 INFO:teuthology.orchestra.run.smithi003.stderr: 62950K .......... .......... .......... .......... .......... 67% 32.3M 3s 2023-12-03T11:51:26.152 INFO:teuthology.orchestra.run.smithi003.stderr: 63000K .......... .......... .......... .......... .......... 67% 41.4M 3s 2023-12-03T11:51:26.154 INFO:teuthology.orchestra.run.smithi003.stderr: 63050K .......... .......... .......... .......... .......... 67% 36.8M 3s 2023-12-03T11:51:26.154 INFO:teuthology.orchestra.run.smithi003.stderr: 63100K .......... .......... .......... .......... .......... 67% 47.5M 3s 2023-12-03T11:51:26.161 INFO:teuthology.orchestra.run.smithi003.stderr: 63150K .......... .......... .......... .......... .......... 68% 7.73M 3s 2023-12-03T11:51:26.162 INFO:teuthology.orchestra.run.smithi003.stderr: 63200K .......... .......... .......... .......... .......... 68% 68.2M 3s 2023-12-03T11:51:26.163 INFO:teuthology.orchestra.run.smithi003.stderr: 63250K .......... .......... .......... .......... .......... 68% 25.2M 3s 2023-12-03T11:51:26.165 INFO:teuthology.orchestra.run.smithi003.stderr: 63300K .......... .......... .......... .......... .......... 68% 33.4M 3s 2023-12-03T11:51:26.167 INFO:teuthology.orchestra.run.smithi003.stderr: 63350K .......... .......... .......... .......... .......... 68% 28.5M 3s 2023-12-03T11:51:26.170 INFO:teuthology.orchestra.run.smithi003.stderr: 63400K .......... .......... .......... .......... .......... 68% 14.8M 3s 2023-12-03T11:51:26.171 INFO:teuthology.orchestra.run.smithi003.stderr: 63450K .......... .......... .......... .......... .......... 68% 36.9M 3s 2023-12-03T11:51:26.174 INFO:teuthology.orchestra.run.smithi003.stderr: 63500K .......... .......... .......... .......... .......... 68% 26.7M 3s 2023-12-03T11:51:26.174 INFO:teuthology.orchestra.run.smithi003.stderr: 63550K .......... .......... .......... .......... .......... 68% 93.9M 3s 2023-12-03T11:51:26.177 INFO:teuthology.orchestra.run.smithi003.stderr: 63600K .......... .......... .......... .......... .......... 68% 16.2M 3s 2023-12-03T11:51:26.178 INFO:teuthology.orchestra.run.smithi003.stderr: 63650K .......... .......... .......... .......... .......... 68% 27.0M 3s 2023-12-03T11:51:26.180 INFO:teuthology.orchestra.run.smithi003.stderr: 63700K .......... .......... .......... .......... .......... 68% 34.5M 3s 2023-12-03T11:51:26.181 INFO:teuthology.orchestra.run.smithi003.stderr: 63750K .......... .......... .......... .......... .......... 68% 34.8M 3s 2023-12-03T11:51:26.182 INFO:teuthology.orchestra.run.smithi003.stderr: 63800K .......... .......... .......... .......... .......... 68% 51.5M 3s 2023-12-03T11:51:26.186 INFO:teuthology.orchestra.run.smithi003.stderr: 63850K .......... .......... .......... .......... .......... 68% 18.3M 3s 2023-12-03T11:51:26.186 INFO:teuthology.orchestra.run.smithi003.stderr: 63900K .......... .......... .......... .......... .......... 68% 47.0M 3s 2023-12-03T11:51:26.187 INFO:teuthology.orchestra.run.smithi003.stderr: 63950K .......... .......... .......... .......... .......... 68% 48.0M 3s 2023-12-03T11:51:26.190 INFO:teuthology.orchestra.run.smithi003.stderr: 64000K .......... .......... .......... .......... .......... 68% 19.4M 3s 2023-12-03T11:51:26.190 INFO:teuthology.orchestra.run.smithi003.stderr: 64050K .......... .......... .......... .......... .......... 68% 87.3M 3s 2023-12-03T11:51:26.192 INFO:teuthology.orchestra.run.smithi003.stderr: 64100K .......... .......... .......... .......... .......... 69% 23.7M 3s 2023-12-03T11:51:26.193 INFO:teuthology.orchestra.run.smithi003.stderr: 64150K .......... .......... .......... .......... .......... 69% 50.5M 3s 2023-12-03T11:51:26.194 INFO:teuthology.orchestra.run.smithi003.stderr: 64200K .......... .......... .......... .......... .......... 69% 30.3M 3s 2023-12-03T11:51:26.197 INFO:teuthology.orchestra.run.smithi003.stderr: 64250K .......... .......... .......... .......... .......... 69% 23.7M 3s 2023-12-03T11:51:26.197 INFO:teuthology.orchestra.run.smithi003.stderr: 64300K .......... .......... .......... .......... .......... 69% 75.7M 3s 2023-12-03T11:51:26.201 INFO:teuthology.orchestra.run.smithi003.stderr: 64350K .......... .......... .......... .......... .......... 69% 20.9M 3s 2023-12-03T11:51:26.201 INFO:teuthology.orchestra.run.smithi003.stderr: 64400K .......... .......... .......... .......... .......... 69% 59.2M 3s 2023-12-03T11:51:26.202 INFO:teuthology.orchestra.run.smithi003.stderr: 64450K .......... .......... .......... .......... .......... 69% 49.6M 3s 2023-12-03T11:51:26.203 INFO:teuthology.orchestra.run.smithi003.stderr: 64500K .......... .......... .......... .......... .......... 69% 36.8M 3s 2023-12-03T11:51:26.205 INFO:teuthology.orchestra.run.smithi003.stderr: 64550K .......... .......... .......... .......... .......... 69% 23.3M 3s 2023-12-03T11:51:26.207 INFO:teuthology.orchestra.run.smithi003.stderr: 64600K .......... .......... .......... .......... .......... 69% 24.8M 3s 2023-12-03T11:51:26.208 INFO:teuthology.orchestra.run.smithi003.stderr: 64650K .......... .......... .......... .......... .......... 69% 41.7M 3s 2023-12-03T11:51:26.211 INFO:teuthology.orchestra.run.smithi003.stderr: 64700K .......... .......... .......... .......... .......... 69% 17.7M 3s 2023-12-03T11:51:26.212 INFO:teuthology.orchestra.run.smithi003.stderr: 64750K .......... .......... .......... .......... .......... 69% 45.5M 3s 2023-12-03T11:51:26.214 INFO:teuthology.orchestra.run.smithi003.stderr: 64800K .......... .......... .......... .......... .......... 69% 18.7M 3s 2023-12-03T11:51:26.216 INFO:teuthology.orchestra.run.smithi003.stderr: 64850K .......... .......... .......... .......... .......... 69% 40.0M 3s 2023-12-03T11:51:26.217 INFO:teuthology.orchestra.run.smithi003.stderr: 64900K .......... .......... .......... .......... .......... 69% 35.1M 3s 2023-12-03T11:51:26.218 INFO:teuthology.orchestra.run.smithi003.stderr: 64950K .......... .......... .......... .......... .......... 69% 39.2M 3s 2023-12-03T11:51:26.221 INFO:teuthology.orchestra.run.smithi003.stderr: 65000K .......... .......... .......... .......... .......... 70% 21.3M 3s 2023-12-03T11:51:26.222 INFO:teuthology.orchestra.run.smithi003.stderr: 65050K .......... .......... .......... .......... .......... 70% 48.8M 3s 2023-12-03T11:51:26.223 INFO:teuthology.orchestra.run.smithi003.stderr: 65100K .......... .......... .......... .......... .......... 70% 45.4M 3s 2023-12-03T11:51:26.224 INFO:teuthology.orchestra.run.smithi003.stderr: 65150K .......... .......... .......... .......... .......... 70% 25.3M 3s 2023-12-03T11:51:26.226 INFO:teuthology.orchestra.run.smithi003.stderr: 65200K .......... .......... .......... .......... .......... 70% 33.9M 3s 2023-12-03T11:51:26.228 INFO:teuthology.orchestra.run.smithi003.stderr: 65250K .......... .......... .......... .......... .......... 70% 34.2M 3s 2023-12-03T11:51:26.230 INFO:teuthology.orchestra.run.smithi003.stderr: 65300K .......... .......... .......... .......... .......... 70% 21.2M 3s 2023-12-03T11:51:26.231 INFO:teuthology.orchestra.run.smithi003.stderr: 65350K .......... .......... .......... .......... .......... 70% 35.5M 3s 2023-12-03T11:51:26.232 INFO:teuthology.orchestra.run.smithi003.stderr: 65400K .......... .......... .......... .......... .......... 70% 50.5M 3s 2023-12-03T11:51:26.236 INFO:teuthology.orchestra.run.smithi003.stderr: 65450K .......... .......... .......... .......... .......... 70% 13.4M 3s 2023-12-03T11:51:26.238 INFO:teuthology.orchestra.run.smithi003.stderr: 65500K .......... .......... .......... .......... .......... 70% 21.3M 3s 2023-12-03T11:51:26.243 INFO:teuthology.orchestra.run.smithi003.stderr: 65550K .......... .......... .......... .......... .......... 70% 18.6M 3s 2023-12-03T11:51:26.243 INFO:teuthology.orchestra.run.smithi003.stderr: 65600K .......... .......... .......... .......... .......... 70% 24.2M 3s 2023-12-03T11:51:26.245 INFO:teuthology.orchestra.run.smithi003.stderr: 65650K .......... .......... .......... .......... .......... 70% 23.9M 3s 2023-12-03T11:51:26.247 INFO:teuthology.orchestra.run.smithi003.stderr: 65700K .......... .......... .......... .......... .......... 70% 25.9M 3s 2023-12-03T11:51:26.249 INFO:teuthology.orchestra.run.smithi003.stderr: 65750K .......... .......... .......... .......... .......... 70% 18.8M 3s 2023-12-03T11:51:26.250 INFO:teuthology.orchestra.run.smithi003.stderr: 65800K .......... .......... .......... .......... .......... 70% 47.5M 3s 2023-12-03T11:51:26.252 INFO:teuthology.orchestra.run.smithi003.stderr: 65850K .......... .......... .......... .......... .......... 70% 33.8M 3s 2023-12-03T11:51:26.254 INFO:teuthology.orchestra.run.smithi003.stderr: 65900K .......... .......... .......... .......... .......... 70% 26.7M 3s 2023-12-03T11:51:26.254 INFO:teuthology.orchestra.run.smithi003.stderr: 65950K .......... .......... .......... .......... .......... 71% 50.0M 3s 2023-12-03T11:51:26.256 INFO:teuthology.orchestra.run.smithi003.stderr: 66000K .......... .......... .......... .......... .......... 71% 28.6M 3s 2023-12-03T11:51:26.257 INFO:teuthology.orchestra.run.smithi003.stderr: 66050K .......... .......... .......... .......... .......... 71% 36.7M 3s 2023-12-03T11:51:26.259 INFO:teuthology.orchestra.run.smithi003.stderr: 66100K .......... .......... .......... .......... .......... 71% 27.9M 3s 2023-12-03T11:51:26.260 INFO:teuthology.orchestra.run.smithi003.stderr: 66150K .......... .......... .......... .......... .......... 71% 50.0M 3s 2023-12-03T11:51:26.262 INFO:teuthology.orchestra.run.smithi003.stderr: 66200K .......... .......... .......... .......... .......... 71% 30.1M 3s 2023-12-03T11:51:26.264 INFO:teuthology.orchestra.run.smithi003.stderr: 66250K .......... .......... .......... .......... .......... 71% 30.8M 3s 2023-12-03T11:51:26.264 INFO:teuthology.orchestra.run.smithi003.stderr: 66300K .......... .......... .......... .......... .......... 71% 42.1M 3s 2023-12-03T11:51:26.266 INFO:teuthology.orchestra.run.smithi003.stderr: 66350K .......... .......... .......... .......... .......... 71% 50.6M 3s 2023-12-03T11:51:26.272 INFO:teuthology.orchestra.run.smithi003.stderr: 66400K .......... .......... .......... .......... .......... 71% 8.22M 3s 2023-12-03T11:51:26.273 INFO:teuthology.orchestra.run.smithi003.stderr: 66450K .......... .......... .......... .......... .......... 71% 37.6M 3s 2023-12-03T11:51:26.275 INFO:teuthology.orchestra.run.smithi003.stderr: 66500K .......... .......... .......... .......... .......... 71% 25.5M 3s 2023-12-03T11:51:26.275 INFO:teuthology.orchestra.run.smithi003.stderr: 66550K .......... .......... .......... .......... .......... 71% 57.3M 3s 2023-12-03T11:51:26.277 INFO:teuthology.orchestra.run.smithi003.stderr: 66600K .......... .......... .......... .......... .......... 71% 46.0M 3s 2023-12-03T11:51:26.282 INFO:teuthology.orchestra.run.smithi003.stderr: 66650K .......... .......... .......... .......... .......... 71% 10.5M 3s 2023-12-03T11:51:26.282 INFO:teuthology.orchestra.run.smithi003.stderr: 66700K .......... .......... .......... .......... .......... 71% 57.6M 3s 2023-12-03T11:51:26.283 INFO:teuthology.orchestra.run.smithi003.stderr: 66750K .......... .......... .......... .......... .......... 71% 45.8M 3s 2023-12-03T11:51:26.285 INFO:teuthology.orchestra.run.smithi003.stderr: 66800K .......... .......... .......... .......... .......... 71% 32.6M 3s 2023-12-03T11:51:26.287 INFO:teuthology.orchestra.run.smithi003.stderr: 66850K .......... .......... .......... .......... .......... 72% 21.3M 3s 2023-12-03T11:51:26.289 INFO:teuthology.orchestra.run.smithi003.stderr: 66900K .......... .......... .......... .......... .......... 72% 25.0M 3s 2023-12-03T11:51:26.292 INFO:teuthology.orchestra.run.smithi003.stderr: 66950K .......... .......... .......... .......... .......... 72% 18.6M 3s 2023-12-03T11:51:26.293 INFO:teuthology.orchestra.run.smithi003.stderr: 67000K .......... .......... .......... .......... .......... 72% 41.5M 3s 2023-12-03T11:51:26.293 INFO:teuthology.orchestra.run.smithi003.stderr: 67050K .......... .......... .......... .......... .......... 72% 87.5M 3s 2023-12-03T11:51:26.295 INFO:teuthology.orchestra.run.smithi003.stderr: 67100K .......... .......... .......... .......... .......... 72% 25.7M 3s 2023-12-03T11:51:26.297 INFO:teuthology.orchestra.run.smithi003.stderr: 67150K .......... .......... .......... .......... .......... 72% 24.1M 3s 2023-12-03T11:51:26.298 INFO:teuthology.orchestra.run.smithi003.stderr: 67200K .......... .......... .......... .......... .......... 72% 53.6M 3s 2023-12-03T11:51:26.300 INFO:teuthology.orchestra.run.smithi003.stderr: 67250K .......... .......... .......... .......... .......... 72% 25.8M 3s 2023-12-03T11:51:26.301 INFO:teuthology.orchestra.run.smithi003.stderr: 67300K .......... .......... .......... .......... .......... 72% 44.1M 3s 2023-12-03T11:51:26.303 INFO:teuthology.orchestra.run.smithi003.stderr: 67350K .......... .......... .......... .......... .......... 72% 24.7M 3s 2023-12-03T11:51:26.305 INFO:teuthology.orchestra.run.smithi003.stderr: 67400K .......... .......... .......... .......... .......... 72% 25.0M 3s 2023-12-03T11:51:26.306 INFO:teuthology.orchestra.run.smithi003.stderr: 67450K .......... .......... .......... .......... .......... 72% 47.4M 3s 2023-12-03T11:51:26.308 INFO:teuthology.orchestra.run.smithi003.stderr: 67500K .......... .......... .......... .......... .......... 72% 25.4M 3s 2023-12-03T11:51:26.310 INFO:teuthology.orchestra.run.smithi003.stderr: 67550K .......... .......... .......... .......... .......... 72% 23.7M 3s 2023-12-03T11:51:26.311 INFO:teuthology.orchestra.run.smithi003.stderr: 67600K .......... .......... .......... .......... .......... 72% 44.2M 3s 2023-12-03T11:51:26.313 INFO:teuthology.orchestra.run.smithi003.stderr: 67650K .......... .......... .......... .......... .......... 72% 23.6M 3s 2023-12-03T11:51:26.314 INFO:teuthology.orchestra.run.smithi003.stderr: 67700K .......... .......... .......... .......... .......... 72% 55.3M 3s 2023-12-03T11:51:26.315 INFO:teuthology.orchestra.run.smithi003.stderr: 67750K .......... .......... .......... .......... .......... 72% 43.7M 3s 2023-12-03T11:51:26.317 INFO:teuthology.orchestra.run.smithi003.stderr: 67800K .......... .......... .......... .......... .......... 73% 26.8M 3s 2023-12-03T11:51:26.319 INFO:teuthology.orchestra.run.smithi003.stderr: 67850K .......... .......... .......... .......... .......... 73% 28.8M 3s 2023-12-03T11:51:26.321 INFO:teuthology.orchestra.run.smithi003.stderr: 67900K .......... .......... .......... .......... .......... 73% 43.4M 3s 2023-12-03T11:51:26.322 INFO:teuthology.orchestra.run.smithi003.stderr: 67950K .......... .......... .......... .......... .......... 73% 27.3M 3s 2023-12-03T11:51:26.325 INFO:teuthology.orchestra.run.smithi003.stderr: 68000K .......... .......... .......... .......... .......... 73% 16.6M 3s 2023-12-03T11:51:26.326 INFO:teuthology.orchestra.run.smithi003.stderr: 68050K .......... .......... .......... .......... .......... 73% 43.2M 3s 2023-12-03T11:51:26.328 INFO:teuthology.orchestra.run.smithi003.stderr: 68100K .......... .......... .......... .......... .......... 73% 19.8M 3s 2023-12-03T11:51:26.329 INFO:teuthology.orchestra.run.smithi003.stderr: 68150K .......... .......... .......... .......... .......... 73% 38.4M 3s 2023-12-03T11:51:26.333 INFO:teuthology.orchestra.run.smithi003.stderr: 68200K .......... .......... .......... .......... .......... 73% 19.2M 3s 2023-12-03T11:51:26.333 INFO:teuthology.orchestra.run.smithi003.stderr: 68250K .......... .......... .......... .......... .......... 73% 67.5M 3s 2023-12-03T11:51:26.335 INFO:teuthology.orchestra.run.smithi003.stderr: 68300K .......... .......... .......... .......... .......... 73% 29.0M 3s 2023-12-03T11:51:26.337 INFO:teuthology.orchestra.run.smithi003.stderr: 68350K .......... .......... .......... .......... .......... 73% 21.6M 3s 2023-12-03T11:51:26.338 INFO:teuthology.orchestra.run.smithi003.stderr: 68400K .......... .......... .......... .......... .......... 73% 36.7M 3s 2023-12-03T11:51:26.339 INFO:teuthology.orchestra.run.smithi003.stderr: 68450K .......... .......... .......... .......... .......... 73% 46.9M 3s 2023-12-03T11:51:26.341 INFO:teuthology.orchestra.run.smithi003.stderr: 68500K .......... .......... .......... .......... .......... 73% 27.5M 3s 2023-12-03T11:51:26.342 INFO:teuthology.orchestra.run.smithi003.stderr: 68550K .......... .......... .......... .......... .......... 73% 31.4M 3s 2023-12-03T11:51:26.343 INFO:teuthology.orchestra.run.smithi003.stderr: 68600K .......... .......... .......... .......... .......... 73% 42.0M 3s 2023-12-03T11:51:26.345 INFO:teuthology.orchestra.run.smithi003.stderr: 68650K .......... .......... .......... .......... .......... 73% 29.3M 3s 2023-12-03T11:51:26.346 INFO:teuthology.orchestra.run.smithi003.stderr: 68700K .......... .......... .......... .......... .......... 74% 46.5M 3s 2023-12-03T11:51:26.348 INFO:teuthology.orchestra.run.smithi003.stderr: 68750K .......... .......... .......... .......... .......... 74% 22.4M 3s 2023-12-03T11:51:26.351 INFO:teuthology.orchestra.run.smithi003.stderr: 68800K .......... .......... .......... .......... .......... 74% 16.1M 3s 2023-12-03T11:51:26.352 INFO:teuthology.orchestra.run.smithi003.stderr: 68850K .......... .......... .......... .......... .......... 74% 74.3M 3s 2023-12-03T11:51:26.356 INFO:teuthology.orchestra.run.smithi003.stderr: 68900K .......... .......... .......... .......... .......... 74% 14.9M 3s 2023-12-03T11:51:26.357 INFO:teuthology.orchestra.run.smithi003.stderr: 68950K .......... .......... .......... .......... .......... 74% 34.7M 3s 2023-12-03T11:51:26.359 INFO:teuthology.orchestra.run.smithi003.stderr: 69000K .......... .......... .......... .......... .......... 74% 19.4M 3s 2023-12-03T11:51:26.361 INFO:teuthology.orchestra.run.smithi003.stderr: 69050K .......... .......... .......... .......... .......... 74% 32.8M 3s 2023-12-03T11:51:26.363 INFO:teuthology.orchestra.run.smithi003.stderr: 69100K .......... .......... .......... .......... .......... 74% 23.4M 3s 2023-12-03T11:51:26.366 INFO:teuthology.orchestra.run.smithi003.stderr: 69150K .......... .......... .......... .......... .......... 74% 18.9M 3s 2023-12-03T11:51:26.367 INFO:teuthology.orchestra.run.smithi003.stderr: 69200K .......... .......... .......... .......... .......... 74% 41.1M 3s 2023-12-03T11:51:26.369 INFO:teuthology.orchestra.run.smithi003.stderr: 69250K .......... .......... .......... .......... .......... 74% 29.1M 3s 2023-12-03T11:51:26.369 INFO:teuthology.orchestra.run.smithi003.stderr: 69300K .......... .......... .......... .......... .......... 74% 51.9M 3s 2023-12-03T11:51:26.371 INFO:teuthology.orchestra.run.smithi003.stderr: 69350K .......... .......... .......... .......... .......... 74% 30.7M 3s 2023-12-03T11:51:26.372 INFO:teuthology.orchestra.run.smithi003.stderr: 69400K .......... .......... .......... .......... .......... 74% 52.3M 3s 2023-12-03T11:51:26.374 INFO:teuthology.orchestra.run.smithi003.stderr: 69450K .......... .......... .......... .......... .......... 74% 30.8M 3s 2023-12-03T11:51:26.375 INFO:teuthology.orchestra.run.smithi003.stderr: 69500K .......... .......... .......... .......... .......... 74% 29.7M 3s 2023-12-03T11:51:26.376 INFO:teuthology.orchestra.run.smithi003.stderr: 69550K .......... .......... .......... .......... .......... 74% 45.2M 3s 2023-12-03T11:51:26.378 INFO:teuthology.orchestra.run.smithi003.stderr: 69600K .......... .......... .......... .......... .......... 74% 32.1M 3s 2023-12-03T11:51:26.379 INFO:teuthology.orchestra.run.smithi003.stderr: 69650K .......... .......... .......... .......... .......... 75% 44.7M 3s 2023-12-03T11:51:26.381 INFO:teuthology.orchestra.run.smithi003.stderr: 69700K .......... .......... .......... .......... .......... 75% 28.3M 2s 2023-12-03T11:51:26.382 INFO:teuthology.orchestra.run.smithi003.stderr: 69750K .......... .......... .......... .......... .......... 75% 39.3M 2s 2023-12-03T11:51:26.383 INFO:teuthology.orchestra.run.smithi003.stderr: 69800K .......... .......... .......... .......... .......... 75% 26.6M 2s 2023-12-03T11:51:26.387 INFO:teuthology.orchestra.run.smithi003.stderr: 69850K .......... .......... .......... .......... .......... 75% 13.9M 2s 2023-12-03T11:51:26.388 INFO:teuthology.orchestra.run.smithi003.stderr: 69900K .......... .......... .......... .......... .......... 75% 33.6M 2s 2023-12-03T11:51:26.390 INFO:teuthology.orchestra.run.smithi003.stderr: 69950K .......... .......... .......... .......... .......... 75% 31.3M 2s 2023-12-03T11:51:26.392 INFO:teuthology.orchestra.run.smithi003.stderr: 70000K .......... .......... .......... .......... .......... 75% 31.1M 2s 2023-12-03T11:51:26.393 INFO:teuthology.orchestra.run.smithi003.stderr: 70050K .......... .......... .......... .......... .......... 75% 51.2M 2s 2023-12-03T11:51:26.397 INFO:teuthology.orchestra.run.smithi003.stderr: 70100K .......... .......... .......... .......... .......... 75% 13.2M 2s 2023-12-03T11:51:26.397 INFO:teuthology.orchestra.run.smithi003.stderr: 70150K .......... .......... .......... .......... .......... 75% 51.5M 2s 2023-12-03T11:51:26.400 INFO:teuthology.orchestra.run.smithi003.stderr: 70200K .......... .......... .......... .......... .......... 75% 48.3M 2s 2023-12-03T11:51:26.400 INFO:teuthology.orchestra.run.smithi003.stderr: 70250K .......... .......... .......... .......... .......... 75% 29.0M 2s 2023-12-03T11:51:26.403 INFO:teuthology.orchestra.run.smithi003.stderr: 70300K .......... .......... .......... .......... .......... 75% 19.0M 2s 2023-12-03T11:51:26.403 INFO:teuthology.orchestra.run.smithi003.stderr: 70350K .......... .......... .......... .......... .......... 75% 54.7M 2s 2023-12-03T11:51:26.406 INFO:teuthology.orchestra.run.smithi003.stderr: 70400K .......... .......... .......... .......... .......... 75% 20.3M 2s 2023-12-03T11:51:26.407 INFO:teuthology.orchestra.run.smithi003.stderr: 70450K .......... .......... .......... .......... .......... 75% 82.8M 2s 2023-12-03T11:51:26.408 INFO:teuthology.orchestra.run.smithi003.stderr: 70500K .......... .......... .......... .......... .......... 75% 30.5M 2s 2023-12-03T11:51:26.410 INFO:teuthology.orchestra.run.smithi003.stderr: 70550K .......... .......... .......... .......... .......... 75% 34.1M 2s 2023-12-03T11:51:26.410 INFO:teuthology.orchestra.run.smithi003.stderr: 70600K .......... .......... .......... .......... .......... 76% 52.3M 2s 2023-12-03T11:51:26.412 INFO:teuthology.orchestra.run.smithi003.stderr: 70650K .......... .......... .......... .......... .......... 76% 29.7M 2s 2023-12-03T11:51:26.414 INFO:teuthology.orchestra.run.smithi003.stderr: 70700K .......... .......... .......... .......... .......... 76% 23.6M 2s 2023-12-03T11:51:26.415 INFO:teuthology.orchestra.run.smithi003.stderr: 70750K .......... .......... .......... .......... .......... 76% 47.0M 2s 2023-12-03T11:51:26.417 INFO:teuthology.orchestra.run.smithi003.stderr: 70800K .......... .......... .......... .......... .......... 76% 26.4M 2s 2023-12-03T11:51:26.418 INFO:teuthology.orchestra.run.smithi003.stderr: 70850K .......... .......... .......... .......... .......... 76% 48.3M 2s 2023-12-03T11:51:26.420 INFO:teuthology.orchestra.run.smithi003.stderr: 70900K .......... .......... .......... .......... .......... 76% 25.2M 2s 2023-12-03T11:51:26.421 INFO:teuthology.orchestra.run.smithi003.stderr: 70950K .......... .......... .......... .......... .......... 76% 53.7M 2s 2023-12-03T11:51:26.423 INFO:teuthology.orchestra.run.smithi003.stderr: 71000K .......... .......... .......... .......... .......... 76% 22.2M 2s 2023-12-03T11:51:26.424 INFO:teuthology.orchestra.run.smithi003.stderr: 71050K .......... .......... .......... .......... .......... 76% 57.2M 2s 2023-12-03T11:51:26.429 INFO:teuthology.orchestra.run.smithi003.stderr: 71100K .......... .......... .......... .......... .......... 76% 14.8M 2s 2023-12-03T11:51:26.430 INFO:teuthology.orchestra.run.smithi003.stderr: 71150K .......... .......... .......... .......... .......... 76% 376M 2s 2023-12-03T11:51:26.430 INFO:teuthology.orchestra.run.smithi003.stderr: 71200K .......... .......... .......... .......... .......... 76% 49.1M 2s 2023-12-03T11:51:26.431 INFO:teuthology.orchestra.run.smithi003.stderr: 71250K .......... .......... .......... .......... .......... 76% 27.6M 2s 2023-12-03T11:51:26.431 INFO:teuthology.orchestra.run.smithi003.stderr: 71300K .......... .......... .......... .......... .......... 76% 47.3M 2s 2023-12-03T11:51:26.433 INFO:teuthology.orchestra.run.smithi003.stderr: 71350K .......... .......... .......... .......... .......... 76% 26.7M 2s 2023-12-03T11:51:26.434 INFO:teuthology.orchestra.run.smithi003.stderr: 71400K .......... .......... .......... .......... .......... 76% 48.6M 2s 2023-12-03T11:51:26.436 INFO:teuthology.orchestra.run.smithi003.stderr: 71450K .......... .......... .......... .......... .......... 76% 29.3M 2s 2023-12-03T11:51:26.437 INFO:teuthology.orchestra.run.smithi003.stderr: 71500K .......... .......... .......... .......... .......... 77% 40.6M 2s 2023-12-03T11:51:26.440 INFO:teuthology.orchestra.run.smithi003.stderr: 71550K .......... .......... .......... .......... .......... 77% 17.4M 2s 2023-12-03T11:51:26.442 INFO:teuthology.orchestra.run.smithi003.stderr: 71600K .......... .......... .......... .......... .......... 77% 18.8M 2s 2023-12-03T11:51:26.443 INFO:teuthology.orchestra.run.smithi003.stderr: 71650K .......... .......... .......... .......... .......... 77% 42.5M 2s 2023-12-03T11:51:26.446 INFO:teuthology.orchestra.run.smithi003.stderr: 71700K .......... .......... .......... .......... .......... 77% 19.2M 2s 2023-12-03T11:51:26.447 INFO:teuthology.orchestra.run.smithi003.stderr: 71750K .......... .......... .......... .......... .......... 77% 49.3M 2s 2023-12-03T11:51:26.449 INFO:teuthology.orchestra.run.smithi003.stderr: 71800K .......... .......... .......... .......... .......... 77% 35.9M 2s 2023-12-03T11:51:26.451 INFO:teuthology.orchestra.run.smithi003.stderr: 71850K .......... .......... .......... .......... .......... 77% 21.5M 2s 2023-12-03T11:51:26.451 INFO:teuthology.orchestra.run.smithi003.stderr: 71900K .......... .......... .......... .......... .......... 77% 68.2M 2s 2023-12-03T11:51:26.453 INFO:teuthology.orchestra.run.smithi003.stderr: 71950K .......... .......... .......... .......... .......... 77% 43.8M 2s 2023-12-03T11:51:26.454 INFO:teuthology.orchestra.run.smithi003.stderr: 72000K .......... .......... .......... .......... .......... 77% 31.7M 2s 2023-12-03T11:51:26.456 INFO:teuthology.orchestra.run.smithi003.stderr: 72050K .......... .......... .......... .......... .......... 77% 29.4M 2s 2023-12-03T11:51:26.457 INFO:teuthology.orchestra.run.smithi003.stderr: 72100K .......... .......... .......... .......... .......... 77% 67.4M 2s 2023-12-03T11:51:26.458 INFO:teuthology.orchestra.run.smithi003.stderr: 72150K .......... .......... .......... .......... .......... 77% 26.9M 2s 2023-12-03T11:51:26.459 INFO:teuthology.orchestra.run.smithi003.stderr: 72200K .......... .......... .......... .......... .......... 77% 45.6M 2s 2023-12-03T11:51:26.461 INFO:teuthology.orchestra.run.smithi003.stderr: 72250K .......... .......... .......... .......... .......... 77% 24.6M 2s 2023-12-03T11:51:26.463 INFO:teuthology.orchestra.run.smithi003.stderr: 72300K .......... .......... .......... .......... .......... 77% 24.2M 2s 2023-12-03T11:51:26.465 INFO:teuthology.orchestra.run.smithi003.stderr: 72350K .......... .......... .......... .......... .......... 77% 25.8M 2s 2023-12-03T11:51:26.467 INFO:teuthology.orchestra.run.smithi003.stderr: 72400K .......... .......... .......... .......... .......... 77% 21.1M 2s 2023-12-03T11:51:26.469 INFO:teuthology.orchestra.run.smithi003.stderr: 72450K .......... .......... .......... .......... .......... 78% 34.4M 2s 2023-12-03T11:51:26.470 INFO:teuthology.orchestra.run.smithi003.stderr: 72500K .......... .......... .......... .......... .......... 78% 33.0M 2s 2023-12-03T11:51:26.472 INFO:teuthology.orchestra.run.smithi003.stderr: 72550K .......... .......... .......... .......... .......... 78% 27.3M 2s 2023-12-03T11:51:26.474 INFO:teuthology.orchestra.run.smithi003.stderr: 72600K .......... .......... .......... .......... .......... 78% 24.9M 2s 2023-12-03T11:51:26.476 INFO:teuthology.orchestra.run.smithi003.stderr: 72650K .......... .......... .......... .......... .......... 78% 24.0M 2s 2023-12-03T11:51:26.479 INFO:teuthology.orchestra.run.smithi003.stderr: 72700K .......... .......... .......... .......... .......... 78% 16.8M 2s 2023-12-03T11:51:26.480 INFO:teuthology.orchestra.run.smithi003.stderr: 72750K .......... .......... .......... .......... .......... 78% 44.5M 2s 2023-12-03T11:51:26.482 INFO:teuthology.orchestra.run.smithi003.stderr: 72800K .......... .......... .......... .......... .......... 78% 27.1M 2s 2023-12-03T11:51:26.483 INFO:teuthology.orchestra.run.smithi003.stderr: 72850K .......... .......... .......... .......... .......... 78% 49.8M 2s 2023-12-03T11:51:26.484 INFO:teuthology.orchestra.run.smithi003.stderr: 72900K .......... .......... .......... .......... .......... 78% 44.3M 2s 2023-12-03T11:51:26.486 INFO:teuthology.orchestra.run.smithi003.stderr: 72950K .......... .......... .......... .......... .......... 78% 29.0M 2s 2023-12-03T11:51:26.488 INFO:teuthology.orchestra.run.smithi003.stderr: 73000K .......... .......... .......... .......... .......... 78% 27.3M 2s 2023-12-03T11:51:26.488 INFO:teuthology.orchestra.run.smithi003.stderr: 73050K .......... .......... .......... .......... .......... 78% 41.8M 2s 2023-12-03T11:51:26.490 INFO:teuthology.orchestra.run.smithi003.stderr: 73100K .......... .......... .......... .......... .......... 78% 28.8M 2s 2023-12-03T11:51:26.491 INFO:teuthology.orchestra.run.smithi003.stderr: 73150K .......... .......... .......... .......... .......... 78% 48.8M 2s 2023-12-03T11:51:26.493 INFO:teuthology.orchestra.run.smithi003.stderr: 73200K .......... .......... .......... .......... .......... 78% 28.5M 2s 2023-12-03T11:51:26.495 INFO:teuthology.orchestra.run.smithi003.stderr: 73250K .......... .......... .......... .......... .......... 78% 29.6M 2s 2023-12-03T11:51:26.496 INFO:teuthology.orchestra.run.smithi003.stderr: 73300K .......... .......... .......... .......... .......... 78% 47.2M 2s 2023-12-03T11:51:26.497 INFO:teuthology.orchestra.run.smithi003.stderr: 73350K .......... .......... .......... .......... .......... 79% 30.8M 2s 2023-12-03T11:51:26.498 INFO:teuthology.orchestra.run.smithi003.stderr: 73400K .......... .......... .......... .......... .......... 79% 52.1M 2s 2023-12-03T11:51:26.502 INFO:teuthology.orchestra.run.smithi003.stderr: 73450K .......... .......... .......... .......... .......... 79% 11.7M 2s 2023-12-03T11:51:26.504 INFO:teuthology.orchestra.run.smithi003.stderr: 73500K .......... .......... .......... .......... .......... 79% 43.7M 2s 2023-12-03T11:51:26.505 INFO:teuthology.orchestra.run.smithi003.stderr: 73550K .......... .......... .......... .......... .......... 79% 42.0M 2s 2023-12-03T11:51:26.506 INFO:teuthology.orchestra.run.smithi003.stderr: 73600K .......... .......... .......... .......... .......... 79% 29.5M 2s 2023-12-03T11:51:26.507 INFO:teuthology.orchestra.run.smithi003.stderr: 73650K .......... .......... .......... .......... .......... 79% 39.3M 2s 2023-12-03T11:51:26.512 INFO:teuthology.orchestra.run.smithi003.stderr: 73700K .......... .......... .......... .......... .......... 79% 13.5M 2s 2023-12-03T11:51:26.512 INFO:teuthology.orchestra.run.smithi003.stderr: 73750K .......... .......... .......... .......... .......... 79% 38.7M 2s 2023-12-03T11:51:26.514 INFO:teuthology.orchestra.run.smithi003.stderr: 73800K .......... .......... .......... .......... .......... 79% 36.5M 2s 2023-12-03T11:51:26.515 INFO:teuthology.orchestra.run.smithi003.stderr: 73850K .......... .......... .......... .......... .......... 79% 57.3M 2s 2023-12-03T11:51:26.516 INFO:teuthology.orchestra.run.smithi003.stderr: 73900K .......... .......... .......... .......... .......... 79% 26.4M 2s 2023-12-03T11:51:26.518 INFO:teuthology.orchestra.run.smithi003.stderr: 73950K .......... .......... .......... .......... .......... 79% 25.6M 2s 2023-12-03T11:51:26.520 INFO:teuthology.orchestra.run.smithi003.stderr: 74000K .......... .......... .......... .......... .......... 79% 33.4M 2s 2023-12-03T11:51:26.522 INFO:teuthology.orchestra.run.smithi003.stderr: 74050K .......... .......... .......... .......... .......... 79% 28.8M 2s 2023-12-03T11:51:26.523 INFO:teuthology.orchestra.run.smithi003.stderr: 74100K .......... .......... .......... .......... .......... 79% 40.8M 2s 2023-12-03T11:51:26.524 INFO:teuthology.orchestra.run.smithi003.stderr: 74150K .......... .......... .......... .......... .......... 79% 39.3M 2s 2023-12-03T11:51:26.525 INFO:teuthology.orchestra.run.smithi003.stderr: 74200K .......... .......... .......... .......... .......... 79% 44.1M 2s 2023-12-03T11:51:26.527 INFO:teuthology.orchestra.run.smithi003.stderr: 74250K .......... .......... .......... .......... .......... 79% 31.0M 2s 2023-12-03T11:51:26.528 INFO:teuthology.orchestra.run.smithi003.stderr: 74300K .......... .......... .......... .......... .......... 80% 30.9M 2s 2023-12-03T11:51:26.530 INFO:teuthology.orchestra.run.smithi003.stderr: 74350K .......... .......... .......... .......... .......... 80% 36.7M 2s 2023-12-03T11:51:26.532 INFO:teuthology.orchestra.run.smithi003.stderr: 74400K .......... .......... .......... .......... .......... 80% 25.5M 2s 2023-12-03T11:51:26.532 INFO:teuthology.orchestra.run.smithi003.stderr: 74450K .......... .......... .......... .......... .......... 80% 76.9M 2s 2023-12-03T11:51:26.534 INFO:teuthology.orchestra.run.smithi003.stderr: 74500K .......... .......... .......... .......... .......... 80% 32.6M 2s 2023-12-03T11:51:26.535 INFO:teuthology.orchestra.run.smithi003.stderr: 74550K .......... .......... .......... .......... .......... 80% 35.1M 2s 2023-12-03T11:51:26.536 INFO:teuthology.orchestra.run.smithi003.stderr: 74600K .......... .......... .......... .......... .......... 80% 45.6M 2s 2023-12-03T11:51:26.537 INFO:teuthology.orchestra.run.smithi003.stderr: 74650K .......... .......... .......... .......... .......... 80% 41.3M 2s 2023-12-03T11:51:26.539 INFO:teuthology.orchestra.run.smithi003.stderr: 74700K .......... .......... .......... .......... .......... 80% 25.4M 2s 2023-12-03T11:51:26.543 INFO:teuthology.orchestra.run.smithi003.stderr: 74750K .......... .......... .......... .......... .......... 80% 15.1M 2s 2023-12-03T11:51:26.543 INFO:teuthology.orchestra.run.smithi003.stderr: 74800K .......... .......... .......... .......... .......... 80% 55.8M 2s 2023-12-03T11:51:26.545 INFO:teuthology.orchestra.run.smithi003.stderr: 74850K .......... .......... .......... .......... .......... 80% 33.3M 2s 2023-12-03T11:51:26.546 INFO:teuthology.orchestra.run.smithi003.stderr: 74900K .......... .......... .......... .......... .......... 80% 47.6M 2s 2023-12-03T11:51:26.548 INFO:teuthology.orchestra.run.smithi003.stderr: 74950K .......... .......... .......... .......... .......... 80% 30.1M 2s 2023-12-03T11:51:26.549 INFO:teuthology.orchestra.run.smithi003.stderr: 75000K .......... .......... .......... .......... .......... 80% 48.0M 2s 2023-12-03T11:51:26.550 INFO:teuthology.orchestra.run.smithi003.stderr: 75050K .......... .......... .......... .......... .......... 80% 29.7M 2s 2023-12-03T11:51:26.552 INFO:teuthology.orchestra.run.smithi003.stderr: 75100K .......... .......... .......... .......... .......... 80% 30.4M 2s 2023-12-03T11:51:26.553 INFO:teuthology.orchestra.run.smithi003.stderr: 75150K .......... .......... .......... .......... .......... 80% 49.3M 2s 2023-12-03T11:51:26.554 INFO:teuthology.orchestra.run.smithi003.stderr: 75200K .......... .......... .......... .......... .......... 81% 30.7M 2s 2023-12-03T11:51:26.555 INFO:teuthology.orchestra.run.smithi003.stderr: 75250K .......... .......... .......... .......... .......... 81% 44.8M 2s 2023-12-03T11:51:26.559 INFO:teuthology.orchestra.run.smithi003.stderr: 75300K .......... .......... .......... .......... .......... 81% 14.7M 2s 2023-12-03T11:51:26.559 INFO:teuthology.orchestra.run.smithi003.stderr: 75350K .......... .......... .......... .......... .......... 81% 78.6M 2s 2023-12-03T11:51:26.561 INFO:teuthology.orchestra.run.smithi003.stderr: 75400K .......... .......... .......... .......... .......... 81% 22.2M 2s 2023-12-03T11:51:26.564 INFO:teuthology.orchestra.run.smithi003.stderr: 75450K .......... .......... .......... .......... .......... 81% 33.5M 2s 2023-12-03T11:51:26.564 INFO:teuthology.orchestra.run.smithi003.stderr: 75500K .......... .......... .......... .......... .......... 81% 46.1M 2s 2023-12-03T11:51:26.567 INFO:teuthology.orchestra.run.smithi003.stderr: 75550K .......... .......... .......... .......... .......... 81% 21.0M 2s 2023-12-03T11:51:26.567 INFO:teuthology.orchestra.run.smithi003.stderr: 75600K .......... .......... .......... .......... .......... 81% 90.9M 2s 2023-12-03T11:51:26.569 INFO:teuthology.orchestra.run.smithi003.stderr: 75650K .......... .......... .......... .......... .......... 81% 25.9M 2s 2023-12-03T11:51:26.570 INFO:teuthology.orchestra.run.smithi003.stderr: 75700K .......... .......... .......... .......... .......... 81% 30.8M 2s 2023-12-03T11:51:26.571 INFO:teuthology.orchestra.run.smithi003.stderr: 75750K .......... .......... .......... .......... .......... 81% 50.6M 2s 2023-12-03T11:51:26.574 INFO:teuthology.orchestra.run.smithi003.stderr: 75800K .......... .......... .......... .......... .......... 81% 21.2M 2s 2023-12-03T11:51:26.575 INFO:teuthology.orchestra.run.smithi003.stderr: 75850K .......... .......... .......... .......... .......... 81% 82.1M 2s 2023-12-03T11:51:26.576 INFO:teuthology.orchestra.run.smithi003.stderr: 75900K .......... .......... .......... .......... .......... 81% 29.3M 2s 2023-12-03T11:51:26.577 INFO:teuthology.orchestra.run.smithi003.stderr: 75950K .......... .......... .......... .......... .......... 81% 60.1M 2s 2023-12-03T11:51:26.578 INFO:teuthology.orchestra.run.smithi003.stderr: 76000K .......... .......... .......... .......... .......... 81% 27.8M 2s 2023-12-03T11:51:26.581 INFO:teuthology.orchestra.run.smithi003.stderr: 76050K .......... .......... .......... .......... .......... 81% 17.8M 2s 2023-12-03T11:51:26.582 INFO:teuthology.orchestra.run.smithi003.stderr: 76100K .......... .......... .......... .......... .......... 81% 56.1M 2s 2023-12-03T11:51:26.586 INFO:teuthology.orchestra.run.smithi003.stderr: 76150K .......... .......... .......... .......... .......... 82% 15.9M 2s 2023-12-03T11:51:26.586 INFO:teuthology.orchestra.run.smithi003.stderr: 76200K .......... .......... .......... .......... .......... 82% 63.2M 2s 2023-12-03T11:51:26.588 INFO:teuthology.orchestra.run.smithi003.stderr: 76250K .......... .......... .......... .......... .......... 82% 22.8M 2s 2023-12-03T11:51:26.591 INFO:teuthology.orchestra.run.smithi003.stderr: 76300K .......... .......... .......... .......... .......... 82% 23.4M 2s 2023-12-03T11:51:26.593 INFO:teuthology.orchestra.run.smithi003.stderr: 76350K .......... .......... .......... .......... .......... 82% 27.5M 2s 2023-12-03T11:51:26.593 INFO:teuthology.orchestra.run.smithi003.stderr: 76400K .......... .......... .......... .......... .......... 82% 85.4M 2s 2023-12-03T11:51:26.595 INFO:teuthology.orchestra.run.smithi003.stderr: 76450K .......... .......... .......... .......... .......... 82% 20.0M 2s 2023-12-03T11:51:26.597 INFO:teuthology.orchestra.run.smithi003.stderr: 76500K .......... .......... .......... .......... .......... 82% 27.7M 2s 2023-12-03T11:51:26.598 INFO:teuthology.orchestra.run.smithi003.stderr: 76550K .......... .......... .......... .......... .......... 82% 85.2M 2s 2023-12-03T11:51:26.599 INFO:teuthology.orchestra.run.smithi003.stderr: 76600K .......... .......... .......... .......... .......... 82% 29.5M 2s 2023-12-03T11:51:26.600 INFO:teuthology.orchestra.run.smithi003.stderr: 76650K .......... .......... .......... .......... .......... 82% 45.6M 2s 2023-12-03T11:51:26.602 INFO:teuthology.orchestra.run.smithi003.stderr: 76700K .......... .......... .......... .......... .......... 82% 31.6M 2s 2023-12-03T11:51:26.604 INFO:teuthology.orchestra.run.smithi003.stderr: 76750K .......... .......... .......... .......... .......... 82% 24.4M 2s 2023-12-03T11:51:26.604 INFO:teuthology.orchestra.run.smithi003.stderr: 76800K .......... .......... .......... .......... .......... 82% 48.8M 2s 2023-12-03T11:51:26.606 INFO:teuthology.orchestra.run.smithi003.stderr: 76850K .......... .......... .......... .......... .......... 82% 61.5M 2s 2023-12-03T11:51:26.607 INFO:teuthology.orchestra.run.smithi003.stderr: 76900K .......... .......... .......... .......... .......... 82% 26.4M 2s 2023-12-03T11:51:26.609 INFO:teuthology.orchestra.run.smithi003.stderr: 76950K .......... .......... .......... .......... .......... 82% 35.1M 2s 2023-12-03T11:51:26.611 INFO:teuthology.orchestra.run.smithi003.stderr: 77000K .......... .......... .......... .......... .......... 82% 23.7M 2s 2023-12-03T11:51:26.611 INFO:teuthology.orchestra.run.smithi003.stderr: 77050K .......... .......... .......... .......... .......... 82% 69.9M 2s 2023-12-03T11:51:26.613 INFO:teuthology.orchestra.run.smithi003.stderr: 77100K .......... .......... .......... .......... .......... 83% 29.9M 2s 2023-12-03T11:51:26.615 INFO:teuthology.orchestra.run.smithi003.stderr: 77150K .......... .......... .......... .......... .......... 83% 36.2M 2s 2023-12-03T11:51:26.620 INFO:teuthology.orchestra.run.smithi003.stderr: 77200K .......... .......... .......... .......... .......... 83% 11.2M 2s 2023-12-03T11:51:26.620 INFO:teuthology.orchestra.run.smithi003.stderr: 77250K .......... .......... .......... .......... .......... 83% 104M 2s 2023-12-03T11:51:26.621 INFO:teuthology.orchestra.run.smithi003.stderr: 77300K .......... .......... .......... .......... .......... 83% 28.7M 2s 2023-12-03T11:51:26.622 INFO:teuthology.orchestra.run.smithi003.stderr: 77350K .......... .......... .......... .......... .......... 83% 56.6M 2s 2023-12-03T11:51:26.624 INFO:teuthology.orchestra.run.smithi003.stderr: 77400K .......... .......... .......... .......... .......... 83% 25.8M 2s 2023-12-03T11:51:26.625 INFO:teuthology.orchestra.run.smithi003.stderr: 77450K .......... .......... .......... .......... .......... 83% 34.9M 2s 2023-12-03T11:51:26.629 INFO:teuthology.orchestra.run.smithi003.stderr: 77500K .......... .......... .......... .......... .......... 83% 12.7M 2s 2023-12-03T11:51:26.631 INFO:teuthology.orchestra.run.smithi003.stderr: 77550K .......... .......... .......... .......... .......... 83% 27.2M 2s 2023-12-03T11:51:26.632 INFO:teuthology.orchestra.run.smithi003.stderr: 77600K .......... .......... .......... .......... .......... 83% 58.9M 2s 2023-12-03T11:51:26.633 INFO:teuthology.orchestra.run.smithi003.stderr: 77650K .......... .......... .......... .......... .......... 83% 31.2M 2s 2023-12-03T11:51:26.635 INFO:teuthology.orchestra.run.smithi003.stderr: 77700K .......... .......... .......... .......... .......... 83% 35.4M 2s 2023-12-03T11:51:26.636 INFO:teuthology.orchestra.run.smithi003.stderr: 77750K .......... .......... .......... .......... .......... 83% 28.0M 2s 2023-12-03T11:51:26.638 INFO:teuthology.orchestra.run.smithi003.stderr: 77800K .......... .......... .......... .......... .......... 83% 31.6M 2s 2023-12-03T11:51:26.640 INFO:teuthology.orchestra.run.smithi003.stderr: 77850K .......... .......... .......... .......... .......... 83% 29.1M 1s 2023-12-03T11:51:26.641 INFO:teuthology.orchestra.run.smithi003.stderr: 77900K .......... .......... .......... .......... .......... 83% 40.1M 1s 2023-12-03T11:51:26.641 INFO:teuthology.orchestra.run.smithi003.stderr: 77950K .......... .......... .......... .......... .......... 83% 60.9M 1s 2023-12-03T11:51:26.643 INFO:teuthology.orchestra.run.smithi003.stderr: 78000K .......... .......... .......... .......... .......... 84% 31.8M 1s 2023-12-03T11:51:26.644 INFO:teuthology.orchestra.run.smithi003.stderr: 78050K .......... .......... .......... .......... .......... 84% 64.1M 1s 2023-12-03T11:51:26.645 INFO:teuthology.orchestra.run.smithi003.stderr: 78100K .......... .......... .......... .......... .......... 84% 30.9M 1s 2023-12-03T11:51:26.648 INFO:teuthology.orchestra.run.smithi003.stderr: 78150K .......... .......... .......... .......... .......... 84% 26.3M 1s 2023-12-03T11:51:26.648 INFO:teuthology.orchestra.run.smithi003.stderr: 78200K .......... .......... .......... .......... .......... 84% 59.0M 1s 2023-12-03T11:51:26.651 INFO:teuthology.orchestra.run.smithi003.stderr: 78250K .......... .......... .......... .......... .......... 84% 37.7M 1s 2023-12-03T11:51:26.651 INFO:teuthology.orchestra.run.smithi003.stderr: 78300K .......... .......... .......... .......... .......... 84% 40.0M 1s 2023-12-03T11:51:26.653 INFO:teuthology.orchestra.run.smithi003.stderr: 78350K .......... .......... .......... .......... .......... 84% 28.5M 1s 2023-12-03T11:51:26.654 INFO:teuthology.orchestra.run.smithi003.stderr: 78400K .......... .......... .......... .......... .......... 84% 36.5M 1s 2023-12-03T11:51:26.654 INFO:teuthology.orchestra.run.smithi003.stderr: 78450K .......... .......... .......... .......... .......... 84% 69.3M 1s 2023-12-03T11:51:26.656 INFO:teuthology.orchestra.run.smithi003.stderr: 78500K .......... .......... .......... .......... .......... 84% 25.7M 1s 2023-12-03T11:51:26.660 INFO:teuthology.orchestra.run.smithi003.stderr: 78550K .......... .......... .......... .......... .......... 84% 16.4M 1s 2023-12-03T11:51:26.660 INFO:teuthology.orchestra.run.smithi003.stderr: 78600K .......... .......... .......... .......... .......... 84% 48.1M 1s 2023-12-03T11:51:26.661 INFO:teuthology.orchestra.run.smithi003.stderr: 78650K .......... .......... .......... .......... .......... 84% 41.5M 1s 2023-12-03T11:51:26.663 INFO:teuthology.orchestra.run.smithi003.stderr: 78700K .......... .......... .......... .......... .......... 84% 33.6M 1s 2023-12-03T11:51:26.664 INFO:teuthology.orchestra.run.smithi003.stderr: 78750K .......... .......... .......... .......... .......... 84% 54.5M 1s 2023-12-03T11:51:26.665 INFO:teuthology.orchestra.run.smithi003.stderr: 78800K .......... .......... .......... .......... .......... 84% 28.5M 1s 2023-12-03T11:51:26.667 INFO:teuthology.orchestra.run.smithi003.stderr: 78850K .......... .......... .......... .......... .......... 84% 36.6M 1s 2023-12-03T11:51:26.668 INFO:teuthology.orchestra.run.smithi003.stderr: 78900K .......... .......... .......... .......... .......... 84% 47.9M 1s 2023-12-03T11:51:26.669 INFO:teuthology.orchestra.run.smithi003.stderr: 78950K .......... .......... .......... .......... .......... 85% 43.3M 1s 2023-12-03T11:51:26.670 INFO:teuthology.orchestra.run.smithi003.stderr: 79000K .......... .......... .......... .......... .......... 85% 34.0M 1s 2023-12-03T11:51:26.672 INFO:teuthology.orchestra.run.smithi003.stderr: 79050K .......... .......... .......... .......... .......... 85% 26.5M 1s 2023-12-03T11:51:26.674 INFO:teuthology.orchestra.run.smithi003.stderr: 79100K .......... .......... .......... .......... .......... 85% 32.5M 1s 2023-12-03T11:51:26.674 INFO:teuthology.orchestra.run.smithi003.stderr: 79150K .......... .......... .......... .......... .......... 85% 43.4M 1s 2023-12-03T11:51:26.677 INFO:teuthology.orchestra.run.smithi003.stderr: 79200K .......... .......... .......... .......... .......... 85% 23.9M 1s 2023-12-03T11:51:26.678 INFO:teuthology.orchestra.run.smithi003.stderr: 79250K .......... .......... .......... .......... .......... 85% 31.7M 1s 2023-12-03T11:51:26.680 INFO:teuthology.orchestra.run.smithi003.stderr: 79300K .......... .......... .......... .......... .......... 85% 27.3M 1s 2023-12-03T11:51:26.681 INFO:teuthology.orchestra.run.smithi003.stderr: 79350K .......... .......... .......... .......... .......... 85% 62.0M 1s 2023-12-03T11:51:26.682 INFO:teuthology.orchestra.run.smithi003.stderr: 79400K .......... .......... .......... .......... .......... 85% 33.0M 1s 2023-12-03T11:51:26.685 INFO:teuthology.orchestra.run.smithi003.stderr: 79450K .......... .......... .......... .......... .......... 85% 21.6M 1s 2023-12-03T11:51:26.686 INFO:teuthology.orchestra.run.smithi003.stderr: 79500K .......... .......... .......... .......... .......... 85% 47.2M 1s 2023-12-03T11:51:26.686 INFO:teuthology.orchestra.run.smithi003.stderr: 79550K .......... .......... .......... .......... .......... 85% 52.7M 1s 2023-12-03T11:51:26.688 INFO:teuthology.orchestra.run.smithi003.stderr: 79600K .......... .......... .......... .......... .......... 85% 29.1M 1s 2023-12-03T11:51:26.690 INFO:teuthology.orchestra.run.smithi003.stderr: 79650K .......... .......... .......... .......... .......... 85% 29.8M 1s 2023-12-03T11:51:26.693 INFO:teuthology.orchestra.run.smithi003.stderr: 79700K .......... .......... .......... .......... .......... 85% 20.5M 1s 2023-12-03T11:51:26.693 INFO:teuthology.orchestra.run.smithi003.stderr: 79750K .......... .......... .......... .......... .......... 85% 53.0M 1s 2023-12-03T11:51:26.694 INFO:teuthology.orchestra.run.smithi003.stderr: 79800K .......... .......... .......... .......... .......... 85% 54.1M 1s 2023-12-03T11:51:26.696 INFO:teuthology.orchestra.run.smithi003.stderr: 79850K .......... .......... .......... .......... .......... 86% 33.8M 1s 2023-12-03T11:51:26.697 INFO:teuthology.orchestra.run.smithi003.stderr: 79900K .......... .......... .......... .......... .......... 86% 34.2M 1s 2023-12-03T11:51:26.699 INFO:teuthology.orchestra.run.smithi003.stderr: 79950K .......... .......... .......... .......... .......... 86% 23.0M 1s 2023-12-03T11:51:26.701 INFO:teuthology.orchestra.run.smithi003.stderr: 80000K .......... .......... .......... .......... .......... 86% 18.8M 1s 2023-12-03T11:51:26.705 INFO:teuthology.orchestra.run.smithi003.stderr: 80050K .......... .......... .......... .......... .......... 86% 19.3M 1s 2023-12-03T11:51:26.705 INFO:teuthology.orchestra.run.smithi003.stderr: 80100K .......... .......... .......... .......... .......... 86% 57.6M 1s 2023-12-03T11:51:26.707 INFO:teuthology.orchestra.run.smithi003.stderr: 80150K .......... .......... .......... .......... .......... 86% 31.6M 1s 2023-12-03T11:51:26.709 INFO:teuthology.orchestra.run.smithi003.stderr: 80200K .......... .......... .......... .......... .......... 86% 22.8M 1s 2023-12-03T11:51:26.711 INFO:teuthology.orchestra.run.smithi003.stderr: 80250K .......... .......... .......... .......... .......... 86% 24.6M 1s 2023-12-03T11:51:26.712 INFO:teuthology.orchestra.run.smithi003.stderr: 80300K .......... .......... .......... .......... .......... 86% 33.3M 1s 2023-12-03T11:51:26.714 INFO:teuthology.orchestra.run.smithi003.stderr: 80350K .......... .......... .......... .......... .......... 86% 39.6M 1s 2023-12-03T11:51:26.716 INFO:teuthology.orchestra.run.smithi003.stderr: 80400K .......... .......... .......... .......... .......... 86% 29.5M 1s 2023-12-03T11:51:26.717 INFO:teuthology.orchestra.run.smithi003.stderr: 80450K .......... .......... .......... .......... .......... 86% 34.5M 1s 2023-12-03T11:51:26.717 INFO:teuthology.orchestra.run.smithi003.stderr: 80500K .......... .......... .......... .......... .......... 86% 85.0M 1s 2023-12-03T11:51:26.719 INFO:teuthology.orchestra.run.smithi003.stderr: 80550K .......... .......... .......... .......... .......... 86% 27.9M 1s 2023-12-03T11:51:26.720 INFO:teuthology.orchestra.run.smithi003.stderr: 80600K .......... .......... .......... .......... .......... 86% 36.5M 1s 2023-12-03T11:51:26.722 INFO:teuthology.orchestra.run.smithi003.stderr: 80650K .......... .......... .......... .......... .......... 86% 23.7M 1s 2023-12-03T11:51:26.724 INFO:teuthology.orchestra.run.smithi003.stderr: 80700K .......... .......... .......... .......... .......... 86% 34.2M 1s 2023-12-03T11:51:26.724 INFO:teuthology.orchestra.run.smithi003.stderr: 80750K .......... .......... .......... .......... .......... 86% 57.0M 1s 2023-12-03T11:51:26.726 INFO:teuthology.orchestra.run.smithi003.stderr: 80800K .......... .......... .......... .......... .......... 87% 26.8M 1s 2023-12-03T11:51:26.728 INFO:teuthology.orchestra.run.smithi003.stderr: 80850K .......... .......... .......... .......... .......... 87% 37.0M 1s 2023-12-03T11:51:26.730 INFO:teuthology.orchestra.run.smithi003.stderr: 80900K .......... .......... .......... .......... .......... 87% 25.3M 1s 2023-12-03T11:51:26.731 INFO:teuthology.orchestra.run.smithi003.stderr: 80950K .......... .......... .......... .......... .......... 87% 35.3M 1s 2023-12-03T11:51:26.732 INFO:teuthology.orchestra.run.smithi003.stderr: 81000K .......... .......... .......... .......... .......... 87% 72.3M 1s 2023-12-03T11:51:26.734 INFO:teuthology.orchestra.run.smithi003.stderr: 81050K .......... .......... .......... .......... .......... 87% 25.3M 1s 2023-12-03T11:51:26.736 INFO:teuthology.orchestra.run.smithi003.stderr: 81100K .......... .......... .......... .......... .......... 87% 19.8M 1s 2023-12-03T11:51:26.740 INFO:teuthology.orchestra.run.smithi003.stderr: 81150K .......... .......... .......... .......... .......... 87% 17.1M 1s 2023-12-03T11:51:26.740 INFO:teuthology.orchestra.run.smithi003.stderr: 81200K .......... .......... .......... .......... .......... 87% 67.7M 1s 2023-12-03T11:51:26.742 INFO:teuthology.orchestra.run.smithi003.stderr: 81250K .......... .......... .......... .......... .......... 87% 23.4M 1s 2023-12-03T11:51:26.744 INFO:teuthology.orchestra.run.smithi003.stderr: 81300K .......... .......... .......... .......... .......... 87% 25.3M 1s 2023-12-03T11:51:26.748 INFO:teuthology.orchestra.run.smithi003.stderr: 81350K .......... .......... .......... .......... .......... 87% 13.1M 1s 2023-12-03T11:51:26.749 INFO:teuthology.orchestra.run.smithi003.stderr: 81400K .......... .......... .......... .......... .......... 87% 40.7M 1s 2023-12-03T11:51:26.750 INFO:teuthology.orchestra.run.smithi003.stderr: 81450K .......... .......... .......... .......... .......... 87% 44.1M 1s 2023-12-03T11:51:26.751 INFO:teuthology.orchestra.run.smithi003.stderr: 81500K .......... .......... .......... .......... .......... 87% 35.3M 1s 2023-12-03T11:51:26.752 INFO:teuthology.orchestra.run.smithi003.stderr: 81550K .......... .......... .......... .......... .......... 87% 41.4M 1s 2023-12-03T11:51:26.755 INFO:teuthology.orchestra.run.smithi003.stderr: 81600K .......... .......... .......... .......... .......... 87% 25.0M 1s 2023-12-03T11:51:26.756 INFO:teuthology.orchestra.run.smithi003.stderr: 81650K .......... .......... .......... .......... .......... 87% 28.3M 1s 2023-12-03T11:51:26.756 INFO:teuthology.orchestra.run.smithi003.stderr: 81700K .......... .......... .......... .......... .......... 87% 86.2M 1s 2023-12-03T11:51:26.760 INFO:teuthology.orchestra.run.smithi003.stderr: 81750K .......... .......... .......... .......... .......... 88% 26.4M 1s 2023-12-03T11:51:26.760 INFO:teuthology.orchestra.run.smithi003.stderr: 81800K .......... .......... .......... .......... .......... 88% 60.7M 1s 2023-12-03T11:51:26.761 INFO:teuthology.orchestra.run.smithi003.stderr: 81850K .......... .......... .......... .......... .......... 88% 35.8M 1s 2023-12-03T11:51:26.762 INFO:teuthology.orchestra.run.smithi003.stderr: 81900K .......... .......... .......... .......... .......... 88% 38.8M 1s 2023-12-03T11:51:26.763 INFO:teuthology.orchestra.run.smithi003.stderr: 81950K .......... .......... .......... .......... .......... 88% 45.9M 1s 2023-12-03T11:51:26.764 INFO:teuthology.orchestra.run.smithi003.stderr: 82000K .......... .......... .......... .......... .......... 88% 63.4M 1s 2023-12-03T11:51:26.765 INFO:teuthology.orchestra.run.smithi003.stderr: 82050K .......... .......... .......... .......... .......... 88% 27.9M 1s 2023-12-03T11:51:26.768 INFO:teuthology.orchestra.run.smithi003.stderr: 82100K .......... .......... .......... .......... .......... 88% 26.9M 1s 2023-12-03T11:51:26.768 INFO:teuthology.orchestra.run.smithi003.stderr: 82150K .......... .......... .......... .......... .......... 88% 82.0M 1s 2023-12-03T11:51:26.769 INFO:teuthology.orchestra.run.smithi003.stderr: 82200K .......... .......... .......... .......... .......... 88% 36.7M 1s 2023-12-03T11:51:26.771 INFO:teuthology.orchestra.run.smithi003.stderr: 82250K .......... .......... .......... .......... .......... 88% 41.9M 1s 2023-12-03T11:51:26.773 INFO:teuthology.orchestra.run.smithi003.stderr: 82300K .......... .......... .......... .......... .......... 88% 26.1M 1s 2023-12-03T11:51:26.773 INFO:teuthology.orchestra.run.smithi003.stderr: 82350K .......... .......... .......... .......... .......... 88% 108M 1s 2023-12-03T11:51:26.774 INFO:teuthology.orchestra.run.smithi003.stderr: 82400K .......... .......... .......... .......... .......... 88% 31.1M 1s 2023-12-03T11:51:26.777 INFO:teuthology.orchestra.run.smithi003.stderr: 82450K .......... .......... .......... .......... .......... 88% 19.6M 1s 2023-12-03T11:51:26.778 INFO:teuthology.orchestra.run.smithi003.stderr: 82500K .......... .......... .......... .......... .......... 88% 58.6M 1s 2023-12-03T11:51:26.779 INFO:teuthology.orchestra.run.smithi003.stderr: 82550K .......... .......... .......... .......... .......... 88% 43.3M 1s 2023-12-03T11:51:26.780 INFO:teuthology.orchestra.run.smithi003.stderr: 82600K .......... .......... .......... .......... .......... 88% 47.6M 1s 2023-12-03T11:51:26.781 INFO:teuthology.orchestra.run.smithi003.stderr: 82650K .......... .......... .......... .......... .......... 89% 41.8M 1s 2023-12-03T11:51:26.782 INFO:teuthology.orchestra.run.smithi003.stderr: 82700K .......... .......... .......... .......... .......... 89% 47.8M 1s 2023-12-03T11:51:26.783 INFO:teuthology.orchestra.run.smithi003.stderr: 82750K .......... .......... .......... .......... .......... 89% 35.0M 1s 2023-12-03T11:51:26.785 INFO:teuthology.orchestra.run.smithi003.stderr: 82800K .......... .......... .......... .......... .......... 89% 29.7M 1s 2023-12-03T11:51:26.787 INFO:teuthology.orchestra.run.smithi003.stderr: 82850K .......... .......... .......... .......... .......... 89% 43.6M 1s 2023-12-03T11:51:26.789 INFO:teuthology.orchestra.run.smithi003.stderr: 82900K .......... .......... .......... .......... .......... 89% 30.1M 1s 2023-12-03T11:51:26.789 INFO:teuthology.orchestra.run.smithi003.stderr: 82950K .......... .......... .......... .......... .......... 89% 97.5M 1s 2023-12-03T11:51:26.790 INFO:teuthology.orchestra.run.smithi003.stderr: 83000K .......... .......... .......... .......... .......... 89% 31.2M 1s 2023-12-03T11:51:26.795 INFO:teuthology.orchestra.run.smithi003.stderr: 83050K .......... .......... .......... .......... .......... 89% 22.3M 1s 2023-12-03T11:51:26.795 INFO:teuthology.orchestra.run.smithi003.stderr: 83100K .......... .......... .......... .......... .......... 89% 55.4M 1s 2023-12-03T11:51:26.795 INFO:teuthology.orchestra.run.smithi003.stderr: 83150K .......... .......... .......... .......... .......... 89% 35.3M 1s 2023-12-03T11:51:26.796 INFO:teuthology.orchestra.run.smithi003.stderr: 83200K .......... .......... .......... .......... .......... 89% 31.2M 1s 2023-12-03T11:51:26.798 INFO:teuthology.orchestra.run.smithi003.stderr: 83250K .......... .......... .......... .......... .......... 89% 33.7M 1s 2023-12-03T11:51:26.800 INFO:teuthology.orchestra.run.smithi003.stderr: 83300K .......... .......... .......... .......... .......... 89% 79.7M 1s 2023-12-03T11:51:26.800 INFO:teuthology.orchestra.run.smithi003.stderr: 83350K .......... .......... .......... .......... .......... 89% 21.2M 1s 2023-12-03T11:51:26.801 INFO:teuthology.orchestra.run.smithi003.stderr: 83400K .......... .......... .......... .......... .......... 89% 53.7M 1s 2023-12-03T11:51:26.803 INFO:teuthology.orchestra.run.smithi003.stderr: 83450K .......... .......... .......... .......... .......... 89% 33.2M 1s 2023-12-03T11:51:26.805 INFO:teuthology.orchestra.run.smithi003.stderr: 83500K .......... .......... .......... .......... .......... 89% 31.8M 1s 2023-12-03T11:51:26.805 INFO:teuthology.orchestra.run.smithi003.stderr: 83550K .......... .......... .......... .......... .......... 89% 83.9M 1s 2023-12-03T11:51:26.807 INFO:teuthology.orchestra.run.smithi003.stderr: 83600K .......... .......... .......... .......... .......... 90% 18.2M 1s 2023-12-03T11:51:26.809 INFO:teuthology.orchestra.run.smithi003.stderr: 83650K .......... .......... .......... .......... .......... 90% 52.6M 1s 2023-12-03T11:51:26.809 INFO:teuthology.orchestra.run.smithi003.stderr: 83700K .......... .......... .......... .......... .......... 90% 42.7M 1s 2023-12-03T11:51:26.811 INFO:teuthology.orchestra.run.smithi003.stderr: 83750K .......... .......... .......... .......... .......... 90% 26.6M 1s 2023-12-03T11:51:26.812 INFO:teuthology.orchestra.run.smithi003.stderr: 83800K .......... .......... .......... .......... .......... 90% 60.6M 1s 2023-12-03T11:51:26.815 INFO:teuthology.orchestra.run.smithi003.stderr: 83850K .......... .......... .......... .......... .......... 90% 19.5M 1s 2023-12-03T11:51:26.816 INFO:teuthology.orchestra.run.smithi003.stderr: 83900K .......... .......... .......... .......... .......... 90% 33.4M 1s 2023-12-03T11:51:26.819 INFO:teuthology.orchestra.run.smithi003.stderr: 83950K .......... .......... .......... .......... .......... 90% 19.5M 1s 2023-12-03T11:51:26.819 INFO:teuthology.orchestra.run.smithi003.stderr: 84000K .......... .......... .......... .......... .......... 90% 78.0M 1s 2023-12-03T11:51:26.821 INFO:teuthology.orchestra.run.smithi003.stderr: 84050K .......... .......... .......... .......... .......... 90% 24.1M 1s 2023-12-03T11:51:26.825 INFO:teuthology.orchestra.run.smithi003.stderr: 84100K .......... .......... .......... .......... .......... 90% 17.4M 1s 2023-12-03T11:51:26.825 INFO:teuthology.orchestra.run.smithi003.stderr: 84150K .......... .......... .......... .......... .......... 90% 57.3M 1s 2023-12-03T11:51:26.829 INFO:teuthology.orchestra.run.smithi003.stderr: 84200K .......... .......... .......... .......... .......... 90% 19.0M 1s 2023-12-03T11:51:26.829 INFO:teuthology.orchestra.run.smithi003.stderr: 84250K .......... .......... .......... .......... .......... 90% 135M 1s 2023-12-03T11:51:26.830 INFO:teuthology.orchestra.run.smithi003.stderr: 84300K .......... .......... .......... .......... .......... 90% 33.6M 1s 2023-12-03T11:51:26.831 INFO:teuthology.orchestra.run.smithi003.stderr: 84350K .......... .......... .......... .......... .......... 90% 46.2M 1s 2023-12-03T11:51:26.833 INFO:teuthology.orchestra.run.smithi003.stderr: 84400K .......... .......... .......... .......... .......... 90% 30.4M 1s 2023-12-03T11:51:26.833 INFO:teuthology.orchestra.run.smithi003.stderr: 84450K .......... .......... .......... .......... .......... 90% 101M 1s 2023-12-03T11:51:26.835 INFO:teuthology.orchestra.run.smithi003.stderr: 84500K .......... .......... .......... .......... .......... 91% 28.0M 1s 2023-12-03T11:51:26.837 INFO:teuthology.orchestra.run.smithi003.stderr: 84550K .......... .......... .......... .......... .......... 91% 19.2M 1s 2023-12-03T11:51:26.837 INFO:teuthology.orchestra.run.smithi003.stderr: 84600K .......... .......... .......... .......... .......... 91% 92.8M 1s 2023-12-03T11:51:26.840 INFO:teuthology.orchestra.run.smithi003.stderr: 84650K .......... .......... .......... .......... .......... 91% 23.9M 1s 2023-12-03T11:51:26.841 INFO:teuthology.orchestra.run.smithi003.stderr: 84700K .......... .......... .......... .......... .......... 91% 30.0M 1s 2023-12-03T11:51:26.841 INFO:teuthology.orchestra.run.smithi003.stderr: 84750K .......... .......... .......... .......... .......... 91% 84.1M 1s 2023-12-03T11:51:26.843 INFO:teuthology.orchestra.run.smithi003.stderr: 84800K .......... .......... .......... .......... .......... 91% 27.6M 1s 2023-12-03T11:51:26.845 INFO:teuthology.orchestra.run.smithi003.stderr: 84850K .......... .......... .......... .......... .......... 91% 35.8M 1s 2023-12-03T11:51:26.847 INFO:teuthology.orchestra.run.smithi003.stderr: 84900K .......... .......... .......... .......... .......... 91% 29.4M 1s 2023-12-03T11:51:26.849 INFO:teuthology.orchestra.run.smithi003.stderr: 84950K .......... .......... .......... .......... .......... 91% 78.0M 1s 2023-12-03T11:51:26.850 INFO:teuthology.orchestra.run.smithi003.stderr: 85000K .......... .......... .......... .......... .......... 91% 12.9M 1s 2023-12-03T11:51:26.852 INFO:teuthology.orchestra.run.smithi003.stderr: 85050K .......... .......... .......... .......... .......... 91% 34.1M 1s 2023-12-03T11:51:26.854 INFO:teuthology.orchestra.run.smithi003.stderr: 85100K .......... .......... .......... .......... .......... 91% 34.6M 1s 2023-12-03T11:51:26.856 INFO:teuthology.orchestra.run.smithi003.stderr: 85150K .......... .......... .......... .......... .......... 91% 23.6M 1s 2023-12-03T11:51:26.856 INFO:teuthology.orchestra.run.smithi003.stderr: 85200K .......... .......... .......... .......... .......... 91% 52.3M 1s 2023-12-03T11:51:26.860 INFO:teuthology.orchestra.run.smithi003.stderr: 85250K .......... .......... .......... .......... .......... 91% 12.5M 1s 2023-12-03T11:51:26.863 INFO:teuthology.orchestra.run.smithi003.stderr: 85300K .......... .......... .......... .......... .......... 91% 30.2M 1s 2023-12-03T11:51:26.864 INFO:teuthology.orchestra.run.smithi003.stderr: 85350K .......... .......... .......... .......... .......... 91% 23.9M 1s 2023-12-03T11:51:26.866 INFO:teuthology.orchestra.run.smithi003.stderr: 85400K .......... .......... .......... .......... .......... 91% 39.5M 1s 2023-12-03T11:51:26.866 INFO:teuthology.orchestra.run.smithi003.stderr: 85450K .......... .......... .......... .......... .......... 92% 56.7M 1s 2023-12-03T11:51:26.868 INFO:teuthology.orchestra.run.smithi003.stderr: 85500K .......... .......... .......... .......... .......... 92% 35.8M 1s 2023-12-03T11:51:26.870 INFO:teuthology.orchestra.run.smithi003.stderr: 85550K .......... .......... .......... .......... .......... 92% 26.8M 1s 2023-12-03T11:51:26.872 INFO:teuthology.orchestra.run.smithi003.stderr: 85600K .......... .......... .......... .......... .......... 92% 27.2M 1s 2023-12-03T11:51:26.872 INFO:teuthology.orchestra.run.smithi003.stderr: 85650K .......... .......... .......... .......... .......... 92% 81.4M 1s 2023-12-03T11:51:26.873 INFO:teuthology.orchestra.run.smithi003.stderr: 85700K .......... .......... .......... .......... .......... 92% 33.4M 1s 2023-12-03T11:51:26.875 INFO:teuthology.orchestra.run.smithi003.stderr: 85750K .......... .......... .......... .......... .......... 92% 47.2M 1s 2023-12-03T11:51:26.875 INFO:teuthology.orchestra.run.smithi003.stderr: 85800K .......... .......... .......... .......... .......... 92% 39.7M 1s 2023-12-03T11:51:26.876 INFO:teuthology.orchestra.run.smithi003.stderr: 85850K .......... .......... .......... .......... .......... 92% 48.6M 1s 2023-12-03T11:51:26.878 INFO:teuthology.orchestra.run.smithi003.stderr: 85900K .......... .......... .......... .......... .......... 92% 36.6M 1s 2023-12-03T11:51:26.879 INFO:teuthology.orchestra.run.smithi003.stderr: 85950K .......... .......... .......... .......... .......... 92% 33.8M 1s 2023-12-03T11:51:26.881 INFO:teuthology.orchestra.run.smithi003.stderr: 86000K .......... .......... .......... .......... .......... 92% 31.7M 1s 2023-12-03T11:51:26.882 INFO:teuthology.orchestra.run.smithi003.stderr: 86050K .......... .......... .......... .......... .......... 92% 35.0M 1s 2023-12-03T11:51:26.884 INFO:teuthology.orchestra.run.smithi003.stderr: 86100K .......... .......... .......... .......... .......... 92% 31.8M 1s 2023-12-03T11:51:26.884 INFO:teuthology.orchestra.run.smithi003.stderr: 86150K .......... .......... .......... .......... .......... 92% 52.8M 1s 2023-12-03T11:51:26.886 INFO:teuthology.orchestra.run.smithi003.stderr: 86200K .......... .......... .......... .......... .......... 92% 32.9M 1s 2023-12-03T11:51:26.888 INFO:teuthology.orchestra.run.smithi003.stderr: 86250K .......... .......... .......... .......... .......... 92% 41.8M 1s 2023-12-03T11:51:26.890 INFO:teuthology.orchestra.run.smithi003.stderr: 86300K .......... .......... .......... .......... .......... 92% 20.5M 1s 2023-12-03T11:51:26.890 INFO:teuthology.orchestra.run.smithi003.stderr: 86350K .......... .......... .......... .......... .......... 93% 75.3M 1s 2023-12-03T11:51:26.891 INFO:teuthology.orchestra.run.smithi003.stderr: 86400K .......... .......... .......... .......... .......... 93% 39.6M 1s 2023-12-03T11:51:26.893 INFO:teuthology.orchestra.run.smithi003.stderr: 86450K .......... .......... .......... .......... .......... 93% 54.9M 1s 2023-12-03T11:51:26.894 INFO:teuthology.orchestra.run.smithi003.stderr: 86500K .......... .......... .......... .......... .......... 93% 35.3M 1s 2023-12-03T11:51:26.895 INFO:teuthology.orchestra.run.smithi003.stderr: 86550K .......... .......... .......... .......... .......... 93% 34.4M 1s 2023-12-03T11:51:26.896 INFO:teuthology.orchestra.run.smithi003.stderr: 86600K .......... .......... .......... .......... .......... 93% 46.5M 1s 2023-12-03T11:51:26.897 INFO:teuthology.orchestra.run.smithi003.stderr: 86650K .......... .......... .......... .......... .......... 93% 65.3M 1s 2023-12-03T11:51:26.899 INFO:teuthology.orchestra.run.smithi003.stderr: 86700K .......... .......... .......... .......... .......... 93% 34.7M 1s 2023-12-03T11:51:26.901 INFO:teuthology.orchestra.run.smithi003.stderr: 86750K .......... .......... .......... .......... .......... 93% 20.8M 1s 2023-12-03T11:51:26.902 INFO:teuthology.orchestra.run.smithi003.stderr: 86800K .......... .......... .......... .......... .......... 93% 50.5M 1s 2023-12-03T11:51:26.903 INFO:teuthology.orchestra.run.smithi003.stderr: 86850K .......... .......... .......... .......... .......... 93% 48.3M 1s 2023-12-03T11:51:26.904 INFO:teuthology.orchestra.run.smithi003.stderr: 86900K .......... .......... .......... .......... .......... 93% 40.5M 1s 2023-12-03T11:51:26.905 INFO:teuthology.orchestra.run.smithi003.stderr: 86950K .......... .......... .......... .......... .......... 93% 44.3M 1s 2023-12-03T11:51:26.907 INFO:teuthology.orchestra.run.smithi003.stderr: 87000K .......... .......... .......... .......... .......... 93% 30.4M 1s 2023-12-03T11:51:26.908 INFO:teuthology.orchestra.run.smithi003.stderr: 87050K .......... .......... .......... .......... .......... 93% 85.5M 1s 2023-12-03T11:51:26.909 INFO:teuthology.orchestra.run.smithi003.stderr: 87100K .......... .......... .......... .......... .......... 93% 27.7M 1s 2023-12-03T11:51:26.910 INFO:teuthology.orchestra.run.smithi003.stderr: 87150K .......... .......... .......... .......... .......... 93% 43.4M 1s 2023-12-03T11:51:26.912 INFO:teuthology.orchestra.run.smithi003.stderr: 87200K .......... .......... .......... .......... .......... 93% 25.5M 1s 2023-12-03T11:51:26.914 INFO:teuthology.orchestra.run.smithi003.stderr: 87250K .......... .......... .......... .......... .......... 93% 41.1M 1s 2023-12-03T11:51:26.914 INFO:teuthology.orchestra.run.smithi003.stderr: 87300K .......... .......... .......... .......... .......... 94% 67.7M 1s 2023-12-03T11:51:26.915 INFO:teuthology.orchestra.run.smithi003.stderr: 87350K .......... .......... .......... .......... .......... 94% 42.5M 1s 2023-12-03T11:51:26.917 INFO:teuthology.orchestra.run.smithi003.stderr: 87400K .......... .......... .......... .......... .......... 94% 34.5M 1s 2023-12-03T11:51:26.919 INFO:teuthology.orchestra.run.smithi003.stderr: 87450K .......... .......... .......... .......... .......... 94% 24.0M 0s 2023-12-03T11:51:26.919 INFO:teuthology.orchestra.run.smithi003.stderr: 87500K .......... .......... .......... .......... .......... 94% 51.4M 0s 2023-12-03T11:51:26.921 INFO:teuthology.orchestra.run.smithi003.stderr: 87550K .......... .......... .......... .......... .......... 94% 42.2M 0s 2023-12-03T11:51:26.922 INFO:teuthology.orchestra.run.smithi003.stderr: 87600K .......... .......... .......... .......... .......... 94% 33.0M 0s 2023-12-03T11:51:26.924 INFO:teuthology.orchestra.run.smithi003.stderr: 87650K .......... .......... .......... .......... .......... 94% 35.1M 0s 2023-12-03T11:51:26.925 INFO:teuthology.orchestra.run.smithi003.stderr: 87700K .......... .......... .......... .......... .......... 94% 35.6M 0s 2023-12-03T11:51:26.926 INFO:teuthology.orchestra.run.smithi003.stderr: 87750K .......... .......... .......... .......... .......... 94% 39.2M 0s 2023-12-03T11:51:26.929 INFO:teuthology.orchestra.run.smithi003.stderr: 87800K .......... .......... .......... .......... .......... 94% 21.1M 0s 2023-12-03T11:51:26.930 INFO:teuthology.orchestra.run.smithi003.stderr: 87850K .......... .......... .......... .......... .......... 94% 39.0M 0s 2023-12-03T11:51:26.932 INFO:teuthology.orchestra.run.smithi003.stderr: 87900K .......... .......... .......... .......... .......... 94% 24.6M 0s 2023-12-03T11:51:26.934 INFO:teuthology.orchestra.run.smithi003.stderr: 87950K .......... .......... .......... .......... .......... 94% 25.2M 0s 2023-12-03T11:51:26.935 INFO:teuthology.orchestra.run.smithi003.stderr: 88000K .......... .......... .......... .......... .......... 94% 38.4M 0s 2023-12-03T11:51:26.936 INFO:teuthology.orchestra.run.smithi003.stderr: 88050K .......... .......... .......... .......... .......... 94% 43.6M 0s 2023-12-03T11:51:26.941 INFO:teuthology.orchestra.run.smithi003.stderr: 88100K .......... .......... .......... .......... .......... 94% 15.1M 0s 2023-12-03T11:51:26.941 INFO:teuthology.orchestra.run.smithi003.stderr: 88150K .......... .......... .......... .......... .......... 94% 109M 0s 2023-12-03T11:51:26.941 INFO:teuthology.orchestra.run.smithi003.stderr: 88200K .......... .......... .......... .......... .......... 94% 44.1M 0s 2023-12-03T11:51:26.943 INFO:teuthology.orchestra.run.smithi003.stderr: 88250K .......... .......... .......... .......... .......... 95% 37.3M 0s 2023-12-03T11:51:26.944 INFO:teuthology.orchestra.run.smithi003.stderr: 88300K .......... .......... .......... .......... .......... 95% 32.7M 0s 2023-12-03T11:51:26.945 INFO:teuthology.orchestra.run.smithi003.stderr: 88350K .......... .......... .......... .......... .......... 95% 42.8M 0s 2023-12-03T11:51:26.947 INFO:teuthology.orchestra.run.smithi003.stderr: 88400K .......... .......... .......... .......... .......... 95% 26.0M 0s 2023-12-03T11:51:26.947 INFO:teuthology.orchestra.run.smithi003.stderr: 88450K .......... .......... .......... .......... .......... 95% 59.2M 0s 2023-12-03T11:51:26.949 INFO:teuthology.orchestra.run.smithi003.stderr: 88500K .......... .......... .......... .......... .......... 95% 38.5M 0s 2023-12-03T11:51:26.952 INFO:teuthology.orchestra.run.smithi003.stderr: 88550K .......... .......... .......... .......... .......... 95% 25.9M 0s 2023-12-03T11:51:26.953 INFO:teuthology.orchestra.run.smithi003.stderr: 88600K .......... .......... .......... .......... .......... 95% 39.0M 0s 2023-12-03T11:51:26.955 INFO:teuthology.orchestra.run.smithi003.stderr: 88650K .......... .......... .......... .......... .......... 95% 25.0M 0s 2023-12-03T11:51:26.955 INFO:teuthology.orchestra.run.smithi003.stderr: 88700K .......... .......... .......... .......... .......... 95% 95.4M 0s 2023-12-03T11:51:26.956 INFO:teuthology.orchestra.run.smithi003.stderr: 88750K .......... .......... .......... .......... .......... 95% 37.6M 0s 2023-12-03T11:51:26.958 INFO:teuthology.orchestra.run.smithi003.stderr: 88800K .......... .......... .......... .......... .......... 95% 32.6M 0s 2023-12-03T11:51:26.959 INFO:teuthology.orchestra.run.smithi003.stderr: 88850K .......... .......... .......... .......... .......... 95% 25.3M 0s 2023-12-03T11:51:26.961 INFO:teuthology.orchestra.run.smithi003.stderr: 88900K .......... .......... .......... .......... .......... 95% 23.5M 0s 2023-12-03T11:51:26.965 INFO:teuthology.orchestra.run.smithi003.stderr: 88950K .......... .......... .......... .......... .......... 95% 25.9M 0s 2023-12-03T11:51:26.965 INFO:teuthology.orchestra.run.smithi003.stderr: 89000K .......... .......... .......... .......... .......... 95% 34.1M 0s 2023-12-03T11:51:26.966 INFO:teuthology.orchestra.run.smithi003.stderr: 89050K .......... .......... .......... .......... .......... 95% 28.8M 0s 2023-12-03T11:51:26.969 INFO:teuthology.orchestra.run.smithi003.stderr: 89100K .......... .......... .......... .......... .......... 95% 15.0M 0s 2023-12-03T11:51:26.972 INFO:teuthology.orchestra.run.smithi003.stderr: 89150K .......... .......... .......... .......... .......... 96% 17.9M 0s 2023-12-03T11:51:26.974 INFO:teuthology.orchestra.run.smithi003.stderr: 89200K .......... .......... .......... .......... .......... 96% 57.3M 0s 2023-12-03T11:51:26.977 INFO:teuthology.orchestra.run.smithi003.stderr: 89250K .......... .......... .......... .......... .......... 96% 23.9M 0s 2023-12-03T11:51:26.977 INFO:teuthology.orchestra.run.smithi003.stderr: 89300K .......... .......... .......... .......... .......... 96% 40.2M 0s 2023-12-03T11:51:26.981 INFO:teuthology.orchestra.run.smithi003.stderr: 89350K .......... .......... .......... .......... .......... 96% 24.8M 0s 2023-12-03T11:51:26.981 INFO:teuthology.orchestra.run.smithi003.stderr: 89400K .......... .......... .......... .......... .......... 96% 86.4M 0s 2023-12-03T11:51:26.982 INFO:teuthology.orchestra.run.smithi003.stderr: 89450K .......... .......... .......... .......... .......... 96% 32.3M 0s 2023-12-03T11:51:27.000 INFO:teuthology.orchestra.run.smithi003.stderr: 89500K .......... .......... .......... .......... .......... 96% 27.1M 0s 2023-12-03T11:51:27.000 INFO:teuthology.orchestra.run.smithi003.stderr: 89550K .......... .......... .......... .......... .......... 96% 36.2M 0s 2023-12-03T11:51:27.001 INFO:teuthology.orchestra.run.smithi003.stderr: 89600K .......... .......... .......... .......... .......... 96% 73.0M 0s 2023-12-03T11:51:27.001 INFO:teuthology.orchestra.run.smithi003.stderr: 89650K .......... .......... .......... .......... .......... 96% 32.5M 0s 2023-12-03T11:51:27.001 INFO:teuthology.orchestra.run.smithi003.stderr: 89700K .......... .......... .......... .......... .......... 96% 39.7M 0s 2023-12-03T11:51:27.001 INFO:teuthology.orchestra.run.smithi003.stderr: 89750K .......... .......... .......... .......... .......... 96% 49.6M 0s 2023-12-03T11:51:27.001 INFO:teuthology.orchestra.run.smithi003.stderr: 89800K .......... .......... .......... .......... .......... 96% 38.8M 0s 2023-12-03T11:51:27.001 INFO:teuthology.orchestra.run.smithi003.stderr: 89850K .......... .......... .......... .......... .......... 96% 67.4M 0s 2023-12-03T11:51:27.001 INFO:teuthology.orchestra.run.smithi003.stderr: 89900K .......... .......... .......... .......... .......... 96% 25.1M 0s 2023-12-03T11:51:27.001 INFO:teuthology.orchestra.run.smithi003.stderr: 89950K .......... .......... .......... .......... .......... 96% 37.8M 0s 2023-12-03T11:51:27.002 INFO:teuthology.orchestra.run.smithi003.stderr: 90000K .......... .......... .......... .......... .......... 96% 37.2M 0s 2023-12-03T11:51:27.002 INFO:teuthology.orchestra.run.smithi003.stderr: 90050K .......... .......... .......... .......... .......... 96% 27.8M 0s 2023-12-03T11:51:27.002 INFO:teuthology.orchestra.run.smithi003.stderr: 90100K .......... .......... .......... .......... .......... 97% 50.2M 0s 2023-12-03T11:51:27.002 INFO:teuthology.orchestra.run.smithi003.stderr: 90150K .......... .......... .......... .......... .......... 97% 35.0M 0s 2023-12-03T11:51:27.004 INFO:teuthology.orchestra.run.smithi003.stderr: 90200K .......... .......... .......... .......... .......... 97% 20.5M 0s 2023-12-03T11:51:27.004 INFO:teuthology.orchestra.run.smithi003.stderr: 90250K .......... .......... .......... .......... .......... 97% 48.6M 0s 2023-12-03T11:51:27.004 INFO:teuthology.orchestra.run.smithi003.stderr: 90300K .......... .......... .......... .......... .......... 97% 34.5M 0s 2023-12-03T11:51:27.004 INFO:teuthology.orchestra.run.smithi003.stderr: 90350K .......... .......... .......... .......... .......... 97% 56.8M 0s 2023-12-03T11:51:27.005 INFO:teuthology.orchestra.run.smithi003.stderr: 90400K .......... .......... .......... .......... .......... 97% 44.7M 0s 2023-12-03T11:51:27.007 INFO:teuthology.orchestra.run.smithi003.stderr: 90450K .......... .......... .......... .......... .......... 97% 27.0M 0s 2023-12-03T11:51:27.009 INFO:teuthology.orchestra.run.smithi003.stderr: 90500K .......... .......... .......... .......... .......... 97% 29.9M 0s 2023-12-03T11:51:27.011 INFO:teuthology.orchestra.run.smithi003.stderr: 90550K .......... .......... .......... .......... .......... 97% 24.2M 0s 2023-12-03T11:51:27.011 INFO:teuthology.orchestra.run.smithi003.stderr: 90600K .......... .......... .......... .......... .......... 97% 67.2M 0s 2023-12-03T11:51:27.015 INFO:teuthology.orchestra.run.smithi003.stderr: 90650K .......... .......... .......... .......... .......... 97% 22.5M 0s 2023-12-03T11:51:27.015 INFO:teuthology.orchestra.run.smithi003.stderr: 90700K .......... .......... .......... .......... .......... 97% 59.4M 0s 2023-12-03T11:51:27.016 INFO:teuthology.orchestra.run.smithi003.stderr: 90750K .......... .......... .......... .......... .......... 97% 31.8M 0s 2023-12-03T11:51:27.018 INFO:teuthology.orchestra.run.smithi003.stderr: 90800K .......... .......... .......... .......... .......... 97% 42.4M 0s 2023-12-03T11:51:27.018 INFO:teuthology.orchestra.run.smithi003.stderr: 90850K .......... .......... .......... .......... .......... 97% 65.8M 0s 2023-12-03T11:51:27.020 INFO:teuthology.orchestra.run.smithi003.stderr: 90900K .......... .......... .......... .......... .......... 97% 25.5M 0s 2023-12-03T11:51:27.022 INFO:teuthology.orchestra.run.smithi003.stderr: 90950K .......... .......... .......... .......... .......... 97% 23.5M 0s 2023-12-03T11:51:27.023 INFO:teuthology.orchestra.run.smithi003.stderr: 91000K .......... .......... .......... .......... .......... 98% 40.1M 0s 2023-12-03T11:51:27.024 INFO:teuthology.orchestra.run.smithi003.stderr: 91050K .......... .......... .......... .......... .......... 98% 53.6M 0s 2023-12-03T11:51:27.026 INFO:teuthology.orchestra.run.smithi003.stderr: 91100K .......... .......... .......... .......... .......... 98% 29.3M 0s 2023-12-03T11:51:27.028 INFO:teuthology.orchestra.run.smithi003.stderr: 91150K .......... .......... .......... .......... .......... 98% 29.1M 0s 2023-12-03T11:51:27.028 INFO:teuthology.orchestra.run.smithi003.stderr: 91200K .......... .......... .......... .......... .......... 98% 37.6M 0s 2023-12-03T11:51:27.029 INFO:teuthology.orchestra.run.smithi003.stderr: 91250K .......... .......... .......... .......... .......... 98% 50.8M 0s 2023-12-03T11:51:27.031 INFO:teuthology.orchestra.run.smithi003.stderr: 91300K .......... .......... .......... .......... .......... 98% 27.0M 0s 2023-12-03T11:51:27.033 INFO:teuthology.orchestra.run.smithi003.stderr: 91350K .......... .......... .......... .......... .......... 98% 27.0M 0s 2023-12-03T11:51:27.035 INFO:teuthology.orchestra.run.smithi003.stderr: 91400K .......... .......... .......... .......... .......... 98% 25.4M 0s 2023-12-03T11:51:27.036 INFO:teuthology.orchestra.run.smithi003.stderr: 91450K .......... .......... .......... .......... .......... 98% 44.0M 0s 2023-12-03T11:51:27.037 INFO:teuthology.orchestra.run.smithi003.stderr: 91500K .......... .......... .......... .......... .......... 98% 42.1M 0s 2023-12-03T11:51:27.040 INFO:teuthology.orchestra.run.smithi003.stderr: 91550K .......... .......... .......... .......... .......... 98% 22.0M 0s 2023-12-03T11:51:27.041 INFO:teuthology.orchestra.run.smithi003.stderr: 91600K .......... .......... .......... .......... .......... 98% 33.1M 0s 2023-12-03T11:51:27.043 INFO:teuthology.orchestra.run.smithi003.stderr: 91650K .......... .......... .......... .......... .......... 98% 21.8M 0s 2023-12-03T11:51:27.045 INFO:teuthology.orchestra.run.smithi003.stderr: 91700K .......... .......... .......... .......... .......... 98% 22.9M 0s 2023-12-03T11:51:27.046 INFO:teuthology.orchestra.run.smithi003.stderr: 91750K .......... .......... .......... .......... .......... 98% 59.3M 0s 2023-12-03T11:51:27.048 INFO:teuthology.orchestra.run.smithi003.stderr: 91800K .......... .......... .......... .......... .......... 98% 23.9M 0s 2023-12-03T11:51:27.051 INFO:teuthology.orchestra.run.smithi003.stderr: 91850K .......... .......... .......... .......... .......... 98% 23.8M 0s 2023-12-03T11:51:27.052 INFO:teuthology.orchestra.run.smithi003.stderr: 91900K .......... .......... .......... .......... .......... 98% 26.1M 0s 2023-12-03T11:51:27.054 INFO:teuthology.orchestra.run.smithi003.stderr: 91950K .......... .......... .......... .......... .......... 99% 22.6M 0s 2023-12-03T11:51:27.056 INFO:teuthology.orchestra.run.smithi003.stderr: 92000K .......... .......... .......... .......... .......... 99% 27.8M 0s 2023-12-03T11:51:27.057 INFO:teuthology.orchestra.run.smithi003.stderr: 92050K .......... .......... .......... .......... .......... 99% 45.8M 0s 2023-12-03T11:51:27.059 INFO:teuthology.orchestra.run.smithi003.stderr: 92100K .......... .......... .......... .......... .......... 99% 36.0M 0s 2023-12-03T11:51:27.060 INFO:teuthology.orchestra.run.smithi003.stderr: 92150K .......... .......... .......... .......... .......... 99% 29.2M 0s 2023-12-03T11:51:27.061 INFO:teuthology.orchestra.run.smithi003.stderr: 92200K .......... .......... .......... .......... .......... 99% 61.7M 0s 2023-12-03T11:51:27.063 INFO:teuthology.orchestra.run.smithi003.stderr: 92250K .......... .......... .......... .......... .......... 99% 21.2M 0s 2023-12-03T11:51:27.065 INFO:teuthology.orchestra.run.smithi003.stderr: 92300K .......... .......... .......... .......... .......... 99% 31.2M 0s 2023-12-03T11:51:27.067 INFO:teuthology.orchestra.run.smithi003.stderr: 92350K .......... .......... .......... .......... .......... 99% 27.8M 0s 2023-12-03T11:51:27.069 INFO:teuthology.orchestra.run.smithi003.stderr: 92400K .......... .......... .......... .......... .......... 99% 24.2M 0s 2023-12-03T11:51:27.070 INFO:teuthology.orchestra.run.smithi003.stderr: 92450K .......... .......... .......... .......... .......... 99% 67.6M 0s 2023-12-03T11:51:27.071 INFO:teuthology.orchestra.run.smithi003.stderr: 92500K .......... .......... .......... .......... .......... 99% 33.3M 0s 2023-12-03T11:51:27.073 INFO:teuthology.orchestra.run.smithi003.stderr: 92550K .......... .......... .......... .......... .......... 99% 26.2M 0s 2023-12-03T11:51:27.074 INFO:teuthology.orchestra.run.smithi003.stderr: 92600K .......... .......... .......... .......... .......... 99% 43.5M 0s 2023-12-03T11:51:27.074 INFO:teuthology.orchestra.run.smithi003.stderr: 92650K .......... .......... .......... .......... .......... 99% 60.7M 0s 2023-12-03T11:51:27.076 INFO:teuthology.orchestra.run.smithi003.stderr: 92700K .......... .......... .......... .......... .......... 99% 27.6M 0s 2023-12-03T11:51:27.078 INFO:teuthology.orchestra.run.smithi003.stderr: 92750K .......... .......... .......... .......... .......... 99% 28.9M 0s 2023-12-03T11:51:27.083 INFO:teuthology.orchestra.run.smithi003.stderr: 92800K .......... .......... .......... .......... .......... 99% 13.9M 0s 2023-12-03T11:51:27.083 INFO:teuthology.orchestra.run.smithi003.stderr: 92850K .......... .......... .......... .......... .......... 99% 94.2M 0s 2023-12-03T11:51:27.083 INFO:teuthology.orchestra.run.smithi003.stderr: 92900K 100% 134G=8.2s 2023-12-03T11:51:27.084 INFO:teuthology.orchestra.run.smithi003.stderr: 2023-12-03T11:51:27.084 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03 11:51:27 (11.0 MB/s) - ‘gradle-6.0.1-bin.zip’ saved [95129672/95129672] 2023-12-03T11:51:27.084 INFO:teuthology.orchestra.run.smithi003.stderr: 2023-12-03T11:51:27.109 INFO:teuthology.orchestra.run.smithi003.stdout:Archive: gradle-6.0.1-bin.zip 2023-12-03T11:51:27.110 INFO:teuthology.orchestra.run.smithi003.stdout: creating: /opt/gradle/gradle-6.0.1/ 2023-12-03T11:51:27.111 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/getting-started.html 2023-12-03T11:51:27.111 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/LICENSE 2023-12-03T11:51:27.112 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/NOTICE 2023-12-03T11:51:27.112 INFO:teuthology.orchestra.run.smithi003.stdout: creating: /opt/gradle/gradle-6.0.1/init.d/ 2023-12-03T11:51:27.112 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/init.d/readme.txt 2023-12-03T11:51:27.112 INFO:teuthology.orchestra.run.smithi003.stdout: creating: /opt/gradle/gradle-6.0.1/bin/ 2023-12-03T11:51:27.112 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/bin/gradle 2023-12-03T11:51:27.112 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/bin/gradle.bat 2023-12-03T11:51:27.112 INFO:teuthology.orchestra.run.smithi003.stdout: creating: /opt/gradle/gradle-6.0.1/lib/ 2023-12-03T11:51:27.112 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-api-metadata-6.0.1.jar 2023-12-03T11:51:27.114 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-launcher-6.0.1.jar 2023-12-03T11:51:27.114 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-runtime-api-info-6.0.1.jar 2023-12-03T11:51:27.125 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-kotlin-dsl-6.0.1.jar 2023-12-03T11:51:27.128 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-tooling-api-6.0.1.jar 2023-12-03T11:51:27.128 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-wrapper-6.0.1.jar 2023-12-03T11:51:27.128 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-installation-beacon-6.0.1.jar 2023-12-03T11:51:27.128 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-bootstrap-6.0.1.jar 2023-12-03T11:51:27.143 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-core-6.0.1.jar 2023-12-03T11:51:27.144 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-file-collections-6.0.1.jar 2023-12-03T11:51:27.144 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-model-groovy-6.0.1.jar 2023-12-03T11:51:27.145 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-execution-6.0.1.jar 2023-12-03T11:51:27.152 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-model-core-6.0.1.jar 2023-12-03T11:51:27.152 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-cache-packaging-6.0.1.jar 2023-12-03T11:51:27.152 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-cache-6.0.1.jar 2023-12-03T11:51:27.155 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-core-api-6.0.1.jar 2023-12-03T11:51:27.156 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-persistent-cache-6.0.1.jar 2023-12-03T11:51:27.157 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-worker-processes-6.0.1.jar 2023-12-03T11:51:27.159 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-logging-6.0.1.jar 2023-12-03T11:51:27.159 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-jvm-services-6.0.1.jar 2023-12-03T11:51:27.159 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-process-services-6.0.1.jar 2023-12-03T11:51:27.159 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-resources-6.0.1.jar 2023-12-03T11:51:27.161 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-messaging-6.0.1.jar 2023-12-03T11:51:27.161 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-native-6.0.1.jar 2023-12-03T11:51:27.161 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-base-services-groovy-6.0.1.jar 2023-12-03T11:51:27.165 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-base-services-6.0.1.jar 2023-12-03T11:51:27.165 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-option-6.0.1.jar 2023-12-03T11:51:27.165 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-cli-6.0.1.jar 2023-12-03T11:51:27.166 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-snapshots-6.0.1.jar 2023-12-03T11:51:27.166 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-files-6.0.1.jar 2023-12-03T11:51:27.166 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-kotlin-dsl-tooling-models-6.0.1.jar 2023-12-03T11:51:27.405 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-compiler-embeddable-1.3.50-patched-for-gradle-6.0.1.jar 2023-12-03T11:51:27.405 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-hashing-6.0.1.jar 2023-12-03T11:51:27.405 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-pineapple-6.0.1.jar 2023-12-03T11:51:27.405 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-docs-6.0.1.jar 2023-12-03T11:51:27.459 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/groovy-all-1.3-2.5.8.jar 2023-12-03T11:51:27.460 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jul-to-slf4j-1.7.28.jar 2023-12-03T11:51:27.460 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/log4j-over-slf4j-1.7.28.jar 2023-12-03T11:51:27.460 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jcl-over-slf4j-1.7.28.jar 2023-12-03T11:51:27.460 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/slf4j-api-1.7.28.jar 2023-12-03T11:51:27.476 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/guava-27.1-android.jar 2023-12-03T11:51:27.478 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-io-2.6.jar 2023-12-03T11:51:27.482 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-lang-2.6.jar 2023-12-03T11:51:27.482 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-commons-7.1.jar 2023-12-03T11:51:27.482 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-analysis-7.1.jar 2023-12-03T11:51:27.482 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-tree-7.1.jar 2023-12-03T11:51:27.482 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-7.1.jar 2023-12-03T11:51:27.497 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/ant-1.10.7.jar 2023-12-03T11:51:27.497 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-jdk8-1.3.50.jar 2023-12-03T11:51:27.497 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/javax.inject-1.jar 2023-12-03T11:51:27.497 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-common-1.3.50.jar 2023-12-03T11:51:27.499 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-jvm-1.3.50.jar 2023-12-03T11:51:27.499 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-jvm-host-embeddable-1.3.50.jar 2023-12-03T11:51:27.501 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-compiler-embeddable-1.3.50.jar 2023-12-03T11:51:27.503 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-compiler-impl-embeddable-1.3.50.jar 2023-12-03T11:51:27.503 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-sam-with-receiver-compiler-plugin-1.3.50.jar 2023-12-03T11:51:27.519 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlinx-metadata-jvm-0.1.0.jar 2023-12-03T11:51:27.523 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-compress-1.19.jar 2023-12-03T11:51:27.526 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/fastutil-8.3.0-min.jar 2023-12-03T11:51:27.528 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jansi-1.18.jar 2023-12-03T11:51:27.528 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jsr305-3.0.2.jar 2023-12-03T11:51:27.530 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kryo-2.24.0.jar 2023-12-03T11:51:27.531 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-0.18.jar 2023-12-03T11:51:27.531 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/objenesis-2.6.jar 2023-12-03T11:51:27.535 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/trove4j-1.0.20181211.jar 2023-12-03T11:51:27.537 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/xml-apis-1.4.01.jar 2023-12-03T11:51:27.555 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-reflect-1.3.50.jar 2023-12-03T11:51:27.555 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-jdk7-1.3.50.jar 2023-12-03T11:51:27.565 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-1.3.50.jar 2023-12-03T11:51:27.565 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/annotations-13.0.jar 2023-12-03T11:51:27.565 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/ant-launcher-1.10.7.jar 2023-12-03T11:51:27.565 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/minlog-1.2.jar 2023-12-03T11:51:27.565 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-script-runtime-1.3.50.jar 2023-12-03T11:51:27.573 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-daemon-embeddable-1.3.50.jar 2023-12-03T11:51:27.573 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/failureaccess-1.0.1.jar 2023-12-03T11:51:27.575 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-common-1.3.50.jar 2023-12-03T11:51:27.575 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-amd64-libcpp-0.18.jar 2023-12-03T11:51:27.575 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-amd64-libstdcpp-0.18.jar 2023-12-03T11:51:27.575 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-i386-libcpp-0.18.jar 2023-12-03T11:51:27.575 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-i386-libstdcpp-0.18.jar 2023-12-03T11:51:27.576 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-aarch64-0.18.jar 2023-12-03T11:51:27.576 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-0.18.jar 2023-12-03T11:51:27.576 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-0.18.jar 2023-12-03T11:51:27.576 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-osx-amd64-0.18.jar 2023-12-03T11:51:27.576 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-amd64-0.18.jar 2023-12-03T11:51:27.578 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-amd64-min-0.18.jar 2023-12-03T11:51:27.578 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-i386-0.18.jar 2023-12-03T11:51:27.578 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-i386-min-0.18.jar 2023-12-03T11:51:27.578 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-aarch64-ncurses5-0.18.jar 2023-12-03T11:51:27.578 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-ncurses5-0.18.jar 2023-12-03T11:51:27.578 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-ncurses6-0.18.jar 2023-12-03T11:51:27.578 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-ncurses5-0.18.jar 2023-12-03T11:51:27.578 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-ncurses6-0.18.jar 2023-12-03T11:51:27.578 INFO:teuthology.orchestra.run.smithi003.stdout: creating: /opt/gradle/gradle-6.0.1/lib/plugins/ 2023-12-03T11:51:27.578 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-antlr-6.0.1.jar 2023-12-03T11:51:27.579 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-code-quality-6.0.1.jar 2023-12-03T11:51:27.579 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-signing-6.0.1.jar 2023-12-03T11:51:27.580 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-tooling-native-6.0.1.jar 2023-12-03T11:51:27.580 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-native-6.0.1.jar 2023-12-03T11:51:27.581 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-native-6.0.1.jar 2023-12-03T11:51:27.584 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-native-6.0.1.jar 2023-12-03T11:51:27.585 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-kotlin-dsl-provider-plugins-6.0.1.jar 2023-12-03T11:51:27.585 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugin-development-6.0.1.jar 2023-12-03T11:51:27.587 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-maven-6.0.1.jar 2023-12-03T11:51:27.587 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-play-6.0.1.jar 2023-12-03T11:51:27.590 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-6.0.1.jar 2023-12-03T11:51:27.591 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-scala-6.0.1.jar 2023-12-03T11:51:27.591 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ear-6.0.1.jar 2023-12-03T11:51:27.592 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-play-6.0.1.jar 2023-12-03T11:51:27.593 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-javascript-6.0.1.jar 2023-12-03T11:51:27.594 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ivy-6.0.1.jar 2023-12-03T11:51:27.595 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-jacoco-6.0.1.jar 2023-12-03T11:51:27.596 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-init-6.0.1.jar 2023-12-03T11:51:27.597 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-kotlin-dsl-tooling-builders-6.0.1.jar 2023-12-03T11:51:27.599 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugins-6.0.1.jar 2023-12-03T11:51:27.599 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-test-kit-6.0.1.jar 2023-12-03T11:51:27.600 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-groovy-6.0.1.jar 2023-12-03T11:51:27.600 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-scala-6.0.1.jar 2023-12-03T11:51:27.600 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-junit-platform-6.0.1.jar 2023-12-03T11:51:27.601 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-tooling-api-builders-6.0.1.jar 2023-12-03T11:51:27.602 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-jvm-6.0.1.jar 2023-12-03T11:51:27.604 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-java-6.0.1.jar 2023-12-03T11:51:27.604 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-jvm-6.0.1.jar 2023-12-03T11:51:27.605 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-jvm-6.0.1.jar 2023-12-03T11:51:27.609 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-native-6.0.1.jar 2023-12-03T11:51:27.611 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-diagnostics-6.0.1.jar 2023-12-03T11:51:27.611 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-publish-6.0.1.jar 2023-12-03T11:51:27.612 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-base-6.0.1.jar 2023-12-03T11:51:27.614 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-base-6.0.1.jar 2023-12-03T11:51:27.614 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugin-use-6.0.1.jar 2023-12-03T11:51:27.620 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-instant-execution-6.0.1.jar 2023-12-03T11:51:27.621 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-version-control-6.0.1.jar 2023-12-03T11:51:27.635 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-dependency-management-6.0.1.jar 2023-12-03T11:51:27.635 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-composite-builds-6.0.1.jar 2023-12-03T11:51:27.636 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-reporting-6.0.1.jar 2023-12-03T11:51:27.636 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-s3-6.0.1.jar 2023-12-03T11:51:27.637 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-gcs-6.0.1.jar 2023-12-03T11:51:27.637 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-cache-http-6.0.1.jar 2023-12-03T11:51:27.637 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-http-6.0.1.jar 2023-12-03T11:51:27.637 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-sftp-6.0.1.jar 2023-12-03T11:51:27.638 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-profile-6.0.1.jar 2023-12-03T11:51:27.638 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-workers-6.0.1.jar 2023-12-03T11:51:27.657 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/org.eclipse.jgit-5.5.0.201909110433-r.jar 2023-12-03T11:51:27.657 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-http-3.0.0.jar 2023-12-03T11:51:27.657 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-http-shared-3.0.0.jar 2023-12-03T11:51:27.657 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-api-services-storage-v1-rev136-1.25.0.jar 2023-12-03T11:51:27.659 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-api-client-1.25.0.jar 2023-12-03T11:51:27.659 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/asm-util-7.1.jar 2023-12-03T11:51:27.667 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/ivy-2.3.0.jar 2023-12-03T11:51:27.670 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-compat-3.0.4.jar 2023-12-03T11:51:27.673 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-core-3.0.4.jar 2023-12-03T11:51:27.674 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/pmaven-common-0.8-20100325.jar 2023-12-03T11:51:27.674 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/pmaven-groovy-0.8-20100325.jar 2023-12-03T11:51:27.674 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-file-3.0.0.jar 2023-12-03T11:51:27.676 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-container-default-1.7.1.jar 2023-12-03T11:51:27.676 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-connector-wagon-1.13.1.jar 2023-12-03T11:51:27.678 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcpg-jdk15on-1.63.jar 2023-12-03T11:51:27.687 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/rhino-1.7.10.jar 2023-12-03T11:51:27.688 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gson-2.8.5.jar 2023-12-03T11:51:27.690 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/simple-4.1.21.jar 2023-12-03T11:51:27.690 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jatl-0.2.3.jar 2023-12-03T11:51:27.691 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-plugin-api-3.0.4.jar 2023-12-03T11:51:27.691 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-oauth-client-1.25.0.jar 2023-12-03T11:51:27.691 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-http-client-jackson2-1.25.0.jar 2023-12-03T11:51:27.694 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-http-client-1.25.0.jar 2023-12-03T11:51:27.697 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/testng-6.3.1.jar 2023-12-03T11:51:27.699 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/snakeyaml-1.17.jar 2023-12-03T11:51:27.700 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/dd-plist-1.21.jar 2023-12-03T11:51:27.702 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-4.12.jar 2023-12-03T11:51:27.705 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bsh-2.0b6.jar 2023-12-03T11:51:27.705 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-launcher-1.3.1.jar 2023-12-03T11:51:27.712 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-s3-1.11.633.jar 2023-12-03T11:51:27.715 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-kms-1.11.633.jar 2023-12-03T11:51:27.722 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-core-1.11.633.jar 2023-12-03T11:51:27.727 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/httpclient-4.5.10.jar 2023-12-03T11:51:27.729 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jcifs-1.3.17.jar 2023-12-03T11:51:27.730 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/nekohtml-1.9.22.jar 2023-12-03T11:51:27.739 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/xercesImpl-2.12.0.jar 2023-12-03T11:51:27.741 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jsch-0.1.55.jar 2023-12-03T11:51:27.748 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jaxb-impl-2.3.2.jar 2023-12-03T11:51:27.748 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jmespath-java-1.11.633.jar 2023-12-03T11:51:27.757 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-databind-2.9.10.jar 2023-12-03T11:51:27.759 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-core-2.9.10.jar 2023-12-03T11:51:27.759 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-annotations-2.9.10.jar 2023-12-03T11:51:27.764 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/joda-time-2.10.4.jar 2023-12-03T11:51:27.769 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcpkix-jdk15on-1.61.jar 2023-12-03T11:51:27.799 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcprov-jdk15on-1.63.jar 2023-12-03T11:51:27.802 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/commons-codec-1.13.jar 2023-12-03T11:51:27.802 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-aether-provider-3.0.4.jar 2023-12-03T11:51:27.803 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-impl-1.13.1.jar 2023-12-03T11:51:27.804 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-util-1.13.1.jar 2023-12-03T11:51:27.804 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-spi-1.13.1.jar 2023-12-03T11:51:27.804 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-api-1.13.1.jar 2023-12-03T11:51:27.805 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/hamcrest-core-1.3.jar 2023-12-03T11:51:27.807 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/httpcore-4.4.12.jar 2023-12-03T11:51:27.807 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jcommander-1.72.jar 2023-12-03T11:51:27.808 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jzlib-1.1.3.jar 2023-12-03T11:51:27.809 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-artifact-3.0.4.jar 2023-12-03T11:51:27.809 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-model-builder-3.0.4.jar 2023-12-03T11:51:27.811 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-model-3.0.4.jar 2023-12-03T11:51:27.811 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-repository-metadata-3.0.4.jar 2023-12-03T11:51:27.812 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-settings-builder-3.0.4.jar 2023-12-03T11:51:27.812 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-settings-3.0.4.jar 2023-12-03T11:51:27.812 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-sec-dispatcher-1.3.jar 2023-12-03T11:51:27.812 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-cipher-1.7.jar 2023-12-03T11:51:27.813 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-classworlds-2.5.1.jar 2023-12-03T11:51:27.813 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-component-annotations-1.5.5.jar 2023-12-03T11:51:27.813 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-interpolation-1.14.jar 2023-12-03T11:51:27.813 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-provider-api-3.0.0.jar 2023-12-03T11:51:27.815 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-utils-3.1.0.jar 2023-12-03T11:51:27.816 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/xbean-reflect-3.7.jar 2023-12-03T11:51:27.820 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/ion-java-1.0.2.jar 2023-12-03T11:51:27.821 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-engine-1.3.1.jar 2023-12-03T11:51:27.822 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-commons-1.3.1.jar 2023-12-03T11:51:27.822 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/apiguardian-api-1.0.0.jar 2023-12-03T11:51:27.822 INFO:teuthology.orchestra.run.smithi003.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/opentest4j-1.1.1.jar 2023-12-03T11:51:27.869 INFO:teuthology.orchestra.run.smithi003.stdout:export PATH=/opt/gradle/gradle-6.0.1/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin 2023-12-03T11:51:28.213 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:51:28.213 INFO:teuthology.orchestra.run.smithi003.stdout:Welcome to Gradle 6.0.1! 2023-12-03T11:51:28.213 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:51:28.213 INFO:teuthology.orchestra.run.smithi003.stdout:Here are the highlights of this release: 2023-12-03T11:51:28.213 INFO:teuthology.orchestra.run.smithi003.stdout: - Substantial improvements in dependency management, including 2023-12-03T11:51:28.213 INFO:teuthology.orchestra.run.smithi003.stdout: - Publishing Gradle Module Metadata in addition to pom.xml 2023-12-03T11:51:28.213 INFO:teuthology.orchestra.run.smithi003.stdout: - Advanced control of transitive versions 2023-12-03T11:51:28.214 INFO:teuthology.orchestra.run.smithi003.stdout: - Support for optional features and dependencies 2023-12-03T11:51:28.214 INFO:teuthology.orchestra.run.smithi003.stdout: - Rules to tweak published metadata 2023-12-03T11:51:28.214 INFO:teuthology.orchestra.run.smithi003.stdout: - Support for Java 13 2023-12-03T11:51:28.214 INFO:teuthology.orchestra.run.smithi003.stdout: - Faster incremental Java and Groovy compilation 2023-12-03T11:51:28.214 INFO:teuthology.orchestra.run.smithi003.stdout: - New Zinc compiler for Scala 2023-12-03T11:51:28.214 INFO:teuthology.orchestra.run.smithi003.stdout: - VS2019 support 2023-12-03T11:51:28.214 INFO:teuthology.orchestra.run.smithi003.stdout: - Support for Gradle Enterprise plugin 3.0 2023-12-03T11:51:28.214 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:51:28.214 INFO:teuthology.orchestra.run.smithi003.stdout:For more details see https://docs.gradle.org/6.0.1/release-notes.html 2023-12-03T11:51:28.214 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:51:28.214 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:51:28.214 INFO:teuthology.orchestra.run.smithi003.stdout:------------------------------------------------------------ 2023-12-03T11:51:28.214 INFO:teuthology.orchestra.run.smithi003.stdout:Gradle 6.0.1 2023-12-03T11:51:28.214 INFO:teuthology.orchestra.run.smithi003.stdout:------------------------------------------------------------ 2023-12-03T11:51:28.215 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:51:28.215 INFO:teuthology.orchestra.run.smithi003.stdout:Build time: 2019-11-18 20:25:01 UTC 2023-12-03T11:51:28.215 INFO:teuthology.orchestra.run.smithi003.stdout:Revision: fad121066a68c4701acd362daf4287a7c309a0f5 2023-12-03T11:51:28.215 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:51:28.215 INFO:teuthology.orchestra.run.smithi003.stdout:Kotlin: 1.3.50 2023-12-03T11:51:28.215 INFO:teuthology.orchestra.run.smithi003.stdout:Groovy: 2.5.8 2023-12-03T11:51:28.215 INFO:teuthology.orchestra.run.smithi003.stdout:Ant: Apache Ant(TM) version 1.10.7 compiled on September 1 2019 2023-12-03T11:51:28.215 INFO:teuthology.orchestra.run.smithi003.stdout:JVM: 1.8.0_362 (Red Hat, Inc. 25.362-b08) 2023-12-03T11:51:28.215 INFO:teuthology.orchestra.run.smithi003.stdout:OS: Linux 5.14.0-388.el9.x86_64 amd64 2023-12-03T11:51:28.215 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:51:28.216 DEBUG:tasks.s3tests_java:S3 Tests Java: BEGIN 2023-12-03T11:51:28.216 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2023-12-03T11:51:28.216 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi003.front.sepia.ceph.com 2023-12-03T11:51:28.216 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2023-12-03T11:51:28.216 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi037.front.sepia.ceph.com 2023-12-03T11:51:28.217 INFO:tasks.s3tests_java:S3 Tests Java: Creating S3 users... 2023-12-03T11:51:28.536 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf is {'bucket_prefix': 'test-', 's3main': {'access_key': None, 'access_secret': None, 'region': 'mexico', 'endpoint': None, 'port': None, 'display_name': None, 'email': None, 'is_secure': None, 'SSE': 'AES256', 's3dir': 'folder', 'dir': '../data'}} 2023-12-03T11:51:28.537 DEBUG:tasks.s3tests_java:S3 Tests Java: Creating user tester.client.0 2023-12-03T11:51:28.537 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf[s3main] is {'access_key': 'MBPYNDHUSQXVXWZSWATU', 'access_secret': 'xU4EItUJttn/PZvtXmgWHeWYx1ONwnLIxEfvygUplaLIR25uzNL4OQ==', 'region': 'mexico', 'endpoint': 'smithi003.front.sepia.ceph.com:80', 'port': 80, 'display_name': 'Ms. tester.client.0', 'email': 'tester.client.0_test@test.test', 'is_secure': False, 'SSE': 'AES256', 's3dir': 'folder', 'dir': '../data', 'user_id': 'tester.client.0', 'host': 'smithi003.front.sepia.ceph.com'} 2023-12-03T11:51:28.537 DEBUG:tasks.s3tests_java:S3 Tests Java: Setion, User = s3main, tester.client.0 2023-12-03T11:51:28.537 INFO:tasks.s3tests_java:['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '-n', 'client.0', 'user', 'create', '--uid', 'tester.client.0', '--display-name', 'Ms. tester.client.0', '--access-key', 'MBPYNDHUSQXVXWZSWATU', '--secret', 'xU4EItUJttn/PZvtXmgWHeWYx1ONwnLIxEfvygUplaLIR25uzNL4OQ==', '--email', 'tester.client.0_test@test.test', '--cluster', 'ceph'] 2023-12-03T11:51:28.537 DEBUG:teuthology.orchestra.run.smithi003:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid tester.client.0 --display-name 'Ms. tester.client.0' --access-key MBPYNDHUSQXVXWZSWATU --secret xU4EItUJttn/PZvtXmgWHeWYx1ONwnLIxEfvygUplaLIR25uzNL4OQ== --email tester.client.0_test@test.test --cluster ceph 2023-12-03T11:51:28.600 INFO:teuthology.orchestra.run.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:51:28.600 INFO:teuthology.orchestra.run.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:51:28.612 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.611+0000 7fc109711800 20 rados->read ofs=0 len=0 2023-12-03T11:51:28.614 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.613+0000 7fc109711800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:51:28.614 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.613+0000 7fc109711800 20 realm 2023-12-03T11:51:28.614 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.613+0000 7fc109711800 20 rados->read ofs=0 len=0 2023-12-03T11:51:28.614 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.613+0000 7fc109711800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:51:28.614 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.613+0000 7fc109711800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:51:28.614 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.613+0000 7fc109711800 20 rados->read ofs=0 len=0 2023-12-03T11:51:28.615 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.613+0000 7fc109711800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:51:28.615 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.613+0000 7fc109711800 20 rados->read ofs=0 len=0 2023-12-03T11:51:28.615 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.614+0000 7fc109711800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:51:28.615 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.614+0000 7fc109711800 20 rados->read ofs=0 len=0 2023-12-03T11:51:28.616 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.614+0000 7fc109711800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:51:28.616 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.614+0000 7fc109711800 20 searching for the correct realm 2023-12-03T11:51:28.627 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.626+0000 7fc107218640 0 -- 172.21.15.3:0/2089589531 >> [v2:172.21.15.37:6805/1692844418,v1:172.21.15.37:6807/1692844418] conn(0x558639bf4a30 msgr2=0x558639bf6e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:51:28.629 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.627+0000 7fc109711800 20 RGWRados::pool_iterate: got zone_info.83aabb46-04b5-4c96-9933-c6bfb1173a73 2023-12-03T11:51:28.629 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.627+0000 7fc109711800 20 RGWRados::pool_iterate: got zonegroup_info.6a811aad-435d-4fdd-93c9-b7e0b50de429 2023-12-03T11:51:28.629 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.627+0000 7fc109711800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:51:28.629 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.627+0000 7fc109711800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:51:28.629 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.627+0000 7fc109711800 20 rados->read ofs=0 len=0 2023-12-03T11:51:28.629 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.627+0000 7fc109711800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:51:28.629 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.627+0000 7fc109711800 20 rados->read ofs=0 len=0 2023-12-03T11:51:28.630 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.628+0000 7fc109711800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:51:28.630 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.628+0000 7fc109711800 20 rados->read ofs=0 len=0 2023-12-03T11:51:28.631 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.628+0000 7fc109711800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:51:28.631 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.628+0000 7fc109711800 20 zone default found 2023-12-03T11:51:28.631 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.628+0000 7fc109711800 4 Realm: () 2023-12-03T11:51:28.631 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.628+0000 7fc109711800 4 ZoneGroup: default (6a811aad-435d-4fdd-93c9-b7e0b50de429) 2023-12-03T11:51:28.631 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.628+0000 7fc109711800 4 Zone: default (83aabb46-04b5-4c96-9933-c6bfb1173a73) 2023-12-03T11:51:28.631 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.628+0000 7fc109711800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:51:28.631 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.628+0000 7fc109711800 20 zonegroup default 2023-12-03T11:51:28.631 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.628+0000 7fc109711800 20 rados->read ofs=0 len=0 2023-12-03T11:51:28.631 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.628+0000 7fc109711800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:51:28.631 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.628+0000 7fc109711800 20 rados->read ofs=0 len=0 2023-12-03T11:51:28.631 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.629+0000 7fc109711800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:51:28.631 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.629+0000 7fc109711800 20 rados->read ofs=0 len=0 2023-12-03T11:51:28.632 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.629+0000 7fc109711800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:51:28.632 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.629+0000 7fc109711800 20 started sync module instance, tier type = 2023-12-03T11:51:28.632 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.629+0000 7fc109711800 20 started zone id=83aabb46-04b5-4c96-9933-c6bfb1173a73 (name=default) with tier type = 2023-12-03T11:51:28.637 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.636+0000 7fc0fea17640 0 -- 172.21.15.3:0/2089589531 >> [v2:172.21.15.3:6817/3356208405,v1:172.21.15.3:6819/3356208405] conn(0x558639bf9b10 msgr2=0x558639bfbf00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-03T11:51:28.641 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.639+0000 7fc109711800 20 add_watcher() i=0 2023-12-03T11:51:28.641 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.639+0000 7fc109711800 20 add_watcher() i=1 2023-12-03T11:51:28.641 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.639+0000 7fc109711800 20 add_watcher() i=2 2023-12-03T11:51:28.641 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.639+0000 7fc109711800 20 add_watcher() i=3 2023-12-03T11:51:28.641 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.639+0000 7fc109711800 20 add_watcher() i=4 2023-12-03T11:51:28.641 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.639+0000 7fc109711800 20 add_watcher() i=5 2023-12-03T11:51:28.641 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.639+0000 7fc109711800 20 add_watcher() i=6 2023-12-03T11:51:28.641 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.640+0000 7fc109711800 20 add_watcher() i=7 2023-12-03T11:51:28.641 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.640+0000 7fc109711800 2 all 8 watchers are set, enabling cache 2023-12-03T11:51:28.643 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.642+0000 7fc0cd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:51:28.643 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.642+0000 7fc109711800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:51:28.643 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.642+0000 7fc109711800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:51:28.649 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.647+0000 7fc109711800 5 note: GC not initialized 2023-12-03T11:51:28.649 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.647+0000 7fc03bfff640 20 reqs_thread_entry: start 2023-12-03T11:51:28.649 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.647+0000 7fc109711800 20 init_complete bucket index max shards: 11 2023-12-03T11:51:28.649 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.647+0000 7fc109711800 20 Filter name: none 2023-12-03T11:51:28.649 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.647+0000 7fc039ffb640 20 reqs_thread_entry: start 2023-12-03T11:51:28.649 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.647+0000 7fc109711800 10 cache get: name=default.rgw.meta+users.uid+tester.client.0 : miss 2023-12-03T11:51:28.649 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.647+0000 7fc109711800 20 rados->read ofs=0 len=0 2023-12-03T11:51:28.650 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.648+0000 7fc109711800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:51:28.650 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.648+0000 7fc109711800 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x0 2023-12-03T11:51:28.650 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.648+0000 7fc109711800 10 adding default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2023-12-03T11:51:28.650 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.648+0000 7fc109711800 10 cache get: name=default.rgw.meta+users.email+tester.client.0_test@test.test : miss 2023-12-03T11:51:28.651 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.648+0000 7fc109711800 20 rados->read ofs=0 len=0 2023-12-03T11:51:28.651 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.648+0000 7fc109711800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:51:28.651 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.648+0000 7fc109711800 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x0 2023-12-03T11:51:28.651 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.648+0000 7fc109711800 10 adding default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2023-12-03T11:51:28.651 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.648+0000 7fc109711800 10 cache get: name=default.rgw.meta+users.keys+MBPYNDHUSQXVXWZSWATU : miss 2023-12-03T11:51:28.651 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.648+0000 7fc109711800 20 rados->read ofs=0 len=0 2023-12-03T11:51:28.651 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.648+0000 7fc109711800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:51:28.651 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.648+0000 7fc109711800 10 cache put: name=default.rgw.meta+users.keys+MBPYNDHUSQXVXWZSWATU info.flags=0x0 2023-12-03T11:51:28.651 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.648+0000 7fc109711800 10 adding default.rgw.meta+users.keys+MBPYNDHUSQXVXWZSWATU to cache LRU end 2023-12-03T11:51:28.651 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.648+0000 7fc109711800 10 cache get: name=default.rgw.meta+users.keys+MBPYNDHUSQXVXWZSWATU : hit (negative entry) 2023-12-03T11:51:28.651 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.648+0000 7fc109711800 10 cache get: name=default.rgw.meta+users.keys+MBPYNDHUSQXVXWZSWATU : hit (negative entry) 2023-12-03T11:51:28.652 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.650+0000 7fc109711800 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2023-12-03T11:51:28.652 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.650+0000 7fc109711800 10 moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2023-12-03T11:51:28.652 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.650+0000 7fc109711800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.uid:tester.client.0, ofs0, ns] 2023-12-03T11:51:28.652 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.650+0000 7fc0fda15640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660583 cookie 94034982854480 notifier 7758 bl.length()=636 2023-12-03T11:51:28.652 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.650+0000 7fc0fda15640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2023-12-03T11:51:28.652 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.650+0000 7fc0fda15640 10 rgw watcher librados: moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2023-12-03T11:51:28.654 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.653+0000 7fc109711800 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2023-12-03T11:51:28.654 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.653+0000 7fc109711800 10 moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2023-12-03T11:51:28.654 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.653+0000 7fc109711800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:tester.client.0_test@test.test, ofs0, ns] 2023-12-03T11:51:28.655 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.653+0000 7fc0fda15640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660521 cookie 94034982857040 notifier 7758 bl.length()=200 2023-12-03T11:51:28.655 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.653+0000 7fc0fda15640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2023-12-03T11:51:28.655 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.653+0000 7fc0fda15640 10 rgw watcher librados: moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2023-12-03T11:51:28.657 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.656+0000 7fc109711800 10 cache put: name=default.rgw.meta+users.keys+MBPYNDHUSQXVXWZSWATU info.flags=0x7 2023-12-03T11:51:28.658 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.656+0000 7fc109711800 10 moving default.rgw.meta+users.keys+MBPYNDHUSQXVXWZSWATU to cache LRU end 2023-12-03T11:51:28.658 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.656+0000 7fc109711800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.keys:MBPYNDHUSQXVXWZSWATU, ofs0, ns] 2023-12-03T11:51:28.658 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.656+0000 7fc0fda15640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660549 cookie 94034980372304 notifier 7758 bl.length()=189 2023-12-03T11:51:28.658 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.656+0000 7fc0fda15640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+MBPYNDHUSQXVXWZSWATU info.flags=0x7 2023-12-03T11:51:28.658 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.656+0000 7fc0fda15640 10 rgw watcher librados: moving default.rgw.meta+users.keys+MBPYNDHUSQXVXWZSWATU to cache LRU end 2023-12-03T11:51:28.659 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2023-12-03T11:51:28.659 INFO:teuthology.orchestra.run.smithi003.stdout: "user_id": "tester.client.0", 2023-12-03T11:51:28.659 INFO:teuthology.orchestra.run.smithi003.stdout: "display_name": "Ms. tester.client.0", 2023-12-03T11:51:28.659 INFO:teuthology.orchestra.run.smithi003.stdout: "email": "tester.client.0_test@test.test", 2023-12-03T11:51:28.659 INFO:teuthology.orchestra.run.smithi003.stdout: "suspended": 0, 2023-12-03T11:51:28.659 INFO:teuthology.orchestra.run.smithi003.stdout: "max_buckets": 1000, 2023-12-03T11:51:28.659 INFO:teuthology.orchestra.run.smithi003.stdout: "subusers": [], 2023-12-03T11:51:28.660 INFO:teuthology.orchestra.run.smithi003.stdout: "keys": [ 2023-12-03T11:51:28.660 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-12-03T11:51:28.660 INFO:teuthology.orchestra.run.smithi003.stdout: "user": "tester.client.0", 2023-12-03T11:51:28.660 INFO:teuthology.orchestra.run.smithi003.stdout: "access_key": "MBPYNDHUSQXVXWZSWATU", 2023-12-03T11:51:28.660 INFO:teuthology.orchestra.run.smithi003.stdout: "secret_key": "xU4EItUJttn/PZvtXmgWHeWYx1ONwnLIxEfvygUplaLIR25uzNL4OQ==" 2023-12-03T11:51:28.660 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-12-03T11:51:28.660 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2023-12-03T11:51:28.660 INFO:teuthology.orchestra.run.smithi003.stdout: "swift_keys": [], 2023-12-03T11:51:28.660 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": [], 2023-12-03T11:51:28.660 INFO:teuthology.orchestra.run.smithi003.stdout: "op_mask": "read, write, delete", 2023-12-03T11:51:28.660 INFO:teuthology.orchestra.run.smithi003.stdout: "default_placement": "", 2023-12-03T11:51:28.660 INFO:teuthology.orchestra.run.smithi003.stdout: "default_storage_class": "", 2023-12-03T11:51:28.661 INFO:teuthology.orchestra.run.smithi003.stdout: "placement_tags": [], 2023-12-03T11:51:28.661 INFO:teuthology.orchestra.run.smithi003.stdout: "bucket_quota": { 2023-12-03T11:51:28.661 INFO:teuthology.orchestra.run.smithi003.stdout: "enabled": false, 2023-12-03T11:51:28.661 INFO:teuthology.orchestra.run.smithi003.stdout: "check_on_raw": false, 2023-12-03T11:51:28.661 INFO:teuthology.orchestra.run.smithi003.stdout: "max_size": -1, 2023-12-03T11:51:28.661 INFO:teuthology.orchestra.run.smithi003.stdout: "max_size_kb": 0, 2023-12-03T11:51:28.661 INFO:teuthology.orchestra.run.smithi003.stdout: "max_objects": -1 2023-12-03T11:51:28.661 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-12-03T11:51:28.661 INFO:teuthology.orchestra.run.smithi003.stdout: "user_quota": { 2023-12-03T11:51:28.661 INFO:teuthology.orchestra.run.smithi003.stdout: "enabled": false, 2023-12-03T11:51:28.661 INFO:teuthology.orchestra.run.smithi003.stdout: "check_on_raw": false, 2023-12-03T11:51:28.661 INFO:teuthology.orchestra.run.smithi003.stdout: "max_size": -1, 2023-12-03T11:51:28.661 INFO:teuthology.orchestra.run.smithi003.stdout: "max_size_kb": 0, 2023-12-03T11:51:28.661 INFO:teuthology.orchestra.run.smithi003.stdout: "max_objects": -1 2023-12-03T11:51:28.661 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-12-03T11:51:28.661 INFO:teuthology.orchestra.run.smithi003.stdout: "temp_url_keys": [], 2023-12-03T11:51:28.661 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "rgw", 2023-12-03T11:51:28.662 INFO:teuthology.orchestra.run.smithi003.stdout: "mfa_ids": [] 2023-12-03T11:51:28.662 INFO:teuthology.orchestra.run.smithi003.stdout:} 2023-12-03T11:51:28.662 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:51:28.662 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.659+0000 7fc0cd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:51:28.662 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.661+0000 7fc109711800 20 remove_watcher() i=0 2023-12-03T11:51:28.663 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.661+0000 7fc109711800 2 removed watcher, disabling cache 2023-12-03T11:51:28.664 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.663+0000 7fc109711800 20 remove_watcher() i=1 2023-12-03T11:51:28.665 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.664+0000 7fc109711800 20 remove_watcher() i=2 2023-12-03T11:51:28.666 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.665+0000 7fc109711800 20 remove_watcher() i=3 2023-12-03T11:51:28.668 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.666+0000 7fc109711800 20 remove_watcher() i=4 2023-12-03T11:51:28.668 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.667+0000 7fc109711800 20 remove_watcher() i=5 2023-12-03T11:51:28.669 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.668+0000 7fc109711800 20 remove_watcher() i=6 2023-12-03T11:51:28.670 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.669+0000 7fc109711800 20 remove_watcher() i=7 2023-12-03T11:51:28.677 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-12-03T11:51:28.677 DEBUG:teuthology.orchestra.run.smithi003:> dd of=/home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf 2023-12-03T11:51:28.707 INFO:tasks.s3tests_java:S3 Tests Java: Running tests... 2023-12-03T11:51:28.707 DEBUG:teuthology.orchestra.run.smithi003:> cp /home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf /home/ubuntu/cephtest/s3-tests-java/config.properties 2023-12-03T11:51:28.773 DEBUG:teuthology.orchestra.run.smithi003:> radosgw-admin gc process --include-all 2023-12-03T11:51:28.865 INFO:teuthology.orchestra.run.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:51:28.865 INFO:teuthology.orchestra.run.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:51:28.879 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.878+0000 7fc506ee4800 20 rados->read ofs=0 len=0 2023-12-03T11:51:28.881 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.879+0000 7fc506ee4800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:51:28.881 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.879+0000 7fc506ee4800 20 realm 2023-12-03T11:51:28.881 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.879+0000 7fc506ee4800 20 rados->read ofs=0 len=0 2023-12-03T11:51:28.881 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.879+0000 7fc506ee4800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:51:28.881 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.880+0000 7fc506ee4800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:51:28.881 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.880+0000 7fc506ee4800 20 rados->read ofs=0 len=0 2023-12-03T11:51:28.881 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.880+0000 7fc506ee4800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:51:28.881 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.880+0000 7fc506ee4800 20 rados->read ofs=0 len=0 2023-12-03T11:51:28.882 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.881+0000 7fc506ee4800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:51:28.882 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.881+0000 7fc506ee4800 20 rados->read ofs=0 len=0 2023-12-03T11:51:28.882 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.881+0000 7fc506ee4800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:51:28.882 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.881+0000 7fc506ee4800 20 searching for the correct realm 2023-12-03T11:51:28.893 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.892+0000 7fc5049eb640 0 -- 172.21.15.3:0/3706651050 >> [v2:172.21.15.37:6805/1692844418,v1:172.21.15.37:6807/1692844418] conn(0x5597f4715700 msgr2=0x5597f4717b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:51:28.896 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.894+0000 7fc506ee4800 20 RGWRados::pool_iterate: got zone_info.83aabb46-04b5-4c96-9933-c6bfb1173a73 2023-12-03T11:51:28.896 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.894+0000 7fc506ee4800 20 RGWRados::pool_iterate: got zonegroup_info.6a811aad-435d-4fdd-93c9-b7e0b50de429 2023-12-03T11:51:28.896 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.894+0000 7fc506ee4800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:51:28.896 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.894+0000 7fc506ee4800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:51:28.896 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.894+0000 7fc506ee4800 20 rados->read ofs=0 len=0 2023-12-03T11:51:28.896 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.895+0000 7fc506ee4800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:51:28.896 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.895+0000 7fc506ee4800 20 rados->read ofs=0 len=0 2023-12-03T11:51:28.897 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.895+0000 7fc506ee4800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:51:28.897 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.895+0000 7fc506ee4800 20 rados->read ofs=0 len=0 2023-12-03T11:51:28.897 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.895+0000 7fc506ee4800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:51:28.897 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.895+0000 7fc506ee4800 20 zone default found 2023-12-03T11:51:28.898 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.895+0000 7fc506ee4800 4 Realm: () 2023-12-03T11:51:28.898 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.895+0000 7fc506ee4800 4 ZoneGroup: default (6a811aad-435d-4fdd-93c9-b7e0b50de429) 2023-12-03T11:51:28.898 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.895+0000 7fc506ee4800 4 Zone: default (83aabb46-04b5-4c96-9933-c6bfb1173a73) 2023-12-03T11:51:28.898 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.895+0000 7fc506ee4800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:51:28.898 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.895+0000 7fc506ee4800 20 zonegroup default 2023-12-03T11:51:28.898 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.895+0000 7fc506ee4800 20 rados->read ofs=0 len=0 2023-12-03T11:51:28.898 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.896+0000 7fc506ee4800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:51:28.898 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.896+0000 7fc506ee4800 20 rados->read ofs=0 len=0 2023-12-03T11:51:28.898 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.896+0000 7fc506ee4800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:51:28.898 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.896+0000 7fc506ee4800 20 rados->read ofs=0 len=0 2023-12-03T11:51:28.899 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.896+0000 7fc506ee4800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:51:28.899 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.896+0000 7fc506ee4800 20 started sync module instance, tier type = 2023-12-03T11:51:28.899 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.896+0000 7fc506ee4800 20 started zone id=83aabb46-04b5-4c96-9933-c6bfb1173a73 (name=default) with tier type = 2023-12-03T11:51:28.904 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.903+0000 7fc5051ec640 0 -- 172.21.15.3:0/3706651050 >> [v2:172.21.15.37:6816/3770469300,v1:172.21.15.37:6818/3770469300] conn(0x7fc4ec053030 msgr2=0x7fc4ec07b930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:51:28.907 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.906+0000 7fc506ee4800 20 add_watcher() i=0 2023-12-03T11:51:28.907 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.906+0000 7fc506ee4800 20 add_watcher() i=1 2023-12-03T11:51:28.907 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.906+0000 7fc506ee4800 20 add_watcher() i=2 2023-12-03T11:51:28.907 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.906+0000 7fc506ee4800 20 add_watcher() i=3 2023-12-03T11:51:28.907 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.906+0000 7fc506ee4800 20 add_watcher() i=4 2023-12-03T11:51:28.908 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.906+0000 7fc506ee4800 20 add_watcher() i=5 2023-12-03T11:51:28.908 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.906+0000 7fc506ee4800 20 add_watcher() i=6 2023-12-03T11:51:28.908 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.907+0000 7fc506ee4800 20 add_watcher() i=7 2023-12-03T11:51:28.908 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.907+0000 7fc506ee4800 2 all 8 watchers are set, enabling cache 2023-12-03T11:51:28.909 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.908+0000 7fc4cb7de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:51:28.910 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.909+0000 7fc506ee4800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:51:28.910 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.909+0000 7fc506ee4800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:51:28.957 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.956+0000 7fc43a7fc640 20 reqs_thread_entry: start 2023-12-03T11:51:28.957 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.956+0000 7fc506ee4800 20 init_complete bucket index max shards: 11 2023-12-03T11:51:28.958 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.956+0000 7fc506ee4800 20 Filter name: none 2023-12-03T11:51:28.958 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.956+0000 7fc42bfff640 20 reqs_thread_entry: start 2023-12-03T11:51:28.958 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.956+0000 7fc506ee4800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2023-12-03T11:51:28.959 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.957+0000 7fc506ee4800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:51:28.959 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.958+0000 7fc506ee4800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:51:28.960 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.959+0000 7fc506ee4800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2023-12-03T11:51:28.960 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.959+0000 7fc506ee4800 20 garbage collection: RGWGC::process iterating over entry tag='_YWN7L_Kved_4JzNBzeeeI4rQKVsNV2c', time=2023-12-03T13:46:32.441140+0000, chain.objs.size()=1 2023-12-03T11:51:28.960 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.959+0000 7fc506ee4800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.15__shadow_.oe9f8h1X-qpqdIMqG4dP3rQmLo4Juce_0 2023-12-03T11:51:28.962 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.961+0000 7fc506ee4800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:51:28.964 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.963+0000 7fc506ee4800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2023-12-03T11:51:28.966 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.965+0000 7fc506ee4800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:51:28.966 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.965+0000 7fc506ee4800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:51:28.967 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.965+0000 7fc506ee4800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2023-12-03T11:51:28.967 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.965+0000 7fc506ee4800 20 garbage collection: RGWGC::process iterating over entry tag='83aabb46-04b5-4c96-9933-c6bfb1173a73.4653.6330433953757923101', time=2023-12-03T13:46:32.320734+0000, chain.objs.size()=4 2023-12-03T11:51:28.967 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.965+0000 7fc506ee4800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.11__multipart_foo.2~qkA7ZYfxuexf4tghDkAqIXQJJhybeS-.1 2023-12-03T11:51:28.967 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.965+0000 7fc506ee4800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.11__multipart_foo.2~qkA7ZYfxuexf4tghDkAqIXQJJhybeS-.2 2023-12-03T11:51:28.967 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.965+0000 7fc506ee4800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.11__multipart_foo.2~qkA7ZYfxuexf4tghDkAqIXQJJhybeS-.3 2023-12-03T11:51:28.967 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.965+0000 7fc506ee4800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.11__multipart_foo.2~qkA7ZYfxuexf4tghDkAqIXQJJhybeS-.4 2023-12-03T11:51:28.969 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.968+0000 7fc506ee4800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:51:28.971 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.970+0000 7fc506ee4800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2023-12-03T11:51:28.972 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.971+0000 7fc506ee4800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:51:28.973 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.972+0000 7fc506ee4800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:51:28.973 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.972+0000 7fc506ee4800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2023-12-03T11:51:28.973 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.972+0000 7fc506ee4800 20 garbage collection: RGWGC::process iterating over entry tag='83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.15__shadow_.88BgYbQ6UQ_BiDcPq7CdPYxSdGA-0bD_1_d359be3642d7c9dee3007f1e14ed5453', time=2023-12-03T13:46:32.466060+0000, chain.objs.size()=1 2023-12-03T11:51:28.973 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.972+0000 7fc506ee4800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.15__shadow_.88BgYbQ6UQ_BiDcPq7CdPYxSdGA-0bD_0 2023-12-03T11:51:28.974 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.973+0000 7fc506ee4800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:51:28.976 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.975+0000 7fc506ee4800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2023-12-03T11:51:28.978 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.976+0000 7fc506ee4800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:51:28.980 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.977+0000 7fc506ee4800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:51:28.980 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.978+0000 7fc506ee4800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2023-12-03T11:51:28.980 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.978+0000 7fc506ee4800 20 garbage collection: RGWGC::process iterating over entry tag='83aabb46-04b5-4c96-9933-c6bfb1173a73.4653.10348991387330289336', time=2023-12-03T13:46:32.511679+0000, chain.objs.size()=3 2023-12-03T11:51:28.980 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.978+0000 7fc506ee4800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.16__multipart_foo-FROZEN.2~4YRdtSB53jf2C5eZb9-7M90nDB43zQo.1 2023-12-03T11:51:28.980 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.978+0000 7fc506ee4800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.16__multipart_foo-FROZEN.2~4YRdtSB53jf2C5eZb9-7M90nDB43zQo.2 2023-12-03T11:51:28.980 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.978+0000 7fc506ee4800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.16__multipart_foo-FROZEN.2~4YRdtSB53jf2C5eZb9-7M90nDB43zQo.3 2023-12-03T11:51:28.981 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.978+0000 7fc506ee4800 20 garbage collection: RGWGC::process iterating over entry tag='83aabb46-04b5-4c96-9933-c6bfb1173a73.4653.2929520179933456401', time=2023-12-03T13:46:32.578428+0000, chain.objs.size()=3 2023-12-03T11:51:28.981 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.978+0000 7fc506ee4800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.14__multipart_foo-FROZEN.2~MTDqLPi4VuwT2h1ItzjWXaJqcnW9pPj.1 2023-12-03T11:51:28.981 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.978+0000 7fc506ee4800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.14__multipart_foo-FROZEN.2~MTDqLPi4VuwT2h1ItzjWXaJqcnW9pPj.2 2023-12-03T11:51:28.981 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.978+0000 7fc506ee4800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.14__multipart_foo-FROZEN.2~MTDqLPi4VuwT2h1ItzjWXaJqcnW9pPj.3 2023-12-03T11:51:28.982 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.981+0000 7fc506ee4800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:51:28.984 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.983+0000 7fc506ee4800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2023-12-03T11:51:28.985 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.984+0000 7fc506ee4800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:51:28.986 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.985+0000 7fc506ee4800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:51:28.987 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.985+0000 7fc506ee4800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2023-12-03T11:51:28.987 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.985+0000 7fc506ee4800 20 garbage collection: RGWGC::process iterating over entry tag='83aabb46-04b5-4c96-9933-c6bfb1173a73.4653.11781301567546197555', time=2023-12-03T13:46:32.374054+0000, chain.objs.size()=4 2023-12-03T11:51:28.987 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.985+0000 7fc506ee4800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.10__multipart_foo.2~T1VF383YWvBksFoytEV8A3pXaA-SYRt.1 2023-12-03T11:51:28.988 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.985+0000 7fc506ee4800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.10__multipart_foo.2~T1VF383YWvBksFoytEV8A3pXaA-SYRt.2 2023-12-03T11:51:28.988 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.985+0000 7fc506ee4800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.10__multipart_foo.2~T1VF383YWvBksFoytEV8A3pXaA-SYRt.3 2023-12-03T11:51:28.988 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.985+0000 7fc506ee4800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.10__multipart_foo.2~T1VF383YWvBksFoytEV8A3pXaA-SYRt.4 2023-12-03T11:51:28.988 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.985+0000 7fc506ee4800 20 garbage collection: RGWGC::process iterating over entry tag='_m6AtA0gPXXzrczVkBGfY2tS3jG2TSeD', time=2023-12-03T13:46:32.428131+0000, chain.objs.size()=1 2023-12-03T11:51:28.988 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.985+0000 7fc506ee4800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.15__shadow_.lQ6eXKE7ecAN9NQibyzAxLa62XAr7aI_0 2023-12-03T11:51:28.989 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.987+0000 7fc506ee4800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:51:28.991 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.990+0000 7fc506ee4800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2023-12-03T11:51:28.992 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.991+0000 7fc506ee4800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:51:28.993 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.991+0000 7fc506ee4800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:51:28.993 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.992+0000 7fc506ee4800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2023-12-03T11:51:28.993 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.992+0000 7fc506ee4800 20 garbage collection: RGWGC::process iterating over entry tag='_En7bxfrO2DjvBMmU2O1vyyhm0KbZEMU', time=2023-12-03T13:46:32.520299+0000, chain.objs.size()=2 2023-12-03T11:51:28.994 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.992+0000 7fc506ee4800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.16__shadow_.I_kGVcyvhVsNw_xrTwns71lEG02DXbl_0 2023-12-03T11:51:28.994 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.992+0000 7fc506ee4800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.16__shadow_.I_kGVcyvhVsNw_xrTwns71lEG02DXbl_1 2023-12-03T11:51:28.997 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.996+0000 7fc506ee4800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:51:28.999 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.998+0000 7fc506ee4800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2023-12-03T11:51:29.000 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:28.999+0000 7fc506ee4800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:51:29.001 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.000+0000 7fc506ee4800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:51:29.001 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.000+0000 7fc506ee4800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2023-12-03T11:51:29.001 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.000+0000 7fc506ee4800 20 garbage collection: RGWGC::process iterating over entry tag='_ZClSMph25bCqPWF1VPVRYK_4PK4e3LQ', time=2023-12-03T13:46:32.531332+0000, chain.objs.size()=2 2023-12-03T11:51:29.002 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.000+0000 7fc506ee4800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.16__shadow_.YBxNTAk9JU6gqA86xR-FBEy7ZFza5Ph_1 2023-12-03T11:51:29.002 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.000+0000 7fc506ee4800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.16__shadow_.YBxNTAk9JU6gqA86xR-FBEy7ZFza5Ph_2 2023-12-03T11:51:29.002 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.000+0000 7fc506ee4800 20 garbage collection: RGWGC::process iterating over entry tag='83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.16__multipart_foo-STANDARD.2~vlfDWI-vv3RhE217kuvJVo_qOJBj_Sx.2_42d279f30963775c303ba66607dd32af', time=2023-12-03T13:46:32.541238+0000, chain.objs.size()=3 2023-12-03T11:51:29.002 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.000+0000 7fc506ee4800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.16__multipart_foo-STANDARD.2~vlfDWI-vv3RhE217kuvJVo_qOJBj_Sx.1 2023-12-03T11:51:29.002 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.000+0000 7fc506ee4800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.16__multipart_foo-STANDARD.2~vlfDWI-vv3RhE217kuvJVo_qOJBj_Sx.2 2023-12-03T11:51:29.002 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.000+0000 7fc506ee4800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.16__multipart_foo-STANDARD.2~vlfDWI-vv3RhE217kuvJVo_qOJBj_Sx.3 2023-12-03T11:51:29.006 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.005+0000 7fc506ee4800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:51:29.008 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.007+0000 7fc506ee4800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2023-12-03T11:51:29.010 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.009+0000 7fc506ee4800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:51:29.010 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.009+0000 7fc506ee4800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:51:29.010 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.009+0000 7fc506ee4800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:51:29.011 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.010+0000 7fc506ee4800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2023-12-03T11:51:29.013 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.012+0000 7fc506ee4800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:51:29.013 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.012+0000 7fc506ee4800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:51:29.014 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.013+0000 7fc506ee4800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:51:29.015 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.014+0000 7fc506ee4800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2023-12-03T11:51:29.016 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.015+0000 7fc506ee4800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:51:29.017 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.016+0000 7fc506ee4800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:51:29.018 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.016+0000 7fc506ee4800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2023-12-03T11:51:29.018 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.016+0000 7fc506ee4800 20 garbage collection: RGWGC::process iterating over entry tag='83aabb46-04b5-4c96-9933-c6bfb1173a73.4653.15542755290438594238', time=2023-12-03T13:46:32.458685+0000, chain.objs.size()=1 2023-12-03T11:51:29.018 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.016+0000 7fc506ee4800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.15__shadow_.88BgYbQ6UQ_BiDcPq7CdPYxSdGA-0bD_0 2023-12-03T11:51:29.018 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.016+0000 7fc506ee4800 20 garbage collection: RGWGC::process iterating over entry tag='83aabb46-04b5-4c96-9933-c6bfb1173a73.4653.5391387683847757900', time=2023-12-03T13:46:32.536660+0000, chain.objs.size()=3 2023-12-03T11:51:29.018 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.016+0000 7fc506ee4800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.16__multipart_foo-LUKEWARM.2~bfCD-t6umQHlMAUwQttXrJXmQJk63il.1 2023-12-03T11:51:29.018 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.016+0000 7fc506ee4800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.16__multipart_foo-LUKEWARM.2~bfCD-t6umQHlMAUwQttXrJXmQJk63il.2 2023-12-03T11:51:29.018 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.016+0000 7fc506ee4800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.16__multipart_foo-LUKEWARM.2~bfCD-t6umQHlMAUwQttXrJXmQJk63il.3 2023-12-03T11:51:29.019 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.017+0000 7fc506ee4800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:51:29.021 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.019+0000 7fc506ee4800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2023-12-03T11:51:29.022 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.021+0000 7fc506ee4800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:51:29.022 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.021+0000 7fc506ee4800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:51:29.023 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.021+0000 7fc506ee4800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2023-12-03T11:51:29.023 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.021+0000 7fc506ee4800 20 garbage collection: RGWGC::process iterating over entry tag='_-Kq_IhC4mAP7-uOUARWgq-yjV33U9Nd', time=2023-12-03T13:46:32.470347+0000, chain.objs.size()=1 2023-12-03T11:51:29.023 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.021+0000 7fc506ee4800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.15__shadow_.Qw7ms5MkyD2bfYN6TaugXp34AI7piY9_0 2023-12-03T11:51:29.023 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.021+0000 7fc506ee4800 20 garbage collection: RGWGC::process iterating over entry tag='_TtupqrtLLmtNsbRquMblFbiM5RCdUzZ', time=2023-12-03T13:46:32.515743+0000, chain.objs.size()=2 2023-12-03T11:51:29.023 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.021+0000 7fc506ee4800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.16__shadow_.KQrimPKg2RCkQ84Dfsi2Za1UXa34og1_0 2023-12-03T11:51:29.023 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.021+0000 7fc506ee4800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.16__shadow_.KQrimPKg2RCkQ84Dfsi2Za1UXa34og1_1 2023-12-03T11:51:29.026 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.025+0000 7fc506ee4800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:51:29.028 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.027+0000 7fc506ee4800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2023-12-03T11:51:29.030 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.028+0000 7fc506ee4800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:51:29.030 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.029+0000 7fc506ee4800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:51:29.030 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.029+0000 7fc506ee4800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:51:29.031 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.030+0000 7fc506ee4800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2023-12-03T11:51:29.032 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.031+0000 7fc506ee4800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:51:29.033 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.032+0000 7fc506ee4800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:51:29.034 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.032+0000 7fc506ee4800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2023-12-03T11:51:29.034 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.032+0000 7fc506ee4800 20 garbage collection: RGWGC::process iterating over entry tag='83aabb46-04b5-4c96-9933-c6bfb1173a73.4653.3661947526298669191', time=2023-12-03T13:46:32.611694+0000, chain.objs.size()=2 2023-12-03T11:51:29.034 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.032+0000 7fc506ee4800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.13__shadow_.cSalt2bVl9tMrElFsaOam8DkIJpA2y4_0 2023-12-03T11:51:29.034 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.032+0000 7fc506ee4800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.13__shadow_.cSalt2bVl9tMrElFsaOam8DkIJpA2y4_1 2023-12-03T11:51:29.035 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.034+0000 7fc506ee4800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:51:29.037 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.036+0000 7fc506ee4800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2023-12-03T11:51:29.039 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.037+0000 7fc506ee4800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:51:29.039 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.038+0000 7fc506ee4800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:51:29.039 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.038+0000 7fc506ee4800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2023-12-03T11:51:29.040 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.038+0000 7fc506ee4800 20 garbage collection: RGWGC::process iterating over entry tag='_9czDo8zmzPzZwh5QvQYVbZz1MKQSasi', time=2023-12-03T13:46:32.454451+0000, chain.objs.size()=1 2023-12-03T11:51:29.040 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.038+0000 7fc506ee4800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.15__shadow_.eMgj45jLXPlQ0q4YzdGl5G-yExrgB4z_1 2023-12-03T11:51:29.041 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.040+0000 7fc506ee4800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:51:29.043 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.042+0000 7fc506ee4800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2023-12-03T11:51:29.044 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.043+0000 7fc506ee4800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:51:29.045 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.043+0000 7fc506ee4800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:51:29.045 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.044+0000 7fc506ee4800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2023-12-03T11:51:29.045 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.044+0000 7fc506ee4800 20 garbage collection: RGWGC::process iterating over entry tag='83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.16__multipart_foo-FROZEN.2~4YRdtSB53jf2C5eZb9-7M90nDB43zQo.2_2809218652f117a86fcca578839e03dd', time=2023-12-03T13:46:32.553610+0000, chain.objs.size()=3 2023-12-03T11:51:29.045 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.044+0000 7fc506ee4800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.16__multipart_foo-FROZEN.2~4YRdtSB53jf2C5eZb9-7M90nDB43zQo.1 2023-12-03T11:51:29.045 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.044+0000 7fc506ee4800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.16__multipart_foo-FROZEN.2~4YRdtSB53jf2C5eZb9-7M90nDB43zQo.2 2023-12-03T11:51:29.046 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.044+0000 7fc506ee4800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.16__multipart_foo-FROZEN.2~4YRdtSB53jf2C5eZb9-7M90nDB43zQo.3 2023-12-03T11:51:29.047 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.045+0000 7fc506ee4800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:51:29.049 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.048+0000 7fc506ee4800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2023-12-03T11:51:29.050 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.049+0000 7fc506ee4800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:51:29.051 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.050+0000 7fc506ee4800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:51:29.051 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.050+0000 7fc506ee4800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:51:29.052 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.051+0000 7fc506ee4800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2023-12-03T11:51:29.054 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.053+0000 7fc506ee4800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:51:29.054 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.053+0000 7fc506ee4800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:51:29.055 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.054+0000 7fc506ee4800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:51:29.056 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.055+0000 7fc506ee4800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2023-12-03T11:51:29.057 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.056+0000 7fc506ee4800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:51:29.058 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.057+0000 7fc506ee4800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:51:29.058 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.057+0000 7fc506ee4800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2023-12-03T11:51:29.058 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.057+0000 7fc506ee4800 20 garbage collection: RGWGC::process iterating over entry tag='_bIY5FFSoMTKfdAyKbaj-gn8bE3T3JVE', time=2023-12-03T13:46:32.503221+0000, chain.objs.size()=2 2023-12-03T11:51:29.058 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.057+0000 7fc506ee4800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.16__shadow_.yDoU2E57SFkkktBg-1vxB4btnujEJb7_0 2023-12-03T11:51:29.058 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.057+0000 7fc506ee4800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.16__shadow_.yDoU2E57SFkkktBg-1vxB4btnujEJb7_1 2023-12-03T11:51:29.061 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.060+0000 7fc506ee4800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:51:29.064 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.062+0000 7fc506ee4800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2023-12-03T11:51:29.065 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.064+0000 7fc506ee4800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:51:29.065 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.064+0000 7fc506ee4800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:51:29.066 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.064+0000 7fc506ee4800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:51:29.067 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.065+0000 7fc506ee4800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2023-12-03T11:51:29.068 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.067+0000 7fc506ee4800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:51:29.069 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.067+0000 7fc506ee4800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:51:29.069 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.068+0000 7fc506ee4800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:51:29.071 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.069+0000 7fc506ee4800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2023-12-03T11:51:29.072 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.071+0000 7fc506ee4800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:51:29.073 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.072+0000 7fc506ee4800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:51:29.073 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.072+0000 7fc506ee4800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:51:29.074 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.073+0000 7fc506ee4800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2023-12-03T11:51:29.075 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.074+0000 7fc506ee4800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:51:29.076 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.075+0000 7fc506ee4800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:51:29.076 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.075+0000 7fc506ee4800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:51:29.077 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.076+0000 7fc506ee4800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2023-12-03T11:51:29.078 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.077+0000 7fc506ee4800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:51:29.079 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.078+0000 7fc506ee4800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:51:29.079 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.078+0000 7fc506ee4800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2023-12-03T11:51:29.079 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.078+0000 7fc506ee4800 20 garbage collection: RGWGC::process iterating over entry tag='83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.15__shadow_.kcB8drP1wqEJuBSTA2t-8Db6AtCrSv0_1_215c4051a72749bf632217fe75338324', time=2023-12-03T13:46:32.474639+0000, chain.objs.size()=1 2023-12-03T11:51:29.080 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.078+0000 7fc506ee4800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.15__shadow_.kcB8drP1wqEJuBSTA2t-8Db6AtCrSv0_0 2023-12-03T11:51:29.080 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.079+0000 7fc506ee4800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:51:29.082 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.081+0000 7fc506ee4800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2023-12-03T11:51:29.084 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.083+0000 7fc506ee4800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:51:29.084 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.083+0000 7fc506ee4800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:51:29.085 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.084+0000 7fc506ee4800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2023-12-03T11:51:29.085 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.084+0000 7fc506ee4800 20 garbage collection: RGWGC::process iterating over entry tag='_CqmJJfGSpjLnbu0BqX2ax1A1nz05w3M', time=2023-12-03T13:46:32.445497+0000, chain.objs.size()=1 2023-12-03T11:51:29.085 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.084+0000 7fc506ee4800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.15__shadow_.dooXJV_735oTUNsY35MS0uQT2C5zKcx_0 2023-12-03T11:51:29.087 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.086+0000 7fc506ee4800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:51:29.089 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.088+0000 7fc506ee4800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2023-12-03T11:51:29.090 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.089+0000 7fc506ee4800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:51:29.091 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.090+0000 7fc506ee4800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:51:29.091 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.090+0000 7fc506ee4800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2023-12-03T11:51:29.092 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.090+0000 7fc506ee4800 20 garbage collection: RGWGC::process iterating over entry tag='83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.16__multipart_foo-LUKEWARM.2~bfCD-t6umQHlMAUwQttXrJXmQJk63il.2_cefc65d840a588c26ffb10b6ad8398bb', time=2023-12-03T13:46:32.545201+0000, chain.objs.size()=3 2023-12-03T11:51:29.092 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.090+0000 7fc506ee4800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.16__multipart_foo-LUKEWARM.2~bfCD-t6umQHlMAUwQttXrJXmQJk63il.1 2023-12-03T11:51:29.092 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.090+0000 7fc506ee4800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.16__multipart_foo-LUKEWARM.2~bfCD-t6umQHlMAUwQttXrJXmQJk63il.2 2023-12-03T11:51:29.092 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.090+0000 7fc506ee4800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.16__multipart_foo-LUKEWARM.2~bfCD-t6umQHlMAUwQttXrJXmQJk63il.3 2023-12-03T11:51:29.092 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.091+0000 7fc506ee4800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:51:29.095 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.093+0000 7fc506ee4800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2023-12-03T11:51:29.096 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.095+0000 7fc506ee4800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:51:29.097 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.095+0000 7fc506ee4800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:51:29.097 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.096+0000 7fc506ee4800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:51:29.098 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.097+0000 7fc506ee4800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2023-12-03T11:51:29.099 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.098+0000 7fc506ee4800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:51:29.100 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.099+0000 7fc506ee4800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:51:29.100 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.099+0000 7fc506ee4800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2023-12-03T11:51:29.100 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.099+0000 7fc506ee4800 20 garbage collection: RGWGC::process iterating over entry tag='83aabb46-04b5-4c96-9933-c6bfb1173a73.4653.18377131291731228815', time=2023-12-03T13:46:32.618697+0000, chain.objs.size()=2 2023-12-03T11:51:29.100 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.099+0000 7fc506ee4800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.13__shadow_.ik8QhLSFaKVGUyYl7ip2DOf7bSU7olg_0 2023-12-03T11:51:29.100 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.099+0000 7fc506ee4800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.13__shadow_.ik8QhLSFaKVGUyYl7ip2DOf7bSU7olg_1 2023-12-03T11:51:29.103 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.102+0000 7fc506ee4800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:51:29.105 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.104+0000 7fc506ee4800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2023-12-03T11:51:29.107 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.105+0000 7fc506ee4800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:51:29.107 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.106+0000 7fc506ee4800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:51:29.108 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.106+0000 7fc506ee4800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2023-12-03T11:51:29.108 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.106+0000 7fc506ee4800 20 garbage collection: RGWGC::process iterating over entry tag='83aabb46-04b5-4c96-9933-c6bfb1173a73.4653.15240308958836163988', time=2023-12-03T13:46:32.403063+0000, chain.objs.size()=4 2023-12-03T11:51:29.108 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.106+0000 7fc506ee4800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.9__multipart_foo.2~7rzTQBaOhtghlRd7cKB1m_lvWefNEyu.1 2023-12-03T11:51:29.108 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.106+0000 7fc506ee4800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.9__multipart_foo.2~7rzTQBaOhtghlRd7cKB1m_lvWefNEyu.2 2023-12-03T11:51:29.108 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.106+0000 7fc506ee4800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.9__multipart_foo.2~7rzTQBaOhtghlRd7cKB1m_lvWefNEyu.3 2023-12-03T11:51:29.108 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.106+0000 7fc506ee4800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.9__multipart_foo.2~7rzTQBaOhtghlRd7cKB1m_lvWefNEyu.4 2023-12-03T11:51:29.108 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.106+0000 7fc506ee4800 20 garbage collection: RGWGC::process iterating over entry tag='_-6cey1NMooOW2eGaN_R-U0dN1cWY1hb', time=2023-12-03T13:46:32.507624+0000, chain.objs.size()=2 2023-12-03T11:51:29.108 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.106+0000 7fc506ee4800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.16__shadow_.r_pOPT4rgk-NKJ66OI34ySYs74BkZgl_1 2023-12-03T11:51:29.108 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.106+0000 7fc506ee4800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.16__shadow_.r_pOPT4rgk-NKJ66OI34ySYs74BkZgl_2 2023-12-03T11:51:29.111 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.110+0000 7fc506ee4800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:51:29.114 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.113+0000 7fc506ee4800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2023-12-03T11:51:29.115 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.114+0000 7fc506ee4800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:51:29.116 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.114+0000 7fc506ee4800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:51:29.116 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.115+0000 7fc506ee4800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:51:29.117 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.116+0000 7fc506ee4800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2023-12-03T11:51:29.118 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.117+0000 7fc506ee4800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:51:29.119 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.118+0000 7fc506ee4800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:51:29.120 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.118+0000 7fc506ee4800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2023-12-03T11:51:29.120 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.118+0000 7fc506ee4800 20 garbage collection: RGWGC::process iterating over entry tag='83aabb46-04b5-4c96-9933-c6bfb1173a73.4653.3001255035959802219', time=2023-12-03T13:46:32.582575+0000, chain.objs.size()=3 2023-12-03T11:51:29.120 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.118+0000 7fc506ee4800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.14__multipart_foo-STANDARD.2~Tqa8fEyRuSlugOfa9nyU97QwxRbtdc4.1 2023-12-03T11:51:29.120 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.118+0000 7fc506ee4800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.14__multipart_foo-STANDARD.2~Tqa8fEyRuSlugOfa9nyU97QwxRbtdc4.2 2023-12-03T11:51:29.120 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.118+0000 7fc506ee4800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.14__multipart_foo-STANDARD.2~Tqa8fEyRuSlugOfa9nyU97QwxRbtdc4.3 2023-12-03T11:51:29.121 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.120+0000 7fc506ee4800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:51:29.123 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.122+0000 7fc506ee4800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2023-12-03T11:51:29.125 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.124+0000 7fc506ee4800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:51:29.125 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.124+0000 7fc506ee4800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:51:29.126 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.124+0000 7fc506ee4800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2023-12-03T11:51:29.126 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.124+0000 7fc506ee4800 20 garbage collection: RGWGC::process iterating over entry tag='__g-KcSc18YYgk86go9OtdJIdNMNcock', time=2023-12-03T13:46:32.432484+0000, chain.objs.size()=1 2023-12-03T11:51:29.126 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.124+0000 7fc506ee4800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.15__shadow_.31fDp1Ykjr_lpatxJakGMfhtx4TG67e_1 2023-12-03T11:51:29.126 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.124+0000 7fc506ee4800 20 garbage collection: RGWGC::process iterating over entry tag='83aabb46-04b5-4c96-9933-c6bfb1173a73.4653.6909795222448070732', time=2023-12-03T13:46:32.436817+0000, chain.objs.size()=1 2023-12-03T11:51:29.126 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.124+0000 7fc506ee4800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.15__shadow_.kcB8drP1wqEJuBSTA2t-8Db6AtCrSv0_0 2023-12-03T11:51:29.126 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.124+0000 7fc506ee4800 20 garbage collection: RGWGC::process iterating over entry tag='83aabb46-04b5-4c96-9933-c6bfb1173a73.4653.15534283890781091536', time=2023-12-03T13:46:32.524390+0000, chain.objs.size()=3 2023-12-03T11:51:29.129 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.124+0000 7fc506ee4800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.16__multipart_foo-STANDARD.2~vlfDWI-vv3RhE217kuvJVo_qOJBj_Sx.1 2023-12-03T11:51:29.129 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.124+0000 7fc506ee4800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.16__multipart_foo-STANDARD.2~vlfDWI-vv3RhE217kuvJVo_qOJBj_Sx.2 2023-12-03T11:51:29.130 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.124+0000 7fc506ee4800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.16__multipart_foo-STANDARD.2~vlfDWI-vv3RhE217kuvJVo_qOJBj_Sx.3 2023-12-03T11:51:29.130 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.124+0000 7fc506ee4800 20 garbage collection: RGWGC::process iterating over entry tag='_EznIcEmKEi_9b9BmqGSoNfXkTnHU4RI', time=2023-12-03T13:46:32.549173+0000, chain.objs.size()=2 2023-12-03T11:51:29.130 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.124+0000 7fc506ee4800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.16__shadow_.LZUr_X3eG0ewdLGaPQ5F_0uxPVDoylo_0 2023-12-03T11:51:29.130 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.125+0000 7fc506ee4800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.16__shadow_.LZUr_X3eG0ewdLGaPQ5F_0uxPVDoylo_1 2023-12-03T11:51:29.130 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.128+0000 7fc506ee4800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:51:29.131 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.130+0000 7fc506ee4800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2023-12-03T11:51:29.132 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.131+0000 7fc506ee4800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:51:29.133 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.132+0000 7fc506ee4800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:51:29.133 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.132+0000 7fc506ee4800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2023-12-03T11:51:29.134 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.132+0000 7fc506ee4800 20 garbage collection: RGWGC::process iterating over entry tag='83aabb46-04b5-4c96-9933-c6bfb1173a73.4653.17268635285228956561', time=2023-12-03T13:46:32.346005+0000, chain.objs.size()=4 2023-12-03T11:51:29.134 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.132+0000 7fc506ee4800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.12__multipart_foo.2~nlK--PqpLNd0NMA58-FcbLIIj1h6WMl.1 2023-12-03T11:51:29.134 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.132+0000 7fc506ee4800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.12__multipart_foo.2~nlK--PqpLNd0NMA58-FcbLIIj1h6WMl.2 2023-12-03T11:51:29.134 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.132+0000 7fc506ee4800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.12__multipart_foo.2~nlK--PqpLNd0NMA58-FcbLIIj1h6WMl.3 2023-12-03T11:51:29.134 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.132+0000 7fc506ee4800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.12__multipart_foo.2~nlK--PqpLNd0NMA58-FcbLIIj1h6WMl.4 2023-12-03T11:51:29.134 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.132+0000 7fc506ee4800 20 garbage collection: RGWGC::process iterating over entry tag='83aabb46-04b5-4c96-9933-c6bfb1173a73.4653.6196592974454432604', time=2023-12-03T13:46:32.586926+0000, chain.objs.size()=3 2023-12-03T11:51:29.134 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.132+0000 7fc506ee4800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.14__multipart_foo-LUKEWARM.2~eij8Msx5VSJfUd9vH0jneBhTaOIhCxb.1 2023-12-03T11:51:29.134 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.132+0000 7fc506ee4800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.14__multipart_foo-LUKEWARM.2~eij8Msx5VSJfUd9vH0jneBhTaOIhCxb.2 2023-12-03T11:51:29.134 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.132+0000 7fc506ee4800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.14__multipart_foo-LUKEWARM.2~eij8Msx5VSJfUd9vH0jneBhTaOIhCxb.3 2023-12-03T11:51:29.137 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.136+0000 7fc506ee4800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:51:29.140 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.139+0000 7fc4cb7de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:51:29.143 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.142+0000 7fc506ee4800 20 remove_watcher() i=0 2023-12-03T11:51:29.143 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.142+0000 7fc506ee4800 2 removed watcher, disabling cache 2023-12-03T11:51:29.144 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.143+0000 7fc506ee4800 20 remove_watcher() i=1 2023-12-03T11:51:29.145 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.144+0000 7fc506ee4800 20 remove_watcher() i=2 2023-12-03T11:51:29.146 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.145+0000 7fc506ee4800 20 remove_watcher() i=3 2023-12-03T11:51:29.147 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.146+0000 7fc506ee4800 20 remove_watcher() i=4 2023-12-03T11:51:29.148 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.147+0000 7fc506ee4800 20 remove_watcher() i=5 2023-12-03T11:51:29.149 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.148+0000 7fc506ee4800 20 remove_watcher() i=6 2023-12-03T11:51:29.150 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.149+0000 7fc506ee4800 20 remove_watcher() i=7 2023-12-03T11:51:29.156 DEBUG:teuthology.orchestra.run.smithi003:> radosgw-admin gc process --include-all 2023-12-03T11:51:29.206 INFO:teuthology.orchestra.run.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:51:29.206 INFO:teuthology.orchestra.run.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:51:29.220 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.219+0000 7f6c51921800 20 rados->read ofs=0 len=0 2023-12-03T11:51:29.222 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.221+0000 7f6c51921800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:51:29.222 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.221+0000 7f6c51921800 20 realm 2023-12-03T11:51:29.222 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.221+0000 7f6c51921800 20 rados->read ofs=0 len=0 2023-12-03T11:51:29.222 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.221+0000 7f6c51921800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:51:29.223 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.221+0000 7f6c51921800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:51:29.223 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.221+0000 7f6c51921800 20 rados->read ofs=0 len=0 2023-12-03T11:51:29.223 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.221+0000 7f6c51921800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:51:29.223 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.221+0000 7f6c51921800 20 rados->read ofs=0 len=0 2023-12-03T11:51:29.223 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.222+0000 7f6c51921800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:51:29.223 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.222+0000 7f6c51921800 20 rados->read ofs=0 len=0 2023-12-03T11:51:29.223 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.222+0000 7f6c51921800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:51:29.223 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.222+0000 7f6c51921800 20 searching for the correct realm 2023-12-03T11:51:29.233 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.232+0000 7f6c4d6b8640 0 -- 172.21.15.3:0/4079639353 >> [v2:172.21.15.37:6805/1692844418,v1:172.21.15.37:6807/1692844418] conn(0x56081ca0b020 msgr2=0x56081ca0d410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:51:29.235 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.233+0000 7f6c51921800 20 RGWRados::pool_iterate: got zone_info.83aabb46-04b5-4c96-9933-c6bfb1173a73 2023-12-03T11:51:29.235 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.233+0000 7f6c51921800 20 RGWRados::pool_iterate: got zonegroup_info.6a811aad-435d-4fdd-93c9-b7e0b50de429 2023-12-03T11:51:29.235 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.233+0000 7f6c51921800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:51:29.235 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.233+0000 7f6c51921800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:51:29.235 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.233+0000 7f6c51921800 20 rados->read ofs=0 len=0 2023-12-03T11:51:29.235 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.234+0000 7f6c51921800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:51:29.235 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.234+0000 7f6c51921800 20 rados->read ofs=0 len=0 2023-12-03T11:51:29.236 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.234+0000 7f6c51921800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:51:29.236 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.234+0000 7f6c51921800 20 rados->read ofs=0 len=0 2023-12-03T11:51:29.237 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.234+0000 7f6c51921800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:51:29.237 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.234+0000 7f6c51921800 20 zone default found 2023-12-03T11:51:29.237 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.234+0000 7f6c51921800 4 Realm: () 2023-12-03T11:51:29.237 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.234+0000 7f6c51921800 4 ZoneGroup: default (6a811aad-435d-4fdd-93c9-b7e0b50de429) 2023-12-03T11:51:29.237 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.234+0000 7f6c51921800 4 Zone: default (83aabb46-04b5-4c96-9933-c6bfb1173a73) 2023-12-03T11:51:29.237 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.234+0000 7f6c51921800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:51:29.237 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.234+0000 7f6c51921800 20 zonegroup default 2023-12-03T11:51:29.237 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.234+0000 7f6c51921800 20 rados->read ofs=0 len=0 2023-12-03T11:51:29.237 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.235+0000 7f6c51921800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:51:29.237 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.235+0000 7f6c51921800 20 rados->read ofs=0 len=0 2023-12-03T11:51:29.237 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.235+0000 7f6c51921800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:51:29.237 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.235+0000 7f6c51921800 20 rados->read ofs=0 len=0 2023-12-03T11:51:29.237 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.235+0000 7f6c51921800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:51:29.237 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.235+0000 7f6c51921800 20 started sync module instance, tier type = 2023-12-03T11:51:29.238 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.235+0000 7f6c51921800 20 started zone id=83aabb46-04b5-4c96-9933-c6bfb1173a73 (name=default) with tier type = 2023-12-03T11:51:29.242 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.241+0000 7f6c4ceb7640 0 -- 172.21.15.3:0/4079639353 >> [v2:172.21.15.3:6817/3356208405,v1:172.21.15.3:6819/3356208405] conn(0x56081ca0ffe0 msgr2=0x56081ca123d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-03T11:51:29.246 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.245+0000 7f6c51921800 20 add_watcher() i=0 2023-12-03T11:51:29.246 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.245+0000 7f6c51921800 20 add_watcher() i=1 2023-12-03T11:51:29.246 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.245+0000 7f6c51921800 20 add_watcher() i=2 2023-12-03T11:51:29.246 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.245+0000 7f6c51921800 20 add_watcher() i=3 2023-12-03T11:51:29.246 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.245+0000 7f6c51921800 20 add_watcher() i=4 2023-12-03T11:51:29.246 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.245+0000 7f6c51921800 20 add_watcher() i=5 2023-12-03T11:51:29.246 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.245+0000 7f6c51921800 20 add_watcher() i=6 2023-12-03T11:51:29.247 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.246+0000 7f6c51921800 20 add_watcher() i=7 2023-12-03T11:51:29.247 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.246+0000 7f6c51921800 2 all 8 watchers are set, enabling cache 2023-12-03T11:51:29.249 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.247+0000 7f6c12fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:51:29.249 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.248+0000 7f6c51921800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:51:29.249 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.248+0000 7f6c51921800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:51:29.292 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.290+0000 7f6b81ffb640 20 reqs_thread_entry: start 2023-12-03T11:51:29.292 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.290+0000 7f6c51921800 20 init_complete bucket index max shards: 11 2023-12-03T11:51:29.292 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.290+0000 7f6c51921800 20 Filter name: none 2023-12-03T11:51:29.292 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.290+0000 7f6b737fe640 20 reqs_thread_entry: start 2023-12-03T11:51:29.292 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.290+0000 7f6c51921800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2023-12-03T11:51:29.293 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.292+0000 7f6c51921800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:51:29.293 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.292+0000 7f6c51921800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:51:29.294 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.293+0000 7f6c51921800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:51:29.295 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.293+0000 7f6c51921800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2023-12-03T11:51:29.296 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.295+0000 7f6c51921800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:51:29.296 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.295+0000 7f6c51921800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:51:29.296 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.295+0000 7f6c51921800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:51:29.298 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.296+0000 7f6c51921800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2023-12-03T11:51:29.299 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.298+0000 7f6c51921800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:51:29.300 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.298+0000 7f6c51921800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:51:29.300 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.299+0000 7f6c51921800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:51:29.301 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.300+0000 7f6c51921800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2023-12-03T11:51:29.302 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.301+0000 7f6c51921800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:51:29.303 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.302+0000 7f6c51921800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:51:29.303 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.302+0000 7f6c51921800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:51:29.304 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.303+0000 7f6c51921800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2023-12-03T11:51:29.305 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.304+0000 7f6c51921800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:51:29.306 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.305+0000 7f6c51921800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:51:29.306 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.305+0000 7f6c51921800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:51:29.307 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.306+0000 7f6c51921800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2023-12-03T11:51:29.308 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.307+0000 7f6c51921800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:51:29.309 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.308+0000 7f6c51921800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:51:29.309 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.308+0000 7f6c51921800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:51:29.310 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.309+0000 7f6c51921800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2023-12-03T11:51:29.311 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.310+0000 7f6c51921800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:51:29.312 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.310+0000 7f6c51921800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:51:29.312 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.311+0000 7f6c51921800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:51:29.313 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.312+0000 7f6c51921800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2023-12-03T11:51:29.314 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.313+0000 7f6c51921800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:51:29.314 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.313+0000 7f6c51921800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:51:29.315 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.313+0000 7f6c51921800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:51:29.316 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.314+0000 7f6c51921800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2023-12-03T11:51:29.317 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.316+0000 7f6c51921800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:51:29.317 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.316+0000 7f6c51921800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:51:29.318 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.316+0000 7f6c51921800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:51:29.319 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.317+0000 7f6c51921800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2023-12-03T11:51:29.320 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.319+0000 7f6c51921800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:51:29.321 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.320+0000 7f6c51921800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:51:29.321 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.320+0000 7f6c51921800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:51:29.322 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.321+0000 7f6c51921800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2023-12-03T11:51:29.324 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.322+0000 7f6c51921800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:51:29.324 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.323+0000 7f6c51921800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:51:29.324 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.323+0000 7f6c51921800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:51:29.325 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.324+0000 7f6c51921800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2023-12-03T11:51:29.326 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.325+0000 7f6c51921800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:51:29.327 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.326+0000 7f6c51921800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:51:29.327 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.326+0000 7f6c51921800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:51:29.328 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.327+0000 7f6c51921800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2023-12-03T11:51:29.329 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.328+0000 7f6c51921800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:51:29.329 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.328+0000 7f6c51921800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:51:29.330 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.329+0000 7f6c51921800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:51:29.331 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.330+0000 7f6c51921800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2023-12-03T11:51:29.332 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.331+0000 7f6c51921800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:51:29.332 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.331+0000 7f6c51921800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:51:29.333 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.332+0000 7f6c51921800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:51:29.334 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.333+0000 7f6c51921800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2023-12-03T11:51:29.335 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.334+0000 7f6c51921800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:51:29.336 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.334+0000 7f6c51921800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:51:29.336 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.335+0000 7f6c51921800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:51:29.337 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.336+0000 7f6c51921800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2023-12-03T11:51:29.339 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.337+0000 7f6c51921800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:51:29.339 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.338+0000 7f6c51921800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:51:29.339 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.338+0000 7f6c51921800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:51:29.340 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.339+0000 7f6c51921800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2023-12-03T11:51:29.342 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.340+0000 7f6c51921800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:51:29.342 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.341+0000 7f6c51921800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:51:29.343 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.342+0000 7f6c51921800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:51:29.344 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.343+0000 7f6c51921800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2023-12-03T11:51:29.345 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.344+0000 7f6c51921800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:51:29.346 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.345+0000 7f6c51921800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:51:29.346 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.345+0000 7f6c51921800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:51:29.347 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.346+0000 7f6c51921800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2023-12-03T11:51:29.349 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.347+0000 7f6c51921800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:51:29.349 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.348+0000 7f6c51921800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:51:29.349 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.348+0000 7f6c51921800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:51:29.350 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.349+0000 7f6c51921800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2023-12-03T11:51:29.351 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.350+0000 7f6c51921800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:51:29.352 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.351+0000 7f6c51921800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:51:29.352 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.351+0000 7f6c51921800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:51:29.353 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.352+0000 7f6c51921800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2023-12-03T11:51:29.355 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.353+0000 7f6c51921800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:51:29.355 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.354+0000 7f6c51921800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:51:29.355 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.354+0000 7f6c51921800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:51:29.356 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.355+0000 7f6c51921800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2023-12-03T11:51:29.357 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.356+0000 7f6c51921800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:51:29.358 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.357+0000 7f6c51921800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:51:29.358 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.357+0000 7f6c51921800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:51:29.359 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.358+0000 7f6c51921800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2023-12-03T11:51:29.360 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.359+0000 7f6c51921800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:51:29.361 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.359+0000 7f6c51921800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:51:29.361 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.360+0000 7f6c51921800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:51:29.362 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.361+0000 7f6c51921800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2023-12-03T11:51:29.363 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.362+0000 7f6c51921800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:51:29.364 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.363+0000 7f6c51921800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:51:29.364 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.363+0000 7f6c51921800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:51:29.365 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.364+0000 7f6c51921800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2023-12-03T11:51:29.367 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.366+0000 7f6c51921800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:51:29.367 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.366+0000 7f6c51921800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:51:29.368 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.366+0000 7f6c51921800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:51:29.368 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.367+0000 7f6c51921800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2023-12-03T11:51:29.370 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.368+0000 7f6c51921800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:51:29.370 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.369+0000 7f6c51921800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:51:29.370 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.369+0000 7f6c51921800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:51:29.372 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.370+0000 7f6c51921800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2023-12-03T11:51:29.373 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.372+0000 7f6c51921800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:51:29.373 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.372+0000 7f6c51921800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:51:29.374 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.372+0000 7f6c51921800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:51:29.374 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.373+0000 7f6c51921800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2023-12-03T11:51:29.377 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.375+0000 7f6c51921800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:51:29.377 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.375+0000 7f6c51921800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:51:29.377 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.375+0000 7f6c51921800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:51:29.377 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.376+0000 7f6c51921800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2023-12-03T11:51:29.379 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.377+0000 7f6c51921800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:51:29.379 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.378+0000 7f6c51921800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:51:29.379 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.378+0000 7f6c51921800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:51:29.381 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.379+0000 7f6c51921800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2023-12-03T11:51:29.382 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.381+0000 7f6c51921800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:51:29.382 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.381+0000 7f6c51921800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:51:29.383 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.381+0000 7f6c51921800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:51:29.383 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.382+0000 7f6c51921800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2023-12-03T11:51:29.385 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.383+0000 7f6c51921800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:51:29.385 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.384+0000 7f6c51921800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:51:29.386 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.385+0000 7f6c51921800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:51:29.387 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.386+0000 7f6c51921800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2023-12-03T11:51:29.389 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.387+0000 7f6c51921800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:51:29.389 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.388+0000 7f6c51921800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:51:29.390 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.388+0000 7f6c51921800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:51:29.391 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.390+0000 7f6c12fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:51:29.393 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.392+0000 7f6c51921800 20 remove_watcher() i=0 2023-12-03T11:51:29.393 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.392+0000 7f6c51921800 2 removed watcher, disabling cache 2023-12-03T11:51:29.394 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.393+0000 7f6c51921800 20 remove_watcher() i=1 2023-12-03T11:51:29.395 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.394+0000 7f6c51921800 20 remove_watcher() i=2 2023-12-03T11:51:29.396 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.395+0000 7f6c51921800 20 remove_watcher() i=3 2023-12-03T11:51:29.397 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.396+0000 7f6c51921800 20 remove_watcher() i=4 2023-12-03T11:51:29.398 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.397+0000 7f6c51921800 20 remove_watcher() i=5 2023-12-03T11:51:29.399 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.398+0000 7f6c51921800 20 remove_watcher() i=6 2023-12-03T11:51:29.400 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:51:29.399+0000 7f6c51921800 20 remove_watcher() i=7 2023-12-03T11:51:29.406 DEBUG:teuthology.orchestra.run.smithi003:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests AWS4Test 2023-12-03T11:51:29.899 INFO:teuthology.orchestra.run.smithi003.stdout:Starting a Gradle Daemon (subsequent builds will be faster) 2023-12-03T11:51:34.100 INFO:teuthology.orchestra.run.smithi003.stdout:> Task :clean UP-TO-DATE 2023-12-03T11:51:58.599 INFO:teuthology.orchestra.run.smithi003.stdout:> Task :compileJava 2023-12-03T11:51:58.699 INFO:teuthology.orchestra.run.smithi003.stdout:> Task :processResources 2023-12-03T11:51:58.699 INFO:teuthology.orchestra.run.smithi003.stdout:> Task :classes 2023-12-03T11:51:59.199 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:51:59.199 INFO:teuthology.orchestra.run.smithi003.stdout:> Task :compileTestJava 2023-12-03T11:51:59.200 INFO:teuthology.orchestra.run.smithi003.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2023-12-03T11:51:59.200 INFO:teuthology.orchestra.run.smithi003.stderr:Note: Recompile with -Xlint:deprecation for details. 2023-12-03T11:51:59.201 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:51:59.201 INFO:teuthology.orchestra.run.smithi003.stdout:> Task :processTestResources NO-SOURCE 2023-12-03T11:51:59.201 INFO:teuthology.orchestra.run.smithi003.stdout:> Task :testClasses 2023-12-03T11:52:05.299 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:52:05.299 INFO:teuthology.orchestra.run.smithi003.stdout:> Task :test 2023-12-03T11:52:05.299 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:52:05.299 INFO:teuthology.orchestra.run.smithi003.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 STARTED 2023-12-03T11:52:09.599 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:52:09.599 INFO:teuthology.orchestra.run.smithi003.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 PASSED 2023-12-03T11:52:09.999 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:52:09.999 INFO:teuthology.orchestra.run.smithi003.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 STARTED 2023-12-03T11:52:10.098 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:52:10.099 INFO:teuthology.orchestra.run.smithi003.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 PASSED 2023-12-03T11:52:10.398 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:52:10.399 INFO:teuthology.orchestra.run.smithi003.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 STARTED 2023-12-03T11:52:24.599 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:52:24.599 INFO:teuthology.orchestra.run.smithi003.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 PASSED 2023-12-03T11:52:24.999 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:52:24.999 INFO:teuthology.orchestra.run.smithi003.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 STARTED 2023-12-03T11:52:24.999 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:52:24.999 INFO:teuthology.orchestra.run.smithi003.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 PASSED 2023-12-03T11:52:25.098 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:52:25.099 INFO:teuthology.orchestra.run.smithi003.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 STARTED 2023-12-03T11:52:25.198 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:52:25.199 INFO:teuthology.orchestra.run.smithi003.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 PASSED 2023-12-03T11:52:25.499 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:52:25.499 INFO:teuthology.orchestra.run.smithi003.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 STARTED 2023-12-03T11:52:29.999 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:52:29.999 INFO:teuthology.orchestra.run.smithi003.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 PASSED 2023-12-03T11:52:30.599 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:52:30.599 INFO:teuthology.orchestra.run.smithi003.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 STARTED 2023-12-03T11:53:06.499 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:53:06.499 INFO:teuthology.orchestra.run.smithi003.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 PASSED 2023-12-03T11:53:07.198 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:53:07.199 INFO:teuthology.orchestra.run.smithi003.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 STARTED 2023-12-03T11:53:07.298 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:53:07.299 INFO:teuthology.orchestra.run.smithi003.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 PASSED 2023-12-03T11:53:07.598 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:53:07.599 INFO:teuthology.orchestra.run.smithi003.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 STARTED 2023-12-03T11:53:07.698 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:53:07.699 INFO:teuthology.orchestra.run.smithi003.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 PASSED 2023-12-03T11:53:08.398 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:53:08.399 INFO:teuthology.orchestra.run.smithi003.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 STARTED 2023-12-03T11:53:12.099 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:53:12.099 INFO:teuthology.orchestra.run.smithi003.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 PASSED 2023-12-03T11:53:12.499 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:53:12.499 INFO:teuthology.orchestra.run.smithi003.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 STARTED 2023-12-03T11:53:12.599 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:53:12.599 INFO:teuthology.orchestra.run.smithi003.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 PASSED 2023-12-03T11:53:12.698 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:53:12.699 INFO:teuthology.orchestra.run.smithi003.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 STARTED 2023-12-03T11:53:18.998 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:53:18.999 INFO:teuthology.orchestra.run.smithi003.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 PASSED 2023-12-03T11:53:19.299 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:53:19.299 INFO:teuthology.orchestra.run.smithi003.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 STARTED 2023-12-03T11:53:27.699 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:53:27.699 INFO:teuthology.orchestra.run.smithi003.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 PASSED 2023-12-03T11:53:28.198 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:53:28.199 INFO:teuthology.orchestra.run.smithi003.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 STARTED 2023-12-03T11:53:30.199 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:53:30.199 INFO:teuthology.orchestra.run.smithi003.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 PASSED 2023-12-03T11:53:30.598 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:53:30.599 INFO:teuthology.orchestra.run.smithi003.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 STARTED 2023-12-03T11:54:20.899 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:54:20.900 INFO:teuthology.orchestra.run.smithi003.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 PASSED 2023-12-03T11:54:21.298 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:54:21.299 INFO:teuthology.orchestra.run.smithi003.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 STARTED 2023-12-03T11:54:26.699 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:54:26.699 INFO:teuthology.orchestra.run.smithi003.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 PASSED 2023-12-03T11:54:27.099 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:54:27.099 INFO:teuthology.orchestra.run.smithi003.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 STARTED 2023-12-03T11:54:30.899 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:54:30.899 INFO:teuthology.orchestra.run.smithi003.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 PASSED 2023-12-03T11:54:31.298 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:54:31.299 INFO:teuthology.orchestra.run.smithi003.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 STARTED 2023-12-03T11:54:32.698 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:54:32.699 INFO:teuthology.orchestra.run.smithi003.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 PASSED 2023-12-03T11:54:37.698 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:54:37.699 INFO:teuthology.orchestra.run.smithi003.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateAfterToday4AWS4 STARTED 2023-12-03T11:54:37.799 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:54:37.799 INFO:teuthology.orchestra.run.smithi003.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateAfterToday4AWS4 PASSED 2023-12-03T11:54:38.599 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:54:38.599 INFO:teuthology.orchestra.run.smithi003.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeEpochAWS4 STARTED 2023-12-03T11:54:38.699 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:54:38.699 INFO:teuthology.orchestra.run.smithi003.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeEpochAWS4 PASSED 2023-12-03T11:54:39.099 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:54:39.099 INFO:teuthology.orchestra.run.smithi003.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeToday4AWS4 STARTED 2023-12-03T11:54:39.099 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:54:39.099 INFO:teuthology.orchestra.run.smithi003.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeToday4AWS4 PASSED 2023-12-03T11:54:39.599 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:54:39.599 INFO:teuthology.orchestra.run.smithi003.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateEmptyAWS4 STARTED 2023-12-03T11:54:39.599 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:54:39.599 INFO:teuthology.orchestra.run.smithi003.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateEmptyAWS4 PASSED 2023-12-03T11:54:39.998 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:54:39.999 INFO:teuthology.orchestra.run.smithi003.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateInvalidAWS4 STARTED 2023-12-03T11:54:40.098 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:54:40.098 INFO:teuthology.orchestra.run.smithi003.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateInvalidAWS4 PASSED 2023-12-03T11:54:40.498 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:54:40.499 INFO:teuthology.orchestra.run.smithi003.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateNoneAWS4 STARTED 2023-12-03T11:54:40.599 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:54:40.599 INFO:teuthology.orchestra.run.smithi003.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateNoneAWS4 PASSED 2023-12-03T11:54:40.998 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:54:40.999 INFO:teuthology.orchestra.run.smithi003.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadMd5InvalidGarbageAWS4 STARTED 2023-12-03T11:54:41.099 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:54:41.099 INFO:teuthology.orchestra.run.smithi003.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadMd5InvalidGarbageAWS4 PASSED 2023-12-03T11:54:41.499 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:54:41.499 INFO:teuthology.orchestra.run.smithi003.stdout:suite > AWS4 tests > AWS4Test.testUploadFileHLAPIBigFileAWS4 STARTED 2023-12-03T11:54:49.699 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:54:49.699 INFO:teuthology.orchestra.run.smithi003.stdout:suite > AWS4 tests > AWS4Test.testUploadFileHLAPIBigFileAWS4 PASSED 2023-12-03T11:54:50.199 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:54:50.199 INFO:teuthology.orchestra.run.smithi003.stdout:---------------------------------------------------------------------- 2023-12-03T11:54:50.199 INFO:teuthology.orchestra.run.smithi003.stdout:| Results: SUCCESS (26 tests, 26 successes, 0 failures, 0 skipped) | 2023-12-03T11:54:50.199 INFO:teuthology.orchestra.run.smithi003.stdout:---------------------------------------------------------------------- 2023-12-03T11:54:50.254 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:54:50.254 INFO:teuthology.orchestra.run.smithi003.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2023-12-03T11:54:50.254 INFO:teuthology.orchestra.run.smithi003.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2023-12-03T11:54:50.254 INFO:teuthology.orchestra.run.smithi003.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2023-12-03T11:54:50.254 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:54:50.254 INFO:teuthology.orchestra.run.smithi003.stdout:BUILD SUCCESSFUL in 3m 20s 2023-12-03T11:54:50.254 INFO:teuthology.orchestra.run.smithi003.stdout:5 actionable tasks: 4 executed, 1 up-to-date 2023-12-03T11:54:50.570 DEBUG:teuthology.orchestra.run.smithi003:> radosgw-admin gc process --include-all 2023-12-03T11:54:50.621 INFO:teuthology.orchestra.run.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:54:50.621 INFO:teuthology.orchestra.run.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:54:50.635 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.634+0000 7f6400e0f800 20 rados->read ofs=0 len=0 2023-12-03T11:54:50.637 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.636+0000 7f6400e0f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:54:50.637 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.636+0000 7f6400e0f800 20 realm 2023-12-03T11:54:50.637 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.636+0000 7f6400e0f800 20 rados->read ofs=0 len=0 2023-12-03T11:54:50.637 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.636+0000 7f6400e0f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:54:50.637 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.636+0000 7f6400e0f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:54:50.637 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.636+0000 7f6400e0f800 20 rados->read ofs=0 len=0 2023-12-03T11:54:50.637 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.636+0000 7f6400e0f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:54:50.637 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.636+0000 7f6400e0f800 20 rados->read ofs=0 len=0 2023-12-03T11:54:50.638 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.637+0000 7f6400e0f800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:54:50.638 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.637+0000 7f6400e0f800 20 rados->read ofs=0 len=0 2023-12-03T11:54:50.638 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.637+0000 7f6400e0f800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:54:50.639 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.637+0000 7f6400e0f800 20 searching for the correct realm 2023-12-03T11:54:50.648 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.647+0000 7f63fc48c640 0 -- 172.21.15.3:0/3815072874 >> [v2:172.21.15.37:6805/1692844418,v1:172.21.15.37:6807/1692844418] conn(0x564ce2734710 msgr2=0x564ce2736b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:54:50.651 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.649+0000 7f6400e0f800 20 RGWRados::pool_iterate: got zone_info.83aabb46-04b5-4c96-9933-c6bfb1173a73 2023-12-03T11:54:50.651 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.649+0000 7f6400e0f800 20 RGWRados::pool_iterate: got zonegroup_info.6a811aad-435d-4fdd-93c9-b7e0b50de429 2023-12-03T11:54:50.651 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.649+0000 7f6400e0f800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:54:50.651 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.649+0000 7f6400e0f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:54:50.651 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.649+0000 7f6400e0f800 20 rados->read ofs=0 len=0 2023-12-03T11:54:50.651 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.649+0000 7f6400e0f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:54:50.651 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.649+0000 7f6400e0f800 20 rados->read ofs=0 len=0 2023-12-03T11:54:50.651 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.649+0000 7f6400e0f800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:54:50.651 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.649+0000 7f6400e0f800 20 rados->read ofs=0 len=0 2023-12-03T11:54:50.652 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.650+0000 7f6400e0f800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:54:50.652 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.650+0000 7f6400e0f800 20 zone default found 2023-12-03T11:54:50.652 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.650+0000 7f6400e0f800 4 Realm: () 2023-12-03T11:54:50.652 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.650+0000 7f6400e0f800 4 ZoneGroup: default (6a811aad-435d-4fdd-93c9-b7e0b50de429) 2023-12-03T11:54:50.652 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.650+0000 7f6400e0f800 4 Zone: default (83aabb46-04b5-4c96-9933-c6bfb1173a73) 2023-12-03T11:54:50.652 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.650+0000 7f6400e0f800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:54:50.652 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.650+0000 7f6400e0f800 20 zonegroup default 2023-12-03T11:54:50.653 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.650+0000 7f6400e0f800 20 rados->read ofs=0 len=0 2023-12-03T11:54:50.653 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.650+0000 7f6400e0f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:54:50.653 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.650+0000 7f6400e0f800 20 rados->read ofs=0 len=0 2023-12-03T11:54:50.653 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.651+0000 7f6400e0f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:54:50.653 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.651+0000 7f6400e0f800 20 rados->read ofs=0 len=0 2023-12-03T11:54:50.653 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.651+0000 7f6400e0f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:54:50.653 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.651+0000 7f6400e0f800 20 started sync module instance, tier type = 2023-12-03T11:54:50.653 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.651+0000 7f6400e0f800 20 started zone id=83aabb46-04b5-4c96-9933-c6bfb1173a73 (name=default) with tier type = 2023-12-03T11:54:50.658 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.657+0000 7f63fcc8d640 0 -- 172.21.15.3:0/3815072874 >> [v2:172.21.15.37:6816/3770469300,v1:172.21.15.37:6818/3770469300] conn(0x7f63f008b410 msgr2=0x7f63f005d120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-03T11:54:50.662 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.660+0000 7f6400e0f800 20 add_watcher() i=0 2023-12-03T11:54:50.662 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.660+0000 7f6400e0f800 20 add_watcher() i=1 2023-12-03T11:54:50.662 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.660+0000 7f6400e0f800 20 add_watcher() i=2 2023-12-03T11:54:50.662 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.660+0000 7f6400e0f800 20 add_watcher() i=3 2023-12-03T11:54:50.662 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.660+0000 7f6400e0f800 20 add_watcher() i=4 2023-12-03T11:54:50.662 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.660+0000 7f6400e0f800 20 add_watcher() i=5 2023-12-03T11:54:50.662 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.660+0000 7f6400e0f800 20 add_watcher() i=6 2023-12-03T11:54:50.663 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.661+0000 7f6400e0f800 20 add_watcher() i=7 2023-12-03T11:54:50.663 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.661+0000 7f6400e0f800 2 all 8 watchers are set, enabling cache 2023-12-03T11:54:50.665 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.663+0000 7f63c27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:54:50.665 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.664+0000 7f6400e0f800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:54:50.665 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.664+0000 7f6400e0f800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:54:50.709 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.707+0000 7f63317fa640 20 reqs_thread_entry: start 2023-12-03T11:54:50.709 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.707+0000 7f6400e0f800 20 init_complete bucket index max shards: 11 2023-12-03T11:54:50.709 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.707+0000 7f6400e0f800 20 Filter name: none 2023-12-03T11:54:50.709 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.707+0000 7f632affd640 20 reqs_thread_entry: start 2023-12-03T11:54:50.710 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.707+0000 7f6400e0f800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2023-12-03T11:54:50.713 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.708+0000 7f6400e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:50.713 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.709+0000 7f6400e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:50.713 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.709+0000 7f6400e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2023-12-03T11:54:50.713 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.709+0000 7f6400e0f800 20 garbage collection: RGWGC::process iterating over entry tag='2~3C6ue5506ySaikpestCPnftCe0LkjE6', time=2023-12-03T13:52:09.504874+0000, chain.objs.size()=5 2023-12-03T11:54:50.713 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.709+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.29__multipart_key1.2~3C6ue5506ySaikpestCPnftCe0LkjE6.1 2023-12-03T11:54:50.713 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.709+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.29__multipart_key1.2~3C6ue5506ySaikpestCPnftCe0LkjE6.2 2023-12-03T11:54:50.713 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.709+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.29__multipart_key1.2~3C6ue5506ySaikpestCPnftCe0LkjE6.3 2023-12-03T11:54:50.714 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.709+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.29__multipart_key1.2~3C6ue5506ySaikpestCPnftCe0LkjE6.4 2023-12-03T11:54:50.714 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.709+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.29__multipart_key1.2~3C6ue5506ySaikpestCPnftCe0LkjE6.5 2023-12-03T11:54:50.714 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.709+0000 7f6400e0f800 20 garbage collection: RGWGC::process iterating over entry tag='83aabb46-04b5-4c96-9933-c6bfb1173a73.4653.2923189093045071956', time=2023-12-03T13:53:55.154814+0000, chain.objs.size()=11 2023-12-03T11:54:50.714 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.709+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.44__multipart_key1.2~z9n5PYGodt_di8OB91em0KseAJhZpv3.1 2023-12-03T11:54:50.714 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.709+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.44__multipart_key1.2~z9n5PYGodt_di8OB91em0KseAJhZpv3.2 2023-12-03T11:54:50.714 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.709+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.44__multipart_key1.2~z9n5PYGodt_di8OB91em0KseAJhZpv3.3 2023-12-03T11:54:50.714 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.709+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.44__multipart_key1.2~z9n5PYGodt_di8OB91em0KseAJhZpv3.4 2023-12-03T11:54:50.715 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.710+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.44__multipart_key1.2~z9n5PYGodt_di8OB91em0KseAJhZpv3.5 2023-12-03T11:54:50.715 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.710+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.44__multipart_key1.2~z9n5PYGodt_di8OB91em0KseAJhZpv3.6 2023-12-03T11:54:50.715 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.710+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.44__multipart_key1.2~z9n5PYGodt_di8OB91em0KseAJhZpv3.7 2023-12-03T11:54:50.717 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.714+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.44__multipart_key1.2~z9n5PYGodt_di8OB91em0KseAJhZpv3.8 2023-12-03T11:54:50.717 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.714+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.44__multipart_key1.2~z9n5PYGodt_di8OB91em0KseAJhZpv3.9 2023-12-03T11:54:50.717 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.715+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.44__multipart_key1.2~z9n5PYGodt_di8OB91em0KseAJhZpv3.10 2023-12-03T11:54:50.717 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.715+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.44__multipart_key1.2~z9n5PYGodt_di8OB91em0KseAJhZpv3.11 2023-12-03T11:54:50.717 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.715+0000 7f6400e0f800 20 garbage collection: RGWGC::process iterating over entry tag='83aabb46-04b5-4c96-9933-c6bfb1173a73.4653.8494892397622673589', time=2023-12-03T13:54:49.853216+0000, chain.objs.size()=11 2023-12-03T11:54:50.717 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.715+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.55__multipart_key1.2~Au9J8U98nh1Vay2OOQ4nTyF5MCULM2d.1 2023-12-03T11:54:50.717 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.715+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.55__multipart_key1.2~Au9J8U98nh1Vay2OOQ4nTyF5MCULM2d.2 2023-12-03T11:54:50.718 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.715+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.55__multipart_key1.2~Au9J8U98nh1Vay2OOQ4nTyF5MCULM2d.3 2023-12-03T11:54:50.718 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.715+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.55__multipart_key1.2~Au9J8U98nh1Vay2OOQ4nTyF5MCULM2d.4 2023-12-03T11:54:50.718 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.715+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.55__multipart_key1.2~Au9J8U98nh1Vay2OOQ4nTyF5MCULM2d.5 2023-12-03T11:54:50.718 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.715+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.55__multipart_key1.2~Au9J8U98nh1Vay2OOQ4nTyF5MCULM2d.6 2023-12-03T11:54:50.718 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.715+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.55__multipart_key1.2~Au9J8U98nh1Vay2OOQ4nTyF5MCULM2d.7 2023-12-03T11:54:50.722 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.719+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.55__multipart_key1.2~Au9J8U98nh1Vay2OOQ4nTyF5MCULM2d.8 2023-12-03T11:54:50.722 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.720+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.55__multipart_key1.2~Au9J8U98nh1Vay2OOQ4nTyF5MCULM2d.9 2023-12-03T11:54:50.722 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.721+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.55__multipart_key1.2~Au9J8U98nh1Vay2OOQ4nTyF5MCULM2d.10 2023-12-03T11:54:50.722 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.721+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.55__multipart_key1.2~Au9J8U98nh1Vay2OOQ4nTyF5MCULM2d.11 2023-12-03T11:54:50.727 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.725+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:54:50.729 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.728+0000 7f6400e0f800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2023-12-03T11:54:50.730 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.729+0000 7f6400e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:50.731 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.730+0000 7f6400e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:50.731 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.730+0000 7f6400e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:50.732 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.731+0000 7f6400e0f800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2023-12-03T11:54:50.733 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.732+0000 7f6400e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:50.734 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.732+0000 7f6400e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:50.734 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.733+0000 7f6400e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2023-12-03T11:54:50.735 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.733+0000 7f6400e0f800 20 garbage collection: RGWGC::process iterating over entry tag='83aabb46-04b5-4c96-9933-c6bfb1173a73.4653.4416988752520514557', time=2023-12-03T13:53:06.597508+0000, chain.objs.size()=5 2023-12-03T11:54:50.735 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.733+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.36__multipart_key1.2~luKf-qUp3Gy0n-k60NxfJ6s5Lm9Txjx.1 2023-12-03T11:54:50.735 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.733+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.36__shadow_key1.2~luKf-qUp3Gy0n-k60NxfJ6s5Lm9Txjx.1_1 2023-12-03T11:54:50.735 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.733+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.36__multipart_key1.2~luKf-qUp3Gy0n-k60NxfJ6s5Lm9Txjx.2 2023-12-03T11:54:50.735 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.733+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.36__shadow_key1.2~luKf-qUp3Gy0n-k60NxfJ6s5Lm9Txjx.2_1 2023-12-03T11:54:50.735 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.733+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.36__multipart_key1.2~luKf-qUp3Gy0n-k60NxfJ6s5Lm9Txjx.3 2023-12-03T11:54:50.736 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.735+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:54:50.740 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.738+0000 7f6400e0f800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2023-12-03T11:54:50.741 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.740+0000 7f6400e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:50.742 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.740+0000 7f6400e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:50.742 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.740+0000 7f6400e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:50.743 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.741+0000 7f6400e0f800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2023-12-03T11:54:50.744 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.743+0000 7f6400e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:50.745 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.744+0000 7f6400e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:50.745 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.744+0000 7f6400e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2023-12-03T11:54:50.745 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.744+0000 7f6400e0f800 20 garbage collection: RGWGC::process iterating over entry tag='83aabb46-04b5-4c96-9933-c6bfb1173a73.4653.10622302853017644681', time=2023-12-03T13:52:59.672005+0000, chain.objs.size()=5 2023-12-03T11:54:50.745 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.744+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.36__multipart_key1.2~4rIncg-ysNbjZDI6BH5n-6n2UPQ1scf.1 2023-12-03T11:54:50.746 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.744+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.36__multipart_key1.2~4rIncg-ysNbjZDI6BH5n-6n2UPQ1scf.2 2023-12-03T11:54:50.746 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.744+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.36__multipart_key1.2~4rIncg-ysNbjZDI6BH5n-6n2UPQ1scf.3 2023-12-03T11:54:50.746 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.744+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.36__multipart_key1.2~4rIncg-ysNbjZDI6BH5n-6n2UPQ1scf.4 2023-12-03T11:54:50.746 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.744+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.36__multipart_key1.2~4rIncg-ysNbjZDI6BH5n-6n2UPQ1scf.5 2023-12-03T11:54:50.748 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.746+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:54:50.751 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.750+0000 7f6400e0f800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2023-12-03T11:54:50.752 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.751+0000 7f6400e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:50.753 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.751+0000 7f6400e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:50.753 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.752+0000 7f6400e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2023-12-03T11:54:50.753 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.752+0000 7f6400e0f800 20 garbage collection: RGWGC::process iterating over entry tag='83aabb46-04b5-4c96-9933-c6bfb1173a73.4653.6369698192760339288', time=2023-12-03T13:53:06.384725+0000, chain.objs.size()=5 2023-12-03T11:54:50.753 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.752+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.36__multipart_key1.2~iXZxgcq1JmBvmCBnnIAJP_xhRa6ywo4.1 2023-12-03T11:54:50.754 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.752+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.36__shadow_key1.2~iXZxgcq1JmBvmCBnnIAJP_xhRa6ywo4.1_1 2023-12-03T11:54:50.754 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.752+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.36__multipart_key1.2~iXZxgcq1JmBvmCBnnIAJP_xhRa6ywo4.2 2023-12-03T11:54:50.754 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.752+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.36__shadow_key1.2~iXZxgcq1JmBvmCBnnIAJP_xhRa6ywo4.2_1 2023-12-03T11:54:50.754 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.752+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.36__multipart_key1.2~iXZxgcq1JmBvmCBnnIAJP_xhRa6ywo4.3 2023-12-03T11:54:50.756 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.755+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:54:50.758 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.757+0000 7f6400e0f800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2023-12-03T11:54:50.760 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.759+0000 7f6400e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:50.760 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.759+0000 7f6400e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:50.761 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.759+0000 7f6400e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2023-12-03T11:54:50.761 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.759+0000 7f6400e0f800 20 garbage collection: RGWGC::process iterating over entry tag='83aabb46-04b5-4c96-9933-c6bfb1173a73.4653.3704318421061614064', time=2023-12-03T13:54:03.498934+0000, chain.objs.size()=10 2023-12-03T11:54:50.761 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.759+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.44__multipart_key1.2~kFvtIzprEbQl6f4nOvaQLnSDPDE-twq.1 2023-12-03T11:54:50.761 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.759+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.44__multipart_key1.2~kFvtIzprEbQl6f4nOvaQLnSDPDE-twq.2 2023-12-03T11:54:50.761 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.759+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.44__multipart_key1.2~kFvtIzprEbQl6f4nOvaQLnSDPDE-twq.3 2023-12-03T11:54:50.761 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.759+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.44__multipart_key1.2~kFvtIzprEbQl6f4nOvaQLnSDPDE-twq.4 2023-12-03T11:54:50.762 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.759+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.44__multipart_key1.2~kFvtIzprEbQl6f4nOvaQLnSDPDE-twq.5 2023-12-03T11:54:50.762 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.759+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.44__multipart_key1.2~kFvtIzprEbQl6f4nOvaQLnSDPDE-twq.6 2023-12-03T11:54:50.762 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.759+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.44__multipart_key1.2~kFvtIzprEbQl6f4nOvaQLnSDPDE-twq.7 2023-12-03T11:54:50.762 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.759+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.44__multipart_key1.2~kFvtIzprEbQl6f4nOvaQLnSDPDE-twq.8 2023-12-03T11:54:50.762 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.759+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.44__multipart_key1.2~kFvtIzprEbQl6f4nOvaQLnSDPDE-twq.9 2023-12-03T11:54:50.762 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.759+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.44__multipart_key1.2~kFvtIzprEbQl6f4nOvaQLnSDPDE-twq.10 2023-12-03T11:54:50.766 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.764+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:54:50.768 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.767+0000 7f6400e0f800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2023-12-03T11:54:50.770 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.769+0000 7f6400e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:50.770 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.769+0000 7f6400e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:50.771 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.769+0000 7f6400e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2023-12-03T11:54:50.771 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.769+0000 7f6400e0f800 20 garbage collection: RGWGC::process iterating over entry tag='83aabb46-04b5-4c96-9933-c6bfb1173a73.4653.15207857742331326759', time=2023-12-03T13:52:30.045348+0000, chain.objs.size()=5 2023-12-03T11:54:50.771 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.769+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.33__multipart_key1.2~xU2t18dw0MooZygTG4_rkUL4UGqdnco.1 2023-12-03T11:54:50.771 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.769+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.33__multipart_key1.2~xU2t18dw0MooZygTG4_rkUL4UGqdnco.2 2023-12-03T11:54:50.771 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.769+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.33__multipart_key1.2~xU2t18dw0MooZygTG4_rkUL4UGqdnco.3 2023-12-03T11:54:50.771 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.769+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.33__multipart_key1.2~xU2t18dw0MooZygTG4_rkUL4UGqdnco.4 2023-12-03T11:54:50.771 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.769+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.33__multipart_key1.2~xU2t18dw0MooZygTG4_rkUL4UGqdnco.5 2023-12-03T11:54:50.773 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.772+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:54:50.775 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.774+0000 7f6400e0f800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2023-12-03T11:54:50.776 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.775+0000 7f6400e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:50.777 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.776+0000 7f6400e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:50.777 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.776+0000 7f6400e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:50.778 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.777+0000 7f6400e0f800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2023-12-03T11:54:50.780 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.778+0000 7f6400e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:50.780 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.779+0000 7f6400e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:50.780 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.779+0000 7f6400e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:50.781 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.780+0000 7f6400e0f800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2023-12-03T11:54:50.783 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.781+0000 7f6400e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:50.783 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.782+0000 7f6400e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:50.784 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.782+0000 7f6400e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2023-12-03T11:54:50.784 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.782+0000 7f6400e0f800 20 garbage collection: RGWGC::process iterating over entry tag='83aabb46-04b5-4c96-9933-c6bfb1173a73.4653.2536324550842542253', time=2023-12-03T13:53:27.808300+0000, chain.objs.size()=5 2023-12-03T11:54:50.784 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.782+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.42__multipart_file.mpg.2~x6mh-IhnA38HeTEenCwVQ2-GpxEYvRH.1 2023-12-03T11:54:50.784 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.782+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.42__multipart_file.mpg.2~x6mh-IhnA38HeTEenCwVQ2-GpxEYvRH.2 2023-12-03T11:54:50.784 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.782+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.42__multipart_file.mpg.2~x6mh-IhnA38HeTEenCwVQ2-GpxEYvRH.3 2023-12-03T11:54:50.785 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.782+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.42__multipart_file.mpg.2~x6mh-IhnA38HeTEenCwVQ2-GpxEYvRH.4 2023-12-03T11:54:50.785 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.782+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.42__multipart_file.mpg.2~x6mh-IhnA38HeTEenCwVQ2-GpxEYvRH.5 2023-12-03T11:54:50.785 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.782+0000 7f6400e0f800 20 garbage collection: RGWGC::process iterating over entry tag='83aabb46-04b5-4c96-9933-c6bfb1173a73.4653.13246393889791766203', time=2023-12-03T13:54:21.031336+0000, chain.objs.size()=11 2023-12-03T11:54:50.785 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.782+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.44__multipart_key1.2~vgbYl9iT51K63p3ylND7rT6xpx_wo4S.1 2023-12-03T11:54:50.785 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.782+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.44__shadow_key1.2~vgbYl9iT51K63p3ylND7rT6xpx_wo4S.1_1 2023-12-03T11:54:50.785 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.782+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.44__multipart_key1.2~vgbYl9iT51K63p3ylND7rT6xpx_wo4S.2 2023-12-03T11:54:50.785 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.782+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.44__shadow_key1.2~vgbYl9iT51K63p3ylND7rT6xpx_wo4S.2_1 2023-12-03T11:54:50.786 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.782+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.44__multipart_key1.2~vgbYl9iT51K63p3ylND7rT6xpx_wo4S.3 2023-12-03T11:54:50.786 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.782+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.44__shadow_key1.2~vgbYl9iT51K63p3ylND7rT6xpx_wo4S.3_1 2023-12-03T11:54:50.786 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.782+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.44__multipart_key1.2~vgbYl9iT51K63p3ylND7rT6xpx_wo4S.4 2023-12-03T11:54:50.787 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.785+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.44__shadow_key1.2~vgbYl9iT51K63p3ylND7rT6xpx_wo4S.4_1 2023-12-03T11:54:50.787 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.785+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.44__multipart_key1.2~vgbYl9iT51K63p3ylND7rT6xpx_wo4S.5 2023-12-03T11:54:50.788 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.786+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.44__shadow_key1.2~vgbYl9iT51K63p3ylND7rT6xpx_wo4S.5_1 2023-12-03T11:54:50.788 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.786+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.44__multipart_key1.2~vgbYl9iT51K63p3ylND7rT6xpx_wo4S.6 2023-12-03T11:54:50.794 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.793+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:54:50.800 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.799+0000 7f6400e0f800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2023-12-03T11:54:50.801 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.800+0000 7f6400e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:50.801 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.800+0000 7f6400e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:50.802 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.801+0000 7f6400e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2023-12-03T11:54:50.802 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.801+0000 7f6400e0f800 20 garbage collection: RGWGC::process iterating over entry tag='83aabb46-04b5-4c96-9933-c6bfb1173a73.4653.9450899492966663483', time=2023-12-03T13:52:55.794768+0000, chain.objs.size()=5 2023-12-03T11:54:50.802 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.801+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.36__multipart_key1.2~JtpTO24d0A-nW4k9ggGwRzkH4FDF_S_.1 2023-12-03T11:54:50.803 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.801+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.36__multipart_key1.2~JtpTO24d0A-nW4k9ggGwRzkH4FDF_S_.2 2023-12-03T11:54:50.803 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.801+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.36__multipart_key1.2~JtpTO24d0A-nW4k9ggGwRzkH4FDF_S_.3 2023-12-03T11:54:50.803 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.801+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.36__multipart_key1.2~JtpTO24d0A-nW4k9ggGwRzkH4FDF_S_.4 2023-12-03T11:54:50.803 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.801+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.36__multipart_key1.2~JtpTO24d0A-nW4k9ggGwRzkH4FDF_S_.5 2023-12-03T11:54:50.803 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.801+0000 7f6400e0f800 20 garbage collection: RGWGC::process iterating over entry tag='83aabb46-04b5-4c96-9933-c6bfb1173a73.4653.13322092982262091692', time=2023-12-03T13:53:06.888560+0000, chain.objs.size()=4 2023-12-03T11:54:50.803 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.801+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.35__shadow_.m7xBPs-oB0jf05X-49BJeYbak6qnnZP_1 2023-12-03T11:54:50.803 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.801+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.35__shadow_.m7xBPs-oB0jf05X-49BJeYbak6qnnZP_2 2023-12-03T11:54:50.803 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.801+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.35__shadow_.m7xBPs-oB0jf05X-49BJeYbak6qnnZP_3 2023-12-03T11:54:50.803 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.801+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.35__shadow_.m7xBPs-oB0jf05X-49BJeYbak6qnnZP_4 2023-12-03T11:54:50.808 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.807+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:54:50.810 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.809+0000 7f6400e0f800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2023-12-03T11:54:50.812 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.810+0000 7f6400e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:50.812 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.811+0000 7f6400e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:50.813 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.811+0000 7f6400e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2023-12-03T11:54:50.813 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.811+0000 7f6400e0f800 20 garbage collection: RGWGC::process iterating over entry tag='83aabb46-04b5-4c96-9933-c6bfb1173a73.4653.12107802661614288385', time=2023-12-03T13:52:24.669915+0000, chain.objs.size()=5 2023-12-03T11:54:50.813 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.811+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.31__multipart_key1.2~z6Td9OUklowJyP9F07FbL1ODNy-OTdn.1 2023-12-03T11:54:50.814 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.811+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.31__multipart_key1.2~z6Td9OUklowJyP9F07FbL1ODNy-OTdn.2 2023-12-03T11:54:50.814 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.811+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.31__multipart_key1.2~z6Td9OUklowJyP9F07FbL1ODNy-OTdn.3 2023-12-03T11:54:50.814 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.811+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.31__multipart_key1.2~z6Td9OUklowJyP9F07FbL1ODNy-OTdn.4 2023-12-03T11:54:50.814 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.811+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.31__multipart_key1.2~z6Td9OUklowJyP9F07FbL1ODNy-OTdn.5 2023-12-03T11:54:50.814 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.811+0000 7f6400e0f800 20 garbage collection: RGWGC::process iterating over entry tag='83aabb46-04b5-4c96-9933-c6bfb1173a73.4653.7073235505442139603', time=2023-12-03T13:54:26.774280+0000, chain.objs.size()=5 2023-12-03T11:54:50.814 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.811+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.45__multipart_key1.2~Km2BD0BWhwM4cn-UKyUwviElZbHYuxw.1 2023-12-03T11:54:50.814 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.811+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.45__multipart_key1.2~Km2BD0BWhwM4cn-UKyUwviElZbHYuxw.2 2023-12-03T11:54:50.814 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.811+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.45__multipart_key1.2~Km2BD0BWhwM4cn-UKyUwviElZbHYuxw.3 2023-12-03T11:54:50.814 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.811+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.45__multipart_key1.2~Km2BD0BWhwM4cn-UKyUwviElZbHYuxw.4 2023-12-03T11:54:50.814 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.811+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.45__multipart_key1.2~Km2BD0BWhwM4cn-UKyUwviElZbHYuxw.5 2023-12-03T11:54:50.818 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.816+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:54:50.820 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.819+0000 7f6400e0f800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2023-12-03T11:54:50.822 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.821+0000 7f6400e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:50.823 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.821+0000 7f6400e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:50.823 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.821+0000 7f6400e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:50.824 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.823+0000 7f6400e0f800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2023-12-03T11:54:50.825 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.824+0000 7f6400e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:50.826 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.824+0000 7f6400e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:50.826 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.825+0000 7f6400e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:50.827 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.826+0000 7f6400e0f800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2023-12-03T11:54:50.828 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.827+0000 7f6400e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:50.829 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.827+0000 7f6400e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:50.830 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.828+0000 7f6400e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=10, truncated=0, next_marker='' 2023-12-03T11:54:50.830 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.828+0000 7f6400e0f800 20 garbage collection: RGWGC::process iterating over entry tag='83aabb46-04b5-4c96-9933-c6bfb1173a73.4653.950040222384950601', time=2023-12-03T13:53:03.163692+0000, chain.objs.size()=5 2023-12-03T11:54:50.830 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.828+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.36__multipart_key1.2~kn5VxN0YWi_uS2M04-mh9AnKmDSKOg-.1 2023-12-03T11:54:50.830 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.828+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.36__shadow_key1.2~kn5VxN0YWi_uS2M04-mh9AnKmDSKOg-.1_1 2023-12-03T11:54:50.830 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.828+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.36__multipart_key1.2~kn5VxN0YWi_uS2M04-mh9AnKmDSKOg-.2 2023-12-03T11:54:50.830 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.828+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.36__shadow_key1.2~kn5VxN0YWi_uS2M04-mh9AnKmDSKOg-.2_1 2023-12-03T11:54:50.830 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.828+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.36__multipart_key1.2~kn5VxN0YWi_uS2M04-mh9AnKmDSKOg-.3 2023-12-03T11:54:50.831 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.828+0000 7f6400e0f800 20 garbage collection: RGWGC::process iterating over entry tag='83aabb46-04b5-4c96-9933-c6bfb1173a73.4653.17031072492927215275', time=2023-12-03T13:53:27.874143+0000, chain.objs.size()=5 2023-12-03T11:54:50.831 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.828+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.42__multipart_file2.mpg.2~kfok3kVXFKq2wdmFLs_qsAeljrJkaYb.1 2023-12-03T11:54:50.831 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.828+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.42__multipart_file2.mpg.2~kfok3kVXFKq2wdmFLs_qsAeljrJkaYb.2 2023-12-03T11:54:50.831 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.828+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.42__multipart_file2.mpg.2~kfok3kVXFKq2wdmFLs_qsAeljrJkaYb.3 2023-12-03T11:54:50.831 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.828+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.42__multipart_file2.mpg.2~kfok3kVXFKq2wdmFLs_qsAeljrJkaYb.4 2023-12-03T11:54:50.831 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.828+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.42__multipart_file2.mpg.2~kfok3kVXFKq2wdmFLs_qsAeljrJkaYb.5 2023-12-03T11:54:50.831 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.828+0000 7f6400e0f800 20 garbage collection: RGWGC::process iterating over entry tag='2~ElRGHnW9pN_qSBAS2TNt_fW3kRH7ysY', time=2023-12-03T13:54:36.124409+0000, chain.objs.size()=1 2023-12-03T11:54:50.831 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.828+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.47__multipart_key1.2~ElRGHnW9pN_qSBAS2TNt_fW3kRH7ysY.14 2023-12-03T11:54:50.831 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.828+0000 7f6400e0f800 20 garbage collection: RGWGC::process iterating over entry tag='2~ElRGHnW9pN_qSBAS2TNt_fW3kRH7ysY', time=2023-12-03T13:54:36.333481+0000, chain.objs.size()=1 2023-12-03T11:54:50.831 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.828+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.47__multipart_key1.2~ElRGHnW9pN_qSBAS2TNt_fW3kRH7ysY.15 2023-12-03T11:54:50.833 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.831+0000 7f6400e0f800 20 garbage collection: RGWGC::process iterating over entry tag='2~ElRGHnW9pN_qSBAS2TNt_fW3kRH7ysY', time=2023-12-03T13:54:36.389185+0000, chain.objs.size()=1 2023-12-03T11:54:50.833 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.831+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.47__multipart_key1.2~ElRGHnW9pN_qSBAS2TNt_fW3kRH7ysY.16 2023-12-03T11:54:50.833 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.831+0000 7f6400e0f800 20 garbage collection: RGWGC::process iterating over entry tag='2~ElRGHnW9pN_qSBAS2TNt_fW3kRH7ysY', time=2023-12-03T13:54:36.435869+0000, chain.objs.size()=1 2023-12-03T11:54:50.833 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.831+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.47__multipart_key1.2~ElRGHnW9pN_qSBAS2TNt_fW3kRH7ysY.17 2023-12-03T11:54:50.833 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.831+0000 7f6400e0f800 20 garbage collection: RGWGC::process iterating over entry tag='2~ElRGHnW9pN_qSBAS2TNt_fW3kRH7ysY', time=2023-12-03T13:54:36.455085+0000, chain.objs.size()=1 2023-12-03T11:54:50.833 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.831+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.47__multipart_key1.2~ElRGHnW9pN_qSBAS2TNt_fW3kRH7ysY.18 2023-12-03T11:54:50.833 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.831+0000 7f6400e0f800 20 garbage collection: RGWGC::process iterating over entry tag='2~ElRGHnW9pN_qSBAS2TNt_fW3kRH7ysY', time=2023-12-03T13:54:36.534706+0000, chain.objs.size()=1 2023-12-03T11:54:50.833 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.831+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.47__multipart_key1.2~ElRGHnW9pN_qSBAS2TNt_fW3kRH7ysY.19 2023-12-03T11:54:50.833 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.831+0000 7f6400e0f800 20 garbage collection: RGWGC::process iterating over entry tag='2~ElRGHnW9pN_qSBAS2TNt_fW3kRH7ysY', time=2023-12-03T13:54:36.627059+0000, chain.objs.size()=1 2023-12-03T11:54:50.833 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.831+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.47__multipart_key1.2~ElRGHnW9pN_qSBAS2TNt_fW3kRH7ysY.20 2023-12-03T11:54:50.834 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.832+0000 7f6400e0f800 20 garbage collection: RGWGC::process iterating over entry tag='2~ElRGHnW9pN_qSBAS2TNt_fW3kRH7ysY', time=2023-12-03T13:54:36.796872+0000, chain.objs.size()=46 2023-12-03T11:54:50.834 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.832+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.47__multipart_key1.2~ElRGHnW9pN_qSBAS2TNt_fW3kRH7ysY.1 2023-12-03T11:54:50.834 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.832+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.47__multipart_key1.2~ElRGHnW9pN_qSBAS2TNt_fW3kRH7ysY.2 2023-12-03T11:54:50.834 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.832+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.47__multipart_key1.2~ElRGHnW9pN_qSBAS2TNt_fW3kRH7ysY.3 2023-12-03T11:54:50.835 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.833+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.47__multipart_key1.2~ElRGHnW9pN_qSBAS2TNt_fW3kRH7ysY.4 2023-12-03T11:54:50.835 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.833+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.47__multipart_key1.2~ElRGHnW9pN_qSBAS2TNt_fW3kRH7ysY.5 2023-12-03T11:54:50.835 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.833+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.47__multipart_key1.2~ElRGHnW9pN_qSBAS2TNt_fW3kRH7ysY.6 2023-12-03T11:54:50.837 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.836+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.47__multipart_key1.2~ElRGHnW9pN_qSBAS2TNt_fW3kRH7ysY.7 2023-12-03T11:54:50.840 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.838+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.47__multipart_key1.2~ElRGHnW9pN_qSBAS2TNt_fW3kRH7ysY.8 2023-12-03T11:54:50.840 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.838+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.47__multipart_key1.2~ElRGHnW9pN_qSBAS2TNt_fW3kRH7ysY.9 2023-12-03T11:54:50.840 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.838+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.47__multipart_key1.2~ElRGHnW9pN_qSBAS2TNt_fW3kRH7ysY.10 2023-12-03T11:54:50.840 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.838+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.47__multipart_key1.2~ElRGHnW9pN_qSBAS2TNt_fW3kRH7ysY.11 2023-12-03T11:54:50.840 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.838+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.47__multipart_key1.2~ElRGHnW9pN_qSBAS2TNt_fW3kRH7ysY.12 2023-12-03T11:54:50.840 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.838+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.47__multipart_key1.2~ElRGHnW9pN_qSBAS2TNt_fW3kRH7ysY.13 2023-12-03T11:54:50.841 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.838+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.47__multipart_key1.KtlJtL29IocfDhEz3k-fvT2rfyGe7o-G.14 2023-12-03T11:54:50.842 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.840+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.47__multipart_key1.ZHx9jPcJElJdR1EcXjdsfbOAqkg2XibB.15 2023-12-03T11:54:50.842 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.840+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.47__multipart_key1.oefR52D8kCtTZsEmdZG_i9xCNC1PFlmI.16 2023-12-03T11:54:50.842 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.840+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.47__multipart_key1.jMkDHzQejk1iovQOXy9WVTuSSplv3NXn.17 2023-12-03T11:54:50.842 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.840+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.47__multipart_key1.9GR9IFOaPGiDY2VqdgP6nBzdThyzr5W3.18 2023-12-03T11:54:50.843 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.841+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.47__multipart_key1.dIpJEaSJJc_9X-NAwG89tbe-BP25xSlQ.19 2023-12-03T11:54:50.847 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.845+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.47__multipart_key1.EP6yy5F9UcK0XJ7I1E0IXrw3MeOK7FyE.20 2023-12-03T11:54:50.847 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.845+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.47__multipart_key1.2~ElRGHnW9pN_qSBAS2TNt_fW3kRH7ysY.21 2023-12-03T11:54:50.847 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.845+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.47__multipart_key1.2~ElRGHnW9pN_qSBAS2TNt_fW3kRH7ysY.22 2023-12-03T11:54:50.847 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.845+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.47__multipart_key1.2~ElRGHnW9pN_qSBAS2TNt_fW3kRH7ysY.23 2023-12-03T11:54:50.847 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.845+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.47__multipart_key1.2~ElRGHnW9pN_qSBAS2TNt_fW3kRH7ysY.24 2023-12-03T11:54:50.847 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.845+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.47__multipart_key1.2~ElRGHnW9pN_qSBAS2TNt_fW3kRH7ysY.25 2023-12-03T11:54:50.847 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.845+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.47__multipart_key1.2~ElRGHnW9pN_qSBAS2TNt_fW3kRH7ysY.26 2023-12-03T11:54:50.849 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.848+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.47__multipart_key1.2~ElRGHnW9pN_qSBAS2TNt_fW3kRH7ysY.27 2023-12-03T11:54:50.850 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.848+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.47__multipart_key1.2~ElRGHnW9pN_qSBAS2TNt_fW3kRH7ysY.28 2023-12-03T11:54:50.850 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.848+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.47__multipart_key1.2~ElRGHnW9pN_qSBAS2TNt_fW3kRH7ysY.29 2023-12-03T11:54:50.850 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.848+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.47__multipart_key1.2~ElRGHnW9pN_qSBAS2TNt_fW3kRH7ysY.30 2023-12-03T11:54:50.851 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.849+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.47__multipart_key1.2~ElRGHnW9pN_qSBAS2TNt_fW3kRH7ysY.31 2023-12-03T11:54:50.851 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.849+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.47__multipart_key1.2~ElRGHnW9pN_qSBAS2TNt_fW3kRH7ysY.32 2023-12-03T11:54:50.851 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.850+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.47__multipart_key1.2~ElRGHnW9pN_qSBAS2TNt_fW3kRH7ysY.33 2023-12-03T11:54:50.851 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.850+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.47__multipart_key1.2~ElRGHnW9pN_qSBAS2TNt_fW3kRH7ysY.34 2023-12-03T11:54:50.851 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.850+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.47__multipart_key1.2~ElRGHnW9pN_qSBAS2TNt_fW3kRH7ysY.35 2023-12-03T11:54:50.851 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.850+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.47__multipart_key1.2~ElRGHnW9pN_qSBAS2TNt_fW3kRH7ysY.36 2023-12-03T11:54:50.851 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.850+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.47__multipart_key1.2~ElRGHnW9pN_qSBAS2TNt_fW3kRH7ysY.37 2023-12-03T11:54:50.854 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.853+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.47__multipart_key1.2~ElRGHnW9pN_qSBAS2TNt_fW3kRH7ysY.38 2023-12-03T11:54:50.855 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.853+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.47__multipart_key1.2~ElRGHnW9pN_qSBAS2TNt_fW3kRH7ysY.39 2023-12-03T11:54:50.855 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.853+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.47__multipart_key1.2~ElRGHnW9pN_qSBAS2TNt_fW3kRH7ysY.40 2023-12-03T11:54:50.855 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.853+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.47__multipart_key1.2~ElRGHnW9pN_qSBAS2TNt_fW3kRH7ysY.41 2023-12-03T11:54:50.855 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.853+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.47__multipart_key1.2~ElRGHnW9pN_qSBAS2TNt_fW3kRH7ysY.42 2023-12-03T11:54:50.856 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.855+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.47__multipart_key1.2~ElRGHnW9pN_qSBAS2TNt_fW3kRH7ysY.43 2023-12-03T11:54:50.858 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.857+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.47__multipart_key1.2~ElRGHnW9pN_qSBAS2TNt_fW3kRH7ysY.44 2023-12-03T11:54:50.858 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.857+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.47__multipart_key1.2~ElRGHnW9pN_qSBAS2TNt_fW3kRH7ysY.45 2023-12-03T11:54:50.858 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.857+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.47__multipart_key1.2~ElRGHnW9pN_qSBAS2TNt_fW3kRH7ysY.47 2023-12-03T11:54:50.861 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.860+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:54:50.863 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.862+0000 7f6400e0f800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2023-12-03T11:54:50.865 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.864+0000 7f6400e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:50.865 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.864+0000 7f6400e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:50.866 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.865+0000 7f6400e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:50.870 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.866+0000 7f6400e0f800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2023-12-03T11:54:50.870 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.867+0000 7f6400e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:50.870 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.867+0000 7f6400e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:50.870 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.867+0000 7f6400e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:50.870 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.868+0000 7f6400e0f800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2023-12-03T11:54:50.871 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.870+0000 7f6400e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:50.872 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.871+0000 7f6400e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:50.873 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.871+0000 7f6400e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2023-12-03T11:54:50.873 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.871+0000 7f6400e0f800 20 garbage collection: RGWGC::process iterating over entry tag='83aabb46-04b5-4c96-9933-c6bfb1173a73.4653.9871194559125658799', time=2023-12-03T13:52:42.511553+0000, chain.objs.size()=5 2023-12-03T11:54:50.873 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.871+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.36__multipart_key1.2~gKyPNaTUNGHZnAPkYVJ7MCx4utmBAD6.1 2023-12-03T11:54:50.873 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.871+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.36__multipart_key1.2~gKyPNaTUNGHZnAPkYVJ7MCx4utmBAD6.2 2023-12-03T11:54:50.873 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.871+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.36__multipart_key1.2~gKyPNaTUNGHZnAPkYVJ7MCx4utmBAD6.3 2023-12-03T11:54:50.873 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.871+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.36__multipart_key1.2~gKyPNaTUNGHZnAPkYVJ7MCx4utmBAD6.4 2023-12-03T11:54:50.873 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.871+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.36__multipart_key1.2~gKyPNaTUNGHZnAPkYVJ7MCx4utmBAD6.5 2023-12-03T11:54:50.876 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.875+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:54:50.879 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.878+0000 7f6400e0f800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2023-12-03T11:54:50.880 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.879+0000 7f6400e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:50.881 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.879+0000 7f6400e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:50.881 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.880+0000 7f6400e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2023-12-03T11:54:50.881 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.880+0000 7f6400e0f800 20 garbage collection: RGWGC::process iterating over entry tag='83aabb46-04b5-4c96-9933-c6bfb1173a73.4653.14933398508519273833', time=2023-12-03T13:53:12.192281+0000, chain.objs.size()=5 2023-12-03T11:54:50.881 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.880+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.40__multipart_key1.2~l3hR8HyMXHA53wbnycJegmLo94nW-5p.1 2023-12-03T11:54:50.881 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.880+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.40__multipart_key1.2~l3hR8HyMXHA53wbnycJegmLo94nW-5p.2 2023-12-03T11:54:50.881 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.880+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.40__multipart_key1.2~l3hR8HyMXHA53wbnycJegmLo94nW-5p.3 2023-12-03T11:54:50.882 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.880+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.40__multipart_key1.2~l3hR8HyMXHA53wbnycJegmLo94nW-5p.4 2023-12-03T11:54:50.882 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.880+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.40__multipart_key1.2~l3hR8HyMXHA53wbnycJegmLo94nW-5p.5 2023-12-03T11:54:50.888 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.887+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:54:50.890 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.889+0000 7f6400e0f800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2023-12-03T11:54:50.891 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.890+0000 7f6400e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:50.892 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.891+0000 7f6400e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:50.892 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.891+0000 7f6400e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:50.893 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.892+0000 7f6400e0f800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2023-12-03T11:54:50.894 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.893+0000 7f6400e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:50.895 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.894+0000 7f6400e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:50.895 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.894+0000 7f6400e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:50.896 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.895+0000 7f6400e0f800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2023-12-03T11:54:50.897 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.896+0000 7f6400e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:50.898 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.897+0000 7f6400e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:50.899 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.897+0000 7f6400e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2023-12-03T11:54:50.899 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.897+0000 7f6400e0f800 20 garbage collection: RGWGC::process iterating over entry tag='83aabb46-04b5-4c96-9933-c6bfb1173a73.4653.2961977899069665314', time=2023-12-03T13:53:46.727028+0000, chain.objs.size()=11 2023-12-03T11:54:50.899 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.897+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.44__multipart_key1.2~Zai4xDspZcUGDSKr4xYJJJHl_Xu2ORd.1 2023-12-03T11:54:50.899 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.897+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.44__multipart_key1.2~Zai4xDspZcUGDSKr4xYJJJHl_Xu2ORd.2 2023-12-03T11:54:50.899 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.897+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.44__multipart_key1.2~Zai4xDspZcUGDSKr4xYJJJHl_Xu2ORd.3 2023-12-03T11:54:50.899 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.897+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.44__multipart_key1.2~Zai4xDspZcUGDSKr4xYJJJHl_Xu2ORd.4 2023-12-03T11:54:50.899 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.897+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.44__multipart_key1.2~Zai4xDspZcUGDSKr4xYJJJHl_Xu2ORd.5 2023-12-03T11:54:50.899 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.897+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.44__multipart_key1.2~Zai4xDspZcUGDSKr4xYJJJHl_Xu2ORd.6 2023-12-03T11:54:50.899 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.897+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.44__multipart_key1.2~Zai4xDspZcUGDSKr4xYJJJHl_Xu2ORd.7 2023-12-03T11:54:50.899 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.897+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.44__multipart_key1.2~Zai4xDspZcUGDSKr4xYJJJHl_Xu2ORd.8 2023-12-03T11:54:50.899 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.897+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.44__multipart_key1.2~Zai4xDspZcUGDSKr4xYJJJHl_Xu2ORd.9 2023-12-03T11:54:50.899 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.897+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.44__multipart_key1.2~Zai4xDspZcUGDSKr4xYJJJHl_Xu2ORd.10 2023-12-03T11:54:50.899 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.897+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.44__multipart_key1.2~Zai4xDspZcUGDSKr4xYJJJHl_Xu2ORd.11 2023-12-03T11:54:50.903 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.902+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:54:50.908 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.907+0000 7f6400e0f800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2023-12-03T11:54:50.909 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.908+0000 7f6400e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:50.910 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.909+0000 7f6400e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:50.910 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.909+0000 7f6400e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2023-12-03T11:54:50.910 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.909+0000 7f6400e0f800 20 garbage collection: RGWGC::process iterating over entry tag='83aabb46-04b5-4c96-9933-c6bfb1173a73.4653.168006111625000568', time=2023-12-03T13:53:19.023094+0000, chain.objs.size()=5 2023-12-03T11:54:50.910 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.909+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.41__multipart_key1.2~Mh64XASGU0sJgOfSdKCy9uk5PsUOfqS.1 2023-12-03T11:54:50.911 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.909+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.41__multipart_key1.2~Mh64XASGU0sJgOfSdKCy9uk5PsUOfqS.2 2023-12-03T11:54:50.911 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.909+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.41__multipart_key1.2~Mh64XASGU0sJgOfSdKCy9uk5PsUOfqS.3 2023-12-03T11:54:50.911 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.909+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.41__multipart_key1.2~Mh64XASGU0sJgOfSdKCy9uk5PsUOfqS.4 2023-12-03T11:54:50.911 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.909+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.41__multipart_key1.2~Mh64XASGU0sJgOfSdKCy9uk5PsUOfqS.5 2023-12-03T11:54:50.914 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.912+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:54:50.916 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.915+0000 7f6400e0f800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2023-12-03T11:54:50.917 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.916+0000 7f6400e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:50.918 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.917+0000 7f6400e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:50.918 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.917+0000 7f6400e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:50.919 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.918+0000 7f6400e0f800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2023-12-03T11:54:50.920 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.919+0000 7f6400e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:50.921 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.920+0000 7f6400e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:50.921 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.920+0000 7f6400e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2023-12-03T11:54:50.921 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.920+0000 7f6400e0f800 20 garbage collection: RGWGC::process iterating over entry tag='83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.33__multipart_key1.2~xU2t18dw0MooZygTG4_rkUL4UGqdnco.2_40e663be86fecf9a559d21ef83f94f40', time=2023-12-03T13:52:30.336121+0000, chain.objs.size()=5 2023-12-03T11:54:50.922 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.920+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.33__multipart_key1.2~xU2t18dw0MooZygTG4_rkUL4UGqdnco.1 2023-12-03T11:54:50.922 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.920+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.33__multipart_key1.2~xU2t18dw0MooZygTG4_rkUL4UGqdnco.2 2023-12-03T11:54:50.922 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.920+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.33__multipart_key1.2~xU2t18dw0MooZygTG4_rkUL4UGqdnco.3 2023-12-03T11:54:50.922 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.920+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.33__multipart_key1.2~xU2t18dw0MooZygTG4_rkUL4UGqdnco.4 2023-12-03T11:54:50.922 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.920+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.33__multipart_key1.2~xU2t18dw0MooZygTG4_rkUL4UGqdnco.5 2023-12-03T11:54:50.923 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.922+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:54:50.925 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.924+0000 7f6400e0f800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2023-12-03T11:54:50.926 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.925+0000 7f6400e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:50.927 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.925+0000 7f6400e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:50.927 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.926+0000 7f6400e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:50.928 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.927+0000 7f6400e0f800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2023-12-03T11:54:50.929 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.928+0000 7f6400e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:50.930 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.929+0000 7f6400e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:50.930 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.929+0000 7f6400e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:50.931 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.930+0000 7f6400e0f800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2023-12-03T11:54:50.933 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.931+0000 7f6400e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:50.933 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.932+0000 7f6400e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:50.933 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.932+0000 7f6400e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2023-12-03T11:54:50.934 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.932+0000 7f6400e0f800 20 garbage collection: RGWGC::process iterating over entry tag='83aabb46-04b5-4c96-9933-c6bfb1173a73.4653.10940056359542456126', time=2023-12-03T13:54:30.992845+0000, chain.objs.size()=5 2023-12-03T11:54:50.934 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.932+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.46__multipart_key1.2~E92D6TFG9hMCEQcfkLB_6KylK13aEic.1 2023-12-03T11:54:50.934 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.932+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.46__multipart_key1.2~E92D6TFG9hMCEQcfkLB_6KylK13aEic.2 2023-12-03T11:54:50.934 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.932+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.46__multipart_key1.2~E92D6TFG9hMCEQcfkLB_6KylK13aEic.3 2023-12-03T11:54:50.934 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.932+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.46__multipart_key1.2~E92D6TFG9hMCEQcfkLB_6KylK13aEic.4 2023-12-03T11:54:50.934 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.932+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.46__multipart_key1.2~E92D6TFG9hMCEQcfkLB_6KylK13aEic.5 2023-12-03T11:54:50.936 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.934+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:54:50.939 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.938+0000 7f6400e0f800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2023-12-03T11:54:50.940 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.939+0000 7f6400e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:50.940 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.939+0000 7f6400e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:50.941 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.940+0000 7f6400e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:50.942 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.941+0000 7f6400e0f800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2023-12-03T11:54:50.943 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.942+0000 7f6400e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:50.944 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.943+0000 7f6400e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:50.944 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.943+0000 7f6400e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:50.945 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.944+0000 7f6400e0f800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2023-12-03T11:54:50.946 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.945+0000 7f6400e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:50.947 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.946+0000 7f6400e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:50.948 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.946+0000 7f6400e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2023-12-03T11:54:50.948 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.946+0000 7f6400e0f800 20 garbage collection: RGWGC::process iterating over entry tag='83aabb46-04b5-4c96-9933-c6bfb1173a73.4653.301620890410775669', time=2023-12-03T13:54:12.601465+0000, chain.objs.size()=11 2023-12-03T11:54:50.948 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.946+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.44__multipart_key1.2~pj0OZsQaEGRENkl0w4yC1fb1N8azRDs.1 2023-12-03T11:54:50.948 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.946+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.44__shadow_key1.2~pj0OZsQaEGRENkl0w4yC1fb1N8azRDs.1_1 2023-12-03T11:54:50.948 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.946+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.44__multipart_key1.2~pj0OZsQaEGRENkl0w4yC1fb1N8azRDs.2 2023-12-03T11:54:50.948 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.946+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.44__shadow_key1.2~pj0OZsQaEGRENkl0w4yC1fb1N8azRDs.2_1 2023-12-03T11:54:50.949 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.946+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.44__multipart_key1.2~pj0OZsQaEGRENkl0w4yC1fb1N8azRDs.3 2023-12-03T11:54:50.949 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.946+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.44__shadow_key1.2~pj0OZsQaEGRENkl0w4yC1fb1N8azRDs.3_1 2023-12-03T11:54:50.949 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.946+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.44__multipart_key1.2~pj0OZsQaEGRENkl0w4yC1fb1N8azRDs.4 2023-12-03T11:54:50.949 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.946+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.44__shadow_key1.2~pj0OZsQaEGRENkl0w4yC1fb1N8azRDs.4_1 2023-12-03T11:54:50.949 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.946+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.44__multipart_key1.2~pj0OZsQaEGRENkl0w4yC1fb1N8azRDs.5 2023-12-03T11:54:50.949 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.946+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.44__shadow_key1.2~pj0OZsQaEGRENkl0w4yC1fb1N8azRDs.5_1 2023-12-03T11:54:50.949 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.946+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.44__multipart_key1.2~pj0OZsQaEGRENkl0w4yC1fb1N8azRDs.6 2023-12-03T11:54:50.949 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.946+0000 7f6400e0f800 20 garbage collection: RGWGC::process iterating over entry tag='83aabb46-04b5-4c96-9933-c6bfb1173a73.4653.12591398432537500908', time=2023-12-03T13:54:20.817623+0000, chain.objs.size()=11 2023-12-03T11:54:50.949 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.946+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.44__multipart_key1.2~hlbx5veNux9pibN4fswUMPv35Gvnrb_.1 2023-12-03T11:54:50.951 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.950+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.44__shadow_key1.2~hlbx5veNux9pibN4fswUMPv35Gvnrb_.1_1 2023-12-03T11:54:50.952 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.950+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.44__multipart_key1.2~hlbx5veNux9pibN4fswUMPv35Gvnrb_.2 2023-12-03T11:54:50.954 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.953+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.44__shadow_key1.2~hlbx5veNux9pibN4fswUMPv35Gvnrb_.2_1 2023-12-03T11:54:50.955 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.953+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.44__multipart_key1.2~hlbx5veNux9pibN4fswUMPv35Gvnrb_.3 2023-12-03T11:54:50.955 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.953+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.44__shadow_key1.2~hlbx5veNux9pibN4fswUMPv35Gvnrb_.3_1 2023-12-03T11:54:50.955 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.953+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.44__multipart_key1.2~hlbx5veNux9pibN4fswUMPv35Gvnrb_.4 2023-12-03T11:54:50.955 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.953+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.44__shadow_key1.2~hlbx5veNux9pibN4fswUMPv35Gvnrb_.4_1 2023-12-03T11:54:50.955 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.953+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.44__multipart_key1.2~hlbx5veNux9pibN4fswUMPv35Gvnrb_.5 2023-12-03T11:54:50.955 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.953+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.44__shadow_key1.2~hlbx5veNux9pibN4fswUMPv35Gvnrb_.5_1 2023-12-03T11:54:50.955 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.953+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.44__multipart_key1.2~hlbx5veNux9pibN4fswUMPv35Gvnrb_.6 2023-12-03T11:54:50.960 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.958+0000 7f6400e0f800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:54:50.963 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.962+0000 7f63c27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:54:50.965 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.964+0000 7f6400e0f800 20 remove_watcher() i=0 2023-12-03T11:54:50.965 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.964+0000 7f6400e0f800 2 removed watcher, disabling cache 2023-12-03T11:54:50.966 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.965+0000 7f6400e0f800 20 remove_watcher() i=1 2023-12-03T11:54:50.967 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.966+0000 7f6400e0f800 20 remove_watcher() i=2 2023-12-03T11:54:50.968 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.967+0000 7f6400e0f800 20 remove_watcher() i=3 2023-12-03T11:54:50.970 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.969+0000 7f6400e0f800 20 remove_watcher() i=4 2023-12-03T11:54:50.971 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.970+0000 7f6400e0f800 20 remove_watcher() i=5 2023-12-03T11:54:50.972 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.971+0000 7f6400e0f800 20 remove_watcher() i=6 2023-12-03T11:54:50.973 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:50.972+0000 7f6400e0f800 20 remove_watcher() i=7 2023-12-03T11:54:50.978 DEBUG:teuthology.orchestra.run.smithi003:> radosgw-admin gc process --include-all 2023-12-03T11:54:51.028 INFO:teuthology.orchestra.run.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:54:51.028 INFO:teuthology.orchestra.run.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:54:51.042 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.041+0000 7ff854f11800 20 rados->read ofs=0 len=0 2023-12-03T11:54:51.044 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.043+0000 7ff854f11800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:54:51.045 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.043+0000 7ff854f11800 20 realm 2023-12-03T11:54:51.045 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.043+0000 7ff854f11800 20 rados->read ofs=0 len=0 2023-12-03T11:54:51.045 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.043+0000 7ff854f11800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:54:51.045 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.043+0000 7ff854f11800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:54:51.045 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.043+0000 7ff854f11800 20 rados->read ofs=0 len=0 2023-12-03T11:54:51.045 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.043+0000 7ff854f11800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:54:51.045 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.043+0000 7ff854f11800 20 rados->read ofs=0 len=0 2023-12-03T11:54:51.045 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.044+0000 7ff854f11800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:54:51.045 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.044+0000 7ff854f11800 20 rados->read ofs=0 len=0 2023-12-03T11:54:51.046 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.045+0000 7ff854f11800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:54:51.046 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.045+0000 7ff854f11800 20 searching for the correct realm 2023-12-03T11:54:51.056 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.055+0000 7ff852a11640 0 -- 172.21.15.3:0/417580812 >> [v2:172.21.15.37:6805/1692844418,v1:172.21.15.37:6807/1692844418] conn(0x55b2bb6302c0 msgr2=0x55b2bb6326f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-03T11:54:51.057 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.056+0000 7ff854f11800 20 RGWRados::pool_iterate: got zone_info.83aabb46-04b5-4c96-9933-c6bfb1173a73 2023-12-03T11:54:51.057 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.056+0000 7ff854f11800 20 RGWRados::pool_iterate: got zonegroup_info.6a811aad-435d-4fdd-93c9-b7e0b50de429 2023-12-03T11:54:51.057 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.056+0000 7ff854f11800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:54:51.057 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.056+0000 7ff854f11800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:54:51.058 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.056+0000 7ff854f11800 20 rados->read ofs=0 len=0 2023-12-03T11:54:51.058 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.056+0000 7ff854f11800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:54:51.058 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.056+0000 7ff854f11800 20 rados->read ofs=0 len=0 2023-12-03T11:54:51.059 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.056+0000 7ff854f11800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:54:51.059 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.056+0000 7ff854f11800 20 rados->read ofs=0 len=0 2023-12-03T11:54:51.059 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.057+0000 7ff854f11800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:54:51.059 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.057+0000 7ff854f11800 20 zone default found 2023-12-03T11:54:51.059 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.057+0000 7ff854f11800 4 Realm: () 2023-12-03T11:54:51.059 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.057+0000 7ff854f11800 4 ZoneGroup: default (6a811aad-435d-4fdd-93c9-b7e0b50de429) 2023-12-03T11:54:51.059 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.057+0000 7ff854f11800 4 Zone: default (83aabb46-04b5-4c96-9933-c6bfb1173a73) 2023-12-03T11:54:51.059 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.057+0000 7ff854f11800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:54:51.059 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.057+0000 7ff854f11800 20 zonegroup default 2023-12-03T11:54:51.059 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.057+0000 7ff854f11800 20 rados->read ofs=0 len=0 2023-12-03T11:54:51.060 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.057+0000 7ff854f11800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:54:51.060 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.057+0000 7ff854f11800 20 rados->read ofs=0 len=0 2023-12-03T11:54:51.060 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.057+0000 7ff854f11800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:54:51.060 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.057+0000 7ff854f11800 20 rados->read ofs=0 len=0 2023-12-03T11:54:51.060 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.057+0000 7ff854f11800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:54:51.060 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.057+0000 7ff854f11800 20 started sync module instance, tier type = 2023-12-03T11:54:51.060 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.058+0000 7ff854f11800 20 started zone id=83aabb46-04b5-4c96-9933-c6bfb1173a73 (name=default) with tier type = 2023-12-03T11:54:51.066 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.065+0000 7ff852210640 0 -- 172.21.15.3:0/417580812 >> [v2:172.21.15.3:6817/3356208405,v1:172.21.15.3:6819/3356208405] conn(0x55b2bb6352e0 msgr2=0x55b2bb6376d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:54:51.068 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.067+0000 7ff854f11800 20 add_watcher() i=0 2023-12-03T11:54:51.069 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.067+0000 7ff854f11800 20 add_watcher() i=1 2023-12-03T11:54:51.069 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.067+0000 7ff854f11800 20 add_watcher() i=2 2023-12-03T11:54:51.069 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.067+0000 7ff854f11800 20 add_watcher() i=3 2023-12-03T11:54:51.069 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.067+0000 7ff854f11800 20 add_watcher() i=4 2023-12-03T11:54:51.069 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.067+0000 7ff854f11800 20 add_watcher() i=5 2023-12-03T11:54:51.069 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.067+0000 7ff854f11800 20 add_watcher() i=6 2023-12-03T11:54:51.070 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.068+0000 7ff854f11800 20 add_watcher() i=7 2023-12-03T11:54:51.070 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.068+0000 7ff854f11800 2 all 8 watchers are set, enabling cache 2023-12-03T11:54:51.071 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.069+0000 7ff793fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:54:51.071 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.070+0000 7ff854f11800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:54:51.071 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.070+0000 7ff854f11800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:54:51.114 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.112+0000 7ff782ffd640 20 reqs_thread_entry: start 2023-12-03T11:54:51.114 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.112+0000 7ff854f11800 20 init_complete bucket index max shards: 11 2023-12-03T11:54:51.114 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.112+0000 7ff854f11800 20 Filter name: none 2023-12-03T11:54:51.114 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.112+0000 7ff780ff9640 20 reqs_thread_entry: start 2023-12-03T11:54:51.114 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.112+0000 7ff854f11800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2023-12-03T11:54:51.115 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.114+0000 7ff854f11800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.115 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.114+0000 7ff854f11800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:51.116 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.114+0000 7ff854f11800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.117 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.115+0000 7ff854f11800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2023-12-03T11:54:51.118 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.117+0000 7ff854f11800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.119 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.117+0000 7ff854f11800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:51.119 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.117+0000 7ff854f11800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.120 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.118+0000 7ff854f11800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2023-12-03T11:54:51.121 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.120+0000 7ff854f11800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.122 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.120+0000 7ff854f11800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:51.122 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.120+0000 7ff854f11800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.122 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.121+0000 7ff854f11800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2023-12-03T11:54:51.124 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.122+0000 7ff854f11800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.124 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.123+0000 7ff854f11800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:51.124 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.123+0000 7ff854f11800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.125 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.124+0000 7ff854f11800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2023-12-03T11:54:51.126 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.125+0000 7ff854f11800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.127 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.126+0000 7ff854f11800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:51.127 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.126+0000 7ff854f11800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.128 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.127+0000 7ff854f11800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2023-12-03T11:54:51.130 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.128+0000 7ff854f11800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.130 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.129+0000 7ff854f11800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:51.131 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.129+0000 7ff854f11800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.132 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.130+0000 7ff854f11800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2023-12-03T11:54:51.133 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.132+0000 7ff854f11800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.133 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.132+0000 7ff854f11800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:51.134 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.132+0000 7ff854f11800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.134 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.133+0000 7ff854f11800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2023-12-03T11:54:51.136 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.135+0000 7ff854f11800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.137 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.135+0000 7ff854f11800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:51.137 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.135+0000 7ff854f11800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.137 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.136+0000 7ff854f11800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2023-12-03T11:54:51.139 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.137+0000 7ff854f11800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.139 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.138+0000 7ff854f11800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:51.139 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.138+0000 7ff854f11800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.141 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.140+0000 7ff854f11800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2023-12-03T11:54:51.142 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.141+0000 7ff854f11800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.142 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.141+0000 7ff854f11800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:51.143 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.142+0000 7ff854f11800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.144 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.143+0000 7ff854f11800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2023-12-03T11:54:51.145 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.144+0000 7ff854f11800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.146 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.144+0000 7ff854f11800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:51.146 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.145+0000 7ff854f11800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.147 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.146+0000 7ff854f11800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2023-12-03T11:54:51.148 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.147+0000 7ff854f11800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.149 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.148+0000 7ff854f11800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:51.149 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.148+0000 7ff854f11800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.150 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.149+0000 7ff854f11800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2023-12-03T11:54:51.152 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.150+0000 7ff854f11800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.152 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.150+0000 7ff854f11800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:51.152 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.151+0000 7ff854f11800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.153 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.152+0000 7ff854f11800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2023-12-03T11:54:51.154 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.153+0000 7ff854f11800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.155 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.154+0000 7ff854f11800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:51.155 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.154+0000 7ff854f11800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.156 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.155+0000 7ff854f11800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2023-12-03T11:54:51.157 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.156+0000 7ff854f11800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.158 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.157+0000 7ff854f11800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:51.158 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.157+0000 7ff854f11800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.159 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.158+0000 7ff854f11800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2023-12-03T11:54:51.161 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.159+0000 7ff854f11800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.161 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.160+0000 7ff854f11800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:51.162 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.161+0000 7ff854f11800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.163 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.162+0000 7ff854f11800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2023-12-03T11:54:51.164 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.163+0000 7ff854f11800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.164 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.163+0000 7ff854f11800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:51.165 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.164+0000 7ff854f11800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.166 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.164+0000 7ff854f11800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2023-12-03T11:54:51.167 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.166+0000 7ff854f11800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.167 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.166+0000 7ff854f11800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:51.168 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.167+0000 7ff854f11800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.169 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.168+0000 7ff854f11800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2023-12-03T11:54:51.170 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.169+0000 7ff854f11800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.170 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.169+0000 7ff854f11800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:51.171 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.170+0000 7ff854f11800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.172 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.170+0000 7ff854f11800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2023-12-03T11:54:51.173 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.172+0000 7ff854f11800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.174 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.172+0000 7ff854f11800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:51.174 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.173+0000 7ff854f11800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.175 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.174+0000 7ff854f11800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2023-12-03T11:54:51.176 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.175+0000 7ff854f11800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.176 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.175+0000 7ff854f11800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:51.177 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.176+0000 7ff854f11800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.178 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.177+0000 7ff854f11800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2023-12-03T11:54:51.179 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.178+0000 7ff854f11800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.180 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.179+0000 7ff854f11800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:51.180 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.179+0000 7ff854f11800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.181 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.180+0000 7ff854f11800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2023-12-03T11:54:51.183 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.182+0000 7ff854f11800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.183 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.182+0000 7ff854f11800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:51.183 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.182+0000 7ff854f11800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.184 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.183+0000 7ff854f11800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2023-12-03T11:54:51.186 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.184+0000 7ff854f11800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.186 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.185+0000 7ff854f11800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:51.186 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.185+0000 7ff854f11800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.187 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.186+0000 7ff854f11800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2023-12-03T11:54:51.188 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.187+0000 7ff854f11800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.189 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.188+0000 7ff854f11800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:51.189 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.188+0000 7ff854f11800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.190 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.189+0000 7ff854f11800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2023-12-03T11:54:51.191 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.190+0000 7ff854f11800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.192 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.190+0000 7ff854f11800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:51.192 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.191+0000 7ff854f11800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.193 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.192+0000 7ff854f11800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2023-12-03T11:54:51.194 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.193+0000 7ff854f11800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.195 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.194+0000 7ff854f11800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:51.195 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.194+0000 7ff854f11800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.196 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.195+0000 7ff854f11800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2023-12-03T11:54:51.198 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.196+0000 7ff854f11800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.198 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.197+0000 7ff854f11800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:51.198 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.197+0000 7ff854f11800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.199 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.198+0000 7ff854f11800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2023-12-03T11:54:51.200 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.199+0000 7ff854f11800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.201 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.200+0000 7ff854f11800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:51.201 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.200+0000 7ff854f11800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.202 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.201+0000 7ff854f11800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2023-12-03T11:54:51.203 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.202+0000 7ff854f11800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.204 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.203+0000 7ff854f11800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:51.204 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.203+0000 7ff854f11800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.205 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.204+0000 7ff854f11800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2023-12-03T11:54:51.206 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.205+0000 7ff854f11800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.207 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.206+0000 7ff854f11800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:51.207 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.206+0000 7ff854f11800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.208 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.207+0000 7ff854f11800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2023-12-03T11:54:51.209 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.208+0000 7ff854f11800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.210 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.209+0000 7ff854f11800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:51.210 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.209+0000 7ff854f11800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.212 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.210+0000 7ff793fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:54:51.214 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.213+0000 7ff854f11800 20 remove_watcher() i=0 2023-12-03T11:54:51.214 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.213+0000 7ff854f11800 2 removed watcher, disabling cache 2023-12-03T11:54:51.215 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.214+0000 7ff854f11800 20 remove_watcher() i=1 2023-12-03T11:54:51.216 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.215+0000 7ff854f11800 20 remove_watcher() i=2 2023-12-03T11:54:51.217 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.216+0000 7ff854f11800 20 remove_watcher() i=3 2023-12-03T11:54:51.218 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.217+0000 7ff854f11800 20 remove_watcher() i=4 2023-12-03T11:54:51.219 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.218+0000 7ff854f11800 20 remove_watcher() i=5 2023-12-03T11:54:51.220 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.219+0000 7ff854f11800 20 remove_watcher() i=6 2023-12-03T11:54:51.221 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.220+0000 7ff854f11800 20 remove_watcher() i=7 2023-12-03T11:54:51.227 DEBUG:teuthology.orchestra.run.smithi003:> radosgw-admin gc process --include-all 2023-12-03T11:54:51.277 INFO:teuthology.orchestra.run.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:54:51.277 INFO:teuthology.orchestra.run.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:54:51.292 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.290+0000 7f7ef3d35800 20 rados->read ofs=0 len=0 2023-12-03T11:54:51.293 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.292+0000 7f7ef3d35800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:54:51.293 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.292+0000 7f7ef3d35800 20 realm 2023-12-03T11:54:51.293 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.292+0000 7f7ef3d35800 20 rados->read ofs=0 len=0 2023-12-03T11:54:51.294 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.292+0000 7f7ef3d35800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:54:51.294 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.292+0000 7f7ef3d35800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:54:51.294 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.292+0000 7f7ef3d35800 20 rados->read ofs=0 len=0 2023-12-03T11:54:51.294 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.292+0000 7f7ef3d35800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:54:51.294 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.292+0000 7f7ef3d35800 20 rados->read ofs=0 len=0 2023-12-03T11:54:51.295 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.293+0000 7f7ef3d35800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:54:51.295 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.293+0000 7f7ef3d35800 20 rados->read ofs=0 len=0 2023-12-03T11:54:51.295 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.293+0000 7f7ef3d35800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:54:51.295 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.294+0000 7f7ef3d35800 20 searching for the correct realm 2023-12-03T11:54:51.302 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.301+0000 7f7ef02ce640 0 -- 172.21.15.3:0/3749340146 >> [v2:172.21.15.37:6816/3770469300,v1:172.21.15.37:6818/3770469300] conn(0x7f7ee405e040 msgr2=0x7f7ee406ba90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:54:51.306 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.305+0000 7f7eefacd640 0 -- 172.21.15.3:0/3749340146 >> [v2:172.21.15.37:6805/1692844418,v1:172.21.15.37:6807/1692844418] conn(0x55d6d6ee13a0 msgr2=0x55d6d6ee3790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:54:51.307 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.305+0000 7f7ef3d35800 20 RGWRados::pool_iterate: got zone_info.83aabb46-04b5-4c96-9933-c6bfb1173a73 2023-12-03T11:54:51.307 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.305+0000 7f7ef3d35800 20 RGWRados::pool_iterate: got zonegroup_info.6a811aad-435d-4fdd-93c9-b7e0b50de429 2023-12-03T11:54:51.307 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.305+0000 7f7ef3d35800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:54:51.307 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.305+0000 7f7ef3d35800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:54:51.307 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.305+0000 7f7ef3d35800 20 rados->read ofs=0 len=0 2023-12-03T11:54:51.307 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.306+0000 7f7ef3d35800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:54:51.307 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.306+0000 7f7ef3d35800 20 rados->read ofs=0 len=0 2023-12-03T11:54:51.308 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.306+0000 7f7ef3d35800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:54:51.308 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.306+0000 7f7ef3d35800 20 rados->read ofs=0 len=0 2023-12-03T11:54:51.308 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.306+0000 7f7ef3d35800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:54:51.309 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.306+0000 7f7ef3d35800 20 zone default found 2023-12-03T11:54:51.309 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.306+0000 7f7ef3d35800 4 Realm: () 2023-12-03T11:54:51.309 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.306+0000 7f7ef3d35800 4 ZoneGroup: default (6a811aad-435d-4fdd-93c9-b7e0b50de429) 2023-12-03T11:54:51.309 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.306+0000 7f7ef3d35800 4 Zone: default (83aabb46-04b5-4c96-9933-c6bfb1173a73) 2023-12-03T11:54:51.309 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.306+0000 7f7ef3d35800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:54:51.309 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.306+0000 7f7ef3d35800 20 zonegroup default 2023-12-03T11:54:51.309 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.306+0000 7f7ef3d35800 20 rados->read ofs=0 len=0 2023-12-03T11:54:51.309 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.306+0000 7f7ef3d35800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:54:51.309 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.306+0000 7f7ef3d35800 20 rados->read ofs=0 len=0 2023-12-03T11:54:51.309 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.307+0000 7f7ef3d35800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:54:51.309 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.307+0000 7f7ef3d35800 20 rados->read ofs=0 len=0 2023-12-03T11:54:51.309 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.307+0000 7f7ef3d35800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:54:51.309 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.307+0000 7f7ef3d35800 20 started sync module instance, tier type = 2023-12-03T11:54:51.309 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.307+0000 7f7ef3d35800 20 started zone id=83aabb46-04b5-4c96-9933-c6bfb1173a73 (name=default) with tier type = 2023-12-03T11:54:51.317 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.316+0000 7f7ef3d35800 20 add_watcher() i=0 2023-12-03T11:54:51.317 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.316+0000 7f7ef3d35800 20 add_watcher() i=1 2023-12-03T11:54:51.317 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.316+0000 7f7ef3d35800 20 add_watcher() i=2 2023-12-03T11:54:51.317 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.316+0000 7f7ef3d35800 20 add_watcher() i=3 2023-12-03T11:54:51.317 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.316+0000 7f7ef3d35800 20 add_watcher() i=4 2023-12-03T11:54:51.318 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.316+0000 7f7ef3d35800 20 add_watcher() i=5 2023-12-03T11:54:51.318 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.316+0000 7f7ef3d35800 20 add_watcher() i=6 2023-12-03T11:54:51.318 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.317+0000 7f7ef3d35800 20 add_watcher() i=7 2023-12-03T11:54:51.318 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.317+0000 7f7ef3d35800 2 all 8 watchers are set, enabling cache 2023-12-03T11:54:51.320 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.318+0000 7f7eb5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:54:51.320 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.319+0000 7f7ef3d35800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:54:51.320 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.319+0000 7f7ef3d35800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:54:51.364 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.362+0000 7f7e2cff9640 20 reqs_thread_entry: start 2023-12-03T11:54:51.364 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.362+0000 7f7ef3d35800 20 init_complete bucket index max shards: 11 2023-12-03T11:54:51.364 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.362+0000 7f7ef3d35800 20 Filter name: none 2023-12-03T11:54:51.364 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.362+0000 7f7e227fc640 20 reqs_thread_entry: start 2023-12-03T11:54:51.364 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.362+0000 7f7ef3d35800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2023-12-03T11:54:51.365 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.364+0000 7f7ef3d35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.366 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.365+0000 7f7ef3d35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:51.366 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.365+0000 7f7ef3d35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.367 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.366+0000 7f7ef3d35800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2023-12-03T11:54:51.368 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.367+0000 7f7ef3d35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.369 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.368+0000 7f7ef3d35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:51.369 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.368+0000 7f7ef3d35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.370 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.369+0000 7f7ef3d35800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2023-12-03T11:54:51.372 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.370+0000 7f7ef3d35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.372 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.371+0000 7f7ef3d35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:51.372 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.371+0000 7f7ef3d35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.373 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.372+0000 7f7ef3d35800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2023-12-03T11:54:51.375 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.373+0000 7f7ef3d35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.375 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.374+0000 7f7ef3d35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:51.376 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.374+0000 7f7ef3d35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.377 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.375+0000 7f7ef3d35800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2023-12-03T11:54:51.378 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.377+0000 7f7ef3d35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.378 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.377+0000 7f7ef3d35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:51.379 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.378+0000 7f7ef3d35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.380 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.379+0000 7f7ef3d35800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2023-12-03T11:54:51.381 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.380+0000 7f7ef3d35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.382 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.381+0000 7f7ef3d35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:51.382 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.381+0000 7f7ef3d35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.383 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.382+0000 7f7ef3d35800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2023-12-03T11:54:51.384 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.383+0000 7f7ef3d35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.385 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.384+0000 7f7ef3d35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:51.385 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.384+0000 7f7ef3d35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.386 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.385+0000 7f7ef3d35800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2023-12-03T11:54:51.387 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.386+0000 7f7ef3d35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.388 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.387+0000 7f7ef3d35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:51.388 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.387+0000 7f7ef3d35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.389 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.388+0000 7f7ef3d35800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2023-12-03T11:54:51.391 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.390+0000 7f7ef3d35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.392 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.390+0000 7f7ef3d35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:51.392 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.391+0000 7f7ef3d35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.393 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.392+0000 7f7ef3d35800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2023-12-03T11:54:51.394 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.393+0000 7f7ef3d35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.395 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.394+0000 7f7ef3d35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:51.395 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.394+0000 7f7ef3d35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.396 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.395+0000 7f7ef3d35800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2023-12-03T11:54:51.398 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.397+0000 7f7ef3d35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.398 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.397+0000 7f7ef3d35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:51.398 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.397+0000 7f7ef3d35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.399 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.398+0000 7f7ef3d35800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2023-12-03T11:54:51.401 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.399+0000 7f7ef3d35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.401 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.400+0000 7f7ef3d35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:51.402 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.400+0000 7f7ef3d35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.402 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.401+0000 7f7ef3d35800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2023-12-03T11:54:51.403 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.402+0000 7f7ef3d35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.404 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.403+0000 7f7ef3d35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:51.404 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.403+0000 7f7ef3d35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.405 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.404+0000 7f7ef3d35800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2023-12-03T11:54:51.407 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.405+0000 7f7ef3d35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.407 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.406+0000 7f7ef3d35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:51.407 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.406+0000 7f7ef3d35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.409 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.408+0000 7f7ef3d35800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2023-12-03T11:54:51.410 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.409+0000 7f7ef3d35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.411 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.410+0000 7f7ef3d35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:51.411 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.410+0000 7f7ef3d35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.413 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.412+0000 7f7ef3d35800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2023-12-03T11:54:51.415 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.413+0000 7f7ef3d35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.415 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.414+0000 7f7ef3d35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:51.415 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.414+0000 7f7ef3d35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.416 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.415+0000 7f7ef3d35800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2023-12-03T11:54:51.417 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.416+0000 7f7ef3d35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.418 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.417+0000 7f7ef3d35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:51.418 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.417+0000 7f7ef3d35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.419 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.418+0000 7f7ef3d35800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2023-12-03T11:54:51.421 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.420+0000 7f7ef3d35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.422 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.421+0000 7f7ef3d35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:51.422 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.421+0000 7f7ef3d35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.423 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.422+0000 7f7ef3d35800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2023-12-03T11:54:51.424 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.423+0000 7f7ef3d35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.425 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.424+0000 7f7ef3d35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:51.425 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.424+0000 7f7ef3d35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.427 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.425+0000 7f7ef3d35800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2023-12-03T11:54:51.428 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.427+0000 7f7ef3d35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.429 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.427+0000 7f7ef3d35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:51.429 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.428+0000 7f7ef3d35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.430 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.429+0000 7f7ef3d35800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2023-12-03T11:54:51.432 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.431+0000 7f7ef3d35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.432 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.431+0000 7f7ef3d35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:51.432 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.431+0000 7f7ef3d35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.433 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.432+0000 7f7ef3d35800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2023-12-03T11:54:51.435 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.434+0000 7f7ef3d35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.435 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.434+0000 7f7ef3d35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:51.435 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.434+0000 7f7ef3d35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.436 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.435+0000 7f7ef3d35800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2023-12-03T11:54:51.437 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.436+0000 7f7ef3d35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.438 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.437+0000 7f7ef3d35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:51.438 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.437+0000 7f7ef3d35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.439 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.438+0000 7f7ef3d35800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2023-12-03T11:54:51.441 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.440+0000 7f7ef3d35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.441 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.440+0000 7f7ef3d35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:51.442 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.441+0000 7f7ef3d35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.443 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.442+0000 7f7ef3d35800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2023-12-03T11:54:51.444 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.443+0000 7f7ef3d35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.444 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.443+0000 7f7ef3d35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:51.445 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.444+0000 7f7ef3d35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.446 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.445+0000 7f7ef3d35800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2023-12-03T11:54:51.447 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.446+0000 7f7ef3d35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.448 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.447+0000 7f7ef3d35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:51.448 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.447+0000 7f7ef3d35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.449 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.448+0000 7f7ef3d35800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2023-12-03T11:54:51.451 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.449+0000 7f7ef3d35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.451 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.450+0000 7f7ef3d35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:51.451 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.450+0000 7f7ef3d35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.452 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.451+0000 7f7ef3d35800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2023-12-03T11:54:51.453 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.452+0000 7f7ef3d35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.454 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.453+0000 7f7ef3d35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:51.454 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.453+0000 7f7ef3d35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.455 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.454+0000 7f7ef3d35800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2023-12-03T11:54:51.456 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.455+0000 7f7ef3d35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.457 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.456+0000 7f7ef3d35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:51.457 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.456+0000 7f7ef3d35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.458 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.457+0000 7f7ef3d35800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2023-12-03T11:54:51.459 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.458+0000 7f7ef3d35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.460 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.459+0000 7f7ef3d35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:51.460 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.459+0000 7f7ef3d35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.461 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.460+0000 7f7ef3d35800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2023-12-03T11:54:51.463 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.461+0000 7f7ef3d35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.463 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.462+0000 7f7ef3d35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:51.463 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.462+0000 7f7ef3d35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.464 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.463+0000 7f7ef3d35800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2023-12-03T11:54:51.466 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.464+0000 7f7ef3d35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.466 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.465+0000 7f7ef3d35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:51.466 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.465+0000 7f7ef3d35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.468 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.467+0000 7f7eb5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:54:51.471 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.470+0000 7f7ef3d35800 20 remove_watcher() i=0 2023-12-03T11:54:51.471 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.470+0000 7f7ef3d35800 2 removed watcher, disabling cache 2023-12-03T11:54:51.472 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.471+0000 7f7ef3d35800 20 remove_watcher() i=1 2023-12-03T11:54:51.473 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.472+0000 7f7ef3d35800 20 remove_watcher() i=2 2023-12-03T11:54:51.474 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.473+0000 7f7ef3d35800 20 remove_watcher() i=3 2023-12-03T11:54:51.475 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.474+0000 7f7ef3d35800 20 remove_watcher() i=4 2023-12-03T11:54:51.476 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.475+0000 7f7ef3d35800 20 remove_watcher() i=5 2023-12-03T11:54:51.477 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.476+0000 7f7ef3d35800 20 remove_watcher() i=6 2023-12-03T11:54:51.478 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.477+0000 7f7ef3d35800 20 remove_watcher() i=7 2023-12-03T11:54:51.483 DEBUG:teuthology.orchestra.run.smithi003:> radosgw-admin gc process --include-all 2023-12-03T11:54:51.534 INFO:teuthology.orchestra.run.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:54:51.534 INFO:teuthology.orchestra.run.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:54:51.549 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.548+0000 7f824502f800 20 rados->read ofs=0 len=0 2023-12-03T11:54:51.551 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.549+0000 7f824502f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:54:51.551 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.549+0000 7f824502f800 20 realm 2023-12-03T11:54:51.551 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.549+0000 7f824502f800 20 rados->read ofs=0 len=0 2023-12-03T11:54:51.551 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.550+0000 7f824502f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:54:51.551 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.550+0000 7f824502f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:54:51.551 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.550+0000 7f824502f800 20 rados->read ofs=0 len=0 2023-12-03T11:54:51.551 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.550+0000 7f824502f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:54:51.551 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.550+0000 7f824502f800 20 rados->read ofs=0 len=0 2023-12-03T11:54:51.552 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.550+0000 7f824502f800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:54:51.552 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.550+0000 7f824502f800 20 rados->read ofs=0 len=0 2023-12-03T11:54:51.552 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.551+0000 7f824502f800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:54:51.552 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.551+0000 7f824502f800 20 searching for the correct realm 2023-12-03T11:54:51.561 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.560+0000 7f824021a640 0 -- 172.21.15.3:0/2020222827 >> [v2:172.21.15.3:6808/263125788,v1:172.21.15.3:6809/263125788] conn(0x7f823409b030 msgr2=0x7f82340978c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:54:51.563 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.562+0000 7f824502f800 20 RGWRados::pool_iterate: got zone_info.83aabb46-04b5-4c96-9933-c6bfb1173a73 2023-12-03T11:54:51.563 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.562+0000 7f824502f800 20 RGWRados::pool_iterate: got zonegroup_info.6a811aad-435d-4fdd-93c9-b7e0b50de429 2023-12-03T11:54:51.563 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.562+0000 7f824502f800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:54:51.563 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.562+0000 7f824502f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:54:51.563 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.562+0000 7f824502f800 20 rados->read ofs=0 len=0 2023-12-03T11:54:51.563 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.562+0000 7f824502f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:54:51.564 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.562+0000 7f824502f800 20 rados->read ofs=0 len=0 2023-12-03T11:54:51.565 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.562+0000 7f824502f800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:54:51.565 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.562+0000 7f824502f800 20 rados->read ofs=0 len=0 2023-12-03T11:54:51.565 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.563+0000 7f824502f800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:54:51.565 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.563+0000 7f824502f800 20 zone default found 2023-12-03T11:54:51.565 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.563+0000 7f824502f800 4 Realm: () 2023-12-03T11:54:51.566 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.563+0000 7f824502f800 4 ZoneGroup: default (6a811aad-435d-4fdd-93c9-b7e0b50de429) 2023-12-03T11:54:51.566 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.563+0000 7f824502f800 4 Zone: default (83aabb46-04b5-4c96-9933-c6bfb1173a73) 2023-12-03T11:54:51.566 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.563+0000 7f824502f800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:54:51.566 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.563+0000 7f824502f800 20 zonegroup default 2023-12-03T11:54:51.566 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.563+0000 7f824502f800 20 rados->read ofs=0 len=0 2023-12-03T11:54:51.566 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.563+0000 7f824502f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:54:51.566 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.563+0000 7f824502f800 20 rados->read ofs=0 len=0 2023-12-03T11:54:51.566 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.563+0000 7f824502f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:54:51.566 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.563+0000 7f824502f800 20 rados->read ofs=0 len=0 2023-12-03T11:54:51.566 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.564+0000 7f824502f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:54:51.567 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.564+0000 7f824502f800 20 started sync module instance, tier type = 2023-12-03T11:54:51.567 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.564+0000 7f824502f800 20 started zone id=83aabb46-04b5-4c96-9933-c6bfb1173a73 (name=default) with tier type = 2023-12-03T11:54:51.570 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.569+0000 7f824021a640 0 -- 172.21.15.3:0/2020222827 >> [v2:172.21.15.3:6800/2373485412,v1:172.21.15.3:6801/2373485412] conn(0x7f823801c540 msgr2=0x7f823801c960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:54:51.574 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.573+0000 7f824502f800 20 add_watcher() i=0 2023-12-03T11:54:51.574 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.573+0000 7f824502f800 20 add_watcher() i=1 2023-12-03T11:54:51.575 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.573+0000 7f824502f800 20 add_watcher() i=2 2023-12-03T11:54:51.575 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.573+0000 7f824502f800 20 add_watcher() i=3 2023-12-03T11:54:51.575 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.573+0000 7f824502f800 20 add_watcher() i=4 2023-12-03T11:54:51.575 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.573+0000 7f824502f800 20 add_watcher() i=5 2023-12-03T11:54:51.575 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.573+0000 7f824502f800 20 add_watcher() i=6 2023-12-03T11:54:51.575 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.574+0000 7f824502f800 20 add_watcher() i=7 2023-12-03T11:54:51.575 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.574+0000 7f824502f800 2 all 8 watchers are set, enabling cache 2023-12-03T11:54:51.577 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.576+0000 7f82067e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:54:51.577 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.576+0000 7f824502f800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:54:51.577 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.576+0000 7f824502f800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:54:51.621 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.619+0000 7f81757fa640 20 reqs_thread_entry: start 2023-12-03T11:54:51.621 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.619+0000 7f824502f800 20 init_complete bucket index max shards: 11 2023-12-03T11:54:51.621 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.619+0000 7f824502f800 20 Filter name: none 2023-12-03T11:54:51.621 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.619+0000 7f816effd640 20 reqs_thread_entry: start 2023-12-03T11:54:51.621 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.619+0000 7f824502f800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2023-12-03T11:54:51.622 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.620+0000 7f824502f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.622 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.621+0000 7f824502f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:51.622 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.621+0000 7f824502f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.623 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.622+0000 7f824502f800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2023-12-03T11:54:51.625 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.623+0000 7f824502f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.625 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.624+0000 7f824502f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:51.625 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.624+0000 7f824502f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.626 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.625+0000 7f824502f800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2023-12-03T11:54:51.627 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.626+0000 7f824502f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.628 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.627+0000 7f824502f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:51.628 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.627+0000 7f824502f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.629 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.628+0000 7f824502f800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2023-12-03T11:54:51.631 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.629+0000 7f824502f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.632 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.631+0000 7f824502f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:51.632 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.631+0000 7f824502f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.633 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.632+0000 7f824502f800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2023-12-03T11:54:51.634 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.633+0000 7f824502f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.635 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.634+0000 7f824502f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:51.635 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.634+0000 7f824502f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.636 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.635+0000 7f824502f800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2023-12-03T11:54:51.638 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.636+0000 7f824502f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.638 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.637+0000 7f824502f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:51.638 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.637+0000 7f824502f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.639 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.638+0000 7f824502f800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2023-12-03T11:54:51.641 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.639+0000 7f824502f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.641 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.640+0000 7f824502f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:51.641 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.640+0000 7f824502f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.642 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.641+0000 7f824502f800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2023-12-03T11:54:51.643 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.642+0000 7f824502f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.644 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.643+0000 7f824502f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:51.644 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.643+0000 7f824502f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.645 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.644+0000 7f824502f800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2023-12-03T11:54:51.646 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.645+0000 7f824502f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.647 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.646+0000 7f824502f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:51.647 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.646+0000 7f824502f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.648 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.647+0000 7f824502f800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2023-12-03T11:54:51.650 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.649+0000 7f824502f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.650 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.649+0000 7f824502f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:51.651 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.649+0000 7f824502f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.652 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.651+0000 7f824502f800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2023-12-03T11:54:51.653 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.652+0000 7f824502f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.654 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.652+0000 7f824502f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:51.654 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.653+0000 7f824502f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.655 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.654+0000 7f824502f800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2023-12-03T11:54:51.657 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.655+0000 7f824502f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.657 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.655+0000 7f824502f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:51.657 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.656+0000 7f824502f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.658 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.657+0000 7f824502f800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2023-12-03T11:54:51.659 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.658+0000 7f824502f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.659 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.658+0000 7f824502f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:51.660 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.658+0000 7f824502f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.661 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.659+0000 7f824502f800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2023-12-03T11:54:51.662 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.660+0000 7f824502f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.662 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.661+0000 7f824502f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:51.662 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.661+0000 7f824502f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.663 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.662+0000 7f824502f800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2023-12-03T11:54:51.664 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.663+0000 7f824502f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.665 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.664+0000 7f824502f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:51.665 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.664+0000 7f824502f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.666 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.665+0000 7f824502f800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2023-12-03T11:54:51.667 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.666+0000 7f824502f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.668 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.667+0000 7f824502f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:51.668 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.667+0000 7f824502f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.669 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.668+0000 7f824502f800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2023-12-03T11:54:51.670 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.669+0000 7f824502f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.671 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.670+0000 7f824502f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:51.671 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.670+0000 7f824502f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.672 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.671+0000 7f824502f800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2023-12-03T11:54:51.673 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.672+0000 7f824502f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.674 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.673+0000 7f824502f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:51.674 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.673+0000 7f824502f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.675 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.674+0000 7f824502f800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2023-12-03T11:54:51.676 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.675+0000 7f824502f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.677 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.676+0000 7f824502f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:51.677 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.676+0000 7f824502f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.679 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.677+0000 7f824502f800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2023-12-03T11:54:51.680 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.679+0000 7f824502f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.680 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.679+0000 7f824502f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:51.681 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.679+0000 7f824502f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.682 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.680+0000 7f824502f800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2023-12-03T11:54:51.683 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.682+0000 7f824502f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.684 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.683+0000 7f824502f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:51.684 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.683+0000 7f824502f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.685 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.684+0000 7f824502f800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2023-12-03T11:54:51.689 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.686+0000 7f824502f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.690 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.686+0000 7f824502f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:51.690 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.686+0000 7f824502f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.690 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.687+0000 7f824502f800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2023-12-03T11:54:51.690 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.689+0000 7f824502f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.691 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.689+0000 7f824502f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:51.691 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.690+0000 7f824502f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.692 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.691+0000 7f824502f800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2023-12-03T11:54:51.694 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.692+0000 7f824502f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.694 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.692+0000 7f824502f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:51.694 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.693+0000 7f824502f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.695 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.694+0000 7f824502f800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2023-12-03T11:54:51.696 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.695+0000 7f824502f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.697 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.695+0000 7f824502f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:51.697 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.695+0000 7f824502f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.697 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.696+0000 7f824502f800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2023-12-03T11:54:51.699 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.698+0000 7f824502f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.699 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.698+0000 7f824502f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:51.700 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.698+0000 7f824502f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.701 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.699+0000 7f824502f800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2023-12-03T11:54:51.702 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.701+0000 7f824502f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.703 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.701+0000 7f824502f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:51.703 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.701+0000 7f824502f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.703 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.702+0000 7f824502f800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2023-12-03T11:54:51.705 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.704+0000 7f824502f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.705 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.704+0000 7f824502f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:51.706 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.704+0000 7f824502f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.707 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.705+0000 7f824502f800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2023-12-03T11:54:51.708 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.707+0000 7f824502f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.708 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.707+0000 7f824502f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:51.709 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.707+0000 7f824502f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.710 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.708+0000 7f824502f800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2023-12-03T11:54:51.711 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.710+0000 7f824502f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.712 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.711+0000 7f824502f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:51.712 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.711+0000 7f824502f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.713 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.712+0000 7f824502f800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2023-12-03T11:54:51.714 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.713+0000 7f824502f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.715 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.714+0000 7f824502f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:51.715 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.714+0000 7f824502f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.716 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.715+0000 7f824502f800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2023-12-03T11:54:51.717 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.716+0000 7f824502f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.718 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.716+0000 7f824502f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:51.718 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.717+0000 7f824502f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:51.720 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.718+0000 7f82067e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:54:51.722 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.721+0000 7f824502f800 20 remove_watcher() i=0 2023-12-03T11:54:51.722 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.721+0000 7f824502f800 2 removed watcher, disabling cache 2023-12-03T11:54:51.723 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.722+0000 7f824502f800 20 remove_watcher() i=1 2023-12-03T11:54:51.724 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.723+0000 7f824502f800 20 remove_watcher() i=2 2023-12-03T11:54:51.726 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.724+0000 7f824502f800 20 remove_watcher() i=3 2023-12-03T11:54:51.727 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.725+0000 7f824502f800 20 remove_watcher() i=4 2023-12-03T11:54:51.727 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.726+0000 7f824502f800 20 remove_watcher() i=5 2023-12-03T11:54:51.728 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.727+0000 7f824502f800 20 remove_watcher() i=6 2023-12-03T11:54:51.729 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:51.728+0000 7f824502f800 20 remove_watcher() i=7 2023-12-03T11:54:51.735 DEBUG:teuthology.orchestra.run.smithi003:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests BucketTest 2023-12-03T11:54:52.313 INFO:teuthology.orchestra.run.smithi003.stdout:> Task :clean 2023-12-03T11:54:52.911 INFO:teuthology.orchestra.run.smithi003.stdout:> Task :compileJava 2023-12-03T11:54:52.911 INFO:teuthology.orchestra.run.smithi003.stdout:> Task :processResources 2023-12-03T11:54:52.911 INFO:teuthology.orchestra.run.smithi003.stdout:> Task :classes 2023-12-03T11:54:53.310 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:54:53.311 INFO:teuthology.orchestra.run.smithi003.stdout:> Task :compileTestJava 2023-12-03T11:54:53.311 INFO:teuthology.orchestra.run.smithi003.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2023-12-03T11:54:53.311 INFO:teuthology.orchestra.run.smithi003.stderr:Note: Recompile with -Xlint:deprecation for details. 2023-12-03T11:54:53.312 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:54:53.312 INFO:teuthology.orchestra.run.smithi003.stdout:> Task :processTestResources NO-SOURCE 2023-12-03T11:54:53.312 INFO:teuthology.orchestra.run.smithi003.stdout:> Task :testClasses 2023-12-03T11:54:55.312 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:54:55.312 INFO:teuthology.orchestra.run.smithi003.stdout:> Task :test 2023-12-03T11:54:55.312 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:54:55.312 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectEmpty STARTED 2023-12-03T11:54:55.312 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:54:55.312 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectEmpty PASSED 2023-12-03T11:54:55.312 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:54:55.312 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectMismatch STARTED 2023-12-03T11:54:55.312 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:54:55.312 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectMismatch PASSED 2023-12-03T11:54:55.610 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:54:55.611 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectUnreadable STARTED 2023-12-03T11:54:55.710 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:54:55.711 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectUnreadable PASSED 2023-12-03T11:54:56.010 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:54:56.010 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Bucket tests > BucketTest.testBucketCreateReadDelete STARTED 2023-12-03T11:54:56.210 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:54:56.211 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Bucket tests > BucketTest.testBucketCreateReadDelete PASSED 2023-12-03T11:54:56.310 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:54:56.310 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNonEmpty STARTED 2023-12-03T11:54:56.510 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:54:56.510 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNonEmpty PASSED 2023-12-03T11:54:56.810 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:54:56.810 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNotExist STARTED 2023-12-03T11:54:56.910 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:54:56.911 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNotExist PASSED 2023-12-03T11:54:57.010 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:54:57.011 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Bucket tests > BucketTest.testBucketListDistinct STARTED 2023-12-03T11:54:57.210 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:54:57.211 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Bucket tests > BucketTest.testBucketListDistinct PASSED 2023-12-03T11:54:57.810 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:54:57.810 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Bucket tests > BucketTest.testBucketListEmpty STARTED 2023-12-03T11:54:57.911 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:54:57.911 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Bucket tests > BucketTest.testBucketListEmpty PASSED 2023-12-03T11:54:58.310 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:54:58.311 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Bucket tests > BucketTest.testBucketNotExist STARTED 2023-12-03T11:54:58.311 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:54:58.311 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Bucket tests > BucketTest.testBucketNotExist PASSED 2023-12-03T11:54:58.399 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:54:58.400 INFO:teuthology.orchestra.run.smithi003.stdout:-------------------------------------------------------------------- 2023-12-03T11:54:58.400 INFO:teuthology.orchestra.run.smithi003.stdout:| Results: SUCCESS (9 tests, 9 successes, 0 failures, 0 skipped) | 2023-12-03T11:54:58.400 INFO:teuthology.orchestra.run.smithi003.stdout:-------------------------------------------------------------------- 2023-12-03T11:54:58.400 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:54:58.400 INFO:teuthology.orchestra.run.smithi003.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2023-12-03T11:54:58.400 INFO:teuthology.orchestra.run.smithi003.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2023-12-03T11:54:58.400 INFO:teuthology.orchestra.run.smithi003.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2023-12-03T11:54:58.400 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:54:58.400 INFO:teuthology.orchestra.run.smithi003.stdout:BUILD SUCCESSFUL in 6s 2023-12-03T11:54:58.400 INFO:teuthology.orchestra.run.smithi003.stdout:5 actionable tasks: 5 executed 2023-12-03T11:54:58.413 DEBUG:teuthology.orchestra.run.smithi003:> radosgw-admin gc process --include-all 2023-12-03T11:54:58.466 INFO:teuthology.orchestra.run.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:54:58.466 INFO:teuthology.orchestra.run.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:54:58.481 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.479+0000 7f8ee3812800 20 rados->read ofs=0 len=0 2023-12-03T11:54:58.482 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.481+0000 7f8ee3812800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:54:58.482 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.481+0000 7f8ee3812800 20 realm 2023-12-03T11:54:58.482 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.481+0000 7f8ee3812800 20 rados->read ofs=0 len=0 2023-12-03T11:54:58.483 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.481+0000 7f8ee3812800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:54:58.483 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.481+0000 7f8ee3812800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:54:58.483 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.481+0000 7f8ee3812800 20 rados->read ofs=0 len=0 2023-12-03T11:54:58.483 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.481+0000 7f8ee3812800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:54:58.483 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.481+0000 7f8ee3812800 20 rados->read ofs=0 len=0 2023-12-03T11:54:58.483 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.482+0000 7f8ee3812800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:54:58.483 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.482+0000 7f8ee3812800 20 rados->read ofs=0 len=0 2023-12-03T11:54:58.484 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.482+0000 7f8ee3812800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:54:58.484 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.482+0000 7f8ee3812800 20 searching for the correct realm 2023-12-03T11:54:58.495 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.493+0000 7f8edee50640 0 -- 172.21.15.3:0/1066473541 >> [v2:172.21.15.37:6805/1692844418,v1:172.21.15.37:6807/1692844418] conn(0x55d573fd12b0 msgr2=0x55d573fd36a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:54:58.497 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.495+0000 7f8ee3812800 20 RGWRados::pool_iterate: got zone_info.83aabb46-04b5-4c96-9933-c6bfb1173a73 2023-12-03T11:54:58.497 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.495+0000 7f8ee3812800 20 RGWRados::pool_iterate: got zonegroup_info.6a811aad-435d-4fdd-93c9-b7e0b50de429 2023-12-03T11:54:58.497 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.495+0000 7f8ee3812800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:54:58.497 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.495+0000 7f8ee3812800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:54:58.497 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.495+0000 7f8ee3812800 20 rados->read ofs=0 len=0 2023-12-03T11:54:58.497 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.495+0000 7f8ee3812800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:54:58.497 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.495+0000 7f8ee3812800 20 rados->read ofs=0 len=0 2023-12-03T11:54:58.498 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.496+0000 7f8ee3812800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:54:58.498 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.496+0000 7f8ee3812800 20 rados->read ofs=0 len=0 2023-12-03T11:54:58.498 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.496+0000 7f8ee3812800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:54:58.498 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.496+0000 7f8ee3812800 20 zone default found 2023-12-03T11:54:58.498 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.496+0000 7f8ee3812800 4 Realm: () 2023-12-03T11:54:58.499 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.496+0000 7f8ee3812800 4 ZoneGroup: default (6a811aad-435d-4fdd-93c9-b7e0b50de429) 2023-12-03T11:54:58.499 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.496+0000 7f8ee3812800 4 Zone: default (83aabb46-04b5-4c96-9933-c6bfb1173a73) 2023-12-03T11:54:58.499 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.496+0000 7f8ee3812800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:54:58.499 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.496+0000 7f8ee3812800 20 zonegroup default 2023-12-03T11:54:58.499 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.496+0000 7f8ee3812800 20 rados->read ofs=0 len=0 2023-12-03T11:54:58.499 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.496+0000 7f8ee3812800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:54:58.499 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.496+0000 7f8ee3812800 20 rados->read ofs=0 len=0 2023-12-03T11:54:58.499 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.497+0000 7f8ee3812800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:54:58.499 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.497+0000 7f8ee3812800 20 rados->read ofs=0 len=0 2023-12-03T11:54:58.499 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.497+0000 7f8ee3812800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:54:58.499 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.497+0000 7f8ee3812800 20 started sync module instance, tier type = 2023-12-03T11:54:58.500 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.497+0000 7f8ee3812800 20 started zone id=83aabb46-04b5-4c96-9933-c6bfb1173a73 (name=default) with tier type = 2023-12-03T11:54:58.505 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.503+0000 7f8edf651640 0 -- 172.21.15.3:0/1066473541 >> [v2:172.21.15.37:6816/3770469300,v1:172.21.15.37:6818/3770469300] conn(0x7f8ed4019930 msgr2=0x7f8ed4033400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:54:58.508 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.507+0000 7f8ee3812800 20 add_watcher() i=0 2023-12-03T11:54:58.508 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.507+0000 7f8ee3812800 20 add_watcher() i=1 2023-12-03T11:54:58.508 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.507+0000 7f8ee3812800 20 add_watcher() i=2 2023-12-03T11:54:58.508 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.507+0000 7f8ee3812800 20 add_watcher() i=3 2023-12-03T11:54:58.508 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.507+0000 7f8ee3812800 20 add_watcher() i=4 2023-12-03T11:54:58.509 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.507+0000 7f8ee3812800 20 add_watcher() i=5 2023-12-03T11:54:58.509 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.507+0000 7f8ee3812800 20 add_watcher() i=6 2023-12-03T11:54:58.509 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.508+0000 7f8ee3812800 20 add_watcher() i=7 2023-12-03T11:54:58.509 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.508+0000 7f8ee3812800 2 all 8 watchers are set, enabling cache 2023-12-03T11:54:58.511 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.509+0000 7f8e1ffff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:54:58.511 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.510+0000 7f8ee3812800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:54:58.511 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.510+0000 7f8ee3812800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:54:58.559 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.557+0000 7f8e16ffd640 20 reqs_thread_entry: start 2023-12-03T11:54:58.559 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.557+0000 7f8ee3812800 20 init_complete bucket index max shards: 11 2023-12-03T11:54:58.559 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.557+0000 7f8ee3812800 20 Filter name: none 2023-12-03T11:54:58.559 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.557+0000 7f8e14ff9640 20 reqs_thread_entry: start 2023-12-03T11:54:58.559 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.557+0000 7f8ee3812800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2023-12-03T11:54:58.560 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.559+0000 7f8ee3812800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:58.561 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.559+0000 7f8ee3812800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:58.561 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.560+0000 7f8ee3812800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:58.562 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.561+0000 7f8ee3812800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2023-12-03T11:54:58.563 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.562+0000 7f8ee3812800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:58.563 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.562+0000 7f8ee3812800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:58.564 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.563+0000 7f8ee3812800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:58.565 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.564+0000 7f8ee3812800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2023-12-03T11:54:58.566 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.565+0000 7f8ee3812800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:58.567 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.566+0000 7f8ee3812800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:58.567 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.566+0000 7f8ee3812800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:58.568 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.567+0000 7f8ee3812800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2023-12-03T11:54:58.570 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.568+0000 7f8ee3812800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:58.570 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.569+0000 7f8ee3812800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:58.570 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.569+0000 7f8ee3812800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:58.571 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.570+0000 7f8ee3812800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2023-12-03T11:54:58.573 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.571+0000 7f8ee3812800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:58.573 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.572+0000 7f8ee3812800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:58.573 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.572+0000 7f8ee3812800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:58.574 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.573+0000 7f8ee3812800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2023-12-03T11:54:58.576 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.575+0000 7f8ee3812800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:58.577 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.576+0000 7f8ee3812800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:58.577 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.576+0000 7f8ee3812800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:58.579 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.577+0000 7f8ee3812800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2023-12-03T11:54:58.580 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.579+0000 7f8ee3812800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:58.581 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.580+0000 7f8ee3812800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:58.581 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.580+0000 7f8ee3812800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:58.582 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.581+0000 7f8ee3812800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2023-12-03T11:54:58.584 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.582+0000 7f8ee3812800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:58.584 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.583+0000 7f8ee3812800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:58.585 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.584+0000 7f8ee3812800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:58.587 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.585+0000 7f8ee3812800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2023-12-03T11:54:58.588 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.587+0000 7f8ee3812800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:58.589 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.588+0000 7f8ee3812800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:58.589 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.588+0000 7f8ee3812800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:58.590 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.589+0000 7f8ee3812800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2023-12-03T11:54:58.591 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.590+0000 7f8ee3812800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:58.592 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.591+0000 7f8ee3812800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:58.592 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.591+0000 7f8ee3812800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:58.593 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.592+0000 7f8ee3812800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2023-12-03T11:54:58.594 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.593+0000 7f8ee3812800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:58.595 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.594+0000 7f8ee3812800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:58.595 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.594+0000 7f8ee3812800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:58.596 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.595+0000 7f8ee3812800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2023-12-03T11:54:58.597 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.596+0000 7f8ee3812800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:58.598 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.597+0000 7f8ee3812800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:58.598 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.597+0000 7f8ee3812800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:58.599 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.598+0000 7f8ee3812800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2023-12-03T11:54:58.600 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.599+0000 7f8ee3812800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:58.601 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.600+0000 7f8ee3812800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:58.601 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.600+0000 7f8ee3812800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:58.602 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.601+0000 7f8ee3812800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2023-12-03T11:54:58.604 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.603+0000 7f8ee3812800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:58.604 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.603+0000 7f8ee3812800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:58.605 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.603+0000 7f8ee3812800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:58.605 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.604+0000 7f8ee3812800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2023-12-03T11:54:58.607 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.606+0000 7f8ee3812800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:58.608 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.606+0000 7f8ee3812800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:58.608 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.607+0000 7f8ee3812800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:58.609 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.608+0000 7f8ee3812800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2023-12-03T11:54:58.610 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.609+0000 7f8ee3812800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:58.611 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.609+0000 7f8ee3812800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:58.611 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.609+0000 7f8ee3812800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:58.612 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.610+0000 7f8ee3812800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2023-12-03T11:54:58.613 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.612+0000 7f8ee3812800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:58.613 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.612+0000 7f8ee3812800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:58.614 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.613+0000 7f8ee3812800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:58.615 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.613+0000 7f8ee3812800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2023-12-03T11:54:58.616 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.615+0000 7f8ee3812800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:58.616 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.615+0000 7f8ee3812800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:58.617 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.615+0000 7f8ee3812800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:58.617 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.616+0000 7f8ee3812800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2023-12-03T11:54:58.619 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.618+0000 7f8ee3812800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:58.620 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.618+0000 7f8ee3812800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:58.620 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.618+0000 7f8ee3812800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:58.620 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.619+0000 7f8ee3812800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2023-12-03T11:54:58.622 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.621+0000 7f8ee3812800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:58.623 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.621+0000 7f8ee3812800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:58.623 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.621+0000 7f8ee3812800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:58.624 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.622+0000 7f8ee3812800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2023-12-03T11:54:58.625 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.624+0000 7f8ee3812800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:58.625 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.624+0000 7f8ee3812800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:58.626 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.625+0000 7f8ee3812800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:58.627 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.625+0000 7f8ee3812800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2023-12-03T11:54:58.628 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.627+0000 7f8ee3812800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:58.628 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.627+0000 7f8ee3812800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:58.629 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.627+0000 7f8ee3812800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:58.630 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.628+0000 7f8ee3812800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2023-12-03T11:54:58.631 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.630+0000 7f8ee3812800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:58.632 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.631+0000 7f8ee3812800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:58.632 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.631+0000 7f8ee3812800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:58.633 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.632+0000 7f8ee3812800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2023-12-03T11:54:58.634 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.633+0000 7f8ee3812800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:58.635 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.634+0000 7f8ee3812800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:58.635 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.634+0000 7f8ee3812800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:58.636 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.635+0000 7f8ee3812800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2023-12-03T11:54:58.638 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.637+0000 7f8ee3812800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:58.638 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.637+0000 7f8ee3812800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:58.639 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.638+0000 7f8ee3812800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:58.640 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.639+0000 7f8ee3812800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2023-12-03T11:54:58.641 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.640+0000 7f8ee3812800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:58.642 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.641+0000 7f8ee3812800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:58.642 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.641+0000 7f8ee3812800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:58.643 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.642+0000 7f8ee3812800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2023-12-03T11:54:58.644 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.643+0000 7f8ee3812800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:58.645 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.644+0000 7f8ee3812800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:58.645 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.644+0000 7f8ee3812800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:58.646 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.645+0000 7f8ee3812800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2023-12-03T11:54:58.648 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.647+0000 7f8ee3812800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:58.648 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.647+0000 7f8ee3812800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:58.649 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.647+0000 7f8ee3812800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:58.650 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.649+0000 7f8ee3812800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2023-12-03T11:54:58.651 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.650+0000 7f8ee3812800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:58.652 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.651+0000 7f8ee3812800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:58.652 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.651+0000 7f8ee3812800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:58.653 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.652+0000 7f8ee3812800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2023-12-03T11:54:58.655 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.654+0000 7f8ee3812800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:58.655 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.654+0000 7f8ee3812800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:58.656 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.654+0000 7f8ee3812800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:58.657 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.656+0000 7f8ee3812800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2023-12-03T11:54:58.658 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.657+0000 7f8ee3812800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:58.662 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.657+0000 7f8ee3812800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:58.663 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.658+0000 7f8ee3812800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:58.663 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.659+0000 7f8ee3812800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2023-12-03T11:54:58.663 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.661+0000 7f8ee3812800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:58.663 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.661+0000 7f8ee3812800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:58.663 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.662+0000 7f8ee3812800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:58.665 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.664+0000 7f8e1ffff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:54:58.667 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.666+0000 7f8ee3812800 20 remove_watcher() i=0 2023-12-03T11:54:58.667 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.666+0000 7f8ee3812800 2 removed watcher, disabling cache 2023-12-03T11:54:58.668 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.667+0000 7f8ee3812800 20 remove_watcher() i=1 2023-12-03T11:54:58.669 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.668+0000 7f8ee3812800 20 remove_watcher() i=2 2023-12-03T11:54:58.670 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.669+0000 7f8ee3812800 20 remove_watcher() i=3 2023-12-03T11:54:58.671 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.670+0000 7f8ee3812800 20 remove_watcher() i=4 2023-12-03T11:54:58.672 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.671+0000 7f8ee3812800 20 remove_watcher() i=5 2023-12-03T11:54:58.673 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.672+0000 7f8ee3812800 20 remove_watcher() i=6 2023-12-03T11:54:58.674 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.673+0000 7f8ee3812800 20 remove_watcher() i=7 2023-12-03T11:54:58.680 DEBUG:teuthology.orchestra.run.smithi003:> radosgw-admin gc process --include-all 2023-12-03T11:54:58.730 INFO:teuthology.orchestra.run.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:54:58.730 INFO:teuthology.orchestra.run.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:54:58.745 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.743+0000 7f905d328800 20 rados->read ofs=0 len=0 2023-12-03T11:54:58.746 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.745+0000 7f905d328800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:54:58.747 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.745+0000 7f905d328800 20 realm 2023-12-03T11:54:58.747 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.745+0000 7f905d328800 20 rados->read ofs=0 len=0 2023-12-03T11:54:58.747 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.745+0000 7f905d328800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:54:58.747 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.745+0000 7f905d328800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:54:58.747 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.745+0000 7f905d328800 20 rados->read ofs=0 len=0 2023-12-03T11:54:58.747 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.745+0000 7f905d328800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:54:58.747 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.745+0000 7f905d328800 20 rados->read ofs=0 len=0 2023-12-03T11:54:58.748 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.746+0000 7f905d328800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:54:58.748 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.746+0000 7f905d328800 20 rados->read ofs=0 len=0 2023-12-03T11:54:58.748 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.746+0000 7f905d328800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:54:58.748 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.746+0000 7f905d328800 20 searching for the correct realm 2023-12-03T11:54:58.757 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.756+0000 7f9058860640 0 -- 172.21.15.3:0/4103783779 >> [v2:172.21.15.3:6817/3356208405,v1:172.21.15.3:6819/3356208405] conn(0x561937c18230 msgr2=0x561937c1a620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:54:58.759 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.758+0000 7f905d328800 20 RGWRados::pool_iterate: got zone_info.83aabb46-04b5-4c96-9933-c6bfb1173a73 2023-12-03T11:54:58.759 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.758+0000 7f905d328800 20 RGWRados::pool_iterate: got zonegroup_info.6a811aad-435d-4fdd-93c9-b7e0b50de429 2023-12-03T11:54:58.759 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.758+0000 7f905d328800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:54:58.759 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.758+0000 7f905d328800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:54:58.759 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.758+0000 7f905d328800 20 rados->read ofs=0 len=0 2023-12-03T11:54:58.760 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.758+0000 7f905d328800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:54:58.760 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.758+0000 7f905d328800 20 rados->read ofs=0 len=0 2023-12-03T11:54:58.760 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.758+0000 7f905d328800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:54:58.760 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.758+0000 7f905d328800 20 rados->read ofs=0 len=0 2023-12-03T11:54:58.761 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.758+0000 7f905d328800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:54:58.761 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.758+0000 7f905d328800 20 zone default found 2023-12-03T11:54:58.761 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.758+0000 7f905d328800 4 Realm: () 2023-12-03T11:54:58.761 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.758+0000 7f905d328800 4 ZoneGroup: default (6a811aad-435d-4fdd-93c9-b7e0b50de429) 2023-12-03T11:54:58.761 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.758+0000 7f905d328800 4 Zone: default (83aabb46-04b5-4c96-9933-c6bfb1173a73) 2023-12-03T11:54:58.761 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.758+0000 7f905d328800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:54:58.761 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.758+0000 7f905d328800 20 zonegroup default 2023-12-03T11:54:58.761 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.758+0000 7f905d328800 20 rados->read ofs=0 len=0 2023-12-03T11:54:58.761 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.759+0000 7f905d328800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:54:58.761 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.759+0000 7f905d328800 20 rados->read ofs=0 len=0 2023-12-03T11:54:58.762 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.759+0000 7f905d328800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:54:58.762 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.759+0000 7f905d328800 20 rados->read ofs=0 len=0 2023-12-03T11:54:58.762 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.759+0000 7f905d328800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:54:58.762 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.759+0000 7f905d328800 20 started sync module instance, tier type = 2023-12-03T11:54:58.762 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.759+0000 7f905d328800 20 started zone id=83aabb46-04b5-4c96-9933-c6bfb1173a73 (name=default) with tier type = 2023-12-03T11:54:58.765 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.764+0000 7f9059862640 0 -- 172.21.15.3:0/4103783779 >> [v2:172.21.15.37:6817/511039327,v1:172.21.15.37:6819/511039327] conn(0x7f905002b040 msgr2=0x7f905002b420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:54:58.770 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.769+0000 7f905d328800 20 add_watcher() i=0 2023-12-03T11:54:58.770 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.769+0000 7f905d328800 20 add_watcher() i=1 2023-12-03T11:54:58.770 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.769+0000 7f905d328800 20 add_watcher() i=2 2023-12-03T11:54:58.770 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.769+0000 7f905d328800 20 add_watcher() i=3 2023-12-03T11:54:58.770 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.769+0000 7f905d328800 20 add_watcher() i=4 2023-12-03T11:54:58.770 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.769+0000 7f905d328800 20 add_watcher() i=5 2023-12-03T11:54:58.771 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.769+0000 7f905d328800 20 add_watcher() i=6 2023-12-03T11:54:58.771 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.770+0000 7f905d328800 20 add_watcher() i=7 2023-12-03T11:54:58.771 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.770+0000 7f905d328800 2 all 8 watchers are set, enabling cache 2023-12-03T11:54:58.772 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.771+0000 7f901efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:54:58.773 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.772+0000 7f905d328800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:54:58.773 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.772+0000 7f905d328800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:54:58.817 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.815+0000 7f8f8dffb640 20 reqs_thread_entry: start 2023-12-03T11:54:58.817 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.815+0000 7f905d328800 20 init_complete bucket index max shards: 11 2023-12-03T11:54:58.817 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.815+0000 7f905d328800 20 Filter name: none 2023-12-03T11:54:58.817 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.815+0000 7f8f7f7fe640 20 reqs_thread_entry: start 2023-12-03T11:54:58.817 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.815+0000 7f905d328800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2023-12-03T11:54:58.818 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.817+0000 7f905d328800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:58.818 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.817+0000 7f905d328800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:58.818 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.817+0000 7f905d328800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:58.819 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.818+0000 7f905d328800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2023-12-03T11:54:58.821 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.820+0000 7f905d328800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:58.821 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.820+0000 7f905d328800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:58.822 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.820+0000 7f905d328800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:58.822 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.821+0000 7f905d328800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2023-12-03T11:54:58.824 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.823+0000 7f905d328800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:58.825 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.823+0000 7f905d328800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:58.825 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.824+0000 7f905d328800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:58.826 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.825+0000 7f905d328800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2023-12-03T11:54:58.827 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.826+0000 7f905d328800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:58.828 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.827+0000 7f905d328800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:58.828 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.827+0000 7f905d328800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:58.829 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.828+0000 7f905d328800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2023-12-03T11:54:58.830 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.829+0000 7f905d328800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:58.831 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.830+0000 7f905d328800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:58.831 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.830+0000 7f905d328800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:58.832 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.831+0000 7f905d328800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2023-12-03T11:54:58.833 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.832+0000 7f905d328800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:58.833 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.832+0000 7f905d328800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:58.834 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.833+0000 7f905d328800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:58.835 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.834+0000 7f905d328800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2023-12-03T11:54:58.836 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.835+0000 7f905d328800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:58.837 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.836+0000 7f905d328800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:58.837 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.836+0000 7f905d328800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:58.838 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.837+0000 7f905d328800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2023-12-03T11:54:58.839 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.838+0000 7f905d328800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:58.840 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.839+0000 7f905d328800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:58.840 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.839+0000 7f905d328800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:58.841 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.840+0000 7f905d328800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2023-12-03T11:54:58.842 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.841+0000 7f905d328800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:58.842 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.841+0000 7f905d328800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:58.843 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.842+0000 7f905d328800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:58.844 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.843+0000 7f905d328800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2023-12-03T11:54:58.845 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.844+0000 7f905d328800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:58.845 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.844+0000 7f905d328800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:58.846 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.845+0000 7f905d328800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:58.847 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.846+0000 7f905d328800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2023-12-03T11:54:58.848 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.847+0000 7f905d328800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:58.849 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.847+0000 7f905d328800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:58.849 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.848+0000 7f905d328800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:58.850 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.849+0000 7f905d328800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2023-12-03T11:54:58.851 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.850+0000 7f905d328800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:58.852 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.850+0000 7f905d328800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:58.852 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.851+0000 7f905d328800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:58.853 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.851+0000 7f905d328800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2023-12-03T11:54:58.854 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.853+0000 7f905d328800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:58.854 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.853+0000 7f905d328800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:58.855 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.853+0000 7f905d328800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:58.855 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.854+0000 7f905d328800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2023-12-03T11:54:58.857 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.856+0000 7f905d328800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:58.857 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.856+0000 7f905d328800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:58.858 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.856+0000 7f905d328800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:58.858 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.857+0000 7f905d328800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2023-12-03T11:54:58.860 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.859+0000 7f905d328800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:58.860 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.859+0000 7f905d328800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:58.861 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.859+0000 7f905d328800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:58.862 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.860+0000 7f905d328800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2023-12-03T11:54:58.867 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.862+0000 7f905d328800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:58.867 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.862+0000 7f905d328800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:58.867 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.862+0000 7f905d328800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:58.867 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.863+0000 7f905d328800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2023-12-03T11:54:58.868 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.865+0000 7f905d328800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:58.868 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.865+0000 7f905d328800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:58.868 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.865+0000 7f905d328800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:58.868 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.866+0000 7f905d328800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2023-12-03T11:54:58.869 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.867+0000 7f905d328800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:58.869 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.868+0000 7f905d328800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:58.870 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.868+0000 7f905d328800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:58.870 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.869+0000 7f905d328800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2023-12-03T11:54:58.871 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.870+0000 7f905d328800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:58.872 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.871+0000 7f905d328800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:58.872 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.871+0000 7f905d328800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:58.873 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.872+0000 7f905d328800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2023-12-03T11:54:58.874 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.873+0000 7f905d328800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:58.875 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.874+0000 7f905d328800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:58.875 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.874+0000 7f905d328800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:58.876 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.875+0000 7f905d328800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2023-12-03T11:54:58.878 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.876+0000 7f905d328800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:58.878 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.877+0000 7f905d328800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:58.878 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.877+0000 7f905d328800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:58.879 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.878+0000 7f905d328800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2023-12-03T11:54:58.880 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.879+0000 7f905d328800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:58.881 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.880+0000 7f905d328800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:58.881 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.880+0000 7f905d328800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:58.882 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.881+0000 7f905d328800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2023-12-03T11:54:58.883 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.882+0000 7f905d328800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:58.884 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.883+0000 7f905d328800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:58.884 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.883+0000 7f905d328800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:58.885 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.884+0000 7f905d328800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2023-12-03T11:54:58.887 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.885+0000 7f905d328800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:58.887 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.886+0000 7f905d328800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:58.887 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.886+0000 7f905d328800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:58.888 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.887+0000 7f905d328800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2023-12-03T11:54:58.889 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.888+0000 7f905d328800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:58.890 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.889+0000 7f905d328800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:58.890 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.889+0000 7f905d328800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:58.891 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.890+0000 7f905d328800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2023-12-03T11:54:58.892 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.891+0000 7f905d328800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:58.893 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.892+0000 7f905d328800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:58.893 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.892+0000 7f905d328800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:58.894 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.893+0000 7f905d328800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2023-12-03T11:54:58.896 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.894+0000 7f905d328800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:58.896 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.895+0000 7f905d328800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:58.897 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.895+0000 7f905d328800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:58.897 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.896+0000 7f905d328800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2023-12-03T11:54:58.899 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.897+0000 7f905d328800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:58.899 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.898+0000 7f905d328800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:58.899 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.898+0000 7f905d328800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:58.900 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.899+0000 7f905d328800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2023-12-03T11:54:58.902 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.900+0000 7f905d328800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:58.902 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.901+0000 7f905d328800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:58.902 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.901+0000 7f905d328800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:58.903 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.902+0000 7f905d328800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2023-12-03T11:54:58.905 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.904+0000 7f905d328800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:58.905 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.904+0000 7f905d328800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:58.905 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.904+0000 7f905d328800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:58.907 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.905+0000 7f905d328800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2023-12-03T11:54:58.908 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.907+0000 7f905d328800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:58.908 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.907+0000 7f905d328800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:58.909 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.908+0000 7f905d328800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:58.910 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.909+0000 7f905d328800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2023-12-03T11:54:58.911 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.910+0000 7f905d328800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:58.912 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.911+0000 7f905d328800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:58.912 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.911+0000 7f905d328800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:58.914 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.913+0000 7f901efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:54:58.916 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.915+0000 7f905d328800 20 remove_watcher() i=0 2023-12-03T11:54:58.916 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.915+0000 7f905d328800 2 removed watcher, disabling cache 2023-12-03T11:54:58.917 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.916+0000 7f905d328800 20 remove_watcher() i=1 2023-12-03T11:54:58.918 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.917+0000 7f905d328800 20 remove_watcher() i=2 2023-12-03T11:54:58.919 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.918+0000 7f905d328800 20 remove_watcher() i=3 2023-12-03T11:54:58.921 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.919+0000 7f905d328800 20 remove_watcher() i=4 2023-12-03T11:54:58.921 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.920+0000 7f905d328800 20 remove_watcher() i=5 2023-12-03T11:54:58.923 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.922+0000 7f905d328800 20 remove_watcher() i=6 2023-12-03T11:54:58.924 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.923+0000 7f905d328800 20 remove_watcher() i=7 2023-12-03T11:54:58.930 DEBUG:teuthology.orchestra.run.smithi003:> radosgw-admin gc process --include-all 2023-12-03T11:54:58.980 INFO:teuthology.orchestra.run.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:54:58.980 INFO:teuthology.orchestra.run.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:54:58.994 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.993+0000 7fb4bd013800 20 rados->read ofs=0 len=0 2023-12-03T11:54:58.996 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.995+0000 7fb4bd013800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:54:58.996 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.995+0000 7fb4bd013800 20 realm 2023-12-03T11:54:58.997 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.995+0000 7fb4bd013800 20 rados->read ofs=0 len=0 2023-12-03T11:54:58.997 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.995+0000 7fb4bd013800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:54:58.997 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.995+0000 7fb4bd013800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:54:58.997 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.995+0000 7fb4bd013800 20 rados->read ofs=0 len=0 2023-12-03T11:54:58.997 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.995+0000 7fb4bd013800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:54:58.997 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.995+0000 7fb4bd013800 20 rados->read ofs=0 len=0 2023-12-03T11:54:58.998 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.996+0000 7fb4bd013800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:54:58.998 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.996+0000 7fb4bd013800 20 rados->read ofs=0 len=0 2023-12-03T11:54:58.998 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.996+0000 7fb4bd013800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:54:58.998 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:58.996+0000 7fb4bd013800 20 searching for the correct realm 2023-12-03T11:54:59.007 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.006+0000 7fb4bab1a640 0 -- 172.21.15.3:0/377255450 >> [v2:172.21.15.37:6805/1692844418,v1:172.21.15.37:6807/1692844418] conn(0x564322ca3260 msgr2=0x564322ca5690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:54:59.011 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.007+0000 7fb4bd013800 20 RGWRados::pool_iterate: got zone_info.83aabb46-04b5-4c96-9933-c6bfb1173a73 2023-12-03T11:54:59.012 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.007+0000 7fb4bd013800 20 RGWRados::pool_iterate: got zonegroup_info.6a811aad-435d-4fdd-93c9-b7e0b50de429 2023-12-03T11:54:59.012 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.007+0000 7fb4bd013800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:54:59.012 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.007+0000 7fb4bd013800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:54:59.012 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.007+0000 7fb4bd013800 20 rados->read ofs=0 len=0 2023-12-03T11:54:59.012 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.008+0000 7fb4bd013800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:54:59.012 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.008+0000 7fb4bd013800 20 rados->read ofs=0 len=0 2023-12-03T11:54:59.012 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.008+0000 7fb4bd013800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:54:59.012 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.008+0000 7fb4bd013800 20 rados->read ofs=0 len=0 2023-12-03T11:54:59.012 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.008+0000 7fb4bd013800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:54:59.012 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.008+0000 7fb4bd013800 20 zone default found 2023-12-03T11:54:59.012 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.008+0000 7fb4bd013800 4 Realm: () 2023-12-03T11:54:59.012 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.008+0000 7fb4bd013800 4 ZoneGroup: default (6a811aad-435d-4fdd-93c9-b7e0b50de429) 2023-12-03T11:54:59.012 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.008+0000 7fb4bd013800 4 Zone: default (83aabb46-04b5-4c96-9933-c6bfb1173a73) 2023-12-03T11:54:59.013 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.008+0000 7fb4bd013800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:54:59.013 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.008+0000 7fb4bd013800 20 zonegroup default 2023-12-03T11:54:59.013 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.008+0000 7fb4bd013800 20 rados->read ofs=0 len=0 2023-12-03T11:54:59.013 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.008+0000 7fb4bd013800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:54:59.013 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.008+0000 7fb4bd013800 20 rados->read ofs=0 len=0 2023-12-03T11:54:59.013 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.009+0000 7fb4bd013800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:54:59.013 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.009+0000 7fb4bd013800 20 rados->read ofs=0 len=0 2023-12-03T11:54:59.013 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.009+0000 7fb4bd013800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:54:59.013 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.009+0000 7fb4bd013800 20 started sync module instance, tier type = 2023-12-03T11:54:59.013 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.009+0000 7fb4bd013800 20 started zone id=83aabb46-04b5-4c96-9933-c6bfb1173a73 (name=default) with tier type = 2023-12-03T11:54:59.017 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.015+0000 7fb4bb31b640 0 -- 172.21.15.3:0/377255450 >> [v2:172.21.15.37:6816/3770469300,v1:172.21.15.37:6818/3770469300] conn(0x7fb4b002f960 msgr2=0x7fb4b002e3e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:54:59.020 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.019+0000 7fb4bd013800 20 add_watcher() i=0 2023-12-03T11:54:59.020 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.019+0000 7fb4bd013800 20 add_watcher() i=1 2023-12-03T11:54:59.020 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.019+0000 7fb4bd013800 20 add_watcher() i=2 2023-12-03T11:54:59.020 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.019+0000 7fb4bd013800 20 add_watcher() i=3 2023-12-03T11:54:59.021 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.019+0000 7fb4bd013800 20 add_watcher() i=4 2023-12-03T11:54:59.021 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.019+0000 7fb4bd013800 20 add_watcher() i=5 2023-12-03T11:54:59.021 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.019+0000 7fb4bd013800 20 add_watcher() i=6 2023-12-03T11:54:59.021 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.020+0000 7fb4bd013800 20 add_watcher() i=7 2023-12-03T11:54:59.021 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.020+0000 7fb4bd013800 2 all 8 watchers are set, enabling cache 2023-12-03T11:54:59.022 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.021+0000 7fb3fbfff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:54:59.023 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.022+0000 7fb4bd013800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:54:59.023 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.022+0000 7fb4bd013800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:54:59.066 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.064+0000 7fb3eaffd640 20 reqs_thread_entry: start 2023-12-03T11:54:59.066 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.064+0000 7fb4bd013800 20 init_complete bucket index max shards: 11 2023-12-03T11:54:59.066 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.064+0000 7fb4bd013800 20 Filter name: none 2023-12-03T11:54:59.066 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.064+0000 7fb3e8ff9640 20 reqs_thread_entry: start 2023-12-03T11:54:59.066 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.065+0000 7fb4bd013800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2023-12-03T11:54:59.067 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.066+0000 7fb4bd013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:59.067 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.066+0000 7fb4bd013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:59.068 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.067+0000 7fb4bd013800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:59.069 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.067+0000 7fb4bd013800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2023-12-03T11:54:59.070 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.069+0000 7fb4bd013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:59.074 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.070+0000 7fb4bd013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:59.075 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.070+0000 7fb4bd013800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:59.075 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.071+0000 7fb4bd013800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2023-12-03T11:54:59.075 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.072+0000 7fb4bd013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:59.075 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.073+0000 7fb4bd013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:59.075 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.073+0000 7fb4bd013800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:59.075 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.074+0000 7fb4bd013800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2023-12-03T11:54:59.077 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.076+0000 7fb4bd013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:59.077 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.076+0000 7fb4bd013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:59.078 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.076+0000 7fb4bd013800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:59.079 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.078+0000 7fb4bd013800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2023-12-03T11:54:59.080 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.079+0000 7fb4bd013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:59.080 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.079+0000 7fb4bd013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:59.081 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.080+0000 7fb4bd013800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:59.082 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.081+0000 7fb4bd013800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2023-12-03T11:54:59.083 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.082+0000 7fb4bd013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:59.084 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.082+0000 7fb4bd013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:59.084 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.083+0000 7fb4bd013800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:59.085 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.083+0000 7fb4bd013800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2023-12-03T11:54:59.086 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.085+0000 7fb4bd013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:59.086 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.085+0000 7fb4bd013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:59.087 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.086+0000 7fb4bd013800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:59.088 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.087+0000 7fb4bd013800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2023-12-03T11:54:59.089 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.088+0000 7fb4bd013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:59.090 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.089+0000 7fb4bd013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:59.090 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.089+0000 7fb4bd013800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:59.091 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.090+0000 7fb4bd013800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2023-12-03T11:54:59.092 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.091+0000 7fb4bd013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:59.093 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.092+0000 7fb4bd013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:59.093 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.092+0000 7fb4bd013800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:59.094 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.093+0000 7fb4bd013800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2023-12-03T11:54:59.096 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.095+0000 7fb4bd013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:59.096 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.095+0000 7fb4bd013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:59.096 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.095+0000 7fb4bd013800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:59.098 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.096+0000 7fb4bd013800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2023-12-03T11:54:59.099 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.097+0000 7fb4bd013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:59.099 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.098+0000 7fb4bd013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:59.099 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.098+0000 7fb4bd013800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:59.100 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.099+0000 7fb4bd013800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2023-12-03T11:54:59.102 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.100+0000 7fb4bd013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:59.102 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.101+0000 7fb4bd013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:59.102 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.101+0000 7fb4bd013800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:59.103 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.102+0000 7fb4bd013800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2023-12-03T11:54:59.104 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.103+0000 7fb4bd013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:59.105 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.104+0000 7fb4bd013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:59.105 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.104+0000 7fb4bd013800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:59.107 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.105+0000 7fb4bd013800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2023-12-03T11:54:59.107 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.106+0000 7fb4bd013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:59.108 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.107+0000 7fb4bd013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:59.108 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.107+0000 7fb4bd013800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:59.109 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.108+0000 7fb4bd013800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2023-12-03T11:54:59.110 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.109+0000 7fb4bd013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:59.111 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.110+0000 7fb4bd013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:59.111 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.110+0000 7fb4bd013800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:59.112 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.111+0000 7fb4bd013800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2023-12-03T11:54:59.113 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.112+0000 7fb4bd013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:59.114 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.113+0000 7fb4bd013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:59.114 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.113+0000 7fb4bd013800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:59.115 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.114+0000 7fb4bd013800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2023-12-03T11:54:59.116 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.115+0000 7fb4bd013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:59.117 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.116+0000 7fb4bd013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:59.117 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.116+0000 7fb4bd013800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:59.118 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.117+0000 7fb4bd013800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2023-12-03T11:54:59.119 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.118+0000 7fb4bd013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:59.120 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.119+0000 7fb4bd013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:59.120 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.119+0000 7fb4bd013800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:59.121 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.120+0000 7fb4bd013800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2023-12-03T11:54:59.122 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.121+0000 7fb4bd013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:59.123 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.121+0000 7fb4bd013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:59.123 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.122+0000 7fb4bd013800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:59.124 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.123+0000 7fb4bd013800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2023-12-03T11:54:59.125 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.124+0000 7fb4bd013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:59.126 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.125+0000 7fb4bd013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:59.126 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.125+0000 7fb4bd013800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:59.128 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.126+0000 7fb4bd013800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2023-12-03T11:54:59.129 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.128+0000 7fb4bd013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:59.129 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.128+0000 7fb4bd013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:59.130 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.128+0000 7fb4bd013800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:59.130 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.129+0000 7fb4bd013800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2023-12-03T11:54:59.132 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.131+0000 7fb4bd013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:59.132 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.131+0000 7fb4bd013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:59.133 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.131+0000 7fb4bd013800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:59.134 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.132+0000 7fb4bd013800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2023-12-03T11:54:59.136 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.135+0000 7fb4bd013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:59.136 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.135+0000 7fb4bd013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:59.136 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.135+0000 7fb4bd013800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:59.137 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.136+0000 7fb4bd013800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2023-12-03T11:54:59.139 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.138+0000 7fb4bd013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:59.139 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.138+0000 7fb4bd013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:59.140 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.138+0000 7fb4bd013800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:59.140 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.139+0000 7fb4bd013800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2023-12-03T11:54:59.142 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.141+0000 7fb4bd013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:59.143 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.142+0000 7fb4bd013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:59.143 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.142+0000 7fb4bd013800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:59.144 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.143+0000 7fb4bd013800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2023-12-03T11:54:59.145 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.144+0000 7fb4bd013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:59.146 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.144+0000 7fb4bd013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:59.146 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.145+0000 7fb4bd013800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:59.147 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.145+0000 7fb4bd013800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2023-12-03T11:54:59.148 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.147+0000 7fb4bd013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:59.149 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.148+0000 7fb4bd013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:59.149 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.148+0000 7fb4bd013800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:59.151 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.149+0000 7fb4bd013800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2023-12-03T11:54:59.152 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.151+0000 7fb4bd013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:59.152 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.151+0000 7fb4bd013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:59.153 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.152+0000 7fb4bd013800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:59.154 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.153+0000 7fb4bd013800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2023-12-03T11:54:59.155 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.154+0000 7fb4bd013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:59.157 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.155+0000 7fb4bd013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:59.157 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.155+0000 7fb4bd013800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:59.158 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.156+0000 7fb4bd013800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2023-12-03T11:54:59.159 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.158+0000 7fb4bd013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:59.159 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.158+0000 7fb4bd013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:59.160 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.158+0000 7fb4bd013800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:59.161 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.159+0000 7fb4bd013800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2023-12-03T11:54:59.162 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.161+0000 7fb4bd013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:59.163 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.161+0000 7fb4bd013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:59.163 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.162+0000 7fb4bd013800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:59.164 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.163+0000 7fb4bd013800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2023-12-03T11:54:59.166 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.165+0000 7fb4bd013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:59.167 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.165+0000 7fb4bd013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:59.167 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.166+0000 7fb4bd013800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:59.169 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.168+0000 7fb3fbfff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:54:59.171 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.170+0000 7fb4bd013800 20 remove_watcher() i=0 2023-12-03T11:54:59.171 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.170+0000 7fb4bd013800 2 removed watcher, disabling cache 2023-12-03T11:54:59.173 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.171+0000 7fb4bd013800 20 remove_watcher() i=1 2023-12-03T11:54:59.174 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.172+0000 7fb4bd013800 20 remove_watcher() i=2 2023-12-03T11:54:59.175 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.173+0000 7fb4bd013800 20 remove_watcher() i=3 2023-12-03T11:54:59.176 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.174+0000 7fb4bd013800 20 remove_watcher() i=4 2023-12-03T11:54:59.176 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.175+0000 7fb4bd013800 20 remove_watcher() i=5 2023-12-03T11:54:59.177 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.176+0000 7fb4bd013800 20 remove_watcher() i=6 2023-12-03T11:54:59.178 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.177+0000 7fb4bd013800 20 remove_watcher() i=7 2023-12-03T11:54:59.184 DEBUG:teuthology.orchestra.run.smithi003:> radosgw-admin gc process --include-all 2023-12-03T11:54:59.234 INFO:teuthology.orchestra.run.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:54:59.234 INFO:teuthology.orchestra.run.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:54:59.248 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.247+0000 7f0b7c724800 20 rados->read ofs=0 len=0 2023-12-03T11:54:59.251 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.249+0000 7f0b7c724800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:54:59.251 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.249+0000 7f0b7c724800 20 realm 2023-12-03T11:54:59.251 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.249+0000 7f0b7c724800 20 rados->read ofs=0 len=0 2023-12-03T11:54:59.251 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.249+0000 7f0b7c724800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:54:59.251 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.249+0000 7f0b7c724800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:54:59.251 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.249+0000 7f0b7c724800 20 rados->read ofs=0 len=0 2023-12-03T11:54:59.252 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.249+0000 7f0b7c724800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:54:59.252 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.249+0000 7f0b7c724800 20 rados->read ofs=0 len=0 2023-12-03T11:54:59.253 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.250+0000 7f0b7c724800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:54:59.253 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.250+0000 7f0b7c724800 20 rados->read ofs=0 len=0 2023-12-03T11:54:59.253 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.250+0000 7f0b7c724800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:54:59.253 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.250+0000 7f0b7c724800 20 searching for the correct realm 2023-12-03T11:54:59.261 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.260+0000 7f0b78395640 0 -- 172.21.15.3:0/3219136429 >> [v2:172.21.15.37:6805/1692844418,v1:172.21.15.37:6807/1692844418] conn(0x55e99a2ecab0 msgr2=0x55e99a2eeea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-03T11:54:59.263 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.262+0000 7f0b7c724800 20 RGWRados::pool_iterate: got zone_info.83aabb46-04b5-4c96-9933-c6bfb1173a73 2023-12-03T11:54:59.263 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.262+0000 7f0b7c724800 20 RGWRados::pool_iterate: got zonegroup_info.6a811aad-435d-4fdd-93c9-b7e0b50de429 2023-12-03T11:54:59.264 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.262+0000 7f0b7c724800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:54:59.264 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.262+0000 7f0b7c724800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:54:59.264 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.262+0000 7f0b7c724800 20 rados->read ofs=0 len=0 2023-12-03T11:54:59.264 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.262+0000 7f0b7c724800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:54:59.264 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.262+0000 7f0b7c724800 20 rados->read ofs=0 len=0 2023-12-03T11:54:59.265 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.263+0000 7f0b7c724800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:54:59.265 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.263+0000 7f0b7c724800 20 rados->read ofs=0 len=0 2023-12-03T11:54:59.265 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.263+0000 7f0b7c724800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:54:59.265 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.263+0000 7f0b7c724800 20 zone default found 2023-12-03T11:54:59.265 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.263+0000 7f0b7c724800 4 Realm: () 2023-12-03T11:54:59.265 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.263+0000 7f0b7c724800 4 ZoneGroup: default (6a811aad-435d-4fdd-93c9-b7e0b50de429) 2023-12-03T11:54:59.265 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.263+0000 7f0b7c724800 4 Zone: default (83aabb46-04b5-4c96-9933-c6bfb1173a73) 2023-12-03T11:54:59.266 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.263+0000 7f0b7c724800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:54:59.266 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.263+0000 7f0b7c724800 20 zonegroup default 2023-12-03T11:54:59.266 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.263+0000 7f0b7c724800 20 rados->read ofs=0 len=0 2023-12-03T11:54:59.266 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.263+0000 7f0b7c724800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:54:59.266 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.263+0000 7f0b7c724800 20 rados->read ofs=0 len=0 2023-12-03T11:54:59.266 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.263+0000 7f0b7c724800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:54:59.266 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.263+0000 7f0b7c724800 20 rados->read ofs=0 len=0 2023-12-03T11:54:59.266 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.264+0000 7f0b7c724800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:54:59.266 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.264+0000 7f0b7c724800 20 started sync module instance, tier type = 2023-12-03T11:54:59.266 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.264+0000 7f0b7c724800 20 started zone id=83aabb46-04b5-4c96-9933-c6bfb1173a73 (name=default) with tier type = 2023-12-03T11:54:59.270 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.269+0000 7f0b78b96640 0 -- 172.21.15.3:0/3219136429 >> [v2:172.21.15.37:6816/3770469300,v1:172.21.15.37:6818/3770469300] conn(0x7f0b6c086140 msgr2=0x7f0b6c00ea20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:54:59.274 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.273+0000 7f0b7c724800 20 add_watcher() i=0 2023-12-03T11:54:59.274 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.273+0000 7f0b7c724800 20 add_watcher() i=1 2023-12-03T11:54:59.274 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.273+0000 7f0b7c724800 20 add_watcher() i=2 2023-12-03T11:54:59.274 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.273+0000 7f0b7c724800 20 add_watcher() i=3 2023-12-03T11:54:59.274 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.273+0000 7f0b7c724800 20 add_watcher() i=4 2023-12-03T11:54:59.275 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.273+0000 7f0b7c724800 20 add_watcher() i=5 2023-12-03T11:54:59.275 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.273+0000 7f0b7c724800 20 add_watcher() i=6 2023-12-03T11:54:59.275 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.274+0000 7f0b7c724800 20 add_watcher() i=7 2023-12-03T11:54:59.275 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.274+0000 7f0b7c724800 2 all 8 watchers are set, enabling cache 2023-12-03T11:54:59.276 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.275+0000 7f0b3e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:54:59.277 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.276+0000 7f0b7c724800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:54:59.277 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.276+0000 7f0b7c724800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:54:59.321 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.319+0000 7f0aad7fa640 20 reqs_thread_entry: start 2023-12-03T11:54:59.321 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.319+0000 7f0b7c724800 20 init_complete bucket index max shards: 11 2023-12-03T11:54:59.321 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.319+0000 7f0b7c724800 20 Filter name: none 2023-12-03T11:54:59.321 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.319+0000 7f0aa6ffd640 20 reqs_thread_entry: start 2023-12-03T11:54:59.321 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.319+0000 7f0b7c724800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2023-12-03T11:54:59.322 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.321+0000 7f0b7c724800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:59.323 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.321+0000 7f0b7c724800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:59.323 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.322+0000 7f0b7c724800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:59.324 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.323+0000 7f0b7c724800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2023-12-03T11:54:59.325 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.324+0000 7f0b7c724800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:59.326 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.325+0000 7f0b7c724800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:59.326 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.325+0000 7f0b7c724800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:59.327 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.326+0000 7f0b7c724800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2023-12-03T11:54:59.329 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.327+0000 7f0b7c724800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:59.329 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.328+0000 7f0b7c724800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:59.330 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.328+0000 7f0b7c724800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:59.330 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.329+0000 7f0b7c724800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2023-12-03T11:54:59.332 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.330+0000 7f0b7c724800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:59.332 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.331+0000 7f0b7c724800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:59.332 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.331+0000 7f0b7c724800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:59.333 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.332+0000 7f0b7c724800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2023-12-03T11:54:59.335 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.334+0000 7f0b7c724800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:59.335 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.334+0000 7f0b7c724800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:59.336 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.335+0000 7f0b7c724800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:59.337 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.336+0000 7f0b7c724800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2023-12-03T11:54:59.338 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.337+0000 7f0b7c724800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:59.338 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.337+0000 7f0b7c724800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:59.339 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.338+0000 7f0b7c724800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:59.340 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.338+0000 7f0b7c724800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2023-12-03T11:54:59.341 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.340+0000 7f0b7c724800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:59.341 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.340+0000 7f0b7c724800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:59.342 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.340+0000 7f0b7c724800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:59.343 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.341+0000 7f0b7c724800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2023-12-03T11:54:59.344 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.343+0000 7f0b7c724800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:59.344 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.343+0000 7f0b7c724800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:59.345 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.344+0000 7f0b7c724800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:59.346 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.345+0000 7f0b7c724800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2023-12-03T11:54:59.348 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.347+0000 7f0b7c724800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:59.349 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.348+0000 7f0b7c724800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:59.349 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.348+0000 7f0b7c724800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:59.351 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.350+0000 7f0b7c724800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2023-12-03T11:54:59.352 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.351+0000 7f0b7c724800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:59.352 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.351+0000 7f0b7c724800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:59.353 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.352+0000 7f0b7c724800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:59.354 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.353+0000 7f0b7c724800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2023-12-03T11:54:59.355 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.354+0000 7f0b7c724800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:59.355 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.354+0000 7f0b7c724800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:59.356 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.354+0000 7f0b7c724800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:59.356 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.355+0000 7f0b7c724800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2023-12-03T11:54:59.358 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.357+0000 7f0b7c724800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:59.358 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.357+0000 7f0b7c724800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:59.359 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.357+0000 7f0b7c724800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:59.360 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.359+0000 7f0b7c724800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2023-12-03T11:54:59.361 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.360+0000 7f0b7c724800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:59.361 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.360+0000 7f0b7c724800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:59.362 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.360+0000 7f0b7c724800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:59.362 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.361+0000 7f0b7c724800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2023-12-03T11:54:59.364 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.363+0000 7f0b7c724800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:59.365 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.363+0000 7f0b7c724800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:59.365 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.363+0000 7f0b7c724800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:59.366 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.364+0000 7f0b7c724800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2023-12-03T11:54:59.367 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.366+0000 7f0b7c724800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:59.367 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.366+0000 7f0b7c724800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:59.368 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.366+0000 7f0b7c724800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:59.369 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.367+0000 7f0b7c724800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2023-12-03T11:54:59.370 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.369+0000 7f0b7c724800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:59.370 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.369+0000 7f0b7c724800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:59.371 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.369+0000 7f0b7c724800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:59.372 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.371+0000 7f0b7c724800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2023-12-03T11:54:59.373 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.372+0000 7f0b7c724800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:59.374 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.373+0000 7f0b7c724800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:59.374 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.373+0000 7f0b7c724800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:59.375 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.374+0000 7f0b7c724800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2023-12-03T11:54:59.377 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.375+0000 7f0b7c724800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:59.377 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.376+0000 7f0b7c724800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:59.377 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.376+0000 7f0b7c724800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:59.379 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.377+0000 7f0b7c724800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2023-12-03T11:54:59.380 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.379+0000 7f0b7c724800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:59.380 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.379+0000 7f0b7c724800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:59.380 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.379+0000 7f0b7c724800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:59.381 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.380+0000 7f0b7c724800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2023-12-03T11:54:59.383 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.381+0000 7f0b7c724800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:59.383 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.382+0000 7f0b7c724800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:59.383 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.382+0000 7f0b7c724800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:59.384 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.383+0000 7f0b7c724800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2023-12-03T11:54:59.386 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.384+0000 7f0b7c724800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:59.386 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.385+0000 7f0b7c724800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:59.387 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.385+0000 7f0b7c724800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:59.387 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.386+0000 7f0b7c724800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2023-12-03T11:54:59.389 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.388+0000 7f0b7c724800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:59.390 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.389+0000 7f0b7c724800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:59.390 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.389+0000 7f0b7c724800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:59.391 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.390+0000 7f0b7c724800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2023-12-03T11:54:59.393 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.392+0000 7f0b7c724800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:59.394 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.392+0000 7f0b7c724800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:59.394 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.392+0000 7f0b7c724800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:59.395 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.393+0000 7f0b7c724800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2023-12-03T11:54:59.396 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.395+0000 7f0b7c724800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:59.397 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.395+0000 7f0b7c724800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:59.397 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.396+0000 7f0b7c724800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:59.398 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.398+0000 7f0b7c724800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2023-12-03T11:54:59.399 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.398+0000 7f0b7c724800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:59.399 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.398+0000 7f0b7c724800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:59.400 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.399+0000 7f0b7c724800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:59.401 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.400+0000 7f0b7c724800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2023-12-03T11:54:59.402 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.401+0000 7f0b7c724800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:59.403 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.401+0000 7f0b7c724800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:59.403 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.401+0000 7f0b7c724800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:59.403 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.402+0000 7f0b7c724800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2023-12-03T11:54:59.405 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.404+0000 7f0b7c724800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:59.406 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.405+0000 7f0b7c724800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:59.406 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.405+0000 7f0b7c724800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:59.407 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.406+0000 7f0b7c724800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2023-12-03T11:54:59.409 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.408+0000 7f0b7c724800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:59.409 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.408+0000 7f0b7c724800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:59.410 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.408+0000 7f0b7c724800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:59.411 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.409+0000 7f0b7c724800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2023-12-03T11:54:59.412 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.411+0000 7f0b7c724800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:59.412 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.411+0000 7f0b7c724800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:59.413 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.411+0000 7f0b7c724800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:59.413 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.412+0000 7f0b7c724800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2023-12-03T11:54:59.415 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.414+0000 7f0b7c724800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:59.416 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.414+0000 7f0b7c724800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:59.416 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.414+0000 7f0b7c724800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:59.417 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.415+0000 7f0b7c724800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2023-12-03T11:54:59.418 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.417+0000 7f0b7c724800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:59.418 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.417+0000 7f0b7c724800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:59.418 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.417+0000 7f0b7c724800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:59.419 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.418+0000 7f0b7c724800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2023-12-03T11:54:59.421 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.419+0000 7f0b7c724800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:59.421 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.420+0000 7f0b7c724800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:54:59.421 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.420+0000 7f0b7c724800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:54:59.423 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.422+0000 7f0b3e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:54:59.425 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.424+0000 7f0b7c724800 20 remove_watcher() i=0 2023-12-03T11:54:59.426 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.424+0000 7f0b7c724800 2 removed watcher, disabling cache 2023-12-03T11:54:59.426 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.425+0000 7f0b7c724800 20 remove_watcher() i=1 2023-12-03T11:54:59.427 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.426+0000 7f0b7c724800 20 remove_watcher() i=2 2023-12-03T11:54:59.428 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.427+0000 7f0b7c724800 20 remove_watcher() i=3 2023-12-03T11:54:59.429 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.428+0000 7f0b7c724800 20 remove_watcher() i=4 2023-12-03T11:54:59.430 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.429+0000 7f0b7c724800 20 remove_watcher() i=5 2023-12-03T11:54:59.431 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.430+0000 7f0b7c724800 20 remove_watcher() i=6 2023-12-03T11:54:59.432 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:54:59.431+0000 7f0b7c724800 20 remove_watcher() i=7 2023-12-03T11:54:59.438 DEBUG:teuthology.orchestra.run.smithi003:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests ObjectTest 2023-12-03T11:54:59.911 INFO:teuthology.orchestra.run.smithi003.stdout:> Task :clean 2023-12-03T11:55:00.608 INFO:teuthology.orchestra.run.smithi003.stdout:> Task :compileJava 2023-12-03T11:55:00.608 INFO:teuthology.orchestra.run.smithi003.stdout:> Task :processResources 2023-12-03T11:55:00.608 INFO:teuthology.orchestra.run.smithi003.stdout:> Task :classes 2023-12-03T11:55:00.907 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:55:00.907 INFO:teuthology.orchestra.run.smithi003.stdout:> Task :compileTestJava 2023-12-03T11:55:00.908 INFO:teuthology.orchestra.run.smithi003.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2023-12-03T11:55:00.908 INFO:teuthology.orchestra.run.smithi003.stderr:Note: Recompile with -Xlint:deprecation for details. 2023-12-03T11:55:00.909 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:55:00.909 INFO:teuthology.orchestra.run.smithi003.stdout:> Task :processTestResources NO-SOURCE 2023-12-03T11:55:00.909 INFO:teuthology.orchestra.run.smithi003.stdout:> Task :testClasses 2023-12-03T11:55:02.807 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:55:02.807 INFO:teuthology.orchestra.run.smithi003.stdout:> Task :test 2023-12-03T11:55:02.807 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:55:02.808 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Object tests > ObjectTest.TestObjectCopyKeyNotFound STARTED 2023-12-03T11:55:02.808 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:55:02.808 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Object tests > ObjectTest.TestObjectCopyKeyNotFound PASSED 2023-12-03T11:55:03.107 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:55:03.107 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadExpectNone STARTED 2023-12-03T11:55:03.207 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:55:03.207 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadExpectNone PASSED 2023-12-03T11:55:03.507 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:55:03.507 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadMd5Empty STARTED 2023-12-03T11:55:03.607 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:55:03.607 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadMd5Empty PASSED 2023-12-03T11:55:04.007 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:55:04.007 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadLLAPI STARTED 2023-12-03T11:55:06.207 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:55:06.207 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadLLAPI PASSED 2023-12-03T11:55:06.507 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:55:06.507 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadNotFoundLLAPI STARTED 2023-12-03T11:55:06.607 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:55:06.607 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadNotFoundLLAPI PASSED 2023-12-03T11:55:06.907 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:55:06.907 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Object tests > ObjectTest.testDownloadHLAPI STARTED 2023-12-03T11:55:07.107 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:55:07.107 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Object tests > ObjectTest.testDownloadHLAPI PASSED 2023-12-03T11:55:07.507 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:55:07.507 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Object tests > ObjectTest.testDownloadNoBucketHLAPI STARTED 2023-12-03T11:55:07.508 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:55:07.508 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Object tests > ObjectTest.testDownloadNoBucketHLAPI PASSED 2023-12-03T11:55:07.607 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:55:07.607 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Object tests > ObjectTest.testDownloadNoKeyHLAPI STARTED 2023-12-03T11:55:07.707 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:55:07.707 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Object tests > ObjectTest.testDownloadNoKeyHLAPI PASSED 2023-12-03T11:55:08.007 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:55:08.007 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1MB STARTED 2023-12-03T11:55:09.807 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:55:09.807 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1MB PASSED 2023-12-03T11:55:10.208 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:55:10.208 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1b STARTED 2023-12-03T11:55:10.208 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:55:10.208 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1b PASSED 2023-12-03T11:55:10.607 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:55:10.607 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1kb STARTED 2023-12-03T11:55:10.707 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:55:10.707 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1kb PASSED 2023-12-03T11:55:11.007 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:55:11.007 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Object tests > ObjectTest.testEncryptionKeyNoSSEC STARTED 2023-12-03T11:55:11.107 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:55:11.107 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Object tests > ObjectTest.testEncryptionKeyNoSSEC PASSED 2023-12-03T11:55:11.507 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:55:11.507 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECInvalidMd5 STARTED 2023-12-03T11:55:11.607 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:55:11.607 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECInvalidMd5 PASSED 2023-12-03T11:55:11.906 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:55:11.907 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoKey STARTED 2023-12-03T11:55:12.007 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:55:12.007 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoKey PASSED 2023-12-03T11:55:12.507 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:55:12.507 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoMd5 STARTED 2023-12-03T11:55:12.607 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:55:12.607 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoMd5 PASSED 2023-12-03T11:55:13.007 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:55:13.007 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Object tests > ObjectTest.testMultiObjectDelete STARTED 2023-12-03T11:55:13.207 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:55:13.207 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Object tests > ObjectTest.testMultiObjectDelete PASSED 2023-12-03T11:55:13.507 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:55:13.507 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Object tests > ObjectTest.testMultipartCopyHLAPIA STARTED 2023-12-03T11:55:15.909 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:55:15.910 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Object tests > ObjectTest.testMultipartCopyHLAPIA PASSED 2023-12-03T11:55:16.507 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:55:16.507 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Object tests > ObjectTest.testMultipartCopyMultipleSizesLLAPI STARTED 2023-12-03T11:55:48.907 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:55:48.907 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Object tests > ObjectTest.testMultipartCopyMultipleSizesLLAPI PASSED 2023-12-03T11:55:49.608 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:55:49.608 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCBucketHLAPI STARTED 2023-12-03T11:55:49.608 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:55:49.608 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCBucketHLAPI PASSED 2023-12-03T11:55:50.007 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:55:50.007 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCKeyHLAPI STARTED 2023-12-03T11:55:50.107 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:55:50.107 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCKeyHLAPI PASSED 2023-12-03T11:55:50.606 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:55:50.607 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Object tests > ObjectTest.testMultipartDownloadHLAPI STARTED 2023-12-03T11:56:02.007 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:56:02.007 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Object tests > ObjectTest.testMultipartDownloadHLAPI PASSED 2023-12-03T11:56:02.407 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:56:02.407 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Object tests > ObjectTest.testMultipartDownloadNoBucketHLAPI STARTED 2023-12-03T11:56:02.407 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:56:02.407 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Object tests > ObjectTest.testMultipartDownloadNoBucketHLAPI PASSED 2023-12-03T11:56:02.507 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:56:02.507 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Object tests > ObjectTest.testMultipartDownloadWithPauseHLAPI STARTED 2023-12-03T11:56:05.309 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:56:05.310 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Object tests > ObjectTest.testMultipartDownloadWithPauseHLAPI PASSED 2023-12-03T11:56:05.607 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:56:05.607 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Object tests > ObjectTest.testMultipartUploadHLAPIAWS4 STARTED 2023-12-03T11:56:19.007 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:56:19.007 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Object tests > ObjectTest.testMultipartUploadHLAPIAWS4 PASSED 2023-12-03T11:56:19.507 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:56:19.507 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Object tests > ObjectTest.testMultipartUploadIncorrectMissingPartLLAPI STARTED 2023-12-03T11:56:21.507 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:56:21.507 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Object tests > ObjectTest.testMultipartUploadIncorrectMissingPartLLAPI PASSED 2023-12-03T11:56:21.807 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:56:21.807 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Object tests > ObjectTest.testMultipartUploadMultipleSizesLLAPI STARTED 2023-12-03T11:56:53.107 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:56:53.108 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Object tests > ObjectTest.testMultipartUploadMultipleSizesLLAPI PASSED 2023-12-03T11:56:53.407 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:56:53.407 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Object tests > ObjectTest.testMultipartUploadOverwriteExistingObjectLLAPI STARTED 2023-12-03T11:56:56.707 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:56:56.707 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Object tests > ObjectTest.testMultipartUploadOverwriteExistingObjectLLAPI PASSED 2023-12-03T11:56:57.107 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:56:57.107 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Object tests > ObjectTest.testMultipartUploadSmallLLAPI STARTED 2023-12-03T11:56:59.107 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:56:59.107 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Object tests > ObjectTest.testMultipartUploadSmallLLAPI PASSED 2023-12-03T11:56:59.507 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:56:59.507 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Object tests > ObjectTest.testMultipartUploadWithPause STARTED 2023-12-03T11:57:00.507 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:57:00.507 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Object tests > ObjectTest.testMultipartUploadWithPause PASSED 2023-12-03T11:57:04.707 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:57:04.707 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Object tests > ObjectTest.testObjectCopyBucketNotFound STARTED 2023-12-03T11:57:04.807 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:57:04.807 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Object tests > ObjectTest.testObjectCopyBucketNotFound PASSED 2023-12-03T11:57:04.907 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:57:04.907 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Object tests > ObjectTest.testObjectCreateBadExpectMismatch STARTED 2023-12-03T11:57:05.106 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:57:05.107 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Object tests > ObjectTest.testObjectCreateBadExpectMismatch PASSED 2023-12-03T11:57:06.307 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:57:06.307 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5InvalidShort STARTED 2023-12-03T11:57:06.406 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:57:06.407 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5InvalidShort PASSED 2023-12-03T11:57:06.806 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:57:06.807 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Ivalid STARTED 2023-12-03T11:57:06.907 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:57:06.907 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Ivalid PASSED 2023-12-03T11:57:07.207 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:57:07.207 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5None STARTED 2023-12-03T11:57:07.306 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:57:07.307 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5None PASSED 2023-12-03T11:57:07.706 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:57:07.707 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Unreadable STARTED 2023-12-03T11:57:07.807 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:57:07.807 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Unreadable PASSED 2023-12-03T11:57:08.106 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:57:08.107 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Object tests > ObjectTest.testObjectHeadZeroBytes STARTED 2023-12-03T11:57:08.207 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:57:08.207 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Object tests > ObjectTest.testObjectHeadZeroBytes PASSED 2023-12-03T11:57:08.607 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:57:08.607 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterDot STARTED 2023-12-03T11:57:08.807 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:57:08.807 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterDot PASSED 2023-12-03T11:57:09.207 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:57:09.207 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterNotExist STARTED 2023-12-03T11:57:09.407 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:57:09.407 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterNotExist PASSED 2023-12-03T11:57:09.907 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:57:09.907 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterPercentage STARTED 2023-12-03T11:57:10.107 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:57:10.107 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterPercentage PASSED 2023-12-03T11:57:10.507 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:57:10.507 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Object tests > ObjectTest.testObjectListMarkerAfterList STARTED 2023-12-03T11:57:10.707 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:57:10.707 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Object tests > ObjectTest.testObjectListMarkerAfterList PASSED 2023-12-03T11:57:11.207 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:57:11.207 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Object tests > ObjectTest.testObjectListMarkerBeforeList STARTED 2023-12-03T11:57:11.407 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:57:11.407 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Object tests > ObjectTest.testObjectListMarkerBeforeList PASSED 2023-12-03T11:57:11.806 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:57:11.807 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Object tests > ObjectTest.testObjectListMarkerNotInList STARTED 2023-12-03T11:57:12.007 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:57:12.007 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Object tests > ObjectTest.testObjectListMarkerNotInList PASSED 2023-12-03T11:57:12.507 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:57:12.507 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Object tests > ObjectTest.testObjectListMarkerUnreadable STARTED 2023-12-03T11:57:12.707 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:57:12.707 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Object tests > ObjectTest.testObjectListMarkerUnreadable PASSED 2023-12-03T11:57:13.107 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:57:13.107 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNegative STARTED 2023-12-03T11:57:13.307 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:57:13.307 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNegative PASSED 2023-12-03T11:57:13.807 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:57:13.807 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNone STARTED 2023-12-03T11:57:14.007 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:57:14.007 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNone PASSED 2023-12-03T11:57:14.407 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:57:14.407 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysOne STARTED 2023-12-03T11:57:14.607 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:57:14.607 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysOne PASSED 2023-12-03T11:57:15.007 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:57:15.007 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysZero STARTED 2023-12-03T11:57:15.207 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:57:15.207 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysZero PASSED 2023-12-03T11:57:15.707 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:57:15.707 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Object tests > ObjectTest.testObjectListPrefixAlt STARTED 2023-12-03T11:57:15.907 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:57:15.907 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Object tests > ObjectTest.testObjectListPrefixAlt PASSED 2023-12-03T11:57:16.307 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:57:16.307 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Object tests > ObjectTest.testObjectListPrefixBasic STARTED 2023-12-03T11:57:16.407 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:57:16.407 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Object tests > ObjectTest.testObjectListPrefixBasic PASSED 2023-12-03T11:57:16.907 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:57:16.907 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterAlt STARTED 2023-12-03T11:57:17.107 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:57:17.107 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterAlt PASSED 2023-12-03T11:57:17.507 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:57:17.507 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterBasic STARTED 2023-12-03T11:57:17.709 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:57:17.709 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterBasic PASSED 2023-12-03T11:57:18.107 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:57:18.107 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterDelimiterNotExist STARTED 2023-12-03T11:57:18.306 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:57:18.307 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterDelimiterNotExist PASSED 2023-12-03T11:57:18.806 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:57:18.807 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixDelimiterNotExist STARTED 2023-12-03T11:57:19.006 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:57:19.007 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixDelimiterNotExist PASSED 2023-12-03T11:57:19.407 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:57:19.407 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixNotExist STARTED 2023-12-03T11:57:19.607 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:57:19.607 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixNotExist PASSED 2023-12-03T11:57:20.106 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:57:20.107 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Object tests > ObjectTest.testObjectListPrefixEmpty STARTED 2023-12-03T11:57:20.207 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:57:20.207 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Object tests > ObjectTest.testObjectListPrefixEmpty PASSED 2023-12-03T11:57:20.707 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:57:20.707 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNone STARTED 2023-12-03T11:57:20.907 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:57:20.907 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNone PASSED 2023-12-03T11:57:21.306 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:57:21.307 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNotExist STARTED 2023-12-03T11:57:21.406 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:57:21.407 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNotExist PASSED 2023-12-03T11:57:21.906 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:57:21.907 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Object tests > ObjectTest.testObjectListPrefixUnreadable STARTED 2023-12-03T11:57:22.007 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:57:22.007 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Object tests > ObjectTest.testObjectListPrefixUnreadable PASSED 2023-12-03T11:57:22.507 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:57:22.507 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Object tests > ObjectTest.testObjectReadFromNonExistantBucket STARTED 2023-12-03T11:57:22.607 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:57:22.607 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Object tests > ObjectTest.testObjectReadFromNonExistantBucket PASSED 2023-12-03T11:57:22.906 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:57:22.907 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Object tests > ObjectTest.testObjectReadNotExist STARTED 2023-12-03T11:57:23.007 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:57:23.007 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Object tests > ObjectTest.testObjectReadNotExist PASSED 2023-12-03T11:57:23.407 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:57:23.407 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Object tests > ObjectTest.testObjectWriteCacheControl STARTED 2023-12-03T11:57:23.407 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:57:23.407 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Object tests > ObjectTest.testObjectWriteCacheControl PASSED 2023-12-03T11:57:23.806 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:57:23.807 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Object tests > ObjectTest.testObjectWriteCheckEtag STARTED 2023-12-03T11:57:23.907 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:57:23.907 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Object tests > ObjectTest.testObjectWriteCheckEtag PASSED 2023-12-03T11:57:24.206 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:57:24.207 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Object tests > ObjectTest.testObjectWriteReadUpdateReadDelete STARTED 2023-12-03T11:57:24.507 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:57:24.507 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Object tests > ObjectTest.testObjectWriteReadUpdateReadDelete PASSED 2023-12-03T11:57:24.807 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:57:24.807 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Object tests > ObjectTest.testObjectWriteToNonExistantBucket STARTED 2023-12-03T11:57:24.907 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:57:24.907 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Object tests > ObjectTest.testObjectWriteToNonExistantBucket PASSED 2023-12-03T11:57:25.006 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:57:25.007 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Object tests > ObjectTest.testRangedSkipLeadingBytesResponseCode STARTED 2023-12-03T11:57:25.109 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:57:25.110 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Object tests > ObjectTest.testRangedSkipLeadingBytesResponseCode PASSED 2023-12-03T11:57:25.507 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:57:25.507 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Object tests > ObjectTest.testRangedrequestResponseCode STARTED 2023-12-03T11:57:25.606 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:57:25.607 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Object tests > ObjectTest.testRangedrequestResponseCode PASSED 2023-12-03T11:57:26.006 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:57:26.007 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Object tests > ObjectTest.testSSEKMSNoKey STARTED 2023-12-03T11:57:26.107 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:57:26.107 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Object tests > ObjectTest.testSSEKMSNoKey PASSED 2023-12-03T11:57:26.506 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:57:26.507 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Object tests > ObjectTest.testSSEKMSNotDeclared STARTED 2023-12-03T11:57:26.607 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:57:26.607 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Object tests > ObjectTest.testSSEKMSNotDeclared PASSED 2023-12-03T11:57:26.906 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:57:26.907 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Object tests > ObjectTest.testUploadFileHLAPIBigFile STARTED 2023-12-03T11:57:38.207 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:57:38.207 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Object tests > ObjectTest.testUploadFileHLAPIBigFile PASSED 2023-12-03T11:57:38.607 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:57:38.607 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Object tests > ObjectTest.testUploadFileList STARTED 2023-12-03T11:57:49.907 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:57:49.907 INFO:teuthology.orchestra.run.smithi003.stdout:suite > Object tests > ObjectTest.testUploadFileList PASSED 2023-12-03T11:57:50.283 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:57:50.284 INFO:teuthology.orchestra.run.smithi003.stdout:---------------------------------------------------------------------- 2023-12-03T11:57:50.284 INFO:teuthology.orchestra.run.smithi003.stdout:| Results: SUCCESS (70 tests, 70 successes, 0 failures, 0 skipped) | 2023-12-03T11:57:50.284 INFO:teuthology.orchestra.run.smithi003.stdout:---------------------------------------------------------------------- 2023-12-03T11:57:50.284 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:57:50.284 INFO:teuthology.orchestra.run.smithi003.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2023-12-03T11:57:50.284 INFO:teuthology.orchestra.run.smithi003.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2023-12-03T11:57:50.284 INFO:teuthology.orchestra.run.smithi003.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2023-12-03T11:57:50.284 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:57:50.284 INFO:teuthology.orchestra.run.smithi003.stdout:BUILD SUCCESSFUL in 2m 50s 2023-12-03T11:57:50.284 INFO:teuthology.orchestra.run.smithi003.stdout:5 actionable tasks: 5 executed 2023-12-03T11:57:50.287 DEBUG:teuthology.orchestra.run.smithi003:> radosgw-admin gc process --include-all 2023-12-03T11:57:50.338 INFO:teuthology.orchestra.run.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:57:50.338 INFO:teuthology.orchestra.run.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:57:50.352 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.351+0000 7f7df1f20800 20 rados->read ofs=0 len=0 2023-12-03T11:57:50.354 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.352+0000 7f7df1f20800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:57:50.354 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.352+0000 7f7df1f20800 20 realm 2023-12-03T11:57:50.354 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.352+0000 7f7df1f20800 20 rados->read ofs=0 len=0 2023-12-03T11:57:50.354 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.353+0000 7f7df1f20800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:57:50.354 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.353+0000 7f7df1f20800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:57:50.354 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.353+0000 7f7df1f20800 20 rados->read ofs=0 len=0 2023-12-03T11:57:50.354 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.353+0000 7f7df1f20800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:57:50.354 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.353+0000 7f7df1f20800 20 rados->read ofs=0 len=0 2023-12-03T11:57:50.355 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.354+0000 7f7df1f20800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:57:50.355 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.354+0000 7f7df1f20800 20 rados->read ofs=0 len=0 2023-12-03T11:57:50.355 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.354+0000 7f7df1f20800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:57:50.355 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.354+0000 7f7df1f20800 20 searching for the correct realm 2023-12-03T11:57:50.368 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.366+0000 7f7dee3ee640 0 -- 172.21.15.3:0/3821756056 >> [v2:172.21.15.37:6816/3770469300,v1:172.21.15.37:6818/3770469300] conn(0x7f7de4027970 msgr2=0x7f7de40333f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:57:50.368 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.366+0000 7f7df1f20800 20 RGWRados::pool_iterate: got zone_info.83aabb46-04b5-4c96-9933-c6bfb1173a73 2023-12-03T11:57:50.368 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.366+0000 7f7df1f20800 20 RGWRados::pool_iterate: got zonegroup_info.6a811aad-435d-4fdd-93c9-b7e0b50de429 2023-12-03T11:57:50.368 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.366+0000 7f7df1f20800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:57:50.368 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.366+0000 7f7df1f20800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:57:50.368 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.366+0000 7f7df1f20800 20 rados->read ofs=0 len=0 2023-12-03T11:57:50.368 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.367+0000 7f7df1f20800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:57:50.368 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.367+0000 7f7df1f20800 20 rados->read ofs=0 len=0 2023-12-03T11:57:50.369 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.367+0000 7f7df1f20800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:57:50.370 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.367+0000 7f7df1f20800 20 rados->read ofs=0 len=0 2023-12-03T11:57:50.370 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.367+0000 7f7df1f20800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:57:50.370 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.367+0000 7f7df1f20800 20 zone default found 2023-12-03T11:57:50.370 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.367+0000 7f7df1f20800 4 Realm: () 2023-12-03T11:57:50.370 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.367+0000 7f7df1f20800 4 ZoneGroup: default (6a811aad-435d-4fdd-93c9-b7e0b50de429) 2023-12-03T11:57:50.370 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.367+0000 7f7df1f20800 4 Zone: default (83aabb46-04b5-4c96-9933-c6bfb1173a73) 2023-12-03T11:57:50.370 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.367+0000 7f7df1f20800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:57:50.370 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.367+0000 7f7df1f20800 20 zonegroup default 2023-12-03T11:57:50.370 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.367+0000 7f7df1f20800 20 rados->read ofs=0 len=0 2023-12-03T11:57:50.370 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.367+0000 7f7df1f20800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:57:50.370 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.367+0000 7f7df1f20800 20 rados->read ofs=0 len=0 2023-12-03T11:57:50.370 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.368+0000 7f7df1f20800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:57:50.370 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.368+0000 7f7df1f20800 20 rados->read ofs=0 len=0 2023-12-03T11:57:50.371 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.368+0000 7f7df1f20800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:57:50.371 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.368+0000 7f7df1f20800 20 started sync module instance, tier type = 2023-12-03T11:57:50.371 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.368+0000 7f7df1f20800 20 started zone id=83aabb46-04b5-4c96-9933-c6bfb1173a73 (name=default) with tier type = 2023-12-03T11:57:50.379 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.377+0000 7f7ded3ec640 0 -- 172.21.15.3:0/3821756056 >> [v2:172.21.15.3:6817/3356208405,v1:172.21.15.3:6819/3356208405] conn(0x55aee4c269a0 msgr2=0x55aee4c28d90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:57:50.379 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.378+0000 7f7df1f20800 20 add_watcher() i=0 2023-12-03T11:57:50.379 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.378+0000 7f7df1f20800 20 add_watcher() i=1 2023-12-03T11:57:50.379 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.378+0000 7f7df1f20800 20 add_watcher() i=2 2023-12-03T11:57:50.379 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.378+0000 7f7df1f20800 20 add_watcher() i=3 2023-12-03T11:57:50.379 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.378+0000 7f7df1f20800 20 add_watcher() i=4 2023-12-03T11:57:50.380 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.378+0000 7f7df1f20800 20 add_watcher() i=5 2023-12-03T11:57:50.380 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.378+0000 7f7df1f20800 20 add_watcher() i=6 2023-12-03T11:57:50.380 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.379+0000 7f7df1f20800 20 add_watcher() i=7 2023-12-03T11:57:50.380 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.379+0000 7f7df1f20800 2 all 8 watchers are set, enabling cache 2023-12-03T11:57:50.382 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.380+0000 7f7db37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:57:50.382 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.381+0000 7f7df1f20800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:57:50.382 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.381+0000 7f7df1f20800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:57:50.429 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.427+0000 7f7d227fc640 20 reqs_thread_entry: start 2023-12-03T11:57:50.429 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.427+0000 7f7df1f20800 20 init_complete bucket index max shards: 11 2023-12-03T11:57:50.429 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.427+0000 7f7df1f20800 20 Filter name: none 2023-12-03T11:57:50.429 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.427+0000 7f7d13fff640 20 reqs_thread_entry: start 2023-12-03T11:57:50.429 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.427+0000 7f7df1f20800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2023-12-03T11:57:50.430 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.429+0000 7f7df1f20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:57:50.431 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.429+0000 7f7df1f20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:57:50.432 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.430+0000 7f7df1f20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2023-12-03T11:57:50.432 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.430+0000 7f7df1f20800 20 garbage collection: RGWGC::process iterating over entry tag='83aabb46-04b5-4c96-9933-c6bfb1173a73.4653.2393897529717349296', time=2023-12-03T13:55:45.576789+0000, chain.objs.size()=5 2023-12-03T11:57:50.432 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.430+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.83__multipart_key1.2~5COECgF1uxS8w0E1StSei91xTbJMK4v.1 2023-12-03T11:57:50.432 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.430+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.83__shadow_key1.2~5COECgF1uxS8w0E1StSei91xTbJMK4v.1_1 2023-12-03T11:57:50.432 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.430+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.83__multipart_key1.2~5COECgF1uxS8w0E1StSei91xTbJMK4v.2 2023-12-03T11:57:50.433 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.430+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.83__shadow_key1.2~5COECgF1uxS8w0E1StSei91xTbJMK4v.2_1 2023-12-03T11:57:50.433 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.430+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.83__multipart_key1.2~5COECgF1uxS8w0E1StSei91xTbJMK4v.3 2023-12-03T11:57:50.433 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.430+0000 7f7df1f20800 20 garbage collection: RGWGC::process iterating over entry tag='83aabb46-04b5-4c96-9933-c6bfb1173a73.4653.17627044890224871113', time=2023-12-03T13:55:49.268553+0000, chain.objs.size()=4 2023-12-03T11:57:50.433 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.430+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.82__shadow_.ZIvvvRiVTbVxUnjjuF92qQf0xmUKfCg_1 2023-12-03T11:57:50.433 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.430+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.82__shadow_.ZIvvvRiVTbVxUnjjuF92qQf0xmUKfCg_2 2023-12-03T11:57:50.433 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.430+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.82__shadow_.ZIvvvRiVTbVxUnjjuF92qQf0xmUKfCg_3 2023-12-03T11:57:50.433 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.430+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.82__shadow_.ZIvvvRiVTbVxUnjjuF92qQf0xmUKfCg_4 2023-12-03T11:57:50.433 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.430+0000 7f7df1f20800 20 garbage collection: RGWGC::process iterating over entry tag='83aabb46-04b5-4c96-9933-c6bfb1173a73.4653.8935228917270498311', time=2023-12-03T13:56:53.144738+0000, chain.objs.size()=5 2023-12-03T11:57:50.433 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.430+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.91__multipart_key1.2~FkYw80tfid94wGQ5dauevdhrQO9XDQN.1 2023-12-03T11:57:50.433 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.430+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.91__shadow_key1.2~FkYw80tfid94wGQ5dauevdhrQO9XDQN.1_1 2023-12-03T11:57:50.433 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.430+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.91__multipart_key1.2~FkYw80tfid94wGQ5dauevdhrQO9XDQN.2 2023-12-03T11:57:50.437 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.436+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.91__shadow_key1.2~FkYw80tfid94wGQ5dauevdhrQO9XDQN.2_1 2023-12-03T11:57:50.437 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.436+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.91__multipart_key1.2~FkYw80tfid94wGQ5dauevdhrQO9XDQN.3 2023-12-03T11:57:50.440 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.439+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:57:50.443 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.442+0000 7f7df1f20800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2023-12-03T11:57:50.444 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.443+0000 7f7df1f20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:57:50.445 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.444+0000 7f7df1f20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:57:50.446 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.444+0000 7f7df1f20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2023-12-03T11:57:50.446 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.444+0000 7f7df1f20800 20 garbage collection: RGWGC::process iterating over entry tag='83aabb46-04b5-4c96-9933-c6bfb1173a73.4653.5220313745417952951', time=2023-12-03T13:55:48.988025+0000, chain.objs.size()=5 2023-12-03T11:57:50.446 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.444+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.83__multipart_key1.2~rhbEfG0VvILDKD80LaCJfZjoqS5SMyE.1 2023-12-03T11:57:50.446 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.444+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.83__shadow_key1.2~rhbEfG0VvILDKD80LaCJfZjoqS5SMyE.1_1 2023-12-03T11:57:50.446 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.444+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.83__multipart_key1.2~rhbEfG0VvILDKD80LaCJfZjoqS5SMyE.2 2023-12-03T11:57:50.446 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.444+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.83__shadow_key1.2~rhbEfG0VvILDKD80LaCJfZjoqS5SMyE.2_1 2023-12-03T11:57:50.446 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.444+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.83__multipart_key1.2~rhbEfG0VvILDKD80LaCJfZjoqS5SMyE.3 2023-12-03T11:57:50.448 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.446+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:57:50.450 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.449+0000 7f7df1f20800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2023-12-03T11:57:50.452 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.451+0000 7f7df1f20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:57:50.452 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.451+0000 7f7df1f20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:57:50.453 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.451+0000 7f7df1f20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2023-12-03T11:57:50.453 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.451+0000 7f7df1f20800 20 garbage collection: RGWGC::process iterating over entry tag='83aabb46-04b5-4c96-9933-c6bfb1173a73.4653.13962707990497046084', time=2023-12-03T13:55:35.253220+0000, chain.objs.size()=5 2023-12-03T11:57:50.453 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.451+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.83__multipart_key1.2~TWCuEJgWMm41iwlYdTVuMlAKvEYJJ2S.1 2023-12-03T11:57:50.453 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.451+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.83__multipart_key1.2~TWCuEJgWMm41iwlYdTVuMlAKvEYJJ2S.2 2023-12-03T11:57:50.453 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.451+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.83__multipart_key1.2~TWCuEJgWMm41iwlYdTVuMlAKvEYJJ2S.3 2023-12-03T11:57:50.454 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.451+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.83__multipart_key1.2~TWCuEJgWMm41iwlYdTVuMlAKvEYJJ2S.4 2023-12-03T11:57:50.454 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.451+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.83__multipart_key1.2~TWCuEJgWMm41iwlYdTVuMlAKvEYJJ2S.5 2023-12-03T11:57:50.454 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.451+0000 7f7df1f20800 20 garbage collection: RGWGC::process iterating over entry tag='83aabb46-04b5-4c96-9933-c6bfb1173a73.4653.12740166453413169358', time=2023-12-03T13:56:56.804024+0000, chain.objs.size()=5 2023-12-03T11:57:50.454 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.451+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.92__multipart_key1.2~Ny4EMQiAkDsAoezFsY5J1VCXXnLTLrU.1 2023-12-03T11:57:50.454 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.451+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.92__multipart_key1.2~Ny4EMQiAkDsAoezFsY5J1VCXXnLTLrU.2 2023-12-03T11:57:50.454 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.451+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.92__multipart_key1.2~Ny4EMQiAkDsAoezFsY5J1VCXXnLTLrU.3 2023-12-03T11:57:50.454 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.451+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.92__multipart_key1.2~Ny4EMQiAkDsAoezFsY5J1VCXXnLTLrU.4 2023-12-03T11:57:50.454 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.451+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.92__multipart_key1.2~Ny4EMQiAkDsAoezFsY5J1VCXXnLTLrU.5 2023-12-03T11:57:50.457 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.456+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:57:50.460 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.459+0000 7f7df1f20800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2023-12-03T11:57:50.462 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.461+0000 7f7df1f20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:57:50.462 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.461+0000 7f7df1f20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:57:50.462 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.461+0000 7f7df1f20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:57:50.464 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.463+0000 7f7df1f20800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2023-12-03T11:57:50.465 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.464+0000 7f7df1f20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:57:50.466 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.464+0000 7f7df1f20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:57:50.466 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.465+0000 7f7df1f20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:57:50.467 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.466+0000 7f7df1f20800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2023-12-03T11:57:50.468 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.467+0000 7f7df1f20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:57:50.468 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.467+0000 7f7df1f20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:57:50.469 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.468+0000 7f7df1f20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2023-12-03T11:57:50.469 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.468+0000 7f7df1f20800 20 garbage collection: RGWGC::process iterating over entry tag='83aabb46-04b5-4c96-9933-c6bfb1173a73.4653.3655176298454923325', time=2023-12-03T13:55:48.785440+0000, chain.objs.size()=5 2023-12-03T11:57:50.469 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.468+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.83__multipart_key1.2~qvVtfSyTqqTbMD2Qej_D1kqAkLMqxcM.1 2023-12-03T11:57:50.470 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.468+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.83__shadow_key1.2~qvVtfSyTqqTbMD2Qej_D1kqAkLMqxcM.1_1 2023-12-03T11:57:50.470 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.468+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.83__multipart_key1.2~qvVtfSyTqqTbMD2Qej_D1kqAkLMqxcM.2 2023-12-03T11:57:50.470 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.468+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.83__shadow_key1.2~qvVtfSyTqqTbMD2Qej_D1kqAkLMqxcM.2_1 2023-12-03T11:57:50.470 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.468+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.83__multipart_key1.2~qvVtfSyTqqTbMD2Qej_D1kqAkLMqxcM.3 2023-12-03T11:57:50.471 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.470+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:57:50.474 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.473+0000 7f7df1f20800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2023-12-03T11:57:50.476 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.475+0000 7f7df1f20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:57:50.476 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.475+0000 7f7df1f20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:57:50.478 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.476+0000 7f7df1f20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=9, truncated=0, next_marker='' 2023-12-03T11:57:50.478 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.476+0000 7f7df1f20800 20 garbage collection: RGWGC::process iterating over entry tag='83aabb46-04b5-4c96-9933-c6bfb1173a73.4653.5661937043042298397', time=2023-12-03T13:56:59.194372+0000, chain.objs.size()=5 2023-12-03T11:57:50.478 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.476+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.93__multipart_key1.2~LmRbdHlDmvctgpSAWlaixiYD9_hzgAh.1 2023-12-03T11:57:50.478 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.476+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.93__multipart_key1.2~LmRbdHlDmvctgpSAWlaixiYD9_hzgAh.2 2023-12-03T11:57:50.478 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.476+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.93__multipart_key1.2~LmRbdHlDmvctgpSAWlaixiYD9_hzgAh.3 2023-12-03T11:57:50.478 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.476+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.93__multipart_key1.2~LmRbdHlDmvctgpSAWlaixiYD9_hzgAh.4 2023-12-03T11:57:50.478 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.476+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.93__multipart_key1.2~LmRbdHlDmvctgpSAWlaixiYD9_hzgAh.5 2023-12-03T11:57:50.478 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.476+0000 7f7df1f20800 20 garbage collection: RGWGC::process iterating over entry tag='2~rOu-fggc1lPj05uEmyRbGxE4dQDGSHv', time=2023-12-03T13:57:03.395568+0000, chain.objs.size()=1 2023-12-03T11:57:50.479 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.476+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.94__multipart_key1.2~rOu-fggc1lPj05uEmyRbGxE4dQDGSHv.14 2023-12-03T11:57:50.479 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.476+0000 7f7df1f20800 20 garbage collection: RGWGC::process iterating over entry tag='2~rOu-fggc1lPj05uEmyRbGxE4dQDGSHv', time=2023-12-03T13:57:03.426503+0000, chain.objs.size()=1 2023-12-03T11:57:50.479 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.476+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.94__multipart_key1.2~rOu-fggc1lPj05uEmyRbGxE4dQDGSHv.15 2023-12-03T11:57:50.479 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.476+0000 7f7df1f20800 20 garbage collection: RGWGC::process iterating over entry tag='2~rOu-fggc1lPj05uEmyRbGxE4dQDGSHv', time=2023-12-03T13:57:03.511617+0000, chain.objs.size()=1 2023-12-03T11:57:50.479 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.476+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.94__multipart_key1.2~rOu-fggc1lPj05uEmyRbGxE4dQDGSHv.16 2023-12-03T11:57:50.479 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.476+0000 7f7df1f20800 20 garbage collection: RGWGC::process iterating over entry tag='2~rOu-fggc1lPj05uEmyRbGxE4dQDGSHv', time=2023-12-03T13:57:03.537550+0000, chain.objs.size()=1 2023-12-03T11:57:50.479 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.476+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.94__multipart_key1.2~rOu-fggc1lPj05uEmyRbGxE4dQDGSHv.17 2023-12-03T11:57:50.479 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.476+0000 7f7df1f20800 20 garbage collection: RGWGC::process iterating over entry tag='2~rOu-fggc1lPj05uEmyRbGxE4dQDGSHv', time=2023-12-03T13:57:03.616536+0000, chain.objs.size()=1 2023-12-03T11:57:50.479 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.476+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.94__multipart_key1.2~rOu-fggc1lPj05uEmyRbGxE4dQDGSHv.18 2023-12-03T11:57:50.479 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.476+0000 7f7df1f20800 20 garbage collection: RGWGC::process iterating over entry tag='2~rOu-fggc1lPj05uEmyRbGxE4dQDGSHv', time=2023-12-03T13:57:03.710952+0000, chain.objs.size()=1 2023-12-03T11:57:50.479 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.476+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.94__multipart_key1.2~rOu-fggc1lPj05uEmyRbGxE4dQDGSHv.19 2023-12-03T11:57:50.479 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.476+0000 7f7df1f20800 20 garbage collection: RGWGC::process iterating over entry tag='2~rOu-fggc1lPj05uEmyRbGxE4dQDGSHv', time=2023-12-03T13:57:03.763701+0000, chain.objs.size()=1 2023-12-03T11:57:50.479 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.476+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.94__multipart_key1.2~rOu-fggc1lPj05uEmyRbGxE4dQDGSHv.20 2023-12-03T11:57:50.481 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.479+0000 7f7df1f20800 20 garbage collection: RGWGC::process iterating over entry tag='2~rOu-fggc1lPj05uEmyRbGxE4dQDGSHv', time=2023-12-03T13:57:03.870343+0000, chain.objs.size()=60 2023-12-03T11:57:50.481 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.479+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.94__multipart_key1.2~rOu-fggc1lPj05uEmyRbGxE4dQDGSHv.1 2023-12-03T11:57:50.481 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.479+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.94__multipart_key1.2~rOu-fggc1lPj05uEmyRbGxE4dQDGSHv.2 2023-12-03T11:57:50.481 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.479+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.94__multipart_key1.2~rOu-fggc1lPj05uEmyRbGxE4dQDGSHv.3 2023-12-03T11:57:50.481 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.479+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.94__multipart_key1.2~rOu-fggc1lPj05uEmyRbGxE4dQDGSHv.4 2023-12-03T11:57:50.481 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.479+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.94__multipart_key1.2~rOu-fggc1lPj05uEmyRbGxE4dQDGSHv.5 2023-12-03T11:57:50.481 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.479+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.94__multipart_key1.2~rOu-fggc1lPj05uEmyRbGxE4dQDGSHv.6 2023-12-03T11:57:50.481 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.480+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.94__multipart_key1.2~rOu-fggc1lPj05uEmyRbGxE4dQDGSHv.7 2023-12-03T11:57:50.482 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.481+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.94__multipart_key1.2~rOu-fggc1lPj05uEmyRbGxE4dQDGSHv.8 2023-12-03T11:57:50.482 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.481+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.94__multipart_key1.2~rOu-fggc1lPj05uEmyRbGxE4dQDGSHv.9 2023-12-03T11:57:50.483 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.481+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.94__multipart_key1.2~rOu-fggc1lPj05uEmyRbGxE4dQDGSHv.10 2023-12-03T11:57:50.483 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.482+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.94__multipart_key1.2~rOu-fggc1lPj05uEmyRbGxE4dQDGSHv.11 2023-12-03T11:57:50.485 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.484+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.94__multipart_key1.2~rOu-fggc1lPj05uEmyRbGxE4dQDGSHv.12 2023-12-03T11:57:50.487 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.486+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.94__multipart_key1.2~rOu-fggc1lPj05uEmyRbGxE4dQDGSHv.13 2023-12-03T11:57:50.487 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.486+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.94__multipart_key1.GLM2FqJdMdg7jEcP26YlrzDX26ZaaXyH.14 2023-12-03T11:57:50.488 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.486+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.94__multipart_key1.oW2ikY-wcyLPthv33aRxI1rznYtDk5G6.15 2023-12-03T11:57:50.488 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.486+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.94__multipart_key1.WNRM4ECSqW2nMMnAe9ILcgYVun6cZge3.16 2023-12-03T11:57:50.488 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.486+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.94__multipart_key1.oBl2GFhiib14TkrCZ23A3fGPSvlcmoHi.17 2023-12-03T11:57:50.488 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.486+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.94__multipart_key1.YPvvqvJIOq1DaFKT01vcw_YCGZ9k2ZZC.18 2023-12-03T11:57:50.488 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.486+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.94__multipart_key1.lc3AcUj73Du18F7VIm9yOHb5t4tlEjrW.19 2023-12-03T11:57:50.488 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.486+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.94__multipart_key1.fBv3m3jwGPHm83rO58pQNnNdwJSvUFMy.20 2023-12-03T11:57:50.488 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.486+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.94__multipart_key1.2~rOu-fggc1lPj05uEmyRbGxE4dQDGSHv.21 2023-12-03T11:57:50.488 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.486+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.94__multipart_key1.2~rOu-fggc1lPj05uEmyRbGxE4dQDGSHv.22 2023-12-03T11:57:50.488 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.486+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.94__multipart_key1.2~rOu-fggc1lPj05uEmyRbGxE4dQDGSHv.23 2023-12-03T11:57:50.490 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.489+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.94__multipart_key1.2~rOu-fggc1lPj05uEmyRbGxE4dQDGSHv.24 2023-12-03T11:57:50.491 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.489+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.94__multipart_key1.2~rOu-fggc1lPj05uEmyRbGxE4dQDGSHv.25 2023-12-03T11:57:50.491 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.489+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.94__multipart_key1.2~rOu-fggc1lPj05uEmyRbGxE4dQDGSHv.26 2023-12-03T11:57:50.491 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.490+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.94__multipart_key1.2~rOu-fggc1lPj05uEmyRbGxE4dQDGSHv.27 2023-12-03T11:57:50.491 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.490+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.94__multipart_key1.2~rOu-fggc1lPj05uEmyRbGxE4dQDGSHv.28 2023-12-03T11:57:50.492 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.491+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.94__multipart_key1.2~rOu-fggc1lPj05uEmyRbGxE4dQDGSHv.29 2023-12-03T11:57:50.492 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.491+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.94__multipart_key1.2~rOu-fggc1lPj05uEmyRbGxE4dQDGSHv.30 2023-12-03T11:57:50.493 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.491+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.94__multipart_key1.2~rOu-fggc1lPj05uEmyRbGxE4dQDGSHv.31 2023-12-03T11:57:50.493 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.491+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.94__multipart_key1.2~rOu-fggc1lPj05uEmyRbGxE4dQDGSHv.32 2023-12-03T11:57:50.493 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.491+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.94__multipart_key1.2~rOu-fggc1lPj05uEmyRbGxE4dQDGSHv.33 2023-12-03T11:57:50.493 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.491+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.94__multipart_key1.2~rOu-fggc1lPj05uEmyRbGxE4dQDGSHv.34 2023-12-03T11:57:50.494 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.493+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.94__multipart_key1.2~rOu-fggc1lPj05uEmyRbGxE4dQDGSHv.35 2023-12-03T11:57:50.494 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.493+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.94__multipart_key1.2~rOu-fggc1lPj05uEmyRbGxE4dQDGSHv.36 2023-12-03T11:57:50.495 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.494+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.94__multipart_key1.2~rOu-fggc1lPj05uEmyRbGxE4dQDGSHv.37 2023-12-03T11:57:50.496 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.495+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.94__multipart_key1.2~rOu-fggc1lPj05uEmyRbGxE4dQDGSHv.38 2023-12-03T11:57:50.496 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.495+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.94__multipart_key1.2~rOu-fggc1lPj05uEmyRbGxE4dQDGSHv.39 2023-12-03T11:57:50.497 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.496+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.94__multipart_key1.2~rOu-fggc1lPj05uEmyRbGxE4dQDGSHv.40 2023-12-03T11:57:50.497 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.496+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.94__multipart_key1.2~rOu-fggc1lPj05uEmyRbGxE4dQDGSHv.41 2023-12-03T11:57:50.498 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.496+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.94__multipart_key1.2~rOu-fggc1lPj05uEmyRbGxE4dQDGSHv.42 2023-12-03T11:57:50.498 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.496+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.94__multipart_key1.2~rOu-fggc1lPj05uEmyRbGxE4dQDGSHv.43 2023-12-03T11:57:50.499 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.498+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.94__multipart_key1.2~rOu-fggc1lPj05uEmyRbGxE4dQDGSHv.44 2023-12-03T11:57:50.500 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.498+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.94__multipart_key1.2~rOu-fggc1lPj05uEmyRbGxE4dQDGSHv.45 2023-12-03T11:57:50.500 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.498+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.94__multipart_key1.2~rOu-fggc1lPj05uEmyRbGxE4dQDGSHv.46 2023-12-03T11:57:50.500 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.498+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.94__multipart_key1.2~rOu-fggc1lPj05uEmyRbGxE4dQDGSHv.47 2023-12-03T11:57:50.500 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.498+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.94__multipart_key1.2~rOu-fggc1lPj05uEmyRbGxE4dQDGSHv.48 2023-12-03T11:57:50.500 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.498+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.94__multipart_key1.2~rOu-fggc1lPj05uEmyRbGxE4dQDGSHv.49 2023-12-03T11:57:50.500 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.498+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.94__multipart_key1.2~rOu-fggc1lPj05uEmyRbGxE4dQDGSHv.50 2023-12-03T11:57:50.500 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.499+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.94__multipart_key1.2~rOu-fggc1lPj05uEmyRbGxE4dQDGSHv.51 2023-12-03T11:57:50.501 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.500+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.94__multipart_key1.2~rOu-fggc1lPj05uEmyRbGxE4dQDGSHv.52 2023-12-03T11:57:50.502 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.500+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.94__multipart_key1.2~rOu-fggc1lPj05uEmyRbGxE4dQDGSHv.53 2023-12-03T11:57:50.502 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.500+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.94__multipart_key1.2~rOu-fggc1lPj05uEmyRbGxE4dQDGSHv.54 2023-12-03T11:57:50.503 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.502+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.94__multipart_key1.2~rOu-fggc1lPj05uEmyRbGxE4dQDGSHv.55 2023-12-03T11:57:50.504 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.502+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.94__multipart_key1.2~rOu-fggc1lPj05uEmyRbGxE4dQDGSHv.56 2023-12-03T11:57:50.504 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.502+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.94__multipart_key1.2~rOu-fggc1lPj05uEmyRbGxE4dQDGSHv.57 2023-12-03T11:57:50.504 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.502+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.94__multipart_key1.2~rOu-fggc1lPj05uEmyRbGxE4dQDGSHv.59 2023-12-03T11:57:50.505 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.503+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.94__multipart_key1.2~rOu-fggc1lPj05uEmyRbGxE4dQDGSHv.60 2023-12-03T11:57:50.505 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.503+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.94__multipart_key1.2~rOu-fggc1lPj05uEmyRbGxE4dQDGSHv.63 2023-12-03T11:57:50.507 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.506+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:57:50.510 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.509+0000 7f7df1f20800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2023-12-03T11:57:50.511 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.510+0000 7f7df1f20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:57:50.512 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.510+0000 7f7df1f20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:57:50.512 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.510+0000 7f7df1f20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:57:50.513 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.511+0000 7f7df1f20800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2023-12-03T11:57:50.514 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.513+0000 7f7df1f20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:57:50.514 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.513+0000 7f7df1f20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:57:50.515 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.513+0000 7f7df1f20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:57:50.516 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.514+0000 7f7df1f20800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2023-12-03T11:57:50.517 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.516+0000 7f7df1f20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:57:50.518 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.517+0000 7f7df1f20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:57:50.519 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.517+0000 7f7df1f20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2023-12-03T11:57:50.519 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.517+0000 7f7df1f20800 20 garbage collection: RGWGC::process iterating over entry tag='83aabb46-04b5-4c96-9933-c6bfb1173a73.4653.9523943493186748020', time=2023-12-03T13:55:39.142305+0000, chain.objs.size()=5 2023-12-03T11:57:50.519 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.517+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.83__multipart_key1.2~xrCZFAFUGnG2DmWZzD0BMNuR1VMpTEL.1 2023-12-03T11:57:50.519 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.517+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.83__multipart_key1.2~xrCZFAFUGnG2DmWZzD0BMNuR1VMpTEL.2 2023-12-03T11:57:50.519 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.517+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.83__multipart_key1.2~xrCZFAFUGnG2DmWZzD0BMNuR1VMpTEL.3 2023-12-03T11:57:50.519 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.517+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.83__multipart_key1.2~xrCZFAFUGnG2DmWZzD0BMNuR1VMpTEL.4 2023-12-03T11:57:50.519 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.517+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.83__multipart_key1.2~xrCZFAFUGnG2DmWZzD0BMNuR1VMpTEL.5 2023-12-03T11:57:50.522 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.520+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:57:50.524 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.523+0000 7f7df1f20800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2023-12-03T11:57:50.525 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.524+0000 7f7df1f20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:57:50.526 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.525+0000 7f7df1f20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:57:50.526 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.525+0000 7f7df1f20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:57:50.527 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.526+0000 7f7df1f20800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2023-12-03T11:57:50.528 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.527+0000 7f7df1f20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:57:50.529 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.528+0000 7f7df1f20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:57:50.530 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.528+0000 7f7df1f20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2023-12-03T11:57:50.530 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.528+0000 7f7df1f20800 20 garbage collection: RGWGC::process iterating over entry tag='83aabb46-04b5-4c96-9933-c6bfb1173a73.4653.16260852888122674195', time=2023-12-03T13:56:37.555106+0000, chain.objs.size()=5 2023-12-03T11:57:50.530 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.528+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.91__multipart_key1.2~Z2w9d_XKRnCFdBsdz-ZVvlBPBlL3_3x.1 2023-12-03T11:57:50.530 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.528+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.91__multipart_key1.2~Z2w9d_XKRnCFdBsdz-ZVvlBPBlL3_3x.2 2023-12-03T11:57:50.530 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.528+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.91__multipart_key1.2~Z2w9d_XKRnCFdBsdz-ZVvlBPBlL3_3x.3 2023-12-03T11:57:50.530 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.528+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.91__multipart_key1.2~Z2w9d_XKRnCFdBsdz-ZVvlBPBlL3_3x.4 2023-12-03T11:57:50.530 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.528+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.91__multipart_key1.2~Z2w9d_XKRnCFdBsdz-ZVvlBPBlL3_3x.5 2023-12-03T11:57:50.533 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.530+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:57:50.535 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.534+0000 7f7df1f20800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2023-12-03T11:57:50.536 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.535+0000 7f7df1f20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:57:50.536 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.535+0000 7f7df1f20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:57:50.537 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.536+0000 7f7df1f20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2023-12-03T11:57:50.537 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.536+0000 7f7df1f20800 20 garbage collection: RGWGC::process iterating over entry tag='83aabb46-04b5-4c96-9933-c6bfb1173a73.4653.9898582104854548059', time=2023-12-03T13:56:02.064887+0000, chain.objs.size()=5 2023-12-03T11:57:50.537 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.536+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.87__multipart_key1.2~fJPhUnHYLxyv2jIitOlJLhVh-Ujp1Ha.1 2023-12-03T11:57:50.537 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.536+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.87__multipart_key1.2~fJPhUnHYLxyv2jIitOlJLhVh-Ujp1Ha.2 2023-12-03T11:57:50.538 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.536+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.87__multipart_key1.2~fJPhUnHYLxyv2jIitOlJLhVh-Ujp1Ha.3 2023-12-03T11:57:50.538 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.536+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.87__multipart_key1.2~fJPhUnHYLxyv2jIitOlJLhVh-Ujp1Ha.4 2023-12-03T11:57:50.538 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.536+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.87__multipart_key1.2~fJPhUnHYLxyv2jIitOlJLhVh-Ujp1Ha.5 2023-12-03T11:57:50.539 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.538+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:57:50.542 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.541+0000 7f7df1f20800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2023-12-03T11:57:50.544 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.542+0000 7f7df1f20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:57:50.544 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.543+0000 7f7df1f20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:57:50.545 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.543+0000 7f7df1f20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2023-12-03T11:57:50.545 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.543+0000 7f7df1f20800 20 garbage collection: RGWGC::process iterating over entry tag='83aabb46-04b5-4c96-9933-c6bfb1173a73.4653.14884076768974694174', time=2023-12-03T13:57:49.977682+0000, chain.objs.size()=5 2023-12-03T11:57:50.545 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.543+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.133__multipart_key1/data/file.mpg.2~05DhJP3M4U8V9vqTpqGMeo2lJTSLv7j.1 2023-12-03T11:57:50.545 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.543+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.133__multipart_key1/data/file.mpg.2~05DhJP3M4U8V9vqTpqGMeo2lJTSLv7j.2 2023-12-03T11:57:50.545 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.543+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.133__multipart_key1/data/file.mpg.2~05DhJP3M4U8V9vqTpqGMeo2lJTSLv7j.3 2023-12-03T11:57:50.545 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.543+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.133__multipart_key1/data/file.mpg.2~05DhJP3M4U8V9vqTpqGMeo2lJTSLv7j.4 2023-12-03T11:57:50.545 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.543+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.133__multipart_key1/data/file.mpg.2~05DhJP3M4U8V9vqTpqGMeo2lJTSLv7j.5 2023-12-03T11:57:50.548 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.546+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:57:50.550 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.549+0000 7f7df1f20800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2023-12-03T11:57:50.551 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.550+0000 7f7df1f20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:57:50.552 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.551+0000 7f7df1f20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:57:50.552 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.551+0000 7f7df1f20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2023-12-03T11:57:50.552 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.551+0000 7f7df1f20800 20 garbage collection: RGWGC::process iterating over entry tag='83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.80__multipart_key1.2~h9_X6YCU8oR62M_CXIJhxegIn2V2Vjy.2_5aefd280fb18bdf8faac7ae0ae62eeae', time=2023-12-03T13:55:15.983658+0000, chain.objs.size()=5 2023-12-03T11:57:50.552 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.551+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.80__multipart_key1.2~h9_X6YCU8oR62M_CXIJhxegIn2V2Vjy.1 2023-12-03T11:57:50.553 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.551+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.80__multipart_key1.2~h9_X6YCU8oR62M_CXIJhxegIn2V2Vjy.2 2023-12-03T11:57:50.553 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.551+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.80__multipart_key1.2~h9_X6YCU8oR62M_CXIJhxegIn2V2Vjy.3 2023-12-03T11:57:50.553 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.551+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.80__multipart_key1.2~h9_X6YCU8oR62M_CXIJhxegIn2V2Vjy.4 2023-12-03T11:57:50.553 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.551+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.80__multipart_key1.2~h9_X6YCU8oR62M_CXIJhxegIn2V2Vjy.5 2023-12-03T11:57:50.554 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.553+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:57:50.557 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.556+0000 7f7df1f20800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2023-12-03T11:57:50.558 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.557+0000 7f7df1f20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:57:50.559 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.558+0000 7f7df1f20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:57:50.560 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.558+0000 7f7df1f20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:57:50.560 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.559+0000 7f7df1f20800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2023-12-03T11:57:50.562 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.560+0000 7f7df1f20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:57:50.562 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.561+0000 7f7df1f20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:57:50.563 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.561+0000 7f7df1f20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:57:50.564 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.562+0000 7f7df1f20800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2023-12-03T11:57:50.565 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.564+0000 7f7df1f20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:57:50.565 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.564+0000 7f7df1f20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:57:50.566 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.564+0000 7f7df1f20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:57:50.567 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.565+0000 7f7df1f20800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2023-12-03T11:57:50.568 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.567+0000 7f7df1f20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:57:50.569 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.567+0000 7f7df1f20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:57:50.569 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.568+0000 7f7df1f20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:57:50.570 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.569+0000 7f7df1f20800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2023-12-03T11:57:50.571 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.570+0000 7f7df1f20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:57:50.571 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.570+0000 7f7df1f20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:57:50.572 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.571+0000 7f7df1f20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:57:50.573 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.572+0000 7f7df1f20800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2023-12-03T11:57:50.574 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.573+0000 7f7df1f20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:57:50.575 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.573+0000 7f7df1f20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:57:50.575 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.574+0000 7f7df1f20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2023-12-03T11:57:50.575 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.574+0000 7f7df1f20800 20 garbage collection: RGWGC::process iterating over entry tag='83aabb46-04b5-4c96-9933-c6bfb1173a73.4653.625694967514253218', time=2023-12-03T13:55:16.254181+0000, chain.objs.size()=5 2023-12-03T11:57:50.575 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.574+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.80__multipart_key1.2~h9_X6YCU8oR62M_CXIJhxegIn2V2Vjy.1 2023-12-03T11:57:50.576 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.574+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.80__multipart_key1.2~h9_X6YCU8oR62M_CXIJhxegIn2V2Vjy.2 2023-12-03T11:57:50.576 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.574+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.80__multipart_key1.2~h9_X6YCU8oR62M_CXIJhxegIn2V2Vjy.3 2023-12-03T11:57:50.576 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.574+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.80__multipart_key1.2~h9_X6YCU8oR62M_CXIJhxegIn2V2Vjy.4 2023-12-03T11:57:50.576 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.574+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.80__multipart_key1.2~h9_X6YCU8oR62M_CXIJhxegIn2V2Vjy.5 2023-12-03T11:57:50.576 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.575+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:57:50.579 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.578+0000 7f7df1f20800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2023-12-03T11:57:50.580 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.579+0000 7f7df1f20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:57:50.581 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.579+0000 7f7df1f20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:57:50.581 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.580+0000 7f7df1f20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2023-12-03T11:57:50.581 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.580+0000 7f7df1f20800 20 garbage collection: RGWGC::process iterating over entry tag='83aabb46-04b5-4c96-9933-c6bfb1173a73.4653.9809917875686028993', time=2023-12-03T13:56:05.353187+0000, chain.objs.size()=5 2023-12-03T11:57:50.581 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.580+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.88__multipart_key1.2~5hNGwVNqrYRAOlgbj-_docz9a2MmrFc.1 2023-12-03T11:57:50.581 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.580+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.88__multipart_key1.2~5hNGwVNqrYRAOlgbj-_docz9a2MmrFc.2 2023-12-03T11:57:50.582 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.580+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.88__multipart_key1.2~5hNGwVNqrYRAOlgbj-_docz9a2MmrFc.3 2023-12-03T11:57:50.582 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.580+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.88__multipart_key1.2~5hNGwVNqrYRAOlgbj-_docz9a2MmrFc.4 2023-12-03T11:57:50.582 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.580+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.88__multipart_key1.2~5hNGwVNqrYRAOlgbj-_docz9a2MmrFc.5 2023-12-03T11:57:50.584 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.583+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:57:50.587 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.585+0000 7f7df1f20800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2023-12-03T11:57:50.588 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.587+0000 7f7df1f20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:57:50.588 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.587+0000 7f7df1f20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:57:50.588 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.587+0000 7f7df1f20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:57:50.590 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.588+0000 7f7df1f20800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2023-12-03T11:57:50.591 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.590+0000 7f7df1f20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:57:50.592 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.590+0000 7f7df1f20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:57:50.592 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.590+0000 7f7df1f20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2023-12-03T11:57:50.592 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.590+0000 7f7df1f20800 20 garbage collection: RGWGC::process iterating over entry tag='83aabb46-04b5-4c96-9933-c6bfb1173a73.4653.3358041542933251717', time=2023-12-03T13:55:42.272205+0000, chain.objs.size()=5 2023-12-03T11:57:50.592 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.590+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.83__multipart_key1.2~n0LQF6CvCOf_D6ecZFnEeQKS5woRWcR.1 2023-12-03T11:57:50.592 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.590+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.83__multipart_key1.2~n0LQF6CvCOf_D6ecZFnEeQKS5woRWcR.2 2023-12-03T11:57:50.592 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.590+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.83__multipart_key1.2~n0LQF6CvCOf_D6ecZFnEeQKS5woRWcR.3 2023-12-03T11:57:50.592 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.590+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.83__multipart_key1.2~n0LQF6CvCOf_D6ecZFnEeQKS5woRWcR.4 2023-12-03T11:57:50.592 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.590+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.83__multipart_key1.2~n0LQF6CvCOf_D6ecZFnEeQKS5woRWcR.5 2023-12-03T11:57:50.594 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.593+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:57:50.598 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.597+0000 7f7df1f20800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2023-12-03T11:57:50.599 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.598+0000 7f7df1f20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:57:50.599 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.598+0000 7f7df1f20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:57:50.600 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.599+0000 7f7df1f20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2023-12-03T11:57:50.600 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.599+0000 7f7df1f20800 20 garbage collection: RGWGC::process iterating over entry tag='83aabb46-04b5-4c96-9933-c6bfb1173a73.4653.16934150340678741684', time=2023-12-03T13:56:39.452888+0000, chain.objs.size()=5 2023-12-03T11:57:50.600 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.599+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.91__multipart_key1.2~d2vW_Fyyx57u1nv9B7iu4a8-pb8rZuK.1 2023-12-03T11:57:50.600 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.599+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.91__multipart_key1.2~d2vW_Fyyx57u1nv9B7iu4a8-pb8rZuK.2 2023-12-03T11:57:50.600 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.599+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.91__multipart_key1.2~d2vW_Fyyx57u1nv9B7iu4a8-pb8rZuK.3 2023-12-03T11:57:50.601 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.599+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.91__multipart_key1.2~d2vW_Fyyx57u1nv9B7iu4a8-pb8rZuK.4 2023-12-03T11:57:50.601 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.599+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.91__multipart_key1.2~d2vW_Fyyx57u1nv9B7iu4a8-pb8rZuK.5 2023-12-03T11:57:50.603 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.602+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:57:50.606 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.604+0000 7f7df1f20800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2023-12-03T11:57:50.607 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.606+0000 7f7df1f20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:57:50.607 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.606+0000 7f7df1f20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:57:50.608 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.607+0000 7f7df1f20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2023-12-03T11:57:50.608 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.607+0000 7f7df1f20800 20 garbage collection: RGWGC::process iterating over entry tag='2~Jq3OrGoZRR_V-BBD7UzpI-EItdDCtch', time=2023-12-03T13:55:06.093058+0000, chain.objs.size()=5 2023-12-03T11:57:50.609 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.607+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.68__multipart_key1.2~Jq3OrGoZRR_V-BBD7UzpI-EItdDCtch.1 2023-12-03T11:57:50.609 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.607+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.68__multipart_key1.2~Jq3OrGoZRR_V-BBD7UzpI-EItdDCtch.2 2023-12-03T11:57:50.609 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.607+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.68__multipart_key1.2~Jq3OrGoZRR_V-BBD7UzpI-EItdDCtch.3 2023-12-03T11:57:50.609 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.607+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.68__multipart_key1.2~Jq3OrGoZRR_V-BBD7UzpI-EItdDCtch.4 2023-12-03T11:57:50.609 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.607+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.68__multipart_key1.2~Jq3OrGoZRR_V-BBD7UzpI-EItdDCtch.5 2023-12-03T11:57:50.609 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.607+0000 7f7df1f20800 20 garbage collection: RGWGC::process iterating over entry tag='83aabb46-04b5-4c96-9933-c6bfb1173a73.4653.16927562683321218711', time=2023-12-03T13:56:19.138447+0000, chain.objs.size()=5 2023-12-03T11:57:50.609 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.607+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.89__multipart_file.mpg.2~Qa7v4YeK2xweGrBGj27wJxahidpvNIq.1 2023-12-03T11:57:50.609 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.607+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.89__multipart_file.mpg.2~Qa7v4YeK2xweGrBGj27wJxahidpvNIq.2 2023-12-03T11:57:50.609 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.607+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.89__multipart_file.mpg.2~Qa7v4YeK2xweGrBGj27wJxahidpvNIq.3 2023-12-03T11:57:50.609 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.607+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.89__multipart_file.mpg.2~Qa7v4YeK2xweGrBGj27wJxahidpvNIq.4 2023-12-03T11:57:50.609 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.607+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.89__multipart_file.mpg.2~Qa7v4YeK2xweGrBGj27wJxahidpvNIq.5 2023-12-03T11:57:50.609 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.607+0000 7f7df1f20800 20 garbage collection: RGWGC::process iterating over entry tag='83aabb46-04b5-4c96-9933-c6bfb1173a73.4653.13401533383449355022', time=2023-12-03T13:57:38.271105+0000, chain.objs.size()=5 2023-12-03T11:57:50.609 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.607+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.132__multipart_key1.2~NZNX0yLW_esurofTDQJqcyRc6F8d5GS.1 2023-12-03T11:57:50.609 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.607+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.132__multipart_key1.2~NZNX0yLW_esurofTDQJqcyRc6F8d5GS.2 2023-12-03T11:57:50.611 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.609+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.132__multipart_key1.2~NZNX0yLW_esurofTDQJqcyRc6F8d5GS.3 2023-12-03T11:57:50.613 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.612+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.132__multipart_key1.2~NZNX0yLW_esurofTDQJqcyRc6F8d5GS.4 2023-12-03T11:57:50.613 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.612+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.132__multipart_key1.2~NZNX0yLW_esurofTDQJqcyRc6F8d5GS.5 2023-12-03T11:57:50.617 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.616+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:57:50.620 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.618+0000 7f7df1f20800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2023-12-03T11:57:50.621 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.620+0000 7f7df1f20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:57:50.621 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.620+0000 7f7df1f20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:57:50.622 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.620+0000 7f7df1f20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2023-12-03T11:57:50.622 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.620+0000 7f7df1f20800 20 garbage collection: RGWGC::process iterating over entry tag='83aabb46-04b5-4c96-9933-c6bfb1173a73.4653.991466865493645056', time=2023-12-03T13:56:19.189400+0000, chain.objs.size()=5 2023-12-03T11:57:50.622 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.620+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.89__multipart_file2.mpg.2~GpSkBKTlGP2ijp9aH08bJGkgtOYIrpT.1 2023-12-03T11:57:50.622 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.620+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.89__multipart_file2.mpg.2~GpSkBKTlGP2ijp9aH08bJGkgtOYIrpT.2 2023-12-03T11:57:50.622 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.620+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.89__multipart_file2.mpg.2~GpSkBKTlGP2ijp9aH08bJGkgtOYIrpT.3 2023-12-03T11:57:50.622 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.620+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.89__multipart_file2.mpg.2~GpSkBKTlGP2ijp9aH08bJGkgtOYIrpT.4 2023-12-03T11:57:50.623 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.620+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.89__multipart_file2.mpg.2~GpSkBKTlGP2ijp9aH08bJGkgtOYIrpT.5 2023-12-03T11:57:50.623 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.620+0000 7f7df1f20800 20 garbage collection: RGWGC::process iterating over entry tag='83aabb46-04b5-4c96-9933-c6bfb1173a73.4653.8897977493935305771', time=2023-12-03T13:56:35.033267+0000, chain.objs.size()=5 2023-12-03T11:57:50.623 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.620+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.91__multipart_key1.2~tEymI4CbsXi8kRhuyu5wNYoLoD4uAPe.1 2023-12-03T11:57:50.623 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.620+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.91__multipart_key1.2~tEymI4CbsXi8kRhuyu5wNYoLoD4uAPe.2 2023-12-03T11:57:50.623 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.620+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.91__multipart_key1.2~tEymI4CbsXi8kRhuyu5wNYoLoD4uAPe.3 2023-12-03T11:57:50.623 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.620+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.91__multipart_key1.2~tEymI4CbsXi8kRhuyu5wNYoLoD4uAPe.4 2023-12-03T11:57:50.623 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.620+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.91__multipart_key1.2~tEymI4CbsXi8kRhuyu5wNYoLoD4uAPe.5 2023-12-03T11:57:50.628 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.627+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:57:50.631 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.630+0000 7f7df1f20800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2023-12-03T11:57:50.632 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.631+0000 7f7df1f20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:57:50.632 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.631+0000 7f7df1f20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:57:50.633 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.632+0000 7f7df1f20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2023-12-03T11:57:50.633 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.632+0000 7f7df1f20800 20 garbage collection: RGWGC::process iterating over entry tag='83aabb46-04b5-4c96-9933-c6bfb1173a73.4653.11319490694059682418', time=2023-12-03T13:55:09.862468+0000, chain.objs.size()=2 2023-12-03T11:57:50.633 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.632+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.72__shadow_.PAO86ANf680AMD_c5Y1L2EZr1d7QZzJ_1 2023-12-03T11:57:50.633 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.632+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.72__shadow_.PAO86ANf680AMD_c5Y1L2EZr1d7QZzJ_2 2023-12-03T11:57:50.634 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.633+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:57:50.637 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.636+0000 7f7df1f20800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2023-12-03T11:57:50.638 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.637+0000 7f7df1f20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:57:50.639 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.637+0000 7f7df1f20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:57:50.639 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.638+0000 7f7df1f20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:57:50.640 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.639+0000 7f7df1f20800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2023-12-03T11:57:50.641 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.640+0000 7f7df1f20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:57:50.642 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.641+0000 7f7df1f20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:57:50.643 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.641+0000 7f7df1f20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2023-12-03T11:57:50.643 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.641+0000 7f7df1f20800 20 garbage collection: RGWGC::process iterating over entry tag='83aabb46-04b5-4c96-9933-c6bfb1173a73.4653.13014700501846003898', time=2023-12-03T13:56:52.953247+0000, chain.objs.size()=5 2023-12-03T11:57:50.643 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.641+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.91__multipart_key1.2~EihY2PLWbzK5tec-Q559WJWVdrsdCrm.1 2023-12-03T11:57:50.643 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.641+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.91__shadow_key1.2~EihY2PLWbzK5tec-Q559WJWVdrsdCrm.1_1 2023-12-03T11:57:50.643 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.641+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.91__multipart_key1.2~EihY2PLWbzK5tec-Q559WJWVdrsdCrm.2 2023-12-03T11:57:50.643 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.641+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.91__shadow_key1.2~EihY2PLWbzK5tec-Q559WJWVdrsdCrm.2_1 2023-12-03T11:57:50.644 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.641+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.91__multipart_key1.2~EihY2PLWbzK5tec-Q559WJWVdrsdCrm.3 2023-12-03T11:57:50.645 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.644+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:57:50.648 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.647+0000 7f7df1f20800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2023-12-03T11:57:50.649 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.648+0000 7f7df1f20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:57:50.650 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.648+0000 7f7df1f20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:57:50.650 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.649+0000 7f7df1f20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:57:50.651 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.650+0000 7f7df1f20800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2023-12-03T11:57:50.652 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.651+0000 7f7df1f20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:57:50.653 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.651+0000 7f7df1f20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:57:50.653 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.652+0000 7f7df1f20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2023-12-03T11:57:50.653 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.652+0000 7f7df1f20800 20 garbage collection: RGWGC::process iterating over entry tag='83aabb46-04b5-4c96-9933-c6bfb1173a73.4653.16185919834833989660', time=2023-12-03T13:56:41.876726+0000, chain.objs.size()=5 2023-12-03T11:57:50.653 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.652+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.91__multipart_key1.2~pJNyBIYYOGAmez3CGHIO-SyzLsB-AnF.1 2023-12-03T11:57:50.653 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.652+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.91__shadow_key1.2~pJNyBIYYOGAmez3CGHIO-SyzLsB-AnF.1_1 2023-12-03T11:57:50.654 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.652+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.91__multipart_key1.2~pJNyBIYYOGAmez3CGHIO-SyzLsB-AnF.2 2023-12-03T11:57:50.654 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.652+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.91__shadow_key1.2~pJNyBIYYOGAmez3CGHIO-SyzLsB-AnF.2_1 2023-12-03T11:57:50.654 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.652+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83aabb46-04b5-4c96-9933-c6bfb1173a73.4538.91__multipart_key1.2~pJNyBIYYOGAmez3CGHIO-SyzLsB-AnF.3 2023-12-03T11:57:50.655 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.654+0000 7f7df1f20800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:57:50.659 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.658+0000 7f7db37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:57:50.661 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.660+0000 7f7df1f20800 20 remove_watcher() i=0 2023-12-03T11:57:50.661 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.660+0000 7f7df1f20800 2 removed watcher, disabling cache 2023-12-03T11:57:50.662 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.661+0000 7f7df1f20800 20 remove_watcher() i=1 2023-12-03T11:57:50.663 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.662+0000 7f7df1f20800 20 remove_watcher() i=2 2023-12-03T11:57:50.664 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.663+0000 7f7df1f20800 20 remove_watcher() i=3 2023-12-03T11:57:50.665 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.664+0000 7f7df1f20800 20 remove_watcher() i=4 2023-12-03T11:57:50.666 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.665+0000 7f7df1f20800 20 remove_watcher() i=5 2023-12-03T11:57:50.667 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.666+0000 7f7df1f20800 20 remove_watcher() i=6 2023-12-03T11:57:50.668 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.667+0000 7f7df1f20800 20 remove_watcher() i=7 2023-12-03T11:57:50.674 DEBUG:teuthology.orchestra.run.smithi003:> radosgw-admin gc process --include-all 2023-12-03T11:57:50.724 INFO:teuthology.orchestra.run.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:57:50.724 INFO:teuthology.orchestra.run.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:57:50.742 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.738+0000 7f72e3331800 20 rados->read ofs=0 len=0 2023-12-03T11:57:50.742 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.739+0000 7f72e3331800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:57:50.743 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.739+0000 7f72e3331800 20 realm 2023-12-03T11:57:50.743 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.739+0000 7f72e3331800 20 rados->read ofs=0 len=0 2023-12-03T11:57:50.743 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.740+0000 7f72e3331800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:57:50.743 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.740+0000 7f72e3331800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:57:50.743 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.740+0000 7f72e3331800 20 rados->read ofs=0 len=0 2023-12-03T11:57:50.743 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.740+0000 7f72e3331800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:57:50.743 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.740+0000 7f72e3331800 20 rados->read ofs=0 len=0 2023-12-03T11:57:50.743 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.741+0000 7f72e3331800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:57:50.743 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.741+0000 7f72e3331800 20 rados->read ofs=0 len=0 2023-12-03T11:57:50.743 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.741+0000 7f72e3331800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:57:50.743 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.741+0000 7f72e3331800 20 searching for the correct realm 2023-12-03T11:57:50.751 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.749+0000 7f72df03c640 0 -- 172.21.15.3:0/1106905785 >> [v2:172.21.15.37:6805/1692844418,v1:172.21.15.37:6807/1692844418] conn(0x560cbaa24d90 msgr2=0x560cbaa271e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:57:50.753 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.752+0000 7f72e3331800 20 RGWRados::pool_iterate: got zone_info.83aabb46-04b5-4c96-9933-c6bfb1173a73 2023-12-03T11:57:50.753 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.752+0000 7f72e3331800 20 RGWRados::pool_iterate: got zonegroup_info.6a811aad-435d-4fdd-93c9-b7e0b50de429 2023-12-03T11:57:50.753 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.752+0000 7f72e3331800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:57:50.753 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.752+0000 7f72e3331800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:57:50.753 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.752+0000 7f72e3331800 20 rados->read ofs=0 len=0 2023-12-03T11:57:50.754 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.752+0000 7f72e3331800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:57:50.754 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.752+0000 7f72e3331800 20 rados->read ofs=0 len=0 2023-12-03T11:57:50.755 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.752+0000 7f72e3331800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:57:50.755 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.752+0000 7f72e3331800 20 rados->read ofs=0 len=0 2023-12-03T11:57:50.755 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.753+0000 7f72e3331800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:57:50.755 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.753+0000 7f72e3331800 20 zone default found 2023-12-03T11:57:50.755 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.753+0000 7f72e3331800 4 Realm: () 2023-12-03T11:57:50.755 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.753+0000 7f72e3331800 4 ZoneGroup: default (6a811aad-435d-4fdd-93c9-b7e0b50de429) 2023-12-03T11:57:50.755 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.753+0000 7f72e3331800 4 Zone: default (83aabb46-04b5-4c96-9933-c6bfb1173a73) 2023-12-03T11:57:50.755 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.753+0000 7f72e3331800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:57:50.755 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.753+0000 7f72e3331800 20 zonegroup default 2023-12-03T11:57:50.756 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.753+0000 7f72e3331800 20 rados->read ofs=0 len=0 2023-12-03T11:57:50.756 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.753+0000 7f72e3331800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:57:50.756 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.753+0000 7f72e3331800 20 rados->read ofs=0 len=0 2023-12-03T11:57:50.756 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.753+0000 7f72e3331800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:57:50.756 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.753+0000 7f72e3331800 20 rados->read ofs=0 len=0 2023-12-03T11:57:50.756 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.753+0000 7f72e3331800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:57:50.756 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.753+0000 7f72e3331800 20 started sync module instance, tier type = 2023-12-03T11:57:50.756 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.753+0000 7f72e3331800 20 started zone id=83aabb46-04b5-4c96-9933-c6bfb1173a73 (name=default) with tier type = 2023-12-03T11:57:50.757 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.756+0000 7f72df83d640 0 -- 172.21.15.3:0/1106905785 >> [v2:172.21.15.37:6816/3770469300,v1:172.21.15.37:6818/3770469300] conn(0x7f72d4021060 msgr2=0x7f72d40849a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:57:50.764 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.762+0000 7f72e3331800 20 add_watcher() i=0 2023-12-03T11:57:50.764 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.762+0000 7f72e3331800 20 add_watcher() i=1 2023-12-03T11:57:50.764 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.762+0000 7f72e3331800 20 add_watcher() i=2 2023-12-03T11:57:50.764 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.762+0000 7f72e3331800 20 add_watcher() i=3 2023-12-03T11:57:50.764 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.762+0000 7f72e3331800 20 add_watcher() i=4 2023-12-03T11:57:50.764 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.762+0000 7f72e3331800 20 add_watcher() i=5 2023-12-03T11:57:50.764 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.762+0000 7f72e3331800 20 add_watcher() i=6 2023-12-03T11:57:50.764 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.763+0000 7f72e3331800 20 add_watcher() i=7 2023-12-03T11:57:50.765 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.763+0000 7f72e3331800 2 all 8 watchers are set, enabling cache 2023-12-03T11:57:50.766 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.765+0000 7f72a57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:57:50.767 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.765+0000 7f72e3331800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:57:50.767 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.765+0000 7f72e3331800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:57:50.812 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.810+0000 7f7213fff640 20 reqs_thread_entry: start 2023-12-03T11:57:50.812 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.810+0000 7f72e3331800 20 init_complete bucket index max shards: 11 2023-12-03T11:57:50.812 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.810+0000 7f72e3331800 20 Filter name: none 2023-12-03T11:57:50.812 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.810+0000 7f7211ffb640 20 reqs_thread_entry: start 2023-12-03T11:57:50.812 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.810+0000 7f72e3331800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2023-12-03T11:57:50.813 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.812+0000 7f72e3331800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:57:50.813 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.812+0000 7f72e3331800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:57:50.814 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.812+0000 7f72e3331800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:57:50.815 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.813+0000 7f72e3331800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2023-12-03T11:57:50.816 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.815+0000 7f72e3331800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:57:50.816 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.815+0000 7f72e3331800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:57:50.817 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.815+0000 7f72e3331800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:57:50.818 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.816+0000 7f72e3331800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2023-12-03T11:57:50.819 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.818+0000 7f72e3331800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:57:50.819 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.818+0000 7f72e3331800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:57:50.820 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.818+0000 7f72e3331800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:57:50.820 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.819+0000 7f72e3331800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2023-12-03T11:57:50.822 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.820+0000 7f72e3331800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:57:50.822 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.821+0000 7f72e3331800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:57:50.823 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.821+0000 7f72e3331800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:57:50.823 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.822+0000 7f72e3331800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2023-12-03T11:57:50.824 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.823+0000 7f72e3331800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:57:50.825 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.824+0000 7f72e3331800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:57:50.825 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.824+0000 7f72e3331800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:57:50.826 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.825+0000 7f72e3331800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2023-12-03T11:57:50.827 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.826+0000 7f72e3331800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:57:50.828 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.827+0000 7f72e3331800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:57:50.828 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.827+0000 7f72e3331800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:57:50.829 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.828+0000 7f72e3331800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2023-12-03T11:57:50.830 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.829+0000 7f72e3331800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:57:50.831 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.830+0000 7f72e3331800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:57:50.831 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.830+0000 7f72e3331800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:57:50.832 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.831+0000 7f72e3331800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2023-12-03T11:57:50.833 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.832+0000 7f72e3331800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:57:50.834 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.832+0000 7f72e3331800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:57:50.834 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.833+0000 7f72e3331800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:57:50.835 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.834+0000 7f72e3331800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2023-12-03T11:57:50.836 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.835+0000 7f72e3331800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:57:50.837 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.836+0000 7f72e3331800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:57:50.837 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.836+0000 7f72e3331800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:57:50.838 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.837+0000 7f72e3331800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2023-12-03T11:57:50.839 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.838+0000 7f72e3331800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:57:50.840 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.839+0000 7f72e3331800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:57:50.840 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.839+0000 7f72e3331800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:57:50.841 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.840+0000 7f72e3331800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2023-12-03T11:57:50.843 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.841+0000 7f72e3331800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:57:50.843 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.842+0000 7f72e3331800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:57:50.843 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.842+0000 7f72e3331800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:57:50.844 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.843+0000 7f72e3331800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2023-12-03T11:57:50.845 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.844+0000 7f72e3331800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:57:50.846 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.845+0000 7f72e3331800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:57:50.846 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.845+0000 7f72e3331800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:57:50.847 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.846+0000 7f72e3331800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2023-12-03T11:57:50.850 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.849+0000 7f72e3331800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:57:50.850 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.849+0000 7f72e3331800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:57:50.850 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.849+0000 7f72e3331800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:57:50.851 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.850+0000 7f72e3331800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2023-12-03T11:57:50.853 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.851+0000 7f72e3331800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:57:50.853 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.852+0000 7f72e3331800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:57:50.853 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.852+0000 7f72e3331800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:57:50.854 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.853+0000 7f72e3331800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2023-12-03T11:57:50.855 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.854+0000 7f72e3331800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:57:50.856 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.855+0000 7f72e3331800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:57:50.856 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.855+0000 7f72e3331800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:57:50.857 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.856+0000 7f72e3331800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2023-12-03T11:57:50.858 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.857+0000 7f72e3331800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:57:50.859 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.858+0000 7f72e3331800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:57:50.859 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.858+0000 7f72e3331800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:57:50.860 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.859+0000 7f72e3331800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2023-12-03T11:57:50.861 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.860+0000 7f72e3331800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:57:50.862 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.860+0000 7f72e3331800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:57:50.862 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.861+0000 7f72e3331800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:57:50.863 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.862+0000 7f72e3331800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2023-12-03T11:57:50.865 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.864+0000 7f72e3331800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:57:50.866 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.865+0000 7f72e3331800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:57:50.866 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.865+0000 7f72e3331800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:57:50.867 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.866+0000 7f72e3331800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2023-12-03T11:57:50.869 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.868+0000 7f72e3331800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:57:50.869 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.868+0000 7f72e3331800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:57:50.869 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.868+0000 7f72e3331800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:57:50.870 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.869+0000 7f72e3331800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2023-12-03T11:57:50.872 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.871+0000 7f72e3331800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:57:50.872 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.871+0000 7f72e3331800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:57:50.873 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.872+0000 7f72e3331800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:57:50.874 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.873+0000 7f72e3331800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2023-12-03T11:57:50.875 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.874+0000 7f72e3331800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:57:50.876 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.874+0000 7f72e3331800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:57:50.876 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.875+0000 7f72e3331800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:57:50.877 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.875+0000 7f72e3331800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2023-12-03T11:57:50.878 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.877+0000 7f72e3331800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:57:50.879 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.878+0000 7f72e3331800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:57:50.879 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.878+0000 7f72e3331800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:57:50.880 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.879+0000 7f72e3331800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2023-12-03T11:57:50.882 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.880+0000 7f72e3331800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:57:50.882 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.881+0000 7f72e3331800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:57:50.882 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.881+0000 7f72e3331800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:57:50.884 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.882+0000 7f72e3331800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2023-12-03T11:57:50.885 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.884+0000 7f72e3331800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:57:50.885 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.884+0000 7f72e3331800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:57:50.886 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.884+0000 7f72e3331800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:57:50.887 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.885+0000 7f72e3331800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2023-12-03T11:57:50.888 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.887+0000 7f72e3331800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:57:50.889 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.887+0000 7f72e3331800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:57:50.889 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.887+0000 7f72e3331800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:57:50.890 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.888+0000 7f72e3331800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2023-12-03T11:57:50.891 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.890+0000 7f72e3331800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:57:50.891 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.890+0000 7f72e3331800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:57:50.892 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.890+0000 7f72e3331800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:57:50.892 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.891+0000 7f72e3331800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2023-12-03T11:57:50.894 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.892+0000 7f72e3331800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:57:50.894 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.893+0000 7f72e3331800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:57:50.894 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.893+0000 7f72e3331800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:57:50.895 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.894+0000 7f72e3331800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2023-12-03T11:57:50.897 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.896+0000 7f72e3331800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:57:50.897 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.896+0000 7f72e3331800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:57:50.897 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.896+0000 7f72e3331800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:57:50.899 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.897+0000 7f72e3331800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2023-12-03T11:57:50.900 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.899+0000 7f72e3331800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:57:50.900 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.899+0000 7f72e3331800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:57:50.900 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.899+0000 7f72e3331800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:57:50.901 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.900+0000 7f72e3331800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2023-12-03T11:57:50.903 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.902+0000 7f72e3331800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:57:50.904 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.903+0000 7f72e3331800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:57:50.904 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.903+0000 7f72e3331800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:57:50.905 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.904+0000 7f72e3331800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2023-12-03T11:57:50.906 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.905+0000 7f72e3331800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:57:50.907 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.906+0000 7f72e3331800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:57:50.907 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.906+0000 7f72e3331800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:57:50.908 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.907+0000 7f72e3331800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2023-12-03T11:57:50.910 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.908+0000 7f72e3331800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:57:50.910 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.909+0000 7f72e3331800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:57:50.910 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.909+0000 7f72e3331800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:57:50.912 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.911+0000 7f72a57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:57:50.915 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.913+0000 7f72e3331800 20 remove_watcher() i=0 2023-12-03T11:57:50.915 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.913+0000 7f72e3331800 2 removed watcher, disabling cache 2023-12-03T11:57:50.916 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.914+0000 7f72e3331800 20 remove_watcher() i=1 2023-12-03T11:57:50.917 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.916+0000 7f72e3331800 20 remove_watcher() i=2 2023-12-03T11:57:50.918 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.917+0000 7f72e3331800 20 remove_watcher() i=3 2023-12-03T11:57:50.919 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.918+0000 7f72e3331800 20 remove_watcher() i=4 2023-12-03T11:57:50.920 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.919+0000 7f72e3331800 20 remove_watcher() i=5 2023-12-03T11:57:50.921 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.920+0000 7f72e3331800 20 remove_watcher() i=6 2023-12-03T11:57:50.922 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:50.920+0000 7f72e3331800 20 remove_watcher() i=7 2023-12-03T11:57:50.927 INFO:teuthology.run_tasks:Running task s3tests... 2023-12-03T11:57:50.945 DEBUG:tasks.s3tests:s3tests config is {'client.0': {'rgw_server': 'client.0', 'force-branch': 'ceph-master', 'slow_backend': True, 'storage classes': 'LUKEWARM, FROZEN'}} 2023-12-03T11:57:50.945 INFO:tasks.s3tests:Downloading s3-tests... 2023-12-03T11:57:50.945 INFO:tasks.s3tests:Using branch 'ceph-master' for s3tests 2023-12-03T11:57:50.945 DEBUG:teuthology.orchestra.run.smithi003:> git clone -b ceph-master https://git.ceph.com/s3-tests.git /home/ubuntu/cephtest/s3-tests-client.0 2023-12-03T11:57:50.976 INFO:teuthology.orchestra.run.smithi003.stderr:Cloning into '/home/ubuntu/cephtest/s3-tests-client.0'... 2023-12-03T11:57:51.631 INFO:tasks.s3tests:Creating rgw users... 2023-12-03T11:57:51.631 DEBUG:tasks.s3tests:Creating user foo.client.0 on client.0 2023-12-03T11:57:51.631 DEBUG:teuthology.orchestra.run.smithi003:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid foo.client.0 --display-name 'Mr. foo.client.0' --email foo.client.0+test@test.test --caps 'user-policy=*' --access-key KRQFZISSJIRMVZUMFSZJ --secret DR7AlDJcQZuv2WmbJS0X+qwStLJ6IS0WgKahwQTGgg0JYoiN9ucfWg== --cluster ceph 2023-12-03T11:57:51.736 INFO:teuthology.orchestra.run.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:57:51.736 INFO:teuthology.orchestra.run.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:57:51.747 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.746+0000 7efdbf120800 20 rados->read ofs=0 len=0 2023-12-03T11:57:51.749 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.748+0000 7efdbf120800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:57:51.749 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.748+0000 7efdbf120800 20 realm 2023-12-03T11:57:51.749 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.748+0000 7efdbf120800 20 rados->read ofs=0 len=0 2023-12-03T11:57:51.750 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.748+0000 7efdbf120800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:57:51.750 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.748+0000 7efdbf120800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:57:51.750 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.748+0000 7efdbf120800 20 rados->read ofs=0 len=0 2023-12-03T11:57:51.750 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.748+0000 7efdbf120800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:57:51.750 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.748+0000 7efdbf120800 20 rados->read ofs=0 len=0 2023-12-03T11:57:51.750 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.749+0000 7efdbf120800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:57:51.750 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.749+0000 7efdbf120800 20 rados->read ofs=0 len=0 2023-12-03T11:57:51.751 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.749+0000 7efdbf120800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:57:51.751 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.749+0000 7efdbf120800 20 searching for the correct realm 2023-12-03T11:57:51.763 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.761+0000 7efdbaded640 0 -- 172.21.15.3:0/712318225 >> [v2:172.21.15.37:6805/1692844418,v1:172.21.15.37:6807/1692844418] conn(0x5574b7008730 msgr2=0x5574b700ab80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:57:51.764 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.762+0000 7efdbf120800 20 RGWRados::pool_iterate: got zone_info.83aabb46-04b5-4c96-9933-c6bfb1173a73 2023-12-03T11:57:51.764 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.762+0000 7efdbf120800 20 RGWRados::pool_iterate: got zonegroup_info.6a811aad-435d-4fdd-93c9-b7e0b50de429 2023-12-03T11:57:51.764 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.762+0000 7efdbf120800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:57:51.764 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.762+0000 7efdbf120800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:57:51.764 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.762+0000 7efdbf120800 20 rados->read ofs=0 len=0 2023-12-03T11:57:51.764 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.762+0000 7efdbf120800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:57:51.764 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.762+0000 7efdbf120800 20 rados->read ofs=0 len=0 2023-12-03T11:57:51.764 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.762+0000 7efdbf120800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:57:51.764 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.762+0000 7efdbf120800 20 rados->read ofs=0 len=0 2023-12-03T11:57:51.765 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.763+0000 7efdbf120800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:57:51.765 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.763+0000 7efdbf120800 20 zone default found 2023-12-03T11:57:51.765 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.763+0000 7efdbf120800 4 Realm: () 2023-12-03T11:57:51.765 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.763+0000 7efdbf120800 4 ZoneGroup: default (6a811aad-435d-4fdd-93c9-b7e0b50de429) 2023-12-03T11:57:51.765 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.763+0000 7efdbf120800 4 Zone: default (83aabb46-04b5-4c96-9933-c6bfb1173a73) 2023-12-03T11:57:51.765 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.763+0000 7efdbf120800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:57:51.765 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.763+0000 7efdbf120800 20 zonegroup default 2023-12-03T11:57:51.766 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.763+0000 7efdbf120800 20 rados->read ofs=0 len=0 2023-12-03T11:57:51.766 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.763+0000 7efdbf120800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:57:51.766 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.763+0000 7efdbf120800 20 rados->read ofs=0 len=0 2023-12-03T11:57:51.766 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.763+0000 7efdbf120800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:57:51.766 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.763+0000 7efdbf120800 20 rados->read ofs=0 len=0 2023-12-03T11:57:51.766 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.764+0000 7efdbf120800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:57:51.766 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.764+0000 7efdbf120800 20 started sync module instance, tier type = 2023-12-03T11:57:51.766 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.764+0000 7efdbf120800 20 started zone id=83aabb46-04b5-4c96-9933-c6bfb1173a73 (name=default) with tier type = 2023-12-03T11:57:51.773 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.772+0000 7efdba5ec640 0 -- 172.21.15.3:0/712318225 >> [v2:172.21.15.3:6817/3356208405,v1:172.21.15.3:6819/3356208405] conn(0x5574b700d810 msgr2=0x5574b700fc00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:57:51.774 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.773+0000 7efdbf120800 20 add_watcher() i=0 2023-12-03T11:57:51.774 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.773+0000 7efdbf120800 20 add_watcher() i=1 2023-12-03T11:57:51.774 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.773+0000 7efdbf120800 20 add_watcher() i=2 2023-12-03T11:57:51.775 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.773+0000 7efdbf120800 20 add_watcher() i=3 2023-12-03T11:57:51.775 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.773+0000 7efdbf120800 20 add_watcher() i=4 2023-12-03T11:57:51.775 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.773+0000 7efdbf120800 20 add_watcher() i=5 2023-12-03T11:57:51.775 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.774+0000 7efdbf120800 20 add_watcher() i=6 2023-12-03T11:57:51.775 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.774+0000 7efdbf120800 20 add_watcher() i=7 2023-12-03T11:57:51.775 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.774+0000 7efdbf120800 2 all 8 watchers are set, enabling cache 2023-12-03T11:57:51.777 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.776+0000 7efcfbfff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:57:51.777 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.776+0000 7efdbf120800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:57:51.777 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.776+0000 7efdbf120800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:57:51.782 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.781+0000 7efdbf120800 5 note: GC not initialized 2023-12-03T11:57:51.783 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.781+0000 7efceaffd640 20 reqs_thread_entry: start 2023-12-03T11:57:51.783 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.781+0000 7efdbf120800 20 init_complete bucket index max shards: 11 2023-12-03T11:57:51.783 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.781+0000 7efdbf120800 20 Filter name: none 2023-12-03T11:57:51.783 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.781+0000 7efce8ff9640 20 reqs_thread_entry: start 2023-12-03T11:57:51.783 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.781+0000 7efdbf120800 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2023-12-03T11:57:51.784 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.782+0000 7efdbf120800 20 rados->read ofs=0 len=0 2023-12-03T11:57:51.784 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.782+0000 7efdbf120800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:57:51.784 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.782+0000 7efdbf120800 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x0 2023-12-03T11:57:51.784 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.782+0000 7efdbf120800 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2023-12-03T11:57:51.784 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.782+0000 7efdbf120800 10 cache get: name=default.rgw.meta+users.email+foo.client.0+test@test.test : miss 2023-12-03T11:57:51.784 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.782+0000 7efdbf120800 20 rados->read ofs=0 len=0 2023-12-03T11:57:51.785 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.782+0000 7efdbf120800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:57:51.785 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.782+0000 7efdbf120800 10 cache put: name=default.rgw.meta+users.email+foo.client.0+test@test.test info.flags=0x0 2023-12-03T11:57:51.785 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.782+0000 7efdbf120800 10 adding default.rgw.meta+users.email+foo.client.0+test@test.test to cache LRU end 2023-12-03T11:57:51.785 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.782+0000 7efdbf120800 10 cache get: name=default.rgw.meta+users.keys+KRQFZISSJIRMVZUMFSZJ : miss 2023-12-03T11:57:51.785 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.782+0000 7efdbf120800 20 rados->read ofs=0 len=0 2023-12-03T11:57:51.785 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.783+0000 7efdbf120800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:57:51.785 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.783+0000 7efdbf120800 10 cache put: name=default.rgw.meta+users.keys+KRQFZISSJIRMVZUMFSZJ info.flags=0x0 2023-12-03T11:57:51.785 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.783+0000 7efdbf120800 10 adding default.rgw.meta+users.keys+KRQFZISSJIRMVZUMFSZJ to cache LRU end 2023-12-03T11:57:51.785 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.783+0000 7efdbf120800 10 cache get: name=default.rgw.meta+users.keys+KRQFZISSJIRMVZUMFSZJ : hit (negative entry) 2023-12-03T11:57:51.785 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.783+0000 7efdbf120800 10 cache get: name=default.rgw.meta+users.keys+KRQFZISSJIRMVZUMFSZJ : hit (negative entry) 2023-12-03T11:57:51.785 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.784+0000 7efdbf120800 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2023-12-03T11:57:51.786 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.784+0000 7efdbf120800 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2023-12-03T11:57:51.786 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.784+0000 7efdbf120800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:foo.client.0, ofs0, ns] 2023-12-03T11:57:51.786 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.785+0000 7efda17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660689 cookie 139628112359424 notifier 8034 bl.length()=640 2023-12-03T11:57:51.786 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.785+0000 7efda17fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2023-12-03T11:57:51.786 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.785+0000 7efda17fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2023-12-03T11:57:51.789 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.788+0000 7efdbf120800 10 cache put: name=default.rgw.meta+users.email+foo.client.0+test@test.test info.flags=0x7 2023-12-03T11:57:51.789 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.788+0000 7efdbf120800 10 moving default.rgw.meta+users.email+foo.client.0+test@test.test to cache LRU end 2023-12-03T11:57:51.789 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.788+0000 7efdbf120800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.email:foo.client.0+test@test.test, ofs0, ns] 2023-12-03T11:57:51.789 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.788+0000 7efda17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660724 cookie 93959774884672 notifier 8034 bl.length()=194 2023-12-03T11:57:51.789 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.788+0000 7efda17fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foo.client.0+test@test.test info.flags=0x7 2023-12-03T11:57:51.789 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.788+0000 7efda17fa640 10 rgw watcher librados: moving default.rgw.meta+users.email+foo.client.0+test@test.test to cache LRU end 2023-12-03T11:57:51.792 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.791+0000 7efdbf120800 10 cache put: name=default.rgw.meta+users.keys+KRQFZISSJIRMVZUMFSZJ info.flags=0x7 2023-12-03T11:57:51.792 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.791+0000 7efdbf120800 10 moving default.rgw.meta+users.keys+KRQFZISSJIRMVZUMFSZJ to cache LRU end 2023-12-03T11:57:51.792 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.791+0000 7efdbf120800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.keys:KRQFZISSJIRMVZUMFSZJ, ofs0, ns] 2023-12-03T11:57:51.792 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.791+0000 7efda0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660690 cookie 139628112359424 notifier 8034 bl.length()=186 2023-12-03T11:57:51.792 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.791+0000 7efda0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+KRQFZISSJIRMVZUMFSZJ info.flags=0x7 2023-12-03T11:57:51.792 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.791+0000 7efda0ff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+KRQFZISSJIRMVZUMFSZJ to cache LRU end 2023-12-03T11:57:51.794 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2023-12-03T11:57:51.794 INFO:teuthology.orchestra.run.smithi003.stdout: "user_id": "foo.client.0", 2023-12-03T11:57:51.794 INFO:teuthology.orchestra.run.smithi003.stdout: "display_name": "Mr. foo.client.0", 2023-12-03T11:57:51.794 INFO:teuthology.orchestra.run.smithi003.stdout: "email": "foo.client.0+test@test.test", 2023-12-03T11:57:51.794 INFO:teuthology.orchestra.run.smithi003.stdout: "suspended": 0, 2023-12-03T11:57:51.794 INFO:teuthology.orchestra.run.smithi003.stdout: "max_buckets": 1000, 2023-12-03T11:57:51.794 INFO:teuthology.orchestra.run.smithi003.stdout: "subusers": [], 2023-12-03T11:57:51.794 INFO:teuthology.orchestra.run.smithi003.stdout: "keys": [ 2023-12-03T11:57:51.794 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-12-03T11:57:51.794 INFO:teuthology.orchestra.run.smithi003.stdout: "user": "foo.client.0", 2023-12-03T11:57:51.794 INFO:teuthology.orchestra.run.smithi003.stdout: "access_key": "KRQFZISSJIRMVZUMFSZJ", 2023-12-03T11:57:51.794 INFO:teuthology.orchestra.run.smithi003.stdout: "secret_key": "DR7AlDJcQZuv2WmbJS0X+qwStLJ6IS0WgKahwQTGgg0JYoiN9ucfWg==" 2023-12-03T11:57:51.794 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-12-03T11:57:51.795 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2023-12-03T11:57:51.795 INFO:teuthology.orchestra.run.smithi003.stdout: "swift_keys": [], 2023-12-03T11:57:51.795 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": [ 2023-12-03T11:57:51.795 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-12-03T11:57:51.795 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "user-policy", 2023-12-03T11:57:51.795 INFO:teuthology.orchestra.run.smithi003.stdout: "perm": "*" 2023-12-03T11:57:51.795 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-12-03T11:57:51.795 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2023-12-03T11:57:51.795 INFO:teuthology.orchestra.run.smithi003.stdout: "op_mask": "read, write, delete", 2023-12-03T11:57:51.795 INFO:teuthology.orchestra.run.smithi003.stdout: "default_placement": "", 2023-12-03T11:57:51.795 INFO:teuthology.orchestra.run.smithi003.stdout: "default_storage_class": "", 2023-12-03T11:57:51.795 INFO:teuthology.orchestra.run.smithi003.stdout: "placement_tags": [], 2023-12-03T11:57:51.795 INFO:teuthology.orchestra.run.smithi003.stdout: "bucket_quota": { 2023-12-03T11:57:51.795 INFO:teuthology.orchestra.run.smithi003.stdout: "enabled": false, 2023-12-03T11:57:51.795 INFO:teuthology.orchestra.run.smithi003.stdout: "check_on_raw": false, 2023-12-03T11:57:51.796 INFO:teuthology.orchestra.run.smithi003.stdout: "max_size": -1, 2023-12-03T11:57:51.796 INFO:teuthology.orchestra.run.smithi003.stdout: "max_size_kb": 0, 2023-12-03T11:57:51.796 INFO:teuthology.orchestra.run.smithi003.stdout: "max_objects": -1 2023-12-03T11:57:51.796 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-12-03T11:57:51.796 INFO:teuthology.orchestra.run.smithi003.stdout: "user_quota": { 2023-12-03T11:57:51.796 INFO:teuthology.orchestra.run.smithi003.stdout: "enabled": false, 2023-12-03T11:57:51.796 INFO:teuthology.orchestra.run.smithi003.stdout: "check_on_raw": false, 2023-12-03T11:57:51.796 INFO:teuthology.orchestra.run.smithi003.stdout: "max_size": -1, 2023-12-03T11:57:51.796 INFO:teuthology.orchestra.run.smithi003.stdout: "max_size_kb": 0, 2023-12-03T11:57:51.796 INFO:teuthology.orchestra.run.smithi003.stdout: "max_objects": -1 2023-12-03T11:57:51.796 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-12-03T11:57:51.796 INFO:teuthology.orchestra.run.smithi003.stdout: "temp_url_keys": [], 2023-12-03T11:57:51.796 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "rgw", 2023-12-03T11:57:51.796 INFO:teuthology.orchestra.run.smithi003.stdout: "mfa_ids": [] 2023-12-03T11:57:51.796 INFO:teuthology.orchestra.run.smithi003.stdout:} 2023-12-03T11:57:51.796 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:57:51.797 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.793+0000 7efcfbfff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:57:51.797 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.795+0000 7efdbf120800 20 remove_watcher() i=0 2023-12-03T11:57:51.797 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.795+0000 7efdbf120800 2 removed watcher, disabling cache 2023-12-03T11:57:51.798 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.797+0000 7efdbf120800 20 remove_watcher() i=1 2023-12-03T11:57:51.799 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.798+0000 7efdbf120800 20 remove_watcher() i=2 2023-12-03T11:57:51.800 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.799+0000 7efdbf120800 20 remove_watcher() i=3 2023-12-03T11:57:51.802 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.800+0000 7efdbf120800 20 remove_watcher() i=4 2023-12-03T11:57:51.803 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.802+0000 7efdbf120800 20 remove_watcher() i=5 2023-12-03T11:57:51.804 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.803+0000 7efdbf120800 20 remove_watcher() i=6 2023-12-03T11:57:51.805 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.804+0000 7efdbf120800 20 remove_watcher() i=7 2023-12-03T11:57:51.810 DEBUG:teuthology.orchestra.run.smithi003:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid foo.client.0 --totp-serial 2998738846 --totp-seed C6T6ZD3EDMNGCVP3BWSWUHHMJSAB6PTUFEN7CYH5U7TCPA5WA6Y667YSZXGE45LA --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2023-12-03T11:57:51.874 INFO:teuthology.orchestra.run.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:57:51.874 INFO:teuthology.orchestra.run.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:57:51.886 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.885+0000 7f9ead72d800 20 rados->read ofs=0 len=0 2023-12-03T11:57:51.888 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.887+0000 7f9ead72d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:57:51.888 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.887+0000 7f9ead72d800 20 realm 2023-12-03T11:57:51.888 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.887+0000 7f9ead72d800 20 rados->read ofs=0 len=0 2023-12-03T11:57:51.888 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.887+0000 7f9ead72d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:57:51.888 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.887+0000 7f9ead72d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:57:51.889 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.887+0000 7f9ead72d800 20 rados->read ofs=0 len=0 2023-12-03T11:57:51.889 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.887+0000 7f9ead72d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:57:51.889 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.887+0000 7f9ead72d800 20 rados->read ofs=0 len=0 2023-12-03T11:57:51.889 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.888+0000 7f9ead72d800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:57:51.889 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.888+0000 7f9ead72d800 20 rados->read ofs=0 len=0 2023-12-03T11:57:51.890 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.888+0000 7f9ead72d800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:57:51.890 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.888+0000 7f9ead72d800 20 searching for the correct realm 2023-12-03T11:57:51.900 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.899+0000 7f9ea9468640 0 -- 172.21.15.3:0/2930194692 >> [v2:172.21.15.37:6805/1692844418,v1:172.21.15.37:6807/1692844418] conn(0x55ca4030d1f0 msgr2=0x55ca4030f640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:57:51.902 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.900+0000 7f9ead72d800 20 RGWRados::pool_iterate: got zone_info.83aabb46-04b5-4c96-9933-c6bfb1173a73 2023-12-03T11:57:51.902 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.900+0000 7f9ead72d800 20 RGWRados::pool_iterate: got zonegroup_info.6a811aad-435d-4fdd-93c9-b7e0b50de429 2023-12-03T11:57:51.902 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.900+0000 7f9ead72d800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:57:51.902 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.900+0000 7f9ead72d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:57:51.902 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.900+0000 7f9ead72d800 20 rados->read ofs=0 len=0 2023-12-03T11:57:51.902 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.901+0000 7f9ead72d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:57:51.902 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.901+0000 7f9ead72d800 20 rados->read ofs=0 len=0 2023-12-03T11:57:51.903 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.901+0000 7f9ead72d800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:57:51.903 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.901+0000 7f9ead72d800 20 rados->read ofs=0 len=0 2023-12-03T11:57:51.904 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.901+0000 7f9ead72d800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:57:51.904 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.901+0000 7f9ead72d800 20 zone default found 2023-12-03T11:57:51.904 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.901+0000 7f9ead72d800 4 Realm: () 2023-12-03T11:57:51.904 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.901+0000 7f9ead72d800 4 ZoneGroup: default (6a811aad-435d-4fdd-93c9-b7e0b50de429) 2023-12-03T11:57:51.904 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.901+0000 7f9ead72d800 4 Zone: default (83aabb46-04b5-4c96-9933-c6bfb1173a73) 2023-12-03T11:57:51.904 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.901+0000 7f9ead72d800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:57:51.904 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.901+0000 7f9ead72d800 20 zonegroup default 2023-12-03T11:57:51.904 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.901+0000 7f9ead72d800 20 rados->read ofs=0 len=0 2023-12-03T11:57:51.904 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.901+0000 7f9ead72d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:57:51.904 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.902+0000 7f9ead72d800 20 rados->read ofs=0 len=0 2023-12-03T11:57:51.904 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.902+0000 7f9ead72d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:57:51.904 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.902+0000 7f9ead72d800 20 rados->read ofs=0 len=0 2023-12-03T11:57:51.904 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.902+0000 7f9ead72d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:57:51.905 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.902+0000 7f9ead72d800 20 started sync module instance, tier type = 2023-12-03T11:57:51.905 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.902+0000 7f9ead72d800 20 started zone id=83aabb46-04b5-4c96-9933-c6bfb1173a73 (name=default) with tier type = 2023-12-03T11:57:51.911 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.910+0000 7f9ea8c67640 0 -- 172.21.15.3:0/2930194692 >> [v2:172.21.15.3:6817/3356208405,v1:172.21.15.3:6819/3356208405] conn(0x55ca403122d0 msgr2=0x55ca403146c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:57:51.914 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.912+0000 7f9ead72d800 20 add_watcher() i=0 2023-12-03T11:57:51.914 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.912+0000 7f9ead72d800 20 add_watcher() i=1 2023-12-03T11:57:51.914 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.912+0000 7f9ead72d800 20 add_watcher() i=2 2023-12-03T11:57:51.914 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.912+0000 7f9ead72d800 20 add_watcher() i=3 2023-12-03T11:57:51.914 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.912+0000 7f9ead72d800 20 add_watcher() i=4 2023-12-03T11:57:51.914 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.912+0000 7f9ead72d800 20 add_watcher() i=5 2023-12-03T11:57:51.914 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.912+0000 7f9ead72d800 20 add_watcher() i=6 2023-12-03T11:57:51.914 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.913+0000 7f9ead72d800 20 add_watcher() i=7 2023-12-03T11:57:51.914 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.913+0000 7f9ead72d800 2 all 8 watchers are set, enabling cache 2023-12-03T11:57:51.916 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.915+0000 7f9e6efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:57:51.916 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.915+0000 7f9ead72d800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:57:51.916 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.915+0000 7f9ead72d800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:57:51.921 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.920+0000 7f9ead72d800 5 note: GC not initialized 2023-12-03T11:57:51.921 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.920+0000 7f9dddffb640 20 reqs_thread_entry: start 2023-12-03T11:57:51.922 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.920+0000 7f9ead72d800 20 init_complete bucket index max shards: 11 2023-12-03T11:57:51.922 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.920+0000 7f9ead72d800 20 Filter name: none 2023-12-03T11:57:51.922 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.920+0000 7f9dcf7fe640 20 reqs_thread_entry: start 2023-12-03T11:57:51.922 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.920+0000 7f9ead72d800 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2023-12-03T11:57:51.922 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.920+0000 7f9ead72d800 20 rados->read ofs=0 len=0 2023-12-03T11:57:51.922 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.921+0000 7f9ead72d800 20 rados_obj.operate() r=0 bl.length=455 2023-12-03T11:57:51.922 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.921+0000 7f9ead72d800 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x13 2023-12-03T11:57:51.922 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.921+0000 7f9ead72d800 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2023-12-03T11:57:51.923 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:51.921+0000 7f9ead72d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:57:54.072 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.070+0000 7f9ead72d800 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2023-12-03T11:57:54.072 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.070+0000 7f9ead72d800 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2023-12-03T11:57:54.072 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.070+0000 7f9ead72d800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:foo.client.0, ofs0, ns] 2023-12-03T11:57:54.073 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.071+0000 7f9e8affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595283 cookie 140319266357248 notifier 7562 bl.length()=654 2023-12-03T11:57:54.073 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.071+0000 7f9e8affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2023-12-03T11:57:54.073 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.071+0000 7f9e8affd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2023-12-03T11:57:54.076 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.074+0000 7f9e6efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:57:54.079 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.078+0000 7f9ead72d800 20 remove_watcher() i=0 2023-12-03T11:57:54.079 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.078+0000 7f9ead72d800 2 removed watcher, disabling cache 2023-12-03T11:57:54.080 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.079+0000 7f9ead72d800 20 remove_watcher() i=1 2023-12-03T11:57:54.082 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.080+0000 7f9ead72d800 20 remove_watcher() i=2 2023-12-03T11:57:54.083 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.082+0000 7f9ead72d800 20 remove_watcher() i=3 2023-12-03T11:57:54.085 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.083+0000 7f9ead72d800 20 remove_watcher() i=4 2023-12-03T11:57:54.086 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.085+0000 7f9ead72d800 20 remove_watcher() i=5 2023-12-03T11:57:54.087 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.086+0000 7f9ead72d800 20 remove_watcher() i=6 2023-12-03T11:57:54.088 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.087+0000 7f9ead72d800 20 remove_watcher() i=7 2023-12-03T11:57:54.095 DEBUG:tasks.s3tests:Creating user bar.client.0 on client.0 2023-12-03T11:57:54.095 DEBUG:teuthology.orchestra.run.smithi003:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid bar.client.0 --display-name 'Mr. bar.client.0' --email bar.client.0+test@test.test --caps 'user-policy=*' --access-key EHZPMFZRAZUUJFXNYLCE --secret FFEi6TYZRXBfjFkVoPQ+KbVLoINSBhqvqCRCwxkr04Vaat+0d42oAQ== --cluster ceph 2023-12-03T11:57:54.165 INFO:teuthology.orchestra.run.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:57:54.165 INFO:teuthology.orchestra.run.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:57:54.177 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.176+0000 7f6acea2f800 20 rados->read ofs=0 len=0 2023-12-03T11:57:54.179 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.178+0000 7f6acea2f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:57:54.179 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.178+0000 7f6acea2f800 20 realm 2023-12-03T11:57:54.180 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.178+0000 7f6acea2f800 20 rados->read ofs=0 len=0 2023-12-03T11:57:54.180 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.178+0000 7f6acea2f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:57:54.180 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.178+0000 7f6acea2f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:57:54.180 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.178+0000 7f6acea2f800 20 rados->read ofs=0 len=0 2023-12-03T11:57:54.180 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.178+0000 7f6acea2f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:57:54.180 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.178+0000 7f6acea2f800 20 rados->read ofs=0 len=0 2023-12-03T11:57:54.181 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.179+0000 7f6acea2f800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:57:54.181 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.179+0000 7f6acea2f800 20 rados->read ofs=0 len=0 2023-12-03T11:57:54.181 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.180+0000 7f6acea2f800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:57:54.181 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.180+0000 7f6acea2f800 20 searching for the correct realm 2023-12-03T11:57:54.193 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.191+0000 7f6ac9c2e640 0 -- 172.21.15.3:0/510631717 >> [v2:172.21.15.37:6805/1692844418,v1:172.21.15.37:6807/1692844418] conn(0x5629b3f41b80 msgr2=0x5629b3f43fd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:57:54.195 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.193+0000 7f6acea2f800 20 RGWRados::pool_iterate: got zone_info.83aabb46-04b5-4c96-9933-c6bfb1173a73 2023-12-03T11:57:54.195 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.193+0000 7f6acea2f800 20 RGWRados::pool_iterate: got zonegroup_info.6a811aad-435d-4fdd-93c9-b7e0b50de429 2023-12-03T11:57:54.195 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.193+0000 7f6acea2f800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:57:54.195 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.193+0000 7f6acea2f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:57:54.195 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.193+0000 7f6acea2f800 20 rados->read ofs=0 len=0 2023-12-03T11:57:54.195 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.193+0000 7f6acea2f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:57:54.195 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.193+0000 7f6acea2f800 20 rados->read ofs=0 len=0 2023-12-03T11:57:54.196 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.194+0000 7f6acea2f800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:57:54.196 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.194+0000 7f6acea2f800 20 rados->read ofs=0 len=0 2023-12-03T11:57:54.196 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.194+0000 7f6acea2f800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:57:54.196 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.194+0000 7f6acea2f800 20 zone default found 2023-12-03T11:57:54.196 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.194+0000 7f6acea2f800 4 Realm: () 2023-12-03T11:57:54.196 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.194+0000 7f6acea2f800 4 ZoneGroup: default (6a811aad-435d-4fdd-93c9-b7e0b50de429) 2023-12-03T11:57:54.196 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.194+0000 7f6acea2f800 4 Zone: default (83aabb46-04b5-4c96-9933-c6bfb1173a73) 2023-12-03T11:57:54.197 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.194+0000 7f6acea2f800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:57:54.197 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.194+0000 7f6acea2f800 20 zonegroup default 2023-12-03T11:57:54.197 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.194+0000 7f6acea2f800 20 rados->read ofs=0 len=0 2023-12-03T11:57:54.197 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.194+0000 7f6acea2f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:57:54.197 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.194+0000 7f6acea2f800 20 rados->read ofs=0 len=0 2023-12-03T11:57:54.197 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.195+0000 7f6acea2f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:57:54.197 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.195+0000 7f6acea2f800 20 rados->read ofs=0 len=0 2023-12-03T11:57:54.197 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.195+0000 7f6acea2f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:57:54.197 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.195+0000 7f6acea2f800 20 started sync module instance, tier type = 2023-12-03T11:57:54.198 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.195+0000 7f6acea2f800 20 started zone id=83aabb46-04b5-4c96-9933-c6bfb1173a73 (name=default) with tier type = 2023-12-03T11:57:54.204 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.203+0000 7f6ac942d640 0 -- 172.21.15.3:0/510631717 >> [v2:172.21.15.3:6817/3356208405,v1:172.21.15.3:6819/3356208405] conn(0x5629b3f46c60 msgr2=0x5629b3f49050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:57:54.207 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.205+0000 7f6acea2f800 20 add_watcher() i=0 2023-12-03T11:57:54.207 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.205+0000 7f6acea2f800 20 add_watcher() i=1 2023-12-03T11:57:54.207 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.205+0000 7f6acea2f800 20 add_watcher() i=2 2023-12-03T11:57:54.207 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.205+0000 7f6acea2f800 20 add_watcher() i=3 2023-12-03T11:57:54.207 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.205+0000 7f6acea2f800 20 add_watcher() i=4 2023-12-03T11:57:54.207 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.205+0000 7f6acea2f800 20 add_watcher() i=5 2023-12-03T11:57:54.207 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.205+0000 7f6acea2f800 20 add_watcher() i=6 2023-12-03T11:57:54.207 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.206+0000 7f6acea2f800 20 add_watcher() i=7 2023-12-03T11:57:54.208 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.206+0000 7f6acea2f800 2 all 8 watchers are set, enabling cache 2023-12-03T11:57:54.209 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.208+0000 7f6a8f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:57:54.209 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.208+0000 7f6acea2f800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:57:54.209 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.208+0000 7f6acea2f800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:57:54.215 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.213+0000 7f6acea2f800 5 note: GC not initialized 2023-12-03T11:57:54.215 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.213+0000 7f69fe7fc640 20 reqs_thread_entry: start 2023-12-03T11:57:54.215 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.213+0000 7f6acea2f800 20 init_complete bucket index max shards: 11 2023-12-03T11:57:54.215 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.214+0000 7f6acea2f800 20 Filter name: none 2023-12-03T11:57:54.215 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.214+0000 7f69effff640 20 reqs_thread_entry: start 2023-12-03T11:57:54.215 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.214+0000 7f6acea2f800 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2023-12-03T11:57:54.215 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.214+0000 7f6acea2f800 20 rados->read ofs=0 len=0 2023-12-03T11:57:54.216 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.214+0000 7f6acea2f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:57:54.216 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.214+0000 7f6acea2f800 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x0 2023-12-03T11:57:54.216 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.214+0000 7f6acea2f800 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2023-12-03T11:57:54.216 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.214+0000 7f6acea2f800 10 cache get: name=default.rgw.meta+users.email+bar.client.0+test@test.test : miss 2023-12-03T11:57:54.216 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.214+0000 7f6acea2f800 20 rados->read ofs=0 len=0 2023-12-03T11:57:54.216 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.214+0000 7f6acea2f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:57:54.216 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.214+0000 7f6acea2f800 10 cache put: name=default.rgw.meta+users.email+bar.client.0+test@test.test info.flags=0x0 2023-12-03T11:57:54.216 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.214+0000 7f6acea2f800 10 adding default.rgw.meta+users.email+bar.client.0+test@test.test to cache LRU end 2023-12-03T11:57:54.217 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.214+0000 7f6acea2f800 10 cache get: name=default.rgw.meta+users.keys+EHZPMFZRAZUUJFXNYLCE : miss 2023-12-03T11:57:54.217 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.214+0000 7f6acea2f800 20 rados->read ofs=0 len=0 2023-12-03T11:57:54.217 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.215+0000 7f6acea2f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:57:54.217 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.215+0000 7f6acea2f800 10 cache put: name=default.rgw.meta+users.keys+EHZPMFZRAZUUJFXNYLCE info.flags=0x0 2023-12-03T11:57:54.217 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.215+0000 7f6acea2f800 10 adding default.rgw.meta+users.keys+EHZPMFZRAZUUJFXNYLCE to cache LRU end 2023-12-03T11:57:54.217 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.215+0000 7f6acea2f800 10 cache get: name=default.rgw.meta+users.keys+EHZPMFZRAZUUJFXNYLCE : hit (negative entry) 2023-12-03T11:57:54.217 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.215+0000 7f6acea2f800 10 cache get: name=default.rgw.meta+users.keys+EHZPMFZRAZUUJFXNYLCE : hit (negative entry) 2023-12-03T11:57:54.217 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.216+0000 7f6acea2f800 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2023-12-03T11:57:54.217 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.216+0000 7f6acea2f800 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2023-12-03T11:57:54.217 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.216+0000 7f6acea2f800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:bar.client.0, ofs0, ns] 2023-12-03T11:57:54.218 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.217+0000 7f6aabfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595199 cookie 94737110314832 notifier 7583 bl.length()=640 2023-12-03T11:57:54.218 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.217+0000 7f6aabfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2023-12-03T11:57:54.219 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.217+0000 7f6aabfff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2023-12-03T11:57:54.221 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.220+0000 7f6acea2f800 10 cache put: name=default.rgw.meta+users.email+bar.client.0+test@test.test info.flags=0x7 2023-12-03T11:57:54.221 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.220+0000 7f6acea2f800 10 moving default.rgw.meta+users.email+bar.client.0+test@test.test to cache LRU end 2023-12-03T11:57:54.221 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.220+0000 7f6acea2f800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.email:bar.client.0+test@test.test, ofs0, ns] 2023-12-03T11:57:54.222 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.221+0000 7f6aabfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595200 cookie 94737110314832 notifier 7583 bl.length()=194 2023-12-03T11:57:54.222 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.221+0000 7f6aabfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+bar.client.0+test@test.test info.flags=0x7 2023-12-03T11:57:54.222 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.221+0000 7f6aabfff640 10 rgw watcher librados: moving default.rgw.meta+users.email+bar.client.0+test@test.test to cache LRU end 2023-12-03T11:57:54.225 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.223+0000 7f6acea2f800 10 cache put: name=default.rgw.meta+users.keys+EHZPMFZRAZUUJFXNYLCE info.flags=0x7 2023-12-03T11:57:54.225 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.223+0000 7f6acea2f800 10 moving default.rgw.meta+users.keys+EHZPMFZRAZUUJFXNYLCE to cache LRU end 2023-12-03T11:57:54.225 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.223+0000 7f6acea2f800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.keys:EHZPMFZRAZUUJFXNYLCE, ofs0, ns] 2023-12-03T11:57:54.225 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.224+0000 7f6aabfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595317 cookie 94737112803296 notifier 7583 bl.length()=186 2023-12-03T11:57:54.225 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.224+0000 7f6aabfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+EHZPMFZRAZUUJFXNYLCE info.flags=0x7 2023-12-03T11:57:54.225 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.224+0000 7f6aabfff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+EHZPMFZRAZUUJFXNYLCE to cache LRU end 2023-12-03T11:57:54.229 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2023-12-03T11:57:54.229 INFO:teuthology.orchestra.run.smithi003.stdout: "user_id": "bar.client.0", 2023-12-03T11:57:54.230 INFO:teuthology.orchestra.run.smithi003.stdout: "display_name": "Mr. bar.client.0", 2023-12-03T11:57:54.230 INFO:teuthology.orchestra.run.smithi003.stdout: "email": "bar.client.0+test@test.test", 2023-12-03T11:57:54.230 INFO:teuthology.orchestra.run.smithi003.stdout: "suspended": 0, 2023-12-03T11:57:54.230 INFO:teuthology.orchestra.run.smithi003.stdout: "max_buckets": 1000, 2023-12-03T11:57:54.230 INFO:teuthology.orchestra.run.smithi003.stdout: "subusers": [], 2023-12-03T11:57:54.230 INFO:teuthology.orchestra.run.smithi003.stdout: "keys": [ 2023-12-03T11:57:54.230 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-12-03T11:57:54.230 INFO:teuthology.orchestra.run.smithi003.stdout: "user": "bar.client.0", 2023-12-03T11:57:54.230 INFO:teuthology.orchestra.run.smithi003.stdout: "access_key": "EHZPMFZRAZUUJFXNYLCE", 2023-12-03T11:57:54.230 INFO:teuthology.orchestra.run.smithi003.stdout: "secret_key": "FFEi6TYZRXBfjFkVoPQ+KbVLoINSBhqvqCRCwxkr04Vaat+0d42oAQ==" 2023-12-03T11:57:54.230 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-12-03T11:57:54.230 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2023-12-03T11:57:54.230 INFO:teuthology.orchestra.run.smithi003.stdout: "swift_keys": [], 2023-12-03T11:57:54.230 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": [ 2023-12-03T11:57:54.230 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-12-03T11:57:54.231 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "user-policy", 2023-12-03T11:57:54.231 INFO:teuthology.orchestra.run.smithi003.stdout: "perm": "*" 2023-12-03T11:57:54.231 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-12-03T11:57:54.231 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2023-12-03T11:57:54.231 INFO:teuthology.orchestra.run.smithi003.stdout: "op_mask": "read, write, delete", 2023-12-03T11:57:54.231 INFO:teuthology.orchestra.run.smithi003.stdout: "default_placement": "", 2023-12-03T11:57:54.231 INFO:teuthology.orchestra.run.smithi003.stdout: "default_storage_class": "", 2023-12-03T11:57:54.231 INFO:teuthology.orchestra.run.smithi003.stdout: "placement_tags": [], 2023-12-03T11:57:54.231 INFO:teuthology.orchestra.run.smithi003.stdout: "bucket_quota": { 2023-12-03T11:57:54.231 INFO:teuthology.orchestra.run.smithi003.stdout: "enabled": false, 2023-12-03T11:57:54.231 INFO:teuthology.orchestra.run.smithi003.stdout: "check_on_raw": false, 2023-12-03T11:57:54.231 INFO:teuthology.orchestra.run.smithi003.stdout: "max_size": -1, 2023-12-03T11:57:54.231 INFO:teuthology.orchestra.run.smithi003.stdout: "max_size_kb": 0, 2023-12-03T11:57:54.231 INFO:teuthology.orchestra.run.smithi003.stdout: "max_objects": -1 2023-12-03T11:57:54.231 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-12-03T11:57:54.231 INFO:teuthology.orchestra.run.smithi003.stdout: "user_quota": { 2023-12-03T11:57:54.232 INFO:teuthology.orchestra.run.smithi003.stdout: "enabled": false, 2023-12-03T11:57:54.232 INFO:teuthology.orchestra.run.smithi003.stdout: "check_on_raw": false, 2023-12-03T11:57:54.232 INFO:teuthology.orchestra.run.smithi003.stdout: "max_size": -1, 2023-12-03T11:57:54.232 INFO:teuthology.orchestra.run.smithi003.stdout: "max_size_kb": 0, 2023-12-03T11:57:54.232 INFO:teuthology.orchestra.run.smithi003.stdout: "max_objects": -1 2023-12-03T11:57:54.232 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-12-03T11:57:54.232 INFO:teuthology.orchestra.run.smithi003.stdout: "temp_url_keys": [], 2023-12-03T11:57:54.232 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "rgw", 2023-12-03T11:57:54.232 INFO:teuthology.orchestra.run.smithi003.stdout: "mfa_ids": [] 2023-12-03T11:57:54.232 INFO:teuthology.orchestra.run.smithi003.stdout:} 2023-12-03T11:57:54.232 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:57:54.233 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.226+0000 7f6a8f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:57:54.233 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.229+0000 7f6acea2f800 20 remove_watcher() i=0 2023-12-03T11:57:54.233 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.229+0000 7f6acea2f800 2 removed watcher, disabling cache 2023-12-03T11:57:54.233 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.230+0000 7f6acea2f800 20 remove_watcher() i=1 2023-12-03T11:57:54.233 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.231+0000 7f6acea2f800 20 remove_watcher() i=2 2023-12-03T11:57:54.233 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.232+0000 7f6acea2f800 20 remove_watcher() i=3 2023-12-03T11:57:54.234 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.233+0000 7f6acea2f800 20 remove_watcher() i=4 2023-12-03T11:57:54.235 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.234+0000 7f6acea2f800 20 remove_watcher() i=5 2023-12-03T11:57:54.236 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.235+0000 7f6acea2f800 20 remove_watcher() i=6 2023-12-03T11:57:54.237 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.236+0000 7f6acea2f800 20 remove_watcher() i=7 2023-12-03T11:57:54.242 DEBUG:teuthology.orchestra.run.smithi003:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid bar.client.0 --totp-serial 0397326529 --totp-seed PX6M2RRJKRREHFMV3DOBLOTBPNRJXQWQA4JBFHYOKVILZAOMF6J33DDBUU7RXWE3 --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2023-12-03T11:57:54.307 INFO:teuthology.orchestra.run.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:57:54.307 INFO:teuthology.orchestra.run.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:57:54.318 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.317+0000 7f42ce433800 20 rados->read ofs=0 len=0 2023-12-03T11:57:54.320 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.319+0000 7f42ce433800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:57:54.320 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.319+0000 7f42ce433800 20 realm 2023-12-03T11:57:54.320 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.319+0000 7f42ce433800 20 rados->read ofs=0 len=0 2023-12-03T11:57:54.320 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.319+0000 7f42ce433800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:57:54.321 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.319+0000 7f42ce433800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:57:54.321 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.319+0000 7f42ce433800 20 rados->read ofs=0 len=0 2023-12-03T11:57:54.321 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.319+0000 7f42ce433800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:57:54.321 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.319+0000 7f42ce433800 20 rados->read ofs=0 len=0 2023-12-03T11:57:54.322 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.320+0000 7f42ce433800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:57:54.322 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.320+0000 7f42ce433800 20 rados->read ofs=0 len=0 2023-12-03T11:57:54.322 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.320+0000 7f42ce433800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:57:54.322 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.321+0000 7f42ce433800 20 searching for the correct realm 2023-12-03T11:57:54.334 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.332+0000 7f42ce433800 20 RGWRados::pool_iterate: got zone_info.83aabb46-04b5-4c96-9933-c6bfb1173a73 2023-12-03T11:57:54.334 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.332+0000 7f42ce433800 20 RGWRados::pool_iterate: got zonegroup_info.6a811aad-435d-4fdd-93c9-b7e0b50de429 2023-12-03T11:57:54.334 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.332+0000 7f42ce433800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:57:54.335 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.332+0000 7f42ce433800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:57:54.335 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.332+0000 7f42ce433800 20 rados->read ofs=0 len=0 2023-12-03T11:57:54.335 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.333+0000 7f42cc734640 0 -- 172.21.15.3:0/4014206173 >> [v2:172.21.15.3:6816/2638197404,v1:172.21.15.3:6818/2638197404] conn(0x55d144bf5960 msgr2=0x55d144bf7de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:57:54.335 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.333+0000 7f42ce433800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:57:54.335 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.333+0000 7f42ce433800 20 rados->read ofs=0 len=0 2023-12-03T11:57:54.335 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.333+0000 7f42ce433800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:57:54.335 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.333+0000 7f42ce433800 20 rados->read ofs=0 len=0 2023-12-03T11:57:54.336 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.333+0000 7f42ce433800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:57:54.336 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.334+0000 7f42ce433800 20 zone default found 2023-12-03T11:57:54.336 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.334+0000 7f42ce433800 4 Realm: () 2023-12-03T11:57:54.336 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.334+0000 7f42ce433800 4 ZoneGroup: default (6a811aad-435d-4fdd-93c9-b7e0b50de429) 2023-12-03T11:57:54.336 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.334+0000 7f42ce433800 4 Zone: default (83aabb46-04b5-4c96-9933-c6bfb1173a73) 2023-12-03T11:57:54.336 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.334+0000 7f42ce433800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:57:54.336 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.334+0000 7f42ce433800 20 zonegroup default 2023-12-03T11:57:54.336 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.334+0000 7f42ce433800 20 rados->read ofs=0 len=0 2023-12-03T11:57:54.337 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.334+0000 7f42ce433800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:57:54.337 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.334+0000 7f42ce433800 20 rados->read ofs=0 len=0 2023-12-03T11:57:54.337 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.334+0000 7f42ce433800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:57:54.337 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.334+0000 7f42ce433800 20 rados->read ofs=0 len=0 2023-12-03T11:57:54.337 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.334+0000 7f42ce433800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:57:54.337 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.334+0000 7f42ce433800 20 started sync module instance, tier type = 2023-12-03T11:57:54.337 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.334+0000 7f42ce433800 20 started zone id=83aabb46-04b5-4c96-9933-c6bfb1173a73 (name=default) with tier type = 2023-12-03T11:57:54.345 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.344+0000 7f42ce433800 20 add_watcher() i=0 2023-12-03T11:57:54.345 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.344+0000 7f42ce433800 20 add_watcher() i=1 2023-12-03T11:57:54.345 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.344+0000 7f42ce433800 20 add_watcher() i=2 2023-12-03T11:57:54.345 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.344+0000 7f42ce433800 20 add_watcher() i=3 2023-12-03T11:57:54.345 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.344+0000 7f42ce433800 20 add_watcher() i=4 2023-12-03T11:57:54.345 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.344+0000 7f42ce433800 20 add_watcher() i=5 2023-12-03T11:57:54.345 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.344+0000 7f42cb732640 0 -- 172.21.15.3:0/4014206173 >> [v2:172.21.15.3:6817/3356208405,v1:172.21.15.3:6819/3356208405] conn(0x55d144bfead0 msgr2=0x55d144c00ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:57:54.345 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.344+0000 7f42ce433800 20 add_watcher() i=6 2023-12-03T11:57:54.346 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.345+0000 7f42ce433800 20 add_watcher() i=7 2023-12-03T11:57:54.346 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.345+0000 7f42ce433800 2 all 8 watchers are set, enabling cache 2023-12-03T11:57:54.348 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.346+0000 7f4291fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:57:54.348 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.346+0000 7f42ce433800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:57:54.348 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.346+0000 7f42ce433800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:57:54.353 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.352+0000 7f42ce433800 5 note: GC not initialized 2023-12-03T11:57:54.353 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.352+0000 7f4208ff9640 20 reqs_thread_entry: start 2023-12-03T11:57:54.353 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.352+0000 7f42ce433800 20 init_complete bucket index max shards: 11 2023-12-03T11:57:54.354 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.352+0000 7f42ce433800 20 Filter name: none 2023-12-03T11:57:54.354 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.352+0000 7f41fe7fc640 20 reqs_thread_entry: start 2023-12-03T11:57:54.354 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.352+0000 7f42ce433800 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2023-12-03T11:57:54.354 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.352+0000 7f42ce433800 20 rados->read ofs=0 len=0 2023-12-03T11:57:54.354 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.353+0000 7f42ce433800 20 rados_obj.operate() r=0 bl.length=455 2023-12-03T11:57:54.354 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.353+0000 7f42ce433800 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x13 2023-12-03T11:57:54.354 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.353+0000 7f42ce433800 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2023-12-03T11:57:54.354 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.353+0000 7f42ce433800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:57:54.357 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.356+0000 7f42ce433800 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2023-12-03T11:57:54.357 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.356+0000 7f42ce433800 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2023-12-03T11:57:54.357 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.356+0000 7f42ce433800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:bar.client.0, ofs0, ns] 2023-12-03T11:57:54.357 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.356+0000 7f42b27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595201 cookie 94357287493456 notifier 7601 bl.length()=654 2023-12-03T11:57:54.357 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.356+0000 7f42b27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2023-12-03T11:57:54.357 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.356+0000 7f42b27fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2023-12-03T11:57:54.360 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.359+0000 7f4291fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:57:54.362 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.361+0000 7f42ce433800 20 remove_watcher() i=0 2023-12-03T11:57:54.362 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.361+0000 7f42ce433800 2 removed watcher, disabling cache 2023-12-03T11:57:54.363 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.362+0000 7f42ce433800 20 remove_watcher() i=1 2023-12-03T11:57:54.364 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.363+0000 7f42ce433800 20 remove_watcher() i=2 2023-12-03T11:57:54.366 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.364+0000 7f42ce433800 20 remove_watcher() i=3 2023-12-03T11:57:54.366 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.365+0000 7f42ce433800 20 remove_watcher() i=4 2023-12-03T11:57:54.368 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.366+0000 7f42ce433800 20 remove_watcher() i=5 2023-12-03T11:57:54.369 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.367+0000 7f42ce433800 20 remove_watcher() i=6 2023-12-03T11:57:54.370 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.368+0000 7f42ce433800 20 remove_watcher() i=7 2023-12-03T11:57:54.375 DEBUG:tasks.s3tests:Creating user testx$tenanteduser.client.0 on client.0 2023-12-03T11:57:54.375 DEBUG:teuthology.orchestra.run.smithi003:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid 'testx$tenanteduser.client.0' --display-name 'Mr. testx$tenanteduser.client.0' --email 'testx$tenanteduser.client.0+test@test.test' --caps 'user-policy=*' --access-key CAFNLIMRXOQVDCHIFTQI --secret d/DDCEQ1ZsH/M/7l0W1Iz0Xv8TWJVhkz+BjiKfkQ+MSmED86oL1PIg== --cluster ceph 2023-12-03T11:57:54.440 INFO:teuthology.orchestra.run.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:57:54.440 INFO:teuthology.orchestra.run.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:57:54.454 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.452+0000 7f9591b2b800 20 rados->read ofs=0 len=0 2023-12-03T11:57:54.456 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.454+0000 7f9591b2b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:57:54.456 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.454+0000 7f9591b2b800 20 realm 2023-12-03T11:57:54.456 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.454+0000 7f9591b2b800 20 rados->read ofs=0 len=0 2023-12-03T11:57:54.456 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.454+0000 7f9591b2b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:57:54.456 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.454+0000 7f9591b2b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:57:54.456 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.454+0000 7f9591b2b800 20 rados->read ofs=0 len=0 2023-12-03T11:57:54.456 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.455+0000 7f9591b2b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:57:54.456 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.455+0000 7f9591b2b800 20 rados->read ofs=0 len=0 2023-12-03T11:57:54.457 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.455+0000 7f9591b2b800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:57:54.457 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.455+0000 7f9591b2b800 20 rados->read ofs=0 len=0 2023-12-03T11:57:54.457 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.456+0000 7f9591b2b800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:57:54.457 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.456+0000 7f9591b2b800 20 searching for the correct realm 2023-12-03T11:57:54.468 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.467+0000 7f958d832640 0 -- 172.21.15.3:0/704724857 >> [v2:172.21.15.37:6805/1692844418,v1:172.21.15.37:6807/1692844418] conn(0x5566372c62b0 msgr2=0x5566372c86a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:57:54.470 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.468+0000 7f9591b2b800 20 RGWRados::pool_iterate: got zone_info.83aabb46-04b5-4c96-9933-c6bfb1173a73 2023-12-03T11:57:54.470 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.468+0000 7f9591b2b800 20 RGWRados::pool_iterate: got zonegroup_info.6a811aad-435d-4fdd-93c9-b7e0b50de429 2023-12-03T11:57:54.470 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.468+0000 7f9591b2b800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:57:54.470 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.468+0000 7f9591b2b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:57:54.470 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.468+0000 7f9591b2b800 20 rados->read ofs=0 len=0 2023-12-03T11:57:54.470 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.468+0000 7f9591b2b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:57:54.470 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.468+0000 7f9591b2b800 20 rados->read ofs=0 len=0 2023-12-03T11:57:54.470 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.469+0000 7f9591b2b800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:57:54.470 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.469+0000 7f9591b2b800 20 rados->read ofs=0 len=0 2023-12-03T11:57:54.471 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.469+0000 7f9591b2b800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:57:54.472 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.469+0000 7f9591b2b800 20 zone default found 2023-12-03T11:57:54.472 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.469+0000 7f9591b2b800 4 Realm: () 2023-12-03T11:57:54.472 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.469+0000 7f9591b2b800 4 ZoneGroup: default (6a811aad-435d-4fdd-93c9-b7e0b50de429) 2023-12-03T11:57:54.472 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.469+0000 7f9591b2b800 4 Zone: default (83aabb46-04b5-4c96-9933-c6bfb1173a73) 2023-12-03T11:57:54.472 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.469+0000 7f9591b2b800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:57:54.472 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.469+0000 7f9591b2b800 20 zonegroup default 2023-12-03T11:57:54.472 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.469+0000 7f9591b2b800 20 rados->read ofs=0 len=0 2023-12-03T11:57:54.472 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.469+0000 7f9591b2b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:57:54.472 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.469+0000 7f9591b2b800 20 rados->read ofs=0 len=0 2023-12-03T11:57:54.472 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.470+0000 7f9591b2b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:57:54.472 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.470+0000 7f9591b2b800 20 rados->read ofs=0 len=0 2023-12-03T11:57:54.472 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.470+0000 7f9591b2b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:57:54.472 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.470+0000 7f9591b2b800 20 started sync module instance, tier type = 2023-12-03T11:57:54.472 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.470+0000 7f9591b2b800 20 started zone id=83aabb46-04b5-4c96-9933-c6bfb1173a73 (name=default) with tier type = 2023-12-03T11:57:54.478 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.477+0000 7f958e033640 0 -- 172.21.15.3:0/704724857 >> [v2:172.21.15.37:6816/3770469300,v1:172.21.15.37:6818/3770469300] conn(0x7f9584031950 msgr2=0x7f958401c450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:57:54.481 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.479+0000 7f9591b2b800 20 add_watcher() i=0 2023-12-03T11:57:54.481 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.479+0000 7f9591b2b800 20 add_watcher() i=1 2023-12-03T11:57:54.481 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.479+0000 7f9591b2b800 20 add_watcher() i=2 2023-12-03T11:57:54.481 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.479+0000 7f9591b2b800 20 add_watcher() i=3 2023-12-03T11:57:54.481 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.479+0000 7f9591b2b800 20 add_watcher() i=4 2023-12-03T11:57:54.481 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.479+0000 7f9591b2b800 20 add_watcher() i=5 2023-12-03T11:57:54.481 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.480+0000 7f9591b2b800 20 add_watcher() i=6 2023-12-03T11:57:54.482 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.480+0000 7f9591b2b800 20 add_watcher() i=7 2023-12-03T11:57:54.482 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.480+0000 7f9591b2b800 2 all 8 watchers are set, enabling cache 2023-12-03T11:57:54.483 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.482+0000 7f95537e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:57:54.483 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.482+0000 7f9591b2b800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:57:54.483 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.482+0000 7f9591b2b800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:57:54.488 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.487+0000 7f9591b2b800 5 note: GC not initialized 2023-12-03T11:57:54.489 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.487+0000 7f94c27fc640 20 reqs_thread_entry: start 2023-12-03T11:57:54.489 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.487+0000 7f9591b2b800 20 init_complete bucket index max shards: 11 2023-12-03T11:57:54.489 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.487+0000 7f9591b2b800 20 Filter name: none 2023-12-03T11:57:54.489 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.487+0000 7f94b3fff640 20 reqs_thread_entry: start 2023-12-03T11:57:54.489 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.487+0000 7f9591b2b800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2023-12-03T11:57:54.489 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.487+0000 7f9591b2b800 20 rados->read ofs=0 len=0 2023-12-03T11:57:54.490 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.488+0000 7f9591b2b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:57:54.490 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.488+0000 7f9591b2b800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x0 2023-12-03T11:57:54.490 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.488+0000 7f9591b2b800 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2023-12-03T11:57:54.490 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.488+0000 7f9591b2b800 10 cache get: name=default.rgw.meta+users.email+testx$tenanteduser.client.0+test@test.test : miss 2023-12-03T11:57:54.490 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.488+0000 7f9591b2b800 20 rados->read ofs=0 len=0 2023-12-03T11:57:54.491 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.488+0000 7f9591b2b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:57:54.491 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.488+0000 7f9591b2b800 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser.client.0+test@test.test info.flags=0x0 2023-12-03T11:57:54.491 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.488+0000 7f9591b2b800 10 adding default.rgw.meta+users.email+testx$tenanteduser.client.0+test@test.test to cache LRU end 2023-12-03T11:57:54.491 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.488+0000 7f9591b2b800 10 cache get: name=default.rgw.meta+users.keys+CAFNLIMRXOQVDCHIFTQI : miss 2023-12-03T11:57:54.491 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.488+0000 7f9591b2b800 20 rados->read ofs=0 len=0 2023-12-03T11:57:54.491 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.488+0000 7f9591b2b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:57:54.491 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.488+0000 7f9591b2b800 10 cache put: name=default.rgw.meta+users.keys+CAFNLIMRXOQVDCHIFTQI info.flags=0x0 2023-12-03T11:57:54.492 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.488+0000 7f9591b2b800 10 adding default.rgw.meta+users.keys+CAFNLIMRXOQVDCHIFTQI to cache LRU end 2023-12-03T11:57:54.492 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.488+0000 7f9591b2b800 10 cache get: name=default.rgw.meta+users.keys+CAFNLIMRXOQVDCHIFTQI : hit (negative entry) 2023-12-03T11:57:54.492 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.488+0000 7f9591b2b800 10 cache get: name=default.rgw.meta+users.keys+CAFNLIMRXOQVDCHIFTQI : hit (negative entry) 2023-12-03T11:57:54.492 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.490+0000 7f9591b2b800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2023-12-03T11:57:54.492 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.490+0000 7f9591b2b800 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2023-12-03T11:57:54.492 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.490+0000 7f9591b2b800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser.client.0, ofs0, ns] 2023-12-03T11:57:54.492 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.490+0000 7f956f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595318 cookie 93897500729568 notifier 8121 bl.length()=714 2023-12-03T11:57:54.492 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.490+0000 7f956f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2023-12-03T11:57:54.492 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.490+0000 7f956f7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2023-12-03T11:57:54.494 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.493+0000 7f9591b2b800 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser.client.0+test@test.test info.flags=0x7 2023-12-03T11:57:54.494 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.493+0000 7f9591b2b800 10 moving default.rgw.meta+users.email+testx$tenanteduser.client.0+test@test.test to cache LRU end 2023-12-03T11:57:54.494 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.493+0000 7f9591b2b800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.email:testx$tenanteduser.client.0+test@test.test, ofs0, ns] 2023-12-03T11:57:54.495 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.493+0000 7f956f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595161 cookie 93897500734384 notifier 8121 bl.length()=224 2023-12-03T11:57:54.495 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.493+0000 7f956f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+testx$tenanteduser.client.0+test@test.test info.flags=0x7 2023-12-03T11:57:54.495 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.493+0000 7f956f7fe640 10 rgw watcher librados: moving default.rgw.meta+users.email+testx$tenanteduser.client.0+test@test.test to cache LRU end 2023-12-03T11:57:54.497 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.496+0000 7f9591b2b800 10 cache put: name=default.rgw.meta+users.keys+CAFNLIMRXOQVDCHIFTQI info.flags=0x7 2023-12-03T11:57:54.497 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.496+0000 7f9591b2b800 10 moving default.rgw.meta+users.keys+CAFNLIMRXOQVDCHIFTQI to cache LRU end 2023-12-03T11:57:54.497 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.496+0000 7f9591b2b800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.keys:CAFNLIMRXOQVDCHIFTQI, ofs0, ns] 2023-12-03T11:57:54.497 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.496+0000 7f956f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595202 cookie 93897498238800 notifier 8121 bl.length()=201 2023-12-03T11:57:54.498 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.496+0000 7f956f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+CAFNLIMRXOQVDCHIFTQI info.flags=0x7 2023-12-03T11:57:54.498 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.496+0000 7f956f7fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+CAFNLIMRXOQVDCHIFTQI to cache LRU end 2023-12-03T11:57:54.499 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2023-12-03T11:57:54.499 INFO:teuthology.orchestra.run.smithi003.stdout: "user_id": "testx$tenanteduser.client.0", 2023-12-03T11:57:54.499 INFO:teuthology.orchestra.run.smithi003.stdout: "display_name": "Mr. testx$tenanteduser.client.0", 2023-12-03T11:57:54.499 INFO:teuthology.orchestra.run.smithi003.stdout: "email": "testx$tenanteduser.client.0+test@test.test", 2023-12-03T11:57:54.499 INFO:teuthology.orchestra.run.smithi003.stdout: "suspended": 0, 2023-12-03T11:57:54.499 INFO:teuthology.orchestra.run.smithi003.stdout: "max_buckets": 1000, 2023-12-03T11:57:54.500 INFO:teuthology.orchestra.run.smithi003.stdout: "subusers": [], 2023-12-03T11:57:54.500 INFO:teuthology.orchestra.run.smithi003.stdout: "keys": [ 2023-12-03T11:57:54.500 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-12-03T11:57:54.500 INFO:teuthology.orchestra.run.smithi003.stdout: "user": "testx$tenanteduser.client.0", 2023-12-03T11:57:54.500 INFO:teuthology.orchestra.run.smithi003.stdout: "access_key": "CAFNLIMRXOQVDCHIFTQI", 2023-12-03T11:57:54.500 INFO:teuthology.orchestra.run.smithi003.stdout: "secret_key": "d/DDCEQ1ZsH/M/7l0W1Iz0Xv8TWJVhkz+BjiKfkQ+MSmED86oL1PIg==" 2023-12-03T11:57:54.500 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-12-03T11:57:54.500 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2023-12-03T11:57:54.500 INFO:teuthology.orchestra.run.smithi003.stdout: "swift_keys": [], 2023-12-03T11:57:54.501 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": [ 2023-12-03T11:57:54.501 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-12-03T11:57:54.501 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "user-policy", 2023-12-03T11:57:54.501 INFO:teuthology.orchestra.run.smithi003.stdout: "perm": "*" 2023-12-03T11:57:54.501 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-12-03T11:57:54.501 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2023-12-03T11:57:54.501 INFO:teuthology.orchestra.run.smithi003.stdout: "op_mask": "read, write, delete", 2023-12-03T11:57:54.501 INFO:teuthology.orchestra.run.smithi003.stdout: "default_placement": "", 2023-12-03T11:57:54.501 INFO:teuthology.orchestra.run.smithi003.stdout: "default_storage_class": "", 2023-12-03T11:57:54.501 INFO:teuthology.orchestra.run.smithi003.stdout: "placement_tags": [], 2023-12-03T11:57:54.501 INFO:teuthology.orchestra.run.smithi003.stdout: "bucket_quota": { 2023-12-03T11:57:54.501 INFO:teuthology.orchestra.run.smithi003.stdout: "enabled": false, 2023-12-03T11:57:54.501 INFO:teuthology.orchestra.run.smithi003.stdout: "check_on_raw": false, 2023-12-03T11:57:54.501 INFO:teuthology.orchestra.run.smithi003.stdout: "max_size": -1, 2023-12-03T11:57:54.501 INFO:teuthology.orchestra.run.smithi003.stdout: "max_size_kb": 0, 2023-12-03T11:57:54.502 INFO:teuthology.orchestra.run.smithi003.stdout: "max_objects": -1 2023-12-03T11:57:54.502 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-12-03T11:57:54.502 INFO:teuthology.orchestra.run.smithi003.stdout: "user_quota": { 2023-12-03T11:57:54.502 INFO:teuthology.orchestra.run.smithi003.stdout: "enabled": false, 2023-12-03T11:57:54.502 INFO:teuthology.orchestra.run.smithi003.stdout: "check_on_raw": false, 2023-12-03T11:57:54.502 INFO:teuthology.orchestra.run.smithi003.stdout: "max_size": -1, 2023-12-03T11:57:54.502 INFO:teuthology.orchestra.run.smithi003.stdout: "max_size_kb": 0, 2023-12-03T11:57:54.502 INFO:teuthology.orchestra.run.smithi003.stdout: "max_objects": -1 2023-12-03T11:57:54.502 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-12-03T11:57:54.502 INFO:teuthology.orchestra.run.smithi003.stdout: "temp_url_keys": [], 2023-12-03T11:57:54.502 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "rgw", 2023-12-03T11:57:54.502 INFO:teuthology.orchestra.run.smithi003.stdout: "mfa_ids": [] 2023-12-03T11:57:54.502 INFO:teuthology.orchestra.run.smithi003.stdout:} 2023-12-03T11:57:54.502 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:57:54.503 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.499+0000 7f95537e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:57:54.503 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.501+0000 7f9591b2b800 20 remove_watcher() i=0 2023-12-03T11:57:54.503 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.501+0000 7f9591b2b800 2 removed watcher, disabling cache 2023-12-03T11:57:54.503 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.502+0000 7f9591b2b800 20 remove_watcher() i=1 2023-12-03T11:57:54.504 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.503+0000 7f9591b2b800 20 remove_watcher() i=2 2023-12-03T11:57:54.505 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.504+0000 7f9591b2b800 20 remove_watcher() i=3 2023-12-03T11:57:54.506 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.505+0000 7f9591b2b800 20 remove_watcher() i=4 2023-12-03T11:57:54.507 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.506+0000 7f9591b2b800 20 remove_watcher() i=5 2023-12-03T11:57:54.508 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.507+0000 7f9591b2b800 20 remove_watcher() i=6 2023-12-03T11:57:54.509 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.508+0000 7f9591b2b800 20 remove_watcher() i=7 2023-12-03T11:57:54.514 DEBUG:teuthology.orchestra.run.smithi003:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid 'testx$tenanteduser.client.0' --totp-serial 3350959360 --totp-seed YGEUETJILM2XKZBK33QEWZPYI6Q7N5RVSPZCBEXZ6BJVN2KZ5AADL4X3AFWXWGSH --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2023-12-03T11:57:54.578 INFO:teuthology.orchestra.run.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:57:54.578 INFO:teuthology.orchestra.run.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:57:54.590 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.588+0000 7fa964c8c800 20 rados->read ofs=0 len=0 2023-12-03T11:57:54.591 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.590+0000 7fa964c8c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:57:54.591 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.590+0000 7fa964c8c800 20 realm 2023-12-03T11:57:54.591 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.590+0000 7fa964c8c800 20 rados->read ofs=0 len=0 2023-12-03T11:57:54.591 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.590+0000 7fa964c8c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:57:54.592 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.590+0000 7fa964c8c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:57:54.592 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.590+0000 7fa964c8c800 20 rados->read ofs=0 len=0 2023-12-03T11:57:54.592 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.590+0000 7fa964c8c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:57:54.592 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.590+0000 7fa964c8c800 20 rados->read ofs=0 len=0 2023-12-03T11:57:54.592 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.591+0000 7fa964c8c800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:57:54.593 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.591+0000 7fa964c8c800 20 rados->read ofs=0 len=0 2023-12-03T11:57:54.593 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.591+0000 7fa964c8c800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:57:54.593 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.591+0000 7fa964c8c800 20 searching for the correct realm 2023-12-03T11:57:54.604 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.602+0000 7fa964c8c800 20 RGWRados::pool_iterate: got zone_info.83aabb46-04b5-4c96-9933-c6bfb1173a73 2023-12-03T11:57:54.604 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.602+0000 7fa964c8c800 20 RGWRados::pool_iterate: got zonegroup_info.6a811aad-435d-4fdd-93c9-b7e0b50de429 2023-12-03T11:57:54.604 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.602+0000 7fa964c8c800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:57:54.604 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.602+0000 7fa964c8c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:57:54.604 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.602+0000 7fa964c8c800 20 rados->read ofs=0 len=0 2023-12-03T11:57:54.604 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.603+0000 7fa962f8d640 0 -- 172.21.15.3:0/2646881145 >> [v2:172.21.15.3:6816/2638197404,v1:172.21.15.3:6818/2638197404] conn(0x55e1c91d44c0 msgr2=0x55e1c91d68e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:57:54.604 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.603+0000 7fa964c8c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:57:54.604 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.603+0000 7fa964c8c800 20 rados->read ofs=0 len=0 2023-12-03T11:57:54.606 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.603+0000 7fa964c8c800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:57:54.606 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.603+0000 7fa964c8c800 20 rados->read ofs=0 len=0 2023-12-03T11:57:54.606 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.603+0000 7fa964c8c800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:57:54.606 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.603+0000 7fa964c8c800 20 zone default found 2023-12-03T11:57:54.606 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.603+0000 7fa964c8c800 4 Realm: () 2023-12-03T11:57:54.606 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.603+0000 7fa964c8c800 4 ZoneGroup: default (6a811aad-435d-4fdd-93c9-b7e0b50de429) 2023-12-03T11:57:54.606 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.603+0000 7fa964c8c800 4 Zone: default (83aabb46-04b5-4c96-9933-c6bfb1173a73) 2023-12-03T11:57:54.606 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.603+0000 7fa964c8c800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:57:54.606 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.603+0000 7fa964c8c800 20 zonegroup default 2023-12-03T11:57:54.606 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.603+0000 7fa964c8c800 20 rados->read ofs=0 len=0 2023-12-03T11:57:54.606 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.604+0000 7fa964c8c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:57:54.606 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.604+0000 7fa964c8c800 20 rados->read ofs=0 len=0 2023-12-03T11:57:54.607 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.604+0000 7fa964c8c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:57:54.607 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.604+0000 7fa964c8c800 20 rados->read ofs=0 len=0 2023-12-03T11:57:54.607 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.604+0000 7fa964c8c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:57:54.607 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.605+0000 7fa964c8c800 20 started sync module instance, tier type = 2023-12-03T11:57:54.607 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.605+0000 7fa964c8c800 20 started zone id=83aabb46-04b5-4c96-9933-c6bfb1173a73 (name=default) with tier type = 2023-12-03T11:57:54.615 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.614+0000 7fa96278c640 0 -- 172.21.15.3:0/2646881145 >> [v2:172.21.15.3:6808/263125788,v1:172.21.15.3:6809/263125788] conn(0x7fa958068040 msgr2=0x7fa9580c99c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:57:54.615 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.614+0000 7fa964c8c800 20 add_watcher() i=0 2023-12-03T11:57:54.615 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.614+0000 7fa964c8c800 20 add_watcher() i=1 2023-12-03T11:57:54.615 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.614+0000 7fa964c8c800 20 add_watcher() i=2 2023-12-03T11:57:54.615 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.614+0000 7fa964c8c800 20 add_watcher() i=3 2023-12-03T11:57:54.616 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.614+0000 7fa964c8c800 20 add_watcher() i=4 2023-12-03T11:57:54.616 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.614+0000 7fa964c8c800 20 add_watcher() i=5 2023-12-03T11:57:54.616 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.614+0000 7fa964c8c800 20 add_watcher() i=6 2023-12-03T11:57:54.616 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.615+0000 7fa964c8c800 20 add_watcher() i=7 2023-12-03T11:57:54.616 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.615+0000 7fa964c8c800 2 all 8 watchers are set, enabling cache 2023-12-03T11:57:54.618 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.617+0000 7fa927fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:57:54.619 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.617+0000 7fa964c8c800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:57:54.619 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.617+0000 7fa964c8c800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:57:54.624 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.622+0000 7fa964c8c800 5 note: GC not initialized 2023-12-03T11:57:54.624 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.622+0000 7fa896ffd640 20 reqs_thread_entry: start 2023-12-03T11:57:54.624 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.623+0000 7fa964c8c800 20 init_complete bucket index max shards: 11 2023-12-03T11:57:54.624 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.623+0000 7fa964c8c800 20 Filter name: none 2023-12-03T11:57:54.624 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.623+0000 7fa894ff9640 20 reqs_thread_entry: start 2023-12-03T11:57:54.625 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.623+0000 7fa964c8c800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2023-12-03T11:57:54.625 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.623+0000 7fa964c8c800 20 rados->read ofs=0 len=0 2023-12-03T11:57:54.625 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.623+0000 7fa964c8c800 20 rados_obj.operate() r=0 bl.length=514 2023-12-03T11:57:54.625 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.623+0000 7fa964c8c800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x13 2023-12-03T11:57:54.625 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.623+0000 7fa964c8c800 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2023-12-03T11:57:54.625 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.623+0000 7fa964c8c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:57:54.627 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.626+0000 7fa964c8c800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2023-12-03T11:57:54.628 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.626+0000 7fa964c8c800 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2023-12-03T11:57:54.628 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.626+0000 7fa964c8c800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser.client.0, ofs0, ns] 2023-12-03T11:57:54.628 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.627+0000 7fa950ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595319 cookie 94428230202256 notifier 8142 bl.length()=728 2023-12-03T11:57:54.628 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.627+0000 7fa950ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2023-12-03T11:57:54.628 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.627+0000 7fa950ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2023-12-03T11:57:54.630 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.629+0000 7fa927fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:57:54.632 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.631+0000 7fa964c8c800 20 remove_watcher() i=0 2023-12-03T11:57:54.633 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.631+0000 7fa964c8c800 2 removed watcher, disabling cache 2023-12-03T11:57:54.634 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.632+0000 7fa964c8c800 20 remove_watcher() i=1 2023-12-03T11:57:54.635 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.633+0000 7fa964c8c800 20 remove_watcher() i=2 2023-12-03T11:57:54.636 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.634+0000 7fa964c8c800 20 remove_watcher() i=3 2023-12-03T11:57:54.637 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.635+0000 7fa964c8c800 20 remove_watcher() i=4 2023-12-03T11:57:54.638 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.636+0000 7fa964c8c800 20 remove_watcher() i=5 2023-12-03T11:57:54.641 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.637+0000 7fa964c8c800 20 remove_watcher() i=6 2023-12-03T11:57:54.641 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.638+0000 7fa964c8c800 20 remove_watcher() i=7 2023-12-03T11:57:54.645 DEBUG:tasks.s3tests:Creating user foobar.client.0 on client.0 2023-12-03T11:57:54.645 DEBUG:teuthology.orchestra.run.smithi003:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid foobar.client.0 --display-name 'Mr. foobar.client.0' --email foobar.client.0+test@test.test --caps 'user-policy=*' --access-key LFNWUUYUSDDBQKEUHGYB --secret f7QFwqVAzZML4BoBnRp9J2seaswG4cs0ARsL52r57L8rdqY8/EO/pw== --cluster ceph 2023-12-03T11:57:54.714 INFO:teuthology.orchestra.run.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:57:54.714 INFO:teuthology.orchestra.run.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:57:54.726 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.724+0000 7fbd34926800 20 rados->read ofs=0 len=0 2023-12-03T11:57:54.730 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.729+0000 7fbd34926800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:57:54.730 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.729+0000 7fbd34926800 20 realm 2023-12-03T11:57:54.730 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.729+0000 7fbd34926800 20 rados->read ofs=0 len=0 2023-12-03T11:57:54.731 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.729+0000 7fbd34926800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:57:54.731 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.729+0000 7fbd34926800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:57:54.731 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.729+0000 7fbd34926800 20 rados->read ofs=0 len=0 2023-12-03T11:57:54.731 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.729+0000 7fbd34926800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:57:54.731 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.729+0000 7fbd34926800 20 rados->read ofs=0 len=0 2023-12-03T11:57:54.735 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.733+0000 7fbd34926800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:57:54.735 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.733+0000 7fbd34926800 20 rados->read ofs=0 len=0 2023-12-03T11:57:54.735 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.734+0000 7fbd34926800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:57:54.735 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.734+0000 7fbd34926800 20 searching for the correct realm 2023-12-03T11:57:54.754 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.752+0000 7fbd30685640 0 -- 172.21.15.3:0/3204037848 >> [v2:172.21.15.37:6805/1692844418,v1:172.21.15.37:6807/1692844418] conn(0x55a3aa9d2ab0 msgr2=0x55a3aa9d4ea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:57:54.754 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.753+0000 7fbd34926800 20 RGWRados::pool_iterate: got zone_info.83aabb46-04b5-4c96-9933-c6bfb1173a73 2023-12-03T11:57:54.755 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.753+0000 7fbd34926800 20 RGWRados::pool_iterate: got zonegroup_info.6a811aad-435d-4fdd-93c9-b7e0b50de429 2023-12-03T11:57:54.755 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.753+0000 7fbd34926800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:57:54.755 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.753+0000 7fbd34926800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:57:54.755 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.753+0000 7fbd34926800 20 rados->read ofs=0 len=0 2023-12-03T11:57:54.755 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.753+0000 7fbd34926800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:57:54.755 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.753+0000 7fbd34926800 20 rados->read ofs=0 len=0 2023-12-03T11:57:54.756 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.754+0000 7fbd34926800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:57:54.756 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.754+0000 7fbd34926800 20 rados->read ofs=0 len=0 2023-12-03T11:57:54.756 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.754+0000 7fbd34926800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:57:54.757 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.754+0000 7fbd34926800 20 zone default found 2023-12-03T11:57:54.757 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.754+0000 7fbd34926800 4 Realm: () 2023-12-03T11:57:54.757 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.754+0000 7fbd34926800 4 ZoneGroup: default (6a811aad-435d-4fdd-93c9-b7e0b50de429) 2023-12-03T11:57:54.757 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.754+0000 7fbd34926800 4 Zone: default (83aabb46-04b5-4c96-9933-c6bfb1173a73) 2023-12-03T11:57:54.757 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.754+0000 7fbd34926800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:57:54.757 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.754+0000 7fbd34926800 20 zonegroup default 2023-12-03T11:57:54.757 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.754+0000 7fbd34926800 20 rados->read ofs=0 len=0 2023-12-03T11:57:54.757 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.754+0000 7fbd34926800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:57:54.757 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.754+0000 7fbd34926800 20 rados->read ofs=0 len=0 2023-12-03T11:57:54.757 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.755+0000 7fbd34926800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:57:54.757 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.755+0000 7fbd34926800 20 rados->read ofs=0 len=0 2023-12-03T11:57:54.757 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.755+0000 7fbd34926800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:57:54.757 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.755+0000 7fbd34926800 20 started sync module instance, tier type = 2023-12-03T11:57:54.757 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.755+0000 7fbd34926800 20 started zone id=83aabb46-04b5-4c96-9933-c6bfb1173a73 (name=default) with tier type = 2023-12-03T11:57:54.763 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.762+0000 7fbd30e86640 0 -- 172.21.15.3:0/3204037848 >> [v2:172.21.15.37:6816/3770469300,v1:172.21.15.37:6818/3770469300] conn(0x7fbd24058800 msgr2=0x7fbd24088290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:57:54.765 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.764+0000 7fbd34926800 20 add_watcher() i=0 2023-12-03T11:57:54.766 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.764+0000 7fbd34926800 20 add_watcher() i=1 2023-12-03T11:57:54.766 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.764+0000 7fbd34926800 20 add_watcher() i=2 2023-12-03T11:57:54.766 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.764+0000 7fbd34926800 20 add_watcher() i=3 2023-12-03T11:57:54.766 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.764+0000 7fbd34926800 20 add_watcher() i=4 2023-12-03T11:57:54.766 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.764+0000 7fbd34926800 20 add_watcher() i=5 2023-12-03T11:57:54.766 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.764+0000 7fbd34926800 20 add_watcher() i=6 2023-12-03T11:57:54.766 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.765+0000 7fbd34926800 20 add_watcher() i=7 2023-12-03T11:57:54.766 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.765+0000 7fbd34926800 2 all 8 watchers are set, enabling cache 2023-12-03T11:57:54.768 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.766+0000 7fbcf67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:57:54.768 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.767+0000 7fbd34926800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:57:54.768 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.767+0000 7fbd34926800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:57:54.775 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.772+0000 7fbd34926800 5 note: GC not initialized 2023-12-03T11:57:54.775 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.772+0000 7fbc657fa640 20 reqs_thread_entry: start 2023-12-03T11:57:54.775 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.772+0000 7fbd34926800 20 init_complete bucket index max shards: 11 2023-12-03T11:57:54.775 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.772+0000 7fbd34926800 20 Filter name: none 2023-12-03T11:57:54.775 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.772+0000 7fbc5effd640 20 reqs_thread_entry: start 2023-12-03T11:57:54.775 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.772+0000 7fbd34926800 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2023-12-03T11:57:54.775 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.772+0000 7fbd34926800 20 rados->read ofs=0 len=0 2023-12-03T11:57:54.775 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.772+0000 7fbd34926800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:57:54.775 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.772+0000 7fbd34926800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x0 2023-12-03T11:57:54.775 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.772+0000 7fbd34926800 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2023-12-03T11:57:54.775 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.772+0000 7fbd34926800 10 cache get: name=default.rgw.meta+users.email+foobar.client.0+test@test.test : miss 2023-12-03T11:57:54.775 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.772+0000 7fbd34926800 20 rados->read ofs=0 len=0 2023-12-03T11:57:54.776 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.773+0000 7fbd34926800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:57:54.776 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.773+0000 7fbd34926800 10 cache put: name=default.rgw.meta+users.email+foobar.client.0+test@test.test info.flags=0x0 2023-12-03T11:57:54.776 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.773+0000 7fbd34926800 10 adding default.rgw.meta+users.email+foobar.client.0+test@test.test to cache LRU end 2023-12-03T11:57:54.776 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.773+0000 7fbd34926800 10 cache get: name=default.rgw.meta+users.keys+LFNWUUYUSDDBQKEUHGYB : miss 2023-12-03T11:57:54.776 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.773+0000 7fbd34926800 20 rados->read ofs=0 len=0 2023-12-03T11:57:54.776 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.773+0000 7fbd34926800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:57:54.776 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.773+0000 7fbd34926800 10 cache put: name=default.rgw.meta+users.keys+LFNWUUYUSDDBQKEUHGYB info.flags=0x0 2023-12-03T11:57:54.776 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.773+0000 7fbd34926800 10 adding default.rgw.meta+users.keys+LFNWUUYUSDDBQKEUHGYB to cache LRU end 2023-12-03T11:57:54.776 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.773+0000 7fbd34926800 10 cache get: name=default.rgw.meta+users.keys+LFNWUUYUSDDBQKEUHGYB : hit (negative entry) 2023-12-03T11:57:54.776 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.773+0000 7fbd34926800 10 cache get: name=default.rgw.meta+users.keys+LFNWUUYUSDDBQKEUHGYB : hit (negative entry) 2023-12-03T11:57:54.777 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.774+0000 7fbd34926800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2023-12-03T11:57:54.777 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.774+0000 7fbd34926800 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2023-12-03T11:57:54.777 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.774+0000 7fbd34926800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2023-12-03T11:57:54.777 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.775+0000 7fbd16ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562458 cookie 94161430508144 notifier 7658 bl.length()=655 2023-12-03T11:57:54.777 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.775+0000 7fbd16ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2023-12-03T11:57:54.777 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.775+0000 7fbd16ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2023-12-03T11:57:54.779 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.778+0000 7fbd34926800 10 cache put: name=default.rgw.meta+users.email+foobar.client.0+test@test.test info.flags=0x7 2023-12-03T11:57:54.779 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.778+0000 7fbd34926800 10 moving default.rgw.meta+users.email+foobar.client.0+test@test.test to cache LRU end 2023-12-03T11:57:54.780 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.778+0000 7fbd34926800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:foobar.client.0+test@test.test, ofs0, ns] 2023-12-03T11:57:54.780 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.778+0000 7fbd16ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562616 cookie 94161430501280 notifier 7658 bl.length()=200 2023-12-03T11:57:54.780 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.778+0000 7fbd16ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foobar.client.0+test@test.test info.flags=0x7 2023-12-03T11:57:54.780 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.778+0000 7fbd16ffd640 10 rgw watcher librados: moving default.rgw.meta+users.email+foobar.client.0+test@test.test to cache LRU end 2023-12-03T11:57:54.782 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.781+0000 7fbd34926800 10 cache put: name=default.rgw.meta+users.keys+LFNWUUYUSDDBQKEUHGYB info.flags=0x7 2023-12-03T11:57:54.782 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.781+0000 7fbd34926800 10 moving default.rgw.meta+users.keys+LFNWUUYUSDDBQKEUHGYB to cache LRU end 2023-12-03T11:57:54.782 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.781+0000 7fbd34926800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.keys:LFNWUUYUSDDBQKEUHGYB, ofs0, ns] 2023-12-03T11:57:54.782 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.781+0000 7fbd167fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562617 cookie 94161430507104 notifier 7658 bl.length()=189 2023-12-03T11:57:54.782 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.781+0000 7fbd167fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+LFNWUUYUSDDBQKEUHGYB info.flags=0x7 2023-12-03T11:57:54.783 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.781+0000 7fbd167fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+LFNWUUYUSDDBQKEUHGYB to cache LRU end 2023-12-03T11:57:54.783 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2023-12-03T11:57:54.783 INFO:teuthology.orchestra.run.smithi003.stdout: "user_id": "foobar.client.0", 2023-12-03T11:57:54.783 INFO:teuthology.orchestra.run.smithi003.stdout: "display_name": "Mr. foobar.client.0", 2023-12-03T11:57:54.783 INFO:teuthology.orchestra.run.smithi003.stdout: "email": "foobar.client.0+test@test.test", 2023-12-03T11:57:54.784 INFO:teuthology.orchestra.run.smithi003.stdout: "suspended": 0, 2023-12-03T11:57:54.784 INFO:teuthology.orchestra.run.smithi003.stdout: "max_buckets": 1000, 2023-12-03T11:57:54.784 INFO:teuthology.orchestra.run.smithi003.stdout: "subusers": [], 2023-12-03T11:57:54.784 INFO:teuthology.orchestra.run.smithi003.stdout: "keys": [ 2023-12-03T11:57:54.784 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-12-03T11:57:54.784 INFO:teuthology.orchestra.run.smithi003.stdout: "user": "foobar.client.0", 2023-12-03T11:57:54.784 INFO:teuthology.orchestra.run.smithi003.stdout: "access_key": "LFNWUUYUSDDBQKEUHGYB", 2023-12-03T11:57:54.784 INFO:teuthology.orchestra.run.smithi003.stdout: "secret_key": "f7QFwqVAzZML4BoBnRp9J2seaswG4cs0ARsL52r57L8rdqY8/EO/pw==" 2023-12-03T11:57:54.784 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-12-03T11:57:54.784 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2023-12-03T11:57:54.784 INFO:teuthology.orchestra.run.smithi003.stdout: "swift_keys": [], 2023-12-03T11:57:54.784 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": [ 2023-12-03T11:57:54.784 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-12-03T11:57:54.785 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "user-policy", 2023-12-03T11:57:54.785 INFO:teuthology.orchestra.run.smithi003.stdout: "perm": "*" 2023-12-03T11:57:54.785 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-12-03T11:57:54.785 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2023-12-03T11:57:54.785 INFO:teuthology.orchestra.run.smithi003.stdout: "op_mask": "read, write, delete", 2023-12-03T11:57:54.785 INFO:teuthology.orchestra.run.smithi003.stdout: "default_placement": "", 2023-12-03T11:57:54.785 INFO:teuthology.orchestra.run.smithi003.stdout: "default_storage_class": "", 2023-12-03T11:57:54.785 INFO:teuthology.orchestra.run.smithi003.stdout: "placement_tags": [], 2023-12-03T11:57:54.785 INFO:teuthology.orchestra.run.smithi003.stdout: "bucket_quota": { 2023-12-03T11:57:54.785 INFO:teuthology.orchestra.run.smithi003.stdout: "enabled": false, 2023-12-03T11:57:54.785 INFO:teuthology.orchestra.run.smithi003.stdout: "check_on_raw": false, 2023-12-03T11:57:54.785 INFO:teuthology.orchestra.run.smithi003.stdout: "max_size": -1, 2023-12-03T11:57:54.786 INFO:teuthology.orchestra.run.smithi003.stdout: "max_size_kb": 0, 2023-12-03T11:57:54.786 INFO:teuthology.orchestra.run.smithi003.stdout: "max_objects": -1 2023-12-03T11:57:54.786 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-12-03T11:57:54.786 INFO:teuthology.orchestra.run.smithi003.stdout: "user_quota": { 2023-12-03T11:57:54.786 INFO:teuthology.orchestra.run.smithi003.stdout: "enabled": false, 2023-12-03T11:57:54.786 INFO:teuthology.orchestra.run.smithi003.stdout: "check_on_raw": false, 2023-12-03T11:57:54.786 INFO:teuthology.orchestra.run.smithi003.stdout: "max_size": -1, 2023-12-03T11:57:54.786 INFO:teuthology.orchestra.run.smithi003.stdout: "max_size_kb": 0, 2023-12-03T11:57:54.786 INFO:teuthology.orchestra.run.smithi003.stdout: "max_objects": -1 2023-12-03T11:57:54.786 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-12-03T11:57:54.786 INFO:teuthology.orchestra.run.smithi003.stdout: "temp_url_keys": [], 2023-12-03T11:57:54.786 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "rgw", 2023-12-03T11:57:54.786 INFO:teuthology.orchestra.run.smithi003.stdout: "mfa_ids": [] 2023-12-03T11:57:54.787 INFO:teuthology.orchestra.run.smithi003.stdout:} 2023-12-03T11:57:54.787 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:57:54.787 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.783+0000 7fbcf67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:57:54.787 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.785+0000 7fbd34926800 20 remove_watcher() i=0 2023-12-03T11:57:54.788 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.785+0000 7fbd34926800 2 removed watcher, disabling cache 2023-12-03T11:57:54.788 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.786+0000 7fbd34926800 20 remove_watcher() i=1 2023-12-03T11:57:54.788 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.787+0000 7fbd34926800 20 remove_watcher() i=2 2023-12-03T11:57:54.789 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.788+0000 7fbd34926800 20 remove_watcher() i=3 2023-12-03T11:57:54.790 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.789+0000 7fbd34926800 20 remove_watcher() i=4 2023-12-03T11:57:54.791 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.790+0000 7fbd34926800 20 remove_watcher() i=5 2023-12-03T11:57:54.792 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.791+0000 7fbd34926800 20 remove_watcher() i=6 2023-12-03T11:57:54.793 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.792+0000 7fbd34926800 20 remove_watcher() i=7 2023-12-03T11:57:54.798 DEBUG:teuthology.orchestra.run.smithi003:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid foobar.client.0 --totp-serial 8747777528 --totp-seed V5IDTU3KWLWILJFJKTTVKWDA3B65UNLYUY3GDSZW7CPV7MG7JXM43G2HSS7NLIG5 --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2023-12-03T11:57:54.863 INFO:teuthology.orchestra.run.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:57:54.863 INFO:teuthology.orchestra.run.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:57:54.874 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.873+0000 7f8053c2d800 20 rados->read ofs=0 len=0 2023-12-03T11:57:54.876 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.874+0000 7f8053c2d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:57:54.876 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.874+0000 7f8053c2d800 20 realm 2023-12-03T11:57:54.876 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.874+0000 7f8053c2d800 20 rados->read ofs=0 len=0 2023-12-03T11:57:54.876 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.875+0000 7f8053c2d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:57:54.876 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.875+0000 7f8053c2d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:57:54.876 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.875+0000 7f8053c2d800 20 rados->read ofs=0 len=0 2023-12-03T11:57:54.876 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.875+0000 7f8053c2d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:57:54.877 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.875+0000 7f8053c2d800 20 rados->read ofs=0 len=0 2023-12-03T11:57:54.877 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.875+0000 7f8053c2d800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:57:54.877 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.876+0000 7f8053c2d800 20 rados->read ofs=0 len=0 2023-12-03T11:57:54.877 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.876+0000 7f8053c2d800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:57:54.878 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.876+0000 7f8053c2d800 20 searching for the correct realm 2023-12-03T11:57:54.887 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.885+0000 7f804e62d640 0 -- 172.21.15.3:0/3488273896 >> [v2:172.21.15.3:6817/3356208405,v1:172.21.15.3:6819/3356208405] conn(0x559b15f2e970 msgr2=0x559b15f30d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:57:54.888 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.887+0000 7f8053c2d800 20 RGWRados::pool_iterate: got zone_info.83aabb46-04b5-4c96-9933-c6bfb1173a73 2023-12-03T11:57:54.889 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.887+0000 7f8053c2d800 20 RGWRados::pool_iterate: got zonegroup_info.6a811aad-435d-4fdd-93c9-b7e0b50de429 2023-12-03T11:57:54.889 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.887+0000 7f8053c2d800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:57:54.889 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.887+0000 7f8053c2d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:57:54.889 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.887+0000 7f8053c2d800 20 rados->read ofs=0 len=0 2023-12-03T11:57:54.889 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.887+0000 7f8053c2d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:57:54.889 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.887+0000 7f8053c2d800 20 rados->read ofs=0 len=0 2023-12-03T11:57:54.890 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.888+0000 7f8053c2d800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:57:54.890 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.888+0000 7f8053c2d800 20 rados->read ofs=0 len=0 2023-12-03T11:57:54.891 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.888+0000 7f8053c2d800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:57:54.891 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.888+0000 7f8053c2d800 20 zone default found 2023-12-03T11:57:54.891 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.888+0000 7f8053c2d800 4 Realm: () 2023-12-03T11:57:54.891 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.888+0000 7f8053c2d800 4 ZoneGroup: default (6a811aad-435d-4fdd-93c9-b7e0b50de429) 2023-12-03T11:57:54.891 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.888+0000 7f8053c2d800 4 Zone: default (83aabb46-04b5-4c96-9933-c6bfb1173a73) 2023-12-03T11:57:54.891 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.888+0000 7f8053c2d800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:57:54.891 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.888+0000 7f8053c2d800 20 zonegroup default 2023-12-03T11:57:54.891 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.888+0000 7f8053c2d800 20 rados->read ofs=0 len=0 2023-12-03T11:57:54.891 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.888+0000 7f8053c2d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:57:54.891 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.888+0000 7f8053c2d800 20 rados->read ofs=0 len=0 2023-12-03T11:57:54.891 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.889+0000 7f8053c2d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:57:54.891 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.889+0000 7f8053c2d800 20 rados->read ofs=0 len=0 2023-12-03T11:57:54.891 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.889+0000 7f8053c2d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:57:54.892 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.889+0000 7f8053c2d800 20 started sync module instance, tier type = 2023-12-03T11:57:54.892 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.889+0000 7f8053c2d800 20 started zone id=83aabb46-04b5-4c96-9933-c6bfb1173a73 (name=default) with tier type = 2023-12-03T11:57:54.895 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.894+0000 7f804ee2e640 0 -- 172.21.15.3:0/3488273896 >> [v2:172.21.15.3:6800/2373485412,v1:172.21.15.3:6801/2373485412] conn(0x7f804801a040 msgr2=0x7f804805d8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:57:54.900 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.898+0000 7f8053c2d800 20 add_watcher() i=0 2023-12-03T11:57:54.900 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.898+0000 7f8053c2d800 20 add_watcher() i=1 2023-12-03T11:57:54.900 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.898+0000 7f8053c2d800 20 add_watcher() i=2 2023-12-03T11:57:54.900 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.898+0000 7f8053c2d800 20 add_watcher() i=3 2023-12-03T11:57:54.900 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.898+0000 7f8053c2d800 20 add_watcher() i=4 2023-12-03T11:57:54.900 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.898+0000 7f8053c2d800 20 add_watcher() i=5 2023-12-03T11:57:54.900 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.898+0000 7f8053c2d800 20 add_watcher() i=6 2023-12-03T11:57:54.900 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.899+0000 7f8053c2d800 20 add_watcher() i=7 2023-12-03T11:57:54.901 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.899+0000 7f8053c2d800 2 all 8 watchers are set, enabling cache 2023-12-03T11:57:54.902 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.901+0000 7f7f8ffff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:57:54.902 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.901+0000 7f8053c2d800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:57:54.902 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.901+0000 7f8053c2d800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:57:54.907 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.906+0000 7f8053c2d800 5 note: GC not initialized 2023-12-03T11:57:54.907 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.906+0000 7f7f7effd640 20 reqs_thread_entry: start 2023-12-03T11:57:54.907 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.906+0000 7f8053c2d800 20 init_complete bucket index max shards: 11 2023-12-03T11:57:54.907 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.906+0000 7f8053c2d800 20 Filter name: none 2023-12-03T11:57:54.908 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.906+0000 7f7f7cff9640 20 reqs_thread_entry: start 2023-12-03T11:57:54.908 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.906+0000 7f8053c2d800 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2023-12-03T11:57:54.908 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.906+0000 7f8053c2d800 20 rados->read ofs=0 len=0 2023-12-03T11:57:54.908 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.907+0000 7f8053c2d800 20 rados_obj.operate() r=0 bl.length=467 2023-12-03T11:57:54.908 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.907+0000 7f8053c2d800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x13 2023-12-03T11:57:54.908 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.907+0000 7f8053c2d800 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2023-12-03T11:57:54.908 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.907+0000 7f8053c2d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:57:54.911 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.909+0000 7f8053c2d800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2023-12-03T11:57:54.911 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.909+0000 7f8053c2d800 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2023-12-03T11:57:54.911 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.909+0000 7f8053c2d800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2023-12-03T11:57:54.911 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.910+0000 7f80457fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562459 cookie 94124576568608 notifier 8187 bl.length()=669 2023-12-03T11:57:54.911 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.910+0000 7f80457fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2023-12-03T11:57:54.911 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.910+0000 7f80457fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2023-12-03T11:57:54.913 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.912+0000 7f7f8ffff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:57:54.916 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.914+0000 7f8053c2d800 20 remove_watcher() i=0 2023-12-03T11:57:54.916 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.914+0000 7f8053c2d800 2 removed watcher, disabling cache 2023-12-03T11:57:54.917 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.915+0000 7f8053c2d800 20 remove_watcher() i=1 2023-12-03T11:57:54.918 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.916+0000 7f8053c2d800 20 remove_watcher() i=2 2023-12-03T11:57:54.919 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.918+0000 7f8053c2d800 20 remove_watcher() i=3 2023-12-03T11:57:54.920 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.919+0000 7f8053c2d800 20 remove_watcher() i=4 2023-12-03T11:57:54.921 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.920+0000 7f8053c2d800 20 remove_watcher() i=5 2023-12-03T11:57:54.922 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.921+0000 7f8053c2d800 20 remove_watcher() i=6 2023-12-03T11:57:54.923 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.922+0000 7f8053c2d800 20 remove_watcher() i=7 2023-12-03T11:57:54.928 DEBUG:teuthology.orchestra.run.smithi003:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 caps add --uid foobar.client.0 --caps 'roles=*' --cluster ceph 2023-12-03T11:57:54.984 INFO:teuthology.orchestra.run.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:57:54.984 INFO:teuthology.orchestra.run.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:57:54.995 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.994+0000 7f75ee72b800 20 rados->read ofs=0 len=0 2023-12-03T11:57:54.997 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.996+0000 7f75ee72b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:57:54.997 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.996+0000 7f75ee72b800 20 realm 2023-12-03T11:57:54.997 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.996+0000 7f75ee72b800 20 rados->read ofs=0 len=0 2023-12-03T11:57:54.997 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.996+0000 7f75ee72b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:57:54.997 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.996+0000 7f75ee72b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:57:54.998 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.996+0000 7f75ee72b800 20 rados->read ofs=0 len=0 2023-12-03T11:57:54.998 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.996+0000 7f75ee72b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:57:54.998 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.996+0000 7f75ee72b800 20 rados->read ofs=0 len=0 2023-12-03T11:57:54.998 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.997+0000 7f75ee72b800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:57:54.998 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.997+0000 7f75ee72b800 20 rados->read ofs=0 len=0 2023-12-03T11:57:54.998 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.997+0000 7f75ee72b800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:57:54.999 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:54.997+0000 7f75ee72b800 20 searching for the correct realm 2023-12-03T11:57:55.009 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.007+0000 7f75e9c31640 0 -- 172.21.15.3:0/1149492512 >> [v2:172.21.15.3:6817/3356208405,v1:172.21.15.3:6819/3356208405] conn(0x5612982ea8d0 msgr2=0x5612982eccc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:57:55.009 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.008+0000 7f75ee72b800 20 RGWRados::pool_iterate: got zone_info.83aabb46-04b5-4c96-9933-c6bfb1173a73 2023-12-03T11:57:55.009 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.008+0000 7f75ee72b800 20 RGWRados::pool_iterate: got zonegroup_info.6a811aad-435d-4fdd-93c9-b7e0b50de429 2023-12-03T11:57:55.009 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.008+0000 7f75ee72b800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:57:55.010 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.008+0000 7f75ee72b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:57:55.010 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.008+0000 7f75ee72b800 20 rados->read ofs=0 len=0 2023-12-03T11:57:55.010 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.008+0000 7f75ee72b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:57:55.010 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.008+0000 7f75ee72b800 20 rados->read ofs=0 len=0 2023-12-03T11:57:55.011 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.008+0000 7f75ee72b800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:57:55.011 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.008+0000 7f75ee72b800 20 rados->read ofs=0 len=0 2023-12-03T11:57:55.011 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.009+0000 7f75ee72b800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:57:55.011 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.009+0000 7f75ee72b800 20 zone default found 2023-12-03T11:57:55.011 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.009+0000 7f75ee72b800 4 Realm: () 2023-12-03T11:57:55.011 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.009+0000 7f75ee72b800 4 ZoneGroup: default (6a811aad-435d-4fdd-93c9-b7e0b50de429) 2023-12-03T11:57:55.012 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.009+0000 7f75ee72b800 4 Zone: default (83aabb46-04b5-4c96-9933-c6bfb1173a73) 2023-12-03T11:57:55.012 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.009+0000 7f75ee72b800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:57:55.012 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.009+0000 7f75ee72b800 20 zonegroup default 2023-12-03T11:57:55.012 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.009+0000 7f75ee72b800 20 rados->read ofs=0 len=0 2023-12-03T11:57:55.012 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.009+0000 7f75ee72b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:57:55.012 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.009+0000 7f75ee72b800 20 rados->read ofs=0 len=0 2023-12-03T11:57:55.012 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.009+0000 7f75ee72b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:57:55.012 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.009+0000 7f75ee72b800 20 rados->read ofs=0 len=0 2023-12-03T11:57:55.012 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.009+0000 7f75ee72b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:57:55.012 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.010+0000 7f75ee72b800 20 started sync module instance, tier type = 2023-12-03T11:57:55.012 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.010+0000 7f75ee72b800 20 started zone id=83aabb46-04b5-4c96-9933-c6bfb1173a73 (name=default) with tier type = 2023-12-03T11:57:55.018 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.017+0000 7f75e9c31640 0 -- 172.21.15.3:0/1149492512 >> [v2:172.21.15.3:6817/3356208405,v1:172.21.15.3:6819/3356208405] conn(0x7f75c407ab70 msgr2=0x7f75c407cfa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:57:55.020 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.018+0000 7f75ee72b800 20 add_watcher() i=0 2023-12-03T11:57:55.020 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.018+0000 7f75ee72b800 20 add_watcher() i=1 2023-12-03T11:57:55.020 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.018+0000 7f75ee72b800 20 add_watcher() i=2 2023-12-03T11:57:55.020 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.018+0000 7f75ee72b800 20 add_watcher() i=3 2023-12-03T11:57:55.020 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.018+0000 7f75ee72b800 20 add_watcher() i=4 2023-12-03T11:57:55.021 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.019+0000 7f75ee72b800 20 add_watcher() i=5 2023-12-03T11:57:55.021 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.019+0000 7f75ee72b800 20 add_watcher() i=6 2023-12-03T11:57:55.021 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.019+0000 7f75ee72b800 20 add_watcher() i=7 2023-12-03T11:57:55.021 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.019+0000 7f75ee72b800 2 all 8 watchers are set, enabling cache 2023-12-03T11:57:55.022 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.021+0000 7f75affe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:57:55.022 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.021+0000 7f75ee72b800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:57:55.022 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.021+0000 7f75ee72b800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:57:55.028 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.026+0000 7f75ee72b800 5 note: GC not initialized 2023-12-03T11:57:55.028 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.026+0000 7f751effd640 20 reqs_thread_entry: start 2023-12-03T11:57:55.028 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.026+0000 7f75ee72b800 20 init_complete bucket index max shards: 11 2023-12-03T11:57:55.028 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.026+0000 7f75ee72b800 20 Filter name: none 2023-12-03T11:57:55.028 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.026+0000 7f751cff9640 20 reqs_thread_entry: start 2023-12-03T11:57:55.028 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.026+0000 7f75ee72b800 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2023-12-03T11:57:55.028 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.026+0000 7f75ee72b800 20 rados->read ofs=0 len=0 2023-12-03T11:57:55.029 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.027+0000 7f75ee72b800 20 rados_obj.operate() r=0 bl.length=481 2023-12-03T11:57:55.029 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.027+0000 7f75ee72b800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x13 2023-12-03T11:57:55.029 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.027+0000 7f75ee72b800 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2023-12-03T11:57:55.029 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.027+0000 7f75ee72b800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:57:55.030 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.029+0000 7f75ee72b800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2023-12-03T11:57:55.030 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.029+0000 7f75ee72b800 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2023-12-03T11:57:55.030 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.029+0000 7f75ee72b800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2023-12-03T11:57:55.031 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.030+0000 7f75d8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562460 cookie 94637862624144 notifier 8208 bl.length()=682 2023-12-03T11:57:55.031 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.030+0000 7f75d8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2023-12-03T11:57:55.031 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.030+0000 7f75d8ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2023-12-03T11:57:55.032 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2023-12-03T11:57:55.033 INFO:teuthology.orchestra.run.smithi003.stdout: "user_id": "foobar.client.0", 2023-12-03T11:57:55.033 INFO:teuthology.orchestra.run.smithi003.stdout: "display_name": "Mr. foobar.client.0", 2023-12-03T11:57:55.033 INFO:teuthology.orchestra.run.smithi003.stdout: "email": "foobar.client.0+test@test.test", 2023-12-03T11:57:55.033 INFO:teuthology.orchestra.run.smithi003.stdout: "suspended": 0, 2023-12-03T11:57:55.033 INFO:teuthology.orchestra.run.smithi003.stdout: "max_buckets": 1000, 2023-12-03T11:57:55.033 INFO:teuthology.orchestra.run.smithi003.stdout: "subusers": [], 2023-12-03T11:57:55.033 INFO:teuthology.orchestra.run.smithi003.stdout: "keys": [ 2023-12-03T11:57:55.033 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-12-03T11:57:55.033 INFO:teuthology.orchestra.run.smithi003.stdout: "user": "foobar.client.0", 2023-12-03T11:57:55.033 INFO:teuthology.orchestra.run.smithi003.stdout: "access_key": "LFNWUUYUSDDBQKEUHGYB", 2023-12-03T11:57:55.033 INFO:teuthology.orchestra.run.smithi003.stdout: "secret_key": "f7QFwqVAzZML4BoBnRp9J2seaswG4cs0ARsL52r57L8rdqY8/EO/pw==" 2023-12-03T11:57:55.033 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-12-03T11:57:55.033 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2023-12-03T11:57:55.034 INFO:teuthology.orchestra.run.smithi003.stdout: "swift_keys": [], 2023-12-03T11:57:55.034 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": [ 2023-12-03T11:57:55.034 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-12-03T11:57:55.034 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "roles", 2023-12-03T11:57:55.034 INFO:teuthology.orchestra.run.smithi003.stdout: "perm": "*" 2023-12-03T11:57:55.034 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-12-03T11:57:55.034 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-12-03T11:57:55.034 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "user-policy", 2023-12-03T11:57:55.034 INFO:teuthology.orchestra.run.smithi003.stdout: "perm": "*" 2023-12-03T11:57:55.034 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-12-03T11:57:55.034 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2023-12-03T11:57:55.034 INFO:teuthology.orchestra.run.smithi003.stdout: "op_mask": "read, write, delete", 2023-12-03T11:57:55.034 INFO:teuthology.orchestra.run.smithi003.stdout: "default_placement": "", 2023-12-03T11:57:55.034 INFO:teuthology.orchestra.run.smithi003.stdout: "default_storage_class": "", 2023-12-03T11:57:55.035 INFO:teuthology.orchestra.run.smithi003.stdout: "placement_tags": [], 2023-12-03T11:57:55.035 INFO:teuthology.orchestra.run.smithi003.stdout: "bucket_quota": { 2023-12-03T11:57:55.035 INFO:teuthology.orchestra.run.smithi003.stdout: "enabled": false, 2023-12-03T11:57:55.035 INFO:teuthology.orchestra.run.smithi003.stdout: "check_on_raw": false, 2023-12-03T11:57:55.035 INFO:teuthology.orchestra.run.smithi003.stdout: "max_size": -1, 2023-12-03T11:57:55.035 INFO:teuthology.orchestra.run.smithi003.stdout: "max_size_kb": 0, 2023-12-03T11:57:55.035 INFO:teuthology.orchestra.run.smithi003.stdout: "max_objects": -1 2023-12-03T11:57:55.035 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-12-03T11:57:55.035 INFO:teuthology.orchestra.run.smithi003.stdout: "user_quota": { 2023-12-03T11:57:55.035 INFO:teuthology.orchestra.run.smithi003.stdout: "enabled": false, 2023-12-03T11:57:55.035 INFO:teuthology.orchestra.run.smithi003.stdout: "check_on_raw": false, 2023-12-03T11:57:55.035 INFO:teuthology.orchestra.run.smithi003.stdout: "max_size": -1, 2023-12-03T11:57:55.035 INFO:teuthology.orchestra.run.smithi003.stdout: "max_size_kb": 0, 2023-12-03T11:57:55.036 INFO:teuthology.orchestra.run.smithi003.stdout: "max_objects": -1 2023-12-03T11:57:55.036 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-12-03T11:57:55.036 INFO:teuthology.orchestra.run.smithi003.stdout: "temp_url_keys": [], 2023-12-03T11:57:55.036 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "rgw", 2023-12-03T11:57:55.036 INFO:teuthology.orchestra.run.smithi003.stdout: "mfa_ids": [ 2023-12-03T11:57:55.036 INFO:teuthology.orchestra.run.smithi003.stdout: "8747777528" 2023-12-03T11:57:55.036 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2023-12-03T11:57:55.036 INFO:teuthology.orchestra.run.smithi003.stdout:} 2023-12-03T11:57:55.036 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:57:55.037 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.032+0000 7f75affe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:57:55.037 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.034+0000 7f75ee72b800 20 remove_watcher() i=0 2023-12-03T11:57:55.037 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.034+0000 7f75ee72b800 2 removed watcher, disabling cache 2023-12-03T11:57:55.037 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.035+0000 7f75ee72b800 20 remove_watcher() i=1 2023-12-03T11:57:55.038 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.036+0000 7f75ee72b800 20 remove_watcher() i=2 2023-12-03T11:57:55.039 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.037+0000 7f75ee72b800 20 remove_watcher() i=3 2023-12-03T11:57:55.040 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.038+0000 7f75ee72b800 20 remove_watcher() i=4 2023-12-03T11:57:55.041 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.039+0000 7f75ee72b800 20 remove_watcher() i=5 2023-12-03T11:57:55.042 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.041+0000 7f75ee72b800 20 remove_watcher() i=6 2023-12-03T11:57:55.043 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.042+0000 7f75ee72b800 20 remove_watcher() i=7 2023-12-03T11:57:55.048 DEBUG:teuthology.orchestra.run.smithi003:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 caps add --uid foobar.client.0 --caps 'oidc-provider=*' --cluster ceph 2023-12-03T11:57:55.103 INFO:teuthology.orchestra.run.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:57:55.104 INFO:teuthology.orchestra.run.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:57:55.115 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.114+0000 7f584433b800 20 rados->read ofs=0 len=0 2023-12-03T11:57:55.118 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.116+0000 7f584433b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:57:55.118 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.116+0000 7f584433b800 20 realm 2023-12-03T11:57:55.118 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.116+0000 7f584433b800 20 rados->read ofs=0 len=0 2023-12-03T11:57:55.118 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.117+0000 7f584433b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:57:55.118 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.117+0000 7f584433b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:57:55.118 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.117+0000 7f584433b800 20 rados->read ofs=0 len=0 2023-12-03T11:57:55.118 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.117+0000 7f584433b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:57:55.119 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.117+0000 7f584433b800 20 rados->read ofs=0 len=0 2023-12-03T11:57:55.119 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.118+0000 7f584433b800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:57:55.119 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.118+0000 7f584433b800 20 rados->read ofs=0 len=0 2023-12-03T11:57:55.120 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.118+0000 7f584433b800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:57:55.120 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.118+0000 7f584433b800 20 searching for the correct realm 2023-12-03T11:57:55.127 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.126+0000 7f5840040640 0 -- 172.21.15.3:0/506105641 >> [v2:172.21.15.37:6805/1692844418,v1:172.21.15.37:6807/1692844418] conn(0x55959548e660 msgr2=0x559595490a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:57:55.131 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.129+0000 7f584433b800 20 RGWRados::pool_iterate: got zone_info.83aabb46-04b5-4c96-9933-c6bfb1173a73 2023-12-03T11:57:55.131 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.129+0000 7f584433b800 20 RGWRados::pool_iterate: got zonegroup_info.6a811aad-435d-4fdd-93c9-b7e0b50de429 2023-12-03T11:57:55.131 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.129+0000 7f584433b800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:57:55.131 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.129+0000 7f584433b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:57:55.131 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.129+0000 7f584433b800 20 rados->read ofs=0 len=0 2023-12-03T11:57:55.132 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.129+0000 7f584433b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:57:55.132 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.129+0000 7f584433b800 20 rados->read ofs=0 len=0 2023-12-03T11:57:55.132 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.129+0000 7f584433b800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:57:55.132 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.129+0000 7f584433b800 20 rados->read ofs=0 len=0 2023-12-03T11:57:55.132 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.130+0000 7f5840040640 0 -- 172.21.15.3:0/506105641 >> [v2:172.21.15.37:6805/1692844418,v1:172.21.15.37:6807/1692844418] conn(0x7f581c082ab0 msgr2=0x7f581c084ea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:57:55.132 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.130+0000 7f584433b800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:57:55.132 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.130+0000 7f584433b800 20 zone default found 2023-12-03T11:57:55.132 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.130+0000 7f584433b800 4 Realm: () 2023-12-03T11:57:55.132 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.130+0000 7f584433b800 4 ZoneGroup: default (6a811aad-435d-4fdd-93c9-b7e0b50de429) 2023-12-03T11:57:55.132 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.130+0000 7f584433b800 4 Zone: default (83aabb46-04b5-4c96-9933-c6bfb1173a73) 2023-12-03T11:57:55.132 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.130+0000 7f584433b800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:57:55.132 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.130+0000 7f584433b800 20 zonegroup default 2023-12-03T11:57:55.132 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.130+0000 7f584433b800 20 rados->read ofs=0 len=0 2023-12-03T11:57:55.132 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.130+0000 7f584433b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:57:55.133 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.130+0000 7f584433b800 20 rados->read ofs=0 len=0 2023-12-03T11:57:55.133 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.130+0000 7f584433b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:57:55.133 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.130+0000 7f584433b800 20 rados->read ofs=0 len=0 2023-12-03T11:57:55.133 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.130+0000 7f584433b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:57:55.133 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.130+0000 7f584433b800 20 started sync module instance, tier type = 2023-12-03T11:57:55.133 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.130+0000 7f584433b800 20 started zone id=83aabb46-04b5-4c96-9933-c6bfb1173a73 (name=default) with tier type = 2023-12-03T11:57:55.140 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.139+0000 7f584433b800 20 add_watcher() i=0 2023-12-03T11:57:55.141 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.139+0000 7f584433b800 20 add_watcher() i=1 2023-12-03T11:57:55.141 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.139+0000 7f584433b800 20 add_watcher() i=2 2023-12-03T11:57:55.141 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.139+0000 7f584433b800 20 add_watcher() i=3 2023-12-03T11:57:55.141 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.139+0000 7f584433b800 20 add_watcher() i=4 2023-12-03T11:57:55.141 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.139+0000 7f584433b800 20 add_watcher() i=5 2023-12-03T11:57:55.141 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.139+0000 7f584433b800 20 add_watcher() i=6 2023-12-03T11:57:55.151 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.150+0000 7f584433b800 20 add_watcher() i=7 2023-12-03T11:57:55.151 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.150+0000 7f584433b800 2 all 8 watchers are set, enabling cache 2023-12-03T11:57:55.153 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.152+0000 7f58067e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:57:55.153 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.152+0000 7f584433b800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:57:55.153 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.152+0000 7f584433b800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:57:55.160 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.157+0000 7f584433b800 5 note: GC not initialized 2023-12-03T11:57:55.160 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.157+0000 7f57757fa640 20 reqs_thread_entry: start 2023-12-03T11:57:55.160 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.157+0000 7f584433b800 20 init_complete bucket index max shards: 11 2023-12-03T11:57:55.160 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.157+0000 7f584433b800 20 Filter name: none 2023-12-03T11:57:55.160 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.158+0000 7f576effd640 20 reqs_thread_entry: start 2023-12-03T11:57:55.160 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.158+0000 7f584433b800 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2023-12-03T11:57:55.160 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.158+0000 7f584433b800 20 rados->read ofs=0 len=0 2023-12-03T11:57:55.160 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.158+0000 7f584433b800 20 rados_obj.operate() r=0 bl.length=494 2023-12-03T11:57:55.160 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.158+0000 7f584433b800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x13 2023-12-03T11:57:55.160 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.158+0000 7f584433b800 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2023-12-03T11:57:55.160 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.158+0000 7f584433b800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:57:55.161 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.159+0000 7f584433b800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2023-12-03T11:57:55.161 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.159+0000 7f584433b800 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2023-12-03T11:57:55.161 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.159+0000 7f584433b800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2023-12-03T11:57:55.161 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.160+0000 7f58267fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562461 cookie 94100943125264 notifier 7721 bl.length()=703 2023-12-03T11:57:55.161 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.160+0000 7f58267fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2023-12-03T11:57:55.161 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.160+0000 7f58267fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2023-12-03T11:57:55.162 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2023-12-03T11:57:55.163 INFO:teuthology.orchestra.run.smithi003.stdout: "user_id": "foobar.client.0", 2023-12-03T11:57:55.163 INFO:teuthology.orchestra.run.smithi003.stdout: "display_name": "Mr. foobar.client.0", 2023-12-03T11:57:55.163 INFO:teuthology.orchestra.run.smithi003.stdout: "email": "foobar.client.0+test@test.test", 2023-12-03T11:57:55.163 INFO:teuthology.orchestra.run.smithi003.stdout: "suspended": 0, 2023-12-03T11:57:55.163 INFO:teuthology.orchestra.run.smithi003.stdout: "max_buckets": 1000, 2023-12-03T11:57:55.163 INFO:teuthology.orchestra.run.smithi003.stdout: "subusers": [], 2023-12-03T11:57:55.163 INFO:teuthology.orchestra.run.smithi003.stdout: "keys": [ 2023-12-03T11:57:55.163 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-12-03T11:57:55.163 INFO:teuthology.orchestra.run.smithi003.stdout: "user": "foobar.client.0", 2023-12-03T11:57:55.163 INFO:teuthology.orchestra.run.smithi003.stdout: "access_key": "LFNWUUYUSDDBQKEUHGYB", 2023-12-03T11:57:55.163 INFO:teuthology.orchestra.run.smithi003.stdout: "secret_key": "f7QFwqVAzZML4BoBnRp9J2seaswG4cs0ARsL52r57L8rdqY8/EO/pw==" 2023-12-03T11:57:55.163 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-12-03T11:57:55.163 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2023-12-03T11:57:55.163 INFO:teuthology.orchestra.run.smithi003.stdout: "swift_keys": [], 2023-12-03T11:57:55.163 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": [ 2023-12-03T11:57:55.164 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-12-03T11:57:55.164 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "oidc-provider", 2023-12-03T11:57:55.164 INFO:teuthology.orchestra.run.smithi003.stdout: "perm": "*" 2023-12-03T11:57:55.164 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-12-03T11:57:55.164 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-12-03T11:57:55.164 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "roles", 2023-12-03T11:57:55.164 INFO:teuthology.orchestra.run.smithi003.stdout: "perm": "*" 2023-12-03T11:57:55.164 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-12-03T11:57:55.164 INFO:teuthology.orchestra.run.smithi003.stdout: { 2023-12-03T11:57:55.164 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "user-policy", 2023-12-03T11:57:55.164 INFO:teuthology.orchestra.run.smithi003.stdout: "perm": "*" 2023-12-03T11:57:55.164 INFO:teuthology.orchestra.run.smithi003.stdout: } 2023-12-03T11:57:55.164 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2023-12-03T11:57:55.164 INFO:teuthology.orchestra.run.smithi003.stdout: "op_mask": "read, write, delete", 2023-12-03T11:57:55.164 INFO:teuthology.orchestra.run.smithi003.stdout: "default_placement": "", 2023-12-03T11:57:55.165 INFO:teuthology.orchestra.run.smithi003.stdout: "default_storage_class": "", 2023-12-03T11:57:55.165 INFO:teuthology.orchestra.run.smithi003.stdout: "placement_tags": [], 2023-12-03T11:57:55.165 INFO:teuthology.orchestra.run.smithi003.stdout: "bucket_quota": { 2023-12-03T11:57:55.165 INFO:teuthology.orchestra.run.smithi003.stdout: "enabled": false, 2023-12-03T11:57:55.165 INFO:teuthology.orchestra.run.smithi003.stdout: "check_on_raw": false, 2023-12-03T11:57:55.165 INFO:teuthology.orchestra.run.smithi003.stdout: "max_size": -1, 2023-12-03T11:57:55.165 INFO:teuthology.orchestra.run.smithi003.stdout: "max_size_kb": 0, 2023-12-03T11:57:55.165 INFO:teuthology.orchestra.run.smithi003.stdout: "max_objects": -1 2023-12-03T11:57:55.165 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-12-03T11:57:55.165 INFO:teuthology.orchestra.run.smithi003.stdout: "user_quota": { 2023-12-03T11:57:55.165 INFO:teuthology.orchestra.run.smithi003.stdout: "enabled": false, 2023-12-03T11:57:55.165 INFO:teuthology.orchestra.run.smithi003.stdout: "check_on_raw": false, 2023-12-03T11:57:55.165 INFO:teuthology.orchestra.run.smithi003.stdout: "max_size": -1, 2023-12-03T11:57:55.165 INFO:teuthology.orchestra.run.smithi003.stdout: "max_size_kb": 0, 2023-12-03T11:57:55.165 INFO:teuthology.orchestra.run.smithi003.stdout: "max_objects": -1 2023-12-03T11:57:55.165 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2023-12-03T11:57:55.166 INFO:teuthology.orchestra.run.smithi003.stdout: "temp_url_keys": [], 2023-12-03T11:57:55.166 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "rgw", 2023-12-03T11:57:55.166 INFO:teuthology.orchestra.run.smithi003.stdout: "mfa_ids": [ 2023-12-03T11:57:55.166 INFO:teuthology.orchestra.run.smithi003.stdout: "8747777528" 2023-12-03T11:57:55.166 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2023-12-03T11:57:55.166 INFO:teuthology.orchestra.run.smithi003.stdout:} 2023-12-03T11:57:55.166 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:57:55.166 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.162+0000 7f58067e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:57:55.167 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.165+0000 7f584433b800 20 remove_watcher() i=0 2023-12-03T11:57:55.167 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.165+0000 7f584433b800 2 removed watcher, disabling cache 2023-12-03T11:57:55.167 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.166+0000 7f584433b800 20 remove_watcher() i=1 2023-12-03T11:57:55.168 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.167+0000 7f584433b800 20 remove_watcher() i=2 2023-12-03T11:57:55.169 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.168+0000 7f584433b800 20 remove_watcher() i=3 2023-12-03T11:57:55.170 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.169+0000 7f584433b800 20 remove_watcher() i=4 2023-12-03T11:57:55.171 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.170+0000 7f584433b800 20 remove_watcher() i=5 2023-12-03T11:57:55.172 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.171+0000 7f584433b800 20 remove_watcher() i=6 2023-12-03T11:57:55.173 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T11:57:55.171+0000 7f584433b800 20 remove_watcher() i=7 2023-12-03T11:57:55.178 INFO:tasks.s3tests:Configuring s3-tests... 2023-12-03T11:57:55.178 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-12-03T11:57:55.179 DEBUG:teuthology.orchestra.run.smithi003:> dd of=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf 2023-12-03T11:57:55.206 INFO:tasks.s3tests:Configuring boto... 2023-12-03T11:57:55.206 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2023-12-03T11:57:55.206 DEBUG:teuthology.orchestra.run.smithi003:> dd of=/home/ubuntu/cephtest/boto-client.0.cfg 2023-12-03T11:57:55.275 DEBUG:teuthology.orchestra.run.smithi003:s3 tests against rgw> source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt tox -- -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3' 2023-12-03T11:57:55.447 INFO:teuthology.orchestra.run.smithi003.stdout:GLOB sdist-make: /home/ubuntu/cephtest/s3-tests-client.0/setup.py 2023-12-03T11:57:55.633 INFO:teuthology.orchestra.run.smithi003.stdout:py create: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py 2023-12-03T11:57:55.902 INFO:teuthology.orchestra.run.smithi003.stdout:py installdeps: -rrequirements.txt 2023-12-03T11:59:18.665 INFO:teuthology.orchestra.run.smithi003.stdout:py inst: /home/ubuntu/cephtest/s3-tests-client.0/.tox/.tmp/package/1/s3tests-0.0.1.zip 2023-12-03T11:59:20.388 INFO:teuthology.orchestra.run.smithi003.stdout:py installed: boto==2.49.0,boto3==1.24.96,botocore==1.27.96,cachetools==5.3.2,certifi==2023.11.17,chardet==5.2.0,charset-normalizer==3.3.2,colorama==0.4.6,distlib==0.3.7,exceptiongroup==1.2.0,filelock==3.13.1,gevent==23.9.1,greenlet==3.0.1,httplib2==0.22.0,idna==3.6,iniconfig==2.0.0,isodate==0.6.1,jmespath==1.0.1,lxml==4.9.3,munch==4.0.0,packaging==23.2,platformdirs==4.0.0,pluggy==1.3.0,pyparsing==3.1.1,pyproject-api==1.6.1,pytest==7.4.3,python-dateutil==2.8.2,pytz==2023.3.post1,PyYAML==6.0.1,requests==2.31.0,s3tests @ file:///home/ubuntu/cephtest/s3-tests-client.0/.tox/.tmp/package/1/s3tests-0.0.1.zip#sha256=d169216b4b91f90bd199caff62c687c3048e203a11059bc5ca9c738dfc7e543c,s3transfer==0.6.2,six==1.16.0,tomli==2.0.1,tox==4.11.4,urllib3==1.26.18,virtualenv==20.25.0,zope.event==5.0,zope.interface==6.1 2023-12-03T11:59:20.388 INFO:teuthology.orchestra.run.smithi003.stdout:py run-test-pre: PYTHONHASHSEED='584372447' 2023-12-03T11:59:20.388 INFO:teuthology.orchestra.run.smithi003.stdout:py run-test: commands[0] | pytest -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3' 2023-12-03T11:59:20.542 INFO:teuthology.orchestra.run.smithi003.stdout:============================= test session starts ============================== 2023-12-03T11:59:20.542 INFO:teuthology.orchestra.run.smithi003.stdout:platform linux -- Python 3.9.17, pytest-7.4.3, pluggy-1.3.0 -- /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/bin/python 2023-12-03T11:59:20.542 INFO:teuthology.orchestra.run.smithi003.stdout:cachedir: .tox/py/.pytest_cache 2023-12-03T11:59:20.542 INFO:teuthology.orchestra.run.smithi003.stdout:rootdir: /home/ubuntu/cephtest/s3-tests-client.0 2023-12-03T11:59:20.542 INFO:teuthology.orchestra.run.smithi003.stdout:configfile: pytest.ini 2023-12-03T11:59:22.187 INFO:teuthology.orchestra.run.smithi003.stdout:collecting ... collected 787 items / 124 deselected / 663 selected 2023-12-03T11:59:22.188 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T11:59:22.562 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_none PASSED [ 0%] 2023-12-03T11:59:22.876 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_empty PASSED [ 0%] 2023-12-03T11:59:23.248 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests/functional/test_headers.py::test_object_create_date_and_amz_date PASSED [ 0%] 2023-12-03T11:59:23.614 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests/functional/test_headers.py::test_object_create_amz_date_and_no_date PASSED [ 0%] 2023-12-03T11:59:23.953 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_none PASSED [ 0%] 2023-12-03T11:59:24.251 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests/functional/test_headers.py::test_bucket_create_contentlength_none PASSED [ 0%] 2023-12-03T11:59:24.709 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests/functional/test_headers.py::test_object_acl_create_contentlength_none PASSED [ 1%] 2023-12-03T11:59:25.005 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_contentlength_none PASSED [ 1%] 2023-12-03T11:59:25.126 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_empty PASSED [ 1%] 2023-12-03T11:59:25.250 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_none PASSED [ 1%] 2023-12-03T11:59:25.564 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_mismatch_below_aws2 PASSED [ 1%] 2023-12-03T11:59:25.872 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_incorrect_aws2 PASSED [ 1%] 2023-12-03T11:59:26.181 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_invalid_aws2 PASSED [ 1%] 2023-12-03T11:59:26.485 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_none_aws2 PASSED [ 2%] 2023-12-03T11:59:26.608 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_invalid_aws2 PASSED [ 2%] 2023-12-03T11:59:26.728 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_none_aws2 PASSED [ 2%] 2023-12-03T11:59:26.803 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests/functional/test_headers.py::test_object_create_bad_md5_invalid_garbage_aws4 SKIPPED [ 2%] 2023-12-03T11:59:26.879 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_mismatch_below_aws4 SKIPPED [ 2%] 2023-12-03T11:59:26.954 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_incorrect_aws4 SKIPPED [ 2%] 2023-12-03T11:59:27.031 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_invalid_aws4 SKIPPED [ 3%] 2023-12-03T11:59:27.107 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests/functional/test_headers.py::test_object_create_bad_ua_empty_aws4 SKIPPED [ 3%] 2023-12-03T11:59:27.182 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests/functional/test_headers.py::test_object_create_bad_ua_none_aws4 SKIPPED [ 3%] 2023-12-03T11:59:27.258 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_invalid_aws4 SKIPPED [ 3%] 2023-12-03T11:59:27.333 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_invalid_aws4 SKIPPED [ 3%] 2023-12-03T11:59:27.410 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_empty_aws4 SKIPPED [ 3%] 2023-12-03T11:59:27.486 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_empty_aws4 SKIPPED [ 3%] 2023-12-03T11:59:27.564 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_none_aws4 SKIPPED [ 4%] 2023-12-03T11:59:27.646 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_none_aws4 SKIPPED [ 4%] 2023-12-03T11:59:27.721 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_before_today_aws4 SKIPPED [ 4%] 2023-12-03T11:59:27.797 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_before_today_aws4 SKIPPED [ 4%] 2023-12-03T11:59:27.873 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_after_today_aws4 SKIPPED [ 4%] 2023-12-03T11:59:27.948 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_after_today_aws4 SKIPPED [ 4%] 2023-12-03T11:59:28.028 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_before_epoch_aws4 SKIPPED [ 4%] 2023-12-03T11:59:28.103 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_before_epoch_aws4 SKIPPED [ 5%] 2023-12-03T11:59:28.179 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_after_end_aws4 SKIPPED [ 5%] 2023-12-03T11:59:28.254 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_after_end_aws4 SKIPPED [ 5%] 2023-12-03T11:59:28.330 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests/functional/test_headers.py::test_object_create_missing_signed_custom_header_aws4 SKIPPED [ 5%] 2023-12-03T11:59:28.405 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests/functional/test_headers.py::test_object_create_missing_signed_header_aws4 SKIPPED [ 5%] 2023-12-03T11:59:28.481 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_invalid_aws4 SKIPPED [ 5%] 2023-12-03T11:59:28.556 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_ua_empty_aws4 SKIPPED [ 6%] 2023-12-03T11:59:28.631 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_ua_none_aws4 SKIPPED [ 6%] 2023-12-03T11:59:28.710 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_invalid_aws4 SKIPPED [ 6%] 2023-12-03T11:59:28.788 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_invalid_aws4 SKIPPED [ 6%] 2023-12-03T11:59:28.864 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_empty_aws4 SKIPPED [ 6%] 2023-12-03T11:59:28.939 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_empty_aws4 SKIPPED [ 6%] 2023-12-03T11:59:29.015 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_none_aws4 SKIPPED [ 6%] 2023-12-03T11:59:29.090 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_none_aws4 SKIPPED [ 7%] 2023-12-03T11:59:29.165 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_before_today_aws4 SKIPPED [ 7%] 2023-12-03T11:59:29.241 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_before_today_aws4 SKIPPED [ 7%] 2023-12-03T11:59:29.317 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_after_today_aws4 SKIPPED [ 7%] 2023-12-03T11:59:29.392 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_after_today_aws4 SKIPPED [ 7%] 2023-12-03T11:59:29.467 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_before_epoch_aws4 SKIPPED [ 7%] 2023-12-03T11:59:29.543 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_before_epoch_aws4 SKIPPED [ 7%] 2023-12-03T11:59:30.100 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests/functional/test_s3.py::test_versioning_obj_read_not_exist_null PASSED [ 8%] 2023-12-03T11:59:33.289 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests/functional/test_s3.py::test_object_storage_class PASSED [ 8%] 2023-12-03T11:59:37.453 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests/functional/test_s3.py::test_object_storage_class_multipart PASSED [ 8%] 2023-12-03T11:59:43.435 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests/functional/test_s3.py::test_object_modify_storage_class PASSED [ 8%] 2023-12-03T11:59:50.423 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests/functional/test_s3.py::test_object_modify_storage_class_multipart PASSED [ 8%] 2023-12-03T11:59:53.128 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests/functional/test_s3.py::test_object_storage_class_copy PASSED [ 8%] 2023-12-03T11:59:55.037 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests/functional/test_s3.py::test_object_storage_class_copy_multipart PASSED [ 9%] 2023-12-03T11:59:55.747 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests/functional/test_s3.py::test_atomic_dual_conditional_write_1mb PASSED [ 9%] 2023-12-03T11:59:56.010 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests/functional/test_s3.py::test_atomic_write_bucket_gone PASSED [ 9%] 2023-12-03T11:59:56.688 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests/functional/test_s3.py::test_encryption_sse_c_multipart_invalid_chunks_1 PASSED [ 9%] 2023-12-03T11:59:57.226 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests/functional/test_s3.py::test_encryption_sse_c_multipart_invalid_chunks_2 PASSED [ 9%] 2023-12-03T11:59:58.009 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests/functional/test_s3.py::test_bucket_policy_set_condition_operator_end_with_IfExists PASSED [ 9%] 2023-12-03T11:59:58.489 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests/functional/test_s3.py::test_bucket_policy_put_obj_request_obj_tag PASSED [ 9%] 2023-12-03T11:59:58.815 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests/functional/test_s3_website.py::test_website_nonexistant_bucket_rgw SKIPPED [ 10%] 2023-12-03T11:59:58.816 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_public_index SKIPPED [ 10%] 2023-12-03T11:59:58.817 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_public_index SKIPPED [ 10%] 2023-12-03T11:59:58.819 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty SKIPPED [ 10%] 2023-12-03T11:59:58.820 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty SKIPPED [ 10%] 2023-12-03T11:59:58.821 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index SKIPPED [ 10%] 2023-12-03T11:59:58.822 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index SKIPPED [ 11%] 2023-12-03T11:59:58.823 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_missingerrordoc SKIPPED [ 11%] 2023-12-03T11:59:58.824 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_missingerrordoc SKIPPED [ 11%] 2023-12-03T11:59:58.824 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_missingerrordoc SKIPPED [ 11%] 2023-12-03T11:59:58.825 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_missingerrordoc SKIPPED [ 11%] 2023-12-03T11:59:58.826 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_blockederrordoc SKIPPED [ 11%] 2023-12-03T11:59:58.827 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_pubilc_errordoc SKIPPED [ 11%] 2023-12-03T11:59:58.828 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_blockederrordoc SKIPPED [ 12%] 2023-12-03T11:59:58.830 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_blockederrordoc SKIPPED [ 12%] 2023-12-03T11:59:58.830 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_blockederrordoc SKIPPED [ 12%] 2023-12-03T11:59:58.831 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_gooderrordoc SKIPPED [ 12%] 2023-12-03T11:59:58.832 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_gooderrordoc SKIPPED [ 12%] 2023-12-03T11:59:58.833 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_gooderrordoc SKIPPED [ 12%] 2023-12-03T11:59:58.834 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_gooderrordoc SKIPPED [ 12%] 2023-12-03T11:59:58.835 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_base SKIPPED [ 13%] 2023-12-03T11:59:58.836 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_path SKIPPED [ 13%] 2023-12-03T11:59:58.837 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_path_upgrade SKIPPED [ 13%] 2023-12-03T11:59:58.838 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_nonwebsite SKIPPED [ 13%] 2023-12-03T11:59:58.839 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_public_relative SKIPPED [ 13%] 2023-12-03T11:59:58.840 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_public_abs SKIPPED [ 13%] 2023-12-03T11:59:58.841 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_private_relative SKIPPED [ 14%] 2023-12-03T11:59:58.842 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_private_abs SKIPPED [ 14%] 2023-12-03T11:59:58.915 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests/functional/test_s3_website.py::test_routing_generator XFAIL [ 14%] 2023-12-03T11:59:58.927 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests/functional/test_utils.py::test_generate PASSED [ 14%] 2023-12-03T11:59:59.575 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_invalid_short PASSED [ 14%] 2023-12-03T12:00:10.200 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_bad PASSED [ 14%] 2023-12-03T12:00:10.621 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_empty PASSED [ 14%] 2023-12-03T12:00:11.104 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_none PASSED [ 15%] 2023-12-03T12:00:11.584 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_mismatch PASSED [ 15%] 2023-12-03T12:00:12.072 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_empty PASSED [ 15%] 2023-12-03T12:00:12.550 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_none PASSED [ 15%] 2023-12-03T12:00:12.914 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contentlength_negative PASSED [ 15%] 2023-12-03T12:00:13.394 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_invalid PASSED [ 15%] 2023-12-03T12:00:13.878 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_empty PASSED [ 15%] 2023-12-03T12:00:14.331 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_none PASSED [ 16%] 2023-12-03T12:00:14.708 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_put_bad_canned_acl PASSED [ 16%] 2023-12-03T12:00:15.062 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_expect_mismatch PASSED [ 16%] 2023-12-03T12:00:15.415 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_expect_empty PASSED [ 16%] 2023-12-03T12:00:15.537 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_contentlength_negative PASSED [ 16%] 2023-12-03T12:00:15.949 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_invalid_garbage_aws2 PASSED [ 16%] 2023-12-03T12:00:16.421 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_ua_empty_aws2 PASSED [ 17%] 2023-12-03T12:00:16.897 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_ua_none_aws2 PASSED [ 17%] 2023-12-03T12:00:17.299 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_invalid_aws2 PASSED [ 17%] 2023-12-03T12:00:17.667 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_empty_aws2 PASSED [ 17%] 2023-12-03T12:00:18.040 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_before_today_aws2 PASSED [ 17%] 2023-12-03T12:00:18.409 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_before_epoch_aws2 PASSED [ 17%] 2023-12-03T12:00:18.780 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_after_end_aws2 PASSED [ 17%] 2023-12-03T12:00:19.129 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_ua_empty_aws2 PASSED [ 18%] 2023-12-03T12:00:19.485 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_ua_none_aws2 PASSED [ 18%] 2023-12-03T12:00:19.618 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_invalid_aws2 PASSED [ 18%] 2023-12-03T12:00:19.750 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_empty_aws2 PASSED [ 18%] 2023-12-03T12:00:19.922 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_before_today_aws2 PASSED [ 18%] 2023-12-03T12:00:20.050 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_after_today_aws2 PASSED [ 18%] 2023-12-03T12:00:20.179 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_before_epoch_aws2 PASSED [ 19%] 2023-12-03T12:00:20.530 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy PASSED [ 19%] 2023-12-03T12:00:20.672 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy_invalid_user PASSED [ 19%] 2023-12-03T12:00:20.852 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy_parameter_limit PASSED [ 19%] 2023-12-03T12:00:21.165 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_iam.py::test_put_existing_user_policy PASSED [ 19%] 2023-12-03T12:00:21.457 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_iam.py::test_list_user_policy PASSED [ 19%] 2023-12-03T12:00:21.592 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_iam.py::test_list_user_policy_invalid_user PASSED [ 19%] 2023-12-03T12:00:21.887 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy PASSED [ 20%] 2023-12-03T12:00:22.209 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy_invalid_user PASSED [ 20%] 2023-12-03T12:00:22.657 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy_from_multiple_policies PASSED [ 20%] 2023-12-03T12:00:22.890 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy PASSED [ 20%] 2023-12-03T12:00:23.183 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_invalid_user PASSED [ 20%] 2023-12-03T12:00:23.480 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_invalid_policy_name PASSED [ 20%] 2023-12-03T12:00:24.075 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_from_multiple_policies PASSED [ 20%] 2023-12-03T12:00:24.561 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_iam.py::test_allow_bucket_actions_in_user_policy PASSED [ 21%] 2023-12-03T12:00:25.004 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_iam.py::test_deny_bucket_actions_in_user_policy PASSED [ 21%] 2023-12-03T12:00:25.521 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_iam.py::test_allow_object_actions_in_user_policy PASSED [ 21%] 2023-12-03T12:00:26.240 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_iam.py::test_deny_object_actions_in_user_policy PASSED [ 21%] 2023-12-03T12:00:27.396 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_iam.py::test_allow_multipart_actions_in_user_policy PASSED [ 21%] 2023-12-03T12:00:28.572 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_iam.py::test_deny_multipart_actions_in_user_policy PASSED [ 21%] 2023-12-03T12:00:29.204 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_iam.py::test_allow_tagging_actions_in_user_policy PASSED [ 22%] 2023-12-03T12:00:29.812 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_iam.py::test_deny_tagging_actions_in_user_policy PASSED [ 22%] 2023-12-03T12:00:30.306 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_iam.py::test_verify_conflicting_user_policy_statements PASSED [ 22%] 2023-12-03T12:00:30.957 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_iam.py::test_verify_conflicting_user_policies PASSED [ 22%] 2023-12-03T12:00:31.302 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_iam.py::test_verify_allow_iam_actions PASSED [ 22%] 2023-12-03T12:00:31.813 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_empty PASSED [ 22%] 2023-12-03T12:00:32.561 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_distinct PASSED [ 22%] 2023-12-03T12:00:33.164 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_many PASSED [ 23%] 2023-12-03T12:00:33.775 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_many PASSED [ 23%] 2023-12-03T12:00:34.404 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_basic_key_count PASSED [ 23%] 2023-12-03T12:00:34.975 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_basic PASSED [ 23%] 2023-12-03T12:00:35.608 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_basic PASSED [ 23%] 2023-12-03T12:00:36.176 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_encoding_basic PASSED [ 23%] 2023-12-03T12:00:36.736 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_encoding_basic PASSED [ 23%] 2023-12-03T12:00:37.586 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix PASSED [ 24%] 2023-12-03T12:00:38.427 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix PASSED [ 24%] 2023-12-03T12:00:38.935 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix_ends_with_delimiter PASSED [ 24%] 2023-12-03T12:00:39.408 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix_ends_with_delimiter PASSED [ 24%] 2023-12-03T12:00:39.979 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_alt PASSED [ 24%] 2023-12-03T12:00:40.553 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_alt PASSED [ 24%] 2023-12-03T12:00:41.406 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix_underscore PASSED [ 25%] 2023-12-03T12:00:42.279 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix_underscore PASSED [ 25%] 2023-12-03T12:00:42.860 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_percentage PASSED [ 25%] 2023-12-03T12:00:43.438 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_percentage PASSED [ 25%] 2023-12-03T12:00:44.004 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_whitespace PASSED [ 25%] 2023-12-03T12:00:44.570 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_whitespace PASSED [ 25%] 2023-12-03T12:00:45.142 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_dot PASSED [ 25%] 2023-12-03T12:00:45.706 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_dot PASSED [ 26%] 2023-12-03T12:00:46.319 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_unreadable PASSED [ 26%] 2023-12-03T12:00:46.888 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_unreadable PASSED [ 26%] 2023-12-03T12:00:47.463 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_empty PASSED [ 26%] 2023-12-03T12:00:48.036 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_empty PASSED [ 26%] 2023-12-03T12:00:48.620 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_none PASSED [ 26%] 2023-12-03T12:00:49.185 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_none PASSED [ 26%] 2023-12-03T12:00:49.764 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_notempty PASSED [ 27%] 2023-12-03T12:00:50.308 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_defaultempty PASSED [ 27%] 2023-12-03T12:00:50.847 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_empty PASSED [ 27%] 2023-12-03T12:00:51.418 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_not_exist PASSED [ 27%] 2023-12-03T12:00:51.993 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_not_exist PASSED [ 27%] 2023-12-03T12:01:32.807 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_not_skip_special PASSED [ 27%] 2023-12-03T12:01:33.351 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_basic PASSED [ 28%] 2023-12-03T12:01:33.900 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_basic PASSED [ 28%] 2023-12-03T12:01:34.469 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_alt PASSED [ 28%] 2023-12-03T12:01:35.059 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_alt PASSED [ 28%] 2023-12-03T12:01:35.592 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_empty PASSED [ 28%] 2023-12-03T12:01:36.138 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_empty PASSED [ 28%] 2023-12-03T12:01:36.684 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_none PASSED [ 28%] 2023-12-03T12:01:37.222 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_none PASSED [ 29%] 2023-12-03T12:01:37.795 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_not_exist PASSED [ 29%] 2023-12-03T12:01:38.336 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_not_exist PASSED [ 29%] 2023-12-03T12:01:38.893 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_unreadable PASSED [ 29%] 2023-12-03T12:01:39.439 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_unreadable PASSED [ 29%] 2023-12-03T12:01:40.172 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_basic PASSED [ 29%] 2023-12-03T12:01:40.741 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_basic PASSED [ 30%] 2023-12-03T12:01:41.310 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_alt PASSED [ 30%] 2023-12-03T12:01:41.930 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_alt PASSED [ 30%] 2023-12-03T12:01:42.498 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_prefix_not_exist PASSED [ 30%] 2023-12-03T12:01:43.065 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_prefix_not_exist PASSED [ 30%] 2023-12-03T12:01:43.650 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_delimiter_not_exist PASSED [ 30%] 2023-12-03T12:01:44.216 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_delimiter_not_exist PASSED [ 30%] 2023-12-03T12:01:44.781 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_prefix_delimiter_not_exist PASSED [ 31%] 2023-12-03T12:01:45.391 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_prefix_delimiter_not_exist PASSED [ 31%] 2023-12-03T12:01:46.026 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_one PASSED [ 31%] 2023-12-03T12:01:46.668 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_one PASSED [ 31%] 2023-12-03T12:01:47.238 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_zero PASSED [ 31%] 2023-12-03T12:01:47.805 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_zero PASSED [ 31%] 2023-12-03T12:01:48.368 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_none PASSED [ 31%] 2023-12-03T12:01:48.945 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_none PASSED [ 32%] 2023-12-03T12:01:49.217 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_account_usage PASSED [ 32%] 2023-12-03T12:01:49.747 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_head_bucket_usage PASSED [ 32%] 2023-12-03T12:01:51.447 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_unordered PASSED [ 32%] 2023-12-03T12:01:53.157 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_unordered PASSED [ 32%] 2023-12-03T12:01:53.710 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_invalid PASSED [ 32%] 2023-12-03T12:01:54.272 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_none PASSED [ 33%] 2023-12-03T12:01:54.881 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_empty PASSED [ 33%] 2023-12-03T12:01:55.457 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_continuationtoken_empty PASSED [ 33%] 2023-12-03T12:01:56.093 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_continuationtoken PASSED [ 33%] 2023-12-03T12:01:56.734 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_both_continuationtoken_startafter PASSED [ 33%] 2023-12-03T12:01:57.310 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_unreadable PASSED [ 33%] 2023-12-03T12:01:57.880 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_unreadable PASSED [ 33%] 2023-12-03T12:01:58.497 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_not_in_list PASSED [ 34%] 2023-12-03T12:01:59.064 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_not_in_list PASSED [ 34%] 2023-12-03T12:01:59.631 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_after_list PASSED [ 34%] 2023-12-03T12:02:00.207 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_after_list PASSED [ 34%] 2023-12-03T12:02:01.032 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_return_data PASSED [ 34%] 2023-12-03T12:02:02.090 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_return_data_versioning PASSED [ 34%] 2023-12-03T12:02:02.505 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_objects_anonymous PASSED [ 34%] 2023-12-03T12:02:02.956 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_objects_anonymous PASSED [ 35%] 2023-12-03T12:02:03.326 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_objects_anonymous_fail PASSED [ 35%] 2023-12-03T12:02:03.696 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_objects_anonymous_fail PASSED [ 35%] 2023-12-03T12:02:03.837 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_notexist PASSED [ 35%] 2023-12-03T12:02:03.975 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_notexist PASSED [ 35%] 2023-12-03T12:02:04.111 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_delete_notexist PASSED [ 35%] 2023-12-03T12:02:04.613 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_delete_nonempty PASSED [ 36%] 2023-12-03T12:02:06.198 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_concurrent_set_canned_acl PASSED [ 36%] 2023-12-03T12:02:06.373 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_to_nonexist_bucket PASSED [ 36%] 2023-12-03T12:02:06.832 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_with_chunked_transfer_encoding PASSED [ 36%] 2023-12-03T12:02:07.189 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_delete PASSED [ 36%] 2023-12-03T12:02:07.564 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_object_read_not_exist PASSED [ 36%] 2023-12-03T12:02:07.941 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_object_requestid_matches_header_on_error PASSED [ 36%] 2023-12-03T12:02:09.740 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_concurrent_multi_object_delete PASSED [ 37%] 2023-12-03T12:02:10.467 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_multi_object_delete PASSED [ 37%] 2023-12-03T12:02:11.196 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_multi_objectv2_delete PASSED [ 37%] 2023-12-03T12:02:52.781 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_multi_object_delete_key_limit PASSED [ 37%] 2023-12-03T12:03:35.624 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_multi_objectv2_delete_key_limit PASSED [ 37%] 2023-12-03T12:03:36.084 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_object_head_zero_bytes PASSED [ 37%] 2023-12-03T12:03:36.524 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_check_etag PASSED [ 38%] 2023-12-03T12:03:36.993 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_cache_control PASSED [ 38%] 2023-12-03T12:03:37.466 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_expires PASSED [ 38%] 2023-12-03T12:03:38.037 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_read_update_read_delete PASSED [ 38%] 2023-12-03T12:03:38.507 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_none_to_good PASSED [ 38%] 2023-12-03T12:03:38.981 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_none_to_empty PASSED [ 38%] 2023-12-03T12:03:39.554 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_overwrite_to_empty PASSED [ 38%] 2023-12-03T12:03:40.060 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_object_metadata_replaced_on_put PASSED [ 39%] 2023-12-03T12:03:40.580 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_file PASSED [ 39%] 2023-12-03T12:03:41.102 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_anonymous_request PASSED [ 39%] 2023-12-03T12:03:41.684 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_request PASSED [ 39%] 2023-12-03T12:03:42.194 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_no_content_type PASSED [ 39%] 2023-12-03T12:03:42.571 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_request_bad_access_key PASSED [ 39%] 2023-12-03T12:03:43.017 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_success_code PASSED [ 39%] 2023-12-03T12:03:43.457 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_invalid_success_code PASSED [ 40%] 2023-12-03T12:03:44.202 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_larger_than_chunk PASSED [ 40%] 2023-12-03T12:03:44.680 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_key_from_filename PASSED [ 40%] 2023-12-03T12:03:45.133 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_ignored_header PASSED [ 40%] 2023-12-03T12:03:45.592 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_case_insensitive_condition_fields PASSED [ 40%] 2023-12-03T12:03:46.063 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_escaped_field_values PASSED [ 40%] 2023-12-03T12:03:46.605 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_success_redirect_action PASSED [ 41%] 2023-12-03T12:03:46.982 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_signature PASSED [ 41%] 2023-12-03T12:03:47.357 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_access_key PASSED [ 41%] 2023-12-03T12:03:47.739 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_date_format PASSED [ 41%] 2023-12-03T12:03:48.145 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_no_key_specified PASSED [ 41%] 2023-12-03T12:03:48.520 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_signature PASSED [ 41%] 2023-12-03T12:03:48.910 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_policy_condition PASSED [ 41%] 2023-12-03T12:03:49.383 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_user_specified_header PASSED [ 42%] 2023-12-03T12:03:49.760 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_request_missing_policy_specified_field PASSED [ 42%] 2023-12-03T12:03:50.138 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_condition_is_case_sensitive PASSED [ 42%] 2023-12-03T12:03:50.516 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_expires_is_case_sensitive PASSED [ 42%] 2023-12-03T12:03:50.892 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_expired_policy PASSED [ 42%] 2023-12-03T12:03:51.511 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_wrong_bucket PASSED [ 42%] 2023-12-03T12:03:51.927 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_request_field_value PASSED [ 42%] 2023-12-03T12:03:52.314 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_expires_condition PASSED [ 43%] 2023-12-03T12:03:52.691 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_conditions_list PASSED [ 43%] 2023-12-03T12:03:53.073 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_limit_exceeded PASSED [ 43%] 2023-12-03T12:03:53.453 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_content_length_argument PASSED [ 43%] 2023-12-03T12:03:53.851 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_content_length_argument PASSED [ 43%] 2023-12-03T12:03:54.237 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_below_minimum PASSED [ 43%] 2023-12-03T12:03:55.618 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_rgw_chunk_size_bug PASSED [ 44%] 2023-12-03T12:03:56.000 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_empty_conditions PASSED [ 44%] 2023-12-03T12:03:56.549 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmatch_good PASSED [ 44%] 2023-12-03T12:03:57.059 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmatch_failed PASSED [ 44%] 2023-12-03T12:03:57.538 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifnonematch_good PASSED [ 44%] 2023-12-03T12:03:58.044 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifnonematch_failed PASSED [ 44%] 2023-12-03T12:03:58.562 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmodifiedsince_good PASSED [ 44%] 2023-12-03T12:04:00.063 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmodifiedsince_failed PASSED [ 45%] 2023-12-03T12:04:00.580 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifunmodifiedsince_good PASSED [ 45%] 2023-12-03T12:04:01.103 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifunmodifiedsince_failed PASSED [ 45%] 2023-12-03T12:04:01.744 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_good PASSED [ 45%] 2023-12-03T12:04:02.379 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_failed PASSED [ 45%] 2023-12-03T12:04:02.980 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_overwrite_existed_good PASSED [ 45%] 2023-12-03T12:04:03.470 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_nonexisted_failed PASSED [ 46%] 2023-12-03T12:04:04.068 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_good PASSED [ 46%] 2023-12-03T12:04:04.695 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_failed PASSED [ 46%] 2023-12-03T12:04:05.205 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_nonexisted_good PASSED [ 46%] 2023-12-03T12:04:05.844 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_overwrite_existed_failed PASSED [ 46%] 2023-12-03T12:04:06.336 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get PASSED [ 46%] 2023-12-03T12:04:06.697 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_bucket_gone PASSED [ 46%] 2023-12-03T12:04:07.053 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_object_delete_key_bucket_gone PASSED [ 47%] 2023-12-03T12:04:07.481 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_object_gone PASSED [ 47%] 2023-12-03T12:04:07.867 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head PASSED [ 47%] 2023-12-03T12:04:08.003 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head_notexist PASSED [ 47%] 2023-12-03T12:04:08.623 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head_extended PASSED [ 47%] 2023-12-03T12:04:09.086 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_bucket_acl PASSED [ 47%] 2023-12-03T12:04:09.596 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_object_acl PASSED [ 47%] 2023-12-03T12:04:12.510 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_object_put_acl_mtime PASSED [ 48%] 2023-12-03T12:04:12.985 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated PASSED [ 48%] 2023-12-03T12:04:13.458 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_response_headers PASSED [ 48%] 2023-12-03T12:04:13.941 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_bucket_acl PASSED [ 48%] 2023-12-03T12:04:14.405 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_object_acl PASSED [ 48%] 2023-12-03T12:04:14.864 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_bucket_gone PASSED [ 48%] 2023-12-03T12:04:15.357 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_object_gone PASSED [ 49%] 2023-12-03T12:04:15.850 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_not_expired PASSED [ 49%] 2023-12-03T12:04:16.383 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_not_expired_tenant PASSED [ 49%] 2023-12-03T12:04:16.840 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_range_zero PASSED [ 49%] 2023-12-03T12:04:17.297 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_max_range PASSED [ 49%] 2023-12-03T12:04:17.758 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_positive_range PASSED [ 49%] 2023-12-03T12:04:18.219 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_object_anon_put PASSED [ 49%] 2023-12-03T12:04:18.699 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_object_anon_put_write_access PASSED [ 50%] 2023-12-03T12:04:19.143 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_object_put_authenticated PASSED [ 50%] 2023-12-03T12:04:19.597 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_put_authenticated_expired PASSED [ 50%] 2023-12-03T12:04:19.772 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_starts_nonalpha PASSED [ 50%] 2023-12-03T12:04:19.905 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_short_one PASSED [ 50%] 2023-12-03T12:04:20.039 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_short_two PASSED [ 50%] 2023-12-03T12:04:20.396 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_60 PASSED [ 50%] 2023-12-03T12:04:20.748 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_61 PASSED [ 51%] 2023-12-03T12:04:21.105 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_62 PASSED [ 51%] 2023-12-03T12:04:21.461 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_63 PASSED [ 51%] 2023-12-03T12:04:21.883 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_long_name PASSED [ 51%] 2023-12-03T12:04:22.019 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_ip PASSED [ 51%] 2023-12-03T12:04:22.153 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_underscore PASSED [ 51%] 2023-12-03T12:04:22.509 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_long PASSED [ 52%] 2023-12-03T12:04:22.681 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dash_at_end PASSED [ 52%] 2023-12-03T12:04:22.815 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dot_dot PASSED [ 52%] 2023-12-03T12:04:22.950 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dot_dash PASSED [ 52%] 2023-12-03T12:04:23.086 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dash_dot PASSED [ 52%] 2023-12-03T12:04:23.504 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_exists PASSED [ 52%] 2023-12-03T12:04:23.929 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_get_location PASSED [ 52%] 2023-12-03T12:04:24.307 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_exists_nonowner PASSED [ 53%] 2023-12-03T12:04:24.718 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_overwrite_acl PASSED [ 53%] 2023-12-03T12:04:25.136 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_new_acl PASSED [ 53%] 2023-12-03T12:04:25.505 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_default PASSED [ 53%] 2023-12-03T12:04:25.914 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_during_create PASSED [ 53%] 2023-12-03T12:04:26.403 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned PASSED [ 53%] 2023-12-03T12:04:26.811 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_publicreadwrite PASSED [ 53%] 2023-12-03T12:04:27.256 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_authenticatedread PASSED [ 54%] 2023-12-03T12:04:27.768 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_default PASSED [ 54%] 2023-12-03T12:04:28.276 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_during_create PASSED [ 54%] 2023-12-03T12:04:28.878 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned PASSED [ 54%] 2023-12-03T12:04:29.403 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_publicreadwrite PASSED [ 54%] 2023-12-03T12:04:29.910 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_authenticatedread PASSED [ 54%] 2023-12-03T12:04:30.510 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_bucketownerread PASSED [ 55%] 2023-12-03T12:04:31.104 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_bucketownerfullcontrol PASSED [ 55%] 2023-12-03T12:04:31.728 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_full_control_verify_owner PASSED [ 55%] 2023-12-03T12:04:32.279 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_full_control_verify_attributes PASSED [ 55%] 2023-12-03T12:04:32.665 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_private_to_private PASSED [ 55%] 2023-12-03T12:04:33.271 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl PASSED [ 55%] 2023-12-03T12:04:33.874 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_write PASSED [ 55%] 2023-12-03T12:04:34.494 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_writeacp PASSED [ 56%] 2023-12-03T12:04:35.097 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_read PASSED [ 56%] 2023-12-03T12:04:35.700 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_readacp PASSED [ 56%] 2023-12-03T12:04:36.396 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_fullcontrol PASSED [ 56%] 2023-12-03T12:04:36.957 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_read PASSED [ 56%] 2023-12-03T12:04:37.507 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_readacp PASSED [ 56%] 2023-12-03T12:04:38.130 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_write PASSED [ 57%] 2023-12-03T12:04:38.690 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_writeacp PASSED [ 57%] 2023-12-03T12:04:39.111 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_nonexist_user PASSED [ 57%] 2023-12-03T12:04:39.799 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_no_grants PASSED [ 57%] 2023-12-03T12:04:40.335 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_object_header_acl_grants PASSED [ 57%] 2023-12-03T12:04:40.875 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_header_acl_grants PASSED [ 57%] 2023-12-03T12:04:41.339 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_email PASSED [ 57%] 2023-12-03T12:04:41.743 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_email_not_exist PASSED [ 58%] 2023-12-03T12:04:42.347 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_revoke_all PASSED [ 58%] 2023-12-03T12:04:43.115 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_private PASSED [ 58%] 2023-12-03T12:04:43.926 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_private PASSED [ 58%] 2023-12-03T12:04:44.760 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_publicread PASSED [ 58%] 2023-12-03T12:04:45.544 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_publicread PASSED [ 58%] 2023-12-03T12:04:46.321 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_publicreadwrite PASSED [ 58%] 2023-12-03T12:04:47.101 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_publicreadwrite PASSED [ 59%] 2023-12-03T12:04:47.932 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_private PASSED [ 59%] 2023-12-03T12:04:48.821 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_publicread PASSED [ 59%] 2023-12-03T12:04:49.933 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_publicreadwrite PASSED [ 59%] 2023-12-03T12:04:50.770 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_private PASSED [ 59%] 2023-12-03T12:04:51.563 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_publicread PASSED [ 59%] 2023-12-03T12:04:52.353 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_publicreadwrite PASSED [ 60%] 2023-12-03T12:04:53.749 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_buckets_create_then_list PASSED [ 60%] 2023-12-03T12:04:55.147 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_buckets_list_ctime PASSED [ 60%] 2023-12-03T12:04:55.270 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_anonymous PASSED [ 60%] 2023-12-03T12:04:55.408 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_invalid_auth PASSED [ 60%] 2023-12-03T12:04:55.543 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_bad_auth PASSED [ 60%] 2023-12-03T12:04:55.939 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_starts_alpha PASSED [ 60%] 2023-12-03T12:04:56.341 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_starts_digit PASSED [ 61%] 2023-12-03T12:04:56.692 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_contains_period PASSED [ 61%] 2023-12-03T12:04:57.057 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_contains_hyphen PASSED [ 61%] 2023-12-03T12:04:57.702 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_not_overriding PASSED [ 61%] 2023-12-03T12:04:59.668 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_special_key_names PASSED [ 61%] 2023-12-03T12:05:00.314 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_special_prefix PASSED [ 61%] 2023-12-03T12:05:00.923 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_zero_size PASSED [ 61%] 2023-12-03T12:05:03.565 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_16m PASSED [ 62%] 2023-12-03T12:05:04.187 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_same_bucket PASSED [ 62%] 2023-12-03T12:05:04.788 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_verify_contenttype PASSED [ 62%] 2023-12-03T12:05:05.367 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_to_itself PASSED [ 62%] 2023-12-03T12:05:05.926 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_to_itself_with_metadata PASSED [ 62%] 2023-12-03T12:05:06.836 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_diff_bucket PASSED [ 62%] 2023-12-03T12:05:07.537 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_not_owned_bucket PASSED [ 63%] 2023-12-03T12:05:08.217 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_not_owned_object_bucket PASSED [ 63%] 2023-12-03T12:05:08.874 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_canned_acl PASSED [ 63%] 2023-12-03T12:05:10.042 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_retaining_metadata PASSED [ 63%] 2023-12-03T12:05:11.231 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_replacing_metadata PASSED [ 63%] 2023-12-03T12:05:11.608 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_bucket_not_found PASSED [ 63%] 2023-12-03T12:05:11.980 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_key_not_found PASSED [ 63%] 2023-12-03T12:05:13.942 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioned_bucket PASSED [ 64%] 2023-12-03T12:05:14.651 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioned_url_encoding PASSED [ 64%] 2023-12-03T12:05:23.084 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioning_multipart_upload PASSED [ 64%] 2023-12-03T12:05:23.188 INFO:tasks.rgw.client.0.smithi003.stdout:*** Caught signal (Segmentation fault) ** 2023-12-03T12:05:23.188 INFO:tasks.rgw.client.0.smithi003.stdout: in thread 11b618640 thread_name:memcheck-amd64- 2023-12-03T12:05:23.242 INFO:tasks.rgw.client.0.smithi003.stdout: ceph version 18.0.0-7537-gbcbf278c (bcbf278cf395873c2a482f5a7b2345faf2160319) reef (dev) 2023-12-03T12:05:23.242 INFO:tasks.rgw.client.0.smithi003.stdout: 1: /lib64/libc.so.6(+0x54db0) [0x7928db0] 2023-12-03T12:05:23.242 INFO:tasks.rgw.client.0.smithi003.stdout: 2: (RGWCompleteMultipart::complete()+0x4a) [0x6ed66a] 2023-12-03T12:05:23.242 INFO:tasks.rgw.client.0.smithi003.stdout: 3: (rgw_process_authenticated(RGWHandler_REST*, RGWOp*&, RGWRequest*, req_state*, optional_yield, rgw::sal::Driver*, bool)+0xb91) [0x582fb1] 2023-12-03T12:05:23.242 INFO:tasks.rgw.client.0.smithi003.stdout: 4: (process_request(RGWProcessEnv const&, RGWRequest*, std::__cxx11::basic_string, std::allocator > const&, RGWRestfulIO*, optional_yield, rgw::dmclock::Scheduler*, std::__cxx11::basic_string, std::allocator >*, std::chrono::duration >*, int*)+0xf75) [0x586a75] 2023-12-03T12:05:23.242 INFO:tasks.rgw.client.0.smithi003.stdout: 5: radosgw(+0xc724b0) [0xd7a4b0] 2023-12-03T12:05:23.243 INFO:tasks.rgw.client.0.smithi003.stdout: 6: radosgw(+0x3cf496) [0x4d7496] 2023-12-03T12:05:23.243 INFO:tasks.rgw.client.0.smithi003.stdout: 7: make_fcontext() 2023-12-03T12:05:23.260 INFO:tasks.rgw.client.0.smithi003.stdout:2023-12-03T12:05:23.256+0000 11b618640 -1 *** Caught signal (Segmentation fault) ** 2023-12-03T12:05:23.260 INFO:tasks.rgw.client.0.smithi003.stdout: in thread 11b618640 thread_name:memcheck-amd64- 2023-12-03T12:05:23.260 INFO:tasks.rgw.client.0.smithi003.stdout: 2023-12-03T12:05:23.260 INFO:tasks.rgw.client.0.smithi003.stdout: ceph version 18.0.0-7537-gbcbf278c (bcbf278cf395873c2a482f5a7b2345faf2160319) reef (dev) 2023-12-03T12:05:23.260 INFO:tasks.rgw.client.0.smithi003.stdout: 1: /lib64/libc.so.6(+0x54db0) [0x7928db0] 2023-12-03T12:05:23.260 INFO:tasks.rgw.client.0.smithi003.stdout: 2: (RGWCompleteMultipart::complete()+0x4a) [0x6ed66a] 2023-12-03T12:05:23.260 INFO:tasks.rgw.client.0.smithi003.stdout: 3: (rgw_process_authenticated(RGWHandler_REST*, RGWOp*&, RGWRequest*, req_state*, optional_yield, rgw::sal::Driver*, bool)+0xb91) [0x582fb1] 2023-12-03T12:05:23.260 INFO:tasks.rgw.client.0.smithi003.stdout: 4: (process_request(RGWProcessEnv const&, RGWRequest*, std::__cxx11::basic_string, std::allocator > const&, RGWRestfulIO*, optional_yield, rgw::dmclock::Scheduler*, std::__cxx11::basic_string, std::allocator >*, std::chrono::duration >*, int*)+0xf75) [0x586a75] 2023-12-03T12:05:23.260 INFO:tasks.rgw.client.0.smithi003.stdout: 5: radosgw(+0xc724b0) [0xd7a4b0] 2023-12-03T12:05:23.260 INFO:tasks.rgw.client.0.smithi003.stdout: 6: radosgw(+0x3cf496) [0x4d7496] 2023-12-03T12:05:23.260 INFO:tasks.rgw.client.0.smithi003.stdout: 7: make_fcontext() 2023-12-03T12:05:23.260 INFO:tasks.rgw.client.0.smithi003.stdout: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-12-03T12:05:23.261 INFO:tasks.rgw.client.0.smithi003.stdout: 2023-12-03T12:05:23.615 INFO:tasks.rgw.client.0.smithi003.stdout: 0> 2023-12-03T12:05:23.256+0000 11b618640 -1 *** Caught signal (Segmentation fault) ** 2023-12-03T12:05:23.615 INFO:tasks.rgw.client.0.smithi003.stdout: in thread 11b618640 thread_name:memcheck-amd64- 2023-12-03T12:05:23.615 INFO:tasks.rgw.client.0.smithi003.stdout: 2023-12-03T12:05:23.615 INFO:tasks.rgw.client.0.smithi003.stdout: ceph version 18.0.0-7537-gbcbf278c (bcbf278cf395873c2a482f5a7b2345faf2160319) reef (dev) 2023-12-03T12:05:23.615 INFO:tasks.rgw.client.0.smithi003.stdout: 1: /lib64/libc.so.6(+0x54db0) [0x7928db0] 2023-12-03T12:05:23.615 INFO:tasks.rgw.client.0.smithi003.stdout: 2: (RGWCompleteMultipart::complete()+0x4a) [0x6ed66a] 2023-12-03T12:05:23.616 INFO:tasks.rgw.client.0.smithi003.stdout: 3: (rgw_process_authenticated(RGWHandler_REST*, RGWOp*&, RGWRequest*, req_state*, optional_yield, rgw::sal::Driver*, bool)+0xb91) [0x582fb1] 2023-12-03T12:05:23.616 INFO:tasks.rgw.client.0.smithi003.stdout: 4: (process_request(RGWProcessEnv const&, RGWRequest*, std::__cxx11::basic_string, std::allocator > const&, RGWRestfulIO*, optional_yield, rgw::dmclock::Scheduler*, std::__cxx11::basic_string, std::allocator >*, std::chrono::duration >*, int*)+0xf75) [0x586a75] 2023-12-03T12:05:23.616 INFO:tasks.rgw.client.0.smithi003.stdout: 5: radosgw(+0xc724b0) [0xd7a4b0] 2023-12-03T12:05:23.616 INFO:tasks.rgw.client.0.smithi003.stdout: 6: radosgw(+0x3cf496) [0x4d7496] 2023-12-03T12:05:23.616 INFO:tasks.rgw.client.0.smithi003.stdout: 7: make_fcontext() 2023-12-03T12:05:23.616 INFO:tasks.rgw.client.0.smithi003.stdout: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-12-03T12:05:23.616 INFO:tasks.rgw.client.0.smithi003.stdout: 2023-12-03T12:05:24.003 INFO:tasks.rgw.client.0.smithi003.stdout: -2> 2023-12-03T12:05:23.256+0000 11b618640 -1 *** Caught signal (Segmentation fault) ** 2023-12-03T12:05:24.003 INFO:tasks.rgw.client.0.smithi003.stdout: in thread 11b618640 thread_name:memcheck-amd64- 2023-12-03T12:05:24.003 INFO:tasks.rgw.client.0.smithi003.stdout: 2023-12-03T12:05:24.003 INFO:tasks.rgw.client.0.smithi003.stdout: ceph version 18.0.0-7537-gbcbf278c (bcbf278cf395873c2a482f5a7b2345faf2160319) reef (dev) 2023-12-03T12:05:24.003 INFO:tasks.rgw.client.0.smithi003.stdout: 1: /lib64/libc.so.6(+0x54db0) [0x7928db0] 2023-12-03T12:05:24.003 INFO:tasks.rgw.client.0.smithi003.stdout: 2: (RGWCompleteMultipart::complete()+0x4a) [0x6ed66a] 2023-12-03T12:05:24.003 INFO:tasks.rgw.client.0.smithi003.stdout: 3: (rgw_process_authenticated(RGWHandler_REST*, RGWOp*&, RGWRequest*, req_state*, optional_yield, rgw::sal::Driver*, bool)+0xb91) [0x582fb1] 2023-12-03T12:05:24.003 INFO:tasks.rgw.client.0.smithi003.stdout: 4: (process_request(RGWProcessEnv const&, RGWRequest*, std::__cxx11::basic_string, std::allocator > const&, RGWRestfulIO*, optional_yield, rgw::dmclock::Scheduler*, std::__cxx11::basic_string, std::allocator >*, std::chrono::duration >*, int*)+0xf75) [0x586a75] 2023-12-03T12:05:24.003 INFO:tasks.rgw.client.0.smithi003.stdout: 5: radosgw(+0xc724b0) [0xd7a4b0] 2023-12-03T12:05:24.004 INFO:tasks.rgw.client.0.smithi003.stdout: 6: radosgw(+0x3cf496) [0x4d7496] 2023-12-03T12:05:24.004 INFO:tasks.rgw.client.0.smithi003.stdout: 7: make_fcontext() 2023-12-03T12:05:24.004 INFO:tasks.rgw.client.0.smithi003.stdout: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-12-03T12:05:24.004 INFO:tasks.rgw.client.0.smithi003.stdout: 2023-12-03T12:05:35.357 INFO:tasks.rgw.client.0.smithi003.stderr:==00:00:30:56.971 92282== could not unlink /tmp/vgdb-pipe-from-vgdb-to-92282-by-root-on-??? 2023-12-03T12:05:35.357 INFO:tasks.rgw.client.0.smithi003.stderr:==00:00:30:56.971 92282== could not unlink /tmp/vgdb-pipe-to-vgdb-from-92282-by-root-on-??? 2023-12-03T12:05:35.357 INFO:tasks.rgw.client.0.smithi003.stderr:==00:00:30:56.971 92282== could not unlink /tmp/vgdb-pipe-shared-mem-vgdb-92282-by-root-on-??? 2023-12-03T12:05:35.506 INFO:tasks.rgw.client.0.smithi003.stderr:daemon-helper: command crashed with signal 11 2023-12-03T12:05:36.724 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~0s 2023-12-03T12:05:43.037 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~6s 2023-12-03T12:05:49.346 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~13s 2023-12-03T12:05:53.240 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_empty FAILED [ 64%] 2023-12-03T12:05:53.240 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_empty ERROR [ 64%] 2023-12-03T12:05:55.653 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~19s 2023-12-03T12:06:01.961 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~25s 2023-12-03T12:06:07.364 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_small FAILED [ 64%] 2023-12-03T12:06:07.364 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_small ERROR [ 64%] 2023-12-03T12:06:08.269 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~32s 2023-12-03T12:06:14.578 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~38s 2023-12-03T12:06:20.887 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~44s 2023-12-03T12:06:24.584 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_small FAILED [ 64%] 2023-12-03T12:06:24.585 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_small ERROR [ 64%] 2023-12-03T12:06:27.196 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~50s 2023-12-03T12:06:33.505 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~57s 2023-12-03T12:06:39.813 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~63s 2023-12-03T12:06:46.124 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~69s 2023-12-03T12:06:46.779 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_invalid_range FAILED [ 65%] 2023-12-03T12:06:46.779 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_invalid_range ERROR [ 65%] 2023-12-03T12:06:52.431 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~76s 2023-12-03T12:06:58.302 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_without_range FAILED [ 65%] 2023-12-03T12:06:58.303 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_without_range ERROR [ 65%] 2023-12-03T12:06:58.739 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~82s 2023-12-03T12:07:05.048 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~88s 2023-12-03T12:07:10.469 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_special_names FAILED [ 65%] 2023-12-03T12:07:10.469 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_special_names ERROR [ 65%] 2023-12-03T12:07:11.358 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~95s 2023-12-03T12:07:17.667 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~101s 2023-12-03T12:07:23.977 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~107s 2023-12-03T12:07:30.285 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~114s 2023-12-03T12:07:31.253 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload FAILED [ 65%] 2023-12-03T12:07:31.254 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload ERROR [ 65%] 2023-12-03T12:07:36.595 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~120s 2023-12-03T12:07:41.904 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_versioned FAILED [ 65%] 2023-12-03T12:07:41.904 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_versioned ERROR [ 65%] 2023-12-03T12:07:42.904 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~126s 2023-12-03T12:07:49.213 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~132s 2023-12-03T12:07:54.359 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_resend_part FAILED [ 65%] 2023-12-03T12:07:54.359 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_resend_part ERROR [ 65%] 2023-12-03T12:07:55.522 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~139s 2023-12-03T12:08:01.831 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~145s 2023-12-03T12:08:08.141 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~151s 2023-12-03T12:08:08.450 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_multiple_sizes FAILED [ 65%] 2023-12-03T12:08:08.450 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_multiple_sizes ERROR [ 65%] 2023-12-03T12:08:14.450 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~158s 2023-12-03T12:08:20.759 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~164s 2023-12-03T12:08:25.349 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_multiple_sizes FAILED [ 66%] 2023-12-03T12:08:25.349 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_multiple_sizes ERROR [ 66%] 2023-12-03T12:08:27.069 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~170s 2023-12-03T12:08:33.378 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~177s 2023-12-03T12:08:38.444 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_size_too_small FAILED [ 66%] 2023-12-03T12:08:38.444 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_size_too_small ERROR [ 66%] 2023-12-03T12:08:39.687 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~183s 2023-12-03T12:08:45.994 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~189s 2023-12-03T12:08:52.303 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~196s 2023-12-03T12:08:54.990 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_contents FAILED [ 66%] 2023-12-03T12:08:54.990 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_contents ERROR [ 66%] 2023-12-03T12:08:58.612 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~202s 2023-12-03T12:09:04.921 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~208s 2023-12-03T12:09:11.231 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~215s 2023-12-03T12:09:15.335 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_overwrite_existing_object FAILED [ 66%] 2023-12-03T12:09:15.335 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_overwrite_existing_object ERROR [ 66%] 2023-12-03T12:09:17.538 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~221s 2023-12-03T12:09:23.846 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~227s 2023-12-03T12:09:30.156 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~233s 2023-12-03T12:09:30.946 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_abort_multipart_upload FAILED [ 66%] 2023-12-03T12:09:30.947 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_abort_multipart_upload ERROR [ 66%] 2023-12-03T12:09:36.465 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~240s 2023-12-03T12:09:42.775 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~246s 2023-12-03T12:09:49.084 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~252s 2023-12-03T12:09:53.323 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_abort_multipart_upload_not_found FAILED [ 66%] 2023-12-03T12:09:53.324 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_abort_multipart_upload_not_found ERROR [ 66%] 2023-12-03T12:09:55.392 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~259s 2023-12-03T12:10:01.701 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~265s 2023-12-03T12:10:08.011 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~271s 2023-12-03T12:10:13.376 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_list_multipart_upload FAILED [ 66%] 2023-12-03T12:10:13.376 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_list_multipart_upload ERROR [ 66%] 2023-12-03T12:10:14.322 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~278s 2023-12-03T12:10:20.631 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~284s 2023-12-03T12:10:26.195 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_list_multipart_upload_owner FAILED [ 67%] 2023-12-03T12:10:26.195 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_list_multipart_upload_owner ERROR [ 67%] 2023-12-03T12:10:26.940 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~290s 2023-12-03T12:10:33.247 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~297s 2023-12-03T12:10:39.556 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~303s 2023-12-03T12:10:39.556 INFO:tasks.daemonwatchdog.daemon_watchdog:BARK! unmounting mounts and killing all daemons 2023-12-03T12:10:40.865 INFO:tasks.ceph.osd.0:Sent signal 15 2023-12-03T12:10:40.866 INFO:tasks.ceph.osd.1:Sent signal 15 2023-12-03T12:10:40.866 INFO:tasks.ceph.osd.2:Sent signal 15 2023-12-03T12:10:40.866 INFO:tasks.ceph.osd.3:Sent signal 15 2023-12-03T12:10:40.867 INFO:tasks.ceph.osd.4:Sent signal 15 2023-12-03T12:10:40.867 INFO:tasks.ceph.osd.5:Sent signal 15 2023-12-03T12:10:40.867 INFO:tasks.ceph.osd.6:Sent signal 15 2023-12-03T12:10:40.867 INFO:tasks.ceph.osd.7:Sent signal 15 2023-12-03T12:10:40.867 INFO:tasks.ceph.mon.a:Sent signal 15 2023-12-03T12:10:40.868 INFO:tasks.ceph.mon.c:Sent signal 15 2023-12-03T12:10:40.868 INFO:tasks.ceph.mon.b:Sent signal 15 2023-12-03T12:10:40.868 INFO:tasks.ceph.mgr.y:Sent signal 15 2023-12-03T12:10:40.868 INFO:tasks.ceph.mgr.x:Sent signal 15 2023-12-03T12:10:40.869 INFO:tasks.ceph.osd.4.smithi037.stderr:2023-12-03T12:10:40.867+0000 7fb10c054640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 83850) UID: 0 2023-12-03T12:10:40.869 INFO:tasks.ceph.osd.4.smithi037.stderr:2023-12-03T12:10:40.867+0000 7fb10c054640 -1 osd.4 260 *** Got signal Terminated *** 2023-12-03T12:10:40.869 INFO:tasks.ceph.osd.0.smithi003.stderr:2023-12-03T12:10:40.865+0000 7f136cf9b640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 83888) UID: 0 2023-12-03T12:10:40.870 INFO:tasks.ceph.osd.0.smithi003.stderr:2023-12-03T12:10:40.865+0000 7f136cf9b640 -1 osd.0 260 *** Got signal Terminated *** 2023-12-03T12:10:40.870 INFO:tasks.ceph.osd.6.smithi037.stderr:2023-12-03T12:10:40.867+0000 7fc81163a640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 83856) UID: 0 2023-12-03T12:10:40.870 INFO:tasks.ceph.osd.6.smithi037.stderr:2023-12-03T12:10:40.867+0000 7fc81163a640 -1 osd.6 260 *** Got signal Terminated *** 2023-12-03T12:10:40.870 INFO:tasks.ceph.osd.1.smithi003.stderr:2023-12-03T12:10:40.865+0000 7f250ed86640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 83887) UID: 0 2023-12-03T12:10:40.870 INFO:tasks.ceph.osd.1.smithi003.stderr:2023-12-03T12:10:40.865+0000 7f250ed86640 -1 osd.1 260 *** Got signal Terminated *** 2023-12-03T12:10:40.871 INFO:tasks.ceph.osd.5.smithi037.stderr:2023-12-03T12:10:40.867+0000 7f2ef38b2640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 83852) UID: 0 2023-12-03T12:10:40.871 INFO:tasks.ceph.osd.5.smithi037.stderr:2023-12-03T12:10:40.867+0000 7f2ef38b2640 -1 osd.5 260 *** Got signal Terminated *** 2023-12-03T12:10:40.871 INFO:tasks.ceph.osd.2.smithi003.stderr:2023-12-03T12:10:40.866+0000 7f1388676640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 83891) UID: 0 2023-12-03T12:10:40.871 INFO:tasks.ceph.osd.2.smithi003.stderr:2023-12-03T12:10:40.866+0000 7f1388676640 -1 osd.2 260 *** Got signal Terminated *** 2023-12-03T12:10:40.871 INFO:tasks.ceph.osd.7.smithi037.stderr:2023-12-03T12:10:40.867+0000 7ffbf31eb640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 83854) UID: 0 2023-12-03T12:10:40.871 INFO:tasks.ceph.osd.7.smithi037.stderr:2023-12-03T12:10:40.867+0000 7ffbf31eb640 -1 osd.7 260 *** Got signal Terminated *** 2023-12-03T12:10:40.872 INFO:tasks.ceph.osd.3.smithi003.stderr:2023-12-03T12:10:40.866+0000 7fa1d9f24640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 83893) UID: 0 2023-12-03T12:10:40.872 INFO:tasks.ceph.osd.3.smithi003.stderr:2023-12-03T12:10:40.866+0000 7fa1d9f24640 -1 osd.3 260 *** Got signal Terminated *** 2023-12-03T12:10:40.872 INFO:tasks.ceph.mon.b.smithi037.stderr:2023-12-03T12:10:40.867+0000 7f4034bfd640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i b (PID: 83321) UID: 0 2023-12-03T12:10:40.872 INFO:tasks.ceph.mon.b.smithi037.stderr:2023-12-03T12:10:40.867+0000 7f4034bfd640 -1 mon.b@1(peon) e1 *** Got Signal Terminated *** 2023-12-03T12:10:40.872 INFO:tasks.ceph.mon.a.smithi003.stderr:2023-12-03T12:10:40.867+0000 7fbd2bc88640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i a (PID: 83580) UID: 0 2023-12-03T12:10:40.873 INFO:tasks.ceph.mon.a.smithi003.stderr:2023-12-03T12:10:40.867+0000 7fbd2bc88640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2023-12-03T12:10:40.873 INFO:tasks.ceph.mgr.x.smithi037.stderr:2023-12-03T12:10:40.868+0000 7f2c3bb4a640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mgr -f --cluster ceph -i x (PID: 83323) UID: 0 2023-12-03T12:10:40.873 INFO:tasks.ceph.mgr.x.smithi037.stderr:2023-12-03T12:10:40.868+0000 7f2c3bb4a640 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2023-12-03T12:10:40.873 INFO:tasks.ceph.mon.c.smithi003.stderr:2023-12-03T12:10:40.867+0000 7fef8a40f640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i c (PID: 83582) UID: 0 2023-12-03T12:10:40.873 INFO:tasks.ceph.mon.c.smithi003.stderr:2023-12-03T12:10:40.867+0000 7fef8a40f640 -1 mon.c@2(peon) e1 *** Got Signal Terminated *** 2023-12-03T12:10:41.070 INFO:tasks.ceph.mgr.y.smithi003.stderr:daemon-helper: command crashed with signal 15 2023-12-03T12:10:46.849 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_missing_part FAILED [ 67%] 2023-12-03T12:10:46.849 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_missing_part ERROR [ 67%] 2023-12-03T12:11:00.830 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_incorrect_etag FAILED [ 67%] 2023-12-03T12:11:00.830 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_incorrect_etag ERROR [ 67%] 2023-12-03T12:11:10.604 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_get_part FAILED [ 67%] 2023-12-03T12:11:10.605 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_get_part ERROR [ 67%] 2023-12-03T12:11:25.769 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_non_multipart_get_part FAILED [ 67%] 2023-12-03T12:11:25.769 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_non_multipart_get_part ERROR [ 67%] 2023-12-03T12:11:46.746 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_100_continue FAILED [ 67%] 2023-12-03T12:11:46.746 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_100_continue ERROR [ 67%] 2023-12-03T12:12:06.247 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_set_cors FAILED [ 68%] 2023-12-03T12:12:06.248 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_set_cors ERROR [ 68%] 2023-12-03T12:12:19.660 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_cors_origin_response FAILED [ 68%] 2023-12-03T12:12:19.661 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_cors_origin_response ERROR [ 68%] 2023-12-03T12:12:35.765 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_cors_origin_wildcard FAILED [ 68%] 2023-12-03T12:12:35.766 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_cors_origin_wildcard ERROR [ 68%] 2023-12-03T12:12:48.311 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_cors_header_option FAILED [ 68%] 2023-12-03T12:12:48.311 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_cors_header_option ERROR [ 68%] 2023-12-03T12:13:07.010 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_get_object FAILED [ 68%] 2023-12-03T12:13:07.010 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_get_object ERROR [ 68%] 2023-12-03T12:13:27.325 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_get_object_tenant FAILED [ 68%] 2023-12-03T12:13:27.325 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_get_object_tenant ERROR [ 68%] 2023-12-03T12:13:40.192 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_set_bucket_tagging FAILED [ 68%] 2023-12-03T12:13:40.193 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_set_bucket_tagging ERROR [ 68%] 2023-12-03T12:13:55.421 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_1mb FAILED [ 69%] 2023-12-03T12:13:55.421 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_1mb ERROR [ 69%] 2023-12-03T12:14:08.366 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_4mb FAILED [ 69%] 2023-12-03T12:14:08.366 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_4mb ERROR [ 69%] 2023-12-03T12:14:25.104 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_8mb FAILED [ 69%] 2023-12-03T12:14:25.104 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_8mb ERROR [ 69%] 2023-12-03T12:14:37.364 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_1mb FAILED [ 69%] 2023-12-03T12:14:37.364 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_1mb ERROR [ 69%] 2023-12-03T12:14:52.313 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_4mb FAILED [ 69%] 2023-12-03T12:14:52.313 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_4mb ERROR [ 69%] 2023-12-03T12:15:09.833 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_8mb FAILED [ 69%] 2023-12-03T12:15:09.834 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_8mb ERROR [ 69%] 2023-12-03T12:15:24.630 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_1mb FAILED [ 69%] 2023-12-03T12:15:24.631 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_1mb ERROR [ 69%] 2023-12-03T12:15:39.186 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_4mb FAILED [ 70%] 2023-12-03T12:15:39.187 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_4mb ERROR [ 70%] 2023-12-03T12:15:53.818 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_8mb FAILED [ 70%] 2023-12-03T12:15:53.818 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_8mb ERROR [ 70%] 2023-12-03T12:16:05.788 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_conditional_write_1mb FAILED [ 70%] 2023-12-03T12:16:05.788 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_conditional_write_1mb ERROR [ 70%] 2023-12-03T12:16:21.620 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_multipart_upload_write FAILED [ 70%] 2023-12-03T12:16:21.620 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_multipart_upload_write ERROR [ 70%] 2023-12-03T12:16:33.391 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_resend_first_finishes_last FAILED [ 70%] 2023-12-03T12:16:33.391 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_resend_first_finishes_last ERROR [ 70%] 2023-12-03T12:16:44.902 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_response_code FAILED [ 70%] 2023-12-03T12:16:44.905 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_response_code ERROR [ 70%] 2023-12-03T12:17:09.874 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_big_request_response_code FAILED [ 71%] 2023-12-03T12:17:09.875 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_big_request_response_code ERROR [ 71%] 2023-12-03T12:17:27.495 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_skip_leading_bytes_response_code FAILED [ 71%] 2023-12-03T12:17:27.495 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_skip_leading_bytes_response_code ERROR [ 71%] 2023-12-03T12:17:38.244 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_return_trailing_bytes_response_code FAILED [ 71%] 2023-12-03T12:17:38.244 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_return_trailing_bytes_response_code ERROR [ 71%] 2023-12-03T12:17:49.002 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_invalid_range FAILED [ 71%] 2023-12-03T12:17:49.002 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_invalid_range ERROR [ 71%] 2023-12-03T12:18:10.180 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_empty_object FAILED [ 71%] 2023-12-03T12:18:10.181 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_empty_object ERROR [ 71%] 2023-12-03T12:18:27.545 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_create_suspend FAILED [ 71%] 2023-12-03T12:18:27.546 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_create_suspend ERROR [ 71%] 2023-12-03T12:18:48.942 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove FAILED [ 71%] 2023-12-03T12:18:48.942 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove ERROR [ 71%] 2023-12-03T12:19:06.004 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove_head FAILED [ 72%] 2023-12-03T12:19:06.005 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove_head ERROR [ 72%] 2023-12-03T12:19:17.521 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_removal FAILED [ 72%] 2023-12-03T12:19:17.522 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_removal ERROR [ 72%] 2023-12-03T12:19:30.438 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite FAILED [ 72%] 2023-12-03T12:19:30.438 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite ERROR [ 72%] 2023-12-03T12:19:51.235 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite_suspended FAILED [ 72%] 2023-12-03T12:19:51.236 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite_suspended ERROR [ 72%] 2023-12-03T12:20:02.790 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_suspend_versions FAILED [ 72%] 2023-12-03T12:20:02.790 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_suspend_versions ERROR [ 72%] 2023-12-03T12:20:17.810 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_all FAILED [ 72%] 2023-12-03T12:20:17.810 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_all ERROR [ 72%] 2023-12-03T12:20:39.641 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_special_names FAILED [ 73%] 2023-12-03T12:20:39.641 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_special_names ERROR [ 73%] 2023-12-03T12:20:57.934 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_overwrite_multipart FAILED [ 73%] 2023-12-03T12:20:57.935 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_overwrite_multipart ERROR [ 73%] 2023-12-03T12:21:15.143 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_list_marker FAILED [ 73%] 2023-12-03T12:21:15.143 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_list_marker ERROR [ 73%] 2023-12-03T12:21:29.856 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_copy_obj_version FAILED [ 73%] 2023-12-03T12:21:29.856 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_copy_obj_version ERROR [ 73%] 2023-12-03T12:21:52.214 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete FAILED [ 73%] 2023-12-03T12:21:52.214 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete ERROR [ 73%] 2023-12-03T12:22:10.111 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker FAILED [ 73%] 2023-12-03T12:22:10.112 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker ERROR [ 73%] 2023-12-03T12:22:27.789 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker_create FAILED [ 73%] 2023-12-03T12:22:27.789 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker_create ERROR [ 73%] 2023-12-03T12:22:45.444 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_object_acl FAILED [ 74%] 2023-12-03T12:22:45.444 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_object_acl ERROR [ 74%] 2023-12-03T12:23:04.235 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_object_acl_no_version_specified FAILED [ 74%] 2023-12-03T12:23:04.235 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_object_acl_no_version_specified ERROR [ 74%] 2023-12-03T12:23:16.139 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_concurrent_object_create_and_remove FAILED [ 74%] 2023-12-03T12:23:16.139 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_concurrent_object_create_and_remove ERROR [ 74%] 2023-12-03T12:23:33.096 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set FAILED [ 74%] 2023-12-03T12:23:33.097 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set ERROR [ 74%] 2023-12-03T12:23:55.100 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_get FAILED [ 74%] 2023-12-03T12:23:55.100 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_get ERROR [ 74%] 2023-12-03T12:24:11.955 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_get_no_id FAILED [ 74%] 2023-12-03T12:24:11.955 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_get_no_id ERROR [ 74%] 2023-12-03T12:24:26.735 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_id_too_long FAILED [ 74%] 2023-12-03T12:24:26.735 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_id_too_long ERROR [ 74%] 2023-12-03T12:24:43.378 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_same_id FAILED [ 75%] 2023-12-03T12:24:43.378 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_same_id ERROR [ 75%] 2023-12-03T12:24:58.224 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_invalid_status FAILED [ 75%] 2023-12-03T12:24:58.224 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_invalid_status ERROR [ 75%] 2023-12-03T12:25:08.244 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_date FAILED [ 75%] 2023-12-03T12:25:08.244 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_date ERROR [ 75%] 2023-12-03T12:25:22.410 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_invalid_date FAILED [ 75%] 2023-12-03T12:25:22.410 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_invalid_date ERROR [ 75%] 2023-12-03T12:25:33.041 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_noncurrent FAILED [ 75%] 2023-12-03T12:25:33.041 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_noncurrent ERROR [ 75%] 2023-12-03T12:25:49.951 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_deletemarker FAILED [ 75%] 2023-12-03T12:25:49.951 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_deletemarker ERROR [ 75%] 2023-12-03T12:26:14.042 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_filter FAILED [ 76%] 2023-12-03T12:26:14.042 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_filter ERROR [ 76%] 2023-12-03T12:26:33.213 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_empty_filter FAILED [ 76%] 2023-12-03T12:26:33.213 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_empty_filter ERROR [ 76%] 2023-12-03T12:26:45.732 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_multipart FAILED [ 76%] 2023-12-03T12:26:45.732 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_multipart ERROR [ 76%] 2023-12-03T12:27:04.599 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_transition_set_invalid_date FAILED [ 76%] 2023-12-03T12:27:04.600 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_transition_set_invalid_date ERROR [ 76%] 2023-12-03T12:27:19.706 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1b FAILED [ 76%] 2023-12-03T12:27:19.706 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1b ERROR [ 76%] 2023-12-03T12:27:37.914 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1kb FAILED [ 76%] 2023-12-03T12:27:37.914 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1kb ERROR [ 76%] 2023-12-03T12:27:58.217 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1MB FAILED [ 76%] 2023-12-03T12:27:58.217 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1MB ERROR [ 76%] 2023-12-03T12:28:10.415 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_13b FAILED [ 77%] 2023-12-03T12:28:10.415 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_13b ERROR [ 77%] 2023-12-03T12:28:28.179 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_method_head FAILED [ 77%] 2023-12-03T12:28:28.179 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_method_head ERROR [ 77%] 2023-12-03T12:28:43.573 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_present FAILED [ 77%] 2023-12-03T12:28:43.573 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_present ERROR [ 77%] 2023-12-03T12:28:58.035 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_other_key FAILED [ 77%] 2023-12-03T12:28:58.036 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_other_key ERROR [ 77%] 2023-12-03T12:29:14.900 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_invalid_md5 FAILED [ 77%] 2023-12-03T12:29:14.900 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_invalid_md5 ERROR [ 77%] 2023-12-03T12:29:32.775 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_md5 FAILED [ 77%] 2023-12-03T12:29:32.775 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_md5 ERROR [ 77%] 2023-12-03T12:29:50.856 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_key FAILED [ 77%] 2023-12-03T12:29:50.856 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_key ERROR [ 77%] 2023-12-03T12:30:11.937 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_key_no_sse_c FAILED [ 78%] 2023-12-03T12:30:11.937 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_key_no_sse_c ERROR [ 78%] 2023-12-03T12:30:28.234 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_upload FAILED [ 78%] 2023-12-03T12:30:28.234 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_upload ERROR [ 78%] 2023-12-03T12:30:45.347 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_unaligned_multipart_upload FAILED [ 78%] 2023-12-03T12:30:45.347 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_unaligned_multipart_upload ERROR [ 78%] 2023-12-03T12:30:59.072 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_bad_download FAILED [ 78%] 2023-12-03T12:30:59.072 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_bad_download ERROR [ 78%] 2023-12-03T12:31:13.445 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_post_object_authenticated_request FAILED [ 78%] 2023-12-03T12:31:13.445 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_post_object_authenticated_request ERROR [ 78%] 2023-12-03T12:31:23.373 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_method_head FAILED [ 78%] 2023-12-03T12:31:23.374 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_method_head ERROR [ 78%] 2023-12-03T12:31:43.355 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_present FAILED [ 79%] 2023-12-03T12:31:43.355 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_present ERROR [ 79%] 2023-12-03T12:31:54.195 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_no_key FAILED [ 79%] 2023-12-03T12:31:54.196 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_no_key ERROR [ 79%] 2023-12-03T12:32:11.563 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_not_declared FAILED [ 79%] 2023-12-03T12:32:11.564 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_not_declared ERROR [ 79%] 2023-12-03T12:32:31.143 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_upload FAILED [ 79%] 2023-12-03T12:32:31.144 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_upload ERROR [ 79%] 2023-12-03T12:32:43.389 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_1 FAILED [ 79%] 2023-12-03T12:32:43.389 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_1 ERROR [ 79%] 2023-12-03T12:33:01.294 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_2 FAILED [ 79%] 2023-12-03T12:33:01.294 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_2 ERROR [ 79%] 2023-12-03T12:33:17.698 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_post_object_authenticated_request FAILED [ 79%] 2023-12-03T12:33:17.698 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_post_object_authenticated_request ERROR [ 79%] 2023-12-03T12:33:33.709 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1b FAILED [ 80%] 2023-12-03T12:33:33.709 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1b ERROR [ 80%] 2023-12-03T12:33:50.709 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1kb FAILED [ 80%] 2023-12-03T12:33:50.709 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1kb ERROR [ 80%] 2023-12-03T12:34:00.830 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1MB FAILED [ 80%] 2023-12-03T12:34:00.830 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1MB ERROR [ 80%] 2023-12-03T12:34:16.677 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_13b FAILED [ 80%] 2023-12-03T12:34:16.677 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_13b ERROR [ 80%] 2023-12-03T12:34:31.412 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_read_declare FAILED [ 80%] 2023-12-03T12:34:31.412 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_read_declare ERROR [ 80%] 2023-12-03T12:34:53.770 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy FAILED [ 80%] 2023-12-03T12:34:53.770 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy ERROR [ 80%] 2023-12-03T12:35:10.860 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy FAILED [ 80%] 2023-12-03T12:35:10.860 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy ERROR [ 80%] 2023-12-03T12:35:25.636 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_acl FAILED [ 81%] 2023-12-03T12:35:25.637 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_acl ERROR [ 81%] 2023-12-03T12:35:46.528 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_acl FAILED [ 81%] 2023-12-03T12:35:46.529 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_acl ERROR [ 81%] 2023-12-03T12:36:02.589 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_another_bucket FAILED [ 81%] 2023-12-03T12:36:02.589 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_another_bucket ERROR [ 81%] 2023-12-03T12:36:25.841 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_another_bucket FAILED [ 81%] 2023-12-03T12:36:25.841 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_another_bucket ERROR [ 81%] 2023-12-03T12:36:44.814 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_get_obj_tagging FAILED [ 81%] 2023-12-03T12:36:44.814 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_get_obj_tagging ERROR [ 81%] 2023-12-03T12:37:03.517 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_get_obj_head_tagging FAILED [ 81%] 2023-12-03T12:37:03.517 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_get_obj_head_tagging ERROR [ 81%] 2023-12-03T12:37:15.656 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_put_max_tags FAILED [ 82%] 2023-12-03T12:37:15.657 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_put_max_tags ERROR [ 82%] 2023-12-03T12:37:31.343 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_tags FAILED [ 82%] 2023-12-03T12:37:31.343 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_tags ERROR [ 82%] 2023-12-03T12:37:48.572 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_put_max_kvsize_tags FAILED [ 82%] 2023-12-03T12:37:48.572 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_put_max_kvsize_tags ERROR [ 82%] 2023-12-03T12:38:06.200 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_key_tags FAILED [ 82%] 2023-12-03T12:38:06.200 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_key_tags ERROR [ 82%] 2023-12-03T12:38:24.800 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_val_tags FAILED [ 82%] 2023-12-03T12:38:24.800 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_val_tags ERROR [ 82%] 2023-12-03T12:38:37.032 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_put_modify_tags FAILED [ 82%] 2023-12-03T12:38:37.032 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_put_modify_tags ERROR [ 82%] 2023-12-03T12:38:53.414 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_put_delete_tags FAILED [ 82%] 2023-12-03T12:38:53.414 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_put_delete_tags ERROR [ 82%] 2023-12-03T12:39:10.182 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_tags_anonymous_request FAILED [ 83%] 2023-12-03T12:39:10.182 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_tags_anonymous_request ERROR [ 83%] 2023-12-03T12:39:30.079 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_tags_authenticated_request FAILED [ 83%] 2023-12-03T12:39:30.079 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_tags_authenticated_request ERROR [ 83%] 2023-12-03T12:39:44.328 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_with_tags FAILED [ 83%] 2023-12-03T12:39:44.328 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_with_tags ERROR [ 83%] 2023-12-03T12:40:02.792 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_get_tags_acl_public FAILED [ 83%] 2023-12-03T12:40:02.792 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_get_tags_acl_public ERROR [ 83%] 2023-12-03T12:40:17.518 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_put_tags_acl_public FAILED [ 83%] 2023-12-03T12:40:17.518 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_put_tags_acl_public ERROR [ 83%] 2023-12-03T12:40:36.279 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_delete_tags_obj_public FAILED [ 83%] 2023-12-03T12:40:36.279 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_delete_tags_obj_public ERROR [ 83%] 2023-12-03T12:40:57.347 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_atomic_upload_return_version_id FAILED [ 84%] 2023-12-03T12:40:57.348 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_atomic_upload_return_version_id ERROR [ 84%] 2023-12-03T12:41:11.475 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_multipart_upload_return_version_id FAILED [ 84%] 2023-12-03T12:41:11.475 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_multipart_upload_return_version_id ERROR [ 84%] 2023-12-03T12:41:25.216 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_existing_tag FAILED [ 84%] 2023-12-03T12:41:25.216 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_existing_tag ERROR [ 84%] 2023-12-03T12:41:40.617 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_tagging_existing_tag FAILED [ 84%] 2023-12-03T12:41:40.617 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_tagging_existing_tag ERROR [ 84%] 2023-12-03T12:41:54.831 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_tagging_existing_tag FAILED [ 84%] 2023-12-03T12:41:54.832 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_tagging_existing_tag ERROR [ 84%] 2023-12-03T12:42:14.248 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source FAILED [ 84%] 2023-12-03T12:42:14.248 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source ERROR [ 84%] 2023-12-03T12:42:34.303 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source_meta FAILED [ 84%] 2023-12-03T12:42:34.304 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source_meta ERROR [ 84%] 2023-12-03T12:42:53.057 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_acl FAILED [ 85%] 2023-12-03T12:42:53.058 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_acl ERROR [ 85%] 2023-12-03T12:43:07.718 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_grant FAILED [ 85%] 2023-12-03T12:43:07.718 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_grant ERROR [ 85%] 2023-12-03T12:43:21.149 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_s3 FAILED [ 85%] 2023-12-03T12:43:21.150 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_s3 ERROR [ 85%] 2023-12-03T12:43:44.214 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_kms FAILED [ 85%] 2023-12-03T12:43:44.215 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_kms ERROR [ 85%] 2023-12-03T12:44:00.426 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_s3_kms FAILED [ 85%] 2023-12-03T12:44:00.427 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_s3_kms ERROR [ 85%] 2023-12-03T12:44:17.231 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_bad_enc_kms FAILED [ 85%] 2023-12-03T12:44:17.231 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_bad_enc_kms ERROR [ 85%] 2023-12-03T12:44:32.168 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_noenc FAILED [ 85%] 2023-12-03T12:44:32.168 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_noenc ERROR [ 85%] 2023-12-03T12:44:41.446 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_s3 FAILED [ 86%] 2023-12-03T12:44:41.446 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_s3 ERROR [ 86%] 2023-12-03T12:44:59.042 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_acl_existing_tag FAILED [ 86%] 2023-12-03T12:44:59.043 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_acl_existing_tag ERROR [ 86%] 2023-12-03T12:45:15.003 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock FAILED [ 86%] 2023-12-03T12:45:15.003 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock ERROR [ 86%] 2023-12-03T12:45:31.337 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_bucket FAILED [ 86%] 2023-12-03T12:45:31.338 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_bucket ERROR [ 86%] 2023-12-03T12:45:52.958 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_with_days_and_years FAILED [ 86%] 2023-12-03T12:45:52.959 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_with_days_and_years ERROR [ 86%] 2023-12-03T12:46:05.727 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_days FAILED [ 86%] 2023-12-03T12:46:05.728 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_days ERROR [ 86%] 2023-12-03T12:46:25.203 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_years FAILED [ 87%] 2023-12-03T12:46:25.204 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_years ERROR [ 87%] 2023-12-03T12:46:35.263 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_mode FAILED [ 87%] 2023-12-03T12:46:35.263 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_mode ERROR [ 87%] 2023-12-03T12:46:56.547 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_status FAILED [ 87%] 2023-12-03T12:46:56.547 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_status ERROR [ 87%] 2023-12-03T12:47:13.748 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_suspend_versioning FAILED [ 87%] 2023-12-03T12:47:13.748 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_suspend_versioning ERROR [ 87%] 2023-12-03T12:47:35.738 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock FAILED [ 87%] 2023-12-03T12:47:35.738 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock ERROR [ 87%] 2023-12-03T12:47:50.634 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock_invalid_bucket FAILED [ 87%] 2023-12-03T12:47:50.634 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock_invalid_bucket ERROR [ 87%] 2023-12-03T12:48:07.012 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention FAILED [ 87%] 2023-12-03T12:48:07.012 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention ERROR [ 87%] 2023-12-03T12:48:27.178 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_bucket FAILED [ 88%] 2023-12-03T12:48:27.178 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_bucket ERROR [ 88%] 2023-12-03T12:48:43.630 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_mode FAILED [ 88%] 2023-12-03T12:48:43.630 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_mode ERROR [ 88%] 2023-12-03T12:48:59.005 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention FAILED [ 88%] 2023-12-03T12:48:59.005 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention ERROR [ 88%] 2023-12-03T12:49:08.527 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_iso8601 FAILED [ 88%] 2023-12-03T12:49:08.528 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_iso8601 ERROR [ 88%] 2023-12-03T12:49:24.242 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_invalid_bucket FAILED [ 88%] 2023-12-03T12:49:24.242 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_invalid_bucket ERROR [ 88%] 2023-12-03T12:49:37.432 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_versionid FAILED [ 88%] 2023-12-03T12:49:37.432 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_versionid ERROR [ 88%] 2023-12-03T12:50:00.598 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_override_default_retention FAILED [ 88%] 2023-12-03T12:50:00.599 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_override_default_retention ERROR [ 88%] 2023-12-03T12:50:13.365 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_increase_period FAILED [ 89%] 2023-12-03T12:50:13.365 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_increase_period ERROR [ 89%] 2023-12-03T12:50:31.680 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period FAILED [ 89%] 2023-12-03T12:50:31.680 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period ERROR [ 89%] 2023-12-03T12:50:46.893 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period_bypass FAILED [ 89%] 2023-12-03T12:50:46.894 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period_bypass ERROR [ 89%] 2023-12-03T12:51:00.519 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention FAILED [ 89%] 2023-12-03T12:51:00.519 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention ERROR [ 89%] 2023-12-03T12:51:13.985 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention_and_marker FAILED [ 89%] 2023-12-03T12:51:13.985 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention_and_marker ERROR [ 89%] 2023-12-03T12:51:35.028 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_multi_delete_object_with_retention FAILED [ 89%] 2023-12-03T12:51:35.028 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_multi_delete_object_with_retention ERROR [ 89%] 2023-12-03T12:51:53.109 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold FAILED [ 90%] 2023-12-03T12:51:53.109 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold ERROR [ 90%] 2023-12-03T12:52:15.851 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_bucket FAILED [ 90%] 2023-12-03T12:52:15.851 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_bucket ERROR [ 90%] 2023-12-03T12:52:29.642 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_status FAILED [ 90%] 2023-12-03T12:52:29.643 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_status ERROR [ 90%] 2023-12-03T12:52:45.952 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold FAILED [ 90%] 2023-12-03T12:52:45.952 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold ERROR [ 90%] 2023-12-03T12:52:59.923 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold_invalid_bucket FAILED [ 90%] 2023-12-03T12:52:59.923 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold_invalid_bucket ERROR [ 90%] 2023-12-03T12:53:11.936 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_on FAILED [ 90%] 2023-12-03T12:53:11.937 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_on ERROR [ 90%] 2023-12-03T12:53:29.003 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_off FAILED [ 90%] 2023-12-03T12:53:29.003 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_off ERROR [ 90%] 2023-12-03T12:53:46.023 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_metadata FAILED [ 91%] 2023-12-03T12:53:46.023 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_metadata ERROR [ 91%] 2023-12-03T12:54:04.155 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_uploading_obj FAILED [ 91%] 2023-12-03T12:54:04.155 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_uploading_obj ERROR [ 91%] 2023-12-03T12:54:22.529 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_with_bypass FAILED [ 91%] 2023-12-03T12:54:22.530 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_with_bypass ERROR [ 91%] 2023-12-03T12:54:35.783 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_without_bypass FAILED [ 91%] 2023-12-03T12:54:35.784 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_without_bypass ERROR [ 91%] 2023-12-03T12:54:52.524 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_compliance FAILED [ 91%] 2023-12-03T12:54:52.525 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_compliance ERROR [ 91%] 2023-12-03T12:55:04.747 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_copy_object_ifmatch_good FAILED [ 91%] 2023-12-03T12:55:04.748 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_copy_object_ifmatch_good ERROR [ 91%] 2023-12-03T12:55:28.620 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_copy_object_ifnonematch_failed FAILED [ 92%] 2023-12-03T12:55:28.620 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_copy_object_ifnonematch_failed ERROR [ 92%] 2023-12-03T12:55:47.112 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_get_bucket_policy_status FAILED [ 92%] 2023-12-03T12:55:47.112 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_get_bucket_policy_status ERROR [ 92%] 2023-12-03T12:56:01.593 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_get_public_acl_bucket_policy_status FAILED [ 92%] 2023-12-03T12:56:01.594 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_get_public_acl_bucket_policy_status ERROR [ 92%] 2023-12-03T12:56:11.200 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_get_authpublic_acl_bucket_policy_status FAILED [ 92%] 2023-12-03T12:56:11.200 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_get_authpublic_acl_bucket_policy_status ERROR [ 92%] 2023-12-03T12:56:27.982 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_get_publicpolicy_acl_bucket_policy_status FAILED [ 92%] 2023-12-03T12:56:27.982 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_get_publicpolicy_acl_bucket_policy_status ERROR [ 92%] 2023-12-03T12:56:42.692 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_acl_bucket_policy_status FAILED [ 92%] 2023-12-03T12:56:42.693 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_acl_bucket_policy_status ERROR [ 92%] 2023-12-03T12:56:58.108 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_deny_bucket_policy_status FAILED [ 92%] 2023-12-03T12:56:58.108 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_deny_bucket_policy_status ERROR [ 92%] 2023-12-03T12:57:16.034 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_get_default_public_block FAILED [ 93%] 2023-12-03T12:57:16.035 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_get_default_public_block ERROR [ 93%] 2023-12-03T12:57:30.147 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_put_public_block FAILED [ 93%] 2023-12-03T12:57:30.147 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_put_public_block ERROR [ 93%] 2023-12-03T12:57:45.889 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_put_bucket_acls FAILED [ 93%] 2023-12-03T12:57:45.889 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_put_bucket_acls ERROR [ 93%] 2023-12-03T12:58:02.135 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_object_canned_acls FAILED [ 93%] 2023-12-03T12:58:02.135 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_object_canned_acls ERROR [ 93%] 2023-12-03T12:58:13.592 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_policy FAILED [ 93%] 2023-12-03T12:58:13.592 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_policy ERROR [ 93%] 2023-12-03T12:58:26.338 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_ignore_public_acls FAILED [ 93%] 2023-12-03T12:58:26.338 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_ignore_public_acls ERROR [ 93%] 2023-12-03T12:58:41.364 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_on_a_bucket_with_policy FAILED [ 93%] 2023-12-03T12:58:41.364 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_on_a_bucket_with_policy ERROR [ 93%] 2023-12-03T12:59:02.413 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_put_bucket_encryption_kms FAILED [ 94%] 2023-12-03T12:59:02.413 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_put_bucket_encryption_kms ERROR [ 94%] 2023-12-03T12:59:15.466 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_get_bucket_encryption_kms FAILED [ 94%] 2023-12-03T12:59:15.467 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_get_bucket_encryption_kms ERROR [ 94%] 2023-12-03T12:59:29.220 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_delete_bucket_encryption_kms FAILED [ 94%] 2023-12-03T12:59:29.220 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_delete_bucket_encryption_kms ERROR [ 94%] 2023-12-03T12:59:42.509 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_default_post_object_authenticated_request FAILED [ 94%] 2023-12-03T12:59:42.509 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_default_post_object_authenticated_request ERROR [ 94%] 2023-12-03T12:59:58.261 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_torrent FAILED [ 94%] 2023-12-03T12:59:58.261 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_torrent ERROR [ 94%] 2023-12-03T13:00:06.809 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3select.py::test_generate_where_clause ERROR [ 94%] 2023-12-03T13:00:07.068 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3select.py::test_generate_projection ERROR [ 95%] 2023-12-03T13:00:07.245 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3select.py::test_count_operation ERROR [ 95%] 2023-12-03T13:00:07.500 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3select.py::test_count_json_operation ERROR [ 95%] 2023-12-03T13:00:07.679 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3select.py::test_json_column_sum_min_max ERROR [ 95%] 2023-12-03T13:00:07.927 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3select.py::test_json_nullif_expressions ERROR [ 95%] 2023-12-03T13:00:08.184 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3select.py::test_column_sum_min_max ERROR [ 95%] 2023-12-03T13:00:08.367 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3select.py::test_nullif_expressions ERROR [ 95%] 2023-12-03T13:00:08.618 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3select.py::test_nulliftrue_expressions ERROR [ 96%] 2023-12-03T13:00:08.881 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3select.py::test_is_not_null_expressions ERROR [ 96%] 2023-12-03T13:00:09.061 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3select.py::test_lowerupper_expressions ERROR [ 96%] 2023-12-03T13:00:09.322 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3select.py::test_in_expressions ERROR [ 96%] 2023-12-03T13:00:09.500 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3select.py::test_true_false_in_expressions ERROR [ 96%] 2023-12-03T13:00:09.755 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3select.py::test_like_expressions ERROR [ 96%] 2023-12-03T13:00:10.022 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3select.py::test_truefalselike_expressions ERROR [ 96%] 2023-12-03T13:00:10.203 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3select.py::test_complex_expressions ERROR [ 97%] 2023-12-03T13:00:10.458 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3select.py::test_alias ERROR [ 97%] 2023-12-03T13:00:10.642 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3select.py::test_alias_cyclic_refernce ERROR [ 97%] 2023-12-03T13:00:10.892 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3select.py::test_datetime ERROR [ 97%] 2023-12-03T13:00:11.151 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3select.py::test_true_false_datetime ERROR [ 97%] 2023-12-03T13:00:11.330 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3select.py::test_csv_parser ERROR [ 97%] 2023-12-03T13:00:11.586 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3select.py::test_csv_definition ERROR [ 98%] 2023-12-03T13:00:11.852 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3select.py::test_schema_definition ERROR [ 98%] 2023-12-03T13:00:12.037 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3select.py::test_when_then_else_expressions ERROR [ 98%] 2023-12-03T13:00:12.299 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3select.py::test_coalesce_expressions ERROR [ 98%] 2023-12-03T13:00:12.477 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3select.py::test_cast_expressions ERROR [ 98%] 2023-12-03T13:00:12.730 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3select.py::test_version ERROR [ 98%] 2023-12-03T13:00:12.996 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3select.py::test_trim_expressions ERROR [ 98%] 2023-12-03T13:00:13.181 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3select.py::test_truefalse_trim_expressions ERROR [ 99%] 2023-12-03T13:00:13.439 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3select.py::test_escape_expressions ERROR [ 99%] 2023-12-03T13:00:13.619 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3select.py::test_case_value_expressions ERROR [ 99%] 2023-12-03T13:00:13.868 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3select.py::test_bool_cast_expressions ERROR [ 99%] 2023-12-03T13:00:14.135 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3select.py::test_progress_expressions ERROR [ 99%] 2023-12-03T13:00:14.320 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3select.py::test_output_serial_expressions ERROR [ 99%] 2023-12-03T13:00:14.341 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_utils.py::test_generate PASSED [100%] 2023-12-03T13:00:14.341 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.341 INFO:teuthology.orchestra.run.smithi003.stdout:==================================== ERRORS ==================================== 2023-12-03T13:00:14.341 INFO:teuthology.orchestra.run.smithi003.stdout:_______________ ERROR at teardown of test_multipart_upload_empty _______________ 2023-12-03T13:00:14.341 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.341 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:14.341 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.341 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:14.341 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:14.342 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.342 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:14.342 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:14.342 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:14.342 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:14.342 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:14.342 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.342 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:14.342 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:14.342 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.342 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.342 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:14.342 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:14.342 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.343 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.343 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:14.343 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.343 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:14.343 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:14.343 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.343 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.343 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:14.343 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:14.343 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.343 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:14.343 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:14.343 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:14.343 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:14.344 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:14.344 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:14.344 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:14.344 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.344 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:14.344 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:14.344 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:14.344 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:14.344 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:14.344 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:14.344 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:14.344 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:14.344 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:14.344 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.345 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:14.345 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:14.345 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:14.345 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:14.345 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.345 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:14.345 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:14.345 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:14.345 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:14.345 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.345 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.345 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:14.345 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:14.345 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:14.345 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:14.346 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.346 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.346 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:14.346 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:14.346 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:14.346 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.346 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:14.346 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.346 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:14.346 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:14.346 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.346 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:14.347 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:14.347 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:14.347 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:14.347 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:14.347 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:14.347 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.347 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:14.347 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.347 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:14.347 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.347 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:14.347 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:14.347 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.347 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:14.347 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.347 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:14.348 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:14.348 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:14.348 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:14.348 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:14.348 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:14.348 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:14.348 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:14.348 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:14.348 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:14.348 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:14.348 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:14.348 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:14.348 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.348 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:14.348 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:14.349 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:14.349 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:14.349 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:14.349 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:14.349 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:14.349 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:14.349 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:14.349 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:14.349 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:14.349 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.349 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.349 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:14.349 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.349 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:14.349 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:14.350 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:14.350 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:14.350 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:14.350 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:14.350 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:14.350 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:14.350 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:14.350 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:14.350 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:14.350 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:14.350 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:14.350 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:14.350 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:14.350 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:14.350 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:14.351 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:14.351 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:14.351 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:14.351 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:14.351 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:14.351 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:14.351 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:14.351 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:14.351 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:14.351 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:14.351 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:14.351 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.351 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.351 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:14.352 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.352 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:14.352 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:14.352 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.352 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:14.352 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:14.352 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:14.352 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:14.352 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:14.352 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.352 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:14.352 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:14.352 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.353 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.353 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:14.353 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:14.353 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.353 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.353 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:14.353 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:14.353 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:14.353 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:14.353 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:14.353 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.353 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.353 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:14.353 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:14.354 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:14.354 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.354 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:14.354 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.359 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:14.359 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.359 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:14.359 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.359 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:14.359 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.359 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:14.359 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:14.359 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:14.360 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:14.360 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.360 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:14.360 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.360 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:14.360 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:14.360 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:14.360 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:14.360 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:14.360 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:14.360 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:14.360 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:14.360 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:14.360 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:14.360 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:14.361 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:14.361 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:14.361 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:14.361 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:14.361 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:14.361 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:14.361 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:14.361 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:14.361 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:14.361 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:14.361 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:14.361 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:14.361 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:14.362 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:14.362 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:14.362 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:14.362 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:14.362 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:14.362 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:14.362 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:14.362 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:14.362 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:14.362 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:14.362 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:14.362 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:14.362 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:14.363 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:14.363 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:14.363 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:14.363 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.363 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.363 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:14.363 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:14.363 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.363 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:14.363 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.363 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:14.363 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:14.363 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:14.363 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:14.363 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:14.364 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:14.364 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:14.364 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:14.364 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:14.364 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:14.364 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:14.364 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:14.364 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:14.364 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.364 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:14.364 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:14.364 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:14.364 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:14.364 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:14.365 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:14.365 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:14.365 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:14.365 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:14.365 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:14.365 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:14.365 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.365 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.365 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:14.365 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:14.365 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:14.365 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:14.365 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:14.365 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.365 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.366 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:14.366 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:14.366 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:14.366 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:14.366 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:14.366 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.366 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:14.366 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:14.366 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:14.366 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:14.366 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:14.366 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:14.366 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.366 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:14.367 INFO:teuthology.orchestra.run.smithi003.stdout:_______________ ERROR at teardown of test_multipart_upload_small _______________ 2023-12-03T13:00:14.367 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.367 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:14.367 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.367 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:14.367 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:14.367 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.367 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:14.367 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:14.367 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:14.367 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:14.367 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:14.367 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.367 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:14.368 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:14.368 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.368 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.368 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:14.368 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:14.368 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.368 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.368 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:14.368 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.368 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:14.368 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:14.368 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.368 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.368 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:14.368 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:14.368 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.369 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:14.369 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:14.369 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:14.369 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:14.369 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:14.369 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:14.369 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:14.369 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.369 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:14.369 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:14.369 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:14.369 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:14.369 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:14.369 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:14.369 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:14.369 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:14.370 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:14.370 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.370 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:14.370 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:14.370 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:14.370 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:14.370 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.370 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:14.370 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:14.370 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:14.370 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:14.370 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.371 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.371 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:14.371 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:14.371 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:14.371 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:14.371 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.371 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.371 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:14.371 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:14.371 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:14.371 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.371 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:14.371 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.372 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:14.372 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:14.372 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.372 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:14.372 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:14.372 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:14.372 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:14.372 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:14.372 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:14.372 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.372 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:14.372 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.372 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:14.372 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.372 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:14.373 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:14.373 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.373 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:14.373 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.373 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:14.373 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:14.373 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:14.373 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:14.373 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:14.373 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:14.373 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:14.373 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:14.373 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:14.373 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:14.373 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:14.374 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:14.374 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:14.374 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.374 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:14.374 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:14.374 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:14.374 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:14.374 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:14.374 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:14.374 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:14.374 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:14.374 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:14.374 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:14.374 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:14.375 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.375 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.375 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:14.375 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.375 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:14.375 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:14.375 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:14.375 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:14.375 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:14.375 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:14.375 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:14.375 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:14.375 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:14.375 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:14.375 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:14.376 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:14.376 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:14.376 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:14.376 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:14.376 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:14.376 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:14.376 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:14.376 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:14.376 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:14.376 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:14.376 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:14.376 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:14.376 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:14.376 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:14.376 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:14.377 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:14.377 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:14.377 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.377 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.377 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:14.377 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.377 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:14.377 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:14.377 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.377 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:14.377 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:14.377 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:14.377 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:14.377 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:14.377 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.378 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:14.378 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:14.378 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.378 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.378 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:14.378 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:14.378 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.378 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.378 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:14.378 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:14.378 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:14.378 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:14.378 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:14.378 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.379 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.379 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:14.379 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:14.379 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:14.379 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.379 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:14.379 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.379 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:14.379 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.379 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:14.379 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.379 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:14.379 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.379 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:14.379 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:14.379 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:14.379 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:14.380 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.380 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:14.380 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.380 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:14.380 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:14.380 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:14.380 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:14.380 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:14.380 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:14.380 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:14.380 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:14.380 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:14.380 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:14.380 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:14.380 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:14.381 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:14.381 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:14.381 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:14.381 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:14.381 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:14.381 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:14.381 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:14.381 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:14.381 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:14.381 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:14.381 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:14.381 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:14.381 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:14.381 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:14.381 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:14.382 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:14.382 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:14.382 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:14.382 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:14.382 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:14.382 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:14.382 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:14.382 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:14.382 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:14.382 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:14.382 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:14.382 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:14.382 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:14.382 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.383 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.383 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:14.383 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:14.383 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.383 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:14.383 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.383 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:14.383 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:14.383 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:14.383 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:14.383 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:14.383 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:14.383 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:14.383 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:14.383 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:14.383 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:14.384 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:14.384 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:14.384 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:14.384 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.384 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:14.384 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:14.384 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:14.384 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:14.384 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:14.384 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:14.384 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:14.384 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:14.384 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:14.384 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:14.384 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:14.384 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.385 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.385 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:14.385 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:14.385 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:14.385 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:14.385 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:14.385 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.385 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.385 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:14.385 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:14.385 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:14.385 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:14.385 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:14.385 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.385 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:14.385 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:14.386 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:14.386 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:14.386 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:14.386 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:14.386 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.386 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:14.386 INFO:teuthology.orchestra.run.smithi003.stdout:________________ ERROR at teardown of test_multipart_copy_small ________________ 2023-12-03T13:00:14.386 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.386 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:14.386 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.386 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:14.386 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:14.386 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.386 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:14.386 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:14.387 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:14.387 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:14.387 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:14.387 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.387 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:14.387 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:14.387 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.387 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.387 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:14.387 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:14.387 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.387 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.387 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:14.387 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.387 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:14.387 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:14.388 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.388 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.388 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:14.388 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:14.388 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.388 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:14.388 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:14.388 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:14.388 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:14.388 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:14.388 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:14.388 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:14.388 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.388 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:14.388 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:14.389 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:14.389 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:14.389 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:14.389 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:14.389 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:14.389 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:14.389 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:14.389 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.389 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:14.389 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:14.389 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:14.389 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:14.389 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.389 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:14.389 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:14.389 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:14.390 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:14.390 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.390 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.390 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:14.390 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:14.390 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:14.390 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:14.390 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.390 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.390 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:14.390 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:14.390 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:14.390 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.390 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:14.390 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.391 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:14.391 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:14.391 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.391 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:14.391 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:14.391 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:14.391 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:14.391 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:14.391 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:14.391 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.391 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:14.391 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.391 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:14.391 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.392 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:14.392 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:14.392 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.392 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:14.392 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.392 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:14.392 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:14.392 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:14.392 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:14.392 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:14.392 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:14.392 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:14.392 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:14.392 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:14.392 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:14.392 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:14.393 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:14.393 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:14.393 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.393 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:14.393 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:14.393 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:14.393 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:14.393 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:14.393 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:14.393 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:14.393 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:14.393 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:14.393 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:14.393 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:14.393 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.393 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.393 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:14.394 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.394 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:14.394 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:14.394 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:14.394 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:14.394 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:14.394 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:14.394 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:14.394 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:14.394 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:14.394 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:14.394 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:14.394 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:14.394 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:14.395 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:14.395 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:14.395 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:14.395 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:14.395 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:14.395 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:14.395 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:14.395 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:14.395 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:14.395 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:14.395 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:14.395 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:14.395 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:14.395 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:14.395 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:14.395 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.396 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.396 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:14.396 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.396 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:14.396 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:14.396 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.396 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:14.396 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:14.396 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:14.396 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:14.396 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:14.396 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.396 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:14.396 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:14.396 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.396 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.397 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:14.397 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:14.397 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.397 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.397 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:14.397 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:14.397 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:14.397 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:14.397 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:14.397 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.397 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.397 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:14.397 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:14.397 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:14.397 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.397 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:14.398 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.398 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:14.398 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.398 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:14.398 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.398 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:14.398 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.398 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:14.398 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:14.398 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:14.398 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:14.398 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.398 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:14.398 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.398 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:14.399 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:14.399 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:14.399 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:14.399 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:14.399 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:14.399 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:14.399 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:14.399 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:14.399 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:14.399 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:14.399 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:14.399 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:14.399 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:14.399 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:14.399 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:14.399 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:14.399 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:14.400 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:14.400 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:14.400 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:14.400 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:14.400 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:14.400 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:14.400 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:14.400 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:14.400 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:14.400 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:14.400 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:14.400 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:14.400 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:14.400 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:14.400 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:14.401 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:14.401 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:14.401 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:14.401 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:14.401 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:14.401 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:14.401 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:14.401 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.401 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.401 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:14.401 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:14.401 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.401 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:14.401 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.401 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:14.402 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:14.402 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:14.402 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:14.402 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:14.402 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:14.402 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:14.402 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:14.402 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:14.402 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:14.402 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:14.402 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:14.402 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:14.402 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.402 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:14.403 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:14.403 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:14.403 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:14.403 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:14.403 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:14.403 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:14.403 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:14.403 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:14.403 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:14.403 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:14.403 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.403 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.403 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:14.403 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:14.403 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:14.403 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:14.404 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:14.404 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.404 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.404 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:14.404 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:14.404 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:14.404 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:14.404 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:14.404 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.404 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:14.404 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:14.404 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:14.404 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:14.404 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:14.404 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:14.404 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.405 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:14.405 INFO:teuthology.orchestra.run.smithi003.stdout:____________ ERROR at teardown of test_multipart_copy_invalid_range ____________ 2023-12-03T13:00:14.405 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.405 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:14.405 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.405 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:14.405 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:14.405 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.405 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:14.405 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:14.405 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:14.405 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:14.405 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:14.405 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.406 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:14.406 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:14.406 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.406 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.406 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:14.406 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:14.406 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.406 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.406 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:14.406 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.406 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:14.406 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:14.406 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.406 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.407 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:14.407 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:14.407 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.407 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:14.407 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:14.407 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:14.407 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:14.407 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:14.407 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:14.407 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:14.407 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.407 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:14.407 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:14.407 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:14.407 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:14.407 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:14.408 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:14.408 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:14.408 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:14.408 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:14.408 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.408 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:14.408 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:14.408 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:14.408 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:14.408 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.408 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:14.408 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:14.408 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:14.408 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:14.408 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.408 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.409 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:14.409 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:14.409 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:14.409 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:14.409 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.409 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.409 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:14.409 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:14.409 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:14.409 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.409 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:14.409 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.409 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:14.409 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:14.409 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.409 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:14.410 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:14.410 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:14.410 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:14.410 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:14.410 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:14.410 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.410 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:14.410 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.410 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:14.410 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.410 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:14.410 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:14.410 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.410 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:14.411 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.411 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:14.411 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:14.411 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:14.411 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:14.411 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:14.411 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:14.411 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:14.411 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:14.411 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:14.411 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:14.411 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:14.411 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:14.411 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:14.411 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.412 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:14.412 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:14.412 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:14.412 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:14.412 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:14.412 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:14.412 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:14.412 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:14.412 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:14.412 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:14.412 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:14.412 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.412 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.412 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:14.413 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.413 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:14.413 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:14.413 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:14.413 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:14.413 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:14.413 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:14.413 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:14.413 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:14.413 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:14.413 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:14.413 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:14.413 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:14.413 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:14.413 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:14.414 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:14.414 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:14.414 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:14.414 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:14.414 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:14.414 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:14.414 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:14.414 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:14.414 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:14.414 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:14.414 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:14.414 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:14.414 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:14.414 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:14.415 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.415 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.415 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:14.415 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.415 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:14.415 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:14.415 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.415 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:14.415 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:14.415 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:14.415 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:14.415 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:14.415 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.415 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:14.416 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:14.416 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.416 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.416 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:14.416 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:14.416 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.416 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.416 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:14.416 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:14.416 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:14.416 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:14.416 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:14.416 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.416 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.416 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:14.417 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:14.417 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:14.417 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.417 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:14.417 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.417 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:14.417 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.417 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:14.417 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.417 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:14.417 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.417 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:14.417 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:14.417 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:14.417 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:14.417 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.418 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:14.418 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.418 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:14.418 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:14.418 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:14.418 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:14.418 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:14.418 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:14.418 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:14.418 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:14.418 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:14.418 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:14.418 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:14.418 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:14.419 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:14.419 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:14.419 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:14.419 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:14.419 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:14.419 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:14.419 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:14.419 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:14.419 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:14.419 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:14.419 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:14.419 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:14.419 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:14.419 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:14.419 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:14.419 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:14.420 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:14.420 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:14.420 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:14.420 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:14.420 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:14.420 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:14.420 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:14.420 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:14.420 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:14.420 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:14.420 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:14.420 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:14.420 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.420 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.420 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:14.420 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:14.421 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.421 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:14.421 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.421 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:14.421 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:14.421 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:14.421 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:14.421 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:14.421 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:14.421 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:14.421 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:14.421 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:14.421 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:14.421 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:14.422 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:14.422 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:14.422 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.422 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:14.422 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:14.422 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:14.422 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:14.422 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:14.422 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:14.422 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:14.422 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:14.422 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:14.422 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:14.422 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:14.423 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.423 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.423 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:14.423 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:14.423 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:14.423 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:14.423 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:14.423 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.423 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.423 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:14.423 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:14.423 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:14.423 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:14.423 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:14.423 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.424 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:14.424 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:14.424 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:14.424 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:14.424 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:14.424 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:14.424 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.424 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:14.424 INFO:teuthology.orchestra.run.smithi003.stdout:____________ ERROR at teardown of test_multipart_copy_without_range ____________ 2023-12-03T13:00:14.424 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.424 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:14.424 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.424 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:14.424 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:14.424 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.424 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:14.425 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:14.425 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:14.425 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:14.425 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:14.425 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.425 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:14.425 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:14.425 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.425 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.425 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:14.425 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:14.425 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.425 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.425 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:14.425 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.426 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:14.426 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:14.426 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.426 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.426 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:14.426 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:14.426 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.426 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:14.426 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:14.426 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:14.426 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:14.426 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:14.427 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:14.427 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:14.427 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.427 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:14.427 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:14.427 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:14.427 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:14.427 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:14.427 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:14.427 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:14.427 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:14.427 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:14.427 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.427 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:14.427 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:14.427 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:14.428 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:14.428 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.428 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:14.428 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:14.428 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:14.428 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:14.428 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.428 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.428 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:14.428 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:14.428 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:14.428 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:14.428 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.428 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.428 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:14.429 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:14.429 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:14.429 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.429 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:14.429 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.429 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:14.429 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:14.429 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.429 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:14.429 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:14.429 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:14.429 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:14.429 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:14.429 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:14.429 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.430 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:14.430 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.430 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:14.430 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.430 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:14.430 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:14.430 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.430 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:14.430 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.430 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:14.430 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:14.430 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:14.430 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:14.431 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:14.431 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:14.431 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:14.431 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:14.431 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:14.431 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:14.431 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:14.431 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:14.431 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:14.431 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.431 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:14.431 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:14.431 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:14.431 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:14.431 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:14.431 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:14.432 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:14.432 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:14.432 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:14.432 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:14.432 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:14.432 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.432 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.432 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:14.432 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.432 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:14.432 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:14.432 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:14.432 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:14.432 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:14.432 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:14.433 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:14.433 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:14.433 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:14.433 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:14.433 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:14.433 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:14.433 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:14.433 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:14.433 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:14.433 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:14.433 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:14.433 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:14.433 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:14.433 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:14.433 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:14.433 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:14.434 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:14.434 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:14.434 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:14.434 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:14.434 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:14.434 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:14.434 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.434 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.434 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:14.434 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.434 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:14.434 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:14.434 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.434 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:14.434 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:14.435 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:14.435 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:14.435 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:14.435 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.435 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:14.435 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:14.435 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.435 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.435 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:14.435 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:14.435 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.435 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.435 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:14.435 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:14.435 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:14.436 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:14.436 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:14.436 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.436 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.436 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:14.436 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:14.436 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:14.436 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.436 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:14.436 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.436 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:14.436 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.436 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:14.436 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.436 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:14.436 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.437 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:14.437 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:14.437 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:14.437 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:14.437 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.437 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:14.437 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.437 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:14.437 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:14.437 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:14.437 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:14.437 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:14.437 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:14.437 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:14.437 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:14.437 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:14.438 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:14.438 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:14.438 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:14.438 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:14.438 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:14.438 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:14.438 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:14.438 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:14.438 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:14.438 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:14.438 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:14.438 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:14.438 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:14.438 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:14.438 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:14.439 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:14.439 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:14.439 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:14.439 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:14.439 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:14.439 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:14.439 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:14.439 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:14.439 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:14.439 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:14.439 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:14.439 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:14.439 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:14.439 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:14.439 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:14.439 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:14.440 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.440 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.440 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:14.440 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:14.440 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.440 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:14.440 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.440 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:14.440 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:14.440 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:14.440 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:14.440 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:14.440 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:14.440 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:14.440 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:14.441 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:14.441 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:14.441 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:14.441 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:14.441 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:14.441 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.441 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:14.441 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:14.441 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:14.441 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:14.441 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:14.441 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:14.441 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:14.441 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:14.441 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:14.442 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:14.442 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:14.442 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.442 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.442 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:14.442 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:14.442 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:14.442 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:14.442 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:14.442 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.442 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.442 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:14.442 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:14.442 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:14.443 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:14.443 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:14.443 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.443 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:14.443 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:14.443 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:14.443 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:14.443 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:14.443 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:14.443 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.443 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:14.443 INFO:teuthology.orchestra.run.smithi003.stdout:____________ ERROR at teardown of test_multipart_copy_special_names ____________ 2023-12-03T13:00:14.443 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.443 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:14.443 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.443 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:14.444 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:14.444 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.444 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:14.444 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:14.444 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:14.444 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:14.444 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:14.444 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.444 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:14.444 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:14.444 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.444 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.444 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:14.444 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:14.444 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.445 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.445 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:14.445 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.445 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:14.445 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:14.445 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.445 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.445 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:14.445 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:14.445 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.445 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:14.445 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:14.445 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:14.445 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:14.445 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:14.445 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:14.446 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:14.446 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.446 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:14.446 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:14.446 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:14.446 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:14.446 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:14.446 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:14.446 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:14.446 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:14.446 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:14.446 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.446 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:14.446 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:14.446 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:14.447 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:14.447 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.447 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:14.447 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:14.447 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:14.447 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:14.447 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.447 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.447 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:14.447 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:14.447 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:14.447 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:14.447 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.447 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.447 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:14.447 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:14.447 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:14.448 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.448 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:14.448 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.448 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:14.448 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:14.448 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.448 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:14.448 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:14.448 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:14.448 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:14.448 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:14.448 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:14.448 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.448 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:14.448 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.448 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:14.449 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.449 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:14.449 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:14.449 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.449 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:14.449 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.449 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:14.449 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:14.449 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:14.449 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:14.449 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:14.449 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:14.449 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:14.449 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:14.449 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:14.449 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:14.449 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:14.450 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:14.450 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:14.450 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.450 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:14.450 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:14.450 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:14.450 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:14.450 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:14.450 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:14.450 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:14.450 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:14.450 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:14.450 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:14.450 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:14.450 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.451 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.451 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:14.451 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.451 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:14.451 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:14.451 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:14.451 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:14.451 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:14.451 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:14.451 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:14.451 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:14.451 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:14.451 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:14.451 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:14.451 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:14.452 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:14.452 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:14.452 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:14.452 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:14.452 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:14.452 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:14.452 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:14.452 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:14.452 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:14.452 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:14.452 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:14.452 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:14.452 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:14.452 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:14.452 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:14.452 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:14.453 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.453 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.453 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:14.453 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.453 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:14.453 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:14.453 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.453 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:14.453 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:14.453 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:14.453 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:14.453 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:14.453 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.453 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:14.453 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:14.453 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.454 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.454 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:14.454 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:14.454 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.454 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.454 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:14.454 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:14.454 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:14.454 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:14.454 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:14.454 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.454 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.454 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:14.454 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:14.454 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:14.454 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.455 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:14.455 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.455 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:14.455 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.455 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:14.455 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.455 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:14.455 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.455 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:14.455 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:14.455 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:14.455 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:14.455 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.455 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:14.455 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.455 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:14.456 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:14.456 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:14.456 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:14.456 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:14.456 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:14.456 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:14.456 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:14.456 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:14.456 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:14.456 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:14.456 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:14.456 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:14.456 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:14.456 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:14.456 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:14.456 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:14.457 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:14.457 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:14.457 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:14.457 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:14.457 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:14.457 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:14.457 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:14.457 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:14.457 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:14.457 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:14.457 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:14.457 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:14.457 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:14.457 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:14.457 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:14.457 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:14.458 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:14.458 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:14.458 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:14.458 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:14.458 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:14.458 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:14.458 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:14.458 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.458 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.458 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:14.458 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:14.458 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.458 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:14.458 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.458 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:14.459 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:14.459 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:14.459 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:14.459 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:14.459 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:14.459 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:14.459 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:14.459 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:14.459 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:14.459 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:14.459 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:14.459 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:14.459 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.459 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:14.459 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:14.459 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:14.460 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:14.460 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:14.460 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:14.460 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:14.460 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:14.460 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:14.460 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:14.460 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:14.460 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.460 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.460 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:14.460 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:14.460 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:14.460 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:14.460 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:14.461 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.461 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.461 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:14.461 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:14.461 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:14.461 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:14.461 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:14.461 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.461 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:14.461 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:14.461 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:14.461 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:14.461 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:14.461 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:14.461 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.461 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:14.462 INFO:teuthology.orchestra.run.smithi003.stdout:__________________ ERROR at teardown of test_multipart_upload __________________ 2023-12-03T13:00:14.462 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.462 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:14.462 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.462 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:14.462 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:14.462 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.462 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:14.462 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:14.462 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:14.462 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:14.462 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:14.462 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.462 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:14.463 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:14.463 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.463 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.463 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:14.463 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:14.463 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.463 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.463 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:14.463 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.463 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:14.463 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:14.463 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.463 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.463 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:14.463 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:14.463 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.463 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:14.464 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:14.464 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:14.464 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:14.464 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:14.464 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:14.464 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:14.464 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.464 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:14.464 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:14.464 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:14.464 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:14.464 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:14.464 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:14.464 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:14.464 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:14.464 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:14.464 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.465 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:14.465 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:14.465 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:14.465 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:14.465 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.465 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:14.465 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:14.465 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:14.465 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:14.465 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.465 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.465 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:14.465 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:14.465 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:14.465 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:14.465 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.466 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.466 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:14.466 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:14.466 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:14.466 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.466 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:14.466 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.466 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:14.466 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:14.466 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.466 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:14.466 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:14.466 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:14.466 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:14.466 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:14.467 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:14.467 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.467 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:14.467 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.467 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:14.467 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.467 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:14.467 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:14.467 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.467 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:14.467 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.467 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:14.467 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:14.467 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:14.467 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:14.467 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:14.467 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:14.468 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:14.468 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:14.468 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:14.468 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:14.468 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:14.468 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:14.468 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:14.468 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.468 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:14.468 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:14.468 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:14.468 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:14.468 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:14.468 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:14.468 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:14.468 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:14.469 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:14.469 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:14.469 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:14.469 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.469 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.469 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:14.469 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.469 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:14.469 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:14.469 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:14.469 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:14.469 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:14.469 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:14.469 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:14.469 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:14.469 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:14.469 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:14.470 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:14.470 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:14.470 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:14.470 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:14.470 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:14.470 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:14.470 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:14.470 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:14.470 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:14.470 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:14.470 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:14.470 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:14.470 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:14.470 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:14.471 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:14.471 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:14.471 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:14.471 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:14.471 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.471 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.471 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:14.471 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.471 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:14.471 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:14.471 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.471 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:14.471 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:14.471 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:14.471 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:14.472 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:14.472 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.472 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:14.472 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:14.472 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.472 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.472 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:14.472 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:14.472 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.472 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.472 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:14.472 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:14.472 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:14.472 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:14.472 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:14.472 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.473 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.473 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:14.473 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:14.473 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:14.473 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.473 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:14.473 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.473 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:14.473 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.473 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:14.473 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.473 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:14.473 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.473 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:14.473 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:14.474 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:14.474 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:14.474 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.474 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:14.474 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.474 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:14.474 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:14.474 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:14.474 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:14.474 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:14.474 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:14.474 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:14.474 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:14.474 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:14.474 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:14.474 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:14.475 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:14.475 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:14.475 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:14.475 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:14.475 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:14.475 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:14.475 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:14.475 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:14.475 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:14.475 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:14.475 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:14.475 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:14.475 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:14.475 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:14.475 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:14.475 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:14.476 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:14.476 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:14.476 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:14.476 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:14.476 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:14.476 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:14.476 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:14.476 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:14.476 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:14.476 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:14.476 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:14.476 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:14.476 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:14.476 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.476 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.477 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:14.477 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:14.477 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.477 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:14.477 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.477 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:14.477 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:14.477 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:14.477 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:14.477 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:14.477 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:14.477 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:14.477 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:14.477 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:14.477 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:14.477 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:14.478 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:14.478 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:14.478 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.478 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:14.478 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:14.478 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:14.478 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:14.478 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:14.478 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:14.478 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:14.478 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:14.478 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:14.478 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:14.478 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:14.478 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.479 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.479 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:14.479 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:14.479 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:14.479 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:14.479 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:14.479 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.479 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.479 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:14.479 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:14.479 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:14.479 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:14.479 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:14.479 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.479 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:14.479 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:14.479 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:14.480 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:14.480 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:14.480 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:14.480 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.480 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:14.480 INFO:teuthology.orchestra.run.smithi003.stdout:______________ ERROR at teardown of test_multipart_copy_versioned ______________ 2023-12-03T13:00:14.480 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.480 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:14.480 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.480 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:14.480 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:14.480 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.480 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:14.480 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:14.480 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:14.480 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:14.481 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:14.481 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.481 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:14.481 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:14.481 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.481 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.481 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:14.481 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:14.481 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.481 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.481 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:14.481 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.481 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:14.481 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:14.481 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.481 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.482 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:14.482 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:14.482 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.482 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:14.482 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:14.482 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:14.482 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:14.482 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:14.482 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:14.482 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:14.482 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.482 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:14.482 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:14.482 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:14.482 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:14.483 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:14.483 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:14.483 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:14.483 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:14.483 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:14.483 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.483 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:14.483 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:14.483 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:14.483 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:14.483 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.483 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:14.483 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:14.483 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:14.483 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:14.483 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.484 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.484 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:14.484 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:14.484 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:14.484 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:14.484 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.484 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.484 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:14.484 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:14.484 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:14.484 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.484 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:14.484 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.484 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:14.484 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:14.484 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.485 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:14.485 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:14.485 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:14.485 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:14.485 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:14.485 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:14.485 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.485 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:14.485 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.485 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:14.485 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.485 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:14.485 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:14.485 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.485 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:14.485 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.486 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:14.486 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:14.486 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:14.486 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:14.486 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:14.486 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:14.486 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:14.486 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:14.486 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:14.486 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:14.486 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:14.486 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:14.486 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:14.486 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.486 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:14.487 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:14.487 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:14.487 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:14.487 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:14.487 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:14.487 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:14.487 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:14.487 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:14.487 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:14.487 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:14.487 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.487 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.487 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:14.487 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.487 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:14.487 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:14.488 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:14.488 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:14.488 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:14.488 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:14.488 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:14.488 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:14.488 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:14.488 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:14.488 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:14.488 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:14.488 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:14.488 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:14.488 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:14.488 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:14.488 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:14.488 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:14.488 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:14.489 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:14.489 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:14.489 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:14.489 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:14.489 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:14.489 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:14.489 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:14.489 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:14.489 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:14.489 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.489 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.489 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:14.489 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.489 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:14.489 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:14.489 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.490 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:14.490 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:14.490 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:14.490 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:14.490 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:14.490 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.490 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:14.490 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:14.490 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.490 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.490 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:14.490 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:14.490 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.490 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.490 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:14.490 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:14.491 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:14.491 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:14.491 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:14.491 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.491 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.491 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:14.491 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:14.491 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:14.491 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.491 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:14.491 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.491 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:14.491 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.491 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:14.492 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.492 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:14.492 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.492 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:14.492 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:14.492 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:14.492 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:14.492 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.492 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:14.492 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.492 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:14.492 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:14.492 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:14.492 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:14.492 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:14.492 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:14.493 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:14.493 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:14.493 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:14.493 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:14.493 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:14.493 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:14.493 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:14.493 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:14.493 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:14.493 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:14.493 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:14.493 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:14.493 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:14.493 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:14.493 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:14.493 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:14.494 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:14.494 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:14.494 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:14.494 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:14.494 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:14.494 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:14.494 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:14.494 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:14.494 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:14.494 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:14.494 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:14.494 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:14.494 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:14.494 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:14.494 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:14.494 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:14.495 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:14.495 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:14.495 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.495 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.495 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:14.495 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:14.495 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.495 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:14.495 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.495 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:14.495 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:14.495 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:14.495 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:14.495 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:14.495 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:14.495 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:14.496 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:14.496 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:14.496 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:14.496 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:14.496 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:14.496 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:14.496 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.496 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:14.496 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:14.496 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:14.496 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:14.496 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:14.496 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:14.496 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:14.496 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:14.496 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:14.497 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:14.497 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:14.497 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.497 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.497 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:14.497 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:14.497 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:14.497 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:14.497 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:14.497 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.497 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.497 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:14.497 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:14.497 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:14.497 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:14.498 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:14.498 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.498 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:14.498 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:14.498 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:14.498 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:14.498 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:14.498 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:14.498 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.498 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:14.498 INFO:teuthology.orchestra.run.smithi003.stdout:____________ ERROR at teardown of test_multipart_upload_resend_part ____________ 2023-12-03T13:00:14.498 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.498 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:14.498 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.498 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:14.498 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:14.499 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.499 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:14.499 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:14.499 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:14.499 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:14.499 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:14.499 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.499 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:14.499 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:14.499 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.499 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.499 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:14.499 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:14.499 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.499 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.500 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:14.500 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.500 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:14.500 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:14.500 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.500 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.500 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:14.500 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:14.500 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.500 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:14.500 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:14.500 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:14.500 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:14.500 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:14.500 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:14.500 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:14.500 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.501 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:14.501 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:14.501 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:14.501 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:14.501 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:14.501 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:14.501 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:14.501 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:14.501 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:14.501 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.501 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:14.501 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:14.501 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:14.501 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:14.501 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.501 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:14.502 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:14.502 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:14.502 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:14.502 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.502 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.502 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:14.502 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:14.502 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:14.502 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:14.502 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.502 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.502 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:14.502 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:14.502 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:14.502 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.503 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:14.503 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.503 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:14.503 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:14.503 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.503 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:14.503 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:14.503 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:14.503 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:14.503 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:14.503 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:14.503 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.503 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:14.503 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.503 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:14.504 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.504 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:14.504 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:14.504 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.504 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:14.504 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.504 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:14.504 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:14.504 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:14.504 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:14.504 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:14.504 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:14.504 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:14.504 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:14.504 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:14.504 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:14.504 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:14.505 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:14.505 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:14.505 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.505 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:14.505 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:14.505 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:14.505 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:14.505 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:14.505 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:14.505 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:14.505 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:14.505 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:14.505 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:14.505 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:14.505 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.506 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.506 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:14.506 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.506 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:14.506 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:14.506 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:14.506 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:14.506 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:14.506 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:14.506 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:14.506 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:14.506 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:14.506 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:14.506 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:14.507 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:14.507 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:14.507 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:14.507 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:14.507 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:14.507 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:14.507 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:14.507 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:14.507 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:14.507 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:14.507 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:14.507 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:14.507 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:14.507 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:14.507 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:14.507 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:14.508 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:14.508 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.508 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.508 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:14.508 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.508 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:14.508 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:14.508 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.508 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:14.508 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:14.508 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:14.508 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:14.508 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:14.508 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.508 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:14.509 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:14.509 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.509 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.509 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:14.509 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:14.509 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.509 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.509 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:14.509 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:14.509 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:14.509 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:14.509 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:14.509 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.509 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.509 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:14.509 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:14.509 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:14.510 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.510 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:14.510 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.510 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:14.510 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.510 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:14.510 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.510 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:14.510 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.510 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:14.510 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:14.510 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:14.510 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:14.510 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.510 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:14.511 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.511 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:14.511 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:14.511 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:14.511 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:14.511 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:14.511 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:14.511 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:14.511 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:14.511 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:14.511 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:14.511 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:14.511 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:14.511 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:14.511 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:14.511 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:14.512 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:14.512 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:14.512 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:14.512 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:14.512 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:14.512 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:14.512 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:14.512 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:14.512 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:14.512 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:14.512 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:14.512 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:14.512 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:14.512 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:14.512 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:14.513 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:14.513 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:14.513 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:14.513 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:14.513 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:14.513 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:14.513 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:14.513 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:14.513 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:14.513 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:14.513 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.513 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.513 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:14.513 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:14.513 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.513 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:14.513 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.514 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:14.514 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:14.514 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:14.514 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:14.514 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:14.514 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:14.514 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:14.514 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:14.514 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:14.514 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:14.514 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:14.514 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:14.514 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:14.514 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.514 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:14.514 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:14.515 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:14.515 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:14.515 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:14.515 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:14.515 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:14.515 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:14.515 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:14.515 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:14.515 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:14.515 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.515 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.515 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:14.515 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:14.515 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:14.515 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:14.515 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:14.516 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.516 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.516 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:14.516 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:14.516 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:14.516 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:14.516 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:14.516 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.516 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:14.516 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:14.516 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:14.516 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:14.516 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:14.516 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:14.516 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.516 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:14.517 INFO:teuthology.orchestra.run.smithi003.stdout:__________ ERROR at teardown of test_multipart_upload_multiple_sizes ___________ 2023-12-03T13:00:14.517 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.517 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:14.517 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.517 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:14.517 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:14.517 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.517 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:14.517 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:14.517 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:14.517 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:14.517 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:14.517 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.517 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:14.517 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:14.518 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.518 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.518 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:14.518 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:14.518 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.518 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.518 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:14.518 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.518 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:14.518 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:14.518 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.518 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.518 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:14.518 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:14.518 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.518 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:14.519 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:14.519 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:14.519 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:14.519 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:14.519 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:14.519 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:14.519 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.519 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:14.519 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:14.519 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:14.519 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:14.519 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:14.519 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:14.519 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:14.519 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:14.519 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:14.520 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.520 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:14.520 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:14.520 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:14.520 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:14.520 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.520 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:14.520 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:14.520 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:14.520 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:14.520 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.520 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.520 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:14.520 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:14.520 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:14.520 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:14.520 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.521 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.521 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:14.521 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:14.521 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:14.521 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.521 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:14.521 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.521 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:14.521 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:14.521 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.521 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:14.521 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:14.521 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:14.521 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:14.521 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:14.521 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:14.522 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.522 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:14.522 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.522 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:14.522 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.522 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:14.522 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:14.522 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.522 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:14.522 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.522 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:14.522 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:14.522 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:14.522 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:14.523 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:14.523 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:14.523 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:14.523 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:14.523 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:14.523 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:14.523 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:14.523 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:14.523 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:14.523 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.523 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:14.523 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:14.523 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:14.523 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:14.523 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:14.523 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:14.524 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:14.524 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:14.524 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:14.524 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:14.524 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:14.524 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.524 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.524 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:14.524 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.524 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:14.524 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:14.524 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:14.524 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:14.524 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:14.524 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:14.524 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:14.524 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:14.525 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:14.525 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:14.525 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:14.525 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:14.525 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:14.525 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:14.525 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:14.525 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:14.525 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:14.525 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:14.525 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:14.525 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:14.525 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:14.525 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:14.525 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:14.525 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:14.526 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:14.526 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:14.526 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:14.526 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:14.526 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.526 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.526 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:14.526 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.526 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:14.526 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:14.526 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.526 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:14.526 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:14.526 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:14.526 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:14.526 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:14.527 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.527 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:14.527 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:14.527 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.527 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.527 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:14.527 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:14.527 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.527 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.527 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:14.527 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:14.527 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:14.527 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:14.527 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:14.527 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.528 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.528 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:14.528 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:14.528 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:14.528 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.528 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:14.528 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.528 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:14.528 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.528 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:14.528 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.528 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:14.528 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.528 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:14.528 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:14.528 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:14.528 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:14.529 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.529 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:14.529 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.529 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:14.529 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:14.529 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:14.529 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:14.529 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:14.529 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:14.529 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:14.529 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:14.530 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:14.530 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:14.530 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:14.530 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:14.530 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:14.530 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:14.530 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:14.530 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:14.530 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:14.530 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:14.530 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:14.530 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:14.530 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:14.530 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:14.530 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:14.531 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:14.531 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:14.531 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:14.531 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:14.531 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:14.531 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:14.531 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:14.531 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:14.531 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:14.531 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:14.531 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:14.531 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:14.531 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:14.531 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:14.531 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:14.532 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:14.532 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:14.532 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.532 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.532 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:14.532 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:14.532 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.532 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:14.532 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.532 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:14.532 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:14.532 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:14.532 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:14.532 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:14.532 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:14.532 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:14.533 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:14.533 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:14.533 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:14.533 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:14.533 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:14.533 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:14.533 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.533 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:14.533 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:14.533 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:14.533 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:14.533 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:14.533 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:14.533 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:14.533 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:14.533 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:14.533 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:14.534 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:14.534 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.534 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.534 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:14.534 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:14.534 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:14.534 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:14.534 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:14.534 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.534 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.534 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:14.534 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:14.534 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:14.534 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:14.534 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:14.535 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.535 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:14.535 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:14.535 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:14.535 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:14.535 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:14.535 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:14.535 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.535 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:14.535 INFO:teuthology.orchestra.run.smithi003.stdout:___________ ERROR at teardown of test_multipart_copy_multiple_sizes ____________ 2023-12-03T13:00:14.535 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.535 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:14.535 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.535 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:14.535 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:14.535 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.536 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:14.536 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:14.536 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:14.536 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:14.536 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:14.536 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.536 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:14.536 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:14.536 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.536 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.536 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:14.536 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:14.536 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.536 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.536 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:14.536 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.536 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:14.537 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:14.537 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.537 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.537 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:14.537 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:14.537 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.537 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:14.537 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:14.537 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:14.537 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:14.537 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:14.537 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:14.537 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:14.537 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.537 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:14.537 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:14.538 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:14.538 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:14.538 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:14.538 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:14.538 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:14.538 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:14.538 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:14.538 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.538 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:14.538 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:14.538 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:14.538 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:14.538 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.538 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:14.538 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:14.538 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:14.539 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:14.539 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.539 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.539 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:14.539 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:14.539 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:14.539 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:14.539 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.539 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.539 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:14.539 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:14.539 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:14.539 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.539 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:14.539 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.539 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:14.540 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:14.540 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.540 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:14.540 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:14.540 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:14.540 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:14.540 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:14.540 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:14.540 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.540 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:14.540 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.540 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:14.540 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.540 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:14.540 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:14.541 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.541 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:14.541 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.541 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:14.541 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:14.541 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:14.541 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:14.541 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:14.541 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:14.541 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:14.541 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:14.541 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:14.541 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:14.541 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:14.541 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:14.541 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:14.542 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.542 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:14.542 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:14.542 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:14.542 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:14.542 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:14.542 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:14.542 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:14.542 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:14.542 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:14.542 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:14.542 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:14.542 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.542 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.542 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:14.543 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.543 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:14.543 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:14.543 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:14.543 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:14.543 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:14.543 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:14.543 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:14.543 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:14.543 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:14.543 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:14.543 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:14.543 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:14.543 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:14.543 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:14.543 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:14.544 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:14.544 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:14.544 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:14.544 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:14.544 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:14.544 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:14.544 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:14.544 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:14.544 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:14.544 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:14.544 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:14.544 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:14.544 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:14.544 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.544 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.544 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:14.544 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.545 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:14.545 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:14.545 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.545 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:14.545 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:14.545 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:14.545 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:14.545 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:14.545 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.545 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:14.545 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:14.545 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.545 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.545 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:14.545 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:14.545 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.545 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.546 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:14.546 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:14.546 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:14.546 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:14.546 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:14.546 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.546 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.546 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:14.546 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:14.546 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:14.546 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.546 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:14.546 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.546 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:14.546 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.547 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:14.547 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.547 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:14.547 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.547 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:14.547 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:14.547 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:14.547 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:14.547 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.547 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:14.547 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.547 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:14.547 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:14.547 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:14.547 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:14.547 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:14.548 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:14.548 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:14.548 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:14.548 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:14.548 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:14.548 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:14.548 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:14.548 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:14.548 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:14.548 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:14.548 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:14.548 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:14.548 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:14.548 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:14.548 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:14.548 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:14.549 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:14.549 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:14.549 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:14.549 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:14.549 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:14.549 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:14.549 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:14.549 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:14.549 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:14.549 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:14.549 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:14.549 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:14.549 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:14.549 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:14.549 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:14.549 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:14.550 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:14.550 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:14.550 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:14.550 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.550 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.550 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:14.550 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:14.550 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.550 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:14.550 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.550 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:14.550 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:14.550 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:14.550 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:14.550 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:14.551 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:14.551 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:14.551 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:14.551 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:14.551 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:14.551 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:14.551 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:14.551 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:14.551 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.551 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:14.551 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:14.551 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:14.551 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:14.551 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:14.551 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:14.551 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:14.552 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:14.552 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:14.552 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:14.552 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:14.552 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.552 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.552 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:14.552 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:14.552 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:14.552 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:14.552 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:14.552 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.552 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.552 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:14.552 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:14.553 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:14.553 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:14.553 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:14.553 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.553 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:14.553 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:14.553 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:14.553 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:14.553 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:14.553 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:14.553 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.553 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:14.553 INFO:teuthology.orchestra.run.smithi003.stdout:__________ ERROR at teardown of test_multipart_upload_size_too_small ___________ 2023-12-03T13:00:14.553 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.553 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:14.554 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.554 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:14.554 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:14.554 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.554 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:14.554 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:14.554 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:14.554 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:14.554 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:14.554 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.554 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:14.554 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:14.554 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.554 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.554 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:14.554 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:14.555 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.555 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.555 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:14.555 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.555 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:14.555 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:14.555 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.555 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.555 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:14.555 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:14.555 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.555 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:14.555 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:14.555 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:14.555 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:14.555 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:14.555 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:14.556 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:14.556 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.556 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:14.556 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:14.556 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:14.556 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:14.556 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:14.556 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:14.556 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:14.556 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:14.556 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:14.556 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.556 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:14.556 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:14.556 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:14.556 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:14.557 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.557 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:14.557 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:14.557 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:14.557 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:14.557 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.557 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.557 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:14.557 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:14.557 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:14.557 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:14.557 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.557 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.557 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:14.557 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:14.558 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:14.558 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.558 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:14.558 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.558 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:14.558 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:14.558 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.558 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:14.558 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:14.558 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:14.558 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:14.558 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:14.558 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:14.558 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.558 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:14.558 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.559 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:14.559 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.559 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:14.559 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:14.559 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.559 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:14.559 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.559 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:14.559 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:14.559 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:14.559 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:14.559 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:14.559 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:14.559 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:14.559 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:14.559 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:14.560 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:14.560 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:14.560 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:14.560 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:14.560 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.560 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:14.560 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:14.560 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:14.560 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:14.560 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:14.560 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:14.560 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:14.560 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:14.560 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:14.560 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:14.560 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:14.560 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.561 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.561 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:14.561 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.561 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:14.561 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:14.561 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:14.561 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:14.561 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:14.561 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:14.561 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:14.561 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:14.561 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:14.561 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:14.561 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:14.562 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:14.562 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:14.562 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:14.562 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:14.562 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:14.562 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:14.562 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:14.562 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:14.562 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:14.562 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:14.562 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:14.562 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:14.562 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:14.563 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:14.563 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:14.563 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:14.563 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:14.563 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.563 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.563 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:14.563 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.563 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:14.563 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:14.563 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.563 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:14.563 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:14.563 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:14.563 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:14.563 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:14.564 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.564 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:14.564 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:14.564 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.564 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.564 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:14.564 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:14.564 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.564 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.564 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:14.564 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:14.564 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:14.564 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:14.564 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:14.564 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.564 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.565 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:14.565 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:14.565 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:14.565 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.565 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:14.565 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.565 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:14.565 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.565 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:14.565 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.565 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:14.565 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.565 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:14.565 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:14.565 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:14.565 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:14.565 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.566 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:14.566 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.566 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:14.566 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:14.566 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:14.566 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:14.566 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:14.566 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:14.566 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:14.566 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:14.566 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:14.566 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:14.566 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:14.566 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:14.566 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:14.566 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:14.567 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:14.567 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:14.567 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:14.567 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:14.567 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:14.567 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:14.567 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:14.567 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:14.567 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:14.567 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:14.567 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:14.567 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:14.567 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:14.567 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:14.567 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:14.568 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:14.568 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:14.568 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:14.568 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:14.568 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:14.568 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:14.568 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:14.568 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:14.568 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:14.568 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:14.568 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:14.568 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.568 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.568 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:14.568 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:14.569 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.569 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:14.569 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.569 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:14.569 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:14.569 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:14.569 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:14.569 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:14.569 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:14.569 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:14.569 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:14.569 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:14.569 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:14.569 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:14.569 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:14.569 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:14.569 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.570 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:14.570 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:14.570 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:14.570 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:14.570 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:14.570 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:14.570 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:14.570 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:14.570 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:14.570 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:14.570 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:14.570 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.570 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.570 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:14.570 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:14.571 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:14.571 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:14.571 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:14.571 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.571 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.571 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:14.571 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:14.571 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:14.571 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:14.571 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:14.571 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.571 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:14.571 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:14.571 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:14.572 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:14.572 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:14.572 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:14.572 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.572 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:14.572 INFO:teuthology.orchestra.run.smithi003.stdout:_____________ ERROR at teardown of test_multipart_upload_contents ______________ 2023-12-03T13:00:14.572 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.572 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:14.572 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.572 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:14.572 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:14.572 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.572 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:14.572 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:14.572 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:14.572 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:14.572 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:14.573 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.573 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:14.573 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:14.573 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.573 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.573 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:14.573 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:14.573 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.573 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.573 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:14.573 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.573 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:14.573 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:14.573 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.573 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.573 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:14.574 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:14.574 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.574 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:14.574 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:14.574 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:14.574 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:14.574 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:14.574 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:14.574 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:14.574 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.574 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:14.574 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:14.574 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:14.574 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:14.574 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:14.574 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:14.575 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:14.575 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:14.575 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:14.575 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.575 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:14.575 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:14.575 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:14.575 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:14.575 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.575 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:14.575 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:14.575 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:14.575 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:14.575 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.575 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.575 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:14.576 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:14.576 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:14.576 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:14.576 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.576 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.576 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:14.576 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:14.576 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:14.576 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.576 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:14.576 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.576 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:14.576 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:14.576 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.576 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:14.576 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:14.577 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:14.577 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:14.577 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:14.577 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:14.577 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.577 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:14.577 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.577 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:14.577 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.577 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:14.577 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:14.577 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.577 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:14.577 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.577 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:14.577 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:14.578 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:14.578 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:14.578 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:14.578 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:14.578 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:14.578 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:14.578 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:14.578 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:14.578 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:14.578 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:14.578 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:14.578 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.578 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:14.578 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:14.578 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:14.579 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:14.579 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:14.579 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:14.579 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:14.579 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:14.579 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:14.579 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:14.579 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:14.579 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.579 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.579 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:14.579 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.579 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:14.579 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:14.579 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:14.579 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:14.579 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:14.580 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:14.580 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:14.580 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:14.580 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:14.580 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:14.580 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:14.580 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:14.580 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:14.580 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:14.580 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:14.580 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:14.580 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:14.580 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:14.580 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:14.580 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:14.580 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:14.581 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:14.581 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:14.581 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:14.581 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:14.581 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:14.581 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:14.581 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:14.581 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.581 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.581 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:14.581 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.581 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:14.581 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:14.581 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.581 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:14.581 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:14.582 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:14.582 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:14.582 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:14.582 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.582 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:14.582 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:14.582 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.582 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.582 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:14.582 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:14.582 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.582 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.582 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:14.582 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:14.582 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:14.583 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:14.583 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:14.583 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.583 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.583 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:14.583 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:14.583 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:14.583 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.583 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:14.583 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.583 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:14.583 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.583 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:14.583 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.583 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:14.583 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.584 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:14.584 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:14.584 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:14.584 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:14.584 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.584 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:14.584 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.584 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:14.584 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:14.584 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:14.584 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:14.584 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:14.584 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:14.584 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:14.584 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:14.584 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:14.585 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:14.585 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:14.585 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:14.585 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:14.585 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:14.585 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:14.585 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:14.585 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:14.585 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:14.585 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:14.585 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:14.585 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:14.585 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:14.585 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:14.585 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:14.585 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:14.586 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:14.586 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:14.586 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:14.586 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:14.586 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:14.586 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:14.586 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:14.586 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:14.586 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:14.586 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:14.586 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:14.586 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:14.586 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:14.586 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:14.586 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:14.586 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.587 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.587 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:14.587 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:14.587 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.587 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:14.587 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.587 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:14.587 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:14.587 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:14.587 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:14.587 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:14.587 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:14.587 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:14.587 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:14.587 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:14.587 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:14.587 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:14.588 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:14.588 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:14.588 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.588 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:14.588 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:14.588 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:14.588 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:14.588 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:14.588 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:14.588 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:14.588 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:14.588 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:14.588 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:14.588 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:14.588 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.589 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.589 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:14.589 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:14.589 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:14.589 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:14.589 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:14.589 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.589 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.589 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:14.589 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:14.589 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:14.589 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:14.589 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:14.589 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.589 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:14.589 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:14.589 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:14.590 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:14.590 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:14.590 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:14.590 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.590 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:14.590 INFO:teuthology.orchestra.run.smithi003.stdout:_____ ERROR at teardown of test_multipart_upload_overwrite_existing_object _____ 2023-12-03T13:00:14.590 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.590 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:14.590 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.590 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:14.590 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:14.590 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.590 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:14.590 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:14.590 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:14.591 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:14.591 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:14.591 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.591 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:14.591 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:14.591 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.591 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.591 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:14.591 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:14.591 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.591 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.591 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:14.591 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.591 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:14.591 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:14.591 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.592 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.592 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:14.592 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:14.592 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.592 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:14.592 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:14.592 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:14.592 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:14.592 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:14.592 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:14.592 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:14.592 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.592 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:14.592 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:14.592 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:14.593 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:14.593 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:14.593 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:14.593 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:14.593 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:14.593 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:14.593 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.593 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:14.593 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:14.593 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:14.593 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:14.593 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.593 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:14.593 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:14.593 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:14.593 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:14.594 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.594 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.594 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:14.594 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:14.594 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:14.594 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:14.594 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.594 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.594 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:14.594 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:14.594 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:14.594 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.594 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:14.594 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.594 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:14.595 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:14.595 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.595 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:14.595 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:14.595 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:14.595 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:14.595 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:14.595 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:14.595 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.595 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:14.595 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.595 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:14.595 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.595 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:14.595 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:14.595 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.596 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:14.596 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.596 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:14.596 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:14.596 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:14.596 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:14.596 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:14.596 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:14.596 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:14.596 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:14.596 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:14.596 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:14.596 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:14.596 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:14.596 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:14.596 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.597 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:14.597 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:14.597 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:14.597 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:14.597 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:14.597 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:14.597 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:14.597 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:14.597 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:14.597 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:14.597 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:14.597 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.597 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.597 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:14.598 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.598 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:14.598 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:14.598 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:14.598 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:14.598 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:14.598 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:14.598 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:14.598 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:14.598 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:14.598 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:14.598 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:14.598 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:14.598 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:14.598 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:14.598 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:14.599 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:14.599 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:14.599 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:14.599 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:14.599 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:14.599 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:14.599 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:14.599 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:14.599 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:14.599 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:14.599 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:14.599 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:14.599 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:14.599 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.599 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.599 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:14.600 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.600 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:14.600 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:14.600 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.600 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:14.600 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:14.600 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:14.600 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:14.600 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:14.600 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.600 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:14.600 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:14.600 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.600 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.600 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:14.600 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:14.601 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.601 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.601 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:14.601 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:14.601 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:14.601 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:14.601 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:14.601 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.601 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.601 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:14.601 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:14.601 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:14.601 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.601 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:14.602 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.602 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:14.602 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.602 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:14.602 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.602 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:14.602 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.602 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:14.602 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:14.602 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:14.602 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:14.602 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.602 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:14.602 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.602 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:14.602 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:14.603 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:14.603 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:14.603 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:14.603 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:14.603 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:14.603 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:14.603 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:14.603 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:14.603 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:14.603 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:14.603 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:14.603 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:14.603 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:14.603 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:14.603 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:14.603 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:14.604 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:14.604 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:14.604 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:14.604 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:14.604 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:14.604 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:14.604 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:14.604 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:14.604 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:14.604 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:14.604 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:14.604 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:14.604 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:14.604 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:14.604 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:14.604 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:14.604 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:14.605 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:14.605 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:14.605 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:14.605 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:14.605 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:14.605 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.605 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.605 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:14.605 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:14.605 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.605 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:14.605 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.605 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:14.605 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:14.605 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:14.605 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:14.606 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:14.606 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:14.606 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:14.606 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:14.606 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:14.606 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:14.606 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:14.606 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:14.606 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:14.606 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.606 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:14.606 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:14.606 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:14.606 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:14.606 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:14.607 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:14.607 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:14.607 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:14.607 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:14.607 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:14.607 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:14.607 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.607 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.607 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:14.607 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:14.607 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:14.607 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:14.607 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:14.607 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.607 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.607 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:14.608 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:14.608 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:14.608 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:14.608 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:14.608 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.608 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:14.608 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:14.608 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:14.608 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:14.608 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:14.608 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:14.608 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.608 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:14.608 INFO:teuthology.orchestra.run.smithi003.stdout:_______________ ERROR at teardown of test_abort_multipart_upload _______________ 2023-12-03T13:00:14.608 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.608 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:14.609 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.609 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:14.609 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:14.609 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.609 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:14.609 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:14.609 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:14.609 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:14.609 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:14.609 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.609 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:14.609 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:14.609 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.609 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.609 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:14.609 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:14.610 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.610 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.610 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:14.610 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.610 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:14.610 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:14.610 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.610 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.610 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:14.610 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:14.610 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.610 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:14.610 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:14.610 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:14.610 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:14.611 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:14.611 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:14.611 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:14.611 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.611 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:14.611 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:14.611 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:14.611 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:14.611 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:14.611 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:14.611 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:14.611 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:14.611 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:14.612 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.612 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:14.612 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:14.612 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:14.612 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:14.612 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.612 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:14.612 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:14.612 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:14.612 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:14.612 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.612 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.612 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:14.612 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:14.612 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:14.612 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:14.612 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.613 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.613 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:14.613 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:14.613 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:14.613 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.613 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:14.613 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.613 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:14.613 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:14.613 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.613 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:14.613 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:14.613 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:14.613 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:14.613 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:14.613 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:14.613 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.614 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:14.614 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.614 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:14.614 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.614 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:14.614 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:14.614 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.614 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:14.614 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.614 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:14.614 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:14.614 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:14.614 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:14.614 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:14.614 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:14.614 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:14.615 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:14.615 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:14.615 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:14.615 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:14.615 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:14.615 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:14.615 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.615 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:14.615 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:14.615 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:14.615 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:14.615 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:14.615 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:14.615 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:14.615 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:14.615 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:14.616 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:14.616 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:14.616 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.616 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.616 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:14.616 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.616 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:14.616 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:14.616 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:14.616 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:14.616 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:14.616 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:14.616 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:14.616 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:14.616 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:14.617 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:14.617 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:14.617 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:14.617 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:14.617 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:14.617 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:14.617 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:14.617 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:14.617 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:14.617 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:14.617 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:14.617 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:14.617 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:14.617 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:14.617 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:14.617 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:14.618 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:14.618 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:14.618 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:14.618 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.618 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.618 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:14.618 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.618 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:14.618 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:14.618 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.618 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:14.618 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:14.618 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:14.618 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:14.618 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:14.619 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.619 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:14.619 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:14.619 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.619 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.619 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:14.619 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:14.619 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.619 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.619 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:14.619 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:14.619 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:14.619 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:14.619 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:14.619 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.619 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.620 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:14.620 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:14.620 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:14.620 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.620 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:14.620 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.620 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:14.620 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.620 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:14.620 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.620 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:14.620 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.620 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:14.620 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:14.620 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:14.620 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:14.621 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.621 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:14.621 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.621 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:14.621 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:14.621 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:14.621 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:14.621 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:14.621 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:14.621 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:14.621 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:14.621 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:14.621 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:14.621 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:14.621 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:14.621 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:14.622 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:14.622 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:14.622 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:14.622 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:14.622 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:14.622 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:14.622 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:14.622 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:14.622 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:14.622 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:14.622 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:14.622 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:14.622 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:14.623 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:14.623 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:14.623 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:14.623 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:14.623 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:14.623 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:14.623 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:14.623 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:14.623 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:14.623 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:14.623 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:14.623 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:14.623 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:14.623 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:14.624 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.624 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.624 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:14.624 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:14.624 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.624 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:14.624 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.624 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:14.624 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:14.624 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:14.624 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:14.624 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:14.624 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:14.624 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:14.624 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:14.624 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:14.625 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:14.625 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:14.625 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:14.625 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:14.625 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.625 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:14.625 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:14.625 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:14.625 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:14.625 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:14.625 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:14.625 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:14.625 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:14.625 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:14.625 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:14.625 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:14.626 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.626 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.626 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:14.626 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:14.626 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:14.626 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:14.626 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:14.626 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.626 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.626 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:14.626 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:14.626 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:14.626 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:14.626 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:14.627 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.627 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:14.627 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:14.627 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:14.627 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:14.627 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:14.627 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:14.627 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.627 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:14.627 INFO:teuthology.orchestra.run.smithi003.stdout:__________ ERROR at teardown of test_abort_multipart_upload_not_found __________ 2023-12-03T13:00:14.627 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.627 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:14.627 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.627 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:14.628 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:14.628 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.628 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:14.628 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:14.628 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:14.628 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:14.628 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:14.628 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.628 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:14.628 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:14.628 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.628 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.628 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:14.628 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:14.629 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.629 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.629 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:14.629 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.629 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:14.629 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:14.629 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.629 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.629 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:14.629 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:14.629 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.629 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:14.629 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:14.629 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:14.629 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:14.629 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:14.630 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:14.630 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:14.630 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.630 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:14.630 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:14.630 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:14.630 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:14.630 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:14.630 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:14.630 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:14.630 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:14.630 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:14.630 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.630 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:14.631 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:14.631 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:14.631 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:14.631 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.631 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:14.631 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:14.631 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:14.631 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:14.631 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.631 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.631 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:14.631 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:14.631 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:14.631 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:14.631 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.632 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.632 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:14.632 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:14.632 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:14.632 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.632 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:14.632 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.632 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:14.632 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:14.632 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.632 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:14.632 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:14.632 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:14.632 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:14.632 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:14.632 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:14.633 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.633 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:14.633 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.633 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:14.633 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.633 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:14.633 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:14.633 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.633 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:14.633 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.633 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:14.633 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:14.633 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:14.633 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:14.633 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:14.633 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:14.633 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:14.634 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:14.634 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:14.634 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:14.634 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:14.634 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:14.634 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:14.634 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.634 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:14.634 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:14.634 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:14.634 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:14.634 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:14.634 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:14.634 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:14.635 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:14.635 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:14.635 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:14.635 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:14.635 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.635 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.635 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:14.635 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.635 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:14.635 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:14.635 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:14.635 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:14.635 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:14.635 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:14.635 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:14.635 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:14.636 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:14.636 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:14.636 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:14.636 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:14.636 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:14.636 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:14.636 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:14.636 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:14.636 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:14.636 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:14.636 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:14.636 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:14.636 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:14.636 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:14.636 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:14.636 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:14.636 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:14.637 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:14.637 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:14.637 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:14.637 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.637 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.637 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:14.637 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.637 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:14.637 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:14.637 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.637 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:14.637 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:14.637 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:14.637 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:14.637 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:14.637 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.637 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:14.638 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:14.638 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.638 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.638 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:14.638 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:14.638 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.638 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.638 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:14.638 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:14.638 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:14.638 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:14.638 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:14.638 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.638 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.638 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:14.639 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:14.639 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:14.639 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.639 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:14.639 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.639 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:14.639 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.639 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:14.639 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.639 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:14.639 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.639 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:14.639 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:14.639 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:14.639 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:14.640 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.640 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:14.640 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.640 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:14.640 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:14.640 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:14.640 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:14.640 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:14.640 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:14.640 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:14.640 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:14.640 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:14.640 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:14.640 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:14.640 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:14.640 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:14.640 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:14.641 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:14.641 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:14.641 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:14.641 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:14.641 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:14.641 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:14.641 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:14.641 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:14.641 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:14.641 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:14.641 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:14.641 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:14.641 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:14.641 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:14.642 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:14.642 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:14.642 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:14.642 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:14.642 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:14.642 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:14.642 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:14.642 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:14.642 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:14.642 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:14.642 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:14.642 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:14.642 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.642 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.642 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:14.643 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:14.643 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.643 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:14.643 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.643 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:14.643 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:14.643 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:14.643 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:14.643 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:14.643 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:14.643 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:14.643 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:14.643 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:14.643 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:14.643 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:14.643 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:14.644 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:14.644 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.644 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:14.644 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:14.644 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:14.644 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:14.644 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:14.644 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:14.644 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:14.644 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:14.644 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:14.644 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:14.644 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:14.644 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.644 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.644 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:14.644 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:14.645 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:14.645 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:14.645 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:14.645 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.645 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.645 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:14.645 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:14.645 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:14.645 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:14.645 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:14.645 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.645 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:14.645 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:14.645 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:14.645 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:14.645 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:14.646 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:14.646 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.646 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:14.646 INFO:teuthology.orchestra.run.smithi003.stdout:_______________ ERROR at teardown of test_list_multipart_upload ________________ 2023-12-03T13:00:14.646 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.646 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:14.646 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.646 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:14.646 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:14.646 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.646 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:14.646 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:14.646 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:14.646 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:14.647 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:14.647 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.647 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:14.647 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:14.647 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.647 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.647 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:14.647 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:14.647 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.647 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.647 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:14.647 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.647 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:14.647 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:14.647 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.648 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.648 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:14.648 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:14.648 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.648 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:14.648 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:14.648 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:14.648 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:14.648 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:14.648 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:14.648 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:14.648 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.648 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:14.648 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:14.648 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:14.649 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:14.649 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:14.649 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:14.649 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:14.649 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:14.649 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:14.649 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.649 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:14.649 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:14.649 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:14.649 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:14.649 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.649 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:14.649 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:14.650 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:14.650 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:14.650 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.650 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.650 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:14.650 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:14.650 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:14.650 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:14.650 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.650 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.650 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:14.650 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:14.650 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:14.651 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.651 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:14.651 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.651 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:14.651 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:14.651 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.651 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:14.651 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:14.651 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:14.651 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:14.651 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:14.651 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:14.651 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.651 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:14.652 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.652 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:14.652 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.652 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:14.652 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:14.652 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.652 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:14.652 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.652 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:14.652 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:14.652 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:14.652 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:14.652 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:14.652 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:14.653 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:14.653 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:14.653 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:14.653 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:14.653 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:14.653 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:14.653 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:14.653 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.653 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:14.653 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:14.653 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:14.653 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:14.653 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:14.653 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:14.653 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:14.654 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:14.654 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:14.654 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:14.654 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:14.654 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.654 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.654 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:14.654 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.654 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:14.654 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:14.654 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:14.654 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:14.654 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:14.654 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:14.654 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:14.655 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:14.655 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:14.655 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:14.655 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:14.655 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:14.655 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:14.655 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:14.655 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:14.655 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:14.655 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:14.655 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:14.655 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:14.655 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:14.655 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:14.656 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:14.656 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:14.656 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:14.656 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:14.656 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:14.656 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:14.656 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:14.656 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.656 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.656 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:14.656 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.656 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:14.656 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:14.656 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.656 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:14.657 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:14.657 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:14.657 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:14.657 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:14.657 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.657 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:14.657 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:14.657 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.657 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.657 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:14.657 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:14.657 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.657 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.657 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:14.657 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:14.658 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:14.658 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:14.658 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:14.658 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.658 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.658 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:14.658 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:14.658 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:14.658 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.658 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:14.658 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.658 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:14.658 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.658 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:14.659 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.659 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:14.659 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.659 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:14.659 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:14.659 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:14.659 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:14.659 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.659 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:14.659 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.659 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:14.659 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:14.659 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:14.659 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:14.659 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:14.660 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:14.660 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:14.660 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:14.660 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:14.660 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:14.660 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:14.660 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:14.660 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:14.660 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:14.660 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:14.660 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:14.660 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:14.660 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:14.660 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:14.661 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:14.661 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:14.661 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:14.661 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:14.661 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:14.661 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:14.661 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:14.661 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:14.661 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:14.661 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:14.661 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:14.661 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:14.661 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:14.661 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:14.662 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:14.662 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:14.662 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:14.662 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:14.662 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:14.662 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:14.662 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:14.662 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.662 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.662 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:14.662 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:14.662 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.662 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:14.662 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.663 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:14.663 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:14.663 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:14.663 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:14.663 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:14.663 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:14.663 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:14.663 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:14.663 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:14.663 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:14.663 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:14.663 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:14.663 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:14.663 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.664 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:14.664 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:14.664 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:14.664 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:14.664 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:14.664 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:14.664 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:14.664 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:14.664 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:14.664 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:14.664 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:14.664 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.664 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.664 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:14.664 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:14.664 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:14.665 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:14.665 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:14.665 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.665 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.665 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:14.665 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:14.665 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:14.665 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:14.665 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:14.665 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.665 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:14.665 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:14.665 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:14.665 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:14.665 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:14.666 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:14.666 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.666 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:14.666 INFO:teuthology.orchestra.run.smithi003.stdout:____________ ERROR at teardown of test_list_multipart_upload_owner _____________ 2023-12-03T13:00:14.666 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.666 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:14.666 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.666 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:14.666 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:14.666 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.666 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:14.666 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:14.666 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:14.666 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:14.666 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:14.666 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.667 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:14.667 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:14.667 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.667 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.667 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:14.667 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:14.667 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.667 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.667 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:14.667 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.667 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:14.667 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:14.667 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.667 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.667 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:14.667 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:14.668 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.668 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:14.668 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:14.668 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:14.668 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:14.668 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:14.668 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:14.668 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:14.668 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.668 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:14.668 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:14.668 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:14.668 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:14.668 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:14.668 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:14.669 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:14.669 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:14.669 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:14.669 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.669 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:14.669 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:14.669 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:14.669 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:14.669 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.669 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:14.669 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:14.669 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:14.669 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:14.669 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.669 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.670 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:14.670 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:14.670 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:14.670 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:14.670 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.670 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.670 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:14.670 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:14.670 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:14.670 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.670 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:14.670 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.670 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:14.670 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:14.671 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.671 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:14.671 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:14.671 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:14.671 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:14.671 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:14.671 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:14.671 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.671 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:14.671 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.671 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:14.671 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.671 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:14.671 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:14.671 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.672 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:14.672 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.672 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:14.672 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:14.672 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:14.672 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:14.672 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:14.672 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:14.672 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:14.672 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:14.672 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:14.672 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:14.672 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:14.672 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:14.673 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:14.673 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.673 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:14.673 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:14.673 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:14.673 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:14.673 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:14.673 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:14.673 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:14.673 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:14.673 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:14.673 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:14.673 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:14.673 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.673 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.674 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:14.674 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.674 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:14.674 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:14.674 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:14.674 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:14.674 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:14.674 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:14.674 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:14.674 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:14.674 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:14.674 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:14.674 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:14.675 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:14.675 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:14.675 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:14.675 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:14.675 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:14.675 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:14.675 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:14.675 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:14.675 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:14.675 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:14.675 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:14.675 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:14.675 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:14.675 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:14.675 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:14.676 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:14.676 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:14.676 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.676 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.676 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:14.676 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.676 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:14.676 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:14.676 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.676 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:14.676 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:14.676 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:14.676 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:14.676 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:14.676 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.677 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:14.677 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:14.677 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.677 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.677 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:14.677 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:14.677 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.677 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.677 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:14.677 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:14.677 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:14.677 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:14.677 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:14.677 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.678 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.678 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:14.678 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:14.678 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:14.678 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.678 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:14.678 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.678 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:14.678 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.678 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:14.678 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.678 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:14.678 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.678 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:14.679 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:14.679 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:14.679 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:14.679 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.679 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:14.679 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.679 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:14.679 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:14.679 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:14.679 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:14.679 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:14.679 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:14.679 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:14.679 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:14.679 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:14.680 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:14.680 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:14.680 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:14.680 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:14.680 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:14.680 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:14.680 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:14.680 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:14.680 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:14.680 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:14.680 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:14.680 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:14.680 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:14.680 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:14.680 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:14.681 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:14.681 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:14.681 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:14.681 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:14.681 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:14.681 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:14.681 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:14.681 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:14.681 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:14.681 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:14.681 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:14.681 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:14.681 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:14.681 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:14.681 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:14.682 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:14.682 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.682 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.682 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:14.682 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:14.682 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.682 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:14.682 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.682 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:14.682 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:14.682 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:14.682 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:14.682 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:14.682 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:14.683 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:14.683 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:14.683 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:14.683 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:14.683 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:14.683 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:14.683 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:14.683 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.683 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:14.683 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:14.683 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:14.683 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:14.683 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:14.684 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:14.684 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:14.684 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:14.684 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:14.684 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:14.684 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:14.684 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.684 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.684 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:14.684 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:14.684 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:14.684 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:14.684 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:14.684 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.684 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.685 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:14.685 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:14.685 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:14.685 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:14.685 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:14.685 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.685 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:14.685 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:14.685 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:14.685 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:14.685 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:14.685 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:14.685 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.685 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:14.685 INFO:teuthology.orchestra.run.smithi003.stdout:___________ ERROR at teardown of test_multipart_upload_missing_part ____________ 2023-12-03T13:00:14.686 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.686 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:14.686 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.686 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:14.686 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:14.686 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.686 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:14.686 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:14.686 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:14.686 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:14.686 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:14.686 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.686 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:14.686 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:14.687 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.687 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.687 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:14.687 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:14.687 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.687 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.687 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:14.687 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.687 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:14.687 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:14.687 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.687 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.687 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:14.687 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:14.688 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.688 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:14.688 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:14.688 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:14.688 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:14.688 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:14.688 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:14.688 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:14.688 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.688 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:14.688 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:14.688 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:14.688 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:14.688 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:14.688 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:14.689 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:14.689 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:14.689 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:14.689 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.689 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:14.689 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:14.689 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:14.689 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:14.689 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.689 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:14.689 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:14.689 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:14.689 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:14.689 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.690 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.690 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:14.690 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:14.690 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:14.690 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:14.690 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.690 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.690 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:14.690 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:14.690 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:14.690 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.690 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:14.690 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.690 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:14.690 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:14.691 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.691 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:14.691 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:14.691 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:14.691 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:14.691 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:14.691 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:14.691 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.691 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:14.691 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.691 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:14.691 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.691 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:14.691 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:14.691 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.692 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:14.692 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.692 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:14.692 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:14.692 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:14.692 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:14.692 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:14.692 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:14.692 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:14.692 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:14.692 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:14.692 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:14.692 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:14.692 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:14.693 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:14.693 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.693 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:14.693 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:14.693 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:14.693 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:14.693 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:14.693 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:14.693 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:14.693 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:14.693 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:14.693 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:14.693 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:14.693 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.694 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.694 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:14.694 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.694 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:14.694 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:14.694 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:14.694 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:14.694 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:14.694 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:14.694 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:14.694 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:14.694 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:14.694 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:14.694 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:14.695 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:14.695 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:14.695 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:14.695 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:14.695 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:14.695 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:14.695 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:14.695 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:14.695 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:14.695 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:14.695 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:14.695 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:14.695 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:14.695 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:14.696 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:14.696 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:14.696 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:14.696 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.696 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.696 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:14.696 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.696 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:14.696 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:14.696 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.696 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:14.696 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:14.696 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:14.696 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:14.696 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:14.697 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.697 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:14.697 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:14.697 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.697 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.697 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:14.697 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:14.697 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.697 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.697 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:14.697 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:14.697 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:14.697 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:14.697 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:14.697 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.698 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.698 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:14.698 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:14.698 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:14.698 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.717 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:14.717 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.717 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:14.717 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.717 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:14.717 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.717 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:14.718 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.718 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:14.718 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:14.718 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:14.718 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:14.718 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.718 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:14.718 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.718 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:14.718 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:14.718 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:14.718 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:14.718 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:14.718 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:14.718 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:14.719 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:14.719 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:14.719 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:14.719 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:14.719 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:14.719 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:14.719 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:14.719 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:14.719 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:14.719 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:14.719 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:14.719 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:14.719 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:14.719 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:14.719 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:14.719 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:14.720 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:14.720 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:14.720 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:14.720 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:14.720 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:14.720 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:14.720 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:14.720 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:14.720 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:14.720 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:14.720 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:14.720 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:14.720 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:14.720 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:14.720 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:14.720 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:14.721 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:14.721 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.721 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.721 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:14.721 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:14.721 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.721 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:14.721 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.721 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:14.721 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:14.721 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:14.721 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:14.721 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:14.721 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:14.721 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:14.722 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:14.722 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:14.722 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:14.722 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:14.722 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:14.722 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:14.722 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.722 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:14.722 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:14.722 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:14.722 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:14.722 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:14.723 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:14.723 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:14.723 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:14.723 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:14.723 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:14.723 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:14.723 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.723 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.723 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:14.723 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:14.723 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:14.723 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:14.723 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:14.723 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.724 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.724 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:14.724 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:14.724 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:14.724 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:14.724 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:14.724 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.724 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:14.724 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:14.724 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:14.724 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:14.724 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:14.724 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:14.724 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.724 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:14.724 INFO:teuthology.orchestra.run.smithi003.stdout:__________ ERROR at teardown of test_multipart_upload_incorrect_etag ___________ 2023-12-03T13:00:14.725 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.725 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:14.725 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.725 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:14.725 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:14.725 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.725 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:14.725 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:14.725 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:14.725 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:14.725 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:14.725 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.725 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:14.725 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:14.725 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.725 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.726 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:14.726 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:14.726 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.726 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.726 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:14.726 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.726 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:14.726 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:14.726 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.726 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.726 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:14.726 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:14.726 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.726 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:14.726 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:14.726 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:14.727 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:14.727 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:14.727 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:14.727 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:14.727 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.727 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:14.727 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:14.727 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:14.727 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:14.727 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:14.727 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:14.727 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:14.727 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:14.727 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:14.727 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.728 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:14.728 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:14.728 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:14.728 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:14.728 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.728 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:14.728 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:14.728 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:14.728 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:14.728 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.728 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.728 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:14.728 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:14.728 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:14.729 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:14.729 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.729 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.729 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:14.729 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:14.729 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:14.729 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.729 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:14.729 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.729 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:14.729 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:14.729 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.729 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:14.729 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:14.729 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:14.729 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:14.730 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:14.730 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:14.730 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.730 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:14.730 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.730 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:14.730 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.730 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:14.730 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:14.730 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.730 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:14.730 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.730 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:14.730 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:14.730 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:14.731 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:14.731 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:14.731 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:14.731 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:14.731 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:14.731 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:14.731 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:14.731 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:14.731 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:14.731 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:14.731 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.731 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:14.731 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:14.731 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:14.731 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:14.732 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:14.732 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:14.732 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:14.732 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:14.732 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:14.732 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:14.732 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:14.732 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.732 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.732 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:14.732 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.732 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:14.732 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:14.732 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:14.732 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:14.732 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:14.733 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:14.733 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:14.733 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:14.733 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:14.733 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:14.733 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:14.733 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:14.733 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:14.733 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:14.733 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:14.733 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:14.733 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:14.733 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:14.733 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:14.733 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:14.733 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:14.733 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:14.734 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:14.734 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:14.734 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:14.734 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:14.734 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:14.734 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:14.734 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.734 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.734 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:14.734 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.734 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:14.734 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:14.734 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.734 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:14.734 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:14.735 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:14.735 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:14.735 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:14.735 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.735 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:14.735 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:14.735 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.735 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.735 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:14.735 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:14.735 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.735 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.735 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:14.735 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:14.735 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:14.735 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:14.736 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:14.736 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.736 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.736 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:14.736 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:14.736 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:14.736 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.736 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:14.736 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.736 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:14.736 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.736 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:14.736 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.736 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:14.736 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.736 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:14.736 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:14.737 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:14.737 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:14.737 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.737 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:14.737 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.737 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:14.737 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:14.737 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:14.737 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:14.737 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:14.737 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:14.737 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:14.737 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:14.737 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:14.737 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:14.737 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:14.738 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:14.738 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:14.738 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:14.738 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:14.738 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:14.738 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:14.738 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:14.738 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:14.738 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:14.738 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:14.738 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:14.738 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:14.738 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:14.738 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:14.738 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:14.738 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:14.739 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:14.739 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:14.739 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:14.739 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:14.739 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:14.739 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:14.739 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:14.739 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:14.739 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:14.739 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:14.739 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:14.739 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:14.739 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:14.739 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.739 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.740 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:14.740 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:14.740 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.740 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:14.740 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.740 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:14.740 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:14.740 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:14.740 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:14.740 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:14.740 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:14.740 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:14.740 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:14.740 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:14.740 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:14.741 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:14.741 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:14.741 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:14.741 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.741 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:14.741 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:14.741 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:14.741 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:14.741 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:14.741 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:14.741 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:14.741 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:14.741 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:14.741 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:14.741 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:14.741 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.742 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.742 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:14.742 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:14.742 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:14.742 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:14.742 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:14.742 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.742 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.742 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:14.742 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:14.742 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:14.742 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:14.742 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:14.742 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.742 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:14.742 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:14.743 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:14.743 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:14.743 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:14.743 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:14.743 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.743 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:14.743 INFO:teuthology.orchestra.run.smithi003.stdout:_________________ ERROR at teardown of test_multipart_get_part _________________ 2023-12-03T13:00:14.743 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.743 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:14.743 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.743 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:14.743 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:14.743 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.743 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:14.743 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:14.743 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:14.743 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:14.744 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:14.744 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.744 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:14.744 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:14.744 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.744 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.744 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:14.744 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:14.744 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.744 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.744 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:14.744 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.744 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:14.744 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:14.744 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.744 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.745 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:14.745 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:14.745 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.745 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:14.745 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:14.745 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:14.745 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:14.745 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:14.745 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:14.745 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:14.745 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.745 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:14.745 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:14.745 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:14.745 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:14.745 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:14.745 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:14.746 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:14.746 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:14.746 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:14.746 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.746 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:14.746 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:14.746 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:14.746 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:14.746 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.746 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:14.746 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:14.746 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:14.746 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:14.746 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.746 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.746 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:14.747 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:14.747 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:14.747 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:14.747 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.747 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.747 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:14.747 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:14.747 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:14.747 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.747 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:14.747 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.747 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:14.747 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:14.747 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.747 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:14.747 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:14.748 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:14.748 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:14.748 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:14.748 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:14.748 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.748 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:14.748 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.748 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:14.748 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.748 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:14.748 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:14.748 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.748 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:14.748 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.748 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:14.748 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:14.748 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:14.749 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:14.749 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:14.749 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:14.749 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:14.749 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:14.749 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:14.749 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:14.749 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:14.749 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:14.749 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:14.749 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.749 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:14.749 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:14.749 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:14.749 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:14.749 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:14.750 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:14.750 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:14.750 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:14.750 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:14.750 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:14.750 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:14.750 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.750 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.750 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:14.750 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.750 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:14.750 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:14.750 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:14.750 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:14.751 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:14.751 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:14.751 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:14.751 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:14.751 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:14.751 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:14.751 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:14.751 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:14.751 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:14.751 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:14.751 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:14.751 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:14.751 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:14.751 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:14.751 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:14.751 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:14.752 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:14.752 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:14.752 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:14.752 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:14.752 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:14.752 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:14.752 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:14.752 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:14.752 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.752 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.752 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:14.752 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.752 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:14.752 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:14.752 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.752 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:14.753 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:14.753 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:14.753 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:14.753 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:14.753 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.753 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:14.753 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:14.753 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.753 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.753 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:14.753 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:14.753 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.753 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.753 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:14.753 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:14.753 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:14.754 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:14.754 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:14.754 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.754 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.754 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:14.754 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:14.754 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:14.754 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.754 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:14.754 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.754 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:14.754 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.754 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:14.754 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.754 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:14.755 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.755 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:14.755 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:14.755 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:14.755 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:14.755 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.755 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:14.755 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.755 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:14.755 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:14.755 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:14.755 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:14.755 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:14.755 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:14.755 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:14.755 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:14.756 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:14.756 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:14.756 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:14.756 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:14.756 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:14.756 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:14.756 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:14.756 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:14.756 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:14.756 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:14.756 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:14.756 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:14.756 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:14.756 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:14.756 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:14.756 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:14.756 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:14.757 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:14.757 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:14.757 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:14.757 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:14.757 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:14.757 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:14.757 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:14.757 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:14.757 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:14.757 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:14.757 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:14.757 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:14.757 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:14.757 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:14.757 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:14.757 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.757 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.758 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:14.758 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:14.758 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.758 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:14.758 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.758 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:14.758 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:14.758 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:14.758 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:14.758 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:14.758 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:14.758 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:14.758 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:14.758 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:14.759 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:14.759 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:14.759 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:14.759 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:14.759 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.759 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:14.759 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:14.759 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:14.759 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:14.759 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:14.759 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:14.759 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:14.759 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:14.759 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:14.759 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:14.759 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:14.760 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.760 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.760 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:14.760 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:14.760 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:14.760 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:14.760 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:14.760 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.760 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.760 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:14.760 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:14.760 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:14.760 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:14.760 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:14.760 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.760 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:14.761 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:14.761 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:14.761 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:14.761 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:14.761 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:14.761 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.761 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:14.761 INFO:teuthology.orchestra.run.smithi003.stdout:_______________ ERROR at teardown of test_non_multipart_get_part _______________ 2023-12-03T13:00:14.761 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.761 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:14.761 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.761 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:14.761 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:14.762 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.762 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:14.762 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:14.762 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:14.762 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:14.762 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:14.762 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.762 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:14.762 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:14.762 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.762 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.762 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:14.762 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:14.762 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.762 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.763 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:14.763 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.763 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:14.763 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:14.763 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.763 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.763 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:14.763 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:14.763 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.763 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:14.763 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:14.763 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:14.763 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:14.763 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:14.763 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:14.763 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:14.764 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.764 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:14.764 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:14.764 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:14.764 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:14.764 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:14.764 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:14.764 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:14.764 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:14.764 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:14.764 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.764 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:14.764 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:14.764 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:14.764 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:14.764 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.765 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:14.765 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:14.765 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:14.765 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:14.765 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.765 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.765 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:14.765 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:14.765 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:14.765 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:14.765 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.765 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.765 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:14.765 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:14.765 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:14.765 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.765 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:14.766 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.766 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:14.766 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:14.766 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.766 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:14.766 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:14.766 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:14.766 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:14.766 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:14.766 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:14.766 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.766 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:14.766 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.766 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:14.766 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.766 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:14.767 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:14.767 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.767 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:14.767 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.767 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:14.767 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:14.767 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:14.767 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:14.767 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:14.767 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:14.767 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:14.767 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:14.767 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:14.767 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:14.767 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:14.767 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:14.768 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:14.768 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.768 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:14.768 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:14.768 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:14.768 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:14.768 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:14.768 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:14.768 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:14.768 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:14.768 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:14.768 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:14.768 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:14.768 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.768 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.768 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:14.769 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.769 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:14.769 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:14.769 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:14.769 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:14.769 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:14.769 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:14.769 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:14.769 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:14.769 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:14.769 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:14.769 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:14.769 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:14.769 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:14.769 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:14.769 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:14.769 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:14.770 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:14.770 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:14.770 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:14.770 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:14.770 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:14.770 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:14.770 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:14.770 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:14.770 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:14.770 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:14.770 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:14.770 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:14.770 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.770 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.770 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:14.770 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.771 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:14.771 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:14.771 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.771 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:14.771 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:14.771 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:14.771 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:14.771 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:14.771 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.771 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:14.771 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:14.771 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.771 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.771 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:14.771 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:14.771 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.772 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.772 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:14.772 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:14.772 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:14.772 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:14.772 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:14.772 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.772 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.772 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:14.772 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:14.772 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:14.772 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.772 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:14.772 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.773 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:14.773 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.773 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:14.773 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.773 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:14.773 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.773 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:14.773 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:14.773 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:14.773 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:14.773 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.773 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:14.773 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.773 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:14.773 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:14.774 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:14.774 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:14.774 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:14.774 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:14.774 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:14.774 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:14.774 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:14.774 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:14.774 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:14.774 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:14.774 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:14.774 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:14.774 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:14.774 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:14.774 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:14.775 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:14.775 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:14.775 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:14.775 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:14.775 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:14.775 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:14.775 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:14.775 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:14.775 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:14.775 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:14.775 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:14.775 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:14.775 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:14.775 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:14.775 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:14.775 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:14.776 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:14.776 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:14.776 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:14.776 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:14.776 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:14.776 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:14.776 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:14.776 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.776 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.776 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:14.776 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:14.776 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.776 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:14.776 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.776 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:14.776 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:14.776 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:14.777 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:14.777 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:14.777 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:14.777 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:14.777 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:14.777 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:14.777 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:14.777 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:14.777 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:14.777 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:14.777 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.777 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:14.777 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:14.777 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:14.777 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:14.777 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:14.778 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:14.778 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:14.778 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:14.778 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:14.778 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:14.778 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:14.778 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.778 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.778 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:14.778 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:14.778 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:14.778 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:14.778 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:14.778 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.778 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.779 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:14.779 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:14.779 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:14.779 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:14.779 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:14.779 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.779 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:14.779 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:14.779 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:14.779 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:14.779 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:14.779 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:14.779 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.779 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:14.779 INFO:teuthology.orchestra.run.smithi003.stdout:____________________ ERROR at teardown of test_100_continue ____________________ 2023-12-03T13:00:14.779 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.780 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:14.780 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.780 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:14.780 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:14.780 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.780 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:14.780 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:14.780 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:14.780 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:14.780 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:14.780 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.780 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:14.780 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:14.780 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.780 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.780 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:14.780 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:14.781 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.781 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.781 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:14.781 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.781 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:14.781 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:14.781 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.781 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.781 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:14.781 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:14.781 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.781 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:14.781 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:14.781 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:14.781 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:14.781 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:14.782 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:14.782 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:14.782 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.782 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:14.782 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:14.782 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:14.782 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:14.782 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:14.782 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:14.782 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:14.782 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:14.782 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:14.782 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.782 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:14.782 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:14.782 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:14.782 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:14.783 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.783 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:14.783 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:14.783 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:14.783 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:14.783 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.783 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.783 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:14.783 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:14.783 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:14.783 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:14.783 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.783 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.783 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:14.784 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:14.784 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:14.784 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.784 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:14.784 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.784 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:14.784 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:14.784 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.784 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:14.784 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:14.784 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:14.784 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:14.784 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:14.784 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:14.784 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.784 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:14.785 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.785 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:14.785 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.785 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:14.785 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:14.785 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.785 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:14.785 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.785 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:14.785 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:14.785 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:14.785 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:14.785 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:14.785 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:14.785 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:14.785 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:14.786 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:14.786 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:14.786 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:14.786 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:14.786 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:14.786 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.786 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:14.786 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:14.786 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:14.786 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:14.786 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:14.786 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:14.786 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:14.786 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:14.786 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:14.786 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:14.787 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:14.787 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.787 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.787 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:14.787 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.787 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:14.787 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:14.787 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:14.787 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:14.787 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:14.787 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:14.787 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:14.787 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:14.787 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:14.787 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:14.787 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:14.788 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:14.788 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:14.788 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:14.788 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:14.788 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:14.788 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:14.788 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:14.788 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:14.788 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:14.788 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:14.788 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:14.788 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:14.788 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:14.788 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:14.788 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:14.788 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:14.788 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:14.789 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.789 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.789 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:14.789 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.789 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:14.789 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:14.789 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.789 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:14.789 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:14.789 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:14.789 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:14.789 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:14.789 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.789 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:14.789 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:14.789 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.790 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.790 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:14.790 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:14.790 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.790 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.790 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:14.790 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:14.790 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:14.790 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:14.790 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:14.790 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.790 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.790 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:14.790 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:14.790 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:14.791 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.791 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:14.791 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.791 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:14.791 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.791 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:14.791 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.791 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:14.791 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.791 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:14.791 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:14.791 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:14.791 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:14.791 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.791 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:14.791 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.791 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:14.792 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:14.792 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:14.792 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:14.792 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:14.792 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:14.792 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:14.792 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:14.792 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:14.792 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:14.792 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:14.792 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:14.792 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:14.792 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:14.792 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:14.792 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:14.793 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:14.793 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:14.793 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:14.793 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:14.793 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:14.793 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:14.793 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:14.793 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:14.793 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:14.793 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:14.793 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:14.793 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:14.793 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:14.793 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:14.793 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:14.793 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:14.794 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:14.794 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:14.794 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:14.794 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:14.794 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:14.794 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:14.794 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:14.794 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:14.794 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.794 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.794 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:14.794 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:14.794 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.795 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:14.795 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.795 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:14.795 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:14.795 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:14.795 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:14.795 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:14.795 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:14.795 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:14.795 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:14.795 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:14.795 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:14.795 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:14.795 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:14.795 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:14.795 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.796 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:14.796 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:14.796 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:14.796 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:14.796 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:14.796 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:14.796 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:14.796 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:14.796 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:14.796 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:14.796 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:14.796 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.796 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.796 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:14.796 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:14.796 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:14.796 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:14.797 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:14.797 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.797 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.797 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:14.797 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:14.797 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:14.797 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:14.797 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:14.797 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.797 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:14.797 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:14.797 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:14.797 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:14.797 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:14.797 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:14.797 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.798 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:14.798 INFO:teuthology.orchestra.run.smithi003.stdout:______________________ ERROR at teardown of test_set_cors ______________________ 2023-12-03T13:00:14.798 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.798 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:14.798 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.798 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:14.798 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:14.798 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.798 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:14.798 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:14.798 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:14.798 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:14.798 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:14.798 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.798 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:14.798 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:14.799 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.799 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.799 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:14.799 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:14.799 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.799 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.799 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:14.799 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.799 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:14.799 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:14.799 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.799 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.799 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:14.799 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:14.799 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.799 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:14.799 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:14.800 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:14.800 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:14.800 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:14.800 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:14.800 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:14.800 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.800 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:14.800 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:14.800 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:14.800 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:14.800 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:14.800 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:14.800 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:14.800 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:14.800 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:14.800 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.800 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:14.801 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:14.801 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:14.801 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:14.801 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.801 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:14.801 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:14.801 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:14.801 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:14.801 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.801 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.801 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:14.801 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:14.801 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:14.801 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:14.801 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.801 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.802 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:14.802 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:14.802 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:14.802 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.802 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:14.802 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.802 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:14.802 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:14.802 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.802 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:14.802 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:14.802 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:14.802 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:14.802 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:14.802 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:14.802 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.803 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:14.803 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.803 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:14.803 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.803 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:14.803 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:14.803 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.803 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:14.803 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.803 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:14.803 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:14.803 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:14.803 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:14.803 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:14.803 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:14.803 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:14.803 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:14.804 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:14.804 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:14.804 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:14.804 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:14.804 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:14.804 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.804 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:14.804 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:14.804 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:14.804 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:14.804 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:14.804 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:14.804 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:14.804 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:14.804 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:14.804 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:14.804 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:14.805 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.805 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.805 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:14.805 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.805 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:14.805 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:14.805 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:14.805 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:14.805 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:14.805 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:14.805 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:14.805 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:14.805 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:14.805 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:14.806 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:14.806 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:14.806 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:14.806 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:14.806 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:14.806 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:14.806 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:14.806 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:14.806 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:14.806 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:14.806 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:14.806 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:14.806 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:14.806 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:14.806 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:14.806 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:14.807 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:14.807 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:14.807 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.807 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.807 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:14.807 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.807 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:14.807 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:14.807 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.807 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:14.807 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:14.807 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:14.807 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:14.807 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:14.807 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.807 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:14.808 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:14.808 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.808 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.808 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:14.808 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:14.808 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.808 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.808 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:14.808 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:14.808 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:14.808 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:14.808 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:14.808 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.808 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.808 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:14.808 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:14.808 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:14.809 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.809 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:14.809 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.809 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:14.809 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.809 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:14.809 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.809 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:14.809 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.809 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:14.809 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:14.809 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:14.809 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:14.809 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.809 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:14.809 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.809 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:14.810 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:14.810 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:14.810 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:14.810 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:14.810 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:14.810 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:14.810 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:14.810 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:14.810 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:14.810 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:14.810 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:14.810 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:14.810 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:14.810 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:14.810 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:14.810 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:14.811 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:14.811 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:14.811 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:14.811 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:14.811 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:14.811 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:14.811 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:14.811 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:14.811 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:14.811 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:14.811 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:14.811 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:14.811 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:14.811 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:14.811 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:14.811 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:14.811 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:14.812 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:14.812 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:14.812 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:14.812 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:14.812 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:14.812 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:14.812 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.812 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.812 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:14.812 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:14.812 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.812 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:14.812 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.812 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:14.812 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:14.813 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:14.813 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:14.813 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:14.813 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:14.813 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:14.813 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:14.813 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:14.813 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:14.813 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:14.813 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:14.813 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:14.813 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.813 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:14.813 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:14.813 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:14.813 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:14.813 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:14.814 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:14.814 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:14.814 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:14.814 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:14.814 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:14.814 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:14.814 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.814 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.814 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:14.814 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:14.814 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:14.814 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:14.814 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:14.814 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.814 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.814 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:14.814 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:14.815 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:14.815 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:14.815 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:14.815 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.815 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:14.815 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:14.815 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:14.815 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:14.815 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:14.815 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:14.815 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.815 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:14.815 INFO:teuthology.orchestra.run.smithi003.stdout:________________ ERROR at teardown of test_cors_origin_response ________________ 2023-12-03T13:00:14.816 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.816 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:14.816 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.816 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:14.816 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:14.816 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.816 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:14.816 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:14.816 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:14.816 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:14.816 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:14.816 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.816 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:14.816 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:14.816 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.816 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.816 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:14.817 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:14.817 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.817 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.817 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:14.817 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.817 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:14.817 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:14.817 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.817 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.817 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:14.817 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:14.817 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.817 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:14.817 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:14.817 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:14.817 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:14.818 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:14.818 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:14.818 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:14.818 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.818 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:14.818 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:14.818 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:14.818 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:14.818 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:14.818 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:14.818 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:14.818 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:14.818 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:14.818 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.818 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:14.818 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:14.819 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:14.819 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:14.819 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.819 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:14.819 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:14.819 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:14.819 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:14.819 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.819 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.819 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:14.819 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:14.819 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:14.819 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:14.819 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.819 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.819 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:14.820 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:14.820 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:14.820 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.820 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:14.820 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.820 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:14.820 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:14.820 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.820 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:14.820 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:14.820 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:14.820 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:14.820 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:14.820 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:14.820 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.820 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:14.820 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.821 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:14.821 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.821 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:14.821 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:14.821 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.821 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:14.821 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.821 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:14.821 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:14.821 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:14.821 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:14.821 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:14.821 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:14.821 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:14.821 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:14.821 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:14.822 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:14.822 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:14.822 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:14.822 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:14.822 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.822 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:14.822 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:14.822 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:14.822 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:14.822 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:14.822 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:14.822 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:14.822 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:14.822 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:14.822 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:14.822 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:14.823 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.823 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.823 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:14.823 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.823 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:14.823 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:14.823 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:14.823 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:14.823 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:14.823 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:14.823 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:14.823 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:14.823 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:14.823 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:14.823 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:14.823 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:14.824 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:14.824 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:14.824 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:14.824 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:14.824 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:14.824 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:14.824 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:14.824 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:14.824 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:14.824 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:14.824 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:14.824 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:14.824 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:14.824 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:14.824 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:14.824 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:14.825 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.825 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.825 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:14.825 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.825 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:14.825 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:14.825 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.825 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:14.825 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:14.825 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:14.825 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:14.825 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:14.825 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.825 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:14.825 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:14.825 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.825 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.826 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:14.826 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:14.826 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.826 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.826 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:14.826 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:14.826 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:14.826 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:14.826 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:14.826 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.826 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.826 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:14.826 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:14.826 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:14.826 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.827 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:14.827 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.827 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:14.827 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.827 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:14.827 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.827 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:14.827 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.827 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:14.827 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:14.827 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:14.827 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:14.827 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.827 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:14.827 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.827 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:14.828 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:14.828 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:14.828 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:14.828 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:14.828 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:14.828 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:14.828 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:14.828 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:14.828 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:14.828 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:14.828 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:14.828 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:14.828 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:14.828 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:14.828 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:14.828 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:14.828 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:14.829 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:14.829 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:14.829 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:14.829 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:14.829 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:14.829 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:14.829 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:14.829 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:14.829 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:14.829 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:14.829 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:14.829 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:14.829 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:14.829 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:14.829 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:14.830 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:14.830 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:14.830 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:14.830 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:14.830 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:14.830 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:14.830 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:14.830 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.830 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.830 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:14.830 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:14.830 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.830 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:14.830 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.830 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:14.830 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:14.831 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:14.831 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:14.831 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:14.831 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:14.831 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:14.831 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:14.831 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:14.831 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:14.831 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:14.831 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:14.831 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:14.831 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.831 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:14.831 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:14.831 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:14.831 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:14.832 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:14.832 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:14.832 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:14.832 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:14.832 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:14.832 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:14.832 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:14.832 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.832 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.832 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:14.832 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:14.832 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:14.832 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:14.832 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:14.832 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.832 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.832 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:14.833 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:14.833 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:14.833 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:14.833 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:14.833 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.833 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:14.833 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:14.833 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:14.833 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:14.833 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:14.833 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:14.833 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.833 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:14.833 INFO:teuthology.orchestra.run.smithi003.stdout:________________ ERROR at teardown of test_cors_origin_wildcard ________________ 2023-12-03T13:00:14.833 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.833 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:14.834 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.834 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:14.834 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:14.834 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.834 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:14.834 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:14.834 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:14.834 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:14.834 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:14.834 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.834 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:14.834 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:14.834 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.834 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.834 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:14.834 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:14.834 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.835 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.835 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:14.835 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.835 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:14.835 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:14.835 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.835 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.835 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:14.835 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:14.835 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.835 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:14.835 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:14.835 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:14.835 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:14.835 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:14.835 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:14.836 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:14.836 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.836 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:14.836 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:14.836 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:14.836 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:14.836 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:14.836 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:14.836 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:14.836 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:14.836 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:14.836 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.836 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:14.836 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:14.836 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:14.836 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:14.836 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.836 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:14.837 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:14.837 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:14.837 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:14.837 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.837 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.837 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:14.837 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:14.837 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:14.837 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:14.837 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.837 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.837 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:14.838 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:14.838 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:14.838 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.838 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:14.838 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.838 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:14.838 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:14.838 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.838 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:14.838 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:14.838 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:14.838 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:14.838 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:14.838 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:14.839 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.839 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:14.839 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.839 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:14.839 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.839 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:14.839 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:14.839 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.839 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:14.839 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.839 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:14.839 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:14.839 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:14.839 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:14.839 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:14.839 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:14.839 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:14.840 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:14.840 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:14.840 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:14.840 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:14.840 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:14.840 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:14.840 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.840 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:14.840 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:14.840 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:14.840 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:14.840 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:14.840 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:14.840 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:14.840 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:14.840 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:14.840 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:14.841 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:14.841 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.841 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.841 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:14.841 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.841 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:14.841 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:14.841 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:14.841 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:14.841 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:14.841 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:14.841 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:14.841 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:14.841 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:14.841 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:14.841 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:14.841 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:14.842 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:14.842 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:14.842 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:14.842 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:14.842 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:14.842 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:14.842 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:14.842 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:14.842 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:14.842 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:14.842 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:14.842 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:14.842 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:14.842 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:14.842 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:14.843 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:14.843 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.843 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.843 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:14.843 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.843 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:14.843 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:14.843 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.843 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:14.843 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:14.843 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:14.843 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:14.843 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:14.843 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.843 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:14.843 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:14.843 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.844 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.844 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:14.844 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:14.844 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.844 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.844 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:14.844 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:14.844 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:14.844 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:14.844 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:14.844 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.844 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.844 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:14.844 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:14.844 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:14.844 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.845 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:14.845 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.845 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:14.845 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.845 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:14.845 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.845 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:14.845 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.845 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:14.845 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:14.845 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:14.845 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:14.845 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.845 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:14.845 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.845 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:14.845 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:14.846 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:14.846 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:14.846 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:14.846 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:14.846 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:14.846 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:14.846 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:14.846 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:14.846 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:14.846 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:14.846 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:14.846 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:14.846 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:14.846 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:14.846 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:14.846 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:14.846 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:14.847 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:14.847 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:14.847 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:14.847 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:14.847 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:14.847 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:14.847 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:14.847 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:14.847 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:14.847 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:14.847 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:14.847 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:14.847 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:14.847 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:14.847 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:14.848 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:14.848 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:14.848 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:14.848 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:14.848 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:14.848 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:14.848 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.848 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.848 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:14.848 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:14.848 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.848 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:14.848 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.848 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:14.849 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:14.849 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:14.849 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:14.849 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:14.849 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:14.849 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:14.849 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:14.849 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:14.849 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:14.849 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:14.849 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:14.849 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:14.849 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.849 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:14.849 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:14.849 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:14.849 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:14.850 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:14.850 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:14.850 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:14.850 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:14.850 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:14.850 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:14.850 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:14.850 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.850 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.850 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:14.850 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:14.850 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:14.850 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:14.850 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:14.850 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.850 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.851 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:14.851 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:14.851 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:14.851 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:14.851 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:14.851 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.851 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:14.851 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:14.851 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:14.851 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:14.851 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:14.851 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:14.851 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.851 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:14.851 INFO:teuthology.orchestra.run.smithi003.stdout:_________________ ERROR at teardown of test_cors_header_option _________________ 2023-12-03T13:00:14.851 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.851 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:14.852 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.852 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:14.852 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:14.852 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.852 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:14.852 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:14.852 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:14.852 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:14.852 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:14.852 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.852 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:14.852 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:14.852 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.852 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.852 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:14.852 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:14.853 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.853 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.853 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:14.853 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.853 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:14.853 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:14.853 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.853 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.853 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:14.853 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:14.853 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.853 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:14.853 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:14.853 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:14.853 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:14.853 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:14.854 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:14.854 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:14.854 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.854 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:14.854 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:14.854 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:14.854 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:14.854 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:14.854 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:14.854 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:14.854 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:14.854 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:14.854 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.854 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:14.854 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:14.854 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:14.855 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:14.855 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.855 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:14.855 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:14.855 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:14.855 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:14.855 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.855 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.855 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:14.855 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:14.855 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:14.855 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:14.855 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.855 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.855 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:14.855 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:14.855 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:14.856 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.856 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:14.856 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.856 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:14.856 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:14.856 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.856 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:14.856 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:14.856 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:14.856 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:14.856 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:14.856 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:14.856 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.856 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:14.856 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.857 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:14.857 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.857 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:14.857 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:14.857 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.857 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:14.857 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.857 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:14.857 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:14.857 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:14.857 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:14.857 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:14.857 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:14.857 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:14.857 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:14.857 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:14.857 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:14.858 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:14.858 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:14.858 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:14.858 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.858 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:14.858 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:14.858 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:14.858 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:14.858 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:14.858 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:14.858 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:14.858 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:14.858 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:14.858 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:14.858 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:14.858 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.858 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.859 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:14.859 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.859 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:14.859 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:14.859 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:14.859 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:14.859 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:14.859 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:14.859 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:14.859 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:14.859 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:14.859 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:14.859 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:14.859 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:14.860 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:14.860 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:14.860 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:14.860 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:14.860 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:14.860 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:14.860 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:14.860 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:14.860 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:14.860 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:14.860 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:14.860 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:14.860 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:14.860 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:14.860 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:14.860 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:14.860 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.861 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.861 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:14.861 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.861 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:14.861 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:14.861 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.861 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:14.861 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:14.861 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:14.861 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:14.861 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:14.861 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.861 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:14.861 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:14.861 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.861 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.862 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:14.862 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:14.862 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.862 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.862 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:14.862 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:14.862 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:14.862 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:14.862 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:14.862 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.862 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.862 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:14.862 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:14.862 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:14.862 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.862 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:14.863 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.863 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:14.863 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.863 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:14.863 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.863 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:14.863 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.863 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:14.863 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:14.863 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:14.863 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:14.863 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.863 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:14.863 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.863 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:14.863 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:14.863 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:14.864 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:14.864 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:14.864 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:14.864 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:14.864 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:14.864 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:14.864 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:14.864 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:14.864 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:14.864 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:14.864 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:14.864 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:14.864 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:14.864 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:14.864 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:14.864 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:14.865 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:14.865 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:14.865 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:14.865 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:14.865 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:14.865 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:14.865 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:14.865 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:14.865 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:14.865 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:14.865 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:14.865 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:14.865 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:14.865 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:14.865 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:14.865 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:14.865 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:14.866 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:14.866 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:14.866 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:14.866 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:14.866 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.866 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.866 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:14.866 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:14.866 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.866 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:14.866 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.866 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:14.866 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:14.866 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:14.866 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:14.866 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:14.867 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:14.867 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:14.867 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:14.867 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:14.867 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:14.867 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:14.867 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:14.867 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:14.867 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.867 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:14.867 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:14.867 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:14.867 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:14.867 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:14.867 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:14.867 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:14.867 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:14.868 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:14.868 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:14.868 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:14.868 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.868 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.868 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:14.868 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:14.868 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:14.868 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:14.868 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:14.868 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.868 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.868 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:14.868 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:14.868 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:14.868 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:14.868 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:14.869 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.869 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:14.869 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:14.869 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:14.869 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:14.869 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:14.869 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:14.869 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.869 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:14.869 INFO:teuthology.orchestra.run.smithi003.stdout:_____________ ERROR at teardown of test_cors_presigned_get_object ______________ 2023-12-03T13:00:14.869 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.869 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:14.869 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.869 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:14.869 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:14.870 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.870 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:14.870 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:14.870 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:14.870 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:14.870 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:14.870 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.870 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:14.870 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:14.870 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.870 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.870 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:14.870 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:14.870 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.870 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.871 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:14.871 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.871 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:14.871 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:14.871 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.871 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.871 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:14.871 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:14.871 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.871 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:14.871 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:14.871 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:14.871 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:14.871 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:14.871 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:14.871 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:14.872 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.872 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:14.872 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:14.872 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:14.872 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:14.872 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:14.872 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:14.872 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:14.872 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:14.872 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:14.872 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.872 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:14.872 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:14.872 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:14.872 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:14.872 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.873 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:14.873 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:14.873 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:14.873 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:14.873 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.873 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.873 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:14.873 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:14.873 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:14.873 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:14.873 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.873 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.873 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:14.873 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:14.873 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:14.873 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.873 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:14.874 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.874 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:14.874 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:14.874 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.874 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:14.874 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:14.874 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:14.874 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:14.874 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:14.874 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:14.874 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.874 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:14.874 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.874 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:14.874 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.874 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:14.875 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:14.875 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.875 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:14.875 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.875 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:14.875 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:14.875 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:14.875 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:14.875 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:14.875 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:14.875 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:14.875 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:14.875 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:14.875 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:14.875 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:14.875 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:14.875 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:14.876 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.876 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:14.876 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:14.876 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:14.876 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:14.876 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:14.876 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:14.876 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:14.876 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:14.876 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:14.876 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:14.876 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:14.876 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.876 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.876 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:14.876 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.876 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:14.877 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:14.877 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:14.877 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:14.877 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:14.877 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:14.877 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:14.877 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:14.877 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:14.877 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:14.877 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:14.877 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:14.877 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:14.877 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:14.877 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:14.877 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:14.877 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:14.877 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:14.878 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:14.878 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:14.878 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:14.878 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:14.878 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:14.878 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:14.878 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:14.878 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:14.878 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:14.878 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:14.878 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.878 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.878 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:14.878 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.878 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:14.879 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:14.879 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.879 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:14.879 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:14.879 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:14.879 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:14.879 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:14.879 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.879 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:14.879 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:14.879 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.879 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.879 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:14.879 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:14.879 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.879 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.880 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:14.880 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:14.880 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:14.880 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:14.880 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:14.880 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.880 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.880 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:14.880 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:14.880 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:14.880 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.880 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:14.880 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.880 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:14.881 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.881 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:14.881 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.881 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:14.881 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.881 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:14.881 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:14.881 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:14.881 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:14.881 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.881 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:14.881 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.881 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:14.881 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:14.881 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:14.881 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:14.881 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:14.882 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:14.882 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:14.882 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:14.882 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:14.882 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:14.882 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:14.882 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:14.882 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:14.882 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:14.882 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:14.882 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:14.882 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:14.882 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:14.882 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:14.882 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:14.882 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:14.883 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:14.883 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:14.883 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:14.883 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:14.883 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:14.883 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:14.883 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:14.883 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:14.883 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:14.883 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:14.883 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:14.883 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:14.883 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:14.883 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:14.883 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:14.883 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:14.884 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:14.884 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:14.884 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:14.884 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.884 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.884 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:14.884 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:14.884 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.884 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:14.884 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.884 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:14.884 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:14.884 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:14.884 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:14.884 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:14.884 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:14.884 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:14.885 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:14.885 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:14.885 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:14.885 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:14.885 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:14.885 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:14.885 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.885 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:14.885 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:14.885 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:14.885 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:14.885 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:14.885 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:14.885 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:14.885 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:14.885 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:14.886 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:14.886 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:14.886 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.886 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.886 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:14.886 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:14.886 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:14.886 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:14.886 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:14.886 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.886 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.886 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:14.886 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:14.886 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:14.886 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:14.886 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:14.887 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.887 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:14.887 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:14.887 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:14.887 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:14.887 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:14.887 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:14.887 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.887 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:14.887 INFO:teuthology.orchestra.run.smithi003.stdout:__________ ERROR at teardown of test_cors_presigned_get_object_tenant __________ 2023-12-03T13:00:14.887 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.887 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:14.887 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.887 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:14.887 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:14.887 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.887 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:14.888 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:14.888 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:14.888 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:14.888 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:14.888 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.888 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:14.888 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:14.888 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.888 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.888 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:14.888 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:14.888 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.888 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.888 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:14.888 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.888 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:14.888 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:14.889 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.889 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.889 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:14.889 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:14.889 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.889 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:14.889 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:14.889 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:14.889 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:14.889 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:14.889 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:14.889 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:14.889 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.889 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:14.889 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:14.890 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:14.890 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:14.890 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:14.890 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:14.890 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:14.890 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:14.890 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:14.890 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.890 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:14.890 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:14.890 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:14.890 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:14.890 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.890 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:14.890 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:14.890 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:14.891 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:14.891 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.891 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.891 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:14.891 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:14.891 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:14.891 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:14.891 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.891 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.891 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:14.891 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:14.891 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:14.891 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.891 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:14.892 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.892 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:14.892 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:14.892 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.892 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:14.892 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:14.892 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:14.892 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:14.892 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:14.892 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:14.892 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.892 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:14.892 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.892 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:14.892 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.892 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:14.892 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:14.893 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.893 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:14.893 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.893 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:14.893 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:14.893 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:14.893 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:14.893 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:14.893 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:14.893 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:14.893 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:14.893 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:14.893 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:14.893 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:14.893 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:14.894 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:14.894 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.894 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:14.894 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:14.894 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:14.894 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:14.894 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:14.894 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:14.894 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:14.894 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:14.894 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:14.894 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:14.894 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:14.894 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.894 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.895 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:14.895 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.895 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:14.895 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:14.895 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:14.895 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:14.895 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:14.895 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:14.895 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:14.895 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:14.895 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:14.895 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:14.895 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:14.895 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:14.895 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:14.895 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:14.895 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:14.896 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:14.896 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:14.896 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:14.896 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:14.896 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:14.896 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:14.896 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:14.896 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:14.896 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:14.896 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:14.896 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:14.896 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:14.896 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:14.896 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.896 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.896 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:14.896 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.897 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:14.897 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:14.897 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.897 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:14.897 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:14.897 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:14.897 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:14.897 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:14.897 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.897 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:14.897 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:14.897 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.897 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.897 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:14.897 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:14.897 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.898 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.898 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:14.898 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:14.898 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:14.898 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:14.898 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:14.898 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.898 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.898 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:14.898 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:14.898 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:14.898 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.898 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:14.898 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.898 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:14.899 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.899 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:14.899 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.899 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:14.899 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.899 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:14.899 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:14.899 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:14.899 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:14.899 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.899 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:14.899 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.899 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:14.899 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:14.899 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:14.899 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:14.899 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:14.900 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:14.900 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:14.900 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:14.900 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:14.900 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:14.900 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:14.900 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:14.900 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:14.900 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:14.900 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:14.900 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:14.900 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:14.900 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:14.900 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:14.900 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:14.900 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:14.900 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:14.901 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:14.901 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:14.901 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:14.901 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:14.901 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:14.901 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:14.901 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:14.901 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:14.901 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:14.901 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:14.901 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:14.901 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:14.901 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:14.901 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:14.901 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:14.901 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:14.901 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:14.902 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:14.902 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.902 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.902 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:14.902 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:14.902 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.902 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:14.902 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.902 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:14.902 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:14.902 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:14.902 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:14.902 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:14.903 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:14.903 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:14.903 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:14.903 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:14.903 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:14.903 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:14.903 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:14.903 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:14.903 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.903 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:14.903 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:14.903 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:14.903 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:14.903 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:14.903 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:14.903 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:14.904 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:14.904 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:14.904 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:14.904 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:14.904 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.904 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.904 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:14.904 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:14.904 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:14.904 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:14.904 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:14.904 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.904 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.904 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:14.904 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:14.905 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:14.905 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:14.905 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:14.905 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.905 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:14.905 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:14.905 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:14.905 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:14.905 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:14.905 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:14.905 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.905 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:14.905 INFO:teuthology.orchestra.run.smithi003.stdout:_________________ ERROR at teardown of test_set_bucket_tagging _________________ 2023-12-03T13:00:14.905 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.905 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:14.905 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.905 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:14.906 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:14.906 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.906 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:14.906 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:14.906 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:14.906 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:14.906 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:14.906 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.906 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:14.906 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:14.906 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.906 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.906 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:14.906 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:14.906 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.906 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.907 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:14.907 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.907 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:14.907 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:14.907 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.907 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.907 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:14.907 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:14.907 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.907 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:14.907 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:14.907 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:14.907 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:14.907 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:14.907 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:14.907 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:14.908 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.908 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:14.908 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:14.908 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:14.908 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:14.908 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:14.908 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:14.908 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:14.908 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:14.908 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:14.908 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.908 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:14.908 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:14.908 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:14.908 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:14.908 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.909 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:14.909 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:14.909 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:14.909 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:14.909 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.909 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.909 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:14.909 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:14.909 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:14.909 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:14.909 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.909 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.909 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:14.909 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:14.909 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:14.909 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.909 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:14.910 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.910 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:14.910 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:14.910 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.910 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:14.910 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:14.910 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:14.910 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:14.910 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:14.910 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:14.910 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.910 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:14.910 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.910 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:14.910 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.911 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:14.911 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:14.911 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.911 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:14.911 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.911 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:14.911 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:14.911 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:14.911 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:14.911 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:14.911 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:14.911 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:14.911 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:14.911 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:14.911 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:14.911 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:14.912 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:14.912 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:14.912 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.912 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:14.912 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:14.912 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:14.912 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:14.912 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:14.912 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:14.912 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:14.912 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:14.912 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:14.912 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:14.912 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:14.912 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.912 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.912 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:14.913 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.913 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:14.913 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:14.913 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:14.913 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:14.913 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:14.913 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:14.913 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:14.913 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:14.913 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:14.913 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:14.913 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:14.913 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:14.913 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:14.914 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:14.914 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:14.914 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:14.914 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:14.914 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:14.914 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:14.914 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:14.914 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:14.914 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:14.914 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:14.914 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:14.914 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:14.914 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:14.914 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:14.914 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:14.915 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.915 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.915 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:14.915 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.915 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:14.915 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:14.915 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.915 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:14.915 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:14.915 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:14.915 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:14.915 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:14.915 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.915 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:14.915 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:14.915 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.916 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.916 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:14.916 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:14.916 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.916 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.916 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:14.916 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:14.916 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:14.916 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:14.916 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:14.916 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.916 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.916 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:14.916 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:14.916 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:14.916 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.917 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:14.917 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.917 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:14.917 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.917 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:14.917 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.917 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:14.917 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.917 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:14.917 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:14.917 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:14.917 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:14.917 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.917 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:14.917 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.918 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:14.918 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:14.918 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:14.918 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:14.918 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:14.918 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:14.918 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:14.918 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:14.918 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:14.918 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:14.918 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:14.918 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:14.918 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:14.918 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:14.918 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:14.918 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:14.919 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:14.919 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:14.919 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:14.919 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:14.919 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:14.919 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:14.919 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:14.919 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:14.919 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:14.919 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:14.919 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:14.919 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:14.919 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:14.919 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:14.919 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:14.919 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:14.919 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:14.920 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:14.920 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:14.920 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:14.920 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:14.920 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:14.920 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:14.920 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:14.920 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.920 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.920 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:14.920 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:14.920 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.920 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:14.920 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.920 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:14.920 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:14.921 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:14.921 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:14.921 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:14.921 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:14.921 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:14.921 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:14.921 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:14.921 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:14.921 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:14.921 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:14.921 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:14.921 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.921 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:14.921 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:14.921 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:14.921 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:14.922 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:14.922 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:14.922 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:14.922 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:14.922 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:14.922 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:14.922 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:14.922 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.922 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.922 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:14.922 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:14.922 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:14.922 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:14.922 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:14.922 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.922 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.922 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:14.923 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:14.923 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:14.923 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:14.923 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:14.923 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.923 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:14.923 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:14.923 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:14.923 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:14.923 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:14.923 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:14.923 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.923 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:14.923 INFO:teuthology.orchestra.run.smithi003.stdout:__________________ ERROR at teardown of test_atomic_read_1mb ___________________ 2023-12-03T13:00:14.923 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.924 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:14.924 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.924 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:14.924 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:14.924 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.924 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:14.924 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:14.924 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:14.924 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:14.924 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:14.924 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.924 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:14.924 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:14.924 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.925 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.925 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:14.925 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:14.925 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.925 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.925 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:14.925 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.925 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:14.925 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:14.925 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.925 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.925 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:14.925 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:14.925 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.925 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:14.925 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:14.926 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:14.926 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:14.926 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:14.926 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:14.926 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:14.926 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.926 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:14.926 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:14.926 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:14.926 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:14.926 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:14.926 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:14.926 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:14.926 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:14.926 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:14.927 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.927 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:14.927 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:14.927 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:14.927 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:14.927 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.927 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:14.927 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:14.927 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:14.927 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:14.927 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.927 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.927 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:14.927 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:14.927 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:14.927 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:14.927 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.928 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.928 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:14.928 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:14.928 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:14.928 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.928 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:14.928 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.928 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:14.928 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:14.928 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.928 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:14.928 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:14.928 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:14.928 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:14.928 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:14.928 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:14.928 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.929 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:14.929 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.929 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:14.929 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.929 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:14.929 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:14.929 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.929 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:14.929 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.929 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:14.929 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:14.929 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:14.929 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:14.929 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:14.929 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:14.929 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:14.929 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:14.930 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:14.930 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:14.930 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:14.930 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:14.930 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:14.930 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.930 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:14.930 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:14.930 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:14.930 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:14.930 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:14.930 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:14.930 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:14.930 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:14.930 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:14.931 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:14.931 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:14.931 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.931 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.931 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:14.931 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.931 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:14.931 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:14.931 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:14.931 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:14.931 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:14.931 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:14.931 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:14.931 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:14.931 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:14.931 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:14.932 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:14.932 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:14.932 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:14.932 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:14.932 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:14.932 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:14.932 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:14.932 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:14.932 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:14.932 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:14.932 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:14.932 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:14.932 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:14.932 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:14.932 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:14.932 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:14.932 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:14.933 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:14.933 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.933 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.933 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:14.933 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.933 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:14.933 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:14.933 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.933 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:14.933 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:14.933 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:14.933 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:14.933 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:14.933 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.933 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:14.933 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:14.933 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.934 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.934 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:14.934 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:14.934 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.934 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.934 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:14.934 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:14.934 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:14.934 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:14.934 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:14.934 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.934 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.934 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:14.934 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:14.934 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:14.935 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.935 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:14.935 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.935 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:14.935 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.935 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:14.935 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.935 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:14.935 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.935 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:14.935 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:14.935 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:14.935 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:14.936 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.936 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:14.936 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.936 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:14.936 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:14.936 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:14.936 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:14.936 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:14.936 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:14.936 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:14.936 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:14.936 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:14.936 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:14.936 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:14.936 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:14.936 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:14.936 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:14.937 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:14.937 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:14.937 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:14.937 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:14.937 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:14.937 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:14.937 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:14.937 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:14.937 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:14.937 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:14.937 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:14.937 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:14.937 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:14.937 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:14.937 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:14.937 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:14.938 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:14.938 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:14.938 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:14.938 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:14.938 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:14.938 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:14.938 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:14.938 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:14.938 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:14.938 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:14.938 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.938 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.938 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:14.938 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:14.938 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.939 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:14.939 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.939 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:14.939 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:14.939 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:14.939 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:14.939 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:14.939 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:14.939 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:14.939 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:14.939 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:14.939 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:14.939 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:14.939 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:14.940 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:14.940 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.940 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:14.940 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:14.940 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:14.940 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:14.940 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:14.940 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:14.940 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:14.940 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:14.940 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:14.940 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:14.940 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:14.940 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.941 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.941 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:14.941 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:14.941 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:14.941 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:14.941 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:14.941 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.941 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.941 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:14.941 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:14.941 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:14.941 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:14.941 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:14.941 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.941 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:14.941 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:14.942 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:14.942 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:14.942 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:14.942 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:14.942 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.942 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:14.942 INFO:teuthology.orchestra.run.smithi003.stdout:__________________ ERROR at teardown of test_atomic_read_4mb ___________________ 2023-12-03T13:00:14.942 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.942 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:14.942 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.942 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:14.942 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:14.942 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.942 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:14.942 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:14.943 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:14.943 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:14.943 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:14.943 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.943 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:14.943 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:14.943 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.943 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.943 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:14.943 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:14.943 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.943 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.943 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:14.943 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.943 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:14.943 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:14.943 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.944 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.944 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:14.944 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:14.944 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.944 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:14.944 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:14.944 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:14.944 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:14.944 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:14.944 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:14.944 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:14.944 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.944 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:14.944 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:14.944 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:14.944 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:14.945 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:14.945 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:14.945 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:14.945 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:14.945 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:14.945 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.945 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:14.945 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:14.945 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:14.945 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:14.945 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.945 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:14.945 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:14.945 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:14.945 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:14.945 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.945 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.946 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:14.946 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:14.946 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:14.946 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:14.946 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.946 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.946 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:14.946 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:14.946 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:14.946 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.946 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:14.946 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.946 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:14.947 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:14.947 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.947 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:14.947 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:14.947 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:14.947 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:14.947 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:14.947 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:14.947 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.947 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:14.947 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.947 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:14.947 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.947 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:14.947 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:14.947 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.947 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:14.948 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.948 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:14.948 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:14.948 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:14.948 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:14.948 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:14.948 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:14.948 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:14.948 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:14.948 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:14.948 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:14.948 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:14.948 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:14.948 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:14.948 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.948 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:14.949 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:14.949 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:14.949 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:14.949 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:14.949 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:14.949 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:14.949 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:14.949 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:14.949 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:14.949 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:14.949 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.949 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.949 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:14.949 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.949 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:14.949 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:14.949 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:14.950 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:14.950 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:14.950 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:14.950 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:14.950 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:14.950 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:14.950 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:14.950 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:14.950 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:14.950 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:14.950 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:14.950 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:14.950 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:14.950 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:14.950 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:14.950 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:14.951 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:14.951 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:14.951 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:14.951 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:14.951 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:14.951 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:14.951 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:14.951 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:14.951 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:14.951 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.951 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.951 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:14.951 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.951 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:14.951 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:14.951 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.952 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:14.952 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:14.952 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:14.952 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:14.952 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:14.952 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.952 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:14.952 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:14.952 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.952 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.952 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:14.952 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:14.952 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.952 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.952 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:14.952 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:14.953 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:14.953 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:14.953 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:14.953 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.953 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.953 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:14.953 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:14.953 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:14.953 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.953 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:14.953 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.953 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:14.953 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.953 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:14.953 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.953 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:14.953 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.954 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:14.954 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:14.954 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:14.954 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:14.954 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.954 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:14.954 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.954 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:14.954 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:14.954 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:14.954 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:14.954 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:14.954 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:14.954 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:14.954 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:14.954 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:14.955 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:14.955 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:14.955 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:14.955 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:14.955 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:14.955 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:14.955 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:14.955 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:14.955 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:14.955 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:14.955 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:14.955 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:14.955 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:14.955 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:14.955 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:14.955 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:14.955 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:14.956 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:14.956 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:14.956 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:14.956 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:14.956 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:14.956 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:14.956 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:14.956 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:14.956 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:14.956 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:14.956 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:14.956 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:14.956 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:14.956 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:14.956 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.956 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.957 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:14.957 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:14.957 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.957 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:14.957 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.957 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:14.957 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:14.957 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:14.957 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:14.957 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:14.957 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:14.957 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:14.957 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:14.957 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:14.958 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:14.958 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:14.958 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:14.958 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:14.958 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.958 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:14.958 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:14.958 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:14.958 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:14.958 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:14.958 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:14.958 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:14.958 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:14.958 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:14.958 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:14.958 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:14.959 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.959 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.959 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:14.959 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:14.959 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:14.959 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:14.959 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:14.959 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.959 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.959 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:14.959 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:14.959 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:14.959 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:14.959 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:14.959 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.959 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:14.959 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:14.960 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:14.960 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:14.960 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:14.960 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:14.960 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.960 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:14.960 INFO:teuthology.orchestra.run.smithi003.stdout:__________________ ERROR at teardown of test_atomic_read_8mb ___________________ 2023-12-03T13:00:14.960 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.960 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:14.960 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.960 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:14.960 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:14.960 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.960 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:14.960 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:14.960 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:14.960 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:14.961 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:14.961 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.961 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:14.961 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:14.961 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.961 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.961 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:14.961 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:14.961 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.961 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.961 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:14.961 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.961 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:14.961 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:14.961 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.961 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.962 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:14.962 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:14.962 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.962 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:14.962 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:14.962 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:14.962 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:14.962 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:14.962 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:14.962 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:14.962 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.962 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:14.962 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:14.962 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:14.962 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:14.962 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:14.963 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:14.963 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:14.963 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:14.963 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:14.963 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.963 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:14.963 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:14.963 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:14.963 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:14.963 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.963 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:14.963 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:14.963 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:14.963 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:14.963 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.963 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.964 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:14.964 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:14.964 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:14.964 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:14.964 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.964 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.964 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:14.964 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:14.964 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:14.964 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.964 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:14.964 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.964 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:14.964 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:14.964 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.964 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:14.964 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:14.965 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:14.965 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:14.965 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:14.965 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:14.965 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.965 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:14.965 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.965 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:14.965 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.965 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:14.965 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:14.965 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.965 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:14.965 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.965 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:14.965 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:14.965 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:14.966 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:14.966 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:14.966 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:14.966 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:14.966 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:14.966 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:14.966 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:14.966 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:14.966 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:14.966 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:14.966 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.966 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:14.966 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:14.966 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:14.966 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:14.966 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:14.967 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:14.967 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:14.967 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:14.967 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:14.967 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:14.967 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:14.967 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.967 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.967 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:14.967 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.967 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:14.967 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:14.967 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:14.967 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:14.967 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:14.968 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:14.968 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:14.968 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:14.968 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:14.968 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:14.968 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:14.968 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:14.968 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:14.968 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:14.968 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:14.968 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:14.968 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:14.968 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:14.968 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:14.968 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:14.968 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:14.969 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:14.969 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:14.969 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:14.969 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:14.969 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:14.969 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:14.969 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:14.969 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.969 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.969 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:14.969 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.969 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:14.969 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:14.969 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.969 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:14.969 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:14.969 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:14.970 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:14.970 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:14.970 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.970 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:14.970 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:14.970 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.970 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.970 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:14.970 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:14.970 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.970 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.970 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:14.970 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:14.970 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:14.970 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:14.971 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:14.971 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.971 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.971 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:14.971 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:14.971 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:14.971 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.971 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:14.971 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.971 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:14.971 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.971 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:14.971 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.971 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:14.971 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.971 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:14.971 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:14.972 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:14.972 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:14.972 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.972 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:14.972 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.972 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:14.972 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:14.972 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:14.972 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:14.972 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:14.972 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:14.972 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:14.972 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:14.972 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:14.972 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:14.972 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:14.972 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:14.973 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:14.973 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:14.973 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:14.973 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:14.973 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:14.973 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:14.973 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:14.973 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:14.973 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:14.973 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:14.973 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:14.973 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:14.973 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:14.973 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:14.973 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:14.973 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:14.974 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:14.974 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:14.974 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:14.974 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:14.974 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:14.974 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:14.974 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:14.974 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:14.974 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:14.974 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:14.974 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:14.974 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:14.974 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.974 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.974 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:14.974 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:14.975 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.975 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:14.975 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.975 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:14.975 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:14.975 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:14.975 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:14.975 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:14.975 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:14.975 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:14.975 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:14.975 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:14.975 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:14.975 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:14.975 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:14.975 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:14.975 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.976 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:14.976 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:14.976 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:14.976 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:14.976 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:14.976 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:14.976 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:14.976 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:14.976 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:14.976 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:14.976 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:14.976 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.976 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.976 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:14.976 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:14.976 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:14.976 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:14.977 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:14.977 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.977 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.977 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:14.977 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:14.977 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:14.977 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:14.977 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:14.977 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.977 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:14.977 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:14.977 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:14.977 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:14.977 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:14.977 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:14.977 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.977 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:14.978 INFO:teuthology.orchestra.run.smithi003.stdout:__________________ ERROR at teardown of test_atomic_write_1mb __________________ 2023-12-03T13:00:14.978 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.978 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:14.978 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.978 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:14.978 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:14.978 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.978 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:14.978 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:14.978 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:14.978 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:14.978 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:14.978 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.978 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:14.979 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:14.979 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.979 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.979 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:14.979 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:14.979 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.979 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.979 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:14.979 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.979 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:14.979 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:14.979 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.979 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.979 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:14.979 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:14.979 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.980 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:14.980 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:14.980 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:14.980 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:14.980 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:14.980 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:14.980 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:14.980 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.980 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:14.980 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:14.980 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:14.980 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:14.980 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:14.980 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:14.980 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:14.980 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:14.980 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:14.981 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.981 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:14.981 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:14.981 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:14.981 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:14.981 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.981 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:14.981 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:14.981 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:14.981 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:14.981 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.981 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.981 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:14.981 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:14.981 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:14.981 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:14.982 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.982 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.982 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:14.982 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:14.982 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:14.982 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.982 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:14.982 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.982 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:14.982 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:14.982 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.982 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:14.982 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:14.982 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:14.982 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:14.982 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:14.983 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:14.983 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.983 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:14.983 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.983 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:14.983 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.983 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:14.983 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:14.983 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.983 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:14.983 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.983 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:14.983 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:14.983 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:14.983 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:14.983 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:14.983 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:14.984 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:14.984 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:14.984 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:14.984 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:14.984 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:14.984 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:14.984 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:14.984 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.984 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:14.984 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:14.984 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:14.984 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:14.984 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:14.984 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:14.984 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:14.984 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:14.985 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:14.985 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:14.985 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:14.985 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.985 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.985 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:14.985 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.985 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:14.985 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:14.985 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:14.985 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:14.985 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:14.985 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:14.985 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:14.985 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:14.985 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:14.985 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:14.986 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:14.986 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:14.986 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:14.986 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:14.986 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:14.986 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:14.986 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:14.986 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:14.986 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:14.986 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:14.986 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:14.986 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:14.986 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:14.986 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:14.986 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:14.986 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:14.987 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:14.987 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:14.987 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.987 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.987 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:14.987 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.987 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:14.987 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:14.987 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.987 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:14.987 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:14.987 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:14.987 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:14.987 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:14.987 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.987 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:14.988 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:14.988 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.988 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.988 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:14.988 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:14.988 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.988 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.988 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:14.988 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:14.988 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:14.988 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:14.988 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:14.988 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.988 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.988 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:14.988 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:14.988 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:14.989 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.989 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:14.989 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.989 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:14.989 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.989 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:14.989 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.989 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:14.989 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.989 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:14.989 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:14.989 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:14.989 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:14.989 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.989 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:14.990 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.990 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:14.990 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:14.990 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:14.990 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:14.990 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:14.990 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:14.990 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:14.990 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:14.990 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:14.990 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:14.990 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:14.990 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:14.990 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:14.990 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:14.991 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:14.991 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:14.991 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:14.991 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:14.991 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:14.991 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:14.991 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:14.991 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:14.991 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:14.991 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:14.991 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:14.991 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:14.991 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:14.991 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:14.991 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:14.991 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:14.992 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:14.992 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:14.992 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:14.992 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:14.992 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:14.992 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:14.992 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:14.992 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:14.992 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:14.992 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:14.992 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.992 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.992 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:14.992 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:14.992 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.992 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:14.992 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.993 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:14.993 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:14.993 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:14.993 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:14.993 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:14.993 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:14.993 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:14.993 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:14.993 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:14.993 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:14.993 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:14.993 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:14.993 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:14.993 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.993 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:14.994 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:14.994 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:14.994 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:14.994 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:14.994 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:14.994 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:14.994 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:14.994 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:14.994 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:14.994 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:14.994 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.994 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.994 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:14.994 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:14.994 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:14.995 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:14.995 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:14.995 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.995 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.995 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:14.995 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:14.995 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:14.995 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:14.995 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:14.995 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.995 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:14.995 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:14.995 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:14.995 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:14.995 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:14.995 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:14.995 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.996 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:14.996 INFO:teuthology.orchestra.run.smithi003.stdout:__________________ ERROR at teardown of test_atomic_write_4mb __________________ 2023-12-03T13:00:14.996 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.996 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:14.996 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.996 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:14.996 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:14.996 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.996 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:14.996 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:14.996 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:14.996 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:14.996 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:14.996 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.996 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:14.996 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:14.997 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.997 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.997 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:14.997 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:14.997 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:14.997 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.997 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:14.997 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.997 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:14.997 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:14.997 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:14.997 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.997 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:14.997 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:14.997 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.997 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:14.997 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:14.998 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:14.998 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:14.998 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:14.998 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:14.998 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:14.998 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.998 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:14.998 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:14.998 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:14.998 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:14.998 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:14.998 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:14.998 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:14.998 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:14.998 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:14.999 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.999 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:14.999 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:14.999 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:14.999 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:14.999 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.999 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:14.999 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:14.999 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:14.999 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:14.999 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:14.999 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:14.999 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:14.999 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:14.999 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:14.999 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:14.999 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.000 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.000 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:15.000 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:15.000 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:15.000 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.000 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:15.000 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.000 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:15.000 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:15.000 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.000 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:15.000 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:15.000 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:15.000 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:15.001 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:15.001 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:15.001 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.001 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:15.001 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.001 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:15.001 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.001 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.001 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:15.001 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.001 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:15.001 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.001 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:15.001 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:15.001 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:15.001 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:15.001 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:15.002 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:15.002 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.002 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:15.002 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:15.002 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:15.002 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:15.002 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:15.002 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:15.002 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.002 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:15.002 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:15.002 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:15.002 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:15.002 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:15.002 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:15.002 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:15.003 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:15.003 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:15.003 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:15.003 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:15.003 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.003 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.003 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:15.003 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.003 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:15.003 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:15.003 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:15.003 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:15.003 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:15.003 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:15.003 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:15.003 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:15.003 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:15.004 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:15.004 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:15.004 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:15.004 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:15.004 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:15.004 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:15.004 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:15.004 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:15.004 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:15.004 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:15.004 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:15.004 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:15.004 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:15.004 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:15.004 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:15.004 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:15.004 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:15.005 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:15.005 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:15.005 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.005 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.005 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.005 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.005 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:15.005 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:15.005 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.005 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:15.005 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.005 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:15.005 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:15.005 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:15.005 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.005 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:15.006 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:15.006 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.006 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.006 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:15.006 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:15.006 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.006 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.006 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:15.006 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:15.006 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:15.006 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:15.006 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:15.006 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.006 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.006 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:15.006 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:15.007 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:15.007 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.007 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:15.007 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.007 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:15.007 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.007 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:15.007 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.007 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:15.007 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.007 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:15.007 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:15.007 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:15.007 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:15.008 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.008 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:15.008 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.008 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:15.008 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:15.008 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:15.008 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:15.008 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:15.008 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:15.008 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:15.008 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:15.008 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:15.008 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:15.008 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:15.008 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:15.008 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:15.009 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:15.009 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:15.009 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:15.009 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:15.009 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:15.009 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:15.009 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:15.009 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:15.009 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:15.009 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:15.009 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:15.009 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:15.009 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:15.009 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:15.009 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:15.009 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:15.009 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:15.010 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:15.010 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:15.010 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:15.010 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:15.010 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:15.010 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:15.010 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:15.010 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:15.010 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:15.010 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:15.010 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.010 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.010 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.010 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:15.011 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.011 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:15.011 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.011 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:15.011 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:15.011 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:15.011 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:15.011 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:15.011 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:15.011 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.011 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:15.011 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:15.011 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:15.011 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:15.012 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:15.012 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:15.012 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.012 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:15.012 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:15.012 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:15.012 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:15.012 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:15.012 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:15.012 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:15.012 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:15.012 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:15.012 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:15.012 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:15.012 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.012 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.012 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:15.013 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:15.013 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:15.013 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:15.013 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:15.013 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.013 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.013 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:15.013 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:15.013 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:15.013 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:15.013 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:15.013 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.013 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:15.013 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:15.013 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:15.013 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:15.013 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:15.014 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:15.014 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.014 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:15.014 INFO:teuthology.orchestra.run.smithi003.stdout:__________________ ERROR at teardown of test_atomic_write_8mb __________________ 2023-12-03T13:00:15.014 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.014 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.014 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.014 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:15.014 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:15.014 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.014 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:15.014 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.014 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:15.014 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:15.014 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:15.014 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.015 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:15.015 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:15.015 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.015 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.015 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:15.015 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:15.015 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.015 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.015 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:15.015 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.015 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:15.015 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:15.015 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.015 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.015 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:15.015 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:15.015 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.016 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:15.016 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:15.016 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:15.016 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:15.016 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:15.016 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.016 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:15.016 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.016 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:15.016 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:15.016 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:15.016 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:15.016 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:15.016 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:15.016 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:15.016 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:15.017 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.017 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.017 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:15.017 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:15.017 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:15.017 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:15.017 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.017 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:15.017 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:15.017 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:15.017 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:15.017 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.017 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.017 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:15.017 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:15.017 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:15.017 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:15.018 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.018 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.018 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:15.018 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:15.018 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:15.018 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.018 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:15.018 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.018 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:15.018 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:15.018 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.018 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:15.018 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:15.018 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:15.018 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:15.019 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:15.019 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:15.019 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.019 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:15.019 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.019 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:15.019 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.019 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.019 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:15.019 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.019 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:15.019 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.019 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:15.019 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:15.019 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:15.019 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:15.019 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:15.020 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:15.020 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.020 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:15.020 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:15.020 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:15.020 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:15.020 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:15.020 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:15.020 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.020 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:15.020 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:15.020 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:15.020 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:15.020 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:15.020 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:15.020 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:15.020 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:15.021 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:15.021 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:15.021 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:15.021 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.021 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.021 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:15.021 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.021 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:15.021 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:15.021 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:15.021 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:15.021 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:15.021 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:15.021 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:15.022 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:15.022 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:15.022 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:15.022 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:15.022 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:15.022 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:15.022 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:15.022 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:15.022 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:15.022 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:15.022 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:15.022 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:15.022 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:15.022 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:15.022 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:15.022 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:15.023 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:15.023 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:15.023 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:15.023 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:15.023 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:15.023 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.023 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.023 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.023 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.023 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:15.023 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:15.023 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.023 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:15.023 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.023 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:15.023 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:15.024 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:15.024 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.024 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:15.024 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:15.024 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.024 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.024 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:15.024 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:15.024 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.024 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.024 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:15.024 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:15.024 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:15.024 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:15.024 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:15.025 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.025 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.025 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:15.025 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:15.025 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:15.025 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.025 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:15.025 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.025 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:15.025 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.025 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:15.025 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.025 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:15.025 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.025 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:15.025 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:15.025 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:15.026 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:15.026 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.026 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:15.026 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.026 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:15.026 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:15.026 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:15.026 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:15.026 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:15.026 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:15.026 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:15.026 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:15.026 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:15.026 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:15.026 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:15.026 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:15.026 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:15.027 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:15.027 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:15.027 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:15.027 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:15.027 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:15.027 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:15.027 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:15.027 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:15.027 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:15.027 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:15.027 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:15.027 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:15.027 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:15.027 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:15.027 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:15.027 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:15.028 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:15.028 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:15.028 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:15.028 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:15.028 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:15.028 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:15.028 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:15.028 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:15.028 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:15.028 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:15.028 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:15.028 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.028 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.028 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.028 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:15.028 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.029 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:15.029 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.029 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:15.029 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:15.029 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:15.029 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:15.029 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:15.029 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:15.029 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.029 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:15.029 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:15.029 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:15.029 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:15.029 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:15.029 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:15.029 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.029 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:15.030 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:15.030 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:15.030 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:15.030 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:15.030 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:15.030 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:15.030 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:15.030 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:15.030 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:15.030 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:15.030 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.030 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.030 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:15.030 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:15.030 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:15.030 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:15.030 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:15.031 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.031 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.031 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:15.031 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:15.031 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:15.031 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:15.031 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:15.031 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.031 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:15.031 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:15.031 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:15.031 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:15.031 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:15.031 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:15.031 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.031 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:15.031 INFO:teuthology.orchestra.run.smithi003.stdout:_______________ ERROR at teardown of test_atomic_dual_write_1mb ________________ 2023-12-03T13:00:15.032 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.032 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.032 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.032 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:15.032 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:15.032 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.032 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:15.032 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.032 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:15.032 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:15.032 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:15.032 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.032 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:15.032 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:15.033 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.033 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.033 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:15.033 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:15.033 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.033 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.033 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:15.033 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.033 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:15.033 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:15.033 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.033 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.033 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:15.033 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:15.033 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.033 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:15.034 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:15.034 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:15.034 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:15.034 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:15.034 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.034 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:15.034 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.034 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:15.034 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:15.034 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:15.034 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:15.034 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:15.034 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:15.034 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:15.034 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:15.034 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.034 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.035 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:15.035 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:15.035 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:15.035 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:15.035 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.035 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:15.035 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:15.035 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:15.035 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:15.035 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.035 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.035 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:15.035 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:15.035 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:15.035 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:15.035 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.036 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.036 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:15.036 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:15.036 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:15.036 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.036 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:15.036 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.036 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:15.036 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:15.036 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.036 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:15.036 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:15.036 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:15.036 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:15.036 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:15.036 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:15.036 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.037 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:15.037 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.037 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:15.037 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.037 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.037 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:15.037 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.037 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:15.037 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.037 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:15.037 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:15.037 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:15.037 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:15.037 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:15.037 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:15.037 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.038 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:15.038 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:15.038 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:15.038 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:15.038 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:15.038 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:15.038 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.038 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:15.038 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:15.038 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:15.038 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:15.038 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:15.038 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:15.038 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:15.038 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:15.038 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:15.039 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:15.039 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:15.039 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.039 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.039 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:15.039 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.039 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:15.039 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:15.039 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:15.039 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:15.039 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:15.039 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:15.039 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:15.039 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:15.039 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:15.039 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:15.039 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:15.040 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:15.040 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:15.040 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:15.040 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:15.040 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:15.040 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:15.040 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:15.040 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:15.040 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:15.040 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:15.040 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:15.040 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:15.040 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:15.040 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:15.040 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:15.040 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:15.040 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:15.041 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.041 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.041 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.041 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.041 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:15.041 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:15.041 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.041 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:15.041 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.041 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:15.041 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:15.041 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:15.041 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.041 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:15.041 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:15.041 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.042 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.042 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:15.042 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:15.042 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.042 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.042 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:15.042 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:15.045 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:15.045 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:15.045 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:15.045 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.045 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.045 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:15.045 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:15.045 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:15.045 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.045 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:15.045 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.045 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:15.045 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.045 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:15.045 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.046 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:15.046 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.046 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:15.046 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:15.046 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:15.046 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:15.046 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.046 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:15.047 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.047 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:15.047 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:15.047 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:15.047 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:15.047 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:15.047 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:15.047 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:15.047 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:15.047 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:15.047 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:15.047 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:15.047 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:15.048 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:15.048 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:15.048 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:15.048 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:15.048 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:15.048 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:15.048 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:15.048 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:15.048 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:15.048 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:15.048 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:15.048 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:15.048 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:15.048 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:15.048 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:15.048 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:15.048 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:15.049 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:15.049 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:15.049 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:15.049 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:15.049 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:15.049 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:15.049 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:15.049 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:15.049 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:15.049 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:15.049 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:15.049 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.049 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.049 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.049 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:15.049 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.050 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:15.050 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.050 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:15.050 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:15.050 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:15.050 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:15.050 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:15.050 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:15.050 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.050 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:15.050 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:15.050 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:15.050 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:15.050 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:15.050 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:15.050 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.051 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:15.051 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:15.051 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:15.051 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:15.051 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:15.051 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:15.051 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:15.051 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:15.051 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:15.051 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:15.051 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:15.051 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.051 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.051 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:15.051 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:15.051 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:15.052 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:15.052 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:15.052 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.052 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.052 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:15.052 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:15.052 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:15.052 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:15.052 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:15.052 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.052 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:15.052 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:15.052 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:15.052 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:15.052 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:15.052 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:15.053 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.053 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:15.053 INFO:teuthology.orchestra.run.smithi003.stdout:_______________ ERROR at teardown of test_atomic_dual_write_4mb ________________ 2023-12-03T13:00:15.053 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.053 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.053 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.053 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:15.053 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:15.053 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.053 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:15.053 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.053 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:15.053 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:15.053 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:15.053 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.053 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:15.053 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:15.054 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.054 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.054 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:15.054 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:15.054 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.054 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.054 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:15.054 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.054 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:15.054 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:15.054 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.054 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.054 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:15.054 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:15.054 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.054 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:15.054 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:15.055 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:15.055 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:15.055 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:15.055 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.055 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:15.055 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.055 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:15.055 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:15.055 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:15.055 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:15.055 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:15.055 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:15.055 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:15.055 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:15.055 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.056 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.056 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:15.056 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:15.056 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:15.056 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:15.056 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.056 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:15.056 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:15.056 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:15.056 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:15.056 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.056 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.056 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:15.056 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:15.056 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:15.056 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:15.056 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.057 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.057 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:15.057 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:15.057 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:15.057 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.057 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:15.057 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.057 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:15.057 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:15.057 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.057 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:15.057 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:15.057 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:15.057 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:15.058 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:15.058 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:15.058 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.058 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:15.058 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.058 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:15.058 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.058 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.058 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:15.058 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.058 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:15.058 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.058 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:15.059 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:15.059 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:15.059 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:15.059 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:15.059 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:15.059 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.059 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:15.059 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:15.059 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:15.059 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:15.059 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:15.059 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:15.059 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.059 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:15.059 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:15.059 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:15.060 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:15.060 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:15.060 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:15.060 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:15.060 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:15.060 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:15.060 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:15.060 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:15.060 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.060 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.060 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:15.060 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.060 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:15.060 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:15.060 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:15.060 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:15.060 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:15.061 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:15.061 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:15.061 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:15.061 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:15.061 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:15.061 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:15.061 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:15.061 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:15.061 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:15.061 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:15.061 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:15.061 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:15.061 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:15.061 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:15.061 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:15.061 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:15.062 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:15.062 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:15.062 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:15.062 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:15.062 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:15.062 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:15.062 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:15.062 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.062 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.062 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.062 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.062 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:15.062 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:15.062 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.063 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:15.063 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.063 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:15.063 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:15.063 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:15.063 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.063 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:15.063 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:15.063 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.063 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.063 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:15.063 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:15.063 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.063 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.063 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:15.063 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:15.063 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:15.064 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:15.064 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:15.064 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.064 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.064 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:15.064 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:15.064 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:15.064 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.064 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:15.064 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.064 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:15.064 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.064 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:15.064 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.064 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:15.064 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.064 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:15.065 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:15.065 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:15.065 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:15.065 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.065 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:15.065 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.065 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:15.065 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:15.065 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:15.065 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:15.065 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:15.065 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:15.065 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:15.065 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:15.065 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:15.065 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:15.065 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:15.066 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:15.066 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:15.066 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:15.066 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:15.066 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:15.066 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:15.066 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:15.066 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:15.066 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:15.066 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:15.066 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:15.066 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:15.066 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:15.066 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:15.066 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:15.066 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:15.067 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:15.067 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:15.067 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:15.067 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:15.067 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:15.067 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:15.067 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:15.067 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:15.067 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:15.067 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:15.067 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:15.067 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:15.067 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:15.067 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.067 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.067 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.068 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:15.068 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.068 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:15.068 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.068 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:15.068 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:15.068 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:15.068 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:15.068 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:15.068 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:15.068 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.068 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:15.068 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:15.068 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:15.068 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:15.069 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:15.069 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:15.069 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.069 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:15.069 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:15.069 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:15.069 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:15.069 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:15.069 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:15.069 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:15.069 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:15.069 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:15.069 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:15.069 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:15.069 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.069 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.070 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:15.070 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:15.070 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:15.070 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:15.070 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:15.070 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.070 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.070 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:15.070 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:15.070 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:15.070 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:15.070 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:15.070 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.071 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:15.071 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:15.071 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:15.071 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:15.071 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:15.071 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:15.071 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.071 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:15.071 INFO:teuthology.orchestra.run.smithi003.stdout:_______________ ERROR at teardown of test_atomic_dual_write_8mb ________________ 2023-12-03T13:00:15.071 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.071 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.071 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.071 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:15.071 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:15.071 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.071 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:15.072 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.072 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:15.072 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:15.072 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:15.072 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.072 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:15.072 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:15.072 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.072 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.072 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:15.072 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:15.072 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.072 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.072 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:15.072 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.072 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:15.072 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:15.073 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.073 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.073 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:15.073 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:15.073 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.073 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:15.073 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:15.073 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:15.073 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:15.073 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:15.073 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.073 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:15.073 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.073 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:15.073 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:15.073 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:15.074 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:15.074 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:15.074 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:15.074 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:15.074 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:15.074 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.074 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.074 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:15.074 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:15.074 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:15.074 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:15.074 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.074 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:15.074 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:15.074 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:15.074 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:15.075 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.075 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.075 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:15.075 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:15.075 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:15.075 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:15.075 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.075 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.075 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:15.075 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:15.075 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:15.075 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.075 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:15.075 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.075 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:15.075 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:15.076 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.076 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:15.076 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:15.076 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:15.076 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:15.076 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:15.076 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:15.076 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.076 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:15.076 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.076 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:15.076 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.076 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.076 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:15.076 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.076 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:15.076 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.077 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:15.077 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:15.077 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:15.077 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:15.077 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:15.077 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:15.077 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.077 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:15.077 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:15.077 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:15.077 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:15.077 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:15.077 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:15.077 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.077 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:15.077 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:15.078 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:15.078 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:15.078 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:15.078 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:15.078 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:15.078 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:15.078 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:15.078 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:15.078 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:15.078 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.078 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.078 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:15.078 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.078 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:15.078 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:15.078 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:15.078 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:15.079 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:15.079 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:15.079 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:15.079 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:15.079 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:15.079 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:15.079 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:15.079 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:15.079 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:15.079 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:15.079 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:15.079 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:15.079 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:15.080 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:15.080 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:15.080 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:15.080 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:15.080 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:15.080 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:15.080 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:15.080 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:15.080 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:15.080 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:15.080 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:15.080 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.080 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.080 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.080 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.080 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:15.081 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:15.081 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.081 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:15.081 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.081 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:15.081 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:15.081 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:15.081 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.081 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:15.081 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:15.081 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.081 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.081 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:15.081 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:15.081 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.081 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.081 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:15.082 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:15.082 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:15.082 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:15.082 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:15.082 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.082 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.082 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:15.082 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:15.082 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:15.082 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.082 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:15.082 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.082 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:15.082 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.082 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:15.083 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.083 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:15.083 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.083 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:15.083 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:15.083 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:15.083 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:15.083 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.083 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:15.083 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.083 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:15.083 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:15.083 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:15.083 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:15.083 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:15.083 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:15.083 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:15.084 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:15.084 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:15.084 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:15.084 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:15.084 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:15.084 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:15.084 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:15.084 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:15.084 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:15.084 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:15.084 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:15.084 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:15.084 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:15.084 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:15.084 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:15.084 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:15.084 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:15.085 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:15.085 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:15.085 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:15.085 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:15.085 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:15.085 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:15.085 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:15.085 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:15.085 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:15.085 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:15.085 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:15.085 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:15.085 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:15.085 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:15.085 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:15.085 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:15.085 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.086 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.086 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.086 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:15.086 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.086 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:15.086 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.086 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:15.086 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:15.086 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:15.086 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:15.086 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:15.086 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:15.086 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.086 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:15.086 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:15.086 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:15.087 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:15.087 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:15.087 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:15.087 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.087 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:15.087 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:15.087 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:15.087 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:15.087 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:15.087 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:15.087 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:15.087 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:15.087 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:15.087 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:15.087 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:15.087 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.088 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.088 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:15.088 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:15.088 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:15.088 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:15.088 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:15.088 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.088 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.088 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:15.088 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:15.088 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:15.088 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:15.088 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:15.088 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.088 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:15.088 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:15.088 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:15.089 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:15.089 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:15.089 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:15.089 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.089 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:15.089 INFO:teuthology.orchestra.run.smithi003.stdout:____________ ERROR at teardown of test_atomic_conditional_write_1mb ____________ 2023-12-03T13:00:15.089 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.089 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.089 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.089 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:15.089 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:15.089 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.089 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:15.089 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.090 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:15.090 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:15.090 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:15.090 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.090 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:15.090 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:15.090 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.090 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.090 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:15.090 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:15.090 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.090 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.090 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:15.090 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.090 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:15.090 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:15.091 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.091 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.091 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:15.091 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:15.091 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.091 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:15.091 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:15.091 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:15.091 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:15.091 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:15.091 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.091 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:15.091 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.091 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:15.091 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:15.091 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:15.091 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:15.092 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:15.092 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:15.092 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:15.092 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:15.092 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.092 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.092 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:15.092 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:15.092 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:15.092 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:15.092 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.092 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:15.092 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:15.092 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:15.092 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:15.093 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.093 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.093 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:15.093 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:15.093 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:15.093 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:15.093 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.093 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.093 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:15.093 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:15.093 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:15.093 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.093 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:15.093 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.093 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:15.093 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:15.093 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.094 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:15.094 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:15.094 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:15.094 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:15.094 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:15.094 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:15.094 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.094 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:15.094 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.094 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:15.094 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.094 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.094 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:15.094 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.094 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:15.095 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.095 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:15.095 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:15.095 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:15.095 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:15.095 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:15.095 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:15.095 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.095 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:15.095 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:15.095 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:15.095 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:15.095 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:15.095 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:15.095 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.095 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:15.096 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:15.096 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:15.096 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:15.096 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:15.096 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:15.096 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:15.096 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:15.096 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:15.096 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:15.096 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:15.096 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.096 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.096 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:15.096 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.096 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:15.096 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:15.096 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:15.097 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:15.097 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:15.097 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:15.097 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:15.097 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:15.097 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:15.097 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:15.097 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:15.097 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:15.097 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:15.097 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:15.097 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:15.097 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:15.097 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:15.097 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:15.097 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:15.098 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:15.098 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:15.098 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:15.098 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:15.098 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:15.098 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:15.098 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:15.098 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:15.098 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:15.098 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.098 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.098 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.098 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.098 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:15.098 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:15.099 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.099 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:15.099 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.099 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:15.099 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:15.099 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:15.099 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.099 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:15.099 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:15.099 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.099 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.099 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:15.099 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:15.099 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.099 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.099 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:15.099 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:15.100 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:15.100 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:15.100 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:15.100 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.100 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.100 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:15.100 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:15.100 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:15.100 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.100 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:15.100 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.100 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:15.100 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.100 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:15.100 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.100 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:15.100 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.101 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:15.101 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:15.101 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:15.101 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:15.101 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.101 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:15.101 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.101 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:15.101 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:15.101 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:15.101 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:15.101 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:15.101 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:15.102 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:15.102 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:15.102 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:15.102 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:15.102 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:15.102 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:15.102 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:15.102 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:15.102 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:15.102 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:15.102 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:15.102 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:15.102 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:15.102 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:15.102 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:15.103 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:15.103 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:15.103 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:15.103 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:15.103 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:15.103 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:15.103 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:15.103 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:15.103 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:15.103 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:15.103 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:15.103 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:15.103 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:15.103 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:15.103 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:15.103 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:15.103 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:15.104 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:15.104 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:15.104 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.104 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.104 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.104 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:15.104 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.104 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:15.104 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.104 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:15.104 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:15.104 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:15.104 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:15.104 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:15.104 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:15.104 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.104 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:15.105 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:15.105 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:15.105 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:15.105 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:15.105 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:15.105 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.105 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:15.105 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:15.105 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:15.105 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:15.105 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:15.105 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:15.105 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:15.105 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:15.105 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:15.105 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:15.105 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:15.106 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.106 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.106 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:15.106 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:15.106 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:15.106 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:15.106 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:15.106 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.106 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.106 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:15.106 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:15.106 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:15.106 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:15.106 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:15.106 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.106 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:15.107 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:15.107 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:15.107 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:15.107 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:15.107 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:15.107 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.107 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:15.107 INFO:teuthology.orchestra.run.smithi003.stdout:___________ ERROR at teardown of test_atomic_multipart_upload_write ____________ 2023-12-03T13:00:15.107 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.107 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.107 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.107 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:15.107 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:15.107 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.107 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:15.107 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.108 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:15.108 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:15.108 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:15.108 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.108 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:15.108 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:15.108 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.108 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.108 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:15.108 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:15.108 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.108 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.108 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:15.108 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.108 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:15.108 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:15.109 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.109 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.109 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:15.109 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:15.109 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.109 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:15.109 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:15.109 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:15.109 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:15.109 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:15.109 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.109 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:15.109 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.109 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:15.109 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:15.109 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:15.110 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:15.110 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:15.110 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:15.110 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:15.110 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:15.110 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.110 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.110 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:15.110 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:15.110 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:15.110 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:15.110 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.110 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:15.110 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:15.110 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:15.111 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:15.111 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.111 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.111 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:15.111 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:15.111 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:15.111 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:15.111 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.111 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.111 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:15.111 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:15.111 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:15.111 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.111 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:15.111 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.111 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:15.112 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:15.112 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.112 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:15.112 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:15.112 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:15.112 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:15.112 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:15.112 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:15.112 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.112 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:15.112 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.112 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:15.112 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.112 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.113 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:15.113 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.113 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:15.113 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.113 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:15.113 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:15.113 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:15.113 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:15.113 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:15.113 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:15.113 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.113 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:15.113 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:15.113 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:15.113 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:15.113 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:15.114 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:15.114 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.114 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:15.114 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:15.114 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:15.114 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:15.114 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:15.114 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:15.114 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:15.114 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:15.114 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:15.114 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:15.114 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:15.114 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.114 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.114 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:15.115 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.115 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:15.115 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:15.115 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:15.115 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:15.115 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:15.115 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:15.115 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:15.115 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:15.115 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:15.115 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:15.115 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:15.115 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:15.115 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:15.115 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:15.115 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:15.116 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:15.116 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:15.116 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:15.116 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:15.116 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:15.116 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:15.116 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:15.116 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:15.116 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:15.116 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:15.116 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:15.116 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:15.116 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:15.116 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.116 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.116 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.117 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.117 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:15.117 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:15.117 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.117 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:15.117 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.117 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:15.117 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:15.117 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:15.117 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.117 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:15.117 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:15.117 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.117 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.117 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:15.117 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:15.117 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.118 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.118 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:15.118 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:15.118 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:15.118 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:15.118 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:15.118 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.118 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.118 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:15.118 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:15.118 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:15.118 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.118 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:15.118 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.118 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:15.119 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.119 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:15.119 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.119 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:15.119 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.119 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:15.119 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:15.119 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:15.119 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:15.119 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.119 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:15.119 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.119 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:15.119 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:15.119 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:15.119 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:15.120 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:15.120 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:15.120 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:15.120 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:15.120 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:15.120 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:15.120 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:15.120 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:15.120 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:15.120 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:15.120 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:15.120 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:15.120 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:15.120 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:15.120 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:15.120 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:15.120 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:15.121 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:15.121 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:15.121 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:15.121 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:15.121 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:15.121 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:15.121 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:15.121 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:15.121 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:15.121 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:15.121 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:15.121 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:15.121 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:15.121 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:15.121 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:15.121 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:15.122 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:15.122 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:15.122 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:15.122 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.122 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.122 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.122 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:15.122 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.122 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:15.122 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.122 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:15.123 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:15.123 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:15.123 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:15.123 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:15.123 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:15.123 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.123 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:15.123 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:15.123 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:15.123 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:15.123 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:15.123 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:15.123 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.123 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:15.123 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:15.124 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:15.124 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:15.124 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:15.124 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:15.124 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:15.124 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:15.124 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:15.124 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:15.124 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:15.124 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.124 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.124 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:15.124 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:15.124 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:15.124 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:15.125 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:15.125 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.125 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.125 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:15.125 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:15.125 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:15.125 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:15.125 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:15.125 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.125 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:15.125 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:15.125 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:15.125 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:15.125 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:15.125 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:15.126 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.126 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:15.126 INFO:teuthology.orchestra.run.smithi003.stdout:________ ERROR at teardown of test_multipart_resend_first_finishes_last ________ 2023-12-03T13:00:15.126 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.126 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.126 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.126 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:15.126 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:15.126 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.126 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:15.126 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.126 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:15.126 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:15.126 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:15.126 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.127 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:15.127 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:15.127 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.127 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.127 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:15.127 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:15.127 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.127 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.127 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:15.127 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.127 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:15.127 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:15.127 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.127 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.127 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:15.127 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:15.128 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.128 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:15.128 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:15.128 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:15.128 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:15.128 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:15.128 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.128 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:15.128 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.128 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:15.128 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:15.128 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:15.128 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:15.128 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:15.128 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:15.128 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:15.129 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:15.129 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.129 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.129 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:15.129 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:15.129 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:15.129 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:15.129 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.129 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:15.129 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:15.129 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:15.129 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:15.129 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.129 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.129 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:15.129 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:15.130 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:15.130 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:15.130 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.130 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.130 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:15.130 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:15.130 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:15.130 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.130 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:15.130 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.130 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:15.130 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:15.130 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.130 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:15.130 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:15.130 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:15.131 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:15.131 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:15.131 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:15.131 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.131 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:15.131 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.131 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:15.131 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.131 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.131 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:15.131 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.131 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:15.131 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.131 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:15.131 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:15.131 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:15.131 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:15.132 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:15.132 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:15.132 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.132 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:15.132 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:15.132 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:15.132 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:15.132 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:15.132 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:15.132 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.132 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:15.132 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:15.132 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:15.132 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:15.132 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:15.132 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:15.132 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:15.133 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:15.133 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:15.133 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:15.133 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:15.133 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.133 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.133 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:15.133 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.133 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:15.133 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:15.133 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:15.133 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:15.133 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:15.133 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:15.133 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:15.133 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:15.133 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:15.134 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:15.134 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:15.134 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:15.134 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:15.134 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:15.134 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:15.134 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:15.134 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:15.134 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:15.134 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:15.134 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:15.134 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:15.134 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:15.135 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:15.135 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:15.135 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:15.135 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:15.135 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:15.135 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:15.135 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.135 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.135 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.135 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.135 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:15.135 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:15.135 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.135 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:15.135 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.135 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:15.135 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:15.136 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:15.136 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.136 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:15.136 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:15.136 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.136 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.136 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:15.136 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:15.136 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.136 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.136 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:15.136 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:15.136 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:15.136 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:15.136 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:15.136 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.137 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.137 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:15.137 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:15.137 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:15.137 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.137 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:15.137 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.137 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:15.137 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.137 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:15.137 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.137 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:15.137 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.137 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:15.137 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:15.137 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:15.137 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:15.138 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.138 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:15.138 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.138 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:15.138 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:15.138 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:15.138 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:15.138 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:15.138 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:15.138 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:15.138 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:15.138 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:15.138 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:15.138 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:15.138 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:15.138 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:15.139 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:15.139 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:15.139 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:15.139 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:15.139 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:15.139 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:15.139 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:15.139 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:15.139 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:15.139 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:15.139 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:15.139 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:15.139 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:15.139 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:15.139 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:15.140 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:15.140 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:15.140 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:15.140 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:15.140 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:15.140 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:15.140 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:15.140 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:15.140 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:15.140 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:15.140 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:15.140 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:15.140 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.140 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.140 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.140 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:15.141 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.141 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:15.141 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.141 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:15.141 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:15.141 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:15.141 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:15.141 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:15.141 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:15.141 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.141 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:15.141 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:15.141 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:15.141 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:15.141 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:15.141 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:15.142 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.142 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:15.142 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:15.142 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:15.142 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:15.142 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:15.142 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:15.142 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:15.142 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:15.142 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:15.142 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:15.142 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:15.142 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.142 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.142 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:15.142 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:15.143 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:15.143 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:15.143 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:15.143 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.143 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.143 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:15.143 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:15.143 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:15.143 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:15.143 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:15.143 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.143 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:15.143 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:15.143 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:15.143 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:15.143 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:15.143 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:15.144 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.144 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:15.144 INFO:teuthology.orchestra.run.smithi003.stdout:____________ ERROR at teardown of test_ranged_request_response_code ____________ 2023-12-03T13:00:15.144 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.144 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.144 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.144 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:15.144 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:15.144 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.144 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:15.144 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.144 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:15.144 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:15.144 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:15.145 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.145 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:15.145 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:15.145 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.145 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.145 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:15.145 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:15.145 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.145 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.145 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:15.145 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.145 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:15.145 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:15.145 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.145 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.145 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:15.146 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:15.146 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.146 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:15.146 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:15.146 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:15.146 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:15.146 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:15.146 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.146 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:15.146 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.146 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:15.146 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:15.146 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:15.146 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:15.146 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:15.146 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:15.147 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:15.147 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:15.147 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.147 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.147 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:15.147 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:15.147 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:15.147 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:15.147 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.147 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:15.147 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:15.147 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:15.147 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:15.147 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.147 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.147 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:15.148 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:15.148 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:15.148 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:15.148 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.148 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.148 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:15.148 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:15.148 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:15.148 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.148 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:15.148 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.148 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:15.148 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:15.148 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.148 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:15.148 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:15.148 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:15.149 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:15.149 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:15.149 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:15.149 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.149 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:15.149 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.149 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:15.149 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.149 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.149 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:15.149 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.149 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:15.149 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.149 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:15.149 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:15.149 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:15.149 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:15.150 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:15.150 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:15.150 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.150 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:15.150 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:15.150 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:15.150 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:15.150 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:15.150 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:15.150 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.150 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:15.150 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:15.150 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:15.150 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:15.150 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:15.150 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:15.151 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:15.151 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:15.151 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:15.151 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:15.151 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:15.151 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.151 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.151 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:15.151 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.151 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:15.151 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:15.151 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:15.151 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:15.151 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:15.151 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:15.151 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:15.152 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:15.152 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:15.152 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:15.152 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:15.152 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:15.152 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:15.152 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:15.152 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:15.152 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:15.152 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:15.152 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:15.152 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:15.152 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:15.152 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:15.152 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:15.152 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:15.152 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:15.153 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:15.153 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:15.153 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:15.153 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:15.153 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.153 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.153 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.153 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.153 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:15.153 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:15.153 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.153 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:15.153 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.153 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:15.153 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:15.153 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:15.154 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.154 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:15.154 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:15.154 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.154 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.154 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:15.154 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:15.154 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.154 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.154 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:15.154 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:15.154 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:15.154 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:15.154 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:15.154 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.155 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.155 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:15.155 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:15.155 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:15.155 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.155 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:15.155 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.155 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:15.155 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.155 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:15.155 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.155 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:15.155 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.155 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:15.155 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:15.155 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:15.156 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:15.156 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.156 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:15.156 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.156 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:15.156 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:15.156 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:15.156 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:15.156 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:15.156 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:15.156 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:15.156 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:15.156 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:15.156 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:15.157 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:15.157 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:15.157 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:15.157 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:15.157 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:15.157 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:15.157 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:15.157 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:15.157 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:15.157 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:15.157 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:15.157 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:15.157 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:15.157 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:15.157 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:15.157 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:15.157 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:15.158 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:15.158 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:15.158 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:15.158 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:15.158 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:15.158 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:15.158 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:15.158 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:15.158 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:15.158 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:15.158 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:15.158 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:15.158 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:15.158 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.158 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.159 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.159 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:15.159 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.159 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:15.159 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.159 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:15.159 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:15.159 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:15.159 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:15.159 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:15.159 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:15.159 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.159 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:15.159 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:15.159 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:15.159 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:15.160 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:15.160 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:15.160 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.160 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:15.160 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:15.160 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:15.160 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:15.160 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:15.160 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:15.160 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:15.160 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:15.160 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:15.160 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:15.160 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:15.160 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.160 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.160 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:15.161 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:15.161 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:15.161 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:15.161 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:15.161 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.161 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.161 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:15.161 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:15.161 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:15.161 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:15.161 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:15.161 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.161 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:15.161 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:15.161 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:15.161 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:15.162 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:15.162 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:15.162 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.162 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:15.162 INFO:teuthology.orchestra.run.smithi003.stdout:__________ ERROR at teardown of test_ranged_big_request_response_code __________ 2023-12-03T13:00:15.162 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.162 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.162 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.162 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:15.162 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:15.162 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.162 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:15.162 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.162 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:15.163 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:15.163 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:15.163 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.163 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:15.163 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:15.163 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.163 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.163 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:15.163 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:15.163 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.163 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.163 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:15.163 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.163 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:15.163 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:15.163 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.163 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.164 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:15.164 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:15.164 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.164 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:15.164 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:15.164 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:15.164 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:15.164 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:15.164 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.164 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:15.164 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.164 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:15.164 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:15.164 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:15.164 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:15.164 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:15.164 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:15.165 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:15.165 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:15.165 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.165 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.165 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:15.165 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:15.165 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:15.165 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:15.165 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.165 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:15.165 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:15.165 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:15.165 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:15.165 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.165 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.165 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:15.165 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:15.166 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:15.166 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:15.166 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.166 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.166 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:15.166 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:15.166 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:15.166 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.166 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:15.166 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.166 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:15.166 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:15.166 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.166 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:15.166 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:15.166 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:15.167 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:15.167 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:15.167 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:15.167 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.167 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:15.167 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.167 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:15.167 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.167 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.167 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:15.167 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.167 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:15.167 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.167 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:15.168 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:15.168 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:15.168 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:15.168 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:15.168 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:15.168 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.168 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:15.168 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:15.168 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:15.168 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:15.168 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:15.168 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:15.168 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.168 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:15.168 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:15.168 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:15.168 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:15.169 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:15.169 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:15.169 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:15.169 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:15.169 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:15.169 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:15.169 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:15.169 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.169 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.169 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:15.169 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.169 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:15.169 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:15.169 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:15.169 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:15.169 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:15.170 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:15.170 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:15.170 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:15.170 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:15.170 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:15.170 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:15.170 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:15.170 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:15.170 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:15.170 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:15.170 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:15.170 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:15.170 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:15.170 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:15.170 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:15.170 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:15.171 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:15.171 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:15.171 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:15.171 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:15.171 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:15.171 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:15.171 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:15.171 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.171 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.171 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.171 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.171 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:15.171 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:15.171 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.171 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:15.171 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.172 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:15.172 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:15.172 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:15.172 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.172 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:15.172 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:15.172 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.172 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.172 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:15.172 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:15.172 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.172 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.172 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:15.172 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:15.172 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:15.172 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:15.172 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:15.173 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.173 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.173 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:15.173 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:15.173 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:15.173 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.173 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:15.173 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.173 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:15.173 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.173 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:15.173 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.173 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:15.173 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.173 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:15.173 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:15.174 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:15.174 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:15.174 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.174 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:15.174 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.174 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:15.174 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:15.174 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:15.174 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:15.174 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:15.174 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:15.174 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:15.174 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:15.174 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:15.174 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:15.174 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:15.175 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:15.175 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:15.175 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:15.175 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:15.175 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:15.175 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:15.175 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:15.175 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:15.175 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:15.175 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:15.175 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:15.175 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:15.175 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:15.175 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:15.175 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:15.175 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:15.175 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:15.176 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:15.176 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:15.176 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:15.176 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:15.176 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:15.176 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:15.176 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:15.176 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:15.176 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:15.176 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:15.176 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:15.176 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:15.176 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.176 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.176 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.176 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:15.176 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.177 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:15.177 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.177 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:15.177 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:15.177 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:15.177 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:15.177 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:15.177 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:15.177 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.177 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:15.177 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:15.177 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:15.177 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:15.177 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:15.177 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:15.178 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.178 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:15.178 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:15.178 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:15.178 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:15.178 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:15.178 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:15.178 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:15.178 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:15.178 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:15.178 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:15.178 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:15.178 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.178 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.178 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:15.178 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:15.179 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:15.179 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:15.179 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:15.179 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.179 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.179 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:15.179 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:15.179 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:15.179 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:15.179 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:15.179 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.179 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:15.179 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:15.179 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:15.179 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:15.179 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:15.180 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:15.180 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.180 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:15.180 INFO:teuthology.orchestra.run.smithi003.stdout:__ ERROR at teardown of test_ranged_request_skip_leading_bytes_response_code ___ 2023-12-03T13:00:15.180 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.180 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.180 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.180 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:15.180 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:15.180 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.180 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:15.180 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.180 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:15.180 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:15.180 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:15.180 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.181 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:15.181 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:15.181 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.181 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.181 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:15.181 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:15.181 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.181 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.181 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:15.181 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.181 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:15.181 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:15.181 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.181 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.181 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:15.181 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:15.182 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.182 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:15.182 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:15.182 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:15.182 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:15.182 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:15.182 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.182 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:15.182 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.182 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:15.182 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:15.182 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:15.182 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:15.182 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:15.182 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:15.182 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:15.182 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:15.183 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.183 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.183 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:15.183 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:15.183 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:15.183 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:15.183 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.183 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:15.183 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:15.183 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:15.183 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:15.183 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.183 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.183 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:15.183 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:15.183 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:15.183 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:15.184 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.184 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.184 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:15.184 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:15.184 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:15.184 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.184 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:15.184 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.184 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:15.184 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:15.184 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.184 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:15.184 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:15.184 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:15.184 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:15.184 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:15.185 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:15.185 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.185 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:15.185 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.185 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:15.185 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.185 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.185 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:15.185 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.185 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:15.185 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.185 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:15.185 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:15.185 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:15.185 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:15.185 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:15.186 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:15.186 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.186 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:15.186 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:15.186 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:15.186 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:15.186 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:15.186 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:15.186 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.186 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:15.186 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:15.186 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:15.186 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:15.186 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:15.186 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:15.186 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:15.187 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:15.187 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:15.187 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:15.187 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:15.187 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.187 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.187 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:15.187 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.187 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:15.187 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:15.187 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:15.187 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:15.187 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:15.187 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:15.187 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:15.187 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:15.187 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:15.188 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:15.188 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:15.188 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:15.188 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:15.188 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:15.188 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:15.188 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:15.188 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:15.188 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:15.188 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:15.188 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:15.188 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:15.188 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:15.188 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:15.188 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:15.189 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:15.189 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:15.189 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:15.189 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:15.189 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.189 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.189 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.189 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.189 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:15.189 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:15.189 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.189 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:15.189 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.189 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:15.189 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:15.189 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:15.190 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.190 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:15.190 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:15.190 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.190 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.190 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:15.190 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:15.190 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.190 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.190 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:15.190 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:15.190 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:15.190 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:15.190 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:15.190 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.191 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.191 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:15.191 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:15.191 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:15.191 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.191 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:15.191 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.191 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:15.191 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.191 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:15.191 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.191 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:15.191 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.191 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:15.191 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:15.191 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:15.192 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:15.192 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.192 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:15.192 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.192 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:15.192 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:15.192 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:15.192 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:15.192 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:15.192 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:15.192 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:15.192 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:15.192 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:15.192 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:15.192 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:15.192 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:15.192 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:15.193 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:15.193 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:15.193 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:15.193 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:15.193 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:15.193 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:15.193 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:15.193 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:15.193 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:15.193 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:15.193 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:15.193 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:15.193 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:15.193 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:15.193 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:15.193 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:15.193 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:15.194 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:15.194 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:15.194 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:15.194 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:15.194 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:15.194 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:15.194 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:15.194 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:15.194 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:15.194 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:15.194 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.194 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.194 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.194 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:15.195 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.195 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:15.195 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.195 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:15.195 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:15.195 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:15.195 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:15.195 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:15.195 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:15.195 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.195 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:15.195 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:15.195 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:15.195 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:15.195 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:15.195 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:15.196 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.196 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:15.196 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:15.196 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:15.196 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:15.196 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:15.196 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:15.196 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:15.196 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:15.196 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:15.196 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:15.196 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:15.196 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.196 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.196 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:15.196 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:15.197 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:15.197 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:15.197 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:15.197 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.197 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.197 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:15.197 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:15.197 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:15.197 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:15.197 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:15.197 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.197 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:15.197 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:15.197 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:15.197 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:15.197 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:15.197 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:15.198 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.198 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:15.198 INFO:teuthology.orchestra.run.smithi003.stdout:_ ERROR at teardown of test_ranged_request_return_trailing_bytes_response_code _ 2023-12-03T13:00:15.198 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.198 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.198 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.198 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:15.198 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:15.198 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.198 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:15.198 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.198 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:15.198 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:15.198 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:15.198 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.198 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:15.199 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:15.199 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.199 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.199 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:15.199 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:15.199 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.199 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.199 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:15.199 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.199 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:15.199 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:15.199 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.199 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.199 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:15.200 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:15.200 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.200 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:15.200 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:15.200 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:15.200 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:15.200 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:15.200 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.200 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:15.200 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.200 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:15.200 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:15.200 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:15.200 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:15.200 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:15.200 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:15.201 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:15.201 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:15.201 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.201 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.201 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:15.201 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:15.201 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:15.201 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:15.201 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.201 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:15.201 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:15.201 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:15.201 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:15.201 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.201 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.201 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:15.202 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:15.202 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:15.202 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:15.202 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.202 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.202 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:15.202 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:15.202 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:15.202 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.202 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:15.202 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.202 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:15.202 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:15.202 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.202 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:15.202 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:15.203 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:15.203 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:15.203 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:15.203 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:15.203 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.203 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:15.203 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.203 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:15.203 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.203 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.203 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:15.203 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.203 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:15.203 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.203 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:15.203 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:15.204 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:15.204 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:15.204 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:15.204 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:15.204 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.204 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:15.204 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:15.204 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:15.204 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:15.204 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:15.204 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:15.204 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.204 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:15.204 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:15.204 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:15.204 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:15.204 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:15.205 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:15.205 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:15.205 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:15.205 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:15.205 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:15.205 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:15.205 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.205 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.205 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:15.205 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.205 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:15.205 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:15.205 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:15.205 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:15.205 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:15.205 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:15.205 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:15.206 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:15.206 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:15.206 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:15.206 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:15.206 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:15.206 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:15.206 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:15.206 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:15.206 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:15.206 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:15.206 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:15.206 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:15.206 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:15.206 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:15.206 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:15.206 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:15.207 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:15.207 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:15.207 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:15.207 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:15.207 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:15.207 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.207 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.207 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.207 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.207 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:15.207 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:15.207 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.207 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:15.207 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.207 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:15.207 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:15.207 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:15.208 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.208 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:15.208 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:15.208 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.208 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.208 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:15.208 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:15.208 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.208 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.208 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:15.208 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:15.208 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:15.208 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:15.208 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:15.208 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.208 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.209 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:15.209 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:15.209 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:15.209 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.209 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:15.209 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.209 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:15.209 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.209 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:15.209 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.209 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:15.209 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.209 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:15.209 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:15.209 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:15.209 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:15.210 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.210 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:15.210 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.210 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:15.210 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:15.210 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:15.210 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:15.210 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:15.210 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:15.210 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:15.210 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:15.210 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:15.210 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:15.211 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:15.211 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:15.211 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:15.211 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:15.211 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:15.211 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:15.211 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:15.211 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:15.211 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:15.211 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:15.211 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:15.211 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:15.211 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:15.211 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:15.211 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:15.211 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:15.212 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:15.212 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:15.212 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:15.212 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:15.212 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:15.212 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:15.212 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:15.212 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:15.212 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:15.212 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:15.212 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:15.212 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:15.212 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:15.212 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:15.212 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.212 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.213 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.213 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:15.213 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.213 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:15.213 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.213 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:15.213 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:15.213 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:15.213 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:15.213 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:15.213 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:15.213 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.213 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:15.213 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:15.213 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:15.213 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:15.213 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:15.214 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:15.214 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.214 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:15.214 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:15.214 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:15.214 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:15.214 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:15.214 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:15.214 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:15.214 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:15.214 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:15.214 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:15.214 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:15.214 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.214 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.214 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:15.215 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:15.215 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:15.215 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:15.215 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:15.215 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.215 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.215 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:15.215 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:15.215 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:15.215 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:15.215 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:15.215 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.215 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:15.215 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:15.215 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:15.215 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:15.215 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:15.216 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:15.216 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.216 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:15.216 INFO:teuthology.orchestra.run.smithi003.stdout:____________ ERROR at teardown of test_ranged_request_invalid_range ____________ 2023-12-03T13:00:15.216 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.216 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.216 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.216 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:15.216 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:15.216 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.216 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:15.216 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.216 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:15.216 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:15.216 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:15.216 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.217 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:15.217 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:15.217 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.217 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.217 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:15.217 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:15.217 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.217 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.217 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:15.217 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.217 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:15.217 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:15.217 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.217 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.217 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:15.217 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:15.217 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.218 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:15.218 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:15.218 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:15.218 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:15.218 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:15.218 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.218 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:15.218 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.218 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:15.218 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:15.218 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:15.218 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:15.218 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:15.218 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:15.218 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:15.218 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:15.219 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.219 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.219 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:15.219 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:15.219 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:15.219 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:15.219 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.219 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:15.219 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:15.219 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:15.219 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:15.219 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.219 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.219 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:15.219 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:15.219 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:15.220 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:15.220 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.220 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.220 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:15.220 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:15.220 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:15.220 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.220 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:15.220 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.220 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:15.220 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:15.220 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.220 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:15.220 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:15.220 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:15.220 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:15.220 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:15.221 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:15.221 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.221 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:15.221 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.221 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:15.221 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.221 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.221 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:15.221 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.221 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:15.221 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.221 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:15.221 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:15.222 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:15.222 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:15.222 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:15.222 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:15.222 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.222 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:15.222 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:15.222 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:15.222 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:15.222 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:15.222 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:15.222 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.222 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:15.222 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:15.222 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:15.222 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:15.223 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:15.223 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:15.223 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:15.223 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:15.223 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:15.223 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:15.223 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:15.223 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.223 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.223 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:15.223 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.223 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:15.223 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:15.223 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:15.223 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:15.223 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:15.224 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:15.224 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:15.224 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:15.224 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:15.224 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:15.224 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:15.224 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:15.224 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:15.224 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:15.224 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:15.224 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:15.224 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:15.224 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:15.224 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:15.224 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:15.224 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:15.224 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:15.225 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:15.225 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:15.225 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:15.225 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:15.225 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:15.225 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:15.225 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.225 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.225 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.225 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.225 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:15.225 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:15.225 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.225 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:15.225 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.226 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:15.226 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:15.226 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:15.226 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.226 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:15.226 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:15.226 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.226 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.226 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:15.226 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:15.226 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.226 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.226 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:15.226 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:15.226 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:15.226 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:15.227 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:15.227 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.227 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.227 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:15.227 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:15.227 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:15.227 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.227 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:15.227 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.227 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:15.227 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.227 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:15.227 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.227 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:15.227 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.227 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:15.228 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:15.228 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:15.228 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:15.228 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.228 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:15.228 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.228 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:15.228 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:15.228 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:15.228 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:15.228 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:15.228 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:15.228 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:15.228 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:15.228 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:15.228 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:15.228 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:15.229 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:15.229 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:15.229 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:15.229 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:15.229 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:15.229 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:15.229 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:15.229 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:15.229 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:15.229 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:15.229 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:15.229 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:15.229 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:15.229 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:15.229 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:15.229 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:15.230 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:15.230 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:15.230 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:15.230 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:15.230 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:15.230 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:15.230 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:15.230 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:15.230 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:15.230 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:15.230 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:15.230 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:15.230 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:15.230 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.230 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.231 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.231 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:15.231 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.231 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:15.231 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.231 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:15.231 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:15.231 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:15.231 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:15.231 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:15.231 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:15.231 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.231 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:15.231 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:15.231 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:15.232 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:15.232 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:15.232 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:15.232 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.232 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:15.232 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:15.232 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:15.232 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:15.232 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:15.232 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:15.232 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:15.232 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:15.232 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:15.232 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:15.232 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:15.232 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.233 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.233 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:15.233 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:15.233 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:15.233 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:15.233 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:15.233 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.233 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.233 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:15.233 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:15.233 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:15.233 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:15.233 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:15.233 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.233 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:15.233 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:15.233 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:15.234 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:15.234 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:15.234 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:15.234 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.234 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:15.234 INFO:teuthology.orchestra.run.smithi003.stdout:____________ ERROR at teardown of test_ranged_request_empty_object _____________ 2023-12-03T13:00:15.234 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.234 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.234 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.234 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:15.234 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:15.234 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.234 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:15.234 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.234 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:15.234 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:15.235 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:15.235 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.235 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:15.235 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:15.235 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.235 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.235 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:15.235 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:15.235 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.235 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.235 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:15.235 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.235 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:15.235 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:15.235 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.235 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.235 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:15.236 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:15.236 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.236 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:15.236 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:15.236 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:15.236 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:15.236 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:15.236 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.236 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:15.236 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.236 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:15.236 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:15.236 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:15.236 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:15.236 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:15.236 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:15.237 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:15.237 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:15.237 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.237 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.237 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:15.237 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:15.237 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:15.237 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:15.237 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.237 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:15.237 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:15.237 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:15.237 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:15.237 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.237 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.237 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:15.237 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:15.238 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:15.238 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:15.238 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.238 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.238 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:15.238 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:15.238 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:15.238 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.238 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:15.238 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.238 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:15.238 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:15.238 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.238 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:15.238 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:15.239 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:15.239 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:15.239 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:15.239 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:15.239 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.239 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:15.239 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.239 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:15.239 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.239 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.239 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:15.239 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.239 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:15.239 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.239 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:15.239 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:15.240 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:15.240 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:15.240 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:15.240 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:15.240 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.240 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:15.240 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:15.240 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:15.240 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:15.240 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:15.240 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:15.240 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.240 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:15.240 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:15.240 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:15.240 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:15.241 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:15.241 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:15.241 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:15.241 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:15.241 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:15.241 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:15.241 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:15.241 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.241 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.241 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:15.241 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.241 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:15.241 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:15.241 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:15.241 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:15.241 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:15.241 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:15.242 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:15.242 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:15.242 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:15.242 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:15.242 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:15.242 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:15.242 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:15.242 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:15.242 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:15.242 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:15.242 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:15.242 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:15.242 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:15.242 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:15.243 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:15.243 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:15.243 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:15.243 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:15.243 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:15.243 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:15.243 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:15.243 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:15.243 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.243 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.243 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.243 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.243 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:15.243 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:15.243 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.243 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:15.244 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.244 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:15.244 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:15.244 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:15.244 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.244 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:15.244 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:15.244 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.244 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.244 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:15.244 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:15.244 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.244 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.244 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:15.244 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:15.244 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:15.245 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:15.245 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:15.245 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.245 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.245 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:15.245 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:15.245 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:15.245 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.245 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:15.245 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.245 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:15.245 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.245 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:15.245 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.245 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:15.245 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.246 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:15.246 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:15.246 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:15.246 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:15.246 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.246 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:15.246 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.246 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:15.246 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:15.246 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:15.246 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:15.246 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:15.246 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:15.246 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:15.246 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:15.247 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:15.247 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:15.247 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:15.247 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:15.247 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:15.247 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:15.247 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:15.247 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:15.247 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:15.247 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:15.247 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:15.247 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:15.247 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:15.247 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:15.247 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:15.247 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:15.248 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:15.248 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:15.248 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:15.248 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:15.248 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:15.248 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:15.248 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:15.248 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:15.248 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:15.248 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:15.248 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:15.248 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:15.248 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:15.248 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:15.248 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:15.249 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:15.249 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.249 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.249 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.249 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:15.249 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.249 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:15.249 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.249 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:15.249 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:15.249 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:15.249 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:15.249 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:15.249 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:15.249 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.250 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:15.250 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:15.250 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:15.250 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:15.250 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:15.250 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:15.250 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.250 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:15.250 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:15.250 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:15.250 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:15.250 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:15.250 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:15.250 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:15.250 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:15.251 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:15.251 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:15.251 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:15.251 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.251 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.251 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:15.251 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:15.251 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:15.251 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:15.251 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:15.251 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.251 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.251 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:15.251 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:15.251 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:15.252 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:15.252 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:15.252 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.252 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:15.252 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:15.252 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:15.252 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:15.252 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:15.252 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:15.252 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.252 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:15.252 INFO:teuthology.orchestra.run.smithi003.stdout:__________ ERROR at teardown of test_versioning_bucket_create_suspend __________ 2023-12-03T13:00:15.252 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.252 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.253 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.253 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:15.253 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:15.253 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.253 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:15.253 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.253 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:15.253 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:15.253 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:15.253 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.253 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:15.253 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:15.253 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.253 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.254 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:15.254 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:15.254 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.254 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.254 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:15.254 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.254 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:15.254 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:15.254 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.254 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.254 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:15.254 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:15.254 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.254 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:15.255 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:15.255 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:15.255 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:15.255 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:15.255 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.255 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:15.255 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.255 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:15.255 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:15.255 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:15.255 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:15.255 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:15.255 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:15.255 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:15.255 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:15.256 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.256 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.256 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:15.256 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:15.256 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:15.256 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:15.256 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.256 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:15.256 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:15.256 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:15.256 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:15.256 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.256 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.256 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:15.256 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:15.257 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:15.257 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:15.257 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.257 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.257 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:15.257 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:15.257 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:15.257 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.257 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:15.257 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.257 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:15.257 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:15.257 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.257 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:15.258 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:15.258 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:15.258 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:15.258 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:15.258 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:15.258 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.258 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:15.258 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.258 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:15.258 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.258 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.258 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:15.258 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.258 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:15.258 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.259 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:15.259 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:15.259 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:15.259 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:15.259 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:15.259 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:15.259 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.259 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:15.259 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:15.259 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:15.259 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:15.259 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:15.259 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:15.259 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.259 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:15.259 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:15.260 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:15.260 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:15.260 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:15.260 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:15.260 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:15.260 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:15.260 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:15.260 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:15.260 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:15.260 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.260 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.260 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:15.260 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.260 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:15.260 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:15.260 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:15.261 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:15.261 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:15.261 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:15.261 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:15.261 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:15.261 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:15.261 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:15.261 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:15.261 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:15.261 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:15.261 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:15.261 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:15.261 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:15.261 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:15.261 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:15.262 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:15.262 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:15.262 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:15.262 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:15.262 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:15.262 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:15.262 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:15.262 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:15.262 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:15.262 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:15.262 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.262 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.262 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.262 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.262 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:15.263 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:15.263 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.263 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:15.263 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.263 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:15.263 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:15.263 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:15.263 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.263 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:15.263 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:15.263 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.263 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.263 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:15.263 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:15.263 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.263 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.264 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:15.264 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:15.264 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:15.264 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:15.264 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:15.264 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.264 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.264 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:15.264 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:15.264 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:15.264 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.264 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:15.264 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.264 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:15.264 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.264 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:15.265 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.265 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:15.265 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.265 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:15.265 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:15.265 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:15.265 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:15.265 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.265 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:15.265 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.265 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:15.265 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:15.265 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:15.265 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:15.265 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:15.266 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:15.266 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:15.266 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:15.266 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:15.266 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:15.266 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:15.266 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:15.266 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:15.266 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:15.266 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:15.266 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:15.266 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:15.266 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:15.266 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:15.266 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:15.267 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:15.267 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:15.267 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:15.267 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:15.267 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:15.267 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:15.267 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:15.267 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:15.267 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:15.267 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:15.267 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:15.267 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:15.267 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:15.267 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:15.267 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:15.267 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:15.268 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:15.268 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:15.268 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:15.268 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:15.268 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.268 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.268 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.268 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:15.268 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.268 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:15.268 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.268 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:15.268 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:15.268 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:15.268 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:15.268 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:15.269 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:15.269 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.269 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:15.269 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:15.269 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:15.269 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:15.269 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:15.269 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:15.269 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.269 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:15.269 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:15.269 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:15.269 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:15.269 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:15.269 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:15.269 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:15.269 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:15.270 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:15.270 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:15.270 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:15.270 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.270 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.270 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:15.270 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:15.270 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:15.270 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:15.270 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:15.270 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.270 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.270 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:15.270 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:15.270 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:15.271 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:15.271 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:15.271 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.271 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:15.271 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:15.271 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:15.271 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:15.271 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:15.271 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:15.271 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.271 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:15.271 INFO:teuthology.orchestra.run.smithi003.stdout:_________ ERROR at teardown of test_versioning_obj_create_read_remove __________ 2023-12-03T13:00:15.271 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.271 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.272 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.272 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:15.272 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:15.272 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.272 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:15.272 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.272 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:15.272 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:15.272 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:15.272 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.272 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:15.272 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:15.272 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.272 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.272 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:15.272 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:15.272 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.273 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.273 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:15.273 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.273 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:15.273 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:15.273 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.273 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.273 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:15.273 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:15.273 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.273 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:15.273 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:15.273 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:15.273 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:15.273 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:15.273 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.273 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:15.274 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.274 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:15.274 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:15.274 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:15.274 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:15.274 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:15.274 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:15.274 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:15.274 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:15.274 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.274 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.274 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:15.274 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:15.274 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:15.274 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:15.275 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.275 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:15.275 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:15.275 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:15.275 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:15.275 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.275 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.275 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:15.275 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:15.275 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:15.275 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:15.275 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.275 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.275 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:15.275 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:15.275 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:15.276 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.276 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:15.276 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.276 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:15.276 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:15.276 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.276 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:15.276 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:15.276 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:15.276 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:15.276 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:15.276 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:15.276 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.276 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:15.277 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.277 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:15.277 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.277 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.277 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:15.277 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.277 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:15.277 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.277 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:15.277 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:15.277 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:15.277 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:15.277 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:15.277 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:15.277 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.278 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:15.278 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:15.278 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:15.278 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:15.278 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:15.278 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:15.278 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.278 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:15.278 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:15.278 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:15.278 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:15.278 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:15.278 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:15.278 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:15.279 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:15.279 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:15.279 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:15.279 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:15.279 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.279 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.279 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:15.279 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.279 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:15.279 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:15.279 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:15.279 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:15.279 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:15.279 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:15.279 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:15.280 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:15.280 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:15.280 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:15.280 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:15.280 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:15.280 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:15.280 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:15.280 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:15.280 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:15.280 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:15.280 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:15.280 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:15.280 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:15.280 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:15.281 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:15.281 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:15.281 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:15.281 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:15.281 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:15.281 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:15.281 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:15.281 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.281 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.281 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.281 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.281 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:15.281 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:15.281 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.282 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:15.282 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.282 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:15.282 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:15.282 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:15.282 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.282 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:15.282 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:15.282 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.282 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.282 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:15.282 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:15.282 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.282 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.283 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:15.283 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:15.283 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:15.283 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:15.283 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:15.283 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.283 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.283 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:15.283 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:15.283 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:15.283 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.283 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:15.283 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.283 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:15.283 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.284 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:15.284 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.284 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:15.284 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.284 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:15.284 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:15.284 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:15.284 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:15.284 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.284 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:15.284 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.284 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:15.284 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:15.284 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:15.284 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:15.285 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:15.285 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:15.285 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:15.285 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:15.285 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:15.285 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:15.285 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:15.285 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:15.285 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:15.285 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:15.285 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:15.285 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:15.285 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:15.285 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:15.285 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:15.285 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:15.286 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:15.286 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:15.286 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:15.286 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:15.286 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:15.286 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:15.286 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:15.286 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:15.286 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:15.286 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:15.286 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:15.286 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:15.286 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:15.286 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:15.287 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:15.287 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:15.287 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:15.287 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:15.287 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:15.287 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:15.287 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.287 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.287 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.287 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:15.287 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.287 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:15.287 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.287 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:15.287 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:15.288 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:15.288 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:15.288 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:15.288 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:15.288 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.288 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:15.288 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:15.288 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:15.288 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:15.288 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:15.288 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:15.288 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.289 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:15.289 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:15.289 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:15.289 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:15.289 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:15.289 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:15.289 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:15.289 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:15.289 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:15.289 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:15.289 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:15.289 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.289 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.289 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:15.289 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:15.289 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:15.289 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:15.290 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:15.290 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.290 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.290 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:15.290 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:15.290 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:15.290 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:15.290 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:15.290 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.290 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:15.290 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:15.290 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:15.290 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:15.290 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:15.291 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:15.291 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.291 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:15.291 INFO:teuthology.orchestra.run.smithi003.stdout:_______ ERROR at teardown of test_versioning_obj_create_read_remove_head _______ 2023-12-03T13:00:15.291 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.291 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.291 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.291 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:15.291 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:15.291 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.291 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:15.291 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.291 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:15.291 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:15.291 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:15.291 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.292 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:15.292 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:15.292 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.292 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.292 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:15.292 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:15.292 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.292 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.292 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:15.292 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.292 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:15.292 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:15.292 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.292 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.292 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:15.293 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:15.293 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.293 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:15.293 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:15.293 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:15.293 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:15.293 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:15.293 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.293 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:15.293 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.293 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:15.293 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:15.293 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:15.293 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:15.293 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:15.294 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:15.294 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:15.294 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:15.294 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.294 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.294 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:15.294 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:15.294 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:15.294 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:15.294 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.294 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:15.294 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:15.294 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:15.294 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:15.294 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.295 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.295 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:15.295 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:15.295 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:15.295 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:15.295 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.295 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.295 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:15.295 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:15.295 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:15.295 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.295 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:15.295 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.295 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:15.296 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:15.296 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.296 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:15.296 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:15.296 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:15.296 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:15.296 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:15.296 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:15.296 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.296 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:15.296 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.296 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:15.296 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.296 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.296 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:15.296 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.297 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:15.297 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.297 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:15.297 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:15.297 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:15.297 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:15.297 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:15.297 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:15.297 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.297 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:15.297 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:15.297 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:15.297 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:15.297 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:15.297 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:15.297 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.298 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:15.298 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:15.298 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:15.298 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:15.298 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:15.298 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:15.298 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:15.298 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:15.298 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:15.298 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:15.298 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:15.298 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.298 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.298 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:15.298 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.299 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:15.299 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:15.299 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:15.299 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:15.299 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:15.299 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:15.299 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:15.299 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:15.299 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:15.299 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:15.299 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:15.299 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:15.299 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:15.299 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:15.300 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:15.300 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:15.300 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:15.300 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:15.300 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:15.300 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:15.300 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:15.300 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:15.300 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:15.300 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:15.300 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:15.300 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:15.300 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:15.300 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:15.301 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.301 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.301 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.301 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.301 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:15.301 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:15.301 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.301 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:15.301 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.301 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:15.301 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:15.301 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:15.301 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.301 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:15.301 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:15.301 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.301 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.302 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:15.302 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:15.302 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.302 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.302 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:15.302 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:15.302 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:15.302 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:15.302 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:15.302 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.302 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.302 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:15.302 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:15.302 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:15.302 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.303 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:15.303 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.303 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:15.303 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.303 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:15.303 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.303 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:15.303 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.303 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:15.303 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:15.303 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:15.303 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:15.303 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.303 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:15.303 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.303 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:15.304 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:15.304 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:15.304 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:15.304 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:15.304 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:15.304 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:15.304 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:15.304 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:15.304 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:15.304 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:15.304 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:15.304 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:15.304 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:15.304 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:15.304 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:15.304 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:15.305 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:15.305 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:15.305 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:15.305 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:15.305 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:15.305 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:15.305 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:15.305 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:15.305 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:15.305 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:15.305 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:15.305 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:15.305 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:15.305 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:15.305 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:15.305 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:15.305 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:15.306 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:15.306 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:15.306 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:15.306 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:15.306 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:15.306 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:15.306 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.306 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.306 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.306 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:15.306 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.306 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:15.306 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.306 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:15.306 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:15.307 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:15.307 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:15.307 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:15.307 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:15.307 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.307 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:15.307 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:15.307 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:15.307 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:15.307 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:15.307 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:15.307 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.307 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:15.307 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:15.307 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:15.307 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:15.308 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:15.308 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:15.308 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:15.308 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:15.308 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:15.308 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:15.308 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:15.308 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.308 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.308 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:15.308 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:15.308 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:15.308 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:15.308 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:15.308 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.308 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.309 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:15.309 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:15.309 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:15.309 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:15.309 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:15.309 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.309 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:15.309 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:15.309 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:15.309 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:15.309 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:15.309 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:15.309 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.309 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:15.309 INFO:teuthology.orchestra.run.smithi003.stdout:_____ ERROR at teardown of test_versioning_obj_plain_null_version_removal ______ 2023-12-03T13:00:15.309 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.309 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.310 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.310 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:15.310 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:15.310 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.310 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:15.310 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.310 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:15.310 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:15.310 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:15.310 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.310 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:15.310 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:15.310 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.310 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.310 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:15.311 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:15.311 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.311 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.311 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:15.311 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.311 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:15.311 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:15.311 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.311 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.311 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:15.311 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:15.311 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.311 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:15.311 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:15.312 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:15.312 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:15.312 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:15.312 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.312 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:15.312 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.312 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:15.312 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:15.312 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:15.312 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:15.312 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:15.312 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:15.312 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:15.312 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:15.312 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.312 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.313 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:15.313 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:15.313 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:15.313 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:15.313 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.313 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:15.313 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:15.313 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:15.313 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:15.313 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.313 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.313 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:15.313 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:15.313 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:15.313 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:15.313 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.313 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.314 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:15.314 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:15.314 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:15.314 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.314 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:15.314 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.314 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:15.314 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:15.314 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.314 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:15.314 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:15.314 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:15.314 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:15.314 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:15.315 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:15.315 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.315 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:15.315 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.315 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:15.315 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.315 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.315 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:15.315 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.315 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:15.315 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.315 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:15.315 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:15.315 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:15.315 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:15.316 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:15.316 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:15.316 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.316 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:15.316 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:15.316 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:15.316 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:15.316 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:15.316 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:15.316 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.316 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:15.316 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:15.316 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:15.316 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:15.316 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:15.316 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:15.317 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:15.317 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:15.317 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:15.317 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:15.317 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:15.317 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.317 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.317 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:15.317 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.317 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:15.317 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:15.317 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:15.317 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:15.317 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:15.317 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:15.317 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:15.318 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:15.318 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:15.318 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:15.318 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:15.318 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:15.318 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:15.318 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:15.318 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:15.318 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:15.318 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:15.318 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:15.318 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:15.318 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:15.318 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:15.318 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:15.318 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:15.319 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:15.319 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:15.319 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:15.319 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:15.319 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:15.319 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.319 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.319 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.319 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.319 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:15.319 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:15.319 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.319 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:15.319 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.319 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:15.319 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:15.320 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:15.320 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.320 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:15.320 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:15.320 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.320 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.320 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:15.320 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:15.320 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.320 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.320 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:15.320 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:15.320 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:15.320 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:15.320 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:15.320 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.321 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.321 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:15.321 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:15.321 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:15.321 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.321 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:15.321 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.321 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:15.321 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.321 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:15.321 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.321 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:15.321 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.321 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:15.321 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:15.321 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:15.321 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:15.322 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.322 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:15.322 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.322 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:15.322 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:15.322 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:15.322 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:15.322 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:15.322 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:15.322 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:15.322 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:15.322 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:15.322 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:15.323 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:15.323 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:15.323 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:15.323 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:15.323 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:15.323 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:15.323 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:15.323 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:15.323 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:15.323 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:15.323 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:15.323 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:15.323 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:15.323 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:15.323 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:15.323 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:15.324 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:15.324 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:15.324 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:15.324 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:15.324 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:15.324 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:15.324 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:15.324 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:15.324 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:15.324 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:15.324 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:15.324 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:15.324 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:15.324 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:15.324 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.324 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.325 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.325 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:15.325 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.325 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:15.325 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.325 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:15.325 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:15.325 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:15.325 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:15.325 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:15.325 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:15.325 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.325 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:15.325 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:15.325 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:15.325 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:15.326 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:15.326 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:15.326 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.326 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:15.326 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:15.326 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:15.326 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:15.326 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:15.326 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:15.326 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:15.326 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:15.326 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:15.326 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:15.326 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:15.326 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.327 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.327 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:15.327 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:15.327 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:15.327 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:15.327 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:15.327 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.327 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.327 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:15.327 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:15.327 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:15.327 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:15.327 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:15.327 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.327 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:15.327 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:15.327 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:15.328 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:15.328 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:15.328 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:15.328 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.328 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:15.328 INFO:teuthology.orchestra.run.smithi003.stdout:____ ERROR at teardown of test_versioning_obj_plain_null_version_overwrite _____ 2023-12-03T13:00:15.328 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.328 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.328 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.328 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:15.328 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:15.328 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.328 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:15.328 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.328 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:15.328 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:15.329 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:15.329 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.329 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:15.329 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:15.329 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.329 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.329 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:15.329 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:15.329 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.329 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.329 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:15.329 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.329 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:15.329 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:15.329 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.329 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.329 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:15.330 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:15.330 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.330 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:15.330 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:15.330 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:15.330 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:15.330 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:15.330 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.330 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:15.330 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.330 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:15.330 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:15.330 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:15.330 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:15.330 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:15.331 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:15.331 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:15.331 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:15.331 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.331 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.331 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:15.331 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:15.331 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:15.331 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:15.331 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.331 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:15.331 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:15.331 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:15.331 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:15.331 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.331 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.331 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:15.332 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:15.332 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:15.332 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:15.332 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.332 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.332 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:15.332 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:15.332 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:15.332 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.332 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:15.332 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.332 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:15.332 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:15.332 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.332 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:15.332 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:15.333 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:15.333 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:15.333 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:15.333 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:15.333 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.333 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:15.333 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.333 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:15.333 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.333 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.333 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:15.333 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.333 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:15.333 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.333 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:15.334 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:15.334 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:15.334 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:15.334 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:15.334 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:15.334 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.334 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:15.334 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:15.334 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:15.334 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:15.334 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:15.334 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:15.334 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.334 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:15.334 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:15.335 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:15.335 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:15.335 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:15.335 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:15.335 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:15.335 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:15.335 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:15.335 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:15.335 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:15.335 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.335 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.335 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:15.335 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.335 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:15.335 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:15.335 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:15.336 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:15.336 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:15.336 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:15.336 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:15.336 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:15.336 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:15.336 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:15.336 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:15.336 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:15.336 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:15.336 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:15.336 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:15.336 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:15.336 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:15.336 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:15.336 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:15.336 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:15.337 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:15.337 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:15.337 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:15.337 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:15.337 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:15.337 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:15.337 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:15.337 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:15.337 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.337 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.337 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.337 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.337 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:15.337 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:15.337 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.337 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:15.337 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.338 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:15.338 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:15.338 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:15.338 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.338 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:15.338 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:15.338 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.338 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.338 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:15.338 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:15.338 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.338 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.338 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:15.338 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:15.338 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:15.339 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:15.339 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:15.339 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.339 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.339 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:15.339 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:15.339 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:15.339 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.339 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:15.339 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.339 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:15.339 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.339 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:15.339 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.339 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:15.339 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.339 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:15.340 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:15.340 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:15.340 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:15.340 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.340 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:15.340 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.340 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:15.340 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:15.340 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:15.340 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:15.340 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:15.340 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:15.340 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:15.340 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:15.340 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:15.340 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:15.341 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:15.341 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:15.341 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:15.341 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:15.341 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:15.341 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:15.341 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:15.341 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:15.341 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:15.341 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:15.341 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:15.341 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:15.341 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:15.341 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:15.341 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:15.341 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:15.341 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:15.342 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:15.342 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:15.342 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:15.342 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:15.342 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:15.342 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:15.342 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:15.342 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:15.342 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:15.342 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:15.342 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:15.342 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:15.342 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:15.342 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.342 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.343 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.343 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:15.343 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.343 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:15.343 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.343 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:15.343 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:15.343 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:15.343 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:15.343 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:15.343 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:15.343 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.343 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:15.343 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:15.344 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:15.344 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:15.344 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:15.344 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:15.344 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.344 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:15.344 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:15.344 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:15.344 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:15.344 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:15.344 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:15.344 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:15.344 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:15.344 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:15.344 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:15.344 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:15.345 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.345 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.345 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:15.345 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:15.345 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:15.345 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:15.345 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:15.345 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.345 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.345 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:15.345 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:15.345 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:15.345 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:15.345 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:15.345 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.345 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:15.345 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:15.346 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:15.346 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:15.346 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:15.346 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:15.346 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.346 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:15.346 INFO:teuthology.orchestra.run.smithi003.stdout:_ ERROR at teardown of test_versioning_obj_plain_null_version_overwrite_suspended _ 2023-12-03T13:00:15.346 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.346 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.346 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.346 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:15.346 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:15.346 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.346 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:15.346 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.347 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:15.347 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:15.347 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:15.347 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.347 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:15.347 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:15.347 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.347 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.347 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:15.347 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:15.347 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.347 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.347 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:15.347 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.347 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:15.347 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:15.348 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.348 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.348 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:15.348 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:15.348 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.348 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:15.348 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:15.348 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:15.348 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:15.348 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:15.348 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.348 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:15.348 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.348 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:15.348 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:15.348 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:15.348 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:15.349 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:15.349 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:15.349 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:15.349 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:15.349 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.349 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.349 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:15.349 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:15.349 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:15.349 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:15.349 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.349 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:15.349 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:15.349 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:15.349 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:15.349 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.349 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.350 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:15.350 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:15.350 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:15.350 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:15.350 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.350 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.350 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:15.350 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:15.350 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:15.350 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.350 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:15.350 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.350 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:15.350 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:15.350 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.351 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:15.351 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:15.351 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:15.351 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:15.351 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:15.351 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:15.351 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.351 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:15.351 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.351 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:15.351 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.351 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.351 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:15.351 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.351 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:15.351 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.351 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:15.352 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:15.352 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:15.352 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:15.352 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:15.352 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:15.352 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.352 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:15.352 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:15.352 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:15.352 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:15.352 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:15.352 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:15.352 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.352 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:15.352 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:15.352 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:15.353 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:15.353 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:15.353 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:15.353 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:15.353 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:15.353 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:15.353 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:15.353 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:15.353 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.353 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.353 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:15.353 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.353 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:15.353 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:15.353 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:15.353 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:15.353 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:15.354 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:15.354 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:15.354 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:15.354 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:15.354 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:15.354 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:15.354 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:15.354 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:15.354 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:15.354 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:15.354 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:15.354 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:15.354 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:15.355 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:15.355 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:15.355 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:15.355 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:15.355 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:15.355 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:15.355 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:15.355 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:15.355 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:15.355 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:15.355 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.355 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.355 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.355 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.355 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:15.355 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:15.356 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.356 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:15.356 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.356 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:15.356 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:15.356 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:15.356 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.356 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:15.356 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:15.356 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.356 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.356 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:15.356 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:15.356 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.356 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.356 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:15.356 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:15.357 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:15.357 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:15.357 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:15.357 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.357 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.357 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:15.357 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:15.357 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:15.357 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.357 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:15.357 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.357 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:15.357 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.357 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:15.357 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.357 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:15.358 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.358 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:15.358 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:15.358 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:15.358 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:15.358 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.358 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:15.358 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.358 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:15.358 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:15.358 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:15.358 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:15.358 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:15.358 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:15.358 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:15.358 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:15.359 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:15.359 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:15.359 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:15.359 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:15.359 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:15.359 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:15.359 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:15.359 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:15.359 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:15.359 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:15.359 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:15.359 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:15.359 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:15.359 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:15.359 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:15.359 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:15.359 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:15.360 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:15.360 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:15.360 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:15.360 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:15.360 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:15.360 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:15.360 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:15.360 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:15.360 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:15.360 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:15.360 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:15.360 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:15.360 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:15.360 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:15.360 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:15.360 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.361 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.361 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.361 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:15.361 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.361 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:15.361 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.361 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:15.361 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:15.361 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:15.361 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:15.361 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:15.361 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:15.361 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.361 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:15.361 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:15.361 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:15.361 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:15.362 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:15.362 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:15.362 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.362 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:15.362 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:15.362 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:15.362 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:15.362 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:15.362 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:15.362 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:15.362 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:15.362 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:15.362 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:15.362 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:15.362 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.362 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.363 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:15.363 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:15.363 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:15.363 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:15.363 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:15.363 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.363 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.363 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:15.363 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:15.363 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:15.363 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:15.363 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:15.363 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.363 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:15.363 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:15.363 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:15.363 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:15.364 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:15.364 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:15.364 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.364 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:15.364 INFO:teuthology.orchestra.run.smithi003.stdout:__________ ERROR at teardown of test_versioning_obj_suspend_versions ___________ 2023-12-03T13:00:15.364 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.364 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.364 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.364 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:15.364 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:15.364 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.364 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:15.364 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.364 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:15.364 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:15.364 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:15.364 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.365 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:15.365 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:15.365 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.365 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.365 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:15.365 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:15.365 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.365 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.365 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:15.365 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.365 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:15.365 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:15.365 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.365 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.366 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:15.366 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:15.366 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.366 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:15.366 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:15.366 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:15.366 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:15.366 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:15.366 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.366 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:15.366 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.366 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:15.366 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:15.366 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:15.366 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:15.366 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:15.367 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:15.367 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:15.367 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:15.367 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.367 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.367 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:15.367 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:15.367 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:15.367 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:15.367 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.367 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:15.367 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:15.367 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:15.367 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:15.367 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.367 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.368 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:15.368 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:15.368 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:15.368 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:15.368 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.368 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.368 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:15.368 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:15.368 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:15.368 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.368 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:15.368 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.368 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:15.368 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:15.368 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.368 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:15.368 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:15.369 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:15.369 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:15.369 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:15.369 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:15.369 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.369 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:15.369 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.369 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:15.369 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.369 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.369 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:15.369 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.369 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:15.369 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.369 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:15.369 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:15.370 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:15.370 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:15.370 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:15.370 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:15.370 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.370 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:15.370 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:15.370 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:15.370 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:15.370 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:15.370 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:15.370 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.370 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:15.370 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:15.370 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:15.370 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:15.371 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:15.371 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:15.371 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:15.371 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:15.371 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:15.371 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:15.371 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:15.371 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.371 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.371 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:15.371 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.371 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:15.371 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:15.371 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:15.371 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:15.371 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:15.371 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:15.372 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:15.372 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:15.372 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:15.372 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:15.372 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:15.372 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:15.372 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:15.372 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:15.372 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:15.372 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:15.372 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:15.372 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:15.372 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:15.372 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:15.372 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:15.372 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:15.373 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:15.373 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:15.373 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:15.373 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:15.373 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:15.373 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:15.373 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.373 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.373 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.373 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.373 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:15.373 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:15.373 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.373 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:15.373 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.373 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:15.374 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:15.374 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:15.374 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.374 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:15.374 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:15.374 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.374 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.374 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:15.374 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:15.374 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.374 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.374 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:15.374 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:15.374 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:15.374 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:15.374 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:15.375 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.375 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.375 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:15.375 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:15.375 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:15.375 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.375 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:15.375 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.375 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:15.375 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.375 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:15.375 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.375 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:15.375 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.375 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:15.375 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:15.375 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:15.376 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:15.376 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.376 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:15.376 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.376 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:15.376 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:15.376 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:15.376 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:15.376 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:15.376 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:15.376 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:15.376 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:15.376 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:15.376 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:15.376 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:15.377 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:15.377 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:15.377 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:15.377 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:15.377 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:15.377 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:15.377 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:15.377 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:15.377 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:15.377 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:15.377 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:15.377 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:15.377 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:15.377 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:15.377 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:15.377 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:15.378 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:15.378 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:15.378 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:15.378 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:15.378 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:15.378 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:15.378 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:15.378 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:15.378 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:15.378 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:15.378 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:15.378 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:15.378 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:15.378 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.378 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.378 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.379 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:15.379 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.379 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:15.379 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.379 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:15.379 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:15.379 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:15.379 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:15.379 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:15.379 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:15.379 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.379 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:15.379 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:15.379 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:15.379 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:15.379 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:15.379 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:15.380 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.380 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:15.380 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:15.380 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:15.380 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:15.380 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:15.380 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:15.380 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:15.380 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:15.380 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:15.380 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:15.380 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:15.380 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.380 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.380 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:15.380 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:15.381 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:15.381 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:15.381 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:15.381 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.381 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.381 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:15.381 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:15.381 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:15.381 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:15.381 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:15.381 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.381 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:15.381 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:15.381 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:15.381 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:15.381 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:15.382 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:15.382 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.382 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:15.382 INFO:teuthology.orchestra.run.smithi003.stdout:_____ ERROR at teardown of test_versioning_obj_create_versions_remove_all ______ 2023-12-03T13:00:15.382 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.382 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.382 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.382 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:15.382 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:15.382 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.382 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:15.382 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.382 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:15.382 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:15.382 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:15.382 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.383 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:15.383 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:15.383 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.383 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.383 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:15.383 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:15.383 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.383 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.383 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:15.383 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.383 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:15.383 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:15.383 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.383 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.383 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:15.383 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:15.384 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.384 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:15.384 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:15.384 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:15.384 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:15.384 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:15.384 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.384 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:15.384 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.384 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:15.384 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:15.384 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:15.384 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:15.384 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:15.384 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:15.384 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:15.384 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:15.385 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.385 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.385 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:15.385 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:15.385 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:15.385 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:15.385 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.385 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:15.385 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:15.385 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:15.385 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:15.385 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.385 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.385 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:15.385 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:15.385 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:15.385 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:15.386 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.386 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.386 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:15.386 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:15.386 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:15.386 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.386 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:15.386 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.386 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:15.386 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:15.386 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.386 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:15.386 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:15.386 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:15.386 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:15.386 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:15.387 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:15.387 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.387 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:15.387 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.387 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:15.387 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.387 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.387 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:15.387 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.387 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:15.387 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.387 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:15.387 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:15.387 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:15.387 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:15.388 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:15.388 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:15.388 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.388 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:15.388 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:15.388 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:15.388 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:15.388 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:15.388 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:15.388 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.388 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:15.388 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:15.388 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:15.388 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:15.388 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:15.388 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:15.389 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:15.389 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:15.389 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:15.389 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:15.389 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:15.389 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.389 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.389 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:15.389 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.389 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:15.389 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:15.389 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:15.389 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:15.389 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:15.389 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:15.389 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:15.390 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:15.390 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:15.390 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:15.390 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:15.390 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:15.390 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:15.390 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:15.390 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:15.390 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:15.390 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:15.390 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:15.390 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:15.390 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:15.390 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:15.390 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:15.390 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:15.391 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:15.391 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:15.391 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:15.391 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:15.391 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:15.391 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.391 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.391 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.391 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.391 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:15.391 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:15.391 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.391 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:15.391 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.391 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:15.391 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:15.392 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:15.392 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.392 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:15.392 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:15.392 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.392 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.392 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:15.392 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:15.392 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.392 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.392 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:15.392 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:15.392 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:15.392 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:15.392 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:15.392 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.392 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.393 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:15.393 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:15.393 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:15.393 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.393 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:15.393 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.393 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:15.393 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.393 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:15.393 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.393 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:15.393 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.393 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:15.393 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:15.393 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:15.393 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:15.393 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.394 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:15.394 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.394 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:15.394 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:15.394 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:15.394 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:15.394 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:15.394 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:15.394 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:15.394 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:15.394 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:15.394 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:15.394 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:15.394 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:15.394 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:15.395 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:15.395 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:15.395 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:15.395 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:15.395 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:15.395 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:15.395 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:15.395 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:15.395 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:15.395 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:15.395 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:15.395 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:15.395 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:15.395 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:15.395 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:15.395 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:15.395 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:15.396 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:15.396 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:15.396 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:15.396 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:15.396 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:15.396 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:15.396 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:15.396 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:15.396 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:15.396 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:15.396 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.396 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.396 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.396 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:15.396 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.396 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:15.397 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.397 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:15.397 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:15.397 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:15.397 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:15.397 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:15.397 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:15.397 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.397 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:15.397 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:15.397 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:15.397 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:15.397 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:15.397 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:15.397 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.398 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:15.398 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:15.398 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:15.398 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:15.398 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:15.398 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:15.398 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:15.398 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:15.398 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:15.398 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:15.398 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:15.398 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.398 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.398 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:15.398 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:15.398 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:15.399 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:15.399 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:15.399 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.399 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.399 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:15.399 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:15.399 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:15.399 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:15.399 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:15.399 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.399 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:15.399 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:15.399 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:15.399 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:15.399 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:15.400 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:15.400 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.400 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:15.400 INFO:teuthology.orchestra.run.smithi003.stdout:_ ERROR at teardown of test_versioning_obj_create_versions_remove_special_names _ 2023-12-03T13:00:15.400 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.400 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.400 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.400 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:15.400 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:15.400 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.400 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:15.400 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.400 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:15.400 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:15.400 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:15.400 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.401 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:15.401 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:15.401 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.401 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.401 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:15.401 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:15.401 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.401 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.401 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:15.401 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.401 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:15.401 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:15.401 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.401 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.401 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:15.401 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:15.401 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.402 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:15.402 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:15.402 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:15.402 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:15.402 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:15.402 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.402 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:15.402 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.402 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:15.402 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:15.402 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:15.402 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:15.402 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:15.402 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:15.402 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:15.402 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:15.403 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.403 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.403 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:15.403 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:15.403 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:15.403 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:15.403 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.403 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:15.403 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:15.403 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:15.403 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:15.403 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.403 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.403 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:15.403 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:15.403 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:15.404 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:15.404 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.404 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.404 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:15.404 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:15.404 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:15.404 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.404 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:15.404 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.404 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:15.404 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:15.404 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.404 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:15.404 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:15.404 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:15.404 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:15.405 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:15.405 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:15.405 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.405 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:15.405 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.405 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:15.405 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.405 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.405 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:15.405 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.405 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:15.405 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.405 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:15.405 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:15.405 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:15.405 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:15.406 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:15.406 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:15.406 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.406 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:15.406 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:15.406 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:15.406 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:15.406 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:15.406 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:15.406 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.406 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:15.406 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:15.406 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:15.406 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:15.406 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:15.406 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:15.407 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:15.407 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:15.407 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:15.407 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:15.407 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:15.407 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.407 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.407 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:15.407 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.407 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:15.407 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:15.407 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:15.407 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:15.407 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:15.407 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:15.407 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:15.408 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:15.408 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:15.408 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:15.408 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:15.408 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:15.408 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:15.408 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:15.408 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:15.408 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:15.408 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:15.408 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:15.408 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:15.409 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:15.409 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:15.409 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:15.409 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:15.409 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:15.409 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:15.409 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:15.409 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:15.409 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:15.409 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.409 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.409 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.409 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.409 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:15.410 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:15.410 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.410 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:15.410 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.410 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:15.410 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:15.410 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:15.410 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.410 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:15.410 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:15.410 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.410 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.410 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:15.410 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:15.410 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.411 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.411 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:15.411 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:15.411 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:15.411 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:15.411 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:15.411 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.411 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.411 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:15.411 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:15.411 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:15.411 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.411 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:15.411 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.411 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:15.411 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.412 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:15.412 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.412 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:15.412 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.412 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:15.412 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:15.412 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:15.412 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:15.412 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.412 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:15.412 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.412 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:15.412 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:15.412 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:15.412 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:15.413 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:15.413 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:15.413 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:15.413 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:15.413 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:15.413 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:15.413 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:15.413 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:15.413 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:15.413 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:15.413 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:15.413 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:15.413 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:15.413 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:15.413 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:15.413 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:15.414 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:15.414 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:15.414 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:15.414 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:15.414 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:15.414 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:15.414 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:15.414 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:15.414 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:15.414 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:15.414 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:15.414 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:15.414 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:15.414 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:15.415 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:15.415 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:15.415 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:15.415 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:15.415 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:15.415 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:15.415 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.415 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.415 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.415 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:15.415 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.415 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:15.415 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.415 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:15.415 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:15.415 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:15.415 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:15.416 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:15.416 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:15.416 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.416 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:15.416 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:15.416 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:15.416 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:15.416 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:15.416 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:15.416 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.416 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:15.416 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:15.416 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:15.416 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:15.416 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:15.416 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:15.417 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:15.417 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:15.417 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:15.417 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:15.417 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:15.417 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.417 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.417 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:15.417 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:15.417 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:15.417 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:15.417 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:15.417 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.417 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.417 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:15.417 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:15.418 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:15.418 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:15.418 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:15.418 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.418 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:15.418 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:15.418 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:15.418 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:15.418 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:15.418 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:15.418 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.418 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:15.418 INFO:teuthology.orchestra.run.smithi003.stdout:_____ ERROR at teardown of test_versioning_obj_create_overwrite_multipart ______ 2023-12-03T13:00:15.418 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.418 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.418 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.419 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:15.419 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:15.419 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.419 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:15.419 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.419 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:15.419 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:15.419 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:15.419 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.419 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:15.419 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:15.419 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.419 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.419 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:15.419 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:15.419 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.420 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.420 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:15.420 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.420 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:15.420 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:15.420 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.420 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.420 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:15.420 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:15.420 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.420 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:15.420 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:15.420 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:15.421 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:15.421 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:15.421 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.421 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:15.421 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.421 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:15.421 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:15.421 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:15.421 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:15.421 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:15.421 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:15.421 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:15.421 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:15.421 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.421 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.421 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:15.421 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:15.422 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:15.422 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:15.422 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.422 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:15.422 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:15.422 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:15.422 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:15.422 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.422 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.422 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:15.422 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:15.422 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:15.422 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:15.422 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.422 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.422 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:15.423 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:15.423 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:15.423 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.423 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:15.423 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.423 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:15.423 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:15.423 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.423 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:15.423 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:15.423 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:15.423 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:15.423 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:15.423 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:15.423 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.423 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:15.424 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.424 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:15.424 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.424 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.424 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:15.424 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.424 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:15.424 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.424 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:15.424 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:15.424 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:15.424 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:15.424 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:15.424 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:15.424 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.425 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:15.425 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:15.425 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:15.425 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:15.425 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:15.425 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:15.425 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.425 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:15.425 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:15.425 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:15.425 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:15.425 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:15.425 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:15.425 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:15.425 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:15.425 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:15.426 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:15.426 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:15.426 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.426 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.426 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:15.426 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.426 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:15.426 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:15.426 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:15.426 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:15.426 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:15.426 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:15.426 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:15.426 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:15.426 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:15.426 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:15.427 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:15.427 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:15.427 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:15.427 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:15.427 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:15.427 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:15.427 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:15.427 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:15.427 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:15.427 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:15.427 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:15.427 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:15.427 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:15.427 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:15.427 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:15.427 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:15.428 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:15.428 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:15.428 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.428 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.428 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.428 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.428 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:15.428 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:15.428 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.428 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:15.428 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.428 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:15.428 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:15.428 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:15.428 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.428 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:15.428 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:15.429 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.429 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.429 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:15.429 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:15.429 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.429 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.429 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:15.429 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:15.429 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:15.429 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:15.429 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:15.429 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.429 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.429 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:15.429 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:15.429 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:15.430 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.430 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:15.430 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.430 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:15.430 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.430 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:15.430 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.430 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:15.430 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.430 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:15.430 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:15.430 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:15.430 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:15.430 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.430 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:15.430 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.431 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:15.431 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:15.431 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:15.431 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:15.431 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:15.431 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:15.431 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:15.431 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:15.431 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:15.431 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:15.431 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:15.431 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:15.431 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:15.431 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:15.432 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:15.432 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:15.432 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:15.432 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:15.432 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:15.432 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:15.432 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:15.432 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:15.432 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:15.432 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:15.432 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:15.432 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:15.432 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:15.432 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:15.432 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:15.432 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:15.433 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:15.433 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:15.433 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:15.433 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:15.433 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:15.433 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:15.433 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:15.433 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:15.433 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:15.433 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:15.433 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.433 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.433 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.433 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:15.433 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.433 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:15.433 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.434 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:15.434 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:15.434 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:15.434 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:15.434 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:15.434 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:15.434 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.434 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:15.434 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:15.434 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:15.434 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:15.434 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:15.434 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:15.434 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.434 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:15.434 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:15.435 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:15.435 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:15.435 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:15.435 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:15.435 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:15.435 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:15.435 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:15.435 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:15.435 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:15.435 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.435 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.435 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:15.435 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:15.435 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:15.435 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:15.435 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:15.435 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.436 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.436 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:15.436 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:15.436 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:15.436 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:15.436 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:15.436 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.436 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:15.436 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:15.436 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:15.436 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:15.436 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:15.436 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:15.436 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.436 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:15.436 INFO:teuthology.orchestra.run.smithi003.stdout:_____________ ERROR at teardown of test_versioning_obj_list_marker _____________ 2023-12-03T13:00:15.437 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.437 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.437 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.437 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:15.437 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:15.437 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.437 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:15.437 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.437 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:15.437 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:15.437 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:15.437 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.437 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:15.437 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:15.437 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.437 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.437 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:15.438 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:15.438 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.438 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.438 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:15.438 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.438 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:15.438 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:15.438 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.438 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.438 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:15.438 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:15.438 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.438 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:15.438 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:15.438 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:15.438 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:15.439 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:15.439 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.439 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:15.439 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.439 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:15.439 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:15.439 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:15.439 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:15.439 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:15.439 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:15.439 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:15.439 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:15.439 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.439 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.439 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:15.439 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:15.439 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:15.440 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:15.440 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.440 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:15.440 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:15.440 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:15.440 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:15.440 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.440 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.440 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:15.440 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:15.440 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:15.440 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:15.440 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.440 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.440 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:15.440 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:15.441 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:15.441 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.441 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:15.441 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.441 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:15.441 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:15.441 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.441 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:15.441 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:15.441 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:15.441 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:15.441 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:15.441 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:15.441 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.441 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:15.441 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.441 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:15.442 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.442 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.442 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:15.442 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.442 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:15.442 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.442 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:15.442 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:15.442 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:15.442 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:15.442 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:15.442 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:15.442 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.442 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:15.443 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:15.443 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:15.443 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:15.443 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:15.443 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:15.443 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.443 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:15.443 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:15.443 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:15.443 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:15.443 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:15.443 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:15.443 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:15.443 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:15.443 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:15.443 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:15.443 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:15.444 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.444 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.444 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:15.444 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.444 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:15.444 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:15.444 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:15.444 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:15.444 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:15.444 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:15.444 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:15.444 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:15.444 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:15.444 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:15.444 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:15.444 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:15.444 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:15.445 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:15.445 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:15.445 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:15.445 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:15.445 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:15.445 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:15.445 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:15.445 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:15.445 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:15.445 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:15.445 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:15.445 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:15.445 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:15.445 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:15.445 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:15.445 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.445 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.446 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.446 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.446 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:15.446 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:15.446 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.446 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:15.446 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.446 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:15.446 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:15.446 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:15.446 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.446 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:15.446 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:15.446 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.446 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.446 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:15.447 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:15.447 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.447 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.447 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:15.447 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:15.447 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:15.447 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:15.447 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:15.447 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.447 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.447 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:15.447 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:15.447 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:15.447 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.447 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:15.447 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.448 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:15.448 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.448 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:15.448 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.448 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:15.448 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.448 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:15.448 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:15.448 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:15.448 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:15.448 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.448 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:15.448 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.448 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:15.448 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:15.448 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:15.448 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:15.449 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:15.449 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:15.449 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:15.449 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:15.449 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:15.449 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:15.449 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:15.449 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:15.449 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:15.449 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:15.449 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:15.449 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:15.449 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:15.449 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:15.449 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:15.449 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:15.450 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:15.450 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:15.450 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:15.450 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:15.450 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:15.450 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:15.450 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:15.450 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:15.450 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:15.450 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:15.450 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:15.450 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:15.450 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:15.450 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:15.450 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:15.450 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:15.451 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:15.451 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:15.451 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:15.451 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:15.451 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.453 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.453 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.453 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:15.453 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.453 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:15.453 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.454 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:15.454 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:15.454 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:15.454 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:15.454 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:15.454 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:15.454 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.454 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:15.455 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:15.455 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:15.455 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:15.455 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:15.455 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:15.455 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.455 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:15.455 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:15.455 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:15.455 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:15.455 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:15.455 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:15.455 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:15.455 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:15.456 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:15.456 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:15.456 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:15.456 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.456 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.456 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:15.456 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:15.456 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:15.456 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:15.456 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:15.456 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.456 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.456 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:15.456 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:15.457 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:15.457 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:15.457 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:15.457 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.457 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:15.457 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:15.457 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:15.457 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:15.457 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:15.457 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:15.457 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.457 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:15.457 INFO:teuthology.orchestra.run.smithi003.stdout:____________ ERROR at teardown of test_versioning_copy_obj_version _____________ 2023-12-03T13:00:15.458 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.458 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.458 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.458 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:15.458 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:15.458 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.458 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:15.458 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.458 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:15.458 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:15.458 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:15.458 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.458 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:15.459 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:15.459 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.459 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.459 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:15.459 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:15.459 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.459 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.459 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:15.459 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.459 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:15.459 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:15.459 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.459 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.459 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:15.460 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:15.460 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.460 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:15.460 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:15.460 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:15.460 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:15.460 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:15.460 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.460 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:15.460 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.460 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:15.460 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:15.460 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:15.460 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:15.461 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:15.461 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:15.461 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:15.461 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:15.461 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.461 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.461 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:15.461 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:15.461 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:15.461 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:15.461 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.461 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:15.462 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:15.462 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:15.462 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:15.462 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.462 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.462 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:15.462 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:15.462 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:15.462 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:15.462 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.462 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.462 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:15.462 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:15.463 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:15.463 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.463 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:15.463 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.463 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:15.463 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:15.463 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.463 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:15.463 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:15.463 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:15.463 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:15.463 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:15.463 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:15.463 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.464 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:15.464 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.464 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:15.464 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.464 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.464 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:15.464 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.464 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:15.464 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.464 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:15.464 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:15.464 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:15.464 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:15.465 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:15.465 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:15.465 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.465 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:15.465 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:15.465 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:15.465 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:15.465 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:15.465 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:15.465 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.465 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:15.465 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:15.465 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:15.465 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:15.466 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:15.466 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:15.466 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:15.466 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:15.466 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:15.466 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:15.466 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:15.466 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.466 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.466 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:15.466 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.466 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:15.466 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:15.466 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:15.467 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:15.467 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:15.467 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:15.467 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:15.467 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:15.467 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:15.467 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:15.467 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:15.467 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:15.467 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:15.467 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:15.467 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:15.467 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:15.468 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:15.468 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:15.468 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:15.468 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:15.468 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:15.468 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:15.468 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:15.468 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:15.468 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:15.468 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:15.468 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:15.468 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:15.469 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.469 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.469 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.469 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.469 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:15.469 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:15.469 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.469 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:15.469 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.469 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:15.469 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:15.469 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:15.469 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.470 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:15.470 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:15.470 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.470 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.470 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:15.470 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:15.470 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.470 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.470 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:15.470 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:15.470 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:15.470 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:15.470 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:15.471 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.471 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.471 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:15.471 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:15.471 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:15.471 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.471 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:15.471 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.471 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:15.471 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.471 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:15.471 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.471 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:15.471 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.472 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:15.472 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:15.472 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:15.472 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:15.472 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.472 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:15.472 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.472 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:15.472 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:15.472 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:15.472 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:15.472 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:15.472 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:15.473 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:15.473 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:15.473 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:15.473 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:15.473 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:15.473 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:15.473 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:15.473 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:15.473 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:15.473 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:15.473 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:15.473 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:15.473 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:15.473 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:15.473 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:15.474 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:15.474 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:15.474 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:15.474 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:15.474 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:15.474 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:15.474 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:15.474 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:15.474 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:15.474 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:15.474 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:15.474 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:15.474 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:15.475 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:15.475 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:15.475 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:15.475 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:15.475 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:15.475 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:15.475 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.475 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.475 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.475 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:15.475 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.475 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:15.475 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.476 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:15.476 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:15.476 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:15.476 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:15.476 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:15.476 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:15.476 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.476 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:15.476 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:15.476 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:15.476 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:15.476 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:15.476 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:15.476 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.476 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:15.477 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:15.477 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:15.477 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:15.477 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:15.477 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:15.477 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:15.477 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:15.477 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:15.477 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:15.477 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:15.477 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.477 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.477 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:15.478 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:15.478 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:15.478 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:15.478 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:15.478 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.478 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.478 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:15.478 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:15.478 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:15.478 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:15.478 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:15.478 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.478 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:15.478 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:15.478 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:15.479 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:15.479 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:15.479 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:15.479 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.479 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:15.479 INFO:teuthology.orchestra.run.smithi003.stdout:___________ ERROR at teardown of test_versioning_multi_object_delete ___________ 2023-12-03T13:00:15.479 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.479 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.479 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.479 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:15.479 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:15.479 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.479 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:15.479 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.479 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:15.480 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:15.480 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:15.480 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.480 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:15.480 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:15.480 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.480 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.480 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:15.480 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:15.480 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.480 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.480 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:15.481 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.481 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:15.481 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:15.481 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.481 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.481 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:15.481 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:15.481 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.481 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:15.481 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:15.481 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:15.481 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:15.482 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:15.482 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.482 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:15.482 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.482 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:15.482 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:15.482 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:15.482 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:15.482 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:15.482 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:15.482 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:15.482 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:15.482 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.482 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.483 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:15.483 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:15.483 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:15.483 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:15.483 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.483 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:15.483 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:15.483 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:15.483 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:15.483 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.483 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.483 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:15.483 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:15.484 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:15.484 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:15.484 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.484 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.484 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:15.484 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:15.484 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:15.484 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.484 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:15.484 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.484 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:15.484 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:15.484 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.485 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:15.485 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:15.485 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:15.485 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:15.485 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:15.485 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:15.485 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.485 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:15.485 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.485 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:15.485 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.485 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.485 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:15.485 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.485 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:15.486 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.486 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:15.486 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:15.486 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:15.486 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:15.486 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:15.486 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:15.486 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.486 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:15.486 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:15.486 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:15.486 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:15.486 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:15.487 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:15.487 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.487 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:15.487 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:15.487 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:15.487 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:15.487 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:15.487 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:15.487 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:15.487 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:15.487 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:15.487 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:15.487 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:15.488 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.488 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.488 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:15.488 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.488 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:15.488 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:15.488 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:15.488 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:15.488 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:15.488 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:15.488 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:15.488 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:15.488 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:15.489 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:15.489 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:15.489 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:15.489 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:15.489 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:15.489 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:15.489 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:15.489 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:15.489 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:15.489 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:15.489 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:15.489 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:15.489 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:15.489 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:15.490 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:15.490 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:15.490 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:15.490 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:15.490 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:15.490 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.490 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.490 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.490 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.490 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:15.490 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:15.490 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.490 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:15.491 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.491 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:15.491 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:15.491 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:15.491 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.491 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:15.491 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:15.491 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.491 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.491 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:15.491 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:15.491 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.491 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.491 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:15.492 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:15.492 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:15.492 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:15.492 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:15.492 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.492 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.492 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:15.492 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:15.492 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:15.492 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.492 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:15.492 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.492 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:15.493 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.493 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:15.493 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.493 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:15.493 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.493 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:15.493 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:15.493 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:15.493 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:15.493 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.493 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:15.493 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.493 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:15.494 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:15.494 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:15.494 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:15.494 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:15.494 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:15.494 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:15.494 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:15.494 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:15.494 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:15.494 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:15.494 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:15.495 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:15.495 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:15.495 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:15.495 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:15.495 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:15.495 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:15.495 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:15.495 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:15.495 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:15.495 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:15.495 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:15.495 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:15.495 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:15.496 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:15.496 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:15.496 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:15.496 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:15.496 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:15.496 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:15.496 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:15.496 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:15.496 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:15.496 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:15.496 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:15.496 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:15.496 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:15.496 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:15.496 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:15.497 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.497 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.497 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.497 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:15.497 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.497 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:15.497 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.497 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:15.497 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:15.497 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:15.497 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:15.497 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:15.497 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:15.498 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.498 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:15.498 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:15.498 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:15.498 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:15.498 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:15.498 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:15.498 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.498 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:15.498 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:15.498 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:15.498 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:15.498 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:15.498 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:15.499 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:15.499 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:15.499 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:15.499 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:15.499 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:15.499 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.499 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.499 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:15.499 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:15.499 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:15.499 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:15.499 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:15.499 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.499 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.500 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:15.500 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:15.500 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:15.500 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:15.500 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:15.500 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.500 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:15.500 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:15.500 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:15.500 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:15.500 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:15.500 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:15.500 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.501 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:15.501 INFO:teuthology.orchestra.run.smithi003.stdout:_____ ERROR at teardown of test_versioning_multi_object_delete_with_marker _____ 2023-12-03T13:00:15.501 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.501 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.501 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.501 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:15.501 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:15.501 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.501 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:15.501 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.501 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:15.501 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:15.501 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:15.502 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.502 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:15.502 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:15.502 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.502 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.502 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:15.502 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:15.502 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.502 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.502 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:15.502 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.502 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:15.502 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:15.502 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.503 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.503 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:15.503 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:15.503 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.503 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:15.503 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:15.503 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:15.503 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:15.503 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:15.503 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.503 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:15.503 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.503 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:15.503 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:15.504 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:15.504 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:15.504 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:15.504 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:15.504 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:15.504 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:15.504 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.504 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.504 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:15.504 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:15.504 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:15.504 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:15.504 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.504 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:15.505 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:15.505 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:15.505 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:15.505 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.505 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.505 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:15.505 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:15.505 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:15.505 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:15.505 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.505 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.505 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:15.505 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:15.505 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:15.506 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.506 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:15.506 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.506 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:15.506 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:15.506 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.506 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:15.506 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:15.506 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:15.506 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:15.506 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:15.506 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:15.506 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.506 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:15.507 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.507 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:15.507 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.507 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.507 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:15.507 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.507 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:15.507 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.507 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:15.507 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:15.507 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:15.508 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:15.508 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:15.508 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:15.508 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.508 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:15.508 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:15.508 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:15.508 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:15.508 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:15.508 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:15.508 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.508 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:15.508 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:15.508 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:15.509 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:15.509 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:15.509 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:15.509 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:15.509 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:15.509 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:15.509 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:15.509 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:15.509 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.509 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.509 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:15.509 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.509 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:15.509 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:15.510 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:15.510 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:15.510 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:15.510 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:15.510 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:15.510 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:15.510 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:15.510 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:15.510 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:15.510 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:15.510 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:15.510 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:15.510 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:15.511 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:15.511 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:15.511 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:15.511 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:15.511 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:15.511 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:15.511 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:15.511 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:15.511 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:15.511 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:15.511 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:15.511 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:15.511 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:15.511 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.512 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.512 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.512 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.512 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:15.512 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:15.512 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.512 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:15.512 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.512 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:15.512 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:15.512 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:15.512 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.512 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:15.512 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:15.513 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.513 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.513 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:15.513 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:15.513 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.513 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.513 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:15.513 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:15.513 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:15.513 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:15.513 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:15.513 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.513 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.514 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:15.514 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:15.514 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:15.514 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.514 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:15.514 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.514 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:15.514 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.514 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:15.514 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.514 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:15.514 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.514 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:15.515 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:15.515 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:15.515 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:15.515 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.515 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:15.515 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.515 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:15.515 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:15.515 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:15.515 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:15.515 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:15.515 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:15.515 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:15.515 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:15.516 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:15.516 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:15.516 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:15.516 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:15.516 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:15.516 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:15.516 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:15.516 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:15.516 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:15.516 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:15.516 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:15.516 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:15.516 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:15.516 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:15.517 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:15.517 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:15.517 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:15.517 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:15.517 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:15.517 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:15.517 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:15.517 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:15.517 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:15.517 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:15.517 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:15.517 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:15.517 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:15.518 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:15.518 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:15.518 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:15.518 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:15.518 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:15.518 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.518 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.518 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.518 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:15.518 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.518 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:15.518 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.518 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:15.518 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:15.519 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:15.519 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:15.519 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:15.519 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:15.519 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.519 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:15.519 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:15.519 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:15.519 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:15.519 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:15.519 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:15.519 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.519 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:15.520 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:15.520 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:15.520 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:15.520 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:15.520 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:15.520 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:15.520 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:15.520 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:15.520 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:15.520 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:15.520 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.520 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.520 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:15.521 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:15.521 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:15.521 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:15.521 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:15.521 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.521 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.521 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:15.521 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:15.521 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:15.521 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:15.521 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:15.521 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.521 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:15.522 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:15.522 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:15.522 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:15.522 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:15.522 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:15.522 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.522 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:15.522 INFO:teuthology.orchestra.run.smithi003.stdout:_ ERROR at teardown of test_versioning_multi_object_delete_with_marker_create __ 2023-12-03T13:00:15.522 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.522 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.522 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.522 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:15.522 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:15.522 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.523 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:15.523 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.523 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:15.523 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:15.523 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:15.523 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.523 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:15.523 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:15.523 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.523 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.523 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:15.523 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:15.523 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.524 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.524 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:15.524 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.524 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:15.524 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:15.524 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.524 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.524 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:15.524 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:15.524 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.524 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:15.524 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:15.524 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:15.525 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:15.525 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:15.525 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.525 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:15.525 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.525 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:15.525 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:15.525 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:15.525 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:15.525 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:15.525 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:15.525 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:15.525 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:15.525 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.526 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.526 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:15.526 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:15.526 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:15.526 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:15.526 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.526 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:15.526 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:15.526 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:15.526 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:15.526 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.526 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.526 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:15.526 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:15.527 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:15.527 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:15.527 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.527 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.527 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:15.527 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:15.527 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:15.527 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.527 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:15.527 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.527 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:15.527 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:15.527 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.528 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:15.528 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:15.528 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:15.528 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:15.528 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:15.528 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:15.528 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.528 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:15.528 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.528 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:15.528 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.528 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.528 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:15.529 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.529 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:15.529 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.529 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:15.529 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:15.529 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:15.529 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:15.529 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:15.529 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:15.529 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.529 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:15.529 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:15.529 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:15.529 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:15.529 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:15.530 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:15.530 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.530 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:15.530 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:15.530 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:15.530 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:15.530 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:15.530 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:15.530 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:15.530 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:15.530 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:15.530 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:15.530 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:15.531 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.531 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.531 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:15.531 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.531 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:15.531 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:15.531 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:15.531 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:15.531 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:15.531 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:15.531 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:15.531 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:15.531 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:15.532 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:15.532 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:15.532 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:15.532 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:15.532 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:15.532 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:15.532 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:15.532 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:15.532 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:15.532 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:15.532 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:15.532 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:15.532 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:15.533 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:15.533 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:15.533 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:15.533 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:15.533 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:15.533 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:15.533 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.533 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.533 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.533 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.533 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:15.533 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:15.534 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.534 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:15.534 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.534 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:15.534 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:15.534 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:15.534 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.534 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:15.534 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:15.534 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.534 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.534 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:15.534 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:15.534 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.535 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.535 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:15.535 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:15.535 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:15.535 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:15.535 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:15.535 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.535 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.535 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:15.535 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:15.535 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:15.535 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.535 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:15.535 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.536 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:15.536 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.536 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:15.536 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.536 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:15.536 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.536 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:15.536 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:15.536 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:15.536 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:15.536 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.536 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:15.536 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.536 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:15.536 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:15.537 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:15.537 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:15.537 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:15.537 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:15.537 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:15.537 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:15.537 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:15.537 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:15.537 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:15.537 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:15.537 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:15.537 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:15.537 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:15.538 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:15.538 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:15.538 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:15.538 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:15.538 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:15.538 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:15.538 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:15.538 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:15.538 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:15.538 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:15.538 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:15.538 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:15.538 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:15.539 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:15.539 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:15.539 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:15.539 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:15.539 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:15.539 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:15.539 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:15.539 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:15.539 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:15.539 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:15.539 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:15.539 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:15.539 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.539 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.540 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.540 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:15.540 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.540 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:15.540 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.540 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:15.540 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:15.540 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:15.540 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:15.540 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:15.540 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:15.540 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.540 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:15.541 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:15.541 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:15.541 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:15.541 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:15.541 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:15.541 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.541 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:15.541 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:15.541 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:15.541 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:15.541 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:15.541 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:15.541 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:15.542 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:15.542 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:15.542 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:15.542 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:15.542 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.542 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.542 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:15.542 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:15.542 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:15.542 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:15.542 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:15.542 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.542 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.542 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:15.542 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:15.543 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:15.543 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:15.543 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:15.543 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.543 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:15.543 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:15.543 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:15.543 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:15.543 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:15.543 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:15.543 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.543 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:15.543 INFO:teuthology.orchestra.run.smithi003.stdout:________________ ERROR at teardown of test_versioned_object_acl ________________ 2023-12-03T13:00:15.544 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.544 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.544 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.544 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:15.544 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:15.544 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.544 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:15.544 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.544 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:15.544 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:15.544 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:15.544 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.544 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:15.545 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:15.545 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.545 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.545 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:15.545 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:15.545 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.545 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.545 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:15.545 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.545 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:15.545 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:15.545 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.545 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.546 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:15.546 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:15.546 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.546 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:15.546 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:15.546 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:15.546 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:15.546 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:15.546 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.546 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:15.546 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.546 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:15.546 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:15.547 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:15.547 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:15.547 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:15.547 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:15.547 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:15.547 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:15.547 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.547 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.547 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:15.547 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:15.547 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:15.547 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:15.547 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.548 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:15.548 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:15.548 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:15.548 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:15.548 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.548 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.548 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:15.548 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:15.548 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:15.548 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:15.548 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.548 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.548 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:15.548 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:15.549 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:15.549 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.549 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:15.549 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.549 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:15.549 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:15.549 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.549 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:15.549 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:15.549 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:15.549 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:15.549 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:15.549 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:15.549 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.550 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:15.550 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.550 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:15.550 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.550 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.550 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:15.550 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.550 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:15.550 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.550 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:15.550 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:15.550 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:15.550 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:15.551 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:15.551 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:15.551 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.551 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:15.551 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:15.551 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:15.551 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:15.551 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:15.551 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:15.551 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.551 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:15.551 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:15.552 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:15.552 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:15.552 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:15.552 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:15.552 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:15.552 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:15.552 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:15.552 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:15.552 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:15.552 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.552 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.552 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:15.552 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.552 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:15.553 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:15.553 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:15.553 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:15.553 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:15.553 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:15.553 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:15.553 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:15.553 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:15.553 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:15.553 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:15.553 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:15.553 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:15.553 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:15.553 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:15.554 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:15.554 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:15.554 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:15.554 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:15.554 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:15.557 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:15.557 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:15.557 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:15.557 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:15.557 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:15.558 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:15.558 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:15.558 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:15.558 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.558 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.558 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.558 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.558 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:15.558 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:15.558 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.558 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:15.558 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.558 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:15.559 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:15.559 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:15.559 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.559 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:15.559 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:15.559 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.559 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.559 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:15.559 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:15.559 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.559 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.559 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:15.559 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:15.559 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:15.560 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:15.560 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:15.560 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.560 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.560 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:15.560 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:15.560 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:15.560 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.560 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:15.560 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.560 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:15.560 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.560 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:15.561 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.561 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:15.561 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.561 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:15.561 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:15.561 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:15.561 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:15.561 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.561 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:15.561 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.561 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:15.561 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:15.561 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:15.561 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:15.562 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:15.562 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:15.562 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:15.562 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:15.562 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:15.562 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:15.562 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:15.562 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:15.562 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:15.562 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:15.562 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:15.562 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:15.563 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:15.563 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:15.563 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:15.563 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:15.563 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:15.563 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:15.563 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:15.563 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:15.563 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:15.563 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:15.563 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:15.563 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:15.564 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:15.564 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:15.564 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:15.564 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:15.564 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:15.564 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:15.564 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:15.564 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:15.564 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:15.564 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:15.564 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:15.564 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:15.564 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.565 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.565 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.565 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:15.565 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.565 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:15.565 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.565 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:15.565 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:15.565 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:15.565 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:15.565 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:15.565 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:15.565 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.566 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:15.566 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:15.566 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:15.566 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:15.566 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:15.566 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:15.566 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.566 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:15.566 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:15.566 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:15.566 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:15.566 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:15.566 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:15.567 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:15.567 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:15.567 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:15.567 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:15.567 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:15.567 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.567 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.567 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:15.567 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:15.567 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:15.567 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:15.567 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:15.567 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.567 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.568 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:15.568 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:15.568 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:15.568 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:15.568 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:15.568 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.568 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:15.568 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:15.568 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:15.568 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:15.568 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:15.568 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:15.568 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.568 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:15.569 INFO:teuthology.orchestra.run.smithi003.stdout:_____ ERROR at teardown of test_versioned_object_acl_no_version_specified ______ 2023-12-03T13:00:15.569 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.569 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.569 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.569 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:15.569 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:15.569 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.569 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:15.569 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.569 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:15.569 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:15.569 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:15.569 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.569 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:15.570 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:15.570 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.570 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.570 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:15.570 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:15.570 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.570 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.570 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:15.570 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.570 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:15.570 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:15.570 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.570 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.571 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:15.571 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:15.571 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.571 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:15.571 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:15.571 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:15.571 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:15.571 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:15.571 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.571 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:15.571 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.571 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:15.571 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:15.572 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:15.572 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:15.572 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:15.572 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:15.572 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:15.572 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:15.572 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.572 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.572 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:15.572 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:15.572 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:15.572 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:15.572 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.572 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:15.572 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:15.573 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:15.573 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:15.573 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.573 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.573 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:15.573 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:15.573 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:15.573 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:15.573 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.573 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.573 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:15.573 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:15.574 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:15.574 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.574 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:15.574 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.574 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:15.574 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:15.574 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.574 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:15.574 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:15.574 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:15.574 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:15.574 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:15.574 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:15.574 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.575 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:15.575 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.575 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:15.575 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.575 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.575 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:15.575 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.575 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:15.575 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.575 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:15.575 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:15.575 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:15.576 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:15.576 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:15.576 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:15.576 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.576 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:15.576 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:15.576 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:15.576 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:15.576 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:15.576 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:15.576 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.576 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:15.576 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:15.576 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:15.577 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:15.577 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:15.577 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:15.577 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:15.577 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:15.577 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:15.577 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:15.577 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:15.577 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.577 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.577 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:15.577 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.577 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:15.577 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:15.578 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:15.578 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:15.578 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:15.578 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:15.578 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:15.578 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:15.578 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:15.578 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:15.578 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:15.578 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:15.578 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:15.578 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:15.579 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:15.579 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:15.579 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:15.579 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:15.579 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:15.579 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:15.579 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:15.579 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:15.579 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:15.579 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:15.579 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:15.579 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:15.579 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:15.579 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:15.579 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.580 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.580 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.580 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.580 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:15.580 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:15.580 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.580 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:15.580 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.580 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:15.580 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:15.580 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:15.580 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.580 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:15.581 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:15.581 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.581 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.581 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:15.581 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:15.581 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.581 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.581 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:15.581 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:15.581 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:15.581 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:15.581 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:15.581 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.582 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.582 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:15.582 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:15.582 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:15.582 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.582 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:15.582 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.582 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:15.582 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.582 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:15.582 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.582 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:15.582 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.582 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:15.583 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:15.583 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:15.583 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:15.583 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.583 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:15.583 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.583 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:15.583 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:15.583 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:15.583 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:15.583 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:15.583 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:15.583 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:15.584 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:15.584 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:15.584 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:15.584 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:15.584 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:15.584 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:15.584 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:15.584 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:15.584 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:15.584 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:15.584 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:15.585 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:15.585 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:15.585 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:15.585 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:15.585 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:15.585 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:15.585 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:15.585 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:15.585 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:15.585 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:15.585 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:15.585 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:15.585 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:15.585 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:15.586 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:15.586 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:15.586 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:15.586 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:15.586 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:15.586 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:15.586 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:15.586 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:15.586 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.586 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.586 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.586 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:15.586 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.587 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:15.587 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.587 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:15.587 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:15.587 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:15.587 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:15.587 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:15.587 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:15.587 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.587 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:15.587 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:15.587 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:15.587 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:15.588 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:15.588 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:15.588 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.588 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:15.588 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:15.588 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:15.588 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:15.588 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:15.588 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:15.588 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:15.588 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:15.588 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:15.589 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:15.589 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:15.589 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.589 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.589 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:15.589 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:15.589 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:15.589 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:15.589 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:15.589 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.589 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.589 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:15.589 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:15.589 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:15.589 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:15.590 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:15.590 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.590 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:15.590 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:15.590 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:15.590 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:15.590 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:15.590 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:15.590 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.590 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:15.590 INFO:teuthology.orchestra.run.smithi003.stdout:___ ERROR at teardown of test_versioned_concurrent_object_create_and_remove ____ 2023-12-03T13:00:15.590 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.591 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.591 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.591 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:15.591 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:15.591 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.591 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:15.591 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.591 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:15.591 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:15.591 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:15.591 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.591 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:15.592 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:15.592 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.592 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.592 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:15.592 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:15.592 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.592 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.592 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:15.592 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.592 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:15.592 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:15.592 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.592 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.592 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:15.593 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:15.593 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.593 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:15.593 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:15.593 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:15.593 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:15.593 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:15.593 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.593 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:15.593 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.593 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:15.593 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:15.593 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:15.593 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:15.594 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:15.594 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:15.594 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:15.594 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:15.594 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.594 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.594 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:15.594 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:15.594 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:15.594 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:15.594 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.594 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:15.594 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:15.595 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:15.595 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:15.595 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.595 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.595 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:15.595 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:15.595 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:15.595 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:15.595 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.595 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.595 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:15.595 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:15.595 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:15.595 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.596 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:15.596 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.596 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:15.596 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:15.596 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.596 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:15.596 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:15.596 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:15.596 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:15.596 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:15.596 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:15.596 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.596 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:15.596 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.596 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:15.597 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.597 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.597 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:15.597 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.597 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:15.597 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.597 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:15.597 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:15.597 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:15.597 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:15.597 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:15.597 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:15.598 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.598 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:15.598 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:15.598 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:15.598 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:15.598 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:15.598 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:15.598 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.598 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:15.598 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:15.598 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:15.598 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:15.598 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:15.598 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:15.599 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:15.599 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:15.599 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:15.599 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:15.599 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:15.599 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.599 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.599 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:15.599 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.599 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:15.599 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:15.599 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:15.599 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:15.599 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:15.600 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:15.600 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:15.600 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:15.600 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:15.600 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:15.600 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:15.600 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:15.600 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:15.600 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:15.600 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:15.600 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:15.600 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:15.600 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:15.601 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:15.601 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:15.601 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:15.601 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:15.601 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:15.601 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:15.601 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:15.601 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:15.601 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:15.601 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:15.601 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.601 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.602 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.602 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.602 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:15.602 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:15.602 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.602 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:15.602 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.602 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:15.602 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:15.602 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:15.602 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.602 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:15.602 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:15.603 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.603 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.603 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:15.603 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:15.603 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.603 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.603 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:15.603 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:15.603 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:15.603 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:15.603 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:15.603 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.603 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.603 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:15.604 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:15.604 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:15.604 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.604 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:15.604 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.604 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:15.604 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.604 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:15.604 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.604 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:15.604 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.604 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:15.604 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:15.605 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:15.605 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:15.605 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.605 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:15.605 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.605 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:15.605 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:15.605 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:15.605 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:15.605 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:15.605 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:15.605 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:15.605 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:15.606 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:15.606 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:15.606 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:15.606 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:15.606 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:15.606 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:15.606 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:15.606 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:15.606 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:15.606 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:15.606 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:15.606 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:15.606 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:15.606 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:15.607 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:15.607 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:15.607 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:15.607 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:15.607 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:15.607 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:15.607 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:15.607 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:15.607 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:15.607 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:15.607 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:15.607 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:15.607 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:15.608 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:15.608 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:15.608 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:15.608 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:15.608 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:15.608 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.608 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.608 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.608 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:15.608 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.608 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:15.608 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.608 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:15.608 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:15.609 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:15.609 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:15.609 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:15.609 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:15.609 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.609 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:15.609 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:15.609 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:15.609 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:15.609 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:15.609 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:15.609 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.609 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:15.609 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:15.610 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:15.610 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:15.610 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:15.610 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:15.610 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:15.610 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:15.610 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:15.610 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:15.610 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:15.610 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.610 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.610 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:15.610 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:15.611 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:15.611 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:15.611 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:15.611 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.611 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.611 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:15.611 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:15.611 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:15.611 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:15.611 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:15.611 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.611 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:15.611 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:15.612 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:15.612 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:15.612 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:15.612 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:15.612 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.612 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:15.612 INFO:teuthology.orchestra.run.smithi003.stdout:___________________ ERROR at teardown of test_lifecycle_set ____________________ 2023-12-03T13:00:15.612 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.612 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.612 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.612 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:15.612 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:15.612 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.612 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:15.613 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.613 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:15.613 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:15.613 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:15.613 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.613 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:15.613 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:15.613 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.613 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.613 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:15.613 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:15.613 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.613 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.613 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:15.613 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.614 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:15.614 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:15.614 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.614 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.614 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:15.614 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:15.614 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.614 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:15.614 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:15.614 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:15.614 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:15.615 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:15.615 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.615 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:15.615 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.615 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:15.615 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:15.615 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:15.615 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:15.615 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:15.615 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:15.615 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:15.615 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:15.615 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.616 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.616 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:15.616 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:15.616 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:15.616 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:15.616 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.616 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:15.616 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:15.616 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:15.616 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:15.616 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.616 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.616 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:15.616 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:15.617 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:15.617 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:15.617 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.617 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.617 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:15.617 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:15.617 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:15.617 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.617 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:15.617 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.617 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:15.617 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:15.617 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.618 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:15.618 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:15.618 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:15.618 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:15.618 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:15.618 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:15.618 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.618 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:15.618 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.618 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:15.618 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.618 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.618 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:15.618 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.619 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:15.619 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.619 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:15.619 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:15.619 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:15.619 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:15.619 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:15.619 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:15.619 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.619 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:15.619 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:15.619 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:15.619 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:15.619 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:15.620 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:15.620 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.620 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:15.620 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:15.620 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:15.620 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:15.620 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:15.620 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:15.620 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:15.620 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:15.620 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:15.620 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:15.620 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:15.620 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.621 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.621 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:15.621 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.621 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:15.621 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:15.621 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:15.621 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:15.621 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:15.621 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:15.621 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:15.621 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:15.621 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:15.621 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:15.622 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:15.622 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:15.622 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:15.622 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:15.622 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:15.622 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:15.622 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:15.622 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:15.622 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:15.622 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:15.622 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:15.622 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:15.622 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:15.622 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:15.622 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:15.623 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:15.623 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:15.623 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:15.623 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.623 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.623 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.623 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.623 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:15.623 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:15.623 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.623 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:15.623 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.623 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:15.623 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:15.624 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:15.624 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.624 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:15.624 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:15.624 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.624 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.624 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:15.624 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:15.624 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.624 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.624 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:15.624 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:15.624 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:15.624 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:15.624 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:15.625 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.625 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.625 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:15.625 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:15.625 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:15.625 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.625 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:15.625 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.625 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:15.625 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.625 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:15.625 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.625 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:15.625 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.626 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:15.626 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:15.626 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:15.626 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:15.626 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.626 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:15.626 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.626 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:15.626 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:15.626 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:15.626 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:15.626 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:15.626 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:15.626 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:15.626 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:15.627 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:15.627 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:15.627 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:15.627 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:15.627 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:15.627 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:15.627 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:15.627 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:15.627 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:15.627 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:15.628 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:15.628 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:15.628 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:15.628 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:15.628 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:15.628 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:15.628 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:15.628 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:15.628 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:15.628 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:15.628 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:15.628 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:15.628 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:15.628 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:15.629 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:15.629 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:15.629 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:15.629 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:15.629 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:15.629 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:15.629 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:15.629 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:15.629 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.629 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.629 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.629 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:15.629 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.629 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:15.630 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.630 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:15.630 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:15.630 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:15.630 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:15.630 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:15.630 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:15.630 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.630 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:15.630 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:15.630 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:15.630 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:15.630 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:15.631 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:15.631 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.631 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:15.631 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:15.631 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:15.631 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:15.631 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:15.631 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:15.631 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:15.631 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:15.631 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:15.631 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:15.631 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:15.632 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.632 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.632 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:15.632 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:15.632 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:15.632 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:15.632 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:15.632 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.632 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.632 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:15.632 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:15.632 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:15.632 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:15.632 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:15.633 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.633 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:15.633 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:15.633 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:15.633 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:15.633 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:15.633 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:15.633 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.633 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:15.633 INFO:teuthology.orchestra.run.smithi003.stdout:___________________ ERROR at teardown of test_lifecycle_get ____________________ 2023-12-03T13:00:15.633 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.633 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.633 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.633 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:15.634 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:15.634 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.634 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:15.634 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.634 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:15.634 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:15.634 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:15.634 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.634 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:15.634 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:15.634 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.634 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.634 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:15.635 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:15.635 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.635 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.635 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:15.635 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.635 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:15.635 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:15.635 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.635 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.635 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:15.635 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:15.635 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.635 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:15.635 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:15.636 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:15.636 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:15.636 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:15.636 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.636 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:15.636 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.636 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:15.636 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:15.636 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:15.636 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:15.636 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:15.636 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:15.636 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:15.636 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:15.637 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.637 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.637 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:15.637 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:15.637 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:15.637 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:15.637 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.637 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:15.637 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:15.637 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:15.637 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:15.637 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.637 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.638 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:15.638 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:15.638 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:15.638 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:15.638 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.638 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.638 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:15.638 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:15.638 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:15.638 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.638 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:15.638 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.638 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:15.638 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:15.639 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.639 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:15.639 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:15.639 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:15.639 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:15.639 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:15.639 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:15.639 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.639 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:15.639 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.639 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:15.639 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.639 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.639 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:15.640 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.640 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:15.640 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.640 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:15.640 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:15.640 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:15.640 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:15.640 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:15.640 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:15.640 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.640 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:15.641 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:15.641 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:15.641 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:15.641 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:15.641 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:15.641 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.641 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:15.641 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:15.641 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:15.641 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:15.641 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:15.641 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:15.642 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:15.642 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:15.642 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:15.642 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:15.642 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:15.642 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.642 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.642 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:15.642 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.642 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:15.642 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:15.642 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:15.642 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:15.642 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:15.643 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:15.643 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:15.643 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:15.643 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:15.643 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:15.643 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:15.643 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:15.643 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:15.643 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:15.643 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:15.643 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:15.643 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:15.643 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:15.643 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:15.643 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:15.644 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:15.644 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:15.644 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:15.644 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:15.644 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:15.644 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:15.644 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:15.644 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:15.644 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.644 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.644 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.644 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.644 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:15.645 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:15.645 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.645 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:15.645 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.645 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:15.645 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:15.645 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:15.645 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.645 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:15.645 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:15.645 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.645 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.645 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:15.645 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:15.645 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.646 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.646 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:15.646 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:15.646 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:15.646 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:15.646 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:15.646 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.646 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.646 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:15.646 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:15.646 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:15.646 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.646 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:15.646 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.647 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:15.647 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.647 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:15.647 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.647 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:15.647 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.647 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:15.647 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:15.647 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:15.647 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:15.647 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.647 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:15.647 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.647 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:15.648 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:15.648 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:15.648 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:15.648 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:15.648 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:15.648 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:15.648 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:15.648 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:15.648 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:15.648 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:15.648 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:15.648 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:15.648 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:15.648 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:15.649 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:15.649 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:15.649 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:15.649 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:15.649 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:15.649 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:15.649 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:15.649 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:15.649 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:15.649 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:15.649 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:15.649 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:15.650 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:15.650 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:15.650 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:15.650 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:15.650 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:15.650 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:15.650 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:15.650 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:15.650 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:15.650 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:15.650 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:15.650 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:15.650 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:15.650 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.651 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.651 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.651 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:15.651 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.651 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:15.651 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.651 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:15.651 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:15.651 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:15.651 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:15.651 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:15.651 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:15.652 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.652 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:15.652 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:15.652 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:15.652 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:15.652 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:15.652 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:15.652 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.652 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:15.652 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:15.652 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:15.653 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:15.653 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:15.653 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:15.653 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:15.653 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:15.653 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:15.653 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:15.653 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:15.653 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.653 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.653 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:15.653 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:15.653 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:15.653 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:15.654 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:15.654 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.654 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.654 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:15.654 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:15.654 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:15.654 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:15.654 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:15.654 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.654 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:15.654 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:15.654 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:15.654 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:15.655 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:15.655 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:15.655 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.655 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:15.655 INFO:teuthology.orchestra.run.smithi003.stdout:________________ ERROR at teardown of test_lifecycle_get_no_id _________________ 2023-12-03T13:00:15.655 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.655 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.655 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.655 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:15.655 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:15.655 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.655 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:15.655 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.656 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:15.656 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:15.656 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:15.656 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.656 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:15.656 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:15.656 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.656 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.656 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:15.656 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:15.656 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.656 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.656 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:15.656 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.657 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:15.657 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:15.657 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.657 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.657 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:15.657 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:15.657 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.657 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:15.657 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:15.657 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:15.657 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:15.657 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:15.657 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.657 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:15.657 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.658 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:15.658 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:15.658 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:15.658 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:15.658 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:15.658 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:15.658 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:15.658 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:15.658 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.658 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.658 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:15.658 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:15.658 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:15.659 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:15.659 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.659 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:15.659 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:15.659 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:15.659 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:15.659 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.659 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.659 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:15.659 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:15.659 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:15.659 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:15.659 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.659 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.660 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:15.660 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:15.660 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:15.660 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.660 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:15.660 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.660 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:15.660 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:15.660 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.660 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:15.660 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:15.660 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:15.660 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:15.661 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:15.661 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:15.661 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.661 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:15.661 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.661 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:15.661 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.661 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.661 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:15.661 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.661 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:15.661 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.661 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:15.661 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:15.662 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:15.662 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:15.662 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:15.662 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:15.662 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.662 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:15.662 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:15.662 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:15.662 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:15.662 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:15.662 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:15.662 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.662 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:15.663 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:15.663 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:15.663 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:15.663 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:15.663 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:15.663 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:15.663 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:15.663 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:15.663 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:15.663 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:15.663 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.663 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.663 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:15.663 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.664 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:15.664 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:15.664 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:15.664 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:15.664 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:15.664 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:15.664 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:15.664 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:15.664 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:15.664 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:15.664 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:15.664 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:15.664 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:15.664 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:15.665 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:15.665 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:15.665 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:15.665 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:15.665 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:15.665 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:15.665 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:15.665 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:15.665 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:15.665 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:15.665 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:15.665 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:15.666 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:15.666 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:15.666 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.666 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.666 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.666 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.666 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:15.666 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:15.666 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.666 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:15.666 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.666 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:15.667 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:15.667 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:15.667 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.667 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:15.667 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:15.667 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.667 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.667 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:15.667 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:15.667 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.667 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.667 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:15.667 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:15.667 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:15.668 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:15.668 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:15.668 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.668 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.668 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:15.668 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:15.668 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:15.668 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.668 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:15.668 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.668 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:15.668 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.668 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:15.668 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.669 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:15.669 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.669 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:15.669 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:15.669 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:15.669 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:15.669 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.669 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:15.669 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.669 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:15.669 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:15.669 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:15.670 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:15.670 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:15.670 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:15.670 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:15.670 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:15.670 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:15.670 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:15.670 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:15.670 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:15.670 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:15.670 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:15.670 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:15.670 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:15.671 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:15.671 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:15.671 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:15.671 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:15.671 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:15.671 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:15.671 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:15.671 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:15.671 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:15.671 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:15.671 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:15.671 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:15.671 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:15.671 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:15.672 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:15.672 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:15.672 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:15.672 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:15.672 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:15.672 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:15.672 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:15.672 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:15.672 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:15.672 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:15.672 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.672 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.672 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.673 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:15.673 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.673 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:15.673 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.673 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:15.673 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:15.673 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:15.673 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:15.673 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:15.673 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:15.673 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.673 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:15.673 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:15.673 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:15.674 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:15.674 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:15.674 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:15.674 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.674 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:15.674 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:15.674 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:15.674 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:15.674 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:15.674 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:15.674 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:15.674 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:15.674 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:15.674 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:15.675 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:15.675 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.675 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.675 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:15.675 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:15.675 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:15.675 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:15.675 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:15.675 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.675 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.675 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:15.675 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:15.675 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:15.675 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:15.675 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:15.676 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.676 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:15.676 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:15.676 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:15.676 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:15.676 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:15.676 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:15.676 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.676 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:15.676 INFO:teuthology.orchestra.run.smithi003.stdout:_______________ ERROR at teardown of test_lifecycle_id_too_long ________________ 2023-12-03T13:00:15.676 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.676 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.676 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.676 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:15.677 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:15.677 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.677 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:15.677 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.677 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:15.677 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:15.677 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:15.677 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.677 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:15.677 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:15.677 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.677 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.677 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:15.677 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:15.678 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.678 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.678 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:15.678 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.678 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:15.678 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:15.678 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.678 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.678 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:15.678 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:15.678 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.678 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:15.678 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:15.679 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:15.679 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:15.679 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:15.679 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.679 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:15.679 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.679 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:15.679 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:15.679 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:15.679 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:15.679 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:15.679 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:15.680 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:15.680 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:15.680 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.680 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.680 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:15.680 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:15.680 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:15.680 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:15.680 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.680 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:15.680 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:15.680 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:15.680 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:15.681 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.681 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.681 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:15.681 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:15.681 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:15.681 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:15.681 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.681 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.681 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:15.681 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:15.681 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:15.681 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.681 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:15.681 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.682 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:15.682 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:15.682 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.682 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:15.682 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:15.682 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:15.682 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:15.682 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:15.682 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:15.682 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.682 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:15.682 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.683 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:15.683 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.683 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.683 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:15.683 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.683 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:15.683 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.683 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:15.683 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:15.683 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:15.683 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:15.683 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:15.683 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:15.683 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.683 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:15.684 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:15.684 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:15.684 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:15.684 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:15.684 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:15.684 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.684 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:15.684 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:15.684 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:15.684 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:15.684 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:15.684 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:15.684 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:15.685 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:15.685 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:15.685 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:15.685 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:15.685 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.685 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.685 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:15.685 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.685 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:15.685 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:15.685 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:15.685 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:15.685 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:15.686 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:15.686 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:15.686 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:15.686 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:15.686 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:15.686 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:15.686 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:15.686 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:15.686 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:15.686 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:15.686 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:15.686 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:15.686 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:15.687 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:15.687 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:15.687 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:15.687 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:15.687 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:15.687 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:15.687 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:15.687 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:15.687 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:15.687 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:15.687 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.687 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.687 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.688 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.688 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:15.688 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:15.688 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.688 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:15.688 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.688 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:15.688 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:15.688 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:15.688 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.688 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:15.688 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:15.688 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.688 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.689 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:15.689 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:15.689 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.689 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.689 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:15.689 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:15.689 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:15.689 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:15.689 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:15.689 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.689 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.689 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:15.689 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:15.690 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:15.690 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.690 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:15.690 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.690 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:15.690 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.690 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:15.690 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.690 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:15.690 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.690 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:15.690 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:15.690 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:15.690 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:15.691 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.691 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:15.691 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.691 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:15.691 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:15.691 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:15.691 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:15.691 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:15.691 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:15.691 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:15.691 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:15.691 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:15.691 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:15.691 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:15.692 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:15.692 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:15.692 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:15.692 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:15.692 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:15.692 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:15.692 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:15.692 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:15.692 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:15.692 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:15.692 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:15.693 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:15.693 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:15.693 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:15.693 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:15.693 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:15.693 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:15.693 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:15.693 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:15.693 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:15.693 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:15.693 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:15.693 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:15.693 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:15.693 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:15.694 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:15.694 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:15.694 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:15.694 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:15.694 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.694 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.694 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.694 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:15.694 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.694 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:15.694 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.694 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:15.695 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:15.695 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:15.695 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:15.695 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:15.695 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:15.695 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.695 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:15.695 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:15.695 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:15.695 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:15.695 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:15.695 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:15.695 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.696 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:15.696 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:15.696 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:15.696 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:15.696 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:15.696 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:15.696 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:15.696 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:15.696 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:15.696 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:15.696 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:15.696 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.696 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.696 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:15.697 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:15.697 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:15.697 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:15.697 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:15.697 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.697 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.697 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:15.697 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:15.697 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:15.697 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:15.697 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:15.697 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.697 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:15.697 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:15.698 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:15.698 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:15.698 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:15.698 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:15.698 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.698 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:15.698 INFO:teuthology.orchestra.run.smithi003.stdout:_________________ ERROR at teardown of test_lifecycle_same_id __________________ 2023-12-03T13:00:15.698 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.698 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.698 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.698 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:15.698 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:15.699 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.699 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:15.699 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.699 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:15.699 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:15.699 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:15.699 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.699 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:15.699 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:15.699 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.699 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.699 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:15.699 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:15.700 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.700 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.700 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:15.700 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.700 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:15.700 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:15.700 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.700 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.700 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:15.700 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:15.700 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.700 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:15.700 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:15.700 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:15.701 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:15.701 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:15.701 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.701 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:15.701 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.701 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:15.701 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:15.701 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:15.701 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:15.701 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:15.701 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:15.701 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:15.701 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:15.701 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.702 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.702 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:15.702 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:15.702 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:15.702 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:15.702 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.702 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:15.702 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:15.702 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:15.702 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:15.702 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.702 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.703 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:15.703 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:15.703 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:15.703 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:15.703 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.703 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.703 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:15.703 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:15.703 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:15.703 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.703 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:15.703 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.703 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:15.704 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:15.704 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.704 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:15.704 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:15.704 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:15.704 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:15.704 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:15.704 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:15.704 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.704 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:15.704 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.704 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:15.704 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.704 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.704 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:15.705 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.705 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:15.705 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.705 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:15.705 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:15.705 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:15.705 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:15.705 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:15.705 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:15.705 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.705 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:15.706 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:15.706 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:15.706 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:15.706 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:15.706 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:15.706 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.706 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:15.706 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:15.706 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:15.706 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:15.706 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:15.706 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:15.706 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:15.707 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:15.707 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:15.707 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:15.707 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:15.707 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.707 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.707 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:15.707 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.707 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:15.707 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:15.707 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:15.707 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:15.707 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:15.707 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:15.708 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:15.708 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:15.708 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:15.708 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:15.708 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:15.708 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:15.708 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:15.708 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:15.708 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:15.708 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:15.708 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:15.708 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:15.709 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:15.709 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:15.709 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:15.709 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:15.709 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:15.709 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:15.709 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:15.709 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:15.709 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:15.709 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:15.709 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.709 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.709 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.709 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.710 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:15.710 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:15.710 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.710 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:15.710 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.710 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:15.710 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:15.710 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:15.710 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.710 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:15.710 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:15.710 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.710 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.710 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:15.711 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:15.711 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.711 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.711 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:15.711 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:15.711 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:15.711 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:15.711 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:15.711 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.711 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.711 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:15.711 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:15.711 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:15.711 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.712 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:15.712 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.712 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:15.712 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.712 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:15.712 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.712 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:15.712 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.712 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:15.712 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:15.712 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:15.712 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:15.712 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.713 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:15.713 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.713 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:15.713 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:15.713 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:15.713 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:15.713 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:15.713 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:15.713 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:15.713 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:15.713 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:15.713 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:15.713 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:15.714 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:15.714 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:15.714 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:15.714 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:15.714 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:15.714 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:15.714 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:15.714 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:15.714 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:15.714 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:15.714 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:15.714 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:15.714 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:15.714 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:15.715 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:15.715 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:15.715 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:15.715 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:15.715 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:15.715 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:15.715 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:15.715 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:15.715 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:15.715 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:15.715 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:15.715 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:15.715 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:15.716 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:15.716 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:15.716 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.716 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.716 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.716 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:15.716 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.716 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:15.716 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.716 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:15.716 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:15.716 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:15.716 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:15.717 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:15.717 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:15.717 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.717 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:15.717 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:15.717 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:15.717 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:15.717 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:15.717 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:15.717 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.717 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:15.717 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:15.718 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:15.718 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:15.718 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:15.718 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:15.718 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:15.718 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:15.718 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:15.718 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:15.718 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:15.718 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.718 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.718 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:15.718 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:15.719 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:15.719 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:15.719 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:15.719 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.719 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.719 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:15.719 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:15.719 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:15.719 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:15.719 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:15.719 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.719 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:15.719 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:15.720 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:15.720 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:15.720 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:15.720 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:15.720 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.720 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:15.720 INFO:teuthology.orchestra.run.smithi003.stdout:______________ ERROR at teardown of test_lifecycle_invalid_status ______________ 2023-12-03T13:00:15.720 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.720 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.720 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.720 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:15.720 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:15.720 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.720 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:15.721 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.721 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:15.721 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:15.721 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:15.721 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.721 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:15.721 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:15.721 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.721 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.721 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:15.721 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:15.721 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.721 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.721 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:15.722 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.722 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:15.722 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:15.722 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.722 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.722 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:15.722 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:15.722 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.722 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:15.722 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:15.722 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:15.722 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:15.722 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:15.723 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.723 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:15.723 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.723 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:15.723 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:15.723 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:15.723 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:15.723 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:15.723 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:15.723 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:15.723 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:15.723 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.723 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.724 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:15.724 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:15.724 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:15.724 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:15.724 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.724 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:15.724 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:15.724 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:15.724 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:15.724 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.724 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.724 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:15.724 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:15.724 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:15.724 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:15.725 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.725 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.725 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:15.725 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:15.725 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:15.725 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.725 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:15.725 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.725 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:15.725 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:15.725 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.725 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:15.725 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:15.726 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:15.726 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:15.726 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:15.726 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:15.726 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.726 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:15.726 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.726 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:15.726 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.726 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.726 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:15.726 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.726 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:15.727 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.727 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:15.727 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:15.727 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:15.727 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:15.727 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:15.727 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:15.727 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.727 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:15.727 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:15.727 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:15.727 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:15.727 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:15.727 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:15.728 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.728 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:15.728 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:15.728 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:15.728 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:15.728 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:15.728 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:15.728 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:15.728 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:15.728 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:15.728 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:15.728 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:15.728 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.728 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.729 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:15.729 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.729 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:15.729 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:15.729 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:15.729 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:15.729 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:15.729 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:15.729 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:15.729 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:15.729 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:15.729 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:15.729 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:15.730 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:15.730 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:15.730 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:15.730 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:15.730 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:15.730 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:15.730 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:15.730 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:15.730 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:15.730 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:15.730 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:15.730 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:15.730 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:15.731 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:15.731 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:15.731 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:15.731 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:15.731 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.731 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.731 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.731 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.731 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:15.731 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:15.731 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.731 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:15.732 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.732 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:15.732 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:15.732 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:15.732 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.732 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:15.732 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:15.732 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.732 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.732 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:15.732 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:15.732 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.732 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.732 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:15.733 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:15.733 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:15.733 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:15.733 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:15.733 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.733 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.733 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:15.733 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:15.733 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:15.733 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.733 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:15.733 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.733 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:15.733 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.733 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:15.734 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.734 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:15.734 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.734 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:15.734 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:15.734 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:15.734 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:15.734 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.734 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:15.734 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.734 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:15.734 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:15.734 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:15.735 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:15.735 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:15.735 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:15.735 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:15.735 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:15.735 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:15.735 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:15.735 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:15.735 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:15.735 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:15.735 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:15.735 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:15.735 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:15.736 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:15.736 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:15.736 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:15.736 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:15.736 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:15.736 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:15.736 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:15.736 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:15.736 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:15.736 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:15.736 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:15.736 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:15.736 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:15.736 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:15.737 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:15.737 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:15.737 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:15.737 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:15.737 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:15.737 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:15.737 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:15.737 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:15.737 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:15.737 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:15.737 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.737 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.737 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.737 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:15.738 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.738 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:15.738 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.738 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:15.738 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:15.738 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:15.738 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:15.738 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:15.738 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:15.738 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.738 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:15.738 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:15.738 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:15.739 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:15.739 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:15.739 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:15.739 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.739 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:15.739 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:15.739 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:15.739 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:15.739 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:15.739 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:15.739 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:15.739 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:15.739 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:15.740 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:15.740 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:15.740 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.740 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.740 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:15.740 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:15.740 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:15.740 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:15.740 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:15.740 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.740 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.740 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:15.740 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:15.740 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:15.741 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:15.741 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:15.741 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.741 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:15.741 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:15.741 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:15.741 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:15.741 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:15.741 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:15.741 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.741 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:15.741 INFO:teuthology.orchestra.run.smithi003.stdout:_________________ ERROR at teardown of test_lifecycle_set_date _________________ 2023-12-03T13:00:15.741 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.741 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.742 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.742 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:15.742 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:15.742 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.742 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:15.742 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.742 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:15.742 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:15.742 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:15.742 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.742 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:15.742 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:15.742 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.743 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.743 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:15.743 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:15.743 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.743 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.743 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:15.743 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.743 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:15.743 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:15.743 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.743 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.743 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:15.744 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:15.744 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.744 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:15.744 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:15.744 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:15.744 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:15.744 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:15.744 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.744 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:15.745 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.745 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:15.745 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:15.745 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:15.745 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:15.745 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:15.745 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:15.745 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:15.745 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:15.745 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.745 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.745 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:15.745 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:15.746 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:15.746 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:15.746 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.746 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:15.746 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:15.746 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:15.746 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:15.746 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.746 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.746 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:15.746 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:15.746 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:15.747 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:15.747 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.747 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.747 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:15.747 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:15.747 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:15.747 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.747 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:15.747 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.747 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:15.747 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:15.747 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.747 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:15.747 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:15.748 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:15.748 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:15.748 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:15.748 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:15.748 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.748 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:15.748 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.748 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:15.748 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.748 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.748 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:15.748 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.748 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:15.749 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.749 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:15.749 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:15.749 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:15.749 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:15.749 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:15.749 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:15.749 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.749 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:15.749 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:15.749 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:15.749 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:15.749 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:15.749 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:15.750 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.750 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:15.750 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:15.750 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:15.750 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:15.750 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:15.750 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:15.750 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:15.750 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:15.750 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:15.750 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:15.750 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:15.750 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.751 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.751 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:15.751 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.751 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:15.751 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:15.751 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:15.751 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:15.751 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:15.751 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:15.751 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:15.751 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:15.751 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:15.751 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:15.751 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:15.752 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:15.752 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:15.752 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:15.752 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:15.752 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:15.752 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:15.752 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:15.752 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:15.752 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:15.752 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:15.752 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:15.752 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:15.752 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:15.752 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:15.753 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:15.753 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:15.753 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:15.753 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.753 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.753 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.753 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.753 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:15.753 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:15.753 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.753 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:15.753 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.753 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:15.753 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:15.754 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:15.754 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.754 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:15.754 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:15.754 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.754 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.754 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:15.754 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:15.754 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.754 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.754 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:15.754 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:15.754 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:15.754 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:15.755 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:15.755 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.755 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.755 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:15.755 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:15.755 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:15.755 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.755 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:15.755 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.755 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:15.755 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.755 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:15.755 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.755 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:15.755 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.756 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:15.756 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:15.756 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:15.756 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:15.756 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.756 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:15.756 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.756 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:15.756 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:15.756 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:15.756 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:15.756 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:15.756 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:15.756 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:15.757 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:15.757 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:15.757 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:15.757 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:15.757 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:15.757 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:15.757 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:15.757 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:15.757 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:15.757 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:15.757 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:15.757 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:15.757 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:15.757 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:15.758 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:15.758 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:15.758 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:15.758 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:15.758 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:15.758 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:15.758 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:15.758 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:15.758 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:15.758 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:15.758 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:15.758 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:15.758 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:15.759 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:15.759 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:15.759 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:15.759 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:15.759 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:15.759 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:15.759 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.759 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.759 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.759 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:15.759 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.759 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:15.759 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.759 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:15.759 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:15.760 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:15.760 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:15.760 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:15.760 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:15.760 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.760 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:15.760 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:15.760 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:15.760 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:15.760 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:15.760 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:15.760 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.760 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:15.761 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:15.761 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:15.761 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:15.761 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:15.761 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:15.761 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:15.761 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:15.761 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:15.761 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:15.761 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:15.761 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.761 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.761 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:15.761 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:15.762 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:15.762 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:15.762 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:15.762 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.762 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.762 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:15.762 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:15.762 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:15.762 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:15.762 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:15.762 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.762 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:15.762 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:15.763 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:15.763 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:15.763 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:15.763 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:15.763 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.763 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:15.763 INFO:teuthology.orchestra.run.smithi003.stdout:_____________ ERROR at teardown of test_lifecycle_set_invalid_date _____________ 2023-12-03T13:00:15.763 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.763 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.763 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.763 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:15.763 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:15.763 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.764 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:15.764 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.764 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:15.764 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:15.764 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:15.764 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.764 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:15.764 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:15.764 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.764 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.764 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:15.764 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:15.764 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.764 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.764 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:15.765 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.765 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:15.765 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:15.765 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.765 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.765 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:15.765 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:15.765 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.765 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:15.765 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:15.765 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:15.765 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:15.765 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:15.765 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.765 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:15.766 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.766 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:15.766 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:15.766 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:15.766 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:15.766 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:15.766 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:15.766 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:15.766 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:15.766 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.766 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.766 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:15.766 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:15.767 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:15.767 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:15.767 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.767 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:15.767 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:15.767 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:15.767 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:15.767 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.767 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.767 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:15.767 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:15.767 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:15.767 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:15.767 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.768 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.768 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:15.768 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:15.768 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:15.768 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.768 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:15.768 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.768 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:15.768 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:15.768 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.768 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:15.768 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:15.768 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:15.768 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:15.769 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:15.769 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:15.769 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.769 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:15.769 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.769 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:15.769 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.769 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.769 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:15.769 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.769 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:15.769 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.769 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:15.769 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:15.769 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:15.770 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:15.770 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:15.770 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:15.770 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.770 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:15.770 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:15.770 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:15.770 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:15.770 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:15.770 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:15.770 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.770 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:15.771 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:15.771 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:15.771 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:15.771 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:15.771 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:15.771 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:15.771 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:15.771 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:15.771 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:15.771 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:15.771 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.771 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.771 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:15.771 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.772 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:15.772 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:15.772 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:15.772 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:15.772 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:15.772 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:15.772 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:15.772 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:15.772 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:15.772 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:15.772 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:15.772 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:15.772 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:15.772 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:15.773 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:15.773 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:15.773 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:15.773 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:15.773 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:15.773 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:15.773 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:15.773 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:15.773 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:15.773 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:15.773 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:15.773 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:15.773 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:15.773 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:15.773 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.774 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.774 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.774 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.774 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:15.774 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:15.774 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.774 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:15.774 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.774 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:15.774 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:15.774 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:15.774 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.774 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:15.774 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:15.775 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.775 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.775 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:15.775 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:15.775 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.775 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.775 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:15.775 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:15.775 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:15.775 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:15.775 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:15.775 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.775 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.775 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:15.776 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:15.776 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:15.776 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.776 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:15.776 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.776 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:15.776 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.776 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:15.776 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.776 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:15.776 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.776 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:15.776 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:15.776 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:15.777 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:15.777 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.777 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:15.777 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.777 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:15.777 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:15.777 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:15.777 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:15.777 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:15.777 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:15.777 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:15.777 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:15.777 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:15.777 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:15.777 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:15.778 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:15.778 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:15.778 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:15.778 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:15.778 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:15.778 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:15.778 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:15.778 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:15.778 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:15.778 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:15.778 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:15.778 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:15.778 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:15.778 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:15.778 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:15.779 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:15.779 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:15.779 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:15.779 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:15.779 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:15.779 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:15.779 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:15.779 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:15.779 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:15.779 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:15.779 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:15.779 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:15.779 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:15.779 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:15.779 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.780 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.780 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.780 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:15.780 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.780 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:15.780 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.780 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:15.780 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:15.780 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:15.780 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:15.780 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:15.780 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:15.780 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.780 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:15.781 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:15.781 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:15.781 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:15.781 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:15.781 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:15.781 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.781 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:15.781 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:15.781 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:15.781 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:15.781 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:15.781 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:15.781 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:15.781 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:15.782 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:15.782 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:15.782 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:15.782 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.782 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.782 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:15.782 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:15.782 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:15.782 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:15.782 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:15.782 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.782 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.782 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:15.782 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:15.783 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:15.783 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:15.783 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:15.783 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.783 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:15.783 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:15.783 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:15.783 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:15.783 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:15.783 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:15.783 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.783 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:15.783 INFO:teuthology.orchestra.run.smithi003.stdout:______________ ERROR at teardown of test_lifecycle_set_noncurrent ______________ 2023-12-03T13:00:15.783 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.783 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.784 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.784 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:15.784 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:15.784 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.784 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:15.784 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.784 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:15.784 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:15.784 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:15.784 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.784 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:15.784 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:15.784 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.784 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.785 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:15.785 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:15.785 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.785 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.785 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:15.785 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.785 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:15.785 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:15.785 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.785 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.785 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:15.785 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:15.785 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.785 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:15.785 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:15.786 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:15.786 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:15.786 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:15.786 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.786 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:15.786 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.786 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:15.786 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:15.786 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:15.786 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:15.786 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:15.786 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:15.786 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:15.786 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:15.787 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.787 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.787 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:15.787 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:15.787 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:15.787 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:15.787 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.787 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:15.787 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:15.787 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:15.787 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:15.787 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.787 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.787 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:15.788 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:15.788 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:15.788 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:15.788 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.788 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.788 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:15.788 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:15.788 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:15.788 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.788 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:15.788 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.788 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:15.788 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:15.788 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.789 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:15.789 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:15.789 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:15.789 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:15.789 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:15.789 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:15.789 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.789 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:15.789 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.789 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:15.789 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.789 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.789 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:15.789 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.790 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:15.790 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.790 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:15.790 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:15.790 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:15.790 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:15.790 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:15.790 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:15.790 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.790 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:15.790 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:15.790 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:15.790 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:15.791 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:15.791 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:15.791 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.791 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:15.791 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:15.791 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:15.791 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:15.791 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:15.791 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:15.791 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:15.791 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:15.791 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:15.791 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:15.791 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:15.792 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.792 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.792 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:15.792 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.792 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:15.792 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:15.792 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:15.792 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:15.792 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:15.792 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:15.792 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:15.792 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:15.792 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:15.792 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:15.793 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:15.793 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:15.793 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:15.793 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:15.793 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:15.793 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:15.793 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:15.793 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:15.793 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:15.793 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:15.793 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:15.793 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:15.793 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:15.793 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:15.794 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:15.794 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:15.794 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:15.794 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:15.794 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.794 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.794 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.794 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.794 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:15.794 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:15.794 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.794 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:15.795 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.795 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:15.795 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:15.795 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:15.795 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.795 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:15.795 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:15.795 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.795 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.795 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:15.795 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:15.795 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.795 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.795 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:15.795 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:15.796 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:15.796 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:15.796 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:15.796 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.796 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.796 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:15.796 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:15.796 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:15.796 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.796 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:15.796 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.796 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:15.796 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.797 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:15.797 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.797 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:15.797 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.797 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:15.797 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:15.797 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:15.797 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:15.797 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.797 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:15.797 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.797 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:15.797 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:15.797 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:15.798 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:15.798 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:15.798 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:15.798 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:15.798 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:15.798 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:15.798 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:15.798 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:15.798 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:15.798 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:15.798 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:15.798 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:15.798 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:15.798 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:15.799 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:15.799 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:15.799 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:15.799 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:15.799 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:15.799 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:15.799 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:15.799 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:15.799 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:15.799 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:15.799 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:15.799 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:15.799 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:15.799 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:15.800 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:15.800 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:15.800 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:15.800 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:15.800 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:15.800 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:15.800 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:15.800 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:15.800 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:15.800 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.800 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.800 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.800 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:15.800 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.801 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:15.801 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.801 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:15.801 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:15.801 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:15.801 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:15.801 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:15.801 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:15.801 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.801 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:15.801 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:15.801 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:15.801 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:15.801 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:15.802 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:15.802 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.802 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:15.802 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:15.802 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:15.802 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:15.802 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:15.802 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:15.802 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:15.802 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:15.802 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:15.802 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:15.802 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:15.803 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.803 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.803 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:15.803 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:15.803 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:15.803 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:15.803 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:15.803 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.803 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.803 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:15.803 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:15.803 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:15.803 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:15.803 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:15.804 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.804 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:15.804 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:15.804 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:15.804 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:15.804 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:15.804 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:15.804 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.804 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:15.804 INFO:teuthology.orchestra.run.smithi003.stdout:_____________ ERROR at teardown of test_lifecycle_set_deletemarker _____________ 2023-12-03T13:00:15.804 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.804 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.804 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.804 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:15.804 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:15.805 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.805 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:15.805 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.805 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:15.805 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:15.805 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:15.805 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.805 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:15.805 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:15.805 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.805 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.805 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:15.805 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:15.806 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.806 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.806 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:15.806 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.806 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:15.806 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:15.806 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.806 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.806 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:15.806 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:15.806 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.806 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:15.806 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:15.806 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:15.807 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:15.807 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:15.807 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.807 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:15.807 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.807 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:15.807 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:15.807 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:15.807 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:15.807 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:15.807 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:15.807 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:15.808 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:15.808 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.808 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.808 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:15.808 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:15.808 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:15.808 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:15.808 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.808 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:15.808 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:15.808 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:15.808 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:15.808 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.808 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.809 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:15.809 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:15.809 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:15.809 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:15.809 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.809 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.809 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:15.809 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:15.809 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:15.809 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.809 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:15.809 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.809 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:15.809 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:15.809 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.810 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:15.810 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:15.810 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:15.810 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:15.810 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:15.810 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:15.810 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.810 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:15.810 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.810 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:15.810 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.810 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.810 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:15.811 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.811 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:15.811 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.811 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:15.811 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:15.811 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:15.811 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:15.811 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:15.811 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:15.811 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.811 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:15.811 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:15.811 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:15.811 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:15.812 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:15.812 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:15.812 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.812 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:15.812 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:15.812 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:15.812 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:15.812 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:15.812 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:15.812 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:15.812 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:15.812 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:15.812 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:15.812 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:15.813 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.813 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.813 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:15.813 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.813 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:15.813 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:15.813 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:15.813 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:15.813 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:15.813 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:15.813 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:15.813 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:15.813 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:15.813 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:15.814 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:15.814 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:15.814 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:15.814 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:15.814 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:15.814 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:15.814 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:15.814 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:15.814 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:15.814 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:15.814 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:15.814 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:15.814 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:15.814 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:15.815 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:15.815 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:15.815 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:15.815 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:15.815 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.815 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.815 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.815 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.815 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:15.815 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:15.815 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.815 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:15.815 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.815 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:15.816 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:15.816 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:15.816 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.816 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:15.816 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:15.816 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.816 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.816 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:15.816 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:15.816 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.816 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.816 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:15.816 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:15.816 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:15.816 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:15.817 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:15.817 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.817 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.817 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:15.817 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:15.817 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:15.817 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.817 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:15.817 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.817 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:15.817 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.817 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:15.817 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.817 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:15.817 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.818 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:15.818 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:15.818 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:15.818 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:15.818 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.818 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:15.818 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.818 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:15.818 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:15.818 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:15.818 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:15.818 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:15.818 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:15.818 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:15.819 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:15.819 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:15.819 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:15.819 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:15.819 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:15.819 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:15.819 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:15.819 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:15.819 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:15.819 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:15.819 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:15.819 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:15.819 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:15.820 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:15.820 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:15.820 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:15.820 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:15.820 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:15.820 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:15.820 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:15.820 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:15.820 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:15.820 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:15.820 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:15.820 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:15.820 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:15.820 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:15.821 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:15.821 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:15.821 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:15.821 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:15.821 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:15.821 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:15.821 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.821 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.821 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.821 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:15.821 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.821 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:15.821 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.822 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:15.822 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:15.822 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:15.822 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:15.822 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:15.822 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:15.822 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.822 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:15.822 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:15.822 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:15.822 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:15.822 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:15.822 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:15.822 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.822 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:15.823 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:15.823 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:15.823 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:15.823 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:15.823 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:15.823 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:15.823 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:15.823 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:15.823 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:15.823 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:15.823 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.823 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.823 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:15.823 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:15.824 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:15.824 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:15.824 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:15.824 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.824 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.824 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:15.824 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:15.824 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:15.824 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:15.824 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:15.824 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.824 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:15.824 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:15.824 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:15.824 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:15.824 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:15.824 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:15.825 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.825 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:15.825 INFO:teuthology.orchestra.run.smithi003.stdout:________________ ERROR at teardown of test_lifecycle_set_filter ________________ 2023-12-03T13:00:15.825 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.825 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.825 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.825 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:15.825 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:15.825 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.825 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:15.825 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.825 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:15.825 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:15.825 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:15.826 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.826 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:15.826 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:15.826 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.826 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.826 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:15.826 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:15.826 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.826 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.826 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:15.826 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.826 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:15.826 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:15.826 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.826 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.827 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:15.827 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:15.827 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.827 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:15.827 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:15.827 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:15.827 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:15.827 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:15.827 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.827 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:15.827 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.827 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:15.827 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:15.827 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:15.827 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:15.828 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:15.828 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:15.828 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:15.828 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:15.828 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.828 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.828 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:15.828 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:15.828 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:15.828 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:15.828 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.828 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:15.828 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:15.828 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:15.829 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:15.829 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.829 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.829 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:15.829 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:15.829 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:15.829 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:15.829 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.829 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.829 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:15.829 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:15.829 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:15.829 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.829 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:15.829 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.830 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:15.830 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:15.830 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.830 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:15.830 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:15.830 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:15.830 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:15.830 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:15.830 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:15.830 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.830 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:15.830 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.830 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:15.830 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.830 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.831 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:15.831 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.831 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:15.831 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.831 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:15.831 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:15.831 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:15.831 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:15.831 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:15.831 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:15.831 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.831 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:15.831 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:15.832 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:15.832 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:15.832 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:15.832 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:15.832 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.832 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:15.832 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:15.832 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:15.832 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:15.832 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:15.832 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:15.832 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:15.832 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:15.832 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:15.833 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:15.833 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:15.833 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.833 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.833 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:15.833 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.833 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:15.833 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:15.833 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:15.833 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:15.833 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:15.833 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:15.833 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:15.833 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:15.833 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:15.834 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:15.834 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:15.834 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:15.834 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:15.834 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:15.834 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:15.834 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:15.834 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:15.834 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:15.834 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:15.834 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:15.834 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:15.834 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:15.835 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:15.835 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:15.835 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:15.835 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:15.835 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:15.835 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:15.835 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.835 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.835 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.835 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.835 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:15.835 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:15.835 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.835 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:15.836 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.836 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:15.836 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:15.836 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:15.836 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.836 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:15.836 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:15.836 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.836 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.836 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:15.836 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:15.836 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.836 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.836 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:15.836 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:15.837 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:15.837 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:15.837 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:15.837 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.837 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.837 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:15.837 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:15.837 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:15.837 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.837 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:15.837 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.837 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:15.837 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.837 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:15.837 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.838 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:15.838 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.838 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:15.838 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:15.838 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:15.838 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:15.838 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.838 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:15.838 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.838 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:15.838 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:15.838 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:15.838 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:15.839 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:15.839 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:15.839 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:15.839 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:15.839 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:15.839 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:15.839 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:15.839 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:15.839 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:15.839 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:15.839 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:15.839 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:15.839 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:15.839 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:15.839 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:15.840 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:15.840 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:15.840 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:15.840 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:15.840 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:15.840 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:15.840 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:15.840 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:15.840 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:15.840 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:15.840 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:15.840 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:15.840 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:15.840 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:15.840 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:15.840 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:15.841 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:15.841 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:15.841 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:15.841 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:15.841 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:15.841 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.841 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.841 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.841 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:15.841 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.841 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:15.841 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.841 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:15.841 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:15.842 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:15.842 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:15.842 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:15.842 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:15.842 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.842 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:15.842 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:15.842 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:15.842 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:15.842 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:15.842 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:15.842 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.842 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:15.842 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:15.843 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:15.843 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:15.843 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:15.843 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:15.843 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:15.843 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:15.843 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:15.843 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:15.843 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:15.843 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.843 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.843 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:15.844 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:15.844 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:15.844 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:15.844 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:15.844 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.844 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.844 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:15.844 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:15.844 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:15.844 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:15.844 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:15.844 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.844 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:15.844 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:15.845 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:15.845 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:15.845 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:15.845 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:15.845 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.845 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:15.845 INFO:teuthology.orchestra.run.smithi003.stdout:_____________ ERROR at teardown of test_lifecycle_set_empty_filter _____________ 2023-12-03T13:00:15.845 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.845 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.845 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.845 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:15.845 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:15.845 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.845 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:15.845 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.846 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:15.846 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:15.846 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:15.846 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.846 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:15.846 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:15.846 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.846 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.846 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:15.846 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:15.846 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.846 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.846 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:15.846 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.846 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:15.847 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:15.847 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.847 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.847 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:15.847 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:15.847 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.847 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:15.847 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:15.847 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:15.847 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:15.847 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:15.847 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.847 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:15.847 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.847 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:15.848 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:15.848 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:15.848 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:15.848 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:15.848 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:15.848 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:15.848 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:15.848 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.848 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.848 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:15.848 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:15.848 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:15.848 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:15.848 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.849 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:15.849 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:15.849 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:15.849 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:15.849 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.849 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.849 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:15.849 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:15.849 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:15.849 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:15.849 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.849 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.849 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:15.849 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:15.849 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:15.850 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.850 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:15.850 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.850 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:15.850 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:15.850 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.850 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:15.850 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:15.850 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:15.850 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:15.850 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:15.850 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:15.850 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.850 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:15.851 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.851 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:15.851 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.851 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.851 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:15.851 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.851 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:15.851 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.851 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:15.851 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:15.851 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:15.851 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:15.851 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:15.851 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:15.852 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.852 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:15.852 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:15.852 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:15.852 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:15.852 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:15.852 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:15.852 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.852 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:15.852 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:15.852 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:15.852 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:15.852 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:15.852 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:15.853 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:15.853 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:15.853 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:15.853 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:15.853 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:15.853 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.853 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.853 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:15.853 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.853 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:15.853 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:15.853 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:15.853 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:15.853 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:15.853 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:15.854 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:15.854 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:15.854 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:15.854 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:15.854 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:15.854 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:15.854 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:15.854 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:15.854 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:15.854 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:15.854 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:15.854 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:15.854 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:15.855 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:15.855 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:15.855 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:15.855 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:15.855 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:15.855 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:15.855 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:15.855 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:15.855 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:15.855 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.855 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.855 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.855 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.856 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:15.856 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:15.856 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.856 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:15.856 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.856 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:15.856 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:15.856 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:15.856 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.856 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:15.856 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:15.856 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.856 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.856 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:15.856 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:15.857 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.857 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.857 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:15.857 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:15.857 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:15.857 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:15.857 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:15.857 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.857 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.857 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:15.857 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:15.857 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:15.857 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.857 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:15.857 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.858 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:15.858 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.858 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:15.858 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.858 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:15.858 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.858 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:15.858 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:15.858 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:15.858 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:15.858 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.858 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:15.858 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.858 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:15.859 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:15.859 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:15.859 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:15.859 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:15.859 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:15.859 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:15.859 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:15.859 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:15.859 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:15.859 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:15.859 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:15.859 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:15.859 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:15.859 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:15.859 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:15.860 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:15.860 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:15.860 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:15.860 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:15.860 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:15.860 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:15.860 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:15.860 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:15.860 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:15.860 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:15.860 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:15.860 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:15.860 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:15.860 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:15.860 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:15.860 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:15.861 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:15.861 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:15.861 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:15.861 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:15.861 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:15.861 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:15.861 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:15.861 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:15.861 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.861 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.861 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.861 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:15.861 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.861 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:15.862 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.862 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:15.862 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:15.862 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:15.862 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:15.862 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:15.862 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:15.862 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.862 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:15.862 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:15.862 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:15.862 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:15.862 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:15.862 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:15.863 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.863 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:15.863 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:15.863 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:15.863 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:15.863 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:15.863 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:15.863 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:15.863 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:15.863 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:15.863 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:15.863 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:15.863 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.863 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.863 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:15.864 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:15.864 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:15.864 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:15.864 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:15.864 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.864 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.864 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:15.864 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:15.864 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:15.864 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:15.864 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:15.864 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.864 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:15.864 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:15.864 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:15.865 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:15.865 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:15.865 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:15.865 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.865 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:15.865 INFO:teuthology.orchestra.run.smithi003.stdout:______________ ERROR at teardown of test_lifecycle_set_multipart _______________ 2023-12-03T13:00:15.865 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.865 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.865 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.865 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:15.865 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:15.865 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.865 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:15.865 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.865 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:15.865 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:15.866 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:15.866 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.866 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:15.866 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:15.866 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.866 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.866 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:15.866 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:15.866 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.866 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.866 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:15.866 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.866 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:15.866 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:15.867 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.867 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.867 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:15.867 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:15.867 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.867 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:15.867 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:15.867 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:15.867 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:15.867 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:15.867 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.867 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:15.867 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.867 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:15.868 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:15.868 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:15.868 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:15.868 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:15.868 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:15.868 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:15.868 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:15.868 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.868 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.868 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:15.868 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:15.868 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:15.868 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:15.868 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.868 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:15.869 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:15.869 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:15.869 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:15.869 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.869 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.869 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:15.869 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:15.869 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:15.869 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:15.869 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.869 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.869 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:15.869 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:15.869 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:15.869 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.869 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:15.870 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.870 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:15.870 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:15.870 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.870 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:15.870 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:15.870 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:15.870 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:15.870 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:15.870 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:15.870 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.870 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:15.870 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.870 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:15.870 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.871 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.871 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:15.871 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.871 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:15.871 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.871 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:15.871 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:15.871 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:15.871 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:15.871 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:15.871 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:15.871 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.871 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:15.871 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:15.872 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:15.872 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:15.872 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:15.872 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:15.872 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.872 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:15.872 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:15.872 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:15.872 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:15.872 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:15.872 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:15.872 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:15.872 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:15.872 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:15.872 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:15.873 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:15.873 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.873 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.873 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:15.873 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.873 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:15.873 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:15.873 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:15.873 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:15.873 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:15.873 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:15.873 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:15.873 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:15.873 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:15.873 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:15.874 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:15.874 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:15.874 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:15.874 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:15.874 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:15.874 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:15.874 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:15.874 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:15.874 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:15.874 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:15.874 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:15.874 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:15.874 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:15.874 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:15.874 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:15.875 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:15.875 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:15.875 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:15.875 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.875 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.875 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.875 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.875 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:15.875 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:15.875 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.875 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:15.875 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.875 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:15.875 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:15.876 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:15.876 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.876 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:15.876 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:15.876 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.876 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.876 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:15.876 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:15.876 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.876 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.876 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:15.876 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:15.876 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:15.876 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:15.876 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:15.876 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.877 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.877 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:15.877 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:15.877 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:15.877 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.877 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:15.877 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.877 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:15.877 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.877 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:15.877 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.877 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:15.877 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.877 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:15.877 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:15.877 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:15.878 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:15.878 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.878 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:15.878 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.878 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:15.878 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:15.878 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:15.878 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:15.878 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:15.878 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:15.878 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:15.878 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:15.878 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:15.878 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:15.879 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:15.879 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:15.879 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:15.879 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:15.879 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:15.879 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:15.879 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:15.879 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:15.879 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:15.879 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:15.879 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:15.879 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:15.879 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:15.880 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:15.880 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:15.880 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:15.880 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:15.880 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:15.880 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:15.880 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:15.880 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:15.880 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:15.880 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:15.880 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:15.880 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:15.880 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:15.880 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:15.881 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:15.881 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:15.881 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:15.881 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.881 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.881 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.881 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:15.881 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.881 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:15.881 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.881 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:15.881 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:15.881 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:15.881 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:15.882 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:15.882 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:15.882 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.882 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:15.882 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:15.882 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:15.882 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:15.882 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:15.882 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:15.882 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.882 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:15.882 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:15.882 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:15.882 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:15.883 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:15.883 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:15.883 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:15.883 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:15.883 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:15.883 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:15.883 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:15.883 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.883 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.883 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:15.883 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:15.883 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:15.883 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:15.883 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:15.883 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.884 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.884 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:15.884 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:15.884 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:15.884 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:15.884 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:15.884 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.884 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:15.884 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:15.884 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:15.884 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:15.884 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:15.884 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:15.884 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.885 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:15.885 INFO:teuthology.orchestra.run.smithi003.stdout:_______ ERROR at teardown of test_lifecycle_transition_set_invalid_date ________ 2023-12-03T13:00:15.885 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.885 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.885 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.885 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:15.885 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:15.885 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.885 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:15.885 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.885 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:15.885 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:15.885 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:15.886 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.886 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:15.886 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:15.886 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.886 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.886 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:15.886 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:15.886 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.886 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.886 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:15.886 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.886 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:15.886 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:15.886 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.886 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.886 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:15.887 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:15.887 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.887 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:15.887 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:15.887 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:15.887 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:15.887 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:15.887 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.887 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:15.887 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.887 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:15.887 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:15.887 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:15.887 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:15.888 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:15.888 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:15.888 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:15.888 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:15.888 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.888 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.888 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:15.888 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:15.888 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:15.888 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:15.888 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.888 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:15.888 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:15.888 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:15.888 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:15.888 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.889 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.889 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:15.889 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:15.889 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:15.889 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:15.889 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.889 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.889 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:15.889 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:15.889 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:15.889 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.889 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:15.889 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.889 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:15.890 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:15.890 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.890 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:15.890 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:15.890 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:15.890 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:15.890 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:15.890 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:15.890 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.890 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:15.890 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.890 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:15.890 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.890 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.890 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:15.891 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.891 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:15.891 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.891 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:15.891 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:15.891 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:15.891 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:15.891 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:15.891 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:15.891 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.891 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:15.891 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:15.891 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:15.892 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:15.892 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:15.892 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:15.892 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.892 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:15.892 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:15.892 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:15.892 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:15.892 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:15.892 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:15.892 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:15.892 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:15.892 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:15.893 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:15.893 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:15.893 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.893 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.893 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:15.893 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.893 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:15.893 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:15.893 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:15.893 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:15.893 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:15.893 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:15.893 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:15.893 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:15.894 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:15.894 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:15.894 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:15.894 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:15.894 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:15.894 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:15.894 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:15.894 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:15.894 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:15.894 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:15.894 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:15.894 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:15.894 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:15.894 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:15.895 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:15.895 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:15.895 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:15.895 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:15.895 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:15.895 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:15.895 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.895 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.895 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.895 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.895 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:15.895 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:15.895 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.895 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:15.896 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.896 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:15.896 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:15.896 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:15.896 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.896 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:15.896 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:15.896 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.896 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.896 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:15.896 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:15.896 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.896 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.896 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:15.897 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:15.897 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:15.897 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:15.897 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:15.897 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.897 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.897 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:15.897 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:15.897 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:15.897 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.897 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:15.897 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.897 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:15.897 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.897 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:15.898 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.898 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:15.898 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.898 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:15.898 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:15.898 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:15.898 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:15.898 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.898 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:15.898 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.898 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:15.898 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:15.898 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:15.898 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:15.899 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:15.899 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:15.899 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:15.899 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:15.899 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:15.899 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:15.899 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:15.899 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:15.899 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:15.899 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:15.899 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:15.899 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:15.899 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:15.899 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:15.899 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:15.900 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:15.900 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:15.900 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:15.900 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:15.900 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:15.900 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:15.900 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:15.900 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:15.900 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:15.900 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:15.900 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:15.900 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:15.900 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:15.900 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:15.901 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:15.901 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:15.901 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:15.901 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:15.901 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:15.901 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:15.901 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:15.901 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.901 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.901 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.901 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:15.901 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.901 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:15.901 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.902 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:15.902 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:15.902 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:15.902 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:15.902 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:15.902 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:15.902 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.902 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:15.902 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:15.902 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:15.902 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:15.902 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:15.902 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:15.902 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.902 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:15.903 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:15.903 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:15.903 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:15.903 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:15.903 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:15.903 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:15.903 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:15.903 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:15.903 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:15.903 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:15.903 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.903 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.903 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:15.904 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:15.904 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:15.904 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:15.904 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:15.904 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.904 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.904 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:15.904 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:15.904 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:15.904 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:15.904 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:15.904 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.904 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:15.904 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:15.905 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:15.905 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:15.905 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:15.905 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:15.905 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.905 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:15.905 INFO:teuthology.orchestra.run.smithi003.stdout:_______________ ERROR at teardown of test_encrypted_transfer_1b ________________ 2023-12-03T13:00:15.905 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.905 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.905 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.905 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:15.905 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:15.905 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.905 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:15.905 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.906 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:15.906 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:15.906 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:15.906 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.906 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:15.906 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:15.906 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.906 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.906 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:15.906 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:15.906 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.906 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.906 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:15.907 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.907 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:15.907 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:15.907 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.907 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.907 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:15.907 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:15.907 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.907 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:15.907 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:15.907 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:15.907 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:15.907 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:15.907 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.907 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:15.907 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.908 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:15.908 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:15.908 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:15.908 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:15.908 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:15.908 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:15.908 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:15.908 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:15.908 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.908 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.908 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:15.908 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:15.908 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:15.908 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:15.908 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.909 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:15.909 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:15.909 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:15.909 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:15.909 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.909 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.909 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:15.909 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:15.909 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:15.909 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:15.909 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.909 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.909 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:15.909 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:15.909 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:15.910 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.910 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:15.910 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.910 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:15.910 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:15.910 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.910 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:15.910 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:15.910 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:15.910 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:15.910 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:15.910 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:15.910 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.910 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:15.911 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.911 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:15.911 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.911 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.911 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:15.911 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.911 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:15.911 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.911 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:15.911 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:15.911 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:15.911 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:15.911 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:15.911 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:15.911 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.912 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:15.912 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:15.912 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:15.912 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:15.912 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:15.912 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:15.912 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.912 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:15.912 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:15.912 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:15.912 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:15.912 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:15.912 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:15.912 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:15.912 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:15.913 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:15.913 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:15.913 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:15.913 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.913 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.913 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:15.913 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.913 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:15.913 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:15.913 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:15.913 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:15.913 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:15.913 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:15.913 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:15.914 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:15.914 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:15.914 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:15.914 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:15.914 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:15.914 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:15.914 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:15.914 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:15.914 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:15.914 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:15.914 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:15.914 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:15.914 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:15.914 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:15.915 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:15.915 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:15.915 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:15.915 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:15.915 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:15.915 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:15.915 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:15.915 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.915 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.915 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.915 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.915 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:15.915 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:15.915 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.916 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:15.916 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.916 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:15.916 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:15.916 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:15.916 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.916 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:15.916 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:15.916 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.916 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.916 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:15.916 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:15.916 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.916 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.917 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:15.917 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:15.917 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:15.917 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:15.917 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:15.917 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.917 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.917 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:15.917 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:15.917 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:15.917 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.917 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:15.917 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.917 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:15.917 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.917 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:15.918 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.918 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:15.918 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.918 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:15.918 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:15.918 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:15.918 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:15.918 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.918 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:15.918 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.918 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:15.918 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:15.918 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:15.919 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:15.919 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:15.919 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:15.919 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:15.919 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:15.919 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:15.919 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:15.919 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:15.919 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:15.919 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:15.919 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:15.919 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:15.919 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:15.919 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:15.919 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:15.920 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:15.920 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:15.920 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:15.920 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:15.920 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:15.920 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:15.920 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:15.920 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:15.920 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:15.920 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:15.920 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:15.920 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:15.920 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:15.920 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:15.920 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:15.921 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:15.921 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:15.921 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:15.921 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:15.921 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:15.921 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:15.921 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:15.921 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.921 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.921 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.921 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:15.921 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.921 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:15.921 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.921 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:15.922 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:15.922 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:15.922 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:15.922 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:15.922 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:15.922 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.922 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:15.922 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:15.922 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:15.922 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:15.922 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:15.922 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:15.922 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.922 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:15.922 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:15.923 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:15.923 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:15.923 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:15.923 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:15.923 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:15.923 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:15.923 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:15.923 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:15.923 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:15.923 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.923 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.923 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:15.923 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:15.923 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:15.924 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:15.924 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:15.924 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.924 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.924 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:15.924 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:15.924 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:15.924 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:15.924 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:15.924 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.924 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:15.924 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:15.924 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:15.924 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:15.924 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:15.925 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:15.925 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.925 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:15.925 INFO:teuthology.orchestra.run.smithi003.stdout:_______________ ERROR at teardown of test_encrypted_transfer_1kb _______________ 2023-12-03T13:00:15.925 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.925 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.925 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.925 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:15.925 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:15.925 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.925 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:15.925 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.925 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:15.925 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:15.925 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:15.926 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.926 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:15.926 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:15.926 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.926 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.926 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:15.926 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:15.926 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.926 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.926 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:15.926 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.926 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:15.926 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:15.926 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.927 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.927 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:15.927 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:15.927 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.927 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:15.927 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:15.927 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:15.927 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:15.927 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:15.927 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.927 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:15.927 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.927 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:15.927 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:15.928 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:15.928 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:15.928 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:15.928 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:15.928 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:15.928 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:15.928 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.928 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.928 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:15.928 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:15.928 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:15.928 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:15.928 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.928 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:15.929 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:15.929 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:15.929 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:15.929 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.929 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.929 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:15.929 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:15.929 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:15.929 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:15.929 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.929 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.929 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:15.929 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:15.929 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:15.930 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.930 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:15.930 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.930 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:15.930 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:15.930 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.930 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:15.930 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:15.930 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:15.930 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:15.930 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:15.930 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:15.930 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.930 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:15.931 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.931 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:15.931 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.931 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.931 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:15.931 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.931 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:15.931 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.931 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:15.931 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:15.931 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:15.931 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:15.931 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:15.932 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:15.932 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.932 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:15.932 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:15.932 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:15.932 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:15.932 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:15.932 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:15.932 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.932 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:15.932 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:15.932 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:15.932 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:15.932 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:15.932 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:15.933 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:15.933 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:15.933 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:15.933 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:15.933 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:15.933 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.933 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.933 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:15.933 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.933 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:15.933 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:15.933 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:15.933 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:15.933 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:15.933 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:15.934 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:15.934 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:15.934 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:15.934 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:15.934 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:15.934 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:15.934 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:15.934 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:15.934 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:15.934 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:15.934 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:15.934 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:15.934 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:15.934 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:15.935 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:15.935 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:15.935 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:15.935 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:15.935 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:15.935 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:15.935 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:15.935 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:15.935 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.935 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.935 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.935 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.935 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:15.935 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:15.936 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.936 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:15.936 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.936 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:15.936 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:15.936 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:15.936 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.936 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:15.936 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:15.936 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.936 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.936 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:15.936 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:15.936 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.936 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.937 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:15.937 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:15.937 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:15.937 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:15.937 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:15.937 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.937 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.937 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:15.937 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:15.937 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:15.937 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.937 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:15.937 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.937 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:15.937 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.938 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:15.938 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.938 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:15.938 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.938 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:15.938 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:15.938 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:15.938 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:15.938 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.938 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:15.938 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.938 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:15.938 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:15.938 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:15.939 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:15.939 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:15.939 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:15.939 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:15.939 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:15.939 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:15.939 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:15.939 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:15.939 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:15.939 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:15.939 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:15.939 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:15.939 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:15.939 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:15.939 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:15.939 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:15.940 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:15.940 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:15.940 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:15.940 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:15.940 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:15.940 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:15.940 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:15.940 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:15.940 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:15.940 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:15.940 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:15.940 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:15.941 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:15.941 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:15.941 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:15.941 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:15.941 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:15.941 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:15.941 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:15.941 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:15.941 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:15.941 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.941 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.941 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.941 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:15.941 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.942 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:15.942 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.942 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:15.942 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:15.942 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:15.942 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:15.942 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:15.942 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:15.942 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.942 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:15.942 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:15.942 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:15.942 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:15.942 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:15.943 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:15.943 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.943 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:15.943 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:15.943 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:15.943 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:15.943 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:15.943 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:15.943 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:15.943 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:15.943 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:15.943 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:15.943 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:15.943 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.943 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.943 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:15.944 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:15.944 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:15.944 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:15.944 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:15.944 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.944 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.944 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:15.944 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:15.944 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:15.944 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:15.944 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:15.944 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.944 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:15.944 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:15.944 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:15.945 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:15.945 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:15.945 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:15.945 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.945 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:15.945 INFO:teuthology.orchestra.run.smithi003.stdout:_______________ ERROR at teardown of test_encrypted_transfer_1MB _______________ 2023-12-03T13:00:15.945 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.945 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.945 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.945 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:15.945 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:15.945 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.945 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:15.945 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.946 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:15.946 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:15.946 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:15.946 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.946 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:15.946 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:15.946 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.946 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.946 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:15.946 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:15.946 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.946 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.946 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:15.946 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.947 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:15.947 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:15.947 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.947 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.947 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:15.947 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:15.947 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.947 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:15.947 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:15.947 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:15.947 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:15.947 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:15.947 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.947 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:15.947 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.948 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:15.948 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:15.948 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:15.948 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:15.948 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:15.948 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:15.948 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:15.948 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:15.948 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.948 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.948 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:15.948 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:15.948 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:15.948 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:15.948 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.949 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:15.949 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:15.949 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:15.949 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:15.949 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.949 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.949 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:15.949 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:15.949 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:15.949 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:15.949 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.949 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.949 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:15.949 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:15.949 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:15.950 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.950 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:15.950 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.950 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:15.950 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:15.950 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.950 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:15.950 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:15.950 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:15.950 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:15.950 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:15.950 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:15.950 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.950 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:15.951 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.951 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:15.951 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.951 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.951 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:15.951 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.951 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:15.951 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.951 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:15.951 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:15.951 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:15.951 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:15.951 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:15.951 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:15.952 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.952 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:15.952 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:15.952 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:15.952 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:15.952 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:15.952 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:15.952 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.952 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:15.952 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:15.952 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:15.952 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:15.953 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:15.953 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:15.953 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:15.953 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:15.953 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:15.953 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:15.953 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:15.953 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.953 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.953 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:15.953 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.953 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:15.953 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:15.953 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:15.954 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:15.954 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:15.954 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:15.954 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:15.954 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:15.954 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:15.954 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:15.954 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:15.954 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:15.954 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:15.954 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:15.954 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:15.954 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:15.955 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:15.955 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:15.955 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:15.955 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:15.955 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:15.955 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:15.955 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:15.955 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:15.955 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:15.955 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:15.955 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:15.955 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:15.955 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.955 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.956 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.956 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.956 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:15.956 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:15.956 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.956 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:15.956 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.956 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:15.956 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:15.956 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:15.956 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.956 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:15.956 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:15.956 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.956 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.957 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:15.957 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:15.957 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.957 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.957 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:15.957 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:15.957 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:15.957 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:15.957 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:15.957 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.957 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.957 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:15.957 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:15.958 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:15.958 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.958 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:15.958 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.958 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:15.958 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.958 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:15.958 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.958 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:15.958 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.958 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:15.958 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:15.958 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:15.958 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:15.958 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.959 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:15.959 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.959 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:15.959 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:15.959 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:15.959 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:15.959 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:15.959 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:15.959 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:15.959 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:15.959 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:15.959 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:15.959 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:15.959 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:15.960 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:15.960 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:15.960 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:15.960 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:15.960 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:15.960 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:15.960 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:15.960 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:15.960 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:15.960 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:15.960 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:15.960 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:15.960 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:15.960 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:15.960 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:15.961 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:15.961 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:15.961 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:15.961 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:15.961 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:15.961 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:15.961 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:15.961 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:15.961 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:15.961 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:15.961 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:15.961 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:15.961 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:15.961 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.962 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.962 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.962 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:15.962 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.962 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:15.962 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.962 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:15.962 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:15.962 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:15.962 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:15.962 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:15.962 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:15.962 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.963 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:15.963 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:15.963 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:15.963 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:15.963 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:15.963 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:15.963 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.963 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:15.963 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:15.963 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:15.963 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:15.963 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:15.963 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:15.963 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:15.963 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:15.964 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:15.964 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:15.964 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:15.964 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.964 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.964 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:15.964 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:15.964 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:15.964 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:15.964 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:15.964 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.964 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.964 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:15.964 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:15.965 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:15.965 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:15.965 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:15.965 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.965 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:15.965 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:15.965 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:15.965 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:15.965 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:15.965 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:15.965 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.965 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:15.965 INFO:teuthology.orchestra.run.smithi003.stdout:_______________ ERROR at teardown of test_encrypted_transfer_13b _______________ 2023-12-03T13:00:15.965 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.965 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.966 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.966 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:15.966 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:15.966 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.966 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:15.966 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.966 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:15.966 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:15.966 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:15.966 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.966 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:15.966 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:15.966 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.966 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.966 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:15.967 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:15.967 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.967 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.967 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:15.967 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.967 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:15.967 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:15.967 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.967 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.967 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:15.967 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:15.967 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.967 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:15.967 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:15.968 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:15.968 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:15.968 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:15.968 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.968 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:15.968 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.968 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:15.968 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:15.968 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:15.968 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:15.968 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:15.968 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:15.968 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:15.968 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:15.968 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.969 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.969 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:15.969 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:15.969 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:15.969 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:15.969 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.969 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:15.969 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:15.969 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:15.969 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:15.969 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.969 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.969 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:15.969 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:15.970 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:15.970 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:15.970 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.970 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.970 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:15.970 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:15.970 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:15.970 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.970 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:15.970 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.970 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:15.970 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:15.970 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.971 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:15.971 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:15.971 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:15.971 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:15.971 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:15.971 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:15.971 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.971 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:15.971 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.971 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:15.971 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.971 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.971 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:15.971 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.971 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:15.972 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.972 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:15.972 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:15.972 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:15.972 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:15.972 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:15.972 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:15.972 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.972 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:15.972 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:15.972 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:15.972 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:15.972 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:15.972 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:15.973 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.973 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:15.973 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:15.973 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:15.973 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:15.973 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:15.973 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:15.973 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:15.973 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:15.973 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:15.973 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:15.973 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:15.973 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.973 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.973 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:15.974 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.974 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:15.974 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:15.974 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:15.974 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:15.974 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:15.974 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:15.974 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:15.974 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:15.974 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:15.974 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:15.974 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:15.974 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:15.974 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:15.974 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:15.975 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:15.975 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:15.975 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:15.975 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:15.975 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:15.975 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:15.975 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:15.975 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:15.975 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:15.975 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:15.975 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:15.975 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:15.975 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:15.975 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:15.975 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.975 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.976 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.976 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.976 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:15.976 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:15.976 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.976 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:15.976 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.976 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:15.976 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:15.976 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:15.976 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.976 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:15.977 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:15.977 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.977 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.977 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:15.977 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:15.977 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.977 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.977 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:15.977 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:15.977 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:15.977 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:15.977 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:15.977 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.977 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.977 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:15.977 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:15.978 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:15.978 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.978 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:15.978 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.978 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:15.978 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.978 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:15.978 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.978 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:15.978 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.978 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:15.978 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:15.978 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:15.978 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:15.979 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.979 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:15.979 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.979 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:15.979 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:15.979 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:15.979 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:15.979 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:15.979 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:15.979 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:15.979 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:15.979 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:15.979 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:15.979 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:15.980 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:15.980 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:15.980 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:15.980 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:15.980 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:15.980 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:15.980 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:15.980 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:15.980 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:15.980 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:15.980 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:15.980 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:15.980 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:15.980 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:15.980 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:15.981 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:15.981 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:15.981 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:15.981 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:15.981 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:15.981 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:15.981 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:15.981 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:15.981 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:15.981 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:15.981 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:15.981 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:15.981 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:15.981 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:15.981 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.982 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.982 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.982 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:15.982 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.982 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:15.982 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.982 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:15.982 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:15.982 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:15.982 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:15.982 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:15.982 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:15.982 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.982 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:15.983 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:15.983 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:15.983 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:15.983 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:15.983 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:15.983 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.983 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:15.983 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:15.983 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:15.983 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:15.983 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:15.983 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:15.983 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:15.983 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:15.984 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:15.984 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:15.984 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:15.984 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.984 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.984 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:15.984 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:15.984 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:15.984 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:15.984 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:15.984 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.984 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.984 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:15.984 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:15.984 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:15.985 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:15.985 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:15.985 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.985 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:15.985 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:15.985 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:15.985 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:15.985 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:15.985 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:15.985 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.985 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:15.985 INFO:teuthology.orchestra.run.smithi003.stdout:____________ ERROR at teardown of test_encryption_sse_c_method_head ____________ 2023-12-03T13:00:15.985 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.985 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.986 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.986 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:15.986 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:15.986 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.986 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:15.986 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.986 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:15.986 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:15.986 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:15.986 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.986 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:15.986 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:15.986 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.986 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.986 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:15.987 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:15.987 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.987 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.987 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:15.987 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.987 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:15.987 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:15.987 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.987 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.987 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:15.987 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:15.987 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.987 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:15.987 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:15.987 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:15.987 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:15.988 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:15.988 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.988 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:15.988 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.988 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:15.988 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:15.988 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:15.988 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:15.988 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:15.988 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:15.988 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:15.988 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:15.988 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.989 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.989 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:15.989 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:15.989 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:15.989 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:15.989 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.989 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:15.989 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:15.989 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:15.989 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:15.989 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.989 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.989 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:15.989 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:15.989 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:15.990 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:15.990 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.990 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.990 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:15.990 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:15.990 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:15.990 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.990 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:15.990 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.990 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:15.990 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:15.990 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.990 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:15.990 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:15.991 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:15.991 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:15.991 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:15.991 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:15.991 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.991 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:15.991 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.991 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:15.991 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.991 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.991 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:15.991 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.991 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:15.991 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.992 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:15.992 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:15.992 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:15.992 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:15.992 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:15.992 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:15.992 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:15.992 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:15.992 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:15.992 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:15.992 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:15.992 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:15.992 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:15.992 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.993 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:15.993 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:15.993 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:15.993 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:15.993 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:15.993 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:15.993 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:15.993 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:15.993 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:15.993 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:15.993 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:15.993 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.993 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.993 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:15.993 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.994 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:15.994 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:15.994 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:15.994 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:15.994 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:15.994 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:15.994 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:15.994 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:15.994 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:15.994 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:15.994 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:15.994 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:15.994 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:15.994 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:15.995 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:15.995 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:15.995 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:15.995 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:15.995 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:15.995 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:15.995 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:15.995 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:15.995 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:15.995 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:15.995 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:15.995 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:15.995 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:15.995 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:15.995 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.996 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.996 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:15.996 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.996 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:15.996 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:15.996 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.996 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:15.996 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:15.996 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:15.996 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:15.996 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:15.996 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.996 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:15.996 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:15.996 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.997 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:15.997 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:15.997 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:15.997 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.997 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.997 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:15.997 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:15.997 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:15.997 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:15.997 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:15.997 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.997 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.997 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:15.997 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:15.997 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:15.998 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:15.998 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:15.998 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.998 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:15.998 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.998 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:15.998 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.998 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:15.998 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.998 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:15.998 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:15.998 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:15.998 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:15.999 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:15.999 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:15.999 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:15.999 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:15.999 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:15.999 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:15.999 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:15.999 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:15.999 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:15.999 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:15.999 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:15.999 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:15.999 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:15.999 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:15.999 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:15.999 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:16.000 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:16.000 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:16.000 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:16.000 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:16.000 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:16.000 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:16.000 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:16.000 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:16.000 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:16.000 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:16.000 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:16.000 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:16.000 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:16.001 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:16.001 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:16.001 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:16.001 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:16.001 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:16.001 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:16.001 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:16.001 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:16.001 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:16.001 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:16.001 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:16.001 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:16.001 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:16.001 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:16.002 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.002 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.002 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.002 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:16.002 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.002 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:16.002 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.002 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:16.002 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:16.002 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:16.002 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:16.002 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:16.002 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:16.002 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.002 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:16.003 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:16.003 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:16.003 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:16.003 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:16.003 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:16.003 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.003 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:16.003 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:16.003 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:16.003 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:16.003 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:16.003 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:16.003 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:16.003 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:16.004 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:16.004 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:16.004 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:16.004 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.004 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.004 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:16.004 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:16.004 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:16.004 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:16.004 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:16.004 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.004 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.004 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:16.004 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:16.004 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:16.005 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:16.005 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:16.005 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.005 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:16.005 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:16.005 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:16.005 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:16.005 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:16.005 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:16.005 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.005 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:16.005 INFO:teuthology.orchestra.run.smithi003.stdout:______________ ERROR at teardown of test_encryption_sse_c_present ______________ 2023-12-03T13:00:16.005 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.005 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.006 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.006 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:16.006 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:16.006 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.006 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:16.006 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.006 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:16.006 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:16.006 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:16.006 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.006 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:16.006 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:16.006 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.006 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.007 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:16.007 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:16.007 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.007 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.007 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:16.007 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.007 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:16.007 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:16.007 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.007 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.007 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:16.007 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:16.007 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.007 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:16.007 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:16.007 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:16.008 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:16.008 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:16.008 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.008 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:16.008 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.008 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:16.008 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:16.008 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:16.008 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:16.008 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:16.008 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:16.008 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:16.008 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:16.008 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.009 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.009 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:16.009 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:16.009 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:16.009 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:16.009 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.009 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:16.009 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:16.009 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:16.009 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:16.009 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.009 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.009 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:16.009 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:16.010 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:16.010 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:16.010 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.010 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.010 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:16.010 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:16.010 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:16.010 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.010 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:16.010 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.010 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:16.010 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:16.010 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.010 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:16.010 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:16.011 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:16.011 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:16.011 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:16.011 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:16.011 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.011 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:16.011 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.011 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:16.011 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.011 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.011 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:16.011 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.011 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:16.011 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.012 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:16.012 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:16.012 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:16.012 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:16.012 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:16.012 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:16.012 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.012 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:16.012 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:16.012 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:16.012 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:16.012 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:16.013 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:16.013 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.013 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:16.013 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:16.013 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:16.013 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:16.013 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:16.013 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:16.013 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:16.013 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:16.013 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:16.013 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:16.013 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:16.013 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.013 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.014 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:16.014 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.014 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:16.014 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:16.014 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:16.014 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:16.014 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:16.014 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:16.014 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:16.014 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:16.014 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:16.014 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:16.014 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:16.014 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:16.015 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:16.015 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:16.015 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:16.015 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:16.015 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:16.015 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:16.015 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:16.015 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:16.015 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:16.015 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:16.015 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:16.015 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:16.015 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:16.015 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:16.015 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:16.016 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:16.016 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.016 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.016 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.016 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.016 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:16.016 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:16.016 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.016 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:16.016 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.016 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:16.016 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:16.016 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:16.016 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.016 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:16.017 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:16.017 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.017 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.017 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:16.017 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:16.017 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.017 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.017 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:16.017 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:16.017 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:16.017 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:16.017 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:16.017 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.017 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.018 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:16.018 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:16.018 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:16.018 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.018 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:16.018 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.018 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:16.018 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.018 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:16.018 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.018 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:16.018 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.018 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:16.018 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:16.018 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:16.019 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:16.019 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.019 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:16.019 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.019 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:16.019 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:16.019 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:16.019 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:16.019 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:16.019 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:16.019 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:16.019 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:16.019 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:16.019 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:16.020 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:16.020 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:16.020 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:16.020 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:16.020 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:16.020 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:16.020 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:16.020 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:16.020 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:16.020 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:16.020 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:16.020 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:16.020 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:16.020 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:16.020 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:16.021 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:16.021 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:16.021 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:16.021 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:16.021 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:16.021 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:16.021 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:16.021 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:16.021 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:16.021 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:16.021 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:16.021 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:16.021 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:16.021 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:16.021 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:16.022 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.022 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.022 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.022 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:16.022 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.022 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:16.022 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.022 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:16.022 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:16.022 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:16.022 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:16.022 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:16.022 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:16.022 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.023 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:16.023 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:16.023 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:16.023 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:16.023 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:16.023 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:16.023 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.023 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:16.023 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:16.023 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:16.023 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:16.023 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:16.023 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:16.023 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:16.023 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:16.024 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:16.024 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:16.024 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:16.024 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.024 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.024 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:16.024 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:16.024 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:16.024 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:16.024 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:16.024 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.024 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.025 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:16.025 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:16.025 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:16.025 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:16.025 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:16.025 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.025 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:16.025 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:16.025 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:16.025 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:16.025 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:16.025 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:16.025 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.025 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:16.025 INFO:teuthology.orchestra.run.smithi003.stdout:_____________ ERROR at teardown of test_encryption_sse_c_other_key _____________ 2023-12-03T13:00:16.026 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.026 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.026 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.026 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:16.026 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:16.026 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.026 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:16.026 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.026 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:16.026 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:16.026 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:16.026 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.026 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:16.026 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:16.027 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.027 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.027 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:16.027 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:16.027 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.027 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.027 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:16.027 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.027 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:16.027 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:16.027 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.027 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.027 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:16.027 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:16.028 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.028 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:16.028 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:16.028 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:16.028 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:16.028 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:16.028 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.028 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:16.028 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.028 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:16.028 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:16.028 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:16.028 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:16.028 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:16.028 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:16.029 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:16.029 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:16.029 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.029 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.029 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:16.029 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:16.029 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:16.029 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:16.029 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.029 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:16.029 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:16.029 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:16.029 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:16.029 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.030 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.030 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:16.030 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:16.030 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:16.030 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:16.030 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.030 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.030 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:16.030 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:16.030 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:16.030 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.030 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:16.030 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.030 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:16.030 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:16.031 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.031 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:16.031 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:16.031 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:16.031 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:16.031 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:16.031 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:16.031 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.031 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:16.031 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.031 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:16.031 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.031 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.031 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:16.032 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.032 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:16.032 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.032 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:16.032 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:16.032 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:16.032 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:16.032 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:16.032 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:16.032 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.032 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:16.032 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:16.032 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:16.032 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:16.032 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:16.033 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:16.033 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.033 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:16.033 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:16.033 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:16.033 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:16.033 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:16.033 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:16.033 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:16.033 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:16.033 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:16.033 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:16.033 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:16.033 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.033 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.034 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:16.034 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.034 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:16.034 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:16.034 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:16.034 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:16.034 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:16.034 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:16.034 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:16.034 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:16.034 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:16.034 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:16.034 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:16.034 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:16.035 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:16.035 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:16.035 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:16.035 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:16.035 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:16.035 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:16.035 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:16.035 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:16.035 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:16.035 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:16.035 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:16.035 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:16.035 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:16.035 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:16.035 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:16.035 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:16.036 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.036 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.036 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.036 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.036 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:16.036 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:16.036 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.036 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:16.036 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.036 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:16.036 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:16.036 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:16.036 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.037 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:16.037 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:16.037 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.037 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.037 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:16.037 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:16.037 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.037 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.037 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:16.037 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:16.037 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:16.037 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:16.037 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:16.037 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.037 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.038 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:16.038 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:16.038 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:16.038 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.038 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:16.038 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.038 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:16.038 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.038 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:16.038 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.038 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:16.038 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.038 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:16.039 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:16.039 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:16.039 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:16.039 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.039 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:16.039 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.039 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:16.039 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:16.039 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:16.039 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:16.039 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:16.039 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:16.039 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:16.039 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:16.039 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:16.040 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:16.040 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:16.040 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:16.040 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:16.040 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:16.040 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:16.040 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:16.040 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:16.040 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:16.040 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:16.040 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:16.040 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:16.040 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:16.040 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:16.041 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:16.041 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:16.041 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:16.041 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:16.041 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:16.041 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:16.041 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:16.041 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:16.041 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:16.041 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:16.041 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:16.041 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:16.041 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:16.041 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:16.042 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:16.042 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:16.042 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:16.042 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.042 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.042 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.042 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:16.042 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.042 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:16.042 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.042 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:16.042 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:16.042 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:16.043 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:16.043 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:16.043 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:16.043 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.043 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:16.043 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:16.043 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:16.043 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:16.043 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:16.043 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:16.043 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.043 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:16.043 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:16.043 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:16.043 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:16.043 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:16.044 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:16.044 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:16.044 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:16.044 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:16.044 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:16.044 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:16.044 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.044 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.044 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:16.044 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:16.044 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:16.044 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:16.044 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:16.044 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.044 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.045 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:16.045 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:16.045 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:16.045 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:16.045 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:16.045 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.045 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:16.045 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:16.045 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:16.045 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:16.045 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:16.045 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:16.045 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.045 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:16.046 INFO:teuthology.orchestra.run.smithi003.stdout:____________ ERROR at teardown of test_encryption_sse_c_invalid_md5 ____________ 2023-12-03T13:00:16.046 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.046 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.046 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.046 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:16.046 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:16.046 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.046 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:16.046 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.046 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:16.046 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:16.046 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:16.046 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.046 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:16.047 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:16.047 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.047 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.047 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:16.047 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:16.047 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.047 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.047 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:16.047 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.047 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:16.047 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:16.047 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.047 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.047 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:16.048 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:16.048 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.048 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:16.048 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:16.048 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:16.048 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:16.048 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:16.048 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.048 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:16.048 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.048 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:16.048 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:16.048 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:16.048 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:16.049 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:16.049 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:16.049 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:16.049 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:16.049 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.049 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.049 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:16.049 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:16.049 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:16.049 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:16.049 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.049 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:16.049 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:16.049 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:16.050 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:16.050 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.050 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.050 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:16.050 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:16.050 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:16.050 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:16.050 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.050 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.050 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:16.050 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:16.050 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:16.051 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.051 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:16.051 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.051 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:16.051 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:16.051 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.051 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:16.051 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:16.051 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:16.051 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:16.051 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:16.051 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:16.051 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.051 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:16.051 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.052 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:16.052 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.052 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.052 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:16.052 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.052 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:16.052 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.052 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:16.052 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:16.052 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:16.052 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:16.052 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:16.052 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:16.052 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.053 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:16.053 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:16.053 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:16.053 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:16.053 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:16.053 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:16.053 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.053 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:16.053 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:16.053 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:16.053 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:16.053 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:16.053 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:16.053 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:16.053 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:16.054 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:16.054 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:16.054 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:16.054 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.054 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.054 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:16.054 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.054 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:16.054 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:16.054 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:16.054 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:16.054 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:16.054 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:16.054 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:16.054 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:16.055 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:16.055 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:16.055 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:16.055 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:16.055 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:16.055 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:16.055 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:16.055 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:16.055 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:16.055 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:16.055 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:16.055 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:16.055 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:16.055 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:16.056 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:16.056 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:16.056 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:16.056 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:16.056 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:16.056 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:16.056 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.056 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.056 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.056 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.056 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:16.056 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:16.056 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.056 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:16.057 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.057 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:16.057 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:16.057 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:16.057 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.057 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:16.057 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:16.057 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.057 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.057 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:16.057 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:16.057 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.057 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.057 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:16.058 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:16.058 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:16.058 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:16.058 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:16.058 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.058 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.058 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:16.058 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:16.058 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:16.058 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.058 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:16.058 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.058 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:16.058 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.059 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:16.059 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.059 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:16.059 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.059 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:16.059 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:16.059 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:16.059 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:16.059 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.059 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:16.059 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.059 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:16.059 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:16.059 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:16.059 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:16.060 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:16.060 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:16.060 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:16.060 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:16.060 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:16.060 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:16.060 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:16.060 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:16.060 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:16.060 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:16.060 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:16.060 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:16.060 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:16.060 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:16.060 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:16.061 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:16.061 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:16.061 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:16.061 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:16.061 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:16.061 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:16.061 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:16.061 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:16.061 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:16.061 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:16.062 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:16.062 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:16.062 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:16.062 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:16.062 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:16.062 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:16.062 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:16.062 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:16.062 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:16.062 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:16.062 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:16.063 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.063 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.063 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.063 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:16.063 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.063 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:16.063 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.063 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:16.063 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:16.063 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:16.063 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:16.063 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:16.063 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:16.064 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.064 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:16.064 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:16.064 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:16.064 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:16.064 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:16.064 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:16.064 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.064 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:16.064 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:16.064 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:16.064 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:16.064 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:16.065 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:16.065 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:16.065 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:16.065 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:16.065 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:16.065 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:16.065 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.065 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.065 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:16.065 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:16.065 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:16.065 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:16.065 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:16.065 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.066 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.066 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:16.066 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:16.066 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:16.066 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:16.066 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:16.066 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.066 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:16.066 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:16.066 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:16.066 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:16.066 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:16.066 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:16.067 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.067 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:16.067 INFO:teuthology.orchestra.run.smithi003.stdout:______________ ERROR at teardown of test_encryption_sse_c_no_md5 _______________ 2023-12-03T13:00:16.067 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.067 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.067 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.067 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:16.067 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:16.067 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.067 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:16.067 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.067 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:16.067 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:16.068 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:16.068 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.068 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:16.068 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:16.068 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.068 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.068 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:16.068 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:16.068 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.068 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.068 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:16.068 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.068 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:16.068 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:16.069 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.069 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.069 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:16.069 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:16.069 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.069 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:16.069 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:16.069 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:16.069 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:16.069 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:16.069 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.069 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:16.069 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.070 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:16.070 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:16.070 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:16.070 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:16.070 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:16.070 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:16.070 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:16.070 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:16.070 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.070 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.070 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:16.070 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:16.070 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:16.071 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:16.071 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.071 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:16.071 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:16.071 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:16.071 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:16.071 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.071 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.071 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:16.071 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:16.071 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:16.071 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:16.071 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.071 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.072 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:16.072 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:16.072 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:16.072 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.072 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:16.072 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.072 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:16.072 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:16.072 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.072 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:16.072 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:16.072 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:16.072 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:16.072 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:16.073 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:16.073 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.073 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:16.073 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.073 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:16.073 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.073 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.073 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:16.073 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.073 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:16.073 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.073 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:16.073 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:16.073 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:16.074 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:16.074 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:16.074 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:16.074 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.074 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:16.074 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:16.074 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:16.074 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:16.074 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:16.074 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:16.074 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.075 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:16.075 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:16.075 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:16.075 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:16.075 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:16.075 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:16.075 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:16.075 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:16.075 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:16.075 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:16.075 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:16.075 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.075 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.075 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:16.076 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.076 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:16.076 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:16.076 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:16.076 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:16.076 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:16.076 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:16.076 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:16.076 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:16.076 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:16.076 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:16.076 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:16.076 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:16.076 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:16.076 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:16.077 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:16.077 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:16.077 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:16.077 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:16.077 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:16.077 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:16.077 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:16.077 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:16.077 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:16.077 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:16.077 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:16.077 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:16.077 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:16.077 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:16.078 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.078 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.078 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.078 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.078 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:16.078 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:16.078 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.078 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:16.078 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.078 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:16.078 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:16.078 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:16.078 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.079 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:16.079 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:16.079 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.079 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.079 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:16.079 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:16.079 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.079 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.079 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:16.079 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:16.079 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:16.079 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:16.079 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:16.079 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.080 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.080 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:16.080 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:16.080 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:16.080 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.080 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:16.080 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.080 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:16.080 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.080 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:16.080 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.080 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:16.080 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.080 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:16.080 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:16.081 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:16.081 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:16.081 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.081 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:16.081 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.081 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:16.081 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:16.081 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:16.081 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:16.081 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:16.081 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:16.081 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:16.081 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:16.082 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:16.082 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:16.082 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:16.082 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:16.082 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:16.082 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:16.082 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:16.082 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:16.082 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:16.082 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:16.082 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:16.082 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:16.082 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:16.083 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:16.083 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:16.083 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:16.083 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:16.083 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:16.083 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:16.083 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:16.083 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:16.083 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:16.083 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:16.083 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:16.083 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:16.083 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:16.083 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:16.083 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:16.084 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:16.084 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:16.084 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:16.084 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:16.084 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.084 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.084 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.084 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:16.084 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.084 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:16.084 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.084 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:16.084 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:16.084 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:16.084 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:16.084 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:16.085 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:16.085 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.085 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:16.085 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:16.085 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:16.085 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:16.085 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:16.085 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:16.085 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.085 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:16.085 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:16.085 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:16.085 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:16.085 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:16.085 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:16.086 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:16.086 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:16.086 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:16.086 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:16.086 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:16.086 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.086 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.086 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:16.086 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:16.086 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:16.086 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:16.086 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:16.086 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.087 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.087 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:16.087 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:16.087 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:16.087 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:16.087 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:16.087 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.087 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:16.087 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:16.087 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:16.087 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:16.087 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:16.087 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:16.087 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.087 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:16.088 INFO:teuthology.orchestra.run.smithi003.stdout:______________ ERROR at teardown of test_encryption_sse_c_no_key _______________ 2023-12-03T13:00:16.088 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.088 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.088 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.088 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:16.088 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:16.088 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.088 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:16.088 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.088 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:16.088 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:16.088 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:16.088 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.088 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:16.089 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:16.089 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.089 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.089 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:16.089 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:16.089 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.089 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.089 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:16.089 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.089 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:16.089 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:16.089 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.089 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.089 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:16.089 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:16.090 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.090 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:16.090 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:16.090 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:16.090 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:16.090 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:16.090 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.090 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:16.090 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.090 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:16.090 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:16.090 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:16.090 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:16.090 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:16.091 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:16.091 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:16.091 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:16.091 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.091 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.091 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:16.091 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:16.091 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:16.091 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:16.091 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.091 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:16.091 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:16.091 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:16.091 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:16.092 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.092 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.092 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:16.092 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:16.092 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:16.092 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:16.092 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.092 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.092 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:16.092 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:16.092 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:16.092 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.092 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:16.092 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.093 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:16.093 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:16.093 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.093 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:16.093 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:16.093 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:16.093 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:16.093 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:16.093 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:16.093 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.093 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:16.093 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.093 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:16.093 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.093 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.094 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:16.094 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.094 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:16.094 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.094 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:16.094 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:16.094 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:16.094 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:16.094 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:16.094 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:16.094 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.094 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:16.094 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:16.094 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:16.095 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:16.095 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:16.095 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:16.095 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.095 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:16.095 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:16.095 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:16.095 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:16.095 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:16.095 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:16.095 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:16.095 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:16.095 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:16.095 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:16.095 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:16.096 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.096 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.096 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:16.096 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.096 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:16.096 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:16.096 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:16.096 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:16.096 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:16.096 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:16.096 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:16.096 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:16.096 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:16.096 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:16.096 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:16.097 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:16.097 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:16.097 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:16.097 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:16.097 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:16.097 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:16.097 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:16.097 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:16.097 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:16.097 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:16.097 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:16.097 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:16.097 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:16.097 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:16.097 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:16.098 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:16.098 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:16.098 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.098 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.098 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.098 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.098 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:16.098 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:16.098 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.098 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:16.098 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.098 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:16.098 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:16.099 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:16.099 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.099 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:16.099 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:16.099 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.099 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.099 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:16.099 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:16.099 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.099 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.099 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:16.099 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:16.100 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:16.100 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:16.100 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:16.100 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.100 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.100 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:16.100 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:16.100 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:16.100 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.100 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:16.100 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.100 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:16.100 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.101 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:16.101 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.101 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:16.101 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.101 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:16.101 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:16.101 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:16.101 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:16.101 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.101 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:16.101 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.101 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:16.101 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:16.101 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:16.101 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:16.102 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:16.102 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:16.102 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:16.102 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:16.102 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:16.102 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:16.102 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:16.102 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:16.102 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:16.102 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:16.102 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:16.102 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:16.102 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:16.103 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:16.103 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:16.103 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:16.103 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:16.103 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:16.103 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:16.103 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:16.103 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:16.103 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:16.103 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:16.103 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:16.103 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:16.103 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:16.103 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:16.104 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:16.104 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:16.104 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:16.104 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:16.104 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:16.104 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:16.104 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:16.104 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:16.104 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:16.104 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.104 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.104 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.104 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:16.104 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.104 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:16.105 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.105 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:16.105 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:16.105 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:16.105 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:16.105 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:16.105 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:16.105 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.105 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:16.105 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:16.105 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:16.105 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:16.105 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:16.105 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:16.106 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.106 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:16.106 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:16.106 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:16.106 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:16.106 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:16.106 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:16.106 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:16.106 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:16.106 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:16.106 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:16.106 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:16.106 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.106 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.107 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:16.107 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:16.107 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:16.107 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:16.107 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:16.107 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.107 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.107 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:16.107 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:16.107 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:16.107 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:16.107 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:16.107 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.107 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:16.108 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:16.108 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:16.108 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:16.108 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:16.108 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:16.108 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.108 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:16.108 INFO:teuthology.orchestra.run.smithi003.stdout:______________ ERROR at teardown of test_encryption_key_no_sse_c _______________ 2023-12-03T13:00:16.108 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.108 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.108 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.108 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:16.108 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:16.108 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.108 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:16.109 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.109 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:16.109 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:16.109 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:16.109 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.109 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:16.109 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:16.109 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.109 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.109 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:16.109 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:16.109 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.109 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.109 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:16.110 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.110 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:16.110 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:16.110 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.110 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.110 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:16.110 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:16.110 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.110 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:16.110 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:16.110 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:16.110 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:16.110 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:16.111 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.111 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:16.111 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.111 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:16.111 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:16.111 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:16.111 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:16.111 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:16.111 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:16.111 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:16.111 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:16.111 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.111 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.112 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:16.112 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:16.112 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:16.112 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:16.112 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.112 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:16.112 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:16.112 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:16.112 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:16.112 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.112 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.112 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:16.112 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:16.112 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:16.113 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:16.113 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.113 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.113 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:16.113 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:16.113 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:16.113 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.113 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:16.113 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.113 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:16.113 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:16.113 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.113 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:16.113 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:16.113 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:16.114 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:16.114 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:16.114 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:16.114 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.114 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:16.114 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.114 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:16.114 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.114 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.114 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:16.114 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.114 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:16.114 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.115 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:16.115 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:16.115 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:16.115 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:16.115 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:16.115 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:16.115 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.115 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:16.115 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:16.115 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:16.115 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:16.115 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:16.115 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:16.115 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.115 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:16.116 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:16.116 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:16.116 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:16.116 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:16.116 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:16.116 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:16.116 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:16.116 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:16.116 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:16.116 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:16.116 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.116 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.116 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:16.116 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.117 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:16.117 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:16.117 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:16.117 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:16.117 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:16.117 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:16.117 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:16.117 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:16.117 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:16.117 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:16.117 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:16.117 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:16.117 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:16.117 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:16.117 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:16.118 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:16.118 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:16.118 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:16.118 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:16.118 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:16.118 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:16.118 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:16.118 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:16.118 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:16.118 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:16.118 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:16.118 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:16.118 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:16.118 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.119 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.119 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.119 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.119 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:16.119 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:16.119 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.119 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:16.119 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.119 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:16.119 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:16.119 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:16.119 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.119 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:16.119 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:16.119 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.120 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.120 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:16.120 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:16.120 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.120 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.120 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:16.120 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:16.120 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:16.120 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:16.120 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:16.120 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.120 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.120 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:16.120 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:16.120 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:16.121 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.121 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:16.121 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.121 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:16.121 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.121 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:16.121 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.121 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:16.121 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.121 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:16.121 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:16.121 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:16.121 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:16.121 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.122 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:16.122 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.122 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:16.122 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:16.122 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:16.122 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:16.122 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:16.122 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:16.122 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:16.122 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:16.122 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:16.122 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:16.122 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:16.123 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:16.123 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:16.123 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:16.123 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:16.123 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:16.123 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:16.123 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:16.123 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:16.123 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:16.123 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:16.123 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:16.123 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:16.123 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:16.123 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:16.124 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:16.124 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:16.124 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:16.124 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:16.124 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:16.124 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:16.124 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:16.124 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:16.124 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:16.124 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:16.124 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:16.124 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:16.124 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:16.124 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:16.124 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:16.125 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.125 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.125 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.125 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:16.125 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.125 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:16.125 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.125 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:16.125 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:16.125 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:16.125 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:16.125 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:16.125 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:16.126 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.126 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:16.126 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:16.126 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:16.126 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:16.126 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:16.126 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:16.126 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.126 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:16.126 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:16.126 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:16.126 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:16.126 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:16.127 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:16.127 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:16.127 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:16.127 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:16.127 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:16.127 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:16.127 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.127 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.127 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:16.127 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:16.127 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:16.127 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:16.127 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:16.127 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.127 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.128 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:16.128 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:16.128 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:16.128 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:16.128 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:16.128 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.128 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:16.128 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:16.128 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:16.128 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:16.128 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:16.128 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:16.128 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.128 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:16.129 INFO:teuthology.orchestra.run.smithi003.stdout:_________ ERROR at teardown of test_encryption_sse_c_multipart_upload __________ 2023-12-03T13:00:16.129 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.129 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.129 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.129 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:16.129 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:16.129 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.129 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:16.129 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.129 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:16.129 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:16.129 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:16.129 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.130 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:16.130 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:16.130 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.130 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.130 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:16.130 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:16.130 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.130 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.130 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:16.130 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.130 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:16.130 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:16.130 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.130 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.131 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:16.131 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:16.131 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.131 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:16.131 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:16.131 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:16.131 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:16.131 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:16.131 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.131 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:16.131 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.131 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:16.131 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:16.131 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:16.132 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:16.132 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:16.132 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:16.132 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:16.132 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:16.132 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.132 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.132 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:16.132 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:16.132 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:16.132 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:16.132 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.132 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:16.132 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:16.133 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:16.133 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:16.133 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.133 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.133 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:16.133 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:16.133 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:16.133 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:16.133 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.133 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.133 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:16.133 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:16.133 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:16.133 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.133 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:16.134 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.134 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:16.134 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:16.134 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.134 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:16.134 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:16.134 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:16.134 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:16.134 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:16.134 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:16.134 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.134 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:16.134 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.134 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:16.135 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.135 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.135 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:16.135 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.135 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:16.135 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.135 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:16.135 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:16.135 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:16.135 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:16.135 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:16.135 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:16.135 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.135 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:16.136 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:16.136 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:16.136 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:16.136 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:16.136 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:16.136 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.136 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:16.136 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:16.136 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:16.136 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:16.136 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:16.136 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:16.136 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:16.137 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:16.137 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:16.137 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:16.137 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:16.137 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.137 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.137 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:16.137 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.137 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:16.137 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:16.137 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:16.137 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:16.137 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:16.137 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:16.138 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:16.138 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:16.138 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:16.138 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:16.138 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:16.138 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:16.138 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:16.138 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:16.138 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:16.138 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:16.138 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:16.138 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:16.138 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:16.138 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:16.138 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:16.139 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:16.139 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:16.139 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:16.139 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:16.139 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:16.139 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:16.139 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:16.139 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.139 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.139 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.139 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.139 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:16.139 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:16.139 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.140 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:16.140 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.140 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:16.140 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:16.140 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:16.140 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.140 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:16.140 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:16.140 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.140 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.140 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:16.140 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:16.140 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.140 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.140 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:16.140 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:16.141 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:16.141 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:16.141 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:16.141 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.141 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.141 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:16.141 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:16.141 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:16.141 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.141 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:16.141 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.141 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:16.141 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.142 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:16.142 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.142 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:16.142 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.142 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:16.142 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:16.142 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:16.142 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:16.142 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.142 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:16.142 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.142 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:16.142 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:16.142 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:16.143 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:16.143 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:16.143 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:16.143 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:16.143 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:16.143 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:16.143 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:16.143 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:16.143 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:16.143 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:16.143 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:16.143 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:16.143 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:16.143 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:16.144 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:16.144 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:16.144 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:16.144 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:16.144 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:16.144 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:16.144 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:16.144 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:16.144 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:16.144 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:16.144 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:16.144 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:16.144 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:16.144 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:16.144 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:16.144 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:16.145 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:16.145 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:16.145 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:16.145 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:16.145 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:16.145 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:16.145 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:16.145 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.145 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.145 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.145 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:16.145 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.145 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:16.145 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.145 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:16.146 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:16.146 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:16.146 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:16.146 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:16.146 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:16.146 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.146 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:16.146 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:16.146 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:16.146 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:16.146 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:16.146 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:16.146 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.146 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:16.147 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:16.147 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:16.147 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:16.147 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:16.147 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:16.147 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:16.147 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:16.147 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:16.147 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:16.147 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:16.147 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.147 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.147 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:16.148 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:16.148 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:16.148 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:16.148 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:16.148 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.148 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.148 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:16.148 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:16.148 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:16.148 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:16.148 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:16.148 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.149 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:16.149 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:16.149 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:16.149 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:16.149 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:16.149 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:16.149 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.149 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:16.149 INFO:teuthology.orchestra.run.smithi003.stdout:____ ERROR at teardown of test_encryption_sse_c_unaligned_multipart_upload _____ 2023-12-03T13:00:16.149 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.149 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.149 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.149 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:16.149 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:16.149 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.150 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:16.150 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.150 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:16.150 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:16.150 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:16.150 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.150 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:16.150 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:16.150 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.150 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.150 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:16.150 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:16.150 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.151 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.151 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:16.151 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.151 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:16.151 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:16.151 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.151 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.151 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:16.151 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:16.151 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.151 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:16.151 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:16.151 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:16.151 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:16.152 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:16.152 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.152 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:16.152 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.152 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:16.152 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:16.152 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:16.152 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:16.152 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:16.152 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:16.152 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:16.152 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:16.152 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.152 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.153 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:16.153 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:16.153 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:16.153 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:16.153 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.153 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:16.153 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:16.153 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:16.153 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:16.153 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.153 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.153 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:16.153 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:16.153 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:16.154 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:16.154 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.154 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.154 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:16.154 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:16.154 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:16.154 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.154 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:16.154 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.154 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:16.154 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:16.154 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.154 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:16.154 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:16.154 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:16.155 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:16.155 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:16.155 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:16.155 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.155 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:16.155 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.155 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:16.155 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.155 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.155 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:16.155 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.155 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:16.155 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.155 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:16.156 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:16.156 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:16.156 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:16.156 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:16.156 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:16.156 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.156 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:16.156 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:16.156 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:16.156 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:16.156 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:16.156 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:16.156 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.156 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:16.156 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:16.157 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:16.157 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:16.157 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:16.157 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:16.157 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:16.157 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:16.157 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:16.157 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:16.157 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:16.157 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.157 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.157 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:16.157 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.157 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:16.157 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:16.158 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:16.158 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:16.158 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:16.158 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:16.158 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:16.158 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:16.158 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:16.158 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:16.158 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:16.158 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:16.158 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:16.158 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:16.158 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:16.158 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:16.159 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:16.159 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:16.159 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:16.159 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:16.159 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:16.159 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:16.159 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:16.159 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:16.159 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:16.159 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:16.159 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:16.159 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:16.159 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.159 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.160 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.160 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.160 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:16.160 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:16.160 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.160 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:16.160 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.160 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:16.160 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:16.160 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:16.160 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.160 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:16.160 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:16.160 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.161 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.161 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:16.161 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:16.161 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.161 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.161 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:16.161 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:16.161 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:16.161 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:16.161 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:16.161 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.161 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.161 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:16.162 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:16.162 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:16.162 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.162 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:16.162 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.162 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:16.162 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.162 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:16.162 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.162 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:16.162 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.162 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:16.162 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:16.162 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:16.163 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:16.163 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.163 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:16.163 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.163 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:16.163 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:16.163 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:16.163 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:16.163 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:16.163 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:16.163 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:16.163 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:16.163 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:16.163 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:16.164 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:16.164 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:16.164 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:16.164 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:16.164 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:16.164 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:16.164 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:16.164 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:16.164 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:16.164 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:16.164 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:16.164 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:16.164 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:16.164 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:16.165 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:16.165 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:16.165 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:16.165 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:16.165 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:16.165 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:16.165 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:16.165 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:16.165 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:16.165 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:16.165 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:16.165 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:16.165 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:16.165 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:16.166 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:16.166 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:16.166 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.166 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.166 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.166 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:16.166 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.166 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:16.166 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.166 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:16.166 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:16.166 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:16.166 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:16.166 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:16.167 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:16.167 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.167 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:16.167 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:16.167 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:16.167 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:16.167 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:16.167 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:16.167 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.167 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:16.167 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:16.167 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:16.167 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:16.167 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:16.168 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:16.168 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:16.168 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:16.168 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:16.168 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:16.168 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:16.168 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.168 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.168 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:16.168 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:16.168 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:16.168 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:16.168 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:16.168 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.168 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.169 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:16.169 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:16.169 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:16.169 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:16.169 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:16.169 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.169 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:16.169 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:16.169 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:16.169 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:16.169 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:16.169 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:16.169 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.169 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:16.170 INFO:teuthology.orchestra.run.smithi003.stdout:______ ERROR at teardown of test_encryption_sse_c_multipart_bad_download _______ 2023-12-03T13:00:16.170 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.170 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.170 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.170 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:16.170 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:16.170 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.170 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:16.170 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.170 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:16.170 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:16.170 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:16.170 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.170 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:16.170 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:16.171 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.171 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.171 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:16.171 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:16.171 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.171 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.171 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:16.171 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.171 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:16.171 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:16.171 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.171 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.171 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:16.172 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:16.172 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.172 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:16.172 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:16.172 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:16.172 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:16.172 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:16.172 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.172 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:16.172 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.172 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:16.172 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:16.172 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:16.172 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:16.172 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:16.173 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:16.173 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:16.173 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:16.173 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.173 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.173 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:16.173 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:16.173 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:16.173 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:16.173 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.173 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:16.173 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:16.173 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:16.174 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:16.174 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.174 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.174 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:16.174 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:16.174 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:16.174 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:16.174 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.174 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.174 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:16.174 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:16.174 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:16.174 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.174 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:16.175 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.175 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:16.175 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:16.175 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.175 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:16.175 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:16.175 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:16.175 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:16.175 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:16.175 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:16.175 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.175 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:16.175 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.176 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:16.176 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.176 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.176 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:16.176 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.176 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:16.176 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.176 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:16.176 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:16.176 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:16.176 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:16.176 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:16.176 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:16.176 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.176 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:16.177 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:16.177 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:16.177 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:16.177 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:16.177 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:16.177 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.177 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:16.177 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:16.177 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:16.177 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:16.177 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:16.177 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:16.177 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:16.177 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:16.178 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:16.178 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:16.178 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:16.178 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.178 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.178 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:16.178 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.178 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:16.178 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:16.178 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:16.178 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:16.178 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:16.178 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:16.178 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:16.178 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:16.179 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:16.179 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:16.179 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:16.179 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:16.179 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:16.179 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:16.179 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:16.179 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:16.179 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:16.179 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:16.179 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:16.179 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:16.179 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:16.179 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:16.180 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:16.180 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:16.180 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:16.180 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:16.180 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:16.180 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:16.180 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.180 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.180 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.180 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.180 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:16.180 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:16.180 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.180 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:16.180 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.181 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:16.181 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:16.181 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:16.181 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.181 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:16.181 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:16.181 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.181 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.181 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:16.181 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:16.181 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.181 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.181 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:16.182 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:16.182 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:16.182 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:16.182 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:16.182 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.182 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.182 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:16.182 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:16.182 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:16.182 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.182 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:16.182 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.182 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:16.182 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.183 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:16.183 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.183 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:16.183 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.183 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:16.183 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:16.183 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:16.183 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:16.183 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.183 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:16.183 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.183 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:16.183 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:16.183 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:16.183 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:16.184 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:16.184 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:16.184 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:16.184 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:16.184 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:16.184 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:16.184 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:16.184 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:16.184 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:16.184 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:16.184 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:16.184 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:16.184 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:16.184 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:16.184 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:16.185 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:16.185 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:16.185 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:16.185 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:16.185 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:16.185 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:16.185 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:16.185 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:16.185 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:16.185 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:16.185 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:16.185 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:16.185 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:16.186 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:16.186 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:16.186 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:16.186 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:16.186 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:16.186 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:16.186 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:16.186 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:16.186 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.186 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.186 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.186 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:16.186 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.187 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:16.187 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.187 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:16.187 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:16.187 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:16.187 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:16.187 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:16.187 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:16.187 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.187 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:16.187 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:16.187 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:16.187 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:16.187 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:16.188 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:16.188 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.188 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:16.188 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:16.188 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:16.188 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:16.188 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:16.188 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:16.188 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:16.188 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:16.188 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:16.188 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:16.188 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:16.188 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.188 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.189 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:16.189 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:16.189 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:16.189 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:16.189 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:16.189 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.189 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.189 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:16.189 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:16.189 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:16.189 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:16.189 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:16.189 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.189 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:16.189 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:16.190 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:16.190 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:16.190 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:16.190 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:16.190 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.190 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:16.190 INFO:teuthology.orchestra.run.smithi003.stdout:_ ERROR at teardown of test_encryption_sse_c_post_object_authenticated_request _ 2023-12-03T13:00:16.190 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.190 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.190 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.190 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:16.190 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:16.190 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.190 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:16.191 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.191 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:16.191 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:16.191 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:16.191 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.191 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:16.191 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:16.191 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.191 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.191 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:16.191 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:16.191 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.191 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.191 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:16.192 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.192 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:16.192 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:16.192 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.192 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.192 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:16.192 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:16.192 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.192 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:16.192 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:16.192 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:16.192 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:16.192 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:16.192 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.193 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:16.193 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.193 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:16.193 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:16.193 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:16.193 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:16.193 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:16.193 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:16.193 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:16.193 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:16.193 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.193 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.193 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:16.193 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:16.194 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:16.194 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:16.194 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.194 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:16.194 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:16.194 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:16.194 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:16.194 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.194 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.194 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:16.194 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:16.194 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:16.194 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:16.194 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.195 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.195 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:16.195 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:16.195 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:16.195 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.195 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:16.195 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.195 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:16.195 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:16.195 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.195 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:16.195 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:16.195 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:16.195 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:16.195 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:16.196 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:16.196 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.196 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:16.196 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.196 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:16.196 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.196 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.196 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:16.196 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.196 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:16.196 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.196 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:16.196 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:16.196 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:16.197 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:16.197 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:16.197 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:16.197 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.197 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:16.197 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:16.197 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:16.197 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:16.197 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:16.197 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:16.197 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.197 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:16.197 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:16.197 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:16.198 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:16.198 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:16.198 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:16.198 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:16.198 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:16.198 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:16.198 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:16.198 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:16.198 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.198 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.198 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:16.198 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.198 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:16.198 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:16.199 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:16.199 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:16.199 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:16.199 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:16.199 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:16.199 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:16.199 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:16.199 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:16.199 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:16.199 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:16.199 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:16.199 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:16.199 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:16.199 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:16.199 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:16.200 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:16.200 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:16.200 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:16.200 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:16.200 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:16.200 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:16.200 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:16.200 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:16.200 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:16.200 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:16.200 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:16.200 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.200 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.200 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.200 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.201 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:16.201 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:16.201 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.201 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:16.201 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.201 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:16.201 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:16.201 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:16.201 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.201 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:16.201 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:16.201 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.201 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.201 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:16.202 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:16.202 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.202 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.202 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:16.202 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:16.202 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:16.202 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:16.202 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:16.202 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.202 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.202 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:16.202 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:16.202 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:16.202 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.203 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:16.203 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.203 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:16.203 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.203 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:16.203 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.203 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:16.203 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.203 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:16.203 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:16.203 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:16.203 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:16.203 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.203 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:16.203 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.204 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:16.204 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:16.204 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:16.204 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:16.204 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:16.204 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:16.204 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:16.204 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:16.204 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:16.204 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:16.204 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:16.204 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:16.204 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:16.204 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:16.204 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:16.205 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:16.205 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:16.205 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:16.205 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:16.205 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:16.205 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:16.205 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:16.205 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:16.205 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:16.205 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:16.205 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:16.205 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:16.205 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:16.205 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:16.205 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:16.206 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:16.206 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:16.206 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:16.206 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:16.206 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:16.206 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:16.206 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:16.206 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:16.206 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:16.206 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:16.206 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.206 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.206 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.207 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:16.207 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.207 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:16.207 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.207 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:16.207 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:16.207 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:16.207 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:16.207 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:16.207 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:16.207 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.207 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:16.207 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:16.207 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:16.208 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:16.208 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:16.208 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:16.208 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.208 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:16.208 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:16.208 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:16.208 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:16.208 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:16.208 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:16.208 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:16.208 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:16.208 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:16.208 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:16.209 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:16.209 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.209 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.209 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:16.209 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:16.209 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:16.209 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:16.209 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:16.209 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.209 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.209 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:16.209 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:16.209 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:16.210 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:16.210 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:16.210 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.210 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:16.210 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:16.210 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:16.210 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:16.210 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:16.210 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:16.210 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.210 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:16.210 INFO:teuthology.orchestra.run.smithi003.stdout:________________ ERROR at teardown of test_sse_kms_method_head _________________ 2023-12-03T13:00:16.210 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.211 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.211 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.211 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:16.211 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:16.211 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.211 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:16.211 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.211 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:16.211 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:16.211 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:16.211 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.211 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:16.211 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:16.211 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.211 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.212 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:16.212 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:16.212 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.212 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.212 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:16.212 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.212 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:16.212 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:16.212 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.212 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.212 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:16.212 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:16.212 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.212 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:16.213 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:16.213 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:16.213 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:16.213 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:16.213 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.213 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:16.213 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.213 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:16.213 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:16.213 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:16.213 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:16.213 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:16.213 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:16.213 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:16.214 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:16.214 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.214 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.214 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:16.214 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:16.214 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:16.214 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:16.214 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.214 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:16.214 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:16.214 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:16.214 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:16.214 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.214 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.214 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:16.215 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:16.215 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:16.215 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:16.215 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.215 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.215 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:16.215 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:16.215 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:16.215 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.215 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:16.215 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.215 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:16.215 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:16.215 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.215 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:16.216 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:16.216 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:16.216 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:16.216 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:16.216 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:16.216 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.216 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:16.216 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.216 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:16.216 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.216 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.216 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:16.216 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.216 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:16.217 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.217 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:16.217 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:16.217 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:16.217 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:16.217 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:16.217 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:16.217 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.217 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:16.217 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:16.217 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:16.217 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:16.217 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:16.217 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:16.217 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.218 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:16.218 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:16.218 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:16.218 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:16.218 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:16.218 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:16.218 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:16.218 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:16.218 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:16.218 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:16.218 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:16.218 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.218 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.218 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:16.219 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.219 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:16.219 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:16.219 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:16.219 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:16.219 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:16.219 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:16.219 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:16.219 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:16.219 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:16.219 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:16.219 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:16.219 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:16.219 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:16.219 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:16.220 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:16.220 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:16.220 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:16.220 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:16.220 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:16.220 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:16.220 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:16.220 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:16.220 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:16.220 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:16.220 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:16.220 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:16.220 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:16.220 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:16.221 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.221 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.221 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.221 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.221 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:16.221 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:16.221 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.221 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:16.221 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.221 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:16.221 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:16.221 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:16.221 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.221 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:16.222 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:16.222 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.222 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.222 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:16.222 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:16.222 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.222 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.222 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:16.222 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:16.222 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:16.222 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:16.222 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:16.223 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.223 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.223 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:16.223 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:16.223 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:16.223 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.223 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:16.223 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.223 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:16.223 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.223 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:16.223 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.223 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:16.223 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.224 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:16.224 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:16.224 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:16.224 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:16.224 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.224 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:16.224 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.224 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:16.224 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:16.224 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:16.224 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:16.224 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:16.224 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:16.224 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:16.225 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:16.225 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:16.225 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:16.225 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:16.225 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:16.225 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:16.225 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:16.225 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:16.225 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:16.225 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:16.225 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:16.225 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:16.225 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:16.225 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:16.226 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:16.226 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:16.226 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:16.226 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:16.226 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:16.226 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:16.226 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:16.226 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:16.226 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:16.226 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:16.226 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:16.226 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:16.226 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:16.226 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:16.227 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:16.227 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:16.227 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:16.227 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:16.227 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:16.227 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.227 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.227 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.227 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:16.227 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.227 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:16.227 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.227 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:16.227 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:16.228 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:16.228 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:16.228 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:16.228 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:16.228 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.228 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:16.228 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:16.228 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:16.228 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:16.228 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:16.228 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:16.228 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.228 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:16.228 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:16.229 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:16.229 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:16.229 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:16.229 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:16.229 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:16.229 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:16.229 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:16.229 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:16.229 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:16.229 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.229 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.229 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:16.229 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:16.229 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:16.229 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:16.230 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:16.230 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.230 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.230 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:16.230 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:16.230 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:16.230 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:16.230 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:16.230 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.230 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:16.230 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:16.230 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:16.230 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:16.230 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:16.231 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:16.231 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.231 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:16.231 INFO:teuthology.orchestra.run.smithi003.stdout:__________________ ERROR at teardown of test_sse_kms_present ___________________ 2023-12-03T13:00:16.231 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.231 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.231 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.231 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:16.231 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:16.231 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.231 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:16.231 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.231 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:16.232 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:16.232 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:16.232 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.232 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:16.232 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:16.232 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.232 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.232 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:16.232 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:16.232 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.232 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.232 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:16.232 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.232 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:16.232 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:16.233 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.233 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.233 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:16.233 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:16.233 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.233 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:16.233 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:16.233 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:16.233 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:16.233 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:16.233 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.233 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:16.233 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.233 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:16.233 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:16.234 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:16.234 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:16.234 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:16.234 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:16.234 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:16.234 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:16.234 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.234 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.234 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:16.234 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:16.234 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:16.234 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:16.234 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.235 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:16.235 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:16.235 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:16.235 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:16.235 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.235 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.235 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:16.235 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:16.235 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:16.235 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:16.235 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.235 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.235 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:16.235 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:16.236 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:16.236 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.236 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:16.236 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.236 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:16.236 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:16.236 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.236 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:16.236 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:16.236 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:16.236 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:16.236 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:16.236 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:16.236 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.236 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:16.237 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.237 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:16.237 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.237 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.237 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:16.237 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.237 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:16.237 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.237 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:16.237 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:16.237 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:16.237 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:16.237 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:16.237 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:16.238 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.238 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:16.238 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:16.238 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:16.238 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:16.238 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:16.238 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:16.238 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.238 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:16.238 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:16.238 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:16.238 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:16.238 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:16.238 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:16.239 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:16.239 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:16.239 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:16.239 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:16.239 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:16.239 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.239 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.239 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:16.239 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.239 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:16.239 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:16.239 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:16.239 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:16.239 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:16.239 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:16.239 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:16.240 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:16.240 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:16.240 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:16.240 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:16.240 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:16.240 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:16.240 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:16.240 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:16.240 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:16.240 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:16.240 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:16.240 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:16.240 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:16.240 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:16.241 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:16.241 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:16.241 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:16.241 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:16.241 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:16.241 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:16.241 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:16.241 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.241 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.241 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.241 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.241 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:16.241 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:16.241 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.242 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:16.242 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.242 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:16.242 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:16.242 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:16.242 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.242 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:16.242 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:16.242 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.242 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.242 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:16.242 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:16.242 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.243 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.243 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:16.243 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:16.243 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:16.243 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:16.243 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:16.243 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.243 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.243 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:16.243 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:16.243 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:16.243 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.243 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:16.243 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.243 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:16.244 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.244 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:16.244 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.244 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:16.244 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.244 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:16.244 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:16.244 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:16.244 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:16.244 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.244 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:16.244 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.244 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:16.244 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:16.244 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:16.245 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:16.245 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:16.245 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:16.245 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:16.245 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:16.245 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:16.245 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:16.245 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:16.245 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:16.245 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:16.245 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:16.245 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:16.245 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:16.246 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:16.246 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:16.246 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:16.246 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:16.246 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:16.246 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:16.246 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:16.246 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:16.246 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:16.246 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:16.246 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:16.246 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:16.246 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:16.246 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:16.247 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:16.247 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:16.247 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:16.247 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:16.247 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:16.247 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:16.247 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:16.247 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:16.247 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:16.247 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:16.247 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.247 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.247 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.247 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:16.248 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.248 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:16.248 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.248 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:16.248 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:16.248 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:16.248 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:16.248 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:16.248 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:16.248 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.248 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:16.248 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:16.248 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:16.248 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:16.248 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:16.249 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:16.249 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.249 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:16.249 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:16.249 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:16.249 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:16.249 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:16.249 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:16.249 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:16.249 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:16.249 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:16.249 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:16.249 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:16.249 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.250 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.250 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:16.250 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:16.250 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:16.250 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:16.250 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:16.250 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.250 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.250 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:16.250 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:16.250 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:16.250 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:16.250 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:16.250 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.251 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:16.251 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:16.251 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:16.251 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:16.251 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:16.251 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:16.251 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.251 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:16.251 INFO:teuthology.orchestra.run.smithi003.stdout:___________________ ERROR at teardown of test_sse_kms_no_key ___________________ 2023-12-03T13:00:16.251 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.251 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.251 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.251 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:16.251 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:16.252 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.252 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:16.252 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.252 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:16.252 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:16.252 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:16.252 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.252 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:16.252 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:16.252 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.252 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.252 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:16.252 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:16.252 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.253 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.253 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:16.253 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.253 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:16.253 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:16.253 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.253 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.253 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:16.253 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:16.253 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.253 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:16.253 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:16.253 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:16.253 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:16.254 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:16.254 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.254 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:16.254 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.254 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:16.254 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:16.254 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:16.254 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:16.254 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:16.254 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:16.254 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:16.254 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:16.254 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.254 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.254 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:16.255 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:16.255 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:16.255 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:16.255 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.255 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:16.255 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:16.255 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:16.255 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:16.255 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.255 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.255 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:16.255 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:16.255 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:16.255 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:16.255 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.256 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.256 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:16.256 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:16.256 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:16.256 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.256 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:16.256 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.256 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:16.256 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:16.256 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.256 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:16.256 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:16.256 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:16.256 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:16.256 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:16.257 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:16.257 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.257 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:16.257 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.257 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:16.257 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.257 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.257 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:16.257 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.257 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:16.257 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.257 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:16.257 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:16.257 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:16.258 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:16.258 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:16.258 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:16.258 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.258 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:16.258 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:16.258 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:16.258 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:16.258 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:16.258 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:16.258 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.258 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:16.258 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:16.258 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:16.259 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:16.259 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:16.259 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:16.259 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:16.259 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:16.259 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:16.259 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:16.259 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:16.259 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.259 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.259 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:16.259 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.259 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:16.260 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:16.260 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:16.260 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:16.260 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:16.260 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:16.260 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:16.260 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:16.260 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:16.260 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:16.260 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:16.260 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:16.260 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:16.260 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:16.260 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:16.260 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:16.261 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:16.261 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:16.261 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:16.261 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:16.261 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:16.261 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:16.261 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:16.261 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:16.261 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:16.261 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:16.261 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:16.261 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:16.261 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.261 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.262 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.262 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.262 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:16.262 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:16.262 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.262 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:16.262 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.262 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:16.262 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:16.262 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:16.262 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.262 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:16.262 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:16.262 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.263 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.263 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:16.263 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:16.263 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.263 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.263 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:16.263 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:16.263 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:16.263 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:16.263 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:16.263 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.263 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.263 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:16.263 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:16.264 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:16.264 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.264 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:16.264 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.264 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:16.264 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.264 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:16.264 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.264 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:16.264 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.264 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:16.264 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:16.264 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:16.264 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:16.264 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.265 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:16.265 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.265 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:16.265 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:16.265 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:16.265 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:16.265 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:16.265 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:16.265 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:16.265 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:16.265 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:16.265 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:16.265 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:16.265 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:16.266 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:16.266 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:16.266 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:16.266 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:16.266 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:16.266 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:16.266 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:16.266 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:16.266 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:16.266 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:16.266 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:16.266 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:16.266 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:16.267 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:16.267 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:16.267 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:16.267 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:16.267 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:16.267 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:16.267 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:16.267 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:16.267 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:16.267 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:16.267 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:16.267 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:16.267 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:16.267 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:16.267 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:16.268 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.268 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.268 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.268 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:16.268 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.268 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:16.268 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.268 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:16.268 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:16.268 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:16.268 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:16.268 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:16.268 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:16.268 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.269 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:16.269 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:16.269 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:16.269 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:16.269 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:16.269 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:16.269 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.269 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:16.269 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:16.269 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:16.269 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:16.269 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:16.269 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:16.269 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:16.269 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:16.270 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:16.270 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:16.270 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:16.270 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.270 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.270 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:16.270 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:16.270 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:16.270 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:16.270 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:16.270 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.270 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.270 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:16.271 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:16.271 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:16.271 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:16.271 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:16.271 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.271 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:16.271 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:16.271 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:16.271 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:16.271 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:16.271 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:16.271 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.271 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:16.271 INFO:teuthology.orchestra.run.smithi003.stdout:________________ ERROR at teardown of test_sse_kms_not_declared ________________ 2023-12-03T13:00:16.272 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.272 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.272 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.272 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:16.272 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:16.272 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.272 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:16.272 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.272 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:16.272 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:16.272 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:16.272 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.272 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:16.272 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:16.272 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.273 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.273 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:16.273 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:16.273 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.273 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.273 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:16.273 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.273 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:16.273 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:16.273 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.273 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.273 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:16.273 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:16.273 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.274 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:16.274 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:16.274 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:16.274 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:16.274 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:16.274 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.274 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:16.274 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.274 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:16.274 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:16.274 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:16.274 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:16.274 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:16.274 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:16.275 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:16.275 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:16.275 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.275 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.275 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:16.275 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:16.275 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:16.275 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:16.275 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.275 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:16.275 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:16.275 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:16.275 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:16.275 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.275 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.276 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:16.276 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:16.276 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:16.276 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:16.276 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.276 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.276 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:16.276 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:16.276 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:16.276 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.276 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:16.276 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.276 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:16.276 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:16.276 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.277 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:16.277 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:16.277 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:16.277 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:16.277 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:16.277 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:16.277 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.277 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:16.277 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.277 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:16.277 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.277 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.277 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:16.277 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.277 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:16.278 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.278 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:16.278 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:16.278 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:16.278 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:16.278 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:16.278 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:16.278 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.278 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:16.278 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:16.278 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:16.278 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:16.278 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:16.278 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:16.279 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.279 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:16.279 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:16.279 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:16.279 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:16.279 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:16.279 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:16.279 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:16.279 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:16.279 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:16.279 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:16.279 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:16.279 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.279 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.280 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:16.280 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.280 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:16.280 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:16.280 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:16.280 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:16.280 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:16.280 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:16.280 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:16.280 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:16.280 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:16.280 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:16.280 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:16.280 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:16.280 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:16.281 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:16.281 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:16.281 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:16.281 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:16.281 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:16.281 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:16.281 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:16.281 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:16.281 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:16.281 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:16.281 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:16.281 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:16.281 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:16.281 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:16.281 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:16.282 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.282 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.282 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.282 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.282 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:16.282 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:16.282 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.282 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:16.282 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.282 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:16.282 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:16.282 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:16.282 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.282 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:16.283 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:16.283 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.283 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.283 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:16.283 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:16.283 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.283 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.283 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:16.283 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:16.283 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:16.283 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:16.283 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:16.283 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.284 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.284 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:16.284 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:16.284 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:16.284 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.284 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:16.284 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.284 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:16.284 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.284 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:16.284 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.284 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:16.284 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.284 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:16.285 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:16.285 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:16.285 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:16.285 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.285 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:16.285 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.285 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:16.285 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:16.285 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:16.285 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:16.285 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:16.285 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:16.285 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:16.285 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:16.286 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:16.286 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:16.286 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:16.286 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:16.286 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:16.286 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:16.286 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:16.286 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:16.286 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:16.286 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:16.286 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:16.286 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:16.286 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:16.286 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:16.287 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:16.287 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:16.287 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:16.287 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:16.287 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:16.287 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:16.287 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:16.287 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:16.287 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:16.287 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:16.287 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:16.287 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:16.287 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:16.287 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:16.287 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:16.288 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:16.288 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:16.288 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:16.288 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.288 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.288 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.288 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:16.288 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.288 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:16.288 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.288 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:16.288 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:16.288 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:16.288 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:16.289 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:16.289 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:16.289 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.289 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:16.289 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:16.289 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:16.289 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:16.289 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:16.289 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:16.289 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.289 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:16.289 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:16.289 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:16.289 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:16.289 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:16.290 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:16.290 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:16.290 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:16.290 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:16.290 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:16.290 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:16.290 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.290 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.290 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:16.290 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:16.290 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:16.290 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:16.290 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:16.290 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.291 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.291 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:16.291 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:16.291 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:16.291 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:16.291 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:16.291 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.291 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:16.291 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:16.291 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:16.291 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:16.291 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:16.291 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:16.291 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.292 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:16.292 INFO:teuthology.orchestra.run.smithi003.stdout:______________ ERROR at teardown of test_sse_kms_multipart_upload ______________ 2023-12-03T13:00:16.292 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.292 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.292 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.292 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:16.292 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:16.292 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.292 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:16.292 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.292 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:16.292 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:16.292 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:16.292 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.293 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:16.293 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:16.293 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.293 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.293 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:16.293 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:16.293 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.293 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.293 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:16.293 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.293 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:16.293 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:16.293 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.293 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.293 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:16.294 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:16.294 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.294 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:16.294 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:16.294 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:16.294 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:16.294 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:16.294 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.294 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:16.294 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.294 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:16.294 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:16.294 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:16.294 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:16.295 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:16.295 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:16.295 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:16.295 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:16.295 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.295 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.295 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:16.295 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:16.295 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:16.295 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:16.295 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.295 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:16.295 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:16.295 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:16.296 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:16.296 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.296 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.296 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:16.296 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:16.296 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:16.296 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:16.296 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.296 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.296 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:16.296 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:16.296 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:16.296 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.297 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:16.297 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.297 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:16.297 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:16.297 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.297 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:16.297 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:16.297 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:16.297 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:16.297 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:16.297 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:16.297 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.297 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:16.297 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.297 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:16.298 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.298 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.298 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:16.298 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.298 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:16.298 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.298 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:16.298 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:16.298 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:16.298 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:16.298 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:16.298 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:16.298 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.298 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:16.299 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:16.299 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:16.299 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:16.299 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:16.299 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:16.299 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.299 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:16.299 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:16.299 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:16.299 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:16.299 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:16.299 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:16.299 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:16.299 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:16.299 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:16.300 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:16.300 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:16.300 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.300 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.300 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:16.300 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.300 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:16.300 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:16.300 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:16.300 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:16.300 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:16.300 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:16.300 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:16.300 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:16.300 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:16.301 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:16.301 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:16.301 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:16.301 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:16.301 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:16.301 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:16.301 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:16.301 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:16.301 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:16.301 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:16.301 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:16.301 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:16.301 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:16.301 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:16.302 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:16.302 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:16.302 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:16.302 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:16.302 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:16.302 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.302 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.302 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.302 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.302 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:16.302 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:16.302 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.302 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:16.302 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.302 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:16.303 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:16.303 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:16.303 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.303 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:16.303 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:16.303 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.303 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.303 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:16.303 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:16.303 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.303 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.303 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:16.303 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:16.303 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:16.303 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:16.304 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:16.304 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.304 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.304 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:16.304 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:16.304 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:16.304 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.304 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:16.304 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.304 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:16.304 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.304 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:16.304 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.304 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:16.304 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.305 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:16.305 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:16.305 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:16.305 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:16.305 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.305 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:16.305 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.305 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:16.305 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:16.305 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:16.305 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:16.305 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:16.305 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:16.305 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:16.305 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:16.306 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:16.306 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:16.306 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:16.306 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:16.306 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:16.306 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:16.306 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:16.306 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:16.306 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:16.306 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:16.306 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:16.306 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:16.306 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:16.306 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:16.306 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:16.307 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:16.307 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:16.307 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:16.307 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:16.307 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:16.307 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:16.307 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:16.307 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:16.307 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:16.307 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:16.307 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:16.307 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:16.308 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:16.308 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:16.308 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:16.308 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:16.308 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:16.308 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.308 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.308 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.308 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:16.308 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.308 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:16.308 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.308 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:16.308 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:16.308 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:16.309 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:16.309 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:16.309 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:16.309 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.309 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:16.309 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:16.309 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:16.309 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:16.309 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:16.309 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:16.309 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.309 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:16.309 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:16.309 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:16.309 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:16.310 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:16.310 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:16.310 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:16.310 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:16.310 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:16.310 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:16.310 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:16.310 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.310 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.310 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:16.310 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:16.310 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:16.310 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:16.310 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:16.310 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.311 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.311 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:16.311 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:16.311 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:16.311 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:16.311 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:16.311 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.311 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:16.311 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:16.311 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:16.311 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:16.311 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:16.311 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:16.311 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.311 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:16.311 INFO:teuthology.orchestra.run.smithi003.stdout:_________ ERROR at teardown of test_sse_kms_multipart_invalid_chunks_1 _________ 2023-12-03T13:00:16.312 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.312 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.312 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.312 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:16.312 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:16.312 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.312 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:16.312 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.312 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:16.312 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:16.312 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:16.312 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.312 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:16.312 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:16.312 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.313 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.313 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:16.313 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:16.313 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.313 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.313 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:16.313 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.313 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:16.313 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:16.313 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.313 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.313 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:16.313 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:16.313 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.313 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:16.314 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:16.314 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:16.314 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:16.314 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:16.314 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.314 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:16.314 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.314 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:16.314 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:16.314 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:16.314 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:16.314 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:16.314 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:16.314 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:16.314 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:16.315 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.315 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.315 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:16.315 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:16.315 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:16.315 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:16.315 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.315 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:16.315 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:16.315 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:16.315 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:16.315 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.315 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.315 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:16.315 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:16.316 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:16.316 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:16.316 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.316 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.316 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:16.316 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:16.316 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:16.316 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.316 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:16.316 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.316 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:16.316 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:16.316 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.316 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:16.316 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:16.317 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:16.317 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:16.317 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:16.317 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:16.317 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.317 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:16.317 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.317 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:16.317 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.317 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.317 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:16.317 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.317 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:16.317 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.318 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:16.318 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:16.318 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:16.318 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:16.318 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:16.318 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:16.318 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.318 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:16.318 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:16.318 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:16.318 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:16.318 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:16.318 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:16.318 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.318 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:16.318 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:16.319 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:16.319 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:16.319 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:16.319 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:16.319 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:16.319 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:16.319 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:16.319 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:16.319 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:16.319 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.319 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.319 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:16.319 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.320 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:16.320 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:16.320 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:16.320 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:16.320 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:16.320 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:16.320 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:16.320 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:16.320 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:16.320 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:16.320 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:16.320 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:16.320 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:16.320 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:16.321 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:16.321 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:16.321 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:16.321 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:16.321 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:16.321 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:16.321 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:16.321 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:16.321 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:16.321 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:16.321 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:16.321 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:16.321 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:16.321 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:16.322 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.322 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.322 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.322 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.322 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:16.322 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:16.322 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.322 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:16.322 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.322 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:16.322 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:16.322 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:16.322 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.322 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:16.322 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:16.323 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.323 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.323 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:16.323 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:16.323 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.323 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.323 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:16.323 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:16.323 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:16.323 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:16.323 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:16.323 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.323 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.323 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:16.323 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:16.324 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:16.324 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.324 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:16.324 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.324 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:16.324 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.324 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:16.324 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.324 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:16.324 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.324 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:16.324 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:16.324 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:16.324 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:16.325 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.325 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:16.325 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.325 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:16.325 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:16.325 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:16.325 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:16.325 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:16.325 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:16.325 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:16.325 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:16.325 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:16.325 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:16.325 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:16.325 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:16.326 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:16.326 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:16.326 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:16.326 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:16.326 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:16.326 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:16.326 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:16.326 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:16.326 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:16.326 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:16.326 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:16.326 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:16.326 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:16.326 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:16.326 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:16.327 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:16.327 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:16.327 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:16.327 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:16.327 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:16.327 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:16.327 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:16.327 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:16.327 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:16.327 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:16.327 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:16.327 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:16.327 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:16.327 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.328 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.328 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.328 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:16.328 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.328 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:16.328 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.328 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:16.328 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:16.328 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:16.328 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:16.328 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:16.328 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:16.328 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.328 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:16.329 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:16.329 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:16.329 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:16.329 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:16.329 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:16.329 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.329 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:16.329 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:16.329 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:16.329 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:16.329 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:16.329 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:16.329 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:16.329 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:16.329 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:16.330 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:16.330 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:16.330 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.330 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.330 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:16.330 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:16.330 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:16.330 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:16.330 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:16.330 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.330 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.330 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:16.330 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:16.331 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:16.331 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:16.331 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:16.331 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.331 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:16.331 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:16.331 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:16.331 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:16.331 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:16.331 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:16.331 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.331 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:16.331 INFO:teuthology.orchestra.run.smithi003.stdout:_________ ERROR at teardown of test_sse_kms_multipart_invalid_chunks_2 _________ 2023-12-03T13:00:16.332 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.332 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.332 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.332 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:16.332 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:16.332 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.332 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:16.332 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.332 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:16.332 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:16.332 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:16.332 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.332 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:16.332 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:16.332 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.333 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.333 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:16.333 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:16.333 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.333 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.333 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:16.333 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.333 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:16.333 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:16.333 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.333 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.333 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:16.333 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:16.333 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.334 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:16.334 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:16.334 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:16.334 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:16.334 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:16.334 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.334 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:16.334 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.334 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:16.334 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:16.334 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:16.334 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:16.334 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:16.334 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:16.335 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:16.335 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:16.335 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.335 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.335 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:16.335 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:16.335 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:16.335 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:16.335 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.335 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:16.335 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:16.335 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:16.335 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:16.335 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.336 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.336 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:16.336 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:16.336 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:16.336 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:16.336 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.336 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.336 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:16.336 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:16.336 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:16.336 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.336 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:16.336 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.336 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:16.336 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:16.337 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.337 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:16.337 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:16.337 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:16.337 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:16.337 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:16.337 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:16.337 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.337 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:16.337 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.337 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:16.337 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.337 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.337 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:16.338 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.338 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:16.338 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.338 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:16.338 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:16.338 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:16.338 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:16.338 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:16.338 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:16.338 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.338 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:16.338 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:16.338 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:16.338 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:16.339 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:16.339 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:16.339 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.339 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:16.339 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:16.339 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:16.339 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:16.339 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:16.339 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:16.339 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:16.339 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:16.339 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:16.339 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:16.339 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:16.339 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.340 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.340 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:16.340 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.340 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:16.340 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:16.340 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:16.340 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:16.340 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:16.340 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:16.340 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:16.340 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:16.340 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:16.340 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:16.340 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:16.340 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:16.341 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:16.341 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:16.341 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:16.341 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:16.341 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:16.341 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:16.341 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:16.341 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:16.341 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:16.341 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:16.341 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:16.341 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:16.341 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:16.341 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:16.341 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:16.342 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:16.342 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.342 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.342 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.342 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.342 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:16.342 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:16.342 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.342 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:16.342 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.342 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:16.342 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:16.342 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:16.342 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.343 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:16.343 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:16.343 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.343 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.343 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:16.343 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:16.343 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.343 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.343 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:16.343 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:16.343 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:16.343 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:16.343 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:16.344 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.344 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.344 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:16.344 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:16.344 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:16.344 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.344 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:16.344 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.344 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:16.344 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.344 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:16.344 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.344 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:16.344 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.345 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:16.345 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:16.345 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:16.345 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:16.345 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.345 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:16.345 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.345 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:16.345 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:16.345 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:16.345 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:16.345 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:16.345 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:16.345 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:16.345 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:16.346 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:16.346 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:16.346 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:16.346 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:16.346 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:16.346 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:16.346 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:16.346 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:16.346 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:16.346 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:16.346 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:16.346 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:16.346 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:16.346 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:16.347 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:16.347 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:16.347 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:16.347 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:16.347 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:16.347 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:16.347 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:16.347 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:16.347 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:16.347 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:16.347 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:16.347 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:16.347 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:16.347 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:16.348 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:16.348 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:16.348 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:16.348 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:16.348 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.348 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.348 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.348 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:16.348 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.348 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:16.348 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.348 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:16.348 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:16.349 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:16.349 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:16.349 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:16.349 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:16.349 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.349 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:16.349 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:16.349 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:16.349 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:16.349 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:16.349 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:16.349 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.349 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:16.349 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:16.349 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:16.350 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:16.350 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:16.350 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:16.350 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:16.350 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:16.350 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:16.350 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:16.350 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:16.350 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.350 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.350 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:16.350 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:16.351 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:16.351 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:16.351 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:16.351 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.351 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.351 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:16.351 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:16.351 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:16.351 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:16.351 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:16.351 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.351 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:16.351 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:16.351 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:16.351 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:16.352 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:16.352 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:16.352 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.352 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:16.352 INFO:teuthology.orchestra.run.smithi003.stdout:_____ ERROR at teardown of test_sse_kms_post_object_authenticated_request ______ 2023-12-03T13:00:16.352 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.352 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.352 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.352 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:16.352 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:16.352 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.352 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:16.352 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.352 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:16.352 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:16.353 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:16.353 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.353 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:16.353 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:16.353 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.353 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.353 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:16.353 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:16.353 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.353 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.353 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:16.353 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.353 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:16.353 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:16.354 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.354 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.354 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:16.354 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:16.354 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.354 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:16.354 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:16.354 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:16.354 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:16.354 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:16.354 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.354 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:16.354 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.354 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:16.355 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:16.355 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:16.355 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:16.355 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:16.355 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:16.355 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:16.355 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:16.355 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.355 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.355 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:16.355 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:16.355 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:16.355 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:16.355 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.356 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:16.356 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:16.356 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:16.356 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:16.356 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.356 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.356 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:16.356 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:16.356 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:16.356 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:16.356 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.356 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.356 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:16.357 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:16.357 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:16.357 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.357 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:16.357 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.357 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:16.357 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:16.357 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.357 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:16.357 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:16.357 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:16.357 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:16.357 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:16.357 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:16.358 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.358 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:16.358 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.358 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:16.358 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.358 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.358 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:16.358 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.358 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:16.358 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.358 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:16.358 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:16.358 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:16.359 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:16.359 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:16.359 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:16.359 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.359 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:16.359 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:16.359 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:16.359 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:16.359 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:16.359 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:16.359 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.359 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:16.359 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:16.359 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:16.360 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:16.360 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:16.360 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:16.360 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:16.360 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:16.360 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:16.360 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:16.360 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:16.360 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.360 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.360 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:16.360 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.360 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:16.360 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:16.361 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:16.361 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:16.361 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:16.361 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:16.361 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:16.361 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:16.361 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:16.361 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:16.361 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:16.361 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:16.361 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:16.361 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:16.361 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:16.361 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:16.362 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:16.362 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:16.362 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:16.362 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:16.362 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:16.362 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:16.362 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:16.362 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:16.362 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:16.362 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:16.362 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:16.362 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:16.362 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.363 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.363 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.363 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.363 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:16.363 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:16.363 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.363 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:16.363 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.363 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:16.363 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:16.363 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:16.363 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.363 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:16.363 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:16.363 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.364 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.364 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:16.364 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:16.364 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.364 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.364 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:16.364 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:16.364 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:16.364 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:16.364 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:16.364 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.364 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.364 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:16.364 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:16.364 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:16.365 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.365 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:16.365 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.365 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:16.365 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.365 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:16.365 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.365 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:16.365 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.365 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:16.365 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:16.365 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:16.365 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:16.365 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.366 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:16.366 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.366 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:16.366 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:16.366 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:16.366 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:16.366 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:16.366 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:16.366 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:16.366 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:16.366 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:16.366 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:16.366 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:16.366 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:16.366 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:16.367 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:16.367 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:16.367 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:16.367 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:16.367 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:16.367 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:16.367 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:16.367 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:16.367 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:16.367 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:16.367 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:16.367 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:16.367 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:16.367 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:16.368 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:16.368 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:16.368 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:16.368 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:16.368 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:16.368 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:16.368 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:16.368 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:16.368 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:16.368 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:16.368 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:16.368 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:16.369 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:16.369 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.369 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.369 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.369 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:16.369 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.369 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:16.369 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.369 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:16.369 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:16.369 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:16.369 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:16.369 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:16.369 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:16.370 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.370 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:16.370 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:16.370 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:16.370 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:16.370 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:16.370 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:16.370 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.370 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:16.370 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:16.370 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:16.370 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:16.370 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:16.371 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:16.371 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:16.371 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:16.371 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:16.371 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:16.371 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:16.371 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.371 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.371 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:16.371 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:16.371 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:16.371 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:16.371 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:16.372 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.372 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.372 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:16.372 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:16.372 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:16.372 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:16.372 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:16.372 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.372 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:16.372 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:16.372 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:16.372 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:16.372 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:16.372 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:16.373 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.373 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:16.373 INFO:teuthology.orchestra.run.smithi003.stdout:________________ ERROR at teardown of test_sse_kms_transfer_1b _________________ 2023-12-03T13:00:16.373 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.373 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.373 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.373 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:16.373 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:16.373 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.373 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:16.373 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.373 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:16.373 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:16.373 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:16.374 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.374 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:16.374 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:16.374 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.374 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.374 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:16.374 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:16.374 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.374 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.374 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:16.374 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.374 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:16.374 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:16.374 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.375 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.375 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:16.375 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:16.375 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.375 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:16.375 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:16.375 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:16.375 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:16.375 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:16.375 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.375 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:16.375 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.375 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:16.375 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:16.376 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:16.376 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:16.376 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:16.376 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:16.376 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:16.376 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:16.376 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.376 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.376 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:16.376 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:16.376 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:16.376 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:16.376 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.376 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:16.377 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:16.377 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:16.377 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:16.377 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.377 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.377 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:16.377 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:16.377 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:16.377 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:16.377 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.377 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.377 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:16.377 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:16.377 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:16.377 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.378 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:16.378 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.378 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:16.378 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:16.378 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.378 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:16.378 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:16.378 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:16.378 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:16.378 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:16.378 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:16.378 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.378 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:16.378 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.379 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:16.379 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.379 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.379 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:16.379 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.379 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:16.379 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.379 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:16.379 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:16.379 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:16.379 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:16.379 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:16.379 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:16.379 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.380 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:16.380 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:16.380 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:16.380 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:16.380 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:16.380 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:16.380 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.380 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:16.380 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:16.380 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:16.380 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:16.380 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:16.380 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:16.380 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:16.381 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:16.381 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:16.381 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:16.381 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:16.381 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.381 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.381 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:16.382 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.382 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:16.382 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:16.382 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:16.382 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:16.382 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:16.382 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:16.382 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:16.382 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:16.382 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:16.382 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:16.382 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:16.382 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:16.382 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:16.383 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:16.383 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:16.383 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:16.383 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:16.383 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:16.383 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:16.383 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:16.383 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:16.383 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:16.383 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:16.383 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:16.383 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:16.384 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:16.384 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:16.384 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:16.384 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.384 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.384 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.384 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.384 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:16.384 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:16.384 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.384 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:16.384 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.384 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:16.384 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:16.385 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:16.385 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.385 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:16.385 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:16.385 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.385 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.385 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:16.385 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:16.385 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.385 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.385 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:16.385 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:16.385 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:16.385 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:16.386 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:16.386 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.386 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.386 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:16.386 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:16.386 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:16.386 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.386 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:16.386 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.386 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:16.386 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.386 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:16.386 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.387 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:16.387 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.387 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:16.387 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:16.387 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:16.387 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:16.387 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.387 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:16.387 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.387 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:16.387 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:16.387 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:16.387 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:16.388 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:16.388 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:16.388 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:16.388 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:16.388 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:16.388 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:16.388 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:16.388 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:16.388 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:16.388 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:16.388 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:16.388 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:16.388 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:16.389 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:16.389 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:16.389 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:16.389 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:16.389 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:16.389 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:16.389 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:16.389 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:16.389 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:16.389 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:16.389 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:16.389 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:16.389 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:16.390 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:16.390 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:16.390 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:16.390 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:16.390 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:16.390 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:16.390 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:16.390 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:16.390 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:16.390 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:16.390 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.390 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.390 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.390 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:16.391 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.391 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:16.391 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.391 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:16.391 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:16.391 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:16.391 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:16.391 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:16.391 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:16.391 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.391 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:16.391 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:16.391 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:16.392 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:16.392 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:16.392 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:16.392 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.392 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:16.392 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:16.392 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:16.392 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:16.392 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:16.392 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:16.392 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:16.392 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:16.392 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:16.392 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:16.393 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:16.393 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.393 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.393 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:16.393 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:16.393 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:16.393 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:16.393 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:16.393 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.393 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.393 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:16.393 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:16.393 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:16.393 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:16.394 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:16.394 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.394 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:16.394 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:16.394 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:16.394 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:16.394 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:16.394 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:16.394 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.394 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:16.394 INFO:teuthology.orchestra.run.smithi003.stdout:________________ ERROR at teardown of test_sse_kms_transfer_1kb ________________ 2023-12-03T13:00:16.394 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.394 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.395 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.395 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:16.395 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:16.395 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.395 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:16.395 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.395 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:16.395 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:16.395 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:16.395 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.395 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:16.395 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:16.395 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.395 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.395 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:16.395 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:16.396 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.396 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.396 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:16.396 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.396 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:16.396 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:16.396 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.396 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.396 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:16.396 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:16.396 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.396 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:16.396 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:16.396 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:16.397 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:16.397 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:16.397 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.397 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:16.397 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.397 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:16.397 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:16.397 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:16.397 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:16.397 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:16.397 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:16.397 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:16.397 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:16.397 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.397 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.398 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:16.398 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:16.398 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:16.398 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:16.398 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.398 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:16.398 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:16.398 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:16.398 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:16.398 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.398 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.398 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:16.398 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:16.398 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:16.399 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:16.399 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.399 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.399 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:16.399 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:16.399 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:16.399 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.399 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:16.399 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.399 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:16.399 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:16.399 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.399 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:16.399 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:16.400 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:16.400 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:16.400 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:16.400 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:16.400 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.400 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:16.400 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.400 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:16.400 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.400 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.400 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:16.400 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.400 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:16.400 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.400 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:16.401 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:16.401 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:16.401 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:16.401 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:16.401 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:16.401 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.401 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:16.401 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:16.401 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:16.401 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:16.401 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:16.401 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:16.401 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.401 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:16.402 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:16.402 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:16.402 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:16.402 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:16.402 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:16.402 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:16.402 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:16.402 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:16.402 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:16.402 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:16.402 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.402 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.402 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:16.402 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.402 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:16.403 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:16.403 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:16.403 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:16.403 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:16.403 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:16.403 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:16.403 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:16.403 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:16.403 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:16.403 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:16.403 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:16.403 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:16.403 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:16.403 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:16.404 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:16.404 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:16.404 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:16.404 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:16.404 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:16.404 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:16.404 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:16.404 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:16.404 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:16.404 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:16.404 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:16.404 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:16.404 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:16.404 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.404 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.404 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.405 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.405 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:16.405 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:16.405 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.405 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:16.405 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.405 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:16.405 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:16.405 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:16.405 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.405 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:16.405 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:16.405 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.405 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.406 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:16.406 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:16.406 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.406 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.406 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:16.406 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:16.406 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:16.406 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:16.406 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:16.406 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.406 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.406 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:16.406 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:16.407 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:16.407 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.407 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:16.407 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.407 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:16.407 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.407 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:16.407 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.407 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:16.407 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.407 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:16.407 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:16.407 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:16.407 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:16.407 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.408 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:16.408 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.408 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:16.408 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:16.408 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:16.408 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:16.408 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:16.408 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:16.408 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:16.408 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:16.408 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:16.408 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:16.408 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:16.409 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:16.409 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:16.409 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:16.409 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:16.409 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:16.409 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:16.409 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:16.409 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:16.409 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:16.409 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:16.409 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:16.409 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:16.409 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:16.409 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:16.409 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:16.410 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:16.410 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:16.410 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:16.410 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:16.410 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:16.410 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:16.410 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:16.410 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:16.410 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:16.410 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:16.410 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:16.410 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:16.410 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:16.410 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:16.411 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.411 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.411 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.411 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:16.411 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.411 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:16.411 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.411 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:16.411 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:16.411 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:16.411 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:16.411 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:16.411 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:16.411 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.412 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:16.412 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:16.412 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:16.412 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:16.412 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:16.412 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:16.412 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.412 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:16.412 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:16.412 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:16.412 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:16.412 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:16.412 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:16.413 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:16.413 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:16.413 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:16.413 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:16.413 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:16.413 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.413 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.413 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:16.413 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:16.413 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:16.413 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:16.413 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:16.413 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.413 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.413 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:16.414 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:16.414 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:16.414 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:16.414 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:16.414 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.414 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:16.414 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:16.414 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:16.414 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:16.414 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:16.414 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:16.414 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.414 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:16.414 INFO:teuthology.orchestra.run.smithi003.stdout:________________ ERROR at teardown of test_sse_kms_transfer_1MB ________________ 2023-12-03T13:00:16.414 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.415 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.415 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.415 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:16.415 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:16.415 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.415 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:16.415 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.415 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:16.415 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:16.415 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:16.415 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.415 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:16.415 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:16.415 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.415 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.416 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:16.416 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:16.416 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.416 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.416 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:16.416 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.416 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:16.416 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:16.416 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.416 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.416 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:16.416 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:16.416 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.416 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:16.417 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:16.417 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:16.417 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:16.417 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:16.417 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.417 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:16.417 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.417 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:16.417 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:16.417 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:16.417 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:16.417 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:16.417 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:16.417 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:16.417 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:16.417 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.417 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.418 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:16.418 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:16.418 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:16.418 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:16.418 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.418 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:16.418 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:16.418 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:16.418 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:16.418 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.418 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.418 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:16.419 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:16.419 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:16.419 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:16.419 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.419 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.419 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:16.419 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:16.419 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:16.419 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.419 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:16.419 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.419 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:16.419 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:16.419 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.419 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:16.420 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:16.420 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:16.420 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:16.420 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:16.420 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:16.420 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.420 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:16.420 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.420 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:16.420 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.420 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.420 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:16.420 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.420 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:16.420 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.421 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:16.421 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:16.421 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:16.421 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:16.421 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:16.421 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:16.421 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.421 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:16.421 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:16.421 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:16.421 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:16.421 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:16.421 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:16.421 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.422 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:16.422 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:16.422 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:16.422 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:16.422 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:16.422 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:16.422 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:16.422 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:16.422 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:16.422 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:16.422 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:16.422 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.422 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.422 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:16.422 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.423 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:16.423 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:16.423 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:16.423 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:16.423 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:16.423 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:16.423 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:16.423 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:16.423 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:16.423 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:16.423 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:16.423 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:16.423 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:16.423 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:16.424 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:16.424 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:16.424 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:16.424 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:16.424 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:16.424 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:16.424 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:16.424 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:16.424 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:16.424 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:16.424 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:16.424 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:16.424 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:16.424 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:16.424 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.425 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.425 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.425 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.425 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:16.425 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:16.425 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.425 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:16.425 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.425 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:16.425 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:16.425 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:16.425 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.425 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:16.425 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:16.425 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.426 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.426 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:16.426 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:16.426 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.426 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.426 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:16.426 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:16.426 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:16.426 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:16.426 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:16.426 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.426 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.426 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:16.427 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:16.427 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:16.427 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.427 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:16.427 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.427 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:16.427 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.427 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:16.427 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.427 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:16.427 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.427 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:16.427 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:16.427 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:16.428 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:16.428 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.428 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:16.428 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.428 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:16.428 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:16.428 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:16.428 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:16.428 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:16.428 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:16.428 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:16.428 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:16.428 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:16.428 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:16.428 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:16.429 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:16.429 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:16.429 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:16.429 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:16.429 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:16.429 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:16.429 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:16.429 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:16.429 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:16.429 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:16.429 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:16.429 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:16.429 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:16.429 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:16.430 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:16.430 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:16.430 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:16.430 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:16.430 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:16.430 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:16.430 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:16.430 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:16.430 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:16.430 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:16.430 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:16.430 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:16.431 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:16.431 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:16.431 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:16.431 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.431 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.431 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.431 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:16.431 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.431 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:16.431 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.431 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:16.431 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:16.431 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:16.432 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:16.432 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:16.432 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:16.432 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.432 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:16.432 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:16.432 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:16.432 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:16.432 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:16.432 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:16.432 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.432 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:16.432 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:16.432 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:16.432 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:16.432 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:16.433 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:16.433 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:16.433 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:16.433 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:16.433 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:16.433 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:16.433 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.433 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.433 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:16.433 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:16.433 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:16.433 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:16.433 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:16.433 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.434 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.434 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:16.434 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:16.434 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:16.434 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:16.434 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:16.434 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.434 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:16.434 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:16.434 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:16.434 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:16.434 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:16.434 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:16.435 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.435 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:16.435 INFO:teuthology.orchestra.run.smithi003.stdout:________________ ERROR at teardown of test_sse_kms_transfer_13b ________________ 2023-12-03T13:00:16.435 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.435 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.435 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.435 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:16.435 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:16.435 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.435 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:16.435 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.435 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:16.435 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:16.435 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:16.435 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.436 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:16.436 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:16.436 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.436 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.436 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:16.436 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:16.436 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.436 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.436 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:16.436 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.436 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:16.436 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:16.436 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.436 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.436 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:16.437 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:16.437 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.437 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:16.437 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:16.437 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:16.437 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:16.437 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:16.437 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.437 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:16.437 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.437 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:16.437 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:16.437 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:16.437 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:16.438 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:16.438 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:16.438 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:16.438 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:16.438 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.438 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.438 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:16.438 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:16.438 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:16.438 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:16.438 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.438 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:16.438 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:16.438 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:16.439 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:16.439 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.439 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.439 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:16.439 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:16.439 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:16.439 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:16.439 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.439 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.439 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:16.439 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:16.439 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:16.439 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.439 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:16.439 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.440 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:16.440 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:16.440 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.440 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:16.440 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:16.440 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:16.440 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:16.440 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:16.440 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:16.440 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.440 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:16.440 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.440 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:16.441 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.441 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.441 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:16.441 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.441 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:16.441 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.441 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:16.441 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:16.441 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:16.441 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:16.441 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:16.441 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:16.441 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.441 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:16.441 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:16.442 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:16.442 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:16.442 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:16.442 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:16.442 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.442 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:16.442 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:16.442 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:16.442 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:16.442 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:16.442 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:16.442 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:16.442 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:16.443 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:16.443 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:16.443 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:16.443 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.443 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.443 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:16.443 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.443 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:16.443 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:16.443 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:16.443 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:16.443 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:16.444 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:16.444 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:16.444 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:16.444 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:16.444 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:16.444 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:16.444 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:16.444 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:16.444 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:16.444 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:16.444 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:16.444 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:16.444 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:16.444 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:16.445 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:16.445 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:16.445 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:16.445 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:16.445 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:16.445 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:16.445 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:16.445 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:16.445 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:16.445 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.445 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.445 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.445 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.445 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:16.445 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:16.446 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.446 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:16.446 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.446 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:16.446 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:16.446 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:16.446 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.446 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:16.446 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:16.446 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.446 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.446 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:16.446 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:16.447 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.447 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.447 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:16.447 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:16.447 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:16.447 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:16.447 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:16.447 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.447 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.447 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:16.447 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:16.447 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:16.447 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.447 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:16.447 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.447 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:16.448 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.448 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:16.448 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.448 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:16.448 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.448 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:16.448 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:16.448 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:16.448 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:16.448 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.448 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:16.448 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.448 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:16.448 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:16.448 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:16.449 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:16.449 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:16.449 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:16.449 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:16.449 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:16.449 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:16.449 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:16.449 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:16.449 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:16.449 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:16.449 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:16.449 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:16.449 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:16.449 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:16.450 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:16.450 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:16.450 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:16.450 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:16.450 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:16.450 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:16.450 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:16.450 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:16.450 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:16.450 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:16.450 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:16.450 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:16.450 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:16.450 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:16.451 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:16.451 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:16.451 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:16.451 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:16.451 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:16.451 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:16.451 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:16.451 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:16.451 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:16.451 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.451 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.451 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.451 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:16.451 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.452 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:16.452 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.452 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:16.452 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:16.452 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:16.452 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:16.452 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:16.452 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:16.452 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.452 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:16.452 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:16.452 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:16.452 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:16.452 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:16.452 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:16.452 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.453 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:16.453 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:16.453 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:16.453 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:16.453 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:16.453 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:16.453 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:16.453 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:16.453 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:16.453 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:16.453 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:16.453 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.453 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.453 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:16.454 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:16.454 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:16.454 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:16.454 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:16.454 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.454 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.454 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:16.454 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:16.454 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:16.454 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:16.454 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:16.454 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.454 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:16.454 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:16.455 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:16.455 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:16.455 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:16.455 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:16.455 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.455 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:16.455 INFO:teuthology.orchestra.run.smithi003.stdout:________________ ERROR at teardown of test_sse_kms_read_declare ________________ 2023-12-03T13:00:16.455 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.455 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.455 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.455 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:16.455 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:16.455 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.455 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:16.456 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.456 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:16.456 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:16.456 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:16.456 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.456 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:16.456 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:16.456 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.456 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.456 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:16.456 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:16.456 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.456 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.456 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:16.456 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.457 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:16.457 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:16.457 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.457 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.457 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:16.457 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:16.457 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.457 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:16.457 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:16.457 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:16.457 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:16.457 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:16.457 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.457 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:16.457 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.458 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:16.458 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:16.458 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:16.458 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:16.458 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:16.458 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:16.458 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:16.458 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:16.458 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.458 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.458 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:16.458 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:16.458 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:16.458 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:16.459 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.459 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:16.459 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:16.459 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:16.459 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:16.459 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.459 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.459 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:16.459 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:16.459 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:16.459 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:16.459 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.459 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.459 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:16.460 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:16.460 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:16.460 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.460 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:16.460 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.460 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:16.460 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:16.460 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.460 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:16.460 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:16.460 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:16.460 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:16.460 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:16.460 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:16.461 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.461 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:16.461 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.461 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:16.461 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.461 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.461 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:16.461 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.461 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:16.461 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.461 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:16.461 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:16.461 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:16.462 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:16.462 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:16.462 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:16.462 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.462 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:16.462 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:16.462 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:16.462 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:16.462 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:16.462 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:16.462 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.462 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:16.462 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:16.462 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:16.463 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:16.463 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:16.463 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:16.463 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:16.463 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:16.463 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:16.463 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:16.463 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:16.463 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.463 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.463 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:16.463 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.463 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:16.463 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:16.463 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:16.464 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:16.464 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:16.464 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:16.464 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:16.464 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:16.464 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:16.464 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:16.464 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:16.464 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:16.464 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:16.464 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:16.464 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:16.464 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:16.464 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:16.464 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:16.465 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:16.465 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:16.465 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:16.465 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:16.465 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:16.465 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:16.465 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:16.465 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:16.465 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:16.465 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:16.465 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.465 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.465 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.465 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.465 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:16.466 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:16.466 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.466 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:16.466 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.466 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:16.466 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:16.466 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:16.466 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.466 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:16.466 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:16.466 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.466 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.466 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:16.466 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:16.467 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.467 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.467 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:16.467 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:16.467 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:16.467 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:16.467 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:16.467 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.467 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.467 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:16.467 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:16.467 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:16.467 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.467 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:16.468 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.468 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:16.468 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.468 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:16.468 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.468 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:16.468 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.468 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:16.468 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:16.468 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:16.468 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:16.468 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.468 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:16.468 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.469 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:16.469 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:16.469 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:16.469 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:16.469 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:16.469 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:16.469 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:16.469 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:16.469 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:16.469 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:16.469 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:16.469 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:16.469 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:16.469 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:16.469 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:16.469 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:16.470 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:16.470 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:16.470 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:16.470 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:16.470 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:16.470 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:16.470 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:16.470 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:16.470 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:16.470 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:16.470 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:16.470 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:16.470 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:16.471 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:16.471 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:16.471 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:16.471 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:16.471 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:16.471 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:16.471 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:16.471 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:16.471 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:16.471 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:16.471 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:16.471 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.472 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.472 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.472 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:16.472 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.472 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:16.472 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.472 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:16.472 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:16.472 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:16.472 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:16.472 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:16.472 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:16.472 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.472 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:16.472 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:16.473 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:16.473 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:16.473 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:16.473 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:16.473 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.473 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:16.473 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:16.473 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:16.473 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:16.473 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:16.473 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:16.473 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:16.473 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:16.473 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:16.474 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:16.474 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:16.474 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.474 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.474 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:16.474 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:16.474 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:16.474 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:16.474 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:16.474 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.474 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.474 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:16.474 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:16.474 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:16.474 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:16.475 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:16.475 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.475 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:16.475 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:16.475 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:16.475 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:16.475 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:16.475 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:16.475 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.475 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:16.475 INFO:teuthology.orchestra.run.smithi003.stdout:___________________ ERROR at teardown of test_bucket_policy ____________________ 2023-12-03T13:00:16.475 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.475 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.475 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.476 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:16.476 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:16.476 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.476 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:16.476 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.476 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:16.476 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:16.476 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:16.476 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.476 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:16.476 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:16.476 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.476 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.476 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:16.476 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:16.477 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.477 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.477 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:16.477 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.477 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:16.477 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:16.477 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.477 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.477 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:16.477 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:16.477 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.477 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:16.477 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:16.477 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:16.477 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:16.478 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:16.478 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.478 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:16.478 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.478 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:16.478 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:16.478 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:16.478 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:16.478 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:16.478 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:16.478 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:16.478 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:16.478 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.478 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.479 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:16.479 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:16.479 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:16.479 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:16.479 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.479 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:16.479 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:16.479 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:16.479 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:16.479 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.479 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.479 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:16.479 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:16.479 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:16.480 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:16.480 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.480 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.480 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:16.480 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:16.480 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:16.480 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.480 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:16.480 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.480 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:16.480 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:16.480 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.480 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:16.480 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:16.481 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:16.481 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:16.481 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:16.481 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:16.481 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.481 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:16.481 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.481 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:16.481 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.481 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.481 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:16.481 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.482 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:16.482 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.482 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:16.482 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:16.482 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:16.482 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:16.482 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:16.482 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:16.482 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.482 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:16.482 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:16.482 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:16.482 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:16.482 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:16.483 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:16.483 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.483 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:16.483 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:16.483 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:16.483 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:16.483 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:16.483 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:16.483 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:16.483 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:16.483 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:16.483 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:16.483 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:16.483 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.483 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.484 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:16.484 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.484 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:16.484 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:16.484 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:16.484 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:16.484 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:16.484 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:16.484 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:16.484 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:16.484 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:16.484 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:16.484 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:16.484 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:16.485 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:16.485 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:16.485 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:16.485 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:16.485 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:16.485 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:16.485 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:16.485 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:16.485 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:16.485 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:16.485 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:16.485 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:16.486 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:16.486 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:16.486 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:16.486 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:16.486 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.486 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.486 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.486 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.486 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:16.486 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:16.486 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.486 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:16.486 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.486 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:16.486 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:16.487 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:16.487 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.487 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:16.487 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:16.487 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.487 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.487 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:16.487 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:16.487 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.487 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.487 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:16.487 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:16.487 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:16.488 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:16.488 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:16.488 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.488 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.488 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:16.488 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:16.488 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:16.488 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.488 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:16.488 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.488 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:16.488 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.488 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:16.488 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.488 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:16.489 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.489 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:16.489 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:16.489 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:16.489 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:16.489 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.489 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:16.489 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.489 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:16.489 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:16.489 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:16.489 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:16.489 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:16.489 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:16.489 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:16.490 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:16.490 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:16.490 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:16.490 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:16.490 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:16.490 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:16.490 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:16.490 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:16.490 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:16.490 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:16.490 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:16.490 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:16.490 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:16.491 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:16.491 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:16.491 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:16.491 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:16.491 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:16.491 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:16.491 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:16.491 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:16.491 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:16.491 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:16.491 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:16.491 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:16.491 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:16.491 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:16.492 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:16.492 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:16.492 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:16.492 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:16.492 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:16.492 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:16.492 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.492 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.492 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.492 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:16.492 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.492 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:16.493 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.493 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:16.493 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:16.493 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:16.493 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:16.493 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:16.493 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:16.493 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.493 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:16.493 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:16.493 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:16.493 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:16.493 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:16.493 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:16.493 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.494 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:16.494 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:16.494 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:16.494 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:16.494 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:16.494 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:16.494 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:16.494 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:16.494 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:16.494 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:16.494 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:16.494 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.494 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.494 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:16.495 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:16.495 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:16.495 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:16.495 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:16.495 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.495 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.495 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:16.495 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:16.495 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:16.495 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:16.495 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:16.495 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.495 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:16.495 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:16.496 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:16.496 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:16.496 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:16.496 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:16.496 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.496 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:16.496 INFO:teuthology.orchestra.run.smithi003.stdout:__________________ ERROR at teardown of test_bucketv2_policy ___________________ 2023-12-03T13:00:16.496 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.496 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.496 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.496 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:16.496 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:16.496 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.496 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:16.496 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.497 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:16.497 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:16.497 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:16.497 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.497 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:16.497 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:16.497 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.497 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.497 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:16.497 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:16.497 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.497 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.497 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:16.497 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.497 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:16.498 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:16.498 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.498 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.498 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:16.498 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:16.498 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.498 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:16.498 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:16.498 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:16.498 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:16.498 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:16.498 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.498 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:16.498 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.498 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:16.499 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:16.499 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:16.499 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:16.499 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:16.499 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:16.499 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:16.499 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:16.499 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.499 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.499 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:16.499 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:16.499 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:16.499 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:16.499 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.499 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:16.500 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:16.500 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:16.500 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:16.500 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.500 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.500 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:16.500 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:16.500 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:16.500 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:16.500 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.500 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.500 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:16.500 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:16.500 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:16.500 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.501 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:16.501 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.501 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:16.501 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:16.501 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.501 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:16.501 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:16.501 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:16.501 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:16.501 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:16.501 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:16.501 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.501 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:16.502 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.502 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:16.502 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.502 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.502 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:16.502 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.502 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:16.502 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.502 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:16.502 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:16.502 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:16.502 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:16.502 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:16.502 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:16.502 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.503 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:16.503 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:16.503 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:16.503 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:16.503 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:16.503 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:16.503 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.503 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:16.503 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:16.503 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:16.503 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:16.503 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:16.503 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:16.503 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:16.504 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:16.504 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:16.504 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:16.504 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:16.504 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.504 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.504 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:16.504 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.504 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:16.504 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:16.504 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:16.504 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:16.504 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:16.504 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:16.504 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:16.505 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:16.505 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:16.505 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:16.505 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:16.505 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:16.505 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:16.505 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:16.505 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:16.505 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:16.505 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:16.505 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:16.505 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:16.505 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:16.506 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:16.506 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:16.506 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:16.506 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:16.506 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:16.506 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:16.506 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:16.506 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:16.506 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.506 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.506 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.506 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.506 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:16.506 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:16.507 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.507 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:16.507 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.507 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:16.507 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:16.507 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:16.507 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.507 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:16.507 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:16.507 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.507 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.507 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:16.507 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:16.507 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.507 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.508 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:16.508 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:16.508 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:16.508 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:16.508 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:16.508 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.508 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.508 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:16.508 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:16.508 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:16.508 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.508 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:16.508 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.508 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:16.508 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.509 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:16.509 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.509 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:16.509 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.509 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:16.509 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:16.509 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:16.509 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:16.509 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.509 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:16.509 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.509 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:16.509 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:16.509 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:16.510 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:16.510 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:16.510 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:16.510 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:16.510 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:16.510 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:16.510 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:16.510 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:16.510 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:16.510 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:16.510 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:16.510 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:16.510 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:16.511 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:16.511 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:16.511 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:16.511 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:16.511 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:16.511 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:16.511 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:16.511 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:16.511 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:16.511 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:16.511 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:16.511 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:16.511 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:16.511 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:16.512 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:16.512 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:16.512 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:16.512 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:16.512 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:16.512 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:16.512 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:16.512 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:16.512 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:16.512 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:16.512 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.512 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.512 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.512 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:16.513 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.513 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:16.513 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.513 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:16.513 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:16.513 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:16.513 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:16.513 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:16.513 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:16.513 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.513 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:16.513 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:16.513 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:16.513 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:16.513 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:16.514 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:16.514 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.514 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:16.514 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:16.514 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:16.514 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:16.514 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:16.514 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:16.514 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:16.514 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:16.514 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:16.514 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:16.514 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:16.515 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.515 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.515 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:16.515 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:16.515 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:16.515 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:16.515 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:16.515 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.515 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.515 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:16.515 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:16.515 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:16.515 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:16.515 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:16.515 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.515 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:16.516 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:16.516 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:16.516 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:16.516 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:16.516 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:16.516 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.516 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:16.516 INFO:teuthology.orchestra.run.smithi003.stdout:_________________ ERROR at teardown of test_bucket_policy_acl __________________ 2023-12-03T13:00:16.516 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.516 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.516 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.516 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:16.516 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:16.517 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.517 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:16.517 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.517 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:16.517 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:16.517 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:16.517 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.517 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:16.517 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:16.517 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.517 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.517 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:16.517 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:16.517 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.517 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.518 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:16.518 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.518 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:16.518 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:16.518 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.518 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.518 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:16.518 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:16.518 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.518 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:16.518 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:16.518 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:16.518 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:16.518 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:16.519 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.519 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:16.519 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.519 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:16.519 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:16.519 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:16.519 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:16.519 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:16.519 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:16.519 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:16.519 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:16.519 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.519 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.519 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:16.519 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:16.520 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:16.520 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:16.520 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.520 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:16.520 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:16.520 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:16.520 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:16.520 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.520 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.520 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:16.520 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:16.520 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:16.520 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:16.520 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.521 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.521 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:16.521 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:16.521 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:16.521 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.521 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:16.521 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.521 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:16.521 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:16.521 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.521 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:16.521 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:16.521 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:16.521 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:16.522 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:16.522 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:16.522 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.522 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:16.522 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.522 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:16.522 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.522 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.522 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:16.522 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.522 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:16.522 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.522 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:16.522 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:16.522 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:16.523 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:16.523 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:16.523 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:16.523 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.523 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:16.523 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:16.523 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:16.523 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:16.523 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:16.523 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:16.523 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.523 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:16.523 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:16.523 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:16.523 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:16.524 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:16.524 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:16.524 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:16.524 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:16.524 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:16.524 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:16.524 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:16.524 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.524 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.524 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:16.524 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.524 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:16.524 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:16.524 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:16.525 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:16.525 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:16.525 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:16.525 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:16.525 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:16.525 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:16.525 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:16.525 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:16.525 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:16.525 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:16.525 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:16.525 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:16.525 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:16.525 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:16.526 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:16.526 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:16.526 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:16.526 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:16.526 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:16.526 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:16.526 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:16.526 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:16.526 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:16.526 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:16.526 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:16.526 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.526 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.526 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.526 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.527 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:16.527 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:16.527 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.527 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:16.527 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.527 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:16.527 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:16.527 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:16.527 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.527 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:16.527 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:16.527 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.527 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.527 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:16.528 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:16.528 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.528 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.528 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:16.528 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:16.528 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:16.528 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:16.528 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:16.528 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.528 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.528 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:16.528 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:16.528 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:16.528 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.528 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:16.529 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.529 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:16.529 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.529 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:16.529 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.529 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:16.529 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.529 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:16.529 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:16.529 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:16.529 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:16.529 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.529 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:16.529 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.530 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:16.530 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:16.530 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:16.530 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:16.530 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:16.530 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:16.530 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:16.530 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:16.530 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:16.530 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:16.530 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:16.530 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:16.530 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:16.531 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:16.531 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:16.531 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:16.531 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:16.531 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:16.531 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:16.531 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:16.531 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:16.531 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:16.531 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:16.531 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:16.531 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:16.531 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:16.531 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:16.531 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:16.532 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:16.532 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:16.532 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:16.532 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:16.532 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:16.532 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:16.532 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:16.532 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:16.532 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:16.532 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:16.532 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:16.532 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:16.532 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.532 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.533 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.533 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:16.533 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.533 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:16.533 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.533 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:16.533 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:16.533 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:16.533 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:16.533 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:16.533 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:16.533 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.533 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:16.533 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:16.533 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:16.534 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:16.534 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:16.534 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:16.534 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.534 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:16.534 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:16.534 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:16.534 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:16.534 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:16.534 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:16.534 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:16.534 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:16.534 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:16.535 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:16.535 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:16.535 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.535 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.535 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:16.535 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:16.535 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:16.535 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:16.535 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:16.535 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.535 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.535 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:16.535 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:16.535 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:16.535 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:16.536 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:16.536 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.536 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:16.536 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:16.536 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:16.536 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:16.536 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:16.536 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:16.536 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.536 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:16.536 INFO:teuthology.orchestra.run.smithi003.stdout:________________ ERROR at teardown of test_bucketv2_policy_acl _________________ 2023-12-03T13:00:16.536 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.536 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.536 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.536 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:16.537 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:16.537 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.537 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:16.537 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.537 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:16.537 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:16.537 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:16.537 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.537 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:16.537 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:16.537 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.537 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.537 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:16.537 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:16.538 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.538 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.538 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:16.538 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.538 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:16.538 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:16.538 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.538 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.538 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:16.538 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:16.538 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.538 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:16.538 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:16.538 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:16.539 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:16.539 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:16.539 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.539 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:16.539 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.539 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:16.539 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:16.539 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:16.539 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:16.539 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:16.539 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:16.539 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:16.539 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:16.539 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.540 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.540 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:16.540 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:16.540 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:16.540 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:16.540 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.540 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:16.540 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:16.540 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:16.540 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:16.540 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.540 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.540 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:16.541 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:16.541 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:16.541 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:16.541 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.541 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.541 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:16.541 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:16.541 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:16.541 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.541 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:16.541 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.541 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:16.541 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:16.541 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.542 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:16.542 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:16.542 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:16.542 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:16.542 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:16.542 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:16.542 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.542 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:16.542 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.542 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:16.542 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.542 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.542 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:16.542 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.543 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:16.543 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.543 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:16.543 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:16.543 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:16.543 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:16.543 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:16.543 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:16.543 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.543 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:16.543 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:16.543 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:16.543 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:16.543 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:16.543 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:16.544 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.544 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:16.544 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:16.544 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:16.544 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:16.544 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:16.544 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:16.544 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:16.544 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:16.544 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:16.544 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:16.544 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:16.544 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.544 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.544 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:16.545 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.545 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:16.545 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:16.545 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:16.545 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:16.545 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:16.545 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:16.545 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:16.545 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:16.545 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:16.545 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:16.545 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:16.545 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:16.545 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:16.546 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:16.546 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:16.546 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:16.546 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:16.546 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:16.546 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:16.546 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:16.546 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:16.546 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:16.546 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:16.546 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:16.546 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:16.546 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:16.547 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:16.547 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:16.547 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.547 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.547 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.547 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.547 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:16.547 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:16.547 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.547 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:16.547 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.547 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:16.547 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:16.547 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:16.547 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.548 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:16.548 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:16.548 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.548 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.548 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:16.548 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:16.548 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.548 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.548 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:16.548 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:16.548 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:16.548 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:16.548 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:16.548 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.549 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.549 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:16.549 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:16.549 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:16.549 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.549 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:16.549 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.549 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:16.549 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.549 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:16.549 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.549 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:16.549 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.549 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:16.550 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:16.550 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:16.550 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:16.550 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.550 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:16.550 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.550 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:16.550 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:16.550 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:16.550 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:16.550 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:16.550 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:16.550 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:16.550 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:16.551 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:16.551 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:16.551 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:16.551 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:16.551 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:16.551 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:16.551 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:16.551 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:16.551 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:16.551 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:16.551 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:16.551 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:16.551 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:16.551 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:16.551 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:16.552 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:16.552 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:16.552 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:16.552 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:16.552 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:16.552 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:16.552 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:16.552 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:16.552 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:16.552 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:16.552 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:16.552 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:16.552 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:16.553 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:16.553 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:16.553 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:16.553 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:16.553 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.553 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.553 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.553 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:16.553 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.553 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:16.553 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.553 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:16.553 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:16.553 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:16.554 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:16.554 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:16.554 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:16.554 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.554 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:16.554 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:16.554 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:16.554 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:16.554 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:16.554 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:16.554 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.554 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:16.554 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:16.555 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:16.555 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:16.555 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:16.555 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:16.555 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:16.555 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:16.555 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:16.555 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:16.555 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:16.555 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.555 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.555 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:16.555 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:16.555 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:16.555 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:16.556 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:16.556 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.556 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.556 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:16.556 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:16.556 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:16.556 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:16.556 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:16.556 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.556 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:16.556 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:16.556 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:16.556 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:16.556 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:16.556 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:16.557 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.557 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:16.557 INFO:teuthology.orchestra.run.smithi003.stdout:____________ ERROR at teardown of test_bucket_policy_another_bucket ____________ 2023-12-03T13:00:16.557 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.557 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.557 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.557 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:16.557 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:16.557 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.557 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:16.557 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.557 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:16.557 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:16.557 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:16.558 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.558 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:16.558 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:16.558 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.558 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.558 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:16.558 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:16.558 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.558 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.558 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:16.558 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.558 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:16.558 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:16.558 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.559 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.559 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:16.559 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:16.559 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.559 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:16.559 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:16.559 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:16.559 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:16.559 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:16.559 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.559 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:16.559 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.559 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:16.559 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:16.559 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:16.560 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:16.560 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:16.560 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:16.560 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:16.560 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:16.560 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.560 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.560 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:16.560 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:16.560 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:16.560 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:16.560 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.560 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:16.560 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:16.561 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:16.561 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:16.561 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.561 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.561 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:16.561 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:16.561 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:16.561 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:16.561 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.561 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.561 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:16.561 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:16.561 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:16.562 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.562 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:16.562 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.562 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:16.562 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:16.562 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.562 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:16.562 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:16.562 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:16.562 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:16.562 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:16.562 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:16.562 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.562 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:16.562 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.563 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:16.563 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.563 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.563 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:16.563 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.563 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:16.563 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.563 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:16.563 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:16.563 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:16.563 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:16.563 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:16.563 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:16.563 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.563 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:16.564 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:16.564 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:16.564 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:16.564 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:16.564 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:16.564 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.564 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:16.564 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:16.564 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:16.564 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:16.564 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:16.564 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:16.564 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:16.564 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:16.564 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:16.565 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:16.565 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:16.565 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.565 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.565 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:16.565 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.565 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:16.565 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:16.565 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:16.565 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:16.565 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:16.565 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:16.565 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:16.566 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:16.566 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:16.566 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:16.566 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:16.566 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:16.566 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:16.566 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:16.566 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:16.566 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:16.566 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:16.566 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:16.566 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:16.566 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:16.566 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:16.566 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:16.567 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:16.567 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:16.567 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:16.567 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:16.567 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:16.567 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:16.567 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.567 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.567 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.567 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.567 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:16.567 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:16.567 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.568 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:16.568 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.568 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:16.568 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:16.568 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:16.568 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.568 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:16.568 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:16.568 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.568 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.568 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:16.568 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:16.568 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.568 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.568 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:16.569 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:16.569 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:16.569 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:16.569 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:16.569 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.569 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.569 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:16.569 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:16.569 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:16.569 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.569 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:16.569 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.569 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:16.569 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.569 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:16.569 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.570 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:16.570 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.570 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:16.570 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:16.570 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:16.570 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:16.570 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.570 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:16.570 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.570 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:16.570 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:16.570 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:16.570 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:16.570 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:16.570 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:16.570 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:16.571 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:16.571 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:16.571 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:16.571 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:16.571 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:16.571 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:16.571 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:16.571 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:16.571 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:16.571 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:16.571 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:16.571 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:16.571 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:16.571 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:16.572 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:16.572 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:16.572 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:16.572 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:16.572 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:16.572 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:16.572 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:16.572 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:16.572 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:16.572 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:16.572 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:16.572 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:16.572 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:16.573 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:16.573 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:16.573 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:16.573 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:16.573 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:16.573 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:16.573 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.573 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.573 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.573 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:16.573 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.573 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:16.573 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.573 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:16.573 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:16.573 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:16.574 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:16.574 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:16.574 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:16.574 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.574 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:16.574 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:16.574 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:16.574 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:16.574 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:16.574 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:16.574 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.574 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:16.574 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:16.575 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:16.575 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:16.575 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:16.575 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:16.575 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:16.575 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:16.575 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:16.575 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:16.575 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:16.575 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.575 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.575 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:16.575 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:16.575 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:16.575 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:16.576 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:16.576 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.576 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.576 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:16.576 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:16.576 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:16.576 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:16.576 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:16.576 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.576 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:16.576 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:16.576 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:16.576 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:16.577 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:16.577 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:16.577 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.577 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:16.577 INFO:teuthology.orchestra.run.smithi003.stdout:___________ ERROR at teardown of test_bucketv2_policy_another_bucket ___________ 2023-12-03T13:00:16.577 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.577 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.577 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.577 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:16.577 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:16.577 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.577 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:16.577 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.577 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:16.577 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:16.578 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:16.578 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.578 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:16.578 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:16.578 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.578 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.578 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:16.578 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:16.578 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.578 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.578 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:16.578 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.578 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:16.578 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:16.579 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.579 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.579 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:16.579 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:16.579 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.579 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:16.579 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:16.579 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:16.579 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:16.579 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:16.579 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.579 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:16.579 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.579 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:16.580 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:16.580 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:16.580 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:16.580 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:16.580 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:16.580 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:16.580 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:16.580 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.580 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.580 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:16.580 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:16.580 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:16.580 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:16.580 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.580 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:16.580 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:16.581 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:16.581 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:16.581 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.581 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.581 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:16.581 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:16.581 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:16.581 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:16.581 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.581 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.581 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:16.581 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:16.581 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:16.581 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.582 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:16.582 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.582 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:16.582 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:16.582 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.582 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:16.582 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:16.582 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:16.582 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:16.582 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:16.582 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:16.582 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.582 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:16.582 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.582 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:16.583 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.583 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.583 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:16.583 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.583 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:16.583 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.583 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:16.583 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:16.583 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:16.583 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:16.583 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:16.583 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:16.583 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.583 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:16.584 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:16.584 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:16.584 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:16.584 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:16.584 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:16.584 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.584 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:16.584 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:16.584 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:16.584 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:16.584 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:16.584 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:16.584 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:16.584 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:16.584 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:16.585 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:16.585 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:16.585 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.585 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.585 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:16.585 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.585 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:16.585 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:16.585 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:16.585 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:16.585 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:16.585 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:16.585 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:16.585 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:16.586 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:16.586 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:16.586 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:16.586 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:16.586 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:16.586 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:16.586 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:16.586 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:16.586 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:16.586 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:16.586 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:16.586 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:16.586 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:16.586 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:16.587 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:16.587 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:16.587 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:16.587 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:16.587 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:16.587 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:16.587 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.587 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.587 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.587 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.587 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:16.587 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:16.587 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.587 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:16.587 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.588 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:16.588 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:16.588 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:16.588 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.588 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:16.588 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:16.588 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.588 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.588 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:16.588 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:16.588 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.588 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.588 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:16.588 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:16.588 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:16.589 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:16.589 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:16.589 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.589 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.589 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:16.589 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:16.589 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:16.589 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.589 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:16.589 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.589 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:16.589 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.589 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:16.590 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.590 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:16.590 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.590 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:16.590 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:16.590 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:16.590 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:16.590 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.590 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:16.590 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.590 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:16.590 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:16.590 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:16.591 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:16.591 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:16.591 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:16.591 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:16.591 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:16.591 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:16.591 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:16.591 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:16.591 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:16.591 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:16.591 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:16.591 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:16.591 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:16.591 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:16.592 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:16.592 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:16.592 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:16.592 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:16.592 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:16.592 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:16.592 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:16.592 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:16.592 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:16.592 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:16.592 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:16.592 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:16.592 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:16.593 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:16.593 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:16.593 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:16.593 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:16.593 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:16.593 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:16.593 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:16.593 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:16.593 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:16.593 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:16.593 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.593 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.593 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.593 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:16.593 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.594 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:16.594 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.594 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:16.594 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:16.594 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:16.594 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:16.594 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:16.594 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:16.594 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.594 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:16.594 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:16.594 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:16.594 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:16.594 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:16.594 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:16.595 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.595 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:16.595 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:16.595 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:16.595 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:16.595 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:16.595 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:16.595 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:16.595 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:16.595 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:16.595 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:16.595 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:16.595 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.595 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.596 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:16.596 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:16.596 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:16.596 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:16.596 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:16.596 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.596 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.596 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:16.596 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:16.596 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:16.596 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:16.596 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:16.596 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.596 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:16.596 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:16.597 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:16.597 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:16.597 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:16.597 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:16.597 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.597 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:16.597 INFO:teuthology.orchestra.run.smithi003.stdout:__________________ ERROR at teardown of test_get_obj_tagging ___________________ 2023-12-03T13:00:16.597 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.597 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.597 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.597 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:16.597 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:16.597 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.597 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:16.598 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.598 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:16.598 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:16.598 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:16.598 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.598 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:16.598 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:16.598 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.598 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.598 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:16.598 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:16.598 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.598 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.598 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:16.599 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.599 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:16.599 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:16.599 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.599 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.599 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:16.599 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:16.599 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.599 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:16.599 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:16.599 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:16.599 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:16.599 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:16.599 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.599 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:16.600 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.600 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:16.600 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:16.600 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:16.600 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:16.600 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:16.600 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:16.600 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:16.600 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:16.600 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.600 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.600 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:16.600 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:16.600 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:16.600 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:16.601 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.601 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:16.601 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:16.601 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:16.601 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:16.601 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.601 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.601 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:16.601 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:16.601 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:16.601 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:16.601 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.601 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.602 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:16.602 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:16.602 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:16.602 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.602 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:16.602 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.602 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:16.602 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:16.602 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.602 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:16.602 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:16.602 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:16.602 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:16.603 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:16.603 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:16.603 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.603 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:16.603 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.603 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:16.603 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.603 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.603 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:16.603 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.603 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:16.603 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.603 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:16.603 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:16.603 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:16.604 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:16.604 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:16.604 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:16.604 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.604 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:16.604 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:16.604 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:16.604 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:16.604 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:16.604 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:16.604 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.604 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:16.604 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:16.604 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:16.604 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:16.605 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:16.605 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:16.605 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:16.605 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:16.605 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:16.605 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:16.605 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:16.605 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.605 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.605 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:16.605 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.605 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:16.605 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:16.605 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:16.605 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:16.606 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:16.606 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:16.606 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:16.606 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:16.606 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:16.606 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:16.606 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:16.606 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:16.606 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:16.606 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:16.606 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:16.606 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:16.606 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:16.606 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:16.606 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:16.607 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:16.607 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:16.607 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:16.607 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:16.607 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:16.607 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:16.607 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:16.607 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:16.607 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:16.607 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.607 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.607 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.607 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.608 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:16.608 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:16.608 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.608 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:16.608 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.608 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:16.608 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:16.608 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:16.608 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.608 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:16.608 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:16.608 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.608 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.608 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:16.608 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:16.609 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.609 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.609 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:16.609 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:16.609 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:16.609 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:16.609 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:16.609 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.609 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.609 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:16.609 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:16.609 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:16.609 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.609 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:16.609 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.610 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:16.610 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.610 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:16.610 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.610 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:16.610 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.610 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:16.610 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:16.610 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:16.610 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:16.610 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.610 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:16.610 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.610 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:16.611 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:16.611 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:16.611 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:16.611 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:16.611 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:16.611 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:16.611 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:16.611 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:16.611 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:16.611 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:16.611 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:16.611 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:16.611 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:16.611 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:16.611 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:16.612 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:16.612 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:16.612 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:16.612 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:16.612 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:16.612 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:16.612 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:16.612 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:16.612 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:16.612 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:16.612 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:16.612 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:16.612 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:16.612 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:16.613 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:16.613 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:16.613 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:16.613 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:16.613 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:16.613 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:16.613 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:16.613 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:16.613 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:16.613 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:16.613 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.613 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.613 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.613 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:16.613 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.614 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:16.614 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.614 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:16.614 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:16.614 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:16.614 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:16.614 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:16.614 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:16.614 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.614 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:16.614 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:16.614 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:16.614 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:16.614 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:16.615 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:16.615 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.615 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:16.615 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:16.615 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:16.615 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:16.615 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:16.615 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:16.615 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:16.615 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:16.615 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:16.615 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:16.615 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:16.615 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.615 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.616 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:16.616 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:16.616 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:16.616 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:16.616 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:16.616 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.616 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.616 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:16.616 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:16.616 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:16.616 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:16.616 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:16.616 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.616 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:16.617 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:16.617 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:16.617 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:16.617 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:16.617 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:16.617 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.617 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:16.617 INFO:teuthology.orchestra.run.smithi003.stdout:________________ ERROR at teardown of test_get_obj_head_tagging ________________ 2023-12-03T13:00:16.617 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.617 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.617 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.617 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:16.617 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:16.617 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.617 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:16.618 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.618 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:16.618 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:16.618 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:16.618 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.618 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:16.618 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:16.618 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.618 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.618 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:16.618 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:16.618 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.618 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.618 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:16.618 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.619 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:16.619 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:16.619 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.619 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.619 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:16.619 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:16.619 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.619 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:16.619 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:16.619 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:16.619 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:16.619 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:16.619 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.619 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:16.619 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.620 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:16.620 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:16.620 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:16.620 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:16.620 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:16.620 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:16.620 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:16.620 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:16.620 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.620 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.620 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:16.620 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:16.620 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:16.620 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:16.620 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.621 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:16.621 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:16.621 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:16.621 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:16.621 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.621 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.621 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:16.621 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:16.621 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:16.621 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:16.621 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.621 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.621 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:16.621 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:16.622 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:16.622 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.622 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:16.622 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.622 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:16.622 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:16.622 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.622 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:16.622 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:16.622 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:16.622 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:16.622 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:16.622 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:16.622 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.622 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:16.623 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.623 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:16.623 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.623 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.623 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:16.623 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.623 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:16.623 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.623 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:16.623 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:16.623 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:16.623 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:16.623 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:16.623 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:16.623 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.624 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:16.624 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:16.624 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:16.624 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:16.624 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:16.624 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:16.624 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.624 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:16.624 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:16.624 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:16.624 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:16.624 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:16.624 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:16.624 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:16.624 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:16.625 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:16.625 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:16.625 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:16.625 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.625 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.625 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:16.625 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.625 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:16.625 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:16.625 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:16.625 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:16.625 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:16.625 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:16.626 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:16.626 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:16.626 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:16.626 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:16.626 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:16.626 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:16.626 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:16.626 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:16.626 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:16.626 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:16.626 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:16.626 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:16.626 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:16.626 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:16.627 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:16.627 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:16.627 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:16.627 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:16.627 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:16.627 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:16.627 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:16.627 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:16.627 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.627 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.627 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.627 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.627 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:16.627 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:16.627 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.628 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:16.628 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.628 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:16.628 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:16.628 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:16.628 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.628 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:16.628 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:16.628 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.628 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.628 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:16.628 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:16.628 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.628 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.628 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:16.629 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:16.629 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:16.629 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:16.629 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:16.629 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.629 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.629 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:16.629 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:16.629 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:16.629 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.629 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:16.629 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.629 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:16.629 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.629 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:16.630 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.630 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:16.630 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.630 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:16.630 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:16.630 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:16.630 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:16.630 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.630 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:16.630 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.630 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:16.630 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:16.630 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:16.630 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:16.631 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:16.631 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:16.631 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:16.631 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:16.631 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:16.631 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:16.631 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:16.631 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:16.631 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:16.631 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:16.631 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:16.631 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:16.631 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:16.631 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:16.632 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:16.632 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:16.632 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:16.632 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:16.632 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:16.632 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:16.632 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:16.632 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:16.632 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:16.632 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:16.632 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:16.632 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:16.632 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:16.632 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:16.632 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:16.632 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:16.633 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:16.633 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:16.633 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:16.633 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:16.633 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:16.633 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:16.633 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.633 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.633 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.633 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:16.633 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.633 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:16.633 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.633 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:16.634 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:16.634 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:16.634 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:16.634 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:16.634 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:16.634 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.634 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:16.634 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:16.634 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:16.634 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:16.634 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:16.634 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:16.634 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.634 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:16.635 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:16.635 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:16.635 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:16.635 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:16.635 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:16.635 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:16.635 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:16.635 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:16.635 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:16.635 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:16.635 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.635 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.635 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:16.635 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:16.636 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:16.636 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:16.636 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:16.636 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.636 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.636 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:16.636 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:16.636 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:16.636 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:16.636 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:16.636 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.636 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:16.636 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:16.636 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:16.636 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:16.636 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:16.637 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:16.637 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.637 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:16.637 INFO:teuthology.orchestra.run.smithi003.stdout:____________________ ERROR at teardown of test_put_max_tags ____________________ 2023-12-03T13:00:16.637 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.637 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.637 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.637 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:16.637 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:16.637 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.637 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:16.637 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.637 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:16.638 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:16.638 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:16.638 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.638 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:16.638 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:16.638 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.638 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.638 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:16.638 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:16.638 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.638 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.638 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:16.638 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.638 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:16.639 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:16.639 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.639 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.639 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:16.639 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:16.639 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.639 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:16.639 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:16.639 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:16.639 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:16.639 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:16.639 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.639 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:16.639 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.639 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:16.640 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:16.640 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:16.640 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:16.640 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:16.640 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:16.640 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:16.640 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:16.640 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.640 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.640 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:16.640 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:16.640 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:16.640 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:16.640 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.640 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:16.641 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:16.641 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:16.641 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:16.641 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.641 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.641 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:16.641 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:16.641 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:16.641 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:16.641 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.641 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.641 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:16.641 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:16.641 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:16.642 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.642 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:16.642 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.642 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:16.642 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:16.642 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.642 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:16.642 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:16.642 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:16.642 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:16.642 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:16.642 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:16.642 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.642 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:16.643 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.643 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:16.643 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.643 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.643 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:16.643 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.643 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:16.643 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.643 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:16.643 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:16.643 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:16.643 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:16.643 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:16.643 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:16.643 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.644 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:16.644 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:16.644 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:16.644 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:16.644 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:16.644 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:16.644 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.644 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:16.644 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:16.644 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:16.644 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:16.644 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:16.644 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:16.644 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:16.645 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:16.645 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:16.645 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:16.645 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:16.645 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.645 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.645 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:16.645 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.645 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:16.645 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:16.645 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:16.645 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:16.645 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:16.645 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:16.645 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:16.645 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:16.646 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:16.646 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:16.646 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:16.646 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:16.646 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:16.646 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:16.646 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:16.646 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:16.646 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:16.646 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:16.646 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:16.646 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:16.646 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:16.646 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:16.646 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:16.647 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:16.647 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:16.647 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:16.647 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:16.647 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:16.647 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.647 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.647 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.647 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.647 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:16.647 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:16.647 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.647 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:16.647 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.647 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:16.648 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:16.648 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:16.648 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.648 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:16.648 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:16.648 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.648 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.648 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:16.648 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:16.648 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.648 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.648 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:16.648 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:16.648 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:16.648 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:16.649 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:16.649 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.649 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.649 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:16.649 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:16.649 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:16.649 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.649 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:16.649 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.649 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:16.649 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.649 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:16.649 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.649 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:16.650 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.650 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:16.650 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:16.650 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:16.650 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:16.650 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.650 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:16.650 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.650 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:16.650 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:16.650 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:16.650 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:16.650 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:16.650 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:16.650 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:16.651 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:16.651 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:16.651 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:16.651 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:16.651 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:16.651 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:16.651 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:16.651 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:16.651 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:16.651 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:16.651 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:16.651 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:16.651 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:16.651 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:16.652 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:16.652 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:16.652 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:16.652 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:16.652 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:16.652 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:16.652 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:16.652 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:16.652 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:16.652 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:16.652 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:16.652 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:16.652 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:16.652 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:16.653 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:16.653 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:16.653 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:16.653 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:16.653 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:16.653 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.653 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.653 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.653 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:16.653 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.653 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:16.653 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.653 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:16.653 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:16.653 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:16.654 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:16.654 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:16.654 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:16.654 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.654 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:16.654 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:16.654 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:16.654 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:16.654 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:16.654 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:16.654 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.654 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:16.654 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:16.654 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:16.655 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:16.655 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:16.655 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:16.655 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:16.655 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:16.655 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:16.655 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:16.655 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:16.655 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.655 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.655 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:16.655 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:16.655 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:16.655 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:16.655 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:16.655 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.655 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.656 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:16.656 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:16.656 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:16.656 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:16.656 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:16.656 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.656 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:16.656 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:16.656 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:16.656 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:16.656 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:16.656 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:16.656 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.656 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:16.656 INFO:teuthology.orchestra.run.smithi003.stdout:__________________ ERROR at teardown of test_put_excess_tags ___________________ 2023-12-03T13:00:16.657 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.657 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.657 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.657 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:16.657 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:16.657 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.657 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:16.657 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.657 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:16.657 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:16.657 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:16.657 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.657 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:16.657 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:16.657 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.658 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.658 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:16.658 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:16.658 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.658 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.658 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:16.658 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.658 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:16.658 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:16.658 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.658 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.658 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:16.658 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:16.658 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.658 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:16.659 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:16.659 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:16.659 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:16.659 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:16.659 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.659 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:16.659 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.659 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:16.659 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:16.659 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:16.659 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:16.659 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:16.659 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:16.659 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:16.659 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:16.660 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.660 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.660 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:16.660 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:16.660 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:16.660 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:16.660 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.660 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:16.660 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:16.660 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:16.660 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:16.660 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.660 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.660 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:16.660 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:16.660 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:16.661 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:16.661 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.661 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.661 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:16.661 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:16.661 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:16.661 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.661 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:16.661 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.661 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:16.661 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:16.661 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.662 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:16.662 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:16.662 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:16.662 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:16.662 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:16.662 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:16.662 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.662 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:16.662 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.662 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:16.662 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.662 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.662 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:16.662 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.663 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:16.663 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.663 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:16.663 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:16.663 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:16.663 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:16.663 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:16.663 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:16.663 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.663 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:16.663 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:16.663 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:16.663 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:16.663 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:16.663 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:16.664 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.664 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:16.664 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:16.664 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:16.664 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:16.664 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:16.664 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:16.664 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:16.664 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:16.664 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:16.664 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:16.664 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:16.664 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.664 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.664 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:16.664 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.665 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:16.665 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:16.665 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:16.665 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:16.665 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:16.665 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:16.665 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:16.665 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:16.665 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:16.665 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:16.665 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:16.665 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:16.665 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:16.665 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:16.665 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:16.665 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:16.666 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:16.666 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:16.666 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:16.666 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:16.666 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:16.666 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:16.666 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:16.666 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:16.666 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:16.666 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:16.666 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:16.666 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:16.666 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.666 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.667 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.667 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.667 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:16.667 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:16.667 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.667 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:16.667 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.667 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:16.667 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:16.667 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:16.667 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.667 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:16.667 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:16.667 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.667 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.668 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:16.668 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:16.668 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.668 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.668 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:16.668 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:16.668 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:16.668 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:16.668 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:16.668 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.668 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.668 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:16.668 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:16.668 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:16.668 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.669 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:16.669 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.669 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:16.669 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.669 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:16.669 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.669 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:16.669 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.669 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:16.669 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:16.669 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:16.669 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:16.669 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.669 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:16.669 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.670 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:16.670 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:16.670 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:16.670 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:16.670 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:16.670 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:16.670 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:16.670 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:16.670 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:16.670 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:16.670 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:16.670 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:16.670 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:16.670 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:16.671 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:16.671 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:16.671 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:16.671 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:16.671 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:16.671 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:16.671 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:16.671 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:16.671 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:16.671 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:16.671 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:16.671 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:16.671 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:16.671 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:16.672 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:16.672 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:16.672 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:16.672 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:16.672 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:16.672 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:16.672 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:16.672 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:16.672 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:16.672 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:16.672 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:16.672 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:16.673 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.673 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.673 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.673 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:16.673 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.673 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:16.673 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.673 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:16.673 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:16.673 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:16.673 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:16.673 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:16.673 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:16.673 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.674 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:16.674 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:16.674 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:16.674 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:16.674 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:16.674 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:16.674 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.674 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:16.674 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:16.674 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:16.674 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:16.674 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:16.674 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:16.674 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:16.674 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:16.675 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:16.675 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:16.675 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:16.675 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.675 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.675 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:16.675 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:16.675 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:16.675 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:16.675 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:16.675 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.675 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.675 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:16.675 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:16.676 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:16.676 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:16.676 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:16.676 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.676 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:16.676 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:16.676 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:16.676 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:16.676 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:16.676 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:16.676 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.676 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:16.676 INFO:teuthology.orchestra.run.smithi003.stdout:________________ ERROR at teardown of test_put_max_kvsize_tags _________________ 2023-12-03T13:00:16.676 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.676 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.677 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.677 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:16.677 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:16.677 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.677 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:16.677 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.677 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:16.677 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:16.677 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:16.677 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.677 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:16.677 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:16.677 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.677 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.677 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:16.678 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:16.678 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.678 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.678 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:16.678 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.678 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:16.678 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:16.678 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.678 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.678 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:16.678 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:16.678 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.678 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:16.678 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:16.679 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:16.679 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:16.679 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:16.679 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.679 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:16.679 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.679 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:16.679 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:16.679 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:16.679 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:16.679 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:16.679 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:16.679 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:16.679 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:16.680 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.680 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.680 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:16.680 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:16.680 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:16.680 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:16.680 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.680 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:16.680 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:16.680 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:16.680 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:16.680 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.680 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.680 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:16.681 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:16.681 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:16.681 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:16.681 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.681 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.681 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:16.681 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:16.681 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:16.681 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.681 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:16.681 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.681 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:16.681 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:16.681 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.681 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:16.682 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:16.682 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:16.682 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:16.682 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:16.682 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:16.682 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.682 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:16.682 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.682 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:16.682 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.682 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.682 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:16.682 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.683 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:16.683 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.683 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:16.683 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:16.683 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:16.683 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:16.683 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:16.683 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:16.683 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.683 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:16.683 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:16.683 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:16.683 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:16.683 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:16.683 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:16.683 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.684 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:16.684 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:16.684 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:16.684 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:16.684 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:16.684 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:16.684 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:16.684 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:16.684 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:16.684 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:16.684 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:16.684 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.684 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.684 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:16.685 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.685 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:16.685 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:16.685 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:16.685 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:16.685 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:16.685 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:16.685 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:16.685 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:16.685 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:16.685 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:16.685 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:16.685 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:16.686 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:16.686 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:16.686 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:16.686 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:16.686 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:16.686 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:16.686 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:16.686 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:16.686 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:16.686 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:16.686 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:16.686 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:16.686 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:16.687 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:16.687 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:16.687 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:16.687 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.687 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.687 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.687 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.687 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:16.687 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:16.687 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.687 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:16.687 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.687 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:16.687 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:16.687 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:16.687 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.688 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:16.688 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:16.688 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.688 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.688 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:16.688 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:16.688 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.688 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.688 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:16.688 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:16.688 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:16.688 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:16.688 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:16.688 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.689 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.689 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:16.689 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:16.689 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:16.689 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.689 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:16.689 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.689 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:16.689 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.689 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:16.689 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.689 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:16.689 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.689 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:16.690 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:16.690 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:16.690 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:16.690 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.690 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:16.690 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.690 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:16.690 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:16.690 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:16.690 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:16.690 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:16.690 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:16.690 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:16.690 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:16.691 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:16.691 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:16.691 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:16.691 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:16.691 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:16.691 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:16.691 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:16.691 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:16.691 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:16.691 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:16.691 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:16.691 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:16.691 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:16.691 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:16.692 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:16.692 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:16.692 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:16.692 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:16.692 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:16.692 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:16.692 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:16.692 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:16.692 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:16.692 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:16.692 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:16.692 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:16.692 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:16.692 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:16.692 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:16.693 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:16.693 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:16.693 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:16.693 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.693 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.693 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.693 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:16.693 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.693 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:16.693 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.693 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:16.693 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:16.693 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:16.693 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:16.694 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:16.694 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:16.694 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.694 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:16.694 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:16.694 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:16.694 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:16.694 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:16.694 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:16.694 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.694 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:16.694 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:16.694 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:16.694 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:16.694 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:16.695 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:16.695 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:16.695 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:16.695 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:16.695 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:16.695 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:16.695 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.695 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.695 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:16.695 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:16.695 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:16.695 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:16.695 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:16.695 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.695 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.696 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:16.696 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:16.696 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:16.696 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:16.696 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:16.696 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.696 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:16.696 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:16.696 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:16.696 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:16.696 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:16.697 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:16.697 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.697 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:16.697 INFO:teuthology.orchestra.run.smithi003.stdout:________________ ERROR at teardown of test_put_excess_key_tags _________________ 2023-12-03T13:00:16.697 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.697 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.697 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.697 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:16.697 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:16.697 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.697 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:16.698 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.698 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:16.698 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:16.698 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:16.698 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.698 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:16.698 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:16.698 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.698 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.698 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:16.698 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:16.698 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.698 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.699 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:16.699 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.699 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:16.699 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:16.699 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.699 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.699 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:16.699 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:16.699 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.699 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:16.699 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:16.699 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:16.699 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:16.699 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:16.700 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.700 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:16.700 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.700 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:16.700 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:16.700 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:16.700 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:16.700 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:16.700 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:16.700 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:16.700 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:16.700 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.700 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.701 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:16.701 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:16.701 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:16.701 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:16.701 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.701 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:16.701 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:16.701 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:16.701 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:16.701 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.701 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.701 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:16.701 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:16.701 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:16.702 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:16.702 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.702 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.702 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:16.702 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:16.702 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:16.702 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.702 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:16.702 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.702 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:16.702 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:16.702 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.702 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:16.702 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:16.702 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:16.703 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:16.703 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:16.703 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:16.703 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.703 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:16.703 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.703 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:16.703 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.703 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.703 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:16.703 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.703 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:16.703 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.703 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:16.704 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:16.704 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:16.704 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:16.704 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:16.704 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:16.704 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.704 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:16.704 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:16.704 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:16.704 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:16.704 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:16.704 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:16.704 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.704 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:16.704 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:16.705 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:16.705 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:16.705 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:16.705 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:16.705 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:16.705 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:16.705 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:16.705 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:16.705 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:16.705 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.705 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.705 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:16.705 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.705 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:16.705 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:16.705 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:16.706 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:16.706 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:16.706 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:16.706 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:16.706 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:16.706 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:16.706 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:16.706 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:16.706 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:16.706 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:16.706 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:16.706 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:16.706 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:16.706 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:16.707 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:16.707 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:16.707 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:16.707 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:16.707 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:16.707 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:16.707 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:16.707 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:16.707 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:16.707 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:16.707 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:16.707 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.707 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.707 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.707 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.708 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:16.708 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:16.708 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.708 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:16.708 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.708 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:16.708 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:16.708 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:16.708 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.708 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:16.708 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:16.708 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.708 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.708 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:16.709 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:16.709 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.709 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.709 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:16.709 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:16.709 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:16.709 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:16.709 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:16.709 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.709 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.709 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:16.709 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:16.709 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:16.709 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.709 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:16.710 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.710 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:16.710 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.710 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:16.710 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.710 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:16.710 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.710 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:16.710 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:16.710 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:16.710 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:16.710 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.711 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:16.711 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.711 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:16.711 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:16.711 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:16.711 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:16.711 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:16.711 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:16.711 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:16.711 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:16.711 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:16.711 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:16.711 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:16.711 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:16.711 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:16.712 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:16.712 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:16.712 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:16.712 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:16.712 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:16.712 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:16.712 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:16.712 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:16.712 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:16.712 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:16.712 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:16.712 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:16.712 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:16.712 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:16.712 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:16.713 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:16.713 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:16.713 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:16.713 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:16.713 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:16.713 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:16.713 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:16.713 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:16.713 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:16.713 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:16.713 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:16.713 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:16.713 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.713 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.713 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.714 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:16.714 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.714 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:16.714 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.714 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:16.714 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:16.714 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:16.714 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:16.714 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:16.714 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:16.714 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.714 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:16.714 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:16.714 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:16.715 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:16.715 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:16.715 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:16.715 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.715 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:16.715 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:16.715 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:16.715 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:16.715 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:16.715 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:16.715 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:16.715 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:16.715 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:16.715 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:16.715 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:16.715 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.716 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.716 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:16.716 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:16.716 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:16.716 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:16.716 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:16.716 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.716 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.716 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:16.716 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:16.716 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:16.716 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:16.716 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:16.716 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.717 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:16.717 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:16.717 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:16.717 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:16.717 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:16.717 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:16.717 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.717 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:16.717 INFO:teuthology.orchestra.run.smithi003.stdout:________________ ERROR at teardown of test_put_excess_val_tags _________________ 2023-12-03T13:00:16.717 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.717 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.717 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.717 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:16.717 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:16.718 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.718 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:16.718 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.718 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:16.718 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:16.718 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:16.718 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.718 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:16.718 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:16.718 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.718 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.718 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:16.718 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:16.719 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.719 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.719 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:16.719 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.719 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:16.719 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:16.719 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.719 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.719 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:16.719 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:16.719 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.719 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:16.719 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:16.719 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:16.720 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:16.720 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:16.720 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.720 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:16.720 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.720 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:16.720 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:16.720 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:16.720 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:16.720 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:16.720 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:16.720 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:16.720 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:16.720 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.721 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.721 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:16.721 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:16.721 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:16.721 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:16.721 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.721 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:16.721 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:16.721 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:16.721 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:16.721 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.721 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.721 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:16.721 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:16.722 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:16.722 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:16.722 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.722 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.722 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:16.722 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:16.722 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:16.722 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.722 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:16.722 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.722 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:16.722 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:16.722 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.723 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:16.723 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:16.723 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:16.723 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:16.723 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:16.723 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:16.723 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.723 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:16.723 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.723 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:16.723 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.723 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.723 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:16.723 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.724 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:16.724 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.724 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:16.724 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:16.724 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:16.724 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:16.724 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:16.724 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:16.724 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.724 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:16.724 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:16.724 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:16.724 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:16.724 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:16.724 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:16.725 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.725 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:16.725 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:16.725 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:16.725 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:16.725 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:16.725 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:16.725 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:16.725 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:16.725 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:16.725 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:16.725 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:16.725 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.725 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.725 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:16.726 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.726 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:16.726 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:16.726 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:16.726 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:16.726 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:16.726 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:16.726 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:16.726 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:16.726 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:16.726 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:16.726 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:16.726 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:16.726 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:16.726 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:16.727 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:16.727 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:16.727 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:16.727 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:16.727 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:16.727 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:16.727 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:16.727 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:16.727 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:16.727 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:16.727 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:16.727 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:16.727 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:16.727 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:16.728 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.728 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.728 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.728 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.728 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:16.728 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:16.728 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.728 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:16.728 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.728 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:16.728 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:16.728 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:16.728 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.728 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:16.728 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:16.729 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.729 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.729 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:16.729 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:16.729 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.729 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.729 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:16.729 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:16.729 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:16.729 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:16.729 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:16.729 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.729 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.729 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:16.729 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:16.729 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:16.730 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.730 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:16.730 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.730 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:16.730 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.730 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:16.730 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.730 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:16.730 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.730 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:16.730 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:16.730 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:16.730 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:16.730 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.731 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:16.731 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.731 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:16.731 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:16.731 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:16.731 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:16.731 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:16.731 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:16.731 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:16.731 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:16.731 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:16.731 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:16.731 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:16.731 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:16.732 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:16.732 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:16.732 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:16.732 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:16.732 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:16.732 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:16.732 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:16.732 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:16.732 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:16.732 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:16.732 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:16.732 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:16.732 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:16.732 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:16.732 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:16.733 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:16.733 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:16.733 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:16.733 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:16.733 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:16.733 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:16.733 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:16.733 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:16.733 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:16.733 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:16.733 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:16.733 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:16.733 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:16.733 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.734 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.734 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.734 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:16.734 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.734 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:16.734 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.734 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:16.734 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:16.734 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:16.734 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:16.734 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:16.734 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:16.734 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.734 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:16.735 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:16.735 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:16.735 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:16.735 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:16.735 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:16.735 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.735 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:16.735 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:16.735 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:16.735 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:16.735 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:16.735 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:16.735 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:16.735 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:16.735 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:16.736 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:16.736 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:16.736 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.736 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.736 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:16.736 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:16.736 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:16.736 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:16.736 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:16.736 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.736 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.736 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:16.736 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:16.736 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:16.737 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:16.737 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:16.737 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.737 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:16.737 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:16.737 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:16.737 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:16.737 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:16.737 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:16.737 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.737 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:16.737 INFO:teuthology.orchestra.run.smithi003.stdout:__________________ ERROR at teardown of test_put_modify_tags ___________________ 2023-12-03T13:00:16.737 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.737 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.737 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.737 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:16.738 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:16.738 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.738 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:16.738 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.738 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:16.738 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:16.738 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:16.738 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.738 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:16.738 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:16.738 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.738 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.738 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:16.738 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:16.738 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.738 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.739 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:16.739 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.739 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:16.739 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:16.739 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.739 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.739 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:16.739 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:16.739 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.739 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:16.739 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:16.739 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:16.739 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:16.740 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:16.740 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.740 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:16.740 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.740 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:16.740 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:16.740 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:16.740 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:16.740 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:16.740 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:16.740 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:16.740 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:16.740 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.740 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.740 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:16.741 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:16.741 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:16.741 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:16.741 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.741 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:16.741 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:16.741 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:16.741 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:16.741 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.741 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.741 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:16.741 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:16.741 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:16.741 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:16.742 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.742 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.742 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:16.742 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:16.742 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:16.742 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.742 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:16.742 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.742 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:16.742 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:16.742 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.742 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:16.742 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:16.743 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:16.743 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:16.743 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:16.743 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:16.743 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.743 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:16.743 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.743 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:16.743 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.743 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.743 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:16.743 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.743 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:16.743 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.743 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:16.743 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:16.744 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:16.744 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:16.744 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:16.744 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:16.744 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.744 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:16.744 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:16.744 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:16.744 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:16.744 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:16.744 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:16.744 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.744 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:16.744 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:16.744 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:16.745 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:16.745 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:16.745 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:16.745 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:16.745 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:16.745 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:16.745 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:16.745 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:16.745 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.745 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.745 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:16.745 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.745 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:16.745 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:16.745 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:16.746 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:16.746 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:16.746 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:16.746 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:16.746 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:16.746 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:16.746 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:16.746 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:16.746 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:16.746 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:16.746 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:16.746 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:16.747 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:16.747 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:16.747 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:16.747 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:16.747 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:16.747 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:16.747 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:16.747 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:16.747 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:16.747 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:16.747 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:16.747 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:16.747 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:16.747 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.747 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.747 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.747 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.748 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:16.748 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:16.748 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.748 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:16.748 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.748 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:16.748 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:16.748 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:16.748 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.748 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:16.748 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:16.748 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.748 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.748 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:16.748 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:16.749 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.749 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.749 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:16.749 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:16.749 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:16.749 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:16.749 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:16.749 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.749 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.749 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:16.749 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:16.749 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:16.749 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.749 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:16.749 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.750 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:16.750 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.750 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:16.750 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.750 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:16.750 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.750 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:16.750 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:16.750 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:16.750 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:16.750 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.750 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:16.750 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.751 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:16.751 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:16.751 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:16.751 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:16.751 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:16.751 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:16.751 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:16.751 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:16.751 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:16.751 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:16.751 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:16.751 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:16.751 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:16.751 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:16.751 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:16.752 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:16.752 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:16.752 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:16.752 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:16.752 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:16.752 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:16.752 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:16.752 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:16.752 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:16.752 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:16.752 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:16.752 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:16.752 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:16.752 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:16.752 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:16.753 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:16.753 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:16.753 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:16.753 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:16.753 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:16.753 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:16.753 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:16.753 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:16.753 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:16.753 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:16.753 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.753 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.753 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.753 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:16.753 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.753 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:16.754 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.754 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:16.754 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:16.754 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:16.754 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:16.754 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:16.754 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:16.754 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.754 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:16.754 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:16.754 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:16.754 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:16.754 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:16.754 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:16.755 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.755 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:16.755 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:16.755 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:16.755 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:16.755 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:16.755 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:16.755 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:16.755 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:16.755 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:16.755 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:16.755 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:16.755 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.755 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.755 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:16.756 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:16.756 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:16.756 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:16.756 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:16.756 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.756 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.756 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:16.756 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:16.756 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:16.756 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:16.756 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:16.756 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.756 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:16.756 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:16.756 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:16.756 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:16.757 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:16.757 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:16.757 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.757 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:16.757 INFO:teuthology.orchestra.run.smithi003.stdout:__________________ ERROR at teardown of test_put_delete_tags ___________________ 2023-12-03T13:00:16.757 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.757 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.757 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.757 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:16.757 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:16.757 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.757 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:16.757 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.757 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:16.757 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:16.758 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:16.758 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.758 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:16.758 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:16.758 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.758 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.758 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:16.758 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:16.758 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.758 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.758 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:16.758 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.758 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:16.758 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:16.759 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.759 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.759 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:16.759 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:16.759 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.759 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:16.759 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:16.759 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:16.759 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:16.759 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:16.759 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.759 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:16.759 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.759 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:16.759 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:16.760 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:16.760 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:16.760 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:16.760 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:16.760 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:16.760 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:16.760 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.760 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.760 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:16.760 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:16.760 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:16.760 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:16.760 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.760 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:16.761 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:16.761 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:16.761 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:16.761 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.761 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.761 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:16.761 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:16.761 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:16.761 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:16.761 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.761 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.761 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:16.761 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:16.761 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:16.762 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.762 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:16.762 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.762 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:16.762 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:16.762 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.762 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:16.762 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:16.762 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:16.762 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:16.762 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:16.762 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:16.762 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.762 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:16.763 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.763 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:16.763 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.763 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.763 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:16.763 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.763 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:16.763 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.763 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:16.763 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:16.763 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:16.763 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:16.763 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:16.763 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:16.763 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.764 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:16.764 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:16.764 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:16.764 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:16.764 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:16.764 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:16.764 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.764 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:16.764 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:16.764 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:16.764 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:16.764 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:16.764 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:16.764 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:16.765 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:16.765 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:16.765 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:16.765 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:16.765 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.765 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.765 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:16.765 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.765 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:16.765 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:16.765 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:16.765 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:16.765 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:16.765 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:16.765 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:16.766 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:16.766 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:16.766 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:16.766 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:16.766 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:16.766 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:16.766 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:16.766 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:16.766 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:16.766 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:16.766 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:16.766 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:16.766 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:16.766 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:16.766 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:16.767 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:16.767 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:16.767 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:16.767 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:16.767 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:16.767 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:16.767 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.767 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.767 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.767 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.767 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:16.767 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:16.767 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.767 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:16.768 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.768 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:16.768 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:16.768 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:16.768 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.768 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:16.768 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:16.768 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.768 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.768 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:16.768 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:16.768 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.768 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.768 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:16.768 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:16.769 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:16.769 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:16.769 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:16.769 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.769 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.769 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:16.769 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:16.769 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:16.769 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.769 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:16.769 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.769 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:16.769 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.769 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:16.770 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.770 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:16.770 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.770 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:16.770 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:16.770 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:16.770 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:16.770 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.770 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:16.770 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.770 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:16.770 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:16.770 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:16.771 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:16.771 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:16.771 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:16.771 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:16.771 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:16.771 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:16.771 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:16.771 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:16.771 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:16.771 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:16.771 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:16.771 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:16.771 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:16.771 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:16.771 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:16.772 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:16.772 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:16.772 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:16.772 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:16.772 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:16.772 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:16.772 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:16.772 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:16.772 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:16.772 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:16.772 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:16.772 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:16.772 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:16.772 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:16.773 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:16.773 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:16.773 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:16.773 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:16.773 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:16.773 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:16.773 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:16.773 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:16.773 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.773 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.773 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.773 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:16.773 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.773 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:16.773 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.774 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:16.774 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:16.774 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:16.774 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:16.774 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:16.774 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:16.774 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.774 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:16.774 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:16.774 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:16.774 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:16.774 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:16.774 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:16.774 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.774 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:16.774 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:16.775 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:16.775 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:16.775 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:16.775 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:16.775 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:16.775 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:16.775 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:16.775 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:16.775 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:16.775 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.775 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.775 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:16.775 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:16.775 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:16.775 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:16.776 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:16.776 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.776 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.776 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:16.776 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:16.776 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:16.776 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:16.776 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:16.776 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.776 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:16.776 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:16.776 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:16.776 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:16.776 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:16.776 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:16.776 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.777 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:16.777 INFO:teuthology.orchestra.run.smithi003.stdout:_________ ERROR at teardown of test_post_object_tags_anonymous_request _________ 2023-12-03T13:00:16.777 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.777 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.777 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.777 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:16.777 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:16.777 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.777 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:16.777 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.777 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:16.777 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:16.777 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:16.777 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.777 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:16.778 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:16.778 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.778 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.778 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:16.778 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:16.778 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.778 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.778 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:16.778 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.778 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:16.778 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:16.778 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.778 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.778 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:16.778 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:16.779 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.779 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:16.779 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:16.779 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:16.779 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:16.779 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:16.779 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.779 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:16.779 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.779 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:16.779 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:16.779 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:16.779 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:16.779 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:16.779 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:16.779 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:16.780 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:16.780 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.780 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.780 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:16.780 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:16.780 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:16.780 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:16.780 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.780 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:16.780 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:16.780 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:16.780 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:16.780 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.780 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.780 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:16.781 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:16.781 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:16.781 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:16.781 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.781 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.781 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:16.781 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:16.781 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:16.781 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.781 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:16.781 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.781 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:16.781 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:16.782 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.782 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:16.782 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:16.782 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:16.782 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:16.782 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:16.782 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:16.782 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.782 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:16.782 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.782 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:16.782 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.782 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.783 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:16.783 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.783 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:16.783 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.783 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:16.783 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:16.783 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:16.783 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:16.783 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:16.783 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:16.783 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.783 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:16.783 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:16.783 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:16.783 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:16.784 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:16.784 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:16.784 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.784 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:16.784 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:16.784 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:16.784 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:16.784 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:16.784 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:16.784 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:16.784 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:16.784 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:16.784 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:16.784 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:16.784 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.784 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.785 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:16.785 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.785 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:16.785 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:16.785 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:16.785 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:16.785 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:16.785 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:16.785 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:16.785 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:16.785 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:16.785 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:16.785 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:16.785 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:16.785 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:16.786 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:16.786 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:16.786 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:16.786 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:16.786 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:16.786 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:16.786 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:16.786 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:16.786 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:16.786 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:16.786 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:16.786 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:16.786 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:16.786 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:16.787 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:16.787 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.787 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.787 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.787 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.787 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:16.787 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:16.787 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.787 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:16.787 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.787 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:16.787 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:16.787 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:16.787 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.788 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:16.788 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:16.788 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.788 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.788 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:16.788 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:16.788 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.788 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.788 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:16.788 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:16.788 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:16.788 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:16.788 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:16.788 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.788 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.788 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:16.789 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:16.789 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:16.789 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.789 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:16.789 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.789 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:16.789 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.789 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:16.789 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.789 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:16.789 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.789 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:16.789 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:16.789 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:16.789 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:16.790 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.790 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:16.790 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.790 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:16.790 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:16.790 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:16.790 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:16.790 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:16.790 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:16.790 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:16.790 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:16.790 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:16.790 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:16.790 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:16.791 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:16.791 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:16.791 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:16.791 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:16.791 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:16.791 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:16.791 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:16.791 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:16.791 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:16.791 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:16.791 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:16.791 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:16.791 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:16.791 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:16.791 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:16.792 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:16.792 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:16.792 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:16.792 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:16.792 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:16.792 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:16.792 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:16.792 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:16.792 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:16.792 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:16.792 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:16.792 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:16.792 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:16.792 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:16.792 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.792 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.793 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.793 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:16.793 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.793 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:16.793 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.793 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:16.793 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:16.793 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:16.793 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:16.793 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:16.793 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:16.793 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.793 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:16.794 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:16.794 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:16.794 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:16.794 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:16.794 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:16.794 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.794 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:16.794 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:16.794 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:16.794 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:16.794 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:16.794 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:16.794 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:16.794 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:16.794 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:16.795 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:16.795 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:16.795 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.795 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.795 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:16.795 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:16.795 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:16.795 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:16.795 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:16.795 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.795 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.795 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:16.795 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:16.795 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:16.796 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:16.796 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:16.796 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.796 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:16.796 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:16.796 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:16.796 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:16.796 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:16.796 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:16.796 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.796 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:16.796 INFO:teuthology.orchestra.run.smithi003.stdout:_______ ERROR at teardown of test_post_object_tags_authenticated_request _______ 2023-12-03T13:00:16.796 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.796 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.797 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.797 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:16.797 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:16.797 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.797 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:16.797 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.797 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:16.797 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:16.797 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:16.797 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.797 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:16.797 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:16.797 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.797 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.797 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:16.797 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:16.798 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.798 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.798 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:16.798 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.798 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:16.798 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:16.798 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.798 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.798 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:16.798 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:16.798 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.798 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:16.798 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:16.798 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:16.798 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:16.799 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:16.799 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.799 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:16.799 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.799 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:16.799 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:16.799 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:16.799 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:16.799 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:16.799 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:16.799 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:16.799 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:16.799 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.799 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.800 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:16.800 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:16.800 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:16.800 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:16.800 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.800 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:16.800 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:16.800 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:16.800 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:16.800 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.800 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.800 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:16.800 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:16.800 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:16.801 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:16.801 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.801 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.801 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:16.801 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:16.801 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:16.801 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.801 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:16.801 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.801 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:16.801 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:16.801 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.801 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:16.801 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:16.802 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:16.802 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:16.802 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:16.802 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:16.802 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.802 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:16.802 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.802 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:16.802 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.802 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.802 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:16.802 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.802 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:16.802 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.803 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:16.803 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:16.803 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:16.803 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:16.803 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:16.803 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:16.803 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.803 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:16.803 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:16.803 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:16.803 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:16.803 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:16.803 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:16.803 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.803 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:16.804 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:16.804 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:16.804 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:16.804 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:16.804 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:16.804 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:16.804 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:16.804 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:16.804 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:16.804 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:16.804 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.804 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.804 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:16.804 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.804 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:16.805 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:16.805 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:16.805 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:16.805 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:16.805 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:16.805 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:16.805 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:16.805 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:16.805 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:16.805 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:16.805 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:16.805 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:16.805 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:16.806 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:16.806 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:16.806 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:16.806 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:16.806 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:16.806 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:16.806 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:16.806 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:16.806 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:16.806 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:16.806 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:16.806 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:16.806 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:16.806 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:16.807 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.807 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.807 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.807 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.807 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:16.807 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:16.807 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.807 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:16.807 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.807 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:16.807 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:16.807 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:16.807 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.807 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:16.807 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:16.808 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.808 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.808 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:16.808 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:16.808 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.808 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.808 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:16.808 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:16.808 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:16.808 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:16.808 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:16.808 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.808 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.808 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:16.808 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:16.809 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:16.809 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.809 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:16.809 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.809 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:16.809 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.809 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:16.809 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.809 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:16.809 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.809 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:16.809 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:16.809 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:16.809 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:16.809 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.809 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:16.810 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.810 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:16.810 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:16.810 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:16.810 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:16.810 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:16.810 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:16.810 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:16.810 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:16.810 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:16.810 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:16.810 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:16.810 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:16.811 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:16.811 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:16.811 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:16.811 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:16.811 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:16.811 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:16.811 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:16.811 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:16.811 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:16.811 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:16.811 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:16.811 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:16.811 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:16.811 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:16.812 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:16.812 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:16.812 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:16.812 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:16.812 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:16.812 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:16.812 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:16.812 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:16.812 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:16.812 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:16.812 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:16.812 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:16.812 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:16.812 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:16.812 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.813 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.813 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.813 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:16.813 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.813 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:16.813 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.813 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:16.813 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:16.813 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:16.813 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:16.813 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:16.813 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:16.813 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.813 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:16.814 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:16.814 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:16.814 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:16.814 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:16.814 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:16.814 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.814 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:16.814 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:16.814 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:16.814 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:16.814 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:16.814 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:16.814 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:16.814 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:16.815 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:16.815 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:16.815 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:16.815 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.815 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.815 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:16.815 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:16.815 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:16.815 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:16.815 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:16.815 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.815 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.815 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:16.815 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:16.815 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:16.816 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:16.816 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:16.816 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.816 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:16.816 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:16.816 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:16.816 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:16.816 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:16.816 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:16.816 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.816 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:16.816 INFO:teuthology.orchestra.run.smithi003.stdout:_________________ ERROR at teardown of test_put_obj_with_tags __________________ 2023-12-03T13:00:16.816 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.816 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.816 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.817 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:16.817 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:16.817 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.817 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:16.817 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.817 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:16.817 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:16.817 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:16.817 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.817 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:16.817 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:16.817 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.817 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.817 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:16.818 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:16.818 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.818 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.818 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:16.818 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.818 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:16.818 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:16.818 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.818 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.818 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:16.818 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:16.818 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.818 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:16.818 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:16.818 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:16.819 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:16.819 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:16.819 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.819 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:16.819 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.819 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:16.819 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:16.819 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:16.819 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:16.819 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:16.819 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:16.819 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:16.819 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:16.820 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.820 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.820 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:16.820 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:16.820 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:16.820 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:16.820 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.820 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:16.820 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:16.820 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:16.820 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:16.820 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.820 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.820 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:16.820 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:16.821 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:16.821 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:16.821 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.821 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.821 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:16.821 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:16.821 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:16.821 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.821 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:16.821 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.821 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:16.821 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:16.821 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.821 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:16.821 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:16.822 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:16.822 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:16.822 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:16.822 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:16.822 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.822 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:16.822 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.822 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:16.822 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.822 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.822 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:16.822 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.822 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:16.822 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.823 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:16.823 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:16.823 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:16.823 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:16.823 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:16.823 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:16.823 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.823 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:16.823 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:16.823 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:16.823 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:16.823 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:16.823 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:16.823 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.824 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:16.824 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:16.824 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:16.824 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:16.824 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:16.824 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:16.824 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:16.824 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:16.824 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:16.824 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:16.824 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:16.824 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.824 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.824 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:16.824 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.824 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:16.825 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:16.825 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:16.825 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:16.825 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:16.825 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:16.825 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:16.825 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:16.825 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:16.825 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:16.825 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:16.825 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:16.825 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:16.825 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:16.825 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:16.825 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:16.826 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:16.826 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:16.826 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:16.826 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:16.826 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:16.826 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:16.826 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:16.826 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:16.826 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:16.826 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:16.826 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:16.826 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:16.826 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.826 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.826 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.827 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.827 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:16.827 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:16.827 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.827 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:16.827 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.827 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:16.827 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:16.827 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:16.827 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.827 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:16.827 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:16.827 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.827 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.828 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:16.828 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:16.828 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.828 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.828 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:16.828 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:16.828 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:16.828 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:16.828 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:16.828 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.828 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.828 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:16.828 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:16.828 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:16.828 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.829 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:16.829 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.829 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:16.829 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.829 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:16.829 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.829 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:16.829 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.829 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:16.829 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:16.829 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:16.829 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:16.829 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.829 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:16.830 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.830 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:16.830 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:16.830 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:16.830 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:16.830 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:16.830 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:16.830 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:16.830 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:16.830 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:16.830 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:16.830 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:16.830 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:16.830 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:16.831 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:16.831 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:16.831 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:16.831 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:16.831 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:16.831 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:16.831 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:16.831 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:16.831 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:16.831 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:16.831 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:16.831 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:16.831 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:16.831 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:16.831 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:16.832 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:16.832 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:16.832 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:16.832 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:16.832 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:16.832 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:16.832 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:16.832 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:16.832 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:16.832 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:16.832 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:16.832 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:16.832 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.832 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.833 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.833 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:16.833 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.833 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:16.833 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.833 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:16.833 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:16.833 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:16.833 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:16.833 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:16.833 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:16.833 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.833 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:16.833 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:16.834 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:16.834 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:16.834 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:16.834 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:16.834 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.834 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:16.834 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:16.834 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:16.834 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:16.834 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:16.834 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:16.834 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:16.834 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:16.835 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:16.835 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:16.835 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:16.835 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.835 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.835 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:16.835 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:16.835 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:16.835 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:16.835 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:16.835 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.835 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.835 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:16.835 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:16.835 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:16.835 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:16.836 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:16.836 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.836 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:16.836 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:16.836 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:16.836 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:16.836 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:16.836 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:16.836 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.836 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:16.836 INFO:teuthology.orchestra.run.smithi003.stdout:________________ ERROR at teardown of test_get_tags_acl_public _________________ 2023-12-03T13:00:16.836 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.836 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.836 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.837 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:16.837 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:16.837 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.837 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:16.837 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.837 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:16.837 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:16.837 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:16.837 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.837 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:16.837 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:16.837 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.837 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.837 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:16.837 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:16.838 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.838 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.838 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:16.838 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.838 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:16.838 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:16.838 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.838 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.838 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:16.838 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:16.838 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.838 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:16.838 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:16.838 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:16.839 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:16.839 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:16.839 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.839 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:16.839 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.839 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:16.839 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:16.839 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:16.839 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:16.839 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:16.839 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:16.839 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:16.839 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:16.839 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.839 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.840 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:16.840 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:16.840 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:16.840 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:16.840 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.840 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:16.840 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:16.840 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:16.840 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:16.840 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.840 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.840 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:16.840 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:16.840 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:16.840 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:16.841 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.841 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.841 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:16.841 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:16.841 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:16.841 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.841 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:16.841 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.841 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:16.841 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:16.841 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.841 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:16.841 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:16.842 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:16.842 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:16.842 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:16.842 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:16.842 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.842 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:16.842 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.842 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:16.842 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.842 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.842 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:16.842 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.842 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:16.843 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.843 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:16.843 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:16.843 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:16.843 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:16.843 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:16.843 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:16.843 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.843 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:16.843 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:16.843 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:16.843 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:16.843 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:16.843 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:16.843 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.844 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:16.844 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:16.844 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:16.844 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:16.844 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:16.844 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:16.844 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:16.844 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:16.844 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:16.844 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:16.844 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:16.844 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.844 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.844 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:16.844 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.845 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:16.845 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:16.845 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:16.845 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:16.845 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:16.845 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:16.845 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:16.845 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:16.845 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:16.845 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:16.845 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:16.845 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:16.845 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:16.845 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:16.845 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:16.846 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:16.846 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:16.846 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:16.846 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:16.846 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:16.846 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:16.846 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:16.846 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:16.846 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:16.846 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:16.846 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:16.846 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:16.846 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:16.846 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.847 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.847 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.847 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.847 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:16.847 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:16.847 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.847 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:16.847 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.847 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:16.847 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:16.847 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:16.847 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.847 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:16.847 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:16.847 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.848 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.848 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:16.848 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:16.848 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.848 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.848 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:16.848 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:16.848 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:16.848 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:16.848 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:16.848 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.848 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.848 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:16.848 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:16.848 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:16.849 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.849 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:16.849 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.849 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:16.849 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.849 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:16.849 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.849 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:16.849 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.849 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:16.849 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:16.849 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:16.849 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:16.849 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.849 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:16.849 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.849 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:16.850 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:16.850 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:16.850 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:16.850 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:16.850 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:16.850 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:16.850 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:16.850 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:16.850 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:16.850 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:16.850 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:16.850 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:16.850 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:16.850 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:16.851 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:16.851 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:16.851 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:16.851 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:16.851 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:16.851 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:16.851 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:16.851 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:16.851 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:16.851 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:16.851 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:16.851 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:16.851 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:16.851 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:16.852 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:16.852 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:16.852 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:16.852 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:16.852 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:16.852 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:16.852 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:16.852 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:16.852 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:16.852 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:16.852 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:16.852 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.852 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.852 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.853 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:16.853 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.853 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:16.853 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.853 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:16.853 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:16.853 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:16.853 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:16.853 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:16.853 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:16.853 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.853 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:16.853 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:16.853 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:16.854 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:16.854 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:16.854 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:16.854 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.854 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:16.854 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:16.854 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:16.854 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:16.854 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:16.854 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:16.854 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:16.854 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:16.854 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:16.855 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:16.855 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:16.855 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.855 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.855 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:16.855 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:16.855 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:16.855 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:16.855 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:16.855 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.855 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.855 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:16.855 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:16.855 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:16.855 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:16.856 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:16.856 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.856 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:16.856 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:16.856 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:16.856 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:16.856 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:16.856 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:16.856 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.856 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:16.856 INFO:teuthology.orchestra.run.smithi003.stdout:________________ ERROR at teardown of test_put_tags_acl_public _________________ 2023-12-03T13:00:16.856 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.856 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.856 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.856 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:16.857 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:16.857 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.857 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:16.857 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.857 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:16.857 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:16.857 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:16.857 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.857 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:16.857 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:16.857 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.857 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.857 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:16.857 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:16.857 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.857 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.858 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:16.858 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.858 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:16.858 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:16.858 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.858 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.858 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:16.858 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:16.858 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.858 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:16.858 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:16.858 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:16.858 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:16.858 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:16.858 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.859 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:16.859 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.859 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:16.859 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:16.859 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:16.859 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:16.859 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:16.859 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:16.859 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:16.859 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:16.859 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.859 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.859 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:16.859 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:16.860 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:16.860 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:16.860 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.860 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:16.860 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:16.860 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:16.860 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:16.860 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.860 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.860 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:16.860 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:16.860 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:16.860 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:16.860 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.860 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.861 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:16.861 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:16.861 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:16.861 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.861 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:16.861 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.861 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:16.861 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:16.861 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.861 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:16.861 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:16.861 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:16.861 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:16.861 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:16.862 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:16.862 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.862 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:16.862 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.862 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:16.862 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.862 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.862 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:16.862 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.862 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:16.862 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.862 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:16.862 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:16.862 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:16.863 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:16.863 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:16.863 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:16.863 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.863 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:16.863 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:16.863 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:16.863 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:16.863 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:16.863 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:16.863 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.863 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:16.863 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:16.863 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:16.863 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:16.864 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:16.864 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:16.864 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:16.864 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:16.864 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:16.864 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:16.864 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:16.864 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.864 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.864 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:16.864 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.864 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:16.864 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:16.864 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:16.864 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:16.865 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:16.865 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:16.865 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:16.865 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:16.865 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:16.865 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:16.865 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:16.865 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:16.865 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:16.865 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:16.865 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:16.865 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:16.865 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:16.865 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:16.866 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:16.866 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:16.866 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:16.866 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:16.866 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:16.866 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:16.866 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:16.866 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:16.866 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:16.866 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:16.866 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.866 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.866 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.866 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.867 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:16.867 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:16.867 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.867 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:16.867 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.867 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:16.867 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:16.867 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:16.867 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.867 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:16.867 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:16.867 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.867 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.867 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:16.867 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:16.868 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.868 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.868 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:16.868 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:16.868 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:16.868 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:16.868 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:16.868 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.868 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.868 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:16.868 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:16.868 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:16.868 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.868 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:16.869 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.869 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:16.869 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.869 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:16.869 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.869 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:16.869 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.869 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:16.869 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:16.869 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:16.869 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:16.869 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.869 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:16.869 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.869 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:16.870 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:16.870 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:16.870 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:16.870 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:16.870 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:16.870 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:16.870 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:16.870 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:16.870 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:16.870 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:16.870 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:16.870 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:16.870 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:16.870 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:16.871 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:16.871 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:16.871 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:16.871 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:16.871 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:16.871 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:16.871 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:16.871 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:16.871 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:16.871 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:16.871 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:16.871 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:16.871 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:16.872 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:16.872 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:16.872 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:16.872 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:16.872 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:16.872 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:16.872 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:16.872 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:16.872 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:16.872 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:16.872 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:16.872 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:16.872 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.872 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.872 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.873 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:16.873 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.873 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:16.873 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.873 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:16.873 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:16.873 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:16.873 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:16.873 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:16.873 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:16.873 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.873 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:16.873 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:16.873 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:16.874 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:16.874 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:16.874 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:16.874 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.874 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:16.874 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:16.874 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:16.874 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:16.874 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:16.874 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:16.874 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:16.874 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:16.874 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:16.874 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:16.874 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:16.875 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.875 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.875 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:16.875 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:16.875 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:16.875 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:16.875 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:16.875 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.875 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.875 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:16.875 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:16.875 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:16.875 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:16.875 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:16.876 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.876 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:16.876 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:16.876 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:16.876 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:16.876 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:16.876 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:16.876 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.876 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:16.876 INFO:teuthology.orchestra.run.smithi003.stdout:_______________ ERROR at teardown of test_delete_tags_obj_public _______________ 2023-12-03T13:00:16.876 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.876 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.876 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.876 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:16.877 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:16.877 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.877 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:16.877 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.877 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:16.877 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:16.877 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:16.877 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.877 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:16.877 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:16.877 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.877 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.877 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:16.877 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:16.877 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.878 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.878 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:16.878 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.878 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:16.878 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:16.878 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.878 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.878 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:16.878 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:16.878 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.878 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:16.878 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:16.878 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:16.878 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:16.879 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:16.879 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.879 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:16.879 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.879 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:16.879 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:16.879 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:16.879 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:16.879 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:16.879 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:16.879 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:16.879 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:16.879 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.879 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.880 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:16.880 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:16.880 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:16.880 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:16.880 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.880 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:16.880 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:16.880 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:16.880 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:16.880 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.881 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.881 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:16.881 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:16.881 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:16.881 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:16.881 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.881 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.881 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:16.881 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:16.881 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:16.881 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.881 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:16.881 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.882 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:16.882 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:16.882 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.882 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:16.882 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:16.882 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:16.882 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:16.882 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:16.882 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:16.882 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.882 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:16.882 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.882 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:16.882 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.882 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.883 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:16.883 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.883 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:16.883 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.883 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:16.883 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:16.883 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:16.883 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:16.883 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:16.883 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:16.883 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.883 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:16.883 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:16.883 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:16.884 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:16.884 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:16.884 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:16.884 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.884 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:16.884 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:16.884 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:16.884 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:16.884 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:16.884 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:16.884 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:16.884 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:16.884 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:16.884 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:16.884 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:16.885 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.885 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.885 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:16.885 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.885 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:16.885 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:16.885 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:16.885 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:16.885 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:16.885 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:16.885 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:16.885 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:16.885 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:16.885 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:16.886 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:16.886 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:16.886 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:16.886 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:16.886 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:16.886 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:16.886 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:16.886 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:16.886 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:16.886 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:16.886 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:16.886 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:16.886 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:16.886 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:16.886 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:16.887 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:16.887 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:16.887 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:16.887 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.887 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.887 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.887 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.887 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:16.887 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:16.887 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.887 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:16.887 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.887 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:16.887 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:16.887 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:16.888 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.888 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:16.888 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:16.888 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.888 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.888 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:16.888 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:16.888 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.888 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.888 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:16.888 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:16.888 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:16.888 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:16.888 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:16.888 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.889 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.889 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:16.889 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:16.889 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:16.889 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.889 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:16.889 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.889 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:16.889 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.889 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:16.889 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.889 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:16.889 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.889 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:16.890 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:16.890 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:16.890 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:16.890 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.890 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:16.890 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.890 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:16.890 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:16.890 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:16.890 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:16.890 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:16.890 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:16.890 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:16.891 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:16.891 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:16.891 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:16.891 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:16.891 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:16.891 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:16.891 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:16.891 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:16.891 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:16.891 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:16.891 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:16.891 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:16.891 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:16.891 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:16.891 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:16.892 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:16.892 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:16.892 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:16.892 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:16.892 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:16.892 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:16.892 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:16.892 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:16.892 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:16.892 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:16.892 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:16.892 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:16.892 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:16.892 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:16.893 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:16.893 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:16.893 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:16.893 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:16.893 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.893 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.893 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.893 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:16.893 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.893 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:16.893 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.893 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:16.893 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:16.893 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:16.894 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:16.894 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:16.894 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:16.894 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.894 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:16.894 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:16.894 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:16.894 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:16.894 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:16.894 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:16.894 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.894 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:16.894 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:16.894 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:16.894 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:16.895 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:16.895 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:16.895 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:16.895 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:16.895 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:16.895 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:16.895 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:16.895 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.895 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.895 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:16.895 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:16.895 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:16.895 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:16.895 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:16.895 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.895 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.896 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:16.896 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:16.896 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:16.896 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:16.896 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:16.896 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.896 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:16.896 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:16.896 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:16.896 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:16.896 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:16.896 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:16.896 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.896 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:16.897 INFO:teuthology.orchestra.run.smithi003.stdout:_ ERROR at teardown of test_versioning_bucket_atomic_upload_return_version_id __ 2023-12-03T13:00:16.897 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.897 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.897 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.897 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:16.897 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:16.897 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.897 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:16.897 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.897 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:16.897 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:16.897 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:16.897 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.897 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:16.898 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:16.898 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.898 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.898 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:16.898 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:16.898 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.898 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.898 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:16.898 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.898 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:16.898 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:16.898 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.898 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.898 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:16.898 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:16.899 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.899 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:16.899 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:16.899 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:16.899 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:16.899 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:16.899 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.899 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:16.899 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.899 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:16.899 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:16.899 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:16.899 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:16.899 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:16.899 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:16.900 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:16.900 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:16.900 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.900 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.900 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:16.900 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:16.900 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:16.900 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:16.900 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.900 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:16.900 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:16.900 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:16.900 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:16.900 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.900 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.901 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:16.901 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:16.901 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:16.901 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:16.901 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.901 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.901 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:16.901 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:16.901 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:16.901 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.901 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:16.901 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.901 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:16.901 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:16.902 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.902 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:16.902 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:16.902 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:16.902 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:16.902 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:16.902 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:16.902 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.902 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:16.902 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.902 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:16.902 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.902 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.903 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:16.903 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.903 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:16.903 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.903 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:16.903 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:16.903 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:16.903 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:16.903 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:16.903 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:16.903 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.903 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:16.903 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:16.903 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:16.903 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:16.904 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:16.904 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:16.904 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.904 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:16.904 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:16.904 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:16.904 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:16.904 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:16.904 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:16.904 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:16.904 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:16.904 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:16.904 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:16.904 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:16.904 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.905 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.905 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:16.905 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.905 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:16.905 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:16.905 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:16.905 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:16.905 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:16.905 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:16.905 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:16.905 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:16.905 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:16.905 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:16.905 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:16.905 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:16.906 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:16.906 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:16.906 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:16.906 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:16.906 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:16.906 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:16.906 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:16.906 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:16.906 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:16.906 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:16.906 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:16.906 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:16.906 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:16.906 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:16.906 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:16.907 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:16.907 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.907 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.907 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.907 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.907 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:16.907 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:16.907 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.907 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:16.907 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.907 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:16.907 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:16.907 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:16.907 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.908 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:16.908 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:16.908 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.908 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.908 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:16.908 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:16.908 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.908 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.908 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:16.908 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:16.908 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:16.908 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:16.908 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:16.908 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.908 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.909 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:16.909 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:16.909 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:16.909 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.909 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:16.909 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.909 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:16.909 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.909 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:16.909 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.909 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:16.909 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.909 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:16.909 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:16.909 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:16.909 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:16.910 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.910 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:16.910 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.910 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:16.910 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:16.910 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:16.910 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:16.910 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:16.910 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:16.910 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:16.910 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:16.910 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:16.910 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:16.911 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:16.911 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:16.911 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:16.911 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:16.911 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:16.911 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:16.911 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:16.911 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:16.911 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:16.911 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:16.911 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:16.911 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:16.911 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:16.911 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:16.912 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:16.912 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:16.912 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:16.912 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:16.912 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:16.912 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:16.912 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:16.912 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:16.912 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:16.912 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:16.912 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:16.912 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:16.912 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:16.912 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:16.913 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:16.913 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:16.913 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.913 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.913 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.913 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:16.913 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.913 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:16.913 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.913 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:16.913 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:16.913 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:16.913 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:16.913 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:16.913 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:16.914 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.914 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:16.914 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:16.914 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:16.914 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:16.914 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:16.914 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:16.914 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.914 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:16.914 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:16.914 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:16.914 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:16.914 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:16.914 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:16.915 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:16.915 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:16.915 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:16.915 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:16.915 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:16.915 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.915 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.915 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:16.915 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:16.915 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:16.915 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:16.915 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:16.915 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.915 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.915 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:16.916 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:16.916 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:16.916 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:16.916 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:16.916 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.916 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:16.916 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:16.916 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:16.916 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:16.916 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:16.916 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:16.916 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.916 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:16.917 INFO:teuthology.orchestra.run.smithi003.stdout:_ ERROR at teardown of test_versioning_bucket_multipart_upload_return_version_id _ 2023-12-03T13:00:16.917 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.917 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.917 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.917 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:16.917 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:16.917 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.917 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:16.917 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.917 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:16.917 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:16.917 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:16.917 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.917 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:16.917 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:16.918 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.918 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.918 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:16.918 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:16.918 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.918 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.918 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:16.918 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.918 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:16.918 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:16.918 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.918 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.918 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:16.918 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:16.919 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.919 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:16.919 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:16.919 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:16.919 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:16.919 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:16.919 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.919 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:16.919 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.919 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:16.919 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:16.919 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:16.919 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:16.919 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:16.920 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:16.920 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:16.920 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:16.920 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.920 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.920 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:16.920 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:16.920 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:16.920 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:16.920 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.920 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:16.920 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:16.920 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:16.920 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:16.921 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.921 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.921 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:16.921 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:16.921 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:16.921 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:16.921 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.921 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.921 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:16.921 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:16.921 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:16.921 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.921 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:16.922 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.922 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:16.922 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:16.922 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.922 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:16.922 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:16.922 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:16.922 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:16.922 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:16.922 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:16.922 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.922 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:16.922 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.922 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:16.922 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.923 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.923 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:16.923 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.923 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:16.923 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.923 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:16.923 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:16.923 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:16.923 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:16.923 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:16.923 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:16.923 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.923 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:16.923 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:16.923 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:16.924 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:16.924 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:16.924 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:16.924 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.924 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:16.924 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:16.924 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:16.924 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:16.924 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:16.924 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:16.924 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:16.924 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:16.924 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:16.924 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:16.924 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:16.925 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.925 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.925 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:16.925 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.925 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:16.925 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:16.925 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:16.925 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:16.925 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:16.925 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:16.925 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:16.925 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:16.925 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:16.925 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:16.926 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:16.926 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:16.926 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:16.926 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:16.926 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:16.926 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:16.926 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:16.926 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:16.926 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:16.926 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:16.926 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:16.926 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:16.926 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:16.926 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:16.927 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:16.927 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:16.927 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:16.927 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:16.927 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.927 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.927 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.927 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.927 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:16.927 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:16.927 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.927 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:16.927 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.927 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:16.927 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:16.927 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:16.928 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.928 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:16.928 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:16.928 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.928 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.928 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:16.928 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:16.928 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.928 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.928 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:16.928 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:16.928 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:16.928 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:16.928 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:16.928 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.929 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.929 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:16.929 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:16.929 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:16.929 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.929 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:16.929 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.929 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:16.929 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.929 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:16.929 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.929 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:16.929 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.929 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:16.929 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:16.930 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:16.930 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:16.930 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.930 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:16.930 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.930 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:16.930 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:16.930 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:16.930 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:16.930 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:16.930 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:16.930 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:16.930 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:16.930 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:16.931 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:16.931 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:16.931 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:16.931 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:16.931 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:16.931 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:16.931 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:16.931 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:16.931 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:16.931 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:16.931 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:16.931 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:16.931 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:16.932 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:16.932 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:16.932 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:16.932 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:16.932 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:16.932 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:16.932 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:16.932 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:16.932 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:16.932 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:16.932 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:16.932 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:16.932 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:16.932 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:16.932 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:16.933 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:16.933 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:16.933 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:16.933 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.933 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.933 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.933 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:16.933 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.933 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:16.933 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.933 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:16.933 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:16.933 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:16.933 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:16.933 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:16.934 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:16.934 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.934 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:16.934 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:16.934 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:16.934 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:16.934 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:16.934 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:16.934 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.934 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:16.934 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:16.934 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:16.934 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:16.934 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:16.935 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:16.935 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:16.935 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:16.935 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:16.935 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:16.935 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:16.935 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.935 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.935 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:16.935 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:16.935 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:16.935 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:16.935 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:16.935 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.935 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.936 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:16.936 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:16.936 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:16.936 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:16.936 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:16.936 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.936 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:16.936 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:16.936 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:16.936 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:16.936 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:16.936 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:16.936 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.936 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:16.936 INFO:teuthology.orchestra.run.smithi003.stdout:_________ ERROR at teardown of test_bucket_policy_get_obj_existing_tag _________ 2023-12-03T13:00:16.937 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.937 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.937 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.937 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:16.937 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:16.937 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.937 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:16.937 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.937 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:16.937 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:16.937 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:16.937 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.937 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:16.937 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:16.937 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.938 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.938 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:16.938 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:16.938 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.938 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.938 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:16.938 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.938 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:16.938 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:16.938 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.938 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.938 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:16.938 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:16.939 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.939 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:16.939 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:16.939 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:16.939 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:16.939 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:16.939 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.939 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:16.939 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.939 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:16.939 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:16.939 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:16.939 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:16.939 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:16.939 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:16.940 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:16.940 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:16.940 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.940 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.940 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:16.940 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:16.940 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:16.940 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:16.940 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.940 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:16.940 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:16.940 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:16.940 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:16.940 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.941 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.941 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:16.941 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:16.941 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:16.941 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:16.941 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.941 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.941 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:16.941 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:16.941 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:16.941 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.941 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:16.941 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.941 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:16.942 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:16.942 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.942 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:16.942 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:16.942 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:16.942 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:16.942 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:16.942 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:16.942 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.942 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:16.942 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.942 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:16.942 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.942 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.943 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:16.943 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.943 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:16.943 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.943 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:16.943 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:16.943 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:16.943 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:16.943 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:16.943 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:16.943 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.943 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:16.943 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:16.943 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:16.944 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:16.944 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:16.944 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:16.944 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.944 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:16.944 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:16.944 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:16.944 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:16.944 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:16.944 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:16.944 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:16.944 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:16.944 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:16.944 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:16.944 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:16.945 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.945 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.945 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:16.945 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.945 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:16.945 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:16.945 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:16.945 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:16.945 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:16.945 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:16.945 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:16.945 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:16.945 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:16.945 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:16.946 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:16.946 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:16.946 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:16.946 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:16.946 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:16.946 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:16.946 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:16.946 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:16.946 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:16.946 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:16.946 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:16.946 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:16.946 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:16.946 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:16.946 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:16.947 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:16.947 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:16.947 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:16.947 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.947 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.947 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.947 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.947 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:16.947 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:16.947 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.947 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:16.947 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.947 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:16.947 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:16.947 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:16.948 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.948 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:16.948 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:16.948 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.948 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.948 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:16.948 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:16.948 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.948 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.948 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:16.948 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:16.948 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:16.948 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:16.948 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:16.948 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.949 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.949 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:16.949 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:16.949 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:16.949 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.949 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:16.949 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.949 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:16.949 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.949 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:16.949 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.949 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:16.949 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.949 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:16.949 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:16.950 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:16.950 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:16.950 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.950 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:16.950 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.950 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:16.950 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:16.950 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:16.950 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:16.950 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:16.950 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:16.950 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:16.951 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:16.951 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:16.951 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:16.951 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:16.951 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:16.951 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:16.951 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:16.951 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:16.951 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:16.951 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:16.951 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:16.951 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:16.951 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:16.951 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:16.952 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:16.952 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:16.952 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:16.952 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:16.952 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:16.952 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:16.952 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:16.952 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:16.952 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:16.952 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:16.952 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:16.952 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:16.952 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:16.952 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:16.953 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:16.953 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:16.953 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:16.953 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:16.953 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:16.953 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.953 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.953 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.953 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:16.953 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.953 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:16.953 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.953 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:16.953 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:16.953 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:16.954 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:16.954 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:16.954 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:16.954 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.954 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:16.954 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:16.954 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:16.954 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:16.954 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:16.954 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:16.954 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.954 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:16.954 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:16.954 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:16.955 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:16.955 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:16.955 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:16.955 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:16.955 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:16.955 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:16.955 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:16.955 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:16.955 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.955 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.955 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:16.955 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:16.955 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:16.955 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:16.956 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:16.956 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.956 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.956 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:16.956 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:16.956 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:16.956 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:16.956 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:16.956 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.956 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:16.956 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:16.956 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:16.956 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:16.956 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:16.957 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:16.957 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.957 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:16.957 INFO:teuthology.orchestra.run.smithi003.stdout:_____ ERROR at teardown of test_bucket_policy_get_obj_tagging_existing_tag _____ 2023-12-03T13:00:16.957 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.957 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.957 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.957 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:16.957 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:16.957 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.957 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:16.957 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.957 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:16.957 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:16.958 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:16.958 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.958 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:16.958 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:16.958 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.958 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.958 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:16.958 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:16.958 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.958 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.958 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:16.958 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.958 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:16.958 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:16.959 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.959 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.959 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:16.959 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:16.959 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.959 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:16.959 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:16.959 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:16.959 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:16.959 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:16.959 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.959 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:16.959 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.959 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:16.959 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:16.960 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:16.960 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:16.960 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:16.960 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:16.960 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:16.960 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:16.960 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.960 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.960 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:16.960 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:16.960 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:16.960 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:16.960 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.960 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:16.960 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:16.961 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:16.961 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:16.961 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.961 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.961 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:16.961 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:16.961 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:16.961 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:16.961 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.961 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.961 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:16.961 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:16.961 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:16.961 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.962 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:16.962 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.962 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:16.962 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:16.962 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.962 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:16.962 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:16.962 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:16.962 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:16.962 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:16.962 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:16.962 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.962 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:16.963 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.963 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:16.963 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.963 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.963 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:16.963 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.963 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:16.963 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.963 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:16.963 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:16.963 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:16.963 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:16.963 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:16.963 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:16.963 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.964 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:16.964 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:16.964 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:16.964 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:16.964 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:16.964 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:16.964 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.964 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:16.964 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:16.964 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:16.964 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:16.964 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:16.964 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:16.964 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:16.965 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:16.965 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:16.965 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:16.965 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:16.965 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.965 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.965 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:16.965 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.965 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:16.965 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:16.965 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:16.965 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:16.965 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:16.965 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:16.965 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:16.966 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:16.966 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:16.966 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:16.966 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:16.966 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:16.966 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:16.966 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:16.966 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:16.966 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:16.966 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:16.966 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:16.966 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:16.966 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:16.966 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:16.967 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:16.967 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:16.967 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:16.967 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:16.967 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:16.967 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:16.967 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:16.967 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.967 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.967 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.967 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.967 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:16.967 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:16.967 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.967 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:16.968 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.968 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:16.968 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:16.968 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:16.968 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.968 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:16.968 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:16.968 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.968 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.968 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:16.968 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:16.968 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.968 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.968 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:16.968 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:16.969 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:16.969 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:16.969 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:16.969 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.969 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.969 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:16.969 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:16.969 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:16.969 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.969 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:16.969 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.969 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:16.969 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.969 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:16.970 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.970 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:16.970 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.970 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:16.970 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:16.970 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:16.970 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:16.970 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.970 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:16.970 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.970 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:16.970 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:16.970 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:16.970 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:16.971 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:16.971 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:16.971 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:16.971 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:16.971 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:16.971 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:16.971 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:16.971 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:16.971 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:16.971 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:16.971 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:16.971 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:16.971 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:16.971 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:16.971 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:16.972 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:16.972 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:16.972 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:16.972 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:16.972 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:16.972 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:16.972 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:16.972 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:16.972 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:16.972 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:16.972 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:16.972 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:16.972 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:16.972 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:16.973 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:16.973 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:16.973 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:16.973 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:16.973 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:16.973 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:16.973 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:16.973 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.973 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.973 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.973 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:16.973 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.973 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:16.973 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.973 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:16.974 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:16.974 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:16.974 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:16.974 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:16.974 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:16.974 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.974 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:16.974 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:16.974 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:16.974 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:16.974 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:16.974 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:16.974 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.975 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:16.975 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:16.975 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:16.975 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:16.975 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:16.975 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:16.975 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:16.975 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:16.975 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:16.975 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:16.975 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:16.975 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.975 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.976 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:16.976 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:16.976 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:16.976 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:16.976 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:16.976 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.976 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.976 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:16.976 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:16.976 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:16.976 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:16.976 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:16.976 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.976 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:16.976 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:16.976 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:16.976 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:16.977 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:16.977 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:16.977 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.977 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:16.977 INFO:teuthology.orchestra.run.smithi003.stdout:_____ ERROR at teardown of test_bucket_policy_put_obj_tagging_existing_tag _____ 2023-12-03T13:00:16.977 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.977 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.977 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.977 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:16.977 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:16.977 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.977 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:16.977 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.978 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:16.978 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:16.978 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:16.978 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.978 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:16.978 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:16.978 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.978 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.978 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:16.978 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:16.978 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.978 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.978 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:16.978 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.979 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:16.979 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:16.979 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.979 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.979 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:16.979 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:16.979 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.979 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:16.979 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:16.979 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:16.979 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:16.979 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:16.979 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.979 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:16.979 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.979 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:16.980 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:16.980 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:16.980 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:16.980 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:16.980 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:16.980 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:16.980 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:16.980 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.980 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.980 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:16.980 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:16.980 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:16.980 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:16.980 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.980 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:16.980 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:16.981 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:16.981 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:16.981 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.981 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.981 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:16.981 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:16.981 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:16.981 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:16.981 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.981 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.981 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:16.981 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:16.981 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:16.982 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.982 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:16.982 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.982 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:16.982 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:16.982 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.982 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:16.982 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:16.982 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:16.982 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:16.982 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:16.982 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:16.982 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.982 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:16.983 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.983 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:16.983 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.983 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.983 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:16.983 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.983 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:16.983 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.983 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:16.983 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:16.983 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:16.983 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:16.983 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:16.983 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:16.983 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.984 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:16.984 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:16.984 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:16.984 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:16.984 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:16.984 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:16.984 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.984 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:16.984 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:16.984 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:16.984 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:16.984 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:16.984 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:16.984 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:16.985 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:16.985 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:16.985 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:16.985 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:16.985 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.985 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.985 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:16.985 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.985 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:16.985 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:16.985 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:16.985 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:16.985 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:16.985 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:16.985 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:16.986 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:16.986 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:16.986 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:16.986 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:16.986 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:16.986 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:16.986 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:16.986 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:16.986 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:16.986 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:16.986 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:16.986 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:16.986 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:16.987 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:16.987 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:16.987 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:16.987 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:16.987 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:16.987 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:16.987 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:16.987 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:16.987 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.987 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.987 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.987 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.987 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:16.987 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:16.988 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.988 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:16.988 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.988 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:16.988 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:16.988 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:16.988 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.988 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:16.988 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:16.988 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.988 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.988 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:16.988 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:16.988 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.988 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.989 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:16.989 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:16.989 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:16.989 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:16.989 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:16.989 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.989 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.989 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:16.989 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:16.989 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:16.989 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.989 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:16.989 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.989 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:16.989 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.989 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:16.990 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.990 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:16.990 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.990 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:16.990 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:16.990 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:16.990 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:16.990 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.990 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:16.990 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.990 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:16.990 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:16.990 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:16.990 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:16.991 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:16.991 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:16.991 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:16.991 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:16.991 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:16.991 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:16.991 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:16.991 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:16.991 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:16.991 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:16.991 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:16.991 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:16.991 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:16.991 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:16.992 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:16.992 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:16.992 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:16.992 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:16.992 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:16.992 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:16.992 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:16.992 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:16.992 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:16.992 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:16.992 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:16.992 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:16.992 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:16.992 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:16.992 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:16.993 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:16.993 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:16.993 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:16.993 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:16.993 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:16.993 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:16.993 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:16.993 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.993 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.993 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.993 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:16.993 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.993 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:16.993 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.994 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:16.994 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:16.994 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:16.994 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:16.994 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:16.994 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:16.994 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.994 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:16.994 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:16.994 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:16.994 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:16.994 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:16.994 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:16.994 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.994 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:16.995 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:16.995 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:16.995 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:16.995 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:16.995 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:16.995 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:16.995 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:16.995 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:16.995 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:16.995 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:16.995 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.995 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.995 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:16.995 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:16.995 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:16.995 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:16.996 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:16.996 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.996 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.996 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:16.996 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:16.996 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:16.996 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:16.996 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:16.996 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.996 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:16.996 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:16.996 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:16.996 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:16.996 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:16.997 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:16.997 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.997 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:16.997 INFO:teuthology.orchestra.run.smithi003.stdout:_________ ERROR at teardown of test_bucket_policy_put_obj_copy_source __________ 2023-12-03T13:00:16.997 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.997 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:16.997 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.997 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:16.997 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:16.997 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.997 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:16.997 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:16.997 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:16.997 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:16.997 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:16.998 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.998 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:16.998 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:16.998 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.998 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:16.998 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:16.998 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:16.998 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:16.998 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.998 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:16.998 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.998 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:16.998 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:16.998 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:16.998 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.998 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:16.999 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:16.999 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.999 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:16.999 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:16.999 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:16.999 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:16.999 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:16.999 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:16.999 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:16.999 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:16.999 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:16.999 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:16.999 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:16.999 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:17.000 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:17.000 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:17.000 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:17.000 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:17.000 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.000 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.000 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:17.000 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:17.000 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:17.000 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:17.000 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.000 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:17.000 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:17.000 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:17.000 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:17.000 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.001 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.001 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:17.001 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:17.001 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:17.001 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:17.001 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.001 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.001 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:17.001 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:17.001 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:17.001 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.001 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:17.001 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.002 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:17.002 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:17.002 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.002 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:17.002 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:17.002 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:17.002 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:17.002 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:17.002 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:17.002 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.002 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:17.002 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.002 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:17.002 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.002 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.003 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:17.003 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.003 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:17.003 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.003 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:17.003 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:17.003 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:17.003 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:17.003 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:17.003 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:17.003 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.003 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:17.003 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:17.003 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:17.003 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:17.003 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:17.004 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:17.004 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.004 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:17.004 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:17.004 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:17.004 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:17.004 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:17.004 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:17.004 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:17.004 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:17.004 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:17.004 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:17.004 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:17.004 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.004 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.005 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:17.005 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.005 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:17.005 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:17.005 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:17.005 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:17.005 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:17.005 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:17.005 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:17.005 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:17.005 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:17.005 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:17.005 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:17.005 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:17.006 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:17.006 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:17.006 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:17.006 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:17.006 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:17.006 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:17.006 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:17.006 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:17.006 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:17.006 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:17.006 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:17.006 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:17.006 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:17.006 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:17.007 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:17.007 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:17.007 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.007 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.007 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.007 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.007 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:17.007 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:17.007 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.007 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:17.007 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.007 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:17.007 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:17.007 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:17.007 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.007 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:17.008 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:17.008 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.008 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.008 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:17.008 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:17.008 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.008 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.008 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:17.008 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:17.008 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:17.008 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:17.008 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:17.008 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.008 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.008 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:17.009 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:17.009 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:17.009 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.009 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:17.009 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.009 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:17.009 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.009 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:17.009 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.009 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:17.009 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.009 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:17.009 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:17.009 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:17.009 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:17.010 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.010 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:17.010 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.010 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:17.010 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:17.010 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:17.010 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:17.010 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:17.011 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:17.011 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:17.011 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:17.011 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:17.011 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:17.011 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:17.011 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:17.011 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:17.011 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:17.011 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:17.011 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:17.011 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:17.012 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:17.012 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:17.012 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:17.012 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:17.012 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:17.012 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:17.012 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:17.012 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:17.012 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:17.012 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:17.012 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:17.012 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:17.012 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:17.012 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:17.013 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:17.013 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:17.013 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:17.013 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:17.013 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:17.013 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:17.013 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:17.013 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:17.013 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:17.013 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.013 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.013 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.013 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:17.014 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.014 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:17.014 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.014 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:17.014 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:17.014 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:17.014 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:17.014 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:17.014 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:17.014 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.014 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:17.014 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:17.015 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:17.015 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:17.015 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:17.015 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:17.015 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.015 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:17.015 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:17.015 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:17.015 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:17.015 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:17.015 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:17.015 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:17.015 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:17.015 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:17.016 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:17.016 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:17.016 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.016 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.016 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:17.016 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:17.016 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:17.016 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:17.016 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:17.016 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.016 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.016 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:17.016 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:17.016 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:17.017 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:17.017 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:17.017 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.017 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:17.017 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:17.017 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:17.017 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:17.017 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:17.017 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:17.017 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.017 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:17.017 INFO:teuthology.orchestra.run.smithi003.stdout:_______ ERROR at teardown of test_bucket_policy_put_obj_copy_source_meta _______ 2023-12-03T13:00:17.017 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.017 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.017 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.018 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:17.018 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:17.018 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.018 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:17.018 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.018 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:17.018 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:17.018 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:17.018 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.018 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:17.018 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:17.018 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.018 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.019 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:17.019 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:17.019 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.019 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.019 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:17.019 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.019 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:17.019 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:17.019 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.019 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.019 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:17.019 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:17.019 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.019 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:17.020 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:17.020 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:17.020 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:17.020 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:17.020 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.020 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:17.020 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.020 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:17.020 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:17.020 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:17.020 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:17.020 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:17.020 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:17.020 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:17.020 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:17.021 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.021 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.021 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:17.021 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:17.021 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:17.021 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:17.021 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.021 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:17.021 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:17.021 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:17.021 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:17.021 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.021 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.022 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:17.022 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:17.022 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:17.022 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:17.022 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.022 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.022 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:17.022 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:17.022 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:17.022 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.022 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:17.022 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.022 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:17.022 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:17.022 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.023 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:17.023 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:17.023 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:17.023 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:17.023 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:17.023 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:17.023 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.023 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:17.023 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.023 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:17.023 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.023 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.023 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:17.024 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.024 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:17.024 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.024 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:17.024 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:17.024 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:17.024 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:17.024 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:17.024 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:17.024 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.024 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:17.024 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:17.024 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:17.024 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:17.024 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:17.025 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:17.025 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.025 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:17.025 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:17.025 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:17.025 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:17.025 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:17.025 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:17.025 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:17.025 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:17.025 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:17.025 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:17.025 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:17.025 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.025 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.026 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:17.026 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.026 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:17.026 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:17.026 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:17.026 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:17.026 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:17.026 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:17.026 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:17.026 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:17.026 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:17.026 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:17.026 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:17.026 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:17.026 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:17.027 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:17.027 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:17.027 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:17.027 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:17.027 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:17.027 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:17.027 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:17.027 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:17.027 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:17.027 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:17.027 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:17.027 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:17.027 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:17.027 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:17.027 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:17.028 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.028 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.028 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.028 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.028 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:17.028 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:17.028 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.028 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:17.028 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.028 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:17.028 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:17.028 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:17.028 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.028 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:17.029 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:17.029 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.029 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.029 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:17.029 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:17.029 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.029 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.029 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:17.029 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:17.029 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:17.029 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:17.029 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:17.029 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.029 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.030 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:17.030 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:17.030 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:17.030 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.030 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:17.030 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.030 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:17.030 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.030 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:17.030 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.030 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:17.030 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.030 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:17.031 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:17.031 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:17.031 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:17.031 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.031 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:17.031 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.031 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:17.031 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:17.031 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:17.031 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:17.031 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:17.031 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:17.031 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:17.031 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:17.031 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:17.031 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:17.032 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:17.032 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:17.032 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:17.032 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:17.032 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:17.032 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:17.032 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:17.032 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:17.032 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:17.032 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:17.032 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:17.032 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:17.032 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:17.032 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:17.032 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:17.033 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:17.033 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:17.033 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:17.033 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:17.033 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:17.033 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:17.033 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:17.033 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:17.033 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:17.033 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:17.033 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:17.033 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:17.033 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:17.033 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:17.034 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:17.034 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.034 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.034 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.034 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:17.034 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.034 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:17.034 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.034 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:17.034 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:17.034 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:17.034 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:17.034 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:17.035 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:17.035 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.035 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:17.035 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:17.035 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:17.035 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:17.035 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:17.035 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:17.035 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.035 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:17.035 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:17.035 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:17.035 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:17.035 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:17.035 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:17.036 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:17.036 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:17.036 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:17.036 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:17.036 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:17.036 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.036 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.036 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:17.036 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:17.036 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:17.036 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:17.036 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:17.036 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.036 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.036 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:17.036 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:17.037 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:17.037 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:17.037 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:17.037 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.037 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:17.037 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:17.037 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:17.037 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:17.037 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:17.037 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:17.037 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.037 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:17.037 INFO:teuthology.orchestra.run.smithi003.stdout:_____________ ERROR at teardown of test_bucket_policy_put_obj_acl ______________ 2023-12-03T13:00:17.037 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.037 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.037 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.038 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:17.038 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:17.038 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.038 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:17.038 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.038 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:17.038 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:17.038 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:17.038 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.038 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:17.038 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:17.038 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.038 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.038 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:17.038 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:17.039 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.039 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.039 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:17.039 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.039 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:17.039 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:17.039 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.039 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.039 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:17.039 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:17.039 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.039 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:17.039 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:17.039 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:17.039 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:17.040 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:17.040 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.040 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:17.040 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.040 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:17.040 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:17.040 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:17.040 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:17.040 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:17.040 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:17.040 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:17.040 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:17.040 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.040 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.040 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:17.041 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:17.041 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:17.041 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:17.041 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.041 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:17.041 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:17.041 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:17.041 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:17.041 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.041 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.041 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:17.041 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:17.041 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:17.042 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:17.042 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.042 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.042 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:17.042 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:17.042 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:17.042 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.042 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:17.042 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.042 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:17.042 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:17.042 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.042 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:17.042 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:17.042 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:17.043 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:17.043 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:17.043 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:17.043 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.043 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:17.043 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.043 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:17.043 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.043 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.043 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:17.043 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.043 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:17.043 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.043 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:17.043 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:17.043 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:17.044 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:17.044 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:17.044 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:17.044 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.044 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:17.044 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:17.044 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:17.044 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:17.044 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:17.044 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:17.044 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.044 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:17.044 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:17.044 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:17.044 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:17.045 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:17.045 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:17.045 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:17.045 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:17.045 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:17.045 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:17.045 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:17.045 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.045 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.045 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:17.045 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.045 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:17.045 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:17.045 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:17.046 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:17.046 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:17.046 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:17.046 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:17.046 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:17.046 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:17.046 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:17.046 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:17.046 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:17.046 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:17.046 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:17.046 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:17.047 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:17.047 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:17.047 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:17.047 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:17.047 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:17.047 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:17.047 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:17.047 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:17.047 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:17.047 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:17.047 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:17.047 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:17.047 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:17.047 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.047 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.047 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.048 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.048 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:17.048 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:17.048 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.048 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:17.048 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.048 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:17.048 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:17.048 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:17.048 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.048 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:17.048 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:17.048 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.048 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.049 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:17.049 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:17.049 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.049 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.049 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:17.049 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:17.049 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:17.049 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:17.049 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:17.049 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.049 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.049 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:17.049 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:17.049 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:17.049 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.050 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:17.050 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.050 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:17.050 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.050 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:17.050 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.050 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:17.050 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.050 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:17.050 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:17.050 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:17.050 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:17.050 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.050 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:17.051 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.051 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:17.051 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:17.051 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:17.051 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:17.051 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:17.051 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:17.051 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:17.051 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:17.051 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:17.051 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:17.051 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:17.051 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:17.051 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:17.052 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:17.052 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:17.052 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:17.052 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:17.052 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:17.052 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:17.052 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:17.052 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:17.052 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:17.052 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:17.052 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:17.052 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:17.052 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:17.052 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:17.052 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:17.053 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:17.053 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:17.053 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:17.053 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:17.053 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:17.053 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:17.053 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:17.053 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:17.053 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:17.053 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:17.053 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:17.053 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:17.053 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.053 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.053 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.054 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:17.054 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.054 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:17.054 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.054 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:17.054 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:17.054 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:17.054 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:17.054 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:17.054 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:17.054 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.054 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:17.054 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:17.055 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:17.055 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:17.055 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:17.055 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:17.055 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.055 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:17.055 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:17.055 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:17.055 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:17.055 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:17.055 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:17.055 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:17.055 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:17.055 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:17.056 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:17.056 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:17.056 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.056 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.056 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:17.056 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:17.056 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:17.056 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:17.056 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:17.056 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.056 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.056 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:17.056 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:17.056 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:17.056 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:17.056 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:17.057 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.057 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:17.057 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:17.057 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:17.057 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:17.057 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:17.057 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:17.057 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.057 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:17.057 INFO:teuthology.orchestra.run.smithi003.stdout:____________ ERROR at teardown of test_bucket_policy_put_obj_grant _____________ 2023-12-03T13:00:17.057 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.057 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.057 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.057 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:17.058 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:17.058 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.058 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:17.058 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.058 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:17.058 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:17.058 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:17.058 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.058 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:17.058 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:17.058 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.058 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.058 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:17.058 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:17.059 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.059 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.059 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:17.059 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.059 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:17.059 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:17.059 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.059 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.059 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:17.059 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:17.059 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.059 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:17.059 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:17.059 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:17.059 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:17.060 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:17.060 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.060 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:17.060 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.060 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:17.060 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:17.060 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:17.060 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:17.060 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:17.060 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:17.060 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:17.060 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:17.060 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.060 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.060 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:17.061 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:17.061 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:17.061 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:17.061 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.061 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:17.061 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:17.061 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:17.061 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:17.061 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.061 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.061 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:17.061 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:17.061 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:17.061 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:17.062 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.062 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.062 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:17.062 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:17.062 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:17.062 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.062 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:17.062 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.062 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:17.062 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:17.062 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.062 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:17.062 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:17.062 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:17.063 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:17.063 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:17.063 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:17.063 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.063 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:17.063 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.063 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:17.063 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.063 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.063 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:17.063 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.063 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:17.063 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.063 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:17.064 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:17.064 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:17.064 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:17.064 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:17.064 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:17.064 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.064 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:17.064 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:17.064 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:17.064 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:17.064 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:17.064 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:17.064 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.064 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:17.064 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:17.064 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:17.065 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:17.065 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:17.065 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:17.065 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:17.065 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:17.065 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:17.065 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:17.065 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:17.065 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.065 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.065 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:17.065 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.065 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:17.065 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:17.065 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:17.065 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:17.066 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:17.066 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:17.066 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:17.066 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:17.066 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:17.066 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:17.066 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:17.066 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:17.066 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:17.066 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:17.066 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:17.066 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:17.066 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:17.066 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:17.067 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:17.067 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:17.067 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:17.067 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:17.067 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:17.067 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:17.067 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:17.067 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:17.067 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:17.067 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:17.067 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.067 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.067 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.067 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.067 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:17.068 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:17.068 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.068 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:17.068 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.068 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:17.068 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:17.068 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:17.068 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.068 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:17.068 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:17.068 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.068 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.068 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:17.068 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:17.069 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.069 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.069 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:17.069 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:17.069 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:17.069 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:17.069 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:17.069 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.069 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.069 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:17.069 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:17.069 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:17.069 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.069 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:17.069 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.069 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:17.070 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.070 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:17.070 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.070 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:17.070 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.070 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:17.070 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:17.070 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:17.070 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:17.070 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.070 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:17.070 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.070 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:17.070 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:17.070 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:17.071 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:17.071 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:17.071 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:17.071 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:17.071 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:17.071 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:17.071 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:17.071 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:17.071 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:17.071 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:17.071 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:17.071 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:17.071 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:17.071 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:17.072 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:17.072 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:17.072 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:17.072 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:17.072 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:17.072 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:17.072 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:17.072 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:17.072 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:17.072 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:17.072 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:17.072 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:17.072 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:17.072 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:17.073 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:17.073 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:17.073 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:17.073 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:17.073 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:17.073 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:17.073 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:17.073 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:17.073 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:17.073 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.073 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.073 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.073 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:17.073 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.073 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:17.074 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.074 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:17.074 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:17.074 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:17.074 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:17.074 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:17.074 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:17.074 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.074 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:17.074 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:17.074 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:17.074 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:17.074 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:17.074 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:17.075 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.075 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:17.075 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:17.075 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:17.075 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:17.075 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:17.075 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:17.075 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:17.075 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:17.075 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:17.075 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:17.075 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:17.075 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.075 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.075 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:17.076 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:17.076 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:17.076 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:17.076 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:17.076 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.076 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.076 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:17.076 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:17.076 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:17.076 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:17.076 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:17.076 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.076 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:17.077 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:17.077 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:17.077 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:17.077 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:17.077 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:17.077 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.077 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:17.077 INFO:teuthology.orchestra.run.smithi003.stdout:_____________ ERROR at teardown of test_put_obj_enc_conflict_c_s3 ______________ 2023-12-03T13:00:17.077 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.077 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.077 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.077 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:17.077 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:17.077 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.077 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:17.078 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.078 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:17.078 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:17.078 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:17.078 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.078 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:17.078 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:17.078 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.078 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.078 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:17.078 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:17.078 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.078 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.078 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:17.078 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.079 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:17.079 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:17.079 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.079 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.079 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:17.079 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:17.079 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.079 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:17.079 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:17.079 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:17.079 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:17.079 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:17.079 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.079 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:17.079 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.079 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:17.080 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:17.080 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:17.080 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:17.080 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:17.080 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:17.080 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:17.080 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:17.080 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.080 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.080 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:17.080 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:17.080 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:17.080 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:17.080 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.080 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:17.081 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:17.081 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:17.081 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:17.081 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.081 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.081 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:17.081 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:17.081 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:17.081 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:17.081 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.081 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.081 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:17.081 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:17.081 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:17.081 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.082 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:17.082 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.082 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:17.082 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:17.082 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.082 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:17.082 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:17.082 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:17.082 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:17.082 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:17.082 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:17.082 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.082 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:17.082 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.083 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:17.083 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.083 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.083 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:17.083 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.083 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:17.083 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.083 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:17.083 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:17.083 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:17.083 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:17.083 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:17.083 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:17.083 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.084 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:17.084 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:17.084 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:17.084 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:17.084 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:17.084 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:17.084 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.084 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:17.084 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:17.084 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:17.084 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:17.084 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:17.084 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:17.084 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:17.084 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:17.085 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:17.085 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:17.085 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:17.085 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.085 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.085 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:17.085 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.085 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:17.085 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:17.085 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:17.085 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:17.085 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:17.085 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:17.085 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:17.085 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:17.086 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:17.086 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:17.086 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:17.086 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:17.086 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:17.086 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:17.086 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:17.086 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:17.086 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:17.086 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:17.086 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:17.086 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:17.086 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:17.086 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:17.087 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:17.087 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:17.087 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:17.087 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:17.087 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:17.087 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:17.087 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.087 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.087 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.087 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.087 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:17.087 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:17.087 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.087 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:17.088 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.088 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:17.088 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:17.088 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:17.088 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.088 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:17.088 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:17.088 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.088 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.088 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:17.088 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:17.088 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.088 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.088 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:17.088 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:17.089 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:17.089 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:17.089 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:17.089 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.089 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.089 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:17.089 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:17.089 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:17.089 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.089 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:17.089 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.089 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:17.089 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.089 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:17.089 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.090 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:17.090 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.090 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:17.090 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:17.090 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:17.090 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:17.090 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.090 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:17.090 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.090 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:17.090 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:17.090 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:17.090 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:17.090 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:17.091 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:17.091 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:17.091 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:17.091 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:17.091 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:17.091 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:17.091 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:17.091 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:17.091 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:17.091 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:17.091 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:17.091 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:17.091 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:17.091 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:17.092 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:17.092 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:17.092 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:17.092 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:17.092 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:17.092 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:17.092 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:17.092 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:17.092 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:17.092 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:17.092 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:17.092 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:17.092 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:17.092 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:17.093 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:17.093 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:17.093 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:17.093 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:17.093 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:17.093 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:17.093 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:17.093 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.093 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.093 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.093 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:17.093 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.093 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:17.093 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.093 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:17.094 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:17.094 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:17.094 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:17.094 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:17.094 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:17.094 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.094 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:17.094 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:17.094 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:17.094 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:17.094 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:17.094 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:17.095 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.095 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:17.095 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:17.095 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:17.095 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:17.095 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:17.095 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:17.095 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:17.095 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:17.095 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:17.095 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:17.095 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:17.095 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.095 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.095 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:17.096 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:17.096 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:17.096 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:17.096 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:17.096 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.096 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.096 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:17.096 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:17.096 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:17.096 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:17.096 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:17.096 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.096 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:17.096 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:17.097 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:17.097 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:17.097 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:17.097 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:17.097 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.097 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:17.097 INFO:teuthology.orchestra.run.smithi003.stdout:_____________ ERROR at teardown of test_put_obj_enc_conflict_c_kms _____________ 2023-12-03T13:00:17.097 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.097 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.097 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.097 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:17.097 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:17.097 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.097 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:17.097 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.098 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:17.098 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:17.098 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:17.098 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.098 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:17.098 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:17.098 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.098 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.098 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:17.098 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:17.098 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.098 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.098 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:17.098 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.098 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:17.099 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:17.099 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.099 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.099 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:17.099 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:17.099 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.099 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:17.099 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:17.099 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:17.099 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:17.099 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:17.099 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.099 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:17.099 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.099 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:17.100 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:17.100 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:17.100 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:17.100 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:17.100 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:17.100 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:17.100 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:17.100 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.100 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.100 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:17.100 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:17.100 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:17.100 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:17.100 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.101 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:17.101 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:17.101 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:17.101 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:17.101 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.101 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.101 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:17.101 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:17.101 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:17.101 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:17.101 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.101 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.101 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:17.101 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:17.102 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:17.102 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.102 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:17.102 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.102 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:17.102 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:17.102 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.102 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:17.102 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:17.102 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:17.102 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:17.102 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:17.102 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:17.102 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.102 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:17.103 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.103 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:17.103 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.103 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.103 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:17.103 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.103 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:17.103 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.103 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:17.103 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:17.103 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:17.103 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:17.103 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:17.103 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:17.103 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.104 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:17.104 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:17.104 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:17.104 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:17.104 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:17.104 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:17.104 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.104 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:17.104 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:17.104 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:17.104 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:17.104 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:17.104 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:17.104 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:17.104 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:17.105 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:17.105 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:17.105 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:17.105 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.105 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.105 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:17.105 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.105 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:17.105 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:17.105 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:17.105 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:17.105 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:17.105 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:17.105 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:17.106 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:17.106 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:17.106 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:17.106 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:17.106 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:17.106 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:17.106 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:17.106 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:17.106 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:17.106 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:17.106 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:17.106 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:17.106 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:17.106 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:17.107 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:17.107 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:17.107 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:17.107 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:17.107 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:17.107 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:17.107 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:17.107 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.107 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.107 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.107 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.107 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:17.107 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:17.107 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.107 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:17.108 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.108 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:17.108 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:17.108 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:17.108 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.108 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:17.108 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:17.108 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.108 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.108 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:17.108 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:17.108 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.108 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.108 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:17.108 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:17.109 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:17.109 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:17.109 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:17.109 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.109 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.109 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:17.109 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:17.109 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:17.109 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.109 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:17.109 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.109 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:17.109 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.109 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:17.110 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.110 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:17.110 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.110 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:17.110 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:17.110 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:17.110 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:17.110 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.110 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:17.110 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.110 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:17.110 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:17.110 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:17.110 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:17.111 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:17.111 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:17.111 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:17.111 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:17.111 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:17.111 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:17.111 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:17.111 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:17.111 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:17.111 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:17.111 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:17.111 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:17.111 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:17.111 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:17.111 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:17.112 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:17.112 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:17.112 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:17.112 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:17.112 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:17.112 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:17.112 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:17.112 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:17.112 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:17.112 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:17.112 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:17.112 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:17.112 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:17.113 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:17.113 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:17.113 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:17.113 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:17.113 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:17.113 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:17.113 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:17.113 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:17.113 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.113 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.113 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.113 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:17.113 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.113 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:17.113 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.114 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:17.114 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:17.114 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:17.114 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:17.114 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:17.114 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:17.114 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.114 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:17.114 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:17.114 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:17.114 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:17.114 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:17.114 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:17.114 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.114 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:17.115 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:17.115 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:17.115 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:17.115 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:17.115 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:17.115 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:17.115 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:17.115 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:17.115 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:17.115 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:17.115 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.115 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.115 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:17.115 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:17.115 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:17.115 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:17.116 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:17.116 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.116 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.116 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:17.116 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:17.116 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:17.116 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:17.116 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:17.116 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.116 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:17.116 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:17.116 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:17.116 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:17.116 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:17.116 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:17.117 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.117 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:17.117 INFO:teuthology.orchestra.run.smithi003.stdout:____________ ERROR at teardown of test_put_obj_enc_conflict_s3_kms _____________ 2023-12-03T13:00:17.117 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.117 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.117 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.117 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:17.117 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:17.117 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.117 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:17.117 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.117 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:17.117 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:17.117 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:17.117 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.118 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:17.118 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:17.118 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.118 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.118 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:17.118 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:17.118 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.118 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.118 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:17.118 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.118 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:17.118 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:17.118 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.118 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.119 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:17.119 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:17.119 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.119 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:17.119 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:17.119 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:17.119 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:17.119 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:17.119 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.119 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:17.119 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.119 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:17.119 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:17.119 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:17.119 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:17.120 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:17.120 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:17.120 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:17.120 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:17.120 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.120 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.120 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:17.120 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:17.120 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:17.120 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:17.120 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.120 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:17.120 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:17.120 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:17.120 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:17.121 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.121 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.121 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:17.121 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:17.121 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:17.121 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:17.121 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.121 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.121 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:17.121 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:17.121 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:17.121 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.121 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:17.121 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.122 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:17.122 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:17.122 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.122 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:17.122 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:17.122 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:17.122 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:17.122 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:17.122 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:17.122 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.122 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:17.122 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.122 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:17.122 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.122 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.123 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:17.123 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.123 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:17.123 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.123 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:17.123 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:17.123 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:17.123 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:17.123 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:17.123 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:17.123 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.123 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:17.123 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:17.123 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:17.123 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:17.124 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:17.124 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:17.124 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.124 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:17.124 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:17.124 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:17.124 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:17.124 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:17.124 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:17.124 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:17.124 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:17.124 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:17.124 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:17.124 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:17.124 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.124 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.125 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:17.125 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.125 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:17.125 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:17.125 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:17.125 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:17.125 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:17.125 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:17.125 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:17.125 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:17.125 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:17.125 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:17.125 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:17.125 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:17.125 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:17.125 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:17.126 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:17.126 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:17.126 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:17.126 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:17.126 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:17.126 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:17.126 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:17.126 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:17.126 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:17.126 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:17.126 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:17.126 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:17.126 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:17.126 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:17.126 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.127 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.127 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.127 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.127 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:17.127 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:17.127 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.127 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:17.127 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.127 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:17.127 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:17.127 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:17.127 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.127 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:17.127 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:17.128 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.128 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.128 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:17.128 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:17.128 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.128 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.128 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:17.128 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:17.128 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:17.128 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:17.128 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:17.128 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.128 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.128 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:17.128 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:17.129 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:17.129 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.129 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:17.129 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.129 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:17.129 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.129 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:17.129 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.129 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:17.129 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.129 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:17.129 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:17.129 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:17.129 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:17.129 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.129 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:17.130 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.130 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:17.130 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:17.130 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:17.130 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:17.130 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:17.130 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:17.130 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:17.130 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:17.130 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:17.130 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:17.130 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:17.130 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:17.131 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:17.131 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:17.131 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:17.131 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:17.131 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:17.131 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:17.131 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:17.131 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:17.131 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:17.131 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:17.131 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:17.131 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:17.131 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:17.131 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:17.132 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:17.132 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:17.132 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:17.132 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:17.132 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:17.132 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:17.132 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:17.132 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:17.132 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:17.132 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:17.132 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:17.132 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:17.132 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:17.132 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:17.132 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.133 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.133 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.133 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:17.133 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.133 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:17.133 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.133 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:17.133 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:17.133 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:17.133 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:17.133 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:17.133 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:17.133 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.133 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:17.133 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:17.134 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:17.134 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:17.134 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:17.134 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:17.134 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.134 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:17.134 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:17.134 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:17.134 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:17.134 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:17.134 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:17.134 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:17.134 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:17.134 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:17.134 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:17.134 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:17.135 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.135 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.135 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:17.135 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:17.135 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:17.135 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:17.135 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:17.135 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.135 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.135 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:17.135 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:17.135 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:17.135 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:17.135 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:17.135 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.136 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:17.136 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:17.136 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:17.136 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:17.136 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:17.136 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:17.136 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.136 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:17.136 INFO:teuthology.orchestra.run.smithi003.stdout:__________ ERROR at teardown of test_put_obj_enc_conflict_bad_enc_kms __________ 2023-12-03T13:00:17.136 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.136 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.136 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.136 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:17.136 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:17.137 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.137 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:17.137 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.137 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:17.137 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:17.137 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:17.137 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.137 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:17.137 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:17.137 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.137 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.137 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:17.137 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:17.137 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.138 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.138 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:17.138 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.138 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:17.138 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:17.138 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.138 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.138 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:17.138 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:17.138 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.138 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:17.138 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:17.138 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:17.138 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:17.138 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:17.139 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.139 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:17.139 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.139 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:17.139 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:17.139 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:17.139 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:17.139 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:17.139 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:17.139 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:17.139 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:17.139 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.139 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.139 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:17.139 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:17.140 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:17.140 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:17.140 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.140 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:17.140 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:17.140 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:17.140 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:17.140 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.140 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.140 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:17.140 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:17.140 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:17.140 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:17.140 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.140 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.141 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:17.141 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:17.141 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:17.141 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.141 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:17.141 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.141 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:17.141 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:17.141 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.141 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:17.141 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:17.141 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:17.141 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:17.141 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:17.142 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:17.142 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.142 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:17.142 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.142 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:17.142 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.142 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.142 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:17.142 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.142 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:17.142 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.142 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:17.142 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:17.142 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:17.143 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:17.143 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:17.143 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:17.143 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.143 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:17.143 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:17.143 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:17.143 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:17.143 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:17.143 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:17.143 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.143 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:17.143 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:17.143 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:17.143 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:17.143 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:17.144 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:17.144 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:17.144 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:17.144 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:17.144 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:17.144 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:17.144 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.144 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.144 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:17.144 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.144 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:17.144 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:17.144 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:17.144 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:17.144 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:17.145 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:17.145 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:17.145 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:17.145 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:17.145 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:17.145 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:17.145 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:17.145 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:17.145 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:17.145 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:17.145 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:17.145 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:17.145 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:17.145 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:17.145 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:17.146 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:17.146 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:17.146 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:17.146 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:17.146 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:17.146 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:17.146 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:17.146 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:17.146 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.146 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.146 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.146 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.146 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:17.146 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:17.147 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.147 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:17.147 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.147 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:17.147 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:17.147 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:17.147 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.147 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:17.147 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:17.147 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.147 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.147 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:17.147 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:17.147 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.148 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.148 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:17.148 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:17.148 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:17.148 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:17.148 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:17.148 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.148 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.148 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:17.148 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:17.148 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:17.148 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.148 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:17.148 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.148 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:17.149 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.149 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:17.149 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.149 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:17.149 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.149 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:17.149 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:17.149 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:17.149 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:17.149 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.149 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:17.149 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.149 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:17.149 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:17.149 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:17.150 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:17.150 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:17.150 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:17.150 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:17.150 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:17.150 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:17.150 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:17.150 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:17.150 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:17.150 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:17.150 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:17.150 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:17.150 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:17.150 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:17.150 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:17.151 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:17.151 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:17.151 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:17.151 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:17.151 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:17.151 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:17.151 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:17.151 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:17.151 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:17.151 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:17.151 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:17.151 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:17.151 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:17.151 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:17.152 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:17.152 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:17.152 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:17.152 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:17.152 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:17.152 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:17.152 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:17.152 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:17.152 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.152 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.152 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.152 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:17.152 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.152 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:17.153 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.153 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:17.153 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:17.153 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:17.153 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:17.153 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:17.153 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:17.153 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.153 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:17.153 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:17.153 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:17.153 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:17.153 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:17.153 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:17.154 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.154 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:17.154 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:17.154 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:17.154 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:17.154 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:17.154 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:17.154 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:17.154 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:17.154 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:17.154 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:17.154 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:17.154 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.155 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.155 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:17.155 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:17.155 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:17.155 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:17.155 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:17.155 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.155 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.155 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:17.155 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:17.155 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:17.155 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:17.155 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:17.155 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.155 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:17.156 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:17.156 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:17.156 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:17.156 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:17.156 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:17.156 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.156 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:17.156 INFO:teuthology.orchestra.run.smithi003.stdout:__________ ERROR at teardown of test_bucket_policy_put_obj_kms_noenc ___________ 2023-12-03T13:00:17.156 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.156 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.156 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.156 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:17.156 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:17.156 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.156 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:17.157 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.157 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:17.157 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:17.157 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:17.157 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.157 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:17.157 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:17.157 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.157 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.157 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:17.157 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:17.157 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.157 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.157 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:17.157 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.158 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:17.158 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:17.158 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.158 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.158 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:17.158 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:17.158 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.158 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:17.158 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:17.158 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:17.158 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:17.158 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:17.158 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.158 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:17.159 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.159 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:17.159 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:17.159 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:17.159 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:17.159 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:17.159 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:17.159 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:17.159 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:17.159 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.159 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.159 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:17.159 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:17.159 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:17.159 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:17.160 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.160 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:17.160 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:17.160 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:17.160 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:17.160 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.160 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.160 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:17.160 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:17.160 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:17.160 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:17.160 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.160 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.160 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:17.160 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:17.161 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:17.161 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.161 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:17.161 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.161 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:17.161 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:17.161 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.161 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:17.161 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:17.161 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:17.161 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:17.161 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:17.161 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:17.161 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.162 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:17.162 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.162 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:17.162 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.162 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.162 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:17.162 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.162 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:17.162 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.162 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:17.162 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:17.162 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:17.162 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:17.162 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:17.162 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:17.163 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.163 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:17.163 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:17.163 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:17.163 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:17.163 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:17.163 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:17.163 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.163 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:17.163 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:17.163 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:17.163 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:17.163 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:17.163 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:17.164 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:17.164 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:17.164 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:17.164 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:17.164 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:17.164 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.164 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.164 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:17.164 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.164 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:17.164 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:17.164 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:17.164 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:17.164 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:17.165 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:17.165 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:17.165 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:17.165 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:17.165 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:17.165 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:17.165 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:17.165 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:17.165 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:17.165 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:17.165 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:17.165 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:17.165 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:17.165 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:17.166 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:17.166 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:17.166 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:17.166 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:17.166 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:17.166 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:17.166 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:17.166 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:17.166 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:17.166 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.166 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.166 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.166 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.166 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:17.167 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:17.167 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.167 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:17.167 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.167 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:17.167 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:17.167 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:17.167 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.167 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:17.167 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:17.167 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.167 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.167 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:17.167 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:17.168 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.168 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.168 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:17.168 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:17.168 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:17.168 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:17.168 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:17.168 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.168 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.168 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:17.168 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:17.168 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:17.168 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.169 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:17.169 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.169 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:17.169 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.169 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:17.169 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.169 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:17.169 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.169 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:17.169 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:17.169 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:17.169 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:17.169 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.169 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:17.170 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.170 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:17.170 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:17.170 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:17.170 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:17.170 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:17.170 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:17.170 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:17.170 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:17.170 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:17.170 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:17.170 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:17.170 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:17.170 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:17.171 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:17.171 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:17.171 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:17.171 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:17.171 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:17.171 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:17.171 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:17.171 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:17.171 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:17.171 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:17.171 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:17.171 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:17.171 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:17.171 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:17.171 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:17.172 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:17.172 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:17.172 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:17.172 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:17.172 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:17.172 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:17.172 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:17.172 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:17.172 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:17.172 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:17.172 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:17.172 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:17.172 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.172 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.172 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.173 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:17.173 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.173 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:17.173 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.173 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:17.173 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:17.173 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:17.173 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:17.173 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:17.173 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:17.173 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.173 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:17.173 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:17.173 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:17.174 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:17.174 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:17.174 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:17.174 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.174 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:17.174 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:17.174 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:17.174 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:17.174 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:17.174 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:17.174 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:17.174 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:17.174 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:17.174 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:17.175 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:17.175 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.175 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.175 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:17.175 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:17.175 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:17.175 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:17.175 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:17.175 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.175 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.175 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:17.175 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:17.175 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:17.175 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:17.175 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:17.175 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.176 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:17.176 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:17.176 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:17.176 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:17.176 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:17.176 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:17.176 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.176 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:17.176 INFO:teuthology.orchestra.run.smithi003.stdout:____________ ERROR at teardown of test_bucket_policy_put_obj_kms_s3 ____________ 2023-12-03T13:00:17.176 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.176 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.176 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.176 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:17.176 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:17.177 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.177 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:17.177 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.177 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:17.177 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:17.177 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:17.177 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.177 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:17.177 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:17.177 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.177 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.177 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:17.177 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:17.177 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.177 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.178 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:17.178 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.178 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:17.178 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:17.178 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.178 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.178 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:17.178 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:17.178 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.178 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:17.178 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:17.178 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:17.178 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:17.179 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:17.179 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.179 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:17.179 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.179 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:17.179 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:17.179 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:17.179 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:17.179 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:17.179 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:17.179 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:17.179 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:17.179 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.179 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.179 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:17.180 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:17.180 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:17.180 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:17.180 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.180 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:17.180 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:17.180 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:17.180 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:17.180 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.180 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.180 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:17.180 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:17.180 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:17.180 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:17.180 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.181 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.181 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:17.181 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:17.181 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:17.181 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.181 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:17.181 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.181 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:17.181 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:17.181 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.181 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:17.181 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:17.181 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:17.181 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:17.181 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:17.182 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:17.182 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.182 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:17.182 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.182 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:17.182 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.182 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.182 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:17.182 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.182 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:17.182 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.182 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:17.182 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:17.183 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:17.183 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:17.183 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:17.183 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:17.183 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.183 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:17.183 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:17.183 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:17.183 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:17.183 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:17.183 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:17.183 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.183 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:17.183 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:17.184 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:17.184 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:17.184 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:17.184 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:17.184 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:17.184 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:17.184 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:17.184 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:17.184 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:17.184 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.184 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.184 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:17.184 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.184 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:17.185 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:17.185 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:17.185 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:17.185 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:17.185 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:17.185 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:17.185 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:17.185 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:17.185 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:17.185 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:17.185 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:17.185 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:17.185 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:17.185 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:17.185 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:17.186 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:17.186 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:17.186 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:17.186 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:17.186 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:17.186 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:17.186 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:17.186 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:17.186 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:17.186 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:17.186 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:17.186 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:17.186 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.186 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.186 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.187 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.187 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:17.187 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:17.187 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.187 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:17.187 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.187 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:17.187 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:17.187 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:17.187 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.187 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:17.187 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:17.187 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.187 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.187 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:17.188 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:17.188 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.188 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.188 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:17.188 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:17.188 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:17.188 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:17.188 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:17.188 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.188 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.188 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:17.188 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:17.188 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:17.188 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.188 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:17.189 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.189 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:17.189 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.189 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:17.189 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.189 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:17.189 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.189 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:17.189 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:17.189 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:17.189 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:17.189 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.189 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:17.189 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.189 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:17.189 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:17.190 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:17.190 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:17.190 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:17.190 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:17.190 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:17.190 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:17.190 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:17.190 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:17.190 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:17.190 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:17.190 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:17.190 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:17.190 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:17.191 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:17.191 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:17.191 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:17.191 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:17.191 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:17.191 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:17.191 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:17.191 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:17.191 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:17.191 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:17.191 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:17.191 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:17.191 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:17.191 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:17.192 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:17.192 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:17.192 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:17.192 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:17.192 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:17.192 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:17.192 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:17.192 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:17.192 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:17.192 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:17.192 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:17.192 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.192 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.192 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.193 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:17.193 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.193 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:17.193 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.193 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:17.193 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:17.193 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:17.193 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:17.193 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:17.193 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:17.193 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.193 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:17.193 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:17.193 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:17.193 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:17.194 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:17.194 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:17.194 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.194 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:17.194 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:17.194 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:17.194 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:17.194 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:17.194 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:17.194 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:17.194 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:17.194 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:17.194 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:17.194 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:17.194 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.195 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.195 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:17.195 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:17.195 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:17.195 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:17.195 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:17.195 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.195 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.195 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:17.195 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:17.195 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:17.195 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:17.195 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:17.195 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.196 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:17.196 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:17.196 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:17.196 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:17.196 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:17.196 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:17.196 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.196 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:17.196 INFO:teuthology.orchestra.run.smithi003.stdout:_______ ERROR at teardown of test_bucket_policy_get_obj_acl_existing_tag _______ 2023-12-03T13:00:17.196 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.196 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.196 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.196 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:17.196 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:17.196 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.197 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:17.197 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.197 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:17.197 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:17.197 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:17.197 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.197 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:17.197 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:17.197 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.197 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.197 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:17.197 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:17.197 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.197 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.197 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:17.198 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.198 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:17.198 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:17.198 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.198 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.198 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:17.198 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:17.198 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.198 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:17.198 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:17.198 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:17.198 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:17.198 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:17.198 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.198 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:17.198 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.199 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:17.199 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:17.199 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:17.199 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:17.199 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:17.199 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:17.199 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:17.199 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:17.199 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.199 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.199 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:17.199 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:17.199 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:17.199 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:17.199 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.200 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:17.200 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:17.200 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:17.200 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:17.200 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.200 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.200 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:17.200 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:17.200 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:17.200 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:17.200 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.200 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.200 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:17.200 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:17.200 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:17.201 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.201 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:17.201 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.201 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:17.201 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:17.201 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.201 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:17.201 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:17.201 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:17.201 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:17.201 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:17.201 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:17.201 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.201 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:17.202 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.202 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:17.202 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.202 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.202 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:17.202 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.202 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:17.202 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.202 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:17.202 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:17.202 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:17.202 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:17.202 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:17.203 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:17.203 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.203 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:17.203 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:17.203 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:17.203 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:17.203 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:17.203 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:17.203 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.203 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:17.203 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:17.203 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:17.203 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:17.203 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:17.203 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:17.203 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:17.204 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:17.204 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:17.204 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:17.204 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:17.204 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.204 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.204 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:17.204 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.204 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:17.204 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:17.204 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:17.204 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:17.204 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:17.204 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:17.205 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:17.205 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:17.205 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:17.205 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:17.205 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:17.205 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:17.205 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:17.205 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:17.205 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:17.205 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:17.205 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:17.205 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:17.205 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:17.205 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:17.205 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:17.206 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:17.206 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:17.206 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:17.206 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:17.206 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:17.206 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:17.206 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:17.206 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.206 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.206 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.206 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.206 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:17.206 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:17.206 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.206 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:17.207 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.207 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:17.207 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:17.207 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:17.207 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.207 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:17.207 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:17.207 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.207 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.207 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:17.207 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:17.207 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.207 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.207 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:17.208 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:17.208 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:17.208 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:17.208 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:17.208 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.208 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.208 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:17.208 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:17.208 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:17.208 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.208 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:17.208 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.208 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:17.208 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.208 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:17.209 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.209 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:17.209 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.209 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:17.209 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:17.209 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:17.209 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:17.209 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.209 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:17.209 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.209 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:17.209 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:17.209 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:17.209 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:17.209 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:17.210 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:17.210 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:17.210 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:17.210 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:17.210 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:17.210 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:17.210 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:17.210 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:17.210 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:17.210 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:17.210 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:17.210 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:17.210 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:17.210 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:17.211 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:17.211 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:17.211 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:17.211 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:17.211 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:17.211 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:17.211 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:17.211 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:17.211 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:17.211 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:17.211 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:17.211 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:17.211 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:17.212 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:17.212 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:17.212 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:17.212 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:17.212 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:17.212 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:17.212 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:17.212 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:17.212 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.212 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.212 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.212 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:17.212 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.212 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:17.212 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.213 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:17.213 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:17.213 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:17.213 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:17.213 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:17.213 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:17.213 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.213 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:17.213 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:17.213 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:17.213 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:17.213 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:17.213 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:17.213 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.214 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:17.214 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:17.214 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:17.214 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:17.214 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:17.214 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:17.214 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:17.214 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:17.214 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:17.214 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:17.214 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:17.214 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.214 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.215 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:17.215 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:17.215 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:17.215 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:17.215 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:17.215 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.215 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.215 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:17.215 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:17.215 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:17.215 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:17.215 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:17.215 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.215 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:17.215 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:17.215 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:17.216 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:17.216 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:17.216 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:17.216 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.216 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:17.216 INFO:teuthology.orchestra.run.smithi003.stdout:______________ ERROR at teardown of test_object_lock_put_obj_lock ______________ 2023-12-03T13:00:17.216 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.216 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.216 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.216 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:17.216 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:17.216 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.216 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:17.216 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.216 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:17.216 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:17.217 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:17.217 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.217 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:17.217 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:17.217 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.217 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.217 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:17.217 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:17.217 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.217 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.217 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:17.217 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.217 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:17.217 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:17.217 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.218 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.218 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:17.218 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:17.218 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.218 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:17.218 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:17.218 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:17.218 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:17.218 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:17.218 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.218 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:17.218 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.218 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:17.219 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:17.219 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:17.219 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:17.219 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:17.219 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:17.219 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:17.219 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:17.219 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.219 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.219 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:17.219 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:17.219 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:17.219 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:17.219 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.220 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:17.220 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:17.220 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:17.220 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:17.220 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.220 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.220 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:17.220 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:17.220 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:17.220 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:17.220 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.220 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.220 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:17.220 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:17.220 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:17.221 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.221 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:17.221 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.221 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:17.221 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:17.221 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.221 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:17.221 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:17.221 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:17.221 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:17.221 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:17.221 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:17.221 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.221 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:17.222 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.222 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:17.222 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.222 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.222 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:17.222 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.222 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:17.222 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.222 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:17.222 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:17.222 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:17.222 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:17.222 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:17.222 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:17.222 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.223 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:17.223 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:17.223 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:17.223 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:17.223 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:17.223 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:17.223 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.223 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:17.223 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:17.223 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:17.223 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:17.223 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:17.223 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:17.223 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:17.224 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:17.224 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:17.224 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:17.224 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:17.224 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.224 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.224 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:17.224 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.224 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:17.224 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:17.224 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:17.224 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:17.224 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:17.224 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:17.224 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:17.225 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:17.225 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:17.225 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:17.225 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:17.225 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:17.225 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:17.225 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:17.225 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:17.225 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:17.225 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:17.225 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:17.225 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:17.225 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:17.225 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:17.225 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:17.225 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:17.226 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:17.226 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:17.226 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:17.226 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:17.226 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:17.226 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.226 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.226 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.226 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.226 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:17.226 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:17.226 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.226 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:17.227 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.227 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:17.227 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:17.227 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:17.227 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.227 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:17.227 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:17.227 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.227 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.227 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:17.227 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:17.227 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.227 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.227 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:17.227 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:17.228 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:17.228 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:17.228 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:17.228 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.228 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.228 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:17.228 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:17.228 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:17.228 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.228 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:17.228 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.228 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:17.228 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.228 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:17.228 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.229 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:17.229 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.229 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:17.229 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:17.229 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:17.229 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:17.229 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.229 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:17.229 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.229 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:17.229 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:17.229 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:17.229 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:17.229 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:17.229 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:17.230 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:17.230 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:17.230 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:17.230 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:17.230 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:17.230 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:17.230 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:17.230 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:17.230 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:17.230 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:17.230 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:17.230 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:17.230 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:17.230 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:17.231 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:17.231 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:17.231 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:17.231 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:17.231 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:17.231 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:17.231 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:17.231 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:17.231 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:17.231 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:17.231 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:17.231 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:17.231 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:17.231 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:17.232 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:17.232 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:17.232 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:17.232 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:17.232 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:17.232 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:17.232 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.232 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.232 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.232 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:17.232 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.232 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:17.232 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.232 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:17.232 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:17.233 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:17.233 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:17.233 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:17.233 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:17.233 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.233 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:17.233 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:17.233 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:17.233 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:17.233 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:17.233 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:17.233 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.233 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:17.233 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:17.233 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:17.234 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:17.234 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:17.234 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:17.234 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:17.234 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:17.234 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:17.234 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:17.234 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:17.234 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.234 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.234 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:17.234 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:17.234 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:17.234 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:17.235 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:17.235 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.235 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.235 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:17.235 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:17.235 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:17.235 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:17.235 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:17.235 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.235 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:17.235 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:17.235 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:17.235 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:17.235 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:17.235 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:17.236 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.236 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:17.236 INFO:teuthology.orchestra.run.smithi003.stdout:______ ERROR at teardown of test_object_lock_put_obj_lock_invalid_bucket _______ 2023-12-03T13:00:17.236 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.236 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.236 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.236 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:17.236 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:17.236 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.236 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:17.236 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.236 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:17.236 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:17.236 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:17.236 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.237 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:17.237 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:17.237 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.237 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.237 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:17.237 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:17.237 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.237 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.237 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:17.237 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.237 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:17.237 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:17.237 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.237 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.238 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:17.238 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:17.238 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.238 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:17.238 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:17.238 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:17.238 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:17.238 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:17.238 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.238 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:17.238 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.238 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:17.238 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:17.238 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:17.239 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:17.239 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:17.239 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:17.239 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:17.239 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:17.239 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.239 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.239 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:17.239 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:17.239 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:17.239 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:17.239 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.239 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:17.239 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:17.239 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:17.239 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:17.240 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.240 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.240 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:17.240 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:17.240 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:17.240 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:17.240 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.240 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.240 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:17.240 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:17.240 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:17.240 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.240 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:17.240 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.241 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:17.241 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:17.241 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.241 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:17.241 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:17.241 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:17.241 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:17.241 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:17.241 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:17.241 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.241 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:17.241 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.241 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:17.241 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.241 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.242 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:17.242 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.242 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:17.242 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.242 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:17.242 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:17.242 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:17.242 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:17.242 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:17.242 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:17.242 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.242 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:17.242 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:17.243 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:17.243 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:17.243 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:17.243 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:17.243 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.243 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:17.243 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:17.243 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:17.243 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:17.243 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:17.243 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:17.243 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:17.243 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:17.243 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:17.243 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:17.243 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:17.244 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.244 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.244 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:17.244 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.244 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:17.244 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:17.244 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:17.244 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:17.244 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:17.244 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:17.244 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:17.244 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:17.244 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:17.244 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:17.244 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:17.244 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:17.245 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:17.245 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:17.245 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:17.245 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:17.245 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:17.245 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:17.245 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:17.245 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:17.245 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:17.245 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:17.245 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:17.245 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:17.245 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:17.245 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:17.245 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:17.246 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:17.246 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.246 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.246 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.246 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.246 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:17.246 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:17.246 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.246 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:17.246 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.246 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:17.246 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:17.246 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:17.246 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.247 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:17.247 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:17.247 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.247 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.247 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:17.247 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:17.247 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.247 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.247 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:17.247 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:17.247 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:17.247 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:17.247 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:17.247 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.247 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.248 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:17.248 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:17.248 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:17.248 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.248 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:17.248 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.248 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:17.248 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.248 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:17.248 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.248 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:17.248 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.248 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:17.248 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:17.248 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:17.248 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:17.248 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.249 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:17.249 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.249 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:17.249 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:17.249 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:17.249 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:17.249 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:17.249 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:17.249 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:17.249 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:17.249 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:17.249 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:17.249 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:17.249 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:17.250 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:17.250 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:17.250 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:17.250 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:17.250 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:17.250 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:17.250 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:17.250 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:17.250 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:17.250 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:17.250 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:17.250 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:17.250 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:17.250 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:17.251 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:17.251 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:17.251 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:17.251 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:17.251 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:17.251 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:17.251 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:17.251 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:17.251 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:17.251 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:17.251 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:17.251 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:17.251 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:17.251 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:17.252 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.252 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.252 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.252 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:17.252 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.252 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:17.252 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.252 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:17.252 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:17.252 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:17.252 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:17.252 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:17.252 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:17.252 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.252 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:17.252 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:17.253 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:17.253 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:17.253 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:17.253 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:17.253 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.253 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:17.253 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:17.253 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:17.253 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:17.253 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:17.253 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:17.253 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:17.253 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:17.253 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:17.253 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:17.254 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:17.254 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.254 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.254 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:17.254 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:17.254 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:17.254 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:17.254 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:17.254 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.254 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.254 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:17.254 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:17.254 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:17.254 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:17.255 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:17.255 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.255 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:17.255 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:17.255 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:17.255 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:17.255 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:17.255 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:17.255 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.255 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:17.255 INFO:teuthology.orchestra.run.smithi003.stdout:____ ERROR at teardown of test_object_lock_put_obj_lock_with_days_and_years ____ 2023-12-03T13:00:17.255 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.255 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.255 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.255 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:17.256 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:17.256 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.256 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:17.256 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.256 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:17.256 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:17.256 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:17.256 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.256 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:17.256 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:17.256 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.256 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.256 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:17.256 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:17.256 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.257 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.257 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:17.257 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.257 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:17.257 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:17.257 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.257 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.257 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:17.257 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:17.257 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.257 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:17.257 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:17.257 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:17.257 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:17.257 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:17.257 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.258 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:17.258 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.258 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:17.258 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:17.258 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:17.258 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:17.258 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:17.258 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:17.258 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:17.258 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:17.258 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.258 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.258 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:17.258 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:17.259 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:17.259 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:17.259 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.259 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:17.259 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:17.259 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:17.259 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:17.259 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.259 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.259 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:17.259 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:17.259 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:17.259 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:17.259 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.259 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.260 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:17.260 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:17.260 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:17.260 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.260 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:17.260 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.260 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:17.260 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:17.260 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.260 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:17.260 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:17.260 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:17.260 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:17.260 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:17.261 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:17.261 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.261 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:17.261 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.261 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:17.261 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.261 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.261 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:17.261 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.261 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:17.261 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.261 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:17.261 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:17.261 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:17.262 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:17.262 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:17.262 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:17.262 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.262 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:17.262 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:17.262 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:17.262 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:17.262 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:17.262 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:17.262 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.262 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:17.262 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:17.262 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:17.263 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:17.263 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:17.263 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:17.263 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:17.263 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:17.263 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:17.263 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:17.263 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:17.263 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.263 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.263 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:17.263 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.263 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:17.263 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:17.263 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:17.264 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:17.264 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:17.264 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:17.264 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:17.264 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:17.264 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:17.264 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:17.264 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:17.264 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:17.264 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:17.264 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:17.264 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:17.264 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:17.264 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:17.264 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:17.264 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:17.265 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:17.265 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:17.265 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:17.265 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:17.265 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:17.265 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:17.265 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:17.265 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:17.265 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:17.265 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.265 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.265 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.265 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.265 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:17.265 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:17.265 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.266 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:17.266 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.266 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:17.266 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:17.266 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:17.266 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.266 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:17.266 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:17.266 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.266 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.266 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:17.266 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:17.266 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.266 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.266 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:17.267 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:17.267 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:17.267 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:17.267 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:17.267 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.267 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.267 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:17.267 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:17.267 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:17.267 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.267 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:17.267 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.267 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:17.267 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.267 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:17.268 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.268 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:17.268 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.268 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:17.268 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:17.268 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:17.268 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:17.268 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.268 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:17.268 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.268 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:17.268 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:17.268 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:17.268 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:17.268 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:17.269 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:17.269 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:17.269 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:17.269 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:17.269 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:17.269 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:17.269 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:17.269 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:17.269 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:17.269 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:17.269 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:17.269 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:17.269 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:17.269 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:17.269 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:17.269 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:17.270 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:17.270 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:17.270 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:17.270 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:17.270 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:17.270 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:17.270 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:17.270 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:17.270 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:17.270 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:17.270 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:17.270 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:17.270 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:17.270 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:17.271 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:17.271 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:17.271 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:17.271 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:17.271 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:17.271 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.271 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.271 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.271 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:17.271 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.271 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:17.271 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.271 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:17.271 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:17.271 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:17.272 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:17.272 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:17.272 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:17.272 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.272 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:17.272 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:17.272 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:17.272 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:17.272 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:17.272 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:17.272 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.272 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:17.272 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:17.272 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:17.273 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:17.273 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:17.273 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:17.273 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:17.273 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:17.273 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:17.273 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:17.273 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:17.273 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.273 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.273 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:17.273 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:17.273 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:17.273 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:17.273 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:17.274 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.274 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.274 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:17.274 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:17.274 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:17.274 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:17.274 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:17.274 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.274 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:17.274 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:17.274 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:17.274 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:17.274 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:17.274 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:17.275 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.275 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:17.275 INFO:teuthology.orchestra.run.smithi003.stdout:_______ ERROR at teardown of test_object_lock_put_obj_lock_invalid_days ________ 2023-12-03T13:00:17.275 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.275 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.275 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.275 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:17.275 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:17.275 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.275 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:17.275 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.275 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:17.275 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:17.275 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:17.275 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.275 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:17.276 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:17.276 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.276 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.276 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:17.276 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:17.276 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.276 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.276 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:17.276 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.276 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:17.276 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:17.276 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.276 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.276 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:17.276 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:17.276 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.277 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:17.277 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:17.277 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:17.277 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:17.277 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:17.277 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.277 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:17.277 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.277 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:17.277 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:17.277 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:17.277 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:17.277 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:17.277 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:17.278 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:17.278 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:17.278 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.278 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.278 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:17.278 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:17.278 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:17.278 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:17.278 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.278 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:17.278 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:17.278 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:17.278 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:17.278 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.279 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.279 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:17.279 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:17.279 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:17.279 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:17.279 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.279 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.279 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:17.279 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:17.279 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:17.279 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.279 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:17.279 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.279 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:17.279 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:17.279 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.280 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:17.280 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:17.280 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:17.280 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:17.280 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:17.280 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:17.280 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.280 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:17.280 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.280 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:17.280 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.280 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.280 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:17.280 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.281 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:17.281 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.281 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:17.281 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:17.281 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:17.281 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:17.281 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:17.281 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:17.281 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.281 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:17.281 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:17.281 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:17.281 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:17.281 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:17.282 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:17.282 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.282 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:17.282 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:17.282 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:17.282 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:17.282 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:17.282 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:17.282 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:17.282 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:17.282 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:17.282 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:17.282 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:17.282 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.283 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.283 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:17.283 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.283 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:17.283 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:17.283 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:17.283 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:17.283 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:17.283 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:17.283 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:17.283 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:17.283 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:17.283 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:17.283 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:17.283 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:17.283 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:17.284 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:17.284 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:17.284 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:17.284 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:17.284 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:17.284 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:17.284 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:17.284 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:17.284 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:17.284 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:17.284 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:17.284 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:17.284 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:17.284 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:17.285 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:17.285 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.285 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.285 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.285 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.285 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:17.285 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:17.285 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.285 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:17.285 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.285 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:17.285 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:17.285 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:17.285 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.286 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:17.286 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:17.286 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.286 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.286 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:17.286 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:17.286 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.286 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.286 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:17.286 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:17.286 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:17.286 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:17.286 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:17.286 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.287 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.287 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:17.287 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:17.287 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:17.287 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.287 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:17.287 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.287 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:17.287 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.287 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:17.287 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.287 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:17.287 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.287 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:17.288 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:17.288 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:17.288 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:17.288 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.288 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:17.288 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.288 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:17.288 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:17.288 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:17.288 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:17.288 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:17.288 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:17.288 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:17.288 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:17.288 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:17.289 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:17.289 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:17.289 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:17.289 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:17.289 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:17.289 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:17.289 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:17.289 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:17.289 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:17.289 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:17.289 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:17.289 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:17.289 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:17.289 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:17.289 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:17.290 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:17.290 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:17.290 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:17.290 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:17.290 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:17.290 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:17.290 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:17.290 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:17.290 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:17.290 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:17.290 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:17.290 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:17.290 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:17.290 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:17.291 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:17.291 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:17.291 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.291 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.291 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.291 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:17.291 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.291 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:17.291 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.291 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:17.291 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:17.291 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:17.291 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:17.291 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:17.292 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:17.292 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.292 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:17.292 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:17.292 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:17.292 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:17.292 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:17.292 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:17.292 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.292 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:17.292 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:17.292 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:17.292 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:17.292 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:17.292 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:17.293 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:17.293 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:17.293 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:17.293 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:17.293 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:17.293 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.293 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.293 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:17.293 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:17.293 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:17.293 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:17.293 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:17.293 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.293 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.293 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:17.294 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:17.294 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:17.294 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:17.294 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:17.294 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.294 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:17.294 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:17.294 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:17.294 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:17.294 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:17.294 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:17.294 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.294 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:17.294 INFO:teuthology.orchestra.run.smithi003.stdout:_______ ERROR at teardown of test_object_lock_put_obj_lock_invalid_years _______ 2023-12-03T13:00:17.294 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.295 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.295 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.295 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:17.295 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:17.295 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.295 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:17.295 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.295 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:17.295 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:17.295 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:17.295 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.295 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:17.295 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:17.295 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.295 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.296 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:17.296 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:17.296 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.296 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.296 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:17.296 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.296 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:17.296 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:17.296 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.296 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.296 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:17.296 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:17.296 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.296 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:17.297 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:17.297 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:17.297 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:17.297 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:17.297 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.297 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:17.297 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.297 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:17.297 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:17.297 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:17.297 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:17.297 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:17.297 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:17.297 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:17.297 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:17.298 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.298 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.298 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:17.298 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:17.298 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:17.298 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:17.298 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.298 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:17.298 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:17.298 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:17.298 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:17.298 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.298 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.298 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:17.299 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:17.299 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:17.299 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:17.299 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.299 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.299 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:17.299 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:17.299 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:17.299 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.299 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:17.299 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.299 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:17.299 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:17.299 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.300 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:17.300 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:17.300 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:17.300 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:17.300 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:17.300 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:17.300 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.300 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:17.300 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.300 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:17.300 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.300 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.300 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:17.300 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.301 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:17.301 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.301 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:17.301 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:17.301 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:17.301 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:17.301 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:17.301 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:17.301 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.301 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:17.301 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:17.301 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:17.301 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:17.301 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:17.302 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:17.302 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.302 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:17.302 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:17.302 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:17.302 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:17.302 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:17.302 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:17.302 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:17.302 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:17.302 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:17.302 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:17.302 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:17.303 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.303 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.303 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:17.303 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.303 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:17.303 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:17.303 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:17.303 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:17.303 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:17.303 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:17.303 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:17.303 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:17.303 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:17.303 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:17.303 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:17.304 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:17.304 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:17.304 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:17.304 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:17.304 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:17.304 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:17.304 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:17.304 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:17.304 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:17.304 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:17.304 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:17.304 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:17.304 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:17.304 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:17.305 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:17.305 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:17.305 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:17.305 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.305 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.305 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.305 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.305 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:17.305 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:17.305 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.305 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:17.305 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.305 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:17.305 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:17.305 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:17.305 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.306 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:17.306 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:17.306 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.306 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.306 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:17.306 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:17.306 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.306 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.306 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:17.306 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:17.306 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:17.306 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:17.306 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:17.306 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.307 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.307 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:17.307 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:17.307 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:17.307 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.307 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:17.307 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.307 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:17.307 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.307 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:17.307 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.307 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:17.307 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.308 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:17.308 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:17.308 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:17.308 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:17.308 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.308 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:17.308 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.308 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:17.308 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:17.308 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:17.308 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:17.308 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:17.308 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:17.308 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:17.308 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:17.309 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:17.309 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:17.309 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:17.309 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:17.309 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:17.309 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:17.309 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:17.309 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:17.309 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:17.309 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:17.309 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:17.309 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:17.309 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:17.309 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:17.310 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:17.310 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:17.310 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:17.310 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:17.310 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:17.310 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:17.310 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:17.310 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:17.310 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:17.310 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:17.310 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:17.310 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:17.310 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:17.310 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:17.311 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:17.311 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:17.311 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:17.311 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:17.311 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.311 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.311 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.311 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:17.311 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.311 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:17.311 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.311 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:17.311 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:17.311 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:17.312 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:17.312 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:17.312 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:17.312 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.312 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:17.312 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:17.312 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:17.312 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:17.312 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:17.312 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:17.312 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.312 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:17.312 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:17.312 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:17.312 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:17.313 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:17.313 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:17.313 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:17.313 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:17.313 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:17.313 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:17.313 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:17.313 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.313 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.313 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:17.313 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:17.313 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:17.313 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:17.313 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:17.313 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.313 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.314 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:17.314 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:17.314 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:17.314 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:17.314 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:17.314 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.314 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:17.314 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:17.314 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:17.314 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:17.314 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:17.314 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:17.314 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.315 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:17.315 INFO:teuthology.orchestra.run.smithi003.stdout:_______ ERROR at teardown of test_object_lock_put_obj_lock_invalid_mode ________ 2023-12-03T13:00:17.315 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.315 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.315 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.315 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:17.315 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:17.315 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.315 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:17.315 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.315 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:17.315 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:17.315 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:17.315 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.315 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:17.316 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:17.316 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.316 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.316 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:17.316 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:17.316 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.316 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.316 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:17.316 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.316 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:17.316 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:17.316 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.316 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.316 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:17.316 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:17.317 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.317 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:17.317 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:17.317 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:17.317 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:17.317 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:17.317 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.317 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:17.317 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.317 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:17.317 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:17.317 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:17.317 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:17.317 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:17.317 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:17.318 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:17.318 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:17.318 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.318 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.318 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:17.318 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:17.318 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:17.318 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:17.318 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.318 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:17.318 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:17.318 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:17.318 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:17.318 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.319 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.319 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:17.319 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:17.319 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:17.319 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:17.319 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.319 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.319 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:17.319 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:17.319 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:17.319 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.319 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:17.319 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.319 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:17.320 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:17.320 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.320 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:17.320 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:17.320 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:17.320 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:17.320 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:17.320 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:17.320 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.320 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:17.320 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.320 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:17.320 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.320 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.321 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:17.321 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.321 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:17.321 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.321 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:17.321 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:17.321 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:17.321 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:17.321 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:17.322 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:17.322 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.322 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:17.322 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:17.322 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:17.322 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:17.322 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:17.322 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:17.322 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.322 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:17.322 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:17.322 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:17.322 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:17.322 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:17.323 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:17.323 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:17.323 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:17.323 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:17.323 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:17.323 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:17.323 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.323 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.323 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:17.323 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.323 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:17.323 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:17.323 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:17.323 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:17.324 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:17.324 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:17.324 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:17.324 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:17.324 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:17.324 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:17.324 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:17.324 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:17.324 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:17.324 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:17.324 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:17.324 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:17.325 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:17.325 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:17.325 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:17.325 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:17.325 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:17.325 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:17.325 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:17.325 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:17.325 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:17.325 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:17.325 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:17.325 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:17.325 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.326 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.326 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.326 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.326 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:17.326 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:17.326 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.326 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:17.326 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.326 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:17.326 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:17.326 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:17.326 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.326 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:17.327 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:17.327 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.327 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.327 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:17.327 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:17.327 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.327 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.327 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:17.327 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:17.327 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:17.327 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:17.327 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:17.327 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.327 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.328 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:17.328 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:17.328 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:17.328 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.328 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:17.328 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.328 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:17.328 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.328 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:17.328 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.328 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:17.328 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.328 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:17.328 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:17.328 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:17.329 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:17.329 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.329 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:17.329 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.329 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:17.329 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:17.329 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:17.329 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:17.329 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:17.329 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:17.329 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:17.329 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:17.329 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:17.330 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:17.330 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:17.330 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:17.330 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:17.330 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:17.330 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:17.330 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:17.330 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:17.330 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:17.330 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:17.330 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:17.330 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:17.330 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:17.331 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:17.331 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:17.331 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:17.331 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:17.331 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:17.331 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:17.331 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:17.331 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:17.331 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:17.331 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:17.331 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:17.331 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:17.331 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:17.332 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:17.332 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:17.332 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:17.332 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:17.332 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:17.332 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.332 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.332 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.332 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:17.332 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.332 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:17.332 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.332 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:17.333 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:17.333 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:17.333 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:17.333 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:17.333 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:17.333 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.333 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:17.333 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:17.333 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:17.333 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:17.333 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:17.333 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:17.333 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.334 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:17.334 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:17.334 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:17.334 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:17.334 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:17.334 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:17.334 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:17.334 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:17.334 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:17.334 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:17.334 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:17.334 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.334 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.334 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:17.335 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:17.335 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:17.335 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:17.335 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:17.335 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.335 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.335 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:17.335 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:17.335 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:17.335 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:17.335 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:17.335 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.335 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:17.336 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:17.336 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:17.336 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:17.336 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:17.336 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:17.336 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.336 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:17.336 INFO:teuthology.orchestra.run.smithi003.stdout:______ ERROR at teardown of test_object_lock_put_obj_lock_invalid_status _______ 2023-12-03T13:00:17.336 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.336 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.336 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.336 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:17.336 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:17.336 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.337 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:17.337 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.337 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:17.337 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:17.337 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:17.337 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.337 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:17.337 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:17.337 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.337 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.337 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:17.337 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:17.337 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.337 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.337 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:17.338 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.338 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:17.338 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:17.338 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.338 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.338 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:17.338 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:17.338 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.338 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:17.338 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:17.338 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:17.338 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:17.338 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:17.338 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.339 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:17.339 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.339 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:17.339 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:17.339 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:17.339 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:17.339 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:17.339 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:17.339 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:17.339 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:17.339 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.339 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.339 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:17.339 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:17.339 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:17.340 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:17.340 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.340 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:17.340 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:17.340 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:17.340 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:17.340 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.340 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.340 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:17.340 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:17.340 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:17.340 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:17.340 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.340 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.341 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:17.341 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:17.341 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:17.341 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.341 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:17.341 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.341 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:17.341 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:17.341 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.341 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:17.341 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:17.341 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:17.341 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:17.342 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:17.342 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:17.342 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.342 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:17.342 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.342 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:17.342 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.342 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.342 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:17.342 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.342 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:17.342 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.342 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:17.342 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:17.342 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:17.343 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:17.343 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:17.343 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:17.343 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.343 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:17.343 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:17.343 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:17.343 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:17.343 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:17.343 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:17.343 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.343 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:17.343 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:17.343 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:17.343 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:17.344 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:17.344 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:17.344 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:17.344 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:17.344 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:17.344 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:17.344 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:17.344 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.344 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.344 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:17.344 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.344 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:17.344 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:17.344 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:17.344 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:17.345 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:17.345 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:17.345 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:17.345 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:17.345 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:17.345 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:17.345 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:17.345 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:17.345 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:17.345 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:17.345 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:17.345 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:17.345 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:17.345 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:17.345 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:17.346 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:17.346 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:17.346 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:17.346 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:17.346 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:17.346 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:17.346 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:17.346 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:17.346 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:17.346 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.346 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.346 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.346 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.346 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:17.347 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:17.347 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.347 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:17.347 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.347 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:17.347 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:17.347 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:17.347 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.347 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:17.347 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:17.347 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.347 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.347 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:17.347 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:17.348 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.348 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.348 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:17.348 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:17.348 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:17.348 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:17.348 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:17.348 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.348 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.348 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:17.348 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:17.348 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:17.348 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.348 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:17.348 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.348 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:17.349 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.349 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:17.349 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.349 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:17.349 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.349 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:17.349 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:17.349 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:17.349 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:17.349 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.349 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:17.349 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.349 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:17.349 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:17.349 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:17.350 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:17.350 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:17.350 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:17.350 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:17.350 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:17.350 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:17.350 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:17.350 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:17.350 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:17.350 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:17.350 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:17.350 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:17.350 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:17.350 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:17.351 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:17.351 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:17.351 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:17.351 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:17.351 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:17.351 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:17.351 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:17.351 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:17.351 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:17.351 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:17.351 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:17.351 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:17.351 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:17.351 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:17.351 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:17.352 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:17.352 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:17.352 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:17.352 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:17.352 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:17.352 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:17.352 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:17.352 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:17.352 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.352 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.352 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.352 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:17.352 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.352 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:17.353 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.353 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:17.353 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:17.353 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:17.353 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:17.353 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:17.353 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:17.353 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.353 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:17.353 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:17.353 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:17.353 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:17.353 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:17.353 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:17.353 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.354 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:17.354 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:17.354 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:17.354 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:17.354 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:17.354 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:17.354 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:17.354 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:17.354 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:17.354 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:17.354 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:17.354 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.354 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.354 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:17.355 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:17.355 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:17.355 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:17.355 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:17.355 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.355 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.355 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:17.355 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:17.355 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:17.355 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:17.355 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:17.355 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.355 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:17.355 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:17.355 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:17.355 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:17.356 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:17.356 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:17.356 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.356 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:17.356 INFO:teuthology.orchestra.run.smithi003.stdout:___________ ERROR at teardown of test_object_lock_suspend_versioning ___________ 2023-12-03T13:00:17.356 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.356 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.356 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.356 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:17.356 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:17.356 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.356 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:17.356 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.356 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:17.356 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:17.357 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:17.357 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.357 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:17.357 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:17.357 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.357 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.357 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:17.357 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:17.357 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.357 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.357 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:17.357 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.357 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:17.357 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:17.358 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.358 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.358 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:17.358 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:17.358 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.358 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:17.358 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:17.358 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:17.358 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:17.358 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:17.358 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.358 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:17.358 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.359 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:17.359 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:17.359 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:17.359 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:17.359 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:17.359 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:17.359 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:17.359 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:17.359 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.359 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.359 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:17.359 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:17.359 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:17.359 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:17.359 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.359 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:17.360 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:17.360 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:17.360 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:17.360 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.360 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.360 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:17.360 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:17.360 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:17.360 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:17.360 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.360 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.360 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:17.360 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:17.360 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:17.360 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.360 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:17.360 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.361 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:17.361 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:17.361 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.361 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:17.361 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:17.361 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:17.361 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:17.361 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:17.361 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:17.361 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.361 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:17.361 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.361 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:17.361 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.362 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.362 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:17.362 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.362 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:17.362 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.362 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:17.362 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:17.362 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:17.362 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:17.362 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:17.362 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:17.362 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.362 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:17.362 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:17.363 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:17.363 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:17.363 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:17.363 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:17.363 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.363 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:17.363 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:17.363 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:17.363 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:17.363 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:17.363 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:17.363 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:17.363 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:17.363 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:17.363 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:17.364 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:17.364 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.364 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.364 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:17.364 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.364 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:17.364 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:17.364 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:17.364 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:17.364 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:17.364 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:17.364 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:17.364 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:17.364 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:17.364 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:17.364 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:17.364 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:17.365 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:17.365 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:17.365 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:17.365 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:17.365 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:17.365 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:17.365 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:17.365 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:17.365 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:17.365 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:17.365 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:17.365 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:17.365 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:17.365 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:17.365 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:17.365 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:17.366 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.366 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.366 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.366 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.366 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:17.366 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:17.366 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.366 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:17.366 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.366 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:17.366 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:17.366 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:17.366 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.366 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:17.367 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:17.367 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.367 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.367 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:17.367 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:17.367 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.367 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.367 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:17.367 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:17.367 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:17.367 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:17.367 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:17.367 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.367 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.367 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:17.368 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:17.368 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:17.368 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.368 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:17.368 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.368 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:17.368 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.368 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:17.368 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.368 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:17.368 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.368 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:17.368 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:17.368 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:17.368 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:17.369 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.369 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:17.369 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.369 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:17.369 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:17.369 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:17.369 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:17.369 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:17.369 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:17.369 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:17.369 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:17.369 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:17.369 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:17.369 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:17.369 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:17.369 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:17.370 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:17.370 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:17.370 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:17.370 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:17.370 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:17.370 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:17.370 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:17.370 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:17.370 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:17.370 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:17.370 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:17.370 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:17.370 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:17.370 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:17.371 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:17.371 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:17.371 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:17.371 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:17.371 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:17.371 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:17.371 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:17.371 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:17.371 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:17.371 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:17.371 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:17.371 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:17.371 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:17.371 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.372 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.372 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.372 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:17.372 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.372 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:17.372 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.372 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:17.372 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:17.372 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:17.372 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:17.372 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:17.372 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:17.372 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.372 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:17.373 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:17.373 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:17.373 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:17.373 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:17.373 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:17.373 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.373 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:17.373 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:17.373 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:17.373 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:17.373 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:17.373 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:17.373 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:17.373 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:17.373 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:17.373 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:17.374 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:17.374 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.374 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.374 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:17.374 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:17.374 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:17.374 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:17.374 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:17.374 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.374 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.374 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:17.374 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:17.374 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:17.374 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:17.375 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:17.375 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.375 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:17.375 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:17.375 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:17.375 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:17.375 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:17.375 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:17.375 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.375 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:17.375 INFO:teuthology.orchestra.run.smithi003.stdout:______________ ERROR at teardown of test_object_lock_get_obj_lock ______________ 2023-12-03T13:00:17.375 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.375 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.375 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.376 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:17.376 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:17.376 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.376 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:17.376 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.376 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:17.376 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:17.376 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:17.376 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.376 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:17.376 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:17.376 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.376 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.376 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:17.376 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:17.377 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.377 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.377 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:17.377 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.377 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:17.377 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:17.377 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.377 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.377 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:17.377 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:17.377 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.377 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:17.377 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:17.377 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:17.378 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:17.378 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:17.378 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.378 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:17.378 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.378 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:17.378 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:17.378 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:17.378 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:17.378 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:17.378 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:17.378 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:17.378 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:17.378 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.378 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.379 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:17.379 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:17.379 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:17.379 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:17.379 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.379 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:17.379 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:17.379 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:17.379 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:17.379 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.379 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.379 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:17.379 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:17.379 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:17.380 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:17.380 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.380 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.380 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:17.380 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:17.380 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:17.380 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.380 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:17.380 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.380 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:17.380 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:17.380 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.380 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:17.380 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:17.380 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:17.381 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:17.381 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:17.381 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:17.381 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.381 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:17.381 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.381 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:17.381 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.381 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.381 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:17.381 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.381 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:17.381 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.382 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:17.382 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:17.382 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:17.382 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:17.382 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:17.382 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:17.382 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.382 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:17.382 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:17.382 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:17.382 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:17.382 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:17.382 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:17.382 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.383 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:17.383 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:17.383 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:17.383 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:17.383 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:17.383 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:17.383 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:17.383 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:17.383 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:17.383 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:17.383 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:17.383 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.383 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.383 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:17.383 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.384 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:17.384 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:17.384 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:17.384 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:17.384 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:17.384 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:17.384 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:17.384 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:17.384 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:17.384 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:17.384 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:17.384 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:17.384 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:17.384 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:17.385 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:17.385 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:17.385 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:17.385 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:17.385 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:17.385 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:17.385 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:17.385 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:17.385 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:17.385 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:17.385 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:17.385 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:17.385 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:17.385 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:17.386 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.386 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.386 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.386 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.386 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:17.386 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:17.386 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.386 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:17.386 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.386 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:17.386 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:17.386 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:17.386 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.387 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:17.387 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:17.387 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.387 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.387 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:17.387 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:17.387 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.387 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.387 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:17.387 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:17.387 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:17.387 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:17.387 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:17.387 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.387 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.388 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:17.388 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:17.388 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:17.388 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.388 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:17.388 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.388 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:17.388 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.388 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:17.388 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.388 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:17.388 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.388 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:17.388 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:17.388 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:17.389 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:17.389 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.389 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:17.389 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.389 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:17.389 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:17.389 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:17.389 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:17.389 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:17.389 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:17.389 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:17.389 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:17.389 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:17.389 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:17.389 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:17.390 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:17.390 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:17.390 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:17.390 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:17.390 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:17.390 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:17.390 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:17.390 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:17.390 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:17.390 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:17.390 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:17.390 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:17.390 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:17.390 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:17.391 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:17.391 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:17.391 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:17.391 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:17.391 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:17.391 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:17.391 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:17.391 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:17.391 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:17.391 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:17.391 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:17.391 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:17.391 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:17.391 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:17.391 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:17.392 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.392 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.392 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.392 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:17.392 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.392 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:17.392 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.392 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:17.392 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:17.392 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:17.392 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:17.392 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:17.392 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:17.392 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.393 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:17.393 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:17.393 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:17.393 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:17.393 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:17.393 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:17.393 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.393 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:17.393 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:17.393 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:17.393 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:17.393 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:17.393 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:17.394 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:17.394 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:17.394 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:17.394 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:17.394 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:17.394 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.394 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.394 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:17.394 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:17.394 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:17.394 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:17.394 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:17.394 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.394 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.394 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:17.395 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:17.395 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:17.395 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:17.395 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:17.395 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.395 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:17.395 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:17.395 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:17.395 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:17.395 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:17.395 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:17.395 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.395 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:17.395 INFO:teuthology.orchestra.run.smithi003.stdout:______ ERROR at teardown of test_object_lock_get_obj_lock_invalid_bucket _______ 2023-12-03T13:00:17.395 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.396 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.396 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.396 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:17.396 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:17.396 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.396 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:17.396 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.396 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:17.396 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:17.396 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:17.396 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.396 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:17.396 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:17.396 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.396 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.397 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:17.397 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:17.397 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.397 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.397 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:17.397 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.397 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:17.397 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:17.397 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.397 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.397 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:17.397 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:17.397 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.397 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:17.397 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:17.398 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:17.398 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:17.398 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:17.398 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.398 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:17.398 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.398 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:17.398 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:17.398 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:17.398 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:17.398 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:17.398 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:17.398 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:17.398 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:17.398 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.398 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.399 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:17.399 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:17.399 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:17.399 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:17.399 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.399 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:17.399 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:17.399 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:17.399 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:17.399 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.399 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.399 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:17.399 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:17.399 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:17.400 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:17.400 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.400 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.400 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:17.400 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:17.400 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:17.400 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.400 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:17.400 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.400 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:17.400 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:17.400 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.400 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:17.400 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:17.400 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:17.401 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:17.401 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:17.401 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:17.401 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.401 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:17.401 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.401 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:17.401 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.401 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.401 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:17.401 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.401 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:17.401 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.401 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:17.402 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:17.402 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:17.402 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:17.402 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:17.402 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:17.402 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.402 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:17.402 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:17.402 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:17.402 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:17.402 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:17.402 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:17.402 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.402 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:17.403 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:17.403 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:17.403 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:17.403 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:17.403 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:17.403 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:17.403 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:17.403 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:17.403 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:17.403 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:17.403 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.403 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.403 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:17.403 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.404 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:17.404 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:17.404 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:17.404 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:17.404 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:17.404 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:17.404 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:17.404 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:17.404 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:17.404 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:17.404 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:17.404 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:17.404 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:17.404 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:17.404 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:17.405 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:17.405 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:17.405 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:17.405 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:17.405 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:17.405 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:17.405 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:17.405 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:17.405 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:17.405 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:17.405 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:17.405 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:17.405 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:17.405 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.405 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.406 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.406 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.406 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:17.406 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:17.406 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.406 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:17.406 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.406 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:17.406 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:17.406 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:17.406 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.406 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:17.406 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:17.406 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.407 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.407 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:17.407 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:17.407 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.407 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.407 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:17.407 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:17.407 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:17.407 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:17.407 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:17.407 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.407 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.407 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:17.407 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:17.408 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:17.408 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.408 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:17.408 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.408 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:17.408 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.408 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:17.408 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.408 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:17.408 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.408 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:17.408 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:17.408 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:17.408 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:17.408 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.409 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:17.409 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.409 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:17.409 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:17.409 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:17.409 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:17.409 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:17.409 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:17.409 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:17.409 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:17.409 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:17.409 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:17.409 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:17.409 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:17.409 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:17.410 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:17.410 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:17.410 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:17.410 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:17.410 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:17.410 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:17.410 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:17.410 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:17.410 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:17.410 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:17.410 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:17.410 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:17.410 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:17.411 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:17.411 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:17.411 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:17.411 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:17.411 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:17.411 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:17.411 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:17.411 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:17.411 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:17.411 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:17.411 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:17.411 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:17.411 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:17.411 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:17.412 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.412 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.412 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.412 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:17.412 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.412 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:17.412 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.412 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:17.412 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:17.412 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:17.412 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:17.412 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:17.412 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:17.412 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.413 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:17.413 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:17.413 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:17.413 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:17.413 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:17.413 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:17.413 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.413 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:17.413 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:17.413 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:17.413 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:17.413 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:17.413 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:17.413 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:17.413 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:17.414 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:17.414 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:17.414 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:17.414 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.414 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.414 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:17.414 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:17.414 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:17.414 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:17.414 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:17.414 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.414 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.414 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:17.414 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:17.415 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:17.415 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:17.415 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:17.415 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.415 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:17.415 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:17.415 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:17.415 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:17.415 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:17.415 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:17.415 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.415 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:17.415 INFO:teuthology.orchestra.run.smithi003.stdout:___________ ERROR at teardown of test_object_lock_put_obj_retention ____________ 2023-12-03T13:00:17.415 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.415 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.416 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.416 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:17.416 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:17.416 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.416 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:17.416 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.416 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:17.416 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:17.416 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:17.416 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.416 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:17.416 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:17.416 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.416 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.416 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:17.417 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:17.417 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.417 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.417 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:17.417 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.417 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:17.417 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:17.417 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.417 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.417 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:17.417 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:17.417 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.417 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:17.417 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:17.418 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:17.418 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:17.418 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:17.418 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.418 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:17.418 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.418 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:17.418 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:17.418 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:17.418 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:17.418 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:17.418 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:17.418 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:17.419 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:17.419 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.419 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.419 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:17.419 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:17.419 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:17.419 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:17.419 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.419 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:17.419 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:17.419 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:17.419 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:17.419 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.419 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.419 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:17.420 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:17.420 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:17.420 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:17.420 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.420 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.420 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:17.420 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:17.420 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:17.420 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.420 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:17.420 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.420 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:17.420 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:17.420 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.420 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:17.421 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:17.421 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:17.421 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:17.421 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:17.421 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:17.421 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.421 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:17.421 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.421 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:17.421 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.421 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.421 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:17.421 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.421 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:17.422 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.422 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:17.422 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:17.422 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:17.422 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:17.422 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:17.422 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:17.422 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.422 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:17.422 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:17.422 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:17.422 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:17.422 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:17.422 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:17.422 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.423 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:17.423 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:17.423 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:17.423 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:17.423 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:17.423 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:17.423 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:17.423 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:17.423 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:17.423 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:17.423 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:17.423 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.423 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.423 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:17.424 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.424 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:17.424 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:17.424 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:17.424 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:17.424 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:17.424 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:17.424 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:17.424 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:17.424 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:17.424 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:17.424 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:17.424 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:17.424 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:17.424 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:17.425 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:17.425 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:17.425 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:17.425 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:17.425 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:17.425 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:17.425 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:17.425 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:17.425 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:17.425 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:17.425 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:17.425 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:17.425 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:17.425 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:17.425 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.425 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.426 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.426 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.426 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:17.426 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:17.426 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.426 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:17.426 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.426 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:17.426 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:17.426 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:17.426 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.426 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:17.426 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:17.426 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.427 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.427 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:17.427 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:17.427 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.427 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.427 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:17.427 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:17.427 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:17.427 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:17.427 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:17.427 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.427 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.427 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:17.427 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:17.427 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:17.428 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.428 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:17.428 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.428 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:17.428 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.428 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:17.428 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.428 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:17.428 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.428 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:17.428 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:17.428 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:17.428 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:17.428 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.429 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:17.429 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.429 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:17.429 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:17.429 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:17.429 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:17.429 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:17.429 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:17.429 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:17.429 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:17.429 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:17.429 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:17.429 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:17.429 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:17.429 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:17.430 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:17.430 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:17.430 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:17.430 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:17.430 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:17.430 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:17.430 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:17.430 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:17.430 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:17.430 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:17.430 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:17.430 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:17.430 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:17.431 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:17.431 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:17.431 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:17.431 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:17.431 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:17.431 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:17.431 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:17.431 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:17.431 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:17.431 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:17.431 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:17.431 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:17.431 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:17.431 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:17.431 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.432 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.432 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.432 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:17.432 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.432 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:17.432 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.432 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:17.432 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:17.432 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:17.432 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:17.432 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:17.432 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:17.432 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.432 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:17.432 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:17.433 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:17.433 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:17.433 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:17.433 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:17.433 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.433 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:17.433 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:17.433 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:17.433 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:17.433 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:17.433 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:17.433 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:17.433 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:17.433 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:17.434 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:17.434 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:17.434 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.434 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.434 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:17.434 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:17.434 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:17.434 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:17.434 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:17.434 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.434 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.434 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:17.434 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:17.434 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:17.434 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:17.435 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:17.435 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.435 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:17.435 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:17.435 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:17.435 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:17.435 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:17.435 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:17.435 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.435 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:17.435 INFO:teuthology.orchestra.run.smithi003.stdout:____ ERROR at teardown of test_object_lock_put_obj_retention_invalid_bucket ____ 2023-12-03T13:00:17.435 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.435 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.435 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.436 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:17.436 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:17.436 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.436 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:17.436 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.436 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:17.436 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:17.436 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:17.436 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.436 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:17.436 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:17.436 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.436 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.436 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:17.436 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:17.437 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.437 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.437 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:17.437 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.437 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:17.437 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:17.437 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.437 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.437 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:17.437 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:17.437 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.437 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:17.437 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:17.437 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:17.437 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:17.438 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:17.438 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.438 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:17.438 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.438 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:17.438 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:17.438 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:17.438 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:17.438 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:17.438 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:17.438 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:17.438 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:17.438 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.439 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.439 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:17.439 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:17.439 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:17.439 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:17.439 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.439 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:17.439 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:17.439 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:17.439 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:17.439 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.439 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.439 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:17.439 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:17.439 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:17.439 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:17.440 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.440 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.440 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:17.440 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:17.440 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:17.440 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.440 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:17.440 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.440 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:17.440 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:17.440 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.440 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:17.440 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:17.440 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:17.441 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:17.441 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:17.441 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:17.441 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.441 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:17.441 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.441 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:17.441 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.441 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.441 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:17.441 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.441 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:17.441 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.441 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:17.442 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:17.442 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:17.442 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:17.442 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:17.442 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:17.442 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.442 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:17.442 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:17.442 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:17.442 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:17.442 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:17.442 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:17.442 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.443 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:17.443 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:17.443 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:17.443 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:17.443 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:17.443 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:17.443 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:17.443 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:17.443 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:17.443 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:17.443 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:17.443 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.443 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.443 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:17.443 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.444 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:17.444 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:17.444 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:17.444 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:17.444 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:17.444 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:17.444 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:17.444 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:17.444 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:17.444 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:17.444 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:17.444 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:17.444 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:17.444 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:17.444 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:17.445 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:17.445 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:17.445 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:17.445 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:17.445 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:17.445 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:17.445 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:17.445 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:17.445 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:17.445 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:17.445 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:17.445 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:17.445 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:17.445 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.446 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.446 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.446 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.446 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:17.446 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:17.446 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.446 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:17.446 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.446 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:17.446 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:17.446 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:17.446 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.446 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:17.446 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:17.447 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.447 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.447 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:17.447 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:17.447 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.447 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.447 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:17.447 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:17.447 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:17.447 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:17.447 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:17.447 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.447 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.447 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:17.448 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:17.448 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:17.448 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.448 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:17.448 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.448 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:17.448 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.448 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:17.448 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.448 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:17.448 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.448 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:17.448 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:17.448 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:17.448 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:17.449 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.449 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:17.449 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.449 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:17.449 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:17.449 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:17.449 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:17.449 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:17.449 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:17.449 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:17.449 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:17.449 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:17.449 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:17.449 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:17.449 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:17.450 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:17.450 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:17.450 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:17.450 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:17.450 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:17.450 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:17.450 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:17.450 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:17.450 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:17.450 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:17.450 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:17.450 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:17.450 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:17.451 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:17.451 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:17.451 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:17.451 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:17.451 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:17.451 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:17.451 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:17.451 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:17.451 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:17.451 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:17.451 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:17.451 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:17.451 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:17.451 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:17.452 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:17.452 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.452 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.452 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.452 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:17.452 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.452 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:17.452 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.452 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:17.452 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:17.452 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:17.452 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:17.452 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:17.452 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:17.452 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.453 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:17.453 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:17.453 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:17.453 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:17.453 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:17.453 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:17.453 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.453 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:17.453 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:17.453 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:17.453 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:17.453 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:17.453 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:17.453 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:17.453 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:17.454 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:17.454 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:17.454 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:17.454 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.454 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.454 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:17.454 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:17.454 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:17.454 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:17.454 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:17.454 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.454 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.455 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:17.455 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:17.455 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:17.455 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:17.455 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:17.455 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.455 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:17.455 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:17.455 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:17.455 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:17.455 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:17.455 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:17.455 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.455 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:17.455 INFO:teuthology.orchestra.run.smithi003.stdout:_____ ERROR at teardown of test_object_lock_put_obj_retention_invalid_mode _____ 2023-12-03T13:00:17.455 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.456 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.456 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.456 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:17.456 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:17.456 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.456 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:17.456 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.456 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:17.456 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:17.456 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:17.456 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.456 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:17.456 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:17.456 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.457 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.457 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:17.457 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:17.457 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.457 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.457 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:17.457 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.457 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:17.457 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:17.457 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.457 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.457 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:17.457 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:17.457 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.458 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:17.458 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:17.458 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:17.458 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:17.458 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:17.458 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.458 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:17.458 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.458 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:17.458 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:17.458 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:17.458 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:17.458 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:17.458 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:17.459 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:17.459 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:17.459 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.459 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.459 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:17.459 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:17.459 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:17.459 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:17.459 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.459 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:17.459 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:17.459 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:17.459 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:17.459 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.460 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.460 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:17.460 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:17.460 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:17.460 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:17.460 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.460 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.460 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:17.460 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:17.460 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:17.460 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.460 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:17.460 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.460 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:17.460 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:17.461 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.461 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:17.461 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:17.461 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:17.461 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:17.461 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:17.461 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:17.461 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.461 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:17.461 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.461 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:17.461 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.461 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.461 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:17.462 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.462 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:17.462 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.462 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:17.462 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:17.462 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:17.462 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:17.462 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:17.462 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:17.462 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.462 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:17.462 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:17.462 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:17.463 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:17.463 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:17.463 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:17.463 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.463 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:17.463 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:17.463 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:17.463 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:17.463 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:17.463 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:17.463 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:17.463 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:17.463 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:17.463 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:17.463 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:17.464 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.464 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.464 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:17.464 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.464 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:17.464 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:17.464 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:17.464 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:17.464 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:17.464 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:17.464 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:17.464 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:17.464 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:17.464 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:17.465 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:17.465 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:17.465 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:17.465 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:17.465 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:17.465 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:17.465 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:17.465 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:17.465 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:17.465 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:17.465 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:17.465 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:17.465 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:17.465 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:17.466 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:17.466 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:17.466 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:17.466 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:17.466 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.466 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.466 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.466 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.466 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:17.466 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:17.466 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.466 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:17.466 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.466 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:17.467 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:17.467 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:17.467 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.467 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:17.467 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:17.467 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.467 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.467 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:17.467 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:17.467 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.467 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.467 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:17.467 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:17.467 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:17.467 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:17.468 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:17.468 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.468 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.468 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:17.468 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:17.468 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:17.468 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.468 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:17.468 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.468 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:17.468 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.468 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:17.468 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.468 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:17.469 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.469 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:17.469 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:17.469 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:17.469 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:17.469 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.469 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:17.469 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.469 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:17.469 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:17.469 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:17.469 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:17.469 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:17.469 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:17.470 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:17.470 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:17.470 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:17.470 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:17.470 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:17.470 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:17.470 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:17.470 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:17.470 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:17.470 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:17.470 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:17.470 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:17.470 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:17.470 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:17.471 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:17.471 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:17.471 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:17.471 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:17.471 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:17.471 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:17.471 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:17.471 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:17.471 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:17.471 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:17.471 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:17.471 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:17.471 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:17.471 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:17.472 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:17.472 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:17.472 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:17.472 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:17.472 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:17.472 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:17.472 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.472 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.472 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.472 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:17.472 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.472 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:17.472 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.472 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:17.473 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:17.473 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:17.473 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:17.473 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:17.473 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:17.473 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.473 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:17.473 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:17.473 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:17.473 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:17.473 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:17.473 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:17.473 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.473 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:17.473 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:17.474 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:17.474 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:17.474 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:17.474 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:17.474 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:17.474 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:17.474 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:17.474 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:17.474 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:17.474 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.474 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.474 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:17.474 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:17.475 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:17.475 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:17.475 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:17.475 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.475 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.475 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:17.475 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:17.475 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:17.475 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:17.475 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:17.475 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.475 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:17.475 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:17.475 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:17.475 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:17.476 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:17.476 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:17.476 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.476 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:17.476 INFO:teuthology.orchestra.run.smithi003.stdout:___________ ERROR at teardown of test_object_lock_get_obj_retention ____________ 2023-12-03T13:00:17.476 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.476 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.476 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.476 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:17.476 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:17.476 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.476 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:17.476 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.476 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:17.476 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:17.477 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:17.477 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.477 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:17.477 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:17.477 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.477 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.477 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:17.477 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:17.477 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.477 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.477 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:17.477 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.477 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:17.477 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:17.477 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.477 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.478 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:17.478 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:17.478 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.478 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:17.478 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:17.478 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:17.478 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:17.478 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:17.478 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.478 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:17.478 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.478 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:17.478 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:17.479 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:17.479 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:17.479 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:17.479 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:17.479 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:17.479 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:17.479 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.479 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.479 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:17.479 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:17.479 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:17.479 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:17.479 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.479 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:17.480 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:17.480 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:17.480 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:17.480 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.480 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.480 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:17.480 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:17.480 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:17.480 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:17.480 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.480 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.480 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:17.480 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:17.480 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:17.480 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.481 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:17.481 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.481 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:17.481 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:17.481 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.481 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:17.481 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:17.481 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:17.481 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:17.481 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:17.481 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:17.481 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.481 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:17.481 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.481 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:17.482 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.482 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.482 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:17.482 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.482 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:17.482 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.482 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:17.482 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:17.482 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:17.482 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:17.482 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:17.482 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:17.482 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.483 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:17.483 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:17.483 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:17.483 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:17.483 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:17.483 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:17.483 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.483 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:17.483 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:17.483 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:17.483 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:17.483 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:17.483 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:17.483 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:17.483 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:17.484 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:17.484 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:17.484 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:17.484 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.484 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.484 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:17.484 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.484 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:17.484 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:17.484 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:17.484 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:17.484 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:17.484 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:17.484 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:17.485 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:17.485 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:17.485 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:17.485 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:17.485 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:17.485 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:17.485 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:17.485 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:17.485 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:17.485 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:17.485 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:17.485 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:17.485 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:17.485 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:17.485 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:17.486 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:17.486 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:17.486 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:17.486 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:17.486 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:17.486 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:17.486 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.486 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.486 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.486 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.486 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:17.486 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:17.486 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.486 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:17.487 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.487 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:17.487 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:17.487 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:17.487 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.487 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:17.487 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:17.487 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.487 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.487 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:17.487 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:17.487 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.487 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.487 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:17.488 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:17.488 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:17.488 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:17.488 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:17.488 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.488 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.488 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:17.488 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:17.488 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:17.488 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.488 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:17.488 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.488 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:17.488 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.488 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:17.489 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.489 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:17.489 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.489 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:17.489 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:17.489 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:17.489 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:17.489 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.489 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:17.489 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.489 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:17.489 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:17.489 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:17.489 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:17.489 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:17.490 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:17.490 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:17.490 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:17.490 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:17.490 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:17.490 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:17.490 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:17.490 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:17.490 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:17.490 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:17.490 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:17.490 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:17.490 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:17.491 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:17.491 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:17.491 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:17.491 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:17.491 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:17.491 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:17.491 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:17.491 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:17.491 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:17.491 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:17.491 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:17.491 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:17.491 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:17.491 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:17.492 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:17.492 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:17.492 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:17.492 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:17.492 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:17.492 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:17.492 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:17.492 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:17.492 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.492 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.492 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.492 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:17.492 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.492 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:17.493 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.493 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:17.493 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:17.493 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:17.493 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:17.493 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:17.493 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:17.493 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.493 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:17.493 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:17.493 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:17.493 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:17.493 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:17.493 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:17.493 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.493 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:17.494 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:17.494 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:17.494 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:17.494 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:17.494 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:17.494 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:17.494 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:17.494 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:17.494 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:17.494 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:17.494 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.494 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.494 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:17.494 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:17.495 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:17.495 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:17.495 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:17.495 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.495 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.495 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:17.495 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:17.495 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:17.495 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:17.495 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:17.495 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.495 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:17.495 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:17.495 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:17.496 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:17.496 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:17.496 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:17.496 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.496 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:17.496 INFO:teuthology.orchestra.run.smithi003.stdout:_______ ERROR at teardown of test_object_lock_get_obj_retention_iso8601 ________ 2023-12-03T13:00:17.496 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.496 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.496 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.496 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:17.496 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:17.496 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.496 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:17.496 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.496 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:17.497 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:17.497 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:17.497 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.497 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:17.497 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:17.497 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.497 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.497 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:17.497 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:17.497 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.497 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.497 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:17.497 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.497 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:17.498 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:17.498 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.498 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.498 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:17.498 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:17.498 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.498 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:17.498 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:17.498 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:17.498 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:17.498 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:17.498 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.498 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:17.498 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.498 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:17.499 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:17.499 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:17.499 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:17.499 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:17.499 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:17.499 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:17.499 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:17.499 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.499 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.499 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:17.499 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:17.499 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:17.499 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:17.499 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.500 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:17.500 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:17.500 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:17.500 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:17.500 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.500 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.500 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:17.500 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:17.500 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:17.500 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:17.500 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.500 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.500 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:17.501 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:17.501 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:17.501 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.501 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:17.501 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.501 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:17.501 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:17.501 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.501 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:17.501 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:17.501 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:17.501 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:17.501 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:17.501 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:17.502 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.502 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:17.502 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.502 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:17.502 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.502 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.502 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:17.502 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.502 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:17.502 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.502 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:17.502 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:17.502 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:17.503 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:17.503 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:17.503 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:17.503 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.503 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:17.503 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:17.503 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:17.503 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:17.503 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:17.503 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:17.503 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.503 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:17.503 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:17.503 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:17.503 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:17.504 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:17.504 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:17.504 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:17.504 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:17.504 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:17.504 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:17.504 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:17.504 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.504 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.504 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:17.504 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.504 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:17.504 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:17.504 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:17.504 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:17.505 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:17.505 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:17.505 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:17.505 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:17.505 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:17.505 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:17.505 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:17.505 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:17.505 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:17.505 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:17.505 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:17.505 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:17.505 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:17.505 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:17.505 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:17.506 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:17.506 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:17.506 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:17.506 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:17.506 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:17.506 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:17.506 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:17.506 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:17.506 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:17.506 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.506 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.506 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.506 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.506 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:17.506 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:17.507 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.507 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:17.507 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.507 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:17.507 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:17.507 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:17.507 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.507 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:17.507 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:17.507 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.507 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.507 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:17.507 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:17.507 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.507 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.508 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:17.508 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:17.508 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:17.508 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:17.508 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:17.508 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.508 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.508 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:17.508 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:17.508 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:17.508 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.508 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:17.508 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.508 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:17.509 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.509 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:17.509 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.509 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:17.509 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.509 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:17.509 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:17.509 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:17.509 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:17.509 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.509 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:17.509 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.509 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:17.509 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:17.509 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:17.510 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:17.510 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:17.510 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:17.510 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:17.510 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:17.510 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:17.510 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:17.510 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:17.510 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:17.510 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:17.510 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:17.510 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:17.510 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:17.510 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:17.510 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:17.511 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:17.511 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:17.511 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:17.511 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:17.511 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:17.511 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:17.511 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:17.511 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:17.511 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:17.511 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:17.511 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:17.511 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:17.511 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:17.512 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:17.512 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:17.512 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:17.512 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:17.512 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:17.512 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:17.512 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:17.512 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:17.512 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:17.512 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.512 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.512 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.512 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:17.512 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.512 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:17.513 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.513 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:17.513 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:17.513 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:17.513 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:17.513 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:17.513 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:17.513 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.513 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:17.513 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:17.513 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:17.513 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:17.513 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:17.513 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:17.514 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.514 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:17.514 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:17.514 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:17.514 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:17.514 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:17.514 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:17.514 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:17.514 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:17.514 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:17.514 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:17.514 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:17.514 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.514 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.515 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:17.515 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:17.515 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:17.515 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:17.515 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:17.515 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.515 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.515 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:17.515 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:17.515 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:17.515 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:17.515 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:17.515 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.515 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:17.515 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:17.516 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:17.516 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:17.516 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:17.516 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:17.516 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.516 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:17.516 INFO:teuthology.orchestra.run.smithi003.stdout:____ ERROR at teardown of test_object_lock_get_obj_retention_invalid_bucket ____ 2023-12-03T13:00:17.516 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.516 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.516 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.516 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:17.516 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:17.516 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.516 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:17.516 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.517 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:17.517 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:17.517 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:17.517 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.517 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:17.517 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:17.517 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.517 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.517 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:17.517 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:17.517 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.517 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.517 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:17.517 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.517 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:17.518 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:17.518 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.518 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.518 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:17.518 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:17.518 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.518 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:17.518 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:17.518 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:17.518 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:17.518 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:17.518 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.518 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:17.518 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.518 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:17.519 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:17.519 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:17.519 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:17.519 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:17.519 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:17.519 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:17.519 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:17.519 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.519 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.519 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:17.519 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:17.519 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:17.519 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:17.519 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.519 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:17.520 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:17.520 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:17.520 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:17.520 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.520 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.520 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:17.520 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:17.520 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:17.520 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:17.520 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.520 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.520 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:17.520 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:17.520 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:17.520 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.521 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:17.521 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.521 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:17.521 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:17.521 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.521 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:17.521 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:17.521 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:17.521 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:17.521 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:17.521 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:17.521 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.521 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:17.522 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.522 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:17.522 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.522 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.522 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:17.522 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.522 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:17.522 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.522 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:17.522 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:17.522 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:17.522 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:17.522 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:17.523 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:17.523 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.523 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:17.523 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:17.523 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:17.523 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:17.523 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:17.523 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:17.523 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.523 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:17.523 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:17.523 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:17.523 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:17.523 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:17.523 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:17.524 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:17.524 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:17.524 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:17.524 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:17.524 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:17.524 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.524 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.524 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:17.524 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.524 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:17.524 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:17.524 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:17.524 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:17.524 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:17.525 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:17.525 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:17.525 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:17.525 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:17.525 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:17.525 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:17.525 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:17.525 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:17.525 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:17.525 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:17.525 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:17.525 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:17.525 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:17.525 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:17.525 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:17.526 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:17.526 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:17.526 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:17.526 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:17.526 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:17.526 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:17.526 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:17.526 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:17.526 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.526 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.526 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.526 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.526 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:17.527 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:17.527 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.527 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:17.527 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.527 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:17.527 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:17.527 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:17.527 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.527 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:17.527 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:17.527 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.527 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.527 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:17.527 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:17.527 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.527 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.528 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:17.528 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:17.528 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:17.528 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:17.528 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:17.528 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.528 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.528 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:17.528 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:17.528 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:17.528 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.528 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:17.528 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.528 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:17.529 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.529 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:17.529 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.529 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:17.529 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.529 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:17.529 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:17.529 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:17.529 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:17.529 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.529 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:17.529 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.529 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:17.529 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:17.529 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:17.530 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:17.530 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:17.530 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:17.530 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:17.530 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:17.530 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:17.530 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:17.530 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:17.530 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:17.530 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:17.530 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:17.530 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:17.530 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:17.531 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:17.531 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:17.531 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:17.531 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:17.531 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:17.531 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:17.531 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:17.531 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:17.531 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:17.531 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:17.531 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:17.531 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:17.531 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:17.531 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:17.531 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:17.532 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:17.532 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:17.532 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:17.532 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:17.532 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:17.532 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:17.532 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:17.532 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:17.532 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:17.532 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.532 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.532 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.532 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:17.532 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.533 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:17.533 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.533 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:17.533 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:17.533 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:17.533 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:17.533 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:17.533 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:17.533 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.533 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:17.533 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:17.533 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:17.533 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:17.533 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:17.534 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:17.534 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.534 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:17.534 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:17.534 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:17.534 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:17.534 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:17.534 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:17.534 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:17.534 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:17.534 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:17.534 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:17.534 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:17.535 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.535 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.535 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:17.535 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:17.535 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:17.535 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:17.535 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:17.535 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.535 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.535 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:17.535 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:17.535 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:17.535 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:17.535 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:17.535 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.536 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:17.536 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:17.536 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:17.536 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:17.536 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:17.536 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:17.536 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.536 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:17.536 INFO:teuthology.orchestra.run.smithi003.stdout:______ ERROR at teardown of test_object_lock_put_obj_retention_versionid _______ 2023-12-03T13:00:17.536 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.536 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.536 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.536 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:17.536 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:17.536 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.537 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:17.537 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.537 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:17.537 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:17.537 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:17.537 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.537 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:17.537 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:17.537 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.537 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.537 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:17.537 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:17.537 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.537 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.537 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:17.538 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.538 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:17.538 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:17.538 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.538 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.538 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:17.538 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:17.538 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.538 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:17.538 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:17.538 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:17.538 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:17.538 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:17.538 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.539 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:17.539 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.539 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:17.539 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:17.539 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:17.539 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:17.539 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:17.539 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:17.539 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:17.539 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:17.539 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.539 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.539 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:17.539 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:17.539 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:17.540 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:17.540 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.540 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:17.540 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:17.540 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:17.540 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:17.540 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.540 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.540 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:17.540 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:17.540 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:17.540 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:17.540 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.540 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.541 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:17.541 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:17.541 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:17.541 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.541 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:17.541 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.541 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:17.541 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:17.541 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.541 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:17.541 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:17.541 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:17.541 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:17.541 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:17.542 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:17.542 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.542 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:17.542 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.542 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:17.542 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.542 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.542 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:17.542 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.542 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:17.542 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.542 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:17.542 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:17.542 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:17.543 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:17.543 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:17.543 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:17.543 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.543 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:17.543 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:17.543 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:17.543 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:17.543 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:17.543 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:17.543 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.543 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:17.543 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:17.543 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:17.543 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:17.544 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:17.544 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:17.544 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:17.544 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:17.544 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:17.544 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:17.544 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:17.544 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.544 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.544 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:17.544 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.544 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:17.544 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:17.544 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:17.545 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:17.545 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:17.545 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:17.545 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:17.545 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:17.545 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:17.545 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:17.545 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:17.545 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:17.545 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:17.545 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:17.545 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:17.545 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:17.545 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:17.545 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:17.546 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:17.546 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:17.546 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:17.546 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:17.546 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:17.546 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:17.546 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:17.546 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:17.546 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:17.546 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:17.546 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.546 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.546 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.546 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.546 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:17.547 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:17.547 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.547 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:17.547 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.547 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:17.547 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:17.547 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:17.547 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.547 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:17.547 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:17.547 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.547 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.547 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:17.547 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:17.548 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.548 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.548 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:17.548 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:17.548 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:17.548 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:17.548 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:17.548 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.548 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.548 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:17.548 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:17.548 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:17.548 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.548 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:17.549 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.549 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:17.549 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.549 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:17.549 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.549 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:17.549 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.549 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:17.549 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:17.549 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:17.549 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:17.549 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.549 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:17.549 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.549 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:17.550 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:17.550 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:17.550 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:17.550 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:17.550 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:17.550 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:17.550 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:17.550 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:17.550 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:17.550 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:17.550 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:17.550 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:17.550 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:17.550 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:17.550 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:17.551 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:17.551 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:17.551 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:17.551 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:17.551 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:17.551 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:17.551 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:17.551 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:17.551 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:17.551 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:17.551 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:17.551 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:17.551 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:17.552 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:17.552 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:17.552 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:17.552 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:17.552 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:17.552 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:17.552 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:17.552 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:17.552 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:17.552 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:17.552 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:17.552 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.552 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.552 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.553 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:17.553 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.553 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:17.553 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.553 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:17.553 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:17.553 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:17.553 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:17.553 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:17.553 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:17.553 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.553 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:17.553 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:17.553 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:17.553 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:17.554 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:17.554 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:17.554 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.554 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:17.554 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:17.554 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:17.554 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:17.554 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:17.554 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:17.554 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:17.554 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:17.554 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:17.554 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:17.554 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:17.554 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.555 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.555 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:17.555 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:17.555 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:17.555 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:17.555 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:17.555 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.555 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.555 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:17.555 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:17.555 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:17.555 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:17.555 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:17.555 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.556 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:17.556 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:17.556 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:17.556 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:17.556 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:17.556 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:17.556 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.556 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:17.556 INFO:teuthology.orchestra.run.smithi003.stdout:_ ERROR at teardown of test_object_lock_put_obj_retention_override_default_retention _ 2023-12-03T13:00:17.556 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.556 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.556 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.556 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:17.556 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:17.556 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.557 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:17.557 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.557 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:17.557 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:17.557 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:17.557 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.557 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:17.557 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:17.557 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.557 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.557 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:17.557 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:17.557 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.557 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.558 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:17.558 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.558 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:17.558 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:17.558 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.558 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.558 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:17.558 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:17.558 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.558 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:17.558 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:17.558 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:17.558 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:17.558 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:17.559 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.559 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:17.559 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.559 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:17.559 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:17.559 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:17.559 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:17.559 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:17.559 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:17.559 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:17.559 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:17.559 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.559 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.559 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:17.560 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:17.560 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:17.560 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:17.560 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.560 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:17.560 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:17.560 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:17.560 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:17.560 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.560 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.560 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:17.560 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:17.560 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:17.560 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:17.560 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.561 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.561 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:17.561 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:17.561 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:17.561 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.561 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:17.561 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.561 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:17.561 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:17.561 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.561 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:17.561 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:17.561 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:17.561 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:17.562 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:17.562 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:17.562 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.562 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:17.562 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.562 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:17.562 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.562 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.562 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:17.562 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.562 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:17.562 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.562 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:17.563 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:17.563 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:17.563 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:17.563 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:17.563 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:17.563 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.563 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:17.563 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:17.563 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:17.563 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:17.563 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:17.563 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:17.563 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.564 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:17.564 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:17.564 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:17.564 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:17.564 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:17.564 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:17.564 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:17.564 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:17.564 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:17.564 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:17.564 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:17.564 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.564 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.564 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:17.564 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.565 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:17.565 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:17.565 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:17.565 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:17.565 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:17.565 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:17.565 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:17.565 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:17.565 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:17.565 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:17.565 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:17.565 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:17.565 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:17.565 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:17.566 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:17.566 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:17.566 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:17.566 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:17.566 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:17.566 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:17.566 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:17.566 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:17.566 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:17.566 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:17.566 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:17.566 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:17.566 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:17.567 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:17.567 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.567 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.567 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.567 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.567 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:17.567 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:17.567 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.567 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:17.567 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.567 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:17.567 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:17.567 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:17.567 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.567 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:17.568 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:17.568 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.568 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.568 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:17.568 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:17.568 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.568 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.568 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:17.568 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:17.568 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:17.568 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:17.568 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:17.568 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.569 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.569 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:17.569 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:17.569 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:17.569 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.569 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:17.569 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.569 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:17.569 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.569 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:17.569 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.569 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:17.569 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.569 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:17.570 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:17.570 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:17.570 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:17.570 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.570 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:17.570 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.570 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:17.570 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:17.573 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:17.573 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:17.573 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:17.573 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:17.573 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:17.573 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:17.573 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:17.574 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:17.574 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:17.574 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:17.574 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:17.574 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:17.574 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:17.574 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:17.574 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:17.574 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:17.574 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:17.574 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:17.574 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:17.574 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:17.575 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:17.575 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:17.575 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:17.575 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:17.575 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:17.575 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:17.575 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:17.575 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:17.575 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:17.575 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:17.575 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:17.575 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:17.575 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:17.575 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:17.576 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:17.576 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:17.576 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:17.576 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:17.576 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.576 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.576 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.576 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:17.576 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.576 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:17.576 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.576 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:17.576 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:17.576 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:17.576 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:17.577 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:17.577 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:17.577 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.577 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:17.577 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:17.577 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:17.577 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:17.577 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:17.577 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:17.577 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.577 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:17.577 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:17.577 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:17.577 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:17.578 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:17.578 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:17.578 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:17.578 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:17.578 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:17.578 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:17.578 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:17.578 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.578 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.578 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:17.578 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:17.578 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:17.579 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:17.579 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:17.579 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.579 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.579 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:17.579 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:17.579 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:17.579 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:17.579 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:17.579 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.579 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:17.579 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:17.579 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:17.579 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:17.580 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:17.580 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:17.580 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.580 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:17.580 INFO:teuthology.orchestra.run.smithi003.stdout:___ ERROR at teardown of test_object_lock_put_obj_retention_increase_period ____ 2023-12-03T13:00:17.580 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.580 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.580 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.580 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:17.580 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:17.580 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.580 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:17.580 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.580 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:17.581 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:17.581 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:17.581 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.581 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:17.581 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:17.581 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.581 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.581 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:17.581 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:17.581 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.581 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.581 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:17.581 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.581 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:17.581 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:17.582 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.582 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.582 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:17.582 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:17.582 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.582 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:17.582 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:17.582 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:17.582 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:17.582 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:17.582 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.582 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:17.582 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.582 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:17.583 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:17.583 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:17.583 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:17.583 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:17.583 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:17.583 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:17.583 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:17.583 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.583 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.583 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:17.583 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:17.583 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:17.583 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:17.583 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.584 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:17.584 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:17.584 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:17.584 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:17.584 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.584 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.584 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:17.584 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:17.584 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:17.584 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:17.584 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.584 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.584 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:17.584 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:17.585 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:17.585 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.585 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:17.585 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.585 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:17.585 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:17.585 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.585 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:17.585 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:17.585 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:17.585 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:17.585 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:17.585 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:17.585 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.585 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:17.586 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.586 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:17.586 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.586 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.586 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:17.586 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.586 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:17.586 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.586 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:17.586 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:17.586 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:17.586 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:17.586 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:17.586 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:17.587 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.587 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:17.587 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:17.587 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:17.587 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:17.587 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:17.587 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:17.587 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.587 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:17.587 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:17.587 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:17.587 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:17.587 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:17.587 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:17.587 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:17.588 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:17.588 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:17.588 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:17.588 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:17.588 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.588 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.588 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:17.588 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.588 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:17.588 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:17.588 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:17.588 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:17.588 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:17.588 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:17.588 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:17.589 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:17.589 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:17.589 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:17.589 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:17.589 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:17.589 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:17.589 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:17.589 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:17.589 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:17.589 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:17.589 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:17.589 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:17.589 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:17.589 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:17.590 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:17.590 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:17.590 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:17.590 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:17.590 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:17.590 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:17.590 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:17.590 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.590 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.590 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.590 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.590 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:17.590 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:17.591 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.591 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:17.591 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.591 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:17.591 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:17.591 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:17.591 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.591 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:17.591 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:17.591 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.591 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.591 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:17.591 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:17.591 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.592 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.592 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:17.592 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:17.592 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:17.592 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:17.592 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:17.592 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.592 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.592 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:17.592 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:17.592 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:17.592 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.592 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:17.592 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.593 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:17.593 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.593 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:17.593 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.593 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:17.593 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.593 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:17.593 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:17.593 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:17.593 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:17.593 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.593 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:17.593 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.593 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:17.593 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:17.594 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:17.594 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:17.594 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:17.594 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:17.594 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:17.594 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:17.594 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:17.594 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:17.594 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:17.594 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:17.594 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:17.594 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:17.594 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:17.594 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:17.595 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:17.595 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:17.595 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:17.595 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:17.595 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:17.595 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:17.595 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:17.595 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:17.595 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:17.595 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:17.595 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:17.595 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:17.595 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:17.595 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:17.595 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:17.596 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:17.596 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:17.596 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:17.596 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:17.596 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:17.596 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:17.596 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:17.596 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:17.596 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:17.596 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.596 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.596 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.596 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:17.596 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.596 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:17.597 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.597 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:17.597 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:17.597 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:17.597 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:17.597 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:17.597 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:17.597 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.597 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:17.597 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:17.597 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:17.597 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:17.597 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:17.597 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:17.597 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.598 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:17.598 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:17.598 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:17.598 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:17.598 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:17.598 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:17.598 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:17.598 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:17.598 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:17.598 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:17.598 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:17.598 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.598 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.599 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:17.599 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:17.599 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:17.599 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:17.599 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:17.599 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.599 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.599 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:17.599 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:17.599 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:17.599 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:17.599 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:17.599 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.599 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:17.599 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:17.600 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:17.600 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:17.600 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:17.600 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:17.600 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.600 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:17.600 INFO:teuthology.orchestra.run.smithi003.stdout:____ ERROR at teardown of test_object_lock_put_obj_retention_shorten_period ____ 2023-12-03T13:00:17.600 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.600 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.600 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.600 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:17.600 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:17.600 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.600 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:17.600 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.601 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:17.601 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:17.601 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:17.601 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.601 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:17.601 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:17.601 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.601 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.601 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:17.601 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:17.601 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.601 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.601 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:17.601 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.602 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:17.602 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:17.602 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.602 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.602 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:17.602 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:17.602 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.602 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:17.602 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:17.602 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:17.602 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:17.602 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:17.602 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.602 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:17.602 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.603 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:17.603 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:17.603 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:17.603 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:17.603 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:17.603 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:17.603 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:17.603 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:17.603 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.603 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.603 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:17.630 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:17.630 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:17.631 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:17.631 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.631 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:17.631 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:17.631 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:17.631 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:17.631 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.631 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.631 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:17.631 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:17.631 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:17.631 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:17.631 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.632 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.632 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:17.632 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:17.632 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:17.632 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.632 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:17.632 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.632 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:17.632 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:17.632 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.632 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:17.632 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:17.632 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:17.632 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:17.633 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:17.633 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:17.633 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.633 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:17.633 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.633 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:17.633 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.633 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.633 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:17.633 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.633 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:17.633 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.633 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:17.633 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:17.634 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:17.634 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:17.634 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:17.634 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:17.634 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.634 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:17.634 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:17.634 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:17.634 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:17.634 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:17.634 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:17.634 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.634 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:17.634 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:17.635 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:17.635 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:17.635 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:17.635 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:17.635 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:17.635 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:17.635 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:17.635 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:17.635 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:17.635 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.635 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.635 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:17.635 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.635 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:17.636 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:17.636 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:17.636 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:17.636 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:17.636 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:17.636 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:17.636 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:17.636 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:17.636 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:17.636 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:17.636 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:17.636 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:17.636 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:17.636 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:17.636 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:17.637 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:17.637 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:17.637 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:17.637 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:17.637 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:17.637 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:17.637 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:17.637 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:17.637 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:17.637 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:17.637 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:17.637 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:17.637 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.637 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.637 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.638 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.638 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:17.638 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:17.638 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.638 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:17.638 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.638 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:17.638 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:17.638 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:17.638 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.638 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:17.638 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:17.638 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.639 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.639 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:17.639 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:17.639 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.639 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.639 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:17.639 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:17.639 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:17.639 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:17.639 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:17.639 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.639 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.639 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:17.639 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:17.640 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:17.640 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.640 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:17.640 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.640 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:17.640 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.640 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:17.640 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.640 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:17.640 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.640 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:17.640 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:17.640 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:17.640 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:17.641 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.641 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:17.641 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.641 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:17.641 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:17.641 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:17.641 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:17.641 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:17.641 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:17.641 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:17.641 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:17.641 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:17.641 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:17.641 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:17.641 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:17.642 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:17.642 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:17.642 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:17.642 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:17.642 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:17.642 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:17.642 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:17.642 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:17.642 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:17.642 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:17.642 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:17.642 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:17.642 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:17.642 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:17.643 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:17.643 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:17.643 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:17.643 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:17.643 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:17.643 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:17.643 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:17.643 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:17.643 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:17.643 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:17.643 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:17.643 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:17.644 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:17.644 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:17.644 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.644 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.644 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.644 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:17.644 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.644 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:17.644 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.644 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:17.644 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:17.644 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:17.644 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:17.644 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:17.644 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:17.645 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.645 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:17.645 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:17.645 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:17.645 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:17.645 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:17.645 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:17.645 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.645 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:17.645 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:17.645 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:17.645 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:17.645 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:17.645 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:17.645 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:17.646 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:17.646 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:17.646 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:17.646 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:17.646 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.646 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.646 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:17.646 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:17.646 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:17.646 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:17.646 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:17.646 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.646 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.646 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:17.646 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:17.647 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:17.647 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:17.647 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:17.647 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.647 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:17.647 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:17.647 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:17.647 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:17.647 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:17.647 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:17.647 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.647 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:17.647 INFO:teuthology.orchestra.run.smithi003.stdout:_ ERROR at teardown of test_object_lock_put_obj_retention_shorten_period_bypass _ 2023-12-03T13:00:17.647 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.647 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.648 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.648 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:17.648 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:17.648 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.648 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:17.648 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.648 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:17.648 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:17.648 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:17.648 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.648 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:17.648 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:17.648 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.648 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.648 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:17.648 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:17.649 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.649 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.649 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:17.649 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.649 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:17.649 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:17.649 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.649 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.649 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:17.649 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:17.649 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.649 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:17.649 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:17.649 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:17.649 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:17.650 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:17.650 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.650 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:17.650 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.650 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:17.650 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:17.650 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:17.650 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:17.650 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:17.650 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:17.650 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:17.650 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:17.650 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.650 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.650 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:17.651 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:17.651 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:17.651 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:17.651 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.651 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:17.651 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:17.651 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:17.651 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:17.651 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.651 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.651 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:17.651 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:17.651 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:17.651 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:17.652 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.652 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.652 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:17.652 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:17.652 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:17.652 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.652 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:17.652 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.652 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:17.652 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:17.652 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.652 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:17.652 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:17.652 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:17.652 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:17.653 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:17.653 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:17.653 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.653 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:17.653 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.653 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:17.653 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.653 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.653 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:17.653 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.653 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:17.653 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.653 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:17.653 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:17.653 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:17.653 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:17.654 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:17.654 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:17.654 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.654 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:17.654 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:17.654 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:17.654 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:17.654 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:17.654 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:17.654 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.654 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:17.654 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:17.654 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:17.655 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:17.655 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:17.655 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:17.655 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:17.655 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:17.655 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:17.655 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:17.655 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:17.655 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.655 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.655 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:17.655 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.655 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:17.655 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:17.656 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:17.656 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:17.656 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:17.656 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:17.656 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:17.656 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:17.656 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:17.656 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:17.656 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:17.656 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:17.656 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:17.656 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:17.656 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:17.656 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:17.657 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:17.657 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:17.657 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:17.657 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:17.657 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:17.657 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:17.657 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:17.657 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:17.657 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:17.657 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:17.657 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:17.657 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:17.657 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.657 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.658 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.658 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.658 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:17.658 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:17.658 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.658 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:17.658 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.658 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:17.658 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:17.658 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:17.658 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.658 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:17.658 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:17.658 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.658 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.659 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:17.659 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:17.659 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.659 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.659 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:17.659 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:17.659 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:17.659 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:17.659 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:17.659 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.659 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.659 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:17.659 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:17.659 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:17.659 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.660 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:17.660 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.660 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:17.660 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.660 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:17.660 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.660 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:17.660 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.660 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:17.660 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:17.660 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:17.660 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:17.660 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.660 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:17.660 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.661 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:17.661 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:17.661 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:17.661 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:17.661 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:17.661 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:17.661 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:17.661 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:17.661 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:17.661 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:17.661 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:17.661 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:17.661 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:17.661 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:17.662 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:17.662 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:17.662 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:17.662 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:17.662 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:17.662 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:17.662 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:17.662 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:17.662 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:17.662 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:17.662 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:17.662 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:17.662 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:17.662 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:17.663 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:17.663 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:17.663 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:17.663 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:17.663 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:17.663 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:17.663 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:17.663 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:17.663 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:17.663 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:17.663 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:17.663 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:17.663 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.663 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.663 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.663 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:17.664 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.664 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:17.664 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.664 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:17.664 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:17.664 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:17.664 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:17.664 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:17.664 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:17.664 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.664 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:17.664 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:17.664 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:17.664 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:17.664 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:17.664 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:17.665 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.665 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:17.665 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:17.665 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:17.665 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:17.665 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:17.665 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:17.665 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:17.665 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:17.665 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:17.665 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:17.665 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:17.665 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.665 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.666 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:17.666 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:17.666 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:17.666 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:17.666 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:17.666 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.666 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.666 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:17.666 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:17.666 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:17.667 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:17.667 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:17.667 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.667 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:17.667 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:17.667 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:17.667 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:17.667 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:17.667 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:17.667 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.667 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:17.668 INFO:teuthology.orchestra.run.smithi003.stdout:______ ERROR at teardown of test_object_lock_delete_object_with_retention ______ 2023-12-03T13:00:17.668 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.668 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.668 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.668 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:17.668 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:17.668 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.668 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:17.668 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.668 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:17.668 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:17.668 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:17.669 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.669 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:17.669 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:17.669 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.669 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.669 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:17.669 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:17.669 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.669 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.669 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:17.669 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.669 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:17.669 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:17.669 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.670 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.670 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:17.670 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:17.670 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.670 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:17.670 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:17.670 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:17.670 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:17.670 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:17.670 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.670 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:17.670 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.670 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:17.671 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:17.671 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:17.671 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:17.671 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:17.671 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:17.671 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:17.671 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:17.671 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.671 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.671 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:17.671 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:17.671 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:17.671 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:17.672 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.672 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:17.672 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:17.672 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:17.672 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:17.672 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.672 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.672 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:17.672 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:17.672 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:17.672 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:17.672 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.672 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.673 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:17.673 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:17.673 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:17.673 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.673 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:17.673 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.673 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:17.673 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:17.673 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.673 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:17.673 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:17.673 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:17.673 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:17.673 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:17.674 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:17.674 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.674 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:17.674 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.674 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:17.674 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.674 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.674 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:17.674 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.674 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:17.674 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.674 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:17.674 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:17.674 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:17.675 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:17.675 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:17.675 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:17.675 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.675 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:17.675 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:17.675 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:17.675 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:17.675 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:17.675 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:17.675 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.675 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:17.675 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:17.676 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:17.676 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:17.676 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:17.676 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:17.676 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:17.676 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:17.676 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:17.676 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:17.676 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:17.676 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.676 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.676 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:17.676 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.676 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:17.677 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:17.677 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:17.677 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:17.677 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:17.677 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:17.677 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:17.677 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:17.677 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:17.677 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:17.677 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:17.677 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:17.677 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:17.677 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:17.677 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:17.678 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:17.678 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:17.678 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:17.678 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:17.678 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:17.678 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:17.678 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:17.678 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:17.678 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:17.678 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:17.678 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:17.678 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:17.678 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:17.679 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.679 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.679 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.679 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.679 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:17.679 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:17.679 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.679 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:17.679 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.679 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:17.679 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:17.679 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:17.680 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.680 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:17.680 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:17.680 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.680 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.680 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:17.680 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:17.680 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.680 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.680 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:17.680 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:17.680 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:17.680 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:17.681 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:17.681 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.681 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.681 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:17.681 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:17.681 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:17.681 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.681 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:17.681 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.681 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:17.681 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.681 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:17.682 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.682 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:17.682 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.682 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:17.682 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:17.682 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:17.682 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:17.682 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.682 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:17.682 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.682 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:17.682 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:17.682 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:17.682 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:17.683 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:17.683 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:17.683 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:17.683 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:17.683 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:17.683 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:17.683 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:17.683 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:17.683 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:17.683 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:17.683 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:17.683 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:17.683 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:17.683 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:17.684 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:17.684 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:17.684 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:17.684 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:17.684 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:17.684 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:17.684 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:17.684 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:17.684 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:17.684 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:17.684 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:17.684 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:17.684 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:17.684 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:17.685 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:17.685 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:17.685 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:17.685 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:17.685 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:17.685 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:17.685 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:17.685 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:17.685 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.685 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.685 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.685 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:17.685 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.685 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:17.686 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.686 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:17.686 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:17.686 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:17.686 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:17.686 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:17.686 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:17.686 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.686 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:17.686 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:17.686 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:17.686 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:17.686 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:17.686 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:17.687 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.687 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:17.687 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:17.687 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:17.687 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:17.687 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:17.687 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:17.687 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:17.687 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:17.687 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:17.687 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:17.687 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:17.687 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.687 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.688 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:17.688 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:17.688 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:17.688 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:17.688 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:17.688 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.688 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.688 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:17.688 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:17.688 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:17.688 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:17.688 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:17.688 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.688 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:17.688 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:17.689 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:17.689 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:17.689 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:17.689 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:17.689 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.689 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:17.689 INFO:teuthology.orchestra.run.smithi003.stdout:_ ERROR at teardown of test_object_lock_delete_object_with_retention_and_marker _ 2023-12-03T13:00:17.689 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.689 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.689 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.689 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:17.689 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:17.689 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.689 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:17.689 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.690 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:17.690 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:17.690 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:17.690 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.690 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:17.690 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:17.690 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.690 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.690 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:17.690 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:17.690 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.690 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.690 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:17.690 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.691 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:17.691 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:17.691 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.691 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.691 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:17.691 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:17.691 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.691 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:17.691 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:17.691 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:17.691 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:17.691 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:17.691 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.692 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:17.692 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.692 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:17.692 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:17.692 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:17.692 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:17.692 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:17.692 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:17.692 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:17.692 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:17.692 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.692 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.692 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:17.692 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:17.692 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:17.693 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:17.693 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.693 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:17.693 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:17.693 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:17.693 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:17.693 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.693 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.693 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:17.693 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:17.693 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:17.693 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:17.693 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.693 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.694 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:17.694 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:17.694 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:17.694 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.694 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:17.694 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.694 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:17.694 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:17.694 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.694 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:17.694 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:17.694 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:17.694 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:17.694 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:17.695 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:17.695 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.695 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:17.695 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.695 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:17.695 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.695 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.695 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:17.695 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.695 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:17.695 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.695 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:17.695 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:17.695 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:17.696 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:17.696 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:17.696 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:17.696 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.696 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:17.696 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:17.696 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:17.696 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:17.696 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:17.696 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:17.696 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.696 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:17.696 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:17.696 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:17.696 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:17.697 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:17.697 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:17.697 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:17.697 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:17.697 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:17.697 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:17.697 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:17.697 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.697 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.697 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:17.697 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.697 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:17.697 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:17.697 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:17.698 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:17.698 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:17.698 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:17.698 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:17.698 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:17.698 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:17.698 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:17.698 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:17.698 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:17.698 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:17.698 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:17.698 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:17.698 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:17.699 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:17.699 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:17.699 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:17.699 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:17.699 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:17.699 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:17.699 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:17.699 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:17.699 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:17.699 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:17.699 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:17.699 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:17.699 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.699 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.699 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.700 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.700 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:17.700 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:17.700 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.700 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:17.700 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.700 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:17.700 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:17.700 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:17.700 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.700 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:17.700 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:17.700 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.700 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.700 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:17.701 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:17.701 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.701 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.701 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:17.701 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:17.701 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:17.701 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:17.701 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:17.701 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.701 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.701 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:17.701 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:17.701 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:17.702 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.702 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:17.702 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.702 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:17.702 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.702 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:17.702 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.702 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:17.702 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.702 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:17.702 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:17.702 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:17.702 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:17.702 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.703 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:17.703 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.703 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:17.703 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:17.703 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:17.703 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:17.703 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:17.703 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:17.703 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:17.703 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:17.703 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:17.703 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:17.703 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:17.703 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:17.703 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:17.703 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:17.704 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:17.704 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:17.704 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:17.704 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:17.704 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:17.704 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:17.704 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:17.704 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:17.704 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:17.704 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:17.704 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:17.704 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:17.704 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:17.704 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:17.705 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:17.705 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:17.705 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:17.705 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:17.705 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:17.705 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:17.705 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:17.705 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:17.705 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:17.705 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:17.705 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:17.705 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:17.705 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.705 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.706 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.706 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:17.706 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.706 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:17.706 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.706 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:17.706 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:17.706 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:17.706 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:17.706 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:17.706 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:17.706 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.706 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:17.706 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:17.707 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:17.707 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:17.707 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:17.707 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:17.707 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.707 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:17.707 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:17.707 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:17.707 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:17.707 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:17.707 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:17.707 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:17.707 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:17.707 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:17.707 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:17.708 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:17.708 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.708 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.708 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:17.708 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:17.708 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:17.708 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:17.708 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:17.708 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.708 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.708 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:17.708 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:17.708 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:17.708 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:17.708 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:17.709 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.709 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:17.709 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:17.709 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:17.709 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:17.709 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:17.709 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:17.709 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.709 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:17.709 INFO:teuthology.orchestra.run.smithi003.stdout:___ ERROR at teardown of test_object_lock_multi_delete_object_with_retention ___ 2023-12-03T13:00:17.709 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.709 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.709 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.709 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:17.710 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:17.710 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.710 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:17.710 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.710 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:17.710 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:17.710 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:17.710 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.710 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:17.710 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:17.710 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.710 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.710 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:17.710 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:17.711 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.711 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.711 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:17.711 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.711 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:17.711 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:17.711 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.711 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.711 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:17.711 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:17.711 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.711 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:17.711 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:17.711 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:17.711 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:17.712 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:17.712 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.712 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:17.712 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.712 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:17.712 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:17.712 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:17.712 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:17.712 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:17.712 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:17.712 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:17.712 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:17.712 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.712 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.712 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:17.713 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:17.713 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:17.713 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:17.713 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.713 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:17.713 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:17.713 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:17.713 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:17.713 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.713 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.713 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:17.713 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:17.713 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:17.713 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:17.713 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.714 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.714 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:17.714 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:17.714 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:17.714 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.714 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:17.714 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.714 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:17.714 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:17.714 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.714 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:17.714 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:17.714 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:17.714 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:17.714 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:17.714 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:17.715 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.715 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:17.715 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.715 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:17.715 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.715 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.715 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:17.715 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.715 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:17.715 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.715 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:17.715 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:17.715 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:17.715 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:17.715 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:17.716 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:17.716 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.716 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:17.716 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:17.716 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:17.716 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:17.716 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:17.716 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:17.716 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.716 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:17.716 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:17.716 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:17.716 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:17.716 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:17.717 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:17.717 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:17.717 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:17.717 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:17.717 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:17.717 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:17.717 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.717 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.717 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:17.717 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.717 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:17.717 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:17.717 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:17.717 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:17.717 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:17.718 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:17.718 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:17.718 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:17.718 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:17.718 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:17.718 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:17.718 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:17.718 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:17.718 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:17.718 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:17.718 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:17.718 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:17.718 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:17.718 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:17.719 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:17.719 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:17.719 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:17.719 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:17.719 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:17.719 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:17.719 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:17.719 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:17.719 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:17.719 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.719 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.719 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.719 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.719 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:17.720 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:17.720 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.720 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:17.720 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.720 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:17.720 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:17.720 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:17.720 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.720 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:17.720 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:17.720 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.720 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.720 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:17.721 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:17.721 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.721 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.721 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:17.721 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:17.721 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:17.721 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:17.721 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:17.721 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.721 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.721 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:17.721 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:17.721 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:17.722 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.722 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:17.722 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.722 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:17.722 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.722 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:17.722 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.722 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:17.722 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.722 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:17.722 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:17.722 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:17.722 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:17.722 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.723 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:17.723 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.723 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:17.723 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:17.723 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:17.723 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:17.723 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:17.723 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:17.723 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:17.723 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:17.723 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:17.723 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:17.723 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:17.723 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:17.723 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:17.724 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:17.724 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:17.724 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:17.724 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:17.724 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:17.724 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:17.724 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:17.724 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:17.724 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:17.724 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:17.724 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:17.724 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:17.724 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:17.725 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:17.725 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:17.725 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:17.725 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:17.725 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:17.725 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:17.725 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:17.725 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:17.725 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:17.725 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:17.725 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:17.725 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:17.725 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:17.725 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:17.726 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.726 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.726 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.726 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:17.726 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.726 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:17.726 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.726 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:17.726 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:17.726 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:17.726 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:17.726 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:17.726 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:17.726 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.727 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:17.727 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:17.727 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:17.727 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:17.727 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:17.727 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:17.727 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.727 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:17.727 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:17.727 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:17.727 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:17.727 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:17.727 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:17.727 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:17.727 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:17.728 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:17.728 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:17.728 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:17.728 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.728 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.728 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:17.728 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:17.728 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:17.728 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:17.728 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:17.728 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.728 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.728 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:17.728 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:17.728 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:17.729 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:17.729 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:17.729 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.729 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:17.729 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:17.729 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:17.729 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:17.729 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:17.729 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:17.729 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.729 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:17.729 INFO:teuthology.orchestra.run.smithi003.stdout:_____________ ERROR at teardown of test_object_lock_put_legal_hold _____________ 2023-12-03T13:00:17.730 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.730 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.730 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.730 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:17.730 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:17.730 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.730 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:17.730 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.730 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:17.730 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:17.730 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:17.730 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.730 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:17.730 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:17.730 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.731 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.731 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:17.731 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:17.731 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.731 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.731 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:17.731 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.731 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:17.731 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:17.731 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.731 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.731 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:17.731 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:17.732 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.732 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:17.732 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:17.732 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:17.732 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:17.732 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:17.732 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.732 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:17.732 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.732 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:17.732 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:17.732 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:17.732 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:17.732 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:17.732 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:17.733 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:17.733 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:17.733 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.733 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.733 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:17.733 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:17.733 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:17.733 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:17.733 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.733 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:17.733 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:17.733 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:17.733 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:17.733 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.734 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.734 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:17.734 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:17.734 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:17.734 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:17.734 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.734 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.734 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:17.734 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:17.734 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:17.734 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.734 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:17.734 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.735 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:17.735 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:17.735 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.735 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:17.735 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:17.735 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:17.735 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:17.735 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:17.735 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:17.735 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.735 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:17.735 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.735 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:17.735 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.735 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.736 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:17.736 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.736 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:17.736 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.736 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:17.736 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:17.736 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:17.736 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:17.736 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:17.736 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:17.736 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.736 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:17.736 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:17.736 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:17.736 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:17.737 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:17.737 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:17.737 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.737 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:17.737 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:17.737 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:17.737 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:17.737 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:17.737 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:17.737 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:17.737 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:17.737 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:17.737 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:17.737 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:17.737 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.738 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.738 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:17.738 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.738 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:17.738 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:17.738 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:17.738 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:17.738 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:17.738 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:17.738 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:17.738 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:17.738 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:17.738 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:17.738 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:17.739 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:17.739 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:17.739 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:17.739 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:17.739 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:17.739 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:17.739 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:17.739 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:17.739 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:17.739 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:17.739 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:17.739 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:17.739 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:17.739 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:17.739 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:17.740 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:17.740 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:17.740 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.740 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.740 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.740 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.740 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:17.740 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:17.740 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.740 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:17.740 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.740 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:17.740 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:17.741 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:17.741 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.741 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:17.741 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:17.741 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.741 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.741 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:17.741 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:17.741 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.741 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.741 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:17.741 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:17.741 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:17.742 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:17.742 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:17.742 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.742 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.742 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:17.742 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:17.742 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:17.742 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.742 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:17.742 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.742 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:17.742 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.742 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:17.742 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.743 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:17.743 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.743 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:17.743 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:17.743 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:17.743 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:17.743 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.743 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:17.743 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.743 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:17.743 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:17.743 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:17.743 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:17.743 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:17.744 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:17.744 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:17.744 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:17.744 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:17.744 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:17.744 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:17.744 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:17.744 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:17.744 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:17.744 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:17.744 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:17.744 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:17.744 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:17.745 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:17.745 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:17.745 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:17.745 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:17.745 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:17.745 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:17.745 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:17.745 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:17.745 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:17.745 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:17.745 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:17.745 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:17.745 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:17.745 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:17.745 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:17.745 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:17.746 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:17.746 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:17.746 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:17.746 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:17.746 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:17.746 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:17.746 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.746 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.746 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.746 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:17.746 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.746 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:17.746 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.746 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:17.747 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:17.747 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:17.747 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:17.747 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:17.747 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:17.747 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.747 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:17.747 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:17.747 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:17.747 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:17.747 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:17.747 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:17.747 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.747 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:17.747 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:17.748 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:17.748 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:17.748 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:17.748 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:17.748 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:17.748 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:17.748 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:17.748 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:17.748 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:17.748 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.748 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.748 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:17.748 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:17.748 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:17.749 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:17.749 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:17.749 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.749 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.749 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:17.749 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:17.749 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:17.749 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:17.749 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:17.749 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.749 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:17.749 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:17.749 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:17.749 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:17.749 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:17.750 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:17.750 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.750 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:17.750 INFO:teuthology.orchestra.run.smithi003.stdout:_____ ERROR at teardown of test_object_lock_put_legal_hold_invalid_bucket ______ 2023-12-03T13:00:17.750 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.750 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.750 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.750 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:17.750 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:17.750 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.750 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:17.750 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.750 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:17.751 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:17.751 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:17.751 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.751 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:17.751 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:17.751 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.751 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.751 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:17.751 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:17.751 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.751 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.751 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:17.751 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.751 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:17.752 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:17.752 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.752 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.752 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:17.752 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:17.752 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.752 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:17.752 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:17.752 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:17.752 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:17.752 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:17.752 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.752 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:17.752 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.752 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:17.752 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:17.753 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:17.753 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:17.753 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:17.753 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:17.753 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:17.753 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:17.753 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.753 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.753 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:17.753 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:17.753 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:17.753 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:17.753 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.754 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:17.754 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:17.754 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:17.754 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:17.754 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.754 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.754 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:17.754 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:17.754 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:17.754 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:17.754 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.754 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.754 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:17.754 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:17.755 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:17.755 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.755 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:17.755 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.755 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:17.755 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:17.755 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.755 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:17.755 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:17.755 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:17.755 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:17.755 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:17.755 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:17.755 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.755 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:17.756 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.756 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:17.756 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.756 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.756 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:17.756 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.756 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:17.756 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.756 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:17.756 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:17.756 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:17.756 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:17.756 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:17.756 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:17.757 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.757 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:17.757 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:17.757 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:17.757 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:17.757 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:17.757 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:17.757 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.757 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:17.757 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:17.757 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:17.757 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:17.757 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:17.757 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:17.757 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:17.758 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:17.758 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:17.758 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:17.758 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:17.758 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.758 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.758 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:17.758 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.758 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:17.758 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:17.758 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:17.758 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:17.758 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:17.758 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:17.759 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:17.759 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:17.759 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:17.759 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:17.759 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:17.759 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:17.759 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:17.759 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:17.759 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:17.759 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:17.759 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:17.759 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:17.759 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:17.759 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:17.759 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:17.760 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:17.760 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:17.760 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:17.760 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:17.760 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:17.760 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:17.760 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:17.760 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.760 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.760 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.760 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.760 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:17.760 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:17.760 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.760 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:17.761 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.761 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:17.761 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:17.761 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:17.761 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.761 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:17.761 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:17.761 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.761 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.761 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:17.761 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:17.761 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.761 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.761 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:17.762 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:17.762 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:17.762 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:17.762 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:17.762 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.762 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.762 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:17.762 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:17.762 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:17.762 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.762 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:17.762 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.762 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:17.762 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.763 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:17.763 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.763 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:17.763 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.763 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:17.763 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:17.763 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:17.763 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:17.763 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.763 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:17.763 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.763 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:17.763 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:17.763 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:17.763 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:17.764 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:17.764 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:17.764 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:17.764 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:17.764 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:17.764 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:17.764 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:17.764 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:17.764 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:17.764 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:17.764 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:17.764 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:17.764 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:17.764 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:17.765 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:17.765 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:17.765 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:17.765 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:17.765 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:17.765 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:17.765 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:17.765 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:17.765 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:17.765 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:17.765 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:17.765 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:17.765 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:17.766 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:17.766 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:17.766 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:17.766 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:17.766 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:17.766 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:17.766 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:17.766 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:17.766 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:17.766 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.766 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.766 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.766 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:17.766 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.767 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:17.767 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.767 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:17.767 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:17.767 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:17.767 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:17.767 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:17.767 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:17.767 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.767 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:17.767 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:17.767 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:17.767 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:17.767 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:17.768 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:17.768 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.768 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:17.768 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:17.768 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:17.768 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:17.768 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:17.768 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:17.768 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:17.768 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:17.768 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:17.768 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:17.768 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:17.768 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.768 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.769 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:17.769 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:17.769 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:17.769 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:17.769 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:17.769 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.769 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.769 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:17.769 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:17.769 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:17.769 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:17.769 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:17.769 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.769 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:17.770 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:17.770 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:17.770 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:17.770 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:17.770 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:17.770 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.770 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:17.770 INFO:teuthology.orchestra.run.smithi003.stdout:_____ ERROR at teardown of test_object_lock_put_legal_hold_invalid_status ______ 2023-12-03T13:00:17.770 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.770 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.770 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.770 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:17.770 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:17.770 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.771 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:17.771 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.771 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:17.771 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:17.771 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:17.771 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.771 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:17.771 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:17.771 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.771 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.771 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:17.771 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:17.771 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.771 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.772 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:17.772 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.772 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:17.772 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:17.772 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.772 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.772 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:17.772 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:17.772 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.772 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:17.772 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:17.772 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:17.772 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:17.772 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:17.772 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.773 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:17.773 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.773 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:17.773 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:17.773 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:17.773 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:17.773 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:17.773 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:17.773 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:17.773 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:17.773 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.773 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.773 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:17.773 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:17.773 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:17.773 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:17.774 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.774 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:17.774 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:17.774 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:17.774 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:17.774 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.774 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.774 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:17.774 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:17.774 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:17.774 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:17.774 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.774 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.774 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:17.775 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:17.775 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:17.775 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.775 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:17.775 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.775 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:17.775 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:17.775 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.775 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:17.775 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:17.775 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:17.775 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:17.775 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:17.775 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:17.775 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.776 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:17.776 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.776 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:17.776 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.776 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.776 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:17.776 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.776 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:17.776 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.776 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:17.776 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:17.776 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:17.776 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:17.776 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:17.776 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:17.776 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.777 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:17.777 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:17.777 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:17.777 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:17.777 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:17.777 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:17.777 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.777 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:17.777 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:17.777 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:17.777 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:17.777 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:17.777 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:17.777 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:17.778 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:17.778 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:17.778 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:17.778 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:17.778 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.778 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.778 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:17.778 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.778 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:17.778 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:17.778 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:17.778 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:17.778 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:17.778 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:17.779 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:17.779 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:17.779 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:17.779 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:17.779 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:17.779 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:17.779 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:17.779 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:17.779 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:17.779 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:17.779 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:17.779 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:17.779 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:17.779 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:17.779 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:17.779 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:17.780 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:17.780 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:17.780 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:17.780 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:17.780 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:17.780 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:17.780 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.780 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.780 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.780 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.780 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:17.780 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:17.780 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.780 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:17.781 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.781 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:17.781 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:17.781 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:17.781 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.781 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:17.781 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:17.781 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.781 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.781 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:17.781 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:17.781 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.781 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.781 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:17.781 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:17.782 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:17.782 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:17.782 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:17.782 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.782 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.782 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:17.782 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:17.782 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:17.782 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.782 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:17.782 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.782 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:17.783 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.783 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:17.783 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.783 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:17.783 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.783 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:17.783 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:17.783 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:17.783 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:17.783 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.783 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:17.783 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.783 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:17.783 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:17.783 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:17.784 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:17.784 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:17.784 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:17.784 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:17.784 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:17.784 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:17.784 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:17.784 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:17.784 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:17.784 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:17.784 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:17.784 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:17.784 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:17.784 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:17.785 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:17.785 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:17.785 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:17.785 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:17.785 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:17.785 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:17.785 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:17.785 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:17.785 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:17.785 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:17.785 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:17.785 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:17.785 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:17.785 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:17.785 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:17.785 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:17.786 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:17.786 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:17.786 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:17.786 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:17.786 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:17.786 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:17.786 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:17.786 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.786 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.786 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.786 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:17.786 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.786 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:17.786 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.787 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:17.787 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:17.787 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:17.787 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:17.787 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:17.787 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:17.787 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.787 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:17.787 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:17.787 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:17.787 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:17.787 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:17.787 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:17.787 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.787 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:17.788 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:17.788 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:17.788 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:17.788 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:17.788 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:17.788 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:17.788 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:17.788 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:17.788 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:17.788 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:17.788 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.788 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.788 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:17.788 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:17.788 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:17.788 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:17.789 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:17.789 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.789 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.789 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:17.789 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:17.789 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:17.789 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:17.789 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:17.789 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.789 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:17.789 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:17.789 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:17.789 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:17.790 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:17.790 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:17.790 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.790 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:17.790 INFO:teuthology.orchestra.run.smithi003.stdout:_____________ ERROR at teardown of test_object_lock_get_legal_hold _____________ 2023-12-03T13:00:17.790 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.790 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.790 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.790 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:17.790 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:17.790 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.790 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:17.790 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.790 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:17.791 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:17.791 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:17.791 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.791 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:17.791 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:17.791 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.791 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.791 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:17.791 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:17.791 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.791 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.791 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:17.791 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.791 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:17.792 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:17.792 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.792 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.792 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:17.792 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:17.792 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.792 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:17.792 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:17.792 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:17.792 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:17.792 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:17.792 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.792 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:17.792 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.792 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:17.793 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:17.793 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:17.793 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:17.793 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:17.793 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:17.793 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:17.793 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:17.793 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.793 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.793 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:17.793 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:17.793 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:17.793 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:17.793 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.793 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:17.794 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:17.794 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:17.794 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:17.794 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.794 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.794 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:17.794 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:17.794 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:17.794 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:17.794 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.794 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.794 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:17.794 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:17.794 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:17.795 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.795 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:17.795 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.795 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:17.795 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:17.795 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.795 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:17.795 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:17.795 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:17.795 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:17.795 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:17.795 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:17.795 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.795 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:17.795 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.796 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:17.796 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.796 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.796 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:17.796 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.796 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:17.796 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.796 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:17.796 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:17.796 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:17.796 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:17.796 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:17.796 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:17.796 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.796 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:17.797 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:17.797 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:17.797 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:17.797 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:17.797 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:17.797 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.797 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:17.797 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:17.797 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:17.797 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:17.797 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:17.797 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:17.797 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:17.797 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:17.797 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:17.798 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:17.798 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:17.798 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.798 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.798 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:17.798 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.798 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:17.798 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:17.798 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:17.798 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:17.798 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:17.798 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:17.798 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:17.798 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:17.798 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:17.799 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:17.799 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:17.799 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:17.799 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:17.799 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:17.799 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:17.799 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:17.799 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:17.799 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:17.799 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:17.799 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:17.799 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:17.799 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:17.799 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:17.799 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:17.800 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:17.800 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:17.800 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:17.800 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:17.800 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.800 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.800 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.800 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.800 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:17.800 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:17.800 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.800 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:17.800 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.800 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:17.800 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:17.801 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:17.801 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.801 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:17.801 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:17.801 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.801 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.801 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:17.801 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:17.801 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.801 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.801 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:17.801 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:17.801 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:17.801 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:17.802 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:17.802 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.802 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.802 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:17.802 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:17.802 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:17.802 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.802 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:17.802 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.802 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:17.802 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.802 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:17.802 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.803 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:17.803 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.803 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:17.803 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:17.803 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:17.803 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:17.803 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.803 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:17.803 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.803 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:17.803 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:17.803 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:17.803 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:17.803 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:17.803 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:17.804 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:17.804 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:17.804 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:17.804 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:17.804 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:17.804 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:17.804 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:17.804 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:17.804 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:17.804 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:17.804 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:17.804 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:17.804 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:17.804 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:17.804 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:17.805 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:17.805 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:17.805 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:17.805 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:17.805 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:17.805 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:17.805 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:17.805 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:17.805 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:17.805 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:17.805 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:17.805 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:17.805 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:17.805 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:17.805 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:17.806 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:17.806 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:17.806 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:17.806 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:17.806 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.806 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.806 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.806 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:17.806 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.806 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:17.806 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.806 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:17.806 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:17.806 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:17.806 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:17.807 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:17.807 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:17.807 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.807 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:17.807 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:17.807 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:17.807 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:17.807 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:17.807 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:17.807 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.807 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:17.807 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:17.807 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:17.807 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:17.807 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:17.807 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:17.808 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:17.808 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:17.808 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:17.808 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:17.808 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:17.808 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.808 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.808 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:17.808 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:17.808 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:17.808 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:17.808 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:17.808 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.808 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.809 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:17.809 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:17.809 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:17.809 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:17.809 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:17.809 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.809 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:17.809 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:17.809 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:17.809 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:17.809 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:17.809 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:17.809 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.809 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:17.809 INFO:teuthology.orchestra.run.smithi003.stdout:_____ ERROR at teardown of test_object_lock_get_legal_hold_invalid_bucket ______ 2023-12-03T13:00:17.810 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.810 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.810 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.810 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:17.810 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:17.810 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.810 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:17.810 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.810 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:17.810 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:17.810 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:17.810 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.810 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:17.811 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:17.811 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.811 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.811 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:17.811 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:17.811 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.811 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.811 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:17.811 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.811 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:17.811 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:17.811 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.811 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.811 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:17.812 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:17.812 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.812 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:17.812 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:17.812 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:17.812 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:17.812 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:17.812 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.812 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:17.812 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.812 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:17.812 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:17.812 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:17.812 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:17.813 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:17.813 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:17.813 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:17.813 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:17.813 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.813 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.813 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:17.813 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:17.813 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:17.813 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:17.813 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.813 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:17.813 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:17.813 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:17.814 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:17.814 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.814 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.814 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:17.814 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:17.814 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:17.814 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:17.814 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.814 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.814 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:17.814 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:17.814 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:17.814 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.814 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:17.815 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.815 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:17.815 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:17.815 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.815 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:17.815 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:17.815 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:17.815 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:17.815 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:17.815 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:17.815 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.815 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:17.815 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.815 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:17.815 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.816 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.816 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:17.816 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.816 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:17.816 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.816 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:17.816 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:17.816 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:17.816 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:17.816 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:17.816 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:17.816 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.816 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:17.816 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:17.816 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:17.817 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:17.817 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:17.817 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:17.817 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.817 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:17.817 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:17.817 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:17.817 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:17.817 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:17.817 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:17.817 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:17.817 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:17.817 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:17.817 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:17.817 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:17.818 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.818 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.818 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:17.818 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.818 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:17.818 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:17.818 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:17.818 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:17.818 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:17.818 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:17.818 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:17.818 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:17.818 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:17.818 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:17.819 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:17.819 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:17.819 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:17.819 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:17.819 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:17.819 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:17.819 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:17.819 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:17.819 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:17.819 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:17.819 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:17.819 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:17.819 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:17.819 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:17.819 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:17.820 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:17.820 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:17.820 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:17.820 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.820 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.820 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.820 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.820 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:17.820 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:17.820 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.820 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:17.820 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.820 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:17.820 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:17.821 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:17.821 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.821 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:17.821 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:17.821 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.821 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.821 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:17.821 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:17.821 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.821 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.821 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:17.821 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:17.821 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:17.821 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:17.822 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:17.822 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.822 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.822 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:17.822 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:17.822 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:17.822 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.822 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:17.822 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.822 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:17.822 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.822 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:17.822 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.822 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:17.822 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.823 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:17.823 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:17.823 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:17.823 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:17.823 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.823 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:17.823 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.823 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:17.823 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:17.823 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:17.823 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:17.823 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:17.823 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:17.823 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:17.823 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:17.823 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:17.824 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:17.824 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:17.824 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:17.824 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:17.824 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:17.824 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:17.824 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:17.824 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:17.824 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:17.824 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:17.824 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:17.824 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:17.824 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:17.824 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:17.824 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:17.825 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:17.825 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:17.825 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:17.825 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:17.825 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:17.825 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:17.825 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:17.825 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:17.825 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:17.825 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:17.825 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:17.825 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:17.825 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:17.825 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:17.826 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:17.826 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:17.826 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.826 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.826 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.826 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:17.826 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.826 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:17.826 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.826 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:17.826 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:17.826 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:17.826 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:17.826 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:17.827 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:17.827 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.827 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:17.827 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:17.827 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:17.827 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:17.827 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:17.827 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:17.827 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.827 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:17.827 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:17.827 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:17.827 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:17.827 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:17.827 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:17.828 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:17.828 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:17.828 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:17.828 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:17.828 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:17.828 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.828 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.828 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:17.828 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:17.828 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:17.828 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:17.828 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:17.828 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.828 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.828 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:17.828 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:17.829 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:17.829 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:17.829 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:17.829 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.829 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:17.829 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:17.829 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:17.829 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:17.829 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:17.829 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:17.829 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.829 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:17.829 INFO:teuthology.orchestra.run.smithi003.stdout:____ ERROR at teardown of test_object_lock_delete_object_with_legal_hold_on ____ 2023-12-03T13:00:17.829 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.829 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.830 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.830 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:17.830 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:17.830 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.830 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:17.830 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.830 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:17.830 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:17.830 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:17.830 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.830 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:17.830 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:17.830 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.830 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.831 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:17.831 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:17.831 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.831 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.831 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:17.831 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.831 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:17.831 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:17.831 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.831 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.831 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:17.831 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:17.831 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.831 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:17.832 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:17.832 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:17.832 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:17.832 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:17.832 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.832 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:17.832 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.832 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:17.832 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:17.832 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:17.832 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:17.832 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:17.832 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:17.832 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:17.832 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:17.833 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.833 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.833 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:17.833 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:17.833 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:17.833 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:17.833 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.833 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:17.833 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:17.833 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:17.833 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:17.833 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.833 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.833 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:17.833 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:17.834 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:17.834 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:17.834 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.834 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.834 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:17.834 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:17.834 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:17.834 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.834 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:17.834 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.834 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:17.834 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:17.834 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.835 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:17.835 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:17.835 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:17.835 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:17.835 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:17.835 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:17.835 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.835 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:17.835 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.835 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:17.835 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.835 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.835 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:17.835 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.835 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:17.835 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.836 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:17.836 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:17.836 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:17.836 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:17.836 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:17.836 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:17.836 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.836 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:17.836 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:17.836 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:17.836 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:17.836 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:17.836 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:17.836 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.836 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:17.836 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:17.837 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:17.837 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:17.837 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:17.837 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:17.837 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:17.837 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:17.837 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:17.837 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:17.837 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:17.837 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.837 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.837 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:17.837 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.838 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:17.838 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:17.838 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:17.838 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:17.838 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:17.838 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:17.838 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:17.838 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:17.838 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:17.838 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:17.838 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:17.838 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:17.838 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:17.838 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:17.839 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:17.839 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:17.839 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:17.839 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:17.839 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:17.839 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:17.839 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:17.839 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:17.839 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:17.839 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:17.839 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:17.839 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:17.839 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:17.839 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:17.839 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.840 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.840 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.840 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.840 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:17.840 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:17.840 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.840 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:17.840 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.840 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:17.840 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:17.840 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:17.840 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.840 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:17.840 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:17.841 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.841 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.841 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:17.841 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:17.841 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.841 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.841 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:17.841 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:17.841 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:17.841 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:17.841 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:17.841 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.841 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.841 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:17.842 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:17.842 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:17.842 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.842 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:17.842 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.842 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:17.842 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.842 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:17.842 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.842 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:17.842 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.842 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:17.842 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:17.842 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:17.843 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:17.843 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.843 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:17.843 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.843 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:17.843 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:17.843 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:17.843 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:17.843 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:17.843 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:17.843 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:17.843 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:17.843 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:17.843 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:17.843 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:17.844 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:17.844 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:17.844 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:17.844 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:17.844 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:17.844 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:17.844 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:17.844 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:17.844 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:17.844 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:17.844 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:17.844 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:17.844 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:17.844 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:17.844 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:17.845 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:17.845 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:17.845 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:17.845 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:17.845 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:17.845 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:17.845 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:17.845 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:17.845 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:17.845 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:17.845 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:17.845 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:17.845 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:17.845 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:17.845 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.846 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.846 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.846 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:17.846 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.846 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:17.846 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.846 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:17.846 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:17.846 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:17.846 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:17.846 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:17.846 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:17.846 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.847 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:17.847 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:17.847 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:17.847 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:17.847 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:17.847 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:17.847 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.847 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:17.847 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:17.847 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:17.847 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:17.847 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:17.847 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:17.847 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:17.848 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:17.848 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:17.848 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:17.848 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:17.848 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.848 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.848 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:17.848 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:17.848 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:17.848 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:17.848 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:17.848 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.848 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.849 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:17.849 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:17.849 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:17.849 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:17.849 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:17.849 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.849 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:17.849 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:17.849 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:17.849 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:17.849 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:17.849 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:17.849 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.850 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:17.850 INFO:teuthology.orchestra.run.smithi003.stdout:___ ERROR at teardown of test_object_lock_delete_object_with_legal_hold_off ____ 2023-12-03T13:00:17.850 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.850 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.850 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.850 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:17.850 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:17.850 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.850 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:17.850 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.850 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:17.850 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:17.850 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:17.851 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.851 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:17.851 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:17.851 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.851 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.851 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:17.851 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:17.851 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.851 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.851 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:17.851 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.851 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:17.851 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:17.851 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.852 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.852 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:17.852 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:17.852 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.852 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:17.852 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:17.852 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:17.852 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:17.852 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:17.852 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.852 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:17.852 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.852 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:17.853 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:17.853 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:17.853 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:17.853 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:17.853 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:17.853 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:17.853 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:17.853 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.853 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.853 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:17.853 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:17.853 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:17.853 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:17.853 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.853 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:17.854 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:17.854 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:17.854 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:17.854 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.854 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.854 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:17.854 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:17.854 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:17.854 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:17.854 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.854 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.854 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:17.854 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:17.855 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:17.855 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.855 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:17.855 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.855 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:17.855 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:17.855 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.855 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:17.855 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:17.855 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:17.855 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:17.855 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:17.855 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:17.855 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.855 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:17.856 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.856 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:17.856 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.856 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.856 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:17.856 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.856 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:17.856 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.856 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:17.856 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:17.856 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:17.856 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:17.856 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:17.856 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:17.856 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.856 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:17.857 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:17.857 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:17.857 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:17.857 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:17.857 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:17.857 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.857 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:17.857 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:17.857 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:17.857 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:17.857 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:17.857 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:17.857 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:17.857 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:17.857 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:17.857 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:17.858 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:17.858 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.858 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.858 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:17.858 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.858 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:17.858 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:17.858 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:17.858 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:17.858 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:17.858 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:17.858 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:17.858 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:17.859 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:17.859 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:17.859 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:17.859 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:17.859 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:17.859 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:17.859 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:17.859 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:17.859 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:17.859 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:17.859 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:17.859 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:17.859 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:17.859 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:17.859 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:17.859 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:17.860 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:17.860 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:17.860 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:17.860 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:17.860 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.860 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.860 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.860 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.860 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:17.860 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:17.860 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.860 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:17.860 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.860 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:17.861 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:17.861 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:17.861 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.861 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:17.861 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:17.861 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.861 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.861 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:17.861 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:17.861 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.861 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.861 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:17.861 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:17.861 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:17.861 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:17.862 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:17.862 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.862 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.862 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:17.862 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:17.862 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:17.862 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.862 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:17.862 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.862 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:17.862 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.862 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:17.862 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.863 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:17.863 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.863 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:17.863 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:17.863 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:17.863 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:17.863 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.863 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:17.863 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.863 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:17.863 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:17.863 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:17.863 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:17.863 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:17.863 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:17.864 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:17.864 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:17.864 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:17.864 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:17.864 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:17.864 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:17.864 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:17.864 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:17.864 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:17.864 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:17.864 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:17.864 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:17.864 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:17.864 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:17.864 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:17.865 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:17.865 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:17.865 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:17.865 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:17.865 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:17.865 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:17.865 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:17.865 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:17.865 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:17.865 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:17.865 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:17.865 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:17.865 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:17.865 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:17.865 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:17.866 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:17.866 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:17.866 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:17.866 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:17.866 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.866 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.866 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.866 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:17.866 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.866 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:17.866 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.866 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:17.866 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:17.866 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:17.866 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:17.867 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:17.867 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:17.867 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.867 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:17.867 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:17.867 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:17.867 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:17.867 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:17.867 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:17.867 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.867 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:17.867 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:17.867 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:17.867 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:17.867 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:17.868 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:17.868 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:17.868 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:17.868 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:17.868 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:17.868 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:17.868 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.868 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.868 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:17.868 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:17.868 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:17.868 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:17.868 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:17.868 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.868 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.869 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:17.869 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:17.869 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:17.869 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:17.869 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:17.869 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.869 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:17.869 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:17.869 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:17.869 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:17.869 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:17.869 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:17.869 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.869 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:17.869 INFO:teuthology.orchestra.run.smithi003.stdout:____________ ERROR at teardown of test_object_lock_get_obj_metadata ____________ 2023-12-03T13:00:17.870 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.870 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.870 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.870 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:17.870 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:17.870 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.870 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:17.870 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.870 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:17.870 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:17.870 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:17.870 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.870 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:17.870 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:17.871 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.871 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.871 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:17.871 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:17.871 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.871 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.871 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:17.871 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.871 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:17.871 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:17.871 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.871 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.871 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:17.871 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:17.872 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.872 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:17.872 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:17.872 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:17.872 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:17.872 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:17.872 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.872 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:17.872 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.872 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:17.872 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:17.872 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:17.872 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:17.872 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:17.872 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:17.873 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:17.873 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:17.873 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.873 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.873 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:17.873 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:17.873 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:17.873 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:17.873 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.873 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:17.873 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:17.873 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:17.873 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:17.874 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.874 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.874 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:17.874 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:17.874 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:17.874 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:17.874 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.874 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.874 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:17.874 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:17.874 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:17.874 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.874 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:17.874 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.874 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:17.875 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:17.875 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.875 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:17.875 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:17.875 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:17.875 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:17.875 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:17.875 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:17.875 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.875 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:17.875 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.875 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:17.875 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.875 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.876 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:17.876 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.876 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:17.876 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.876 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:17.876 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:17.876 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:17.876 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:17.876 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:17.876 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:17.876 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.876 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:17.876 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:17.876 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:17.876 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:17.877 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:17.877 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:17.877 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.877 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:17.877 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:17.877 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:17.877 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:17.877 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:17.877 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:17.877 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:17.877 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:17.877 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:17.877 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:17.877 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:17.877 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.877 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.878 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:17.878 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.878 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:17.878 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:17.878 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:17.878 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:17.878 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:17.878 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:17.878 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:17.878 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:17.878 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:17.878 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:17.878 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:17.878 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:17.878 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:17.879 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:17.879 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:17.879 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:17.879 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:17.879 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:17.879 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:17.879 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:17.879 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:17.879 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:17.879 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:17.879 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:17.879 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:17.879 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:17.879 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:17.879 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:17.880 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.880 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.880 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.880 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.880 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:17.880 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:17.880 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.880 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:17.880 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.880 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:17.880 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:17.880 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:17.880 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.880 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:17.881 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:17.881 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.881 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.881 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:17.881 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:17.881 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.881 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.881 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:17.881 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:17.881 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:17.881 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:17.881 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:17.881 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.881 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.882 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:17.882 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:17.882 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:17.882 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.882 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:17.882 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.882 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:17.882 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.882 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:17.882 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.882 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:17.882 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.882 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:17.882 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:17.882 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:17.883 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:17.883 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.883 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:17.883 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.883 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:17.883 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:17.883 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:17.883 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:17.883 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:17.883 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:17.883 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:17.883 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:17.883 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:17.884 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:17.884 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:17.884 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:17.884 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:17.884 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:17.884 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:17.884 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:17.884 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:17.884 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:17.884 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:17.884 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:17.884 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:17.884 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:17.884 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:17.884 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:17.885 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:17.885 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:17.885 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:17.885 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:17.885 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:17.885 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:17.885 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:17.885 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:17.885 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:17.885 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:17.885 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:17.885 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:17.885 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:17.886 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:17.886 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:17.886 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:17.886 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.886 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.886 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.886 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:17.886 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.886 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:17.886 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.886 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:17.886 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:17.886 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:17.887 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:17.887 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:17.887 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:17.887 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.887 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:17.887 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:17.887 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:17.887 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:17.887 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:17.887 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:17.887 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.887 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:17.887 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:17.887 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:17.887 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:17.888 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:17.888 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:17.888 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:17.888 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:17.888 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:17.888 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:17.888 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:17.888 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.888 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.888 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:17.888 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:17.888 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:17.888 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:17.888 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:17.888 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.889 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.889 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:17.889 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:17.889 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:17.889 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:17.889 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:17.889 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.889 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:17.889 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:17.889 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:17.889 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:17.889 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:17.889 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:17.889 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.889 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:17.889 INFO:teuthology.orchestra.run.smithi003.stdout:_____________ ERROR at teardown of test_object_lock_uploading_obj ______________ 2023-12-03T13:00:17.890 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.890 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.890 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.890 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:17.890 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:17.890 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.890 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:17.890 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.890 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:17.890 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:17.890 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:17.890 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.890 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:17.891 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:17.891 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.891 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.891 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:17.891 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:17.891 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.891 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.891 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:17.891 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.891 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:17.891 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:17.891 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.891 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.892 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:17.892 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:17.892 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.892 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:17.892 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:17.892 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:17.892 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:17.892 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:17.892 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.892 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:17.892 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.892 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:17.892 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:17.892 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:17.893 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:17.893 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:17.893 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:17.893 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:17.893 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:17.893 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.893 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.893 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:17.893 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:17.893 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:17.893 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:17.893 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.893 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:17.893 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:17.893 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:17.894 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:17.894 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.894 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.894 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:17.894 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:17.894 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:17.894 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:17.894 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.894 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.894 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:17.894 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:17.894 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:17.894 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.894 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:17.894 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.895 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:17.895 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:17.895 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.895 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:17.895 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:17.895 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:17.895 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:17.895 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:17.895 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:17.895 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.895 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:17.895 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.895 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:17.895 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.895 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.896 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:17.896 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.896 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:17.896 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.896 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:17.896 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:17.896 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:17.896 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:17.896 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:17.896 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:17.896 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.896 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:17.896 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:17.897 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:17.897 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:17.897 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:17.897 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:17.897 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.897 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:17.897 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:17.897 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:17.897 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:17.897 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:17.897 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:17.897 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:17.897 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:17.897 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:17.897 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:17.898 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:17.898 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.898 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.898 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:17.898 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.898 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:17.898 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:17.898 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:17.898 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:17.898 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:17.898 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:17.899 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:17.899 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:17.899 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:17.899 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:17.899 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:17.899 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:17.899 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:17.899 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:17.899 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:17.899 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:17.899 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:17.899 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:17.899 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:17.899 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:17.899 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:17.900 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:17.900 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:17.900 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:17.900 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:17.900 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:17.900 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:17.900 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:17.900 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.900 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.900 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.900 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.900 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:17.900 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:17.900 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.901 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:17.901 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.901 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:17.901 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:17.901 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:17.901 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.901 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:17.901 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:17.901 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.901 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.901 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:17.901 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:17.901 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.901 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.901 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:17.902 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:17.902 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:17.902 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:17.902 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:17.902 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.902 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.902 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:17.902 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:17.902 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:17.902 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.902 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:17.902 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.902 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:17.902 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.903 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:17.903 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.903 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:17.903 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.903 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:17.903 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:17.903 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:17.903 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:17.903 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.903 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:17.903 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.903 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:17.903 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:17.903 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:17.904 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:17.904 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:17.904 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:17.904 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:17.904 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:17.904 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:17.904 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:17.904 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:17.904 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:17.904 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:17.904 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:17.904 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:17.904 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:17.905 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:17.905 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:17.905 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:17.905 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:17.905 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:17.905 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:17.905 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:17.905 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:17.905 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:17.905 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:17.905 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:17.905 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:17.905 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:17.905 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:17.906 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:17.906 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:17.906 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:17.906 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:17.906 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:17.906 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:17.906 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:17.906 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:17.906 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:17.906 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:17.906 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.906 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.906 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.906 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:17.907 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.907 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:17.907 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.907 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:17.907 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:17.907 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:17.907 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:17.907 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:17.907 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:17.907 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.907 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:17.907 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:17.907 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:17.907 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:17.907 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:17.908 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:17.908 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.908 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:17.908 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:17.908 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:17.908 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:17.908 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:17.908 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:17.908 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:17.908 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:17.908 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:17.908 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:17.908 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:17.908 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.908 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.909 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:17.909 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:17.909 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:17.909 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:17.909 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:17.909 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.909 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.909 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:17.909 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:17.909 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:17.909 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:17.909 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:17.909 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.909 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:17.910 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:17.910 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:17.910 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:17.910 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:17.910 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:17.910 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.910 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:17.910 INFO:teuthology.orchestra.run.smithi003.stdout:_ ERROR at teardown of test_object_lock_changing_mode_from_governance_with_bypass _ 2023-12-03T13:00:17.910 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.910 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.910 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.911 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:17.911 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:17.911 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.911 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:17.911 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.911 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:17.911 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:17.911 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:17.911 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.911 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:17.911 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:17.911 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.911 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.911 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:17.912 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:17.912 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.912 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.912 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:17.912 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.912 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:17.912 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:17.912 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.912 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.912 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:17.912 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:17.912 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.912 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:17.912 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:17.913 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:17.913 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:17.913 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:17.913 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.913 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:17.913 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.913 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:17.913 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:17.913 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:17.913 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:17.913 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:17.913 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:17.913 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:17.913 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:17.913 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.913 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.914 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:17.914 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:17.914 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:17.914 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:17.914 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.914 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:17.914 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:17.914 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:17.914 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:17.914 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.914 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.914 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:17.914 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:17.915 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:17.915 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:17.915 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.915 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.915 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:17.915 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:17.915 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:17.915 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.915 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:17.915 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.915 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:17.915 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:17.915 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.915 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:17.915 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:17.915 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:17.916 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:17.916 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:17.916 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:17.916 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.916 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:17.916 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.916 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:17.916 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.916 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.916 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:17.916 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.916 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:17.916 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.916 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:17.916 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:17.917 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:17.917 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:17.917 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:17.917 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:17.917 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.917 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:17.917 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:17.917 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:17.917 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:17.917 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:17.917 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:17.917 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.917 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:17.917 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:17.917 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:17.918 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:17.918 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:17.918 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:17.918 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:17.918 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:17.918 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:17.918 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:17.918 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:17.918 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.918 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.918 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:17.918 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.918 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:17.918 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:17.918 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:17.919 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:17.919 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:17.919 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:17.919 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:17.919 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:17.919 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:17.919 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:17.919 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:17.919 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:17.919 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:17.919 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:17.919 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:17.919 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:17.919 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:17.920 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:17.920 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:17.920 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:17.920 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:17.920 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:17.920 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:17.920 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:17.920 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:17.920 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:17.920 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:17.920 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:17.920 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.920 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.920 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.920 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.921 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:17.921 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:17.921 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.921 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:17.921 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.921 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:17.921 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:17.921 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:17.921 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.921 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:17.921 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:17.921 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.921 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.921 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:17.922 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:17.922 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.922 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.922 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:17.922 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:17.922 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:17.922 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:17.922 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:17.922 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.922 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.922 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:17.922 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:17.922 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:17.923 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.923 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:17.923 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.923 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:17.923 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.923 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:17.923 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.923 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:17.923 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.923 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:17.923 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:17.923 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:17.923 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:17.924 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.924 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:17.924 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.924 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:17.924 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:17.924 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:17.924 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:17.924 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:17.924 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:17.924 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:17.924 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:17.924 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:17.924 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:17.924 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:17.924 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:17.925 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:17.925 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:17.925 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:17.925 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:17.925 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:17.925 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:17.925 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:17.925 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:17.925 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:17.925 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:17.925 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:17.925 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:17.925 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:17.925 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:17.925 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:17.925 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:17.926 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:17.926 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:17.926 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:17.926 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:17.926 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:17.926 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:17.926 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:17.926 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:17.926 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:17.926 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:17.926 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:17.926 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:17.926 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.926 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.927 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.927 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:17.927 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.927 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:17.927 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.927 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:17.927 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:17.927 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:17.927 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:17.927 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:17.927 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:17.927 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.927 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:17.927 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:17.928 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:17.928 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:17.928 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:17.928 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:17.928 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.928 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:17.928 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:17.928 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:17.928 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:17.928 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:17.928 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:17.928 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:17.928 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:17.928 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:17.928 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:17.928 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:17.929 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.929 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.929 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:17.929 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:17.929 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:17.929 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:17.929 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:17.929 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.929 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.929 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:17.929 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:17.929 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:17.929 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:17.929 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:17.929 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.930 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:17.930 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:17.930 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:17.930 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:17.930 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:17.930 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:17.930 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.930 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:17.930 INFO:teuthology.orchestra.run.smithi003.stdout:_ ERROR at teardown of test_object_lock_changing_mode_from_governance_without_bypass _ 2023-12-03T13:00:17.930 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.930 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.930 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.930 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:17.930 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:17.931 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.931 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:17.931 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.931 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:17.931 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:17.931 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:17.931 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.931 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:17.931 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:17.931 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.931 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.931 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:17.931 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:17.932 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.932 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.932 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:17.932 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.932 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:17.932 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:17.932 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.932 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.932 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:17.932 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:17.932 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.932 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:17.932 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:17.932 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:17.933 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:17.933 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:17.933 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.933 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:17.933 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.933 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:17.933 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:17.933 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:17.933 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:17.933 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:17.933 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:17.933 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:17.933 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:17.933 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.933 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.934 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:17.934 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:17.934 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:17.934 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:17.934 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.934 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:17.934 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:17.934 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:17.934 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:17.934 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.934 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.934 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:17.934 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:17.935 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:17.935 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:17.935 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.935 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.935 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:17.935 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:17.935 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:17.935 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.935 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:17.935 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.935 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:17.935 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:17.935 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.935 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:17.935 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:17.936 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:17.936 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:17.936 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:17.936 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:17.936 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.936 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:17.936 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.936 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:17.936 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.936 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.936 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:17.936 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.936 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:17.936 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.936 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:17.937 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:17.937 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:17.937 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:17.937 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:17.937 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:17.937 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.937 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:17.937 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:17.937 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:17.937 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:17.937 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:17.937 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:17.937 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.937 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:17.937 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:17.938 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:17.938 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:17.938 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:17.938 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:17.938 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:17.938 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:17.938 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:17.938 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:17.938 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:17.938 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.938 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.938 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:17.938 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.938 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:17.939 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:17.939 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:17.939 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:17.939 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:17.939 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:17.939 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:17.939 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:17.939 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:17.939 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:17.939 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:17.939 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:17.939 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:17.939 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:17.939 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:17.939 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:17.940 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:17.940 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:17.940 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:17.940 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:17.940 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:17.940 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:17.940 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:17.940 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:17.940 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:17.940 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:17.940 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:17.940 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:17.941 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.941 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.941 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.941 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.941 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:17.941 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:17.941 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.941 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:17.941 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.941 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:17.941 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:17.941 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:17.941 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.942 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:17.942 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:17.942 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.942 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.942 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:17.942 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:17.942 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.942 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.942 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:17.942 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:17.942 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:17.942 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:17.942 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:17.942 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.943 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.943 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:17.943 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:17.943 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:17.943 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.943 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:17.943 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.943 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:17.943 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.943 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:17.943 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.943 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:17.943 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.943 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:17.944 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:17.944 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:17.944 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:17.944 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.944 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:17.944 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.944 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:17.944 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:17.944 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:17.944 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:17.944 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:17.944 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:17.944 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:17.944 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:17.944 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:17.945 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:17.945 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:17.945 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:17.945 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:17.945 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:17.945 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:17.945 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:17.945 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:17.945 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:17.945 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:17.945 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:17.945 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:17.945 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:17.945 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:17.945 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:17.946 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:17.946 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:17.946 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:17.946 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:17.946 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:17.946 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:17.946 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:17.946 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:17.946 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:17.946 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:17.946 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:17.947 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:17.947 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:17.947 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:17.947 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:17.947 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:17.947 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.947 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.947 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.947 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:17.947 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.947 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:17.947 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.947 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:17.947 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:17.947 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:17.948 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:17.948 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:17.948 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:17.948 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.948 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:17.948 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:17.948 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:17.948 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:17.948 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:17.948 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:17.948 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.948 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:17.948 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:17.948 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:17.949 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:17.949 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:17.949 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:17.949 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:17.949 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:17.949 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:17.949 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:17.949 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:17.949 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.949 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.949 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:17.949 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:17.949 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:17.949 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:17.949 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:17.950 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.950 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.950 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:17.950 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:17.950 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:17.950 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:17.950 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:17.950 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.950 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:17.950 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:17.950 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:17.950 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:17.950 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:17.951 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:17.951 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.951 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:17.951 INFO:teuthology.orchestra.run.smithi003.stdout:_____ ERROR at teardown of test_object_lock_changing_mode_from_compliance ______ 2023-12-03T13:00:17.951 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.951 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.951 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.951 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:17.951 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:17.951 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.951 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:17.951 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.951 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:17.951 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:17.952 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:17.952 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.952 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:17.952 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:17.952 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.952 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.952 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:17.952 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:17.952 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.952 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.952 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:17.952 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.952 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:17.952 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:17.952 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.953 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.953 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:17.953 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:17.953 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.953 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:17.953 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:17.953 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:17.953 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:17.953 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:17.953 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.953 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:17.953 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.953 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:17.953 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:17.954 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:17.954 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:17.954 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:17.954 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:17.954 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:17.954 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:17.954 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.954 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.954 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:17.954 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:17.954 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:17.954 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:17.954 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.954 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:17.954 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:17.955 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:17.955 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:17.955 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.955 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.955 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:17.955 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:17.955 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:17.955 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:17.955 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.955 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.955 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:17.955 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:17.955 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:17.955 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.955 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:17.956 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.956 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:17.956 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:17.956 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.956 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:17.956 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:17.956 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:17.956 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:17.956 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:17.956 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:17.956 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.956 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:17.956 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.956 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:17.956 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.957 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.957 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:17.957 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.957 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:17.957 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.957 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:17.957 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:17.957 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:17.957 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:17.957 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:17.957 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:17.957 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.957 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:17.957 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:17.958 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:17.958 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:17.958 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:17.958 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:17.958 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.958 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:17.958 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:17.958 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:17.958 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:17.958 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:17.958 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:17.958 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:17.958 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:17.958 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:17.959 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:17.959 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:17.959 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.959 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.959 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:17.959 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.959 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:17.959 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:17.959 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:17.959 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:17.959 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:17.959 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:17.960 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:17.960 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:17.960 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:17.960 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:17.960 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:17.960 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:17.960 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:17.960 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:17.960 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:17.960 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:17.960 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:17.960 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:17.960 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:17.960 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:17.960 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:17.961 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:17.961 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:17.961 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:17.961 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:17.961 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:17.961 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:17.961 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:17.961 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.961 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.961 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.961 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.961 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:17.961 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:17.961 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.962 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:17.962 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.962 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:17.962 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:17.962 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:17.962 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.962 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:17.962 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:17.962 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.962 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.962 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:17.962 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:17.962 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.962 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.963 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:17.963 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:17.963 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:17.963 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:17.963 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:17.963 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.963 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.963 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:17.963 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:17.963 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:17.963 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.963 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:17.963 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.963 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:17.964 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.964 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:17.964 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.964 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:17.964 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.964 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:17.964 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:17.964 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:17.964 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:17.964 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.964 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:17.964 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.964 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:17.964 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:17.964 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:17.964 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:17.965 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:17.965 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:17.965 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:17.965 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:17.965 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:17.965 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:17.965 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:17.965 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:17.965 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:17.965 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:17.965 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:17.965 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:17.965 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:17.965 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:17.965 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:17.966 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:17.966 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:17.966 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:17.966 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:17.966 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:17.966 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:17.966 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:17.966 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:17.966 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:17.966 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:17.966 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:17.966 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:17.966 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:17.967 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:17.967 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:17.967 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:17.967 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:17.967 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:17.967 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:17.967 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:17.967 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:17.967 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.967 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.967 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.967 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:17.967 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.967 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:17.967 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.968 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:17.968 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:17.968 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:17.968 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:17.968 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:17.968 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:17.968 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.968 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:17.968 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:17.968 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:17.968 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:17.968 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:17.968 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:17.968 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.969 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:17.969 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:17.969 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:17.969 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:17.969 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:17.969 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:17.969 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:17.969 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:17.969 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:17.969 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:17.969 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:17.969 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.969 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.969 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:17.969 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:17.970 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:17.970 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:17.970 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:17.970 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.970 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.970 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:17.970 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:17.970 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:17.970 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:17.970 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:17.970 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.970 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:17.970 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:17.970 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:17.970 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:17.971 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:17.971 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:17.971 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.971 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:17.971 INFO:teuthology.orchestra.run.smithi003.stdout:______________ ERROR at teardown of test_copy_object_ifmatch_good ______________ 2023-12-03T13:00:17.971 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.971 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.971 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.971 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:17.971 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:17.971 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.971 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:17.972 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.972 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:17.972 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:17.972 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:17.972 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.972 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:17.972 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:17.972 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.972 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.972 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:17.972 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:17.972 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.972 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.973 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:17.973 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.973 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:17.973 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:17.973 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.973 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.973 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:17.973 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:17.973 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.973 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:17.973 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:17.973 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:17.973 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:17.973 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:17.973 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.974 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:17.974 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.974 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:17.974 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:17.974 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:17.974 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:17.974 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:17.974 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:17.974 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:17.974 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:17.974 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.974 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.974 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:17.974 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:17.974 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:17.975 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:17.975 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.975 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:17.975 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:17.975 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:17.975 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:17.975 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.975 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.975 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:17.975 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:17.975 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:17.975 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:17.975 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.975 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.975 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:17.976 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:17.976 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:17.976 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.976 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:17.976 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.976 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:17.976 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:17.976 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.976 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:17.976 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:17.976 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:17.976 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:17.976 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:17.976 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:17.977 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.977 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:17.977 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.977 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:17.977 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.977 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.977 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:17.977 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.977 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:17.977 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.977 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:17.977 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:17.977 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:17.977 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:17.977 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:17.977 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:17.978 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.978 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:17.978 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:17.978 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:17.978 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:17.978 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:17.978 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:17.978 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.978 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:17.978 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:17.978 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:17.978 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:17.978 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:17.978 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:17.979 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:17.979 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:17.979 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:17.979 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:17.979 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:17.979 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.979 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.979 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:17.979 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.979 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:17.979 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:17.979 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:17.979 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:17.979 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:17.979 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:17.979 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:17.979 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:17.980 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:17.980 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:17.980 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:17.980 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:17.980 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:17.980 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:17.980 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:17.980 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:17.980 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:17.980 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:17.980 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:17.980 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:17.980 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:17.980 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:17.981 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:17.981 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:17.981 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:17.981 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:17.981 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:17.981 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:17.981 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.981 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.981 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.981 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.981 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:17.981 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:17.981 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.981 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:17.982 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.982 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:17.982 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:17.982 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:17.982 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.982 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:17.982 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:17.982 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.982 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.982 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:17.982 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:17.982 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.982 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.982 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:17.983 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:17.983 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:17.983 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:17.983 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:17.983 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.983 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.983 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:17.983 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:17.983 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:17.983 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.983 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:17.984 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.984 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:17.984 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.984 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:17.984 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.984 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:17.984 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.984 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:17.984 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:17.984 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:17.984 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:17.984 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.985 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:17.985 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.985 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:17.985 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:17.985 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:17.985 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:17.985 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:17.985 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:17.985 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:17.985 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:17.985 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:17.985 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:17.985 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:17.986 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:17.986 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:17.986 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:17.986 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:17.986 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:17.986 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:17.986 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:17.986 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:17.986 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:17.986 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:17.986 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:17.986 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:17.986 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:17.987 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:17.987 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:17.987 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:17.987 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:17.987 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:17.987 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:17.987 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:17.987 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:17.987 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:17.987 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:17.987 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:17.987 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:17.987 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:17.987 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:17.988 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:17.988 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:17.988 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.988 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.988 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.988 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:17.988 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.988 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:17.988 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.988 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:17.988 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:17.988 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:17.988 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:17.989 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:17.989 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:17.989 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.989 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:17.989 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:17.989 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:17.989 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:17.989 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:17.989 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:17.989 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.989 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:17.989 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:17.989 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:17.989 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:17.990 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:17.990 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:17.990 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:17.990 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:17.990 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:17.990 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:17.990 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:17.990 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.990 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.990 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:17.990 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:17.990 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:17.990 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:17.990 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:17.991 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.991 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.991 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:17.991 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:17.991 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:17.991 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:17.991 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:17.991 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.991 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:17.991 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:17.991 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:17.991 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:17.991 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:17.992 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:17.992 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.992 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:17.992 INFO:teuthology.orchestra.run.smithi003.stdout:___________ ERROR at teardown of test_copy_object_ifnonematch_failed ___________ 2023-12-03T13:00:17.992 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.992 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.992 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.992 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:17.992 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:17.992 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.992 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:17.992 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.992 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:17.993 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:17.993 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:17.993 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.993 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:17.993 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:17.993 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.993 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.993 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:17.993 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:17.993 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.993 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.993 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:17.993 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.993 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:17.993 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:17.994 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:17.994 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.994 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:17.994 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:17.994 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.994 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:17.994 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:17.994 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:17.994 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:17.994 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:17.994 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.994 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:17.994 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.995 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:17.995 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:17.995 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:17.995 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:17.995 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:17.995 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:17.995 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:17.995 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:17.995 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:17.995 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.995 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:17.995 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:17.996 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:17.996 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:17.996 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.996 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:17.996 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:17.996 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:17.996 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:17.996 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.996 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.996 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:17.996 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:17.996 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:17.996 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:17.997 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:17.997 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.997 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:17.997 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:17.997 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:17.997 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.997 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:17.997 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.997 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:17.997 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:17.997 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.997 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:17.997 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:17.998 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:17.998 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:17.998 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:17.998 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:17.998 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.998 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:17.998 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.998 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:17.998 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.998 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:17.998 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:17.998 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:17.998 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:17.999 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:17.999 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:17.999 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:17.999 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:17.999 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:17.999 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:17.999 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:17.999 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:17.999 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:17.999 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:17.999 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:17.999 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:17.999 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:17.999 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:18.000 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.000 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:18.000 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:18.000 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:18.000 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:18.000 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:18.000 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:18.000 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:18.000 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:18.000 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:18.000 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:18.000 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:18.000 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.000 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.000 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:18.001 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.001 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:18.001 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:18.001 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:18.001 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:18.001 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:18.001 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:18.001 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:18.001 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:18.001 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:18.001 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:18.001 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:18.001 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:18.001 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:18.002 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:18.002 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:18.002 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:18.002 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:18.002 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:18.002 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:18.002 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:18.002 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:18.002 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:18.002 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:18.002 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:18.002 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:18.002 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:18.002 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:18.003 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:18.003 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.003 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.003 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.003 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.003 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:18.003 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:18.003 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.003 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:18.003 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.003 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:18.003 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:18.003 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:18.003 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.003 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:18.004 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:18.004 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.004 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.004 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:18.004 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:18.004 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.004 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.004 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:18.004 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:18.004 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:18.004 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:18.004 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:18.004 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.004 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.005 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:18.005 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:18.005 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:18.005 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.005 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:18.005 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.005 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:18.005 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.005 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:18.005 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.005 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:18.005 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.005 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:18.005 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:18.005 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:18.005 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:18.006 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.006 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:18.006 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.006 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:18.006 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:18.006 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:18.006 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:18.006 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:18.006 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:18.006 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:18.006 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:18.006 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:18.006 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:18.006 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:18.007 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:18.007 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:18.007 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:18.007 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:18.007 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:18.007 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:18.007 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:18.007 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:18.007 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:18.007 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:18.007 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:18.007 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:18.007 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:18.007 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:18.007 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:18.008 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:18.008 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:18.008 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:18.008 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:18.008 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:18.008 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:18.008 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:18.008 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:18.008 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:18.008 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:18.008 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:18.008 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:18.008 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:18.008 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:18.009 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.009 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.009 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.009 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:18.009 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.009 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:18.009 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.009 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:18.009 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:18.009 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:18.009 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:18.009 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:18.009 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:18.009 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.009 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:18.010 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:18.010 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:18.010 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:18.010 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:18.010 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:18.010 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.010 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:18.010 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:18.010 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:18.010 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:18.010 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:18.010 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:18.010 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:18.011 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:18.011 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:18.011 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:18.011 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:18.011 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.011 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.011 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:18.011 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:18.011 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:18.011 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:18.011 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:18.011 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.011 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.011 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:18.012 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:18.012 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:18.012 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:18.012 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:18.012 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.012 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:18.012 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:18.012 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:18.012 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:18.012 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:18.012 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:18.012 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.012 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:18.012 INFO:teuthology.orchestra.run.smithi003.stdout:______________ ERROR at teardown of test_get_bucket_policy_status ______________ 2023-12-03T13:00:18.012 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.013 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.013 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.013 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:18.013 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:18.013 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.013 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:18.013 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.013 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:18.013 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:18.013 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:18.013 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.013 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:18.013 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:18.013 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.013 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.014 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:18.014 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:18.014 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.014 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.014 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:18.014 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.014 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:18.014 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:18.014 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.014 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.014 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:18.014 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:18.014 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.014 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:18.015 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:18.015 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:18.015 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:18.015 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:18.015 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.015 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:18.015 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.015 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:18.015 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:18.015 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:18.015 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:18.015 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:18.015 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:18.015 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:18.015 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:18.016 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.016 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.016 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:18.016 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:18.016 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:18.016 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:18.016 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.016 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:18.016 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:18.016 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:18.016 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:18.016 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.016 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.016 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:18.016 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:18.017 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:18.017 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:18.017 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.017 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.017 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:18.017 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:18.017 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:18.017 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.017 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:18.017 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.017 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:18.017 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:18.017 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.017 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:18.017 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:18.018 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:18.018 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:18.018 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:18.018 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:18.018 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.018 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:18.018 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.018 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:18.018 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.018 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.018 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:18.018 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.018 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:18.019 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.019 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:18.019 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:18.019 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:18.019 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:18.019 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:18.019 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:18.019 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.019 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:18.019 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:18.019 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:18.019 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:18.019 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:18.019 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:18.019 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.020 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:18.020 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:18.020 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:18.020 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:18.020 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:18.020 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:18.020 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:18.020 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:18.020 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:18.020 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:18.020 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:18.020 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.020 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.020 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:18.020 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.021 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:18.021 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:18.021 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:18.021 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:18.021 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:18.021 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:18.021 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:18.021 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:18.021 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:18.021 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:18.021 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:18.022 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:18.022 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:18.022 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:18.022 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:18.022 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:18.022 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:18.022 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:18.022 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:18.022 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:18.022 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:18.022 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:18.022 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:18.022 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:18.023 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:18.023 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:18.023 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:18.023 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:18.023 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.023 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.023 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.023 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.023 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:18.023 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:18.023 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.023 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:18.023 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.023 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:18.023 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:18.024 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:18.024 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.024 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:18.024 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:18.024 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.024 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.024 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:18.024 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:18.024 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.024 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.024 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:18.024 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:18.024 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:18.024 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:18.024 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:18.025 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.025 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.025 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:18.025 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:18.025 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:18.025 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.025 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:18.025 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.025 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:18.025 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.025 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:18.025 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.025 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:18.025 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.026 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:18.026 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:18.026 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:18.026 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:18.026 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.026 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:18.026 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.026 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:18.026 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:18.026 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:18.026 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:18.026 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:18.026 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:18.026 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:18.026 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:18.027 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:18.027 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:18.027 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:18.027 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:18.027 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:18.027 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:18.027 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:18.027 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:18.027 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:18.027 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:18.027 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:18.027 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:18.027 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:18.027 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:18.028 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:18.028 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:18.028 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:18.028 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:18.028 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:18.028 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:18.028 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:18.028 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:18.028 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:18.028 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:18.028 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:18.028 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:18.028 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:18.028 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:18.028 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:18.028 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:18.029 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:18.029 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:18.029 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.029 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.029 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.029 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:18.029 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.029 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:18.029 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.029 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:18.029 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:18.029 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:18.029 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:18.029 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:18.029 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:18.030 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.030 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:18.030 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:18.030 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:18.030 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:18.030 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:18.030 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:18.030 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.030 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:18.030 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:18.030 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:18.030 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:18.030 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:18.030 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:18.031 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:18.031 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:18.031 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:18.031 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:18.031 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:18.031 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.031 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.031 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:18.031 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:18.031 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:18.031 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:18.031 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:18.031 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.032 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.032 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:18.032 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:18.032 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:18.032 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:18.032 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:18.032 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.032 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:18.032 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:18.032 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:18.032 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:18.032 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:18.033 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:18.033 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.033 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:18.033 INFO:teuthology.orchestra.run.smithi003.stdout:________ ERROR at teardown of test_get_public_acl_bucket_policy_status _________ 2023-12-03T13:00:18.033 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.033 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.033 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.033 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:18.033 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:18.033 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.033 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:18.033 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.033 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:18.033 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:18.034 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:18.034 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.034 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:18.034 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:18.034 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.034 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.034 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:18.034 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:18.034 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.034 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.034 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:18.034 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.034 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:18.035 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:18.035 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.035 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.035 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:18.035 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:18.035 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.035 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:18.035 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:18.035 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:18.035 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:18.035 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:18.035 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.035 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:18.036 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.036 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:18.036 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:18.036 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:18.036 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:18.036 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:18.036 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:18.036 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:18.036 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:18.036 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.036 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.036 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:18.036 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:18.036 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:18.037 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:18.037 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.037 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:18.037 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:18.037 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:18.037 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:18.037 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.037 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.037 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:18.037 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:18.037 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:18.037 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:18.037 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.037 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.038 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:18.038 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:18.038 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:18.038 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.038 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:18.038 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.038 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:18.038 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:18.038 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.038 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:18.038 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:18.038 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:18.038 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:18.039 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:18.039 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:18.039 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.039 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:18.039 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.039 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:18.039 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.039 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.039 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:18.039 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.039 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:18.039 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.039 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:18.039 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:18.039 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:18.040 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:18.040 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:18.040 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:18.040 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.040 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:18.040 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:18.040 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:18.040 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:18.040 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:18.040 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:18.040 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.040 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:18.040 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:18.040 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:18.041 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:18.041 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:18.041 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:18.041 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:18.041 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:18.041 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:18.041 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:18.041 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:18.041 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.041 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.041 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:18.041 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.041 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:18.042 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:18.042 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:18.042 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:18.042 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:18.042 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:18.042 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:18.042 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:18.042 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:18.042 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:18.042 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:18.042 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:18.042 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:18.042 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:18.042 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:18.042 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:18.043 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:18.043 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:18.043 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:18.043 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:18.043 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:18.043 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:18.043 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:18.043 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:18.043 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:18.043 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:18.043 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:18.043 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:18.043 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.044 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.044 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.044 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.044 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:18.044 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:18.044 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.044 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:18.044 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.044 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:18.044 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:18.044 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:18.044 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.044 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:18.044 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:18.044 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.044 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.045 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:18.045 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:18.045 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.045 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.045 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:18.045 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:18.045 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:18.045 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:18.045 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:18.045 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.045 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.045 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:18.045 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:18.045 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:18.046 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.046 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:18.046 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.046 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:18.046 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.046 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:18.046 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.046 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:18.046 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.046 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:18.046 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:18.046 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:18.047 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:18.047 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.047 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:18.047 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.047 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:18.047 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:18.047 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:18.047 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:18.047 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:18.047 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:18.047 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:18.047 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:18.047 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:18.047 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:18.047 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:18.047 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:18.048 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:18.048 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:18.048 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:18.048 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:18.048 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:18.048 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:18.048 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:18.048 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:18.048 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:18.048 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:18.048 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:18.048 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:18.048 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:18.048 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:18.049 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:18.049 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:18.049 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:18.049 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:18.049 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:18.049 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:18.049 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:18.049 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:18.049 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:18.049 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:18.049 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:18.049 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:18.049 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:18.049 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:18.049 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.049 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.050 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.050 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:18.050 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.050 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:18.050 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.050 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:18.050 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:18.050 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:18.050 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:18.050 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:18.050 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:18.050 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.050 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:18.051 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:18.051 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:18.051 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:18.051 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:18.051 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:18.051 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.051 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:18.051 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:18.051 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:18.051 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:18.051 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:18.051 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:18.051 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:18.052 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:18.052 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:18.052 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:18.052 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:18.052 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.052 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.052 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:18.052 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:18.052 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:18.052 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:18.052 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:18.052 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.052 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.052 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:18.052 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:18.053 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:18.053 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:18.053 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:18.053 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.053 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:18.053 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:18.053 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:18.053 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:18.053 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:18.053 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:18.053 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.053 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:18.053 INFO:teuthology.orchestra.run.smithi003.stdout:______ ERROR at teardown of test_get_authpublic_acl_bucket_policy_status _______ 2023-12-03T13:00:18.053 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.053 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.054 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.054 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:18.054 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:18.054 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.054 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:18.054 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.054 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:18.054 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:18.054 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:18.054 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.054 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:18.054 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:18.054 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.054 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.055 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:18.055 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:18.055 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.055 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.055 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:18.055 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.055 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:18.055 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:18.055 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.055 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.055 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:18.055 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:18.055 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.055 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:18.055 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:18.056 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:18.056 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:18.056 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:18.056 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.056 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:18.056 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.056 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:18.056 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:18.056 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:18.056 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:18.056 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:18.056 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:18.056 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:18.056 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:18.057 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.057 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.057 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:18.057 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:18.057 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:18.057 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:18.057 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.057 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:18.057 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:18.057 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:18.057 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:18.057 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.057 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.057 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:18.058 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:18.058 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:18.058 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:18.058 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.058 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.058 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:18.058 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:18.058 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:18.058 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.058 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:18.058 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.058 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:18.058 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:18.059 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.059 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:18.059 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:18.059 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:18.059 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:18.059 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:18.059 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:18.059 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.059 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:18.059 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.059 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:18.059 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.059 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.059 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:18.060 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.060 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:18.060 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.060 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:18.060 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:18.060 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:18.060 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:18.060 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:18.060 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:18.060 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.060 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:18.060 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:18.061 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:18.061 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:18.061 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:18.061 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:18.061 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.061 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:18.061 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:18.061 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:18.061 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:18.061 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:18.061 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:18.061 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:18.061 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:18.061 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:18.062 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:18.062 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:18.062 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.062 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.062 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:18.062 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.062 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:18.062 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:18.062 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:18.062 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:18.062 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:18.062 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:18.062 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:18.062 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:18.063 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:18.063 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:18.063 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:18.063 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:18.063 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:18.063 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:18.063 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:18.063 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:18.063 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:18.063 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:18.063 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:18.063 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:18.063 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:18.063 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:18.064 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:18.064 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:18.064 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:18.064 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:18.064 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:18.064 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:18.064 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.064 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.064 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.064 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.064 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:18.064 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:18.064 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.064 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:18.065 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.065 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:18.065 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:18.065 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:18.065 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.065 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:18.065 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:18.065 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.065 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.065 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:18.065 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:18.065 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.065 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.066 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:18.066 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:18.066 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:18.066 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:18.066 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:18.066 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.066 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.066 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:18.066 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:18.066 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:18.066 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.066 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:18.066 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.066 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:18.067 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.067 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:18.067 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.067 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:18.067 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.067 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:18.067 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:18.067 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:18.067 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:18.067 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.067 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:18.067 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.067 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:18.067 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:18.067 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:18.068 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:18.068 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:18.068 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:18.068 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:18.068 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:18.068 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:18.068 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:18.068 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:18.068 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:18.068 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:18.068 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:18.068 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:18.068 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:18.068 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:18.069 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:18.069 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:18.069 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:18.069 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:18.069 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:18.069 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:18.069 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:18.069 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:18.069 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:18.069 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:18.069 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:18.069 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:18.069 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:18.069 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:18.069 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:18.070 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:18.070 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:18.070 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:18.070 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:18.070 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:18.070 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:18.070 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:18.070 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:18.070 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.070 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.070 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.070 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:18.071 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.071 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:18.071 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.071 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:18.071 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:18.071 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:18.071 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:18.071 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:18.071 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:18.071 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.071 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:18.071 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:18.071 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:18.071 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:18.071 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:18.072 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:18.072 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.072 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:18.072 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:18.072 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:18.072 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:18.072 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:18.072 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:18.072 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:18.072 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:18.072 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:18.072 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:18.072 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:18.072 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.073 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.073 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:18.073 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:18.073 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:18.073 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:18.073 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:18.073 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.073 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.073 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:18.073 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:18.073 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:18.073 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:18.073 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:18.073 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.074 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:18.074 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:18.074 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:18.074 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:18.074 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:18.074 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:18.074 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.074 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:18.074 INFO:teuthology.orchestra.run.smithi003.stdout:_____ ERROR at teardown of test_get_publicpolicy_acl_bucket_policy_status ______ 2023-12-03T13:00:18.074 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.074 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.074 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.074 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:18.074 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:18.074 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.075 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:18.075 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.075 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:18.075 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:18.075 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:18.075 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.075 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:18.075 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:18.075 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.075 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.075 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:18.075 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:18.075 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.075 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.076 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:18.076 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.076 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:18.076 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:18.076 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.076 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.076 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:18.076 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:18.076 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.076 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:18.076 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:18.076 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:18.076 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:18.076 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:18.076 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.077 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:18.077 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.077 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:18.077 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:18.077 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:18.077 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:18.077 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:18.077 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:18.077 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:18.077 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:18.077 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.077 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.077 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:18.077 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:18.078 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:18.078 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:18.078 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.078 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:18.078 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:18.078 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:18.078 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:18.078 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.078 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.078 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:18.078 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:18.078 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:18.078 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:18.078 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.078 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.079 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:18.079 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:18.079 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:18.079 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.079 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:18.079 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.079 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:18.079 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:18.079 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.079 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:18.079 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:18.079 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:18.079 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:18.079 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:18.080 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:18.080 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.080 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:18.080 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.080 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:18.080 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.080 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.080 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:18.080 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.080 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:18.080 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.080 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:18.080 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:18.080 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:18.080 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:18.081 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:18.081 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:18.081 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.081 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:18.081 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:18.081 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:18.081 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:18.081 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:18.081 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:18.081 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.081 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:18.081 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:18.081 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:18.081 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:18.081 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:18.082 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:18.082 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:18.082 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:18.082 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:18.082 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:18.082 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:18.082 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.082 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.082 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:18.082 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.082 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:18.082 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:18.083 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:18.083 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:18.083 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:18.083 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:18.083 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:18.083 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:18.083 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:18.083 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:18.083 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:18.083 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:18.083 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:18.083 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:18.083 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:18.084 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:18.084 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:18.084 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:18.084 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:18.084 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:18.084 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:18.084 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:18.084 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:18.084 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:18.084 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:18.084 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:18.084 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:18.084 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:18.084 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.085 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.085 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.085 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.085 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:18.085 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:18.085 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.085 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:18.085 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.085 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:18.085 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:18.085 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:18.085 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.085 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:18.085 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:18.086 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.086 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.086 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:18.086 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:18.086 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.086 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.086 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:18.086 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:18.086 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:18.086 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:18.086 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:18.086 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.086 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.086 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:18.087 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:18.087 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:18.087 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.087 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:18.087 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.087 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:18.087 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.087 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:18.087 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.087 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:18.087 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.087 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:18.087 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:18.087 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:18.088 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:18.088 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.088 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:18.088 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.088 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:18.088 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:18.088 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:18.088 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:18.088 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:18.088 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:18.088 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:18.088 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:18.088 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:18.088 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:18.088 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:18.089 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:18.089 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:18.089 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:18.089 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:18.089 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:18.089 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:18.089 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:18.089 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:18.089 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:18.089 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:18.089 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:18.089 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:18.089 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:18.089 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:18.090 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:18.090 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:18.090 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:18.090 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:18.090 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:18.090 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:18.090 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:18.090 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:18.090 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:18.090 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:18.090 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:18.090 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:18.090 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:18.090 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:18.091 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:18.091 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.091 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.091 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.091 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:18.091 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.091 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:18.091 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.091 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:18.091 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:18.091 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:18.091 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:18.092 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:18.092 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:18.092 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.092 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:18.092 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:18.092 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:18.092 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:18.092 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:18.092 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:18.092 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.092 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:18.092 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:18.092 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:18.092 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:18.093 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:18.093 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:18.093 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:18.093 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:18.093 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:18.093 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:18.093 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:18.093 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.093 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.093 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:18.093 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:18.093 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:18.093 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:18.093 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:18.093 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.094 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.094 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:18.094 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:18.094 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:18.094 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:18.094 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:18.094 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.094 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:18.094 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:18.094 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:18.094 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:18.094 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:18.094 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:18.095 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.095 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:18.095 INFO:teuthology.orchestra.run.smithi003.stdout:____ ERROR at teardown of test_get_nonpublicpolicy_acl_bucket_policy_status ____ 2023-12-03T13:00:18.095 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.095 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.095 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.095 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:18.095 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:18.095 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.095 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:18.095 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.095 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:18.095 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:18.096 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:18.096 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.096 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:18.096 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:18.096 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.096 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.096 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:18.096 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:18.096 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.096 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.096 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:18.096 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.096 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:18.096 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:18.097 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.097 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.097 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:18.097 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:18.097 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.097 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:18.097 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:18.097 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:18.097 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:18.097 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:18.097 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.097 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:18.097 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.097 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:18.097 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:18.098 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:18.098 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:18.098 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:18.098 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:18.098 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:18.098 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:18.098 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.098 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.098 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:18.098 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:18.098 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:18.098 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:18.098 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.098 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:18.098 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:18.099 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:18.099 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:18.099 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.099 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.099 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:18.099 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:18.099 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:18.099 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:18.099 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.099 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.099 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:18.099 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:18.099 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:18.099 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.100 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:18.100 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.100 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:18.100 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:18.100 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.100 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:18.100 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:18.100 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:18.100 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:18.100 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:18.100 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:18.100 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.100 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:18.100 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.101 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:18.101 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.101 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.101 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:18.101 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.101 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:18.101 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.101 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:18.101 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:18.101 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:18.101 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:18.101 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:18.101 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:18.102 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.102 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:18.102 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:18.102 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:18.102 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:18.102 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:18.102 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:18.102 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.102 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:18.102 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:18.102 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:18.102 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:18.102 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:18.102 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:18.103 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:18.103 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:18.103 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:18.103 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:18.103 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:18.103 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.103 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.103 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:18.103 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.103 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:18.103 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:18.103 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:18.103 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:18.103 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:18.104 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:18.104 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:18.104 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:18.104 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:18.104 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:18.104 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:18.104 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:18.104 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:18.104 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:18.104 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:18.104 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:18.104 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:18.104 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:18.104 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:18.104 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:18.105 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:18.105 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:18.105 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:18.105 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:18.105 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:18.105 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:18.105 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:18.105 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:18.105 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.105 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.105 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.105 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.105 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:18.105 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:18.105 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.106 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:18.106 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.106 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:18.106 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:18.106 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:18.106 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.106 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:18.106 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:18.106 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.106 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.106 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:18.106 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:18.106 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.106 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.107 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:18.107 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:18.107 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:18.107 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:18.107 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:18.107 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.107 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.107 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:18.107 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:18.107 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:18.107 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.107 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:18.107 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.108 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:18.108 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.108 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:18.108 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.108 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:18.108 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.108 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:18.108 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:18.108 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:18.108 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:18.108 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.108 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:18.108 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.108 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:18.109 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:18.109 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:18.109 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:18.109 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:18.109 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:18.109 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:18.109 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:18.109 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:18.109 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:18.109 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:18.109 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:18.109 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:18.109 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:18.109 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:18.110 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:18.110 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:18.110 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:18.110 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:18.110 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:18.110 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:18.110 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:18.110 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:18.110 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:18.110 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:18.110 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:18.110 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:18.110 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:18.110 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:18.111 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:18.111 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:18.111 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:18.111 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:18.111 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:18.111 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:18.111 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:18.111 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:18.111 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:18.111 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:18.111 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:18.111 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.111 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.111 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.112 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:18.112 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.112 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:18.112 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.112 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:18.112 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:18.112 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:18.112 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:18.112 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:18.112 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:18.112 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.112 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:18.112 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:18.113 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:18.113 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:18.113 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:18.113 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:18.113 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.113 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:18.113 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:18.113 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:18.113 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:18.113 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:18.113 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:18.113 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:18.113 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:18.113 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:18.113 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:18.114 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:18.114 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.114 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.114 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:18.114 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:18.114 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:18.114 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:18.114 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:18.114 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.114 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.114 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:18.114 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:18.114 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:18.114 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:18.115 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:18.115 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.115 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:18.115 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:18.115 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:18.115 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:18.115 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:18.115 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:18.115 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.115 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:18.115 INFO:teuthology.orchestra.run.smithi003.stdout:___ ERROR at teardown of test_get_nonpublicpolicy_deny_bucket_policy_status ____ 2023-12-03T13:00:18.115 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.115 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.115 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.115 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:18.116 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:18.116 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.116 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:18.116 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.116 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:18.116 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:18.116 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:18.116 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.116 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:18.116 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:18.116 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.116 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.116 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:18.116 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:18.117 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.117 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.117 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:18.117 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.117 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:18.117 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:18.117 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.117 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.117 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:18.117 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:18.117 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.117 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:18.117 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:18.117 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:18.117 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:18.118 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:18.118 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.118 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:18.118 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.118 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:18.118 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:18.118 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:18.118 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:18.118 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:18.118 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:18.118 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:18.118 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:18.118 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.118 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.119 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:18.119 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:18.119 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:18.119 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:18.119 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.119 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:18.119 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:18.119 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:18.119 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:18.119 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.119 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.119 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:18.119 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:18.119 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:18.120 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:18.120 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.120 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.120 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:18.120 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:18.120 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:18.120 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.120 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:18.120 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.120 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:18.120 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:18.120 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.120 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:18.120 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:18.121 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:18.121 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:18.121 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:18.121 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:18.121 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.121 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:18.121 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.121 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:18.121 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.121 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.121 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:18.121 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.121 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:18.122 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.122 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:18.122 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:18.122 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:18.122 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:18.122 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:18.122 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:18.122 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.122 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:18.122 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:18.122 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:18.122 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:18.122 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:18.122 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:18.123 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.123 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:18.123 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:18.123 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:18.123 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:18.123 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:18.123 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:18.123 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:18.123 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:18.123 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:18.123 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:18.123 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:18.123 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.123 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.123 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:18.124 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.124 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:18.124 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:18.124 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:18.124 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:18.124 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:18.124 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:18.124 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:18.124 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:18.124 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:18.124 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:18.124 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:18.124 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:18.124 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:18.124 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:18.124 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:18.125 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:18.125 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:18.125 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:18.125 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:18.125 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:18.125 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:18.125 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:18.125 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:18.125 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:18.125 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:18.125 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:18.125 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:18.125 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:18.125 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.126 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.126 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.126 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.126 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:18.126 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:18.126 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.126 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:18.126 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.126 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:18.126 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:18.126 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:18.126 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.126 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:18.126 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:18.126 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.127 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.127 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:18.127 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:18.127 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.127 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.127 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:18.127 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:18.127 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:18.127 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:18.127 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:18.127 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.127 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.127 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:18.127 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:18.128 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:18.128 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.128 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:18.128 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.128 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:18.128 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.128 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:18.128 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.128 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:18.128 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.128 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:18.128 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:18.128 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:18.128 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:18.128 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.128 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:18.129 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.129 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:18.129 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:18.129 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:18.129 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:18.129 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:18.129 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:18.129 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:18.129 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:18.129 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:18.129 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:18.129 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:18.129 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:18.129 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:18.130 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:18.130 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:18.130 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:18.130 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:18.130 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:18.130 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:18.130 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:18.130 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:18.130 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:18.130 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:18.130 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:18.130 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:18.131 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:18.131 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:18.131 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:18.131 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:18.131 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:18.131 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:18.131 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:18.131 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:18.131 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:18.131 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:18.131 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:18.131 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:18.131 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:18.131 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:18.132 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:18.132 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.132 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.132 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.132 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:18.132 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.132 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:18.132 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.132 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:18.132 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:18.132 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:18.132 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:18.133 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:18.133 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:18.133 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.133 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:18.133 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:18.133 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:18.133 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:18.133 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:18.133 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:18.133 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.133 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:18.133 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:18.133 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:18.133 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:18.133 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:18.134 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:18.134 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:18.134 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:18.134 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:18.134 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:18.134 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:18.134 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.134 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.134 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:18.134 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:18.134 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:18.134 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:18.134 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:18.135 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.135 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.135 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:18.135 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:18.135 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:18.135 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:18.135 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:18.135 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.135 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:18.135 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:18.135 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:18.135 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:18.135 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:18.135 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:18.136 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.136 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:18.136 INFO:teuthology.orchestra.run.smithi003.stdout:______________ ERROR at teardown of test_get_default_public_block ______________ 2023-12-03T13:00:18.136 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.136 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.136 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.136 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:18.136 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:18.136 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.136 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:18.136 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.136 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:18.136 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:18.136 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:18.136 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.137 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:18.137 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:18.137 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.137 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.137 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:18.137 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:18.137 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.137 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.137 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:18.137 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.137 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:18.137 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:18.137 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.138 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.138 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:18.138 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:18.138 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.138 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:18.138 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:18.138 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:18.138 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:18.138 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:18.138 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.138 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:18.138 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.138 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:18.138 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:18.138 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:18.138 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:18.139 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:18.139 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:18.139 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:18.139 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:18.139 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.139 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.139 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:18.139 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:18.139 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:18.139 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:18.139 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.139 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:18.139 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:18.139 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:18.139 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:18.140 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.140 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.140 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:18.140 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:18.140 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:18.140 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:18.140 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.140 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.140 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:18.140 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:18.140 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:18.140 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.140 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:18.140 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.140 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:18.141 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:18.141 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.141 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:18.141 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:18.141 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:18.141 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:18.141 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:18.141 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:18.141 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.141 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:18.141 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.141 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:18.141 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.141 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.142 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:18.142 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.142 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:18.142 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.142 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:18.142 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:18.142 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:18.142 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:18.142 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:18.142 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:18.142 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.142 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:18.142 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:18.142 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:18.143 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:18.143 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:18.143 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:18.143 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.143 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:18.143 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:18.143 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:18.143 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:18.143 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:18.143 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:18.143 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:18.143 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:18.143 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:18.143 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:18.144 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:18.144 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.144 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.144 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:18.144 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.144 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:18.144 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:18.144 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:18.144 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:18.144 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:18.144 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:18.144 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:18.144 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:18.145 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:18.145 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:18.145 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:18.145 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:18.145 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:18.145 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:18.145 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:18.145 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:18.145 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:18.145 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:18.145 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:18.145 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:18.145 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:18.145 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:18.145 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:18.146 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:18.146 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:18.146 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:18.146 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:18.146 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:18.146 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.146 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.146 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.146 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.146 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:18.146 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:18.146 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.147 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:18.147 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.147 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:18.147 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:18.147 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:18.147 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.147 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:18.147 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:18.147 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.147 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.147 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:18.147 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:18.147 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.147 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.148 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:18.148 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:18.148 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:18.148 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:18.148 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:18.148 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.148 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.148 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:18.148 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:18.148 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:18.148 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.148 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:18.148 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.148 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:18.148 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.149 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:18.149 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.149 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:18.149 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.149 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:18.149 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:18.149 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:18.149 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:18.149 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.149 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:18.149 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.149 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:18.149 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:18.149 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:18.149 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:18.149 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:18.150 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:18.150 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:18.150 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:18.150 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:18.150 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:18.150 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:18.150 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:18.150 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:18.150 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:18.150 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:18.150 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:18.150 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:18.150 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:18.151 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:18.151 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:18.151 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:18.151 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:18.151 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:18.151 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:18.151 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:18.151 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:18.151 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:18.151 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:18.151 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:18.151 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:18.151 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:18.151 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:18.151 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:18.152 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:18.152 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:18.152 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:18.152 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:18.152 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:18.152 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:18.152 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:18.152 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.152 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.152 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.152 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:18.152 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.152 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:18.152 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.153 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:18.153 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:18.153 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:18.153 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:18.153 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:18.153 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:18.153 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.153 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:18.153 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:18.153 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:18.153 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:18.153 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:18.153 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:18.153 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.153 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:18.154 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:18.154 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:18.154 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:18.154 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:18.154 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:18.154 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:18.154 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:18.154 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:18.154 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:18.154 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:18.154 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.154 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.154 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:18.154 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:18.155 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:18.155 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:18.155 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:18.155 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.155 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.155 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:18.155 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:18.155 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:18.155 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:18.155 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:18.155 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.155 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:18.155 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:18.155 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:18.156 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:18.156 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:18.156 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:18.156 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.156 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:18.156 INFO:teuthology.orchestra.run.smithi003.stdout:__________________ ERROR at teardown of test_put_public_block __________________ 2023-12-03T13:00:18.156 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.156 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.156 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.156 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:18.156 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:18.156 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.156 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:18.156 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.157 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:18.157 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:18.157 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:18.157 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.157 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:18.157 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:18.157 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.157 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.157 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:18.157 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:18.157 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.157 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.157 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:18.157 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.158 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:18.158 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:18.158 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.158 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.158 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:18.158 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:18.158 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.158 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:18.158 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:18.158 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:18.158 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:18.158 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:18.158 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.158 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:18.158 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.158 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:18.159 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:18.159 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:18.159 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:18.159 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:18.159 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:18.159 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:18.159 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:18.159 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.159 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.159 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:18.159 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:18.159 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:18.159 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:18.159 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.160 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:18.160 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:18.160 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:18.160 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:18.160 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.160 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.160 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:18.160 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:18.160 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:18.160 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:18.160 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.160 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.160 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:18.160 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:18.161 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:18.161 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.161 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:18.161 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.161 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:18.161 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:18.161 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.161 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:18.161 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:18.161 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:18.161 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:18.161 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:18.161 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:18.161 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.162 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:18.162 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.162 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:18.162 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.162 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.162 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:18.162 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.162 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:18.162 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.162 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:18.162 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:18.162 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:18.162 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:18.162 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:18.163 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:18.163 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.163 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:18.163 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:18.163 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:18.163 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:18.163 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:18.163 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:18.163 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.163 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:18.163 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:18.163 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:18.163 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:18.163 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:18.163 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:18.164 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:18.164 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:18.164 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:18.164 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:18.164 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:18.164 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.164 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.164 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:18.164 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.164 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:18.164 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:18.164 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:18.164 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:18.164 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:18.164 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:18.165 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:18.165 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:18.165 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:18.165 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:18.165 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:18.165 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:18.165 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:18.165 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:18.165 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:18.165 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:18.165 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:18.165 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:18.165 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:18.165 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:18.166 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:18.166 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:18.166 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:18.166 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:18.166 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:18.166 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:18.166 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:18.166 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:18.166 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.166 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.166 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.166 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.166 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:18.167 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:18.167 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.167 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:18.167 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.167 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:18.167 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:18.167 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:18.167 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.167 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:18.167 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:18.167 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.167 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.167 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:18.167 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:18.167 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.167 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.168 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:18.168 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:18.168 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:18.168 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:18.168 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:18.168 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.168 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.168 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:18.168 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:18.168 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:18.168 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.168 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:18.168 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.168 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:18.169 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.169 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:18.169 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.169 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:18.169 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.169 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:18.169 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:18.169 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:18.169 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:18.169 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.169 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:18.169 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.170 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:18.170 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:18.170 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:18.170 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:18.170 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:18.170 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:18.170 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:18.170 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:18.170 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:18.170 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:18.170 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:18.170 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:18.170 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:18.170 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:18.170 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:18.171 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:18.171 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:18.171 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:18.171 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:18.171 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:18.171 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:18.171 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:18.171 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:18.171 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:18.171 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:18.171 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:18.171 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:18.171 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:18.171 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:18.172 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:18.172 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:18.172 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:18.172 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:18.172 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:18.172 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:18.172 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:18.172 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:18.172 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:18.172 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:18.172 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:18.172 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.172 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.172 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.172 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:18.173 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.173 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:18.173 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.173 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:18.173 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:18.173 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:18.173 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:18.173 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:18.173 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:18.173 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.173 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:18.173 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:18.173 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:18.173 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:18.174 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:18.174 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:18.174 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.174 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:18.174 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:18.174 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:18.174 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:18.174 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:18.174 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:18.174 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:18.174 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:18.174 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:18.174 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:18.174 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:18.175 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.175 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.175 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:18.175 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:18.175 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:18.175 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:18.175 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:18.175 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.175 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.175 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:18.175 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:18.175 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:18.175 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:18.175 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:18.175 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.176 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:18.176 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:18.176 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:18.176 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:18.176 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:18.176 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:18.176 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.176 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:18.176 INFO:teuthology.orchestra.run.smithi003.stdout:____________ ERROR at teardown of test_block_public_put_bucket_acls ____________ 2023-12-03T13:00:18.176 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.176 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.176 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.176 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:18.176 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:18.176 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.177 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:18.177 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.177 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:18.177 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:18.177 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:18.177 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.177 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:18.177 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:18.177 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.177 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.177 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:18.177 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:18.177 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.177 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.178 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:18.178 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.178 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:18.178 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:18.178 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.178 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.178 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:18.178 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:18.178 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.178 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:18.178 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:18.178 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:18.178 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:18.178 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:18.178 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.179 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:18.179 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.179 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:18.179 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:18.179 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:18.179 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:18.179 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:18.179 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:18.179 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:18.179 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:18.179 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.179 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.179 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:18.179 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:18.179 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:18.180 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:18.180 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.180 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:18.180 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:18.180 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:18.180 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:18.180 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.180 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.180 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:18.180 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:18.180 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:18.180 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:18.180 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.180 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.180 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:18.180 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:18.181 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:18.181 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.181 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:18.181 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.181 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:18.181 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:18.181 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.181 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:18.181 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:18.181 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:18.181 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:18.181 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:18.182 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:18.182 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.182 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:18.182 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.182 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:18.182 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.182 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.182 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:18.182 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.182 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:18.182 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.182 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:18.182 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:18.182 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:18.183 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:18.183 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:18.183 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:18.183 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.183 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:18.183 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:18.183 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:18.183 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:18.183 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:18.183 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:18.183 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.183 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:18.183 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:18.183 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:18.183 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:18.184 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:18.184 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:18.184 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:18.184 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:18.184 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:18.184 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:18.184 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:18.184 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.184 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.184 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:18.184 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.184 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:18.184 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:18.184 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:18.184 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:18.185 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:18.185 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:18.185 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:18.185 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:18.185 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:18.185 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:18.185 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:18.185 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:18.185 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:18.185 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:18.185 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:18.185 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:18.185 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:18.185 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:18.185 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:18.186 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:18.186 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:18.186 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:18.186 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:18.186 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:18.186 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:18.186 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:18.186 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:18.186 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:18.186 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.186 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.186 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.186 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.186 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:18.187 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:18.187 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.187 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:18.187 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.187 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:18.187 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:18.187 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:18.187 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.187 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:18.187 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:18.187 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.187 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.187 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:18.187 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:18.187 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.187 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.188 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:18.188 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:18.188 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:18.188 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:18.188 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:18.188 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.188 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.188 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:18.188 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:18.188 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:18.188 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.188 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:18.188 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.188 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:18.189 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.189 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:18.189 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.189 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:18.189 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.189 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:18.189 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:18.189 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:18.189 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:18.189 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.189 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:18.189 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.189 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:18.189 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:18.189 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:18.190 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:18.190 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:18.190 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:18.190 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:18.190 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:18.190 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:18.190 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:18.190 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:18.190 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:18.190 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:18.190 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:18.190 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:18.190 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:18.190 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:18.190 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:18.191 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:18.191 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:18.191 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:18.191 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:18.191 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:18.191 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:18.191 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:18.191 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:18.191 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:18.191 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:18.191 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:18.191 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:18.191 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:18.191 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:18.192 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:18.192 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:18.192 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:18.192 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:18.192 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:18.192 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:18.192 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:18.192 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:18.192 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.192 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.192 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.193 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:18.193 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.193 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:18.193 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.193 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:18.193 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:18.193 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:18.193 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:18.193 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:18.193 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:18.193 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.193 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:18.193 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:18.193 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:18.193 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:18.194 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:18.194 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:18.194 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.194 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:18.194 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:18.194 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:18.194 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:18.194 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:18.194 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:18.194 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:18.194 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:18.194 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:18.194 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:18.194 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:18.195 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.195 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.195 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:18.195 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:18.195 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:18.195 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:18.195 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:18.195 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.195 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.195 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:18.195 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:18.195 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:18.195 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:18.195 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:18.195 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.196 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:18.196 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:18.196 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:18.196 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:18.196 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:18.196 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:18.196 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.196 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:18.196 INFO:teuthology.orchestra.run.smithi003.stdout:__________ ERROR at teardown of test_block_public_object_canned_acls ___________ 2023-12-03T13:00:18.196 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.196 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.196 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.196 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:18.196 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:18.196 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.196 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:18.197 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.197 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:18.197 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:18.197 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:18.197 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.197 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:18.197 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:18.197 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.197 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.197 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:18.197 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:18.197 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.197 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.197 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:18.197 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.198 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:18.198 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:18.198 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.198 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.198 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:18.198 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:18.198 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.198 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:18.198 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:18.198 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:18.198 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:18.198 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:18.198 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.199 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:18.199 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.199 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:18.199 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:18.199 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:18.199 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:18.199 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:18.199 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:18.199 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:18.199 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:18.199 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.199 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.199 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:18.199 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:18.199 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:18.200 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:18.200 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.200 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:18.200 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:18.200 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:18.200 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:18.200 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.200 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.200 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:18.200 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:18.200 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:18.200 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:18.200 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.200 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.201 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:18.201 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:18.201 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:18.201 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.201 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:18.201 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.201 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:18.201 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:18.201 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.201 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:18.201 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:18.201 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:18.201 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:18.201 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:18.202 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:18.202 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.202 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:18.202 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.202 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:18.202 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.202 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.202 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:18.202 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.202 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:18.202 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.202 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:18.202 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:18.202 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:18.203 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:18.203 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:18.203 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:18.203 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.203 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:18.203 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:18.203 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:18.203 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:18.203 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:18.203 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:18.203 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.203 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:18.203 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:18.203 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:18.203 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:18.204 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:18.204 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:18.204 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:18.204 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:18.204 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:18.204 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:18.204 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:18.204 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.204 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.204 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:18.204 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.204 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:18.204 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:18.204 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:18.205 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:18.205 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:18.205 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:18.205 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:18.205 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:18.205 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:18.205 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:18.205 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:18.205 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:18.205 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:18.205 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:18.205 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:18.205 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:18.205 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:18.206 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:18.206 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:18.206 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:18.206 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:18.206 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:18.206 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:18.206 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:18.206 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:18.206 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:18.206 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:18.206 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:18.206 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.206 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.206 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.207 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.207 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:18.207 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:18.207 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.207 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:18.207 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.207 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:18.207 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:18.207 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:18.207 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.207 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:18.207 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:18.207 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.207 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.208 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:18.208 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:18.208 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.208 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.208 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:18.208 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:18.208 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:18.208 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:18.208 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:18.208 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.208 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.208 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:18.208 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:18.208 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:18.208 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.209 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:18.209 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.209 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:18.209 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.209 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:18.209 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.209 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:18.209 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.209 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:18.209 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:18.209 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:18.209 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:18.209 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.209 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:18.209 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.210 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:18.210 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:18.210 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:18.210 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:18.210 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:18.210 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:18.210 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:18.210 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:18.210 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:18.210 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:18.210 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:18.210 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:18.210 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:18.210 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:18.211 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:18.211 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:18.211 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:18.211 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:18.211 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:18.211 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:18.211 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:18.211 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:18.211 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:18.211 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:18.211 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:18.211 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:18.211 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:18.211 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:18.212 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:18.212 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:18.212 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:18.212 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:18.212 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:18.212 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:18.212 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:18.212 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:18.212 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:18.212 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:18.212 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:18.212 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:18.212 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.212 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.212 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.212 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:18.213 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.213 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:18.213 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.213 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:18.213 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:18.213 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:18.213 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:18.213 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:18.213 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:18.213 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.213 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:18.213 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:18.213 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:18.213 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:18.213 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:18.214 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:18.214 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.214 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:18.214 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:18.214 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:18.214 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:18.214 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:18.214 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:18.214 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:18.214 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:18.214 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:18.214 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:18.214 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:18.214 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.214 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.215 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:18.215 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:18.215 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:18.215 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:18.215 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:18.215 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.215 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.215 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:18.215 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:18.215 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:18.215 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:18.215 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:18.215 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.215 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:18.216 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:18.216 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:18.216 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:18.216 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:18.216 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:18.216 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.216 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:18.216 INFO:teuthology.orchestra.run.smithi003.stdout:________________ ERROR at teardown of test_block_public_policy _________________ 2023-12-03T13:00:18.216 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.216 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.216 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.216 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:18.216 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:18.216 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.217 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:18.217 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.217 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:18.217 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:18.217 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:18.217 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.217 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:18.217 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:18.217 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.217 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.217 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:18.217 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:18.217 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.217 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.217 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:18.218 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.218 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:18.218 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:18.218 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.218 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.218 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:18.218 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:18.218 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.218 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:18.218 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:18.218 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:18.218 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:18.218 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:18.218 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.219 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:18.219 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.219 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:18.219 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:18.219 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:18.219 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:18.219 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:18.219 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:18.219 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:18.219 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:18.219 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.219 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.219 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:18.219 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:18.220 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:18.220 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:18.220 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.220 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:18.220 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:18.220 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:18.220 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:18.220 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.220 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.220 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:18.220 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:18.220 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:18.220 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:18.221 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.221 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.221 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:18.221 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:18.221 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:18.221 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.221 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:18.221 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.221 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:18.221 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:18.221 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.221 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:18.221 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:18.221 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:18.222 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:18.222 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:18.222 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:18.222 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.222 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:18.222 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.222 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:18.222 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.222 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.222 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:18.222 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.222 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:18.222 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.222 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:18.223 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:18.223 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:18.223 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:18.223 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:18.223 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:18.223 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.223 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:18.223 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:18.223 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:18.223 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:18.223 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:18.223 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:18.223 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.223 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:18.223 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:18.224 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:18.224 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:18.224 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:18.224 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:18.224 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:18.224 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:18.224 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:18.224 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:18.224 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:18.224 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.224 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.224 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:18.224 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.224 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:18.224 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:18.225 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:18.225 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:18.225 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:18.225 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:18.225 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:18.225 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:18.225 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:18.225 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:18.225 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:18.225 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:18.225 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:18.225 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:18.225 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:18.225 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:18.226 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:18.226 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:18.226 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:18.226 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:18.226 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:18.226 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:18.226 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:18.226 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:18.226 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:18.226 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:18.226 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:18.226 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:18.226 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.226 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.227 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.227 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.227 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:18.227 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:18.227 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.227 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:18.227 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.227 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:18.227 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:18.227 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:18.227 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.227 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:18.227 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:18.227 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.228 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.228 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:18.228 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:18.228 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.228 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.228 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:18.228 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:18.228 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:18.228 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:18.228 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:18.228 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.228 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.228 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:18.228 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:18.228 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:18.229 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.229 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:18.229 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.229 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:18.229 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.229 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:18.229 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.229 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:18.229 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.229 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:18.229 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:18.229 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:18.230 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:18.230 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.230 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:18.230 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.230 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:18.230 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:18.230 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:18.230 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:18.230 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:18.230 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:18.230 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:18.230 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:18.230 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:18.231 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:18.231 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:18.231 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:18.231 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:18.231 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:18.231 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:18.231 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:18.231 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:18.231 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:18.231 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:18.231 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:18.231 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:18.231 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:18.231 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:18.231 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:18.232 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:18.232 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:18.232 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:18.232 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:18.232 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:18.232 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:18.232 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:18.232 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:18.232 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:18.232 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:18.232 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:18.232 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:18.232 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:18.232 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:18.233 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:18.233 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:18.233 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.233 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.233 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.233 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:18.233 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.233 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:18.233 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.233 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:18.233 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:18.233 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:18.233 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:18.233 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:18.234 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:18.234 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.234 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:18.234 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:18.234 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:18.234 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:18.234 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:18.234 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:18.234 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.234 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:18.234 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:18.234 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:18.234 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:18.235 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:18.235 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:18.235 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:18.235 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:18.235 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:18.235 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:18.235 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:18.235 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.235 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.235 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:18.235 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:18.235 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:18.235 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:18.235 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:18.235 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.236 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.236 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:18.236 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:18.236 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:18.236 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:18.236 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:18.236 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.236 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:18.236 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:18.236 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:18.236 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:18.236 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:18.236 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:18.236 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.237 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:18.237 INFO:teuthology.orchestra.run.smithi003.stdout:_________________ ERROR at teardown of test_ignore_public_acls _________________ 2023-12-03T13:00:18.237 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.237 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.237 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.237 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:18.237 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:18.237 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.237 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:18.237 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.237 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:18.237 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:18.237 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:18.237 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.237 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:18.238 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:18.238 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.238 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.238 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:18.238 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:18.238 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.238 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.238 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:18.238 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.238 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:18.238 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:18.238 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.238 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.238 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:18.238 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:18.239 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.239 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:18.239 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:18.239 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:18.239 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:18.239 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:18.239 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.239 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:18.239 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.239 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:18.239 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:18.239 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:18.239 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:18.239 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:18.240 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:18.240 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:18.240 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:18.240 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.240 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.240 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:18.240 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:18.240 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:18.240 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:18.240 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.240 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:18.240 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:18.240 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:18.240 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:18.241 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.241 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.241 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:18.241 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:18.241 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:18.241 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:18.241 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.241 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.241 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:18.241 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:18.241 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:18.241 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.241 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:18.241 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.242 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:18.242 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:18.242 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.242 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:18.242 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:18.242 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:18.242 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:18.242 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:18.242 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:18.242 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.242 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:18.242 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.243 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:18.243 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.243 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.243 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:18.243 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.243 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:18.243 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.243 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:18.243 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:18.243 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:18.243 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:18.243 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:18.243 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:18.243 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.244 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:18.244 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:18.244 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:18.244 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:18.244 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:18.244 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:18.244 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.244 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:18.244 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:18.244 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:18.244 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:18.244 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:18.244 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:18.244 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:18.244 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:18.245 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:18.245 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:18.245 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:18.245 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.245 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.245 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:18.245 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.245 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:18.245 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:18.245 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:18.245 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:18.245 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:18.245 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:18.245 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:18.245 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:18.246 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:18.246 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:18.246 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:18.246 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:18.246 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:18.246 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:18.246 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:18.246 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:18.246 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:18.246 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:18.246 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:18.246 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:18.246 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:18.246 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:18.246 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:18.247 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:18.247 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:18.247 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:18.247 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:18.247 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:18.247 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.247 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.247 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.247 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.247 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:18.247 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:18.247 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.247 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:18.247 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.247 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:18.248 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:18.248 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:18.248 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.248 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:18.248 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:18.248 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.248 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.248 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:18.248 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:18.248 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.248 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.248 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:18.248 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:18.248 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:18.248 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:18.249 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:18.249 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.249 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.249 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:18.249 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:18.249 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:18.249 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.249 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:18.249 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.249 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:18.249 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.249 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:18.249 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.249 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:18.249 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.250 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:18.250 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:18.250 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:18.250 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:18.250 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.250 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:18.250 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.250 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:18.250 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:18.250 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:18.250 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:18.250 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:18.250 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:18.250 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:18.251 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:18.251 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:18.251 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:18.251 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:18.251 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:18.251 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:18.251 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:18.251 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:18.251 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:18.251 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:18.251 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:18.251 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:18.251 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:18.252 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:18.252 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:18.252 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:18.252 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:18.252 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:18.252 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:18.252 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:18.252 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:18.252 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:18.252 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:18.252 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:18.252 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:18.252 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:18.252 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:18.252 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:18.253 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:18.253 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:18.253 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:18.253 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:18.253 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:18.253 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.253 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.253 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.253 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:18.253 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.253 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:18.253 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.253 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:18.254 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:18.254 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:18.254 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:18.254 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:18.254 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:18.254 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.254 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:18.254 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:18.254 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:18.254 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:18.254 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:18.254 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:18.254 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.254 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:18.255 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:18.255 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:18.255 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:18.255 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:18.255 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:18.255 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:18.255 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:18.255 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:18.255 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:18.255 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:18.255 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.255 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.255 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:18.255 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:18.255 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:18.256 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:18.256 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:18.256 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.256 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.256 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:18.256 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:18.256 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:18.256 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:18.256 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:18.256 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.256 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:18.256 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:18.256 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:18.256 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:18.256 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:18.256 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:18.257 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.257 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:18.257 INFO:teuthology.orchestra.run.smithi003.stdout:______ ERROR at teardown of test_multipart_upload_on_a_bucket_with_policy ______ 2023-12-03T13:00:18.257 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.257 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.257 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.257 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:18.257 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:18.257 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.257 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:18.257 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.257 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:18.257 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:18.257 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:18.257 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.258 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:18.258 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:18.258 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.258 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.258 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:18.258 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:18.258 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.258 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.258 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:18.258 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.258 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:18.258 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:18.258 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.259 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.259 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:18.259 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:18.259 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.259 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:18.259 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:18.259 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:18.259 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:18.259 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:18.259 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.259 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:18.259 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.259 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:18.259 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:18.260 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:18.260 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:18.260 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:18.260 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:18.260 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:18.260 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:18.260 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.260 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.260 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:18.260 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:18.260 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:18.260 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:18.260 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.260 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:18.260 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:18.261 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:18.261 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:18.261 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.261 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.261 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:18.261 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:18.261 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:18.261 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:18.261 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.261 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.261 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:18.261 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:18.261 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:18.262 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.262 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:18.262 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.262 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:18.262 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:18.262 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.262 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:18.262 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:18.262 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:18.262 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:18.262 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:18.262 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:18.262 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.262 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:18.262 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.263 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:18.263 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.263 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.263 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:18.263 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.263 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:18.263 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.263 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:18.263 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:18.263 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:18.263 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:18.263 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:18.263 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:18.264 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.264 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:18.264 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:18.264 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:18.264 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:18.264 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:18.264 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:18.264 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.264 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:18.264 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:18.264 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:18.264 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:18.264 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:18.264 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:18.264 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:18.265 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:18.265 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:18.265 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:18.265 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:18.265 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.265 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.265 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:18.265 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.265 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:18.265 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:18.265 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:18.265 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:18.265 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:18.265 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:18.266 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:18.266 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:18.266 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:18.266 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:18.266 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:18.266 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:18.266 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:18.266 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:18.266 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:18.266 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:18.266 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:18.266 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:18.266 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:18.266 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:18.267 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:18.267 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:18.267 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:18.267 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:18.267 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:18.267 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:18.267 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:18.267 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:18.267 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.267 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.267 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.267 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.267 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:18.267 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:18.267 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.268 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:18.268 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.268 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:18.268 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:18.268 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:18.268 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.268 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:18.268 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:18.268 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.268 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.268 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:18.268 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:18.268 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.268 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.268 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:18.269 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:18.269 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:18.269 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:18.269 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:18.269 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.269 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.269 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:18.269 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:18.269 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:18.269 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.269 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:18.269 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.269 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:18.269 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.269 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:18.270 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.270 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:18.270 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.270 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:18.270 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:18.270 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:18.270 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:18.270 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.270 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:18.270 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.270 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:18.270 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:18.271 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:18.271 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:18.271 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:18.271 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:18.271 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:18.271 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:18.271 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:18.271 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:18.271 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:18.271 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:18.271 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:18.271 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:18.271 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:18.271 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:18.272 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:18.272 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:18.272 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:18.272 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:18.272 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:18.272 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:18.272 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:18.272 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:18.272 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:18.272 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:18.272 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:18.272 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:18.272 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:18.272 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:18.272 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:18.273 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:18.273 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:18.273 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:18.273 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:18.273 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:18.273 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:18.273 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:18.273 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:18.273 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:18.273 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.273 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.273 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.273 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:18.273 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.273 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:18.274 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.274 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:18.274 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:18.274 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:18.274 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:18.274 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:18.274 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:18.274 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.274 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:18.274 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:18.274 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:18.274 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:18.274 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:18.274 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:18.275 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.275 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:18.275 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:18.275 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:18.275 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:18.275 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:18.275 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:18.275 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:18.275 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:18.275 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:18.275 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:18.275 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:18.275 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.275 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.275 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:18.276 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:18.276 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:18.276 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:18.276 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:18.276 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.276 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.276 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:18.276 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:18.276 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:18.276 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:18.276 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:18.276 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.276 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:18.276 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:18.276 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:18.277 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:18.277 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:18.277 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:18.277 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.277 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:18.277 INFO:teuthology.orchestra.run.smithi003.stdout:_____________ ERROR at teardown of test_put_bucket_encryption_kms ______________ 2023-12-03T13:00:18.277 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.277 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.277 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.277 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:18.277 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:18.277 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.277 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:18.278 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.278 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:18.278 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:18.278 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:18.278 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.278 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:18.278 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:18.278 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.278 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.278 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:18.278 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:18.278 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.278 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.278 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:18.279 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.279 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:18.279 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:18.279 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.279 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.279 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:18.279 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:18.279 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.279 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:18.279 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:18.279 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:18.279 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:18.279 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:18.279 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.280 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:18.280 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.280 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:18.280 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:18.280 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:18.280 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:18.280 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:18.280 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:18.280 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:18.280 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:18.280 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.280 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.280 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:18.280 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:18.280 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:18.281 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:18.281 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.281 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:18.281 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:18.281 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:18.281 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:18.281 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.281 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.281 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:18.281 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:18.281 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:18.281 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:18.281 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.282 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.282 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:18.282 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:18.282 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:18.282 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.282 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:18.282 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.282 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:18.282 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:18.282 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.282 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:18.282 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:18.282 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:18.282 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:18.283 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:18.283 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:18.283 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.283 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:18.283 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.283 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:18.283 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.283 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.283 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:18.283 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.283 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:18.283 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.283 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:18.283 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:18.283 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:18.284 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:18.284 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:18.284 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:18.284 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.284 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:18.284 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:18.284 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:18.284 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:18.284 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:18.284 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:18.284 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.284 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:18.284 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:18.284 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:18.284 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:18.285 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:18.285 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:18.285 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:18.285 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:18.285 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:18.285 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:18.285 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:18.285 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.285 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.285 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:18.285 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.285 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:18.285 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:18.285 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:18.285 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:18.286 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:18.286 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:18.286 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:18.286 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:18.286 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:18.286 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:18.286 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:18.286 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:18.286 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:18.286 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:18.286 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:18.286 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:18.286 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:18.286 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:18.286 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:18.287 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:18.287 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:18.287 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:18.287 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:18.287 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:18.287 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:18.287 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:18.287 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:18.287 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:18.287 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.287 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.287 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.287 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.287 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:18.288 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:18.288 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.288 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:18.288 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.288 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:18.288 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:18.288 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:18.288 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.288 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:18.288 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:18.288 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.288 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.288 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:18.288 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:18.289 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.289 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.289 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:18.289 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:18.289 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:18.289 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:18.289 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:18.289 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.289 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.289 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:18.289 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:18.289 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:18.289 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.289 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:18.290 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.290 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:18.290 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.290 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:18.290 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.290 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:18.290 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.290 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:18.290 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:18.290 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:18.290 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:18.290 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.290 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:18.291 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.291 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:18.291 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:18.291 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:18.291 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:18.291 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:18.291 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:18.291 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:18.291 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:18.291 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:18.291 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:18.291 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:18.291 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:18.291 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:18.292 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:18.292 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:18.292 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:18.292 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:18.292 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:18.292 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:18.292 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:18.292 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:18.292 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:18.292 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:18.292 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:18.292 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:18.292 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:18.292 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:18.292 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:18.293 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:18.293 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:18.293 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:18.293 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:18.293 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:18.293 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:18.293 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:18.293 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:18.293 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:18.293 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:18.293 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:18.293 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:18.293 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.293 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.294 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.294 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:18.294 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.294 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:18.294 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.294 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:18.294 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:18.294 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:18.294 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:18.294 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:18.294 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:18.294 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.294 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:18.294 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:18.295 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:18.295 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:18.295 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:18.295 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:18.295 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.295 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:18.295 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:18.295 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:18.295 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:18.295 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:18.295 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:18.295 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:18.295 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:18.295 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:18.295 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:18.296 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:18.296 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.296 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.296 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:18.296 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:18.296 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:18.296 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:18.296 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:18.296 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.296 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.296 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:18.296 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:18.296 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:18.296 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:18.296 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:18.297 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.297 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:18.297 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:18.297 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:18.297 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:18.297 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:18.297 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:18.297 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.297 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:18.297 INFO:teuthology.orchestra.run.smithi003.stdout:_____________ ERROR at teardown of test_get_bucket_encryption_kms ______________ 2023-12-03T13:00:18.297 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.297 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.297 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.297 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:18.297 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:18.298 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.298 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:18.298 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.298 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:18.298 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:18.298 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:18.298 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.298 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:18.298 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:18.298 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.298 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.298 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:18.298 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:18.298 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.299 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.299 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:18.299 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.299 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:18.299 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:18.299 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.299 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.299 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:18.299 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:18.299 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.299 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:18.299 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:18.299 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:18.299 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:18.300 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:18.300 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.300 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:18.300 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.300 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:18.300 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:18.300 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:18.300 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:18.300 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:18.300 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:18.300 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:18.300 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:18.300 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.300 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.301 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:18.301 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:18.301 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:18.301 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:18.301 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.301 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:18.301 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:18.301 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:18.301 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:18.301 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.301 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.301 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:18.301 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:18.301 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:18.302 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:18.302 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.302 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.302 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:18.302 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:18.302 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:18.302 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.302 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:18.302 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.302 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:18.303 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:18.303 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.303 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:18.303 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:18.303 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:18.303 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:18.303 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:18.303 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:18.303 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.303 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:18.303 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.304 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:18.304 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.304 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.304 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:18.304 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.304 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:18.304 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.304 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:18.304 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:18.304 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:18.304 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:18.304 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:18.304 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:18.304 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.305 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:18.305 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:18.305 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:18.305 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:18.305 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:18.305 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:18.305 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.305 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:18.305 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:18.305 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:18.305 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:18.305 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:18.305 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:18.306 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:18.306 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:18.306 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:18.306 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:18.306 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:18.306 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.306 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.306 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:18.306 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.306 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:18.306 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:18.306 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:18.306 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:18.306 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:18.307 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:18.307 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:18.307 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:18.307 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:18.307 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:18.307 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:18.307 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:18.307 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:18.307 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:18.307 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:18.307 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:18.307 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:18.307 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:18.308 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:18.308 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:18.308 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:18.308 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:18.308 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:18.308 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:18.308 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:18.308 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:18.308 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:18.308 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:18.308 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.308 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.308 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.309 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.309 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:18.309 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:18.309 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.309 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:18.309 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.309 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:18.309 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:18.309 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:18.309 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.309 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:18.309 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:18.310 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.310 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.310 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:18.310 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:18.310 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.310 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.310 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:18.310 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:18.310 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:18.310 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:18.310 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:18.310 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.310 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.311 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:18.311 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:18.311 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:18.311 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.311 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:18.311 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.311 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:18.311 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.311 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:18.311 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.311 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:18.311 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.311 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:18.311 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:18.311 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:18.312 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:18.312 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.312 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:18.312 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.312 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:18.312 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:18.312 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:18.312 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:18.312 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:18.312 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:18.312 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:18.312 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:18.312 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:18.313 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:18.313 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:18.313 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:18.313 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:18.313 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:18.313 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:18.313 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:18.313 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:18.313 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:18.313 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:18.313 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:18.313 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:18.313 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:18.314 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:18.314 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:18.314 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:18.314 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:18.314 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:18.314 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:18.314 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:18.314 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:18.314 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:18.314 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:18.314 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:18.314 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:18.314 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:18.315 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:18.315 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:18.315 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:18.315 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:18.315 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:18.315 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.315 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.315 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.315 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:18.315 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.315 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:18.315 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.316 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:18.316 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:18.316 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:18.316 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:18.316 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:18.316 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:18.316 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.316 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:18.316 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:18.316 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:18.316 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:18.316 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:18.316 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:18.316 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.317 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:18.317 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:18.317 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:18.317 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:18.317 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:18.317 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:18.317 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:18.317 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:18.317 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:18.317 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:18.317 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:18.317 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.317 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.317 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:18.317 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:18.318 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:18.318 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:18.318 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:18.318 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.318 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.318 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:18.318 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:18.318 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:18.318 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:18.318 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:18.318 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.318 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:18.318 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:18.318 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:18.319 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:18.319 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:18.319 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:18.319 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.319 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:18.319 INFO:teuthology.orchestra.run.smithi003.stdout:____________ ERROR at teardown of test_delete_bucket_encryption_kms ____________ 2023-12-03T13:00:18.319 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.319 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.319 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.319 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:18.319 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:18.319 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.319 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:18.319 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.319 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:18.320 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:18.320 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:18.320 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.320 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:18.320 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:18.320 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.320 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.320 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:18.320 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:18.320 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.320 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.320 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:18.320 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.320 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:18.321 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:18.321 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.321 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.321 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:18.321 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:18.321 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.321 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:18.321 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:18.321 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:18.321 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:18.321 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:18.321 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.321 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:18.322 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.322 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:18.322 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:18.322 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:18.322 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:18.322 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:18.322 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:18.322 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:18.322 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:18.322 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.322 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.322 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:18.322 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:18.322 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:18.322 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:18.323 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.323 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:18.323 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:18.323 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:18.323 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:18.323 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.323 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.323 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:18.323 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:18.323 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:18.323 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:18.323 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.323 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.323 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:18.324 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:18.324 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:18.324 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.324 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:18.324 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.324 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:18.324 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:18.324 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.324 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:18.324 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:18.324 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:18.324 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:18.324 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:18.324 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:18.325 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.325 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:18.325 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.325 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:18.325 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.325 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.325 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:18.325 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.325 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:18.325 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.325 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:18.325 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:18.325 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:18.325 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:18.325 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:18.326 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:18.326 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.326 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:18.326 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:18.326 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:18.326 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:18.326 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:18.326 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:18.326 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.326 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:18.326 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:18.326 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:18.326 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:18.326 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:18.327 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:18.327 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:18.327 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:18.327 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:18.327 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:18.327 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:18.327 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.327 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.327 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:18.327 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.327 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:18.327 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:18.327 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:18.327 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:18.328 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:18.328 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:18.328 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:18.328 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:18.328 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:18.328 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:18.328 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:18.328 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:18.328 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:18.328 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:18.328 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:18.328 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:18.328 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:18.329 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:18.329 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:18.329 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:18.329 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:18.329 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:18.329 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:18.329 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:18.329 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:18.329 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:18.329 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:18.329 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:18.329 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.329 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.329 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.330 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.330 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:18.330 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:18.330 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.330 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:18.330 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.330 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:18.330 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:18.330 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:18.330 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.330 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:18.330 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:18.330 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.330 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.331 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:18.331 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:18.331 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.331 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.331 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:18.331 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:18.331 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:18.331 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:18.331 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:18.331 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.331 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.331 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:18.331 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:18.331 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:18.331 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.332 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:18.332 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.332 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:18.332 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.332 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:18.332 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.332 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:18.332 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.332 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:18.332 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:18.332 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:18.332 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:18.332 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.332 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:18.333 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.333 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:18.333 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:18.333 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:18.333 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:18.333 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:18.333 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:18.333 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:18.333 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:18.333 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:18.333 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:18.333 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:18.333 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:18.333 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:18.334 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:18.334 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:18.334 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:18.334 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:18.334 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:18.334 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:18.334 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:18.334 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:18.334 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:18.334 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:18.334 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:18.334 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:18.334 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:18.334 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:18.335 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:18.335 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:18.335 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:18.335 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:18.335 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:18.335 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:18.335 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:18.335 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:18.335 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:18.335 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:18.335 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:18.335 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:18.335 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:18.335 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.335 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.336 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.336 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:18.336 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.336 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:18.336 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.336 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:18.336 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:18.336 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:18.336 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:18.336 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:18.336 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:18.336 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.336 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:18.336 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:18.337 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:18.337 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:18.337 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:18.337 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:18.337 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.337 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:18.337 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:18.337 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:18.337 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:18.337 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:18.337 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:18.337 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:18.337 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:18.338 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:18.338 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:18.338 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:18.338 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.338 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.338 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:18.338 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:18.338 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:18.338 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:18.338 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:18.338 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.338 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.338 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:18.338 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:18.339 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:18.339 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:18.339 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:18.339 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.339 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:18.339 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:18.339 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:18.339 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:18.339 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:18.339 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:18.339 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.339 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:18.339 INFO:teuthology.orchestra.run.smithi003.stdout:_ ERROR at teardown of test_sse_kms_default_post_object_authenticated_request __ 2023-12-03T13:00:18.339 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.339 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.340 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.340 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:18.340 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:18.340 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.340 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:18.340 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.340 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:18.340 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:18.340 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:18.340 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.340 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:18.340 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:18.340 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.341 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.341 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:18.341 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:18.341 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.341 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.341 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:18.341 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.341 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:18.341 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:18.341 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.341 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.341 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:18.341 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:18.341 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.342 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:18.342 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:18.342 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:18.342 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:18.342 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:18.342 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.342 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:18.342 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.342 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:18.342 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:18.342 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:18.342 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:18.342 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:18.343 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:18.343 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:18.343 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:18.343 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.343 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.343 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:18.343 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:18.343 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:18.343 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:18.343 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.343 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:18.343 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:18.343 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:18.344 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:18.344 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.344 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.344 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:18.344 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:18.344 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:18.344 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:18.344 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.344 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.344 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:18.344 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:18.344 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:18.344 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.344 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:18.344 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.345 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:18.345 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:18.345 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.345 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:18.345 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:18.345 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:18.345 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:18.345 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:18.345 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:18.345 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.345 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:18.345 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.345 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:18.345 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.345 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.346 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:18.346 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.346 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:18.346 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.346 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:18.346 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:18.346 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:18.346 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:18.346 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:18.346 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:18.346 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.346 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:18.346 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:18.346 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:18.347 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:18.347 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:18.347 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:18.347 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.347 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:18.347 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:18.347 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:18.347 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:18.347 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:18.347 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:18.347 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:18.347 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:18.347 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:18.347 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:18.348 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:18.348 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.348 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.348 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:18.348 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.348 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:18.348 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:18.348 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:18.348 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:18.348 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:18.348 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:18.348 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:18.348 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:18.348 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:18.349 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:18.349 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:18.349 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:18.349 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:18.349 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:18.349 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:18.349 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:18.349 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:18.349 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:18.349 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:18.349 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:18.349 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:18.349 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:18.349 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:18.349 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:18.349 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:18.350 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:18.350 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:18.350 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:18.350 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.350 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.350 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.350 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.350 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:18.350 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:18.350 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.350 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:18.350 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.350 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:18.350 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:18.351 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:18.351 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.351 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:18.351 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:18.351 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.351 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.351 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:18.351 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:18.351 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.351 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.351 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:18.351 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:18.351 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:18.351 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:18.352 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:18.352 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.352 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.352 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:18.352 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:18.352 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:18.352 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.352 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:18.352 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.352 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:18.352 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.352 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:18.352 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.352 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:18.352 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.352 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:18.353 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:18.353 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:18.353 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:18.353 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.353 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:18.353 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.353 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:18.353 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:18.353 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:18.353 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:18.353 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:18.353 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:18.354 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:18.354 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:18.354 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:18.354 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:18.354 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:18.354 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:18.354 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:18.354 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:18.354 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:18.354 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:18.354 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:18.354 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:18.354 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:18.354 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:18.355 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:18.355 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:18.355 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:18.355 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:18.355 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:18.355 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:18.355 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:18.355 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:18.355 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:18.355 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:18.355 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:18.355 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:18.355 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:18.355 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:18.355 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:18.356 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:18.356 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:18.356 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:18.356 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:18.356 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:18.356 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.356 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.356 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.356 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:18.356 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.356 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:18.356 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.356 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:18.356 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:18.357 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:18.357 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:18.357 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:18.357 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:18.357 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.357 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:18.357 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:18.357 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:18.357 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:18.357 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:18.357 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:18.357 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.357 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:18.357 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:18.358 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:18.358 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:18.358 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:18.358 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:18.358 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:18.358 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:18.358 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:18.358 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:18.358 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:18.358 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.358 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.358 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:18.358 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:18.358 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:18.358 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:18.359 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:18.359 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.359 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.359 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:18.359 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:18.359 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:18.359 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:18.359 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:18.359 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.359 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:18.359 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:18.359 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:18.359 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:18.359 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:18.360 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:18.360 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.360 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:18.360 INFO:teuthology.orchestra.run.smithi003.stdout:_________________ ERROR at teardown of test_get_object_torrent _________________ 2023-12-03T13:00:18.360 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.360 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.360 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.360 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:18.360 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:18.360 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.360 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:18.360 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.360 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:18.360 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:18.361 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:18.361 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.361 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:18.361 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:18.361 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.361 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.361 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:18.361 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:18.361 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.361 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.361 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:18.361 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.361 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:18.361 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:18.361 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.362 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.362 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:18.362 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:18.362 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.362 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:18.362 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:18.362 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:18.362 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:18.362 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:18.362 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.362 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:18.362 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.362 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:18.362 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:18.363 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:18.363 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:18.363 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:18.363 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:18.363 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:18.363 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:18.363 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.363 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.363 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:18.363 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:18.363 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:18.363 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:18.363 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.363 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:18.363 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:18.364 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:18.364 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:18.364 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.364 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.364 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:18.364 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:18.364 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:18.364 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:18.364 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.364 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.364 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:18.364 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:18.364 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:18.364 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.364 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:18.365 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.365 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:18.365 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:18.365 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.365 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:18.365 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:18.365 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:18.365 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:18.365 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:18.365 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:18.365 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.365 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:18.365 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.366 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:18.366 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.366 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.366 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:18.366 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.366 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:18.366 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.366 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:18.366 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:18.366 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:18.366 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:18.366 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:18.366 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:18.366 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.367 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:18.367 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:18.367 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:18.367 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:18.367 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:18.367 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:18.367 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.367 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:18.367 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:18.367 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:18.367 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:18.367 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:18.367 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:18.367 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:18.368 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:18.368 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:18.368 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:18.368 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:18.368 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.368 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.368 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:18.368 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.368 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:18.368 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:18.368 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:18.368 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:18.368 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:18.368 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:18.368 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:18.369 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:18.369 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:18.369 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:18.369 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:18.369 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:18.369 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:18.369 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:18.369 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:18.369 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:18.369 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:18.369 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:18.369 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:18.369 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:18.369 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:18.369 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:18.370 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:18.370 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:18.370 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:18.370 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:18.370 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:18.370 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:18.370 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.370 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.370 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.370 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.370 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:18.370 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:18.370 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.370 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:18.371 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.371 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:18.371 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:18.371 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:18.371 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.371 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:18.371 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:18.371 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.371 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.371 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:18.371 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:18.371 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.371 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.371 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:18.371 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:18.372 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:18.372 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:18.372 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:18.372 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.372 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.372 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:18.372 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:18.372 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:18.372 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.372 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:18.372 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.372 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:18.372 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.373 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:18.373 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.373 INFO:teuthology.orchestra.run.smithi003.stdout:configfile = 2023-12-03T13:00:18.373 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.373 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(autouse=True) 2023-12-03T13:00:18.373 INFO:teuthology.orchestra.run.smithi003.stdout: def setup_teardown(configfile): 2023-12-03T13:00:18.373 INFO:teuthology.orchestra.run.smithi003.stdout: yield 2023-12-03T13:00:18.373 INFO:teuthology.orchestra.run.smithi003.stdout:> teardown() 2023-12-03T13:00:18.373 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.373 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T13:00:18.373 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.373 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T13:00:18.373 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:18.373 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:18.373 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:18.374 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:18.374 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:18.374 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:18.374 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:18.374 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:18.374 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:18.374 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:18.374 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:18.374 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:18.374 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:18.374 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:18.374 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:18.374 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:18.375 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:18.375 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:18.375 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:18.375 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:18.375 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:18.375 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:18.375 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:18.375 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:18.375 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:18.375 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:18.375 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:18.375 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:18.375 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:18.375 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:18.376 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:18.376 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:18.376 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:18.376 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:18.376 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:18.376 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:18.376 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:18.376 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:18.376 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:18.376 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.376 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.376 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.376 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:18.377 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.377 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:18.377 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.377 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:18.377 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:18.377 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:18.377 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:18.377 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:18.377 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:18.377 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.377 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:18.377 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:18.377 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:18.377 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:18.378 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:18.378 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:18.378 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.378 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:18.378 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:18.378 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:18.378 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:18.378 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:18.378 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:18.378 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:18.378 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:18.378 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:18.378 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:18.378 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:18.379 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.379 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.379 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:18.379 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:18.379 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:18.379 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:18.379 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:18.379 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.379 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.379 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:18.379 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:18.379 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:18.380 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:18.380 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:18.380 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.380 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:18.380 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:18.380 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:18.380 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:18.380 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:18.380 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:18.380 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.380 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:18.380 INFO:teuthology.orchestra.run.smithi003.stdout:_________________ ERROR at setup of test_generate_where_clause _________________ 2023-12-03T13:00:18.380 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.380 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.381 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.381 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:18.381 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:18.381 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.381 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:18.381 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.381 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:18.381 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:18.381 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:18.381 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.381 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:18.381 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:18.381 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.381 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.381 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:18.382 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:18.382 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.382 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.382 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:18.382 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.382 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:18.382 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:18.382 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.382 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.382 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:18.382 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:18.382 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.382 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:18.382 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:18.383 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:18.383 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:18.383 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:18.383 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.383 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:18.383 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.383 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:18.383 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:18.383 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:18.383 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:18.383 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:18.383 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:18.383 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:18.383 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:18.383 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.384 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.384 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:18.384 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:18.384 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:18.384 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:18.384 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.384 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:18.384 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:18.384 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:18.384 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:18.384 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.384 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.384 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:18.384 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:18.384 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:18.385 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:18.385 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.385 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.385 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:18.385 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:18.385 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:18.385 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.385 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:18.385 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.385 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:18.385 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:18.385 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.385 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:18.385 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:18.386 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:18.386 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:18.386 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:18.386 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:18.386 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.386 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:18.386 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.386 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:18.386 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.386 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.386 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:18.386 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.386 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:18.386 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.386 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:18.387 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:18.387 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:18.387 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:18.387 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:18.387 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:18.387 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.387 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:18.387 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:18.387 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:18.387 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:18.387 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:18.387 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:18.387 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.387 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:18.388 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:18.388 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:18.388 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:18.388 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:18.388 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:18.388 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:18.388 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:18.388 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:18.388 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:18.388 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:18.388 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.388 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.388 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:18.388 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.388 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:18.389 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:18.389 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:18.389 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:18.389 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:18.389 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:18.389 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:18.389 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:18.389 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:18.389 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:18.389 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:18.389 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:18.389 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:18.390 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:18.390 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:18.390 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:18.390 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:18.390 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:18.390 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:18.390 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:18.390 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:18.390 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:18.390 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:18.390 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:18.390 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:18.390 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:18.390 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:18.391 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:18.391 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.391 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.391 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.391 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.391 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:18.391 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:18.391 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.391 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:18.391 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.391 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:18.391 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:18.391 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:18.391 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.392 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:18.392 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:18.392 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.392 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.392 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:18.392 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:18.392 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.392 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.392 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:18.392 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:18.392 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:18.392 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:18.392 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:18.392 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.393 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.393 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:18.393 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:18.393 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:18.393 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.393 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:18.393 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.393 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:18.393 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.393 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:18.393 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.393 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(scope="package") 2023-12-03T13:00:18.393 INFO:teuthology.orchestra.run.smithi003.stdout: def configfile(): 2023-12-03T13:00:18.393 INFO:teuthology.orchestra.run.smithi003.stdout:> setup() 2023-12-03T13:00:18.394 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.394 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:309: 2023-12-03T13:00:18.394 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.394 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:272: in setup 2023-12-03T13:00:18.394 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:18.394 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:18.394 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:18.394 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:18.394 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:18.394 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:18.394 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:18.394 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:18.394 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:18.394 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:18.394 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:18.395 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:18.395 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:18.395 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:18.395 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:18.395 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:18.395 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:18.395 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:18.395 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:18.395 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:18.395 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:18.395 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:18.395 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:18.395 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:18.395 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:18.395 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:18.396 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:18.396 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:18.396 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:18.396 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:18.396 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:18.396 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:18.396 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:18.396 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:18.396 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:18.396 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:18.396 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:18.396 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:18.396 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:18.396 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.396 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.397 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.397 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:18.397 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.397 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:18.397 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.397 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:18.397 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:18.397 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:18.397 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:18.397 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:18.397 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:18.397 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.397 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:18.397 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:18.397 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:18.398 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:18.398 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:18.398 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:18.398 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.398 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:18.398 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:18.398 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:18.398 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:18.398 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:18.398 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:18.398 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:18.398 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:18.398 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:18.399 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:18.399 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:18.399 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.399 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.399 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:18.399 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:18.399 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:18.399 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:18.399 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:18.399 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.399 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.399 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:18.399 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:18.399 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:18.399 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:18.400 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:18.400 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.400 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:18.400 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:18.400 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:18.400 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:18.400 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:18.400 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:18.400 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.400 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:18.400 INFO:teuthology.orchestra.run.smithi003.stdout:__________________ ERROR at setup of test_generate_projection __________________ 2023-12-03T13:00:18.400 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.400 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.400 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.401 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:18.401 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:18.401 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.401 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:18.401 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.401 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:18.401 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:18.401 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:18.401 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.401 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:18.401 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:18.401 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.401 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.402 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:18.402 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:18.402 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.402 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.402 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:18.402 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.402 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:18.402 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:18.402 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.402 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.402 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:18.402 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:18.402 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.403 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:18.403 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:18.403 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:18.403 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:18.403 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:18.403 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.403 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:18.403 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.403 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:18.403 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:18.403 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:18.403 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:18.403 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:18.403 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:18.404 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:18.404 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:18.404 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.404 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.404 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:18.404 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:18.404 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:18.404 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:18.404 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.404 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:18.404 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:18.404 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:18.404 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:18.405 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.405 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.405 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:18.405 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:18.405 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:18.405 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:18.405 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.405 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.405 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:18.405 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:18.405 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:18.405 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.405 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:18.405 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.405 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:18.406 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:18.406 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.406 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:18.406 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:18.406 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:18.406 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:18.406 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:18.406 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:18.406 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.406 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:18.406 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.406 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:18.406 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.406 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.407 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:18.407 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.407 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:18.407 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.407 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:18.407 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:18.407 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:18.407 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:18.407 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:18.407 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:18.407 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.407 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:18.407 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:18.407 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:18.407 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:18.408 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:18.408 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:18.408 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.408 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:18.408 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:18.408 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:18.408 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:18.408 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:18.408 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:18.408 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:18.408 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:18.408 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:18.408 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:18.408 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:18.409 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.409 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.409 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:18.409 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.409 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:18.409 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:18.409 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:18.409 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:18.409 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:18.409 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:18.409 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:18.409 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:18.409 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:18.409 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:18.409 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:18.410 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:18.410 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:18.410 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:18.410 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:18.410 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:18.410 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:18.410 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:18.410 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:18.410 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:18.410 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:18.410 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:18.410 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:18.410 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:18.411 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:18.411 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:18.411 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:18.411 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:18.411 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.411 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.411 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.411 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.411 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:18.411 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:18.411 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.411 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:18.411 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.412 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:18.412 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:18.412 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:18.412 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.412 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:18.412 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:18.412 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.412 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.412 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:18.412 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:18.412 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.412 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.412 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:18.412 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:18.412 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:18.413 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:18.413 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:18.413 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.413 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.413 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:18.413 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:18.413 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:18.413 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.413 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:18.413 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.413 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:18.413 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.413 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:18.413 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.413 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(scope="package") 2023-12-03T13:00:18.414 INFO:teuthology.orchestra.run.smithi003.stdout: def configfile(): 2023-12-03T13:00:18.414 INFO:teuthology.orchestra.run.smithi003.stdout:> setup() 2023-12-03T13:00:18.414 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.414 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:309: 2023-12-03T13:00:18.414 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.414 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:272: in setup 2023-12-03T13:00:18.414 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:18.414 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:18.414 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:18.414 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:18.414 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:18.414 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:18.414 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:18.415 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:18.415 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:18.415 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:18.415 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:18.415 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:18.415 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:18.415 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:18.415 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:18.415 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:18.415 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:18.415 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:18.415 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:18.415 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:18.415 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:18.416 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:18.416 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:18.416 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:18.416 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:18.416 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:18.416 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:18.416 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:18.416 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:18.416 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:18.416 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:18.416 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:18.416 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:18.416 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:18.416 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:18.417 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:18.417 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:18.417 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:18.417 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:18.417 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.417 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.417 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.417 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:18.417 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.417 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:18.417 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.417 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:18.417 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:18.417 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:18.417 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:18.418 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:18.418 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:18.418 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.418 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:18.418 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:18.418 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:18.418 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:18.418 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:18.418 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:18.418 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.418 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:18.418 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:18.418 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:18.418 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:18.419 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:18.419 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:18.419 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:18.419 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:18.419 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:18.419 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:18.419 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:18.419 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.419 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.419 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:18.419 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:18.419 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:18.419 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:18.419 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:18.420 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.420 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.420 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:18.420 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:18.420 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:18.420 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:18.420 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:18.420 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.420 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:18.420 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:18.420 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:18.420 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:18.420 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:18.420 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:18.420 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.421 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:18.421 INFO:teuthology.orchestra.run.smithi003.stdout:____________________ ERROR at setup of test_count_operation ____________________ 2023-12-03T13:00:18.421 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.421 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.421 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.421 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:18.421 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:18.421 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.421 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:18.421 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.421 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:18.421 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:18.421 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:18.421 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.422 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:18.422 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:18.422 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.422 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.422 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:18.422 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:18.422 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.422 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.422 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:18.422 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.422 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:18.422 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:18.422 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.422 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.423 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:18.423 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:18.423 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.423 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:18.423 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:18.423 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:18.423 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:18.423 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:18.423 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.423 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:18.423 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.423 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:18.423 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:18.423 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:18.423 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:18.424 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:18.424 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:18.424 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:18.424 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:18.424 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.424 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.424 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:18.424 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:18.424 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:18.424 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:18.424 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.424 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:18.424 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:18.424 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:18.425 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:18.425 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.425 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.425 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:18.425 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:18.425 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:18.425 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:18.425 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.425 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.425 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:18.425 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:18.425 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:18.425 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.425 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:18.425 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.426 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:18.426 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:18.426 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.426 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:18.426 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:18.426 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:18.426 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:18.426 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:18.426 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:18.426 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.426 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:18.426 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.426 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:18.427 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.427 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.427 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:18.427 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.427 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:18.427 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.427 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:18.427 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:18.427 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:18.427 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:18.427 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:18.427 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:18.427 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.427 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:18.428 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:18.428 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:18.428 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:18.428 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:18.428 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:18.428 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.428 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:18.428 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:18.428 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:18.428 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:18.428 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:18.428 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:18.428 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:18.428 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:18.428 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:18.429 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:18.429 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:18.429 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.429 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.429 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:18.429 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.429 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:18.429 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:18.429 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:18.429 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:18.429 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:18.429 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:18.429 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:18.429 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:18.430 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:18.430 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:18.430 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:18.430 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:18.430 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:18.430 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:18.430 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:18.430 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:18.430 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:18.430 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:18.430 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:18.430 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:18.430 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:18.430 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:18.430 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:18.431 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:18.431 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:18.431 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:18.431 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:18.431 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:18.431 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.431 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.431 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.431 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.431 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:18.431 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:18.431 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.431 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:18.432 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.432 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:18.432 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:18.432 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:18.432 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.432 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:18.432 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:18.432 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.432 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.432 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:18.432 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:18.432 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.432 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.432 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:18.433 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:18.433 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:18.433 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:18.433 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:18.433 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.433 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.433 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:18.433 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:18.433 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:18.433 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.433 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:18.433 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.433 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:18.433 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.434 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:18.434 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.434 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(scope="package") 2023-12-03T13:00:18.434 INFO:teuthology.orchestra.run.smithi003.stdout: def configfile(): 2023-12-03T13:00:18.434 INFO:teuthology.orchestra.run.smithi003.stdout:> setup() 2023-12-03T13:00:18.434 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.434 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:309: 2023-12-03T13:00:18.434 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.434 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:272: in setup 2023-12-03T13:00:18.434 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:18.434 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:18.434 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:18.434 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:18.434 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:18.434 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:18.435 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:18.435 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:18.435 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:18.435 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:18.435 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:18.435 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:18.435 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:18.435 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:18.435 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:18.435 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:18.435 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:18.435 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:18.435 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:18.436 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:18.436 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:18.436 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:18.436 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:18.436 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:18.436 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:18.436 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:18.436 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:18.436 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:18.436 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:18.436 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:18.436 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:18.436 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:18.436 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:18.437 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:18.437 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:18.437 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:18.437 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:18.437 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:18.437 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:18.437 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.437 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.437 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.437 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:18.437 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.437 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:18.437 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.437 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:18.437 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:18.438 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:18.438 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:18.438 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:18.438 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:18.438 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.438 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:18.438 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:18.438 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:18.438 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:18.438 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:18.438 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:18.438 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.438 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:18.439 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:18.439 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:18.439 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:18.439 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:18.439 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:18.439 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:18.439 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:18.439 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:18.439 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:18.439 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:18.439 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.439 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.439 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:18.439 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:18.440 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:18.440 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:18.440 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:18.440 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.440 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.440 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:18.440 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:18.440 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:18.440 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:18.440 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:18.440 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.440 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:18.440 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:18.440 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:18.440 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:18.441 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:18.441 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:18.441 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.441 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:18.441 INFO:teuthology.orchestra.run.smithi003.stdout:_________________ ERROR at setup of test_count_json_operation __________________ 2023-12-03T13:00:18.441 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.441 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.441 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.441 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:18.441 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:18.441 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.441 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:18.441 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.441 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:18.441 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:18.442 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:18.442 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.442 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:18.442 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:18.442 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.442 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.442 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:18.442 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:18.442 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.442 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.442 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:18.442 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.442 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:18.442 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:18.443 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.443 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.443 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:18.443 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:18.443 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.443 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:18.443 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:18.443 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:18.443 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:18.443 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:18.443 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.443 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:18.443 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.443 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:18.444 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:18.444 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:18.444 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:18.444 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:18.444 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:18.444 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:18.444 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:18.444 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.444 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.444 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:18.444 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:18.444 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:18.444 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:18.444 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.444 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:18.445 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:18.445 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:18.445 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:18.445 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.445 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.445 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:18.445 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:18.445 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:18.445 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:18.445 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.445 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.445 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:18.445 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:18.446 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:18.446 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.446 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:18.446 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.446 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:18.446 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:18.446 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.446 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:18.446 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:18.446 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:18.446 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:18.446 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:18.446 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:18.446 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.447 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:18.447 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.447 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:18.447 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.447 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.447 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:18.447 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.447 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:18.447 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.447 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:18.447 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:18.447 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:18.447 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:18.447 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:18.448 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:18.448 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.448 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:18.448 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:18.448 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:18.448 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:18.448 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:18.448 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:18.448 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.448 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:18.448 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:18.448 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:18.448 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:18.448 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:18.448 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:18.449 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:18.449 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:18.449 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:18.449 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:18.449 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:18.449 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.449 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.449 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:18.449 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.449 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:18.449 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:18.449 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:18.449 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:18.449 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:18.450 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:18.450 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:18.450 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:18.450 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:18.450 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:18.450 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:18.450 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:18.450 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:18.450 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:18.450 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:18.450 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:18.450 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:18.451 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:18.451 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:18.451 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:18.451 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:18.451 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:18.451 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:18.451 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:18.451 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:18.451 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:18.451 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:18.451 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:18.451 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.451 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.451 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.452 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.452 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:18.452 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:18.452 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.452 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:18.452 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.452 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:18.452 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:18.452 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:18.452 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.452 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:18.452 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:18.452 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.452 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.453 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:18.453 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:18.453 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.453 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.453 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:18.453 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:18.453 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:18.453 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:18.453 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:18.453 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.453 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.453 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:18.453 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:18.453 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:18.454 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.454 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:18.454 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.454 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:18.454 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.454 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:18.454 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.454 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(scope="package") 2023-12-03T13:00:18.454 INFO:teuthology.orchestra.run.smithi003.stdout: def configfile(): 2023-12-03T13:00:18.454 INFO:teuthology.orchestra.run.smithi003.stdout:> setup() 2023-12-03T13:00:18.454 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.454 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:309: 2023-12-03T13:00:18.454 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.454 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:272: in setup 2023-12-03T13:00:18.455 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:18.455 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:18.455 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:18.455 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:18.455 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:18.455 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:18.455 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:18.455 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:18.455 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:18.455 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:18.455 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:18.455 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:18.455 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:18.455 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:18.456 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:18.456 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:18.456 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:18.456 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:18.456 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:18.456 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:18.456 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:18.456 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:18.456 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:18.456 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:18.456 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:18.456 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:18.456 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:18.456 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:18.456 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:18.457 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:18.457 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:18.457 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:18.457 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:18.457 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:18.457 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:18.457 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:18.457 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:18.457 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:18.457 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:18.457 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.457 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.457 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.457 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:18.457 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.458 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:18.458 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.458 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:18.458 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:18.458 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:18.458 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:18.458 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:18.458 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:18.458 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.458 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:18.458 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:18.458 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:18.458 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:18.458 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:18.459 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:18.459 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.459 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:18.459 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:18.459 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:18.459 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:18.459 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:18.459 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:18.459 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:18.459 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:18.459 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:18.459 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:18.459 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:18.459 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.460 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.460 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:18.460 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:18.460 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:18.460 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:18.460 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:18.460 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.460 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.460 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:18.460 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:18.460 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:18.460 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:18.460 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:18.460 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.460 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:18.460 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:18.461 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:18.461 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:18.461 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:18.461 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:18.461 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.461 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:18.461 INFO:teuthology.orchestra.run.smithi003.stdout:________________ ERROR at setup of test_json_column_sum_min_max ________________ 2023-12-03T13:00:18.461 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.461 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.461 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.461 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:18.461 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:18.461 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.461 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:18.462 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.462 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:18.462 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:18.462 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:18.462 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.462 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:18.462 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:18.462 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.462 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.462 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:18.462 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:18.462 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.462 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.463 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:18.463 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.463 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:18.463 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:18.463 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.463 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.463 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:18.463 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:18.463 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.463 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:18.463 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:18.463 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:18.463 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:18.463 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:18.463 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.464 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:18.464 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.464 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:18.464 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:18.464 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:18.464 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:18.464 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:18.464 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:18.464 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:18.464 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:18.464 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.464 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.464 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:18.464 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:18.465 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:18.465 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:18.465 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.465 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:18.465 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:18.465 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:18.465 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:18.465 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.465 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.465 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:18.465 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:18.465 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:18.465 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:18.465 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.465 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.466 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:18.466 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:18.466 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:18.466 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.466 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:18.466 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.466 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:18.466 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:18.466 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.466 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:18.466 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:18.466 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:18.466 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:18.466 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:18.467 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:18.467 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.467 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:18.467 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.467 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:18.467 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.467 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.467 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:18.467 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.467 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:18.467 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.467 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:18.467 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:18.467 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:18.468 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:18.468 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:18.468 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:18.468 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.468 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:18.468 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:18.468 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:18.468 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:18.468 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:18.468 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:18.468 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.468 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:18.468 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:18.468 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:18.469 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:18.469 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:18.469 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:18.469 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:18.469 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:18.469 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:18.469 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:18.469 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:18.469 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.469 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.469 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:18.469 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.469 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:18.469 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:18.470 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:18.470 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:18.470 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:18.470 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:18.470 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:18.470 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:18.470 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:18.470 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:18.470 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:18.470 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:18.470 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:18.470 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:18.470 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:18.471 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:18.471 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:18.471 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:18.471 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:18.471 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:18.471 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:18.471 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:18.471 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:18.471 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:18.471 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:18.471 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:18.471 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:18.471 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:18.471 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.471 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.472 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.472 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.472 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:18.472 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:18.472 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.472 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:18.472 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.472 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:18.472 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:18.472 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:18.472 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.472 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:18.472 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:18.473 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.473 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.473 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:18.473 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:18.473 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.473 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.473 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:18.473 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:18.473 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:18.473 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:18.473 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:18.473 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.473 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.474 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:18.474 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:18.474 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:18.474 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.474 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:18.474 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.474 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:18.474 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.474 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:18.474 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.474 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(scope="package") 2023-12-03T13:00:18.474 INFO:teuthology.orchestra.run.smithi003.stdout: def configfile(): 2023-12-03T13:00:18.474 INFO:teuthology.orchestra.run.smithi003.stdout:> setup() 2023-12-03T13:00:18.474 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.475 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:309: 2023-12-03T13:00:18.475 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.475 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:272: in setup 2023-12-03T13:00:18.475 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:18.475 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:18.475 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:18.475 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:18.475 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:18.475 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:18.475 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:18.475 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:18.475 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:18.475 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:18.476 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:18.476 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:18.476 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:18.476 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:18.476 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:18.476 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:18.476 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:18.476 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:18.476 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:18.476 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:18.476 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:18.476 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:18.476 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:18.476 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:18.477 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:18.477 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:18.477 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:18.477 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:18.477 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:18.477 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:18.477 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:18.477 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:18.477 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:18.477 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:18.477 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:18.477 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:18.477 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:18.477 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:18.478 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:18.478 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.478 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.478 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.478 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:18.478 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.478 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:18.478 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.478 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:18.478 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:18.478 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:18.478 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:18.478 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:18.478 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:18.478 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.479 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:18.479 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:18.479 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:18.479 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:18.479 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:18.479 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:18.479 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.479 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:18.479 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:18.479 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:18.479 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:18.479 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:18.479 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:18.480 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:18.480 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:18.480 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:18.480 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:18.480 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:18.480 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.480 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.480 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:18.480 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:18.480 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:18.480 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:18.480 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:18.480 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.480 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.480 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:18.481 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:18.481 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:18.481 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:18.481 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:18.481 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.481 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:18.481 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:18.481 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:18.481 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:18.481 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:18.481 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:18.481 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.481 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:18.481 INFO:teuthology.orchestra.run.smithi003.stdout:________________ ERROR at setup of test_json_nullif_expressions ________________ 2023-12-03T13:00:18.481 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.482 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.482 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.482 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:18.482 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:18.482 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.482 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:18.482 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.482 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:18.482 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:18.482 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:18.482 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.482 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:18.482 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:18.483 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.483 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.483 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:18.483 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:18.483 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.483 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.483 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:18.483 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.483 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:18.483 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:18.483 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.483 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.483 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:18.483 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:18.484 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.484 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:18.484 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:18.484 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:18.484 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:18.484 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:18.484 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.484 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:18.484 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.484 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:18.484 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:18.484 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:18.484 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:18.484 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:18.484 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:18.485 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:18.485 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:18.485 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.485 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.485 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:18.485 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:18.485 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:18.485 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:18.485 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.485 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:18.485 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:18.485 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:18.485 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:18.485 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.485 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.486 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:18.486 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:18.486 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:18.486 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:18.486 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.486 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.486 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:18.486 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:18.486 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:18.486 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.486 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:18.486 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.486 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:18.486 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:18.487 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.487 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:18.487 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:18.487 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:18.487 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:18.487 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:18.487 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:18.487 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.487 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:18.487 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.487 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:18.487 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.487 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.487 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:18.488 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.488 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:18.488 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.488 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:18.488 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:18.488 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:18.488 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:18.488 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:18.488 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:18.488 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.488 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:18.488 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:18.488 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:18.489 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:18.489 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:18.489 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:18.489 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.489 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:18.489 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:18.489 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:18.489 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:18.489 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:18.489 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:18.489 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:18.489 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:18.489 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:18.489 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:18.489 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:18.490 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.490 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.490 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:18.490 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.490 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:18.490 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:18.490 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:18.490 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:18.490 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:18.490 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:18.490 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:18.490 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:18.490 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:18.490 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:18.491 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:18.491 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:18.491 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:18.491 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:18.491 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:18.491 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:18.491 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:18.491 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:18.491 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:18.491 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:18.491 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:18.491 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:18.491 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:18.491 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:18.492 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:18.492 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:18.492 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:18.492 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:18.492 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.492 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.492 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.492 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.492 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:18.492 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:18.492 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.492 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:18.492 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.492 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:18.492 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:18.493 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:18.493 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.493 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:18.493 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:18.493 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.493 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.493 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:18.493 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:18.493 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.493 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.493 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:18.493 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:18.493 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:18.493 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:18.493 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:18.494 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.494 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.494 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:18.494 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:18.494 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:18.494 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.494 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:18.494 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.494 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:18.494 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.494 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:18.494 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.494 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(scope="package") 2023-12-03T13:00:18.494 INFO:teuthology.orchestra.run.smithi003.stdout: def configfile(): 2023-12-03T13:00:18.495 INFO:teuthology.orchestra.run.smithi003.stdout:> setup() 2023-12-03T13:00:18.495 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.495 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:309: 2023-12-03T13:00:18.495 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.495 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:272: in setup 2023-12-03T13:00:18.495 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:18.495 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:18.495 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:18.495 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:18.495 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:18.495 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:18.495 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:18.495 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:18.495 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:18.495 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:18.496 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:18.496 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:18.496 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:18.496 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:18.496 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:18.496 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:18.496 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:18.496 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:18.496 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:18.496 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:18.496 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:18.496 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:18.496 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:18.496 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:18.496 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:18.497 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:18.497 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:18.497 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:18.497 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:18.497 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:18.497 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:18.497 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:18.497 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:18.497 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:18.497 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:18.497 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:18.497 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:18.497 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:18.497 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:18.498 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.498 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.498 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.498 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:18.498 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.498 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:18.498 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.498 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:18.498 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:18.498 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:18.498 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:18.498 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:18.498 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:18.499 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.499 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:18.499 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:18.499 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:18.499 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:18.499 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:18.499 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:18.499 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.499 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:18.499 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:18.499 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:18.499 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:18.499 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:18.500 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:18.500 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:18.500 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:18.500 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:18.500 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:18.500 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:18.500 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.500 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.500 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:18.500 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:18.500 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:18.500 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:18.500 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:18.500 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.501 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.501 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:18.501 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:18.501 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:18.501 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:18.501 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:18.501 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.501 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:18.501 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:18.501 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:18.501 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:18.501 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:18.501 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:18.501 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.502 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:18.502 INFO:teuthology.orchestra.run.smithi003.stdout:__________________ ERROR at setup of test_column_sum_min_max ___________________ 2023-12-03T13:00:18.502 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.502 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.502 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.502 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:18.502 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:18.502 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.502 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:18.502 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.502 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:18.502 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:18.503 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:18.503 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.503 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:18.503 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:18.503 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.503 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.503 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:18.503 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:18.503 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.503 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.503 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:18.503 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.503 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:18.503 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:18.504 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.504 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.504 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:18.504 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:18.504 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.504 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:18.504 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:18.504 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:18.504 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:18.504 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:18.504 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.504 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:18.504 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.504 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:18.504 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:18.505 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:18.505 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:18.505 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:18.505 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:18.505 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:18.505 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:18.505 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.505 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.505 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:18.505 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:18.505 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:18.505 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:18.506 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.506 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:18.506 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:18.506 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:18.506 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:18.506 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.506 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.506 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:18.506 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:18.506 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:18.506 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:18.506 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.506 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.506 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:18.507 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:18.507 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:18.507 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.507 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:18.507 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.507 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:18.507 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:18.507 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.507 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:18.507 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:18.507 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:18.507 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:18.507 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:18.507 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:18.508 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.508 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:18.508 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.508 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:18.508 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.508 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.508 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:18.508 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.508 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:18.508 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.508 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:18.508 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:18.508 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:18.508 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:18.508 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:18.509 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:18.509 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.509 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:18.509 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:18.509 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:18.509 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:18.509 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:18.509 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:18.509 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.509 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:18.509 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:18.509 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:18.509 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:18.509 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:18.510 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:18.510 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:18.510 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:18.510 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:18.510 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:18.510 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:18.510 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.510 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.510 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:18.510 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.510 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:18.510 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:18.510 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:18.510 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:18.511 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:18.511 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:18.511 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:18.511 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:18.511 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:18.511 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:18.511 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:18.511 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:18.511 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:18.511 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:18.511 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:18.511 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:18.511 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:18.512 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:18.512 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:18.512 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:18.512 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:18.512 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:18.512 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:18.512 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:18.512 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:18.512 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:18.512 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:18.512 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:18.512 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.512 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.513 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.513 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.513 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:18.513 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:18.513 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.513 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:18.513 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.513 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:18.513 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:18.513 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:18.513 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.513 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:18.513 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:18.513 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.514 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.514 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:18.514 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:18.514 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.514 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.514 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:18.514 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:18.514 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:18.514 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:18.514 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:18.514 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.514 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.514 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:18.515 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:18.515 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:18.515 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.515 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:18.515 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.515 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:18.515 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.515 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:18.515 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.515 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(scope="package") 2023-12-03T13:00:18.515 INFO:teuthology.orchestra.run.smithi003.stdout: def configfile(): 2023-12-03T13:00:18.515 INFO:teuthology.orchestra.run.smithi003.stdout:> setup() 2023-12-03T13:00:18.515 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.515 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:309: 2023-12-03T13:00:18.516 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.516 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:272: in setup 2023-12-03T13:00:18.516 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:18.516 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:18.516 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:18.516 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:18.516 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:18.516 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:18.516 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:18.516 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:18.516 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:18.516 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:18.516 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:18.516 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:18.516 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:18.517 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:18.517 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:18.517 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:18.517 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:18.517 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:18.517 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:18.517 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:18.517 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:18.517 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:18.517 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:18.517 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:18.517 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:18.517 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:18.517 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:18.518 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:18.518 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:18.518 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:18.518 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:18.518 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:18.518 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:18.518 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:18.518 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:18.518 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:18.518 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:18.518 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:18.518 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:18.518 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.518 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.518 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.519 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:18.519 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.519 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:18.519 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.519 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:18.519 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:18.519 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:18.519 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:18.519 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:18.519 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:18.519 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.519 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:18.519 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:18.519 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:18.520 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:18.520 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:18.520 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:18.520 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.520 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:18.520 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:18.520 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:18.520 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:18.520 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:18.520 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:18.520 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:18.520 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:18.520 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:18.520 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:18.521 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:18.521 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.521 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.521 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:18.521 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:18.521 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:18.521 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:18.521 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:18.521 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.521 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.521 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:18.521 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:18.521 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:18.522 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:18.522 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:18.522 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.522 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:18.522 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:18.522 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:18.522 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:18.522 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:18.522 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:18.522 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.522 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:18.522 INFO:teuthology.orchestra.run.smithi003.stdout:__________________ ERROR at setup of test_nullif_expressions ___________________ 2023-12-03T13:00:18.522 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.522 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.523 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.523 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:18.523 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:18.523 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.523 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:18.523 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.523 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:18.523 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:18.523 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:18.523 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.523 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:18.523 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:18.523 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.523 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.524 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:18.524 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:18.524 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.524 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.524 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:18.524 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.524 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:18.524 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:18.524 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.524 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.524 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:18.524 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:18.524 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.525 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:18.525 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:18.525 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:18.525 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:18.525 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:18.525 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.525 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:18.525 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.525 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:18.525 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:18.525 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:18.525 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:18.525 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:18.525 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:18.525 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:18.526 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:18.526 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.526 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.526 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:18.526 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:18.526 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:18.526 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:18.526 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.526 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:18.526 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:18.526 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:18.526 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:18.526 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.526 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.527 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:18.527 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:18.527 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:18.527 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:18.527 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.527 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.527 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:18.527 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:18.527 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:18.527 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.527 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:18.527 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.527 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:18.527 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:18.528 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.528 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:18.528 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:18.528 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:18.528 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:18.528 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:18.528 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:18.528 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.528 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:18.528 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.528 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:18.528 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.528 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.528 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:18.528 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.529 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:18.529 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.529 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:18.529 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:18.529 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:18.529 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:18.529 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:18.529 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:18.529 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.529 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:18.529 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:18.529 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:18.529 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:18.529 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:18.530 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:18.530 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.530 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:18.530 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:18.530 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:18.530 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:18.530 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:18.530 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:18.530 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:18.530 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:18.530 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:18.530 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:18.530 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:18.531 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.531 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.531 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:18.531 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.531 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:18.531 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:18.531 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:18.531 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:18.531 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:18.531 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:18.531 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:18.531 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:18.531 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:18.531 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:18.531 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:18.532 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:18.532 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:18.532 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:18.532 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:18.532 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:18.532 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:18.532 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:18.532 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:18.532 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:18.532 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:18.532 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:18.532 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:18.532 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:18.532 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:18.533 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:18.533 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:18.533 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:18.533 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.533 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.533 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.533 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.533 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:18.533 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:18.533 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.533 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:18.533 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.533 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:18.533 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:18.533 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:18.534 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.534 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:18.534 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:18.534 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.534 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.534 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:18.534 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:18.534 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.534 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.534 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:18.534 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:18.534 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:18.534 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:18.534 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:18.535 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.535 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.535 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:18.535 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:18.535 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:18.535 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.535 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:18.535 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.535 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:18.535 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.535 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:18.535 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.535 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(scope="package") 2023-12-03T13:00:18.535 INFO:teuthology.orchestra.run.smithi003.stdout: def configfile(): 2023-12-03T13:00:18.536 INFO:teuthology.orchestra.run.smithi003.stdout:> setup() 2023-12-03T13:00:18.536 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.536 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:309: 2023-12-03T13:00:18.536 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.536 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:272: in setup 2023-12-03T13:00:18.536 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:18.536 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:18.536 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:18.536 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:18.536 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:18.536 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:18.536 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:18.536 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:18.536 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:18.537 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:18.537 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:18.537 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:18.537 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:18.537 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:18.537 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:18.537 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:18.537 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:18.537 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:18.537 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:18.537 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:18.537 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:18.537 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:18.538 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:18.538 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:18.538 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:18.538 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:18.538 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:18.538 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:18.538 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:18.538 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:18.538 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:18.538 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:18.538 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:18.538 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:18.538 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:18.538 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:18.539 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:18.539 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:18.539 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:18.539 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.539 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.539 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.539 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:18.539 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.539 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:18.539 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.539 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:18.539 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:18.539 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:18.539 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:18.540 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:18.540 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:18.540 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.540 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:18.540 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:18.540 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:18.540 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:18.540 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:18.540 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:18.540 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.540 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:18.540 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:18.540 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:18.540 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:18.540 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:18.541 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:18.541 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:18.541 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:18.541 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:18.541 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:18.541 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:18.541 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.541 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.541 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:18.541 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:18.541 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:18.541 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:18.541 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:18.541 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.542 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.542 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:18.542 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:18.542 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:18.542 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:18.542 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:18.542 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.542 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:18.542 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:18.542 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:18.542 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:18.542 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:18.542 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:18.543 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.543 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:18.543 INFO:teuthology.orchestra.run.smithi003.stdout:________________ ERROR at setup of test_nulliftrue_expressions _________________ 2023-12-03T13:00:18.543 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.543 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.543 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.543 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:18.543 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:18.543 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.543 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:18.543 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.543 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:18.543 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:18.543 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:18.543 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.544 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:18.544 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:18.544 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.544 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.544 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:18.544 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:18.544 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.544 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.544 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:18.544 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.544 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:18.544 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:18.544 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.545 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.545 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:18.545 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:18.545 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.545 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:18.545 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:18.545 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:18.545 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:18.545 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:18.545 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.545 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:18.545 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.545 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:18.545 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:18.546 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:18.546 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:18.546 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:18.546 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:18.546 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:18.546 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:18.546 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.546 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.546 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:18.546 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:18.546 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:18.546 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:18.546 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.546 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:18.547 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:18.547 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:18.547 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:18.547 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.547 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.547 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:18.547 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:18.547 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:18.547 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:18.547 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.547 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.547 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:18.547 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:18.547 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:18.548 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.548 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:18.548 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.548 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:18.548 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:18.548 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.548 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:18.548 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:18.548 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:18.548 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:18.548 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:18.548 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:18.548 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.548 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:18.548 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.549 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:18.549 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.549 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.549 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:18.549 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.549 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:18.549 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.549 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:18.549 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:18.549 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:18.549 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:18.549 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:18.549 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:18.550 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.550 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:18.550 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:18.550 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:18.550 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:18.550 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:18.550 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:18.550 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.550 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:18.550 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:18.550 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:18.550 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:18.550 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:18.550 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:18.551 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:18.551 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:18.551 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:18.551 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:18.551 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:18.551 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.551 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.551 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:18.551 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.551 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:18.551 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:18.551 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:18.551 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:18.551 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:18.552 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:18.552 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:18.552 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:18.552 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:18.552 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:18.552 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:18.552 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:18.552 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:18.552 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:18.552 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:18.552 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:18.552 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:18.552 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:18.552 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:18.553 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:18.553 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:18.553 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:18.553 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:18.553 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:18.553 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:18.553 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:18.553 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:18.553 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:18.553 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.553 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.553 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.553 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.553 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:18.553 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:18.554 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.554 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:18.554 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.554 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:18.554 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:18.554 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:18.554 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.554 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:18.554 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:18.554 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.554 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.554 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:18.554 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:18.555 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.555 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.555 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:18.555 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:18.555 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:18.555 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:18.555 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:18.555 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.555 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.555 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:18.555 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:18.555 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:18.555 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.556 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:18.556 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.556 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:18.556 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.556 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:18.556 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.556 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(scope="package") 2023-12-03T13:00:18.556 INFO:teuthology.orchestra.run.smithi003.stdout: def configfile(): 2023-12-03T13:00:18.556 INFO:teuthology.orchestra.run.smithi003.stdout:> setup() 2023-12-03T13:00:18.556 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.556 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:309: 2023-12-03T13:00:18.556 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.556 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:272: in setup 2023-12-03T13:00:18.556 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:18.557 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:18.557 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:18.557 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:18.557 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:18.557 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:18.557 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:18.557 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:18.557 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:18.557 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:18.557 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:18.557 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:18.557 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:18.557 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:18.557 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:18.557 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:18.558 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:18.558 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:18.558 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:18.558 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:18.558 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:18.558 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:18.558 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:18.558 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:18.558 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:18.558 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:18.558 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:18.558 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:18.558 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:18.558 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:18.559 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:18.559 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:18.559 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:18.559 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:18.559 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:18.559 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:18.559 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:18.559 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:18.559 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:18.559 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.559 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.559 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.560 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:18.560 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.560 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:18.560 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.560 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:18.560 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:18.560 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:18.560 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:18.560 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:18.560 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:18.560 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.560 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:18.560 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:18.560 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:18.560 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:18.561 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:18.561 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:18.561 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.561 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:18.561 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:18.561 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:18.561 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:18.561 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:18.561 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:18.561 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:18.561 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:18.561 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:18.562 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:18.562 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:18.562 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.562 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.562 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:18.562 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:18.562 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:18.562 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:18.562 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:18.562 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.562 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.562 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:18.562 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:18.563 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:18.563 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:18.563 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:18.563 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.563 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:18.563 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:18.563 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:18.563 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:18.563 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:18.563 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:18.563 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.563 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:18.563 INFO:teuthology.orchestra.run.smithi003.stdout:________________ ERROR at setup of test_is_not_null_expressions ________________ 2023-12-03T13:00:18.563 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.564 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.564 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.564 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:18.564 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:18.564 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.564 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:18.564 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.564 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:18.564 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:18.564 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:18.564 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.564 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:18.564 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:18.565 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.565 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.565 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:18.565 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:18.565 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.565 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.565 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:18.565 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.565 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:18.565 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:18.565 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.565 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.565 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:18.566 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:18.566 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.566 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:18.566 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:18.566 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:18.566 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:18.566 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:18.566 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.566 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:18.566 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.566 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:18.566 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:18.566 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:18.567 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:18.567 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:18.567 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:18.567 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:18.567 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:18.567 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.567 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.567 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:18.567 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:18.567 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:18.567 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:18.567 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.567 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:18.568 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:18.568 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:18.568 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:18.568 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.568 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.568 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:18.568 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:18.568 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:18.568 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:18.568 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.568 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.568 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:18.568 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:18.569 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:18.569 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.569 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:18.569 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.569 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:18.569 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:18.569 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.569 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:18.569 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:18.569 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:18.569 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:18.569 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:18.569 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:18.570 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.570 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:18.570 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.570 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:18.570 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.570 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.570 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:18.570 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.570 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:18.570 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.570 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:18.570 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:18.570 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:18.571 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:18.571 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:18.571 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:18.571 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.571 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:18.571 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:18.571 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:18.571 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:18.571 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:18.571 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:18.571 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.571 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:18.571 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:18.572 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:18.572 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:18.572 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:18.572 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:18.572 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:18.572 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:18.572 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:18.572 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:18.572 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:18.572 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.572 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.572 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:18.572 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.572 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:18.573 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:18.573 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:18.573 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:18.573 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:18.573 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:18.573 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:18.573 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:18.573 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:18.573 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:18.573 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:18.573 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:18.573 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:18.573 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:18.574 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:18.574 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:18.574 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:18.574 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:18.574 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:18.574 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:18.574 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:18.574 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:18.574 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:18.574 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:18.574 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:18.574 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:18.575 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:18.575 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:18.575 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.575 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.575 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.575 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.575 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:18.575 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:18.575 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.575 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:18.575 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.575 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:18.575 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:18.575 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:18.576 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.576 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:18.576 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:18.576 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.576 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.576 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:18.576 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:18.576 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.576 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.576 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:18.576 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:18.576 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:18.576 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:18.576 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:18.576 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.577 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.577 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:18.577 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:18.577 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:18.577 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.577 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:18.577 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.577 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:18.577 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.577 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:18.577 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.577 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(scope="package") 2023-12-03T13:00:18.577 INFO:teuthology.orchestra.run.smithi003.stdout: def configfile(): 2023-12-03T13:00:18.577 INFO:teuthology.orchestra.run.smithi003.stdout:> setup() 2023-12-03T13:00:18.578 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.578 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:309: 2023-12-03T13:00:18.578 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.578 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:272: in setup 2023-12-03T13:00:18.578 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:18.578 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:18.578 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:18.578 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:18.578 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:18.578 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:18.578 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:18.578 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:18.578 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:18.578 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:18.578 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:18.579 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:18.579 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:18.579 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:18.579 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:18.579 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:18.579 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:18.579 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:18.579 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:18.579 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:18.579 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:18.579 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:18.579 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:18.579 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:18.579 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:18.579 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:18.580 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:18.580 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:18.580 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:18.580 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:18.580 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:18.580 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:18.580 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:18.580 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:18.580 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:18.580 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:18.580 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:18.580 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:18.580 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:18.580 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.581 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.581 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.581 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:18.581 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.581 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:18.581 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.581 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:18.581 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:18.581 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:18.581 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:18.581 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:18.581 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:18.581 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.581 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:18.581 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:18.582 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:18.582 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:18.582 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:18.582 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:18.582 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.582 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:18.582 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:18.582 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:18.582 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:18.582 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:18.582 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:18.582 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:18.582 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:18.583 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:18.583 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:18.583 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:18.583 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.583 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.583 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:18.583 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:18.583 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:18.583 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:18.583 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:18.583 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.583 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.583 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:18.583 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:18.584 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:18.584 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:18.584 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:18.584 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.584 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:18.584 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:18.584 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:18.584 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:18.584 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:18.584 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:18.584 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.584 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:18.584 INFO:teuthology.orchestra.run.smithi003.stdout:________________ ERROR at setup of test_lowerupper_expressions _________________ 2023-12-03T13:00:18.584 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.585 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.585 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.585 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:18.585 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:18.585 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.585 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:18.585 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.585 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:18.585 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:18.585 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:18.585 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.585 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:18.585 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:18.585 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.586 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.586 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:18.586 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:18.586 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.586 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.586 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:18.586 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.586 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:18.586 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:18.586 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.586 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.586 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:18.586 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:18.587 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.587 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:18.587 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:18.587 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:18.587 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:18.587 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:18.587 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.587 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:18.587 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.587 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:18.587 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:18.587 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:18.588 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:18.588 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:18.588 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:18.588 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:18.588 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:18.588 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.588 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.588 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:18.588 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:18.588 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:18.588 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:18.588 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.588 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:18.588 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:18.589 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:18.589 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:18.589 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.589 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.589 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:18.589 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:18.589 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:18.589 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:18.589 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.589 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.589 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:18.589 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:18.589 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:18.589 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.590 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:18.590 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.590 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:18.590 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:18.590 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.590 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:18.590 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:18.590 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:18.590 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:18.590 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:18.590 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:18.590 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.590 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:18.591 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.591 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:18.591 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.591 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.591 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:18.591 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.591 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:18.591 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.591 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:18.591 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:18.591 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:18.591 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:18.591 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:18.591 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:18.592 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.592 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:18.592 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:18.592 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:18.592 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:18.592 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:18.592 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:18.592 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.592 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:18.592 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:18.592 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:18.592 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:18.592 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:18.593 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:18.593 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:18.593 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:18.593 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:18.593 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:18.593 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:18.593 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.593 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.593 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:18.593 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.593 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:18.593 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:18.593 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:18.593 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:18.593 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:18.594 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:18.594 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:18.594 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:18.594 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:18.594 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:18.594 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:18.594 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:18.594 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:18.594 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:18.594 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:18.594 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:18.594 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:18.595 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:18.595 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:18.595 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:18.595 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:18.595 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:18.595 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:18.595 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:18.595 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:18.595 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:18.595 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:18.595 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:18.595 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.595 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.595 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.596 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.596 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:18.596 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:18.596 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.596 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:18.596 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.596 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:18.596 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:18.596 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:18.596 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.596 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:18.596 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:18.596 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.596 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.597 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:18.597 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:18.597 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.597 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.597 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:18.597 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:18.597 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:18.597 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:18.597 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:18.597 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.597 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.597 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:18.597 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:18.597 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:18.598 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.598 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:18.598 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.598 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:18.598 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.598 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:18.598 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.598 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(scope="package") 2023-12-03T13:00:18.598 INFO:teuthology.orchestra.run.smithi003.stdout: def configfile(): 2023-12-03T13:00:18.598 INFO:teuthology.orchestra.run.smithi003.stdout:> setup() 2023-12-03T13:00:18.598 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.598 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:309: 2023-12-03T13:00:18.598 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.598 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:272: in setup 2023-12-03T13:00:18.598 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:18.599 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:18.599 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:18.599 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:18.599 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:18.599 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:18.599 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:18.599 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:18.599 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:18.599 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:18.599 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:18.599 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:18.599 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:18.599 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:18.599 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:18.600 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:18.600 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:18.600 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:18.600 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:18.600 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:18.600 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:18.600 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:18.600 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:18.600 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:18.600 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:18.600 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:18.600 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:18.600 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:18.601 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:18.601 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:18.601 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:18.601 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:18.601 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:18.601 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:18.601 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:18.601 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:18.601 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:18.601 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:18.601 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:18.601 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.601 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.601 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.602 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:18.602 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.602 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:18.602 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.602 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:18.602 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:18.602 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:18.602 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:18.602 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:18.602 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:18.602 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.602 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:18.602 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:18.602 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:18.603 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:18.603 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:18.603 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:18.603 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.603 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:18.603 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:18.603 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:18.603 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:18.603 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:18.603 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:18.603 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:18.603 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:18.603 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:18.603 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:18.603 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:18.604 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.604 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.604 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:18.604 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:18.604 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:18.604 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:18.604 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:18.604 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.604 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.604 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:18.604 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:18.604 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:18.604 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:18.604 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:18.605 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.605 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:18.605 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:18.605 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:18.605 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:18.605 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:18.605 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:18.605 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.605 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:18.605 INFO:teuthology.orchestra.run.smithi003.stdout:____________________ ERROR at setup of test_in_expressions _____________________ 2023-12-03T13:00:18.605 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.605 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.605 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.606 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:18.606 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:18.606 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.606 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:18.606 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.606 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:18.606 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:18.606 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:18.606 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.606 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:18.606 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:18.606 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.606 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.606 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:18.607 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:18.607 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.607 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.607 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:18.607 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.607 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:18.607 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:18.607 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.607 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.607 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:18.607 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:18.607 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.607 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:18.607 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:18.607 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:18.608 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:18.608 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:18.608 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.608 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:18.608 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.608 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:18.608 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:18.608 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:18.608 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:18.608 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:18.608 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:18.608 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:18.608 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:18.609 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.609 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.609 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:18.609 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:18.609 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:18.609 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:18.609 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.609 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:18.609 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:18.609 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:18.609 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:18.609 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.609 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.609 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:18.610 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:18.610 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:18.610 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:18.610 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.610 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.610 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:18.610 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:18.610 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:18.610 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.610 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:18.610 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.610 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:18.610 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:18.611 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.611 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:18.611 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:18.611 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:18.611 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:18.611 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:18.611 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:18.611 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.611 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:18.611 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.611 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:18.611 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.611 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.611 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:18.612 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.612 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:18.612 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.612 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:18.612 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:18.612 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:18.612 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:18.612 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:18.612 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:18.612 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.612 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:18.612 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:18.612 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:18.613 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:18.613 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:18.613 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:18.613 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.613 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:18.613 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:18.613 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:18.613 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:18.613 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:18.613 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:18.613 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:18.613 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:18.613 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:18.613 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:18.614 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:18.614 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.614 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.614 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:18.614 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.614 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:18.614 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:18.614 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:18.614 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:18.614 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:18.614 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:18.614 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:18.614 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:18.614 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:18.615 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:18.615 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:18.615 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:18.615 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:18.615 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:18.615 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:18.615 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:18.615 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:18.615 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:18.615 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:18.615 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:18.615 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:18.615 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:18.615 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:18.616 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:18.616 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:18.616 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:18.616 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:18.616 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:18.616 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.616 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.616 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.616 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.616 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:18.616 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:18.616 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.616 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:18.616 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.617 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:18.617 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:18.617 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:18.617 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.617 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:18.617 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:18.617 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.617 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.617 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:18.617 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:18.617 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.617 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.617 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:18.617 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:18.617 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:18.618 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:18.618 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:18.618 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.618 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.618 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:18.618 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:18.618 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:18.618 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.618 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:18.618 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.618 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:18.618 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.618 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:18.619 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.619 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(scope="package") 2023-12-03T13:00:18.619 INFO:teuthology.orchestra.run.smithi003.stdout: def configfile(): 2023-12-03T13:00:18.619 INFO:teuthology.orchestra.run.smithi003.stdout:> setup() 2023-12-03T13:00:18.619 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.619 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:309: 2023-12-03T13:00:18.619 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.619 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:272: in setup 2023-12-03T13:00:18.619 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:18.619 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:18.619 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:18.619 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:18.619 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:18.619 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:18.620 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:18.620 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:18.620 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:18.620 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:18.620 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:18.620 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:18.620 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:18.620 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:18.620 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:18.620 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:18.620 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:18.620 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:18.620 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:18.620 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:18.620 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:18.621 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:18.621 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:18.621 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:18.621 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:18.621 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:18.621 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:18.621 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:18.621 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:18.621 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:18.621 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:18.621 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:18.621 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:18.621 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:18.621 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:18.622 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:18.622 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:18.622 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:18.622 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:18.622 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.622 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.622 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.622 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:18.622 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.622 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:18.622 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.622 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:18.622 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:18.623 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:18.623 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:18.623 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:18.623 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:18.623 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.623 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:18.623 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:18.623 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:18.623 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:18.623 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:18.623 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:18.623 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.623 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:18.623 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:18.623 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:18.623 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:18.624 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:18.624 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:18.624 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:18.624 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:18.624 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:18.624 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:18.624 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:18.624 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.625 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.625 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:18.625 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:18.625 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:18.625 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:18.625 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:18.625 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.625 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.625 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:18.625 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:18.625 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:18.626 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:18.626 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:18.626 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.626 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:18.626 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:18.626 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:18.626 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:18.626 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:18.626 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:18.626 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.626 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:18.626 INFO:teuthology.orchestra.run.smithi003.stdout:_______________ ERROR at setup of test_true_false_in_expressions _______________ 2023-12-03T13:00:18.626 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.627 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.627 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.627 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:18.627 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:18.627 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.627 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:18.627 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.627 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:18.627 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:18.627 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:18.627 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.627 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:18.627 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:18.627 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.628 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.628 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:18.628 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:18.628 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.628 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.628 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:18.628 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.628 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:18.628 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:18.628 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.628 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.628 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:18.628 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:18.629 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.629 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:18.629 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:18.629 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:18.629 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:18.629 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:18.629 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.629 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:18.629 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.629 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:18.629 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:18.629 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:18.629 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:18.630 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:18.630 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:18.630 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:18.630 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:18.630 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.630 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.630 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:18.630 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:18.630 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:18.630 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:18.630 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.630 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:18.630 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:18.631 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:18.631 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:18.631 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.631 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.631 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:18.631 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:18.631 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:18.631 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:18.631 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.631 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.631 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:18.631 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:18.632 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:18.632 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.632 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:18.632 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.632 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:18.632 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:18.632 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.632 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:18.632 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:18.632 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:18.632 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:18.632 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:18.632 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:18.632 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.633 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:18.633 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.633 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:18.633 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.633 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.633 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:18.633 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.633 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:18.633 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.633 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:18.633 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:18.633 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:18.634 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:18.634 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:18.634 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:18.634 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.634 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:18.634 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:18.634 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:18.634 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:18.634 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:18.634 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:18.634 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.634 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:18.634 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:18.634 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:18.635 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:18.635 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:18.635 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:18.635 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:18.635 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:18.635 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:18.635 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:18.635 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:18.635 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.635 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.635 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:18.635 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.636 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:18.636 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:18.636 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:18.636 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:18.636 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:18.636 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:18.636 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:18.636 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:18.636 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:18.636 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:18.636 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:18.636 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:18.637 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:18.637 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:18.637 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:18.637 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:18.637 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:18.637 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:18.637 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:18.637 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:18.637 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:18.637 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:18.637 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:18.637 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:18.638 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:18.638 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:18.638 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:18.638 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:18.638 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.638 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.638 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.638 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.638 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:18.638 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:18.638 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.639 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:18.639 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.639 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:18.639 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:18.639 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:18.639 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.639 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:18.639 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:18.639 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.639 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.639 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:18.639 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:18.639 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.640 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.640 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:18.640 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:18.640 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:18.640 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:18.640 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:18.640 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.640 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.640 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:18.640 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:18.640 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:18.640 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.640 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:18.640 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.640 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:18.641 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.641 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:18.641 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.641 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(scope="package") 2023-12-03T13:00:18.641 INFO:teuthology.orchestra.run.smithi003.stdout: def configfile(): 2023-12-03T13:00:18.641 INFO:teuthology.orchestra.run.smithi003.stdout:> setup() 2023-12-03T13:00:18.641 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.641 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:309: 2023-12-03T13:00:18.641 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.641 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:272: in setup 2023-12-03T13:00:18.641 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:18.641 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:18.641 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:18.641 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:18.642 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:18.642 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:18.642 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:18.642 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:18.642 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:18.642 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:18.642 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:18.642 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:18.642 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:18.642 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:18.642 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:18.642 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:18.642 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:18.642 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:18.643 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:18.643 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:18.643 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:18.643 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:18.643 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:18.643 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:18.643 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:18.643 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:18.643 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:18.643 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:18.643 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:18.643 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:18.643 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:18.643 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:18.643 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:18.644 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:18.644 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:18.644 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:18.644 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:18.644 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:18.644 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:18.644 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.644 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.644 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.644 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:18.644 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.644 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:18.644 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.644 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:18.645 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:18.645 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:18.645 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:18.645 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:18.645 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:18.645 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.645 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:18.645 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:18.645 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:18.645 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:18.645 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:18.645 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:18.645 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.646 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:18.646 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:18.646 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:18.646 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:18.646 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:18.646 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:18.646 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:18.646 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:18.646 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:18.646 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:18.646 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:18.646 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.646 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.646 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:18.647 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:18.647 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:18.647 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:18.647 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:18.647 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.647 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.647 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:18.647 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:18.647 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:18.647 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:18.647 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:18.647 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.647 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:18.647 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:18.648 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:18.648 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:18.648 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:18.648 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:18.648 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.648 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:18.648 INFO:teuthology.orchestra.run.smithi003.stdout:___________________ ERROR at setup of test_like_expressions ____________________ 2023-12-03T13:00:18.648 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.648 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.648 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.648 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:18.648 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:18.648 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.648 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:18.649 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.649 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:18.649 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:18.649 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:18.649 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.649 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:18.649 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:18.649 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.649 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.649 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:18.649 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:18.649 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.649 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.649 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:18.650 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.650 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:18.650 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:18.650 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.650 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.650 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:18.650 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:18.650 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.650 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:18.650 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:18.650 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:18.650 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:18.650 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:18.650 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.651 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:18.651 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.651 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:18.651 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:18.651 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:18.651 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:18.651 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:18.651 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:18.651 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:18.651 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:18.651 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.651 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.651 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:18.652 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:18.652 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:18.652 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:18.652 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.652 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:18.652 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:18.652 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:18.652 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:18.652 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.652 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.652 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:18.652 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:18.652 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:18.653 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:18.653 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.653 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.653 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:18.653 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:18.653 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:18.653 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.653 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:18.653 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.653 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:18.653 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:18.653 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.653 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:18.653 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:18.654 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:18.654 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:18.654 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:18.654 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:18.654 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.654 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:18.654 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.654 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:18.654 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.654 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.654 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:18.654 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.654 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:18.654 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.655 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:18.655 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:18.655 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:18.655 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:18.655 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:18.655 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:18.655 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.655 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:18.655 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:18.655 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:18.655 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:18.655 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:18.655 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:18.655 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.656 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:18.656 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:18.656 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:18.656 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:18.656 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:18.656 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:18.656 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:18.656 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:18.656 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:18.656 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:18.656 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:18.656 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.656 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.656 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:18.657 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.657 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:18.657 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:18.657 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:18.657 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:18.657 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:18.657 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:18.657 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:18.657 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:18.657 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:18.657 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:18.657 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:18.657 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:18.657 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:18.657 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:18.658 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:18.658 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:18.658 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:18.658 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:18.658 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:18.658 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:18.658 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:18.658 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:18.658 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:18.658 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:18.658 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:18.658 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:18.658 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:18.658 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:18.659 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.659 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.659 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.659 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.659 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:18.659 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:18.659 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.659 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:18.659 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.659 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:18.659 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:18.659 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:18.659 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.659 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:18.660 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:18.660 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.660 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.660 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:18.660 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:18.660 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.660 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.660 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:18.660 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:18.660 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:18.660 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:18.660 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:18.660 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.660 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.661 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:18.661 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:18.661 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:18.661 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.661 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:18.661 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.661 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:18.661 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.661 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:18.661 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.661 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(scope="package") 2023-12-03T13:00:18.661 INFO:teuthology.orchestra.run.smithi003.stdout: def configfile(): 2023-12-03T13:00:18.661 INFO:teuthology.orchestra.run.smithi003.stdout:> setup() 2023-12-03T13:00:18.661 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.662 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:309: 2023-12-03T13:00:18.662 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.662 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:272: in setup 2023-12-03T13:00:18.662 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:18.662 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:18.662 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:18.662 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:18.662 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:18.662 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:18.662 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:18.662 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:18.662 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:18.662 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:18.663 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:18.663 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:18.663 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:18.663 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:18.663 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:18.663 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:18.663 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:18.663 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:18.663 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:18.663 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:18.663 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:18.663 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:18.663 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:18.664 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:18.664 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:18.664 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:18.664 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:18.664 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:18.664 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:18.664 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:18.664 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:18.664 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:18.664 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:18.664 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:18.664 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:18.664 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:18.664 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:18.665 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:18.665 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:18.665 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.665 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.665 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.665 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:18.665 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.665 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:18.665 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.665 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:18.665 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:18.665 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:18.665 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:18.665 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:18.666 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:18.666 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.666 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:18.666 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:18.666 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:18.666 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:18.666 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:18.666 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:18.666 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.666 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:18.666 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:18.666 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:18.666 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:18.667 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:18.667 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:18.667 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:18.667 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:18.667 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:18.667 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:18.667 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:18.667 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.667 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.667 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:18.667 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:18.667 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:18.667 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:18.667 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:18.667 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.668 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.668 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:18.668 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:18.668 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:18.668 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:18.668 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:18.668 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.668 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:18.668 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:18.668 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:18.668 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:18.668 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:18.668 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:18.668 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.669 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:18.669 INFO:teuthology.orchestra.run.smithi003.stdout:_______________ ERROR at setup of test_truefalselike_expressions _______________ 2023-12-03T13:00:18.669 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.669 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.669 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.669 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:18.669 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:18.669 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.669 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:18.669 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.669 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:18.669 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:18.669 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:18.669 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.669 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:18.670 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:18.670 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.670 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.670 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:18.670 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:18.670 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.670 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.670 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:18.670 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.670 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:18.670 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:18.670 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.670 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.670 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:18.671 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:18.671 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.671 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:18.671 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:18.671 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:18.671 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:18.671 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:18.671 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.671 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:18.671 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.671 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:18.671 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:18.671 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:18.671 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:18.672 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:18.672 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:18.672 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:18.672 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:18.672 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.672 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.672 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:18.672 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:18.672 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:18.672 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:18.672 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.672 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:18.672 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:18.672 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:18.673 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:18.673 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.673 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.673 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:18.673 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:18.673 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:18.673 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:18.673 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.673 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.673 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:18.673 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:18.673 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:18.673 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.673 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:18.674 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.674 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:18.674 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:18.674 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.674 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:18.674 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:18.674 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:18.674 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:18.674 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:18.674 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:18.674 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.674 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:18.674 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.675 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:18.675 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.675 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.675 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:18.675 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.675 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:18.675 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.675 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:18.675 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:18.675 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:18.675 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:18.675 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:18.675 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:18.675 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.675 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:18.676 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:18.676 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:18.676 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:18.676 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:18.676 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:18.676 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.676 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:18.676 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:18.676 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:18.676 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:18.676 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:18.676 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:18.676 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:18.677 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:18.677 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:18.677 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:18.677 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:18.677 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.677 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.677 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:18.677 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.677 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:18.677 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:18.677 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:18.677 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:18.677 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:18.677 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:18.678 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:18.678 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:18.678 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:18.678 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:18.678 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:18.678 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:18.678 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:18.678 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:18.678 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:18.678 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:18.678 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:18.678 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:18.678 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:18.679 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:18.679 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:18.679 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:18.679 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:18.679 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:18.679 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:18.679 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:18.679 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:18.679 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:18.679 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.679 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.679 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.679 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.679 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:18.679 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:18.680 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.680 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:18.680 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.680 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:18.680 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:18.680 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:18.680 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.680 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:18.680 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:18.680 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.680 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.680 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:18.680 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:18.680 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.680 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.681 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:18.681 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:18.681 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:18.681 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:18.681 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:18.681 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.681 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.681 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:18.681 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:18.681 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:18.681 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.681 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:18.681 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.681 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:18.682 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.682 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:18.682 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.682 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(scope="package") 2023-12-03T13:00:18.682 INFO:teuthology.orchestra.run.smithi003.stdout: def configfile(): 2023-12-03T13:00:18.682 INFO:teuthology.orchestra.run.smithi003.stdout:> setup() 2023-12-03T13:00:18.682 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.682 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:309: 2023-12-03T13:00:18.682 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.682 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:272: in setup 2023-12-03T13:00:18.682 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:18.682 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:18.682 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:18.682 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:18.683 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:18.683 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:18.683 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:18.683 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:18.683 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:18.683 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:18.683 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:18.683 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:18.683 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:18.683 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:18.683 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:18.683 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:18.683 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:18.683 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:18.684 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:18.684 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:18.684 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:18.684 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:18.684 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:18.684 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:18.684 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:18.684 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:18.684 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:18.684 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:18.684 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:18.684 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:18.684 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:18.684 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:18.685 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:18.685 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:18.685 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:18.685 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:18.685 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:18.685 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:18.685 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:18.685 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.685 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.685 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.685 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:18.685 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.685 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:18.685 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.685 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:18.686 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:18.686 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:18.686 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:18.686 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:18.686 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:18.686 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.686 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:18.686 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:18.686 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:18.686 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:18.686 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:18.686 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:18.686 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.686 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:18.687 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:18.687 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:18.687 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:18.687 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:18.687 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:18.687 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:18.687 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:18.687 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:18.687 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:18.687 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:18.687 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.687 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.687 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:18.687 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:18.688 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:18.688 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:18.688 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:18.688 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.688 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.688 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:18.688 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:18.688 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:18.688 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:18.688 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:18.688 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.688 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:18.688 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:18.689 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:18.689 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:18.689 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:18.689 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:18.689 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.689 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:18.689 INFO:teuthology.orchestra.run.smithi003.stdout:__________________ ERROR at setup of test_complex_expressions __________________ 2023-12-03T13:00:18.689 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.689 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.689 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.689 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:18.689 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:18.689 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.690 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:18.690 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.690 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:18.690 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:18.690 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:18.690 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.690 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:18.690 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:18.690 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.690 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.690 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:18.690 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:18.691 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.691 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.691 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:18.691 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.691 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:18.691 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:18.691 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.691 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.691 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:18.691 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:18.691 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.691 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:18.691 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:18.691 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:18.692 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:18.692 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:18.692 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.692 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:18.692 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.692 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:18.692 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:18.692 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:18.692 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:18.692 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:18.692 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:18.692 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:18.692 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:18.693 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.693 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.693 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:18.693 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:18.693 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:18.693 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:18.693 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.693 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:18.693 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:18.693 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:18.693 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:18.693 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.693 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.693 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:18.693 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:18.694 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:18.694 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:18.694 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.694 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.694 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:18.694 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:18.694 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:18.694 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.694 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:18.694 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.694 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:18.694 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:18.695 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.695 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:18.695 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:18.695 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:18.695 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:18.695 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:18.695 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:18.695 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.695 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:18.695 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.695 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:18.695 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.696 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.696 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:18.696 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.696 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:18.696 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.696 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:18.696 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:18.696 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:18.696 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:18.696 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:18.696 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:18.696 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.696 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:18.696 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:18.697 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:18.697 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:18.697 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:18.697 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:18.697 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.697 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:18.697 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:18.697 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:18.697 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:18.697 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:18.697 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:18.697 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:18.697 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:18.697 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:18.698 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:18.698 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:18.698 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.698 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.698 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:18.698 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.698 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:18.698 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:18.698 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:18.698 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:18.698 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:18.698 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:18.698 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:18.699 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:18.699 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:18.699 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:18.699 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:18.699 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:18.699 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:18.699 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:18.699 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:18.699 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:18.699 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:18.699 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:18.699 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:18.699 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:18.699 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:18.700 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:18.700 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:18.700 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:18.700 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:18.700 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:18.700 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:18.700 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:18.700 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.700 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.700 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.700 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.700 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:18.700 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:18.700 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.701 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:18.701 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.701 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:18.701 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:18.701 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:18.701 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.701 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:18.701 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:18.701 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.701 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.701 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:18.701 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:18.702 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.702 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.702 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:18.702 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:18.702 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:18.702 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:18.702 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:18.702 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.702 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.702 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:18.702 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:18.702 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:18.703 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.703 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:18.703 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.703 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:18.703 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.703 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:18.703 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.703 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(scope="package") 2023-12-03T13:00:18.703 INFO:teuthology.orchestra.run.smithi003.stdout: def configfile(): 2023-12-03T13:00:18.703 INFO:teuthology.orchestra.run.smithi003.stdout:> setup() 2023-12-03T13:00:18.703 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.703 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:309: 2023-12-03T13:00:18.703 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.704 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:272: in setup 2023-12-03T13:00:18.704 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:18.704 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:18.704 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:18.704 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:18.704 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:18.704 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:18.704 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:18.704 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:18.704 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:18.704 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:18.704 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:18.704 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:18.705 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:18.705 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:18.705 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:18.705 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:18.705 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:18.705 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:18.705 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:18.705 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:18.705 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:18.705 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:18.705 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:18.705 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:18.705 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:18.705 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:18.706 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:18.706 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:18.706 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:18.706 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:18.706 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:18.706 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:18.706 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:18.706 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:18.706 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:18.706 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:18.706 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:18.706 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:18.706 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:18.707 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.707 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.707 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.707 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:18.707 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.707 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:18.707 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.707 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:18.707 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:18.707 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:18.707 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:18.707 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:18.707 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:18.707 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.708 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:18.708 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:18.708 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:18.708 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:18.708 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:18.708 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:18.708 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.708 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:18.708 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:18.708 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:18.708 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:18.708 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:18.708 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:18.709 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:18.709 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:18.709 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:18.709 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:18.709 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:18.709 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.709 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.709 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:18.709 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:18.709 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:18.709 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:18.709 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:18.709 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.709 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.710 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:18.710 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:18.710 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:18.710 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:18.710 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:18.710 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.710 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:18.710 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:18.710 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:18.710 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:18.710 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:18.710 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:18.710 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.710 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:18.711 INFO:teuthology.orchestra.run.smithi003.stdout:_________________________ ERROR at setup of test_alias _________________________ 2023-12-03T13:00:18.711 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.711 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.711 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.711 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:18.711 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:18.711 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.711 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:18.711 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.711 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:18.711 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:18.711 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:18.711 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.712 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:18.712 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:18.712 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.712 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.712 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:18.712 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:18.712 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.712 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.712 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:18.712 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.712 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:18.712 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:18.712 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.713 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.713 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:18.713 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:18.713 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.713 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:18.713 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:18.713 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:18.713 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:18.713 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:18.713 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.713 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:18.713 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.713 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:18.713 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:18.714 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:18.714 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:18.714 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:18.714 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:18.714 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:18.714 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:18.714 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.714 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.714 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:18.714 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:18.714 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:18.714 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:18.715 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.715 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:18.715 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:18.715 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:18.715 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:18.715 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.715 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.715 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:18.715 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:18.715 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:18.715 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:18.715 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.715 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.716 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:18.716 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:18.716 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:18.716 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.716 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:18.716 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.716 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:18.716 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:18.716 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.716 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:18.716 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:18.716 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:18.716 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:18.717 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:18.717 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:18.717 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.717 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:18.717 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.717 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:18.717 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.717 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.717 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:18.717 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.717 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:18.717 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.717 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:18.717 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:18.718 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:18.718 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:18.718 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:18.718 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:18.718 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.718 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:18.718 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:18.718 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:18.718 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:18.718 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:18.718 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:18.718 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.719 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:18.719 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:18.719 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:18.719 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:18.719 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:18.719 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:18.719 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:18.719 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:18.719 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:18.719 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:18.719 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:18.719 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.719 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.719 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:18.719 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.720 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:18.720 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:18.720 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:18.720 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:18.720 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:18.720 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:18.720 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:18.720 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:18.720 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:18.720 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:18.720 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:18.720 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:18.720 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:18.721 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:18.721 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:18.721 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:18.721 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:18.721 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:18.721 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:18.721 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:18.721 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:18.721 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:18.721 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:18.721 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:18.721 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:18.721 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:18.721 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:18.721 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:18.722 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.722 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.722 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.722 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.722 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:18.722 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:18.722 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.722 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:18.722 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.722 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:18.722 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:18.722 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:18.722 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.723 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:18.723 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:18.723 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.723 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.723 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:18.723 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:18.723 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.723 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.723 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:18.723 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:18.723 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:18.723 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:18.723 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:18.723 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.723 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.724 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:18.724 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:18.724 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:18.724 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.724 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:18.724 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.724 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:18.724 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.724 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:18.724 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.724 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(scope="package") 2023-12-03T13:00:18.724 INFO:teuthology.orchestra.run.smithi003.stdout: def configfile(): 2023-12-03T13:00:18.724 INFO:teuthology.orchestra.run.smithi003.stdout:> setup() 2023-12-03T13:00:18.724 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.725 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:309: 2023-12-03T13:00:18.725 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.725 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:272: in setup 2023-12-03T13:00:18.725 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:18.725 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:18.725 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:18.725 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:18.725 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:18.725 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:18.725 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:18.725 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:18.725 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:18.726 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:18.726 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:18.726 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:18.726 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:18.726 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:18.726 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:18.726 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:18.726 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:18.726 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:18.726 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:18.726 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:18.726 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:18.727 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:18.727 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:18.727 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:18.727 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:18.727 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:18.727 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:18.727 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:18.727 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:18.727 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:18.727 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:18.727 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:18.727 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:18.728 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:18.728 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:18.728 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:18.728 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:18.728 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:18.728 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:18.728 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.728 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.728 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.728 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:18.728 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.728 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:18.729 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.729 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:18.729 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:18.729 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:18.729 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:18.729 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:18.729 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:18.729 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.729 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:18.729 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:18.729 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:18.729 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:18.729 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:18.729 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:18.729 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.730 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:18.730 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:18.730 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:18.730 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:18.730 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:18.730 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:18.730 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:18.730 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:18.730 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:18.730 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:18.730 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:18.730 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.730 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.731 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:18.731 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:18.731 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:18.731 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:18.731 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:18.731 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.731 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.731 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:18.731 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:18.731 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:18.731 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:18.731 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:18.731 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.732 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:18.732 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:18.732 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:18.732 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:18.732 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:18.732 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:18.732 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.732 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:18.732 INFO:teuthology.orchestra.run.smithi003.stdout:_________________ ERROR at setup of test_alias_cyclic_refernce _________________ 2023-12-03T13:00:18.732 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.732 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.732 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.732 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:18.732 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:18.733 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.733 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:18.733 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.733 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:18.733 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:18.733 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:18.733 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.733 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:18.733 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:18.733 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.733 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.733 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:18.733 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:18.734 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.734 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.734 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:18.734 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.734 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:18.734 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:18.734 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.734 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.734 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:18.734 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:18.734 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.734 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:18.734 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:18.734 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:18.735 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:18.735 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:18.735 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.735 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:18.735 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.735 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:18.735 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:18.735 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:18.735 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:18.735 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:18.735 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:18.735 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:18.735 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:18.736 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.736 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.736 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:18.736 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:18.736 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:18.736 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:18.736 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.736 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:18.736 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:18.736 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:18.736 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:18.736 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.736 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.736 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:18.737 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:18.737 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:18.737 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:18.737 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.737 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.737 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:18.737 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:18.737 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:18.737 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.737 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:18.737 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.737 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:18.737 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:18.737 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.737 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:18.738 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:18.738 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:18.738 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:18.738 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:18.738 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:18.738 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.738 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:18.738 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.738 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:18.738 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.738 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.738 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:18.739 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.739 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:18.739 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.739 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:18.739 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:18.739 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:18.739 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:18.739 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:18.739 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:18.739 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.739 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:18.739 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:18.739 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:18.740 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:18.740 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:18.740 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:18.740 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.740 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:18.740 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:18.740 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:18.740 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:18.740 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:18.740 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:18.740 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:18.740 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:18.741 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:18.741 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:18.741 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:18.741 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.741 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.741 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:18.741 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.741 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:18.741 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:18.741 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:18.741 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:18.741 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:18.741 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:18.741 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:18.742 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:18.742 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:18.742 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:18.742 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:18.742 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:18.742 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:18.742 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:18.742 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:18.742 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:18.742 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:18.742 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:18.742 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:18.743 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:18.743 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:18.743 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:18.743 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:18.743 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:18.743 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:18.743 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:18.743 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:18.743 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:18.743 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.743 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.743 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.743 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.743 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:18.744 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:18.744 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.744 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:18.744 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.744 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:18.744 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:18.744 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:18.744 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.744 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:18.744 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:18.744 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.744 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.744 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:18.745 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:18.745 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.745 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.745 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:18.745 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:18.745 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:18.745 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:18.745 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:18.745 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.745 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.745 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:18.745 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:18.745 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:18.746 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.746 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:18.746 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.746 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:18.746 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.746 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:18.746 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.746 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(scope="package") 2023-12-03T13:00:18.746 INFO:teuthology.orchestra.run.smithi003.stdout: def configfile(): 2023-12-03T13:00:18.746 INFO:teuthology.orchestra.run.smithi003.stdout:> setup() 2023-12-03T13:00:18.746 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.746 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:309: 2023-12-03T13:00:18.746 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.747 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:272: in setup 2023-12-03T13:00:18.747 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:18.747 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:18.747 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:18.747 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:18.747 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:18.747 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:18.747 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:18.747 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:18.747 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:18.747 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:18.747 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:18.747 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:18.747 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:18.748 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:18.748 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:18.748 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:18.748 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:18.748 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:18.748 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:18.748 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:18.748 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:18.748 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:18.748 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:18.748 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:18.748 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:18.748 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:18.749 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:18.749 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:18.749 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:18.749 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:18.749 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:18.749 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:18.749 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:18.749 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:18.749 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:18.749 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:18.749 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:18.749 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:18.749 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:18.749 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.750 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.750 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.750 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:18.750 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.750 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:18.750 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.750 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:18.750 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:18.750 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:18.750 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:18.750 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:18.750 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:18.750 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.750 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:18.751 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:18.751 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:18.751 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:18.751 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:18.751 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:18.751 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.751 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:18.751 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:18.751 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:18.751 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:18.751 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:18.751 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:18.751 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:18.752 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:18.752 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:18.752 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:18.752 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:18.752 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.752 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.752 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:18.752 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:18.752 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:18.752 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:18.752 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:18.752 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.752 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.752 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:18.753 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:18.753 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:18.753 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:18.753 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:18.753 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.753 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:18.753 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:18.753 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:18.753 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:18.753 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:18.753 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:18.753 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.754 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:18.754 INFO:teuthology.orchestra.run.smithi003.stdout:_______________________ ERROR at setup of test_datetime ________________________ 2023-12-03T13:00:18.754 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.754 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.754 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.754 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:18.754 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:18.754 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.754 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:18.754 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.754 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:18.754 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:18.754 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:18.754 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.755 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:18.755 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:18.755 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.755 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.755 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:18.755 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:18.755 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.755 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.755 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:18.755 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.755 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:18.755 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:18.755 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.756 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.756 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:18.756 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:18.756 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.756 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:18.756 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:18.756 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:18.756 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:18.756 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:18.756 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.756 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:18.756 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.756 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:18.756 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:18.757 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:18.757 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:18.757 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:18.757 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:18.757 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:18.757 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:18.757 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.757 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.757 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:18.757 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:18.757 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:18.757 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:18.757 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.758 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:18.758 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:18.758 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:18.758 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:18.758 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.758 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.758 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:18.758 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:18.758 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:18.758 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:18.758 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.758 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.758 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:18.759 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:18.759 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:18.759 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.759 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:18.759 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.759 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:18.759 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:18.759 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.759 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:18.759 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:18.759 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:18.759 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:18.759 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:18.760 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:18.760 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.760 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:18.760 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.760 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:18.760 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.760 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.760 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:18.760 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.760 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:18.760 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.760 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:18.760 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:18.760 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:18.761 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:18.761 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:18.761 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:18.761 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.761 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:18.761 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:18.761 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:18.761 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:18.761 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:18.761 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:18.761 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.761 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:18.761 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:18.762 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:18.762 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:18.762 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:18.762 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:18.762 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:18.762 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:18.762 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:18.762 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:18.762 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:18.762 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.762 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.762 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:18.762 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.763 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:18.763 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:18.763 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:18.763 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:18.763 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:18.763 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:18.763 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:18.763 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:18.763 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:18.763 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:18.763 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:18.763 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:18.763 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:18.763 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:18.763 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:18.764 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:18.764 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:18.764 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:18.764 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:18.764 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:18.764 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:18.764 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:18.764 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:18.764 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:18.764 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:18.764 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:18.764 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:18.764 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:18.765 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.765 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.765 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.765 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.765 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:18.765 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:18.765 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.765 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:18.765 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.765 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:18.765 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:18.765 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:18.765 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.766 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:18.766 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:18.766 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.766 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.766 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:18.766 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:18.766 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.766 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.766 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:18.766 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:18.766 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:18.766 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:18.767 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:18.767 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.767 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.767 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:18.767 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:18.767 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:18.767 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.767 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:18.767 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.767 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:18.767 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.767 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:18.767 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.767 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(scope="package") 2023-12-03T13:00:18.768 INFO:teuthology.orchestra.run.smithi003.stdout: def configfile(): 2023-12-03T13:00:18.768 INFO:teuthology.orchestra.run.smithi003.stdout:> setup() 2023-12-03T13:00:18.768 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.768 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:309: 2023-12-03T13:00:18.768 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.768 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:272: in setup 2023-12-03T13:00:18.768 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:18.768 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:18.768 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:18.768 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:18.768 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:18.768 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:18.768 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:18.768 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:18.769 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:18.769 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:18.769 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:18.769 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:18.769 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:18.769 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:18.769 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:18.769 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:18.769 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:18.769 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:18.769 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:18.769 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:18.769 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:18.770 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:18.770 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:18.770 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:18.770 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:18.770 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:18.770 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:18.770 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:18.770 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:18.770 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:18.770 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:18.770 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:18.770 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:18.770 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:18.771 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:18.771 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:18.771 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:18.771 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:18.771 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:18.771 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.771 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.771 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.771 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:18.771 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.771 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:18.771 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.771 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:18.772 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:18.772 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:18.772 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:18.772 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:18.772 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:18.772 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.772 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:18.772 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:18.772 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:18.772 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:18.772 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:18.772 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:18.772 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.773 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:18.773 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:18.773 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:18.773 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:18.773 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:18.773 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:18.773 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:18.773 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:18.773 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:18.773 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:18.773 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:18.773 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.774 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.774 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:18.774 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:18.774 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:18.774 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:18.774 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:18.774 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.774 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.774 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:18.774 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:18.774 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:18.774 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:18.774 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:18.775 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.775 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:18.775 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:18.775 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:18.775 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:18.775 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:18.775 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:18.775 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.775 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:18.775 INFO:teuthology.orchestra.run.smithi003.stdout:__________________ ERROR at setup of test_true_false_datetime __________________ 2023-12-03T13:00:18.775 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.775 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.775 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.775 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:18.776 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:18.776 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.776 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:18.776 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.776 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:18.776 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:18.776 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:18.776 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.776 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:18.776 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:18.776 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.776 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.776 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:18.777 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:18.777 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.777 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.777 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:18.777 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.777 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:18.777 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:18.777 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.777 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.777 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:18.777 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:18.777 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.777 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:18.777 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:18.777 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:18.778 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:18.778 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:18.778 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.778 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:18.778 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.778 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:18.778 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:18.778 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:18.778 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:18.778 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:18.778 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:18.778 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:18.779 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:18.779 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.779 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.779 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:18.779 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:18.779 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:18.779 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:18.779 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.779 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:18.779 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:18.779 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:18.780 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:18.780 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.780 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.780 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:18.780 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:18.780 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:18.780 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:18.780 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.780 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.780 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:18.780 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:18.780 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:18.780 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.780 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:18.780 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.781 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:18.781 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:18.781 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.781 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:18.781 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:18.781 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:18.781 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:18.781 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:18.781 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:18.781 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.781 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:18.781 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.782 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:18.782 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.782 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.782 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:18.782 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.782 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:18.782 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.782 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:18.782 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:18.782 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:18.782 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:18.782 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:18.782 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:18.782 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.783 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:18.783 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:18.783 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:18.783 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:18.783 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:18.783 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:18.783 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.783 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:18.783 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:18.783 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:18.783 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:18.783 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:18.783 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:18.783 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:18.783 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:18.783 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:18.783 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:18.784 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:18.784 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.784 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.784 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:18.784 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.784 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:18.784 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:18.784 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:18.784 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:18.784 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:18.784 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:18.784 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:18.784 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:18.784 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:18.784 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:18.785 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:18.785 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:18.785 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:18.785 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:18.785 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:18.785 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:18.785 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:18.785 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:18.785 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:18.785 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:18.785 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:18.785 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:18.785 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:18.786 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:18.786 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:18.786 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:18.786 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:18.786 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:18.786 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.786 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.786 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.786 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.786 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:18.786 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:18.786 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.786 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:18.786 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.786 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:18.787 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:18.787 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:18.787 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.787 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:18.787 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:18.787 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.787 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.787 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:18.787 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:18.787 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.787 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.787 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:18.787 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:18.788 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:18.788 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:18.788 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:18.788 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.788 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.788 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:18.788 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:18.788 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:18.788 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.788 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:18.788 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.788 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:18.788 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.788 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:18.788 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.789 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(scope="package") 2023-12-03T13:00:18.789 INFO:teuthology.orchestra.run.smithi003.stdout: def configfile(): 2023-12-03T13:00:18.789 INFO:teuthology.orchestra.run.smithi003.stdout:> setup() 2023-12-03T13:00:18.789 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.789 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:309: 2023-12-03T13:00:18.789 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.789 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:272: in setup 2023-12-03T13:00:18.789 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:18.789 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:18.789 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:18.789 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:18.789 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:18.789 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:18.789 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:18.789 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:18.790 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:18.790 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:18.790 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:18.790 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:18.790 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:18.790 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:18.790 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:18.790 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:18.790 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:18.790 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:18.790 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:18.791 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:18.791 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:18.791 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:18.791 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:18.791 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:18.791 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:18.791 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:18.791 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:18.791 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:18.791 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:18.791 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:18.791 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:18.791 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:18.792 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:18.792 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:18.792 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:18.792 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:18.792 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:18.792 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:18.792 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:18.792 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.792 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.792 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.792 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:18.792 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.792 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:18.792 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.793 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:18.793 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:18.793 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:18.793 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:18.793 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:18.793 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:18.793 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.793 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:18.793 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:18.793 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:18.793 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:18.793 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:18.793 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:18.793 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.793 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:18.793 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:18.794 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:18.794 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:18.794 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:18.794 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:18.794 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:18.794 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:18.794 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:18.794 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:18.794 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:18.794 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.794 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.794 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:18.794 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:18.795 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:18.795 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:18.795 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:18.795 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.795 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.795 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:18.795 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:18.795 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:18.795 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:18.795 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:18.795 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.795 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:18.795 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:18.795 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:18.795 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:18.795 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:18.796 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:18.796 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.796 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:18.796 INFO:teuthology.orchestra.run.smithi003.stdout:______________________ ERROR at setup of test_csv_parser _______________________ 2023-12-03T13:00:18.796 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.796 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.796 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.796 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:18.796 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:18.796 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.796 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:18.796 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.796 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:18.797 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:18.797 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:18.797 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.797 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:18.797 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:18.797 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.797 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.797 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:18.797 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:18.797 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.797 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.797 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:18.797 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.797 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:18.797 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:18.797 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.798 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.798 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:18.798 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:18.798 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.798 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:18.798 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:18.798 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:18.798 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:18.798 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:18.798 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.798 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:18.798 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.798 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:18.798 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:18.798 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:18.799 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:18.799 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:18.799 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:18.799 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:18.799 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:18.799 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.799 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.799 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:18.799 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:18.799 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:18.799 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:18.799 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.800 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:18.800 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:18.800 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:18.800 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:18.800 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.800 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.800 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:18.800 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:18.800 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:18.800 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:18.800 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.800 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.800 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:18.800 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:18.800 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:18.801 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.801 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:18.801 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.801 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:18.801 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:18.801 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.801 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:18.801 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:18.801 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:18.801 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:18.801 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:18.801 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:18.801 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.802 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:18.802 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.802 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:18.802 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.802 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.802 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:18.802 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.802 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:18.802 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.802 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:18.802 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:18.802 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:18.802 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:18.802 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:18.803 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:18.803 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.803 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:18.803 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:18.803 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:18.803 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:18.803 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:18.803 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:18.803 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.803 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:18.803 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:18.803 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:18.803 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:18.803 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:18.804 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:18.804 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:18.804 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:18.804 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:18.804 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:18.804 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:18.804 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.804 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.804 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:18.804 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.804 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:18.804 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:18.804 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:18.805 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:18.805 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:18.805 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:18.805 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:18.805 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:18.805 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:18.805 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:18.805 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:18.805 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:18.805 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:18.805 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:18.805 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:18.805 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:18.805 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:18.806 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:18.806 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:18.806 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:18.806 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:18.806 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:18.806 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:18.806 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:18.806 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:18.806 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:18.806 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:18.806 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:18.806 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.806 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.806 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.807 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.807 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:18.807 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:18.807 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.807 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:18.807 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.807 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:18.807 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:18.807 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:18.807 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.807 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:18.807 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:18.807 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.807 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.807 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:18.808 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:18.808 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.808 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.808 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:18.808 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:18.808 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:18.808 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:18.808 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:18.808 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.808 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.808 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:18.808 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:18.808 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:18.809 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.809 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:18.809 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.809 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:18.809 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.809 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:18.809 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.809 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(scope="package") 2023-12-03T13:00:18.809 INFO:teuthology.orchestra.run.smithi003.stdout: def configfile(): 2023-12-03T13:00:18.809 INFO:teuthology.orchestra.run.smithi003.stdout:> setup() 2023-12-03T13:00:18.809 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.809 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:309: 2023-12-03T13:00:18.810 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.810 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:272: in setup 2023-12-03T13:00:18.810 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:18.810 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:18.810 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:18.810 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:18.810 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:18.810 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:18.810 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:18.810 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:18.810 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:18.810 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:18.810 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:18.811 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:18.811 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:18.811 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:18.811 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:18.811 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:18.811 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:18.811 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:18.811 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:18.811 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:18.811 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:18.811 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:18.811 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:18.811 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:18.812 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:18.812 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:18.812 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:18.812 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:18.812 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:18.812 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:18.812 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:18.812 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:18.812 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:18.812 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:18.812 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:18.812 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:18.812 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:18.812 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:18.813 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:18.813 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.813 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.813 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.813 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:18.813 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.813 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:18.813 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.813 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:18.813 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:18.813 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:18.813 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:18.813 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:18.813 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:18.813 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.814 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:18.814 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:18.814 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:18.814 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:18.814 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:18.814 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:18.814 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.814 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:18.814 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:18.814 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:18.814 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:18.814 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:18.814 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:18.814 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:18.815 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:18.815 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:18.815 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:18.815 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:18.815 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.815 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.815 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:18.815 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:18.815 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:18.815 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:18.815 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:18.815 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.815 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.815 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:18.815 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:18.816 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:18.816 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:18.816 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:18.816 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.816 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:18.816 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:18.816 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:18.816 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:18.816 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:18.816 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:18.816 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.816 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:18.816 INFO:teuthology.orchestra.run.smithi003.stdout:____________________ ERROR at setup of test_csv_definition _____________________ 2023-12-03T13:00:18.817 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.817 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.817 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.817 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:18.817 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:18.817 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.817 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:18.817 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.817 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:18.817 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:18.817 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:18.817 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.817 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:18.817 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:18.818 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.818 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.818 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:18.818 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:18.818 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.818 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.818 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:18.818 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.818 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:18.818 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:18.818 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.818 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.818 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:18.819 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:18.819 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.819 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:18.819 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:18.819 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:18.819 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:18.819 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:18.819 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.819 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:18.819 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.819 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:18.819 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:18.819 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:18.819 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:18.819 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:18.820 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:18.820 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:18.820 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:18.820 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.820 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.820 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:18.820 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:18.820 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:18.820 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:18.820 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.820 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:18.820 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:18.820 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:18.820 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:18.820 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.821 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.821 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:18.821 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:18.821 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:18.821 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:18.821 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.821 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.821 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:18.821 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:18.821 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:18.821 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.821 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:18.821 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.821 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:18.822 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:18.822 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.822 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:18.822 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:18.822 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:18.822 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:18.822 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:18.822 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:18.822 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.822 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:18.822 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.822 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:18.822 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.822 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.822 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:18.823 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.823 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:18.823 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.823 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:18.823 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:18.823 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:18.823 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:18.823 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:18.823 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:18.823 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.823 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:18.823 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:18.823 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:18.823 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:18.824 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:18.824 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:18.824 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.824 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:18.824 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:18.824 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:18.824 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:18.824 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:18.824 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:18.824 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:18.824 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:18.824 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:18.824 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:18.824 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:18.824 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.824 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.825 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:18.825 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.825 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:18.825 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:18.825 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:18.825 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:18.825 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:18.825 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:18.825 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:18.825 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:18.825 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:18.825 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:18.825 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:18.825 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:18.825 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:18.826 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:18.826 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:18.826 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:18.826 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:18.826 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:18.826 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:18.826 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:18.826 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:18.826 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:18.826 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:18.826 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:18.826 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:18.826 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:18.827 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:18.827 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:18.827 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.827 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.827 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.827 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.827 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:18.827 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:18.827 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.827 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:18.827 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.827 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:18.827 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:18.827 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:18.828 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.828 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:18.828 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:18.828 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.828 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.828 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:18.828 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:18.828 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.828 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.828 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:18.828 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:18.828 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:18.828 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:18.828 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:18.828 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.828 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.829 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:18.829 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:18.829 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:18.829 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.829 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:18.829 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.829 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:18.829 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.829 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:18.829 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.829 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(scope="package") 2023-12-03T13:00:18.829 INFO:teuthology.orchestra.run.smithi003.stdout: def configfile(): 2023-12-03T13:00:18.829 INFO:teuthology.orchestra.run.smithi003.stdout:> setup() 2023-12-03T13:00:18.829 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.830 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:309: 2023-12-03T13:00:18.830 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.830 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:272: in setup 2023-12-03T13:00:18.830 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:18.830 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:18.830 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:18.830 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:18.830 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:18.830 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:18.830 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:18.830 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:18.830 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:18.831 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:18.831 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:18.831 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:18.831 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:18.831 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:18.831 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:18.831 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:18.831 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:18.831 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:18.831 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:18.831 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:18.831 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:18.831 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:18.831 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:18.831 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:18.832 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:18.832 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:18.832 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:18.832 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:18.832 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:18.832 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:18.832 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:18.832 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:18.832 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:18.832 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:18.832 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:18.832 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:18.832 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:18.832 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:18.833 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:18.833 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.833 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.833 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.833 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:18.833 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.833 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:18.833 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.833 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:18.833 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:18.833 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:18.833 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:18.833 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:18.833 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:18.833 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.833 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:18.834 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:18.834 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:18.834 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:18.834 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:18.834 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:18.834 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.834 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:18.834 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:18.834 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:18.834 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:18.834 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:18.834 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:18.834 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:18.835 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:18.835 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:18.835 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:18.835 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:18.835 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.835 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.835 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:18.835 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:18.835 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:18.835 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:18.835 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:18.835 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.835 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.835 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:18.835 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:18.836 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:18.836 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:18.836 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:18.836 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.836 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:18.836 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:18.836 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:18.836 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:18.836 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:18.836 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:18.836 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.836 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:18.836 INFO:teuthology.orchestra.run.smithi003.stdout:___________________ ERROR at setup of test_schema_definition ___________________ 2023-12-03T13:00:18.836 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.837 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.837 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.837 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:18.837 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:18.837 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.837 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:18.837 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.837 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:18.837 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:18.837 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:18.837 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.837 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:18.837 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:18.837 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.837 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.837 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:18.838 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:18.838 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.838 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.838 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:18.838 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.838 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:18.838 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:18.838 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.838 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.838 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:18.838 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:18.838 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.838 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:18.839 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:18.839 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:18.839 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:18.839 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:18.839 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.839 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:18.839 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.839 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:18.839 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:18.839 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:18.839 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:18.839 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:18.839 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:18.839 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:18.839 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:18.839 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.840 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.840 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:18.840 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:18.840 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:18.840 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:18.840 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.840 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:18.840 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:18.840 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:18.840 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:18.840 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.840 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.840 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:18.840 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:18.841 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:18.841 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:18.841 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.841 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.841 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:18.841 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:18.841 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:18.841 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.841 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:18.841 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.841 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:18.841 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:18.841 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.842 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:18.842 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:18.842 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:18.842 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:18.842 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:18.842 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:18.842 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.842 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:18.842 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.842 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:18.842 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.842 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.842 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:18.842 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.842 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:18.843 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.843 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:18.843 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:18.843 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:18.843 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:18.843 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:18.843 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:18.843 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.843 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:18.843 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:18.843 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:18.843 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:18.843 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:18.843 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:18.844 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.844 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:18.844 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:18.844 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:18.844 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:18.844 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:18.844 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:18.844 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:18.844 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:18.844 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:18.844 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:18.844 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:18.844 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.845 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.845 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:18.845 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.845 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:18.845 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:18.845 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:18.845 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:18.845 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:18.845 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:18.845 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:18.845 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:18.845 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:18.845 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:18.846 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:18.846 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:18.846 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:18.846 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:18.846 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:18.846 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:18.846 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:18.846 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:18.846 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:18.846 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:18.846 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:18.846 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:18.846 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:18.846 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:18.847 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:18.847 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:18.847 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:18.847 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:18.847 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.847 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.847 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.847 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.847 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:18.847 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:18.847 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.847 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:18.847 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.847 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:18.847 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:18.848 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:18.848 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.848 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:18.848 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:18.848 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.848 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.848 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:18.848 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:18.848 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.848 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.848 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:18.848 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:18.848 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:18.848 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:18.848 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:18.849 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.849 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.849 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:18.849 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:18.849 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:18.849 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.849 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:18.849 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.849 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:18.849 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.849 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:18.849 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.849 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(scope="package") 2023-12-03T13:00:18.849 INFO:teuthology.orchestra.run.smithi003.stdout: def configfile(): 2023-12-03T13:00:18.850 INFO:teuthology.orchestra.run.smithi003.stdout:> setup() 2023-12-03T13:00:18.850 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.850 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:309: 2023-12-03T13:00:18.850 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.850 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:272: in setup 2023-12-03T13:00:18.850 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:18.850 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:18.850 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:18.850 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:18.850 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:18.850 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:18.850 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:18.850 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:18.850 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:18.851 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:18.851 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:18.851 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:18.851 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:18.851 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:18.851 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:18.851 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:18.851 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:18.851 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:18.851 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:18.851 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:18.851 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:18.851 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:18.851 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:18.851 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:18.851 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:18.852 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:18.852 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:18.852 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:18.852 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:18.852 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:18.852 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:18.852 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:18.852 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:18.852 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:18.852 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:18.852 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:18.852 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:18.853 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:18.853 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:18.853 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.853 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.853 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.853 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:18.853 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.853 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:18.853 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.853 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:18.853 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:18.853 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:18.853 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:18.853 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:18.854 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:18.854 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.854 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:18.854 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:18.854 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:18.854 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:18.854 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:18.854 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:18.854 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.854 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:18.854 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:18.854 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:18.854 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:18.855 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:18.855 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:18.855 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:18.855 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:18.855 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:18.855 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:18.855 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:18.855 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.855 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.855 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:18.855 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:18.855 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:18.855 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:18.855 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:18.855 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.856 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.856 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:18.856 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:18.856 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:18.856 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:18.856 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:18.856 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.856 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:18.856 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:18.856 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:18.856 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:18.856 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:18.856 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:18.856 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.856 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:18.857 INFO:teuthology.orchestra.run.smithi003.stdout:______________ ERROR at setup of test_when_then_else_expressions _______________ 2023-12-03T13:00:18.857 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.857 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.857 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.857 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:18.857 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:18.857 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.857 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:18.857 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.858 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:18.858 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:18.858 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:18.858 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.858 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:18.858 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:18.858 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.859 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.859 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:18.859 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:18.859 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.859 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.859 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:18.859 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.859 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:18.859 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:18.859 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.860 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.860 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:18.860 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:18.860 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.860 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:18.860 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:18.860 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:18.860 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:18.860 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:18.860 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.861 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:18.861 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.861 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:18.861 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:18.861 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:18.861 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:18.861 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:18.861 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:18.861 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:18.861 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:18.861 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.861 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.862 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:18.862 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:18.862 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:18.862 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:18.862 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.862 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:18.862 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:18.862 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:18.862 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:18.862 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.862 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.862 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:18.862 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:18.862 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:18.863 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:18.863 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.863 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.863 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:18.863 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:18.863 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:18.863 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.863 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:18.863 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.863 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:18.863 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:18.863 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.863 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:18.863 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:18.864 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:18.864 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:18.864 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:18.864 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:18.864 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.864 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:18.864 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.864 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:18.865 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.865 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.865 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:18.865 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.865 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:18.865 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.865 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:18.865 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:18.866 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:18.866 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:18.866 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:18.866 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:18.866 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.866 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:18.866 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:18.867 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:18.867 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:18.867 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:18.867 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:18.867 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.867 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:18.867 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:18.867 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:18.868 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:18.868 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:18.868 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:18.868 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:18.868 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:18.868 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:18.868 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:18.868 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:18.869 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.869 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.869 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:18.869 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.869 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:18.869 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:18.870 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:18.870 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:18.870 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:18.870 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:18.870 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:18.870 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:18.870 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:18.871 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:18.871 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:18.871 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:18.871 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:18.871 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:18.871 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:18.871 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:18.872 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:18.872 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:18.872 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:18.872 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:18.872 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:18.872 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:18.872 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:18.873 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:18.873 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:18.873 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:18.873 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:18.873 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:18.873 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.873 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.874 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.874 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.874 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:18.874 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:18.874 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.874 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:18.874 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.875 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:18.875 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:18.875 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:18.875 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.875 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:18.875 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:18.875 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.876 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.876 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:18.876 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:18.876 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.876 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.876 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:18.877 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:18.877 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:18.877 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:18.877 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:18.877 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.877 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.877 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:18.878 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:18.878 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:18.878 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.878 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:18.878 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.878 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:18.878 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.879 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:18.879 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.879 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(scope="package") 2023-12-03T13:00:18.879 INFO:teuthology.orchestra.run.smithi003.stdout: def configfile(): 2023-12-03T13:00:18.879 INFO:teuthology.orchestra.run.smithi003.stdout:> setup() 2023-12-03T13:00:18.879 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.879 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:309: 2023-12-03T13:00:18.880 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.880 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:272: in setup 2023-12-03T13:00:18.880 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:18.880 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:18.880 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:18.880 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:18.880 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:18.881 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:18.881 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:18.881 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:18.881 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:18.881 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:18.881 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:18.882 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:18.882 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:18.882 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:18.882 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:18.882 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:18.882 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:18.882 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:18.883 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:18.883 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:18.883 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:18.883 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:18.883 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:18.883 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:18.883 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:18.884 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:18.884 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:18.884 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:18.884 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:18.884 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:18.884 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:18.884 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:18.885 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:18.885 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:18.885 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:18.885 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:18.885 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:18.885 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:18.885 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:18.886 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.886 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.886 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.886 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:18.886 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.886 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:18.886 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.887 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:18.887 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:18.887 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:18.887 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:18.887 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:18.887 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:18.887 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.887 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:18.887 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:18.887 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:18.888 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:18.888 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:18.888 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:18.888 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.888 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:18.888 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:18.888 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:18.888 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:18.888 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:18.888 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:18.888 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:18.888 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:18.888 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:18.889 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:18.889 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:18.889 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.889 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.889 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:18.889 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:18.889 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:18.889 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:18.889 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:18.889 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.889 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.889 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:18.889 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:18.889 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:18.890 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:18.890 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:18.890 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.890 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:18.890 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:18.890 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:18.890 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:18.890 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:18.890 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:18.890 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.890 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:18.891 INFO:teuthology.orchestra.run.smithi003.stdout:_________________ ERROR at setup of test_coalesce_expressions __________________ 2023-12-03T13:00:18.891 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.891 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.891 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.891 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:18.891 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:18.891 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.891 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:18.891 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.891 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:18.891 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:18.891 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:18.891 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.892 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:18.892 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:18.892 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.892 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.892 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:18.892 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:18.892 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.892 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.892 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:18.892 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.892 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:18.892 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:18.892 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.892 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.892 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:18.893 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:18.893 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.893 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:18.893 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:18.893 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:18.893 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:18.893 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:18.893 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.893 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:18.893 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.893 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:18.893 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:18.894 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:18.894 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:18.894 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:18.894 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:18.894 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:18.894 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:18.894 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.894 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.894 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:18.894 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:18.894 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:18.894 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:18.894 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.894 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:18.895 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:18.895 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:18.895 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:18.895 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.895 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.895 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:18.895 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:18.895 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:18.895 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:18.895 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.895 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.895 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:18.895 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:18.896 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:18.896 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.896 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:18.896 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.896 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:18.896 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:18.896 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.896 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:18.896 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:18.896 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:18.896 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:18.896 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:18.896 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:18.896 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.897 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:18.897 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.897 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:18.897 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.897 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.897 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:18.897 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.897 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:18.897 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.897 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:18.897 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:18.897 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:18.897 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:18.897 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:18.897 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:18.897 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.898 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:18.898 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:18.898 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:18.898 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:18.898 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:18.898 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:18.898 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.898 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:18.898 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:18.898 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:18.898 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:18.898 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:18.899 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:18.899 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:18.899 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:18.899 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:18.899 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:18.899 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:18.899 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.899 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.899 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:18.899 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.899 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:18.899 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:18.899 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:18.899 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:18.900 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:18.900 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:18.900 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:18.900 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:18.900 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:18.900 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:18.900 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:18.900 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:18.900 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:18.900 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:18.900 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:18.900 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:18.900 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:18.901 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:18.901 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:18.901 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:18.901 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:18.901 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:18.901 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:18.901 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:18.901 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:18.901 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:18.901 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:18.901 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:18.901 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.901 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.901 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.902 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.902 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:18.902 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:18.902 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.902 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:18.902 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.902 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:18.902 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:18.902 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:18.902 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.903 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:18.903 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:18.903 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.903 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.903 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:18.903 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:18.903 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.903 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.903 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:18.903 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:18.904 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:18.904 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:18.904 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:18.904 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.904 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.904 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:18.904 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:18.904 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:18.904 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.904 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:18.904 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.904 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:18.904 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.905 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:18.905 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.905 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(scope="package") 2023-12-03T13:00:18.905 INFO:teuthology.orchestra.run.smithi003.stdout: def configfile(): 2023-12-03T13:00:18.905 INFO:teuthology.orchestra.run.smithi003.stdout:> setup() 2023-12-03T13:00:18.905 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.905 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:309: 2023-12-03T13:00:18.905 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.905 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:272: in setup 2023-12-03T13:00:18.905 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:18.905 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:18.905 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:18.905 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:18.905 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:18.905 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:18.906 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:18.906 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:18.906 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:18.906 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:18.906 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:18.906 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:18.906 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:18.906 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:18.906 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:18.906 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:18.906 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:18.906 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:18.906 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:18.906 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:18.907 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:18.907 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:18.907 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:18.907 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:18.907 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:18.907 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:18.907 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:18.907 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:18.908 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:18.908 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:18.908 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:18.908 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:18.908 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:18.908 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:18.908 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:18.908 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:18.908 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:18.908 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:18.908 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:18.908 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.908 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.908 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.909 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:18.909 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.909 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:18.909 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.909 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:18.909 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:18.909 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:18.909 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:18.909 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:18.909 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:18.909 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.909 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:18.909 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:18.909 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:18.909 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:18.910 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:18.910 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:18.910 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.910 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:18.910 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:18.910 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:18.910 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:18.910 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:18.910 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:18.910 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:18.910 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:18.910 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:18.910 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:18.910 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:18.911 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.911 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.911 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:18.911 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:18.911 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:18.911 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:18.911 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:18.911 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.911 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.911 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:18.911 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:18.911 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:18.911 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:18.911 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:18.912 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.912 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:18.912 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:18.912 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:18.912 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:18.912 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:18.912 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:18.912 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.913 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:18.913 INFO:teuthology.orchestra.run.smithi003.stdout:___________________ ERROR at setup of test_cast_expressions ____________________ 2023-12-03T13:00:18.913 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.913 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.913 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.913 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:18.913 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:18.913 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.913 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:18.913 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.913 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:18.913 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:18.913 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:18.913 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.914 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:18.914 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:18.914 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.914 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.914 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:18.914 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:18.914 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.914 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.914 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:18.914 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.914 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:18.914 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:18.914 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.915 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.915 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:18.915 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:18.915 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.915 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:18.915 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:18.915 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:18.915 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:18.915 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:18.915 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.915 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:18.915 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.915 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:18.915 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:18.915 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:18.915 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:18.916 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:18.916 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:18.916 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:18.916 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:18.916 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.916 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.916 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:18.916 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:18.916 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:18.916 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:18.916 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.916 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:18.916 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:18.917 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:18.917 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:18.917 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.917 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.917 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:18.917 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:18.917 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:18.917 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:18.917 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.917 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.917 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:18.917 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:18.917 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:18.918 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.918 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:18.918 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.918 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:18.918 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:18.918 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.918 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:18.918 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:18.918 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:18.918 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:18.918 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:18.918 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:18.918 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.918 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:18.919 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.919 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:18.919 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.919 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.919 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:18.919 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.919 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:18.919 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.919 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:18.919 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:18.919 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:18.919 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:18.919 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:18.919 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:18.920 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.920 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:18.920 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:18.920 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:18.920 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:18.920 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:18.920 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:18.920 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.920 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:18.920 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:18.920 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:18.920 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:18.920 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:18.920 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:18.921 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:18.921 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:18.921 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:18.921 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:18.921 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:18.921 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.921 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.921 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:18.921 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.921 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:18.921 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:18.921 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:18.921 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:18.921 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:18.922 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:18.922 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:18.922 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:18.922 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:18.922 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:18.922 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:18.922 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:18.922 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:18.922 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:18.922 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:18.922 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:18.922 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:18.922 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:18.922 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:18.923 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:18.923 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:18.923 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:18.923 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:18.923 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:18.923 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:18.923 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:18.923 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:18.923 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:18.923 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.923 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.923 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.923 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.923 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:18.923 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:18.924 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.924 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:18.924 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.924 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:18.924 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:18.924 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:18.924 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.924 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:18.924 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:18.924 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.924 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.924 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:18.924 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:18.924 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.924 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.925 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:18.925 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:18.925 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:18.925 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:18.925 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:18.925 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.925 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.925 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:18.925 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:18.925 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:18.925 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.925 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:18.925 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.926 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:18.926 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.926 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:18.926 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.926 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(scope="package") 2023-12-03T13:00:18.926 INFO:teuthology.orchestra.run.smithi003.stdout: def configfile(): 2023-12-03T13:00:18.926 INFO:teuthology.orchestra.run.smithi003.stdout:> setup() 2023-12-03T13:00:18.926 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.926 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:309: 2023-12-03T13:00:18.926 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.926 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:272: in setup 2023-12-03T13:00:18.926 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:18.926 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:18.926 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:18.927 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:18.927 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:18.927 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:18.927 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:18.927 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:18.927 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:18.927 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:18.927 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:18.927 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:18.927 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:18.927 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:18.927 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:18.927 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:18.927 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:18.928 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:18.928 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:18.928 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:18.928 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:18.928 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:18.928 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:18.928 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:18.928 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:18.928 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:18.928 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:18.928 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:18.928 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:18.928 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:18.928 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:18.928 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:18.929 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:18.929 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:18.929 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:18.929 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:18.929 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:18.929 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:18.929 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:18.929 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.929 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.929 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.929 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:18.929 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.930 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:18.930 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.930 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:18.930 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:18.930 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:18.930 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:18.930 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:18.930 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:18.930 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.930 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:18.930 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:18.930 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:18.930 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:18.931 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:18.931 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:18.931 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.931 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:18.931 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:18.931 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:18.931 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:18.931 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:18.931 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:18.931 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:18.931 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:18.931 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:18.931 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:18.932 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:18.932 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.932 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.932 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:18.932 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:18.932 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:18.932 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:18.932 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:18.932 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.932 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.932 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:18.932 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:18.932 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:18.932 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:18.932 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:18.933 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.933 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:18.933 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:18.933 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:18.933 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:18.933 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:18.933 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:18.933 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.933 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:18.933 INFO:teuthology.orchestra.run.smithi003.stdout:________________________ ERROR at setup of test_version ________________________ 2023-12-03T13:00:18.933 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.933 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.933 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.933 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:18.934 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:18.934 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.934 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:18.934 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.934 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:18.934 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:18.934 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:18.934 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.934 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:18.934 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:18.934 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.934 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.934 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:18.935 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:18.935 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.935 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.935 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:18.935 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.935 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:18.935 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:18.935 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.935 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.935 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:18.935 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:18.935 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.935 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:18.935 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:18.936 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:18.936 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:18.936 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:18.936 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.936 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:18.936 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.936 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:18.936 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:18.936 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:18.936 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:18.936 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:18.936 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:18.936 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:18.936 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:18.937 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.937 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.937 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:18.937 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:18.937 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:18.937 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:18.937 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.937 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:18.937 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:18.937 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:18.937 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:18.937 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.937 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.937 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:18.937 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:18.938 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:18.938 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:18.938 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.938 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.938 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:18.938 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:18.938 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:18.938 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.938 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:18.938 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.938 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:18.938 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:18.938 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.939 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:18.939 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:18.939 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:18.939 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:18.939 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:18.939 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:18.939 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.939 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:18.939 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.939 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:18.939 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.939 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.939 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:18.939 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.940 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:18.940 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.940 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:18.940 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:18.940 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:18.940 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:18.940 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:18.940 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:18.940 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.940 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:18.940 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:18.940 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:18.940 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:18.940 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:18.941 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:18.941 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.941 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:18.941 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:18.941 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:18.941 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:18.941 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:18.941 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:18.941 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:18.941 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:18.941 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:18.941 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:18.941 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:18.941 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.942 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.942 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:18.942 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.942 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:18.942 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:18.942 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:18.942 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:18.942 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:18.942 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:18.942 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:18.942 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:18.942 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:18.943 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:18.943 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:18.943 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:18.943 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:18.943 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:18.943 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:18.943 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:18.943 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:18.943 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:18.943 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:18.943 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:18.943 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:18.943 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:18.944 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:18.944 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:18.944 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:18.944 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:18.944 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:18.944 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:18.944 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.944 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.944 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.944 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.944 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:18.944 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:18.944 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.944 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:18.945 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.945 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:18.945 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:18.945 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:18.945 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.945 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:18.945 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:18.945 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.945 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.945 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:18.945 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:18.945 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.945 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.945 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:18.946 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:18.946 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:18.946 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:18.946 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:18.946 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.946 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.946 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:18.946 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:18.946 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:18.946 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.946 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:18.946 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.946 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:18.946 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.947 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:18.947 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.947 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(scope="package") 2023-12-03T13:00:18.947 INFO:teuthology.orchestra.run.smithi003.stdout: def configfile(): 2023-12-03T13:00:18.947 INFO:teuthology.orchestra.run.smithi003.stdout:> setup() 2023-12-03T13:00:18.947 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.947 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:309: 2023-12-03T13:00:18.947 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.947 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:272: in setup 2023-12-03T13:00:18.947 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:18.947 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:18.947 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:18.947 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:18.947 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:18.948 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:18.948 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:18.948 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:18.948 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:18.948 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:18.948 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:18.948 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:18.948 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:18.948 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:18.948 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:18.948 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:18.948 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:18.948 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:18.948 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:18.949 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:18.949 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:18.949 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:18.949 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:18.949 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:18.949 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:18.949 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:18.949 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:18.949 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:18.949 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:18.949 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:18.949 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:18.949 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:18.949 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:18.950 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:18.950 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:18.950 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:18.950 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:18.950 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:18.950 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:18.950 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.950 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.950 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.950 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:18.950 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.950 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:18.950 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.951 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:18.951 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:18.951 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:18.951 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:18.951 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:18.951 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:18.951 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.951 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:18.951 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:18.951 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:18.951 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:18.951 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:18.952 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:18.952 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.952 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:18.952 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:18.952 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:18.952 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:18.952 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:18.952 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:18.952 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:18.952 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:18.952 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:18.952 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:18.952 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:18.953 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.953 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.953 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:18.953 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:18.953 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:18.953 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:18.953 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:18.953 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.953 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.953 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:18.953 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:18.953 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:18.953 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:18.953 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:18.954 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.954 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:18.954 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:18.954 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:18.954 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:18.954 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:18.954 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:18.954 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.954 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:18.954 INFO:teuthology.orchestra.run.smithi003.stdout:___________________ ERROR at setup of test_trim_expressions ____________________ 2023-12-03T13:00:18.954 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.954 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.954 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.954 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:18.955 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:18.955 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.955 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:18.955 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.955 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:18.955 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:18.955 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:18.955 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.955 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:18.955 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:18.955 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.955 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.956 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:18.956 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:18.956 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.956 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.956 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:18.956 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.956 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:18.956 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:18.956 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.956 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.956 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:18.956 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:18.956 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.956 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:18.956 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:18.957 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:18.957 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:18.957 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:18.957 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.957 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:18.957 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.957 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:18.957 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:18.957 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:18.957 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:18.957 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:18.957 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:18.957 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:18.958 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:18.958 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.958 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.958 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:18.958 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:18.958 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:18.958 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:18.958 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.958 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:18.958 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:18.958 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:18.958 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:18.958 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.959 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.959 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:18.959 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:18.959 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:18.959 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:18.959 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.959 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.959 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:18.959 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:18.959 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:18.959 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.959 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:18.959 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.959 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:18.960 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:18.960 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.960 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:18.960 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:18.960 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:18.960 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:18.960 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:18.960 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:18.960 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.960 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:18.960 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.960 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:18.960 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.960 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.961 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:18.961 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.961 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:18.961 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.961 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:18.961 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:18.961 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:18.961 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:18.961 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:18.961 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:18.961 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.961 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:18.961 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:18.962 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:18.962 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:18.962 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:18.962 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:18.962 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.962 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:18.962 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:18.962 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:18.962 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:18.962 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:18.962 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:18.962 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:18.962 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:18.963 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:18.963 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:18.963 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:18.963 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.963 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.963 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:18.963 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.963 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:18.963 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:18.963 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:18.963 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:18.963 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:18.963 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:18.963 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:18.963 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:18.964 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:18.964 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:18.964 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:18.964 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:18.964 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:18.964 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:18.964 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:18.964 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:18.964 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:18.964 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:18.964 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:18.964 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:18.964 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:18.964 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:18.965 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:18.965 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:18.965 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:18.965 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:18.965 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:18.965 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:18.965 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.965 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.965 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.965 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.965 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:18.965 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:18.965 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.965 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:18.965 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.966 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:18.966 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:18.966 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:18.966 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.966 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:18.966 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:18.966 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.966 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.966 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:18.966 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:18.966 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.966 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.966 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:18.967 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:18.967 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:18.967 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:18.967 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:18.967 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.967 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.967 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:18.967 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:18.967 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:18.967 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.967 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:18.967 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.967 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:18.967 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.968 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:18.968 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.968 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(scope="package") 2023-12-03T13:00:18.968 INFO:teuthology.orchestra.run.smithi003.stdout: def configfile(): 2023-12-03T13:00:18.968 INFO:teuthology.orchestra.run.smithi003.stdout:> setup() 2023-12-03T13:00:18.968 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.968 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:309: 2023-12-03T13:00:18.968 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.968 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:272: in setup 2023-12-03T13:00:18.968 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:18.969 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:18.969 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:18.969 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:18.969 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:18.969 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:18.969 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:18.969 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:18.969 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:18.969 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:18.969 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:18.969 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:18.969 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:18.969 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:18.970 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:18.970 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:18.970 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:18.970 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:18.970 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:18.970 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:18.970 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:18.970 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:18.970 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:18.970 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:18.970 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:18.970 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:18.970 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:18.971 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:18.971 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:18.971 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:18.971 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:18.971 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:18.971 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:18.971 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:18.971 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:18.971 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:18.971 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:18.971 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:18.971 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:18.972 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.972 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.972 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.972 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:18.972 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.972 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:18.972 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.972 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:18.972 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:18.972 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:18.972 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:18.972 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:18.972 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:18.972 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.973 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:18.973 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:18.973 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:18.973 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:18.973 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:18.973 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:18.973 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.973 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:18.973 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:18.973 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:18.973 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:18.973 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:18.973 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:18.974 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:18.974 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:18.974 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:18.974 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:18.974 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:18.974 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.974 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.974 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:18.974 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:18.974 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:18.974 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:18.974 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:18.974 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.975 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.975 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:18.975 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:18.975 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:18.975 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:18.975 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:18.975 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.975 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:18.975 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:18.975 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:18.975 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:18.975 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:18.975 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:18.975 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.976 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:18.976 INFO:teuthology.orchestra.run.smithi003.stdout:______________ ERROR at setup of test_truefalse_trim_expressions _______________ 2023-12-03T13:00:18.976 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.976 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.976 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.976 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:18.976 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:18.976 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.976 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:18.976 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.976 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:18.976 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:18.976 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:18.977 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.977 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:18.977 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:18.977 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.977 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.977 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:18.977 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:18.977 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.977 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.977 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:18.977 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.977 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:18.977 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:18.977 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.977 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.978 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:18.978 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:18.978 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.978 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:18.978 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:18.978 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:18.978 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:18.978 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:18.978 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.978 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:18.978 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.978 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:18.979 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:18.979 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:18.979 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:18.979 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:18.979 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:18.979 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:18.979 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:18.979 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.979 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.979 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:18.979 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:18.979 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:18.979 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:18.979 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.980 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:18.980 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:18.980 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:18.980 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:18.980 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.980 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.980 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:18.980 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:18.980 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:18.980 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:18.980 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.980 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.981 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:18.981 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:18.981 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:18.981 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.981 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:18.981 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.981 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:18.981 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:18.981 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.981 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:18.981 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:18.981 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:18.981 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:18.982 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:18.982 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:18.982 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.982 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:18.982 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.982 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:18.982 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.982 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.982 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:18.982 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.982 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:18.983 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.983 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:18.983 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:18.983 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:18.983 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:18.983 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:18.983 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:18.983 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.983 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:18.983 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:18.983 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:18.983 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:18.983 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:18.983 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:18.984 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.984 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:18.984 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:18.984 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:18.984 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:18.984 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:18.984 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:18.984 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:18.984 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:18.984 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:18.984 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:18.984 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:18.984 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.985 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.985 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:18.985 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.985 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:18.985 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:18.985 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:18.985 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:18.985 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:18.985 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:18.985 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:18.985 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:18.985 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:18.985 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:18.985 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:18.985 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:18.986 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:18.986 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:18.986 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:18.986 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:18.986 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:18.986 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:18.986 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:18.986 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:18.986 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:18.986 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:18.986 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:18.986 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:18.986 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:18.986 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:18.987 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:18.987 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:18.987 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.987 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.987 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.987 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.987 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:18.987 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:18.987 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.987 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:18.987 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.987 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:18.987 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:18.987 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:18.988 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.988 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:18.988 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:18.988 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.988 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.988 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:18.988 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:18.988 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.988 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.988 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:18.988 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:18.988 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:18.988 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:18.988 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:18.989 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.989 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.989 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:18.989 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:18.989 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:18.989 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.989 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:18.989 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.989 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:18.989 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.989 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:18.989 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.989 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(scope="package") 2023-12-03T13:00:18.989 INFO:teuthology.orchestra.run.smithi003.stdout: def configfile(): 2023-12-03T13:00:18.990 INFO:teuthology.orchestra.run.smithi003.stdout:> setup() 2023-12-03T13:00:18.990 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.990 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:309: 2023-12-03T13:00:18.990 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.990 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:272: in setup 2023-12-03T13:00:18.990 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:18.990 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:18.990 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:18.990 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:18.990 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:18.990 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:18.990 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:18.990 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:18.991 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:18.991 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:18.991 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:18.991 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:18.991 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:18.991 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:18.991 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:18.991 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:18.991 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:18.991 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:18.991 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:18.991 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:18.991 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:18.992 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:18.992 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:18.992 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:18.992 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:18.992 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:18.992 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:18.992 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:18.992 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:18.992 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:18.992 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:18.992 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:18.992 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:18.992 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:18.993 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:18.993 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:18.993 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:18.993 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:18.993 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:18.993 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.993 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.993 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.993 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:18.993 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.993 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:18.993 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.993 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:18.993 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:18.994 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:18.994 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:18.994 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:18.994 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:18.994 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.994 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:18.994 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:18.994 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:18.994 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:18.994 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:18.994 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:18.994 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.994 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:18.994 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:18.994 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:18.995 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:18.995 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:18.995 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:18.995 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:18.995 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:18.995 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:18.995 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:18.995 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:18.995 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.995 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.995 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:18.995 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:18.995 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:18.996 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:18.996 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:18.996 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.996 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.996 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:18.996 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:18.996 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:18.996 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:18.996 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:18.996 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.996 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:18.996 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:18.996 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:18.996 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:18.997 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:18.997 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:18.997 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.997 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:18.997 INFO:teuthology.orchestra.run.smithi003.stdout:__________________ ERROR at setup of test_escape_expressions ___________________ 2023-12-03T13:00:18.997 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.997 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:18.997 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.997 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:18.997 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:18.997 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.997 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:18.997 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:18.997 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:18.997 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:18.998 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:18.998 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.998 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:18.998 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:18.998 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.998 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:18.998 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:18.998 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:18.998 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:18.998 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.998 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:18.998 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.998 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:18.998 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:18.998 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:18.998 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.999 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:18.999 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:18.999 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.999 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:18.999 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:18.999 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:18.999 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:18.999 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:18.999 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:18.999 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:18.999 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:18.999 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:18.999 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:19.000 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:19.000 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:19.000 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:19.000 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:19.000 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:19.000 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:19.000 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.000 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.000 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:19.000 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:19.000 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:19.000 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:19.000 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.000 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:19.001 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:19.001 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:19.001 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:19.001 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.001 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.001 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:19.001 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:19.001 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:19.001 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:19.001 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.001 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.001 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:19.001 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:19.002 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:19.002 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.002 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:19.002 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.002 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:19.002 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:19.002 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.002 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:19.002 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:19.002 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:19.002 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:19.002 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:19.002 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:19.002 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.003 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:19.003 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.003 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:19.003 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.003 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.003 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:19.003 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.003 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:19.003 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.003 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:19.003 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:19.003 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:19.003 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:19.003 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:19.004 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:19.004 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.004 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:19.004 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:19.004 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:19.004 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:19.004 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:19.004 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:19.004 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.004 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:19.004 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:19.004 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:19.004 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:19.004 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:19.004 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:19.005 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:19.005 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:19.005 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:19.005 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:19.005 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:19.005 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.005 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.005 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:19.005 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.005 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:19.005 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:19.005 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:19.005 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:19.005 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:19.006 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:19.006 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:19.006 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:19.006 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:19.006 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:19.006 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:19.006 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:19.006 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:19.006 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:19.006 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:19.006 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:19.006 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:19.006 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:19.007 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:19.007 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:19.007 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:19.007 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:19.007 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:19.007 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:19.007 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:19.007 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:19.007 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:19.007 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:19.007 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.007 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.007 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.007 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.007 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:19.007 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:19.008 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.008 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:19.008 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.008 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:19.008 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:19.008 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:19.008 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.008 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:19.008 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:19.008 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.008 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.008 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:19.008 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:19.009 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.009 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.009 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:19.009 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:19.009 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:19.009 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:19.009 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:19.009 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.009 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.009 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:19.009 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:19.009 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:19.009 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.009 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:19.010 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.010 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:19.010 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.010 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:19.010 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.010 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(scope="package") 2023-12-03T13:00:19.010 INFO:teuthology.orchestra.run.smithi003.stdout: def configfile(): 2023-12-03T13:00:19.010 INFO:teuthology.orchestra.run.smithi003.stdout:> setup() 2023-12-03T13:00:19.010 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.010 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:309: 2023-12-03T13:00:19.010 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.010 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:272: in setup 2023-12-03T13:00:19.010 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:19.011 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:19.011 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:19.011 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:19.011 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:19.011 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:19.011 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:19.011 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:19.011 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:19.011 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:19.011 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:19.011 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:19.011 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:19.011 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:19.011 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:19.012 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:19.012 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:19.012 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:19.012 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:19.012 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:19.012 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:19.012 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:19.012 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:19.012 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:19.012 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:19.012 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:19.012 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:19.012 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:19.013 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:19.013 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:19.013 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:19.013 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:19.013 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:19.013 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:19.013 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:19.013 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:19.013 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:19.013 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:19.013 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:19.013 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.013 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.013 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.014 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:19.014 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.014 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:19.014 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.014 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:19.014 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:19.014 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:19.014 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:19.014 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:19.014 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:19.014 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.014 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:19.014 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:19.015 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:19.015 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:19.015 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:19.015 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:19.015 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.015 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:19.015 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:19.015 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:19.015 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:19.015 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:19.015 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:19.015 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:19.015 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:19.015 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:19.015 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:19.015 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:19.016 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.016 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.016 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:19.016 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:19.016 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:19.016 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:19.016 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:19.016 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.016 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.016 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:19.016 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:19.016 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:19.016 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:19.016 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:19.017 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.017 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:19.017 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:19.017 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:19.017 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:19.017 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:19.017 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:19.017 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.017 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:19.017 INFO:teuthology.orchestra.run.smithi003.stdout:________________ ERROR at setup of test_case_value_expressions _________________ 2023-12-03T13:00:19.017 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.017 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.017 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.017 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:19.018 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:19.018 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.018 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:19.018 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.018 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:19.018 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:19.018 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:19.018 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.018 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:19.018 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:19.018 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.018 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.019 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:19.019 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:19.019 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.019 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.019 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:19.019 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.019 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:19.019 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:19.019 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.019 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.019 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:19.019 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:19.019 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.019 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:19.019 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:19.020 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:19.020 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:19.020 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:19.020 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.020 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:19.020 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.020 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:19.020 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:19.020 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:19.020 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:19.020 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:19.020 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:19.020 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:19.020 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:19.020 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.021 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.021 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:19.021 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:19.021 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:19.021 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:19.021 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.021 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:19.021 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:19.021 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:19.021 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:19.021 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.021 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.021 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:19.021 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:19.022 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:19.022 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:19.022 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.022 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.022 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:19.022 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:19.022 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:19.022 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.022 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:19.022 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.022 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:19.023 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:19.023 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.023 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:19.023 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:19.023 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:19.023 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:19.023 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:19.023 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:19.023 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.023 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:19.023 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.023 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:19.023 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.024 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.024 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:19.024 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.024 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:19.024 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.024 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:19.024 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:19.024 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:19.024 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:19.024 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:19.024 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:19.024 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.024 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:19.024 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:19.024 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:19.024 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:19.025 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:19.025 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:19.025 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.025 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:19.025 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:19.025 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:19.025 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:19.025 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:19.025 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:19.025 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:19.025 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:19.025 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:19.025 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:19.025 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:19.026 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.026 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.026 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:19.026 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.026 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:19.026 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:19.026 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:19.026 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:19.026 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:19.026 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:19.026 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:19.026 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:19.026 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:19.026 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:19.027 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:19.027 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:19.027 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:19.027 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:19.027 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:19.027 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:19.027 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:19.027 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:19.027 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:19.027 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:19.027 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:19.027 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:19.028 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:19.028 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:19.028 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:19.028 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:19.028 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:19.028 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:19.028 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.028 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.028 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.028 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.028 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:19.028 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:19.028 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.028 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:19.029 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.029 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:19.029 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:19.029 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:19.029 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.029 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:19.029 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:19.029 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.029 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.029 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:19.029 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:19.029 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.029 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.029 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:19.029 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:19.030 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:19.030 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:19.030 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:19.030 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.030 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.030 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:19.030 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:19.030 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:19.030 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.030 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:19.030 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.030 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:19.030 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.031 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:19.031 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.031 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(scope="package") 2023-12-03T13:00:19.031 INFO:teuthology.orchestra.run.smithi003.stdout: def configfile(): 2023-12-03T13:00:19.031 INFO:teuthology.orchestra.run.smithi003.stdout:> setup() 2023-12-03T13:00:19.031 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.031 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:309: 2023-12-03T13:00:19.031 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.031 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:272: in setup 2023-12-03T13:00:19.031 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:19.031 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:19.031 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:19.031 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:19.032 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:19.032 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:19.032 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:19.032 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:19.032 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:19.032 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:19.032 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:19.032 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:19.032 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:19.032 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:19.032 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:19.032 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:19.032 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:19.032 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:19.033 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:19.033 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:19.033 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:19.033 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:19.033 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:19.033 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:19.033 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:19.033 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:19.033 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:19.033 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:19.033 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:19.033 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:19.033 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:19.033 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:19.034 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:19.034 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:19.034 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:19.034 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:19.034 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:19.034 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:19.034 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:19.034 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.034 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.034 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.034 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:19.035 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.035 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:19.035 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.035 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:19.035 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:19.035 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:19.035 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:19.035 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:19.035 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:19.035 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.035 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:19.035 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:19.035 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:19.035 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:19.036 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:19.036 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:19.036 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.036 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:19.036 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:19.036 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:19.036 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:19.036 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:19.036 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:19.036 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:19.036 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:19.036 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:19.036 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:19.036 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:19.037 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.037 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.037 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:19.037 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:19.037 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:19.037 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:19.037 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:19.037 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.037 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.037 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:19.037 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:19.037 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:19.037 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:19.037 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:19.037 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.038 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:19.038 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:19.038 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:19.038 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:19.038 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:19.038 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:19.038 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.038 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:19.038 INFO:teuthology.orchestra.run.smithi003.stdout:_________________ ERROR at setup of test_bool_cast_expressions _________________ 2023-12-03T13:00:19.038 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.038 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.038 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.038 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:19.039 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:19.039 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.039 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:19.039 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.039 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:19.039 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:19.039 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:19.039 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.039 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:19.039 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:19.039 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.039 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.039 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:19.039 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:19.040 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.040 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.040 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:19.040 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.040 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:19.040 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:19.040 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.040 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.040 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:19.040 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:19.040 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.040 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:19.040 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:19.040 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:19.041 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:19.041 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:19.041 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.041 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:19.041 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.041 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:19.041 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:19.041 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:19.041 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:19.041 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:19.041 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:19.041 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:19.041 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:19.041 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.042 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.042 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:19.042 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:19.042 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:19.042 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:19.042 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.042 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:19.042 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:19.042 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:19.042 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:19.042 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.042 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.042 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:19.042 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:19.043 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:19.043 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:19.043 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.043 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.043 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:19.043 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:19.043 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:19.043 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.043 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:19.043 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.043 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:19.043 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:19.043 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.043 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:19.043 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:19.043 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:19.044 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:19.044 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:19.044 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:19.044 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.044 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:19.044 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.044 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:19.044 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.044 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.044 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:19.044 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.044 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:19.045 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.045 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:19.045 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:19.045 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:19.045 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:19.045 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:19.045 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:19.045 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.045 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:19.045 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:19.045 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:19.045 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:19.045 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:19.045 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:19.045 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.046 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:19.046 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:19.046 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:19.046 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:19.046 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:19.046 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:19.046 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:19.046 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:19.046 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:19.046 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:19.046 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:19.046 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.046 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.047 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:19.047 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.047 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:19.047 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:19.047 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:19.047 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:19.047 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:19.047 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:19.047 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:19.047 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:19.047 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:19.047 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:19.047 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:19.047 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:19.048 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:19.048 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:19.048 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:19.048 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:19.048 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:19.048 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:19.048 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:19.048 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:19.048 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:19.048 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:19.048 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:19.048 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:19.048 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:19.048 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:19.048 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:19.049 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:19.049 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.049 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.049 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.049 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.049 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:19.049 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:19.049 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.049 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:19.049 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.049 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:19.049 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:19.049 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:19.049 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.050 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:19.050 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:19.050 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.050 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.050 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:19.050 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:19.050 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.050 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.050 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:19.050 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:19.050 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:19.050 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:19.050 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:19.050 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.050 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.050 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:19.051 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:19.051 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:19.051 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.051 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:19.051 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.051 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:19.051 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.051 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:19.051 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.051 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(scope="package") 2023-12-03T13:00:19.051 INFO:teuthology.orchestra.run.smithi003.stdout: def configfile(): 2023-12-03T13:00:19.051 INFO:teuthology.orchestra.run.smithi003.stdout:> setup() 2023-12-03T13:00:19.051 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.052 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:309: 2023-12-03T13:00:19.052 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.052 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:272: in setup 2023-12-03T13:00:19.052 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:19.052 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:19.052 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:19.052 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:19.052 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:19.052 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:19.052 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:19.052 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:19.052 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:19.052 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:19.052 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:19.052 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:19.053 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:19.053 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:19.053 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:19.053 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:19.053 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:19.053 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:19.053 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:19.053 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:19.053 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:19.053 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:19.053 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:19.053 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:19.053 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:19.053 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:19.054 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:19.054 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:19.054 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:19.054 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:19.054 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:19.054 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:19.054 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:19.054 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:19.054 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:19.054 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:19.054 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:19.054 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:19.054 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:19.054 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.055 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.055 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.055 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:19.055 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.055 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:19.055 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.055 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:19.055 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:19.055 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:19.055 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:19.055 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:19.055 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:19.055 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.055 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:19.056 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:19.056 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:19.056 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:19.056 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:19.056 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:19.056 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.056 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:19.056 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:19.056 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:19.056 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:19.056 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:19.056 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:19.056 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:19.057 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:19.057 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:19.057 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:19.057 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:19.057 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.057 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.057 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:19.057 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:19.057 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:19.057 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:19.057 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:19.057 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.057 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.057 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:19.057 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:19.058 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:19.058 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:19.058 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:19.058 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.058 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:19.058 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:19.058 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:19.058 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:19.058 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:19.058 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:19.058 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.058 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:19.058 INFO:teuthology.orchestra.run.smithi003.stdout:_________________ ERROR at setup of test_progress_expressions __________________ 2023-12-03T13:00:19.058 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.058 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.059 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.059 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:19.059 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:19.059 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.059 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:19.059 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.059 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:19.059 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:19.059 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:19.059 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.059 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:19.059 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:19.059 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.059 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.059 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:19.059 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:19.060 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.060 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.060 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:19.060 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.060 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:19.060 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:19.060 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.060 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.060 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:19.060 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:19.060 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.060 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:19.060 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:19.060 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:19.060 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:19.061 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:19.061 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.061 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:19.061 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.061 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:19.061 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:19.061 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:19.061 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:19.061 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:19.061 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:19.061 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:19.061 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:19.061 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.061 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.062 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:19.062 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:19.062 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:19.062 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:19.062 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.062 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:19.062 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:19.062 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:19.062 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:19.062 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.062 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.062 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:19.062 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:19.062 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:19.062 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:19.063 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.063 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.063 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:19.063 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:19.063 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:19.063 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.063 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:19.063 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.063 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:19.063 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:19.063 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.063 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:19.063 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:19.063 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:19.063 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:19.064 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:19.064 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:19.064 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.064 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:19.064 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.064 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:19.064 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.064 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.064 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:19.064 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.064 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:19.064 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.064 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:19.064 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:19.065 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:19.065 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:19.065 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:19.065 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:19.065 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.065 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:19.065 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:19.065 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:19.065 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:19.065 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:19.065 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:19.065 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.065 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:19.065 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:19.065 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:19.066 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:19.066 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:19.066 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:19.066 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:19.066 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:19.066 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:19.066 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:19.066 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:19.066 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.066 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.066 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:19.066 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.066 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:19.067 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:19.067 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:19.067 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:19.067 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:19.067 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:19.067 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:19.067 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:19.067 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:19.067 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:19.067 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:19.067 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:19.067 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:19.067 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:19.067 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:19.068 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:19.068 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:19.068 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:19.068 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:19.068 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:19.068 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:19.068 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:19.068 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:19.068 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:19.068 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:19.068 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:19.068 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:19.068 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:19.068 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.069 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.069 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.069 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.069 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:19.069 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:19.069 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.069 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:19.069 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.069 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:19.069 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:19.069 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:19.069 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.069 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:19.069 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:19.070 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.070 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.070 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:19.070 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:19.070 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.070 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.070 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:19.070 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:19.070 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:19.070 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:19.070 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:19.070 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.070 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.070 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:19.071 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:19.071 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:19.071 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.071 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:19.071 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.071 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:19.071 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.071 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:19.071 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.071 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(scope="package") 2023-12-03T13:00:19.071 INFO:teuthology.orchestra.run.smithi003.stdout: def configfile(): 2023-12-03T13:00:19.071 INFO:teuthology.orchestra.run.smithi003.stdout:> setup() 2023-12-03T13:00:19.071 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.071 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:309: 2023-12-03T13:00:19.072 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.072 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:272: in setup 2023-12-03T13:00:19.072 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:19.072 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:19.072 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:19.072 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:19.072 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:19.072 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:19.072 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:19.072 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:19.072 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:19.072 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:19.072 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:19.073 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:19.073 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:19.073 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:19.073 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:19.073 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:19.073 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:19.073 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:19.073 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:19.073 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:19.073 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:19.073 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:19.073 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:19.073 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:19.073 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:19.073 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:19.074 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:19.074 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:19.074 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:19.074 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:19.074 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:19.074 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:19.074 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:19.074 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:19.074 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:19.074 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:19.074 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:19.074 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:19.074 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:19.074 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.075 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.075 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.075 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:19.075 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.075 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:19.075 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.075 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:19.075 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:19.075 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:19.075 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:19.075 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:19.075 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:19.075 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.075 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:19.076 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:19.076 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:19.076 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:19.076 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:19.076 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:19.076 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.076 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:19.076 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:19.076 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:19.076 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:19.076 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:19.076 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:19.076 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:19.076 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:19.076 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:19.076 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:19.076 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:19.077 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.077 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.077 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:19.077 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:19.077 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:19.077 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:19.077 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:19.077 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.077 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.077 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:19.077 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:19.077 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:19.077 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:19.078 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:19.078 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.078 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:19.078 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:19.078 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:19.078 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:19.078 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:19.078 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:19.078 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.078 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:19.078 INFO:teuthology.orchestra.run.smithi003.stdout:_______________ ERROR at setup of test_output_serial_expressions _______________ 2023-12-03T13:00:19.078 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.078 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.079 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.079 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:19.079 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:19.079 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.079 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:19.079 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.079 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:19.079 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:19.079 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:19.079 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.079 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:19.079 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:19.079 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.079 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.080 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:19.080 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:19.080 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.080 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.080 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:19.080 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.080 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:19.080 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:19.080 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.080 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.080 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:19.080 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:19.080 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.080 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:19.081 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:19.081 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:19.081 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:19.081 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:19.081 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.081 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:19.081 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.081 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:19.081 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:19.081 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:19.081 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:19.081 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:19.081 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:19.081 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:19.082 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:19.082 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.082 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.082 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:19.082 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:19.082 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:19.082 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:19.082 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.082 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:19.082 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:19.082 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:19.082 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:19.082 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.082 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.083 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:19.083 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:19.083 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:19.083 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:19.083 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.083 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.083 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:19.083 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:19.083 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:19.083 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.083 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:19.083 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.083 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:19.083 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:19.084 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.084 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:19.084 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:19.084 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:19.084 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:19.084 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:19.084 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:19.084 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.084 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:19.084 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.084 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:19.084 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.084 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.084 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:19.084 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.085 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:19.085 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.085 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:19.085 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:19.085 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:19.085 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:19.085 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:19.085 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:19.085 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.085 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:19.085 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:19.085 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:19.085 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:19.085 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:19.086 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:19.086 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.086 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:19.086 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:19.086 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:19.086 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:19.086 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:19.086 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:19.086 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:19.086 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:19.086 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:19.086 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:19.086 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:19.086 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.087 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.087 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:19.087 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.087 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:19.087 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:19.087 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:19.087 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:19.087 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:19.087 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:19.087 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:19.087 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:19.087 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:19.087 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:19.087 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:19.088 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:19.088 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:19.088 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:19.088 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:19.088 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:19.088 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:19.088 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:19.088 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:19.088 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:19.088 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:19.088 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:19.088 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:19.088 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:19.088 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:19.088 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:19.089 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:19.089 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:19.089 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.089 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.089 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.089 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.089 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:19.089 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:19.089 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.089 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:19.089 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.089 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:19.089 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:19.089 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:19.089 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.090 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:19.090 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:19.090 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.090 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.090 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:19.090 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:19.090 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.090 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.090 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:19.090 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:19.090 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:19.090 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:19.090 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:19.090 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.091 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.091 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:19.091 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:19.091 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:19.091 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.091 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:19.091 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.091 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:19.091 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.091 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:19.091 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.091 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.fixture(scope="package") 2023-12-03T13:00:19.092 INFO:teuthology.orchestra.run.smithi003.stdout: def configfile(): 2023-12-03T13:00:19.092 INFO:teuthology.orchestra.run.smithi003.stdout:> setup() 2023-12-03T13:00:19.092 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.092 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:309: 2023-12-03T13:00:19.092 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.092 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:272: in setup 2023-12-03T13:00:19.092 INFO:teuthology.orchestra.run.smithi003.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T13:00:19.092 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T13:00:19.092 INFO:teuthology.orchestra.run.smithi003.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T13:00:19.092 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T13:00:19.092 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.list_buckets() 2023-12-03T13:00:19.092 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:19.092 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:19.092 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:19.092 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:19.093 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:19.093 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:19.093 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:19.093 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:19.093 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:19.093 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:19.093 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:19.093 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:19.093 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:19.093 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:19.093 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:19.093 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:19.093 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:19.093 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:19.093 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:19.094 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:19.094 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:19.094 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:19.094 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:19.094 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:19.094 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:19.094 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:19.094 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:19.094 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:19.094 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:19.094 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:19.094 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:19.094 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:19.094 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:19.094 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:19.095 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.095 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.095 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.095 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:19.095 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.095 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:19.095 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.095 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:19.095 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:19.095 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:19.095 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:19.095 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:19.095 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:19.096 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.096 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:19.096 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:19.096 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:19.096 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:19.096 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:19.096 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:19.096 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.096 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:19.096 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:19.096 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:19.096 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:19.096 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:19.096 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:19.097 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:19.097 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:19.097 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:19.097 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:19.097 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:19.097 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.097 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.097 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:19.097 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:19.097 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:19.097 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:19.097 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:19.097 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.097 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.098 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:19.098 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:19.098 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:19.098 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:19.098 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:19.098 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.098 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:19.098 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:19.098 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:19.098 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:19.098 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:19.098 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/" 2023-12-03T13:00:19.098 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.098 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:19.098 INFO:teuthology.orchestra.run.smithi003.stdout:=================================== FAILURES =================================== 2023-12-03T13:00:19.099 INFO:teuthology.orchestra.run.smithi003.stdout:_________________________ test_multipart_upload_empty __________________________ 2023-12-03T13:00:19.099 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.099 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.099 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.099 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:19.099 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:19.099 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.099 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:19.099 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.099 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:19.099 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:19.099 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:19.099 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.099 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:19.100 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:19.100 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.100 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.100 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:19.100 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:19.100 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.100 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.100 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:19.100 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.100 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:19.100 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:19.100 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.100 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.101 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:19.101 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:19.101 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.101 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:19.101 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:19.101 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:19.101 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:19.101 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:19.101 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.101 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:19.101 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.101 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:19.101 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:19.101 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:19.102 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:19.102 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:19.102 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:19.102 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:19.102 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:19.102 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.102 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.102 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:19.102 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:19.102 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:19.102 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:19.102 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.102 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:19.103 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:19.103 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:19.103 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:19.103 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.103 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.103 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:19.103 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:19.103 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:19.103 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:19.103 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.103 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.103 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:19.103 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:19.103 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:19.103 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.104 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:19.104 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.104 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:19.104 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:19.104 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.104 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:19.104 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:19.104 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:19.104 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:19.104 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:19.104 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:19.104 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.104 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:19.104 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.105 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:19.105 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.105 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.105 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:19.105 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.105 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:19.105 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.105 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:19.105 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:19.105 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:19.105 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:19.105 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:19.105 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:19.105 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.106 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:19.106 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:19.106 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:19.106 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:19.106 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:19.106 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:19.106 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.106 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:19.106 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:19.106 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:19.106 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:19.106 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:19.106 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:19.106 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:19.107 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:19.107 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:19.107 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:19.107 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:19.107 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.107 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.107 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:19.107 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.107 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:19.107 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:19.107 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:19.107 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:19.107 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:19.107 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:19.107 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:19.108 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:19.108 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:19.108 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:19.108 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:19.108 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:19.108 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:19.108 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:19.108 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:19.108 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:19.108 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:19.108 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:19.108 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:19.109 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:19.109 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:19.109 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:19.109 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:19.109 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:19.109 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:19.109 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:19.109 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:19.109 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:19.109 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.109 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.109 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.109 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.109 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:19.110 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:19.110 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.110 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:19.110 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.110 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:19.110 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:19.110 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:19.110 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.110 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:19.110 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:19.110 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.110 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.110 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:19.110 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:19.111 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.111 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.111 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:19.111 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:19.111 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:19.111 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:19.111 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:19.111 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.111 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.111 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:19.111 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:19.111 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:19.111 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.111 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:19.112 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.112 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:19.112 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.112 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:19.112 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.112 INFO:teuthology.orchestra.run.smithi003.stdout: def test_multipart_upload_empty(): 2023-12-03T13:00:19.112 INFO:teuthology.orchestra.run.smithi003.stdout: bucket_name = get_new_bucket() 2023-12-03T13:00:19.112 INFO:teuthology.orchestra.run.smithi003.stdout: client = get_client() 2023-12-03T13:00:19.112 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.112 INFO:teuthology.orchestra.run.smithi003.stdout: key1 = "mymultipart" 2023-12-03T13:00:19.112 INFO:teuthology.orchestra.run.smithi003.stdout: objlen = 0 2023-12-03T13:00:19.112 INFO:teuthology.orchestra.run.smithi003.stdout: (upload_id, data, parts) = _multipart_upload(bucket_name=bucket_name, key=key1, size=objlen) 2023-12-03T13:00:19.112 INFO:teuthology.orchestra.run.smithi003.stdout:> e = assert_raises(ClientError, client.complete_multipart_upload,Bucket=bucket_name, Key=key1, UploadId=upload_id) 2023-12-03T13:00:19.113 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.113 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:5811: 2023-12-03T13:00:19.113 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.113 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/utils.py:11: in assert_raises 2023-12-03T13:00:19.113 INFO:teuthology.orchestra.run.smithi003.stdout: callableObj(*args, **kwargs) 2023-12-03T13:00:19.113 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:19.113 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:19.113 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:19.113 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:19.113 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:19.113 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:19.113 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:19.113 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:19.113 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:19.113 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:19.113 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:19.114 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:19.114 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:19.114 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:19.114 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:19.114 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:19.114 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:19.114 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:19.114 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:19.114 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:19.114 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:19.114 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:19.114 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:19.114 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:19.114 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:19.115 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:19.115 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:19.115 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:19.115 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:19.115 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:19.115 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:19.115 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:19.115 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:19.115 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:19.115 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.115 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.115 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.115 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:19.115 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.115 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:19.115 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.116 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:19.116 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:19.116 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:19.116 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:19.116 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:19.116 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:19.116 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.116 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:19.116 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:19.116 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:19.116 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:19.116 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:19.116 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:19.117 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.117 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:19.117 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:19.117 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:19.117 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:19.117 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:19.117 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:19.117 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:19.117 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:19.117 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:19.117 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:19.117 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:19.117 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.117 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.117 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:19.117 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:19.118 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:19.118 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:19.118 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:19.118 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.118 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.118 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:19.118 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:19.118 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:19.118 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:19.118 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:19.118 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.118 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:19.118 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:19.118 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:19.119 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:19.119 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:19.119 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-323/mymultipart?uploadId=2~kJIFdbpn366yLMcvdqSGtTERlVA7p4z" 2023-12-03T13:00:19.119 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.119 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:19.119 INFO:teuthology.orchestra.run.smithi003.stdout:_________________________ test_multipart_upload_small __________________________ 2023-12-03T13:00:19.119 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.119 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.119 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.119 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:19.119 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:19.119 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.119 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:19.119 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.119 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:19.120 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:19.120 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:19.120 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.120 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:19.120 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:19.120 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.120 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.120 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:19.120 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:19.120 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.120 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.120 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:19.120 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.120 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:19.120 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:19.120 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.121 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.121 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:19.121 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:19.121 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.121 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:19.121 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:19.121 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:19.121 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:19.121 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:19.121 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.121 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:19.121 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.121 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:19.122 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:19.122 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:19.122 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:19.122 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:19.122 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:19.122 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:19.122 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:19.122 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.122 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.122 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:19.122 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:19.122 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:19.122 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:19.123 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.123 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:19.123 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:19.123 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:19.123 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:19.123 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.123 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.123 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:19.123 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:19.123 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:19.123 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:19.123 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.123 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.123 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:19.124 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:19.124 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:19.124 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.124 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:19.124 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.124 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:19.124 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:19.124 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.124 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:19.124 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:19.124 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:19.124 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:19.124 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:19.124 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:19.124 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.124 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:19.124 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.125 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:19.125 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.125 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.125 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:19.125 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.125 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:19.125 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.125 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:19.125 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:19.125 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:19.125 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:19.125 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:19.125 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:19.126 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.126 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:19.126 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:19.126 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:19.126 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:19.126 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:19.126 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:19.126 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.126 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:19.126 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:19.126 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:19.126 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:19.126 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:19.126 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:19.127 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:19.127 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:19.127 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:19.127 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:19.127 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:19.127 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.127 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.127 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:19.127 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.127 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:19.127 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:19.127 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:19.127 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:19.127 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:19.128 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:19.128 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:19.128 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:19.128 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:19.128 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:19.128 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:19.128 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:19.128 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:19.128 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:19.128 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:19.128 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:19.128 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:19.128 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:19.128 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:19.128 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:19.129 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:19.129 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:19.129 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:19.129 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:19.129 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:19.129 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:19.129 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:19.129 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:19.129 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.129 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.129 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.129 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.129 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:19.129 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:19.130 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.130 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:19.130 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.130 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:19.130 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:19.130 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:19.130 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.130 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:19.130 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:19.130 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.130 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.130 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:19.130 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:19.130 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.130 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.131 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:19.131 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:19.131 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:19.131 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:19.131 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:19.131 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.131 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.131 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:19.131 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:19.131 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:19.131 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.131 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:19.131 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.132 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:19.132 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.132 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:19.132 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.132 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T13:00:19.132 INFO:teuthology.orchestra.run.smithi003.stdout: def test_multipart_upload_small(): 2023-12-03T13:00:19.132 INFO:teuthology.orchestra.run.smithi003.stdout:> bucket_name = get_new_bucket() 2023-12-03T13:00:19.132 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.132 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:5818: 2023-12-03T13:00:19.132 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.132 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:19.132 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:19.132 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:19.132 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:19.133 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:19.133 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:19.133 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:19.133 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:19.133 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:19.133 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:19.133 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:19.133 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:19.133 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:19.133 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:19.133 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:19.133 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:19.133 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:19.133 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:19.134 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:19.134 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:19.134 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:19.134 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:19.134 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:19.134 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:19.134 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:19.134 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:19.134 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:19.134 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:19.134 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:19.134 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:19.134 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:19.134 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:19.135 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:19.135 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:19.135 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:19.135 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:19.135 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.135 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.135 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.135 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:19.135 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.135 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:19.135 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.135 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:19.135 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:19.136 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:19.136 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:19.136 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:19.136 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:19.136 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.136 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:19.136 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:19.136 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:19.136 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:19.136 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:19.136 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:19.136 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.136 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:19.136 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:19.137 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:19.137 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:19.137 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:19.137 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:19.137 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:19.137 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:19.137 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:19.137 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:19.137 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:19.137 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.137 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.137 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:19.137 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:19.137 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:19.137 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:19.138 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:19.138 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.138 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.138 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:19.138 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:19.138 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:19.138 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:19.138 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:19.138 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.138 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:19.138 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:19.138 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:19.138 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:19.139 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:19.139 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-324" 2023-12-03T13:00:19.139 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.139 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:19.139 INFO:teuthology.orchestra.run.smithi003.stdout:__________________________ test_multipart_copy_small ___________________________ 2023-12-03T13:00:19.139 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.139 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.139 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.139 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:19.139 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:19.139 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.139 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:19.139 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.139 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:19.140 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:19.140 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:19.140 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.140 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:19.140 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:19.140 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.140 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.140 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:19.140 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:19.140 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.140 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.140 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:19.140 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.140 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:19.140 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:19.141 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.141 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.141 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:19.141 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:19.141 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.141 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:19.141 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:19.141 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:19.141 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:19.141 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:19.141 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.141 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:19.141 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.142 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:19.142 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:19.142 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:19.142 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:19.142 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:19.142 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:19.142 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:19.142 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:19.142 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.142 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.142 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:19.142 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:19.142 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:19.142 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:19.143 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.143 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:19.143 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:19.143 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:19.143 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:19.143 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.143 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.143 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:19.143 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:19.143 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:19.143 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:19.143 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.143 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.143 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:19.144 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:19.144 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:19.144 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.144 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:19.144 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.144 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:19.144 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:19.144 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.144 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:19.144 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:19.144 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:19.144 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:19.144 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:19.144 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:19.144 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.145 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:19.145 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.145 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:19.145 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.145 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.145 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:19.145 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.145 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:19.145 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.145 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:19.145 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:19.145 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:19.145 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:19.145 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:19.145 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:19.145 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.145 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:19.146 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:19.146 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:19.146 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:19.146 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:19.146 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:19.146 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.146 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:19.146 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:19.146 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:19.146 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:19.146 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:19.146 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:19.147 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:19.147 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:19.147 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:19.147 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:19.147 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:19.147 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.147 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.147 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:19.147 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.147 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:19.147 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:19.147 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:19.147 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:19.148 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:19.148 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:19.148 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:19.148 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:19.148 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:19.148 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:19.148 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:19.148 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:19.148 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:19.148 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:19.148 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:19.148 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:19.148 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:19.148 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:19.148 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:19.149 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:19.149 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:19.149 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:19.149 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:19.149 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:19.149 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:19.149 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:19.149 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:19.149 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:19.149 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.149 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.149 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.149 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.149 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:19.149 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:19.150 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.150 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:19.150 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.150 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:19.150 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:19.150 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:19.150 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.150 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:19.150 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:19.150 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.150 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.150 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:19.151 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:19.151 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.151 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.151 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:19.151 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:19.151 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:19.151 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:19.151 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:19.151 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.151 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.151 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:19.151 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:19.151 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:19.152 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.152 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:19.152 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.152 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:19.152 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.152 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:19.152 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.152 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T13:00:19.152 INFO:teuthology.orchestra.run.smithi003.stdout: def test_multipart_copy_small(): 2023-12-03T13:00:19.152 INFO:teuthology.orchestra.run.smithi003.stdout: src_key = 'foo' 2023-12-03T13:00:19.152 INFO:teuthology.orchestra.run.smithi003.stdout:> src_bucket_name = _create_key_with_random_content(src_key) 2023-12-03T13:00:19.152 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.152 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:5894: 2023-12-03T13:00:19.152 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.152 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:5832: in _create_key_with_random_content 2023-12-03T13:00:19.153 INFO:teuthology.orchestra.run.smithi003.stdout: bucket_name = get_new_bucket() 2023-12-03T13:00:19.153 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:19.153 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:19.153 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:19.153 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:19.153 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:19.153 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:19.153 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:19.153 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:19.153 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:19.153 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:19.153 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:19.153 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:19.153 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:19.153 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:19.154 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:19.154 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:19.154 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:19.154 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:19.154 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:19.154 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:19.154 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:19.154 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:19.154 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:19.154 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:19.154 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:19.154 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:19.154 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:19.155 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:19.155 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:19.155 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:19.155 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:19.155 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:19.155 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:19.155 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:19.155 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:19.155 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:19.155 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.155 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.155 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.155 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:19.155 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.155 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:19.155 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.156 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:19.156 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:19.156 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:19.156 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:19.156 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:19.156 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:19.156 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.156 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:19.156 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:19.156 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:19.156 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:19.156 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:19.156 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:19.157 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.157 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:19.157 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:19.157 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:19.157 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:19.157 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:19.157 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:19.157 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:19.157 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:19.157 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:19.157 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:19.157 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:19.157 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.157 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.157 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:19.157 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:19.158 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:19.158 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:19.158 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:19.158 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.158 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.158 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:19.158 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:19.158 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:19.158 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:19.158 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:19.158 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.158 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:19.159 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:19.159 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:19.159 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:19.159 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:19.159 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-325" 2023-12-03T13:00:19.159 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.159 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:19.159 INFO:teuthology.orchestra.run.smithi003.stdout:______________________ test_multipart_copy_invalid_range _______________________ 2023-12-03T13:00:19.159 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.159 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.159 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.159 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:19.159 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:19.159 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.159 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:19.159 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.160 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:19.160 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:19.160 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:19.160 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.160 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:19.160 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:19.160 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.160 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.160 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:19.160 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:19.160 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.160 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.160 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:19.160 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.161 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:19.161 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:19.161 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.161 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.161 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:19.161 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:19.161 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.161 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:19.161 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:19.161 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:19.161 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:19.161 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:19.161 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.161 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:19.162 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.162 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:19.162 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:19.162 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:19.162 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:19.162 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:19.162 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:19.162 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:19.162 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:19.162 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.162 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.162 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:19.162 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:19.163 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:19.163 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:19.163 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.163 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:19.163 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:19.163 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:19.163 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:19.163 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.163 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.163 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:19.163 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:19.163 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:19.163 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:19.163 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.163 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.164 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:19.164 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:19.164 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:19.164 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.164 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:19.164 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.164 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:19.164 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:19.164 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.164 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:19.164 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:19.164 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:19.164 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:19.164 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:19.164 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:19.165 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.165 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:19.165 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.165 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:19.165 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.165 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.165 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:19.165 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.165 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:19.165 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.165 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:19.165 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:19.165 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:19.165 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:19.166 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:19.166 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:19.166 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.166 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:19.166 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:19.166 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:19.166 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:19.166 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:19.166 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:19.166 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.166 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:19.166 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:19.166 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:19.166 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:19.167 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:19.167 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:19.167 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:19.167 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:19.167 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:19.167 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:19.167 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:19.167 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.167 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.167 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:19.167 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.167 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:19.168 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:19.168 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:19.168 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:19.168 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:19.168 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:19.168 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:19.168 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:19.168 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:19.168 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:19.168 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:19.168 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:19.168 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:19.168 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:19.168 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:19.169 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:19.169 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:19.169 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:19.169 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:19.169 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:19.169 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:19.169 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:19.169 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:19.169 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:19.169 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:19.169 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:19.169 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:19.169 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:19.169 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.170 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.170 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.170 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.170 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:19.170 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:19.170 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.170 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:19.170 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.170 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:19.170 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:19.170 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:19.170 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.170 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:19.171 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:19.171 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.171 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.171 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:19.171 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:19.171 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.171 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.171 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:19.171 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:19.171 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:19.171 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:19.171 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:19.171 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.172 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.172 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:19.172 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:19.172 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:19.172 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.172 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:19.172 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.172 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:19.172 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.172 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:19.172 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.172 INFO:teuthology.orchestra.run.smithi003.stdout: def test_multipart_copy_invalid_range(): 2023-12-03T13:00:19.173 INFO:teuthology.orchestra.run.smithi003.stdout: client = get_client() 2023-12-03T13:00:19.173 INFO:teuthology.orchestra.run.smithi003.stdout: src_key = 'source' 2023-12-03T13:00:19.173 INFO:teuthology.orchestra.run.smithi003.stdout:> src_bucket_name = _create_key_with_random_content(src_key, size=5) 2023-12-03T13:00:19.173 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.173 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:5911: 2023-12-03T13:00:19.173 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.173 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:5832: in _create_key_with_random_content 2023-12-03T13:00:19.173 INFO:teuthology.orchestra.run.smithi003.stdout: bucket_name = get_new_bucket() 2023-12-03T13:00:19.173 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:19.173 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:19.173 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:19.173 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:19.173 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:19.173 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:19.174 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:19.174 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:19.174 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:19.174 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:19.174 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:19.174 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:19.174 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:19.174 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:19.174 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:19.174 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:19.174 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:19.174 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:19.174 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:19.174 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:19.175 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:19.175 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:19.175 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:19.175 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:19.175 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:19.175 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:19.175 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:19.175 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:19.175 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:19.175 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:19.175 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:19.175 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:19.176 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:19.176 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:19.176 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:19.176 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:19.176 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.176 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.176 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.176 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:19.176 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.176 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:19.176 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.176 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:19.176 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:19.176 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:19.176 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:19.177 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:19.177 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:19.177 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.177 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:19.177 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:19.177 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:19.177 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:19.177 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:19.177 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:19.177 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.177 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:19.177 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:19.178 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:19.178 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:19.178 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:19.178 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:19.178 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:19.178 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:19.178 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:19.178 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:19.178 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:19.178 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.178 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.178 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:19.178 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:19.178 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:19.179 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:19.179 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:19.179 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.179 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.179 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:19.179 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:19.179 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:19.179 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:19.179 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:19.179 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.179 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:19.179 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:19.179 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:19.180 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:19.180 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:19.180 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-326" 2023-12-03T13:00:19.180 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.180 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:19.180 INFO:teuthology.orchestra.run.smithi003.stdout:______________________ test_multipart_copy_without_range _______________________ 2023-12-03T13:00:19.180 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.180 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.180 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.180 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:19.180 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:19.180 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.180 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:19.180 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.181 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:19.181 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:19.181 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:19.181 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.181 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:19.181 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:19.181 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.181 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.181 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:19.181 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:19.181 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.181 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.181 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:19.181 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.182 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:19.182 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:19.182 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.182 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.182 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:19.182 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:19.182 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.182 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:19.182 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:19.182 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:19.182 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:19.182 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:19.182 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.182 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:19.183 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.183 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:19.183 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:19.183 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:19.183 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:19.183 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:19.183 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:19.183 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:19.183 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:19.183 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.183 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.183 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:19.183 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:19.183 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:19.184 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:19.184 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.184 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:19.184 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:19.184 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:19.184 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:19.184 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.184 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.184 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:19.184 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:19.184 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:19.184 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:19.184 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.185 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.185 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:19.185 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:19.185 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:19.185 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.185 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:19.185 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.185 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:19.185 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:19.185 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.185 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:19.185 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:19.185 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:19.185 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:19.186 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:19.186 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:19.186 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.186 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:19.186 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.186 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:19.186 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.186 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.186 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:19.186 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.186 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:19.186 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.186 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:19.187 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:19.187 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:19.187 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:19.187 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:19.187 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:19.187 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.187 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:19.187 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:19.187 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:19.187 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:19.187 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:19.187 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:19.187 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.187 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:19.187 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:19.188 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:19.188 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:19.188 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:19.188 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:19.188 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:19.188 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:19.188 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:19.188 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:19.188 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:19.188 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.188 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.188 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:19.188 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.189 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:19.189 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:19.189 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:19.189 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:19.189 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:19.189 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:19.189 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:19.189 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:19.189 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:19.189 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:19.189 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:19.189 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:19.189 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:19.189 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:19.190 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:19.190 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:19.190 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:19.190 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:19.190 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:19.190 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:19.190 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:19.190 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:19.190 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:19.190 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:19.190 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:19.190 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:19.191 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:19.191 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:19.191 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.191 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.191 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.191 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.191 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:19.191 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:19.191 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.191 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:19.191 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.191 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:19.191 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:19.192 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:19.192 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.192 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:19.192 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:19.192 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.192 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.192 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:19.192 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:19.192 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.192 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.192 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:19.192 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:19.192 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:19.193 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:19.193 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:19.193 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.193 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.193 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:19.193 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:19.193 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:19.193 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.193 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:19.193 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.193 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:19.193 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.193 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:19.193 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.193 INFO:teuthology.orchestra.run.smithi003.stdout: def test_multipart_copy_without_range(): 2023-12-03T13:00:19.194 INFO:teuthology.orchestra.run.smithi003.stdout: client = get_client() 2023-12-03T13:00:19.194 INFO:teuthology.orchestra.run.smithi003.stdout: src_key = 'source' 2023-12-03T13:00:19.194 INFO:teuthology.orchestra.run.smithi003.stdout:> src_bucket_name = _create_key_with_random_content(src_key, size=10) 2023-12-03T13:00:19.194 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.194 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:5961: 2023-12-03T13:00:19.194 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.194 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:5832: in _create_key_with_random_content 2023-12-03T13:00:19.194 INFO:teuthology.orchestra.run.smithi003.stdout: bucket_name = get_new_bucket() 2023-12-03T13:00:19.194 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:19.194 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:19.194 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:19.194 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:19.194 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:19.195 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:19.195 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:19.195 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:19.195 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:19.195 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:19.195 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:19.195 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:19.195 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:19.195 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:19.195 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:19.195 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:19.195 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:19.195 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:19.195 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:19.195 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:19.196 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:19.196 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:19.196 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:19.196 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:19.196 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:19.196 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:19.196 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:19.196 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:19.196 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:19.196 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:19.196 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:19.196 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:19.197 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:19.197 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:19.197 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:19.197 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:19.197 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.197 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.197 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.197 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:19.197 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.197 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:19.197 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.197 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:19.197 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:19.197 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:19.198 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:19.198 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:19.198 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:19.198 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.198 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:19.198 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:19.198 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:19.198 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:19.198 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:19.198 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:19.198 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.198 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:19.199 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:19.199 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:19.199 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:19.199 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:19.199 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:19.199 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:19.199 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:19.199 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:19.199 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:19.199 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:19.199 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.199 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.199 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:19.199 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:19.199 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:19.200 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:19.200 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:19.200 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.200 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.200 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:19.200 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:19.200 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:19.200 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:19.200 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:19.200 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.200 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:19.200 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:19.200 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:19.201 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:19.201 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:19.201 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-327" 2023-12-03T13:00:19.201 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.201 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:19.201 INFO:teuthology.orchestra.run.smithi003.stdout:______________________ test_multipart_copy_special_names _______________________ 2023-12-03T13:00:19.201 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.201 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.201 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.201 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:19.201 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:19.201 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.202 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:19.202 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.202 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:19.202 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:19.202 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:19.202 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.202 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:19.202 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:19.202 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.202 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.202 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:19.202 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:19.202 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.203 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.203 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:19.203 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.203 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:19.203 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:19.203 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.203 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.203 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:19.203 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:19.203 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.203 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:19.203 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:19.203 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:19.204 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:19.204 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:19.204 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.204 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:19.204 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.204 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:19.204 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:19.204 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:19.204 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:19.204 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:19.204 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:19.204 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:19.204 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:19.204 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.204 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.205 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:19.205 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:19.205 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:19.205 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:19.205 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.205 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:19.205 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:19.205 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:19.205 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:19.205 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.205 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.205 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:19.205 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:19.206 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:19.206 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:19.206 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.206 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.206 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:19.206 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:19.206 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:19.206 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.206 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:19.206 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.206 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:19.206 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:19.206 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.207 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:19.207 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:19.207 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:19.207 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:19.207 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:19.207 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:19.207 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.207 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:19.207 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.207 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:19.207 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.207 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.207 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:19.208 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.208 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:19.208 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.208 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:19.208 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:19.208 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:19.208 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:19.208 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:19.208 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:19.208 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.208 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:19.208 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:19.208 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:19.208 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:19.208 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:19.209 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:19.209 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.209 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:19.209 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:19.209 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:19.209 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:19.209 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:19.209 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:19.209 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:19.209 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:19.209 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:19.209 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:19.209 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:19.210 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.210 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.210 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:19.210 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.210 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:19.210 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:19.210 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:19.210 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:19.210 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:19.210 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:19.210 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:19.210 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:19.210 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:19.211 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:19.211 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:19.211 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:19.211 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:19.211 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:19.211 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:19.211 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:19.211 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:19.211 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:19.211 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:19.211 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:19.211 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:19.211 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:19.212 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:19.212 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:19.212 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:19.212 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:19.212 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:19.212 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:19.212 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.212 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.212 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.212 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.212 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:19.212 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:19.212 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.213 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:19.213 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.213 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:19.213 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:19.213 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:19.213 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.213 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:19.213 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:19.213 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.213 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.213 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:19.213 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:19.213 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.213 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.213 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:19.213 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:19.213 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:19.214 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:19.214 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:19.214 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.214 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.214 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:19.214 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:19.214 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:19.214 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.214 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:19.214 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.214 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:19.214 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.214 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:19.215 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.215 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T13:00:19.215 INFO:teuthology.orchestra.run.smithi003.stdout: def test_multipart_copy_special_names(): 2023-12-03T13:00:19.215 INFO:teuthology.orchestra.run.smithi003.stdout:> src_bucket_name = get_new_bucket() 2023-12-03T13:00:19.215 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.215 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:5985: 2023-12-03T13:00:19.215 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.215 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:19.215 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:19.215 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:19.215 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:19.215 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:19.215 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:19.215 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:19.216 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:19.216 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:19.216 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:19.216 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:19.216 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:19.216 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:19.216 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:19.216 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:19.216 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:19.216 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:19.216 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:19.216 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:19.216 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:19.217 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:19.217 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:19.217 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:19.217 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:19.217 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:19.217 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:19.217 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:19.217 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:19.217 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:19.217 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:19.217 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:19.217 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:19.217 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:19.217 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:19.217 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:19.218 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:19.218 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.218 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.218 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.218 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:19.218 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.218 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:19.218 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.218 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:19.218 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:19.218 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:19.218 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:19.218 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:19.219 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:19.219 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.219 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:19.219 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:19.219 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:19.219 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:19.219 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:19.219 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:19.219 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.219 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:19.219 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:19.219 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:19.219 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:19.219 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:19.220 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:19.220 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:19.220 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:19.220 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:19.220 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:19.220 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:19.220 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.220 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.220 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:19.220 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:19.220 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:19.220 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:19.220 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:19.221 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.221 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.221 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:19.221 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:19.221 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:19.221 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:19.221 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:19.221 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.221 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:19.221 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:19.221 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:19.221 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:19.221 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:19.221 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-328" 2023-12-03T13:00:19.222 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.222 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:19.222 INFO:teuthology.orchestra.run.smithi003.stdout:____________________________ test_multipart_upload _____________________________ 2023-12-03T13:00:19.222 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.222 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.222 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.222 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:19.222 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:19.222 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.222 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:19.222 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.223 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:19.223 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:19.223 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:19.223 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.223 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:19.223 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:19.223 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.223 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.223 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:19.223 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:19.223 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.223 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.223 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:19.223 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.223 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:19.224 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:19.224 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.224 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.224 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:19.224 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:19.224 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.224 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:19.224 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:19.224 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:19.224 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:19.224 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:19.224 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.224 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:19.224 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.225 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:19.225 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:19.225 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:19.225 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:19.225 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:19.225 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:19.225 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:19.225 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:19.225 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.225 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.225 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:19.225 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:19.225 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:19.225 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:19.225 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.225 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:19.226 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:19.226 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:19.226 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:19.226 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.226 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.226 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:19.226 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:19.226 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:19.226 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:19.226 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.226 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.226 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:19.226 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:19.227 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:19.227 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.227 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:19.227 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.227 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:19.227 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:19.227 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.227 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:19.227 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:19.227 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:19.227 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:19.227 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:19.227 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:19.227 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.228 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:19.228 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.228 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:19.228 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.228 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.228 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:19.228 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.228 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:19.228 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.228 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:19.228 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:19.228 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:19.228 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:19.229 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:19.229 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:19.229 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.229 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:19.229 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:19.229 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:19.229 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:19.229 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:19.229 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:19.229 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.229 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:19.229 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:19.229 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:19.229 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:19.230 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:19.230 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:19.230 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:19.230 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:19.230 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:19.230 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:19.230 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:19.230 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.230 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.230 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:19.230 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.230 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:19.230 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:19.230 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:19.230 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:19.231 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:19.231 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:19.231 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:19.231 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:19.231 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:19.231 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:19.231 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:19.231 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:19.231 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:19.231 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:19.231 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:19.231 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:19.231 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:19.232 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:19.232 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:19.232 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:19.232 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:19.232 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:19.232 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:19.232 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:19.232 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:19.232 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:19.232 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:19.232 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:19.233 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.233 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.233 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.233 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.233 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:19.233 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:19.233 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.233 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:19.233 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.233 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:19.233 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:19.233 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:19.233 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.233 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:19.234 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:19.234 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.234 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.234 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:19.234 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:19.234 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.234 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.234 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:19.234 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:19.234 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:19.234 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:19.234 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:19.234 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.234 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.235 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:19.235 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:19.235 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:19.235 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.235 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:19.235 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.235 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:19.235 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.235 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:19.235 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.235 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T13:00:19.235 INFO:teuthology.orchestra.run.smithi003.stdout: def test_multipart_upload(): 2023-12-03T13:00:19.235 INFO:teuthology.orchestra.run.smithi003.stdout:> bucket_name = get_new_bucket() 2023-12-03T13:00:19.236 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.236 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:6019: 2023-12-03T13:00:19.236 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.236 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:19.236 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:19.236 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:19.236 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:19.236 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:19.236 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:19.236 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:19.236 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:19.236 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:19.236 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:19.237 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:19.237 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:19.237 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:19.237 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:19.237 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:19.237 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:19.237 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:19.237 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:19.237 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:19.237 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:19.237 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:19.237 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:19.237 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:19.238 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:19.238 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:19.238 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:19.238 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:19.238 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:19.238 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:19.238 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:19.238 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:19.238 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:19.238 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:19.238 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:19.238 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:19.238 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:19.238 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.239 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.239 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.239 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:19.239 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.239 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:19.239 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.239 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:19.239 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:19.239 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:19.239 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:19.239 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:19.239 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:19.239 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.240 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:19.240 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:19.240 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:19.240 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:19.240 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:19.240 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:19.240 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.240 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:19.240 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:19.240 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:19.240 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:19.240 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:19.240 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:19.240 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:19.240 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:19.241 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:19.241 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:19.241 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:19.241 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.241 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.241 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:19.241 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:19.241 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:19.241 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:19.241 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:19.241 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.241 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.242 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:19.242 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:19.242 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:19.242 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:19.242 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:19.242 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.242 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:19.242 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:19.242 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:19.242 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:19.242 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:19.242 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-329" 2023-12-03T13:00:19.242 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.243 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:19.243 INFO:teuthology.orchestra.run.smithi003.stdout:________________________ test_multipart_copy_versioned _________________________ 2023-12-03T13:00:19.243 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.243 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.243 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.243 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:19.243 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:19.243 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.243 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:19.243 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.243 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:19.243 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:19.243 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:19.243 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.243 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:19.243 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:19.244 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.244 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.244 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:19.244 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:19.244 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.244 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.244 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:19.244 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.244 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:19.244 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:19.244 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.244 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.244 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:19.245 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:19.245 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.245 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:19.245 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:19.245 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:19.245 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:19.245 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:19.245 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.245 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:19.245 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.245 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:19.245 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:19.245 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:19.245 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:19.245 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:19.246 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:19.246 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:19.246 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:19.246 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.246 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.246 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:19.246 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:19.246 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:19.246 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:19.246 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.246 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:19.246 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:19.246 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:19.247 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:19.247 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.247 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.247 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:19.247 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:19.247 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:19.247 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:19.247 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.247 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.247 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:19.247 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:19.247 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:19.247 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.247 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:19.247 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.247 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:19.248 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:19.248 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.248 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:19.248 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:19.248 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:19.248 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:19.248 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:19.248 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:19.248 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.248 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:19.248 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.248 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:19.248 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.249 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.249 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:19.249 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.249 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:19.249 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.249 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:19.249 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:19.249 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:19.249 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:19.249 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:19.249 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:19.249 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.249 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:19.249 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:19.249 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:19.249 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:19.250 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:19.250 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:19.250 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.250 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:19.250 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:19.250 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:19.250 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:19.250 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:19.250 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:19.250 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:19.250 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:19.250 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:19.250 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:19.251 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:19.251 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.251 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.251 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:19.251 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.251 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:19.251 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:19.251 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:19.251 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:19.251 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:19.251 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:19.251 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:19.251 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:19.251 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:19.252 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:19.252 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:19.252 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:19.252 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:19.252 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:19.252 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:19.252 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:19.252 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:19.252 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:19.252 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:19.252 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:19.252 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:19.252 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:19.253 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:19.253 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:19.253 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:19.253 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:19.253 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:19.253 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:19.253 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.253 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.253 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.253 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.253 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:19.253 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:19.253 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.253 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:19.254 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.254 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:19.254 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:19.254 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:19.254 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.254 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:19.254 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:19.254 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.254 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.254 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:19.254 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:19.254 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.254 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.255 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:19.255 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:19.255 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:19.255 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:19.255 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:19.255 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.255 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.255 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:19.255 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:19.255 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:19.255 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.255 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:19.255 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.255 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:19.255 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.256 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:19.256 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.256 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T13:00:19.256 INFO:teuthology.orchestra.run.smithi003.stdout: def test_multipart_copy_versioned(): 2023-12-03T13:00:19.256 INFO:teuthology.orchestra.run.smithi003.stdout:> src_bucket_name = get_new_bucket() 2023-12-03T13:00:19.256 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.256 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:6077: 2023-12-03T13:00:19.256 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.256 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:19.256 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:19.256 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:19.256 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:19.256 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:19.256 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:19.256 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:19.256 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:19.256 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:19.257 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:19.257 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:19.257 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:19.257 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:19.257 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:19.257 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:19.257 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:19.257 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:19.257 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:19.257 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:19.257 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:19.257 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:19.258 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:19.258 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:19.258 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:19.258 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:19.258 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:19.258 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:19.258 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:19.258 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:19.258 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:19.258 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:19.258 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:19.258 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:19.258 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:19.259 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:19.259 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:19.259 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.259 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.259 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.259 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:19.259 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.259 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:19.259 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.259 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:19.259 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:19.259 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:19.259 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:19.259 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:19.259 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:19.260 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.260 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:19.260 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:19.260 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:19.260 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:19.260 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:19.260 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:19.260 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.260 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:19.260 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:19.260 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:19.260 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:19.260 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:19.260 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:19.260 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:19.260 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:19.261 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:19.261 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:19.261 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:19.261 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.261 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.261 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:19.261 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:19.261 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:19.261 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:19.261 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:19.261 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.262 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.262 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:19.262 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:19.262 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:19.262 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:19.262 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:19.262 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.262 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:19.262 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:19.262 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:19.262 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:19.262 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:19.263 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-330" 2023-12-03T13:00:19.263 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.263 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:19.263 INFO:teuthology.orchestra.run.smithi003.stdout:______________________ test_multipart_upload_resend_part _______________________ 2023-12-03T13:00:19.263 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.263 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.263 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.263 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:19.263 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:19.263 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.263 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:19.263 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.263 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:19.263 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:19.264 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:19.264 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.264 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:19.264 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:19.264 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.264 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.264 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:19.264 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:19.264 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.264 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.264 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:19.264 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.264 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:19.264 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:19.264 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.264 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.264 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:19.265 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:19.265 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.265 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:19.265 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:19.265 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:19.265 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:19.265 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:19.265 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.265 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:19.265 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.265 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:19.265 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:19.265 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:19.266 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:19.266 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:19.266 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:19.266 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:19.266 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:19.266 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.266 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.266 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:19.266 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:19.266 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:19.266 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:19.266 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.266 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:19.267 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:19.267 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:19.267 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:19.267 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.267 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.267 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:19.267 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:19.267 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:19.267 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:19.267 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.267 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.267 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:19.267 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:19.268 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:19.268 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.268 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:19.268 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.268 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:19.268 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:19.268 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.268 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:19.268 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:19.268 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:19.268 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:19.268 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:19.268 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:19.268 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.268 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:19.268 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.269 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:19.269 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.269 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.269 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:19.269 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.269 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:19.269 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.269 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:19.269 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:19.269 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:19.269 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:19.269 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:19.269 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:19.269 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.270 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:19.270 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:19.270 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:19.270 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:19.270 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:19.270 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:19.270 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.270 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:19.270 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:19.270 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:19.270 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:19.270 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:19.270 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:19.270 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:19.271 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:19.271 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:19.271 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:19.271 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:19.271 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.271 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.271 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:19.271 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.271 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:19.271 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:19.271 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:19.271 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:19.271 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:19.272 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:19.272 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:19.272 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:19.272 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:19.272 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:19.272 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:19.272 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:19.272 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:19.272 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:19.272 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:19.272 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:19.272 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:19.272 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:19.272 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:19.273 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:19.273 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:19.273 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:19.273 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:19.273 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:19.273 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:19.273 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:19.273 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:19.273 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:19.273 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.273 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.273 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.273 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.273 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:19.273 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:19.274 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.274 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:19.274 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.274 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:19.274 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:19.274 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:19.274 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.274 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:19.274 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:19.274 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.274 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.274 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:19.274 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:19.275 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.275 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.275 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:19.275 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:19.275 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:19.275 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:19.275 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:19.275 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.275 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.275 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:19.275 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:19.275 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:19.275 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.275 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:19.275 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.276 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:19.276 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.276 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:19.276 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.276 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T13:00:19.276 INFO:teuthology.orchestra.run.smithi003.stdout: def test_multipart_upload_resend_part(): 2023-12-03T13:00:19.276 INFO:teuthology.orchestra.run.smithi003.stdout:> bucket_name = get_new_bucket() 2023-12-03T13:00:19.276 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.276 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:6123: 2023-12-03T13:00:19.276 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.276 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:19.276 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:19.276 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:19.276 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:19.276 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:19.276 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:19.277 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:19.277 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:19.277 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:19.277 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:19.277 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:19.277 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:19.277 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:19.277 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:19.277 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:19.277 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:19.277 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:19.277 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:19.277 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:19.277 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:19.277 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:19.278 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:19.278 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:19.278 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:19.278 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:19.278 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:19.278 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:19.278 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:19.278 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:19.278 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:19.278 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:19.278 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:19.278 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:19.279 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:19.279 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:19.279 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:19.279 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.279 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.279 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.279 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:19.279 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.279 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:19.279 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.279 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:19.279 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:19.279 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:19.279 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:19.280 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:19.280 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:19.280 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.280 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:19.280 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:19.280 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:19.280 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:19.280 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:19.280 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:19.280 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.280 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:19.280 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:19.280 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:19.280 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:19.280 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:19.281 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:19.281 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:19.281 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:19.281 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:19.281 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:19.281 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:19.281 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.281 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.281 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:19.281 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:19.281 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:19.281 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:19.281 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:19.281 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.281 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.282 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:19.282 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:19.282 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:19.282 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:19.282 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:19.282 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.282 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:19.282 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:19.282 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:19.282 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:19.282 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:19.282 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-331" 2023-12-03T13:00:19.283 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.283 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:19.283 INFO:teuthology.orchestra.run.smithi003.stdout:_____________________ test_multipart_upload_multiple_sizes _____________________ 2023-12-03T13:00:19.283 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.283 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.283 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.283 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:19.283 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:19.283 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.283 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:19.283 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.283 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:19.283 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:19.283 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:19.283 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.284 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:19.284 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:19.284 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.284 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.284 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:19.284 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:19.284 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.284 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.284 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:19.284 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.284 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:19.284 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:19.284 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.285 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.285 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:19.285 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:19.285 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.285 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:19.285 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:19.285 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:19.285 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:19.285 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:19.285 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.285 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:19.285 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.285 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:19.285 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:19.285 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:19.285 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:19.285 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:19.286 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:19.286 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:19.286 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:19.286 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.286 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.286 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:19.286 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:19.286 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:19.286 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:19.286 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.286 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:19.286 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:19.287 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:19.287 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:19.287 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.287 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.287 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:19.287 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:19.287 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:19.287 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:19.287 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.287 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.287 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:19.287 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:19.287 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:19.287 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.287 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:19.287 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.288 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:19.288 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:19.288 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.288 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:19.288 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:19.288 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:19.288 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:19.288 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:19.288 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:19.288 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.288 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:19.288 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.288 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:19.288 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.289 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.289 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:19.289 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.289 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:19.289 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.289 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:19.289 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:19.289 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:19.289 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:19.289 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:19.289 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:19.289 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.289 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:19.289 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:19.289 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:19.290 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:19.290 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:19.290 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:19.290 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.290 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:19.290 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:19.290 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:19.290 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:19.290 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:19.290 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:19.291 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:19.291 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:19.291 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:19.291 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:19.291 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:19.291 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.291 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.291 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:19.291 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.291 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:19.292 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:19.292 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:19.292 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:19.292 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:19.292 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:19.292 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:19.292 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:19.292 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:19.292 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:19.292 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:19.292 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:19.292 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:19.293 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:19.293 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:19.293 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:19.293 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:19.293 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:19.293 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:19.293 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:19.293 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:19.293 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:19.293 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:19.293 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:19.293 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:19.293 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:19.293 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:19.294 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:19.294 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.294 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.294 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.294 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.294 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:19.294 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:19.294 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.294 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:19.294 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.294 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:19.294 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:19.295 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:19.295 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.295 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:19.295 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:19.295 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.295 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.295 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:19.295 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:19.295 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.295 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.295 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:19.295 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:19.296 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:19.296 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:19.296 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:19.296 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.296 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.296 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:19.296 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:19.296 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:19.296 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.296 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:19.296 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.296 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:19.296 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.297 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:19.297 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.297 INFO:teuthology.orchestra.run.smithi003.stdout: def test_multipart_upload_multiple_sizes(): 2023-12-03T13:00:19.297 INFO:teuthology.orchestra.run.smithi003.stdout:> bucket_name = get_new_bucket() 2023-12-03T13:00:19.297 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.297 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:6134: 2023-12-03T13:00:19.297 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.297 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:19.297 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:19.297 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:19.297 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:19.297 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:19.297 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:19.298 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:19.298 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:19.298 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:19.298 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:19.298 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:19.298 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:19.298 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:19.298 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:19.298 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:19.298 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:19.298 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:19.298 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:19.298 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:19.298 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:19.298 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:19.299 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:19.299 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:19.299 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:19.299 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:19.299 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:19.299 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:19.299 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:19.299 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:19.299 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:19.299 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:19.299 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:19.300 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:19.300 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:19.300 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:19.300 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:19.300 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.300 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.300 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.300 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:19.300 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.300 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:19.300 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.300 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:19.300 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:19.300 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:19.301 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:19.301 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:19.301 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:19.301 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.301 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:19.301 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:19.301 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:19.301 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:19.301 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:19.301 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:19.301 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.301 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:19.301 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:19.302 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:19.302 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:19.302 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:19.302 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:19.302 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:19.302 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:19.302 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:19.302 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:19.302 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:19.302 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.302 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.302 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:19.302 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:19.302 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:19.303 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:19.303 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:19.303 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.303 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.303 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:19.303 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:19.303 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:19.303 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:19.303 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:19.303 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.303 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:19.303 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:19.303 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:19.304 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:19.304 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:19.304 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-332" 2023-12-03T13:00:19.304 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.304 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:19.304 INFO:teuthology.orchestra.run.smithi003.stdout:______________________ test_multipart_copy_multiple_sizes ______________________ 2023-12-03T13:00:19.304 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.304 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.304 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.304 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:19.304 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:19.304 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.305 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:19.305 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.305 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:19.305 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:19.305 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:19.305 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.305 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:19.305 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:19.305 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.305 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.305 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:19.305 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:19.305 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.306 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.306 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:19.306 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.306 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:19.306 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:19.306 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.306 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.306 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:19.306 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:19.306 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.306 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:19.306 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:19.306 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:19.307 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:19.307 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:19.307 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.307 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:19.307 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.307 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:19.307 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:19.307 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:19.307 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:19.307 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:19.307 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:19.307 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:19.307 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:19.307 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.307 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.307 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:19.308 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:19.308 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:19.308 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:19.308 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.308 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:19.308 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:19.308 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:19.308 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:19.308 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.308 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.308 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:19.308 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:19.308 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:19.308 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:19.309 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.309 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.309 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:19.309 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:19.309 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:19.309 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.309 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:19.309 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.309 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:19.309 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:19.309 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.309 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:19.309 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:19.310 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:19.310 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:19.310 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:19.310 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:19.310 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.310 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:19.310 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.310 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:19.310 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.310 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.310 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:19.310 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.310 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:19.311 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.311 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:19.311 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:19.311 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:19.311 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:19.311 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:19.311 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:19.311 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.311 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:19.311 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:19.311 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:19.311 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:19.311 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:19.311 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:19.312 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.312 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:19.312 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:19.312 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:19.312 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:19.312 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:19.312 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:19.312 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:19.312 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:19.312 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:19.312 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:19.312 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:19.312 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.312 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.312 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:19.312 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.313 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:19.313 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:19.313 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:19.313 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:19.313 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:19.313 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:19.313 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:19.313 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:19.313 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:19.313 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:19.313 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:19.313 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:19.314 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:19.314 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:19.314 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:19.314 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:19.314 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:19.314 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:19.314 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:19.314 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:19.314 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:19.314 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:19.314 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:19.314 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:19.314 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:19.314 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:19.314 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:19.315 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:19.315 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.315 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.315 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.315 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.315 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:19.315 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:19.315 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.315 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:19.315 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.315 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:19.315 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:19.315 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:19.316 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.316 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:19.316 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:19.316 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.316 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.316 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:19.316 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:19.316 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.316 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.316 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:19.316 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:19.316 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:19.316 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:19.316 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:19.316 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.317 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.317 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:19.317 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:19.317 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:19.317 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.317 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:19.317 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.317 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:19.317 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.317 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:19.317 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.317 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T13:00:19.317 INFO:teuthology.orchestra.run.smithi003.stdout: def test_multipart_copy_multiple_sizes(): 2023-12-03T13:00:19.317 INFO:teuthology.orchestra.run.smithi003.stdout: src_key = 'foo' 2023-12-03T13:00:19.318 INFO:teuthology.orchestra.run.smithi003.stdout:> src_bucket_name = _create_key_with_random_content(src_key, 12*1024*1024) 2023-12-03T13:00:19.318 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.318 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:6165: 2023-12-03T13:00:19.318 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.318 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:5832: in _create_key_with_random_content 2023-12-03T13:00:19.318 INFO:teuthology.orchestra.run.smithi003.stdout: bucket_name = get_new_bucket() 2023-12-03T13:00:19.318 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:19.318 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:19.318 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:19.318 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:19.318 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:19.318 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:19.319 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:19.319 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:19.319 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:19.319 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:19.319 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:19.319 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:19.319 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:19.319 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:19.319 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:19.319 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:19.319 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:19.319 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:19.319 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:19.319 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:19.319 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:19.320 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:19.320 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:19.320 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:19.320 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:19.320 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:19.320 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:19.320 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:19.320 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:19.320 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:19.320 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:19.320 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:19.320 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:19.320 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:19.320 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:19.321 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:19.321 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.321 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.321 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.321 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:19.321 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.321 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:19.321 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.321 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:19.321 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:19.321 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:19.321 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:19.321 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:19.322 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:19.322 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.322 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:19.322 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:19.322 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:19.322 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:19.322 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:19.322 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:19.322 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.322 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:19.322 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:19.322 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:19.322 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:19.323 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:19.323 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:19.323 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:19.323 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:19.323 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:19.323 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:19.323 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:19.323 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.323 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.323 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:19.323 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:19.323 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:19.323 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:19.323 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:19.324 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.324 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.324 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:19.324 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:19.324 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:19.324 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:19.324 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:19.324 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.324 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:19.324 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:19.324 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:19.324 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:19.324 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:19.324 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-333" 2023-12-03T13:00:19.324 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.324 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:19.325 INFO:teuthology.orchestra.run.smithi003.stdout:_____________________ test_multipart_upload_size_too_small _____________________ 2023-12-03T13:00:19.325 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.325 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.325 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.325 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:19.325 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:19.325 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.325 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:19.325 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.325 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:19.325 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:19.325 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:19.325 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.325 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:19.325 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:19.325 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.326 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.326 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:19.326 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:19.326 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.326 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.326 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:19.326 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.326 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:19.326 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:19.326 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.326 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.326 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:19.327 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:19.327 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.327 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:19.327 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:19.327 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:19.327 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:19.327 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:19.327 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.327 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:19.327 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.327 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:19.327 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:19.327 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:19.327 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:19.327 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:19.328 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:19.328 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:19.328 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:19.328 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.328 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.328 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:19.328 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:19.328 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:19.328 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:19.328 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.328 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:19.328 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:19.328 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:19.328 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:19.329 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.329 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.329 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:19.329 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:19.329 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:19.329 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:19.329 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.329 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.329 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:19.329 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:19.329 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:19.329 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.329 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:19.329 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.329 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:19.329 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:19.330 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.330 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:19.330 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:19.330 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:19.330 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:19.330 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:19.330 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:19.330 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.330 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:19.330 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.330 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:19.330 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.331 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.331 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:19.331 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.331 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:19.331 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.331 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:19.331 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:19.331 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:19.331 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:19.331 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:19.331 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:19.331 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.331 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:19.331 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:19.331 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:19.332 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:19.332 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:19.332 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:19.332 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.332 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:19.332 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:19.332 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:19.332 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:19.332 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:19.332 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:19.332 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:19.332 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:19.332 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:19.333 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:19.333 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:19.333 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.333 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.333 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:19.333 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.333 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:19.333 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:19.333 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:19.333 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:19.333 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:19.333 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:19.333 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:19.333 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:19.334 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:19.334 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:19.334 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:19.334 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:19.334 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:19.334 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:19.334 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:19.334 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:19.334 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:19.334 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:19.334 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:19.334 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:19.334 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:19.335 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:19.335 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:19.335 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:19.335 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:19.335 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:19.335 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:19.335 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:19.335 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.335 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.335 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.335 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.335 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:19.335 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:19.335 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.335 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:19.336 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.336 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:19.336 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:19.336 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:19.336 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.336 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:19.336 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:19.336 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.336 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.336 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:19.336 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:19.336 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.336 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.336 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:19.336 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:19.337 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:19.337 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:19.337 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:19.337 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.337 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.337 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:19.337 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:19.337 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:19.337 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.337 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:19.337 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.337 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:19.337 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.338 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:19.338 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.338 INFO:teuthology.orchestra.run.smithi003.stdout: def test_multipart_upload_size_too_small(): 2023-12-03T13:00:19.338 INFO:teuthology.orchestra.run.smithi003.stdout:> bucket_name = get_new_bucket() 2023-12-03T13:00:19.338 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.338 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:6202: 2023-12-03T13:00:19.338 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.338 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:19.338 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:19.338 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:19.338 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:19.338 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:19.338 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:19.338 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:19.338 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:19.339 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:19.339 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:19.339 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:19.339 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:19.339 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:19.339 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:19.339 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:19.339 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:19.339 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:19.339 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:19.339 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:19.339 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:19.339 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:19.339 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:19.340 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:19.340 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:19.340 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:19.340 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:19.340 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:19.340 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:19.340 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:19.340 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:19.340 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:19.340 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:19.340 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:19.340 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:19.340 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:19.341 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:19.341 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.341 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.341 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.341 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:19.341 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.341 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:19.341 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.341 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:19.341 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:19.341 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:19.341 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:19.341 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:19.341 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:19.342 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.342 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:19.342 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:19.342 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:19.342 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:19.342 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:19.342 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:19.342 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.342 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:19.342 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:19.342 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:19.342 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:19.342 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:19.343 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:19.343 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:19.343 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:19.343 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:19.343 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:19.343 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:19.343 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.343 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.343 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:19.343 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:19.343 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:19.343 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:19.343 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:19.343 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.344 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.344 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:19.344 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:19.344 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:19.344 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:19.344 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:19.344 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.344 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:19.344 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:19.344 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:19.344 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:19.344 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:19.344 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-334" 2023-12-03T13:00:19.344 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.345 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:19.345 INFO:teuthology.orchestra.run.smithi003.stdout:________________________ test_multipart_upload_contents ________________________ 2023-12-03T13:00:19.345 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.345 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.345 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.345 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:19.345 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:19.345 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.345 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:19.345 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.345 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:19.345 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:19.345 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:19.345 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.346 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:19.346 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:19.346 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.346 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.346 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:19.346 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:19.346 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.346 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.346 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:19.346 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.346 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:19.346 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:19.346 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.346 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.347 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:19.347 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:19.347 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.347 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:19.347 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:19.347 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:19.347 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:19.347 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:19.347 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.347 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:19.347 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.347 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:19.347 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:19.347 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:19.347 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:19.347 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:19.348 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:19.348 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:19.348 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:19.348 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.348 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.348 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:19.348 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:19.348 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:19.348 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:19.348 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.348 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:19.348 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:19.348 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:19.349 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:19.349 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.349 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.349 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:19.349 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:19.349 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:19.349 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:19.349 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.349 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.349 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:19.349 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:19.349 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:19.349 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.349 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:19.349 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.350 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:19.350 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:19.350 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.350 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:19.350 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:19.350 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:19.350 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:19.350 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:19.350 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:19.350 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.350 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:19.350 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.350 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:19.351 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.351 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.351 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:19.351 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.351 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:19.351 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.351 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:19.351 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:19.351 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:19.351 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:19.351 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:19.351 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:19.351 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.351 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:19.352 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:19.352 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:19.352 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:19.352 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:19.352 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:19.352 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.352 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:19.352 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:19.352 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:19.352 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:19.352 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:19.352 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:19.352 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:19.352 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:19.353 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:19.353 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:19.353 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:19.353 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.353 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.353 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:19.353 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.353 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:19.353 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:19.353 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:19.353 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:19.353 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:19.353 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:19.353 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:19.353 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:19.354 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:19.354 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:19.354 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:19.354 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:19.354 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:19.354 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:19.354 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:19.354 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:19.354 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:19.354 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:19.354 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:19.354 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:19.354 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:19.354 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:19.355 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:19.355 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:19.355 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:19.355 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:19.355 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:19.355 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:19.355 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.355 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.355 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.355 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.355 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:19.355 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:19.355 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.355 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:19.355 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.356 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:19.356 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:19.356 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:19.356 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.356 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:19.356 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:19.356 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.356 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.356 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:19.356 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:19.356 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.356 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.356 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:19.356 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:19.356 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:19.356 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:19.357 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:19.357 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.357 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.357 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:19.357 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:19.357 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:19.357 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.357 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:19.357 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.357 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:19.357 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.357 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:19.357 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.358 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T13:00:19.358 INFO:teuthology.orchestra.run.smithi003.stdout: def test_multipart_upload_contents(): 2023-12-03T13:00:19.358 INFO:teuthology.orchestra.run.smithi003.stdout:> bucket_name = get_new_bucket() 2023-12-03T13:00:19.358 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.358 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:6248: 2023-12-03T13:00:19.358 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.358 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:19.358 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:19.358 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:19.358 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:19.358 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:19.358 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:19.358 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:19.359 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:19.359 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:19.359 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:19.359 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:19.359 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:19.359 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:19.359 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:19.359 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:19.359 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:19.359 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:19.359 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:19.359 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:19.359 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:19.359 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:19.360 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:19.360 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:19.360 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:19.360 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:19.360 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:19.360 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:19.360 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:19.360 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:19.360 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:19.360 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:19.360 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:19.360 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:19.360 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:19.360 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:19.360 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:19.361 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.361 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.361 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.361 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:19.361 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.361 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:19.361 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.361 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:19.361 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:19.361 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:19.361 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:19.361 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:19.361 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:19.362 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.362 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:19.362 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:19.362 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:19.362 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:19.362 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:19.362 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:19.362 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.362 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:19.362 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:19.362 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:19.363 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:19.363 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:19.363 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:19.363 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:19.363 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:19.363 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:19.363 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:19.363 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:19.363 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.363 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.363 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:19.363 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:19.363 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:19.363 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:19.364 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:19.364 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.364 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.364 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:19.364 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:19.364 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:19.364 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:19.364 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:19.364 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.364 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:19.364 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:19.364 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:19.364 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:19.364 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:19.364 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-335" 2023-12-03T13:00:19.365 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.365 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:19.365 INFO:teuthology.orchestra.run.smithi003.stdout:_______________ test_multipart_upload_overwrite_existing_object ________________ 2023-12-03T13:00:19.365 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.365 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.365 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.365 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:19.365 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:19.365 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.365 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:19.365 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.365 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:19.365 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:19.366 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:19.366 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.366 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:19.366 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:19.366 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.366 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.366 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:19.366 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:19.366 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.366 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.366 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:19.366 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.366 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:19.366 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:19.367 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.367 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.367 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:19.367 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:19.367 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.367 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:19.367 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:19.367 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:19.367 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:19.367 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:19.367 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.367 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:19.367 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.367 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:19.368 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:19.368 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:19.368 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:19.368 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:19.368 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:19.368 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:19.368 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:19.368 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.368 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.368 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:19.368 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:19.368 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:19.368 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:19.368 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.368 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:19.369 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:19.369 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:19.369 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:19.369 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.369 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.369 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:19.369 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:19.369 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:19.369 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:19.369 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.369 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.369 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:19.369 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:19.370 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:19.370 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.370 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:19.370 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.370 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:19.370 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:19.370 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.370 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:19.370 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:19.370 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:19.370 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:19.370 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:19.370 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:19.370 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.371 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:19.371 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.371 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:19.371 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.371 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.371 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:19.371 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.371 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:19.371 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.371 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:19.371 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:19.371 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:19.371 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:19.372 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:19.372 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:19.372 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.372 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:19.372 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:19.372 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:19.372 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:19.372 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:19.372 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:19.372 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.372 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:19.372 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:19.372 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:19.373 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:19.373 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:19.373 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:19.373 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:19.373 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:19.373 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:19.373 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:19.373 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:19.373 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.373 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.373 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:19.373 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.373 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:19.373 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:19.373 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:19.373 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:19.374 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:19.374 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:19.374 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:19.374 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:19.374 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:19.374 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:19.374 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:19.374 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:19.374 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:19.374 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:19.374 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:19.374 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:19.375 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:19.375 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:19.375 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:19.375 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:19.375 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:19.375 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:19.375 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:19.375 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:19.375 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:19.375 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:19.375 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:19.375 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:19.375 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.376 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.376 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.376 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.376 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:19.376 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:19.376 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.376 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:19.376 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.376 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:19.376 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:19.376 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:19.376 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.376 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:19.376 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:19.376 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.377 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.377 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:19.377 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:19.377 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.377 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.377 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:19.377 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:19.377 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:19.377 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:19.377 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:19.377 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.377 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.377 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:19.377 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:19.377 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:19.378 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.378 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:19.378 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.378 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:19.378 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.378 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:19.378 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.378 INFO:teuthology.orchestra.run.smithi003.stdout: def test_multipart_upload_overwrite_existing_object(): 2023-12-03T13:00:19.378 INFO:teuthology.orchestra.run.smithi003.stdout:> bucket_name = get_new_bucket() 2023-12-03T13:00:19.378 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.379 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:6252: 2023-12-03T13:00:19.379 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.379 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:19.379 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:19.379 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:19.379 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:19.379 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:19.379 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:19.379 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:19.379 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:19.379 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:19.379 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:19.379 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:19.379 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:19.379 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:19.380 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:19.380 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:19.380 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:19.380 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:19.380 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:19.380 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:19.380 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:19.380 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:19.380 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:19.380 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:19.380 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:19.380 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:19.380 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:19.381 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:19.381 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:19.381 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:19.381 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:19.381 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:19.381 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:19.381 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:19.381 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:19.381 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:19.381 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:19.381 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.381 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.381 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.381 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:19.382 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.382 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:19.382 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.382 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:19.382 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:19.382 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:19.382 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:19.382 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:19.382 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:19.382 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.382 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:19.382 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:19.382 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:19.383 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:19.383 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:19.383 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:19.383 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.383 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:19.383 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:19.383 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:19.383 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:19.383 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:19.383 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:19.383 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:19.383 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:19.383 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:19.383 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:19.384 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:19.384 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.384 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.384 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:19.384 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:19.384 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:19.384 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:19.384 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:19.384 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.384 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.384 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:19.384 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:19.384 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:19.384 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:19.385 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:19.385 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.385 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:19.385 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:19.385 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:19.385 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:19.385 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:19.385 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-336" 2023-12-03T13:00:19.385 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.385 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:19.385 INFO:teuthology.orchestra.run.smithi003.stdout:_________________________ test_abort_multipart_upload __________________________ 2023-12-03T13:00:19.385 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.385 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.385 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.385 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:19.386 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:19.386 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.386 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:19.386 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.386 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:19.386 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:19.386 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:19.386 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.386 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:19.386 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:19.386 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.386 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.386 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:19.386 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:19.387 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.387 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.387 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:19.387 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.387 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:19.387 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:19.387 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.387 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.387 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:19.387 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:19.387 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.387 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:19.387 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:19.387 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:19.387 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:19.388 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:19.388 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.388 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:19.388 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.388 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:19.388 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:19.388 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:19.388 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:19.388 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:19.388 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:19.388 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:19.388 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:19.388 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.388 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.388 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:19.389 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:19.389 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:19.389 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:19.389 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.389 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:19.389 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:19.389 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:19.389 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:19.389 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.389 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.389 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:19.389 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:19.389 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:19.389 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:19.389 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.390 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.390 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:19.390 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:19.390 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:19.390 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.390 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:19.390 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.390 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:19.390 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:19.390 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.390 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:19.390 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:19.390 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:19.390 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:19.391 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:19.391 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:19.391 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.391 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:19.391 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.391 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:19.391 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.391 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.391 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:19.391 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.391 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:19.391 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.391 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:19.392 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:19.392 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:19.392 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:19.392 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:19.392 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:19.392 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.392 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:19.392 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:19.392 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:19.392 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:19.392 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:19.392 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:19.392 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.392 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:19.393 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:19.393 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:19.393 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:19.393 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:19.393 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:19.393 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:19.393 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:19.393 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:19.393 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:19.393 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:19.393 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.393 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.393 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:19.393 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.394 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:19.394 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:19.394 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:19.394 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:19.394 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:19.394 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:19.394 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:19.394 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:19.394 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:19.394 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:19.394 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:19.394 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:19.394 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:19.394 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:19.395 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:19.395 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:19.395 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:19.395 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:19.395 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:19.395 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:19.395 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:19.395 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:19.395 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:19.395 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:19.395 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:19.395 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:19.395 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:19.395 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:19.396 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.396 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.396 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.396 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.396 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:19.396 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:19.396 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.396 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:19.396 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.396 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:19.396 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:19.396 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:19.396 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.396 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:19.396 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:19.397 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.397 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.397 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:19.397 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:19.397 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.397 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.397 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:19.397 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:19.397 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:19.397 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:19.397 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:19.397 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.397 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.397 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:19.398 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:19.398 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:19.398 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.398 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:19.398 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.398 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:19.398 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.398 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:19.398 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.398 INFO:teuthology.orchestra.run.smithi003.stdout: def test_abort_multipart_upload(): 2023-12-03T13:00:19.398 INFO:teuthology.orchestra.run.smithi003.stdout:> bucket_name = get_new_bucket() 2023-12-03T13:00:19.398 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.398 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:6277: 2023-12-03T13:00:19.398 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.399 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:19.399 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:19.399 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:19.399 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:19.399 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:19.399 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:19.399 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:19.399 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:19.399 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:19.399 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:19.399 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:19.399 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:19.399 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:19.399 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:19.399 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:19.400 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:19.400 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:19.400 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:19.400 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:19.400 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:19.400 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:19.400 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:19.400 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:19.400 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:19.400 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:19.400 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:19.400 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:19.400 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:19.401 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:19.401 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:19.401 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:19.401 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:19.401 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:19.401 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:19.401 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:19.401 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:19.401 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.401 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.401 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.401 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:19.401 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.402 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:19.402 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.402 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:19.402 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:19.402 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:19.402 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:19.402 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:19.402 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:19.402 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.402 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:19.402 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:19.402 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:19.402 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:19.403 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:19.403 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:19.403 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.403 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:19.403 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:19.403 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:19.403 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:19.403 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:19.403 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:19.403 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:19.403 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:19.403 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:19.403 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:19.403 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:19.403 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.403 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.404 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:19.404 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:19.404 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:19.404 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:19.404 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:19.404 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.404 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.404 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:19.404 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:19.404 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:19.404 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:19.404 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:19.404 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.405 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:19.405 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:19.405 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:19.405 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:19.405 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:19.405 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-337" 2023-12-03T13:00:19.405 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.405 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:19.405 INFO:teuthology.orchestra.run.smithi003.stdout:____________________ test_abort_multipart_upload_not_found _____________________ 2023-12-03T13:00:19.405 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.405 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.405 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.405 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:19.405 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:19.405 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.406 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:19.406 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.406 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:19.406 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:19.406 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:19.406 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.406 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:19.406 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:19.406 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.406 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.406 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:19.406 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:19.406 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.406 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.407 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:19.407 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.407 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:19.407 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:19.407 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.407 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.407 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:19.407 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:19.407 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.407 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:19.407 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:19.407 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:19.407 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:19.407 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:19.407 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.407 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:19.408 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.408 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:19.408 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:19.408 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:19.408 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:19.408 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:19.408 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:19.408 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:19.408 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:19.408 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.408 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.408 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:19.408 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:19.408 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:19.409 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:19.409 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.409 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:19.409 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:19.409 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:19.409 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:19.409 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.409 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.409 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:19.409 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:19.409 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:19.409 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:19.409 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.409 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.410 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:19.410 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:19.410 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:19.410 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.410 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:19.410 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.410 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:19.410 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:19.410 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.410 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:19.410 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:19.410 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:19.410 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:19.410 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:19.411 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:19.411 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.411 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:19.411 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.411 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:19.411 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.411 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.411 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:19.411 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.411 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:19.411 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.411 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:19.411 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:19.411 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:19.411 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:19.412 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:19.412 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:19.412 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.412 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:19.412 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:19.412 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:19.412 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:19.412 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:19.412 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:19.412 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.412 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:19.412 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:19.412 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:19.412 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:19.413 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:19.413 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:19.413 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:19.413 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:19.413 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:19.413 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:19.413 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:19.413 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.413 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.413 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:19.413 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.413 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:19.413 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:19.413 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:19.414 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:19.414 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:19.414 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:19.414 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:19.414 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:19.414 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:19.414 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:19.414 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:19.414 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:19.414 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:19.414 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:19.414 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:19.414 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:19.415 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:19.415 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:19.415 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:19.415 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:19.415 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:19.415 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:19.415 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:19.415 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:19.415 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:19.415 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:19.415 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:19.415 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:19.415 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.415 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.415 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.415 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.416 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:19.416 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:19.416 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.416 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:19.416 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.416 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:19.416 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:19.416 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:19.416 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.416 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:19.416 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:19.416 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.416 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.416 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:19.417 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:19.417 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.417 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.417 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:19.417 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:19.417 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:19.417 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:19.417 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:19.417 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.417 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.417 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:19.417 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:19.417 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:19.417 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.418 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:19.418 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.418 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:19.418 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.418 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:19.418 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.418 INFO:teuthology.orchestra.run.smithi003.stdout: def test_abort_multipart_upload_not_found(): 2023-12-03T13:00:19.418 INFO:teuthology.orchestra.run.smithi003.stdout:> bucket_name = get_new_bucket() 2023-12-03T13:00:19.418 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.418 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:6289: 2023-12-03T13:00:19.418 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.418 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:19.418 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:19.418 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:19.419 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:19.419 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:19.419 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:19.419 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:19.419 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:19.419 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:19.419 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:19.419 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:19.419 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:19.419 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:19.419 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:19.419 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:19.419 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:19.419 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:19.419 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:19.419 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:19.420 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:19.420 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:19.420 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:19.420 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:19.420 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:19.420 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:19.420 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:19.420 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:19.420 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:19.420 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:19.420 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:19.420 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:19.420 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:19.420 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:19.420 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:19.421 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:19.421 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:19.421 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.421 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.421 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.421 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:19.421 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.421 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:19.421 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.421 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:19.421 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:19.421 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:19.421 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:19.422 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:19.422 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:19.422 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.422 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:19.422 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:19.422 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:19.422 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:19.422 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:19.422 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:19.422 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.422 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:19.422 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:19.422 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:19.423 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:19.423 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:19.423 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:19.423 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:19.423 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:19.423 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:19.423 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:19.423 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:19.423 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.423 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.423 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:19.423 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:19.423 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:19.423 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:19.424 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:19.424 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.424 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.424 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:19.424 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:19.424 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:19.424 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:19.424 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:19.424 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.424 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:19.424 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:19.424 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:19.424 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:19.424 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:19.424 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-338" 2023-12-03T13:00:19.425 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.425 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:19.425 INFO:teuthology.orchestra.run.smithi003.stdout:__________________________ test_list_multipart_upload __________________________ 2023-12-03T13:00:19.425 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.425 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.425 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.425 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:19.425 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:19.425 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.425 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:19.425 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.425 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:19.425 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:19.425 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:19.426 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.426 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:19.426 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:19.426 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.426 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.426 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:19.426 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:19.426 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.426 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.426 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:19.426 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.426 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:19.426 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:19.427 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.427 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.427 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:19.427 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:19.427 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.427 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:19.427 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:19.427 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:19.427 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:19.427 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:19.427 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.427 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:19.427 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.427 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:19.428 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:19.428 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:19.428 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:19.428 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:19.428 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:19.428 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:19.428 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:19.428 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.428 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.428 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:19.428 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:19.428 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:19.428 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:19.429 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.429 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:19.429 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:19.429 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:19.429 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:19.429 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.429 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.429 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:19.429 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:19.429 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:19.429 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:19.429 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.429 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.429 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:19.429 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:19.430 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:19.430 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.430 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:19.430 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.430 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:19.430 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:19.430 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.430 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:19.430 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:19.430 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:19.430 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:19.430 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:19.430 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:19.430 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.431 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:19.431 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.431 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:19.431 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.431 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.431 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:19.431 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.431 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:19.431 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.431 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:19.431 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:19.431 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:19.431 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:19.432 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:19.432 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:19.432 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.432 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:19.432 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:19.432 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:19.432 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:19.432 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:19.432 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:19.432 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.432 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:19.432 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:19.433 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:19.433 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:19.433 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:19.433 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:19.433 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:19.433 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:19.433 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:19.433 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:19.433 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:19.433 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.433 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.433 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:19.433 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.433 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:19.434 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:19.434 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:19.434 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:19.434 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:19.434 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:19.434 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:19.434 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:19.434 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:19.434 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:19.434 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:19.434 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:19.434 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:19.434 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:19.435 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:19.435 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:19.435 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:19.435 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:19.435 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:19.435 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:19.435 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:19.435 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:19.435 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:19.435 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:19.435 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:19.435 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:19.435 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:19.435 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:19.436 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.436 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.436 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.436 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.436 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:19.436 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:19.436 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.436 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:19.436 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.436 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:19.436 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:19.436 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:19.436 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.436 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:19.437 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:19.437 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.437 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.437 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:19.437 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:19.437 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.437 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.437 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:19.437 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:19.437 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:19.437 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:19.437 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:19.437 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.437 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.438 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:19.438 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:19.438 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:19.438 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.438 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:19.438 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.438 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:19.438 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.438 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:19.438 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.438 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T13:00:19.438 INFO:teuthology.orchestra.run.smithi003.stdout: def test_list_multipart_upload(): 2023-12-03T13:00:19.438 INFO:teuthology.orchestra.run.smithi003.stdout:> bucket_name = get_new_bucket() 2023-12-03T13:00:19.439 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.439 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:6301: 2023-12-03T13:00:19.439 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.439 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:19.439 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:19.439 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:19.439 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:19.439 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:19.439 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:19.439 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:19.439 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:19.439 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:19.439 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:19.439 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:19.440 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:19.440 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:19.440 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:19.440 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:19.440 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:19.440 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:19.440 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:19.440 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:19.440 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:19.440 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:19.440 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:19.440 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:19.440 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:19.440 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:19.441 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:19.441 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:19.441 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:19.441 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:19.441 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:19.441 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:19.441 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:19.441 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:19.441 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:19.441 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:19.441 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:19.441 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.441 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.442 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.442 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:19.442 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.442 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:19.442 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.442 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:19.442 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:19.442 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:19.442 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:19.442 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:19.442 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:19.442 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.442 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:19.443 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:19.443 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:19.443 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:19.443 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:19.443 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:19.443 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.443 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:19.443 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:19.443 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:19.443 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:19.443 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:19.443 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:19.443 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:19.443 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:19.443 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:19.444 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:19.444 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:19.444 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.444 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.444 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:19.444 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:19.444 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:19.444 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:19.444 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:19.444 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.444 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.444 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:19.444 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:19.445 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:19.445 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:19.445 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:19.445 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.445 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:19.445 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:19.445 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:19.445 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:19.445 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:19.445 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-339" 2023-12-03T13:00:19.445 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.445 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:19.445 INFO:teuthology.orchestra.run.smithi003.stdout:_______________________ test_list_multipart_upload_owner _______________________ 2023-12-03T13:00:19.445 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.445 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.446 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.446 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:19.446 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:19.446 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.446 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:19.446 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.446 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:19.446 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:19.446 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:19.446 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.446 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:19.446 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:19.446 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.446 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.447 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:19.447 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:19.447 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.447 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.447 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:19.447 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.447 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:19.447 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:19.447 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.447 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.447 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:19.447 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:19.447 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.448 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:19.448 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:19.448 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:19.448 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:19.448 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:19.448 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.448 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:19.448 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.448 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:19.448 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:19.448 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:19.448 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:19.448 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:19.448 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:19.448 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:19.449 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:19.449 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.449 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.449 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:19.449 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:19.449 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:19.449 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:19.449 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.449 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:19.449 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:19.449 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:19.449 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:19.449 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.449 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.450 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:19.450 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:19.450 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:19.450 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:19.450 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.450 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.450 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:19.450 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:19.450 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:19.450 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.450 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:19.450 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.450 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:19.450 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:19.451 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.451 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:19.451 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:19.451 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:19.451 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:19.451 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:19.451 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:19.451 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.451 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:19.451 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.451 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:19.451 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.451 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.452 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:19.452 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.452 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:19.452 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.452 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:19.452 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:19.452 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:19.452 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:19.452 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:19.452 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:19.452 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.452 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:19.453 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:19.453 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:19.453 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:19.453 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:19.453 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:19.453 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.453 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:19.453 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:19.453 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:19.453 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:19.453 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:19.453 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:19.453 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:19.453 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:19.453 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:19.454 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:19.454 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:19.454 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.454 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.454 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:19.454 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.454 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:19.454 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:19.454 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:19.454 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:19.454 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:19.454 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:19.454 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:19.454 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:19.455 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:19.455 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:19.455 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:19.455 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:19.455 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:19.455 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:19.455 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:19.455 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:19.455 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:19.455 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:19.455 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:19.455 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:19.455 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:19.456 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:19.456 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:19.456 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:19.456 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:19.456 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:19.456 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:19.456 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:19.456 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.456 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.456 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.456 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.456 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:19.456 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:19.456 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.456 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:19.457 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.457 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:19.457 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:19.457 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:19.457 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.457 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:19.457 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:19.457 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.457 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.457 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:19.457 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:19.457 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.457 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.457 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:19.458 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:19.458 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:19.458 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:19.458 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:19.458 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.458 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.458 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:19.458 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:19.458 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:19.458 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.458 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:19.458 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.459 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:19.459 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.459 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:19.459 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.459 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T13:00:19.459 INFO:teuthology.orchestra.run.smithi003.stdout: def test_list_multipart_upload_owner(): 2023-12-03T13:00:19.459 INFO:teuthology.orchestra.run.smithi003.stdout:> bucket_name = get_new_bucket() 2023-12-03T13:00:19.459 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.459 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:6332: 2023-12-03T13:00:19.459 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.459 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:19.459 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:19.459 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:19.459 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:19.459 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:19.460 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:19.460 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:19.460 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:19.460 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:19.460 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:19.460 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:19.460 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:19.460 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:19.460 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:19.460 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:19.460 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:19.460 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:19.460 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:19.461 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:19.461 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:19.461 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:19.461 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:19.461 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:19.461 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:19.461 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:19.461 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:19.461 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:19.461 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:19.461 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:19.461 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:19.461 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:19.462 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:19.462 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:19.462 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:19.462 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:19.462 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:19.462 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.462 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.462 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.462 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:19.462 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.462 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:19.462 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.462 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:19.462 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:19.463 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:19.463 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:19.463 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:19.463 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:19.463 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.463 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:19.463 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:19.463 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:19.463 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:19.463 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:19.463 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:19.463 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.463 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:19.463 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:19.464 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:19.464 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:19.464 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:19.464 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:19.464 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:19.464 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:19.464 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:19.464 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:19.464 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:19.464 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.464 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.465 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:19.465 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:19.465 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:19.465 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:19.465 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:19.465 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.465 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.465 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:19.465 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:19.465 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:19.465 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:19.465 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:19.465 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.465 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:19.465 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:19.466 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:19.466 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:19.466 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:19.466 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-340" 2023-12-03T13:00:19.466 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.466 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:19.466 INFO:teuthology.orchestra.run.smithi003.stdout:______________________ test_multipart_upload_missing_part ______________________ 2023-12-03T13:00:19.466 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.466 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.466 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.466 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:19.466 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:19.466 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.466 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:19.467 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.467 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:19.467 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:19.467 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:19.467 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.467 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:19.467 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:19.467 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.467 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.467 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:19.467 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:19.467 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.467 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.467 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:19.468 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.468 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:19.468 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:19.468 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.468 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.468 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:19.468 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:19.468 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.468 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:19.468 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:19.468 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:19.468 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:19.468 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:19.468 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.469 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:19.469 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.469 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:19.469 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:19.469 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:19.469 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:19.469 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:19.469 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:19.469 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:19.470 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:19.470 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.470 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.470 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:19.470 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:19.470 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:19.470 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:19.470 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.470 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:19.470 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:19.470 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:19.470 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:19.470 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.470 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.471 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:19.471 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:19.471 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:19.471 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:19.471 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.471 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.471 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:19.471 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:19.471 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:19.471 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.471 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:19.471 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.471 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:19.471 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:19.471 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.472 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:19.472 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:19.472 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:19.472 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:19.472 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:19.472 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:19.472 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.472 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:19.472 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.472 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:19.472 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.472 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.472 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:19.472 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.473 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:19.473 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.473 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:19.473 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:19.473 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:19.473 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:19.473 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:19.473 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:19.473 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.473 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:19.473 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:19.473 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:19.473 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:19.473 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:19.473 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:19.473 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.474 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:19.474 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:19.474 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:19.474 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:19.474 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:19.474 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:19.474 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:19.474 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:19.474 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:19.474 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:19.474 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:19.474 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.474 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.474 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:19.474 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.475 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:19.475 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:19.475 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:19.475 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:19.475 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:19.475 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:19.475 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:19.475 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:19.475 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:19.475 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:19.475 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:19.475 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:19.475 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:19.475 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:19.476 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:19.476 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:19.476 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:19.476 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:19.476 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:19.476 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:19.476 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:19.476 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:19.476 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:19.476 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:19.476 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:19.476 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:19.476 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:19.476 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:19.477 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.477 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.477 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.477 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.477 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:19.477 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:19.477 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.477 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:19.477 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.477 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:19.477 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:19.477 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:19.477 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.477 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:19.477 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:19.477 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.477 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.478 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:19.478 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:19.478 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.478 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.478 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:19.478 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:19.478 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:19.478 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:19.478 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:19.478 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.478 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.478 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:19.478 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:19.478 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:19.478 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.479 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:19.479 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.479 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:19.479 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.479 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:19.479 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.479 INFO:teuthology.orchestra.run.smithi003.stdout: def test_multipart_upload_missing_part(): 2023-12-03T13:00:19.479 INFO:teuthology.orchestra.run.smithi003.stdout:> bucket_name = get_new_bucket() 2023-12-03T13:00:19.479 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.479 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:6377: 2023-12-03T13:00:19.479 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.479 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:19.479 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:19.479 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:19.479 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:19.480 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:19.480 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:19.480 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:19.480 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:19.480 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:19.480 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:19.480 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:19.480 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:19.480 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:19.480 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:19.480 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:19.480 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:19.480 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:19.480 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:19.480 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:19.480 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:19.481 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:19.481 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:19.481 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:19.481 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:19.481 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:19.481 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:19.481 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:19.481 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:19.481 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:19.481 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:19.481 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:19.481 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:19.481 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:19.481 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:19.481 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:19.481 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:19.482 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.482 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.482 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.482 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:19.482 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.482 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:19.482 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.482 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:19.482 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:19.482 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:19.482 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:19.482 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:19.482 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:19.482 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.482 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:19.483 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:19.483 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:19.483 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:19.483 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:19.483 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:19.483 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.483 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:19.483 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:19.483 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:19.483 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:19.483 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:19.483 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:19.483 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:19.483 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:19.483 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:19.483 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:19.483 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:19.484 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.484 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.484 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:19.484 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:19.484 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:19.484 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:19.484 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:19.484 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.484 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.484 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:19.484 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:19.484 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:19.484 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:19.484 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:19.484 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.484 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:19.484 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:19.485 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:19.485 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:19.485 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:19.485 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-341" 2023-12-03T13:00:19.485 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.485 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:19.485 INFO:teuthology.orchestra.run.smithi003.stdout:_____________________ test_multipart_upload_incorrect_etag _____________________ 2023-12-03T13:00:19.485 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.485 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.485 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.485 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:19.485 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:19.485 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.485 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:19.485 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.485 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:19.486 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:19.486 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:19.486 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.486 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:19.486 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:19.486 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.486 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.486 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:19.486 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:19.486 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.486 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.486 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:19.486 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.486 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:19.486 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:19.487 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.487 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.487 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:19.487 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:19.487 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.487 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:19.487 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:19.487 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:19.487 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:19.487 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:19.487 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.487 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:19.487 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.487 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:19.487 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:19.487 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:19.488 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:19.488 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:19.488 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:19.488 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:19.488 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:19.488 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.488 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.488 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:19.488 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:19.488 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:19.488 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:19.488 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.488 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:19.488 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:19.488 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:19.489 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:19.489 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.489 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.489 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:19.489 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:19.489 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:19.489 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:19.489 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.489 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.489 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:19.489 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:19.489 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:19.489 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.489 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:19.489 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.490 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:19.490 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:19.490 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.490 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:19.490 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:19.490 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:19.490 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:19.490 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:19.490 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:19.490 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.490 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:19.490 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.490 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:19.490 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.491 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.491 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:19.491 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.491 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:19.491 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.491 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:19.491 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:19.491 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:19.491 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:19.491 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:19.491 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:19.491 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.491 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:19.491 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:19.491 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:19.491 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:19.492 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:19.492 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:19.492 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.492 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:19.492 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:19.492 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:19.492 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:19.492 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:19.492 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:19.492 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:19.492 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:19.492 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:19.492 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:19.492 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:19.492 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.492 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.493 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:19.493 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.493 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:19.493 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:19.493 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:19.493 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:19.493 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:19.493 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:19.493 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:19.493 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:19.493 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:19.493 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:19.493 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:19.493 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:19.493 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:19.493 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:19.494 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:19.494 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:19.494 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:19.494 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:19.494 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:19.494 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:19.494 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:19.494 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:19.494 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:19.494 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:19.494 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:19.494 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:19.494 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:19.494 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:19.494 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.494 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.495 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.495 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.495 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:19.495 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:19.495 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.495 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:19.495 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.495 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:19.495 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:19.495 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:19.495 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.495 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:19.495 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:19.495 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.495 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.495 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:19.496 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:19.496 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.496 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.496 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:19.496 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:19.496 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:19.496 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:19.496 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:19.496 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.496 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.496 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:19.496 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:19.496 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:19.496 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.496 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:19.496 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.497 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:19.497 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.497 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:19.497 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.497 INFO:teuthology.orchestra.run.smithi003.stdout: def test_multipart_upload_incorrect_etag(): 2023-12-03T13:00:19.497 INFO:teuthology.orchestra.run.smithi003.stdout:> bucket_name = get_new_bucket() 2023-12-03T13:00:19.497 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.497 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:6396: 2023-12-03T13:00:19.497 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.497 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:19.497 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:19.497 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:19.497 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:19.497 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:19.497 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:19.497 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:19.498 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:19.498 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:19.498 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:19.498 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:19.498 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:19.498 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:19.498 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:19.498 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:19.498 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:19.498 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:19.498 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:19.498 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:19.498 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:19.498 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:19.498 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:19.499 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:19.499 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:19.499 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:19.499 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:19.499 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:19.499 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:19.499 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:19.499 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:19.499 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:19.499 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:19.499 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:19.499 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:19.499 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:19.499 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:19.499 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.500 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.500 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.500 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:19.500 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.500 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:19.500 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.500 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:19.500 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:19.500 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:19.500 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:19.500 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:19.500 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:19.500 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.500 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:19.500 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:19.501 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:19.501 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:19.501 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:19.501 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:19.501 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.501 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:19.501 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:19.501 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:19.501 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:19.501 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:19.501 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:19.501 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:19.501 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:19.501 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:19.501 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:19.502 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:19.502 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.502 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.502 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:19.502 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:19.502 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:19.502 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:19.502 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:19.502 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.502 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.502 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:19.502 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:19.502 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:19.502 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:19.502 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:19.503 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.503 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:19.503 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:19.503 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:19.503 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:19.503 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:19.503 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-342" 2023-12-03T13:00:19.503 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.503 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:19.503 INFO:teuthology.orchestra.run.smithi003.stdout:___________________________ test_multipart_get_part ____________________________ 2023-12-03T13:00:19.503 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.503 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.503 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.503 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:19.503 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:19.503 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.504 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:19.504 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.504 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:19.504 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:19.504 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:19.504 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.504 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:19.504 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:19.504 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.504 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.504 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:19.504 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:19.504 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.504 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.504 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:19.504 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.505 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:19.505 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:19.505 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.505 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.505 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:19.505 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:19.505 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.505 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:19.505 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:19.505 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:19.505 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:19.505 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:19.505 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.505 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:19.505 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.505 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:19.506 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:19.506 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:19.506 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:19.506 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:19.506 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:19.506 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:19.506 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:19.506 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.506 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.506 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:19.506 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:19.506 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:19.506 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:19.506 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.506 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:19.507 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:19.507 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:19.507 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:19.507 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.507 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.507 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:19.507 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:19.507 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:19.507 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:19.507 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.507 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.507 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:19.507 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:19.507 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:19.507 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.507 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:19.507 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.508 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:19.508 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:19.508 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.508 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:19.508 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:19.508 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:19.508 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:19.508 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:19.508 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:19.508 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.508 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:19.508 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.508 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:19.508 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.508 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.509 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:19.509 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.509 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:19.509 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.509 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:19.509 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:19.509 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:19.509 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:19.509 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:19.509 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:19.509 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.509 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:19.509 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:19.509 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:19.509 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:19.509 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:19.510 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:19.510 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.510 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:19.510 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:19.510 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:19.510 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:19.510 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:19.510 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:19.510 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:19.510 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:19.510 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:19.510 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:19.510 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:19.510 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.511 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.511 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:19.511 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.511 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:19.511 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:19.511 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:19.511 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:19.511 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:19.511 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:19.511 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:19.511 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:19.511 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:19.511 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:19.511 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:19.511 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:19.511 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:19.511 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:19.512 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:19.512 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:19.512 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:19.512 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:19.512 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:19.512 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:19.512 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:19.512 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:19.512 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:19.512 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:19.512 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:19.512 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:19.512 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:19.512 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:19.512 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.512 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.513 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.513 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.513 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:19.513 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:19.513 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.513 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:19.513 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.513 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:19.513 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:19.513 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:19.513 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.513 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:19.513 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:19.513 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.513 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.514 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:19.514 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:19.514 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.514 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.514 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:19.514 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:19.514 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:19.514 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:19.514 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:19.514 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.514 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.514 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:19.514 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:19.514 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:19.514 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.515 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:19.515 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.515 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:19.515 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.515 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:19.515 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.515 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T13:00:19.515 INFO:teuthology.orchestra.run.smithi003.stdout: def test_multipart_get_part(): 2023-12-03T13:00:19.515 INFO:teuthology.orchestra.run.smithi003.stdout:> bucket_name = get_new_bucket() 2023-12-03T13:00:19.515 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.515 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:6416: 2023-12-03T13:00:19.515 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.515 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:19.515 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:19.515 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:19.515 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:19.516 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:19.516 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:19.516 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:19.516 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:19.516 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:19.516 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:19.516 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:19.516 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:19.516 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:19.516 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:19.516 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:19.516 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:19.516 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:19.516 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:19.516 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:19.517 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:19.517 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:19.517 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:19.517 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:19.517 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:19.517 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:19.517 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:19.517 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:19.517 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:19.517 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:19.517 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:19.517 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:19.517 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:19.517 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:19.517 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:19.517 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:19.517 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:19.518 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.518 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.518 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.518 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:19.518 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.518 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:19.518 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.518 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:19.518 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:19.518 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:19.518 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:19.518 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:19.518 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:19.518 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.518 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:19.519 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:19.519 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:19.519 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:19.519 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:19.519 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:19.519 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.519 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:19.519 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:19.519 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:19.519 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:19.519 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:19.519 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:19.519 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:19.519 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:19.519 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:19.519 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:19.520 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:19.520 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.520 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.520 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:19.520 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:19.520 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:19.520 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:19.520 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:19.520 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.520 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.520 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:19.520 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:19.520 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:19.520 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:19.521 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:19.521 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.521 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:19.521 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:19.521 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:19.521 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:19.521 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:19.521 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-343" 2023-12-03T13:00:19.521 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.521 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:19.521 INFO:teuthology.orchestra.run.smithi003.stdout:_________________________ test_non_multipart_get_part __________________________ 2023-12-03T13:00:19.521 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.521 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.521 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.521 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:19.521 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:19.522 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.522 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:19.522 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.522 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:19.522 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:19.522 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:19.522 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.522 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:19.522 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:19.522 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.522 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.522 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:19.522 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:19.522 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.523 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.523 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:19.523 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.523 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:19.523 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:19.523 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.523 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.523 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:19.523 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:19.523 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.523 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:19.523 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:19.523 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:19.523 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:19.523 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:19.523 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.524 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:19.524 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.524 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:19.524 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:19.524 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:19.524 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:19.524 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:19.524 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:19.524 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:19.524 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:19.524 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.524 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.524 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:19.524 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:19.524 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:19.524 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:19.524 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.525 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:19.525 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:19.525 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:19.525 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:19.525 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.525 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.525 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:19.525 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:19.525 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:19.525 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:19.525 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.525 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.525 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:19.525 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:19.525 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:19.525 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.526 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:19.526 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.526 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:19.526 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:19.526 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.526 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:19.526 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:19.526 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:19.526 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:19.526 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:19.526 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:19.526 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.526 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:19.526 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.526 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:19.527 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.527 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.527 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:19.527 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.527 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:19.527 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.527 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:19.527 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:19.527 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:19.527 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:19.527 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:19.527 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:19.527 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.527 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:19.527 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:19.527 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:19.528 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:19.528 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:19.528 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:19.528 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.528 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:19.528 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:19.528 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:19.528 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:19.528 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:19.528 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:19.528 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:19.528 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:19.528 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:19.528 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:19.528 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:19.528 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.528 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.529 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:19.529 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.529 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:19.529 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:19.529 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:19.529 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:19.529 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:19.529 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:19.529 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:19.529 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:19.529 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:19.529 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:19.529 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:19.529 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:19.529 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:19.529 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:19.530 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:19.530 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:19.530 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:19.530 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:19.530 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:19.530 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:19.530 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:19.530 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:19.530 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:19.530 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:19.530 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:19.530 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:19.530 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:19.530 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:19.531 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.531 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.531 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.531 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.531 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:19.531 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:19.531 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.531 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:19.531 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.531 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:19.531 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:19.531 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:19.531 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.531 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:19.531 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:19.531 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.532 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.532 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:19.532 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:19.532 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.532 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.532 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:19.532 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:19.532 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:19.532 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:19.532 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:19.532 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.532 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.532 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:19.532 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:19.532 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:19.533 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.533 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:19.533 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.533 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:19.533 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.533 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:19.533 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.533 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T13:00:19.533 INFO:teuthology.orchestra.run.smithi003.stdout: def test_non_multipart_get_part(): 2023-12-03T13:00:19.533 INFO:teuthology.orchestra.run.smithi003.stdout:> bucket_name = get_new_bucket() 2023-12-03T13:00:19.533 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.533 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:6458: 2023-12-03T13:00:19.533 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.533 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:19.533 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:19.534 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:19.534 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:19.534 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:19.534 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:19.534 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:19.534 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:19.534 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:19.534 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:19.534 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:19.534 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:19.534 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:19.534 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:19.534 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:19.534 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:19.535 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:19.535 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:19.535 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:19.535 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:19.535 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:19.535 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:19.535 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:19.535 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:19.535 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:19.535 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:19.535 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:19.535 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:19.535 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:19.535 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:19.535 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:19.535 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:19.536 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:19.536 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:19.536 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:19.536 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:19.536 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.536 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.536 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.536 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:19.536 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.536 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:19.536 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.536 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:19.536 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:19.536 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:19.536 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:19.537 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:19.537 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:19.537 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.537 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:19.537 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:19.537 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:19.537 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:19.537 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:19.537 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:19.537 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.537 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:19.537 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:19.537 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:19.537 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:19.537 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:19.537 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:19.538 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:19.538 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:19.538 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:19.538 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:19.538 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:19.538 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.538 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.538 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:19.538 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:19.538 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:19.538 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:19.538 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:19.538 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.538 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.538 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:19.538 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:19.539 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:19.539 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:19.539 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:19.539 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.539 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:19.539 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:19.539 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:19.539 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:19.539 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:19.539 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-344" 2023-12-03T13:00:19.539 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.539 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:19.539 INFO:teuthology.orchestra.run.smithi003.stdout:______________________________ test_100_continue _______________________________ 2023-12-03T13:00:19.539 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.539 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.539 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.540 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:19.540 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:19.540 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.540 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:19.540 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.540 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:19.540 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:19.540 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:19.540 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.540 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:19.540 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:19.540 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.540 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.540 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:19.540 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:19.540 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.541 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.541 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:19.541 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.541 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:19.541 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:19.541 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.541 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.541 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:19.541 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:19.541 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.541 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:19.541 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:19.541 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:19.541 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:19.541 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:19.541 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.541 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:19.542 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.542 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:19.542 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:19.542 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:19.542 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:19.542 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:19.542 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:19.542 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:19.542 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:19.542 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.542 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.542 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:19.542 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:19.542 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:19.542 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:19.543 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.543 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:19.543 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:19.543 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:19.543 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:19.543 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.543 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.543 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:19.543 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:19.543 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:19.543 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:19.543 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.543 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.544 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:19.544 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:19.544 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:19.544 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.544 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:19.544 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.544 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:19.544 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:19.544 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.544 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:19.544 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:19.544 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:19.544 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:19.544 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:19.544 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:19.544 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.545 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:19.545 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.545 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:19.545 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.545 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.545 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:19.545 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.545 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:19.545 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.545 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:19.545 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:19.545 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:19.545 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:19.545 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:19.545 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:19.545 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.546 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:19.546 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:19.546 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:19.546 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:19.546 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:19.546 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:19.546 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.546 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:19.546 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:19.546 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:19.546 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:19.546 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:19.546 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:19.546 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:19.547 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:19.547 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:19.547 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:19.547 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:19.547 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.547 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.547 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:19.547 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.547 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:19.547 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:19.547 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:19.547 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:19.547 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:19.547 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:19.547 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:19.547 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:19.548 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:19.548 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:19.548 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:19.548 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:19.548 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:19.548 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:19.548 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:19.548 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:19.548 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:19.548 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:19.548 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:19.548 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:19.548 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:19.548 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:19.548 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:19.548 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:19.549 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:19.549 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:19.549 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:19.549 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:19.549 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.549 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.549 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.549 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.549 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:19.549 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:19.549 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.549 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:19.549 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.549 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:19.549 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:19.549 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:19.549 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.550 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:19.550 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:19.550 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.550 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.550 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:19.550 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:19.550 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.550 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.550 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:19.550 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:19.550 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:19.550 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:19.550 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:19.550 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.550 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.551 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:19.551 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:19.551 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:19.551 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.551 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:19.551 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.551 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:19.551 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.551 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:19.551 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.551 INFO:teuthology.orchestra.run.smithi003.stdout: def test_100_continue(): 2023-12-03T13:00:19.551 INFO:teuthology.orchestra.run.smithi003.stdout: bucket_name = get_new_bucket_name() 2023-12-03T13:00:19.551 INFO:teuthology.orchestra.run.smithi003.stdout: client = get_client() 2023-12-03T13:00:19.551 INFO:teuthology.orchestra.run.smithi003.stdout:> client.create_bucket(Bucket=bucket_name) 2023-12-03T13:00:19.552 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.552 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:6514: 2023-12-03T13:00:19.552 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.552 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:19.552 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:19.552 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:19.552 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:19.552 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:19.552 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:19.552 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:19.552 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:19.552 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:19.552 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:19.552 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:19.552 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:19.552 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:19.553 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:19.553 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:19.553 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:19.553 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:19.553 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:19.553 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:19.553 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:19.553 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:19.553 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:19.553 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:19.553 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:19.553 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:19.553 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:19.553 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:19.553 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:19.554 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:19.554 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:19.554 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:19.554 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:19.554 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:19.554 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:19.554 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.554 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.554 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.554 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:19.554 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.554 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:19.554 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.554 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:19.555 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:19.555 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:19.555 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:19.555 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:19.555 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:19.555 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.555 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:19.555 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:19.555 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:19.555 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:19.555 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:19.555 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:19.555 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.555 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:19.555 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:19.555 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:19.555 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:19.556 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:19.556 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:19.556 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:19.556 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:19.556 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:19.556 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:19.556 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:19.556 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.556 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.556 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:19.556 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:19.556 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:19.556 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:19.556 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:19.556 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.556 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.557 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:19.557 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:19.557 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:19.557 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:19.557 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:19.557 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.557 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:19.557 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:19.557 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:19.557 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:19.557 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:19.557 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-345" 2023-12-03T13:00:19.557 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.557 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:19.557 INFO:teuthology.orchestra.run.smithi003.stdout:________________________________ test_set_cors _________________________________ 2023-12-03T13:00:19.558 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.558 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.558 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.558 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:19.558 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:19.558 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.558 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:19.558 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.558 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:19.558 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:19.558 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:19.558 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.558 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:19.558 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:19.558 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.559 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.559 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:19.559 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:19.559 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.559 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.559 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:19.559 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.559 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:19.559 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:19.559 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.559 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.559 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:19.559 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:19.559 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.559 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:19.560 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:19.560 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:19.560 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:19.560 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:19.560 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.560 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:19.560 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.560 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:19.560 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:19.560 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:19.560 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:19.560 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:19.560 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:19.560 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:19.560 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:19.561 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.561 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.561 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:19.561 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:19.561 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:19.561 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:19.561 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.561 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:19.561 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:19.561 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:19.561 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:19.561 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.561 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.562 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:19.562 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:19.562 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:19.562 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:19.562 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.562 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.562 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:19.562 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:19.562 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:19.562 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.562 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:19.562 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.562 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:19.562 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:19.562 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.563 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:19.563 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:19.563 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:19.563 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:19.563 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:19.563 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:19.563 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.563 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:19.563 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.563 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:19.563 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.563 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.563 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:19.563 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.563 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:19.564 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.564 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:19.564 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:19.564 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:19.564 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:19.564 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:19.564 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:19.564 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.564 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:19.564 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:19.564 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:19.564 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:19.564 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:19.564 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:19.564 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.564 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:19.565 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:19.565 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:19.565 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:19.565 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:19.565 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:19.565 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:19.565 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:19.565 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:19.565 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:19.565 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:19.565 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.565 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.565 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:19.565 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.565 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:19.565 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:19.565 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:19.566 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:19.566 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:19.566 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:19.566 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:19.566 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:19.566 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:19.566 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:19.566 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:19.566 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:19.566 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:19.566 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:19.566 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:19.566 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:19.567 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:19.567 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:19.567 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:19.567 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:19.567 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:19.567 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:19.567 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:19.567 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:19.567 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:19.567 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:19.567 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:19.567 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:19.567 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.567 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.567 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.567 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.568 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:19.568 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:19.568 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.568 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:19.568 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.568 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:19.568 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:19.568 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:19.568 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.568 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:19.568 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:19.568 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.568 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.568 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:19.568 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:19.568 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.569 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.569 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:19.569 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:19.569 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:19.569 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:19.569 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:19.569 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.569 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.569 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:19.569 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:19.569 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:19.569 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.569 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:19.569 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.569 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:19.569 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.570 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:19.570 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.570 INFO:teuthology.orchestra.run.smithi003.stdout: def test_set_cors(): 2023-12-03T13:00:19.570 INFO:teuthology.orchestra.run.smithi003.stdout:> bucket_name = get_new_bucket() 2023-12-03T13:00:19.570 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.570 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:6532: 2023-12-03T13:00:19.570 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.570 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:19.570 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:19.570 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:19.570 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:19.570 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:19.570 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:19.570 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:19.570 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:19.571 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:19.571 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:19.571 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:19.571 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:19.571 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:19.571 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:19.571 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:19.571 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:19.571 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:19.571 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:19.571 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:19.571 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:19.571 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:19.571 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:19.571 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:19.571 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:19.572 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:19.572 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:19.572 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:19.572 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:19.572 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:19.572 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:19.572 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:19.572 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:19.572 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:19.572 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:19.572 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:19.572 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:19.572 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.572 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.572 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.572 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:19.573 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.573 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:19.573 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.573 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:19.573 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:19.573 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:19.573 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:19.573 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:19.573 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:19.573 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.573 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:19.573 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:19.573 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:19.573 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:19.573 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:19.573 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:19.574 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.574 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:19.574 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:19.574 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:19.574 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:19.574 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:19.574 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:19.574 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:19.574 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:19.574 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:19.574 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:19.574 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:19.574 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.574 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.574 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:19.575 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:19.575 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:19.575 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:19.575 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:19.575 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.575 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.575 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:19.575 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:19.575 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:19.575 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:19.575 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:19.575 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.575 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:19.575 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:19.575 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:19.575 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:19.575 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:19.576 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-346" 2023-12-03T13:00:19.576 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.576 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:19.576 INFO:teuthology.orchestra.run.smithi003.stdout:__________________________ test_cors_origin_response ___________________________ 2023-12-03T13:00:19.576 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.576 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.576 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.576 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:19.576 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:19.576 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.576 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:19.576 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.576 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:19.576 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:19.576 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:19.577 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.577 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:19.577 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:19.577 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.577 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.577 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:19.577 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:19.577 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.577 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.577 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:19.577 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.577 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:19.577 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:19.577 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.577 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.578 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:19.578 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:19.578 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.578 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:19.578 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:19.578 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:19.578 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:19.578 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:19.578 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.578 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:19.578 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.578 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:19.578 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:19.578 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:19.578 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:19.578 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:19.579 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:19.579 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:19.579 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:19.579 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.579 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.579 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:19.579 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:19.579 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:19.579 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:19.579 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.579 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:19.579 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:19.579 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:19.579 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:19.579 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.579 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.580 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:19.580 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:19.580 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:19.580 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:19.580 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.580 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.580 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:19.580 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:19.580 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:19.580 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.580 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:19.580 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.580 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:19.580 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:19.580 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.580 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:19.580 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:19.581 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:19.581 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:19.581 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:19.581 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:19.581 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.581 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:19.581 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.581 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:19.581 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.581 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.581 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:19.581 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.581 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:19.581 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.581 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:19.582 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:19.582 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:19.582 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:19.582 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:19.582 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:19.582 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.582 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:19.582 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:19.582 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:19.582 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:19.582 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:19.582 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:19.582 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.582 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:19.582 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:19.583 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:19.583 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:19.583 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:19.583 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:19.583 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:19.583 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:19.583 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:19.583 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:19.583 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:19.583 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.583 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.583 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:19.583 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.583 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:19.583 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:19.583 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:19.583 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:19.584 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:19.584 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:19.584 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:19.584 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:19.584 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:19.584 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:19.584 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:19.584 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:19.584 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:19.584 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:19.584 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:19.584 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:19.584 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:19.584 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:19.584 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:19.585 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:19.585 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:19.585 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:19.585 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:19.585 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:19.585 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:19.585 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:19.585 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:19.585 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:19.585 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.585 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.585 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.585 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.585 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:19.585 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:19.585 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.585 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:19.586 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.586 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:19.586 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:19.586 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:19.586 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.586 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:19.586 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:19.586 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.589 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.589 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:19.589 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:19.589 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.589 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.589 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:19.589 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:19.589 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:19.589 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:19.589 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:19.589 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.589 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.590 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:19.590 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:19.590 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:19.590 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.590 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:19.590 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.590 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:19.590 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.590 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:19.590 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.590 INFO:teuthology.orchestra.run.smithi003.stdout: def test_cors_origin_response(): 2023-12-03T13:00:19.590 INFO:teuthology.orchestra.run.smithi003.stdout:> bucket_name = _setup_bucket_acl(bucket_acl='public-read') 2023-12-03T13:00:19.590 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.590 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:6567: 2023-12-03T13:00:19.591 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.591 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:3245: in _setup_bucket_acl 2023-12-03T13:00:19.591 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(ACL=bucket_acl, Bucket=bucket_name) 2023-12-03T13:00:19.591 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:19.591 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:19.591 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:19.591 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:19.591 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:19.591 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:19.591 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:19.591 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:19.591 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:19.591 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:19.591 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:19.591 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:19.591 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:19.592 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:19.592 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:19.592 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:19.592 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:19.592 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:19.592 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:19.592 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:19.592 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:19.592 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:19.592 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:19.592 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:19.592 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:19.592 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:19.592 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:19.592 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:19.592 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:19.593 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:19.593 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:19.593 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:19.593 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:19.593 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:19.593 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.593 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.593 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.593 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:19.593 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.593 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:19.593 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.593 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:19.593 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:19.593 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:19.593 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:19.594 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:19.594 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:19.594 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.594 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:19.594 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:19.594 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:19.594 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:19.594 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:19.594 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:19.594 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.594 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:19.594 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:19.594 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:19.594 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:19.594 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:19.594 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:19.595 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:19.595 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:19.595 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:19.595 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:19.595 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:19.595 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.595 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.595 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:19.595 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:19.595 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:19.595 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:19.595 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:19.595 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.595 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.595 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:19.595 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:19.596 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:19.596 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:19.596 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:19.596 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.596 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:19.596 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:19.596 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:19.596 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:19.596 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:19.596 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-347" 2023-12-03T13:00:19.596 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.596 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:19.596 INFO:teuthology.orchestra.run.smithi003.stdout:__________________________ test_cors_origin_wildcard ___________________________ 2023-12-03T13:00:19.596 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.596 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.596 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.597 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:19.597 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:19.597 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.597 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:19.597 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.597 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:19.597 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:19.597 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:19.597 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.597 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:19.597 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:19.597 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.597 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.597 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:19.597 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:19.597 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.598 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.598 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:19.598 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.598 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:19.598 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:19.598 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.598 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.598 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:19.598 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:19.598 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.598 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:19.598 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:19.598 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:19.598 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:19.598 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:19.599 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.599 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:19.599 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.599 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:19.599 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:19.599 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:19.599 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:19.599 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:19.599 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:19.599 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:19.599 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:19.599 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.599 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.599 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:19.599 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:19.600 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:19.600 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:19.600 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.600 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:19.600 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:19.600 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:19.600 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:19.600 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.600 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.600 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:19.600 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:19.600 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:19.600 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:19.600 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.600 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.600 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:19.601 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:19.601 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:19.601 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.601 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:19.601 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.601 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:19.601 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:19.601 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.601 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:19.601 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:19.601 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:19.601 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:19.602 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:19.602 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:19.602 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.602 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:19.602 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.602 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:19.602 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.602 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.602 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:19.602 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.602 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:19.602 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.602 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:19.602 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:19.603 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:19.603 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:19.603 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:19.603 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:19.603 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.603 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:19.603 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:19.603 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:19.603 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:19.603 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:19.603 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:19.603 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.603 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:19.603 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:19.604 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:19.604 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:19.604 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:19.604 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:19.604 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:19.604 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:19.604 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:19.604 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:19.604 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:19.604 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.604 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.604 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:19.604 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.604 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:19.604 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:19.604 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:19.604 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:19.605 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:19.605 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:19.605 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:19.605 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:19.605 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:19.605 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:19.605 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:19.605 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:19.605 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:19.605 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:19.605 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:19.605 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:19.605 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:19.605 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:19.605 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:19.606 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:19.606 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:19.606 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:19.606 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:19.606 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:19.606 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:19.606 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:19.606 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:19.606 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:19.606 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.606 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.606 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.606 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.606 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:19.607 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:19.607 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.607 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:19.607 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.607 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:19.607 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:19.607 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:19.607 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.607 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:19.607 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:19.607 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.607 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.607 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:19.607 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:19.607 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.608 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.608 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:19.608 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:19.608 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:19.608 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:19.608 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:19.608 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.608 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.608 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:19.608 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:19.608 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:19.608 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.608 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:19.608 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.608 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:19.608 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.609 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:19.609 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.609 INFO:teuthology.orchestra.run.smithi003.stdout: def test_cors_origin_wildcard(): 2023-12-03T13:00:19.609 INFO:teuthology.orchestra.run.smithi003.stdout:> bucket_name = _setup_bucket_acl(bucket_acl='public-read') 2023-12-03T13:00:19.609 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.609 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:6642: 2023-12-03T13:00:19.609 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.609 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:3245: in _setup_bucket_acl 2023-12-03T13:00:19.609 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(ACL=bucket_acl, Bucket=bucket_name) 2023-12-03T13:00:19.609 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:19.609 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:19.609 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:19.609 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:19.609 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:19.609 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:19.610 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:19.610 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:19.610 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:19.610 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:19.610 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:19.610 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:19.610 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:19.610 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:19.610 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:19.610 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:19.610 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:19.610 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:19.610 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:19.610 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:19.610 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:19.611 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:19.611 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:19.611 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:19.611 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:19.611 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:19.611 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:19.611 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:19.611 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:19.611 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:19.611 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:19.611 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:19.611 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:19.611 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:19.611 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.611 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.611 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.612 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:19.612 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.612 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:19.612 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.612 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:19.612 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:19.612 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:19.612 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:19.612 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:19.612 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:19.612 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.612 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:19.612 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:19.612 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:19.612 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:19.613 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:19.613 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:19.613 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.613 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:19.613 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:19.613 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:19.613 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:19.613 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:19.613 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:19.613 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:19.613 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:19.613 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:19.613 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:19.614 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:19.614 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.614 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.614 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:19.614 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:19.614 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:19.614 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:19.614 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:19.614 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.614 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.614 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:19.614 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:19.614 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:19.614 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:19.614 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:19.615 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.615 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:19.615 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:19.615 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:19.615 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:19.615 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:19.615 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-348" 2023-12-03T13:00:19.615 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.615 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:19.615 INFO:teuthology.orchestra.run.smithi003.stdout:___________________________ test_cors_header_option ____________________________ 2023-12-03T13:00:19.615 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.615 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.615 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.615 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:19.615 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:19.615 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.615 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:19.616 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.616 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:19.616 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:19.616 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:19.616 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.616 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:19.616 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:19.616 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.616 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.616 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:19.616 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:19.616 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.616 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.616 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:19.616 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.617 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:19.617 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:19.617 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.617 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.617 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:19.617 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:19.617 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.617 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:19.617 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:19.617 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:19.617 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:19.617 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:19.617 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.617 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:19.617 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.617 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:19.618 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:19.618 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:19.618 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:19.618 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:19.618 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:19.618 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:19.618 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:19.618 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.618 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.618 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:19.618 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:19.618 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:19.618 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:19.618 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.618 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:19.618 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:19.619 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:19.619 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:19.619 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.619 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.619 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:19.619 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:19.619 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:19.619 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:19.619 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.619 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.619 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:19.619 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:19.619 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:19.619 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.619 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:19.620 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.620 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:19.620 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:19.620 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.620 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:19.620 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:19.620 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:19.620 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:19.620 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:19.620 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:19.620 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.620 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:19.620 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.620 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:19.620 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.621 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.621 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:19.621 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.621 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:19.621 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.621 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:19.621 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:19.621 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:19.621 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:19.621 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:19.621 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:19.621 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.621 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:19.621 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:19.621 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:19.621 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:19.622 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:19.622 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:19.622 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.622 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:19.622 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:19.622 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:19.622 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:19.622 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:19.622 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:19.622 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:19.622 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:19.622 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:19.622 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:19.622 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:19.622 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.623 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.623 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:19.623 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.623 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:19.623 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:19.623 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:19.623 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:19.623 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:19.623 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:19.623 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:19.623 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:19.623 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:19.623 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:19.623 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:19.623 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:19.624 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:19.624 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:19.624 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:19.624 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:19.624 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:19.624 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:19.624 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:19.624 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:19.624 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:19.624 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:19.624 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:19.624 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:19.624 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:19.624 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:19.624 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:19.625 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:19.625 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.625 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.625 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.625 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.625 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:19.625 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:19.625 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.625 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:19.625 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.625 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:19.625 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:19.625 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:19.625 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.625 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:19.625 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:19.626 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.626 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.626 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:19.626 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:19.626 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.626 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.626 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:19.626 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:19.626 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:19.626 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:19.626 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:19.626 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.626 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.626 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:19.626 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:19.627 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:19.627 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.627 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:19.627 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.627 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:19.627 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.627 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:19.627 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.627 INFO:teuthology.orchestra.run.smithi003.stdout: def test_cors_header_option(): 2023-12-03T13:00:19.627 INFO:teuthology.orchestra.run.smithi003.stdout:> bucket_name = _setup_bucket_acl(bucket_acl='public-read') 2023-12-03T13:00:19.627 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.627 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:6667: 2023-12-03T13:00:19.627 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.627 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:3245: in _setup_bucket_acl 2023-12-03T13:00:19.627 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(ACL=bucket_acl, Bucket=bucket_name) 2023-12-03T13:00:19.628 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:19.628 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:19.628 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:19.628 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:19.628 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:19.628 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:19.628 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:19.628 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:19.628 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:19.628 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:19.628 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:19.628 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:19.628 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:19.628 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:19.628 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:19.628 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:19.629 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:19.629 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:19.629 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:19.629 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:19.629 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:19.629 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:19.629 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:19.629 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:19.629 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:19.629 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:19.629 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:19.629 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:19.629 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:19.629 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:19.629 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:19.629 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:19.629 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:19.630 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:19.630 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.630 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.630 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.630 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:19.630 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.630 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:19.630 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.630 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:19.630 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:19.630 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:19.630 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:19.630 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:19.630 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:19.631 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.631 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:19.631 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:19.631 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:19.631 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:19.631 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:19.631 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:19.631 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.631 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:19.631 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:19.631 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:19.631 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:19.631 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:19.631 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:19.631 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:19.631 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:19.632 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:19.632 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:19.632 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:19.632 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.632 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.632 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:19.632 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:19.632 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:19.632 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:19.632 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:19.632 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.632 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.632 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:19.632 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:19.632 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:19.632 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:19.633 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:19.633 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.633 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:19.633 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:19.633 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:19.633 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:19.633 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:19.633 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-349" 2023-12-03T13:00:19.633 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.633 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:19.633 INFO:teuthology.orchestra.run.smithi003.stdout:________________________ test_cors_presigned_get_object ________________________ 2023-12-03T13:00:19.633 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.633 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.633 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.633 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:19.633 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:19.634 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.634 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:19.634 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.634 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:19.634 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:19.634 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:19.634 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.634 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:19.634 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:19.634 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.634 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.634 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:19.634 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:19.634 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.634 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.635 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:19.635 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.635 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:19.635 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:19.635 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.635 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.635 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:19.635 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:19.635 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.635 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:19.635 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:19.635 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:19.635 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:19.635 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:19.635 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.636 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:19.636 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.636 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:19.636 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:19.636 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:19.636 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:19.636 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:19.636 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:19.636 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:19.636 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:19.636 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.636 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.636 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:19.636 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:19.636 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:19.636 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:19.637 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.637 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:19.637 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:19.637 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:19.637 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:19.637 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.637 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.637 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:19.637 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:19.637 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:19.637 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:19.637 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.637 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.637 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:19.637 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:19.638 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:19.638 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.638 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:19.638 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.638 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:19.638 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:19.638 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.638 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:19.638 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:19.638 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:19.638 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:19.638 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:19.638 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:19.638 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.638 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:19.639 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.639 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:19.639 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.639 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.639 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:19.639 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.639 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:19.639 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.639 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:19.639 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:19.639 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:19.639 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:19.639 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:19.639 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:19.639 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.639 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:19.640 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:19.640 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:19.640 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:19.640 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:19.640 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:19.640 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.640 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:19.640 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:19.640 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:19.640 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:19.640 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:19.640 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:19.640 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:19.640 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:19.640 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:19.640 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:19.641 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:19.641 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.641 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.641 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:19.641 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.641 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:19.641 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:19.641 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:19.641 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:19.641 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:19.641 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:19.641 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:19.641 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:19.641 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:19.641 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:19.642 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:19.642 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:19.642 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:19.642 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:19.642 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:19.642 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:19.642 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:19.642 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:19.642 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:19.642 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:19.642 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:19.642 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:19.642 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:19.642 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:19.642 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:19.642 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:19.643 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:19.643 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:19.643 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.643 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.643 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.643 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.643 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:19.643 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:19.643 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.643 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:19.643 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.643 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:19.643 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:19.643 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:19.643 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.643 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:19.644 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:19.644 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.644 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.644 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:19.644 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:19.644 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.644 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.644 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:19.644 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:19.644 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:19.644 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:19.644 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:19.644 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.644 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.644 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:19.644 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:19.645 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:19.645 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.645 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:19.645 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.645 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:19.645 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.645 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:19.645 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.645 INFO:teuthology.orchestra.run.smithi003.stdout: def test_cors_presigned_get_object(): 2023-12-03T13:00:19.645 INFO:teuthology.orchestra.run.smithi003.stdout:> _test_cors_options_presigned_get_object(client=get_client()) 2023-12-03T13:00:19.645 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.645 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:6716: 2023-12-03T13:00:19.645 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.645 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:6693: in _test_cors_options_presigned_get_object 2023-12-03T13:00:19.645 INFO:teuthology.orchestra.run.smithi003.stdout: bucket_name = _setup_bucket_object_acl('public-read', 'public-read', client=client) 2023-12-03T13:00:19.645 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:3234: in _setup_bucket_object_acl 2023-12-03T13:00:19.646 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(ACL=bucket_acl, Bucket=bucket_name) 2023-12-03T13:00:19.646 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:19.646 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:19.646 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:19.646 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:19.646 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:19.646 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:19.646 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:19.646 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:19.646 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:19.646 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:19.646 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:19.646 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:19.646 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:19.646 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:19.647 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:19.647 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:19.647 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:19.647 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:19.647 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:19.647 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:19.647 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:19.647 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:19.647 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:19.647 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:19.647 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:19.647 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:19.647 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:19.647 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:19.647 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:19.648 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:19.648 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:19.648 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:19.648 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:19.648 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:19.648 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.648 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.648 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.648 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:19.648 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.648 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:19.648 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.648 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:19.648 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:19.648 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:19.648 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:19.649 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:19.649 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:19.649 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.649 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:19.649 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:19.649 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:19.649 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:19.649 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:19.649 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:19.649 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.649 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:19.649 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:19.649 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:19.649 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:19.649 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:19.649 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:19.650 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:19.650 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:19.650 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:19.650 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:19.650 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:19.650 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.650 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.650 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:19.650 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:19.650 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:19.650 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:19.650 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:19.650 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.650 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.650 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:19.651 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:19.651 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:19.651 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:19.651 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:19.651 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.651 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:19.651 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:19.651 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:19.651 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:19.651 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:19.651 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-350" 2023-12-03T13:00:19.651 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.651 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:19.651 INFO:teuthology.orchestra.run.smithi003.stdout:____________________ test_cors_presigned_get_object_tenant _____________________ 2023-12-03T13:00:19.651 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.651 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.652 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.652 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:19.652 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:19.652 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.652 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:19.652 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.652 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:19.652 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:19.652 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:19.652 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.652 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:19.652 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:19.652 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.652 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.652 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:19.652 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:19.653 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.653 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.653 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:19.653 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.653 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:19.653 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:19.653 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.653 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.653 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:19.653 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:19.653 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.653 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:19.653 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:19.653 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:19.653 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:19.654 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:19.654 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.654 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:19.654 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.654 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:19.654 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:19.654 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:19.654 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:19.654 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:19.654 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:19.654 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:19.654 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:19.654 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.654 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.654 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:19.655 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:19.655 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:19.655 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:19.655 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.655 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:19.655 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:19.655 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:19.655 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:19.655 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.655 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.655 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:19.655 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:19.655 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:19.655 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:19.655 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.655 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.655 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:19.656 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:19.656 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:19.656 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.656 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:19.656 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.656 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:19.656 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:19.656 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.656 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:19.656 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:19.656 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:19.656 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:19.656 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:19.656 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:19.656 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.656 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:19.657 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.657 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:19.657 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.657 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.657 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:19.657 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.657 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:19.657 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.657 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:19.657 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:19.657 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:19.657 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:19.657 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:19.657 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:19.657 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.658 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:19.658 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:19.658 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:19.658 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:19.658 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:19.658 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:19.658 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.658 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:19.658 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:19.658 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:19.658 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:19.658 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:19.658 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:19.658 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:19.658 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:19.658 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:19.659 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:19.659 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:19.659 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.659 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.659 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:19.659 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.659 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:19.659 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:19.659 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:19.659 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:19.659 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:19.659 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:19.659 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:19.659 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:19.659 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:19.659 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:19.660 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:19.660 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:19.660 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:19.660 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:19.660 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:19.660 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:19.660 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:19.660 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:19.660 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:19.660 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:19.660 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:19.660 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:19.660 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:19.660 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:19.660 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:19.660 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:19.661 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:19.661 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:19.661 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.661 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.661 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.661 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.661 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:19.661 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:19.661 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.661 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:19.661 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.661 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:19.661 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:19.661 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:19.661 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.661 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:19.662 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:19.662 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.662 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.662 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:19.662 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:19.662 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.662 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.662 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:19.662 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:19.662 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:19.662 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:19.662 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:19.662 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.662 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.662 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:19.663 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:19.663 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:19.663 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.663 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:19.663 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.663 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:19.663 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.663 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:19.663 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.663 INFO:teuthology.orchestra.run.smithi003.stdout: def test_cors_presigned_get_object_tenant(): 2023-12-03T13:00:19.663 INFO:teuthology.orchestra.run.smithi003.stdout:> _test_cors_options_presigned_get_object(client=get_tenant_client()) 2023-12-03T13:00:19.663 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.663 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:6719: 2023-12-03T13:00:19.663 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.663 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:6693: in _test_cors_options_presigned_get_object 2023-12-03T13:00:19.664 INFO:teuthology.orchestra.run.smithi003.stdout: bucket_name = _setup_bucket_object_acl('public-read', 'public-read', client=client) 2023-12-03T13:00:19.664 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:3234: in _setup_bucket_object_acl 2023-12-03T13:00:19.664 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(ACL=bucket_acl, Bucket=bucket_name) 2023-12-03T13:00:19.664 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:19.664 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:19.664 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:19.664 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:19.664 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:19.664 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:19.664 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:19.664 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:19.664 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:19.664 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:19.664 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:19.664 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:19.664 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:19.665 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:19.665 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:19.665 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:19.665 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:19.665 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:19.665 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:19.665 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:19.665 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:19.665 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:19.665 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:19.665 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:19.665 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:19.665 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:19.665 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:19.665 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:19.665 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:19.666 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:19.666 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:19.666 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:19.666 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:19.666 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:19.666 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.666 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.666 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.666 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:19.666 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.666 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:19.666 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.666 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:19.666 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:19.667 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:19.667 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:19.667 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:19.667 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:19.667 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.667 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:19.667 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:19.667 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:19.667 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:19.667 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:19.667 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:19.667 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.667 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:19.667 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:19.668 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:19.668 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:19.668 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:19.668 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:19.668 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:19.668 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:19.668 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:19.668 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:19.668 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:19.668 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.668 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.668 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:19.668 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:19.668 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:19.668 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:19.668 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:19.668 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.669 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.669 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:19.669 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:19.669 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:19.669 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:19.669 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:19.669 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.669 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:19.669 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:19.669 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:19.669 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:19.669 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:19.669 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-351" 2023-12-03T13:00:19.669 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.670 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:19.670 INFO:teuthology.orchestra.run.smithi003.stdout:___________________________ test_set_bucket_tagging ____________________________ 2023-12-03T13:00:19.670 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.670 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.670 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.670 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:19.670 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:19.670 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.670 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:19.670 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.670 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:19.670 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:19.670 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:19.670 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.671 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:19.671 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:19.671 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.671 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.671 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:19.671 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:19.671 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.671 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.671 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:19.671 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.671 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:19.671 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:19.671 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.671 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.672 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:19.672 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:19.672 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.672 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:19.672 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:19.672 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:19.672 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:19.672 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:19.672 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.672 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:19.672 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.672 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:19.672 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:19.672 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:19.672 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:19.673 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:19.673 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:19.673 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:19.673 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:19.673 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.673 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.673 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:19.673 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:19.673 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:19.673 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:19.673 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.673 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:19.673 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:19.673 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:19.674 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:19.674 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.674 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.674 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:19.674 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:19.674 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:19.674 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:19.674 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.674 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.674 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:19.674 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:19.674 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:19.674 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.675 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:19.675 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.675 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:19.675 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:19.675 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.675 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:19.675 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:19.675 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:19.675 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:19.675 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:19.675 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:19.675 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.675 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:19.675 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.675 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:19.676 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.676 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.676 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:19.676 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.676 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:19.676 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.676 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:19.676 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:19.676 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:19.676 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:19.676 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:19.676 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:19.676 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.676 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:19.677 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:19.677 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:19.677 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:19.677 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:19.677 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:19.677 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.677 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:19.677 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:19.677 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:19.677 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:19.677 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:19.677 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:19.677 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:19.677 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:19.677 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:19.678 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:19.678 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:19.678 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.678 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.678 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:19.678 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.678 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:19.678 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:19.678 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:19.678 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:19.678 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:19.678 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:19.678 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:19.678 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:19.678 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:19.679 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:19.679 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:19.679 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:19.679 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:19.679 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:19.679 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:19.679 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:19.679 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:19.679 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:19.679 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:19.679 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:19.679 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:19.679 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:19.679 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:19.680 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:19.680 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:19.680 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:19.680 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:19.680 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:19.680 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.680 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.680 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.680 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.680 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:19.680 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:19.680 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.680 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:19.680 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.680 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:19.681 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:19.681 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:19.681 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.681 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:19.681 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:19.681 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.681 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.681 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:19.681 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:19.681 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.681 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.681 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:19.681 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:19.681 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:19.681 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:19.682 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:19.682 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.682 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.682 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:19.682 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:19.682 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:19.682 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.682 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:19.682 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.682 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:19.682 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.682 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:19.682 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.682 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.tagging 2023-12-03T13:00:19.683 INFO:teuthology.orchestra.run.smithi003.stdout: def test_set_bucket_tagging(): 2023-12-03T13:00:19.683 INFO:teuthology.orchestra.run.smithi003.stdout:> bucket_name = get_new_bucket() 2023-12-03T13:00:19.683 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.683 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:6723: 2023-12-03T13:00:19.683 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.683 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:19.683 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:19.683 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:19.683 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:19.683 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:19.683 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:19.683 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:19.683 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:19.683 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:19.683 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:19.683 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:19.684 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:19.684 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:19.684 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:19.684 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:19.684 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:19.684 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:19.684 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:19.684 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:19.684 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:19.684 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:19.684 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:19.684 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:19.684 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:19.684 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:19.685 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:19.685 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:19.685 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:19.685 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:19.685 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:19.685 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:19.685 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:19.685 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:19.685 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:19.685 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:19.685 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:19.685 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.685 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.685 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.685 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:19.686 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.686 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:19.686 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.686 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:19.686 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:19.686 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:19.686 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:19.686 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:19.686 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:19.686 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.686 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:19.686 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:19.686 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:19.686 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:19.687 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:19.687 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:19.687 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.687 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:19.687 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:19.687 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:19.687 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:19.687 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:19.687 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:19.687 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:19.687 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:19.687 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:19.687 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:19.687 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:19.687 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.687 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.688 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:19.688 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:19.688 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:19.688 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:19.688 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:19.688 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.688 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.688 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:19.688 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:19.688 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:19.688 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:19.688 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:19.688 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.688 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:19.688 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:19.688 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:19.689 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:19.689 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:19.689 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-352" 2023-12-03T13:00:19.689 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.689 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:19.689 INFO:teuthology.orchestra.run.smithi003.stdout:_____________________________ test_atomic_read_1mb _____________________________ 2023-12-03T13:00:19.689 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.689 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.689 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.689 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:19.689 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:19.689 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.689 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:19.689 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.689 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:19.689 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:19.690 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:19.690 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.690 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:19.690 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:19.690 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.690 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.690 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:19.690 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:19.690 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.690 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.690 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:19.690 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.690 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:19.690 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:19.690 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.691 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.691 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:19.691 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:19.691 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.691 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:19.691 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:19.691 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:19.691 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:19.691 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:19.691 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.691 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:19.691 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.691 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:19.691 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:19.692 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:19.692 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:19.692 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:19.692 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:19.692 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:19.692 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:19.692 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.692 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.692 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:19.692 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:19.692 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:19.692 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:19.692 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.692 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:19.692 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:19.692 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:19.693 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:19.693 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.693 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.693 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:19.693 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:19.693 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:19.693 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:19.693 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.693 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.693 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:19.693 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:19.693 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:19.693 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.693 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:19.693 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.693 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:19.694 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:19.694 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.694 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:19.694 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:19.694 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:19.694 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:19.694 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:19.694 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:19.694 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.694 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:19.694 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.694 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:19.694 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.694 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.694 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:19.695 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.695 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:19.695 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.695 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:19.695 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:19.695 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:19.695 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:19.695 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:19.695 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:19.695 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.695 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:19.695 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:19.695 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:19.695 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:19.695 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:19.695 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:19.695 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.696 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:19.696 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:19.696 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:19.696 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:19.696 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:19.696 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:19.696 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:19.696 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:19.696 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:19.696 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:19.696 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:19.696 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.696 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.696 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:19.696 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.696 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:19.696 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:19.697 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:19.697 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:19.697 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:19.697 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:19.697 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:19.697 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:19.697 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:19.697 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:19.697 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:19.697 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:19.697 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:19.697 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:19.697 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:19.697 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:19.697 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:19.697 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:19.698 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:19.698 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:19.698 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:19.698 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:19.698 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:19.698 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:19.698 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:19.698 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:19.698 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:19.698 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:19.698 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.698 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.698 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.698 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.698 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:19.699 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:19.699 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.699 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:19.699 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.699 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:19.699 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:19.699 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:19.699 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.699 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:19.699 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:19.699 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.699 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.699 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:19.699 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:19.699 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.699 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.700 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:19.700 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:19.700 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:19.700 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:19.700 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:19.700 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.700 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.700 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:19.700 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:19.700 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:19.700 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.700 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:19.700 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.700 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:19.700 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.700 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:19.701 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.701 INFO:teuthology.orchestra.run.smithi003.stdout: def test_atomic_read_1mb(): 2023-12-03T13:00:19.701 INFO:teuthology.orchestra.run.smithi003.stdout:> _test_atomic_read(1024*1024) 2023-12-03T13:00:19.701 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.701 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:6871: 2023-12-03T13:00:19.701 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.701 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:6851: in _test_atomic_read 2023-12-03T13:00:19.701 INFO:teuthology.orchestra.run.smithi003.stdout: bucket_name = get_new_bucket() 2023-12-03T13:00:19.701 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:19.701 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:19.701 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:19.701 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:19.701 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:19.701 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:19.701 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:19.702 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:19.702 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:19.702 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:19.702 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:19.702 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:19.702 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:19.702 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:19.702 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:19.702 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:19.702 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:19.702 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:19.702 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:19.702 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:19.702 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:19.702 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:19.703 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:19.703 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:19.703 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:19.703 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:19.703 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:19.703 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:19.703 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:19.703 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:19.703 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:19.703 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:19.703 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:19.703 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:19.703 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:19.703 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:19.703 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.703 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.704 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.704 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:19.704 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.704 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:19.704 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.704 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:19.704 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:19.704 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:19.704 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:19.704 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:19.704 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:19.704 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.704 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:19.704 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:19.704 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:19.704 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:19.704 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:19.705 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:19.705 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.705 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:19.705 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:19.705 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:19.705 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:19.705 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:19.705 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:19.705 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:19.705 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:19.705 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:19.705 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:19.705 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:19.705 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.705 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.705 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:19.706 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:19.706 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:19.706 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:19.706 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:19.706 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.706 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.706 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:19.706 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:19.706 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:19.706 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:19.706 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:19.706 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.706 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:19.707 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:19.707 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:19.707 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:19.707 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:19.707 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-353" 2023-12-03T13:00:19.707 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.707 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:19.707 INFO:teuthology.orchestra.run.smithi003.stdout:_____________________________ test_atomic_read_4mb _____________________________ 2023-12-03T13:00:19.707 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.707 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.707 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.707 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:19.707 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:19.707 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.707 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:19.707 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.707 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:19.708 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:19.708 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:19.708 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.708 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:19.708 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:19.708 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.708 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.708 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:19.708 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:19.708 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.708 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.708 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:19.708 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.708 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:19.709 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:19.709 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.709 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.709 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:19.709 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:19.709 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.709 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:19.709 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:19.709 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:19.709 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:19.709 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:19.709 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.709 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:19.709 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.709 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:19.709 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:19.710 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:19.710 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:19.710 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:19.710 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:19.710 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:19.710 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:19.710 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.710 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.710 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:19.710 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:19.710 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:19.710 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:19.710 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.710 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:19.711 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:19.711 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:19.711 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:19.711 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.711 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.711 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:19.711 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:19.711 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:19.711 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:19.711 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.711 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.711 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:19.711 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:19.711 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:19.711 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.711 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:19.712 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.712 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:19.712 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:19.712 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.712 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:19.712 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:19.712 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:19.712 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:19.712 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:19.712 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:19.712 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.712 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:19.712 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.712 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:19.712 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.712 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.712 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:19.713 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.713 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:19.713 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.713 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:19.713 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:19.713 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:19.713 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:19.713 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:19.713 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:19.713 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.713 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:19.713 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:19.713 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:19.713 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:19.713 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:19.714 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:19.714 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.714 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:19.714 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:19.714 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:19.714 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:19.714 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:19.714 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:19.714 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:19.714 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:19.714 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:19.714 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:19.714 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:19.714 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.714 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.714 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:19.715 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.715 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:19.715 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:19.715 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:19.715 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:19.715 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:19.715 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:19.715 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:19.715 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:19.715 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:19.715 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:19.715 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:19.715 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:19.715 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:19.715 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:19.716 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:19.716 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:19.716 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:19.716 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:19.716 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:19.716 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:19.716 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:19.716 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:19.716 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:19.716 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:19.716 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:19.716 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:19.716 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:19.716 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:19.716 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.716 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.717 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.717 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.717 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:19.717 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:19.717 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.717 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:19.717 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.717 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:19.717 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:19.717 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:19.717 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.717 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:19.717 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:19.717 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.717 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.717 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:19.717 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:19.718 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.718 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.718 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:19.718 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:19.718 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:19.718 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:19.718 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:19.718 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.718 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.718 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:19.718 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:19.718 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:19.718 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.718 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:19.719 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.719 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:19.719 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.719 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:19.719 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.719 INFO:teuthology.orchestra.run.smithi003.stdout: def test_atomic_read_4mb(): 2023-12-03T13:00:19.719 INFO:teuthology.orchestra.run.smithi003.stdout:> _test_atomic_read(1024*1024*4) 2023-12-03T13:00:19.719 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.719 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:6874: 2023-12-03T13:00:19.719 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.719 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:6851: in _test_atomic_read 2023-12-03T13:00:19.719 INFO:teuthology.orchestra.run.smithi003.stdout: bucket_name = get_new_bucket() 2023-12-03T13:00:19.719 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:19.719 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:19.719 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:19.719 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:19.720 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:19.720 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:19.720 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:19.720 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:19.720 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:19.720 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:19.720 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:19.720 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:19.720 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:19.720 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:19.720 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:19.720 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:19.720 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:19.720 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:19.720 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:19.720 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:19.721 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:19.721 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:19.721 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:19.721 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:19.721 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:19.721 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:19.721 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:19.721 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:19.721 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:19.721 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:19.721 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:19.721 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:19.721 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:19.721 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:19.721 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:19.721 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:19.721 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.722 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.722 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.722 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:19.722 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.722 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:19.722 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.722 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:19.722 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:19.722 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:19.722 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:19.722 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:19.722 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:19.722 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.722 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:19.723 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:19.723 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:19.723 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:19.723 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:19.723 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:19.723 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.723 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:19.723 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:19.723 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:19.723 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:19.723 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:19.723 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:19.723 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:19.723 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:19.723 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:19.724 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:19.724 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:19.724 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.724 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.724 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:19.724 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:19.724 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:19.724 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:19.724 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:19.724 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.724 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.724 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:19.724 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:19.724 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:19.724 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:19.724 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:19.724 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.725 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:19.725 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:19.725 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:19.725 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:19.725 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:19.725 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-354" 2023-12-03T13:00:19.725 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.725 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:19.725 INFO:teuthology.orchestra.run.smithi003.stdout:_____________________________ test_atomic_read_8mb _____________________________ 2023-12-03T13:00:19.725 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.725 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.725 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.725 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:19.725 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:19.725 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.726 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:19.726 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.726 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:19.726 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:19.726 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:19.726 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.726 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:19.726 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:19.726 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.726 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.726 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:19.726 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:19.726 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.726 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.726 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:19.727 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.727 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:19.727 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:19.727 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.727 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.727 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:19.727 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:19.727 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.727 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:19.727 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:19.727 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:19.727 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:19.727 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:19.727 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.727 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:19.727 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.728 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:19.728 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:19.728 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:19.728 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:19.728 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:19.728 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:19.728 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:19.728 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:19.728 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.728 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.728 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:19.728 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:19.728 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:19.728 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:19.728 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.728 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:19.728 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:19.729 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:19.729 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:19.729 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.729 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.729 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:19.729 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:19.729 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:19.729 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:19.729 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.729 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.729 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:19.729 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:19.729 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:19.729 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.729 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:19.729 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.730 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:19.730 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:19.730 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.730 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:19.730 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:19.730 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:19.730 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:19.730 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:19.730 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:19.730 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.730 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:19.730 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.730 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:19.730 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.730 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.731 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:19.731 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.731 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:19.731 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.731 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:19.731 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:19.731 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:19.731 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:19.731 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:19.731 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:19.731 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.731 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:19.731 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:19.731 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:19.731 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:19.731 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:19.732 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:19.732 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.732 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:19.732 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:19.732 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:19.732 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:19.732 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:19.732 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:19.732 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:19.732 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:19.732 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:19.732 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:19.732 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:19.732 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.732 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.733 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:19.733 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.733 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:19.733 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:19.733 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:19.733 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:19.733 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:19.733 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:19.733 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:19.733 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:19.733 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:19.733 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:19.733 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:19.733 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:19.733 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:19.733 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:19.733 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:19.734 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:19.734 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:19.734 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:19.734 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:19.734 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:19.734 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:19.734 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:19.734 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:19.734 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:19.734 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:19.734 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:19.734 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:19.734 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:19.734 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.734 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.735 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.735 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.735 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:19.735 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:19.735 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.735 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:19.735 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.735 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:19.735 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:19.735 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:19.735 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.735 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:19.735 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:19.735 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.736 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.736 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:19.736 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:19.736 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.736 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.736 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:19.736 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:19.736 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:19.736 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:19.736 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:19.736 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.736 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.736 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:19.736 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:19.736 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:19.736 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.736 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:19.737 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.737 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:19.737 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.737 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:19.737 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.737 INFO:teuthology.orchestra.run.smithi003.stdout: def test_atomic_read_8mb(): 2023-12-03T13:00:19.737 INFO:teuthology.orchestra.run.smithi003.stdout:> _test_atomic_read(1024*1024*8) 2023-12-03T13:00:19.737 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.737 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:6877: 2023-12-03T13:00:19.737 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.737 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:6851: in _test_atomic_read 2023-12-03T13:00:19.737 INFO:teuthology.orchestra.run.smithi003.stdout: bucket_name = get_new_bucket() 2023-12-03T13:00:19.737 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:19.737 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:19.737 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:19.737 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:19.738 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:19.738 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:19.738 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:19.738 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:19.738 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:19.738 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:19.738 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:19.738 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:19.738 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:19.738 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:19.738 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:19.738 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:19.738 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:19.738 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:19.739 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:19.739 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:19.739 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:19.739 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:19.739 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:19.739 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:19.739 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:19.739 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:19.739 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:19.739 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:19.739 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:19.739 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:19.739 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:19.739 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:19.739 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:19.739 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:19.740 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:19.740 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:19.740 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.740 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.740 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.740 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:19.740 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.740 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:19.740 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.740 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:19.740 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:19.740 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:19.740 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:19.740 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:19.740 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:19.740 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.741 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:19.741 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:19.741 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:19.741 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:19.741 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:19.741 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:19.741 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.741 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:19.741 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:19.741 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:19.741 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:19.741 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:19.741 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:19.741 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:19.741 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:19.741 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:19.742 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:19.742 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:19.742 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.742 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.742 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:19.742 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:19.742 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:19.742 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:19.742 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:19.742 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.742 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.742 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:19.742 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:19.742 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:19.742 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:19.743 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:19.743 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.743 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:19.743 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:19.743 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:19.743 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:19.743 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:19.743 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-355" 2023-12-03T13:00:19.743 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.743 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:19.743 INFO:teuthology.orchestra.run.smithi003.stdout:____________________________ test_atomic_write_1mb _____________________________ 2023-12-03T13:00:19.743 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.743 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.743 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.743 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:19.743 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:19.744 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.744 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:19.744 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.744 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:19.744 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:19.744 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:19.744 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.744 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:19.744 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:19.744 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.744 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.744 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:19.744 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:19.744 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.744 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.744 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:19.745 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.745 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:19.745 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:19.745 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.745 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.745 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:19.745 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:19.745 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.745 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:19.745 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:19.745 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:19.745 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:19.745 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:19.745 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.745 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:19.745 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.746 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:19.746 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:19.746 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:19.746 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:19.746 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:19.746 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:19.746 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:19.746 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:19.746 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.746 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.746 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:19.746 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:19.746 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:19.746 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:19.746 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.747 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:19.747 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:19.747 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:19.747 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:19.747 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.747 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.747 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:19.747 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:19.747 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:19.747 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:19.747 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.747 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.747 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:19.747 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:19.747 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:19.747 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.747 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:19.748 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.748 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:19.748 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:19.748 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.748 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:19.748 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:19.748 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:19.748 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:19.748 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:19.748 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:19.748 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.748 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:19.748 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.748 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:19.748 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.748 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.749 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:19.749 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.749 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:19.749 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.749 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:19.749 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:19.749 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:19.749 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:19.749 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:19.749 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:19.749 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.749 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:19.749 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:19.749 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:19.749 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:19.749 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:19.750 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:19.750 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.750 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:19.750 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:19.750 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:19.750 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:19.750 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:19.750 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:19.750 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:19.750 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:19.750 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:19.750 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:19.750 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:19.750 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.751 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.751 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:19.751 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.751 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:19.751 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:19.751 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:19.751 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:19.751 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:19.751 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:19.751 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:19.751 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:19.751 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:19.751 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:19.751 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:19.751 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:19.751 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:19.752 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:19.752 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:19.752 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:19.752 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:19.752 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:19.752 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:19.752 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:19.752 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:19.752 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:19.752 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:19.752 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:19.752 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:19.752 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:19.752 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:19.752 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:19.752 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.752 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.753 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.753 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.753 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:19.753 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:19.753 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.753 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:19.753 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.753 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:19.753 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:19.753 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:19.753 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.753 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:19.753 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:19.753 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.753 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.754 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:19.754 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:19.754 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.754 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.754 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:19.754 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:19.754 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:19.754 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:19.754 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:19.754 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.754 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.754 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:19.754 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:19.754 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:19.754 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.754 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:19.755 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.755 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:19.755 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.755 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:19.755 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.755 INFO:teuthology.orchestra.run.smithi003.stdout: def test_atomic_write_1mb(): 2023-12-03T13:00:19.755 INFO:teuthology.orchestra.run.smithi003.stdout:> _test_atomic_write(1024*1024) 2023-12-03T13:00:19.755 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.755 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:6912: 2023-12-03T13:00:19.755 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.755 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:6887: in _test_atomic_write 2023-12-03T13:00:19.755 INFO:teuthology.orchestra.run.smithi003.stdout: bucket_name = get_new_bucket() 2023-12-03T13:00:19.755 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:19.755 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:19.755 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:19.755 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:19.755 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:19.756 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:19.756 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:19.756 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:19.756 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:19.756 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:19.756 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:19.756 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:19.756 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:19.756 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:19.756 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:19.756 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:19.756 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:19.756 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:19.756 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:19.756 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:19.757 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:19.757 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:19.757 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:19.757 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:19.757 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:19.757 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:19.757 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:19.757 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:19.757 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:19.757 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:19.757 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:19.757 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:19.757 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:19.757 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:19.757 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:19.758 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:19.758 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.758 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.758 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.758 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:19.758 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.758 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:19.758 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.758 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:19.758 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:19.758 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:19.758 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:19.758 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:19.758 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:19.758 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.759 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:19.759 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:19.759 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:19.759 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:19.759 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:19.759 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:19.759 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.759 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:19.759 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:19.759 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:19.759 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:19.759 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:19.759 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:19.759 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:19.759 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:19.759 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:19.760 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:19.760 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:19.760 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.760 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.760 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:19.760 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:19.760 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:19.760 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:19.760 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:19.760 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.760 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.760 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:19.760 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:19.760 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:19.760 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:19.760 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:19.761 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.761 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:19.761 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:19.761 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:19.761 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:19.761 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:19.761 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-356" 2023-12-03T13:00:19.761 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.761 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:19.761 INFO:teuthology.orchestra.run.smithi003.stdout:____________________________ test_atomic_write_4mb _____________________________ 2023-12-03T13:00:19.761 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.761 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.761 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.761 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:19.761 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:19.761 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.762 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:19.762 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.762 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:19.762 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:19.762 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:19.762 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.762 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:19.762 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:19.762 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.762 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.762 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:19.762 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:19.762 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.762 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.762 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:19.762 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.763 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:19.763 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:19.763 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.763 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.763 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:19.763 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:19.763 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.763 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:19.763 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:19.763 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:19.763 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:19.763 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:19.763 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.763 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:19.763 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.764 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:19.764 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:19.764 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:19.764 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:19.764 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:19.764 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:19.764 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:19.764 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:19.764 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.764 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.764 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:19.764 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:19.764 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:19.764 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:19.764 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.764 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:19.764 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:19.765 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:19.765 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:19.765 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.765 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.765 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:19.765 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:19.765 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:19.765 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:19.765 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.765 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.765 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:19.765 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:19.765 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:19.765 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.765 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:19.765 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.765 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:19.766 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:19.766 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.766 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:19.766 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:19.766 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:19.766 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:19.766 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:19.766 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:19.766 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.766 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:19.766 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.766 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:19.766 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.766 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.766 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:19.766 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.767 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:19.767 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.767 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:19.767 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:19.767 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:19.767 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:19.767 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:19.767 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:19.767 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.767 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:19.767 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:19.767 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:19.767 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:19.767 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:19.768 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:19.768 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.768 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:19.768 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:19.768 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:19.768 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:19.768 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:19.768 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:19.768 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:19.768 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:19.768 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:19.768 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:19.768 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:19.768 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.768 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.768 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:19.768 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.769 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:19.769 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:19.769 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:19.769 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:19.769 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:19.769 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:19.769 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:19.769 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:19.769 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:19.769 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:19.769 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:19.769 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:19.769 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:19.769 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:19.769 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:19.769 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:19.770 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:19.770 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:19.770 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:19.770 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:19.770 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:19.770 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:19.770 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:19.770 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:19.770 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:19.770 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:19.770 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:19.770 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:19.770 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.770 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.770 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.771 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.771 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:19.771 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:19.771 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.771 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:19.771 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.771 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:19.771 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:19.771 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:19.771 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.771 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:19.771 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:19.771 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.771 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.771 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:19.772 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:19.772 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.772 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.772 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:19.772 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:19.772 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:19.772 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:19.772 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:19.772 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.772 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.772 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:19.772 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:19.772 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:19.772 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.772 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:19.773 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.773 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:19.773 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.773 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:19.773 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.773 INFO:teuthology.orchestra.run.smithi003.stdout: def test_atomic_write_4mb(): 2023-12-03T13:00:19.773 INFO:teuthology.orchestra.run.smithi003.stdout:> _test_atomic_write(1024*1024*4) 2023-12-03T13:00:19.773 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.773 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:6915: 2023-12-03T13:00:19.773 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.773 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:6887: in _test_atomic_write 2023-12-03T13:00:19.773 INFO:teuthology.orchestra.run.smithi003.stdout: bucket_name = get_new_bucket() 2023-12-03T13:00:19.773 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:19.773 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:19.773 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:19.773 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:19.774 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:19.774 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:19.774 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:19.774 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:19.774 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:19.774 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:19.774 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:19.774 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:19.774 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:19.774 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:19.774 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:19.774 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:19.774 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:19.774 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:19.774 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:19.775 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:19.775 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:19.775 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:19.775 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:19.775 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:19.775 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:19.775 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:19.775 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:19.775 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:19.775 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:19.775 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:19.775 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:19.775 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:19.775 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:19.775 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:19.775 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:19.776 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:19.776 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.776 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.776 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.776 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:19.776 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.776 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:19.776 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.776 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:19.776 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:19.776 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:19.776 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:19.776 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:19.776 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:19.776 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.777 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:19.777 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:19.777 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:19.777 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:19.777 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:19.777 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:19.777 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.777 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:19.777 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:19.777 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:19.777 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:19.777 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:19.777 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:19.777 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:19.777 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:19.777 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:19.778 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:19.778 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:19.778 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.778 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.778 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:19.778 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:19.778 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:19.778 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:19.778 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:19.778 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.778 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.778 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:19.778 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:19.778 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:19.779 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:19.779 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:19.779 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.779 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:19.779 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:19.779 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:19.779 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:19.779 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:19.779 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-357" 2023-12-03T13:00:19.779 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.779 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:19.779 INFO:teuthology.orchestra.run.smithi003.stdout:____________________________ test_atomic_write_8mb _____________________________ 2023-12-03T13:00:19.779 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.779 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.779 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.779 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:19.779 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:19.780 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.780 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:19.780 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.780 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:19.780 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:19.780 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:19.780 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.780 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:19.780 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:19.780 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.780 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.780 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:19.780 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:19.780 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.780 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.780 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:19.781 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.781 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:19.781 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:19.781 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.781 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.781 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:19.781 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:19.781 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.781 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:19.781 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:19.781 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:19.781 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:19.781 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:19.781 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.781 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:19.782 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.782 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:19.782 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:19.782 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:19.782 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:19.782 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:19.782 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:19.782 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:19.782 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:19.782 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.782 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.782 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:19.782 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:19.782 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:19.782 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:19.782 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.783 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:19.783 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:19.783 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:19.783 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:19.783 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.783 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.783 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:19.783 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:19.783 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:19.783 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:19.783 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.783 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.783 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:19.783 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:19.783 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:19.784 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.784 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:19.784 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.784 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:19.784 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:19.784 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.784 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:19.784 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:19.784 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:19.784 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:19.784 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:19.784 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:19.784 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.784 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:19.784 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.784 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:19.785 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.785 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.785 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:19.785 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.785 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:19.785 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.785 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:19.785 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:19.785 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:19.785 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:19.785 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:19.785 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:19.785 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.785 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:19.785 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:19.785 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:19.785 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:19.786 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:19.786 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:19.786 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.786 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:19.786 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:19.786 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:19.786 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:19.786 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:19.786 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:19.786 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:19.786 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:19.786 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:19.786 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:19.786 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:19.786 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.786 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.787 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:19.787 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.787 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:19.787 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:19.787 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:19.787 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:19.787 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:19.787 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:19.787 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:19.787 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:19.787 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:19.787 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:19.787 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:19.787 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:19.787 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:19.787 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:19.787 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:19.788 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:19.788 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:19.788 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:19.788 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:19.788 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:19.788 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:19.788 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:19.788 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:19.788 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:19.788 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:19.788 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:19.788 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:19.788 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:19.788 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.788 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.789 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.789 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.789 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:19.789 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:19.789 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.789 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:19.789 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.789 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:19.789 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:19.789 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:19.789 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.789 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:19.789 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:19.789 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.789 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.789 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:19.790 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:19.790 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.790 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.790 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:19.790 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:19.790 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:19.790 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:19.790 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:19.790 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.790 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.790 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:19.790 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:19.790 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:19.790 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.790 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:19.790 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.791 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:19.791 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.791 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:19.791 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.791 INFO:teuthology.orchestra.run.smithi003.stdout: def test_atomic_write_8mb(): 2023-12-03T13:00:19.791 INFO:teuthology.orchestra.run.smithi003.stdout:> _test_atomic_write(1024*1024*8) 2023-12-03T13:00:19.791 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.791 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:6918: 2023-12-03T13:00:19.791 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.791 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:6887: in _test_atomic_write 2023-12-03T13:00:19.791 INFO:teuthology.orchestra.run.smithi003.stdout: bucket_name = get_new_bucket() 2023-12-03T13:00:19.791 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:19.791 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:19.791 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:19.791 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:19.792 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:19.792 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:19.792 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:19.792 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:19.792 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:19.792 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:19.792 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:19.792 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:19.792 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:19.792 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:19.792 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:19.792 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:19.792 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:19.792 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:19.792 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:19.792 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:19.793 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:19.793 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:19.793 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:19.793 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:19.793 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:19.793 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:19.793 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:19.793 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:19.793 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:19.793 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:19.793 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:19.793 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:19.793 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:19.793 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:19.793 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:19.793 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:19.794 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.794 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.794 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.794 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:19.794 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.794 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:19.794 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.794 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:19.794 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:19.794 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:19.794 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:19.794 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:19.794 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:19.794 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.794 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:19.794 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:19.795 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:19.795 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:19.795 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:19.795 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:19.795 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.795 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:19.795 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:19.795 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:19.795 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:19.795 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:19.795 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:19.795 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:19.795 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:19.795 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:19.795 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:19.795 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:19.796 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.796 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.796 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:19.796 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:19.796 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:19.796 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:19.796 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:19.796 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.796 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.796 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:19.796 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:19.796 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:19.796 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:19.796 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:19.796 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.796 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:19.796 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:19.797 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:19.797 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:19.797 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:19.797 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-358" 2023-12-03T13:00:19.797 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.797 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:19.797 INFO:teuthology.orchestra.run.smithi003.stdout:__________________________ test_atomic_dual_write_1mb __________________________ 2023-12-03T13:00:19.797 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.797 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.797 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.797 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:19.797 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:19.797 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.797 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:19.797 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.797 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:19.798 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:19.798 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:19.798 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.798 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:19.798 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:19.798 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.798 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.798 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:19.798 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:19.798 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.798 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.798 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:19.798 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.798 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:19.798 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:19.799 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.799 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.799 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:19.799 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:19.799 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.799 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:19.799 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:19.799 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:19.799 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:19.799 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:19.799 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.799 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:19.799 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.799 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:19.799 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:19.800 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:19.800 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:19.800 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:19.800 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:19.800 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:19.800 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:19.800 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.800 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.800 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:19.800 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:19.800 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:19.800 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:19.800 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.800 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:19.800 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:19.801 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:19.801 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:19.801 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.801 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.801 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:19.801 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:19.801 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:19.801 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:19.801 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.801 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.801 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:19.801 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:19.801 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:19.801 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.802 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:19.802 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.802 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:19.802 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:19.802 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.802 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:19.802 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:19.802 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:19.802 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:19.802 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:19.802 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:19.802 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.802 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:19.802 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.802 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:19.803 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.803 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.803 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:19.803 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.803 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:19.803 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.803 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:19.803 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:19.803 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:19.803 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:19.803 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:19.803 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:19.803 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.803 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:19.803 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:19.804 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:19.804 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:19.804 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:19.804 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:19.804 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.804 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:19.804 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:19.804 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:19.804 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:19.804 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:19.804 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:19.804 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:19.804 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:19.804 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:19.804 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:19.804 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:19.805 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.805 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.805 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:19.805 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.805 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:19.805 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:19.805 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:19.805 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:19.805 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:19.805 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:19.805 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:19.805 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:19.805 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:19.805 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:19.805 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:19.805 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:19.805 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:19.806 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:19.806 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:19.806 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:19.806 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:19.806 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:19.806 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:19.806 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:19.806 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:19.806 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:19.806 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:19.806 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:19.806 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:19.806 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:19.806 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:19.806 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:19.807 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.807 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.807 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.807 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.807 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:19.807 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:19.807 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.807 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:19.807 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.807 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:19.807 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:19.807 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:19.807 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.807 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:19.807 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:19.807 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.808 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.808 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:19.808 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:19.808 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.808 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.808 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:19.808 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:19.808 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:19.808 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:19.808 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:19.808 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.808 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.808 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:19.808 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:19.808 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:19.809 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.809 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:19.809 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.809 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:19.809 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.809 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:19.809 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.809 INFO:teuthology.orchestra.run.smithi003.stdout: def test_atomic_dual_write_1mb(): 2023-12-03T13:00:19.809 INFO:teuthology.orchestra.run.smithi003.stdout:> _test_atomic_dual_write(1024*1024) 2023-12-03T13:00:19.809 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.809 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:6945: 2023-12-03T13:00:19.809 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.809 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:6925: in _test_atomic_dual_write 2023-12-03T13:00:19.809 INFO:teuthology.orchestra.run.smithi003.stdout: bucket_name = get_new_bucket() 2023-12-03T13:00:19.809 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:19.810 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:19.810 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:19.810 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:19.810 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:19.810 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:19.810 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:19.810 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:19.810 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:19.810 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:19.810 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:19.810 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:19.810 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:19.810 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:19.810 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:19.810 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:19.810 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:19.811 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:19.811 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:19.811 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:19.811 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:19.811 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:19.811 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:19.811 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:19.811 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:19.811 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:19.811 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:19.811 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:19.811 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:19.811 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:19.811 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:19.812 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:19.812 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:19.812 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:19.812 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:19.812 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:19.812 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.812 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.812 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.812 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:19.812 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.812 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:19.812 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.812 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:19.812 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:19.812 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:19.813 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:19.813 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:19.813 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:19.813 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.813 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:19.813 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:19.813 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:19.813 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:19.813 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:19.813 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:19.813 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.813 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:19.813 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:19.813 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:19.813 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:19.813 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:19.814 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:19.814 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:19.814 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:19.814 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:19.814 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:19.814 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:19.814 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.814 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.814 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:19.814 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:19.814 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:19.814 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:19.814 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:19.814 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.814 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.814 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:19.815 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:19.815 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:19.815 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:19.815 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:19.815 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.815 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:19.815 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:19.815 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:19.815 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:19.815 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:19.815 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-359" 2023-12-03T13:00:19.815 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.815 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:19.815 INFO:teuthology.orchestra.run.smithi003.stdout:__________________________ test_atomic_dual_write_4mb __________________________ 2023-12-03T13:00:19.815 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.815 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.816 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.816 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:19.816 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:19.816 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.816 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:19.816 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.816 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:19.816 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:19.816 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:19.816 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.816 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:19.816 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:19.816 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.816 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.816 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:19.817 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:19.817 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.817 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.817 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:19.817 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.817 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:19.817 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:19.817 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.817 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.817 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:19.817 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:19.817 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.817 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:19.817 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:19.817 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:19.817 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:19.818 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:19.818 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.818 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:19.818 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.818 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:19.818 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:19.818 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:19.818 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:19.818 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:19.818 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:19.818 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:19.818 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:19.818 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.818 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.818 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:19.819 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:19.819 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:19.819 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:19.819 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.819 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:19.819 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:19.819 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:19.819 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:19.819 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.819 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.819 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:19.819 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:19.819 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:19.819 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:19.819 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.819 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.819 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:19.820 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:19.820 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:19.820 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.820 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:19.820 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.820 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:19.820 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:19.820 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.820 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:19.820 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:19.820 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:19.820 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:19.820 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:19.820 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:19.820 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.820 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:19.821 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.821 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:19.821 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.821 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.821 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:19.821 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.821 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:19.821 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.821 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:19.821 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:19.821 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:19.821 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:19.821 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:19.821 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:19.821 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.821 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:19.822 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:19.822 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:19.822 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:19.822 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:19.822 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:19.822 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.822 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:19.822 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:19.822 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:19.822 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:19.822 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:19.822 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:19.822 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:19.822 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:19.822 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:19.823 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:19.823 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:19.823 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.823 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.823 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:19.823 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.823 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:19.823 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:19.823 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:19.823 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:19.823 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:19.823 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:19.823 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:19.823 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:19.823 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:19.824 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:19.824 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:19.824 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:19.824 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:19.824 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:19.824 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:19.824 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:19.824 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:19.824 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:19.824 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:19.824 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:19.824 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:19.824 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:19.824 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:19.824 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:19.824 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:19.825 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:19.825 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:19.825 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:19.825 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.825 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.825 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.825 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.825 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:19.825 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:19.825 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.825 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:19.825 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.825 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:19.825 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:19.825 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:19.826 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.826 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:19.826 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:19.826 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.826 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.826 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:19.826 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:19.826 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.826 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.826 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:19.826 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:19.826 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:19.826 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:19.826 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:19.826 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.826 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.827 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:19.827 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:19.827 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:19.827 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.827 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:19.827 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.827 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:19.827 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.827 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:19.827 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.827 INFO:teuthology.orchestra.run.smithi003.stdout: def test_atomic_dual_write_4mb(): 2023-12-03T13:00:19.827 INFO:teuthology.orchestra.run.smithi003.stdout:> _test_atomic_dual_write(1024*1024*4) 2023-12-03T13:00:19.827 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.827 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:6948: 2023-12-03T13:00:19.827 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.827 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:6925: in _test_atomic_dual_write 2023-12-03T13:00:19.828 INFO:teuthology.orchestra.run.smithi003.stdout: bucket_name = get_new_bucket() 2023-12-03T13:00:19.828 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:19.828 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:19.828 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:19.828 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:19.828 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:19.828 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:19.828 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:19.828 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:19.828 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:19.828 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:19.828 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:19.828 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:19.828 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:19.828 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:19.829 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:19.829 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:19.829 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:19.829 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:19.829 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:19.829 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:19.829 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:19.829 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:19.829 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:19.829 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:19.829 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:19.829 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:19.829 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:19.829 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:19.829 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:19.829 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:19.829 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:19.830 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:19.830 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:19.830 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:19.830 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:19.830 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:19.830 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.830 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.830 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.830 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:19.830 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.830 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:19.830 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.830 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:19.830 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:19.830 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:19.831 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:19.831 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:19.831 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:19.831 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.831 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:19.831 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:19.831 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:19.831 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:19.831 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:19.831 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:19.831 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.831 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:19.831 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:19.831 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:19.832 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:19.832 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:19.832 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:19.832 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:19.832 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:19.832 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:19.832 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:19.832 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:19.832 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.832 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.832 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:19.832 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:19.832 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:19.832 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:19.832 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:19.832 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.833 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.833 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:19.833 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:19.833 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:19.833 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:19.833 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:19.833 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.833 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:19.833 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:19.833 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:19.833 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:19.833 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:19.833 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-360" 2023-12-03T13:00:19.833 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.833 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:19.834 INFO:teuthology.orchestra.run.smithi003.stdout:__________________________ test_atomic_dual_write_8mb __________________________ 2023-12-03T13:00:19.834 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.834 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.834 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.834 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:19.834 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:19.834 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.834 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:19.834 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.834 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:19.834 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:19.834 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:19.834 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.834 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:19.834 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:19.835 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.835 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.835 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:19.835 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:19.835 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.835 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.835 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:19.835 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.835 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:19.835 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:19.835 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.835 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.835 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:19.835 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:19.836 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.836 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:19.836 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:19.836 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:19.836 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:19.836 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:19.836 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.836 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:19.836 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.836 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:19.836 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:19.836 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:19.836 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:19.836 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:19.836 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:19.836 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:19.837 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:19.837 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.837 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.837 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:19.837 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:19.837 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:19.837 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:19.837 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.837 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:19.837 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:19.837 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:19.837 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:19.837 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.837 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.837 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:19.837 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:19.837 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:19.838 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:19.838 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.838 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.838 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:19.838 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:19.838 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:19.838 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.838 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:19.838 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.838 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:19.838 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:19.838 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.838 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:19.838 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:19.839 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:19.839 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:19.839 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:19.839 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:19.839 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.839 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:19.839 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.839 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:19.839 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.839 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.839 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:19.839 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.839 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:19.839 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.839 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:19.839 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:19.840 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:19.840 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:19.840 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:19.840 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:19.840 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.840 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:19.840 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:19.840 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:19.840 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:19.840 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:19.840 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:19.840 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.840 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:19.840 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:19.840 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:19.840 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:19.841 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:19.841 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:19.841 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:19.841 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:19.841 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:19.841 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:19.841 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:19.841 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.841 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.841 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:19.841 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.841 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:19.841 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:19.841 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:19.841 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:19.842 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:19.842 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:19.842 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:19.842 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:19.842 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:19.842 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:19.842 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:19.842 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:19.842 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:19.842 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:19.842 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:19.842 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:19.842 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:19.842 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:19.842 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:19.843 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:19.843 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:19.843 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:19.843 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:19.843 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:19.843 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:19.843 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:19.843 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:19.843 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:19.843 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.843 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.843 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.843 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.843 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:19.843 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:19.844 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.844 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:19.844 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.844 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:19.844 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:19.844 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:19.844 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.844 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:19.844 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:19.844 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.844 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.844 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:19.844 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:19.844 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.844 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.844 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:19.845 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:19.845 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:19.845 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:19.845 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:19.845 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.845 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.845 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:19.845 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:19.845 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:19.845 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.845 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:19.845 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.845 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:19.845 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.845 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:19.846 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.846 INFO:teuthology.orchestra.run.smithi003.stdout: def test_atomic_dual_write_8mb(): 2023-12-03T13:00:19.846 INFO:teuthology.orchestra.run.smithi003.stdout:> _test_atomic_dual_write(1024*1024*8) 2023-12-03T13:00:19.846 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.846 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:6951: 2023-12-03T13:00:19.846 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.846 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:6925: in _test_atomic_dual_write 2023-12-03T13:00:19.846 INFO:teuthology.orchestra.run.smithi003.stdout: bucket_name = get_new_bucket() 2023-12-03T13:00:19.846 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:19.846 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:19.846 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:19.846 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:19.846 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:19.846 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:19.846 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:19.847 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:19.847 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:19.847 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:19.847 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:19.847 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:19.847 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:19.847 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:19.847 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:19.847 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:19.847 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:19.847 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:19.847 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:19.847 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:19.847 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:19.847 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:19.847 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:19.848 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:19.848 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:19.848 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:19.848 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:19.848 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:19.848 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:19.848 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:19.848 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:19.848 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:19.848 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:19.848 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:19.848 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:19.848 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:19.848 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.848 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.849 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.849 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:19.849 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.849 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:19.849 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.849 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:19.849 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:19.849 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:19.849 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:19.849 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:19.849 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:19.849 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.849 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:19.849 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:19.849 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:19.849 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:19.850 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:19.850 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:19.850 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.850 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:19.850 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:19.850 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:19.850 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:19.850 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:19.850 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:19.850 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:19.850 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:19.850 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:19.850 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:19.850 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:19.851 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.851 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.851 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:19.851 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:19.851 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:19.851 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:19.851 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:19.851 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.851 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.851 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:19.851 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:19.851 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:19.851 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:19.851 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:19.851 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.851 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:19.852 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:19.852 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:19.852 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:19.852 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:19.852 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-361" 2023-12-03T13:00:19.852 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.852 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:19.852 INFO:teuthology.orchestra.run.smithi003.stdout:______________________ test_atomic_conditional_write_1mb _______________________ 2023-12-03T13:00:19.852 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.852 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.852 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.852 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:19.852 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:19.852 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.852 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:19.853 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.853 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:19.853 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:19.853 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:19.853 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.853 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:19.853 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:19.853 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.853 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.853 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:19.853 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:19.853 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.853 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.853 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:19.853 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.853 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:19.854 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:19.854 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.854 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.854 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:19.854 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:19.854 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.854 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:19.854 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:19.854 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:19.854 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:19.854 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:19.854 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.854 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:19.854 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.854 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:19.854 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:19.855 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:19.855 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:19.855 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:19.855 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:19.855 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:19.855 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:19.855 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.855 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.855 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:19.855 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:19.855 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:19.855 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:19.855 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.855 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:19.855 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:19.856 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:19.856 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:19.856 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.856 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.856 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:19.856 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:19.856 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:19.856 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:19.856 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.856 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.856 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:19.856 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:19.856 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:19.856 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.856 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:19.857 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.857 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:19.857 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:19.857 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.857 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:19.857 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:19.857 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:19.857 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:19.857 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:19.857 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:19.857 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.857 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:19.857 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.857 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:19.857 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.857 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.857 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:19.858 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.858 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:19.858 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.858 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:19.858 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:19.858 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:19.858 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:19.858 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:19.858 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:19.858 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.858 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:19.858 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:19.858 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:19.858 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:19.858 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:19.859 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:19.859 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.859 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:19.859 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:19.859 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:19.859 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:19.859 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:19.859 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:19.859 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:19.859 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:19.859 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:19.859 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:19.859 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:19.859 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.859 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.859 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:19.860 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.860 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:19.860 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:19.860 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:19.860 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:19.860 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:19.860 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:19.860 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:19.860 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:19.860 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:19.860 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:19.860 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:19.860 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:19.860 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:19.860 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:19.860 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:19.861 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:19.861 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:19.861 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:19.861 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:19.861 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:19.861 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:19.861 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:19.861 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:19.861 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:19.861 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:19.861 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:19.861 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:19.861 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:19.861 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.861 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.861 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.861 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.862 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:19.862 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:19.862 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.862 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:19.862 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.862 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:19.862 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:19.862 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:19.862 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.862 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:19.862 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:19.862 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.862 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.862 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:19.863 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:19.863 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.863 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.863 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:19.863 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:19.863 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:19.863 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:19.863 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:19.863 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.863 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.863 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:19.863 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:19.863 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:19.863 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.863 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:19.863 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.864 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:19.864 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.864 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:19.864 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.864 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.fails_on_aws 2023-12-03T13:00:19.864 INFO:teuthology.orchestra.run.smithi003.stdout: def test_atomic_conditional_write_1mb(): 2023-12-03T13:00:19.864 INFO:teuthology.orchestra.run.smithi003.stdout:> _test_atomic_conditional_write(1024*1024) 2023-12-03T13:00:19.864 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.864 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:6984: 2023-12-03T13:00:19.864 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.864 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:6961: in _test_atomic_conditional_write 2023-12-03T13:00:19.864 INFO:teuthology.orchestra.run.smithi003.stdout: bucket_name = get_new_bucket() 2023-12-03T13:00:19.864 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:19.864 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:19.864 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:19.864 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:19.865 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:19.865 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:19.865 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:19.865 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:19.865 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:19.865 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:19.865 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:19.865 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:19.865 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:19.865 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:19.865 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:19.865 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:19.865 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:19.865 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:19.865 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:19.865 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:19.865 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:19.866 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:19.866 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:19.866 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:19.866 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:19.866 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:19.866 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:19.866 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:19.866 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:19.866 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:19.866 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:19.866 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:19.866 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:19.866 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:19.866 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:19.866 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:19.867 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.867 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.867 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.867 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:19.867 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.867 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:19.867 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.867 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:19.867 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:19.867 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:19.867 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:19.867 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:19.867 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:19.867 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.867 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:19.868 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:19.868 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:19.868 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:19.868 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:19.868 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:19.868 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.868 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:19.868 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:19.868 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:19.868 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:19.868 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:19.868 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:19.868 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:19.868 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:19.868 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:19.869 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:19.869 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:19.869 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.869 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.869 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:19.869 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:19.869 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:19.869 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:19.869 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:19.869 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.869 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.869 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:19.869 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:19.869 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:19.869 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:19.869 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:19.870 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.870 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:19.870 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:19.870 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:19.870 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:19.870 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:19.870 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-362" 2023-12-03T13:00:19.870 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.870 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:19.870 INFO:teuthology.orchestra.run.smithi003.stdout:______________________ test_atomic_multipart_upload_write ______________________ 2023-12-03T13:00:19.870 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.870 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.870 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.870 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:19.870 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:19.871 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.871 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:19.871 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.871 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:19.871 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:19.871 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:19.871 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.871 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:19.871 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:19.871 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.871 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.871 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:19.871 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:19.871 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.871 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.871 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:19.872 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.872 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:19.872 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:19.872 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.872 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.872 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:19.872 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:19.872 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.872 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:19.872 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:19.872 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:19.872 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:19.872 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:19.872 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.872 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:19.872 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.873 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:19.873 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:19.873 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:19.873 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:19.873 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:19.873 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:19.873 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:19.873 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:19.873 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.873 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.873 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:19.873 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:19.873 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:19.873 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:19.873 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.873 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:19.874 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:19.874 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:19.874 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:19.874 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.874 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.874 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:19.874 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:19.874 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:19.874 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:19.874 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.874 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.874 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:19.874 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:19.874 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:19.874 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.874 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:19.875 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.875 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:19.875 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:19.875 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.875 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:19.875 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:19.875 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:19.875 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:19.875 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:19.875 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:19.875 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.875 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:19.875 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.875 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:19.875 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.875 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.876 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:19.876 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.876 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:19.876 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.876 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:19.876 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:19.876 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:19.876 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:19.876 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:19.876 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:19.876 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.876 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:19.876 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:19.876 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:19.876 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:19.876 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:19.876 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:19.877 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.877 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:19.877 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:19.877 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:19.877 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:19.877 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:19.877 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:19.877 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:19.877 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:19.877 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:19.877 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:19.877 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:19.877 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.877 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.878 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:19.878 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.878 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:19.878 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:19.878 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:19.878 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:19.878 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:19.878 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:19.878 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:19.878 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:19.878 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:19.878 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:19.878 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:19.878 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:19.878 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:19.879 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:19.879 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:19.879 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:19.879 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:19.879 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:19.879 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:19.879 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:19.879 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:19.879 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:19.879 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:19.879 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:19.879 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:19.879 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:19.879 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:19.879 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:19.879 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.879 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.880 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.880 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.880 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:19.880 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:19.880 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.880 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:19.880 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.880 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:19.880 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:19.880 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:19.880 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.880 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:19.880 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:19.880 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.880 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.881 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:19.881 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:19.881 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.881 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.881 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:19.881 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:19.881 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:19.881 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:19.881 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:19.881 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.881 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.881 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:19.881 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:19.881 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:19.881 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.882 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:19.882 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.882 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:19.882 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.882 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:19.882 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.882 INFO:teuthology.orchestra.run.smithi003.stdout: def test_atomic_multipart_upload_write(): 2023-12-03T13:00:19.882 INFO:teuthology.orchestra.run.smithi003.stdout:> bucket_name = get_new_bucket() 2023-12-03T13:00:19.882 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.882 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:7044: 2023-12-03T13:00:19.882 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.882 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:19.882 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:19.882 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:19.882 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:19.883 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:19.883 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:19.883 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:19.883 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:19.883 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:19.883 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:19.883 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:19.883 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:19.883 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:19.883 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:19.883 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:19.883 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:19.883 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:19.883 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:19.883 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:19.883 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:19.884 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:19.884 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:19.884 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:19.884 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:19.884 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:19.884 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:19.884 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:19.884 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:19.884 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:19.884 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:19.884 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:19.884 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:19.884 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:19.884 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:19.884 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:19.885 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:19.885 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.885 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.885 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.885 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:19.885 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.885 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:19.885 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.885 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:19.885 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:19.885 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:19.885 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:19.885 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:19.885 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:19.885 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.885 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:19.885 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:19.886 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:19.886 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:19.886 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:19.886 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:19.886 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.886 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:19.886 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:19.886 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:19.886 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:19.886 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:19.886 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:19.886 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:19.886 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:19.886 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:19.886 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:19.886 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:19.887 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.887 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.887 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:19.887 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:19.887 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:19.887 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:19.887 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:19.887 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.887 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.887 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:19.887 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:19.887 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:19.887 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:19.887 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:19.887 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.888 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:19.888 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:19.888 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:19.888 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:19.888 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:19.888 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-363" 2023-12-03T13:00:19.888 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.888 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:19.888 INFO:teuthology.orchestra.run.smithi003.stdout:__________________ test_multipart_resend_first_finishes_last ___________________ 2023-12-03T13:00:19.888 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.888 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.888 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.888 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:19.889 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:19.889 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.889 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:19.889 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.889 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:19.889 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:19.889 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:19.889 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.889 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:19.889 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:19.889 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.889 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.889 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:19.889 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:19.890 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.890 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.890 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:19.890 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.890 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:19.890 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:19.890 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.890 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.890 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:19.890 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:19.890 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.890 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:19.890 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:19.890 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:19.891 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:19.891 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:19.891 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.891 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:19.891 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.891 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:19.891 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:19.891 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:19.891 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:19.891 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:19.891 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:19.891 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:19.891 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:19.891 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.892 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.892 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:19.892 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:19.892 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:19.892 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:19.892 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.892 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:19.892 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:19.892 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:19.892 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:19.892 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.892 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.892 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:19.892 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:19.892 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:19.893 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:19.893 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.893 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.893 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:19.893 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:19.893 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:19.893 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.893 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:19.893 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.893 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:19.893 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:19.893 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.893 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:19.893 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:19.893 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:19.893 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:19.894 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:19.894 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:19.894 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.894 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:19.894 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.894 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:19.894 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.894 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.894 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:19.894 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.894 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:19.894 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.894 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:19.894 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:19.895 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:19.895 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:19.895 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:19.895 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:19.895 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.895 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:19.895 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:19.895 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:19.895 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:19.895 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:19.895 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:19.895 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.895 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:19.895 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:19.895 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:19.895 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:19.896 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:19.896 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:19.896 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:19.896 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:19.896 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:19.896 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:19.896 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:19.896 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.896 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.896 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:19.896 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.896 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:19.896 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:19.896 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:19.896 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:19.896 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:19.896 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:19.897 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:19.897 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:19.897 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:19.897 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:19.897 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:19.897 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:19.897 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:19.897 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:19.897 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:19.897 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:19.897 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:19.897 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:19.897 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:19.897 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:19.897 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:19.898 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:19.898 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:19.898 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:19.898 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:19.898 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:19.898 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:19.898 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:19.898 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.898 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.898 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.898 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.898 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:19.898 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:19.898 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.898 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:19.898 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.899 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:19.899 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:19.899 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:19.899 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.899 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:19.899 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:19.899 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.899 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.899 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:19.899 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:19.899 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.899 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.899 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:19.899 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:19.899 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:19.899 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:19.900 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:19.900 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.900 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.900 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:19.900 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:19.900 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:19.900 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.900 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:19.900 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.900 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:19.900 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.900 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:19.900 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.900 INFO:teuthology.orchestra.run.smithi003.stdout: def test_multipart_resend_first_finishes_last(): 2023-12-03T13:00:19.900 INFO:teuthology.orchestra.run.smithi003.stdout:> bucket_name = get_new_bucket() 2023-12-03T13:00:19.900 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.901 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:7082: 2023-12-03T13:00:19.901 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.901 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:19.901 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:19.901 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:19.901 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:19.901 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:19.901 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:19.901 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:19.901 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:19.901 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:19.901 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:19.901 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:19.902 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:19.902 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:19.902 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:19.902 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:19.902 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:19.902 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:19.902 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:19.902 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:19.902 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:19.902 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:19.902 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:19.902 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:19.902 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:19.902 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:19.902 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:19.903 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:19.903 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:19.903 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:19.903 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:19.903 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:19.903 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:19.903 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:19.903 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:19.903 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:19.903 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:19.903 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.903 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.903 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.903 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:19.903 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.903 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:19.904 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.904 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:19.904 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:19.904 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:19.904 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:19.904 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:19.904 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:19.904 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.904 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:19.904 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:19.904 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:19.904 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:19.904 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:19.904 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:19.904 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.904 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:19.905 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:19.905 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:19.905 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:19.905 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:19.905 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:19.905 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:19.905 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:19.905 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:19.905 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:19.905 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:19.905 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.905 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.905 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:19.905 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:19.905 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:19.905 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:19.906 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:19.906 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.906 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.906 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:19.906 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:19.906 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:19.906 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:19.906 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:19.906 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.906 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:19.906 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:19.906 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:19.906 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:19.906 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:19.906 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-364" 2023-12-03T13:00:19.907 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.907 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:19.907 INFO:teuthology.orchestra.run.smithi003.stdout:______________________ test_ranged_request_response_code _______________________ 2023-12-03T13:00:19.907 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.907 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.907 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.907 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:19.907 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:19.907 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.907 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:19.907 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.907 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:19.907 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:19.907 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:19.907 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.907 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:19.908 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:19.908 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.908 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.908 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:19.908 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:19.908 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.908 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.908 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:19.908 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.908 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:19.908 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:19.908 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.908 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.908 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:19.908 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:19.909 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.909 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:19.909 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:19.909 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:19.909 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:19.909 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:19.909 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.909 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:19.909 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.909 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:19.909 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:19.909 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:19.909 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:19.909 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:19.909 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:19.910 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:19.910 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:19.910 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.910 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.910 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:19.910 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:19.910 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:19.910 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:19.910 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.910 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:19.910 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:19.910 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:19.910 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:19.910 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.910 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.911 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:19.911 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:19.911 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:19.911 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:19.911 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.911 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.911 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:19.911 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:19.911 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:19.911 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.911 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:19.911 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.911 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:19.911 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:19.911 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.911 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:19.912 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:19.912 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:19.912 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:19.912 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:19.912 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:19.912 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.912 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:19.912 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.912 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:19.912 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.912 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.912 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:19.912 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.912 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:19.912 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.913 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:19.913 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:19.913 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:19.913 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:19.913 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:19.913 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:19.913 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.913 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:19.913 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:19.913 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:19.913 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:19.913 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:19.913 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:19.913 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.913 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:19.914 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:19.914 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:19.914 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:19.914 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:19.914 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:19.914 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:19.914 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:19.914 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:19.914 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:19.914 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:19.914 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.914 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.914 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:19.914 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.914 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:19.914 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:19.915 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:19.915 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:19.915 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:19.915 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:19.915 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:19.915 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:19.915 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:19.915 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:19.915 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:19.915 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:19.915 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:19.915 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:19.915 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:19.915 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:19.915 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:19.915 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:19.916 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:19.916 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:19.916 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:19.916 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:19.916 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:19.916 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:19.916 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:19.916 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:19.916 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:19.916 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:19.916 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.916 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.916 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.916 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.916 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:19.916 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:19.917 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.917 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:19.917 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.917 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:19.917 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:19.917 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:19.917 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.917 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:19.917 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:19.917 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.917 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.917 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:19.917 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:19.917 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.917 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.917 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:19.918 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:19.918 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:19.918 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:19.918 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:19.918 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.918 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.918 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:19.918 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:19.918 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:19.918 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.918 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:19.918 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.918 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:19.918 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.918 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:19.919 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.919 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T13:00:19.919 INFO:teuthology.orchestra.run.smithi003.stdout: def test_ranged_request_response_code(): 2023-12-03T13:00:19.919 INFO:teuthology.orchestra.run.smithi003.stdout: content = 'testcontent' 2023-12-03T13:00:19.919 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.919 INFO:teuthology.orchestra.run.smithi003.stdout:> bucket_name = get_new_bucket() 2023-12-03T13:00:19.919 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.919 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:7141: 2023-12-03T13:00:19.919 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.919 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:19.919 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:19.919 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:19.919 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:19.919 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:19.919 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:19.920 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:19.920 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:19.920 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:19.920 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:19.920 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:19.920 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:19.920 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:19.920 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:19.920 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:19.920 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:19.920 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:19.920 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:19.920 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:19.920 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:19.920 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:19.920 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:19.920 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:19.921 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:19.921 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:19.921 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:19.921 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:19.921 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:19.921 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:19.921 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:19.921 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:19.921 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:19.921 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:19.921 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:19.921 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:19.921 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:19.921 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.921 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.921 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.922 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:19.922 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.922 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:19.922 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.922 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:19.922 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:19.922 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:19.922 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:19.922 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:19.922 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:19.922 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.922 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:19.922 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:19.922 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:19.923 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:19.923 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:19.923 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:19.923 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.923 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:19.923 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:19.923 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:19.923 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:19.923 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:19.923 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:19.923 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:19.923 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:19.923 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:19.923 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:19.923 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:19.923 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.924 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.924 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:19.924 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:19.924 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:19.924 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:19.924 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:19.924 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.924 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.924 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:19.924 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:19.924 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:19.924 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:19.924 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:19.924 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.924 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:19.925 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:19.925 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:19.925 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:19.925 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:19.925 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-365" 2023-12-03T13:00:19.925 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.925 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:19.925 INFO:teuthology.orchestra.run.smithi003.stdout:____________________ test_ranged_big_request_response_code _____________________ 2023-12-03T13:00:19.925 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.925 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.925 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.925 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:19.925 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:19.925 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.925 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:19.925 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.926 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:19.926 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:19.926 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:19.926 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.926 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:19.926 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:19.926 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.926 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.926 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:19.926 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:19.926 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.926 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.926 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:19.926 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.927 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:19.927 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:19.927 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.927 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.927 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:19.927 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:19.927 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.927 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:19.927 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:19.927 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:19.927 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:19.927 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:19.927 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.927 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:19.927 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.927 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:19.928 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:19.928 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:19.928 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:19.928 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:19.928 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:19.928 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:19.928 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:19.928 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.928 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.928 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:19.928 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:19.928 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:19.928 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:19.928 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.928 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:19.928 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:19.928 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:19.929 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:19.929 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.929 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.929 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:19.929 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:19.929 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:19.929 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:19.929 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.929 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.929 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:19.929 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:19.929 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:19.929 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.929 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:19.929 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.929 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:19.930 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:19.930 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.930 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:19.930 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:19.930 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:19.930 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:19.930 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:19.930 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:19.930 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.930 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:19.930 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.930 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:19.930 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.930 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.930 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:19.931 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.931 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:19.931 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.931 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:19.931 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:19.931 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:19.931 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:19.931 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:19.931 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:19.931 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.931 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:19.931 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:19.931 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:19.931 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:19.931 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:19.932 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:19.932 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.932 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:19.932 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:19.932 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:19.932 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:19.932 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:19.932 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:19.932 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:19.932 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:19.932 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:19.932 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:19.932 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:19.932 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.932 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.932 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:19.933 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.933 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:19.933 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:19.933 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:19.933 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:19.933 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:19.933 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:19.933 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:19.933 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:19.933 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:19.933 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:19.933 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:19.933 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:19.933 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:19.933 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:19.933 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:19.934 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:19.934 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:19.934 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:19.934 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:19.934 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:19.934 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:19.934 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:19.934 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:19.934 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:19.934 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:19.934 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:19.934 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:19.934 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:19.934 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.934 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.935 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.935 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.935 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:19.935 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:19.935 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.935 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:19.935 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.935 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:19.935 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:19.935 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:19.935 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.935 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:19.935 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:19.935 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.935 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.935 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:19.936 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:19.936 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.936 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.936 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:19.936 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:19.936 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:19.936 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:19.936 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:19.936 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.936 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.936 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:19.936 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:19.936 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:19.936 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.936 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:19.936 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.937 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:19.937 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.937 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:19.937 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.937 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T13:00:19.937 INFO:teuthology.orchestra.run.smithi003.stdout: def test_ranged_big_request_response_code(): 2023-12-03T13:00:19.937 INFO:teuthology.orchestra.run.smithi003.stdout: content = _generate_random_string(8*1024*1024) 2023-12-03T13:00:19.937 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.937 INFO:teuthology.orchestra.run.smithi003.stdout:> bucket_name = get_new_bucket() 2023-12-03T13:00:19.937 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.937 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:7159: 2023-12-03T13:00:19.937 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.937 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:19.937 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:19.937 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:19.937 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:19.938 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:19.938 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:19.938 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:19.938 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:19.938 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:19.938 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:19.938 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:19.938 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:19.938 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:19.938 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:19.938 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:19.938 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:19.938 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:19.938 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:19.938 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:19.939 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:19.939 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:19.939 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:19.939 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:19.939 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:19.939 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:19.939 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:19.939 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:19.939 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:19.939 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:19.939 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:19.939 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:19.939 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:19.939 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:19.939 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:19.939 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:19.940 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:19.940 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.940 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.940 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.940 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:19.940 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.940 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:19.940 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.940 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:19.940 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:19.940 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:19.940 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:19.940 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:19.940 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:19.940 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.941 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:19.941 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:19.941 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:19.941 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:19.941 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:19.941 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:19.941 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.941 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:19.941 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:19.941 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:19.941 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:19.941 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:19.941 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:19.941 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:19.941 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:19.941 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:19.942 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:19.942 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:19.942 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.942 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.942 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:19.942 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:19.942 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:19.942 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:19.942 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:19.942 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.942 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.942 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:19.942 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:19.942 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:19.942 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:19.943 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:19.943 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.943 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:19.943 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:19.943 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:19.943 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:19.943 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:19.943 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-366" 2023-12-03T13:00:19.943 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.943 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:19.943 INFO:teuthology.orchestra.run.smithi003.stdout:_____________ test_ranged_request_skip_leading_bytes_response_code _____________ 2023-12-03T13:00:19.943 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.943 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.943 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.943 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:19.944 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:19.944 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.944 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:19.944 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.944 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:19.944 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:19.944 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:19.944 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.944 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:19.944 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:19.944 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.944 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.944 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:19.944 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:19.944 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.944 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.945 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:19.945 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.945 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:19.945 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:19.945 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.945 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.945 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:19.945 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:19.945 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.945 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:19.945 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:19.945 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:19.945 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:19.945 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:19.945 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.945 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:19.946 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.946 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:19.946 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:19.946 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:19.946 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:19.946 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:19.946 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:19.946 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:19.946 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:19.946 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.946 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.946 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:19.946 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:19.946 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:19.947 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:19.947 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.947 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:19.947 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:19.947 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:19.947 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:19.947 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.947 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.947 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:19.947 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:19.947 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:19.947 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:19.947 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.947 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.947 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:19.947 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:19.947 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:19.948 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.948 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:19.948 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.948 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:19.948 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:19.948 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.948 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:19.948 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:19.948 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:19.948 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:19.948 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:19.948 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:19.948 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.948 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:19.948 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.948 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:19.949 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.949 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.949 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:19.949 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.949 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:19.949 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.949 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:19.949 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:19.949 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:19.949 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:19.949 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:19.949 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:19.949 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.949 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:19.949 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:19.949 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:19.950 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:19.950 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:19.950 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:19.950 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.950 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:19.950 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:19.950 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:19.950 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:19.950 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:19.950 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:19.950 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:19.950 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:19.950 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:19.950 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:19.951 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:19.951 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.951 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.951 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:19.951 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.951 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:19.951 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:19.951 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:19.951 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:19.951 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:19.951 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:19.951 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:19.951 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:19.951 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:19.951 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:19.951 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:19.952 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:19.952 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:19.952 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:19.952 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:19.952 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:19.952 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:19.952 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:19.952 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:19.952 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:19.952 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:19.952 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:19.952 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:19.952 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:19.952 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:19.953 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:19.953 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:19.953 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:19.953 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.953 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.953 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.953 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.953 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:19.953 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:19.953 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.953 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:19.953 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.953 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:19.953 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:19.953 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:19.953 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.954 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:19.954 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:19.954 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.954 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.954 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:19.954 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:19.954 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.954 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.954 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:19.954 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:19.954 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:19.954 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:19.954 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:19.954 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.954 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.955 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:19.955 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:19.955 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:19.955 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.955 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:19.955 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.955 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:19.955 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.955 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:19.955 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.955 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T13:00:19.955 INFO:teuthology.orchestra.run.smithi003.stdout: def test_ranged_request_skip_leading_bytes_response_code(): 2023-12-03T13:00:19.955 INFO:teuthology.orchestra.run.smithi003.stdout: content = 'testcontent' 2023-12-03T13:00:19.955 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.955 INFO:teuthology.orchestra.run.smithi003.stdout:> bucket_name = get_new_bucket() 2023-12-03T13:00:19.955 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.956 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:7174: 2023-12-03T13:00:19.956 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.956 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:19.956 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:19.956 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:19.956 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:19.956 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:19.956 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:19.956 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:19.956 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:19.956 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:19.956 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:19.956 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:19.956 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:19.957 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:19.957 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:19.957 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:19.957 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:19.957 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:19.957 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:19.957 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:19.957 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:19.957 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:19.957 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:19.957 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:19.957 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:19.957 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:19.957 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:19.957 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:19.958 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:19.958 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:19.958 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:19.958 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:19.958 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:19.958 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:19.958 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:19.958 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:19.958 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:19.958 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.958 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.958 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.958 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:19.958 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.959 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:19.959 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.959 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:19.959 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:19.959 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:19.959 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:19.959 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:19.959 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:19.959 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.959 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:19.959 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:19.959 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:19.959 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:19.959 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:19.959 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:19.959 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.960 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:19.960 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:19.960 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:19.960 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:19.960 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:19.960 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:19.960 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:19.960 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:19.960 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:19.960 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:19.960 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:19.960 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.960 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.960 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:19.960 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:19.960 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:19.961 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:19.961 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:19.961 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.961 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.961 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:19.961 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:19.961 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:19.961 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:19.961 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:19.961 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.961 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:19.961 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:19.961 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:19.961 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:19.962 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:19.962 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-367" 2023-12-03T13:00:19.962 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.962 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:19.962 INFO:teuthology.orchestra.run.smithi003.stdout:___________ test_ranged_request_return_trailing_bytes_response_code ____________ 2023-12-03T13:00:19.962 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.962 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.962 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.962 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:19.962 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:19.962 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.962 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:19.962 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.962 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:19.962 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:19.963 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:19.963 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.963 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:19.963 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:19.963 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.963 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.963 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:19.963 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:19.963 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.963 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.963 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:19.963 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.963 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:19.963 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:19.963 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.963 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.964 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:19.964 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:19.964 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.964 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:19.964 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:19.964 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:19.964 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:19.964 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:19.964 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.964 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:19.964 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.964 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:19.964 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:19.964 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:19.964 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:19.964 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:19.965 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:19.965 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:19.965 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:19.965 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.965 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.965 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:19.965 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:19.965 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:19.965 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:19.965 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.965 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:19.965 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:19.965 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:19.965 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:19.965 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.966 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.966 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:19.966 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:19.966 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:19.966 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:19.966 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.966 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.966 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:19.966 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:19.966 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:19.966 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.966 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:19.966 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.966 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:19.967 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:19.967 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.967 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:19.967 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:19.967 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:19.967 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:19.967 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:19.967 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:19.967 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.967 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:19.967 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.967 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:19.967 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.967 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.967 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:19.967 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.968 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:19.968 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.968 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:19.968 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:19.968 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:19.968 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:19.968 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:19.968 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:19.968 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.968 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:19.968 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:19.968 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:19.968 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:19.968 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:19.969 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:19.969 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.969 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:19.969 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:19.969 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:19.969 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:19.969 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:19.969 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:19.969 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:19.969 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:19.969 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:19.969 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:19.969 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:19.969 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.969 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.969 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:19.970 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.970 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:19.970 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:19.970 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:19.970 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:19.970 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:19.970 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:19.970 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:19.970 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:19.970 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:19.970 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:19.970 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:19.970 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:19.970 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:19.970 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:19.970 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:19.971 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:19.971 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:19.971 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:19.971 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:19.971 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:19.971 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:19.971 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:19.971 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:19.971 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:19.971 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:19.971 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:19.971 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:19.971 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:19.971 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.972 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.972 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.972 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.972 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:19.972 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:19.972 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.972 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:19.972 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.972 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:19.972 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:19.972 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:19.972 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.972 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:19.972 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:19.972 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.973 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.973 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:19.973 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:19.973 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.973 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.973 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:19.973 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:19.973 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:19.973 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:19.973 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:19.973 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.973 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.973 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:19.973 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:19.973 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:19.973 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.974 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:19.974 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.974 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:19.974 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.974 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:19.974 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.974 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T13:00:19.974 INFO:teuthology.orchestra.run.smithi003.stdout: def test_ranged_request_return_trailing_bytes_response_code(): 2023-12-03T13:00:19.974 INFO:teuthology.orchestra.run.smithi003.stdout: content = 'testcontent' 2023-12-03T13:00:19.974 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.974 INFO:teuthology.orchestra.run.smithi003.stdout:> bucket_name = get_new_bucket() 2023-12-03T13:00:19.974 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.974 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:7189: 2023-12-03T13:00:19.974 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.974 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:19.974 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:19.975 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:19.975 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:19.975 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:19.975 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:19.975 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:19.975 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:19.975 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:19.975 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:19.975 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:19.975 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:19.975 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:19.975 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:19.975 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:19.975 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:19.975 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:19.975 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:19.976 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:19.976 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:19.976 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:19.976 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:19.976 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:19.976 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:19.976 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:19.976 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:19.976 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:19.976 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:19.976 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:19.976 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:19.976 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:19.976 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:19.976 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:19.976 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:19.977 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:19.977 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:19.977 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.977 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.977 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.977 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:19.977 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.977 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:19.977 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.977 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:19.977 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:19.977 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:19.977 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:19.977 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:19.977 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:19.977 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.978 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:19.978 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:19.978 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:19.978 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:19.978 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:19.978 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:19.978 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.978 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:19.978 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:19.978 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:19.978 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:19.978 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:19.978 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:19.978 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:19.979 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:19.979 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:19.979 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:19.979 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:19.979 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.979 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.979 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:19.979 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:19.979 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:19.979 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:19.979 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:19.979 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.979 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.979 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:19.979 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:19.980 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:19.980 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:19.980 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:19.980 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.980 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:19.980 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:19.980 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:19.980 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:19.980 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:19.980 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-368" 2023-12-03T13:00:19.980 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.980 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:19.980 INFO:teuthology.orchestra.run.smithi003.stdout:______________________ test_ranged_request_invalid_range _______________________ 2023-12-03T13:00:19.980 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.980 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.980 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.981 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:19.981 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:19.981 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.981 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:19.981 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.981 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:19.981 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:19.981 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:19.981 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.981 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:19.981 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:19.981 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.981 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.981 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:19.981 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:19.981 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.982 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.982 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:19.982 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.982 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:19.982 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:19.982 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.982 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.982 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:19.982 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:19.982 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.982 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:19.982 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:19.982 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:19.982 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:19.982 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:19.983 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.983 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:19.983 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.983 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:19.983 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:19.983 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:19.983 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:19.983 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:19.983 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:19.983 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:19.983 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:19.983 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.983 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.983 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:19.983 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:19.983 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:19.984 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:19.984 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.984 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:19.984 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:19.984 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:19.984 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:19.984 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.984 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.984 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:19.984 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:19.984 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:19.984 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:19.984 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.984 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.984 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:19.984 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:19.985 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:19.985 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.985 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:19.985 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.985 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:19.985 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:19.985 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.985 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:19.985 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:19.985 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:19.985 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:19.985 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:19.985 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:19.985 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.985 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:19.985 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.985 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:19.986 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.986 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.986 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:19.986 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.986 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:19.986 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.986 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:19.986 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:19.986 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:19.986 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:19.986 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:19.986 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:19.986 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.986 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:19.986 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:19.987 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:19.987 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:19.987 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:19.987 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:19.987 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.987 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:19.987 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:19.987 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:19.987 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:19.987 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:19.987 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:19.987 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:19.987 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:19.987 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:19.987 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:19.987 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:19.987 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.988 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.988 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:19.988 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.988 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:19.988 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:19.988 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:19.988 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:19.988 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:19.988 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:19.988 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:19.988 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:19.988 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:19.988 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:19.988 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:19.988 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:19.988 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:19.989 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:19.989 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:19.989 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:19.989 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:19.989 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:19.989 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:19.989 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:19.989 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:19.989 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:19.989 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:19.989 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:19.989 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:19.989 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:19.989 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:19.989 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:19.989 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.990 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.990 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.990 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.990 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:19.990 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:19.990 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.990 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:19.990 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.990 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:19.990 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:19.990 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:19.990 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.990 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:19.990 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:19.990 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.991 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.991 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:19.991 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:19.991 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.991 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.991 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:19.991 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:19.991 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:19.991 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:19.991 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:19.991 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.991 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.991 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:19.991 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:19.991 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:19.991 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.992 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:19.992 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.992 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:19.992 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.992 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:19.992 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.992 INFO:teuthology.orchestra.run.smithi003.stdout: def test_ranged_request_invalid_range(): 2023-12-03T13:00:19.992 INFO:teuthology.orchestra.run.smithi003.stdout: content = 'testcontent' 2023-12-03T13:00:19.992 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.992 INFO:teuthology.orchestra.run.smithi003.stdout:> bucket_name = get_new_bucket() 2023-12-03T13:00:19.992 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.992 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:7203: 2023-12-03T13:00:19.992 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.992 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:19.992 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:19.993 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:19.993 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:19.993 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:19.993 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:19.993 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:19.993 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:19.993 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:19.993 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:19.993 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:19.993 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:19.993 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:19.993 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:19.993 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:19.993 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:19.993 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:19.993 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:19.994 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:19.994 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:19.994 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:19.994 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:19.994 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:19.994 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:19.994 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:19.994 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:19.994 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:19.994 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:19.994 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:19.994 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:19.994 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:19.994 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:19.994 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:19.994 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:19.994 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:19.995 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:19.995 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.995 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.995 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.995 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:19.995 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.995 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:19.995 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.995 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:19.995 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:19.995 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:19.995 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:19.995 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:19.995 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:19.995 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:19.995 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:19.996 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:19.996 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:19.996 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:19.996 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:19.996 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:19.996 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.996 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:19.996 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:19.996 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:19.996 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:19.996 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:19.996 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:19.996 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:19.996 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:19.996 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:19.996 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:19.997 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:19.997 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.997 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.997 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:19.997 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:19.997 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:19.997 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:19.997 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:19.997 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.997 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.997 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:19.997 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:19.997 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:19.997 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:19.997 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:19.997 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.997 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:19.998 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:19.998 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:19.998 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:19.998 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:19.998 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-369" 2023-12-03T13:00:19.998 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.998 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:19.998 INFO:teuthology.orchestra.run.smithi003.stdout:_______________________ test_ranged_request_empty_object _______________________ 2023-12-03T13:00:19.998 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.998 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:19.998 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.998 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:19.998 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:19.998 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.998 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:19.998 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:19.999 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:19.999 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:19.999 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:19.999 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.999 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:19.999 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:19.999 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.999 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:19.999 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:19.999 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:19.999 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:19.999 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:19.999 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:19.999 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:19.999 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:20.000 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:20.000 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.000 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.000 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:20.000 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:20.000 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.000 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:20.000 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:20.000 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:20.000 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:20.000 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:20.000 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.000 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:20.000 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.000 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:20.001 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:20.001 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:20.001 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:20.001 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:20.001 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:20.001 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:20.001 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:20.001 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.001 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.001 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:20.001 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:20.001 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:20.001 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:20.001 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.001 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:20.002 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:20.002 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:20.002 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:20.002 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.002 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.002 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:20.002 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:20.002 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:20.002 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:20.002 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.002 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.002 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:20.002 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:20.002 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:20.002 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.002 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:20.003 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.003 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:20.003 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:20.003 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.003 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:20.003 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:20.003 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:20.003 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:20.003 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:20.003 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:20.003 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.003 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:20.003 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.003 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:20.003 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.003 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.004 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:20.004 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.004 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:20.004 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.004 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:20.004 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:20.004 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:20.004 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:20.004 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:20.004 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:20.004 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.004 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:20.004 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:20.004 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:20.004 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:20.004 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:20.005 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:20.005 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.005 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:20.005 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:20.005 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:20.005 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:20.005 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:20.005 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:20.005 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:20.005 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:20.005 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:20.005 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:20.005 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:20.005 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.005 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.005 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:20.005 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.006 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:20.006 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:20.006 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:20.006 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:20.006 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:20.006 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:20.006 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:20.006 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:20.006 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:20.006 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:20.006 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:20.006 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:20.006 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:20.006 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:20.006 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:20.007 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:20.007 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:20.007 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:20.007 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:20.007 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:20.007 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:20.007 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:20.007 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:20.007 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:20.007 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:20.007 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:20.007 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:20.007 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:20.007 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.007 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.008 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.008 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.008 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:20.008 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:20.008 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.008 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:20.008 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.008 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:20.008 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:20.008 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:20.008 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.008 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:20.008 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:20.008 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.008 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.008 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:20.009 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:20.009 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.009 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.009 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:20.009 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:20.009 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:20.009 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:20.009 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:20.009 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.009 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.009 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:20.009 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:20.009 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:20.009 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.009 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:20.009 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.010 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:20.010 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.010 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:20.010 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.010 INFO:teuthology.orchestra.run.smithi003.stdout: def test_ranged_request_empty_object(): 2023-12-03T13:00:20.010 INFO:teuthology.orchestra.run.smithi003.stdout: content = '' 2023-12-03T13:00:20.010 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.010 INFO:teuthology.orchestra.run.smithi003.stdout:> bucket_name = get_new_bucket() 2023-12-03T13:00:20.010 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.010 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:7217: 2023-12-03T13:00:20.010 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.010 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:20.010 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:20.010 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:20.010 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:20.011 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:20.011 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:20.011 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:20.011 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:20.011 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:20.011 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:20.011 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:20.011 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:20.011 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:20.011 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:20.011 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:20.011 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:20.011 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:20.011 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:20.011 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:20.012 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:20.012 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:20.012 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:20.012 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:20.012 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:20.012 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:20.012 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:20.012 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:20.012 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:20.012 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:20.012 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:20.012 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:20.012 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:20.012 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:20.012 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:20.012 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:20.013 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:20.013 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.013 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.013 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.013 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:20.013 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.013 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:20.013 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.013 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:20.013 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:20.013 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:20.013 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:20.013 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:20.013 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:20.013 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.014 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:20.014 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:20.014 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:20.014 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:20.014 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:20.014 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:20.014 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.014 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:20.014 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:20.014 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:20.014 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:20.014 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:20.014 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:20.014 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:20.014 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:20.015 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:20.015 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:20.015 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:20.015 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.015 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.015 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:20.015 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:20.015 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:20.015 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:20.015 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:20.015 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.015 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.015 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:20.015 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:20.015 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:20.016 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:20.016 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:20.016 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.016 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:20.016 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:20.016 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:20.016 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:20.016 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:20.016 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-370" 2023-12-03T13:00:20.016 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.016 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:20.016 INFO:teuthology.orchestra.run.smithi003.stdout:____________________ test_versioning_bucket_create_suspend _____________________ 2023-12-03T13:00:20.016 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.016 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.016 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.017 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:20.017 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:20.017 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.017 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:20.017 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.017 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:20.017 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:20.017 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:20.017 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.017 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:20.017 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:20.017 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.017 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.017 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:20.018 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:20.018 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.018 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.018 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:20.018 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.018 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:20.018 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:20.018 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.018 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.018 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:20.018 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:20.018 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.018 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:20.018 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:20.018 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:20.019 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:20.019 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:20.019 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.019 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:20.019 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.019 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:20.019 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:20.019 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:20.019 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:20.019 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:20.019 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:20.019 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:20.019 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:20.019 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.020 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.020 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:20.020 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:20.020 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:20.020 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:20.020 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.020 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:20.020 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:20.020 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:20.020 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:20.020 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.020 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.020 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:20.020 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:20.020 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:20.021 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:20.021 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.021 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.021 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:20.021 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:20.021 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:20.021 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.021 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:20.021 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.021 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:20.021 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:20.021 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.021 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:20.022 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:20.022 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:20.022 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:20.022 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:20.022 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:20.022 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.022 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:20.022 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.022 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:20.022 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.022 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.022 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:20.022 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.022 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:20.022 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.023 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:20.023 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:20.023 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:20.023 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:20.023 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:20.023 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:20.023 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.023 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:20.023 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:20.023 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:20.023 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:20.023 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:20.023 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:20.023 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.023 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:20.024 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:20.024 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:20.024 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:20.024 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:20.024 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:20.024 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:20.024 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:20.024 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:20.024 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:20.024 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:20.024 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.024 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.024 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:20.024 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.024 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:20.025 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:20.025 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:20.025 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:20.025 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:20.025 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:20.025 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:20.025 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:20.025 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:20.025 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:20.025 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:20.025 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:20.025 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:20.025 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:20.025 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:20.025 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:20.025 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:20.026 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:20.026 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:20.026 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:20.026 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:20.026 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:20.026 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:20.026 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:20.026 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:20.026 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:20.026 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:20.026 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:20.026 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.026 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.026 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.026 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.026 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:20.027 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:20.027 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.027 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:20.027 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.027 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:20.027 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:20.027 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:20.027 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.027 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:20.027 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:20.027 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.027 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.027 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:20.027 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:20.027 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.028 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.028 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:20.028 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:20.028 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:20.028 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:20.028 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:20.028 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.028 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.028 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:20.028 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:20.028 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:20.028 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.028 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:20.028 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.029 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:20.029 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.029 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:20.029 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.029 INFO:teuthology.orchestra.run.smithi003.stdout: def test_versioning_bucket_create_suspend(): 2023-12-03T13:00:20.029 INFO:teuthology.orchestra.run.smithi003.stdout:> bucket_name = get_new_bucket() 2023-12-03T13:00:20.029 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.029 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:7229: 2023-12-03T13:00:20.029 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.029 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:20.029 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:20.029 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:20.029 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:20.029 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:20.029 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:20.029 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:20.030 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:20.030 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:20.030 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:20.030 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:20.030 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:20.030 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:20.030 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:20.030 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:20.030 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:20.030 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:20.030 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:20.030 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:20.030 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:20.030 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:20.030 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:20.030 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:20.031 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:20.031 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:20.031 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:20.031 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:20.031 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:20.031 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:20.031 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:20.031 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:20.031 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:20.031 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:20.031 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:20.031 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:20.031 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:20.031 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.032 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.032 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.032 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:20.032 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.032 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:20.032 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.032 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:20.032 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:20.032 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:20.032 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:20.032 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:20.032 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:20.032 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.032 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:20.032 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:20.033 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:20.033 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:20.033 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:20.033 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:20.033 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.033 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:20.033 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:20.033 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:20.033 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:20.033 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:20.033 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:20.033 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:20.033 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:20.033 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:20.033 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:20.034 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:20.034 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.034 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.034 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:20.034 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:20.034 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:20.034 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:20.034 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:20.034 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.034 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.034 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:20.034 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:20.034 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:20.034 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:20.034 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:20.035 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.035 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:20.035 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:20.035 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:20.035 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:20.035 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:20.035 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-371" 2023-12-03T13:00:20.035 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.035 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:20.035 INFO:teuthology.orchestra.run.smithi003.stdout:____________________ test_versioning_obj_create_read_remove ____________________ 2023-12-03T13:00:20.035 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.035 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.035 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.035 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:20.035 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:20.036 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.036 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:20.036 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.036 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:20.036 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:20.036 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:20.036 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.036 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:20.036 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:20.036 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.036 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.036 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:20.036 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:20.036 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.036 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.037 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:20.037 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.037 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:20.037 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:20.037 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.037 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.037 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:20.037 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:20.037 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.037 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:20.037 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:20.037 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:20.037 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:20.037 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:20.037 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.037 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:20.038 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.038 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:20.038 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:20.038 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:20.038 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:20.038 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:20.038 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:20.038 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:20.038 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:20.038 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.038 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.038 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:20.038 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:20.038 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:20.039 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:20.039 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.039 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:20.039 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:20.039 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:20.039 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:20.039 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.039 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.039 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:20.039 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:20.039 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:20.039 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:20.039 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.039 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.040 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:20.040 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:20.040 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:20.040 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.040 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:20.040 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.040 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:20.040 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:20.040 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.040 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:20.040 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:20.040 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:20.040 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:20.040 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:20.040 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:20.040 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.041 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:20.041 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.041 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:20.041 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.041 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.041 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:20.041 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.041 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:20.041 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.041 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:20.041 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:20.041 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:20.041 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:20.041 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:20.042 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:20.042 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.042 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:20.042 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:20.042 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:20.042 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:20.042 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:20.042 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:20.042 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.042 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:20.042 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:20.042 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:20.042 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:20.042 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:20.042 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:20.043 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:20.043 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:20.043 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:20.043 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:20.043 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:20.043 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.043 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.043 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:20.043 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.043 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:20.043 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:20.043 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:20.043 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:20.043 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:20.043 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:20.044 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:20.044 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:20.044 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:20.044 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:20.044 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:20.044 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:20.044 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:20.044 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:20.044 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:20.044 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:20.044 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:20.044 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:20.044 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:20.044 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:20.044 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:20.044 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:20.044 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:20.045 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:20.045 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:20.045 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:20.045 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:20.045 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:20.045 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.045 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.045 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.045 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.045 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:20.045 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:20.045 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.045 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:20.045 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.045 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:20.045 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:20.046 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:20.046 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.046 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:20.046 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:20.046 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.046 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.046 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:20.046 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:20.046 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.046 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.046 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:20.046 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:20.046 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:20.046 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:20.047 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:20.047 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.047 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.047 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:20.047 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:20.047 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:20.047 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.047 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:20.047 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.047 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:20.047 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.047 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:20.047 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.047 INFO:teuthology.orchestra.run.smithi003.stdout: def test_versioning_obj_create_read_remove(): 2023-12-03T13:00:20.047 INFO:teuthology.orchestra.run.smithi003.stdout:> bucket_name = get_new_bucket() 2023-12-03T13:00:20.047 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.048 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:7312: 2023-12-03T13:00:20.048 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.048 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:20.048 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:20.048 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:20.048 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:20.048 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:20.048 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:20.048 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:20.048 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:20.048 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:20.048 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:20.048 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:20.048 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:20.048 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:20.048 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:20.049 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:20.049 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:20.049 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:20.049 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:20.049 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:20.049 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:20.049 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:20.049 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:20.049 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:20.049 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:20.049 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:20.049 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:20.049 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:20.049 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:20.049 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:20.050 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:20.050 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:20.050 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:20.050 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:20.050 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:20.050 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:20.050 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:20.050 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.050 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.050 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.050 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:20.050 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.050 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:20.050 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.051 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:20.051 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:20.051 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:20.051 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:20.051 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:20.051 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:20.051 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.051 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:20.051 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:20.051 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:20.051 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:20.051 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:20.051 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:20.051 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.052 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:20.052 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:20.052 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:20.052 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:20.052 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:20.052 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:20.052 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:20.052 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:20.052 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:20.052 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:20.052 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:20.052 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.052 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.052 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:20.052 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:20.052 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:20.053 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:20.053 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:20.053 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.053 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.053 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:20.053 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:20.053 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:20.053 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:20.053 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:20.053 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.053 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:20.053 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:20.053 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:20.053 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:20.053 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:20.053 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-372" 2023-12-03T13:00:20.054 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.054 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:20.054 INFO:teuthology.orchestra.run.smithi003.stdout:_________________ test_versioning_obj_create_read_remove_head __________________ 2023-12-03T13:00:20.054 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.054 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.054 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.054 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:20.054 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:20.054 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.054 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:20.054 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.054 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:20.054 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:20.054 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:20.054 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.055 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:20.055 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:20.055 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.055 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.055 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:20.055 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:20.055 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.055 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.055 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:20.055 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.055 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:20.055 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:20.055 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.055 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.055 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:20.055 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:20.055 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.056 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:20.056 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:20.056 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:20.056 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:20.056 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:20.056 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.056 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:20.056 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.056 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:20.056 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:20.056 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:20.056 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:20.056 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:20.056 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:20.056 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:20.056 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:20.057 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.057 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.057 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:20.057 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:20.057 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:20.057 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:20.057 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.057 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:20.057 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:20.057 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:20.057 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:20.057 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.057 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.057 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:20.057 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:20.058 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:20.058 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:20.058 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.058 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.058 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:20.058 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:20.058 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:20.058 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.058 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:20.058 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.058 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:20.058 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:20.058 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.058 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:20.058 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:20.059 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:20.059 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:20.059 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:20.059 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:20.059 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.059 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:20.059 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.059 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:20.059 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.059 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.059 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:20.059 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.059 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:20.059 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.059 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:20.059 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:20.060 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:20.060 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:20.060 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:20.060 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:20.060 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.060 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:20.060 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:20.060 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:20.060 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:20.060 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:20.060 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:20.060 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.060 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:20.060 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:20.060 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:20.060 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:20.061 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:20.061 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:20.061 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:20.061 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:20.061 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:20.061 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:20.061 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:20.061 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.061 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.061 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:20.061 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.061 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:20.061 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:20.061 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:20.061 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:20.062 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:20.062 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:20.062 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:20.062 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:20.062 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:20.062 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:20.062 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:20.062 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:20.062 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:20.062 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:20.062 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:20.062 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:20.062 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:20.062 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:20.062 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:20.062 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:20.063 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:20.063 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:20.063 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:20.063 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:20.063 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:20.063 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:20.063 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:20.063 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:20.063 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.063 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.063 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.063 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.063 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:20.063 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:20.063 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.064 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:20.064 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.064 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:20.064 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:20.064 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:20.064 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.064 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:20.064 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:20.064 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.064 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.064 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:20.064 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:20.064 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.064 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.064 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:20.064 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:20.065 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:20.065 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:20.065 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:20.065 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.065 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.065 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:20.065 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:20.065 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:20.065 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.065 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:20.065 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.065 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:20.065 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.065 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:20.065 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.066 INFO:teuthology.orchestra.run.smithi003.stdout: def test_versioning_obj_create_read_remove_head(): 2023-12-03T13:00:20.066 INFO:teuthology.orchestra.run.smithi003.stdout:> bucket_name = get_new_bucket() 2023-12-03T13:00:20.066 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.066 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:7326: 2023-12-03T13:00:20.066 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.066 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:20.066 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:20.066 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:20.066 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:20.066 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:20.066 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:20.066 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:20.066 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:20.066 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:20.066 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:20.066 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:20.067 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:20.067 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:20.067 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:20.067 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:20.067 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:20.067 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:20.067 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:20.067 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:20.067 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:20.067 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:20.067 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:20.067 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:20.067 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:20.067 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:20.067 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:20.067 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:20.067 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:20.068 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:20.068 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:20.068 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:20.068 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:20.068 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:20.068 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:20.068 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:20.068 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:20.068 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.068 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.068 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.068 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:20.068 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.068 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:20.068 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.069 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:20.069 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:20.069 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:20.069 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:20.069 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:20.069 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:20.069 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.069 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:20.069 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:20.069 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:20.069 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:20.069 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:20.069 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:20.069 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.069 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:20.069 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:20.070 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:20.070 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:20.070 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:20.070 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:20.070 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:20.070 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:20.070 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:20.070 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:20.070 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:20.070 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.070 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.070 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:20.070 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:20.070 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:20.070 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:20.070 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:20.071 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.071 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.071 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:20.071 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:20.071 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:20.071 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:20.071 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:20.071 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.071 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:20.071 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:20.071 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:20.071 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:20.071 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:20.071 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-373" 2023-12-03T13:00:20.071 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.072 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:20.072 INFO:teuthology.orchestra.run.smithi003.stdout:________________ test_versioning_obj_plain_null_version_removal ________________ 2023-12-03T13:00:20.072 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.072 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.072 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.072 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:20.072 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:20.072 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.072 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:20.072 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.072 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:20.072 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:20.072 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:20.072 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.072 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:20.072 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:20.073 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.073 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.073 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:20.073 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:20.073 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.073 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.073 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:20.073 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.073 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:20.073 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:20.073 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.073 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.073 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:20.073 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:20.073 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.073 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:20.074 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:20.074 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:20.074 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:20.074 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:20.074 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.074 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:20.074 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.074 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:20.074 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:20.074 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:20.074 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:20.074 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:20.074 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:20.074 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:20.074 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:20.075 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.075 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.075 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:20.075 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:20.075 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:20.075 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:20.075 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.075 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:20.075 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:20.075 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:20.075 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:20.075 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.075 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.075 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:20.075 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:20.075 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:20.075 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:20.076 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.076 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.076 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:20.076 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:20.076 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:20.076 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.076 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:20.076 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.076 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:20.076 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:20.076 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.076 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:20.076 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:20.076 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:20.076 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:20.076 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:20.076 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:20.077 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.077 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:20.077 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.077 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:20.077 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.077 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.077 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:20.077 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.077 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:20.077 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.077 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:20.077 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:20.077 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:20.077 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:20.077 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:20.077 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:20.078 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.078 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:20.078 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:20.078 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:20.078 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:20.078 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:20.078 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:20.078 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.078 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:20.078 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:20.078 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:20.078 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:20.078 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:20.078 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:20.078 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:20.079 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:20.079 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:20.079 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:20.079 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:20.079 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.079 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.079 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:20.079 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.079 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:20.079 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:20.079 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:20.079 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:20.079 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:20.079 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:20.079 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:20.079 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:20.080 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:20.080 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:20.080 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:20.080 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:20.080 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:20.080 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:20.080 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:20.080 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:20.080 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:20.080 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:20.080 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:20.080 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:20.080 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:20.080 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:20.080 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:20.080 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:20.081 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:20.081 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:20.081 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:20.081 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:20.081 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.081 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.081 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.081 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.081 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:20.081 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:20.081 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.081 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:20.081 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.081 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:20.081 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:20.081 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:20.082 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.082 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:20.082 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:20.082 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.082 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.082 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:20.082 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:20.082 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.082 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.082 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:20.082 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:20.082 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:20.082 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:20.082 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:20.082 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.082 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.083 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:20.083 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:20.083 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:20.083 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.083 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:20.083 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.083 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:20.083 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.083 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:20.083 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.083 INFO:teuthology.orchestra.run.smithi003.stdout: def test_versioning_obj_plain_null_version_removal(): 2023-12-03T13:00:20.083 INFO:teuthology.orchestra.run.smithi003.stdout:> bucket_name = get_new_bucket() 2023-12-03T13:00:20.083 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.083 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:7360: 2023-12-03T13:00:20.083 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.083 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:20.084 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:20.084 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:20.084 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:20.084 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:20.084 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:20.084 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:20.084 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:20.084 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:20.084 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:20.084 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:20.084 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:20.084 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:20.084 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:20.084 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:20.084 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:20.084 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:20.084 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:20.085 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:20.085 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:20.085 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:20.085 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:20.085 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:20.085 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:20.085 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:20.085 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:20.085 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:20.085 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:20.085 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:20.085 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:20.085 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:20.085 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:20.085 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:20.086 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:20.086 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:20.086 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:20.086 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.086 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.086 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.086 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:20.086 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.086 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:20.086 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.086 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:20.086 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:20.086 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:20.086 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:20.086 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:20.086 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:20.087 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.087 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:20.087 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:20.087 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:20.087 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:20.087 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:20.087 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:20.087 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.087 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:20.087 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:20.087 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:20.087 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:20.087 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:20.087 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:20.087 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:20.087 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:20.087 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:20.088 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:20.088 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:20.088 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.088 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.088 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:20.088 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:20.088 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:20.088 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:20.088 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:20.088 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.088 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.088 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:20.088 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:20.088 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:20.088 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:20.088 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:20.089 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.089 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:20.089 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:20.089 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:20.089 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:20.089 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:20.089 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-374" 2023-12-03T13:00:20.089 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.089 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:20.089 INFO:teuthology.orchestra.run.smithi003.stdout:_______________ test_versioning_obj_plain_null_version_overwrite _______________ 2023-12-03T13:00:20.089 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.089 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.089 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.089 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:20.089 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:20.089 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.090 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:20.090 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.090 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:20.090 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:20.090 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:20.090 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.090 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:20.090 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:20.090 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.090 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.090 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:20.090 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:20.090 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.090 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.090 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:20.091 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.091 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:20.091 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:20.091 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.091 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.091 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:20.091 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:20.091 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.091 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:20.091 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:20.091 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:20.091 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:20.091 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:20.091 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.091 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:20.092 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.092 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:20.092 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:20.092 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:20.092 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:20.092 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:20.092 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:20.092 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:20.092 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:20.092 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.092 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.092 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:20.092 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:20.092 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:20.092 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:20.092 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.092 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:20.093 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:20.093 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:20.093 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:20.093 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.093 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.093 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:20.093 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:20.093 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:20.093 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:20.093 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.093 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.093 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:20.093 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:20.093 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:20.093 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.093 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:20.094 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.094 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:20.094 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:20.094 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.094 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:20.094 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:20.094 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:20.094 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:20.094 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:20.094 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:20.094 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.094 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:20.094 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.094 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:20.094 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.094 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.095 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:20.095 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.095 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:20.095 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.095 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:20.095 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:20.095 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:20.095 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:20.095 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:20.095 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:20.095 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.095 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:20.095 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:20.095 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:20.095 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:20.095 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:20.095 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:20.096 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.096 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:20.096 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:20.096 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:20.096 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:20.096 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:20.096 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:20.096 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:20.096 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:20.096 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:20.096 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:20.096 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:20.096 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.096 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.096 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:20.096 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.097 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:20.097 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:20.097 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:20.097 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:20.097 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:20.097 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:20.097 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:20.097 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:20.097 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:20.097 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:20.097 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:20.097 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:20.097 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:20.097 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:20.097 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:20.097 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:20.097 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:20.098 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:20.098 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:20.098 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:20.098 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:20.098 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:20.098 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:20.098 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:20.098 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:20.098 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:20.098 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:20.098 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:20.098 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.098 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.098 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.098 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.098 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:20.099 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:20.099 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.099 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:20.099 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.099 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:20.099 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:20.102 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:20.102 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.102 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:20.102 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:20.102 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.102 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.103 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:20.103 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:20.103 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.103 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.103 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:20.103 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:20.103 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:20.103 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:20.103 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:20.103 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.103 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.103 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:20.103 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:20.103 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:20.103 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.103 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:20.104 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.104 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:20.104 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.104 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:20.104 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.104 INFO:teuthology.orchestra.run.smithi003.stdout: def test_versioning_obj_plain_null_version_overwrite(): 2023-12-03T13:00:20.104 INFO:teuthology.orchestra.run.smithi003.stdout:> bucket_name = get_new_bucket() 2023-12-03T13:00:20.104 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.104 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:7380: 2023-12-03T13:00:20.104 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.104 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:20.104 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:20.104 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:20.104 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:20.104 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:20.105 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:20.105 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:20.105 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:20.105 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:20.105 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:20.105 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:20.105 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:20.105 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:20.105 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:20.105 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:20.105 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:20.105 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:20.105 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:20.105 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:20.105 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:20.105 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:20.106 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:20.106 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:20.106 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:20.106 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:20.106 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:20.106 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:20.106 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:20.106 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:20.106 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:20.106 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:20.106 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:20.106 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:20.106 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:20.106 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:20.106 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:20.107 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.107 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.107 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.107 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:20.107 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.107 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:20.107 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.107 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:20.107 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:20.107 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:20.107 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:20.107 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:20.107 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:20.107 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.107 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:20.108 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:20.108 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:20.108 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:20.108 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:20.108 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:20.108 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.108 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:20.108 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:20.108 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:20.108 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:20.108 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:20.108 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:20.108 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:20.108 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:20.108 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:20.108 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:20.109 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:20.109 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.109 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.109 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:20.109 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:20.109 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:20.109 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:20.109 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:20.109 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.109 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.109 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:20.109 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:20.109 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:20.109 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:20.109 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:20.109 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.110 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:20.110 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:20.110 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:20.110 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:20.110 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:20.110 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-375" 2023-12-03T13:00:20.110 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.110 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:20.110 INFO:teuthology.orchestra.run.smithi003.stdout:__________ test_versioning_obj_plain_null_version_overwrite_suspended __________ 2023-12-03T13:00:20.110 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.110 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.110 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.110 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:20.110 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:20.110 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.111 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:20.111 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.111 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:20.111 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:20.111 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:20.111 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.111 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:20.111 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:20.111 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.111 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.111 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:20.111 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:20.111 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.111 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.111 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:20.112 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.112 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:20.112 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:20.112 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.112 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.112 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:20.112 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:20.112 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.112 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:20.112 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:20.112 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:20.112 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:20.112 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:20.112 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.112 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:20.112 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.113 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:20.113 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:20.113 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:20.113 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:20.113 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:20.113 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:20.113 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:20.113 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:20.113 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.113 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.113 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:20.113 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:20.113 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:20.113 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:20.113 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.114 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:20.114 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:20.114 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:20.114 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:20.114 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.114 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.114 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:20.114 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:20.114 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:20.114 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:20.114 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.114 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.114 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:20.114 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:20.114 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:20.115 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.115 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:20.115 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.115 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:20.115 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:20.115 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.115 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:20.115 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:20.115 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:20.115 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:20.115 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:20.115 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:20.115 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.115 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:20.115 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.115 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:20.116 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.116 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.116 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:20.116 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.116 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:20.116 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.116 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:20.116 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:20.116 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:20.116 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:20.116 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:20.116 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:20.116 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.116 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:20.116 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:20.116 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:20.116 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:20.117 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:20.117 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:20.117 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.117 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:20.117 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:20.117 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:20.117 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:20.117 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:20.117 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:20.117 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:20.117 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:20.117 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:20.117 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:20.117 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:20.117 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.118 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.118 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:20.118 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.118 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:20.118 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:20.118 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:20.118 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:20.118 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:20.118 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:20.118 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:20.118 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:20.118 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:20.118 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:20.118 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:20.118 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:20.119 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:20.119 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:20.119 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:20.119 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:20.119 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:20.119 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:20.119 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:20.119 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:20.119 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:20.119 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:20.119 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:20.119 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:20.119 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:20.119 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:20.119 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:20.119 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:20.119 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.120 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.120 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.120 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.120 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:20.120 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:20.120 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.120 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:20.120 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.120 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:20.120 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:20.120 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:20.120 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.120 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:20.120 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:20.120 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.120 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.120 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:20.121 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:20.121 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.121 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.121 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:20.121 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:20.121 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:20.121 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:20.121 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:20.121 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.121 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.121 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:20.121 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:20.121 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:20.121 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.122 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:20.122 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.122 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:20.122 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.122 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:20.122 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.122 INFO:teuthology.orchestra.run.smithi003.stdout: def test_versioning_obj_plain_null_version_overwrite_suspended(): 2023-12-03T13:00:20.122 INFO:teuthology.orchestra.run.smithi003.stdout:> bucket_name = get_new_bucket() 2023-12-03T13:00:20.122 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.122 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:7413: 2023-12-03T13:00:20.122 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.122 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:20.122 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:20.122 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:20.122 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:20.123 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:20.123 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:20.123 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:20.123 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:20.123 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:20.123 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:20.123 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:20.123 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:20.123 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:20.123 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:20.123 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:20.123 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:20.123 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:20.123 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:20.123 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:20.124 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:20.124 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:20.124 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:20.124 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:20.124 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:20.124 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:20.124 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:20.124 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:20.124 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:20.124 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:20.124 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:20.124 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:20.124 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:20.124 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:20.124 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:20.125 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:20.125 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:20.125 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.125 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.125 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.125 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:20.125 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.125 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:20.125 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.125 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:20.125 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:20.125 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:20.125 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:20.125 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:20.125 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:20.126 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.126 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:20.126 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:20.126 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:20.126 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:20.126 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:20.126 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:20.126 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.126 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:20.126 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:20.126 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:20.126 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:20.126 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:20.126 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:20.126 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:20.127 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:20.127 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:20.127 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:20.127 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:20.127 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.127 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.127 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:20.127 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:20.127 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:20.127 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:20.127 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:20.127 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.127 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.127 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:20.128 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:20.128 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:20.128 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:20.128 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:20.128 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.128 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:20.128 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:20.128 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:20.128 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:20.128 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:20.128 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-376" 2023-12-03T13:00:20.128 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.128 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:20.128 INFO:teuthology.orchestra.run.smithi003.stdout:_____________________ test_versioning_obj_suspend_versions _____________________ 2023-12-03T13:00:20.128 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.129 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.129 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.129 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:20.129 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:20.129 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.129 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:20.129 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.129 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:20.129 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:20.129 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:20.129 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.129 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:20.129 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:20.129 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.129 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.129 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:20.130 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:20.130 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.130 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.130 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:20.130 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.130 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:20.130 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:20.130 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.130 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.130 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:20.130 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:20.130 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.130 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:20.130 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:20.130 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:20.131 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:20.131 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:20.131 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.131 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:20.131 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.131 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:20.131 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:20.131 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:20.131 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:20.131 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:20.131 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:20.131 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:20.131 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:20.131 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.131 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.132 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:20.132 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:20.132 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:20.132 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:20.132 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.132 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:20.132 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:20.132 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:20.132 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:20.132 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.132 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.132 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:20.132 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:20.132 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:20.132 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:20.132 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.133 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.133 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:20.133 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:20.133 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:20.133 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.133 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:20.133 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.133 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:20.133 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:20.133 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.133 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:20.133 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:20.133 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:20.133 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:20.133 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:20.133 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:20.133 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.134 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:20.134 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.134 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:20.134 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.134 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.134 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:20.134 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.134 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:20.134 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.134 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:20.134 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:20.134 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:20.134 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:20.134 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:20.134 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:20.135 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.135 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:20.135 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:20.135 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:20.135 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:20.135 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:20.135 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:20.135 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.135 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:20.135 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:20.135 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:20.135 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:20.135 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:20.135 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:20.135 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:20.135 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:20.136 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:20.136 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:20.136 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:20.136 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.136 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.136 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:20.136 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.136 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:20.136 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:20.136 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:20.136 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:20.136 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:20.136 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:20.136 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:20.136 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:20.136 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:20.137 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:20.137 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:20.137 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:20.137 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:20.137 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:20.137 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:20.137 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:20.137 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:20.137 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:20.137 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:20.137 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:20.137 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:20.137 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:20.137 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:20.137 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:20.138 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:20.138 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:20.138 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:20.138 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:20.138 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.138 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.138 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.138 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.138 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:20.138 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:20.138 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.138 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:20.138 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.138 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:20.138 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:20.138 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:20.139 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.139 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:20.139 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:20.139 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.139 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.139 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:20.139 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:20.139 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.139 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.139 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:20.139 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:20.139 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:20.139 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:20.139 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:20.140 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.140 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.140 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:20.140 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:20.140 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:20.140 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.140 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:20.140 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.140 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:20.140 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.140 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:20.140 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.140 INFO:teuthology.orchestra.run.smithi003.stdout: def test_versioning_obj_suspend_versions(): 2023-12-03T13:00:20.140 INFO:teuthology.orchestra.run.smithi003.stdout:> bucket_name = get_new_bucket() 2023-12-03T13:00:20.141 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.141 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:7478: 2023-12-03T13:00:20.141 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.141 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:20.141 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:20.141 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:20.141 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:20.141 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:20.141 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:20.141 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:20.141 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:20.141 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:20.141 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:20.141 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:20.141 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:20.142 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:20.142 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:20.142 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:20.142 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:20.142 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:20.142 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:20.142 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:20.142 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:20.142 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:20.142 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:20.142 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:20.142 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:20.142 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:20.142 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:20.143 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:20.143 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:20.143 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:20.143 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:20.143 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:20.143 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:20.143 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:20.143 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:20.143 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:20.143 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:20.143 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.143 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.143 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.143 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:20.143 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.144 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:20.144 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.144 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:20.144 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:20.144 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:20.144 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:20.144 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:20.144 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:20.144 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.144 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:20.144 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:20.144 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:20.144 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:20.144 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:20.144 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:20.144 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.144 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:20.145 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:20.145 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:20.145 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:20.145 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:20.145 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:20.145 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:20.145 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:20.145 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:20.145 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:20.145 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:20.145 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.145 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.145 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:20.145 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:20.145 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:20.145 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:20.146 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:20.146 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.146 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.146 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:20.146 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:20.146 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:20.146 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:20.146 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:20.146 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.146 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:20.146 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:20.146 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:20.146 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:20.146 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:20.147 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-377" 2023-12-03T13:00:20.147 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.147 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:20.147 INFO:teuthology.orchestra.run.smithi003.stdout:________________ test_versioning_obj_create_versions_remove_all ________________ 2023-12-03T13:00:20.147 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.147 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.147 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.147 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:20.147 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:20.147 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.147 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:20.147 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.147 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:20.147 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:20.147 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:20.147 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.147 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:20.148 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:20.148 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.148 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.148 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:20.148 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:20.148 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.148 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.148 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:20.148 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.148 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:20.148 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:20.148 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.148 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.148 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:20.148 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:20.148 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.149 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:20.149 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:20.149 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:20.149 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:20.149 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:20.149 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.149 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:20.149 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.149 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:20.149 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:20.149 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:20.149 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:20.149 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:20.149 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:20.149 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:20.150 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:20.150 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.150 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.150 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:20.150 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:20.150 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:20.150 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:20.150 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.150 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:20.150 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:20.150 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:20.150 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:20.150 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.150 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.150 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:20.151 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:20.151 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:20.151 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:20.151 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.151 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.151 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:20.151 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:20.151 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:20.151 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.151 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:20.151 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.151 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:20.151 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:20.151 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.151 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:20.151 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:20.152 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:20.152 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:20.152 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:20.152 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:20.152 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.152 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:20.152 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.152 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:20.152 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.152 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.152 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:20.152 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.152 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:20.152 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.152 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:20.152 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:20.153 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:20.153 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:20.153 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:20.153 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:20.153 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.153 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:20.153 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:20.153 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:20.153 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:20.153 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:20.153 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:20.153 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.153 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:20.153 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:20.154 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:20.154 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:20.154 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:20.154 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:20.154 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:20.154 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:20.154 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:20.154 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:20.154 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:20.154 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.154 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.154 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:20.154 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.154 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:20.154 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:20.155 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:20.155 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:20.155 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:20.155 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:20.155 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:20.155 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:20.155 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:20.155 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:20.155 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:20.155 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:20.155 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:20.155 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:20.155 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:20.155 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:20.155 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:20.155 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:20.155 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:20.156 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:20.156 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:20.156 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:20.156 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:20.156 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:20.156 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:20.156 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:20.156 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:20.156 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:20.156 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.156 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.156 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.156 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.156 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:20.156 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:20.157 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.157 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:20.157 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.157 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:20.157 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:20.157 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:20.157 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.157 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:20.157 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:20.157 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.157 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.157 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:20.157 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:20.157 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.157 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.157 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:20.158 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:20.158 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:20.158 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:20.158 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:20.158 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.158 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.158 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:20.158 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:20.158 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:20.158 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.158 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:20.158 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.158 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:20.158 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.158 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:20.159 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.159 INFO:teuthology.orchestra.run.smithi003.stdout: def test_versioning_obj_create_versions_remove_all(): 2023-12-03T13:00:20.159 INFO:teuthology.orchestra.run.smithi003.stdout:> bucket_name = get_new_bucket() 2023-12-03T13:00:20.159 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.159 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:7510: 2023-12-03T13:00:20.159 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.159 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:20.159 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:20.159 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:20.159 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:20.159 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:20.159 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:20.159 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:20.159 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:20.159 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:20.159 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:20.160 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:20.160 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:20.160 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:20.160 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:20.160 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:20.160 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:20.160 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:20.160 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:20.160 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:20.160 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:20.160 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:20.160 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:20.160 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:20.160 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:20.160 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:20.160 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:20.161 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:20.161 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:20.161 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:20.161 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:20.161 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:20.161 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:20.161 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:20.161 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:20.161 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:20.161 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:20.161 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.161 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.161 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.161 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:20.161 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.162 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:20.162 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.162 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:20.162 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:20.162 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:20.162 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:20.162 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:20.162 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:20.162 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.162 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:20.162 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:20.162 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:20.162 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:20.162 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:20.162 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:20.163 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.163 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:20.163 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:20.163 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:20.163 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:20.163 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:20.163 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:20.163 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:20.163 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:20.163 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:20.163 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:20.163 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:20.163 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.163 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.163 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:20.164 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:20.164 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:20.164 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:20.164 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:20.164 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.164 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.164 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:20.164 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:20.164 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:20.164 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:20.164 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:20.164 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.164 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:20.164 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:20.164 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:20.164 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:20.164 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:20.165 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-378" 2023-12-03T13:00:20.165 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.165 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:20.165 INFO:teuthology.orchestra.run.smithi003.stdout:___________ test_versioning_obj_create_versions_remove_special_names ___________ 2023-12-03T13:00:20.165 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.165 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.165 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.165 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:20.165 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:20.165 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.165 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:20.165 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.165 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:20.165 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:20.165 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:20.165 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.166 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:20.166 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:20.166 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.166 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.166 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:20.166 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:20.166 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.166 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.166 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:20.166 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.166 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:20.166 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:20.166 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.166 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.167 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:20.167 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:20.167 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.167 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:20.167 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:20.167 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:20.167 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:20.167 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:20.167 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.167 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:20.167 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.167 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:20.167 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:20.167 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:20.167 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:20.167 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:20.167 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:20.168 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:20.168 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:20.168 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.168 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.168 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:20.168 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:20.168 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:20.168 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:20.168 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.168 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:20.168 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:20.168 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:20.168 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:20.168 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.168 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.168 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:20.169 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:20.169 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:20.169 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:20.169 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.169 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.169 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:20.169 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:20.169 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:20.169 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.169 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:20.169 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.169 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:20.169 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:20.169 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.170 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:20.170 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:20.170 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:20.170 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:20.170 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:20.170 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:20.170 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.170 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:20.170 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.170 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:20.170 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.170 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.170 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:20.170 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.171 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:20.171 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.171 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:20.171 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:20.171 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:20.171 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:20.171 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:20.171 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:20.171 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.171 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:20.171 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:20.171 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:20.171 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:20.171 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:20.171 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:20.171 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.172 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:20.172 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:20.172 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:20.172 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:20.172 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:20.172 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:20.172 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:20.172 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:20.172 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:20.172 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:20.172 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:20.172 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.172 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.172 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:20.172 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.173 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:20.173 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:20.173 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:20.173 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:20.173 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:20.173 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:20.173 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:20.173 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:20.173 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:20.173 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:20.173 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:20.173 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:20.173 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:20.173 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:20.173 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:20.173 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:20.173 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:20.174 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:20.174 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:20.174 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:20.174 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:20.174 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:20.174 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:20.174 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:20.174 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:20.174 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:20.174 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:20.174 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:20.174 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.174 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.174 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.174 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.174 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:20.175 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:20.175 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.175 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:20.175 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.175 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:20.175 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:20.175 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:20.175 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.175 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:20.175 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:20.175 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.175 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.175 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:20.175 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:20.175 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.175 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.175 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:20.176 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:20.176 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:20.176 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:20.176 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:20.176 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.176 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.176 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:20.176 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:20.176 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:20.176 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.176 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:20.176 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.176 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:20.176 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.176 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:20.176 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.177 INFO:teuthology.orchestra.run.smithi003.stdout: def test_versioning_obj_create_versions_remove_special_names(): 2023-12-03T13:00:20.177 INFO:teuthology.orchestra.run.smithi003.stdout:> bucket_name = get_new_bucket() 2023-12-03T13:00:20.177 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.177 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:7526: 2023-12-03T13:00:20.177 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.177 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:20.177 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:20.177 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:20.177 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:20.177 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:20.177 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:20.177 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:20.177 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:20.177 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:20.177 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:20.177 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:20.178 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:20.178 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:20.178 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:20.178 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:20.178 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:20.178 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:20.178 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:20.178 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:20.178 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:20.178 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:20.178 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:20.178 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:20.178 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:20.178 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:20.178 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:20.179 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:20.179 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:20.179 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:20.179 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:20.179 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:20.179 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:20.179 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:20.179 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:20.179 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:20.179 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:20.179 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.179 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.179 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.179 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:20.179 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.180 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:20.180 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.180 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:20.180 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:20.180 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:20.180 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:20.180 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:20.180 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:20.180 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.180 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:20.180 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:20.180 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:20.180 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:20.180 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:20.181 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:20.181 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.181 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:20.181 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:20.181 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:20.181 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:20.181 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:20.181 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:20.181 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:20.181 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:20.181 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:20.181 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:20.181 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:20.181 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.182 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.182 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:20.182 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:20.182 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:20.182 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:20.182 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:20.182 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.182 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.182 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:20.182 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:20.182 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:20.182 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:20.182 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:20.182 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.183 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:20.183 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:20.183 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:20.183 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:20.183 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:20.183 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-379" 2023-12-03T13:00:20.183 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.183 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:20.183 INFO:teuthology.orchestra.run.smithi003.stdout:________________ test_versioning_obj_create_overwrite_multipart ________________ 2023-12-03T13:00:20.183 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.183 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.183 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.183 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:20.183 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:20.183 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.184 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:20.184 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.184 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:20.184 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:20.184 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:20.184 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.184 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:20.184 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:20.184 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.184 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.184 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:20.184 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:20.184 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.184 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.184 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:20.184 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.184 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:20.185 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:20.185 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.185 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.185 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:20.185 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:20.185 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.185 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:20.185 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:20.185 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:20.185 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:20.185 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:20.185 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.185 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:20.185 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.185 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:20.185 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:20.186 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:20.186 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:20.186 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:20.186 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:20.186 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:20.186 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:20.186 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.186 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.186 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:20.186 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:20.186 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:20.186 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:20.186 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.186 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:20.186 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:20.186 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:20.187 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:20.187 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.187 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.187 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:20.187 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:20.187 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:20.187 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:20.187 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.187 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.187 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:20.187 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:20.187 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:20.187 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.187 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:20.187 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.187 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:20.188 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:20.188 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.188 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:20.188 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:20.188 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:20.188 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:20.188 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:20.188 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:20.188 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.188 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:20.188 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.188 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:20.188 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.188 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.188 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:20.188 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.188 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:20.189 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.189 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:20.189 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:20.189 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:20.189 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:20.189 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:20.189 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:20.189 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.189 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:20.189 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:20.189 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:20.189 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:20.189 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:20.189 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:20.189 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.189 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:20.190 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:20.190 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:20.190 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:20.190 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:20.190 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:20.190 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:20.190 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:20.190 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:20.190 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:20.190 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:20.190 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.190 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.190 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:20.190 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.190 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:20.191 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:20.191 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:20.191 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:20.191 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:20.191 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:20.191 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:20.191 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:20.191 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:20.191 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:20.191 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:20.191 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:20.191 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:20.191 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:20.191 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:20.191 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:20.192 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:20.192 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:20.192 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:20.192 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:20.192 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:20.192 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:20.192 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:20.192 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:20.192 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:20.192 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:20.192 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:20.192 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:20.192 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.192 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.192 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.192 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.193 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:20.193 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:20.193 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.193 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:20.193 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.193 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:20.193 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:20.193 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:20.193 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.193 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:20.193 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:20.193 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.193 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.193 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:20.193 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:20.194 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.194 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.194 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:20.194 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:20.194 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:20.194 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:20.194 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:20.194 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.194 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.194 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:20.194 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:20.194 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:20.194 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.194 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:20.194 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.195 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:20.195 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.195 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:20.195 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.195 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T13:00:20.195 INFO:teuthology.orchestra.run.smithi003.stdout: def test_versioning_obj_create_overwrite_multipart(): 2023-12-03T13:00:20.195 INFO:teuthology.orchestra.run.smithi003.stdout:> bucket_name = get_new_bucket() 2023-12-03T13:00:20.195 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.195 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:7544: 2023-12-03T13:00:20.195 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.195 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:20.195 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:20.195 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:20.195 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:20.195 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:20.195 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:20.195 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:20.196 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:20.196 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:20.196 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:20.196 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:20.196 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:20.196 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:20.196 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:20.196 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:20.196 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:20.196 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:20.196 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:20.196 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:20.196 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:20.196 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:20.196 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:20.196 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:20.197 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:20.197 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:20.197 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:20.197 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:20.197 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:20.197 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:20.197 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:20.197 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:20.197 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:20.197 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:20.197 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:20.197 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:20.197 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:20.197 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.197 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.197 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.198 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:20.198 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.198 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:20.198 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.198 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:20.198 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:20.198 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:20.198 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:20.198 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:20.198 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:20.198 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.198 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:20.198 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:20.198 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:20.198 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:20.198 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:20.199 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:20.199 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.199 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:20.199 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:20.199 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:20.199 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:20.199 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:20.199 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:20.199 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:20.199 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:20.199 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:20.199 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:20.199 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:20.199 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.199 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.199 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:20.200 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:20.200 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:20.200 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:20.200 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:20.200 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.200 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.200 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:20.200 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:20.200 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:20.200 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:20.200 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:20.200 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.200 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:20.200 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:20.200 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:20.201 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:20.201 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:20.201 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-380" 2023-12-03T13:00:20.201 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.201 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:20.201 INFO:teuthology.orchestra.run.smithi003.stdout:_______________________ test_versioning_obj_list_marker ________________________ 2023-12-03T13:00:20.201 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.201 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.201 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.201 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:20.201 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:20.201 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.201 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:20.201 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.201 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:20.202 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:20.202 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:20.202 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.202 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:20.202 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:20.202 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.202 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.202 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:20.202 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:20.202 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.202 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.202 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:20.202 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.202 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:20.202 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:20.203 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.203 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.203 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:20.203 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:20.203 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.203 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:20.203 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:20.203 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:20.203 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:20.203 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:20.203 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.203 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:20.203 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.203 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:20.203 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:20.203 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:20.204 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:20.204 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:20.204 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:20.204 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:20.204 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:20.204 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.204 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.204 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:20.204 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:20.204 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:20.204 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:20.204 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.204 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:20.204 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:20.205 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:20.205 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:20.205 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.205 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.205 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:20.205 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:20.205 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:20.205 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:20.205 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.205 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.205 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:20.205 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:20.205 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:20.205 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.205 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:20.205 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.205 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:20.206 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:20.206 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.206 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:20.206 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:20.206 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:20.206 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:20.206 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:20.206 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:20.206 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.206 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:20.206 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.206 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:20.206 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.206 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.206 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:20.206 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.207 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:20.207 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.207 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:20.207 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:20.207 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:20.207 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:20.207 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:20.207 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:20.207 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.207 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:20.207 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:20.207 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:20.207 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:20.207 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:20.207 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:20.207 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.208 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:20.208 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:20.208 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:20.208 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:20.208 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:20.208 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:20.208 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:20.208 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:20.208 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:20.208 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:20.208 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:20.208 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.208 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.208 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:20.208 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.208 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:20.209 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:20.209 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:20.209 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:20.209 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:20.209 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:20.209 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:20.209 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:20.209 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:20.209 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:20.209 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:20.209 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:20.209 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:20.209 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:20.209 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:20.210 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:20.210 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:20.210 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:20.210 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:20.210 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:20.210 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:20.210 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:20.210 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:20.210 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:20.210 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:20.210 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:20.210 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:20.210 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:20.210 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.210 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.211 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.211 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.211 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:20.211 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:20.211 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.211 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:20.211 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.211 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:20.211 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:20.211 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:20.211 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.211 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:20.211 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:20.211 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.211 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.212 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:20.212 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:20.212 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.212 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.212 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:20.212 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:20.212 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:20.212 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:20.212 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:20.212 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.212 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.212 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:20.212 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:20.212 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:20.212 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.212 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:20.212 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.213 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:20.213 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.213 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:20.213 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.213 INFO:teuthology.orchestra.run.smithi003.stdout: def test_versioning_obj_list_marker(): 2023-12-03T13:00:20.213 INFO:teuthology.orchestra.run.smithi003.stdout:> bucket_name = get_new_bucket() 2023-12-03T13:00:20.213 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.213 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:7572: 2023-12-03T13:00:20.213 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.213 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:20.213 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:20.213 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:20.213 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:20.213 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:20.213 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:20.213 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:20.214 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:20.214 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:20.214 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:20.214 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:20.214 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:20.214 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:20.214 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:20.214 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:20.214 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:20.214 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:20.214 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:20.214 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:20.214 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:20.214 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:20.214 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:20.215 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:20.215 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:20.215 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:20.215 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:20.215 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:20.215 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:20.215 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:20.215 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:20.215 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:20.215 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:20.215 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:20.215 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:20.215 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:20.215 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:20.215 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.216 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.216 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.216 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:20.216 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.216 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:20.216 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.216 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:20.216 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:20.216 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:20.216 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:20.216 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:20.216 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:20.216 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.216 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:20.216 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:20.216 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:20.216 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:20.217 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:20.217 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:20.217 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.217 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:20.217 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:20.217 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:20.217 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:20.217 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:20.217 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:20.217 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:20.217 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:20.217 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:20.217 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:20.217 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:20.217 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.217 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.218 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:20.218 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:20.218 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:20.218 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:20.218 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:20.218 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.218 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.218 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:20.218 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:20.218 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:20.218 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:20.218 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:20.218 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.218 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:20.218 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:20.219 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:20.219 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:20.219 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:20.219 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-381" 2023-12-03T13:00:20.219 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.219 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:20.219 INFO:teuthology.orchestra.run.smithi003.stdout:_______________________ test_versioning_copy_obj_version _______________________ 2023-12-03T13:00:20.219 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.219 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.219 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.219 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:20.219 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:20.219 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.219 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:20.219 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.219 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:20.220 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:20.220 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:20.220 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.220 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:20.220 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:20.220 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.220 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.220 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:20.220 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:20.220 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.220 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.220 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:20.220 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.220 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:20.220 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:20.220 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.220 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.221 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:20.221 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:20.221 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.221 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:20.221 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:20.221 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:20.221 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:20.221 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:20.221 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.221 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:20.221 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.221 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:20.221 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:20.221 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:20.221 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:20.222 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:20.222 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:20.222 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:20.222 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:20.222 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.222 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.222 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:20.222 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:20.222 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:20.222 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:20.222 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.222 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:20.222 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:20.222 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:20.223 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:20.223 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.223 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.223 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:20.223 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:20.223 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:20.223 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:20.223 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.223 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.223 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:20.223 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:20.223 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:20.223 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.223 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:20.223 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.223 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:20.223 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:20.224 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.224 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:20.224 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:20.224 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:20.224 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:20.224 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:20.224 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:20.224 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.224 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:20.224 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.224 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:20.224 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.224 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.224 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:20.224 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.224 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:20.225 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.225 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:20.225 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:20.225 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:20.225 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:20.225 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:20.225 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:20.225 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.225 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:20.225 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:20.225 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:20.225 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:20.225 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:20.225 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:20.225 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.225 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:20.226 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:20.226 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:20.226 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:20.226 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:20.226 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:20.226 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:20.226 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:20.226 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:20.226 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:20.226 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:20.226 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.226 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.226 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:20.226 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.227 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:20.227 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:20.227 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:20.227 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:20.227 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:20.227 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:20.227 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:20.227 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:20.227 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:20.227 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:20.227 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:20.227 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:20.227 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:20.227 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:20.227 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:20.227 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:20.227 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:20.228 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:20.228 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:20.228 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:20.228 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:20.228 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:20.228 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:20.228 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:20.228 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:20.228 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:20.228 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:20.228 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:20.228 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.228 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.228 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.228 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.228 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:20.229 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:20.229 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.229 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:20.229 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.229 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:20.229 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:20.229 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:20.229 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.229 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:20.229 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:20.229 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.229 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.229 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:20.229 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:20.229 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.229 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.230 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:20.230 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:20.230 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:20.230 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:20.230 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:20.230 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.230 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.230 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:20.230 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:20.230 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:20.230 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.230 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:20.230 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.230 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:20.231 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.231 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:20.231 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.231 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T13:00:20.231 INFO:teuthology.orchestra.run.smithi003.stdout: def test_versioning_copy_obj_version(): 2023-12-03T13:00:20.231 INFO:teuthology.orchestra.run.smithi003.stdout:> bucket_name = get_new_bucket() 2023-12-03T13:00:20.231 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.231 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:7628: 2023-12-03T13:00:20.231 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.231 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:20.231 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:20.231 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:20.231 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:20.231 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:20.231 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:20.231 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:20.232 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:20.232 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:20.232 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:20.232 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:20.232 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:20.232 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:20.232 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:20.232 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:20.232 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:20.232 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:20.232 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:20.232 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:20.232 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:20.232 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:20.232 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:20.233 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:20.233 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:20.233 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:20.233 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:20.233 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:20.233 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:20.233 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:20.233 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:20.233 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:20.233 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:20.233 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:20.233 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:20.233 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:20.233 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:20.233 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.233 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.234 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.234 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:20.234 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.234 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:20.234 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.234 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:20.234 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:20.234 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:20.234 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:20.234 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:20.234 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:20.234 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.234 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:20.234 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:20.234 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:20.235 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:20.235 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:20.235 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:20.235 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.235 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:20.235 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:20.235 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:20.235 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:20.235 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:20.235 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:20.235 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:20.235 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:20.235 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:20.235 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:20.235 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:20.235 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.235 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.236 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:20.236 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:20.236 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:20.236 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:20.236 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:20.236 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.236 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.236 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:20.236 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:20.236 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:20.236 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:20.236 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:20.236 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.236 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:20.236 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:20.237 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:20.237 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:20.237 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:20.237 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-382" 2023-12-03T13:00:20.237 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.237 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:20.237 INFO:teuthology.orchestra.run.smithi003.stdout:_____________________ test_versioning_multi_object_delete ______________________ 2023-12-03T13:00:20.237 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.237 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.237 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.237 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:20.237 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:20.237 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.237 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:20.237 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.238 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:20.238 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:20.238 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:20.238 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.238 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:20.238 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:20.238 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.238 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.238 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:20.238 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:20.238 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.238 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.238 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:20.238 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.238 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:20.238 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:20.239 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.239 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.239 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:20.239 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:20.239 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.239 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:20.239 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:20.239 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:20.239 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:20.239 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:20.239 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.239 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:20.239 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.239 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:20.239 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:20.239 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:20.240 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:20.240 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:20.240 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:20.240 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:20.240 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:20.240 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.240 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.240 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:20.240 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:20.240 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:20.240 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:20.240 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.240 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:20.240 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:20.240 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:20.240 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:20.241 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.241 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.241 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:20.241 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:20.241 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:20.241 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:20.241 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.241 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.241 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:20.241 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:20.241 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:20.241 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.241 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:20.241 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.241 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:20.242 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:20.242 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.242 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:20.242 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:20.242 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:20.242 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:20.242 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:20.242 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:20.242 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.242 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:20.242 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.242 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:20.242 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.242 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.242 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:20.243 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.243 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:20.243 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.243 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:20.243 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:20.243 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:20.243 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:20.243 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:20.243 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:20.243 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.243 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:20.243 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:20.243 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:20.243 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:20.243 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:20.243 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:20.243 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.244 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:20.244 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:20.244 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:20.244 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:20.244 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:20.244 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:20.244 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:20.244 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:20.244 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:20.244 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:20.244 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:20.244 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.244 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.244 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:20.244 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.244 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:20.245 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:20.245 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:20.245 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:20.245 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:20.245 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:20.245 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:20.245 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:20.245 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:20.245 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:20.245 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:20.245 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:20.245 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:20.245 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:20.245 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:20.245 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:20.245 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:20.245 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:20.246 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:20.246 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:20.246 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:20.246 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:20.246 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:20.246 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:20.246 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:20.246 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:20.246 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:20.246 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:20.246 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.246 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.246 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.246 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.246 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:20.247 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:20.247 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.247 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:20.247 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.247 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:20.247 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:20.247 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:20.247 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.247 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:20.247 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:20.247 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.247 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.247 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:20.247 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:20.247 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.247 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.248 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:20.248 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:20.248 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:20.248 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:20.248 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:20.248 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.248 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.248 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:20.248 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:20.248 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:20.248 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.248 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:20.248 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.248 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:20.248 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.248 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:20.249 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.249 INFO:teuthology.orchestra.run.smithi003.stdout: def test_versioning_multi_object_delete(): 2023-12-03T13:00:20.249 INFO:teuthology.orchestra.run.smithi003.stdout:> bucket_name = get_new_bucket() 2023-12-03T13:00:20.249 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.249 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:7665: 2023-12-03T13:00:20.249 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.249 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:20.249 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:20.249 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:20.249 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:20.249 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:20.249 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:20.249 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:20.249 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:20.249 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:20.249 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:20.249 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:20.250 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:20.250 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:20.250 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:20.250 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:20.250 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:20.250 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:20.250 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:20.250 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:20.250 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:20.250 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:20.250 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:20.250 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:20.250 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:20.250 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:20.250 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:20.251 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:20.251 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:20.251 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:20.251 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:20.251 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:20.251 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:20.251 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:20.251 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:20.251 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:20.251 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:20.251 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.251 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.251 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.251 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:20.252 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.252 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:20.252 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.252 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:20.252 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:20.252 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:20.252 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:20.252 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:20.252 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:20.252 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.252 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:20.252 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:20.252 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:20.252 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:20.252 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:20.252 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:20.253 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.253 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:20.253 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:20.253 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:20.253 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:20.253 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:20.253 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:20.253 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:20.253 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:20.253 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:20.253 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:20.253 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:20.253 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.253 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.253 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:20.253 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:20.254 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:20.254 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:20.254 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:20.254 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.254 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.254 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:20.254 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:20.254 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:20.254 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:20.254 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:20.254 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.254 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:20.254 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:20.254 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:20.254 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:20.255 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:20.255 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-383" 2023-12-03T13:00:20.255 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.255 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:20.255 INFO:teuthology.orchestra.run.smithi003.stdout:_______________ test_versioning_multi_object_delete_with_marker ________________ 2023-12-03T13:00:20.255 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.255 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.255 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.255 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:20.255 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:20.255 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.255 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:20.255 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.255 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:20.255 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:20.255 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:20.255 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.256 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:20.256 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:20.256 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.256 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.256 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:20.256 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:20.256 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.256 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.256 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:20.256 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.256 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:20.256 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:20.256 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.256 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.256 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:20.256 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:20.256 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.257 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:20.257 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:20.257 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:20.257 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:20.257 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:20.257 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.257 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:20.257 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.257 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:20.257 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:20.257 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:20.257 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:20.257 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:20.257 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:20.257 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:20.257 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:20.258 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.258 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.258 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:20.258 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:20.258 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:20.258 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:20.258 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.258 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:20.258 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:20.258 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:20.258 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:20.258 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.258 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.258 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:20.259 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:20.259 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:20.259 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:20.259 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.259 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.259 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:20.259 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:20.259 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:20.259 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.259 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:20.259 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.259 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:20.259 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:20.259 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.259 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:20.259 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:20.260 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:20.260 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:20.260 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:20.260 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:20.260 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.260 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:20.260 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.260 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:20.260 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.260 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.260 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:20.260 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.260 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:20.260 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.260 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:20.260 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:20.260 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:20.261 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:20.261 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:20.261 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:20.261 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.261 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:20.261 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:20.261 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:20.261 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:20.261 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:20.261 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:20.261 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.261 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:20.261 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:20.261 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:20.261 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:20.262 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:20.262 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:20.262 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:20.262 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:20.262 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:20.262 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:20.262 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:20.262 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.262 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.262 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:20.262 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.262 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:20.262 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:20.262 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:20.262 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:20.263 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:20.263 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:20.263 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:20.263 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:20.263 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:20.263 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:20.263 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:20.263 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:20.263 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:20.263 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:20.263 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:20.263 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:20.263 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:20.263 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:20.263 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:20.263 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:20.264 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:20.264 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:20.264 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:20.264 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:20.264 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:20.264 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:20.264 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:20.264 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:20.264 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.264 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.264 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.264 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.264 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:20.264 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:20.264 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.264 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:20.264 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.265 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:20.265 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:20.265 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:20.265 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.265 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:20.265 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:20.265 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.265 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.265 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:20.265 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:20.265 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.265 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.265 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:20.265 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:20.265 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:20.265 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:20.266 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:20.266 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.266 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.266 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:20.266 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:20.266 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:20.266 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.266 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:20.266 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.266 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:20.266 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.266 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:20.266 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.266 INFO:teuthology.orchestra.run.smithi003.stdout: def test_versioning_multi_object_delete_with_marker(): 2023-12-03T13:00:20.266 INFO:teuthology.orchestra.run.smithi003.stdout:> bucket_name = get_new_bucket() 2023-12-03T13:00:20.267 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.267 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:7690: 2023-12-03T13:00:20.267 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.267 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:20.267 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:20.267 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:20.267 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:20.267 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:20.267 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:20.267 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:20.267 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:20.267 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:20.267 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:20.267 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:20.267 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:20.267 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:20.268 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:20.268 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:20.268 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:20.268 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:20.268 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:20.268 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:20.268 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:20.268 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:20.268 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:20.268 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:20.268 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:20.268 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:20.268 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:20.268 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:20.268 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:20.268 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:20.269 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:20.269 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:20.269 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:20.269 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:20.269 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:20.269 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:20.269 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:20.269 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.269 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.269 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.269 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:20.269 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.269 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:20.269 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.270 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:20.270 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:20.270 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:20.270 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:20.270 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:20.270 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:20.270 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.270 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:20.270 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:20.270 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:20.270 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:20.270 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:20.270 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:20.270 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.270 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:20.271 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:20.271 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:20.271 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:20.271 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:20.271 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:20.271 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:20.271 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:20.271 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:20.271 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:20.271 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:20.271 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.271 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.271 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:20.271 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:20.271 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:20.271 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:20.272 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:20.272 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.272 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.272 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:20.272 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:20.272 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:20.272 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:20.272 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:20.272 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.272 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:20.272 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:20.272 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:20.272 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:20.272 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:20.272 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-384" 2023-12-03T13:00:20.273 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.273 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:20.273 INFO:teuthology.orchestra.run.smithi003.stdout:____________ test_versioning_multi_object_delete_with_marker_create ____________ 2023-12-03T13:00:20.273 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.273 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.273 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.273 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:20.273 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:20.273 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.273 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:20.273 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.273 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:20.273 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:20.273 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:20.273 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.273 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:20.273 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:20.274 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.274 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.274 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:20.274 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:20.274 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.274 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.274 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:20.274 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.274 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:20.274 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:20.274 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.274 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.274 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:20.274 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:20.274 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.275 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:20.275 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:20.275 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:20.275 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:20.275 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:20.275 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.275 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:20.275 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.275 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:20.275 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:20.275 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:20.275 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:20.275 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:20.275 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:20.275 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:20.275 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:20.275 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.276 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.276 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:20.276 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:20.276 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:20.276 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:20.276 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.276 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:20.276 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:20.276 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:20.276 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:20.276 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.276 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.276 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:20.276 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:20.276 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:20.276 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:20.277 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.277 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.277 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:20.277 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:20.277 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:20.277 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.277 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:20.277 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.277 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:20.277 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:20.277 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.277 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:20.277 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:20.277 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:20.277 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:20.277 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:20.278 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:20.278 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.278 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:20.278 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.278 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:20.278 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.278 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.278 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:20.278 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.278 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:20.278 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.278 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:20.278 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:20.278 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:20.278 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:20.278 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:20.279 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:20.279 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.279 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:20.279 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:20.279 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:20.279 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:20.279 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:20.279 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:20.279 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.279 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:20.279 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:20.279 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:20.279 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:20.279 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:20.279 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:20.279 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:20.280 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:20.280 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:20.280 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:20.280 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:20.280 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.280 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.280 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:20.280 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.280 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:20.280 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:20.280 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:20.280 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:20.280 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:20.280 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:20.280 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:20.280 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:20.281 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:20.281 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:20.281 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:20.281 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:20.281 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:20.281 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:20.281 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:20.281 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:20.281 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:20.281 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:20.281 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:20.281 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:20.281 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:20.281 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:20.281 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:20.282 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:20.282 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:20.282 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:20.282 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:20.282 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:20.282 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.282 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.282 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.282 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.282 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:20.282 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:20.282 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.282 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:20.282 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.283 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:20.283 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:20.283 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:20.283 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.283 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:20.283 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:20.283 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.283 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.283 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:20.283 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:20.283 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.283 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.283 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:20.283 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:20.283 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:20.283 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:20.284 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:20.284 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.284 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.284 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:20.284 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:20.284 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:20.284 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.284 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:20.284 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.284 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:20.284 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.284 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:20.284 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.284 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T13:00:20.284 INFO:teuthology.orchestra.run.smithi003.stdout: def test_versioning_multi_object_delete_with_marker_create(): 2023-12-03T13:00:20.284 INFO:teuthology.orchestra.run.smithi003.stdout:> bucket_name = get_new_bucket() 2023-12-03T13:00:20.284 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.285 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:7723: 2023-12-03T13:00:20.285 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.285 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:20.285 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:20.285 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:20.285 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:20.285 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:20.285 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:20.285 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:20.285 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:20.285 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:20.285 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:20.285 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:20.285 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:20.286 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:20.286 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:20.286 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:20.286 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:20.286 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:20.286 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:20.286 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:20.286 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:20.286 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:20.286 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:20.286 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:20.286 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:20.286 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:20.286 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:20.286 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:20.287 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:20.287 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:20.287 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:20.287 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:20.287 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:20.287 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:20.287 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:20.287 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:20.287 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:20.287 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.287 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.287 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.287 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:20.287 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.287 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:20.287 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.288 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:20.288 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:20.288 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:20.288 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:20.288 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:20.288 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:20.288 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.288 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:20.288 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:20.288 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:20.288 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:20.288 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:20.288 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:20.288 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.288 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:20.288 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:20.289 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:20.289 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:20.289 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:20.289 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:20.289 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:20.289 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:20.289 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:20.289 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:20.289 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:20.289 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.289 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.289 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:20.289 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:20.289 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:20.289 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:20.289 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:20.289 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.290 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.290 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:20.290 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:20.290 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:20.290 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:20.290 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:20.290 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.290 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:20.290 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:20.290 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:20.290 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:20.290 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:20.290 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-385" 2023-12-03T13:00:20.290 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.291 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:20.291 INFO:teuthology.orchestra.run.smithi003.stdout:__________________________ test_versioned_object_acl ___________________________ 2023-12-03T13:00:20.291 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.291 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.291 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.291 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:20.291 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:20.291 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.291 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:20.291 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.291 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:20.291 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:20.291 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:20.291 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.291 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:20.291 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:20.292 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.292 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.292 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:20.292 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:20.292 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.292 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.292 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:20.292 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.292 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:20.292 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:20.292 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.292 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.292 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:20.292 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:20.292 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.292 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:20.293 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:20.293 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:20.293 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:20.293 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:20.293 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.293 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:20.293 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.293 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:20.293 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:20.293 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:20.293 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:20.293 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:20.293 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:20.293 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:20.293 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:20.293 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.294 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.294 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:20.294 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:20.294 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:20.294 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:20.294 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.294 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:20.294 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:20.294 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:20.294 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:20.294 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.294 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.294 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:20.294 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:20.295 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:20.295 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:20.295 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.295 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.295 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:20.295 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:20.295 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:20.295 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.295 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:20.295 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.295 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:20.295 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:20.295 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.295 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:20.295 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:20.296 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:20.296 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:20.296 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:20.296 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:20.296 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.296 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:20.296 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.296 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:20.296 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.296 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.296 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:20.296 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.296 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:20.297 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.297 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:20.297 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:20.297 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:20.297 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:20.297 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:20.297 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:20.297 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.297 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:20.297 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:20.297 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:20.297 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:20.297 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:20.297 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:20.297 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.297 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:20.298 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:20.298 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:20.298 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:20.298 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:20.298 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:20.298 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:20.298 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:20.298 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:20.298 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:20.298 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:20.298 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.298 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.298 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:20.298 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.298 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:20.299 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:20.299 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:20.299 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:20.299 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:20.299 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:20.299 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:20.299 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:20.299 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:20.299 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:20.299 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:20.299 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:20.299 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:20.299 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:20.299 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:20.300 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:20.300 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:20.300 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:20.300 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:20.300 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:20.300 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:20.300 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:20.300 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:20.300 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:20.300 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:20.300 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:20.300 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:20.300 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:20.300 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.301 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.301 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.301 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.301 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:20.301 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:20.301 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.301 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:20.301 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.301 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:20.301 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:20.301 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:20.301 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.301 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:20.301 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:20.301 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.302 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.302 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:20.302 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:20.302 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.302 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.302 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:20.302 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:20.302 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:20.302 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:20.302 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:20.302 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.302 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.302 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:20.302 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:20.303 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:20.303 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.303 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:20.303 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.303 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:20.303 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.303 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:20.303 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.303 INFO:teuthology.orchestra.run.smithi003.stdout: def test_versioned_object_acl(): 2023-12-03T13:00:20.303 INFO:teuthology.orchestra.run.smithi003.stdout:> bucket_name = get_new_bucket() 2023-12-03T13:00:20.303 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.303 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:7744: 2023-12-03T13:00:20.303 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.304 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:20.304 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:20.304 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:20.304 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:20.304 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:20.304 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:20.304 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:20.304 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:20.304 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:20.304 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:20.304 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:20.304 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:20.304 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:20.304 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:20.304 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:20.305 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:20.305 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:20.305 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:20.305 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:20.305 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:20.305 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:20.305 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:20.305 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:20.305 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:20.305 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:20.305 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:20.305 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:20.305 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:20.305 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:20.305 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:20.305 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:20.306 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:20.306 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:20.306 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:20.306 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:20.306 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:20.306 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.306 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.306 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.306 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:20.306 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.306 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:20.306 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.306 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:20.306 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:20.306 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:20.307 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:20.307 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:20.307 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:20.307 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.307 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:20.307 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:20.307 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:20.307 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:20.307 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:20.307 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:20.307 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.307 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:20.307 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:20.307 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:20.307 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:20.308 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:20.308 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:20.308 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:20.308 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:20.308 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:20.308 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:20.308 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:20.308 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.308 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.308 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:20.308 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:20.308 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:20.308 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:20.308 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:20.308 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.309 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.309 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:20.309 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:20.309 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:20.309 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:20.309 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:20.309 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.309 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:20.309 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:20.309 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:20.309 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:20.309 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:20.309 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-386" 2023-12-03T13:00:20.309 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.309 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:20.309 INFO:teuthology.orchestra.run.smithi003.stdout:________________ test_versioned_object_acl_no_version_specified ________________ 2023-12-03T13:00:20.310 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.310 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.310 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.310 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:20.310 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:20.310 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.310 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:20.310 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.310 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:20.310 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:20.310 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:20.310 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.310 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:20.311 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:20.311 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.311 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.311 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:20.311 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:20.311 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.311 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.311 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:20.311 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.311 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:20.311 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:20.311 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.311 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.311 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:20.311 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:20.311 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.312 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:20.312 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:20.312 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:20.312 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:20.312 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:20.312 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.312 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:20.312 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.312 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:20.312 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:20.312 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:20.312 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:20.312 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:20.312 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:20.312 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:20.312 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:20.313 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.313 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.313 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:20.313 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:20.313 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:20.313 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:20.313 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.313 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:20.313 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:20.313 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:20.313 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:20.313 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.313 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.313 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:20.313 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:20.313 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:20.313 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:20.314 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.314 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.314 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:20.314 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:20.314 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:20.314 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.314 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:20.314 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.314 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:20.314 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:20.314 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.314 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:20.314 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:20.314 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:20.314 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:20.315 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:20.315 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:20.315 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.315 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:20.315 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.315 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:20.315 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.315 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.315 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:20.315 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.315 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:20.315 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.315 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:20.315 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:20.315 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:20.316 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:20.316 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:20.316 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:20.316 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.316 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:20.316 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:20.316 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:20.316 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:20.316 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:20.316 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:20.316 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.316 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:20.316 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:20.316 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:20.316 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:20.316 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:20.316 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:20.317 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:20.317 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:20.317 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:20.317 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:20.317 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:20.317 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.317 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.317 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:20.317 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.317 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:20.317 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:20.317 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:20.317 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:20.317 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:20.317 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:20.317 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:20.318 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:20.318 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:20.318 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:20.318 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:20.318 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:20.318 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:20.318 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:20.318 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:20.318 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:20.318 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:20.318 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:20.318 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:20.318 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:20.318 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:20.319 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:20.319 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:20.319 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:20.319 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:20.319 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:20.319 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:20.319 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:20.319 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.319 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.319 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.319 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.319 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:20.319 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:20.319 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.319 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:20.320 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.320 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:20.320 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:20.320 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:20.320 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.320 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:20.320 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:20.320 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.320 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.320 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:20.320 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:20.320 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.320 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.320 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:20.320 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:20.320 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:20.320 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:20.321 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:20.321 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.321 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.321 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:20.321 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:20.321 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:20.321 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.321 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:20.321 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.321 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:20.321 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.321 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:20.321 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.321 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T13:00:20.321 INFO:teuthology.orchestra.run.smithi003.stdout: def test_versioned_object_acl_no_version_specified(): 2023-12-03T13:00:20.322 INFO:teuthology.orchestra.run.smithi003.stdout:> bucket_name = get_new_bucket() 2023-12-03T13:00:20.322 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.322 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:7812: 2023-12-03T13:00:20.322 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.322 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:20.322 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:20.322 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:20.322 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:20.322 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:20.322 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:20.322 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:20.322 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:20.322 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:20.322 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:20.322 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:20.323 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:20.323 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:20.323 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:20.323 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:20.323 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:20.323 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:20.323 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:20.323 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:20.323 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:20.323 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:20.323 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:20.323 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:20.323 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:20.323 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:20.323 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:20.323 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:20.324 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:20.324 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:20.324 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:20.324 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:20.324 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:20.324 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:20.324 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:20.324 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:20.324 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:20.324 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.324 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.324 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.324 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:20.324 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.324 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:20.324 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.325 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:20.325 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:20.325 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:20.325 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:20.325 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:20.325 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:20.325 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.325 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:20.325 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:20.325 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:20.325 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:20.325 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:20.325 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:20.325 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.325 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:20.325 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:20.326 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:20.326 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:20.326 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:20.326 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:20.326 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:20.326 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:20.326 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:20.326 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:20.326 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:20.326 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.326 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.326 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:20.326 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:20.326 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:20.327 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:20.327 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:20.327 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.327 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.327 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:20.327 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:20.327 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:20.327 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:20.327 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:20.327 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.327 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:20.327 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:20.327 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:20.327 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:20.327 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:20.327 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-387" 2023-12-03T13:00:20.327 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.328 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:20.328 INFO:teuthology.orchestra.run.smithi003.stdout:______________ test_versioned_concurrent_object_create_and_remove ______________ 2023-12-03T13:00:20.328 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.328 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.328 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.328 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:20.328 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:20.328 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.328 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:20.328 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.328 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:20.328 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:20.328 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:20.328 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.328 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:20.329 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:20.329 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.329 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.329 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:20.329 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:20.329 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.329 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.329 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:20.329 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.329 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:20.329 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:20.329 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.329 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.329 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:20.329 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:20.329 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.329 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:20.330 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:20.330 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:20.330 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:20.330 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:20.330 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.330 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:20.330 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.330 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:20.330 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:20.330 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:20.330 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:20.330 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:20.330 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:20.330 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:20.330 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:20.331 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.331 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.331 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:20.331 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:20.331 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:20.331 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:20.331 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.331 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:20.331 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:20.331 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:20.331 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:20.331 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.331 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.331 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:20.331 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:20.331 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:20.332 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:20.332 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.332 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.332 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:20.332 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:20.332 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:20.332 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.332 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:20.332 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.332 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:20.332 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:20.332 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.332 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:20.332 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:20.332 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:20.332 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:20.332 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:20.333 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:20.333 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.333 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:20.333 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.333 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:20.333 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.333 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.333 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:20.333 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.333 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:20.333 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.333 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:20.333 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:20.333 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:20.333 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:20.333 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:20.334 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:20.334 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.334 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:20.334 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:20.334 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:20.334 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:20.334 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:20.334 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:20.334 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.334 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:20.334 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:20.334 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:20.334 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:20.334 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:20.334 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:20.335 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:20.335 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:20.335 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:20.335 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:20.335 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:20.335 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.335 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.335 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:20.335 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.335 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:20.335 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:20.335 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:20.335 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:20.335 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:20.335 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:20.335 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:20.335 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:20.336 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:20.336 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:20.336 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:20.336 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:20.336 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:20.336 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:20.336 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:20.336 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:20.336 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:20.336 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:20.336 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:20.336 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:20.336 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:20.336 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:20.336 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:20.336 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:20.337 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:20.337 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:20.337 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:20.337 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:20.337 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.337 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.337 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.337 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.337 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:20.337 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:20.337 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.337 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:20.337 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.337 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:20.337 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:20.337 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:20.338 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.338 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:20.338 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:20.338 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.338 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.338 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:20.338 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:20.338 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.338 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.338 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:20.338 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:20.338 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:20.338 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:20.338 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:20.338 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.338 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.339 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:20.339 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:20.339 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:20.339 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.339 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:20.339 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.339 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:20.339 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.339 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:20.339 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.339 INFO:teuthology.orchestra.run.smithi003.stdout: def test_versioned_concurrent_object_create_and_remove(): 2023-12-03T13:00:20.339 INFO:teuthology.orchestra.run.smithi003.stdout:> bucket_name = get_new_bucket() 2023-12-03T13:00:20.339 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.339 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:7924: 2023-12-03T13:00:20.339 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.340 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:20.340 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:20.340 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:20.340 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:20.340 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:20.340 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:20.340 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:20.340 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:20.340 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:20.340 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:20.340 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:20.340 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:20.340 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:20.340 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:20.340 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:20.340 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:20.340 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:20.341 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:20.341 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:20.341 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:20.341 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:20.341 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:20.341 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:20.341 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:20.341 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:20.341 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:20.341 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:20.341 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:20.341 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:20.341 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:20.341 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:20.341 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:20.341 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:20.342 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:20.342 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:20.342 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:20.342 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.342 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.342 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.342 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:20.342 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.342 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:20.342 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.342 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:20.342 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:20.342 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:20.342 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:20.342 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:20.343 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:20.343 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.343 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:20.343 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:20.343 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:20.343 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:20.343 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:20.343 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:20.343 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.343 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:20.343 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:20.343 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:20.343 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:20.343 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:20.343 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:20.343 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:20.344 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:20.344 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:20.344 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:20.344 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:20.344 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.344 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.344 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:20.344 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:20.344 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:20.344 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:20.344 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:20.344 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.344 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.344 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:20.344 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:20.344 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:20.344 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:20.345 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:20.345 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.345 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:20.345 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:20.345 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:20.345 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:20.345 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:20.345 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-388" 2023-12-03T13:00:20.345 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.345 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:20.345 INFO:teuthology.orchestra.run.smithi003.stdout:______________________________ test_lifecycle_set ______________________________ 2023-12-03T13:00:20.345 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.345 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.345 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.345 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:20.345 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:20.346 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.346 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:20.346 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.346 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:20.346 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:20.346 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:20.346 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.346 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:20.346 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:20.346 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.346 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.346 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:20.346 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:20.346 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.346 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.347 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:20.347 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.347 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:20.347 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:20.347 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.347 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.347 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:20.347 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:20.347 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.347 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:20.347 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:20.347 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:20.347 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:20.347 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:20.347 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.347 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:20.348 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.348 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:20.348 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:20.348 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:20.348 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:20.348 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:20.348 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:20.348 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:20.348 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:20.348 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.348 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.348 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:20.348 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:20.348 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:20.348 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:20.348 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.349 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:20.349 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:20.349 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:20.349 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:20.349 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.349 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.349 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:20.349 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:20.349 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:20.349 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:20.349 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.349 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.349 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:20.349 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:20.349 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:20.349 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.349 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:20.350 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.350 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:20.350 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:20.350 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.350 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:20.350 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:20.350 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:20.350 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:20.350 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:20.350 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:20.350 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.350 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:20.350 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.350 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:20.350 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.351 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.351 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:20.351 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.351 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:20.351 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.351 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:20.351 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:20.351 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:20.351 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:20.351 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:20.351 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:20.351 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.351 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:20.351 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:20.351 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:20.352 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:20.352 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:20.352 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:20.352 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.352 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:20.352 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:20.352 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:20.352 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:20.352 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:20.352 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:20.352 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:20.352 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:20.352 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:20.352 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:20.352 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:20.352 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.353 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.353 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:20.353 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.353 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:20.353 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:20.353 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:20.353 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:20.353 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:20.353 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:20.353 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:20.353 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:20.353 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:20.353 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:20.353 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:20.353 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:20.353 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:20.353 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:20.354 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:20.354 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:20.354 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:20.354 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:20.354 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:20.354 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:20.354 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:20.354 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:20.354 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:20.354 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:20.354 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:20.354 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:20.354 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:20.354 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:20.354 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.355 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.355 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.355 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.355 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:20.355 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:20.355 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.355 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:20.355 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.355 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:20.355 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:20.355 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:20.355 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.355 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:20.355 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:20.355 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.355 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.355 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:20.356 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:20.356 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.356 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.356 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:20.356 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:20.356 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:20.356 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:20.356 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:20.356 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.356 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.356 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:20.356 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:20.356 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:20.356 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.356 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:20.356 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.357 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:20.357 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.357 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:20.357 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.357 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.lifecycle 2023-12-03T13:00:20.357 INFO:teuthology.orchestra.run.smithi003.stdout: def test_lifecycle_set(): 2023-12-03T13:00:20.357 INFO:teuthology.orchestra.run.smithi003.stdout:> bucket_name = get_new_bucket() 2023-12-03T13:00:20.357 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.357 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:7953: 2023-12-03T13:00:20.357 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.357 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:20.357 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:20.357 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:20.357 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:20.357 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:20.357 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:20.357 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:20.358 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:20.358 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:20.358 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:20.358 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:20.358 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:20.358 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:20.358 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:20.358 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:20.358 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:20.358 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:20.358 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:20.358 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:20.358 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:20.358 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:20.358 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:20.359 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:20.359 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:20.359 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:20.359 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:20.359 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:20.359 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:20.359 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:20.359 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:20.359 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:20.359 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:20.359 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:20.359 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:20.359 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:20.359 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:20.359 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.359 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.359 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.360 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:20.360 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.360 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:20.360 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.360 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:20.360 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:20.360 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:20.360 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:20.360 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:20.360 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:20.360 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.360 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:20.360 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:20.360 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:20.360 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:20.360 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:20.361 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:20.361 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.361 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:20.361 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:20.361 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:20.361 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:20.361 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:20.361 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:20.361 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:20.361 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:20.361 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:20.361 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:20.361 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:20.361 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.361 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.362 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:20.362 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:20.362 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:20.362 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:20.362 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:20.362 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.362 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.362 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:20.362 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:20.362 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:20.362 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:20.362 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:20.362 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.362 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:20.362 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:20.363 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:20.363 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:20.363 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:20.363 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-389" 2023-12-03T13:00:20.363 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.363 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:20.363 INFO:teuthology.orchestra.run.smithi003.stdout:______________________________ test_lifecycle_get ______________________________ 2023-12-03T13:00:20.363 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.363 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.363 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.363 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:20.363 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:20.363 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.363 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:20.363 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.363 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:20.364 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:20.364 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:20.364 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.364 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:20.364 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:20.364 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.364 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.364 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:20.364 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:20.364 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.364 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.364 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:20.364 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.364 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:20.364 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:20.364 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.364 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.365 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:20.365 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:20.365 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.365 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:20.365 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:20.365 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:20.365 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:20.365 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:20.365 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.365 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:20.365 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.365 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:20.365 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:20.365 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:20.365 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:20.365 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:20.366 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:20.366 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:20.366 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:20.366 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.366 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.366 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:20.366 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:20.366 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:20.366 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:20.366 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.366 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:20.366 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:20.366 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:20.366 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:20.366 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.366 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.366 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:20.367 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:20.367 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:20.367 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:20.367 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.367 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.367 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:20.367 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:20.367 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:20.367 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.367 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:20.367 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.367 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:20.367 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:20.367 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.367 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:20.367 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:20.367 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:20.368 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:20.368 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:20.368 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:20.368 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.368 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:20.368 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.368 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:20.368 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.368 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.368 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:20.368 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.368 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:20.368 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.368 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:20.368 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:20.368 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:20.369 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:20.369 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:20.369 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:20.369 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.369 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:20.369 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:20.369 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:20.369 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:20.369 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:20.369 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:20.369 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.369 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:20.369 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:20.369 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:20.369 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:20.369 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:20.370 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:20.370 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:20.370 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:20.370 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:20.370 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:20.370 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:20.370 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.370 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.370 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:20.370 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.370 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:20.370 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:20.370 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:20.370 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:20.370 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:20.370 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:20.371 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:20.371 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:20.371 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:20.371 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:20.371 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:20.371 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:20.371 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:20.371 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:20.371 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:20.371 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:20.371 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:20.371 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:20.371 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:20.371 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:20.371 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:20.371 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:20.372 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:20.372 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:20.372 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:20.372 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:20.372 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:20.372 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:20.372 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.372 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.372 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.372 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.372 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:20.372 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:20.372 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.372 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:20.372 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.372 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:20.373 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:20.373 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:20.373 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.373 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:20.373 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:20.373 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.373 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.373 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:20.373 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:20.373 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.373 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.373 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:20.373 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:20.373 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:20.373 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:20.373 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:20.374 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.374 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.374 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:20.374 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:20.374 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:20.374 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.374 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:20.374 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.374 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:20.374 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.374 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:20.374 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.374 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.lifecycle 2023-12-03T13:00:20.374 INFO:teuthology.orchestra.run.smithi003.stdout: def test_lifecycle_get(): 2023-12-03T13:00:20.374 INFO:teuthology.orchestra.run.smithi003.stdout:> bucket_name = get_new_bucket() 2023-12-03T13:00:20.374 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.375 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:7963: 2023-12-03T13:00:20.375 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.375 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:20.375 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:20.375 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:20.375 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:20.375 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:20.375 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:20.375 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:20.375 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:20.375 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:20.375 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:20.375 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:20.375 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:20.375 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:20.375 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:20.375 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:20.376 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:20.376 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:20.376 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:20.376 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:20.376 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:20.376 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:20.376 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:20.376 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:20.376 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:20.376 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:20.376 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:20.376 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:20.376 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:20.376 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:20.376 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:20.376 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:20.377 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:20.377 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:20.377 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:20.377 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:20.377 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:20.377 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.377 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.377 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.377 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:20.377 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.377 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:20.377 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.377 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:20.377 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:20.377 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:20.377 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:20.377 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:20.378 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:20.378 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.378 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:20.378 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:20.378 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:20.378 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:20.378 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:20.378 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:20.378 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.378 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:20.378 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:20.378 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:20.378 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:20.378 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:20.379 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:20.379 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:20.379 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:20.379 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:20.379 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:20.379 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:20.379 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.379 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.379 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:20.379 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:20.379 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:20.379 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:20.379 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:20.379 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.379 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.379 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:20.380 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:20.380 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:20.380 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:20.380 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:20.380 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.380 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:20.380 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:20.380 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:20.380 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:20.380 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:20.380 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-390" 2023-12-03T13:00:20.380 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.380 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:20.380 INFO:teuthology.orchestra.run.smithi003.stdout:___________________________ test_lifecycle_get_no_id ___________________________ 2023-12-03T13:00:20.380 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.380 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.380 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.381 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:20.381 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:20.381 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.381 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:20.381 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.381 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:20.381 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:20.381 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:20.381 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.381 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:20.381 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:20.381 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.381 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.381 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:20.381 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:20.381 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.381 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.382 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:20.382 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.382 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:20.382 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:20.382 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.382 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.382 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:20.382 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:20.382 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.382 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:20.382 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:20.382 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:20.382 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:20.382 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:20.382 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.382 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:20.383 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.383 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:20.383 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:20.383 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:20.383 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:20.383 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:20.383 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:20.383 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:20.383 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:20.383 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.383 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.383 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:20.383 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:20.383 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:20.383 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:20.383 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.383 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:20.384 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:20.384 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:20.384 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:20.384 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.384 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.384 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:20.384 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:20.384 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:20.384 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:20.384 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.384 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.384 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:20.384 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:20.384 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:20.384 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.385 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:20.385 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.385 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:20.385 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:20.385 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.385 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:20.385 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:20.385 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:20.385 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:20.385 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:20.385 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:20.385 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.385 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:20.385 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.385 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:20.385 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.385 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.386 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:20.386 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.386 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:20.386 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.386 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:20.386 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:20.386 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:20.386 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:20.386 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:20.386 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:20.386 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.386 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:20.386 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:20.386 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:20.386 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:20.387 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:20.387 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:20.387 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.387 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:20.387 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:20.387 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:20.387 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:20.387 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:20.387 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:20.387 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:20.387 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:20.387 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:20.387 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:20.387 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:20.387 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.387 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.387 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:20.388 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.388 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:20.388 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:20.388 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:20.388 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:20.388 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:20.388 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:20.388 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:20.388 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:20.388 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:20.388 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:20.388 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:20.388 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:20.388 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:20.388 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:20.388 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:20.388 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:20.389 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:20.389 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:20.389 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:20.389 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:20.389 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:20.389 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:20.389 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:20.389 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:20.389 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:20.389 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:20.389 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:20.389 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:20.389 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.389 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.389 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.389 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.390 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:20.390 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:20.390 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.390 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:20.390 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.390 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:20.390 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:20.390 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:20.390 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.390 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:20.390 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:20.390 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.390 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.390 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:20.390 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:20.390 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.391 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.391 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:20.391 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:20.391 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:20.391 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:20.391 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:20.391 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.391 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.391 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:20.391 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:20.391 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:20.391 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.391 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:20.391 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.391 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:20.391 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.392 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:20.392 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.392 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.lifecycle 2023-12-03T13:00:20.392 INFO:teuthology.orchestra.run.smithi003.stdout: def test_lifecycle_get_no_id(): 2023-12-03T13:00:20.392 INFO:teuthology.orchestra.run.smithi003.stdout:> bucket_name = get_new_bucket() 2023-12-03T13:00:20.392 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.392 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:7974: 2023-12-03T13:00:20.392 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.392 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:20.392 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:20.392 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:20.392 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:20.392 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:20.392 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:20.392 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:20.392 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:20.392 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:20.393 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:20.393 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:20.393 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:20.393 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:20.393 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:20.393 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:20.393 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:20.393 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:20.393 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:20.393 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:20.393 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:20.393 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:20.393 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:20.393 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:20.393 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:20.393 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:20.394 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:20.394 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:20.394 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:20.394 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:20.394 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:20.394 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:20.394 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:20.394 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:20.394 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:20.394 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:20.394 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:20.394 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.394 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.394 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.394 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:20.394 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.395 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:20.395 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.395 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:20.395 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:20.395 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:20.395 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:20.395 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:20.395 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:20.395 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.395 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:20.395 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:20.395 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:20.395 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:20.395 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:20.395 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:20.395 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.395 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:20.396 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:20.396 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:20.396 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:20.396 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:20.396 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:20.396 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:20.396 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:20.396 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:20.396 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:20.396 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:20.396 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.396 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.396 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:20.396 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:20.396 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:20.396 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:20.397 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:20.397 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.397 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.397 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:20.397 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:20.397 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:20.397 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:20.397 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:20.397 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.397 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:20.397 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:20.397 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:20.397 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:20.397 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:20.397 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-391" 2023-12-03T13:00:20.397 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.397 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:20.398 INFO:teuthology.orchestra.run.smithi003.stdout:__________________________ test_lifecycle_id_too_long __________________________ 2023-12-03T13:00:20.398 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.398 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.398 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.398 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:20.398 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:20.398 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.398 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:20.398 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.398 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:20.398 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:20.398 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:20.398 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.398 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:20.398 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:20.398 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.398 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.399 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:20.399 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:20.399 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.399 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.399 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:20.399 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.399 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:20.399 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:20.399 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.399 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.399 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:20.399 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:20.399 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.399 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:20.399 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:20.399 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:20.400 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:20.400 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:20.400 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.400 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:20.400 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.400 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:20.400 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:20.400 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:20.400 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:20.400 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:20.400 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:20.400 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:20.400 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:20.400 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.400 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.400 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:20.401 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:20.401 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:20.401 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:20.401 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.401 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:20.401 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:20.401 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:20.401 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:20.401 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.401 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.401 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:20.401 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:20.401 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:20.401 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:20.401 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.402 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.402 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:20.402 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:20.402 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:20.402 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.402 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:20.402 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.402 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:20.402 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:20.402 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.402 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:20.402 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:20.402 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:20.402 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:20.402 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:20.403 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:20.403 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.403 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:20.403 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.403 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:20.403 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.403 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.403 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:20.403 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.403 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:20.403 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.403 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:20.403 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:20.403 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:20.403 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:20.403 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:20.404 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:20.404 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.404 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:20.404 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:20.404 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:20.404 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:20.404 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:20.404 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:20.404 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.404 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:20.404 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:20.404 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:20.404 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:20.404 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:20.404 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:20.404 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:20.404 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:20.405 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:20.405 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:20.405 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:20.405 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.405 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.405 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:20.405 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.405 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:20.405 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:20.405 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:20.405 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:20.405 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:20.405 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:20.405 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:20.405 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:20.405 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:20.405 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:20.406 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:20.406 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:20.406 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:20.406 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:20.406 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:20.406 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:20.406 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:20.406 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:20.406 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:20.406 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:20.406 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:20.406 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:20.406 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:20.406 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:20.406 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:20.406 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:20.407 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:20.407 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:20.407 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.407 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.407 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.407 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.407 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:20.407 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:20.407 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.407 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:20.407 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.407 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:20.407 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:20.407 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:20.407 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.407 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:20.408 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:20.408 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.408 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.408 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:20.408 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:20.408 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.408 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.408 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:20.408 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:20.408 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:20.408 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:20.408 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:20.408 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.408 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.408 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:20.408 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:20.409 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:20.409 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.409 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:20.409 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.409 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:20.409 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.409 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:20.409 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.409 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.lifecycle 2023-12-03T13:00:20.409 INFO:teuthology.orchestra.run.smithi003.stdout: def test_lifecycle_id_too_long(): 2023-12-03T13:00:20.409 INFO:teuthology.orchestra.run.smithi003.stdout:> bucket_name = get_new_bucket() 2023-12-03T13:00:20.409 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.409 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:8322: 2023-12-03T13:00:20.409 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.409 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:20.409 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:20.409 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:20.410 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:20.410 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:20.410 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:20.410 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:20.410 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:20.410 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:20.410 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:20.410 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:20.410 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:20.410 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:20.410 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:20.410 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:20.410 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:20.411 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:20.411 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:20.411 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:20.411 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:20.411 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:20.411 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:20.411 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:20.411 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:20.411 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:20.411 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:20.411 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:20.411 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:20.411 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:20.411 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:20.411 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:20.411 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:20.412 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:20.412 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:20.412 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:20.412 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:20.412 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.412 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.412 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.412 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:20.412 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.412 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:20.412 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.412 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:20.412 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:20.412 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:20.412 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:20.412 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:20.412 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:20.413 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.413 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:20.413 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:20.413 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:20.413 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:20.413 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:20.413 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:20.413 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.413 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:20.413 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:20.413 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:20.413 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:20.413 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:20.413 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:20.413 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:20.413 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:20.414 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:20.414 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:20.414 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:20.414 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.414 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.414 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:20.414 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:20.414 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:20.414 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:20.414 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:20.414 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.414 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.414 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:20.414 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:20.414 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:20.414 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:20.415 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:20.415 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.415 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:20.415 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:20.415 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:20.415 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:20.415 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:20.415 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-392" 2023-12-03T13:00:20.415 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.415 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:20.415 INFO:teuthology.orchestra.run.smithi003.stdout:____________________________ test_lifecycle_same_id ____________________________ 2023-12-03T13:00:20.415 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.415 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.415 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.415 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:20.415 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:20.415 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.416 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:20.416 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.416 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:20.416 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:20.416 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:20.416 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.416 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:20.416 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:20.416 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.416 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.416 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:20.416 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:20.416 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.416 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.416 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:20.416 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.416 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:20.417 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:20.417 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.417 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.417 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:20.417 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:20.417 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.417 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:20.417 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:20.417 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:20.417 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:20.417 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:20.417 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.417 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:20.417 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.417 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:20.417 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:20.418 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:20.418 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:20.418 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:20.418 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:20.418 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:20.418 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:20.418 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.418 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.418 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:20.418 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:20.418 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:20.418 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:20.418 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.418 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:20.418 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:20.419 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:20.419 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:20.419 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.419 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.419 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:20.419 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:20.419 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:20.419 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:20.419 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.419 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.419 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:20.419 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:20.419 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:20.419 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.419 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:20.419 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.419 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:20.420 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:20.420 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.420 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:20.420 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:20.420 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:20.420 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:20.420 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:20.420 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:20.420 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.420 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:20.420 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.420 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:20.420 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.420 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.420 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:20.420 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.421 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:20.421 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.421 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:20.421 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:20.421 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:20.421 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:20.421 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:20.421 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:20.421 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.421 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:20.421 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:20.421 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:20.421 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:20.421 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:20.421 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:20.421 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.421 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:20.422 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:20.422 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:20.422 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:20.422 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:20.422 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:20.422 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:20.422 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:20.422 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:20.422 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:20.422 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:20.422 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.422 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.422 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:20.422 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.422 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:20.422 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:20.423 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:20.423 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:20.423 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:20.423 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:20.423 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:20.423 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:20.423 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:20.423 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:20.423 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:20.423 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:20.423 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:20.423 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:20.423 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:20.423 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:20.423 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:20.423 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:20.423 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:20.424 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:20.424 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:20.424 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:20.424 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:20.424 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:20.424 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:20.424 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:20.424 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:20.424 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:20.424 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.424 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.424 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.424 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.424 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:20.424 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:20.424 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.425 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:20.425 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.425 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:20.425 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:20.425 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:20.425 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.425 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:20.425 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:20.425 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.425 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.425 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:20.425 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:20.425 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.425 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.425 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:20.425 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:20.426 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:20.426 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:20.426 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:20.426 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.426 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.426 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:20.426 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:20.426 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:20.426 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.426 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:20.426 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.426 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:20.426 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.426 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:20.426 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.426 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.lifecycle 2023-12-03T13:00:20.427 INFO:teuthology.orchestra.run.smithi003.stdout: def test_lifecycle_same_id(): 2023-12-03T13:00:20.427 INFO:teuthology.orchestra.run.smithi003.stdout:> bucket_name = get_new_bucket() 2023-12-03T13:00:20.427 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.427 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:8334: 2023-12-03T13:00:20.427 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.427 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:20.427 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:20.427 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:20.427 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:20.427 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:20.427 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:20.427 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:20.427 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:20.427 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:20.427 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:20.427 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:20.427 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:20.428 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:20.428 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:20.428 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:20.428 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:20.428 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:20.428 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:20.428 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:20.428 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:20.428 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:20.428 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:20.428 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:20.428 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:20.428 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:20.428 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:20.428 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:20.428 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:20.429 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:20.429 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:20.429 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:20.429 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:20.429 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:20.429 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:20.429 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:20.429 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:20.429 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.429 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.429 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.429 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:20.429 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.429 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:20.429 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.429 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:20.429 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:20.430 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:20.430 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:20.430 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:20.430 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:20.430 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.430 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:20.430 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:20.430 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:20.453 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-03T13:00:20.453 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:20.453 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:20.454 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:20.454 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.454 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:20.454 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:20.454 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:20.454 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:20.454 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:20.454 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:20.454 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:20.454 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:20.454 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:20.454 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:20.454 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:20.454 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.454 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.455 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:20.455 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:20.455 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:20.455 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:20.455 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:20.455 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.455 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.455 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:20.455 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:20.455 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:20.455 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:20.455 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:20.455 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.455 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:20.455 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:20.455 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:20.456 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:20.456 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:20.456 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-393" 2023-12-03T13:00:20.456 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.456 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:20.456 INFO:teuthology.orchestra.run.smithi003.stdout:________________________ test_lifecycle_invalid_status _________________________ 2023-12-03T13:00:20.456 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.456 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.456 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.456 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:20.456 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:20.456 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.456 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:20.456 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.456 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:20.456 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:20.457 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:20.457 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.457 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:20.457 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:20.457 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.457 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.457 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:20.457 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:20.457 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.457 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.457 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:20.457 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.457 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:20.457 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:20.457 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.457 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.458 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:20.458 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:20.458 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.458 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:20.458 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:20.458 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:20.458 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:20.458 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:20.458 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.458 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:20.458 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.458 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:20.458 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:20.458 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:20.458 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:20.458 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:20.459 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:20.459 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:20.459 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:20.459 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.459 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.459 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:20.459 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:20.459 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:20.459 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:20.459 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.459 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:20.459 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:20.459 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:20.459 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:20.459 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.459 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.460 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:20.460 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:20.460 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:20.460 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:20.460 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.460 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.460 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:20.460 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:20.460 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:20.460 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.460 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:20.460 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.460 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:20.460 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:20.460 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.461 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:20.461 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:20.461 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:20.461 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:20.461 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:20.461 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:20.461 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.461 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:20.461 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.461 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:20.461 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.461 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.461 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:20.461 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.462 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:20.462 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.462 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:20.462 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:20.462 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:20.462 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:20.462 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:20.462 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:20.462 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.462 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:20.462 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:20.462 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:20.462 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:20.462 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:20.462 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:20.462 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.463 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:20.463 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:20.463 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:20.463 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:20.463 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:20.463 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:20.463 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:20.463 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:20.463 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:20.463 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:20.463 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:20.463 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.463 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.463 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:20.463 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.463 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:20.464 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:20.464 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:20.464 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:20.464 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:20.464 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:20.464 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:20.464 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:20.464 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:20.464 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:20.464 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:20.464 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:20.464 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:20.464 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:20.464 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:20.464 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:20.464 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:20.465 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:20.465 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:20.465 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:20.465 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:20.465 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:20.465 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:20.465 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:20.465 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:20.465 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:20.465 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:20.465 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:20.465 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.465 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.465 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.466 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.466 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:20.466 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:20.466 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.466 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:20.466 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.466 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:20.466 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:20.466 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:20.466 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.466 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:20.466 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:20.466 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.467 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.467 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:20.467 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:20.467 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.467 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.467 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:20.467 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:20.467 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:20.467 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:20.467 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:20.467 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.467 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.467 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:20.467 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:20.467 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:20.467 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.467 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:20.468 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.468 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:20.468 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.468 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:20.468 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.468 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.lifecycle 2023-12-03T13:00:20.468 INFO:teuthology.orchestra.run.smithi003.stdout: def test_lifecycle_invalid_status(): 2023-12-03T13:00:20.468 INFO:teuthology.orchestra.run.smithi003.stdout:> bucket_name = get_new_bucket() 2023-12-03T13:00:20.468 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.468 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:8347: 2023-12-03T13:00:20.468 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.468 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:20.468 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:20.468 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:20.468 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:20.469 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:20.469 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:20.469 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:20.469 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:20.469 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:20.469 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:20.469 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:20.469 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:20.469 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:20.469 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:20.469 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:20.469 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:20.469 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:20.469 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:20.469 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:20.470 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:20.470 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:20.470 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:20.470 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:20.470 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:20.470 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:20.470 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:20.470 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:20.470 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:20.470 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:20.470 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:20.470 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:20.470 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:20.470 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:20.470 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:20.471 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:20.471 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:20.471 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.471 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.471 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.471 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:20.471 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.471 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:20.471 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.471 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:20.471 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:20.471 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:20.471 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:20.471 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:20.471 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:20.472 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.472 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:20.472 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:20.472 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:20.472 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:20.472 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:20.472 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:20.472 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.472 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:20.472 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:20.472 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:20.472 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:20.472 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:20.472 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:20.472 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:20.472 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:20.472 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:20.473 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:20.473 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:20.473 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.473 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.473 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:20.473 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:20.473 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:20.473 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:20.473 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:20.473 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.473 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.473 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:20.473 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:20.473 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:20.473 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:20.473 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:20.473 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.474 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:20.474 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:20.474 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:20.474 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:20.474 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:20.474 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-394" 2023-12-03T13:00:20.474 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.474 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:20.474 INFO:teuthology.orchestra.run.smithi003.stdout:___________________________ test_lifecycle_set_date ____________________________ 2023-12-03T13:00:20.474 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.474 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.474 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.474 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:20.474 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:20.474 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.474 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:20.475 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.475 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:20.475 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:20.475 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:20.475 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.475 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:20.475 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:20.475 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.475 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.475 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:20.475 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:20.475 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.475 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.475 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:20.475 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.475 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:20.476 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:20.476 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.476 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.476 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:20.476 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:20.476 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.476 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:20.476 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:20.476 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:20.476 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:20.476 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:20.476 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.476 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:20.476 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.476 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:20.477 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:20.477 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:20.477 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:20.477 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:20.477 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:20.477 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:20.477 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:20.477 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.477 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.477 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:20.477 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:20.477 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:20.477 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:20.477 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.477 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:20.477 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:20.478 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:20.478 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:20.478 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.478 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.478 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:20.478 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:20.478 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:20.478 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:20.478 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.478 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.478 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:20.478 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:20.478 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:20.478 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.478 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:20.478 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.479 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:20.479 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:20.479 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.479 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:20.479 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:20.479 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:20.479 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:20.479 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:20.479 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:20.479 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.479 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:20.479 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.479 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:20.479 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.479 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.479 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:20.480 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.480 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:20.480 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.480 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:20.480 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:20.480 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:20.480 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:20.480 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:20.480 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:20.480 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.480 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:20.480 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:20.480 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:20.480 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:20.480 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:20.480 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:20.480 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.481 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:20.481 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:20.481 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:20.481 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:20.481 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:20.481 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:20.481 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:20.481 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:20.481 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:20.481 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:20.481 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:20.481 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.481 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.481 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:20.481 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.481 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:20.482 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:20.482 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:20.482 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:20.482 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:20.482 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:20.482 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:20.482 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:20.482 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:20.482 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:20.482 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:20.482 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:20.482 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:20.482 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:20.482 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:20.482 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:20.483 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:20.483 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:20.483 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:20.483 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:20.483 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:20.483 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:20.483 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:20.483 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:20.483 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:20.483 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:20.483 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:20.483 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:20.483 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.483 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.483 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.483 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.483 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:20.484 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:20.484 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.484 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:20.484 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.484 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:20.484 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:20.484 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:20.484 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.484 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:20.484 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:20.484 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.484 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.484 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:20.484 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:20.484 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.484 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.485 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:20.485 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:20.485 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:20.485 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:20.485 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:20.485 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.485 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.485 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:20.485 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:20.485 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:20.485 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.485 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:20.485 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.485 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:20.485 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.485 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:20.485 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.486 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.lifecycle 2023-12-03T13:00:20.486 INFO:teuthology.orchestra.run.smithi003.stdout: def test_lifecycle_set_date(): 2023-12-03T13:00:20.486 INFO:teuthology.orchestra.run.smithi003.stdout:> bucket_name = get_new_bucket() 2023-12-03T13:00:20.486 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.486 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:8375: 2023-12-03T13:00:20.486 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.486 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:20.486 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:20.486 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:20.486 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:20.486 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:20.486 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:20.486 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:20.486 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:20.486 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:20.486 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:20.487 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:20.487 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:20.487 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:20.487 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:20.487 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:20.487 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:20.487 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:20.487 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:20.487 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:20.487 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:20.487 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:20.487 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:20.487 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:20.487 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:20.487 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:20.488 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:20.488 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:20.488 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:20.488 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:20.488 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:20.488 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:20.488 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:20.488 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:20.488 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:20.488 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:20.488 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:20.488 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.488 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.488 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.488 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:20.488 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.489 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:20.489 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.489 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:20.489 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:20.489 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:20.489 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:20.489 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:20.489 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:20.489 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.489 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:20.489 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:20.489 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:20.489 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:20.489 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:20.489 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:20.489 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.490 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:20.490 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:20.490 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:20.490 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:20.490 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:20.490 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:20.490 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:20.490 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:20.490 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:20.490 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:20.490 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:20.490 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.490 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.490 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:20.490 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:20.490 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:20.491 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:20.491 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:20.491 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.491 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.491 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:20.491 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:20.491 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:20.491 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:20.491 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:20.491 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.491 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:20.491 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:20.491 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:20.491 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:20.491 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:20.492 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-395" 2023-12-03T13:00:20.492 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.492 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:20.492 INFO:teuthology.orchestra.run.smithi003.stdout:_______________________ test_lifecycle_set_invalid_date ________________________ 2023-12-03T13:00:20.492 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.492 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.492 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.492 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:20.492 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:20.492 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.492 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:20.492 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.492 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:20.492 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:20.492 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:20.492 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.493 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:20.493 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:20.493 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.493 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.493 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:20.493 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:20.493 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.493 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.493 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:20.493 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.493 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:20.493 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:20.493 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.493 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.493 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:20.493 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:20.494 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.494 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:20.494 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:20.494 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:20.494 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:20.494 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:20.494 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.494 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:20.494 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.494 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:20.494 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:20.494 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:20.494 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:20.494 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:20.494 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:20.494 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:20.495 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:20.495 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.495 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.495 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:20.495 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:20.495 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:20.495 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:20.495 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.495 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:20.495 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:20.495 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:20.495 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:20.495 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.495 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.495 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:20.495 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:20.495 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:20.496 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:20.496 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.496 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.496 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:20.496 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:20.496 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:20.496 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.496 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:20.496 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.496 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:20.496 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:20.496 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.496 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:20.496 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:20.496 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:20.496 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:20.497 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:20.497 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:20.497 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.497 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:20.497 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.497 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:20.497 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.497 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.497 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:20.497 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.497 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:20.497 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.497 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:20.497 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:20.497 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:20.497 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:20.497 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:20.498 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:20.498 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.498 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:20.498 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:20.498 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:20.498 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:20.498 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:20.498 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:20.498 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.498 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:20.498 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:20.498 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:20.498 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:20.499 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:20.499 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:20.499 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:20.499 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:20.499 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:20.499 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:20.499 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:20.499 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.499 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.499 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:20.499 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.499 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:20.499 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:20.499 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:20.499 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:20.499 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:20.500 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:20.500 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:20.500 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:20.500 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:20.500 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:20.500 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:20.500 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:20.500 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:20.500 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:20.500 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:20.500 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:20.500 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:20.500 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:20.500 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:20.500 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:20.500 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:20.501 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:20.501 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:20.501 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:20.501 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:20.501 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:20.501 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:20.501 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:20.501 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.501 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.501 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.501 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.501 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:20.501 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:20.501 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.501 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:20.502 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.502 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:20.502 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:20.502 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:20.502 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.502 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:20.502 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:20.502 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.502 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.502 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:20.502 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:20.502 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.502 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.502 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:20.502 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:20.502 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:20.503 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:20.503 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:20.503 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.503 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.503 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:20.503 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:20.503 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:20.503 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.503 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:20.503 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.503 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:20.503 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.503 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:20.503 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.503 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.lifecycle 2023-12-03T13:00:20.503 INFO:teuthology.orchestra.run.smithi003.stdout: def test_lifecycle_set_invalid_date(): 2023-12-03T13:00:20.503 INFO:teuthology.orchestra.run.smithi003.stdout:> bucket_name = get_new_bucket() 2023-12-03T13:00:20.504 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.504 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:8385: 2023-12-03T13:00:20.504 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.504 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:20.504 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:20.504 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:20.504 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:20.504 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:20.504 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:20.504 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:20.504 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:20.504 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:20.504 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:20.504 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:20.504 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:20.504 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:20.505 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:20.505 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:20.505 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:20.505 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:20.505 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:20.505 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:20.505 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:20.505 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:20.505 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:20.505 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:20.505 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:20.505 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:20.505 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:20.505 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:20.505 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:20.505 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:20.505 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:20.506 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:20.506 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:20.506 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:20.506 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:20.506 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:20.506 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:20.506 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.506 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.506 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.506 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:20.506 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.506 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:20.506 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.506 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:20.506 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:20.507 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:20.507 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:20.507 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:20.507 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:20.507 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.507 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:20.507 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:20.507 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:20.507 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:20.507 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:20.507 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:20.507 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.507 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:20.507 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:20.507 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:20.507 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:20.507 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:20.508 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:20.508 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:20.508 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:20.508 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:20.508 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:20.508 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:20.508 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.508 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.508 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:20.508 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:20.508 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:20.508 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:20.508 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:20.509 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.509 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.509 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:20.509 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:20.509 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:20.509 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:20.509 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:20.509 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.509 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:20.509 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:20.509 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:20.509 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:20.509 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:20.509 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-396" 2023-12-03T13:00:20.509 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.509 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:20.509 INFO:teuthology.orchestra.run.smithi003.stdout:________________________ test_lifecycle_set_noncurrent _________________________ 2023-12-03T13:00:20.510 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.510 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.510 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.510 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:20.510 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:20.510 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.510 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:20.510 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.510 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:20.510 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:20.510 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:20.510 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.510 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:20.510 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:20.511 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.511 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.511 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:20.511 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:20.511 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.511 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.511 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:20.511 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.511 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:20.511 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:20.511 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.511 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.511 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:20.511 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:20.511 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.512 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:20.512 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:20.512 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:20.512 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:20.512 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:20.512 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.512 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:20.512 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.512 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:20.512 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:20.512 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:20.512 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:20.512 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:20.512 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:20.512 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:20.512 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:20.512 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.513 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.513 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:20.513 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:20.513 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:20.513 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:20.513 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.513 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:20.513 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:20.513 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:20.513 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:20.513 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.513 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.513 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:20.513 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:20.513 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:20.513 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:20.514 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.514 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.514 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:20.514 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:20.514 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:20.514 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.514 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:20.514 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.514 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:20.514 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:20.514 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.514 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:20.514 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:20.514 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:20.514 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:20.514 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:20.515 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:20.515 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.515 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:20.515 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.515 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:20.515 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.515 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.515 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:20.515 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.515 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:20.515 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.515 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:20.515 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:20.515 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:20.515 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:20.515 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:20.516 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:20.516 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.516 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:20.516 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:20.516 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:20.516 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:20.516 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:20.516 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:20.516 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.516 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:20.516 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:20.516 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:20.516 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:20.516 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:20.516 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:20.516 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:20.516 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:20.517 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:20.517 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:20.517 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:20.517 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.517 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.517 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:20.517 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.517 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:20.517 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:20.517 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:20.517 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:20.517 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:20.517 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:20.517 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:20.517 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:20.517 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:20.517 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:20.518 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:20.518 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:20.518 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:20.518 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:20.518 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:20.518 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:20.518 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:20.518 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:20.518 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:20.518 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:20.518 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:20.518 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:20.518 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:20.518 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:20.518 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:20.519 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:20.519 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:20.519 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:20.519 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.519 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.519 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.519 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.519 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:20.519 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:20.519 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.519 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:20.519 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.519 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:20.519 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:20.520 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:20.520 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.520 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:20.520 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:20.520 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.520 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.520 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:20.520 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:20.520 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.520 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.520 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:20.520 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:20.520 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:20.520 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:20.520 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:20.521 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.521 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.521 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:20.521 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:20.521 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:20.521 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.521 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:20.521 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.521 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:20.521 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.521 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:20.521 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.521 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.lifecycle 2023-12-03T13:00:20.521 INFO:teuthology.orchestra.run.smithi003.stdout: def test_lifecycle_set_noncurrent(): 2023-12-03T13:00:20.521 INFO:teuthology.orchestra.run.smithi003.stdout:> bucket_name = _create_objects(keys=['past/foo', 'future/bar']) 2023-12-03T13:00:20.521 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.522 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:8602: 2023-12-03T13:00:20.522 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.522 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:116: in _create_objects 2023-12-03T13:00:20.522 INFO:teuthology.orchestra.run.smithi003.stdout: bucket = get_new_bucket_resource(name=bucket_name) 2023-12-03T13:00:20.522 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:581: in get_new_bucket_resource 2023-12-03T13:00:20.522 INFO:teuthology.orchestra.run.smithi003.stdout: bucket_location = bucket.create() 2023-12-03T13:00:20.522 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/boto3/resources/factory.py:580: in do_action 2023-12-03T13:00:20.522 INFO:teuthology.orchestra.run.smithi003.stdout: response = action(self, *args, **kwargs) 2023-12-03T13:00:20.522 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/boto3/resources/action.py:88: in __call__ 2023-12-03T13:00:20.522 INFO:teuthology.orchestra.run.smithi003.stdout: response = getattr(parent.meta.client, operation_name)(*args, **params) 2023-12-03T13:00:20.522 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:20.522 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:20.522 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:20.522 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:20.523 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:20.523 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:20.523 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:20.523 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:20.523 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:20.523 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:20.523 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:20.523 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:20.523 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:20.523 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:20.523 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:20.523 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:20.523 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:20.523 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:20.523 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:20.523 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:20.524 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:20.524 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:20.524 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:20.524 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:20.524 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:20.524 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:20.524 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:20.524 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:20.524 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:20.524 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:20.524 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:20.524 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:20.524 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:20.524 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:20.524 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.524 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.525 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.525 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:20.525 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.525 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:20.525 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.525 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:20.525 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:20.525 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:20.525 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:20.525 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:20.525 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:20.525 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.525 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:20.525 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:20.525 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:20.525 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:20.525 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:20.526 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:20.526 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.526 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:20.526 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:20.526 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:20.526 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:20.526 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:20.526 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:20.526 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:20.526 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:20.526 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:20.526 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:20.526 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:20.526 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.526 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.527 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:20.527 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:20.527 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:20.527 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:20.527 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:20.527 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.527 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.527 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:20.527 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:20.527 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:20.527 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:20.527 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:20.527 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.527 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:20.527 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:20.527 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:20.528 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:20.528 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:20.528 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-397" 2023-12-03T13:00:20.528 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.528 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:20.528 INFO:teuthology.orchestra.run.smithi003.stdout:_______________________ test_lifecycle_set_deletemarker ________________________ 2023-12-03T13:00:20.528 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.528 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.528 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.528 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:20.528 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:20.528 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.528 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:20.528 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.528 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:20.528 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:20.528 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:20.529 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.529 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:20.529 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:20.529 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.529 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.529 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:20.529 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:20.529 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.529 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.529 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:20.529 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.529 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:20.529 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:20.529 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.529 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.529 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:20.530 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:20.530 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.530 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:20.530 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:20.530 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:20.530 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:20.530 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:20.530 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.530 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:20.530 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.530 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:20.530 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:20.530 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:20.530 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:20.531 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:20.531 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:20.531 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:20.531 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:20.531 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.531 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.531 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:20.531 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:20.531 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:20.531 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:20.531 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.531 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:20.531 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:20.531 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:20.531 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:20.531 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.532 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.532 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:20.532 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:20.532 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:20.532 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:20.532 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.532 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.532 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:20.532 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:20.532 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:20.532 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.532 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:20.532 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.532 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:20.532 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:20.532 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.532 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:20.533 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:20.533 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:20.533 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:20.533 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:20.533 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:20.533 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.533 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:20.533 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.533 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:20.533 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.533 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.533 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:20.533 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.533 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:20.533 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.533 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:20.533 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:20.534 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:20.534 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:20.534 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:20.534 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:20.534 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.534 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:20.534 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:20.534 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:20.534 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:20.534 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:20.534 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:20.534 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.534 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:20.534 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:20.534 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:20.534 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:20.535 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:20.535 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:20.535 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:20.535 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:20.535 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:20.535 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:20.535 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:20.535 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.535 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.535 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:20.535 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.535 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:20.535 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:20.535 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:20.535 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:20.535 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:20.535 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:20.536 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:20.536 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:20.536 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:20.536 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:20.536 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:20.536 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:20.536 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:20.536 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:20.536 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:20.536 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:20.536 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:20.536 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:20.536 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:20.536 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:20.536 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:20.536 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:20.537 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:20.537 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:20.537 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:20.537 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:20.537 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:20.537 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:20.537 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.537 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.537 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.537 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.537 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:20.537 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:20.537 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.537 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:20.537 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.537 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:20.537 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:20.538 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:20.538 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.538 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:20.538 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:20.538 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.538 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.538 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:20.538 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:20.538 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.538 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.538 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:20.538 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:20.538 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:20.538 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:20.538 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:20.538 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.539 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.539 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:20.539 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:20.539 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:20.539 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.539 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:20.539 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.539 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:20.539 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.539 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:20.539 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.539 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.lifecycle 2023-12-03T13:00:20.539 INFO:teuthology.orchestra.run.smithi003.stdout: def test_lifecycle_set_deletemarker(): 2023-12-03T13:00:20.539 INFO:teuthology.orchestra.run.smithi003.stdout:> bucket_name = get_new_bucket() 2023-12-03T13:00:20.539 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.539 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:8641: 2023-12-03T13:00:20.539 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.540 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:20.540 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:20.540 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:20.540 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:20.540 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:20.540 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:20.540 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:20.540 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:20.540 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:20.540 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:20.540 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:20.540 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:20.540 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:20.540 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:20.540 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:20.540 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:20.541 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:20.541 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:20.541 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:20.541 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:20.541 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:20.541 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:20.541 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:20.541 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:20.541 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:20.541 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:20.541 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:20.541 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:20.541 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:20.542 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:20.542 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:20.542 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:20.542 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:20.542 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:20.542 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:20.542 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:20.542 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.542 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.542 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.542 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:20.542 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.542 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:20.542 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.542 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:20.542 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:20.543 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:20.543 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:20.543 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:20.543 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:20.543 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.543 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:20.543 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:20.543 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:20.543 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:20.543 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:20.543 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:20.543 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.543 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:20.543 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:20.543 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:20.543 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:20.543 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:20.544 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:20.544 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:20.544 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:20.544 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:20.544 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:20.544 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:20.544 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.544 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.544 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:20.544 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:20.544 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:20.544 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:20.544 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:20.544 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.544 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.545 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:20.545 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:20.545 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:20.545 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:20.545 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:20.545 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.545 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:20.545 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:20.545 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:20.545 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:20.545 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:20.545 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-398" 2023-12-03T13:00:20.545 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.545 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:20.545 INFO:teuthology.orchestra.run.smithi003.stdout:__________________________ test_lifecycle_set_filter ___________________________ 2023-12-03T13:00:20.545 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.545 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.546 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.546 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:20.546 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:20.546 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.546 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:20.546 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.546 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:20.546 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:20.546 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:20.546 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.546 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:20.546 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:20.546 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.546 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.546 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:20.547 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:20.547 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.547 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.547 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:20.547 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.547 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:20.547 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:20.547 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.547 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.547 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:20.547 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:20.547 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.547 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:20.547 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:20.547 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:20.547 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:20.548 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:20.548 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.548 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:20.548 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.548 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:20.548 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:20.548 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:20.548 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:20.548 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:20.548 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:20.548 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:20.548 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:20.548 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.548 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.548 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:20.548 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:20.549 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:20.549 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:20.549 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.549 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:20.549 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:20.549 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:20.549 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:20.549 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.549 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.549 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:20.549 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:20.549 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:20.549 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:20.549 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.549 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.549 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:20.550 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:20.550 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:20.550 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.550 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:20.550 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.550 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:20.550 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:20.550 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.550 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:20.550 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:20.550 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:20.550 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:20.550 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:20.550 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:20.550 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.551 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:20.551 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.551 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:20.551 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.551 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.551 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:20.551 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.551 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:20.551 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.551 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:20.551 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:20.551 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:20.551 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:20.551 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:20.551 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:20.552 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.552 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:20.552 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:20.552 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:20.552 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:20.552 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:20.552 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:20.552 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.552 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:20.552 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:20.552 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:20.552 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:20.552 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:20.552 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:20.553 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:20.553 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:20.553 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:20.553 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:20.553 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:20.553 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.553 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.553 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:20.553 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.553 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:20.553 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:20.553 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:20.553 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:20.553 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:20.553 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:20.553 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:20.553 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:20.554 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:20.554 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:20.554 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:20.554 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:20.554 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:20.554 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:20.554 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:20.554 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:20.554 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:20.554 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:20.554 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:20.554 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:20.554 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:20.554 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:20.554 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:20.555 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:20.555 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:20.555 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:20.555 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:20.555 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:20.555 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.555 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.555 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.555 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.555 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:20.555 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:20.555 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.555 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:20.555 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.555 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:20.555 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:20.555 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:20.556 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.556 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:20.556 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:20.556 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.556 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.556 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:20.556 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:20.556 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.556 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.556 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:20.556 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:20.556 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:20.556 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:20.556 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:20.556 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.556 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.557 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:20.557 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:20.557 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:20.557 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.557 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:20.557 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.557 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:20.557 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.557 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:20.557 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.557 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.lifecycle 2023-12-03T13:00:20.557 INFO:teuthology.orchestra.run.smithi003.stdout: def test_lifecycle_set_filter(): 2023-12-03T13:00:20.557 INFO:teuthology.orchestra.run.smithi003.stdout:> bucket_name = get_new_bucket() 2023-12-03T13:00:20.557 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.557 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:8650: 2023-12-03T13:00:20.557 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.557 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:20.558 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:20.558 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:20.558 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:20.558 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:20.558 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:20.558 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:20.558 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:20.558 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:20.558 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:20.558 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:20.558 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:20.558 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:20.558 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:20.558 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:20.558 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:20.558 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:20.559 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:20.559 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:20.559 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:20.559 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:20.559 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:20.559 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:20.559 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:20.559 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:20.559 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:20.559 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:20.559 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:20.559 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:20.559 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:20.559 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:20.559 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:20.559 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:20.559 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:20.560 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:20.560 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:20.560 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.560 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.560 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.560 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:20.560 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.560 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:20.560 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.560 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:20.560 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:20.560 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:20.560 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:20.560 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:20.560 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:20.560 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.561 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:20.561 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:20.561 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:20.561 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:20.561 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:20.561 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:20.561 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.561 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:20.561 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:20.561 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:20.561 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:20.561 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:20.561 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:20.561 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:20.561 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:20.561 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:20.562 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:20.562 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:20.562 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.562 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.562 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:20.562 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:20.562 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:20.562 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:20.562 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:20.562 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.562 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.562 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:20.562 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:20.562 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:20.563 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:20.563 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:20.563 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.563 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:20.563 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:20.563 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:20.563 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:20.563 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:20.563 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-399" 2023-12-03T13:00:20.563 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.563 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:20.563 INFO:teuthology.orchestra.run.smithi003.stdout:_______________________ test_lifecycle_set_empty_filter ________________________ 2023-12-03T13:00:20.563 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.563 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.563 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.564 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:20.564 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:20.564 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.564 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:20.564 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.564 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:20.564 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:20.564 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:20.564 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.564 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:20.564 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:20.564 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.564 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.564 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:20.564 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:20.564 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.565 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.565 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:20.565 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.565 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:20.565 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:20.565 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.565 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.565 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:20.565 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:20.565 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.565 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:20.565 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:20.565 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:20.565 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:20.565 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:20.565 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.565 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:20.566 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.566 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:20.566 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:20.566 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:20.566 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:20.566 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:20.566 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:20.566 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:20.566 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:20.566 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.566 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.566 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:20.566 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:20.566 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:20.567 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:20.567 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.567 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:20.567 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:20.567 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:20.567 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:20.567 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.567 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.567 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:20.567 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:20.567 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:20.567 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:20.567 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.567 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.567 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:20.567 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:20.567 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:20.568 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.568 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:20.568 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.568 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:20.568 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:20.568 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.568 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:20.568 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:20.568 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:20.568 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:20.568 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:20.568 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:20.568 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.568 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:20.568 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.568 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:20.569 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.569 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.569 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:20.569 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.569 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:20.569 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.569 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:20.569 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:20.569 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:20.569 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:20.569 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:20.569 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:20.569 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.569 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:20.569 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:20.569 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:20.570 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:20.570 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:20.570 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:20.570 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.570 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:20.570 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:20.570 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:20.570 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:20.570 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:20.570 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:20.570 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:20.570 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:20.570 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:20.570 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:20.570 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:20.570 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.571 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.571 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:20.571 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.571 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:20.571 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:20.571 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:20.571 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:20.571 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:20.571 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:20.571 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:20.571 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:20.571 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:20.571 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:20.571 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:20.571 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:20.572 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:20.572 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:20.572 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:20.572 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:20.572 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:20.572 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:20.572 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:20.572 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:20.572 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:20.572 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:20.572 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:20.572 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:20.572 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:20.572 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:20.572 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:20.572 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:20.573 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.573 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.573 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.573 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.573 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:20.573 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:20.573 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.573 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:20.573 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.573 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:20.573 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:20.573 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:20.573 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.573 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:20.573 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:20.573 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.573 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.574 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:20.574 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:20.574 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.574 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.574 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:20.574 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:20.574 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:20.574 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:20.574 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:20.574 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.574 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.574 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:20.574 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:20.574 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:20.575 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.575 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:20.575 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.575 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:20.575 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.575 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:20.575 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.575 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.lifecycle 2023-12-03T13:00:20.575 INFO:teuthology.orchestra.run.smithi003.stdout: def test_lifecycle_set_empty_filter(): 2023-12-03T13:00:20.575 INFO:teuthology.orchestra.run.smithi003.stdout:> bucket_name = get_new_bucket() 2023-12-03T13:00:20.575 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.575 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:8659: 2023-12-03T13:00:20.575 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.575 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:20.575 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:20.575 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:20.576 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:20.576 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:20.576 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:20.576 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:20.576 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:20.576 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:20.576 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:20.576 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:20.576 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:20.576 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:20.576 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:20.576 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:20.576 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:20.576 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:20.576 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:20.576 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:20.577 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:20.577 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:20.577 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:20.577 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:20.577 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:20.577 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:20.577 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:20.577 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:20.577 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:20.577 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:20.577 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:20.577 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:20.577 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:20.577 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:20.577 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:20.577 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:20.577 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:20.578 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.578 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.578 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.578 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:20.578 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.578 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:20.578 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.578 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:20.578 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:20.578 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:20.578 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:20.578 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:20.578 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:20.578 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.578 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:20.579 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:20.579 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:20.579 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:20.579 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:20.579 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:20.579 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.579 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:20.579 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:20.579 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:20.579 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:20.579 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:20.579 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:20.579 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:20.579 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:20.579 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:20.579 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:20.580 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:20.580 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.580 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.580 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:20.580 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:20.580 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:20.580 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:20.580 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:20.580 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.580 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.580 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:20.580 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:20.580 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:20.580 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:20.580 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:20.580 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.581 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:20.581 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:20.581 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:20.581 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:20.581 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:20.581 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-400" 2023-12-03T13:00:20.581 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.581 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:20.581 INFO:teuthology.orchestra.run.smithi003.stdout:_________________________ test_lifecycle_set_multipart _________________________ 2023-12-03T13:00:20.581 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.581 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.581 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.581 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:20.581 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:20.581 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.581 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:20.582 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.582 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:20.582 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:20.582 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:20.582 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.582 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:20.582 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:20.582 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.582 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.582 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:20.582 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:20.582 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.582 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.582 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:20.582 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.582 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:20.582 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:20.583 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.583 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.583 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:20.583 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:20.583 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.583 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:20.583 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:20.583 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:20.583 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:20.583 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:20.583 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.583 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:20.583 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.583 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:20.583 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:20.583 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:20.584 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:20.584 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:20.584 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:20.584 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:20.584 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:20.584 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.584 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.584 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:20.584 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:20.584 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:20.584 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:20.584 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.584 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:20.584 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:20.585 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:20.585 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:20.585 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.585 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.585 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:20.585 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:20.585 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:20.585 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:20.585 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.585 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.585 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:20.585 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:20.585 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:20.585 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.585 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:20.585 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.585 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:20.586 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:20.586 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.586 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:20.586 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:20.586 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:20.586 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:20.586 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:20.586 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:20.586 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.586 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:20.586 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.586 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:20.586 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.586 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.587 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:20.587 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.587 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:20.587 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.587 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:20.587 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:20.587 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:20.587 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:20.587 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:20.587 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:20.587 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.587 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:20.587 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:20.587 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:20.587 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:20.587 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:20.587 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:20.588 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.588 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:20.588 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:20.588 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:20.588 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:20.588 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:20.588 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:20.588 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:20.588 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:20.588 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:20.588 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:20.588 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:20.588 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.588 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.588 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:20.588 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.589 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:20.589 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:20.589 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:20.589 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:20.589 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:20.589 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:20.589 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:20.589 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:20.589 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:20.589 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:20.589 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:20.589 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:20.589 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:20.589 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:20.589 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:20.589 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:20.589 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:20.590 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:20.590 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:20.590 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:20.590 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:20.590 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:20.590 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:20.590 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:20.590 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:20.590 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:20.590 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:20.590 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:20.590 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.590 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.590 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.590 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.591 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:20.591 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:20.591 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.591 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:20.591 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.591 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:20.591 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:20.591 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:20.591 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.591 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:20.591 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:20.591 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.591 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.591 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:20.591 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:20.592 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.592 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.592 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:20.592 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:20.592 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:20.592 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:20.592 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:20.592 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.592 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.592 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:20.592 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:20.592 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:20.592 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.592 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:20.592 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.592 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:20.592 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.593 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:20.593 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.593 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.lifecycle 2023-12-03T13:00:20.593 INFO:teuthology.orchestra.run.smithi003.stdout: def test_lifecycle_set_multipart(): 2023-12-03T13:00:20.593 INFO:teuthology.orchestra.run.smithi003.stdout:> bucket_name = get_new_bucket() 2023-12-03T13:00:20.593 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.593 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:8703: 2023-12-03T13:00:20.593 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.593 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:20.593 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:20.593 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:20.593 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:20.593 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:20.593 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:20.593 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:20.593 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:20.593 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:20.594 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:20.594 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:20.594 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:20.594 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:20.594 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:20.594 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:20.594 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:20.594 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:20.594 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:20.594 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:20.594 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:20.594 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:20.594 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:20.594 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:20.594 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:20.594 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:20.595 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:20.595 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:20.595 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:20.595 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:20.595 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:20.595 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:20.595 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:20.595 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:20.595 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:20.595 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:20.595 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:20.595 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.595 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.595 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.595 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:20.596 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.596 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:20.596 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.596 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:20.596 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:20.596 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:20.596 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:20.596 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:20.596 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:20.596 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.596 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:20.596 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:20.596 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:20.596 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:20.596 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:20.596 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:20.597 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.597 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:20.597 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:20.597 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:20.597 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:20.597 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:20.597 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:20.597 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:20.597 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:20.597 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:20.597 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:20.597 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:20.597 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.597 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.597 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:20.597 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:20.598 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:20.598 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:20.598 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:20.598 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.598 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.598 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:20.598 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:20.598 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:20.598 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:20.598 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:20.598 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.598 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:20.598 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:20.598 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:20.598 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:20.598 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:20.599 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-401" 2023-12-03T13:00:20.599 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.599 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:20.599 INFO:teuthology.orchestra.run.smithi003.stdout:__________________ test_lifecycle_transition_set_invalid_date __________________ 2023-12-03T13:00:20.599 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.599 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.599 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.599 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:20.599 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:20.599 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.599 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:20.599 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.599 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:20.599 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:20.599 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:20.599 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.600 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:20.600 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:20.600 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.600 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.600 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:20.600 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:20.600 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.600 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.600 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:20.600 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.600 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:20.600 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:20.600 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.600 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.600 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:20.600 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:20.600 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.601 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:20.601 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:20.601 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:20.601 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:20.601 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:20.601 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.601 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:20.601 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.601 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:20.601 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:20.601 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:20.601 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:20.601 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:20.601 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:20.601 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:20.602 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:20.602 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.602 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.602 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:20.602 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:20.602 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:20.602 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:20.602 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.602 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:20.602 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:20.602 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:20.602 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:20.602 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.602 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.602 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:20.602 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:20.603 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:20.603 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:20.603 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.603 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.603 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:20.603 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:20.603 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:20.603 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.603 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:20.603 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.603 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:20.603 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:20.603 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.603 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:20.603 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:20.603 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:20.603 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:20.604 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:20.604 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:20.604 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.604 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:20.604 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.604 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:20.604 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.604 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.604 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:20.604 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.604 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:20.604 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.604 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:20.604 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:20.604 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:20.604 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:20.604 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:20.605 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:20.605 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.605 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:20.605 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:20.605 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:20.605 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:20.605 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:20.605 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:20.605 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.605 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:20.605 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:20.605 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:20.605 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:20.605 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:20.605 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:20.605 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:20.605 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:20.606 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:20.606 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:20.606 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:20.606 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.606 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.606 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:20.606 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.606 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:20.606 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:20.606 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:20.606 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:20.606 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:20.606 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:20.606 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:20.607 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:20.607 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:20.607 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:20.607 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:20.607 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:20.607 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:20.607 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:20.607 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:20.607 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:20.607 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:20.607 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:20.607 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:20.607 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:20.607 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:20.607 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:20.607 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:20.608 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:20.608 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:20.608 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:20.608 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:20.608 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:20.608 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.608 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.608 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.608 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.608 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:20.608 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:20.608 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.608 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:20.608 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.608 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:20.608 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:20.608 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:20.609 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.609 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:20.609 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:20.609 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.609 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.609 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:20.609 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:20.609 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.609 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.609 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:20.609 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:20.609 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:20.609 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:20.609 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:20.609 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.609 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.609 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:20.610 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:20.610 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:20.610 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.610 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:20.610 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.610 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:20.610 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.610 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:20.610 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.610 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.lifecycle 2023-12-03T13:00:20.610 INFO:teuthology.orchestra.run.smithi003.stdout: def test_lifecycle_transition_set_invalid_date(): 2023-12-03T13:00:20.610 INFO:teuthology.orchestra.run.smithi003.stdout:> bucket_name = get_new_bucket() 2023-12-03T13:00:20.610 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.610 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:8752: 2023-12-03T13:00:20.610 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.611 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:20.611 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:20.611 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:20.611 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:20.611 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:20.611 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:20.611 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:20.611 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:20.611 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:20.611 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:20.611 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:20.611 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:20.611 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:20.611 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:20.611 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:20.612 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:20.612 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:20.612 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:20.612 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:20.612 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:20.612 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:20.612 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:20.612 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:20.612 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:20.612 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:20.612 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:20.612 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:20.612 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:20.612 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:20.612 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:20.612 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:20.612 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:20.613 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:20.613 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:20.613 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:20.613 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:20.613 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.613 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.613 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.613 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:20.613 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.613 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:20.613 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.613 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:20.613 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:20.613 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:20.613 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:20.613 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:20.614 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:20.614 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.614 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:20.614 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:20.614 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:20.614 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:20.614 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:20.614 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:20.614 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.614 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:20.614 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:20.614 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:20.614 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:20.614 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:20.614 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:20.614 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:20.615 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:20.615 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:20.615 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:20.615 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:20.615 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.615 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.615 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:20.615 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:20.615 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:20.615 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:20.615 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:20.615 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.615 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.615 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:20.615 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:20.615 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:20.615 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:20.616 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:20.616 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.616 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:20.616 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:20.616 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:20.616 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:20.616 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:20.616 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-402" 2023-12-03T13:00:20.616 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.616 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:20.616 INFO:teuthology.orchestra.run.smithi003.stdout:__________________________ test_encrypted_transfer_1b __________________________ 2023-12-03T13:00:20.616 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.616 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.616 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.617 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:20.617 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:20.617 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.617 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:20.617 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.617 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:20.617 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:20.617 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:20.617 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.617 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:20.617 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:20.617 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.617 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.617 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:20.617 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:20.617 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.617 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.618 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:20.618 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.618 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:20.618 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:20.618 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.618 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.618 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:20.618 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:20.618 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.618 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:20.618 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:20.618 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:20.618 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:20.618 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:20.618 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.618 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:20.619 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.619 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:20.619 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:20.619 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:20.619 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:20.619 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:20.619 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:20.619 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:20.619 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:20.619 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.619 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.619 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:20.619 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:20.619 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:20.620 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:20.620 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.620 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:20.620 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:20.620 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:20.620 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:20.620 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.620 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.620 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:20.620 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:20.620 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:20.620 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:20.620 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.620 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.620 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:20.620 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:20.620 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:20.621 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.621 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:20.621 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.621 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:20.621 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:20.621 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.621 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:20.621 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:20.621 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:20.621 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:20.621 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:20.621 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:20.621 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.621 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:20.621 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.621 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:20.622 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.622 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.622 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:20.622 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.622 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:20.622 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.622 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:20.622 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:20.622 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:20.622 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:20.622 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:20.622 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:20.622 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.622 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:20.622 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:20.622 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:20.623 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:20.623 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:20.623 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:20.623 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.623 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:20.623 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:20.623 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:20.623 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:20.623 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:20.623 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:20.623 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:20.623 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:20.623 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:20.623 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:20.623 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:20.623 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.624 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.624 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:20.624 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.624 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:20.624 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:20.624 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:20.624 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:20.624 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:20.624 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:20.624 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:20.624 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:20.624 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:20.624 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:20.624 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:20.624 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:20.624 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:20.624 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:20.625 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:20.625 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:20.625 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:20.625 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:20.625 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:20.625 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:20.625 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:20.625 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:20.625 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:20.625 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:20.625 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:20.625 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:20.625 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:20.625 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:20.625 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.625 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.626 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.626 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.626 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:20.626 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:20.626 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.626 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:20.626 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.626 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:20.626 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:20.626 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:20.626 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.626 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:20.626 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:20.626 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.626 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.626 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:20.627 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:20.627 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.627 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.627 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:20.627 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:20.627 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:20.627 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:20.627 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:20.627 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.627 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.627 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:20.627 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:20.627 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:20.627 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.627 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:20.627 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.627 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:20.628 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.628 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:20.628 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.628 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.encryption 2023-12-03T13:00:20.628 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T13:00:20.628 INFO:teuthology.orchestra.run.smithi003.stdout: def test_encrypted_transfer_1b(): 2023-12-03T13:00:20.628 INFO:teuthology.orchestra.run.smithi003.stdout:> _test_encryption_sse_customer_write(1) 2023-12-03T13:00:20.628 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.628 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:9326: 2023-12-03T13:00:20.628 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.628 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:8766: in _test_encryption_sse_customer_write 2023-12-03T13:00:20.628 INFO:teuthology.orchestra.run.smithi003.stdout: bucket_name = get_new_bucket() 2023-12-03T13:00:20.628 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:20.628 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:20.629 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:20.629 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:20.629 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:20.629 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:20.629 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:20.629 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:20.629 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:20.629 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:20.629 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:20.629 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:20.629 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:20.629 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:20.629 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:20.629 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:20.629 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:20.629 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:20.630 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:20.630 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:20.630 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:20.630 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:20.630 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:20.630 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:20.630 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:20.630 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:20.630 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:20.630 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:20.630 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:20.630 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:20.630 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:20.630 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:20.630 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:20.630 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:20.631 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:20.631 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:20.631 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.631 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.631 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.631 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:20.631 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.631 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:20.631 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.631 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:20.631 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:20.631 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:20.631 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:20.631 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:20.632 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:20.632 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.632 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:20.632 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:20.632 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:20.632 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:20.632 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:20.632 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:20.632 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.632 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:20.632 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:20.632 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:20.632 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:20.632 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:20.632 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:20.632 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:20.633 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:20.633 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:20.633 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:20.633 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:20.633 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.633 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.633 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:20.633 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:20.633 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:20.633 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:20.633 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:20.633 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.633 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.633 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:20.633 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:20.633 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:20.633 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:20.634 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:20.634 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.634 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:20.634 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:20.634 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:20.634 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:20.634 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:20.634 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-403" 2023-12-03T13:00:20.634 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.634 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:20.634 INFO:teuthology.orchestra.run.smithi003.stdout:_________________________ test_encrypted_transfer_1kb __________________________ 2023-12-03T13:00:20.634 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.634 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.634 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.634 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:20.635 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:20.635 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.635 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:20.635 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.635 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:20.635 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:20.635 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:20.635 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.635 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:20.635 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:20.635 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.635 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.635 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:20.635 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:20.635 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.635 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.636 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:20.636 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.636 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:20.636 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:20.636 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.636 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.636 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:20.636 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:20.636 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.636 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:20.636 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:20.636 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:20.636 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:20.636 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:20.636 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.636 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:20.636 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.637 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:20.637 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:20.637 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:20.637 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:20.637 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:20.637 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:20.637 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:20.637 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:20.637 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.637 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.637 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:20.637 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:20.637 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:20.637 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:20.637 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.637 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:20.637 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:20.638 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:20.638 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:20.638 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.638 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.638 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:20.638 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:20.638 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:20.638 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:20.638 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.638 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.638 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:20.638 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:20.638 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:20.638 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.639 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:20.639 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.639 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:20.639 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:20.639 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.639 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:20.639 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:20.639 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:20.639 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:20.639 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:20.639 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:20.639 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.639 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:20.639 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.639 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:20.639 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.640 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.640 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:20.640 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.640 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:20.640 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.640 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:20.640 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:20.640 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:20.640 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:20.640 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:20.640 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:20.640 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.640 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:20.640 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:20.640 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:20.640 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:20.640 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:20.641 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:20.641 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.641 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:20.641 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:20.641 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:20.641 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:20.641 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:20.641 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:20.641 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:20.641 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:20.641 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:20.641 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:20.641 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:20.641 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.641 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.642 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:20.642 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.642 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:20.642 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:20.642 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:20.642 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:20.642 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:20.642 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:20.642 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:20.642 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:20.642 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:20.642 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:20.642 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:20.642 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:20.642 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:20.642 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:20.643 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:20.643 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:20.643 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:20.643 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:20.643 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:20.643 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:20.643 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:20.643 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:20.643 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:20.643 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:20.643 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:20.643 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:20.643 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:20.643 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:20.643 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.643 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.644 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.644 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.644 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:20.644 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:20.644 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.644 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:20.644 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.644 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:20.644 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:20.644 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:20.644 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.644 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:20.644 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:20.644 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.644 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.644 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:20.645 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:20.645 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.645 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.645 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:20.645 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:20.645 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:20.645 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:20.645 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:20.645 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.645 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.645 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:20.645 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:20.645 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:20.645 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.645 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:20.646 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.646 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:20.646 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.646 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:20.646 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.646 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.encryption 2023-12-03T13:00:20.646 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T13:00:20.646 INFO:teuthology.orchestra.run.smithi003.stdout: def test_encrypted_transfer_1kb(): 2023-12-03T13:00:20.646 INFO:teuthology.orchestra.run.smithi003.stdout:> _test_encryption_sse_customer_write(1024) 2023-12-03T13:00:20.646 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.646 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:9332: 2023-12-03T13:00:20.646 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.646 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:8766: in _test_encryption_sse_customer_write 2023-12-03T13:00:20.646 INFO:teuthology.orchestra.run.smithi003.stdout: bucket_name = get_new_bucket() 2023-12-03T13:00:20.646 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:20.646 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:20.647 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:20.647 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:20.647 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:20.647 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:20.647 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:20.647 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:20.647 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:20.647 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:20.647 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:20.647 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:20.647 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:20.647 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:20.647 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:20.647 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:20.647 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:20.647 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:20.648 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:20.648 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:20.648 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:20.648 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:20.648 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:20.648 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:20.648 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:20.648 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:20.648 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:20.648 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:20.648 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:20.648 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:20.648 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:20.648 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:20.648 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:20.648 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:20.648 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:20.649 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:20.649 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.649 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.649 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.649 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:20.649 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.649 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:20.649 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.649 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:20.649 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:20.649 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:20.649 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:20.649 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:20.649 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:20.650 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.650 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:20.650 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:20.650 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:20.650 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:20.650 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:20.650 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:20.650 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.650 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:20.650 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:20.650 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:20.650 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:20.650 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:20.650 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:20.650 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:20.651 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:20.651 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:20.651 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:20.651 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:20.651 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.651 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.651 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:20.651 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:20.651 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:20.651 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:20.651 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:20.651 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.651 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.651 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:20.651 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:20.651 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:20.652 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:20.652 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:20.652 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.652 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:20.652 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:20.652 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:20.652 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:20.652 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:20.652 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-404" 2023-12-03T13:00:20.652 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.652 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:20.652 INFO:teuthology.orchestra.run.smithi003.stdout:_________________________ test_encrypted_transfer_1MB __________________________ 2023-12-03T13:00:20.652 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.652 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.652 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.652 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:20.653 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:20.653 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.653 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:20.653 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.653 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:20.653 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:20.653 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:20.653 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.653 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:20.653 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:20.653 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.653 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.653 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:20.653 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:20.653 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.653 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.653 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:20.654 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.654 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:20.654 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:20.654 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.654 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.654 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:20.654 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:20.654 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.654 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:20.654 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:20.654 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:20.654 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:20.654 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:20.654 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.654 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:20.654 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.654 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:20.655 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:20.655 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:20.655 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:20.655 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:20.655 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:20.655 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:20.655 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:20.655 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.655 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.655 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:20.655 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:20.655 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:20.655 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:20.655 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.655 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:20.655 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:20.656 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:20.656 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:20.656 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.656 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.656 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:20.656 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:20.656 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:20.656 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:20.656 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.656 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.656 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:20.656 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:20.656 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:20.656 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.656 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:20.656 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.656 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:20.657 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:20.657 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.657 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:20.657 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:20.657 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:20.657 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:20.657 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:20.657 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:20.657 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.657 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:20.657 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.657 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:20.657 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.657 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.657 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:20.657 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.657 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:20.658 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.658 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:20.658 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:20.658 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:20.658 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:20.658 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:20.658 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:20.658 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.658 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:20.658 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:20.658 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:20.658 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:20.658 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:20.658 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:20.658 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.658 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:20.659 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:20.659 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:20.659 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:20.659 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:20.659 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:20.659 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:20.659 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:20.659 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:20.659 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:20.659 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:20.659 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.659 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.659 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:20.659 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.659 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:20.659 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:20.659 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:20.660 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:20.660 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:20.660 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:20.660 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:20.660 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:20.660 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:20.660 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:20.660 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:20.660 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:20.660 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:20.660 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:20.660 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:20.660 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:20.660 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:20.661 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:20.661 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:20.661 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:20.661 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:20.661 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:20.661 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:20.661 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:20.661 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:20.661 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:20.661 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:20.661 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:20.661 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.661 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.661 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.661 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.661 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:20.662 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:20.662 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.662 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:20.662 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.662 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:20.662 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:20.662 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:20.662 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.662 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:20.662 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:20.662 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.662 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.662 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:20.662 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:20.662 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.662 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.663 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:20.663 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:20.663 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:20.663 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:20.663 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:20.663 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.663 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.663 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:20.663 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:20.663 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:20.663 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.663 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:20.663 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.663 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:20.663 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.663 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:20.664 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.664 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.encryption 2023-12-03T13:00:20.664 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T13:00:20.664 INFO:teuthology.orchestra.run.smithi003.stdout: def test_encrypted_transfer_1MB(): 2023-12-03T13:00:20.664 INFO:teuthology.orchestra.run.smithi003.stdout:> _test_encryption_sse_customer_write(1024*1024) 2023-12-03T13:00:20.664 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.664 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:9338: 2023-12-03T13:00:20.664 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.664 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:8766: in _test_encryption_sse_customer_write 2023-12-03T13:00:20.664 INFO:teuthology.orchestra.run.smithi003.stdout: bucket_name = get_new_bucket() 2023-12-03T13:00:20.664 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:20.664 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:20.664 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:20.664 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:20.664 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:20.664 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:20.665 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:20.665 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:20.665 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:20.665 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:20.665 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:20.665 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:20.665 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:20.665 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:20.665 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:20.665 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:20.665 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:20.665 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:20.665 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:20.665 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:20.665 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:20.665 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:20.666 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:20.666 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:20.666 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:20.666 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:20.666 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:20.666 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:20.666 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:20.666 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:20.666 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:20.666 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:20.666 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:20.666 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:20.666 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:20.666 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:20.666 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.667 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.667 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.667 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:20.667 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.667 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:20.667 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.667 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:20.667 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:20.667 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:20.667 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:20.667 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:20.667 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:20.667 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.667 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:20.667 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:20.667 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:20.667 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:20.668 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:20.668 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:20.668 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.668 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:20.668 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:20.668 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:20.668 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:20.668 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:20.668 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:20.668 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:20.668 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:20.668 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:20.668 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:20.668 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:20.668 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.668 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.669 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:20.669 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:20.669 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:20.669 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:20.669 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:20.669 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.669 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.669 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:20.669 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:20.669 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:20.669 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:20.669 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:20.669 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.669 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:20.669 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:20.669 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:20.669 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:20.670 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:20.670 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-405" 2023-12-03T13:00:20.670 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.670 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:20.670 INFO:teuthology.orchestra.run.smithi003.stdout:_________________________ test_encrypted_transfer_13b __________________________ 2023-12-03T13:00:20.670 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.670 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.670 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.670 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:20.670 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:20.670 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.670 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:20.670 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.671 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:20.671 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:20.671 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:20.671 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.671 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:20.671 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:20.671 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.671 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.671 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:20.671 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:20.671 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.671 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.671 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:20.671 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.671 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:20.672 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:20.672 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.672 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.672 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:20.672 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:20.672 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.672 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:20.672 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:20.672 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:20.672 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:20.672 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:20.672 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.672 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:20.672 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.672 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:20.673 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:20.673 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:20.673 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:20.673 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:20.673 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:20.673 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:20.673 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:20.673 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.673 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.673 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:20.673 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:20.673 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:20.673 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:20.673 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.673 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:20.673 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:20.674 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:20.674 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:20.674 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.674 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.674 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:20.674 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:20.674 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:20.674 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:20.674 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.674 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.674 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:20.674 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:20.674 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:20.674 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.674 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:20.675 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.675 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:20.675 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:20.675 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.675 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:20.675 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:20.675 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:20.675 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:20.675 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:20.675 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:20.675 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.675 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:20.675 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.675 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:20.675 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.675 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.675 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:20.676 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.676 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:20.676 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.676 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:20.676 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:20.676 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:20.676 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:20.676 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:20.676 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:20.676 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.676 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:20.676 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:20.676 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:20.676 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:20.676 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:20.676 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:20.677 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.677 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:20.677 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:20.677 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:20.677 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:20.677 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:20.677 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:20.677 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:20.677 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:20.677 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:20.677 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:20.677 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:20.677 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.677 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.677 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:20.677 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.678 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:20.678 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:20.678 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:20.678 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:20.678 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:20.678 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:20.678 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:20.678 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:20.678 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:20.678 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:20.678 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:20.678 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:20.678 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:20.678 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:20.678 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:20.678 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:20.679 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:20.679 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:20.679 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:20.679 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:20.679 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:20.679 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:20.679 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:20.679 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:20.679 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:20.679 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:20.679 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:20.679 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:20.679 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.679 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.679 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.679 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.680 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:20.680 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:20.680 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.680 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:20.680 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.680 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:20.680 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:20.680 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:20.680 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.680 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:20.680 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:20.680 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.680 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.680 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:20.680 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:20.680 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.680 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.681 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:20.681 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:20.681 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:20.681 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:20.681 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:20.681 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.681 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.681 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:20.681 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:20.681 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:20.681 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.681 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:20.681 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.681 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:20.681 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.681 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:20.681 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.682 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.encryption 2023-12-03T13:00:20.682 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T13:00:20.682 INFO:teuthology.orchestra.run.smithi003.stdout: def test_encrypted_transfer_13b(): 2023-12-03T13:00:20.682 INFO:teuthology.orchestra.run.smithi003.stdout:> _test_encryption_sse_customer_write(13) 2023-12-03T13:00:20.682 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.682 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:9344: 2023-12-03T13:00:20.682 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.682 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:8766: in _test_encryption_sse_customer_write 2023-12-03T13:00:20.682 INFO:teuthology.orchestra.run.smithi003.stdout: bucket_name = get_new_bucket() 2023-12-03T13:00:20.682 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:20.682 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:20.682 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:20.682 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:20.683 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:20.683 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:20.683 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:20.683 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:20.683 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:20.683 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:20.683 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:20.683 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:20.683 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:20.683 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:20.683 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:20.683 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:20.683 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:20.683 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:20.683 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:20.683 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:20.683 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:20.684 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:20.684 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:20.684 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:20.684 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:20.684 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:20.684 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:20.684 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:20.684 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:20.684 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:20.684 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:20.684 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:20.684 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:20.684 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:20.684 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:20.684 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:20.684 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.685 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.685 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.685 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:20.685 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.685 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:20.685 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.685 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:20.685 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:20.685 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:20.685 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:20.685 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:20.685 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:20.685 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.685 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:20.685 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:20.685 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:20.686 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:20.686 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:20.686 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:20.686 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.686 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:20.686 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:20.686 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:20.686 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:20.686 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:20.686 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:20.686 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:20.686 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:20.686 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:20.686 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:20.686 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:20.687 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.687 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.687 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:20.687 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:20.687 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:20.687 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:20.687 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:20.687 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.687 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.687 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:20.687 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:20.687 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:20.687 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:20.687 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:20.687 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.687 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:20.688 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:20.688 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:20.688 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:20.688 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:20.688 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-406" 2023-12-03T13:00:20.688 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.688 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:20.688 INFO:teuthology.orchestra.run.smithi003.stdout:______________________ test_encryption_sse_c_method_head _______________________ 2023-12-03T13:00:20.688 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.688 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.688 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.688 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:20.688 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:20.688 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.688 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:20.688 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.688 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:20.689 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:20.689 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:20.689 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.689 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:20.689 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:20.689 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.689 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.689 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:20.689 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:20.689 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.689 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.689 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:20.689 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.689 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:20.689 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:20.689 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.689 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.690 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:20.690 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:20.690 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.690 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:20.690 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:20.690 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:20.690 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:20.690 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:20.690 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.690 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:20.690 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.690 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:20.690 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:20.690 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:20.690 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:20.690 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:20.691 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:20.691 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:20.691 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:20.691 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.691 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.691 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:20.691 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:20.691 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:20.691 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:20.691 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.691 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:20.691 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:20.691 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:20.691 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:20.691 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.691 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.691 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:20.692 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:20.692 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:20.692 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:20.692 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.692 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.692 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:20.692 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:20.692 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:20.692 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.692 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:20.692 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.692 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:20.692 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:20.692 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.693 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:20.693 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:20.693 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:20.693 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:20.693 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:20.693 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:20.693 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.693 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:20.693 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.693 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:20.693 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.693 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.693 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:20.693 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.693 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:20.693 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.694 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:20.694 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:20.694 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:20.694 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:20.694 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:20.694 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:20.694 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.694 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:20.694 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:20.694 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:20.694 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:20.694 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:20.694 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:20.694 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.694 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:20.694 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:20.695 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:20.695 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:20.695 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:20.695 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:20.695 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:20.695 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:20.695 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:20.695 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:20.695 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:20.695 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.695 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.695 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:20.695 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.695 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:20.695 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:20.695 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:20.695 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:20.696 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:20.696 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:20.696 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:20.696 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:20.696 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:20.696 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:20.696 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:20.696 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:20.696 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:20.696 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:20.696 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:20.696 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:20.696 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:20.696 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:20.696 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:20.696 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:20.697 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:20.697 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:20.697 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:20.697 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:20.697 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:20.697 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:20.697 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:20.697 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:20.697 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.697 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.697 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.697 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.697 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:20.697 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:20.697 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.697 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:20.697 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.698 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:20.698 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:20.698 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:20.698 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.698 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:20.698 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:20.698 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.698 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.698 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:20.698 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:20.698 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.698 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.698 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:20.698 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:20.698 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:20.699 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:20.699 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:20.699 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.699 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.699 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:20.699 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:20.699 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:20.699 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.699 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:20.699 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.699 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:20.699 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.699 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:20.699 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.699 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.encryption 2023-12-03T13:00:20.699 INFO:teuthology.orchestra.run.smithi003.stdout: def test_encryption_sse_c_method_head(): 2023-12-03T13:00:20.699 INFO:teuthology.orchestra.run.smithi003.stdout:> bucket_name = get_new_bucket() 2023-12-03T13:00:20.700 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.700 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:9349: 2023-12-03T13:00:20.700 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.700 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:20.700 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:20.700 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:20.700 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:20.700 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:20.700 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:20.700 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:20.700 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:20.700 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:20.700 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:20.700 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:20.700 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:20.700 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:20.700 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:20.701 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:20.701 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:20.701 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:20.701 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:20.701 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:20.701 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:20.701 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:20.701 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:20.701 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:20.701 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:20.701 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:20.701 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:20.701 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:20.701 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:20.701 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:20.701 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:20.702 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:20.702 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:20.702 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:20.702 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:20.702 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:20.702 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:20.702 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.702 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.702 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.702 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:20.702 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.702 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:20.702 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.702 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:20.703 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:20.703 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:20.703 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:20.703 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:20.703 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:20.703 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.703 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:20.703 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:20.703 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:20.703 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:20.703 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:20.703 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:20.703 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.703 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:20.704 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:20.704 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:20.704 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:20.704 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:20.704 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:20.704 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:20.704 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:20.704 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:20.704 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:20.704 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:20.704 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.704 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.704 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:20.704 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:20.704 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:20.704 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:20.704 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:20.705 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.705 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.705 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:20.705 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:20.705 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:20.705 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:20.705 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:20.705 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.705 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:20.705 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:20.705 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:20.705 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:20.705 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:20.705 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-407" 2023-12-03T13:00:20.705 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.705 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:20.706 INFO:teuthology.orchestra.run.smithi003.stdout:________________________ test_encryption_sse_c_present _________________________ 2023-12-03T13:00:20.706 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.706 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.706 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.706 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:20.706 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:20.706 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.706 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:20.706 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.706 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:20.706 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:20.706 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:20.706 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.706 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:20.706 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:20.706 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.707 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.707 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:20.707 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:20.707 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.707 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.707 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:20.707 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.707 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:20.707 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:20.707 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.707 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.707 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:20.707 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:20.707 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.707 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:20.707 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:20.707 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:20.708 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:20.708 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:20.708 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.708 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:20.708 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.708 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:20.708 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:20.708 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:20.708 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:20.708 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:20.708 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:20.708 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:20.708 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:20.708 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.708 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.709 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:20.709 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:20.709 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:20.709 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:20.709 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.709 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:20.709 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:20.709 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:20.709 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:20.709 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.709 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.709 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:20.709 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:20.709 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:20.709 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:20.709 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.709 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.710 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:20.710 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:20.710 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:20.710 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.710 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:20.710 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.710 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:20.710 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:20.710 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.710 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:20.710 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:20.710 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:20.710 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:20.710 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:20.710 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:20.710 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.711 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:20.711 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.711 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:20.711 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.711 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.711 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:20.711 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.711 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:20.711 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.711 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:20.711 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:20.711 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:20.711 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:20.711 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:20.711 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:20.711 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.712 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:20.712 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:20.712 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:20.712 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:20.712 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:20.712 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:20.712 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.712 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:20.712 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:20.712 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:20.712 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:20.712 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:20.712 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:20.712 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:20.712 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:20.712 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:20.713 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:20.713 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:20.713 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.713 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.713 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:20.713 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.713 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:20.713 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:20.713 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:20.713 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:20.713 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:20.713 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:20.713 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:20.713 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:20.713 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:20.713 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:20.713 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:20.714 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:20.714 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:20.714 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:20.714 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:20.714 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:20.714 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:20.714 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:20.714 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:20.714 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:20.714 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:20.714 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:20.714 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:20.714 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:20.714 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:20.715 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:20.715 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:20.715 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:20.715 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.715 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.715 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.715 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.715 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:20.715 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:20.715 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.715 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:20.715 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.715 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:20.715 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:20.715 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:20.715 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.716 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:20.716 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:20.716 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.716 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.716 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:20.716 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:20.716 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.716 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.716 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:20.716 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:20.716 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:20.716 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:20.716 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:20.716 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.716 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.716 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:20.716 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:20.717 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:20.717 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.717 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:20.717 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.717 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:20.717 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.717 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:20.717 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.717 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.encryption 2023-12-03T13:00:20.717 INFO:teuthology.orchestra.run.smithi003.stdout: def test_encryption_sse_c_present(): 2023-12-03T13:00:20.717 INFO:teuthology.orchestra.run.smithi003.stdout:> bucket_name = get_new_bucket() 2023-12-03T13:00:20.717 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.717 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:9374: 2023-12-03T13:00:20.717 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.717 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:20.717 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:20.718 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:20.718 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:20.718 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:20.718 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:20.718 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:20.718 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:20.718 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:20.718 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:20.718 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:20.718 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:20.718 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:20.718 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:20.718 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:20.718 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:20.718 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:20.718 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:20.718 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:20.719 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:20.719 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:20.719 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:20.719 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:20.719 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:20.719 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:20.719 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:20.719 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:20.719 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:20.719 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:20.719 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:20.719 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:20.719 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:20.719 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:20.720 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:20.720 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:20.720 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:20.720 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.720 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.720 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.720 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:20.720 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.720 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:20.720 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.720 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:20.720 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:20.720 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:20.720 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:20.720 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:20.720 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:20.720 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.721 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:20.721 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:20.721 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:20.721 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:20.721 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:20.721 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:20.721 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.721 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:20.721 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:20.721 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:20.721 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:20.721 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:20.721 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:20.721 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:20.721 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:20.722 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:20.722 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:20.722 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:20.722 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.722 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.722 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:20.722 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:20.722 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:20.722 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:20.722 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:20.722 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.722 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.722 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:20.722 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:20.722 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:20.722 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:20.722 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:20.723 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.723 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:20.723 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:20.723 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:20.723 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:20.723 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:20.723 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-408" 2023-12-03T13:00:20.723 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.723 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:20.723 INFO:teuthology.orchestra.run.smithi003.stdout:_______________________ test_encryption_sse_c_other_key ________________________ 2023-12-03T13:00:20.723 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.723 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.723 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.723 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:20.723 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:20.723 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.724 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:20.724 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.724 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:20.724 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:20.724 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:20.724 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.724 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:20.724 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:20.724 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.724 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.724 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:20.724 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:20.724 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.724 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.724 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:20.725 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.725 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:20.725 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:20.725 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.725 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.725 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:20.725 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:20.725 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.725 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:20.725 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:20.725 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:20.725 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:20.725 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:20.725 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.725 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:20.725 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.726 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:20.726 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:20.726 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:20.726 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:20.726 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:20.726 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:20.726 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:20.726 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:20.726 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.726 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.726 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:20.726 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:20.726 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:20.726 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:20.726 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.726 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:20.727 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:20.727 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:20.727 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:20.727 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.727 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.727 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:20.727 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:20.727 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:20.727 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:20.727 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.727 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.727 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:20.727 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:20.727 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:20.727 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.728 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:20.728 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.728 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:20.728 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:20.728 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.728 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:20.728 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:20.728 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:20.728 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:20.728 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:20.728 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:20.728 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.728 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:20.728 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.728 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:20.728 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.728 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.729 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:20.729 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.729 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:20.729 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.729 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:20.729 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:20.729 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:20.729 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:20.729 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:20.729 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:20.729 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.729 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:20.729 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:20.729 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:20.729 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:20.729 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:20.729 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:20.730 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.730 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:20.730 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:20.730 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:20.730 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:20.730 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:20.730 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:20.730 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:20.730 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:20.730 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:20.730 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:20.730 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:20.730 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.730 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.730 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:20.730 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.731 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:20.731 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:20.731 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:20.731 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:20.731 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:20.731 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:20.731 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:20.731 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:20.731 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:20.731 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:20.731 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:20.731 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:20.731 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:20.731 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:20.731 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:20.732 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:20.732 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:20.732 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:20.732 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:20.732 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:20.732 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:20.732 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:20.732 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:20.732 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:20.732 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:20.732 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:20.732 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:20.732 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:20.732 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.732 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.732 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.732 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.733 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:20.733 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:20.733 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.733 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:20.733 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.733 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:20.733 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:20.733 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:20.733 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.733 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:20.733 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:20.733 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.733 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.733 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:20.733 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:20.733 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.734 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.734 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:20.734 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:20.734 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:20.734 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:20.734 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:20.734 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.734 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.734 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:20.734 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:20.734 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:20.734 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.734 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:20.734 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.734 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:20.734 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.734 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:20.735 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.735 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.encryption 2023-12-03T13:00:20.735 INFO:teuthology.orchestra.run.smithi003.stdout: def test_encryption_sse_c_other_key(): 2023-12-03T13:00:20.735 INFO:teuthology.orchestra.run.smithi003.stdout:> bucket_name = get_new_bucket() 2023-12-03T13:00:20.735 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.735 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:9394: 2023-12-03T13:00:20.735 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.735 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:20.735 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:20.735 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:20.735 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:20.735 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:20.735 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:20.735 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:20.735 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:20.736 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:20.736 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:20.736 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:20.736 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:20.736 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:20.736 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:20.736 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:20.736 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:20.736 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:20.736 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:20.736 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:20.736 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:20.736 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:20.736 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:20.736 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:20.736 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:20.737 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:20.737 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:20.737 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:20.737 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:20.737 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:20.737 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:20.737 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:20.737 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:20.737 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:20.737 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:20.737 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:20.737 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:20.737 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.737 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.737 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.737 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:20.738 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.738 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:20.738 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.738 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:20.738 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:20.738 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:20.738 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:20.738 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:20.738 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:20.738 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.738 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:20.738 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:20.738 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:20.738 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:20.738 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:20.738 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:20.739 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.739 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:20.739 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:20.739 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:20.739 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:20.739 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:20.739 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:20.739 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:20.739 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:20.739 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:20.739 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:20.739 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:20.739 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.739 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.739 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:20.739 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:20.740 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:20.740 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:20.740 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:20.740 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.740 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.740 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:20.740 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:20.740 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:20.740 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:20.740 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:20.740 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.740 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:20.740 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:20.740 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:20.740 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:20.740 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:20.740 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-409" 2023-12-03T13:00:20.741 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.741 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:20.741 INFO:teuthology.orchestra.run.smithi003.stdout:______________________ test_encryption_sse_c_invalid_md5 _______________________ 2023-12-03T13:00:20.741 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.741 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.741 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.741 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:20.741 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:20.741 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.741 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:20.741 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.741 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:20.741 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:20.741 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:20.741 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.741 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:20.742 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:20.742 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.742 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.742 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:20.742 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:20.742 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.742 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.742 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:20.742 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.742 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:20.742 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:20.742 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.742 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.742 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:20.742 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:20.743 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.743 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:20.743 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:20.743 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:20.743 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:20.743 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:20.743 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.743 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:20.743 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.743 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:20.743 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:20.743 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:20.743 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:20.743 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:20.743 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:20.743 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:20.744 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:20.744 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.744 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.744 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:20.744 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:20.744 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:20.744 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:20.744 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.744 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:20.744 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:20.744 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:20.744 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:20.744 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.744 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.744 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:20.744 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:20.744 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:20.745 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:20.745 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.745 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.745 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:20.745 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:20.745 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:20.745 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.745 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:20.745 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.745 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:20.745 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:20.745 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.745 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:20.745 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:20.745 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:20.745 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:20.745 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:20.746 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:20.746 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.746 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:20.746 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.746 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:20.746 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.746 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.746 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:20.746 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.746 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:20.746 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.746 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:20.746 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:20.746 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:20.747 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:20.747 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:20.747 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:20.747 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.747 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:20.747 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:20.747 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:20.747 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:20.747 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:20.747 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:20.747 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.747 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:20.747 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:20.747 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:20.747 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:20.747 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:20.747 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:20.748 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:20.748 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:20.748 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:20.748 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:20.748 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:20.748 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.748 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.748 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:20.748 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.748 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:20.748 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:20.748 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:20.748 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:20.748 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:20.748 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:20.748 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:20.749 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:20.749 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:20.749 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:20.749 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:20.749 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:20.749 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:20.749 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:20.749 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:20.749 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:20.749 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:20.749 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:20.749 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:20.749 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:20.749 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:20.749 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:20.749 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:20.749 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:20.750 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:20.750 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:20.750 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:20.750 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:20.750 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.750 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.750 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.750 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.750 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:20.750 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:20.750 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.750 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:20.750 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.750 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:20.750 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:20.750 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:20.751 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.751 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:20.751 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:20.751 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.751 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.751 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:20.751 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:20.751 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.751 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.751 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:20.751 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:20.751 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:20.751 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:20.751 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:20.751 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.751 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.752 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:20.752 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:20.752 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:20.752 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.752 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:20.752 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.752 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:20.752 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.752 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:20.752 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.752 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.encryption 2023-12-03T13:00:20.752 INFO:teuthology.orchestra.run.smithi003.stdout: def test_encryption_sse_c_invalid_md5(): 2023-12-03T13:00:20.752 INFO:teuthology.orchestra.run.smithi003.stdout:> bucket_name = get_new_bucket() 2023-12-03T13:00:20.752 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.752 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:9421: 2023-12-03T13:00:20.752 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.753 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:20.753 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:20.753 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:20.753 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:20.753 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:20.753 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:20.753 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:20.753 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:20.753 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:20.753 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:20.753 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:20.753 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:20.753 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:20.753 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:20.753 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:20.753 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:20.753 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:20.754 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:20.754 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:20.754 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:20.754 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:20.754 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:20.754 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:20.754 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:20.754 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:20.754 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:20.754 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:20.754 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:20.754 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:20.754 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:20.754 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:20.754 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:20.754 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:20.755 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:20.755 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:20.755 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:20.755 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.755 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.755 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.755 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:20.755 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.755 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:20.755 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.755 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:20.755 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:20.755 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:20.755 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:20.755 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:20.755 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:20.756 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.756 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:20.756 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:20.756 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:20.756 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:20.756 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:20.756 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:20.756 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.756 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:20.756 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:20.756 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:20.756 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:20.756 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:20.756 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:20.756 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:20.757 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:20.757 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:20.757 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:20.757 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:20.757 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.757 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.757 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:20.757 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:20.757 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:20.757 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:20.757 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:20.757 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.757 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.757 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:20.757 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:20.757 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:20.758 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:20.758 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:20.758 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.758 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:20.758 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:20.758 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:20.758 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:20.758 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:20.758 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-410" 2023-12-03T13:00:20.758 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.758 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:20.758 INFO:teuthology.orchestra.run.smithi003.stdout:_________________________ test_encryption_sse_c_no_md5 _________________________ 2023-12-03T13:00:20.758 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.758 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.758 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.758 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:20.759 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:20.759 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.759 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:20.759 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.759 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:20.759 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:20.759 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:20.759 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.759 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:20.759 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:20.759 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.759 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.759 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:20.759 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:20.759 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.759 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.760 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:20.760 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.760 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:20.760 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:20.760 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.760 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.760 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:20.760 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:20.760 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.760 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:20.760 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:20.760 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:20.760 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:20.760 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:20.760 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.760 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:20.760 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.761 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:20.761 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:20.761 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:20.761 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:20.761 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:20.761 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:20.761 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:20.761 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:20.761 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.761 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.761 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:20.761 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:20.761 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:20.761 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:20.761 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.761 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:20.762 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:20.762 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:20.762 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:20.762 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.762 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.762 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:20.762 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:20.762 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:20.762 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:20.762 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.762 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.762 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:20.762 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:20.762 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:20.762 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.763 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:20.763 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.763 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:20.763 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:20.763 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.763 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:20.763 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:20.763 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:20.763 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:20.763 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:20.763 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:20.763 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.763 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:20.763 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.763 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:20.763 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.763 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.764 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:20.764 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.764 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:20.764 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.764 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:20.764 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:20.764 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:20.764 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:20.764 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:20.764 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:20.764 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.764 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:20.764 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:20.764 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:20.764 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:20.764 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:20.765 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:20.765 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.765 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:20.765 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:20.765 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:20.765 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:20.765 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:20.765 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:20.765 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:20.765 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:20.765 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:20.765 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:20.765 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:20.765 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.765 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.765 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:20.765 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.766 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:20.766 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:20.766 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:20.766 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:20.766 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:20.766 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:20.766 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:20.766 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:20.766 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:20.766 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:20.766 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:20.766 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:20.766 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:20.766 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:20.766 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:20.766 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:20.767 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:20.767 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:20.767 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:20.767 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:20.767 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:20.767 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:20.767 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:20.767 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:20.767 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:20.767 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:20.767 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:20.767 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:20.767 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.767 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.767 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.768 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.768 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:20.768 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:20.768 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.768 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:20.768 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.768 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:20.768 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:20.768 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:20.768 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.768 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:20.768 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:20.768 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.768 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.768 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:20.768 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:20.769 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.769 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.769 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:20.769 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:20.769 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:20.769 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:20.769 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:20.769 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.769 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.769 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:20.769 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:20.769 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:20.769 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.769 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:20.769 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.769 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:20.770 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.770 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:20.770 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.770 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.encryption 2023-12-03T13:00:20.770 INFO:teuthology.orchestra.run.smithi003.stdout: def test_encryption_sse_c_no_md5(): 2023-12-03T13:00:20.770 INFO:teuthology.orchestra.run.smithi003.stdout:> bucket_name = get_new_bucket() 2023-12-03T13:00:20.770 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.770 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:9439: 2023-12-03T13:00:20.770 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.770 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:20.770 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:20.770 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:20.770 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:20.770 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:20.770 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:20.770 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:20.771 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:20.771 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:20.771 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:20.771 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:20.771 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:20.771 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:20.771 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:20.771 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:20.771 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:20.771 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:20.771 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:20.771 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:20.771 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:20.771 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:20.771 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:20.771 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:20.772 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:20.772 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:20.772 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:20.772 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:20.772 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:20.772 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:20.772 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:20.772 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:20.772 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:20.772 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:20.772 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:20.772 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:20.772 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:20.772 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.772 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.772 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.773 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:20.773 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.773 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:20.773 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.773 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:20.773 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:20.773 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:20.773 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:20.773 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:20.773 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:20.773 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.773 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:20.773 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:20.773 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:20.773 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:20.773 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:20.773 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:20.774 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.774 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:20.774 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:20.774 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:20.774 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:20.774 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:20.774 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:20.774 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:20.774 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:20.774 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:20.774 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:20.774 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:20.774 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.774 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.774 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:20.774 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:20.775 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:20.775 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:20.775 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:20.775 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.775 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.775 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:20.775 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:20.775 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:20.775 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:20.775 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:20.775 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.775 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:20.775 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:20.775 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:20.775 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:20.775 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:20.775 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-411" 2023-12-03T13:00:20.776 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.776 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:20.776 INFO:teuthology.orchestra.run.smithi003.stdout:_________________________ test_encryption_sse_c_no_key _________________________ 2023-12-03T13:00:20.776 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.776 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.776 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.776 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:20.776 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:20.776 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.776 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:20.776 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.776 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:20.776 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:20.776 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:20.776 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.776 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:20.777 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:20.777 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.777 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.777 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:20.777 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:20.777 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.777 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.777 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:20.777 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.777 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:20.777 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:20.777 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.777 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.777 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:20.777 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:20.777 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.777 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:20.778 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:20.778 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:20.778 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:20.778 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:20.778 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.778 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:20.778 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.778 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:20.778 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:20.778 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:20.778 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:20.778 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:20.778 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:20.778 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:20.779 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:20.779 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.779 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.779 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:20.779 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:20.779 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:20.779 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:20.779 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.779 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:20.779 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:20.779 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:20.779 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:20.779 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.779 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.779 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:20.779 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:20.780 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:20.780 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:20.780 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.780 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.780 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:20.780 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:20.780 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:20.780 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.780 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:20.780 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.780 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:20.780 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:20.780 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.780 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:20.780 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:20.780 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:20.781 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:20.781 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:20.781 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:20.781 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.781 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:20.781 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.781 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:20.781 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.781 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.781 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:20.781 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.781 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:20.781 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.781 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:20.781 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:20.781 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:20.782 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:20.782 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:20.782 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:20.782 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.782 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:20.782 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:20.782 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:20.782 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:20.782 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:20.782 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:20.782 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.782 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:20.782 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:20.782 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:20.782 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:20.782 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:20.783 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:20.783 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:20.783 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:20.783 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:20.783 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:20.783 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:20.783 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.783 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.783 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:20.783 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.783 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:20.783 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:20.783 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:20.783 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:20.783 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:20.783 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:20.784 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:20.784 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:20.784 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:20.784 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:20.784 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:20.784 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:20.784 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:20.784 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:20.784 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:20.784 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:20.784 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:20.784 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:20.784 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:20.784 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:20.784 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:20.784 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:20.785 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:20.785 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:20.785 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:20.785 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:20.785 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:20.785 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:20.785 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.785 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.785 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.785 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.785 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:20.785 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:20.785 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.785 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:20.785 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.785 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:20.785 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:20.786 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:20.786 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.786 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:20.786 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:20.786 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.786 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.786 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:20.786 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:20.786 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.786 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.786 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:20.786 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:20.786 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:20.786 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:20.786 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:20.786 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.787 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.787 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:20.787 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:20.787 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:20.787 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.787 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:20.787 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.787 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:20.787 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.787 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:20.787 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.787 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.encryption 2023-12-03T13:00:20.787 INFO:teuthology.orchestra.run.smithi003.stdout: def test_encryption_sse_c_no_key(): 2023-12-03T13:00:20.787 INFO:teuthology.orchestra.run.smithi003.stdout:> bucket_name = get_new_bucket() 2023-12-03T13:00:20.787 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.788 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:9454: 2023-12-03T13:00:20.788 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.788 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:20.788 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:20.788 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:20.788 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:20.788 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:20.788 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:20.788 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:20.788 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:20.788 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:20.788 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:20.788 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:20.788 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:20.788 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:20.788 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:20.788 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:20.789 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:20.789 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:20.789 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:20.789 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:20.789 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:20.789 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:20.789 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:20.789 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:20.789 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:20.789 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:20.789 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:20.789 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:20.789 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:20.789 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:20.789 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:20.790 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:20.790 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:20.790 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:20.790 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:20.790 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:20.790 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:20.790 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.790 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.790 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.790 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:20.790 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.790 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:20.790 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.790 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:20.790 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:20.790 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:20.791 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:20.791 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:20.791 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:20.791 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.791 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:20.791 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:20.791 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:20.791 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:20.791 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:20.791 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:20.791 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.791 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:20.791 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:20.791 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:20.791 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:20.792 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:20.792 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:20.792 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:20.792 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:20.792 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:20.792 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:20.792 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:20.792 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.792 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.792 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:20.792 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:20.792 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:20.792 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:20.792 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:20.792 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.792 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.792 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:20.793 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:20.793 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:20.793 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:20.793 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:20.793 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.793 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:20.793 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:20.793 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:20.793 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:20.793 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:20.793 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-412" 2023-12-03T13:00:20.793 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.793 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:20.793 INFO:teuthology.orchestra.run.smithi003.stdout:_________________________ test_encryption_key_no_sse_c _________________________ 2023-12-03T13:00:20.793 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.793 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.794 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.794 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:20.794 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:20.794 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.794 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:20.794 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.794 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:20.794 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:20.794 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:20.794 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.794 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:20.794 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:20.794 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.794 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.794 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:20.794 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:20.795 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.795 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.795 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:20.795 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.795 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:20.795 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:20.795 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.795 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.795 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:20.795 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:20.795 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.795 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:20.795 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:20.795 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:20.795 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:20.795 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:20.795 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.796 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:20.796 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.796 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:20.796 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:20.796 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:20.796 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:20.796 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:20.796 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:20.796 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:20.796 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:20.796 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.796 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.796 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:20.796 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:20.796 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:20.796 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:20.796 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.797 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:20.797 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:20.797 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:20.797 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:20.797 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.797 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.797 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:20.797 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:20.797 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:20.797 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:20.797 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.797 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.797 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:20.797 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:20.797 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:20.797 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.798 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:20.798 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.798 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:20.798 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:20.798 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.798 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:20.798 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:20.798 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:20.798 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:20.798 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:20.798 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:20.798 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.798 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:20.798 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.798 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:20.798 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.798 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.799 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:20.799 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.799 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:20.799 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.799 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:20.799 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:20.799 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:20.799 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:20.799 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:20.799 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:20.799 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.799 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:20.799 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:20.799 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:20.800 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:20.800 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:20.800 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:20.800 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.800 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:20.800 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:20.800 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:20.800 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:20.800 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:20.800 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:20.800 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:20.800 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:20.800 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:20.800 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:20.800 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:20.800 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.801 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.801 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:20.801 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.801 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:20.801 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:20.801 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:20.801 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:20.801 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:20.801 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:20.801 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:20.801 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:20.801 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:20.801 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:20.801 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:20.801 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:20.801 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:20.802 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:20.802 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:20.802 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:20.802 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:20.802 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:20.802 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:20.802 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:20.802 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:20.802 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:20.802 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:20.802 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:20.802 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:20.802 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:20.802 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:20.802 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:20.803 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.803 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.803 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.803 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.803 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:20.803 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:20.803 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.803 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:20.803 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.803 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:20.803 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:20.803 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:20.803 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.803 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:20.803 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:20.803 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.804 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.804 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:20.804 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:20.804 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.804 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.804 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:20.804 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:20.804 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:20.804 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:20.804 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:20.804 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.804 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.804 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:20.804 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:20.804 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:20.804 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.804 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:20.805 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.805 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:20.805 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.805 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:20.805 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.805 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.encryption 2023-12-03T13:00:20.805 INFO:teuthology.orchestra.run.smithi003.stdout: def test_encryption_key_no_sse_c(): 2023-12-03T13:00:20.805 INFO:teuthology.orchestra.run.smithi003.stdout:> bucket_name = get_new_bucket() 2023-12-03T13:00:20.805 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.805 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:9468: 2023-12-03T13:00:20.805 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.805 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:20.805 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:20.805 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:20.805 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:20.805 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:20.806 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:20.806 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:20.806 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:20.806 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:20.806 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:20.806 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:20.806 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:20.806 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:20.806 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:20.806 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:20.806 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:20.806 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:20.806 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:20.806 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:20.806 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:20.806 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:20.807 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:20.807 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:20.807 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:20.807 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:20.807 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:20.807 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:20.807 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:20.807 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:20.807 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:20.807 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:20.807 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:20.807 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:20.807 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:20.807 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:20.807 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:20.807 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.808 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.808 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.808 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:20.808 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.808 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:20.808 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.808 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:20.808 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:20.808 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:20.808 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:20.808 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:20.808 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:20.808 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.808 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:20.808 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:20.808 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:20.808 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:20.809 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:20.809 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:20.809 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.809 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:20.809 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:20.809 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:20.809 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:20.809 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:20.809 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:20.809 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:20.809 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:20.809 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:20.809 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:20.809 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:20.809 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.809 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.810 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:20.810 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:20.810 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:20.810 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:20.810 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:20.810 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.810 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.810 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:20.810 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:20.810 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:20.810 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:20.810 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:20.810 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.810 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:20.811 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:20.811 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:20.811 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:20.811 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:20.811 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-413" 2023-12-03T13:00:20.811 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.811 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:20.811 INFO:teuthology.orchestra.run.smithi003.stdout:____________________ test_encryption_sse_c_multipart_upload ____________________ 2023-12-03T13:00:20.811 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.811 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.811 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.811 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:20.811 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:20.811 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.811 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:20.812 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.812 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:20.812 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:20.812 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:20.812 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.812 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:20.812 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:20.812 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.812 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.812 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:20.812 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:20.812 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.812 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.812 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:20.812 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.812 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:20.813 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:20.813 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.813 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.813 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:20.813 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:20.813 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.813 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:20.813 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:20.813 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:20.813 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:20.813 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:20.813 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.813 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:20.813 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.813 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:20.813 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:20.814 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:20.814 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:20.814 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:20.814 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:20.814 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:20.814 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:20.814 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.814 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.814 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:20.814 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:20.814 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:20.814 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:20.814 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.814 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:20.814 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:20.814 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:20.815 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:20.815 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.815 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.815 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:20.815 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:20.815 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:20.815 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:20.815 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.815 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.815 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:20.815 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:20.815 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:20.815 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.815 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:20.815 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.815 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:20.816 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:20.816 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.816 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:20.816 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:20.816 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:20.816 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:20.816 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:20.816 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:20.816 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.816 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:20.816 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.816 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:20.816 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.816 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.816 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:20.816 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.817 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:20.817 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.817 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:20.817 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:20.817 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:20.817 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:20.817 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:20.817 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:20.817 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.817 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:20.817 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:20.817 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:20.817 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:20.817 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:20.817 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:20.817 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.817 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:20.818 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:20.818 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:20.818 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:20.818 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:20.818 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:20.818 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:20.818 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:20.818 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:20.818 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:20.818 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:20.818 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.818 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.818 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:20.818 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.818 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:20.818 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:20.819 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:20.819 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:20.819 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:20.819 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:20.819 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:20.819 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:20.819 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:20.819 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:20.819 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:20.819 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:20.819 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:20.819 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:20.819 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:20.819 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:20.819 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:20.820 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:20.820 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:20.820 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:20.820 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:20.820 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:20.820 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:20.820 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:20.820 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:20.820 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:20.820 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:20.820 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:20.820 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.820 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.820 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.820 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.820 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:20.820 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:20.821 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.821 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:20.821 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.821 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:20.821 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:20.821 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:20.821 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.821 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:20.821 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:20.821 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.821 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.821 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:20.821 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:20.822 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.822 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.822 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:20.822 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:20.822 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:20.822 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:20.822 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:20.822 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.822 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.822 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:20.822 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:20.822 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:20.822 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.822 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:20.822 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.823 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:20.823 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.823 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:20.823 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.823 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.encryption 2023-12-03T13:00:20.823 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T13:00:20.823 INFO:teuthology.orchestra.run.smithi003.stdout: def test_encryption_sse_c_multipart_upload(): 2023-12-03T13:00:20.823 INFO:teuthology.orchestra.run.smithi003.stdout:> bucket_name = get_new_bucket() 2023-12-03T13:00:20.823 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.823 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:9535: 2023-12-03T13:00:20.823 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.823 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:20.823 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:20.823 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:20.823 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:20.823 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:20.823 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:20.824 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:20.824 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:20.824 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:20.824 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:20.824 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:20.824 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:20.824 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:20.824 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:20.824 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:20.824 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:20.824 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:20.824 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:20.824 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:20.824 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:20.824 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:20.825 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:20.825 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:20.825 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:20.825 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:20.825 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:20.825 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:20.825 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:20.825 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:20.825 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:20.825 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:20.825 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:20.825 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:20.825 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:20.825 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:20.825 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:20.825 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.825 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.826 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.826 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:20.826 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.826 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:20.826 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.826 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:20.826 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:20.826 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:20.826 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:20.826 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:20.826 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:20.826 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.826 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:20.826 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:20.826 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:20.827 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:20.827 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:20.827 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:20.827 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.827 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:20.827 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:20.827 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:20.827 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:20.827 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:20.827 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:20.827 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:20.827 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:20.827 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:20.827 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:20.827 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:20.827 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.827 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.828 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:20.828 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:20.828 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:20.828 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:20.828 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:20.828 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.828 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.828 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:20.828 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:20.828 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:20.828 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:20.828 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:20.828 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.828 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:20.828 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:20.828 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:20.829 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:20.829 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:20.829 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-414" 2023-12-03T13:00:20.829 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.829 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:20.829 INFO:teuthology.orchestra.run.smithi003.stdout:_______________ test_encryption_sse_c_unaligned_multipart_upload _______________ 2023-12-03T13:00:20.829 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.829 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.829 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.829 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:20.829 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:20.829 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.829 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:20.829 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.829 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:20.829 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:20.830 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:20.830 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.830 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:20.830 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:20.830 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.830 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.830 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:20.830 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:20.830 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.830 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.830 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:20.830 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.830 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:20.830 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:20.830 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.831 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.831 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:20.831 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:20.831 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.831 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:20.831 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:20.831 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:20.831 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:20.831 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:20.831 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.831 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:20.831 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.831 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:20.831 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:20.831 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:20.831 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:20.832 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:20.832 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:20.832 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:20.832 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:20.832 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.832 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.832 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:20.832 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:20.832 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:20.832 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:20.832 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.832 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:20.832 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:20.832 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:20.832 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:20.833 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.833 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.833 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:20.833 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:20.833 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:20.833 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:20.833 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.833 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.833 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:20.833 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:20.833 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:20.833 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.833 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:20.833 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.833 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:20.834 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:20.834 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.834 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:20.834 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:20.834 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:20.834 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:20.834 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:20.834 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:20.834 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.834 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:20.834 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.834 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:20.834 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.834 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.834 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:20.834 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.834 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:20.835 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.835 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:20.835 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:20.835 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:20.835 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:20.835 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:20.835 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:20.835 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.835 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:20.835 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:20.835 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:20.835 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:20.835 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:20.835 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:20.835 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.836 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:20.836 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:20.836 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:20.836 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:20.836 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:20.836 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:20.836 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:20.836 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:20.836 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:20.836 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:20.836 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:20.836 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.836 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.836 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:20.836 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.836 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:20.836 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:20.837 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:20.837 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:20.837 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:20.837 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:20.837 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:20.837 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:20.837 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:20.837 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:20.837 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:20.837 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:20.837 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:20.837 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:20.837 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:20.837 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:20.837 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:20.837 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:20.838 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:20.838 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:20.838 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:20.838 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:20.838 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:20.838 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:20.838 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:20.838 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:20.838 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:20.838 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:20.838 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.838 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.838 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.838 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.838 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:20.839 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:20.839 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.839 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:20.839 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.839 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:20.839 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:20.839 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:20.839 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.839 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:20.839 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:20.839 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.839 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.839 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:20.839 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:20.839 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.839 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.840 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:20.840 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:20.840 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:20.840 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:20.840 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:20.840 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.840 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.840 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:20.840 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:20.840 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:20.840 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.840 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:20.840 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.840 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:20.840 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.840 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:20.840 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.841 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.encryption 2023-12-03T13:00:20.841 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T13:00:20.841 INFO:teuthology.orchestra.run.smithi003.stdout: def test_encryption_sse_c_unaligned_multipart_upload(): 2023-12-03T13:00:20.841 INFO:teuthology.orchestra.run.smithi003.stdout:> bucket_name = get_new_bucket() 2023-12-03T13:00:20.841 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.841 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:9581: 2023-12-03T13:00:20.841 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.841 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:20.841 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:20.841 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:20.841 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:20.841 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:20.841 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:20.841 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:20.841 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:20.841 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:20.842 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:20.842 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:20.842 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:20.842 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:20.842 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:20.842 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:20.842 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:20.842 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:20.842 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:20.842 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:20.842 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:20.842 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:20.842 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:20.842 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:20.842 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:20.843 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:20.843 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:20.843 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:20.843 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:20.843 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:20.843 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:20.843 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:20.843 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:20.843 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:20.843 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:20.843 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:20.843 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:20.843 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.843 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.843 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.844 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:20.844 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.844 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:20.844 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.844 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:20.844 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:20.844 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:20.844 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:20.844 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:20.844 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:20.844 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.844 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:20.844 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:20.844 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:20.844 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:20.844 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:20.845 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:20.845 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.845 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:20.845 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:20.845 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:20.845 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:20.845 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:20.845 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:20.845 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:20.845 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:20.845 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:20.845 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:20.845 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:20.845 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.845 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.845 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:20.846 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:20.846 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:20.846 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:20.846 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:20.846 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.846 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.846 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:20.846 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:20.846 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:20.846 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:20.846 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:20.846 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.846 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:20.846 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:20.846 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:20.846 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:20.847 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:20.847 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-415" 2023-12-03T13:00:20.847 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.847 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:20.847 INFO:teuthology.orchestra.run.smithi003.stdout:_________________ test_encryption_sse_c_multipart_bad_download _________________ 2023-12-03T13:00:20.847 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.847 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.847 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.847 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:20.847 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:20.847 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.847 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:20.847 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.847 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:20.847 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:20.847 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:20.848 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.848 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:20.848 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:20.848 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.848 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.848 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:20.848 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:20.848 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.848 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.848 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:20.848 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.848 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:20.848 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:20.848 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.848 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.848 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:20.848 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:20.849 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.849 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:20.849 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:20.849 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:20.849 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:20.849 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:20.849 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.849 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:20.849 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.849 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:20.849 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:20.849 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:20.849 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:20.849 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:20.849 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:20.849 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:20.850 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:20.850 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.850 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.850 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:20.850 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:20.850 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:20.850 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:20.850 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.850 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:20.850 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:20.850 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:20.850 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:20.850 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.850 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.850 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:20.850 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:20.851 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:20.851 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:20.851 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.851 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.851 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:20.851 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:20.851 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:20.851 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.851 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:20.851 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.851 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:20.851 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:20.851 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.851 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:20.851 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:20.851 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:20.851 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:20.852 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:20.852 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:20.852 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.852 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:20.852 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.852 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:20.852 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.852 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.852 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:20.852 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.852 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:20.852 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.852 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:20.852 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:20.852 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:20.852 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:20.853 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:20.853 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:20.853 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.853 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:20.853 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:20.853 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:20.853 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:20.853 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:20.853 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:20.853 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.853 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:20.853 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:20.853 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:20.853 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:20.853 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:20.853 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:20.854 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:20.854 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:20.854 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:20.854 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:20.854 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:20.854 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.854 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.854 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:20.854 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.854 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:20.854 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:20.854 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:20.854 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:20.854 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:20.855 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:20.855 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:20.855 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:20.855 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:20.855 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:20.855 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:20.855 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:20.855 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:20.855 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:20.855 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:20.855 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:20.855 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:20.855 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:20.855 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:20.855 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:20.855 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:20.856 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:20.856 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:20.856 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:20.856 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:20.856 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:20.856 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:20.856 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:20.856 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.856 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.856 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.856 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.856 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:20.856 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:20.856 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.856 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:20.856 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.856 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:20.857 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:20.857 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:20.857 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.857 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:20.857 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:20.857 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.857 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.857 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:20.857 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:20.857 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.857 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.857 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:20.857 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:20.857 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:20.857 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:20.858 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:20.858 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.858 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.858 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:20.858 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:20.858 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:20.858 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.858 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:20.858 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.858 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:20.858 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.858 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:20.858 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.858 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.encryption 2023-12-03T13:00:20.858 INFO:teuthology.orchestra.run.smithi003.stdout: def test_encryption_sse_c_multipart_bad_download(): 2023-12-03T13:00:20.858 INFO:teuthology.orchestra.run.smithi003.stdout:> bucket_name = get_new_bucket() 2023-12-03T13:00:20.859 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.859 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:9682: 2023-12-03T13:00:20.859 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.859 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:20.859 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:20.859 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:20.859 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:20.859 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:20.859 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:20.859 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:20.859 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:20.859 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:20.859 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:20.859 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:20.859 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:20.859 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:20.860 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:20.860 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:20.860 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:20.860 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:20.860 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:20.860 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:20.860 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:20.860 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:20.860 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:20.860 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:20.860 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:20.860 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:20.860 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:20.860 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:20.860 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:20.860 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:20.860 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:20.861 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:20.861 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:20.861 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:20.861 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:20.861 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:20.861 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:20.861 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.861 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.861 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.861 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:20.861 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.861 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:20.861 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.861 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:20.861 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:20.861 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:20.862 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:20.862 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:20.862 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:20.862 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.862 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:20.862 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:20.862 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:20.862 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:20.862 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:20.862 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:20.862 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.862 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:20.862 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:20.862 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:20.862 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:20.862 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:20.863 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:20.863 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:20.863 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:20.863 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:20.863 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:20.863 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:20.863 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.863 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.863 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:20.863 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:20.863 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:20.863 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:20.863 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:20.863 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.863 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.863 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:20.863 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:20.864 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:20.864 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:20.864 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:20.864 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.864 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:20.864 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:20.864 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:20.864 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:20.864 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:20.864 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-416" 2023-12-03T13:00:20.864 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.864 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:20.864 INFO:teuthology.orchestra.run.smithi003.stdout:___________ test_encryption_sse_c_post_object_authenticated_request ____________ 2023-12-03T13:00:20.864 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.864 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.865 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.865 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:20.865 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:20.865 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.865 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:20.865 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.865 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:20.865 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:20.865 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:20.865 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.865 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:20.865 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:20.865 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.865 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.865 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:20.865 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:20.866 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.866 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.866 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:20.866 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.866 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:20.866 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:20.866 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.866 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.866 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:20.866 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:20.866 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.866 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:20.866 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:20.866 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:20.866 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:20.866 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:20.867 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.867 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:20.867 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.867 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:20.867 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:20.867 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:20.867 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:20.867 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:20.867 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:20.867 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:20.867 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:20.867 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.867 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.867 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:20.867 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:20.867 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:20.867 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:20.868 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.868 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:20.868 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:20.868 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:20.868 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:20.868 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.868 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.868 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:20.868 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:20.868 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:20.868 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:20.868 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.868 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.868 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:20.868 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:20.868 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:20.869 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.869 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:20.869 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.869 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:20.869 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:20.869 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.869 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:20.869 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:20.869 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:20.869 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:20.869 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:20.869 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:20.869 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.869 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:20.869 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.869 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:20.869 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.870 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.870 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:20.870 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.870 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:20.870 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.870 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:20.870 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:20.870 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:20.870 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:20.870 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:20.870 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:20.870 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.870 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:20.870 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:20.870 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:20.870 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:20.871 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:20.871 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:20.871 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.871 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:20.871 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:20.871 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:20.871 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:20.871 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:20.871 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:20.871 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:20.871 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:20.871 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:20.871 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:20.871 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:20.871 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.871 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.871 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:20.872 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.872 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:20.872 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:20.872 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:20.872 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:20.872 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:20.872 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:20.872 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:20.872 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:20.872 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:20.872 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:20.872 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:20.872 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:20.872 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:20.872 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:20.872 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:20.873 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:20.873 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:20.873 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:20.873 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:20.873 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:20.873 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:20.873 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:20.873 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:20.873 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:20.873 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:20.873 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:20.873 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:20.873 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:20.873 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.873 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.873 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.873 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.874 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:20.874 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:20.874 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.874 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:20.874 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.874 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:20.874 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:20.874 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:20.874 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.874 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:20.874 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:20.874 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.874 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.874 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:20.874 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:20.874 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.875 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.875 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:20.875 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:20.875 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:20.875 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:20.875 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:20.875 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.875 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.875 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:20.875 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:20.875 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:20.875 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.875 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:20.875 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.875 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:20.876 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.876 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:20.876 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.876 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.encryption 2023-12-03T13:00:20.876 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T13:00:20.876 INFO:teuthology.orchestra.run.smithi003.stdout: def test_encryption_sse_c_post_object_authenticated_request(): 2023-12-03T13:00:20.876 INFO:teuthology.orchestra.run.smithi003.stdout:> bucket_name = get_new_bucket() 2023-12-03T13:00:20.876 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.876 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:9729: 2023-12-03T13:00:20.876 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.876 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:20.876 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:20.876 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:20.876 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:20.876 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:20.876 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:20.877 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:20.877 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:20.877 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:20.877 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:20.877 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:20.877 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:20.877 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:20.877 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:20.877 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:20.877 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:20.877 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:20.877 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:20.877 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:20.877 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:20.877 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:20.877 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:20.877 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:20.878 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:20.878 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:20.878 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:20.878 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:20.878 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:20.878 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:20.878 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:20.878 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:20.878 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:20.878 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:20.878 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:20.878 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:20.878 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:20.878 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.878 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.878 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.879 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:20.879 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.879 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:20.879 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.879 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:20.879 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:20.879 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:20.879 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:20.879 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:20.879 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:20.879 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.879 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:20.879 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:20.879 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:20.879 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:20.879 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:20.879 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:20.880 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.880 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:20.880 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:20.880 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:20.880 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:20.880 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:20.880 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:20.880 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:20.880 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:20.880 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:20.880 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:20.880 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:20.880 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.880 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.880 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:20.880 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:20.881 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:20.881 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:20.881 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:20.881 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.881 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.881 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:20.881 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:20.881 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:20.881 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:20.881 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:20.881 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.881 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:20.881 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:20.881 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:20.882 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:20.882 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:20.882 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-417" 2023-12-03T13:00:20.882 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.882 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:20.882 INFO:teuthology.orchestra.run.smithi003.stdout:___________________________ test_sse_kms_method_head ___________________________ 2023-12-03T13:00:20.882 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.882 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.882 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.882 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:20.882 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:20.882 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.882 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:20.882 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.882 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:20.882 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:20.883 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:20.883 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.883 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:20.883 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:20.883 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.883 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.883 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:20.883 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:20.883 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.883 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.883 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:20.883 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.883 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:20.883 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:20.883 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.883 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.883 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:20.884 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:20.884 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.884 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:20.884 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:20.884 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:20.884 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:20.884 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:20.884 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.884 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:20.884 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.884 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:20.884 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:20.884 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:20.884 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:20.884 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:20.884 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:20.884 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:20.885 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:20.885 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.885 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.885 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:20.885 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:20.885 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:20.885 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:20.885 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.885 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:20.885 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:20.885 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:20.885 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:20.885 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.885 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.885 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:20.885 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:20.886 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:20.886 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:20.886 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.886 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.886 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:20.886 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:20.886 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:20.886 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.886 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:20.886 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.886 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:20.886 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:20.886 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.886 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:20.886 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:20.887 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:20.887 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:20.887 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:20.887 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:20.887 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.887 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:20.887 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.887 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:20.887 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.887 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.887 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:20.887 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.887 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:20.887 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.887 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:20.887 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:20.888 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:20.888 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:20.888 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:20.888 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:20.888 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.888 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:20.888 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:20.888 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:20.888 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:20.888 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:20.888 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:20.888 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.888 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:20.888 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:20.888 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:20.888 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:20.888 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:20.889 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:20.889 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:20.889 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:20.889 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:20.889 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:20.889 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:20.889 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.889 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.889 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:20.889 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.889 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:20.889 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:20.889 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:20.889 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:20.889 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:20.889 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:20.890 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:20.890 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:20.890 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:20.890 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:20.890 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:20.890 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:20.890 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:20.890 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:20.890 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:20.890 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:20.890 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:20.890 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:20.890 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:20.890 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:20.890 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:20.890 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:20.891 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:20.891 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:20.891 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:20.891 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:20.891 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:20.891 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:20.891 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.891 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.891 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.891 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.891 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:20.891 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:20.891 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.891 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:20.891 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.891 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:20.891 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:20.892 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:20.892 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.892 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:20.892 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:20.892 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.892 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.892 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:20.892 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:20.892 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.892 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.892 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:20.892 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:20.892 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:20.892 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:20.892 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:20.892 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.893 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.893 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:20.893 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:20.893 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:20.893 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.893 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:20.893 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.893 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:20.893 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.893 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:20.893 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.893 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.encryption 2023-12-03T13:00:20.893 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T13:00:20.893 INFO:teuthology.orchestra.run.smithi003.stdout: def test_sse_kms_method_head(): 2023-12-03T13:00:20.893 INFO:teuthology.orchestra.run.smithi003.stdout: kms_keyid = get_main_kms_keyid() 2023-12-03T13:00:20.893 INFO:teuthology.orchestra.run.smithi003.stdout:> bucket_name = get_new_bucket() 2023-12-03T13:00:20.893 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.894 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:9813: 2023-12-03T13:00:20.894 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.894 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:20.894 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:20.894 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:20.894 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:20.894 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:20.894 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:20.894 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:20.894 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:20.894 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:20.894 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:20.894 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:20.894 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:20.895 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:20.895 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:20.895 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:20.895 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:20.895 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:20.895 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:20.895 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:20.895 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:20.895 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:20.895 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:20.895 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:20.895 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:20.895 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:20.895 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:20.895 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:20.895 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:20.895 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:20.896 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:20.896 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:20.896 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:20.896 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:20.896 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:20.896 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:20.896 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:20.896 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.896 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.896 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.896 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:20.896 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.896 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:20.896 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.897 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:20.897 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:20.897 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:20.897 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:20.897 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:20.897 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:20.897 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.897 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:20.897 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:20.897 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:20.897 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:20.897 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:20.897 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:20.897 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.897 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:20.897 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:20.897 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:20.898 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:20.898 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:20.898 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:20.898 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:20.898 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:20.898 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:20.898 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:20.898 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:20.898 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.898 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.898 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:20.898 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:20.898 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:20.898 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:20.898 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:20.898 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.899 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.899 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:20.899 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:20.899 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:20.899 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:20.899 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:20.899 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.899 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:20.899 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:20.899 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:20.899 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:20.899 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:20.899 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-418" 2023-12-03T13:00:20.899 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.899 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:20.899 INFO:teuthology.orchestra.run.smithi003.stdout:_____________________________ test_sse_kms_present _____________________________ 2023-12-03T13:00:20.900 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.900 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.900 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.900 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:20.900 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:20.900 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.900 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:20.900 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.900 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:20.900 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:20.900 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:20.900 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.900 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:20.900 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:20.900 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.900 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.900 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:20.901 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:20.901 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.901 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.901 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:20.901 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.901 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:20.901 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:20.901 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.901 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.901 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:20.901 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:20.901 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.901 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:20.901 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:20.901 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:20.901 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:20.901 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:20.902 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.902 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:20.902 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.902 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:20.902 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:20.902 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:20.902 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:20.902 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:20.902 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:20.902 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:20.902 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:20.902 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.902 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.902 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:20.902 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:20.903 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:20.903 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:20.903 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.903 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:20.903 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:20.903 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:20.903 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:20.903 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.903 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.903 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:20.903 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:20.903 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:20.903 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:20.903 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.903 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.903 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:20.903 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:20.904 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:20.904 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.904 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:20.904 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.904 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:20.904 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:20.904 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.904 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:20.904 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:20.904 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:20.904 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:20.904 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:20.904 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:20.904 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.904 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:20.904 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.904 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:20.905 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.905 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.905 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:20.905 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.905 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:20.905 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.905 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:20.905 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:20.905 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:20.905 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:20.905 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:20.905 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:20.905 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.905 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:20.905 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:20.906 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:20.906 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:20.906 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:20.906 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:20.906 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.906 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:20.906 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:20.906 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:20.906 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:20.906 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:20.906 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:20.906 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:20.906 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:20.906 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:20.906 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:20.906 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:20.906 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.907 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.907 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:20.907 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.907 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:20.907 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:20.907 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:20.907 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:20.907 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:20.907 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:20.907 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:20.907 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:20.907 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:20.907 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:20.907 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:20.908 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:20.908 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:20.908 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:20.908 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:20.908 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:20.908 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:20.908 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:20.908 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:20.908 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:20.908 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:20.908 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:20.908 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:20.908 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:20.908 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:20.908 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:20.908 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:20.909 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:20.909 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.909 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.909 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.909 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.909 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:20.909 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:20.909 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.909 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:20.909 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.909 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:20.909 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:20.909 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:20.909 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.909 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:20.909 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:20.910 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.910 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.910 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:20.910 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:20.910 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.910 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.910 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:20.910 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:20.910 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:20.910 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:20.910 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:20.910 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.910 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.910 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:20.910 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:20.911 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:20.911 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.911 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:20.911 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.911 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:20.911 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.911 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:20.911 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.911 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.encryption 2023-12-03T13:00:20.911 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T13:00:20.911 INFO:teuthology.orchestra.run.smithi003.stdout: def test_sse_kms_present(): 2023-12-03T13:00:20.911 INFO:teuthology.orchestra.run.smithi003.stdout: kms_keyid = get_main_kms_keyid() 2023-12-03T13:00:20.911 INFO:teuthology.orchestra.run.smithi003.stdout:> bucket_name = get_new_bucket() 2023-12-03T13:00:20.911 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.911 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:9840: 2023-12-03T13:00:20.911 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.912 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:20.912 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:20.912 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:20.912 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:20.912 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:20.912 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:20.912 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:20.912 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:20.912 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:20.912 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:20.912 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:20.912 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:20.912 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:20.912 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:20.912 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:20.912 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:20.912 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:20.913 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:20.913 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:20.913 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:20.913 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:20.913 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:20.913 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:20.913 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:20.913 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:20.913 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:20.913 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:20.913 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:20.913 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:20.913 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:20.913 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:20.913 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:20.914 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:20.914 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:20.914 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:20.914 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:20.914 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.914 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.914 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.914 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:20.914 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.914 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:20.914 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.914 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:20.914 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:20.914 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:20.914 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:20.914 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:20.915 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:20.915 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.915 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:20.915 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:20.915 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:20.915 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:20.915 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:20.915 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:20.915 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.915 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:20.915 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:20.915 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:20.915 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:20.915 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:20.915 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:20.915 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:20.915 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:20.916 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:20.916 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:20.916 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:20.916 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.916 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.916 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:20.916 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:20.916 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:20.916 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:20.916 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:20.916 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.916 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.916 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:20.916 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:20.916 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:20.916 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:20.916 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:20.917 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.917 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:20.917 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:20.917 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:20.917 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:20.917 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:20.917 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-419" 2023-12-03T13:00:20.917 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.917 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:20.917 INFO:teuthology.orchestra.run.smithi003.stdout:_____________________________ test_sse_kms_no_key ______________________________ 2023-12-03T13:00:20.917 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.917 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.917 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.917 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:20.917 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:20.917 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.917 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:20.918 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.918 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:20.918 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:20.918 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:20.918 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.918 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:20.918 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:20.918 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.918 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.918 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:20.918 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:20.918 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.918 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.918 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:20.918 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.919 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:20.919 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:20.919 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.919 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.919 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:20.919 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:20.919 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.919 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:20.919 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:20.919 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:20.919 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:20.919 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:20.919 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.919 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:20.919 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.920 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:20.920 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:20.920 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:20.920 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:20.920 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:20.920 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:20.920 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:20.920 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:20.920 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.920 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.920 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:20.920 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:20.920 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:20.920 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:20.921 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.921 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:20.921 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:20.921 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:20.921 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:20.921 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.921 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.921 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:20.921 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:20.921 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:20.921 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:20.921 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.921 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.921 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:20.921 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:20.921 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:20.921 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.922 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:20.922 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.922 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:20.922 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:20.922 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.922 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:20.922 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:20.922 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:20.922 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:20.922 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:20.922 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:20.922 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.922 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:20.922 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.922 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:20.922 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.923 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.923 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:20.923 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.923 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:20.923 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.923 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:20.923 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:20.923 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:20.923 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:20.923 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:20.923 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:20.923 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.923 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:20.923 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:20.923 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:20.923 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:20.924 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:20.924 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:20.924 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.924 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:20.924 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:20.924 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:20.924 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:20.924 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:20.924 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:20.924 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:20.924 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:20.924 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:20.924 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:20.924 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:20.924 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.924 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.925 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:20.925 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.925 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:20.925 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:20.925 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:20.925 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:20.925 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:20.925 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:20.925 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:20.925 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:20.925 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:20.925 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:20.925 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:20.925 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:20.925 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:20.925 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:20.925 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:20.926 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:20.926 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:20.926 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:20.926 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:20.926 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:20.926 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:20.926 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:20.926 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:20.926 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:20.926 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:20.926 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:20.926 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:20.926 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:20.926 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.926 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.926 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.927 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.927 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:20.927 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:20.927 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.927 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:20.927 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.927 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:20.927 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:20.927 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:20.927 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.927 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:20.927 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:20.927 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.927 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.927 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:20.927 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:20.927 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.928 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.928 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:20.928 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:20.928 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:20.928 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:20.928 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:20.928 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.928 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.928 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:20.928 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:20.928 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:20.928 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.928 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:20.928 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.928 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:20.928 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.929 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:20.929 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.929 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.encryption 2023-12-03T13:00:20.929 INFO:teuthology.orchestra.run.smithi003.stdout: def test_sse_kms_no_key(): 2023-12-03T13:00:20.929 INFO:teuthology.orchestra.run.smithi003.stdout:> bucket_name = get_new_bucket() 2023-12-03T13:00:20.929 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.929 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:9859: 2023-12-03T13:00:20.929 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.929 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:20.929 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:20.929 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:20.929 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:20.929 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:20.929 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:20.929 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:20.930 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:20.930 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:20.930 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:20.930 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:20.930 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:20.930 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:20.930 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:20.930 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:20.930 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:20.930 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:20.930 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:20.930 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:20.930 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:20.930 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:20.930 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:20.930 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:20.931 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:20.931 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:20.931 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:20.931 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:20.931 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:20.931 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:20.931 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:20.931 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:20.931 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:20.931 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:20.931 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:20.931 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:20.931 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:20.931 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.931 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.931 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.932 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:20.932 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.932 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:20.932 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.932 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:20.932 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:20.932 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:20.932 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:20.932 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:20.932 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:20.932 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.932 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:20.932 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:20.932 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:20.932 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:20.932 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:20.932 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:20.933 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.933 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:20.933 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:20.933 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:20.933 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:20.933 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:20.933 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:20.933 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:20.933 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:20.933 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:20.933 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:20.933 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:20.933 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.933 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.933 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:20.933 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:20.934 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:20.934 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:20.934 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:20.934 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.934 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.934 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:20.934 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:20.934 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:20.934 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:20.934 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:20.934 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.934 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:20.934 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:20.934 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:20.934 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:20.934 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:20.935 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-420" 2023-12-03T13:00:20.935 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.935 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:20.935 INFO:teuthology.orchestra.run.smithi003.stdout:__________________________ test_sse_kms_not_declared ___________________________ 2023-12-03T13:00:20.935 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.935 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.935 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.935 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:20.935 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:20.935 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.935 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:20.935 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.935 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:20.935 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:20.935 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:20.935 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.936 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:20.936 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:20.936 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.936 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.936 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:20.936 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:20.936 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.936 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.936 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:20.936 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.936 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:20.936 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:20.936 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.936 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.936 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:20.936 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:20.936 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.937 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:20.937 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:20.937 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:20.937 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:20.937 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:20.937 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.937 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:20.937 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.937 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:20.937 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:20.937 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:20.937 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:20.937 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:20.937 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:20.937 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:20.937 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:20.938 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.938 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.938 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:20.938 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:20.938 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:20.938 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:20.938 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.938 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:20.938 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:20.938 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:20.938 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:20.938 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.938 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.938 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:20.938 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:20.938 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:20.939 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:20.939 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.939 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.939 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:20.939 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:20.939 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:20.939 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.939 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:20.939 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.939 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:20.939 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:20.939 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.939 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:20.939 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:20.939 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:20.939 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:20.940 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:20.940 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:20.940 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.940 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:20.940 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.940 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:20.940 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.940 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.940 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:20.940 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.940 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:20.940 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.940 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:20.940 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:20.940 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:20.941 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:20.941 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:20.941 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:20.941 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.941 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:20.941 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:20.941 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:20.941 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:20.941 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:20.941 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:20.941 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.941 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:20.941 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:20.941 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:20.941 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:20.941 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:20.942 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:20.942 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:20.942 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:20.942 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:20.942 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:20.942 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:20.942 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.942 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.942 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:20.942 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.942 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:20.942 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:20.942 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:20.942 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:20.942 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:20.942 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:20.943 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:20.943 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:20.943 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:20.943 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:20.943 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:20.943 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:20.943 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:20.943 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:20.943 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:20.943 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:20.943 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:20.943 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:20.943 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:20.943 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:20.944 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:20.944 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:20.944 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:20.944 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:20.944 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:20.944 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:20.944 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:20.944 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:20.944 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.944 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.944 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.944 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.944 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:20.944 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:20.944 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.944 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:20.945 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.945 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:20.945 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:20.945 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:20.945 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.945 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:20.945 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:20.945 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.945 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.945 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:20.945 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:20.945 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.945 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.945 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:20.945 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:20.945 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:20.946 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:20.946 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:20.946 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.946 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.946 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:20.946 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:20.946 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:20.946 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.946 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:20.946 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.946 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:20.946 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.946 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:20.946 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.947 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.encryption 2023-12-03T13:00:20.947 INFO:teuthology.orchestra.run.smithi003.stdout: def test_sse_kms_not_declared(): 2023-12-03T13:00:20.947 INFO:teuthology.orchestra.run.smithi003.stdout:> bucket_name = get_new_bucket() 2023-12-03T13:00:20.947 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.947 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:9875: 2023-12-03T13:00:20.947 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.947 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:20.947 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:20.947 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:20.947 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:20.947 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:20.947 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:20.947 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:20.947 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:20.947 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:20.948 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:20.948 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:20.948 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:20.948 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:20.948 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:20.948 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:20.948 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:20.948 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:20.948 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:20.948 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:20.948 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:20.948 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:20.948 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:20.948 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:20.948 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:20.949 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:20.949 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:20.949 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:20.949 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:20.949 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:20.949 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:20.949 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:20.949 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:20.949 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:20.949 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:20.949 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:20.949 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:20.949 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.949 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.949 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.949 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:20.950 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.950 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:20.950 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.950 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:20.950 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:20.950 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:20.950 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:20.950 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:20.950 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:20.950 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.950 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:20.950 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:20.950 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:20.951 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:20.951 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:20.951 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:20.951 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.951 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:20.951 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:20.951 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:20.951 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:20.951 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:20.951 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:20.951 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:20.951 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:20.951 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:20.951 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:20.951 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:20.952 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.952 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.952 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:20.952 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:20.952 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:20.952 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:20.952 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:20.952 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.952 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.952 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:20.952 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:20.952 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:20.952 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:20.952 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:20.953 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.953 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:20.953 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:20.953 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:20.953 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:20.953 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:20.953 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-421" 2023-12-03T13:00:20.953 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.953 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:20.953 INFO:teuthology.orchestra.run.smithi003.stdout:________________________ test_sse_kms_multipart_upload _________________________ 2023-12-03T13:00:20.953 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.953 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.953 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.953 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:20.953 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:20.953 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.953 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:20.954 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.954 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:20.954 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:20.954 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:20.954 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.954 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:20.954 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:20.954 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.954 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.954 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:20.954 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:20.954 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.954 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.954 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:20.955 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.955 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:20.955 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:20.955 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.955 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.955 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:20.955 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:20.955 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.955 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:20.955 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:20.955 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:20.955 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:20.955 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:20.955 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.955 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:20.956 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.956 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:20.956 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:20.956 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:20.956 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:20.956 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:20.956 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:20.956 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:20.956 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:20.956 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.956 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.956 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:20.956 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:20.956 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:20.956 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:20.956 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.957 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:20.957 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:20.957 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:20.957 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:20.957 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.957 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.957 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:20.957 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:20.957 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:20.957 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:20.957 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.957 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.957 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:20.957 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:20.957 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:20.957 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.958 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:20.958 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.958 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:20.958 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:20.958 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.958 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:20.958 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:20.958 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:20.958 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:20.958 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:20.958 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:20.958 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.958 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:20.958 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.958 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:20.959 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.959 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.959 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:20.959 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.959 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:20.959 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.959 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:20.959 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:20.959 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:20.959 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:20.959 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:20.959 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:20.959 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.959 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:20.959 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:20.959 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:20.959 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:20.960 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:20.960 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:20.960 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.960 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:20.960 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:20.960 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:20.960 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:20.960 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:20.960 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:20.960 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:20.960 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:20.960 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:20.960 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:20.960 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:20.960 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.960 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.960 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:20.961 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.961 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:20.961 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:20.961 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:20.961 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:20.961 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:20.961 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:20.961 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:20.961 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:20.961 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:20.961 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:20.961 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:20.961 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:20.961 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:20.961 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:20.961 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:20.962 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:20.962 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:20.962 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:20.962 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:20.962 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:20.962 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:20.962 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:20.962 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:20.962 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:20.962 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:20.962 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:20.962 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:20.963 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:20.963 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.963 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.963 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.963 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.963 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:20.963 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:20.963 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.963 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:20.963 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.963 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:20.963 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:20.963 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:20.963 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.963 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:20.964 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:20.964 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.964 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.964 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:20.964 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:20.964 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.964 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.964 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:20.964 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:20.964 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:20.964 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:20.964 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:20.964 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.964 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.964 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:20.964 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:20.964 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:20.965 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.965 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:20.965 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.965 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:20.965 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.965 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:20.965 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.965 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.encryption 2023-12-03T13:00:20.965 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T13:00:20.965 INFO:teuthology.orchestra.run.smithi003.stdout: def test_sse_kms_multipart_upload(): 2023-12-03T13:00:20.965 INFO:teuthology.orchestra.run.smithi003.stdout: kms_keyid = get_main_kms_keyid() 2023-12-03T13:00:20.965 INFO:teuthology.orchestra.run.smithi003.stdout:> bucket_name = get_new_bucket() 2023-12-03T13:00:20.965 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.965 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:9894: 2023-12-03T13:00:20.965 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.965 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:20.965 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:20.966 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:20.966 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:20.966 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:20.966 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:20.966 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:20.966 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:20.966 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:20.966 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:20.966 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:20.966 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:20.966 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:20.966 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:20.966 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:20.966 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:20.966 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:20.967 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:20.967 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:20.967 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:20.967 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:20.967 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:20.967 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:20.967 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:20.967 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:20.967 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:20.967 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:20.967 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:20.967 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:20.967 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:20.967 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:20.967 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:20.967 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:20.968 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:20.968 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:20.968 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:20.968 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.968 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.968 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.968 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:20.968 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.968 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:20.968 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.968 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:20.968 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:20.968 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:20.968 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:20.968 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:20.968 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:20.969 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.969 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:20.969 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:20.969 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:20.969 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:20.969 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:20.969 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:20.969 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.969 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:20.969 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:20.969 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:20.969 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:20.969 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:20.969 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:20.969 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:20.969 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:20.969 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:20.970 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:20.970 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:20.970 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.970 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.970 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:20.970 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:20.970 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:20.970 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:20.970 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:20.970 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.970 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.970 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:20.970 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:20.970 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:20.970 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:20.971 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:20.971 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.971 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:20.971 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:20.971 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:20.971 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:20.971 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:20.971 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-422" 2023-12-03T13:00:20.971 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.971 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:20.971 INFO:teuthology.orchestra.run.smithi003.stdout:___________________ test_sse_kms_multipart_invalid_chunks_1 ____________________ 2023-12-03T13:00:20.971 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.971 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.971 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.971 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:20.971 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:20.971 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.972 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:20.972 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.972 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:20.972 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:20.972 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:20.972 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.972 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:20.972 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:20.972 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.972 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.972 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:20.972 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:20.972 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.972 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.972 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:20.973 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.973 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:20.973 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:20.973 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.973 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.973 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:20.973 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:20.973 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.973 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:20.973 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:20.973 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:20.973 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:20.973 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:20.973 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.973 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:20.974 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.974 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:20.974 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:20.974 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:20.974 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:20.974 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:20.974 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:20.974 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:20.974 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:20.974 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.974 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.974 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:20.974 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:20.975 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:20.975 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:20.975 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.975 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:20.975 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:20.975 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:20.975 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:20.975 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.975 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.975 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:20.975 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:20.975 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:20.975 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:20.975 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.975 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.975 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:20.976 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:20.976 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:20.976 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.976 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:20.976 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.976 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:20.976 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:20.976 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.976 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:20.976 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:20.976 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:20.976 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:20.976 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:20.976 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:20.976 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.976 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:20.977 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.977 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:20.977 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.977 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.977 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:20.977 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.977 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:20.977 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.977 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:20.977 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:20.977 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:20.977 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:20.977 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:20.977 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:20.977 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.977 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:20.978 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:20.978 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:20.978 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:20.978 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:20.978 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:20.978 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.978 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:20.978 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:20.978 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:20.978 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:20.978 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:20.978 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:20.978 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:20.978 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:20.978 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:20.979 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:20.979 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:20.979 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.979 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.979 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:20.979 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.979 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:20.979 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:20.979 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:20.979 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:20.979 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:20.979 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:20.979 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:20.979 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:20.979 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:20.980 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:20.980 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:20.980 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:20.980 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:20.980 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:20.980 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:20.980 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:20.980 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:20.980 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:20.980 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:20.980 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:20.980 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:20.980 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:20.980 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:20.980 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:20.980 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:20.980 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:20.981 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:20.981 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:20.981 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.981 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.981 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.981 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.981 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:20.981 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:20.981 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.981 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:20.981 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.981 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:20.981 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:20.981 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:20.981 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.982 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:20.982 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:20.982 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.982 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.982 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:20.982 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:20.982 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.982 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.982 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:20.982 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:20.982 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:20.982 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:20.982 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:20.982 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.982 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.982 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:20.982 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:20.983 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:20.983 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.983 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:20.983 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.983 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:20.983 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.983 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:20.983 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.983 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.encryption 2023-12-03T13:00:20.983 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T13:00:20.983 INFO:teuthology.orchestra.run.smithi003.stdout: def test_sse_kms_multipart_invalid_chunks_1(): 2023-12-03T13:00:20.983 INFO:teuthology.orchestra.run.smithi003.stdout: kms_keyid = get_main_kms_keyid() 2023-12-03T13:00:20.983 INFO:teuthology.orchestra.run.smithi003.stdout: kms_keyid2 = get_secondary_kms_keyid() 2023-12-03T13:00:20.983 INFO:teuthology.orchestra.run.smithi003.stdout:> bucket_name = get_new_bucket() 2023-12-03T13:00:20.983 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.983 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:9940: 2023-12-03T13:00:20.984 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.984 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:20.984 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:20.984 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:20.984 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:20.984 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:20.984 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:20.984 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:20.984 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:20.984 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:20.984 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:20.984 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:20.984 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:20.984 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:20.984 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:20.985 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:20.985 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:20.985 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:20.985 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:20.985 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:20.985 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:20.985 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:20.985 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:20.985 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:20.985 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:20.985 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:20.985 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:20.985 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:20.985 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:20.986 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:20.986 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:20.986 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:20.986 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:20.986 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:20.986 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:20.986 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:20.986 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:20.986 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.986 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.986 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.986 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:20.986 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.986 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:20.986 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.987 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:20.987 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:20.987 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:20.987 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:20.987 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:20.987 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:20.987 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.987 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:20.987 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:20.987 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:20.987 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:20.987 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:20.987 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:20.987 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.987 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:20.987 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:20.987 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:20.988 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:20.988 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:20.988 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:20.988 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:20.988 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:20.988 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:20.988 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:20.988 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:20.988 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.988 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.988 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:20.988 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:20.988 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:20.988 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:20.988 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:20.988 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.989 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.989 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:20.989 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:20.989 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:20.989 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:20.989 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:20.989 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.989 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:20.989 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:20.989 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:20.989 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:20.989 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:20.989 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-423" 2023-12-03T13:00:20.989 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.989 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:20.989 INFO:teuthology.orchestra.run.smithi003.stdout:___________________ test_sse_kms_multipart_invalid_chunks_2 ____________________ 2023-12-03T13:00:20.990 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.990 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.990 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.990 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:20.990 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:20.990 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.990 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:20.990 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.990 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:20.990 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:20.990 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:20.990 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.990 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:20.990 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:20.990 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.990 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.991 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:20.991 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:20.991 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.991 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.991 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:20.991 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.991 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:20.991 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:20.991 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.991 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.991 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:20.991 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:20.991 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.991 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:20.991 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:20.991 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:20.991 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:20.992 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:20.992 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.992 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:20.992 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.992 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:20.992 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:20.992 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:20.992 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:20.992 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:20.992 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:20.992 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:20.992 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:20.992 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.992 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.992 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:20.992 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:20.993 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:20.993 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:20.993 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.993 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:20.993 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:20.993 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:20.993 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:20.993 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.993 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.993 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:20.993 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:20.993 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:20.993 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:20.993 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.993 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.993 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:20.994 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:20.994 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:20.994 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.994 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:20.994 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.994 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:20.994 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:20.994 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.994 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:20.994 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:20.994 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:20.994 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:20.994 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:20.994 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:20.994 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.994 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:20.995 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.995 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:20.995 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.995 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.995 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:20.995 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.995 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:20.995 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:20.995 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:20.995 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:20.995 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:20.995 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:20.995 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:20.995 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:20.995 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:20.996 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:20.996 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:20.996 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:20.996 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:20.996 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:20.996 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:20.996 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.996 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:20.996 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:20.996 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:20.996 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:20.996 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:20.996 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:20.996 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:20.996 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:20.996 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:20.996 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:20.997 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:20.997 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:20.997 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.997 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:20.997 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.997 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:20.997 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:20.997 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:20.997 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:20.997 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:20.997 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:20.997 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:20.997 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:20.997 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:20.997 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:20.997 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:20.998 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:20.998 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:20.998 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:20.998 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:20.998 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:20.998 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:20.998 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:20.998 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:20.998 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:20.998 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:20.998 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:20.998 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:20.998 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:20.998 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:20.998 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:20.998 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:20.999 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:20.999 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:20.999 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.999 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:20.999 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.999 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:20.999 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:20.999 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.999 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:20.999 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:20.999 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:20.999 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:20.999 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:20.999 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:20.999 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:20.999 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:20.999 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.000 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.000 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:21.000 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:21.000 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.000 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.000 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:21.000 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:21.000 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:21.000 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:21.000 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:21.000 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.000 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.000 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:21.000 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:21.000 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:21.000 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.000 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:21.001 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.001 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:21.001 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.001 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:21.001 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.001 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.encryption 2023-12-03T13:00:21.001 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T13:00:21.001 INFO:teuthology.orchestra.run.smithi003.stdout: def test_sse_kms_multipart_invalid_chunks_2(): 2023-12-03T13:00:21.001 INFO:teuthology.orchestra.run.smithi003.stdout: kms_keyid = get_main_kms_keyid() 2023-12-03T13:00:21.001 INFO:teuthology.orchestra.run.smithi003.stdout:> bucket_name = get_new_bucket() 2023-12-03T13:00:21.001 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.001 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:9966: 2023-12-03T13:00:21.001 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.001 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:21.001 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:21.002 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:21.002 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:21.002 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:21.002 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:21.002 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:21.002 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:21.002 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:21.002 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:21.002 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:21.002 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:21.002 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:21.002 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:21.002 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:21.002 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:21.002 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:21.002 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:21.003 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:21.003 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:21.003 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:21.003 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:21.003 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:21.003 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:21.003 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:21.003 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:21.003 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:21.003 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:21.003 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:21.003 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:21.003 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:21.003 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:21.004 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:21.004 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:21.004 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:21.004 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:21.004 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.004 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.004 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.004 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:21.004 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.004 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:21.004 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.004 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:21.004 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:21.004 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:21.004 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:21.004 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:21.004 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:21.005 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.005 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:21.005 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:21.005 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:21.005 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:21.005 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:21.005 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:21.005 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.005 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:21.005 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:21.005 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:21.005 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:21.005 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:21.005 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:21.006 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:21.006 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:21.006 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:21.006 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:21.006 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:21.006 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.006 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.006 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:21.006 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:21.006 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:21.006 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:21.006 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:21.006 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.006 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.006 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:21.007 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:21.007 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:21.007 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:21.007 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:21.007 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.007 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:21.007 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:21.007 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:21.007 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:21.007 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:21.007 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-424" 2023-12-03T13:00:21.007 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.007 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:21.007 INFO:teuthology.orchestra.run.smithi003.stdout:________________ test_sse_kms_post_object_authenticated_request ________________ 2023-12-03T13:00:21.007 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.007 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.008 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.008 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:21.008 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:21.008 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.008 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:21.008 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.008 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:21.008 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:21.008 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:21.008 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.008 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:21.008 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:21.008 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.008 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.008 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:21.008 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:21.008 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.009 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.009 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:21.009 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.009 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:21.009 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:21.009 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.009 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.009 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:21.009 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:21.009 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.009 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:21.009 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:21.009 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:21.009 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:21.009 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:21.009 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.010 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:21.010 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.010 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:21.010 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:21.010 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:21.010 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:21.010 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:21.010 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:21.010 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:21.010 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:21.010 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.010 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.010 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:21.010 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:21.010 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:21.010 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:21.011 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.011 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:21.011 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:21.011 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:21.011 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:21.011 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.011 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.011 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:21.011 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:21.011 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:21.011 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:21.011 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.011 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.011 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:21.011 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:21.011 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:21.012 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.012 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:21.012 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.012 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:21.012 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:21.012 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.012 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:21.012 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:21.012 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:21.012 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:21.012 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:21.012 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:21.012 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.012 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:21.012 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.012 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:21.013 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.013 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.013 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:21.013 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.013 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:21.013 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.013 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:21.013 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:21.013 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:21.013 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:21.013 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:21.013 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:21.013 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.013 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:21.013 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:21.013 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:21.014 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:21.014 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:21.014 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:21.014 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.014 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:21.014 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:21.014 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:21.014 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:21.014 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:21.014 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:21.014 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:21.014 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:21.014 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:21.014 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:21.014 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:21.014 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.014 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.015 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:21.015 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.015 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:21.015 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:21.015 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:21.015 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:21.015 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:21.015 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:21.015 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:21.015 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:21.015 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:21.015 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:21.015 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:21.015 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:21.015 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:21.016 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:21.016 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:21.016 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:21.016 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:21.016 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:21.016 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:21.016 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:21.016 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:21.016 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:21.016 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:21.016 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:21.016 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:21.016 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:21.016 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:21.016 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:21.017 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.017 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.017 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.017 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.017 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:21.017 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:21.017 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.017 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:21.017 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.017 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:21.017 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:21.017 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:21.017 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.017 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:21.017 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:21.017 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.018 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.018 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:21.018 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:21.018 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.018 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.018 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:21.018 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:21.018 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:21.018 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:21.018 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:21.018 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.018 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.018 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:21.018 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:21.018 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:21.018 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.019 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:21.019 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.019 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:21.019 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.019 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:21.019 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.019 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.encryption 2023-12-03T13:00:21.019 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T13:00:21.019 INFO:teuthology.orchestra.run.smithi003.stdout: def test_sse_kms_post_object_authenticated_request(): 2023-12-03T13:00:21.019 INFO:teuthology.orchestra.run.smithi003.stdout: kms_keyid = get_main_kms_keyid() 2023-12-03T13:00:21.019 INFO:teuthology.orchestra.run.smithi003.stdout:> bucket_name = get_new_bucket() 2023-12-03T13:00:21.019 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.019 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:9992: 2023-12-03T13:00:21.019 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.019 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:21.019 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:21.020 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:21.020 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:21.020 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:21.020 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:21.020 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:21.020 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:21.020 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:21.020 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:21.020 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:21.020 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:21.020 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:21.020 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:21.020 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:21.020 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:21.020 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:21.021 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:21.021 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:21.021 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:21.021 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:21.021 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:21.021 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:21.021 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:21.021 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:21.021 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:21.021 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:21.021 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:21.021 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:21.021 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:21.021 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:21.021 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:21.021 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:21.022 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:21.022 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:21.022 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:21.022 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.022 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.022 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.022 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:21.022 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.022 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:21.022 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.022 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:21.022 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:21.022 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:21.022 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:21.022 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:21.022 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:21.023 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.023 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:21.023 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:21.023 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:21.023 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:21.023 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:21.023 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:21.023 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.023 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:21.023 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:21.023 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:21.023 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:21.023 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:21.023 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:21.023 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:21.023 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:21.024 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:21.024 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:21.024 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:21.024 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.024 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.024 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:21.024 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:21.024 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:21.024 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:21.024 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:21.024 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.024 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.024 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:21.024 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:21.024 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:21.024 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:21.024 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:21.025 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.025 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:21.025 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:21.025 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:21.025 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:21.025 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:21.025 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-425" 2023-12-03T13:00:21.025 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.025 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:21.025 INFO:teuthology.orchestra.run.smithi003.stdout:___________________________ test_sse_kms_transfer_1b ___________________________ 2023-12-03T13:00:21.025 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.025 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.025 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.025 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:21.025 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:21.025 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.025 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:21.026 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.026 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:21.026 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:21.026 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:21.026 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.026 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:21.026 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:21.026 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.026 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.026 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:21.026 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:21.026 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.026 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.026 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:21.026 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.026 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:21.027 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:21.027 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.027 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.027 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:21.027 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:21.027 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.027 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:21.027 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:21.027 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:21.027 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:21.027 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:21.027 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.027 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:21.027 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.027 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:21.028 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:21.028 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:21.028 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:21.028 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:21.028 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:21.028 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:21.028 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:21.028 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.028 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.028 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:21.028 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:21.028 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:21.028 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:21.028 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.028 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:21.028 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:21.029 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:21.029 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:21.029 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.029 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.029 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:21.029 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:21.029 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:21.029 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:21.029 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.029 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.029 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:21.029 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:21.029 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:21.029 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.029 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:21.029 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.030 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:21.030 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:21.030 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.030 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:21.030 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:21.030 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:21.030 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:21.030 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:21.030 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:21.030 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.030 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:21.030 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.030 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:21.030 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.030 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.030 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:21.031 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.031 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:21.031 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.031 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:21.031 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:21.031 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:21.031 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:21.031 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:21.031 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:21.031 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.031 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:21.031 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:21.031 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:21.031 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:21.031 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:21.032 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:21.032 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.032 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:21.032 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:21.032 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:21.032 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:21.032 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:21.032 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:21.032 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:21.032 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:21.032 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:21.032 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:21.032 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:21.032 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.032 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.032 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:21.033 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.033 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:21.033 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:21.033 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:21.033 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:21.033 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:21.033 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:21.033 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:21.033 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:21.033 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:21.033 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:21.033 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:21.033 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:21.033 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:21.033 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:21.033 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:21.034 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:21.034 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:21.034 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:21.034 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:21.034 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:21.034 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:21.034 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:21.034 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:21.034 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:21.034 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:21.034 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:21.034 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:21.034 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:21.034 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.034 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.035 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.035 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.035 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:21.035 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:21.035 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.035 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:21.035 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.035 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:21.035 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:21.035 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:21.035 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.035 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:21.035 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:21.035 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.035 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.035 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:21.035 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:21.036 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.036 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.036 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:21.036 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:21.036 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:21.036 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:21.036 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:21.036 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.036 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.036 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:21.036 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:21.036 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:21.036 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.036 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:21.036 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.036 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:21.036 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.037 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:21.037 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.037 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.encryption 2023-12-03T13:00:21.037 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T13:00:21.037 INFO:teuthology.orchestra.run.smithi003.stdout: def test_sse_kms_transfer_1b(): 2023-12-03T13:00:21.037 INFO:teuthology.orchestra.run.smithi003.stdout: kms_keyid = get_main_kms_keyid() 2023-12-03T13:00:21.037 INFO:teuthology.orchestra.run.smithi003.stdout: if kms_keyid is None: 2023-12-03T13:00:21.037 INFO:teuthology.orchestra.run.smithi003.stdout: pytest.skip('[s3 main] section missing kms_keyid') 2023-12-03T13:00:21.037 INFO:teuthology.orchestra.run.smithi003.stdout:> _test_sse_kms_customer_write(1, key_id = kms_keyid) 2023-12-03T13:00:21.037 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.037 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:10040: 2023-12-03T13:00:21.037 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.037 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:9788: in _test_sse_kms_customer_write 2023-12-03T13:00:21.037 INFO:teuthology.orchestra.run.smithi003.stdout: bucket_name = get_new_bucket() 2023-12-03T13:00:21.037 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:21.037 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:21.038 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:21.038 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:21.038 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:21.038 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:21.038 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:21.038 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:21.038 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:21.038 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:21.038 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:21.038 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:21.038 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:21.038 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:21.038 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:21.038 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:21.039 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:21.039 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:21.039 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:21.039 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:21.039 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:21.039 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:21.039 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:21.039 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:21.039 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:21.039 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:21.039 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:21.039 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:21.039 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:21.039 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:21.039 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:21.039 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:21.040 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:21.040 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:21.040 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:21.040 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:21.040 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.040 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.040 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.040 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:21.040 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.040 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:21.040 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.040 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:21.040 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:21.040 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:21.040 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:21.040 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:21.041 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:21.041 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.041 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:21.041 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:21.041 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:21.041 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:21.041 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:21.041 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:21.041 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.041 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:21.041 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:21.041 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:21.041 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:21.041 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:21.041 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:21.041 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:21.042 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:21.042 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:21.042 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:21.042 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:21.042 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.042 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.042 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:21.042 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:21.042 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:21.042 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:21.042 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:21.042 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.042 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.042 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:21.042 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:21.043 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:21.043 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:21.043 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:21.043 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.043 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:21.043 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:21.043 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:21.043 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:21.043 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:21.043 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-426" 2023-12-03T13:00:21.043 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.043 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:21.043 INFO:teuthology.orchestra.run.smithi003.stdout:__________________________ test_sse_kms_transfer_1kb ___________________________ 2023-12-03T13:00:21.043 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.043 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.043 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.044 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:21.044 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:21.044 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.044 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:21.044 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.044 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:21.044 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:21.044 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:21.044 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.044 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:21.044 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:21.044 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.044 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.044 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:21.044 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:21.044 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.044 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.045 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:21.045 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.045 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:21.045 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:21.045 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.045 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.045 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:21.045 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:21.045 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.045 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:21.045 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:21.045 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:21.045 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:21.045 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:21.045 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.045 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:21.046 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.046 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:21.046 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:21.046 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:21.046 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:21.046 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:21.046 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:21.046 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:21.046 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:21.046 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.046 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.046 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:21.046 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:21.046 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:21.046 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:21.046 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.047 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:21.047 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:21.047 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:21.047 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:21.047 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.047 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.047 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:21.047 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:21.047 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:21.047 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:21.047 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.047 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.047 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:21.047 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:21.047 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:21.047 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.048 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:21.048 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.048 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:21.048 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:21.048 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.048 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:21.048 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:21.048 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:21.048 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:21.048 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:21.048 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:21.048 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.048 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:21.048 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.048 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:21.048 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.048 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.049 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:21.049 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.049 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:21.049 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.049 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:21.049 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:21.049 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:21.049 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:21.049 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:21.049 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:21.049 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.049 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:21.049 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:21.049 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:21.050 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:21.050 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:21.050 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:21.050 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.050 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:21.050 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:21.050 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:21.050 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:21.050 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:21.050 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:21.050 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:21.050 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:21.050 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:21.050 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:21.050 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:21.050 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.051 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.051 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:21.051 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.051 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:21.051 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:21.051 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:21.051 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:21.051 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:21.051 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:21.051 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:21.051 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:21.051 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:21.051 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:21.051 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:21.051 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:21.051 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:21.052 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:21.052 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:21.052 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:21.052 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:21.052 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:21.052 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:21.052 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:21.052 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:21.052 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:21.052 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:21.052 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:21.052 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:21.052 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:21.052 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:21.052 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:21.052 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.053 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.053 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.053 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.053 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:21.053 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:21.053 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.053 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:21.053 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.053 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:21.053 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:21.053 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:21.053 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.053 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:21.053 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:21.053 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.053 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.053 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:21.054 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:21.054 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.054 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.054 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:21.054 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:21.054 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:21.054 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:21.054 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:21.054 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.054 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.054 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:21.054 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:21.054 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:21.054 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.054 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:21.055 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.055 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:21.055 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.055 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:21.055 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.055 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.encryption 2023-12-03T13:00:21.055 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T13:00:21.055 INFO:teuthology.orchestra.run.smithi003.stdout: def test_sse_kms_transfer_1kb(): 2023-12-03T13:00:21.055 INFO:teuthology.orchestra.run.smithi003.stdout: kms_keyid = get_main_kms_keyid() 2023-12-03T13:00:21.055 INFO:teuthology.orchestra.run.smithi003.stdout: if kms_keyid is None: 2023-12-03T13:00:21.055 INFO:teuthology.orchestra.run.smithi003.stdout: pytest.skip('[s3 main] section missing kms_keyid') 2023-12-03T13:00:21.055 INFO:teuthology.orchestra.run.smithi003.stdout:> _test_sse_kms_customer_write(1024, key_id = kms_keyid) 2023-12-03T13:00:21.055 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.055 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:10049: 2023-12-03T13:00:21.055 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.055 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:9788: in _test_sse_kms_customer_write 2023-12-03T13:00:21.055 INFO:teuthology.orchestra.run.smithi003.stdout: bucket_name = get_new_bucket() 2023-12-03T13:00:21.056 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:21.056 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:21.056 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:21.056 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:21.056 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:21.056 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:21.056 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:21.056 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:21.056 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:21.056 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:21.056 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:21.056 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:21.056 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:21.056 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:21.056 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:21.056 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:21.057 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:21.057 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:21.057 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:21.057 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:21.057 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:21.057 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:21.057 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:21.057 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:21.057 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:21.057 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:21.057 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:21.057 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:21.057 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:21.057 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:21.057 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:21.057 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:21.058 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:21.058 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:21.058 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:21.058 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:21.058 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.058 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.058 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.058 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:21.058 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.058 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:21.058 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.058 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:21.058 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:21.058 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:21.058 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:21.058 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:21.059 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:21.059 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.059 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:21.059 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:21.059 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:21.059 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:21.059 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:21.059 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:21.059 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.059 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:21.059 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:21.059 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:21.059 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:21.059 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:21.059 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:21.060 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:21.060 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:21.060 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:21.060 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:21.060 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:21.060 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.060 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.060 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:21.060 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:21.060 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:21.060 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:21.060 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:21.060 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.060 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.060 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:21.060 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:21.060 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:21.061 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:21.061 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:21.061 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.061 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:21.061 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:21.061 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:21.061 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:21.061 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:21.061 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-427" 2023-12-03T13:00:21.061 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.061 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:21.061 INFO:teuthology.orchestra.run.smithi003.stdout:__________________________ test_sse_kms_transfer_1MB ___________________________ 2023-12-03T13:00:21.061 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.061 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.061 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.062 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:21.062 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:21.062 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.062 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:21.062 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.062 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:21.062 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:21.062 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:21.062 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.062 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:21.062 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:21.062 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.062 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.062 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:21.062 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:21.062 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.063 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.063 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:21.063 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.063 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:21.063 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:21.063 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.063 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.063 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:21.063 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:21.063 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.063 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:21.063 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:21.063 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:21.063 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:21.063 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:21.063 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.064 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:21.064 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.064 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:21.064 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:21.064 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:21.064 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:21.064 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:21.064 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:21.064 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:21.064 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:21.064 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.064 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.064 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:21.064 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:21.064 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:21.064 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:21.065 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.065 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:21.065 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:21.065 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:21.065 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:21.065 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.065 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.065 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:21.065 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:21.065 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:21.065 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:21.065 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.065 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.065 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:21.065 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:21.065 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:21.065 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.066 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:21.066 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.066 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:21.066 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:21.066 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.066 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:21.066 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:21.066 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:21.066 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:21.066 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:21.066 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:21.066 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.066 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:21.066 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.066 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:21.067 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.067 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.067 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:21.067 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.067 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:21.067 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.067 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:21.067 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:21.067 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:21.067 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:21.067 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:21.067 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:21.067 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.067 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:21.067 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:21.067 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:21.068 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:21.068 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:21.068 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:21.068 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.068 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:21.068 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:21.068 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:21.068 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:21.068 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:21.068 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:21.068 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:21.068 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:21.068 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:21.068 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:21.068 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:21.068 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.069 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.069 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:21.069 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.069 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:21.069 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:21.069 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:21.069 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:21.069 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:21.069 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:21.069 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:21.069 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:21.069 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:21.069 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:21.069 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:21.069 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:21.069 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:21.069 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:21.070 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:21.070 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:21.070 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:21.070 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:21.070 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:21.070 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:21.070 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:21.070 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:21.070 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:21.070 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:21.070 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:21.070 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:21.070 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:21.070 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:21.070 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.071 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.071 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.071 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.071 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:21.071 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:21.071 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.071 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:21.071 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.071 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:21.071 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:21.071 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:21.071 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.071 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:21.071 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:21.071 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.071 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.072 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:21.072 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:21.072 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.072 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.072 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:21.072 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:21.072 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:21.072 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:21.072 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:21.072 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.072 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.072 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:21.072 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:21.072 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:21.072 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.073 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:21.073 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.073 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:21.073 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.073 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:21.073 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.073 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.encryption 2023-12-03T13:00:21.073 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T13:00:21.073 INFO:teuthology.orchestra.run.smithi003.stdout: def test_sse_kms_transfer_1MB(): 2023-12-03T13:00:21.073 INFO:teuthology.orchestra.run.smithi003.stdout: kms_keyid = get_main_kms_keyid() 2023-12-03T13:00:21.073 INFO:teuthology.orchestra.run.smithi003.stdout: if kms_keyid is None: 2023-12-03T13:00:21.073 INFO:teuthology.orchestra.run.smithi003.stdout: pytest.skip('[s3 main] section missing kms_keyid') 2023-12-03T13:00:21.073 INFO:teuthology.orchestra.run.smithi003.stdout:> _test_sse_kms_customer_write(1024*1024, key_id = kms_keyid) 2023-12-03T13:00:21.073 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.073 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:10058: 2023-12-03T13:00:21.074 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.074 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:9788: in _test_sse_kms_customer_write 2023-12-03T13:00:21.074 INFO:teuthology.orchestra.run.smithi003.stdout: bucket_name = get_new_bucket() 2023-12-03T13:00:21.074 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:21.074 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:21.074 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:21.074 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:21.074 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:21.074 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:21.074 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:21.074 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:21.074 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:21.074 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:21.074 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:21.074 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:21.074 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:21.075 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:21.075 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:21.075 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:21.075 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:21.075 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:21.075 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:21.075 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:21.075 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:21.075 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:21.075 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:21.075 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:21.075 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:21.075 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:21.075 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:21.075 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:21.075 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:21.076 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:21.076 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:21.076 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:21.076 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:21.076 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:21.076 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:21.076 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:21.076 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.076 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.076 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.076 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:21.076 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.076 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:21.076 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.076 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:21.076 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:21.077 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:21.077 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:21.077 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:21.077 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:21.077 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.077 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:21.077 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:21.077 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:21.077 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:21.077 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:21.077 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:21.077 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.077 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:21.077 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:21.077 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:21.077 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:21.078 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:21.078 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:21.078 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:21.078 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:21.078 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:21.078 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:21.078 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:21.078 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.078 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.078 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:21.078 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:21.078 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:21.078 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:21.078 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:21.078 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.078 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.079 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:21.079 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:21.079 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:21.079 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:21.079 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:21.079 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.079 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:21.079 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:21.079 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:21.079 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:21.079 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:21.079 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-428" 2023-12-03T13:00:21.079 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.079 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:21.079 INFO:teuthology.orchestra.run.smithi003.stdout:__________________________ test_sse_kms_transfer_13b ___________________________ 2023-12-03T13:00:21.079 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.079 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.080 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.080 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:21.080 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:21.080 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.080 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:21.080 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.080 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:21.080 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:21.080 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:21.080 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.080 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:21.080 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:21.080 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.080 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.080 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:21.080 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:21.081 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.081 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.081 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:21.081 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.081 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:21.081 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:21.081 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.081 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.081 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:21.081 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:21.081 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.081 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:21.081 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:21.081 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:21.082 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:21.082 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:21.082 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.082 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:21.082 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.082 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:21.082 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:21.082 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:21.082 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:21.082 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:21.082 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:21.082 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:21.082 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:21.082 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.082 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.082 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:21.083 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:21.083 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:21.083 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:21.083 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.083 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:21.083 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:21.083 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:21.083 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:21.083 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.083 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.083 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:21.083 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:21.083 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:21.083 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:21.083 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.083 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.084 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:21.084 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:21.084 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:21.084 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.084 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:21.084 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.084 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:21.084 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:21.084 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.084 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:21.084 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:21.084 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:21.084 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:21.084 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:21.084 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:21.084 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.085 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:21.085 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.085 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:21.085 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.085 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.085 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:21.085 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.085 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:21.085 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.085 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:21.085 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:21.085 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:21.085 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:21.085 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:21.085 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:21.085 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.085 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:21.086 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:21.086 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:21.086 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:21.086 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:21.086 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:21.086 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.086 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:21.086 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:21.086 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:21.086 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:21.086 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:21.086 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:21.086 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:21.086 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:21.086 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:21.087 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:21.087 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:21.087 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.087 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.087 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:21.087 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.087 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:21.087 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:21.087 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:21.087 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:21.087 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:21.087 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:21.087 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:21.087 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:21.087 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:21.087 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:21.088 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:21.088 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:21.088 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:21.088 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:21.088 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:21.088 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:21.088 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:21.088 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:21.088 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:21.088 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:21.088 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:21.088 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:21.088 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:21.088 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:21.088 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:21.088 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:21.088 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:21.089 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:21.089 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.089 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.089 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.089 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.089 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:21.089 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:21.089 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.089 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:21.089 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.089 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:21.089 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:21.089 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:21.089 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.089 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:21.089 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:21.089 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.090 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.090 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:21.090 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:21.090 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.090 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.090 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:21.090 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:21.090 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:21.090 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:21.090 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:21.090 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.090 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.090 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:21.090 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:21.090 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:21.091 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.091 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:21.091 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.091 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:21.091 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.091 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:21.091 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.091 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.encryption 2023-12-03T13:00:21.091 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T13:00:21.091 INFO:teuthology.orchestra.run.smithi003.stdout: def test_sse_kms_transfer_13b(): 2023-12-03T13:00:21.091 INFO:teuthology.orchestra.run.smithi003.stdout: kms_keyid = get_main_kms_keyid() 2023-12-03T13:00:21.091 INFO:teuthology.orchestra.run.smithi003.stdout: if kms_keyid is None: 2023-12-03T13:00:21.091 INFO:teuthology.orchestra.run.smithi003.stdout: pytest.skip('[s3 main] section missing kms_keyid') 2023-12-03T13:00:21.091 INFO:teuthology.orchestra.run.smithi003.stdout:> _test_sse_kms_customer_write(13, key_id = kms_keyid) 2023-12-03T13:00:21.091 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.091 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:10067: 2023-12-03T13:00:21.091 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.092 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:9788: in _test_sse_kms_customer_write 2023-12-03T13:00:21.092 INFO:teuthology.orchestra.run.smithi003.stdout: bucket_name = get_new_bucket() 2023-12-03T13:00:21.092 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:21.092 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:21.092 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:21.092 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:21.092 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:21.092 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:21.092 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:21.092 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:21.092 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:21.092 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:21.092 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:21.092 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:21.093 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:21.093 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:21.093 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:21.093 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:21.093 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:21.093 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:21.093 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:21.093 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:21.093 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:21.093 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:21.093 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:21.093 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:21.093 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:21.093 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:21.093 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:21.093 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:21.094 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:21.094 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:21.094 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:21.094 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:21.094 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:21.094 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:21.094 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:21.094 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:21.094 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.094 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.094 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.094 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:21.094 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.094 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:21.094 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.094 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:21.095 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:21.095 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:21.095 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:21.095 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:21.095 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:21.095 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.095 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:21.095 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:21.095 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:21.095 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:21.095 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:21.095 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:21.095 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.095 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:21.095 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:21.095 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:21.096 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:21.096 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:21.096 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:21.096 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:21.096 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:21.096 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:21.096 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:21.096 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:21.096 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.096 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.096 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:21.096 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:21.096 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:21.096 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:21.096 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:21.096 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.097 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.097 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:21.097 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:21.097 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:21.097 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:21.097 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:21.097 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.097 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:21.097 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:21.097 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:21.097 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:21.097 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:21.097 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-429" 2023-12-03T13:00:21.097 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.097 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:21.097 INFO:teuthology.orchestra.run.smithi003.stdout:__________________________ test_sse_kms_read_declare ___________________________ 2023-12-03T13:00:21.097 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.098 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.098 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.098 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:21.098 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:21.098 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.098 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:21.098 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.098 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:21.098 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:21.098 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:21.098 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.098 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:21.098 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:21.098 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.098 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.098 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:21.099 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:21.099 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.099 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.099 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:21.099 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.099 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:21.099 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:21.099 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.099 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.099 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:21.099 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:21.099 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.099 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:21.099 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:21.099 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:21.099 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:21.099 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:21.100 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.100 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:21.100 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.100 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:21.100 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:21.100 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:21.100 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:21.100 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:21.100 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:21.100 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:21.100 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:21.100 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.100 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.100 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:21.100 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:21.100 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:21.101 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:21.101 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.101 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:21.101 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:21.101 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:21.101 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:21.101 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.101 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.101 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:21.101 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:21.101 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:21.101 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:21.101 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.101 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.101 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:21.101 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:21.102 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:21.102 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.102 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:21.102 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.102 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:21.102 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:21.102 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.102 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:21.102 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:21.102 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:21.102 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:21.102 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:21.102 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:21.102 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.102 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:21.102 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.103 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:21.103 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.103 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.103 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:21.103 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.103 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:21.103 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.103 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:21.103 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:21.103 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:21.103 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:21.103 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:21.103 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:21.103 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.104 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:21.104 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:21.104 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:21.104 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:21.104 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:21.104 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:21.104 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.104 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:21.104 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:21.104 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:21.104 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:21.104 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:21.104 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:21.104 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:21.104 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:21.104 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:21.105 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:21.105 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:21.105 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.105 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.105 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:21.105 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.105 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:21.105 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:21.105 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:21.105 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:21.105 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:21.105 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:21.105 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:21.105 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:21.105 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:21.105 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:21.106 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:21.106 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:21.106 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:21.106 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:21.106 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:21.106 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:21.106 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:21.106 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:21.106 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:21.106 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:21.106 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:21.106 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:21.106 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:21.106 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:21.106 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:21.107 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:21.107 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:21.107 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:21.107 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.107 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.107 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.107 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.107 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:21.107 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:21.107 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.107 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:21.107 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.107 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:21.107 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:21.107 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:21.107 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.108 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:21.108 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:21.108 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.108 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.108 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:21.108 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:21.108 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.108 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.108 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:21.108 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:21.108 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:21.108 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:21.108 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:21.108 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.108 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.108 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:21.108 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:21.109 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:21.109 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.109 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:21.109 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.109 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:21.109 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.109 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:21.109 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.109 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.encryption 2023-12-03T13:00:21.109 INFO:teuthology.orchestra.run.smithi003.stdout: def test_sse_kms_read_declare(): 2023-12-03T13:00:21.109 INFO:teuthology.orchestra.run.smithi003.stdout:> bucket_name = get_new_bucket() 2023-12-03T13:00:21.109 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.109 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:10072: 2023-12-03T13:00:21.109 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.109 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:21.109 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:21.110 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:21.110 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:21.110 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:21.110 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:21.110 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:21.110 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:21.110 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:21.110 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:21.110 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:21.110 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:21.110 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:21.110 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:21.110 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:21.110 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:21.110 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:21.110 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:21.110 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:21.111 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:21.111 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:21.111 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:21.111 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:21.111 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:21.111 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:21.111 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:21.111 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:21.111 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:21.111 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:21.111 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:21.111 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:21.111 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:21.111 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:21.111 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:21.112 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:21.112 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:21.112 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.112 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.112 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.112 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:21.112 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.112 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:21.112 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.112 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:21.112 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:21.112 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:21.112 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:21.112 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:21.112 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:21.112 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.113 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:21.113 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:21.113 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:21.113 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:21.113 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:21.113 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:21.113 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.113 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:21.113 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:21.113 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:21.113 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:21.113 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:21.113 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:21.113 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:21.114 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:21.114 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:21.114 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:21.114 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:21.114 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.114 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.114 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:21.114 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:21.114 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:21.114 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:21.114 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:21.114 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.114 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.114 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:21.114 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:21.114 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:21.115 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:21.115 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:21.115 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.115 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:21.115 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:21.115 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:21.115 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:21.115 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:21.115 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-430" 2023-12-03T13:00:21.115 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.115 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:21.115 INFO:teuthology.orchestra.run.smithi003.stdout:______________________________ test_bucket_policy ______________________________ 2023-12-03T13:00:21.115 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.115 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.115 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.115 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:21.115 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:21.116 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.116 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:21.116 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.116 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:21.116 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:21.116 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:21.116 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.116 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:21.116 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:21.116 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.116 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.116 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:21.116 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:21.116 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.116 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.116 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:21.117 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.117 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:21.117 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:21.117 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.117 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.117 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:21.117 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:21.117 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.117 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:21.117 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:21.117 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:21.117 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:21.117 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:21.117 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.117 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:21.117 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.117 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:21.118 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:21.118 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:21.118 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:21.118 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:21.118 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:21.118 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:21.118 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:21.118 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.118 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.118 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:21.118 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:21.118 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:21.118 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:21.118 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.118 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:21.118 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:21.119 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:21.119 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:21.119 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.119 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.119 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:21.119 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:21.119 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:21.119 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:21.119 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.119 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.119 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:21.119 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:21.119 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:21.119 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.119 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:21.119 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.120 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:21.120 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:21.120 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.120 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:21.120 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:21.120 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:21.120 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:21.120 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:21.120 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:21.120 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.120 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:21.120 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.120 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:21.120 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.120 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.120 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:21.121 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.121 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:21.121 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.121 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:21.121 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:21.121 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:21.121 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:21.121 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:21.121 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:21.121 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.121 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:21.121 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:21.121 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:21.121 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:21.121 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:21.122 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:21.122 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.122 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:21.122 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:21.122 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:21.122 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:21.122 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:21.122 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:21.122 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:21.122 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:21.122 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:21.122 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:21.122 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:21.122 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.122 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.123 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:21.123 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.123 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:21.123 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:21.123 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:21.123 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:21.123 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:21.123 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:21.123 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:21.123 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:21.123 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:21.123 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:21.123 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:21.123 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:21.123 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:21.123 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:21.124 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:21.124 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:21.124 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:21.124 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:21.124 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:21.124 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:21.124 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:21.124 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:21.124 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:21.124 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:21.124 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:21.124 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:21.124 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:21.124 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:21.124 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.124 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.125 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.125 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.125 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:21.125 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:21.125 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.125 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:21.125 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.125 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:21.125 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:21.125 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:21.125 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.125 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:21.125 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:21.125 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.125 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.126 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:21.126 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:21.126 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.126 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.126 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:21.126 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:21.126 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:21.126 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:21.126 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:21.126 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.126 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.126 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:21.126 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:21.126 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:21.126 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.126 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:21.127 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.127 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:21.127 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.127 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:21.127 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.127 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.bucket_policy 2023-12-03T13:00:21.127 INFO:teuthology.orchestra.run.smithi003.stdout: def test_bucket_policy(): 2023-12-03T13:00:21.127 INFO:teuthology.orchestra.run.smithi003.stdout:> bucket_name = get_new_bucket() 2023-12-03T13:00:21.127 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.127 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:10091: 2023-12-03T13:00:21.127 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.127 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:21.127 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:21.127 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:21.127 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:21.127 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:21.128 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:21.128 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:21.128 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:21.128 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:21.128 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:21.128 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:21.128 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:21.128 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:21.128 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:21.128 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:21.128 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:21.128 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:21.128 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:21.128 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:21.128 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:21.128 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:21.128 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:21.129 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:21.129 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:21.129 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:21.129 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:21.129 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:21.129 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:21.129 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:21.129 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:21.129 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:21.129 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:21.129 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:21.129 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:21.129 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:21.129 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:21.129 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.129 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.129 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.130 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:21.130 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.130 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:21.130 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.130 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:21.130 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:21.130 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:21.130 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:21.130 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:21.130 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:21.130 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.130 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:21.130 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:21.130 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:21.130 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:21.131 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:21.131 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:21.131 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.131 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:21.131 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:21.131 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:21.131 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:21.131 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:21.131 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:21.131 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:21.131 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:21.131 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:21.131 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:21.131 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:21.131 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.131 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.131 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:21.132 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:21.132 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:21.132 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:21.132 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:21.132 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.132 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.132 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:21.132 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:21.132 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:21.132 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:21.132 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:21.132 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.132 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:21.132 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:21.132 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:21.132 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:21.133 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:21.133 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-431" 2023-12-03T13:00:21.133 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.133 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:21.133 INFO:teuthology.orchestra.run.smithi003.stdout:_____________________________ test_bucketv2_policy _____________________________ 2023-12-03T13:00:21.133 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.133 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.133 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.133 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:21.133 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:21.133 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.133 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:21.133 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.133 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:21.133 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:21.133 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:21.133 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.134 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:21.134 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:21.134 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.134 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.134 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:21.134 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:21.134 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.134 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.134 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:21.134 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.134 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:21.134 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:21.134 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.134 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.134 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:21.134 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:21.135 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.135 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:21.135 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:21.135 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:21.135 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:21.135 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:21.135 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.135 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:21.135 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.135 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:21.135 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:21.135 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:21.135 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:21.135 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:21.135 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:21.136 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:21.136 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:21.136 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.136 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.136 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:21.136 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:21.136 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:21.136 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:21.136 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.136 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:21.136 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:21.136 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:21.136 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:21.136 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.136 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.137 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:21.137 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:21.137 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:21.137 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:21.137 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.137 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.137 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:21.137 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:21.137 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:21.137 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.137 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:21.137 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.137 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:21.137 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:21.137 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.137 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:21.137 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:21.138 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:21.138 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:21.138 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:21.138 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:21.138 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.138 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:21.138 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.138 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:21.138 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.138 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.138 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:21.138 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.138 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:21.138 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.138 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:21.139 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:21.139 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:21.139 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:21.139 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:21.139 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:21.139 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.139 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:21.139 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:21.139 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:21.139 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:21.139 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:21.139 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:21.139 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.139 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:21.139 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:21.139 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:21.140 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:21.140 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:21.140 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:21.140 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:21.140 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:21.140 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:21.140 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:21.140 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:21.140 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.140 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.140 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:21.140 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.140 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:21.140 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:21.140 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:21.140 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:21.141 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:21.141 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:21.141 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:21.141 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:21.141 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:21.141 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:21.141 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:21.141 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:21.141 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:21.141 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:21.141 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:21.141 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:21.141 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:21.141 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:21.141 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:21.141 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:21.141 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:21.142 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:21.142 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:21.142 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:21.142 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:21.142 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:21.142 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:21.142 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:21.142 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.142 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.142 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.142 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.142 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:21.142 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:21.142 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.142 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:21.142 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.143 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:21.143 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:21.143 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:21.143 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.143 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:21.143 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:21.143 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.143 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.143 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:21.143 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:21.143 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.143 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.143 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:21.143 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:21.143 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:21.143 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:21.144 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:21.144 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.144 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.144 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:21.144 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:21.144 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:21.144 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.144 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:21.144 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.144 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:21.144 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.144 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:21.144 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.144 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.bucket_policy 2023-12-03T13:00:21.144 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.list_objects_v2 2023-12-03T13:00:21.144 INFO:teuthology.orchestra.run.smithi003.stdout: def test_bucketv2_policy(): 2023-12-03T13:00:21.144 INFO:teuthology.orchestra.run.smithi003.stdout:> bucket_name = get_new_bucket() 2023-12-03T13:00:21.145 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.145 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:10121: 2023-12-03T13:00:21.145 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.145 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:21.145 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:21.145 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:21.145 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:21.145 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:21.145 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:21.145 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:21.145 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:21.145 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:21.145 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:21.145 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:21.145 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:21.146 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:21.146 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:21.146 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:21.146 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:21.146 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:21.146 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:21.146 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:21.146 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:21.146 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:21.146 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:21.146 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:21.146 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:21.146 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:21.146 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:21.146 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:21.147 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:21.147 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:21.147 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:21.147 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:21.147 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:21.147 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:21.147 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:21.147 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:21.147 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:21.147 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.147 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.147 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.147 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:21.147 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.147 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:21.147 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.148 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:21.148 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:21.148 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:21.148 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:21.148 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:21.148 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:21.148 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.148 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:21.148 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:21.148 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:21.148 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:21.148 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:21.148 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:21.148 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.148 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:21.148 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:21.149 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:21.149 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:21.149 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:21.149 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:21.149 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:21.149 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:21.149 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:21.149 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:21.149 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:21.149 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.149 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.149 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:21.149 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:21.149 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:21.149 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:21.149 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:21.150 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.150 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.150 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:21.150 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:21.150 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:21.150 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:21.150 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:21.150 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.150 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:21.150 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:21.150 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:21.150 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:21.150 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:21.150 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-432" 2023-12-03T13:00:21.150 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.150 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:21.151 INFO:teuthology.orchestra.run.smithi003.stdout:____________________________ test_bucket_policy_acl ____________________________ 2023-12-03T13:00:21.151 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.151 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.151 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.151 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:21.151 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:21.151 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.151 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:21.151 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.151 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:21.151 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:21.151 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:21.151 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.151 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:21.151 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:21.151 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.152 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.152 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:21.152 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:21.152 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.152 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.152 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:21.152 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.152 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:21.152 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:21.152 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.152 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.152 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:21.152 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:21.152 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.152 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:21.152 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:21.152 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:21.153 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:21.153 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:21.153 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.153 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:21.153 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.153 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:21.153 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:21.153 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:21.153 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:21.153 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:21.153 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:21.153 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:21.153 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:21.153 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.153 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.153 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:21.154 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:21.154 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:21.154 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:21.154 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.154 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:21.154 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:21.154 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:21.154 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:21.154 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.154 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.154 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:21.154 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:21.154 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:21.154 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:21.154 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.154 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.154 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:21.155 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:21.155 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:21.155 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.155 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:21.155 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.155 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:21.155 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:21.155 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.155 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:21.155 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:21.155 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:21.155 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:21.155 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:21.155 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:21.155 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.155 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:21.156 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.156 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:21.156 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.156 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.156 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:21.156 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.156 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:21.156 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.156 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:21.156 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:21.156 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:21.156 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:21.156 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:21.156 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:21.156 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.156 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:21.157 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:21.157 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:21.157 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:21.157 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:21.157 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:21.157 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.157 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:21.157 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:21.157 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:21.157 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:21.157 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:21.157 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:21.157 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:21.157 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:21.157 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:21.158 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:21.158 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:21.158 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.158 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.158 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:21.158 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.158 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:21.158 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:21.158 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:21.158 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:21.158 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:21.158 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:21.158 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:21.158 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:21.158 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:21.158 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:21.159 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:21.159 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:21.159 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:21.159 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:21.159 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:21.159 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:21.159 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:21.159 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:21.159 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:21.159 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:21.159 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:21.159 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:21.159 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:21.159 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:21.159 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:21.159 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:21.160 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:21.160 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:21.160 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.160 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.160 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.160 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.160 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:21.160 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:21.160 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.160 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:21.160 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.160 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:21.160 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:21.160 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:21.160 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.160 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:21.160 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:21.161 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.161 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.161 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:21.161 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:21.161 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.161 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.161 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:21.161 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:21.161 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:21.161 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:21.161 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:21.161 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.161 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.161 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:21.161 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:21.161 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:21.162 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.162 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:21.162 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.162 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:21.162 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.162 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:21.162 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.162 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.bucket_policy 2023-12-03T13:00:21.162 INFO:teuthology.orchestra.run.smithi003.stdout: def test_bucket_policy_acl(): 2023-12-03T13:00:21.162 INFO:teuthology.orchestra.run.smithi003.stdout:> bucket_name = get_new_bucket() 2023-12-03T13:00:21.162 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.162 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:10150: 2023-12-03T13:00:21.162 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.162 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:21.162 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:21.162 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:21.163 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:21.163 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:21.163 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:21.163 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:21.163 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:21.163 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:21.163 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:21.163 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:21.163 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:21.163 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:21.163 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:21.163 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:21.163 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:21.163 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:21.163 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:21.164 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:21.164 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:21.164 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:21.164 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:21.164 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:21.164 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:21.164 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:21.164 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:21.164 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:21.164 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:21.164 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:21.164 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:21.164 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:21.164 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:21.164 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:21.164 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:21.164 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:21.165 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:21.165 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.165 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.165 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.165 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:21.165 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.165 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:21.165 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.165 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:21.165 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:21.165 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:21.165 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:21.165 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:21.165 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:21.165 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.165 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:21.166 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:21.166 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:21.166 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:21.166 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:21.166 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:21.166 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.166 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:21.166 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:21.166 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:21.166 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:21.166 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:21.166 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:21.166 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:21.166 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:21.166 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:21.166 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:21.166 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:21.167 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.167 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.167 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:21.167 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:21.167 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:21.167 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:21.167 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:21.167 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.167 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.167 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:21.167 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:21.167 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:21.167 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:21.167 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:21.167 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.168 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:21.168 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:21.168 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:21.168 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:21.168 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:21.168 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-433" 2023-12-03T13:00:21.168 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.168 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:21.168 INFO:teuthology.orchestra.run.smithi003.stdout:___________________________ test_bucketv2_policy_acl ___________________________ 2023-12-03T13:00:21.168 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.168 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.168 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.168 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:21.168 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:21.168 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.169 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:21.169 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.169 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:21.169 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:21.169 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:21.169 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.169 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:21.169 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:21.169 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.169 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.169 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:21.169 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:21.169 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.169 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.169 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:21.169 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.169 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:21.170 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:21.170 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.170 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.170 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:21.170 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:21.170 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.170 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:21.170 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:21.170 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:21.170 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:21.170 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:21.170 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.170 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:21.170 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.170 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:21.171 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:21.171 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:21.171 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:21.171 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:21.171 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:21.171 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:21.171 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:21.171 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.171 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.171 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:21.171 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:21.171 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:21.171 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:21.171 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.171 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:21.171 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:21.172 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:21.172 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:21.172 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.172 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.172 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:21.172 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:21.172 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:21.172 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:21.172 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.172 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.172 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:21.172 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:21.172 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:21.172 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.172 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:21.172 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.173 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:21.173 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:21.173 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.173 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:21.173 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:21.173 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:21.173 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:21.173 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:21.173 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:21.173 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.173 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:21.173 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.173 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:21.173 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.173 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.174 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:21.174 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.174 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:21.174 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.174 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:21.174 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:21.174 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:21.174 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:21.174 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:21.174 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:21.174 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.174 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:21.174 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:21.174 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:21.174 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:21.174 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:21.175 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:21.175 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.175 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:21.175 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:21.175 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:21.175 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:21.175 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:21.175 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:21.175 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:21.175 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:21.175 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:21.175 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:21.175 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:21.175 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.175 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.175 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:21.176 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.176 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:21.176 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:21.176 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:21.176 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:21.176 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:21.176 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:21.176 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:21.176 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:21.176 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:21.176 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:21.176 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:21.176 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:21.176 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:21.176 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:21.176 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:21.177 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:21.177 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:21.177 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:21.177 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:21.177 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:21.177 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:21.177 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:21.177 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:21.177 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:21.177 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:21.177 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:21.177 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:21.177 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:21.177 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.177 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.177 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.178 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.178 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:21.178 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:21.178 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.178 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:21.178 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.178 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:21.178 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:21.178 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:21.178 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.178 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:21.178 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:21.178 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.178 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.178 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:21.178 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:21.179 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.179 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.179 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:21.179 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:21.179 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:21.179 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:21.179 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:21.179 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.179 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.179 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:21.179 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:21.179 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:21.179 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.179 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:21.179 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.180 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:21.180 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.180 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:21.180 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.180 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.bucket_policy 2023-12-03T13:00:21.180 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.list_objects_v2 2023-12-03T13:00:21.180 INFO:teuthology.orchestra.run.smithi003.stdout: def test_bucketv2_policy_acl(): 2023-12-03T13:00:21.180 INFO:teuthology.orchestra.run.smithi003.stdout:> bucket_name = get_new_bucket() 2023-12-03T13:00:21.180 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.180 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:10186: 2023-12-03T13:00:21.180 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.180 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:21.180 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:21.180 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:21.180 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:21.180 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:21.181 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:21.181 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:21.181 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:21.181 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:21.181 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:21.181 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:21.181 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:21.181 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:21.181 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:21.181 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:21.181 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:21.181 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:21.181 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:21.181 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:21.181 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:21.181 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:21.182 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:21.182 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:21.182 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:21.182 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:21.182 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:21.182 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:21.182 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:21.182 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:21.182 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:21.182 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:21.182 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:21.182 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:21.182 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:21.182 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:21.182 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:21.183 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.183 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.183 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.183 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:21.183 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.183 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:21.183 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.183 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:21.183 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:21.183 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:21.183 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:21.183 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:21.183 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:21.183 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.183 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:21.183 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:21.183 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:21.184 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:21.184 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:21.184 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:21.184 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.184 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:21.184 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:21.184 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:21.184 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:21.184 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:21.184 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:21.184 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:21.184 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:21.184 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:21.184 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:21.184 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:21.184 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.185 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.185 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:21.185 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:21.185 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:21.185 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:21.185 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:21.185 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.185 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.185 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:21.185 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:21.185 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:21.185 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:21.185 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:21.185 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.185 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:21.185 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:21.185 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:21.186 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:21.186 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:21.186 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-434" 2023-12-03T13:00:21.186 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.186 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:21.186 INFO:teuthology.orchestra.run.smithi003.stdout:______________________ test_bucket_policy_another_bucket _______________________ 2023-12-03T13:00:21.186 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.186 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.186 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.186 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:21.186 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:21.186 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.186 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:21.186 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.186 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:21.186 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:21.187 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:21.187 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.187 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:21.187 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:21.187 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.187 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.187 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:21.187 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:21.187 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.187 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.187 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:21.187 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.187 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:21.187 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:21.187 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.187 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.188 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:21.188 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:21.188 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.188 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:21.188 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:21.188 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:21.188 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:21.188 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:21.188 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.188 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:21.188 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.188 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:21.188 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:21.188 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:21.188 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:21.188 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:21.188 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:21.189 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:21.189 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:21.189 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.189 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.189 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:21.189 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:21.189 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:21.189 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:21.189 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.189 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:21.189 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:21.189 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:21.189 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:21.189 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.189 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.190 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:21.190 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:21.190 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:21.190 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:21.190 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.190 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.190 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:21.190 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:21.190 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:21.190 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.190 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:21.190 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.190 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:21.190 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:21.190 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.190 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:21.191 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:21.191 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:21.191 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:21.191 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:21.191 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:21.191 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.191 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:21.191 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.191 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:21.191 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.191 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.191 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:21.191 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.191 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:21.191 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.192 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:21.192 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:21.192 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:21.192 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:21.192 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:21.192 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:21.192 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.192 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:21.192 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:21.192 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:21.192 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:21.192 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:21.192 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:21.192 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.192 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:21.192 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:21.192 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:21.193 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:21.193 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:21.193 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:21.193 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:21.193 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:21.193 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:21.193 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:21.193 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:21.193 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.193 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.193 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:21.193 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.193 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:21.193 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:21.193 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:21.193 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:21.193 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:21.194 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:21.194 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:21.194 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:21.194 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:21.194 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:21.194 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:21.194 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:21.194 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:21.194 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:21.194 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:21.194 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:21.194 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:21.194 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:21.194 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:21.194 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:21.194 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:21.195 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:21.195 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:21.195 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:21.195 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:21.195 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:21.195 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:21.195 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:21.195 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.195 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.195 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.195 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.195 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:21.195 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:21.195 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.195 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:21.195 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.196 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:21.196 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:21.196 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:21.196 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.196 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:21.196 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:21.196 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.196 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.196 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:21.196 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:21.196 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.196 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.196 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:21.196 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:21.196 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:21.196 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:21.196 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:21.197 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.197 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.197 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:21.197 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:21.197 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:21.197 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.197 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:21.197 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.197 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:21.197 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.197 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:21.197 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.197 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.bucket_policy 2023-12-03T13:00:21.197 INFO:teuthology.orchestra.run.smithi003.stdout: def test_bucket_policy_another_bucket(): 2023-12-03T13:00:21.197 INFO:teuthology.orchestra.run.smithi003.stdout:> bucket_name = get_new_bucket() 2023-12-03T13:00:21.197 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.197 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:10310: 2023-12-03T13:00:21.198 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.198 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:21.198 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:21.198 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:21.198 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:21.198 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:21.198 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:21.198 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:21.198 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:21.198 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:21.198 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:21.198 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:21.198 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:21.198 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:21.198 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:21.198 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:21.199 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:21.199 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:21.199 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:21.199 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:21.199 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:21.199 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:21.199 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:21.199 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:21.199 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:21.199 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:21.199 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:21.199 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:21.199 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:21.199 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:21.199 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:21.199 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:21.200 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:21.200 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:21.200 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:21.200 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:21.200 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:21.200 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.200 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.200 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.200 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:21.200 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.200 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:21.200 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.200 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:21.200 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:21.201 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:21.201 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:21.201 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:21.201 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:21.201 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.201 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:21.201 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:21.201 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:21.201 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:21.201 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:21.201 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:21.201 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.201 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:21.201 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:21.201 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:21.201 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:21.201 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:21.202 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:21.202 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:21.202 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:21.202 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:21.202 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:21.202 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:21.202 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.202 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.202 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:21.202 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:21.202 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:21.202 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:21.202 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:21.202 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.202 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.203 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:21.203 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:21.203 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:21.203 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:21.203 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:21.203 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.203 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:21.203 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:21.203 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:21.203 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:21.203 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:21.203 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-435" 2023-12-03T13:00:21.203 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.203 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:21.203 INFO:teuthology.orchestra.run.smithi003.stdout:_____________________ test_bucketv2_policy_another_bucket ______________________ 2023-12-03T13:00:21.203 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.204 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.204 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.204 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:21.204 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:21.204 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.204 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:21.204 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.204 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:21.204 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:21.204 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:21.204 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.204 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:21.204 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:21.204 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.204 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.204 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:21.205 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:21.205 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.205 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.205 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:21.205 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.205 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:21.205 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:21.205 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.205 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.205 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:21.205 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:21.205 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.205 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:21.205 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:21.205 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:21.205 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:21.205 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:21.206 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.206 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:21.206 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.206 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:21.206 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:21.206 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:21.206 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:21.206 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:21.206 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:21.206 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:21.206 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:21.206 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.206 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.206 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:21.206 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:21.207 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:21.207 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:21.207 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.207 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:21.207 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:21.207 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:21.207 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:21.207 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.207 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.207 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:21.207 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:21.207 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:21.207 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:21.207 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.207 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.207 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:21.207 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:21.208 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:21.208 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.208 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:21.208 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.208 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:21.208 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:21.208 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.208 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:21.208 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:21.208 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:21.208 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:21.208 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:21.208 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:21.208 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.208 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:21.208 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.208 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:21.209 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.209 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.209 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:21.209 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.209 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:21.209 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.209 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:21.209 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:21.209 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:21.209 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:21.209 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:21.209 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:21.209 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.209 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:21.209 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:21.209 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:21.210 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:21.210 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:21.210 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:21.210 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.210 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:21.210 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:21.210 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:21.210 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:21.210 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:21.210 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:21.210 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:21.210 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:21.210 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:21.210 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:21.210 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:21.210 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.211 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.211 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:21.211 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.211 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:21.211 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:21.211 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:21.211 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:21.211 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:21.211 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:21.211 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:21.211 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:21.211 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:21.211 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:21.212 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:21.212 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:21.212 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:21.212 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:21.212 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:21.212 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:21.212 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:21.212 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:21.212 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:21.212 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:21.212 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:21.212 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:21.212 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:21.212 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:21.212 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:21.212 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:21.212 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:21.213 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:21.213 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.213 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.213 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.213 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.213 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:21.213 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:21.213 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.213 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:21.213 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.213 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:21.213 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:21.213 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:21.213 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.213 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:21.214 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:21.214 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.214 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.214 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:21.214 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:21.214 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.214 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.214 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:21.214 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:21.214 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:21.214 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:21.214 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:21.214 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.214 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.214 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:21.214 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:21.215 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:21.215 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.215 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:21.215 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.215 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:21.215 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.215 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:21.215 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.215 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.bucket_policy 2023-12-03T13:00:21.215 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.list_objects_v2 2023-12-03T13:00:21.215 INFO:teuthology.orchestra.run.smithi003.stdout: def test_bucketv2_policy_another_bucket(): 2023-12-03T13:00:21.215 INFO:teuthology.orchestra.run.smithi003.stdout:> bucket_name = get_new_bucket() 2023-12-03T13:00:21.215 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.215 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:10348: 2023-12-03T13:00:21.215 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.215 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:21.215 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:21.216 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:21.216 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:21.216 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:21.216 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:21.216 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:21.216 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:21.216 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:21.216 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:21.216 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:21.216 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:21.216 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:21.216 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:21.216 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:21.216 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:21.216 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:21.216 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:21.217 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:21.217 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:21.217 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:21.217 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:21.217 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:21.217 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:21.217 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:21.217 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:21.217 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:21.217 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:21.217 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:21.217 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:21.217 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:21.217 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:21.217 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:21.217 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:21.217 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:21.218 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:21.218 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.218 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.218 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.218 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:21.218 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.218 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:21.218 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.218 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:21.218 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:21.218 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:21.218 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:21.218 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:21.218 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:21.218 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.218 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:21.219 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:21.219 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:21.219 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:21.219 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:21.219 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:21.219 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.219 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:21.219 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:21.219 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:21.219 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:21.219 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:21.219 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:21.219 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:21.219 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:21.219 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:21.219 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:21.219 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:21.220 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.220 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.220 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:21.220 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:21.220 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:21.220 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:21.220 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:21.220 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.220 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.220 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:21.220 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:21.220 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:21.220 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:21.220 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:21.220 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.220 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:21.221 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:21.221 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:21.221 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:21.221 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:21.221 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-436" 2023-12-03T13:00:21.221 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.221 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:21.221 INFO:teuthology.orchestra.run.smithi003.stdout:_____________________________ test_get_obj_tagging _____________________________ 2023-12-03T13:00:21.221 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.221 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.221 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.221 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:21.221 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:21.221 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.221 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:21.222 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.222 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:21.222 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:21.222 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:21.222 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.222 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:21.222 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:21.222 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.222 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.222 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:21.222 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:21.222 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.222 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.222 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:21.222 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.223 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:21.223 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:21.223 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.223 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.223 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:21.223 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:21.223 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.223 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:21.223 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:21.223 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:21.223 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:21.223 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:21.223 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.223 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:21.223 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.223 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:21.223 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:21.224 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:21.224 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:21.224 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:21.224 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:21.224 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:21.224 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:21.224 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.224 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.224 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:21.224 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:21.224 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:21.224 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:21.224 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.224 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:21.224 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:21.224 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:21.225 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:21.225 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.225 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.225 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:21.225 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:21.225 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:21.225 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:21.225 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.225 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.225 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:21.225 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:21.225 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:21.225 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.225 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:21.225 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.225 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:21.225 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:21.226 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.226 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:21.226 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:21.226 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:21.226 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:21.226 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:21.226 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:21.226 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.226 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:21.226 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.226 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:21.226 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.226 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.226 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:21.226 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.227 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:21.227 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.227 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:21.227 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:21.227 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:21.227 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:21.227 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:21.227 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:21.227 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.227 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:21.227 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:21.227 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:21.227 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:21.227 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:21.227 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:21.228 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.228 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:21.228 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:21.228 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:21.228 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:21.228 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:21.228 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:21.228 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:21.228 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:21.228 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:21.228 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:21.228 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:21.228 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.228 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.228 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:21.228 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.228 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:21.229 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:21.229 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:21.229 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:21.229 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:21.229 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:21.229 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:21.229 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:21.229 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:21.229 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:21.229 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:21.229 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:21.229 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:21.229 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:21.229 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:21.229 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:21.229 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:21.230 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:21.230 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:21.230 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:21.230 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:21.230 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:21.230 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:21.230 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:21.230 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:21.230 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:21.230 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:21.230 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:21.230 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.230 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.230 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.230 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.230 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:21.230 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:21.231 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.231 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:21.231 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.231 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:21.231 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:21.231 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:21.231 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.231 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:21.231 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:21.231 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.231 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.231 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:21.231 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:21.231 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.231 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.232 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:21.232 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:21.232 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:21.232 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:21.232 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:21.232 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.232 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.232 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:21.232 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:21.232 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:21.232 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.232 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:21.232 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.232 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:21.232 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.233 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:21.233 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.233 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.tagging 2023-12-03T13:00:21.233 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T13:00:21.233 INFO:teuthology.orchestra.run.smithi003.stdout: def test_get_obj_tagging(): 2023-12-03T13:00:21.233 INFO:teuthology.orchestra.run.smithi003.stdout: key = 'testputtags' 2023-12-03T13:00:21.233 INFO:teuthology.orchestra.run.smithi003.stdout:> bucket_name = _create_key_with_random_content(key) 2023-12-03T13:00:21.233 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.233 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:10458: 2023-12-03T13:00:21.233 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.233 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:5832: in _create_key_with_random_content 2023-12-03T13:00:21.233 INFO:teuthology.orchestra.run.smithi003.stdout: bucket_name = get_new_bucket() 2023-12-03T13:00:21.233 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:21.233 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:21.233 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:21.234 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:21.234 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:21.234 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:21.234 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:21.234 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:21.234 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:21.234 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:21.234 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:21.234 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:21.234 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:21.234 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:21.234 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:21.234 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:21.234 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:21.234 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:21.234 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:21.234 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:21.235 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:21.235 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:21.235 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:21.235 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:21.235 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:21.235 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:21.235 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:21.235 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:21.235 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:21.235 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:21.235 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:21.235 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:21.235 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:21.235 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:21.235 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:21.235 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:21.236 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.236 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.236 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.236 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:21.236 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.236 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:21.236 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.236 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:21.236 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:21.236 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:21.236 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:21.236 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:21.236 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:21.236 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.236 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:21.236 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:21.236 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:21.237 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:21.237 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:21.237 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:21.237 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.237 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:21.237 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:21.237 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:21.237 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:21.237 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:21.237 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:21.237 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:21.237 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:21.237 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:21.237 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:21.237 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:21.237 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.238 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.238 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:21.238 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:21.238 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:21.238 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:21.238 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:21.238 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.238 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.238 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:21.238 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:21.238 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:21.238 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:21.238 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:21.238 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.238 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:21.238 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:21.239 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:21.239 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:21.239 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:21.239 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-437" 2023-12-03T13:00:21.239 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.239 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:21.239 INFO:teuthology.orchestra.run.smithi003.stdout:__________________________ test_get_obj_head_tagging ___________________________ 2023-12-03T13:00:21.239 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.239 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.239 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.239 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:21.239 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:21.239 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.239 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:21.239 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.239 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:21.240 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:21.240 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:21.240 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.240 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:21.240 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:21.240 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.240 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.240 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:21.240 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:21.240 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.240 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.240 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:21.240 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.240 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:21.240 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:21.240 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.241 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.241 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:21.241 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:21.241 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.241 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:21.241 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:21.241 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:21.241 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:21.241 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:21.241 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.241 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:21.241 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.241 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:21.241 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:21.241 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:21.241 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:21.241 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:21.242 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:21.242 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:21.242 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:21.242 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.242 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.242 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:21.242 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:21.242 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:21.242 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:21.242 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.242 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:21.242 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:21.242 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:21.242 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:21.242 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.242 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.243 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:21.243 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:21.243 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:21.243 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:21.243 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.243 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.243 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:21.243 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:21.243 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:21.243 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.243 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:21.243 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.243 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:21.243 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:21.243 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.244 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:21.244 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:21.244 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:21.244 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:21.244 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:21.244 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:21.244 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.244 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:21.244 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.244 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:21.244 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.244 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.244 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:21.244 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.244 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:21.244 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.245 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:21.245 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:21.245 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:21.245 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:21.245 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:21.245 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:21.245 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.245 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:21.245 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:21.245 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:21.245 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:21.245 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:21.245 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:21.245 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.245 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:21.246 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:21.246 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:21.246 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:21.246 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:21.246 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:21.246 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:21.246 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:21.246 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:21.246 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:21.246 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:21.246 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.246 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.246 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:21.246 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.246 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:21.246 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:21.246 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:21.247 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:21.247 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:21.247 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:21.247 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:21.247 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:21.247 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:21.247 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:21.247 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:21.247 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:21.247 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:21.247 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:21.247 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:21.247 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:21.247 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:21.247 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:21.247 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:21.248 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:21.248 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:21.248 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:21.248 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:21.248 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:21.248 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:21.248 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:21.248 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:21.248 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:21.248 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.248 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.248 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.248 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.248 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:21.248 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:21.248 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.248 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:21.249 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.249 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:21.249 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:21.249 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:21.249 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.249 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:21.249 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:21.249 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.249 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.249 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:21.249 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:21.249 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.249 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.249 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:21.249 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:21.249 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:21.250 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:21.250 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:21.250 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.250 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.250 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:21.250 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:21.250 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:21.250 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.250 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:21.250 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.250 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:21.250 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.250 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:21.250 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.250 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.tagging 2023-12-03T13:00:21.250 INFO:teuthology.orchestra.run.smithi003.stdout: def test_get_obj_head_tagging(): 2023-12-03T13:00:21.251 INFO:teuthology.orchestra.run.smithi003.stdout: key = 'testputtags' 2023-12-03T13:00:21.251 INFO:teuthology.orchestra.run.smithi003.stdout:> bucket_name = _create_key_with_random_content(key) 2023-12-03T13:00:21.251 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.251 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:10472: 2023-12-03T13:00:21.251 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.251 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:5832: in _create_key_with_random_content 2023-12-03T13:00:21.251 INFO:teuthology.orchestra.run.smithi003.stdout: bucket_name = get_new_bucket() 2023-12-03T13:00:21.251 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:21.251 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:21.251 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:21.251 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:21.251 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:21.251 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:21.251 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:21.251 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:21.251 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:21.252 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:21.252 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:21.252 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:21.252 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:21.252 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:21.252 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:21.252 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:21.252 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:21.252 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:21.252 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:21.252 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:21.252 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:21.252 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:21.252 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:21.252 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:21.252 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:21.252 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:21.253 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:21.253 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:21.253 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:21.253 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:21.253 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:21.253 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:21.253 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:21.253 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:21.253 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:21.253 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:21.253 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.253 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.253 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.253 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:21.253 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.254 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:21.254 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.254 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:21.254 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:21.254 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:21.254 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:21.254 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:21.254 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:21.254 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.254 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:21.254 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:21.254 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:21.254 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:21.254 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:21.254 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:21.254 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.255 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:21.255 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:21.255 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:21.255 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:21.255 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:21.255 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:21.255 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:21.255 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:21.255 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:21.255 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:21.255 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:21.255 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.255 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.255 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:21.255 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:21.255 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:21.256 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:21.256 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:21.256 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.256 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.256 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:21.256 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:21.256 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:21.256 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:21.256 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:21.256 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.256 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:21.256 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:21.256 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:21.256 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:21.256 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:21.256 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-438" 2023-12-03T13:00:21.256 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.257 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:21.257 INFO:teuthology.orchestra.run.smithi003.stdout:______________________________ test_put_max_tags _______________________________ 2023-12-03T13:00:21.257 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.257 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.257 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.257 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:21.257 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:21.257 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.257 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:21.257 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.257 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:21.257 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:21.257 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:21.257 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.257 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:21.257 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:21.257 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.258 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.258 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:21.258 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:21.258 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.258 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.258 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:21.258 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.258 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:21.258 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:21.258 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.258 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.258 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:21.258 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:21.258 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.258 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:21.258 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:21.259 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:21.259 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:21.259 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:21.259 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.259 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:21.259 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.259 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:21.259 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:21.259 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:21.259 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:21.259 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:21.259 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:21.259 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:21.259 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:21.259 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.259 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.260 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:21.260 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:21.260 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:21.260 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:21.260 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.260 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:21.260 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:21.260 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:21.260 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:21.260 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.260 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.260 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:21.260 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:21.260 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:21.260 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:21.260 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.261 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.261 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:21.261 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:21.261 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:21.261 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.261 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:21.261 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.261 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:21.261 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:21.261 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.261 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:21.261 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:21.261 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:21.261 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:21.261 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:21.261 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:21.261 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.262 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:21.262 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.262 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:21.262 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.262 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.262 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:21.262 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.262 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:21.262 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.262 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:21.262 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:21.262 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:21.262 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:21.262 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:21.262 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:21.262 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.263 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:21.263 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:21.263 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:21.263 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:21.263 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:21.263 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:21.263 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.263 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:21.263 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:21.263 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:21.263 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:21.263 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:21.263 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:21.263 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:21.263 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:21.264 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:21.264 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:21.264 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:21.264 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.264 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.264 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:21.264 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.264 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:21.264 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:21.264 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:21.264 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:21.264 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:21.264 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:21.264 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:21.264 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:21.265 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:21.265 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:21.265 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:21.265 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:21.265 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:21.265 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:21.265 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:21.265 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:21.265 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:21.265 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:21.265 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:21.265 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:21.265 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:21.265 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:21.265 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:21.265 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:21.265 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:21.266 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:21.266 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:21.266 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:21.266 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.266 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.266 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.266 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.266 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:21.266 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:21.266 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.266 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:21.266 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.266 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:21.266 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:21.266 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:21.266 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.267 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:21.267 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:21.267 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.267 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.267 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:21.267 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:21.267 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.267 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.267 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:21.267 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:21.267 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:21.267 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:21.267 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:21.267 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.267 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.267 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:21.268 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:21.268 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:21.268 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.268 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:21.268 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.268 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:21.268 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.268 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:21.268 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.268 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.tagging 2023-12-03T13:00:21.268 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T13:00:21.268 INFO:teuthology.orchestra.run.smithi003.stdout: def test_put_max_tags(): 2023-12-03T13:00:21.268 INFO:teuthology.orchestra.run.smithi003.stdout: key = 'testputmaxtags' 2023-12-03T13:00:21.268 INFO:teuthology.orchestra.run.smithi003.stdout:> bucket_name = _create_key_with_random_content(key) 2023-12-03T13:00:21.268 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.268 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:10488: 2023-12-03T13:00:21.269 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.269 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:5832: in _create_key_with_random_content 2023-12-03T13:00:21.269 INFO:teuthology.orchestra.run.smithi003.stdout: bucket_name = get_new_bucket() 2023-12-03T13:00:21.269 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:21.269 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:21.269 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:21.269 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:21.269 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:21.269 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:21.269 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:21.269 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:21.269 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:21.269 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:21.269 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:21.269 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:21.269 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:21.269 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:21.270 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:21.270 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:21.270 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:21.270 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:21.270 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:21.270 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:21.270 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:21.270 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:21.270 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:21.270 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:21.270 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:21.270 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:21.270 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:21.270 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:21.270 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:21.270 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:21.271 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:21.271 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:21.271 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:21.271 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:21.271 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:21.271 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:21.271 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.271 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.271 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.271 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:21.271 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.271 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:21.271 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.271 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:21.271 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:21.271 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:21.272 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:21.272 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:21.272 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:21.272 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.272 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:21.272 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:21.272 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:21.272 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:21.272 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:21.272 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:21.272 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.272 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:21.272 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:21.272 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:21.272 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:21.272 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:21.272 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:21.273 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:21.273 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:21.273 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:21.273 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:21.273 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:21.273 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.273 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.273 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:21.273 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:21.273 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:21.273 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:21.273 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:21.273 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.273 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.273 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:21.273 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:21.273 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:21.274 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:21.274 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:21.274 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.274 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:21.274 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:21.274 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:21.274 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:21.274 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:21.274 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-439" 2023-12-03T13:00:21.274 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.274 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:21.274 INFO:teuthology.orchestra.run.smithi003.stdout:_____________________________ test_put_excess_tags _____________________________ 2023-12-03T13:00:21.274 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.274 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.275 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.275 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:21.275 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:21.275 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.275 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:21.275 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.275 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:21.275 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:21.275 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:21.275 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.275 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:21.275 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:21.275 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.275 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.275 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:21.275 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:21.276 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.276 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.276 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:21.276 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.276 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:21.276 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:21.276 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.276 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.276 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:21.276 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:21.276 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.276 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:21.276 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:21.276 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:21.276 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:21.276 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:21.277 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.277 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:21.277 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.277 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:21.277 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:21.277 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:21.277 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:21.277 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:21.277 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:21.277 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:21.277 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:21.277 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.277 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.277 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:21.277 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:21.277 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:21.278 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:21.278 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.278 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:21.278 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:21.278 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:21.278 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:21.278 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.278 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.278 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:21.278 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:21.278 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:21.278 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:21.278 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.278 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.278 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:21.278 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:21.279 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:21.279 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.279 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:21.279 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.279 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:21.279 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:21.279 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.279 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:21.279 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:21.279 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:21.279 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:21.279 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:21.279 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:21.279 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.279 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:21.279 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.280 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:21.280 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.280 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.280 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:21.280 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.280 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:21.280 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.280 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:21.280 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:21.280 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:21.280 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:21.280 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:21.280 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:21.280 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.280 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:21.280 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:21.280 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:21.281 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:21.281 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:21.281 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:21.281 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.281 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:21.281 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:21.281 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:21.281 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:21.281 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:21.281 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:21.281 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:21.281 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:21.281 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:21.281 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:21.281 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:21.282 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.282 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.282 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:21.282 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.282 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:21.282 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:21.282 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:21.282 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:21.282 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:21.282 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:21.282 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:21.282 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:21.282 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:21.282 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:21.282 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:21.282 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:21.283 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:21.283 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:21.283 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:21.283 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:21.283 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:21.283 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:21.283 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:21.283 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:21.283 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:21.283 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:21.283 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:21.283 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:21.283 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:21.283 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:21.283 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:21.283 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:21.283 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.284 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.284 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.284 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.284 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:21.284 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:21.284 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.284 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:21.284 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.284 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:21.284 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:21.284 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:21.284 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.284 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:21.284 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:21.284 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.284 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.284 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:21.285 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:21.285 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.285 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.285 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:21.285 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:21.285 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:21.285 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:21.285 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:21.285 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.285 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.285 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:21.285 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:21.285 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:21.285 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.285 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:21.286 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.286 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:21.286 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.286 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:21.286 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.286 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.tagging 2023-12-03T13:00:21.286 INFO:teuthology.orchestra.run.smithi003.stdout: def test_put_excess_tags(): 2023-12-03T13:00:21.286 INFO:teuthology.orchestra.run.smithi003.stdout: key = 'testputmaxtags' 2023-12-03T13:00:21.286 INFO:teuthology.orchestra.run.smithi003.stdout:> bucket_name = _create_key_with_random_content(key) 2023-12-03T13:00:21.286 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.286 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:10501: 2023-12-03T13:00:21.286 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.286 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:5832: in _create_key_with_random_content 2023-12-03T13:00:21.286 INFO:teuthology.orchestra.run.smithi003.stdout: bucket_name = get_new_bucket() 2023-12-03T13:00:21.286 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:21.287 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:21.287 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:21.287 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:21.287 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:21.287 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:21.287 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:21.287 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:21.287 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:21.287 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:21.287 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:21.287 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:21.287 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:21.287 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:21.287 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:21.287 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:21.288 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:21.288 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:21.288 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:21.288 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:21.288 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:21.288 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:21.288 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:21.288 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:21.288 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:21.288 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:21.288 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:21.288 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:21.288 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:21.288 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:21.288 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:21.288 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:21.288 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:21.289 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:21.289 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:21.289 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:21.289 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.289 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.289 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.289 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:21.289 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.289 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:21.289 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.289 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:21.289 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:21.289 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:21.289 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:21.289 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:21.289 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:21.290 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.290 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:21.290 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:21.290 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:21.290 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:21.290 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:21.290 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:21.290 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.290 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:21.290 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:21.290 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:21.290 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:21.290 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:21.290 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:21.290 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:21.290 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:21.290 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:21.291 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:21.291 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:21.291 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.291 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.291 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:21.291 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:21.291 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:21.291 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:21.291 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:21.291 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.291 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.291 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:21.291 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:21.291 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:21.291 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:21.291 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:21.292 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.292 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:21.292 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:21.292 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:21.292 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:21.292 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:21.292 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-440" 2023-12-03T13:00:21.292 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.292 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:21.292 INFO:teuthology.orchestra.run.smithi003.stdout:___________________________ test_put_max_kvsize_tags ___________________________ 2023-12-03T13:00:21.292 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.292 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.292 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.292 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:21.292 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:21.292 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.292 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:21.293 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.293 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:21.293 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:21.293 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:21.293 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.293 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:21.293 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:21.293 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.293 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.293 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:21.293 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:21.293 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.293 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.293 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:21.293 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.293 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:21.294 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:21.294 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.294 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.294 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:21.294 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:21.294 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.294 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:21.294 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:21.294 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:21.294 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:21.294 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:21.294 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.294 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:21.294 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.294 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:21.294 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:21.295 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:21.295 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:21.295 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:21.295 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:21.295 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:21.295 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:21.295 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.295 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.295 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:21.295 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:21.295 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:21.295 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:21.295 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.295 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:21.295 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:21.295 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:21.296 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:21.296 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.296 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.296 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:21.296 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:21.296 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:21.296 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:21.296 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.296 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.296 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:21.296 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:21.296 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:21.296 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.296 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:21.296 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.296 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:21.297 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:21.297 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.297 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:21.297 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:21.297 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:21.297 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:21.297 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:21.297 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:21.297 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.297 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:21.297 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.297 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:21.297 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.297 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.297 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:21.297 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.298 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:21.298 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.298 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:21.298 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:21.298 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:21.298 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:21.298 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:21.298 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:21.298 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.298 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:21.298 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:21.298 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:21.298 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:21.298 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:21.298 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:21.298 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.299 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:21.299 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:21.299 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:21.299 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:21.299 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:21.299 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:21.299 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:21.299 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:21.299 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:21.299 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:21.299 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:21.299 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.299 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.299 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:21.299 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.299 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:21.299 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:21.300 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:21.300 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:21.300 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:21.300 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:21.300 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:21.300 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:21.300 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:21.300 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:21.300 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:21.300 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:21.300 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:21.300 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:21.300 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:21.300 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:21.300 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:21.300 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:21.301 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:21.301 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:21.301 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:21.301 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:21.301 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:21.301 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:21.301 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:21.301 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:21.301 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:21.301 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:21.301 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.301 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.301 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.301 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.301 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:21.302 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:21.302 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.302 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:21.302 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.302 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:21.302 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:21.302 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:21.302 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.302 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:21.302 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:21.302 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.302 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.302 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:21.302 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:21.302 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.303 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.303 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:21.303 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:21.303 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:21.303 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:21.303 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:21.303 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.303 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.303 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:21.303 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:21.303 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:21.303 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.303 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:21.303 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.303 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:21.304 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.304 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:21.304 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.304 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.tagging 2023-12-03T13:00:21.304 INFO:teuthology.orchestra.run.smithi003.stdout: def test_put_max_kvsize_tags(): 2023-12-03T13:00:21.304 INFO:teuthology.orchestra.run.smithi003.stdout: key = 'testputmaxkeysize' 2023-12-03T13:00:21.304 INFO:teuthology.orchestra.run.smithi003.stdout:> bucket_name = _create_key_with_random_content(key) 2023-12-03T13:00:21.304 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.304 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:10516: 2023-12-03T13:00:21.304 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.304 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:5832: in _create_key_with_random_content 2023-12-03T13:00:21.304 INFO:teuthology.orchestra.run.smithi003.stdout: bucket_name = get_new_bucket() 2023-12-03T13:00:21.304 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:21.304 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:21.304 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:21.305 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:21.305 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:21.305 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:21.305 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:21.305 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:21.305 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:21.305 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:21.305 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:21.305 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:21.305 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:21.305 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:21.305 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:21.305 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:21.305 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:21.305 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:21.305 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:21.306 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:21.306 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:21.306 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:21.306 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:21.306 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:21.306 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:21.306 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:21.306 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:21.306 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:21.306 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:21.306 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:21.306 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:21.306 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:21.306 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:21.307 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:21.307 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:21.307 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:21.307 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.307 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.307 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.307 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:21.307 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.307 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:21.307 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.307 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:21.307 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:21.307 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:21.308 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:21.308 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:21.308 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:21.308 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.308 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:21.308 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:21.308 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:21.308 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:21.308 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:21.308 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:21.308 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.308 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:21.308 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:21.308 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:21.309 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:21.309 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:21.309 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:21.309 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:21.309 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:21.309 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:21.309 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:21.309 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:21.309 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.309 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.309 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:21.309 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:21.309 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:21.309 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:21.309 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:21.309 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.310 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.310 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:21.310 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:21.310 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:21.310 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:21.310 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:21.310 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.310 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:21.310 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:21.310 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:21.310 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:21.310 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:21.310 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-441" 2023-12-03T13:00:21.310 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.311 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:21.311 INFO:teuthology.orchestra.run.smithi003.stdout:___________________________ test_put_excess_key_tags ___________________________ 2023-12-03T13:00:21.311 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.311 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.311 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.311 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:21.311 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:21.311 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.311 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:21.311 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.311 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:21.311 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:21.311 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:21.311 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.311 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:21.312 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:21.312 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.312 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.312 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:21.312 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:21.312 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.312 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.312 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:21.312 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.312 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:21.312 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:21.312 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.312 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.312 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:21.313 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:21.313 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.313 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:21.313 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:21.313 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:21.313 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:21.313 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:21.313 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.313 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:21.313 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.313 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:21.313 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:21.313 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:21.313 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:21.313 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:21.314 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:21.314 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:21.314 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:21.314 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.314 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.314 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:21.314 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:21.314 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:21.314 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:21.314 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.314 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:21.314 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:21.314 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:21.314 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:21.315 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.315 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.315 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:21.315 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:21.315 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:21.315 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:21.315 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.315 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.315 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:21.315 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:21.315 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:21.315 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.315 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:21.315 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.315 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:21.315 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:21.316 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.316 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:21.316 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:21.316 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:21.316 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:21.316 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:21.316 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:21.316 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.316 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:21.316 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.316 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:21.316 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.316 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.316 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:21.317 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.317 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:21.317 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.317 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:21.317 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:21.317 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:21.317 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:21.317 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:21.317 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:21.317 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.317 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:21.317 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:21.317 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:21.317 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:21.317 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:21.318 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:21.318 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.318 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:21.318 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:21.318 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:21.318 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:21.318 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:21.318 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:21.318 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:21.318 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:21.318 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:21.318 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:21.318 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:21.318 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.318 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.319 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:21.319 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.319 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:21.319 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:21.319 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:21.319 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:21.319 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:21.319 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:21.319 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:21.319 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:21.319 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:21.319 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:21.319 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:21.320 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:21.320 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:21.320 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:21.320 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:21.320 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:21.320 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:21.320 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:21.320 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:21.320 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:21.320 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:21.320 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:21.320 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:21.320 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:21.320 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:21.320 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:21.321 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:21.321 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:21.321 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.321 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.321 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.321 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.321 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:21.321 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:21.321 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.321 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:21.321 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.321 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:21.321 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:21.321 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:21.322 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.322 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:21.322 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:21.322 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.322 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.322 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:21.322 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:21.322 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.322 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.322 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:21.322 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:21.322 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:21.322 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:21.322 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:21.322 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.322 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.323 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:21.323 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:21.323 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:21.323 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.323 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:21.323 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.323 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:21.323 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.323 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:21.323 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.323 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.tagging 2023-12-03T13:00:21.323 INFO:teuthology.orchestra.run.smithi003.stdout: def test_put_excess_key_tags(): 2023-12-03T13:00:21.323 INFO:teuthology.orchestra.run.smithi003.stdout: key = 'testputexcesskeytags' 2023-12-03T13:00:21.323 INFO:teuthology.orchestra.run.smithi003.stdout:> bucket_name = _create_key_with_random_content(key) 2023-12-03T13:00:21.323 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.324 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:10537: 2023-12-03T13:00:21.324 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.324 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:5832: in _create_key_with_random_content 2023-12-03T13:00:21.324 INFO:teuthology.orchestra.run.smithi003.stdout: bucket_name = get_new_bucket() 2023-12-03T13:00:21.324 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:21.324 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:21.324 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:21.324 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:21.324 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:21.324 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:21.324 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:21.324 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:21.324 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:21.324 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:21.324 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:21.324 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:21.324 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:21.325 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:21.325 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:21.325 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:21.325 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:21.325 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:21.325 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:21.325 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:21.325 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:21.325 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:21.325 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:21.325 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:21.325 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:21.325 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:21.325 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:21.325 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:21.325 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:21.325 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:21.326 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:21.326 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:21.326 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:21.326 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:21.326 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:21.326 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:21.326 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.326 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.326 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.326 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:21.326 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.326 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:21.326 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.326 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:21.326 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:21.327 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:21.327 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:21.327 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:21.327 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:21.327 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.327 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:21.327 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:21.327 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:21.327 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:21.327 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:21.327 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:21.327 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.327 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:21.327 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:21.327 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:21.327 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:21.328 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:21.328 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:21.328 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:21.328 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:21.328 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:21.328 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:21.328 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:21.328 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.328 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.328 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:21.328 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:21.328 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:21.328 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:21.328 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:21.328 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.328 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.328 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:21.329 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:21.329 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:21.329 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:21.329 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:21.329 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.329 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:21.329 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:21.329 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:21.329 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:21.329 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:21.329 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-442" 2023-12-03T13:00:21.329 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.329 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:21.329 INFO:teuthology.orchestra.run.smithi003.stdout:___________________________ test_put_excess_val_tags ___________________________ 2023-12-03T13:00:21.329 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.329 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.330 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.330 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:21.330 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:21.330 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.330 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:21.330 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.330 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:21.330 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:21.330 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:21.330 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.330 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:21.330 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:21.330 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.331 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.331 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:21.331 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:21.331 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.331 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.331 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:21.331 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.331 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:21.331 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:21.331 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.331 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.331 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:21.331 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:21.331 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.331 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:21.331 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:21.331 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:21.332 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:21.332 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:21.332 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.332 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:21.332 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.332 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:21.332 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:21.332 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:21.332 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:21.332 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:21.332 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:21.332 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:21.332 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:21.332 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.332 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.332 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:21.333 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:21.333 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:21.333 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:21.333 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.333 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:21.333 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:21.333 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:21.333 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:21.333 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.333 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.333 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:21.333 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:21.333 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:21.333 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:21.333 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.333 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.334 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:21.334 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:21.334 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:21.334 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.334 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:21.334 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.334 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:21.334 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:21.334 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.334 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:21.334 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:21.334 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:21.334 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:21.334 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:21.334 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:21.335 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.335 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:21.335 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.335 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:21.335 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.335 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.335 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:21.335 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.335 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:21.335 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.335 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:21.335 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:21.335 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:21.335 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:21.335 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:21.335 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:21.335 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.336 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:21.336 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:21.336 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:21.336 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:21.336 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:21.336 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:21.336 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.336 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:21.336 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:21.336 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:21.336 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:21.336 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:21.336 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:21.336 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:21.336 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:21.336 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:21.337 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:21.337 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:21.337 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.337 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.337 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:21.337 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.337 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:21.337 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:21.337 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:21.337 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:21.337 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:21.337 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:21.337 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:21.337 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:21.337 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:21.337 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:21.337 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:21.338 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:21.338 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:21.338 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:21.338 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:21.338 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:21.338 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:21.338 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:21.338 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:21.338 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:21.338 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:21.338 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:21.338 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:21.338 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:21.338 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:21.338 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:21.339 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:21.339 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:21.339 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.339 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.339 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.339 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.339 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:21.339 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:21.339 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.339 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:21.339 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.339 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:21.339 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:21.339 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:21.339 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.339 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:21.339 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:21.340 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.340 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.340 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:21.340 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:21.340 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.340 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.340 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:21.340 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:21.340 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:21.340 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:21.340 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:21.340 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.340 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.340 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:21.340 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:21.340 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:21.341 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.341 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:21.341 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.341 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:21.341 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.341 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:21.341 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.341 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.tagging 2023-12-03T13:00:21.341 INFO:teuthology.orchestra.run.smithi003.stdout: def test_put_excess_val_tags(): 2023-12-03T13:00:21.341 INFO:teuthology.orchestra.run.smithi003.stdout: key = 'testputexcesskeytags' 2023-12-03T13:00:21.341 INFO:teuthology.orchestra.run.smithi003.stdout:> bucket_name = _create_key_with_random_content(key) 2023-12-03T13:00:21.341 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.341 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:10559: 2023-12-03T13:00:21.341 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.341 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:5832: in _create_key_with_random_content 2023-12-03T13:00:21.342 INFO:teuthology.orchestra.run.smithi003.stdout: bucket_name = get_new_bucket() 2023-12-03T13:00:21.342 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:21.342 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:21.342 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:21.342 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:21.342 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:21.342 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:21.342 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:21.342 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:21.342 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:21.342 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:21.342 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:21.342 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:21.342 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:21.342 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:21.343 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:21.343 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:21.343 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:21.343 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:21.343 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:21.343 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:21.343 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:21.343 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:21.343 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:21.343 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:21.343 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:21.343 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:21.343 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:21.343 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:21.343 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:21.343 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:21.344 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:21.344 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:21.344 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:21.344 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:21.344 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:21.344 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:21.344 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.344 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.344 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.344 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:21.344 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.344 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:21.344 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.344 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:21.344 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:21.344 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:21.345 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:21.345 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:21.345 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:21.345 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.345 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:21.345 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:21.345 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:21.345 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:21.345 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:21.345 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:21.345 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.345 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:21.345 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:21.345 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:21.345 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:21.345 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:21.345 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:21.346 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:21.346 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:21.346 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:21.346 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:21.346 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:21.346 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.346 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.346 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:21.346 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:21.346 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:21.346 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:21.346 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:21.346 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.346 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.346 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:21.347 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:21.347 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:21.347 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:21.347 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:21.347 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.347 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:21.347 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:21.347 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:21.347 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:21.347 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:21.347 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-443" 2023-12-03T13:00:21.347 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.347 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:21.347 INFO:teuthology.orchestra.run.smithi003.stdout:_____________________________ test_put_modify_tags _____________________________ 2023-12-03T13:00:21.347 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.347 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.348 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.348 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:21.348 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:21.348 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.348 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:21.348 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.348 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:21.348 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:21.348 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:21.348 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.348 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:21.348 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:21.348 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.348 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.348 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:21.348 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:21.349 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.349 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.349 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:21.349 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.349 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:21.349 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:21.349 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.349 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.349 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:21.349 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:21.349 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.349 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:21.349 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:21.349 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:21.349 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:21.349 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:21.349 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.350 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:21.350 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.350 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:21.350 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:21.350 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:21.350 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:21.350 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:21.350 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:21.350 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:21.350 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:21.350 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.350 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.350 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:21.350 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:21.350 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:21.351 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:21.351 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.351 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:21.351 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:21.351 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:21.351 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:21.351 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.351 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.351 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:21.351 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:21.351 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:21.351 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:21.351 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.351 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.351 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:21.351 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:21.351 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:21.352 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.352 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:21.352 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.352 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:21.352 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:21.352 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.352 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:21.352 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:21.352 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:21.352 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:21.352 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:21.352 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:21.352 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.352 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:21.352 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.353 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:21.353 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.353 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.353 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:21.353 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.353 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:21.353 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.353 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:21.353 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:21.353 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:21.353 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:21.353 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:21.353 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:21.353 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.353 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:21.353 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:21.354 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:21.354 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:21.354 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:21.354 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:21.354 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.354 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:21.354 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:21.354 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:21.354 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:21.354 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:21.354 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:21.354 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:21.354 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:21.354 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:21.354 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:21.355 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:21.355 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.355 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.355 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:21.355 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.355 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:21.355 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:21.355 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:21.355 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:21.355 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:21.355 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:21.355 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:21.355 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:21.355 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:21.355 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:21.355 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:21.355 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:21.356 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:21.356 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:21.356 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:21.356 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:21.356 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:21.356 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:21.356 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:21.356 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:21.356 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:21.356 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:21.356 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:21.356 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:21.356 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:21.356 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:21.356 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:21.357 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:21.357 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.357 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.357 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.357 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.357 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:21.357 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:21.357 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.357 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:21.357 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.357 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:21.357 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:21.357 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:21.357 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.357 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:21.357 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:21.358 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.358 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.358 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:21.358 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:21.358 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.358 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.358 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:21.358 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:21.358 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:21.358 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:21.358 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:21.358 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.358 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.358 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:21.358 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:21.359 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:21.359 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.359 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:21.359 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.359 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:21.359 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.359 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:21.359 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.359 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.tagging 2023-12-03T13:00:21.359 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T13:00:21.359 INFO:teuthology.orchestra.run.smithi003.stdout: def test_put_modify_tags(): 2023-12-03T13:00:21.359 INFO:teuthology.orchestra.run.smithi003.stdout: key = 'testputmodifytags' 2023-12-03T13:00:21.359 INFO:teuthology.orchestra.run.smithi003.stdout:> bucket_name = _create_key_with_random_content(key) 2023-12-03T13:00:21.359 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.359 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:10582: 2023-12-03T13:00:21.359 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.360 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:5832: in _create_key_with_random_content 2023-12-03T13:00:21.360 INFO:teuthology.orchestra.run.smithi003.stdout: bucket_name = get_new_bucket() 2023-12-03T13:00:21.360 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:21.360 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:21.360 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:21.360 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:21.360 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:21.360 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:21.360 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:21.360 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:21.360 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:21.360 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:21.360 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:21.360 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:21.360 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:21.360 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:21.360 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:21.361 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:21.361 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:21.361 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:21.361 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:21.361 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:21.361 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:21.361 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:21.361 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:21.361 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:21.361 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:21.361 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:21.361 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:21.361 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:21.361 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:21.361 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:21.361 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:21.362 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:21.362 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:21.362 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:21.362 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:21.362 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:21.362 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.362 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.362 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.362 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:21.362 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.362 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:21.362 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.362 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:21.362 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:21.363 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:21.363 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:21.363 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:21.363 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:21.363 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.363 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:21.363 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:21.363 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:21.363 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:21.363 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:21.363 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:21.363 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.363 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:21.363 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:21.363 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:21.363 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:21.364 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:21.364 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:21.364 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:21.364 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:21.364 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:21.364 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:21.364 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:21.364 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.364 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.364 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:21.364 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:21.364 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:21.364 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:21.364 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:21.364 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.364 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.365 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:21.365 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:21.365 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:21.365 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:21.365 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:21.365 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.365 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:21.365 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:21.365 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:21.365 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:21.365 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:21.365 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-444" 2023-12-03T13:00:21.365 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.365 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:21.365 INFO:teuthology.orchestra.run.smithi003.stdout:_____________________________ test_put_delete_tags _____________________________ 2023-12-03T13:00:21.365 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.365 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.366 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.366 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:21.366 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:21.366 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.366 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:21.366 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.366 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:21.366 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:21.366 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:21.366 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.366 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:21.366 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:21.366 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.366 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.366 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:21.367 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:21.367 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.367 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.367 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:21.367 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.367 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:21.367 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:21.367 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.367 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.367 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:21.367 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:21.367 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.367 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:21.367 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:21.367 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:21.367 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:21.367 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:21.368 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.368 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:21.368 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.368 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:21.368 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:21.368 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:21.368 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:21.368 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:21.368 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:21.368 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:21.368 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:21.368 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.368 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.368 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:21.368 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:21.368 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:21.369 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:21.369 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.369 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:21.369 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:21.369 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:21.369 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:21.369 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.369 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.369 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:21.369 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:21.369 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:21.369 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:21.369 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.369 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.369 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:21.369 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:21.369 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:21.370 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.370 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:21.370 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.370 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:21.370 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:21.370 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.370 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:21.370 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:21.370 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:21.370 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:21.370 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:21.370 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:21.370 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.370 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:21.370 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.371 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:21.371 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.371 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.371 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:21.371 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.371 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:21.371 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.371 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:21.371 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:21.371 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:21.371 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:21.371 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:21.371 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:21.371 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.371 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:21.371 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:21.372 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:21.372 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:21.372 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:21.372 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:21.372 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.372 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:21.372 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:21.372 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:21.372 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:21.372 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:21.372 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:21.372 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:21.372 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:21.372 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:21.372 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:21.372 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:21.372 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.373 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.373 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:21.373 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.373 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:21.373 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:21.373 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:21.373 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:21.373 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:21.373 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:21.373 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:21.373 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:21.373 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:21.373 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:21.373 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:21.373 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:21.373 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:21.374 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:21.374 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:21.374 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:21.374 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:21.374 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:21.374 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:21.374 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:21.374 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:21.374 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:21.374 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:21.374 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:21.374 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:21.374 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:21.374 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:21.375 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:21.375 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.375 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.375 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.375 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.375 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:21.375 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:21.375 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.375 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:21.375 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.375 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:21.375 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:21.375 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:21.375 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.375 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:21.375 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:21.376 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.376 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.376 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:21.376 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:21.376 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.376 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.376 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:21.376 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:21.376 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:21.376 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:21.376 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:21.376 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.376 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.376 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:21.376 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:21.376 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:21.377 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.377 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:21.377 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.377 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:21.377 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.377 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:21.377 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.377 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.tagging 2023-12-03T13:00:21.377 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T13:00:21.377 INFO:teuthology.orchestra.run.smithi003.stdout: def test_put_delete_tags(): 2023-12-03T13:00:21.377 INFO:teuthology.orchestra.run.smithi003.stdout: key = 'testputmodifytags' 2023-12-03T13:00:21.377 INFO:teuthology.orchestra.run.smithi003.stdout:> bucket_name = _create_key_with_random_content(key) 2023-12-03T13:00:21.377 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.377 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:10612: 2023-12-03T13:00:21.377 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.377 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:5832: in _create_key_with_random_content 2023-12-03T13:00:21.377 INFO:teuthology.orchestra.run.smithi003.stdout: bucket_name = get_new_bucket() 2023-12-03T13:00:21.378 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:21.378 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:21.378 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:21.378 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:21.378 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:21.378 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:21.378 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:21.378 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:21.378 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:21.378 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:21.378 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:21.378 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:21.378 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:21.378 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:21.378 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:21.379 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:21.379 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:21.379 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:21.379 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:21.379 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:21.379 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:21.379 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:21.379 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:21.379 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:21.379 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:21.379 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:21.379 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:21.379 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:21.379 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:21.379 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:21.379 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:21.380 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:21.380 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:21.380 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:21.380 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:21.380 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:21.380 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.380 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.380 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.380 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:21.380 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.380 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:21.380 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.380 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:21.380 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:21.380 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:21.380 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:21.381 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:21.381 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:21.381 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.381 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:21.381 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:21.381 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:21.381 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:21.381 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:21.381 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:21.381 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.381 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:21.381 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:21.381 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:21.381 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:21.381 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:21.381 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:21.382 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:21.382 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:21.382 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:21.382 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:21.382 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:21.382 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.382 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.382 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:21.382 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:21.382 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:21.382 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:21.382 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:21.382 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.382 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.382 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:21.382 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:21.383 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:21.383 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:21.383 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:21.383 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.383 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:21.383 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:21.383 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:21.383 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:21.383 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:21.383 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-445" 2023-12-03T13:00:21.383 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.383 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:21.383 INFO:teuthology.orchestra.run.smithi003.stdout:___________________ test_post_object_tags_anonymous_request ____________________ 2023-12-03T13:00:21.383 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.383 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.383 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.384 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:21.384 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:21.384 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.384 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:21.384 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.384 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:21.385 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:21.385 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:21.385 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.385 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:21.385 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:21.385 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.385 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.385 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:21.385 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:21.385 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.385 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.386 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:21.386 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.386 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:21.386 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:21.386 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.386 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.386 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:21.386 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:21.386 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.386 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:21.386 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:21.386 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:21.386 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:21.386 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:21.386 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.387 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:21.387 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.387 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:21.387 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:21.387 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:21.387 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:21.387 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:21.387 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:21.387 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:21.387 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:21.387 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.387 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.387 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:21.387 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:21.387 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:21.387 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:21.387 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.388 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:21.388 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:21.388 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:21.388 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:21.388 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.388 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.388 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:21.388 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:21.388 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:21.388 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:21.388 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.388 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.388 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:21.388 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:21.388 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:21.388 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.389 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:21.389 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.389 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:21.389 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:21.389 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.389 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:21.389 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:21.389 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:21.389 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:21.389 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:21.389 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:21.389 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.389 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:21.389 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.389 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:21.389 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.390 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.390 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:21.390 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.390 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:21.390 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.390 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:21.390 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:21.390 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:21.390 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:21.390 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:21.390 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:21.390 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.390 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:21.390 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:21.390 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:21.391 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:21.391 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:21.391 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:21.391 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.391 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:21.391 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:21.391 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:21.391 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:21.391 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:21.391 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:21.391 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:21.391 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:21.391 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:21.391 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:21.391 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:21.391 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.392 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.392 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:21.392 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.392 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:21.392 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:21.392 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:21.392 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:21.392 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:21.392 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:21.392 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:21.392 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:21.392 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:21.392 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:21.392 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:21.392 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:21.392 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:21.392 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:21.393 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:21.393 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:21.393 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:21.393 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:21.393 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:21.393 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:21.393 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:21.393 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:21.393 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:21.393 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:21.393 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:21.393 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:21.393 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:21.393 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:21.393 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.393 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.393 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.394 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.394 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:21.394 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:21.394 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.394 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:21.394 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.394 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:21.394 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:21.394 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:21.394 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.394 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:21.394 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:21.394 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.394 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.394 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:21.395 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:21.395 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.395 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.395 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:21.395 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:21.395 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:21.395 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:21.395 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:21.395 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.395 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.395 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:21.395 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:21.395 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:21.395 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.395 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:21.395 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.395 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:21.396 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.396 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:21.396 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.396 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.tagging 2023-12-03T13:00:21.396 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T13:00:21.396 INFO:teuthology.orchestra.run.smithi003.stdout: def test_post_object_tags_anonymous_request(): 2023-12-03T13:00:21.396 INFO:teuthology.orchestra.run.smithi003.stdout: bucket_name = get_new_bucket_name() 2023-12-03T13:00:21.396 INFO:teuthology.orchestra.run.smithi003.stdout: client = get_client() 2023-12-03T13:00:21.396 INFO:teuthology.orchestra.run.smithi003.stdout: url = _get_post_url(bucket_name) 2023-12-03T13:00:21.396 INFO:teuthology.orchestra.run.smithi003.stdout:> client.create_bucket(ACL='public-read-write', Bucket=bucket_name) 2023-12-03T13:00:21.396 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.396 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:10634: 2023-12-03T13:00:21.396 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.396 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:21.396 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:21.397 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:21.397 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:21.397 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:21.397 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:21.397 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:21.397 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:21.397 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:21.397 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:21.397 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:21.397 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:21.397 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:21.397 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:21.397 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:21.397 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:21.397 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:21.397 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:21.398 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:21.398 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:21.398 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:21.398 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:21.398 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:21.398 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:21.398 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:21.398 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:21.398 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:21.398 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:21.398 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:21.398 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:21.398 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:21.398 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:21.398 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:21.398 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:21.399 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.399 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.399 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.399 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:21.399 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.399 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:21.399 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.399 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:21.399 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:21.399 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:21.399 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:21.399 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:21.399 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:21.399 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.399 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:21.399 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:21.399 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:21.400 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:21.400 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:21.400 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:21.400 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.400 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:21.400 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:21.400 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:21.400 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:21.400 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:21.400 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:21.400 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:21.400 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:21.400 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:21.400 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:21.400 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:21.400 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.400 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.401 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:21.401 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:21.401 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:21.401 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:21.401 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:21.401 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.401 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.401 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:21.401 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:21.401 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:21.401 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:21.401 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:21.401 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.401 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:21.401 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:21.401 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:21.402 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:21.402 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:21.402 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-446" 2023-12-03T13:00:21.402 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.402 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:21.402 INFO:teuthology.orchestra.run.smithi003.stdout:_________________ test_post_object_tags_authenticated_request __________________ 2023-12-03T13:00:21.402 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.402 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.402 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.402 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:21.402 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:21.402 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.402 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:21.402 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.402 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:21.402 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:21.403 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:21.403 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.403 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:21.403 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:21.403 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.403 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.403 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:21.403 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:21.403 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.403 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.403 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:21.403 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.403 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:21.403 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:21.403 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.403 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.403 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:21.404 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:21.404 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.404 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:21.404 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:21.404 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:21.404 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:21.404 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:21.404 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.404 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:21.404 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.404 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:21.404 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:21.404 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:21.404 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:21.404 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:21.405 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:21.405 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:21.405 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:21.405 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.405 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.405 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:21.405 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:21.405 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:21.405 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:21.405 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.405 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:21.405 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:21.405 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:21.405 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:21.405 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.405 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.405 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:21.406 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:21.406 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:21.406 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:21.406 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.406 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.406 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:21.406 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:21.406 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:21.406 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.406 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:21.406 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.406 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:21.406 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:21.406 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.406 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:21.407 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:21.407 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:21.407 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:21.407 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:21.407 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:21.407 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.407 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:21.407 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.407 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:21.407 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.407 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.407 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:21.407 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.408 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:21.408 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.408 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:21.408 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:21.408 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:21.408 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:21.408 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:21.408 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:21.408 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.408 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:21.408 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:21.408 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:21.408 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:21.408 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:21.408 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:21.408 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.409 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:21.409 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:21.409 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:21.409 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:21.409 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:21.409 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:21.409 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:21.409 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:21.409 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:21.409 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:21.409 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:21.409 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.409 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.409 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:21.409 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.409 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:21.409 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:21.410 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:21.410 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:21.410 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:21.410 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:21.410 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:21.410 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:21.410 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:21.410 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:21.410 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:21.410 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:21.410 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:21.410 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:21.410 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:21.410 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:21.410 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:21.410 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:21.411 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:21.411 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:21.411 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:21.411 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:21.411 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:21.411 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:21.411 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:21.411 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:21.411 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:21.411 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:21.411 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.411 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.411 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.411 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.411 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:21.411 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:21.412 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.412 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:21.412 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.412 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:21.412 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:21.412 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:21.412 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.412 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:21.412 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:21.412 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.412 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.412 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:21.412 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:21.412 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.412 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.413 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:21.413 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:21.413 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:21.413 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:21.413 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:21.413 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.413 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.413 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:21.413 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:21.413 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:21.413 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.413 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:21.413 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.413 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:21.413 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.414 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:21.414 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.414 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.tagging 2023-12-03T13:00:21.414 INFO:teuthology.orchestra.run.smithi003.stdout: def test_post_object_tags_authenticated_request(): 2023-12-03T13:00:21.414 INFO:teuthology.orchestra.run.smithi003.stdout:> bucket_name = get_new_bucket() 2023-12-03T13:00:21.414 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.414 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:10662: 2023-12-03T13:00:21.414 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.414 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:21.414 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:21.414 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:21.414 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:21.414 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:21.414 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:21.414 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:21.414 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:21.415 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:21.415 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:21.415 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:21.415 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:21.415 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:21.415 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:21.415 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:21.415 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:21.415 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:21.415 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:21.415 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:21.415 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:21.415 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:21.415 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:21.415 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:21.415 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:21.416 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:21.416 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:21.416 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:21.416 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:21.416 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:21.416 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:21.416 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:21.416 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:21.416 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:21.416 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:21.416 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:21.416 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:21.416 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.416 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.416 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.416 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:21.416 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.417 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:21.417 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.417 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:21.417 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:21.417 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:21.417 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:21.417 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:21.417 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:21.417 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.417 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:21.417 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:21.417 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:21.417 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:21.417 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:21.418 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:21.418 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.418 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:21.418 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:21.418 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:21.418 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:21.418 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:21.418 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:21.418 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:21.418 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:21.418 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:21.418 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:21.418 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:21.418 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.418 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.418 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:21.418 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:21.419 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:21.419 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:21.419 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:21.419 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.419 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.419 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:21.419 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:21.419 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:21.419 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:21.419 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:21.419 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.419 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:21.419 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:21.419 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:21.419 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:21.419 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:21.420 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-447" 2023-12-03T13:00:21.420 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.420 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:21.420 INFO:teuthology.orchestra.run.smithi003.stdout:____________________________ test_put_obj_with_tags ____________________________ 2023-12-03T13:00:21.420 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.420 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.420 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.420 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:21.420 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:21.420 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.420 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:21.420 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.420 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:21.420 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:21.420 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:21.420 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.421 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:21.421 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:21.421 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.421 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.421 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:21.421 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:21.421 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.421 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.421 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:21.421 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.421 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:21.421 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:21.421 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.421 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.421 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:21.421 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:21.422 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.422 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:21.422 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:21.422 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:21.422 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:21.422 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:21.422 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.422 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:21.422 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.422 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:21.422 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:21.422 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:21.422 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:21.422 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:21.422 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:21.422 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:21.423 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:21.423 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.423 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.423 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:21.423 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:21.423 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:21.423 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:21.423 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.423 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:21.423 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:21.423 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:21.423 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:21.423 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.423 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.423 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:21.423 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:21.423 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:21.424 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:21.424 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.424 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.424 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:21.424 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:21.424 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:21.424 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.424 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:21.424 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.424 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:21.424 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:21.424 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.424 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:21.424 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:21.424 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:21.424 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:21.425 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:21.425 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:21.425 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.425 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:21.425 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.425 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:21.425 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.425 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.425 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:21.425 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.425 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:21.425 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.425 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:21.425 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:21.425 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:21.425 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:21.425 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:21.426 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:21.426 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.426 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:21.426 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:21.426 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:21.426 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:21.426 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:21.426 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:21.426 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.426 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:21.426 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:21.426 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:21.426 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:21.426 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:21.426 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:21.427 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:21.427 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:21.427 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:21.427 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:21.427 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:21.427 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.427 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.427 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:21.427 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.427 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:21.427 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:21.427 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:21.427 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:21.427 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:21.427 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:21.427 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:21.427 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:21.428 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:21.428 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:21.428 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:21.428 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:21.428 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:21.428 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:21.428 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:21.428 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:21.428 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:21.428 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:21.428 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:21.428 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:21.428 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:21.428 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:21.428 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:21.429 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:21.429 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:21.429 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:21.429 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:21.429 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:21.429 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.429 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.429 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.429 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.429 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:21.429 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:21.429 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.429 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:21.429 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.429 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:21.429 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:21.430 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:21.430 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.430 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:21.430 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:21.430 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.430 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.430 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:21.430 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:21.430 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.430 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.430 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:21.430 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:21.430 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:21.430 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:21.430 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:21.430 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.430 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.431 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:21.431 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:21.431 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:21.431 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.431 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:21.431 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.431 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:21.431 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.431 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:21.431 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.431 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.tagging 2023-12-03T13:00:21.431 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T13:00:21.431 INFO:teuthology.orchestra.run.smithi003.stdout: def test_put_obj_with_tags(): 2023-12-03T13:00:21.431 INFO:teuthology.orchestra.run.smithi003.stdout:> bucket_name = get_new_bucket() 2023-12-03T13:00:21.431 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.432 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:10709: 2023-12-03T13:00:21.432 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.432 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:21.432 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:21.432 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:21.432 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:21.432 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:21.432 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:21.432 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:21.432 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:21.432 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:21.432 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:21.432 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:21.432 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:21.432 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:21.432 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:21.432 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:21.433 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:21.433 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:21.433 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:21.433 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:21.433 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:21.433 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:21.433 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:21.433 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:21.433 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:21.433 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:21.433 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:21.433 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:21.433 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:21.433 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:21.433 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:21.433 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:21.433 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:21.434 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:21.434 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:21.434 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:21.434 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:21.434 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.434 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.434 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.434 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:21.434 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.434 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:21.434 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.434 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:21.434 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:21.434 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:21.434 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:21.434 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:21.435 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:21.435 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.435 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:21.435 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:21.435 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:21.435 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:21.435 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:21.435 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:21.435 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.435 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:21.435 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:21.435 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:21.435 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:21.435 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:21.435 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:21.435 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:21.436 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:21.436 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:21.436 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:21.436 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:21.436 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.436 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.436 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:21.436 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:21.436 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:21.436 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:21.436 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:21.436 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.436 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.436 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:21.436 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:21.436 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:21.437 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:21.437 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:21.437 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.437 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:21.437 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:21.437 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:21.437 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:21.437 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:21.437 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-448" 2023-12-03T13:00:21.437 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.437 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:21.437 INFO:teuthology.orchestra.run.smithi003.stdout:___________________________ test_get_tags_acl_public ___________________________ 2023-12-03T13:00:21.437 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.437 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.437 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.437 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:21.437 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:21.438 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.438 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:21.438 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.438 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:21.438 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:21.438 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:21.438 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.438 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:21.438 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:21.438 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.438 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.438 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:21.438 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:21.438 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.438 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.438 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:21.438 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.439 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:21.439 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:21.439 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.439 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.439 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:21.439 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:21.439 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.439 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:21.439 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:21.439 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:21.439 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:21.439 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:21.439 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.439 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:21.439 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.440 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:21.440 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:21.440 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:21.440 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:21.440 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:21.440 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:21.440 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:21.440 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:21.440 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.440 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.440 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:21.440 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:21.440 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:21.440 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:21.440 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.440 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:21.441 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:21.441 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:21.441 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:21.441 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.441 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.441 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:21.441 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:21.441 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:21.441 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:21.441 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.441 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.441 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:21.441 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:21.441 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:21.441 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.441 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:21.442 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.442 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:21.442 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:21.442 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.442 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:21.442 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:21.442 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:21.442 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:21.442 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:21.442 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:21.442 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.442 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:21.442 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.442 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:21.442 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.442 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.443 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:21.443 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.443 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:21.443 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.443 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:21.443 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:21.443 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:21.443 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:21.443 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:21.443 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:21.443 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.443 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:21.443 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:21.443 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:21.443 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:21.443 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:21.444 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:21.444 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.444 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:21.444 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:21.444 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:21.444 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:21.444 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:21.444 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:21.444 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:21.444 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:21.444 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:21.444 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:21.444 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:21.444 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.444 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.444 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:21.444 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.445 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:21.445 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:21.445 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:21.445 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:21.445 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:21.445 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:21.445 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:21.445 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:21.445 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:21.445 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:21.445 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:21.445 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:21.445 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:21.445 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:21.445 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:21.445 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:21.446 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:21.446 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:21.446 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:21.446 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:21.446 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:21.446 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:21.446 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:21.446 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:21.446 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:21.446 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:21.446 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:21.446 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:21.446 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.446 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.446 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.446 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.446 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:21.447 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:21.447 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.447 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:21.447 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.447 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:21.447 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:21.447 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:21.447 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.447 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:21.447 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:21.447 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.447 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.447 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:21.447 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:21.447 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.447 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.448 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:21.448 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:21.448 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:21.448 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:21.448 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:21.448 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.448 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.448 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:21.448 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:21.448 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:21.448 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.448 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:21.448 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.448 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:21.448 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.448 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:21.448 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.449 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.tagging 2023-12-03T13:00:21.449 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.bucket_policy 2023-12-03T13:00:21.449 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T13:00:21.449 INFO:teuthology.orchestra.run.smithi003.stdout: def test_get_tags_acl_public(): 2023-12-03T13:00:21.449 INFO:teuthology.orchestra.run.smithi003.stdout: key = 'testputtagsacl' 2023-12-03T13:00:21.449 INFO:teuthology.orchestra.run.smithi003.stdout:> bucket_name = _create_key_with_random_content(key) 2023-12-03T13:00:21.449 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.449 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:10743: 2023-12-03T13:00:21.449 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.449 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:5832: in _create_key_with_random_content 2023-12-03T13:00:21.449 INFO:teuthology.orchestra.run.smithi003.stdout: bucket_name = get_new_bucket() 2023-12-03T13:00:21.449 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:21.449 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:21.449 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:21.449 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:21.449 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:21.449 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:21.450 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:21.450 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:21.450 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:21.450 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:21.450 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:21.450 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:21.450 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:21.450 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:21.450 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:21.450 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:21.450 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:21.450 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:21.450 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:21.450 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:21.451 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:21.451 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:21.451 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:21.451 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:21.451 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:21.451 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:21.451 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:21.451 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:21.451 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:21.451 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:21.451 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:21.451 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:21.451 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:21.451 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:21.451 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:21.451 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:21.452 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.452 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.452 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.452 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:21.452 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.452 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:21.452 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.452 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:21.452 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:21.452 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:21.452 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:21.452 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:21.452 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:21.452 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.452 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:21.452 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:21.452 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:21.453 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:21.453 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:21.453 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:21.453 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.453 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:21.453 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:21.453 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:21.453 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:21.453 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:21.453 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:21.453 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:21.453 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:21.453 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:21.453 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:21.453 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:21.453 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.454 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.454 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:21.454 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:21.454 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:21.454 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:21.454 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:21.454 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.454 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.454 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:21.454 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:21.454 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:21.454 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:21.454 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:21.454 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.454 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:21.454 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:21.455 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:21.455 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:21.455 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:21.455 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-449" 2023-12-03T13:00:21.455 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.455 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:21.455 INFO:teuthology.orchestra.run.smithi003.stdout:___________________________ test_put_tags_acl_public ___________________________ 2023-12-03T13:00:21.455 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.455 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.455 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.455 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:21.455 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:21.455 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.455 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:21.455 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.455 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:21.456 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:21.456 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:21.456 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.456 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:21.456 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:21.456 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.456 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.456 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:21.456 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:21.456 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.456 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.456 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:21.456 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.456 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:21.456 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:21.456 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.456 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.457 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:21.457 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:21.457 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.457 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:21.457 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:21.457 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:21.457 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:21.457 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:21.457 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.457 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:21.457 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.457 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:21.457 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:21.457 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:21.457 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:21.457 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:21.458 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:21.458 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:21.458 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:21.458 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.458 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.458 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:21.458 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:21.458 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:21.458 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:21.458 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.458 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:21.458 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:21.458 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:21.458 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:21.458 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.458 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.459 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:21.459 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:21.459 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:21.459 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:21.459 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.459 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.459 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:21.459 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:21.459 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:21.459 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.459 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:21.459 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.459 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:21.459 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:21.459 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.459 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:21.459 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:21.460 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:21.460 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:21.460 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:21.460 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:21.460 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.460 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:21.460 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.460 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:21.460 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.460 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.460 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:21.460 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.460 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:21.460 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.460 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:21.461 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:21.461 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:21.461 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:21.461 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:21.461 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:21.461 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.461 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:21.461 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:21.461 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:21.461 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:21.461 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:21.461 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:21.461 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.461 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:21.461 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:21.461 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:21.462 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:21.462 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:21.462 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:21.462 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:21.462 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:21.462 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:21.462 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:21.462 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:21.462 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.462 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.462 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:21.462 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.462 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:21.462 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:21.463 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:21.463 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:21.463 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:21.463 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:21.463 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:21.463 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:21.463 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:21.463 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:21.463 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:21.463 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:21.463 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:21.463 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:21.463 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:21.463 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:21.463 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:21.463 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:21.463 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:21.464 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:21.464 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:21.464 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:21.464 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:21.464 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:21.464 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:21.464 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:21.464 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:21.464 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:21.464 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.464 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.464 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.464 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.464 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:21.464 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:21.464 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.465 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:21.465 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.465 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:21.465 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:21.465 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:21.465 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.465 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:21.465 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:21.465 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.465 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.465 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:21.465 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:21.465 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.465 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.465 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:21.465 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:21.465 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:21.466 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:21.466 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:21.466 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.466 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.466 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:21.466 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:21.466 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:21.466 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.466 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:21.466 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.466 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:21.466 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.466 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:21.466 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.466 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.tagging 2023-12-03T13:00:21.466 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.bucket_policy 2023-12-03T13:00:21.467 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T13:00:21.467 INFO:teuthology.orchestra.run.smithi003.stdout: def test_put_tags_acl_public(): 2023-12-03T13:00:21.467 INFO:teuthology.orchestra.run.smithi003.stdout: key = 'testputtagsacl' 2023-12-03T13:00:21.467 INFO:teuthology.orchestra.run.smithi003.stdout:> bucket_name = _create_key_with_random_content(key) 2023-12-03T13:00:21.467 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.467 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:10766: 2023-12-03T13:00:21.467 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.467 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:5832: in _create_key_with_random_content 2023-12-03T13:00:21.467 INFO:teuthology.orchestra.run.smithi003.stdout: bucket_name = get_new_bucket() 2023-12-03T13:00:21.467 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:21.467 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:21.467 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:21.467 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:21.467 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:21.467 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:21.467 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:21.468 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:21.468 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:21.468 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:21.468 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:21.468 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:21.468 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:21.468 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:21.468 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:21.468 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:21.468 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:21.468 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:21.468 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:21.468 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:21.468 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:21.468 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:21.469 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:21.469 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:21.469 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:21.469 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:21.469 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:21.469 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:21.469 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:21.469 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:21.469 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:21.469 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:21.469 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:21.469 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:21.469 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:21.469 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:21.469 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.469 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.470 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.470 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:21.470 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.470 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:21.470 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.470 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:21.470 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:21.470 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:21.470 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:21.470 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:21.470 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:21.470 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.470 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:21.470 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:21.470 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:21.470 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:21.471 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:21.471 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:21.471 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.471 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:21.471 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:21.471 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:21.471 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:21.471 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:21.471 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:21.471 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:21.471 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:21.471 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:21.471 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:21.471 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:21.471 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.472 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.472 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:21.472 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:21.472 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:21.472 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:21.472 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:21.472 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.472 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.472 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:21.472 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:21.472 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:21.472 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:21.472 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:21.472 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.472 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:21.472 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:21.473 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:21.473 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:21.473 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:21.473 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-450" 2023-12-03T13:00:21.473 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.473 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:21.473 INFO:teuthology.orchestra.run.smithi003.stdout:_________________________ test_delete_tags_obj_public __________________________ 2023-12-03T13:00:21.473 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.473 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.473 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.473 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:21.473 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:21.473 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.473 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:21.473 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.473 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:21.473 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:21.474 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:21.474 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.474 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:21.474 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:21.474 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.474 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.474 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:21.474 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:21.474 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.474 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.474 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:21.474 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.474 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:21.474 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:21.475 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.475 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.475 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:21.475 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:21.475 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.475 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:21.475 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:21.475 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:21.475 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:21.475 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:21.475 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.475 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:21.475 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.475 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:21.475 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:21.475 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:21.476 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:21.476 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:21.476 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:21.476 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:21.476 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:21.476 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.476 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.476 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:21.476 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:21.476 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:21.476 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:21.476 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.476 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:21.476 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:21.476 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:21.476 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:21.477 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.477 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.477 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:21.477 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:21.477 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:21.477 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:21.477 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.477 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.477 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:21.477 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:21.477 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:21.477 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.477 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:21.477 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.477 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:21.477 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:21.477 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.478 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:21.478 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:21.478 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:21.478 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:21.478 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:21.478 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:21.478 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.478 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:21.478 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.478 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:21.478 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.478 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.478 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:21.478 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.478 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:21.478 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.479 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:21.479 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:21.479 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:21.479 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:21.479 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:21.479 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:21.479 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.479 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:21.479 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:21.479 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:21.479 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:21.479 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:21.479 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:21.479 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.479 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:21.479 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:21.480 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:21.480 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:21.480 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:21.480 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:21.480 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:21.480 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:21.480 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:21.480 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:21.480 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:21.480 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.480 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.480 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:21.480 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.480 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:21.480 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:21.480 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:21.481 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:21.481 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:21.481 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:21.481 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:21.481 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:21.481 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:21.481 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:21.481 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:21.481 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:21.481 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:21.481 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:21.481 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:21.481 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:21.481 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:21.481 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:21.481 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:21.481 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:21.482 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:21.482 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:21.482 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:21.482 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:21.482 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:21.482 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:21.482 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:21.482 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:21.482 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.482 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.482 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.482 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.482 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:21.482 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:21.483 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.483 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:21.483 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.483 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:21.483 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:21.483 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:21.483 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.483 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:21.483 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:21.483 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.483 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.483 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:21.483 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:21.483 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.483 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.483 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:21.483 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:21.484 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:21.484 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:21.484 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:21.484 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.484 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.484 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:21.484 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:21.484 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:21.484 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.484 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:21.484 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.484 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:21.484 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.484 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:21.484 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.484 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.tagging 2023-12-03T13:00:21.485 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.bucket_policy 2023-12-03T13:00:21.485 INFO:teuthology.orchestra.run.smithi003.stdout: def test_delete_tags_obj_public(): 2023-12-03T13:00:21.485 INFO:teuthology.orchestra.run.smithi003.stdout: key = 'testputtagsacl' 2023-12-03T13:00:21.485 INFO:teuthology.orchestra.run.smithi003.stdout:> bucket_name = _create_key_with_random_content(key) 2023-12-03T13:00:21.485 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.485 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:10787: 2023-12-03T13:00:21.485 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.485 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:5832: in _create_key_with_random_content 2023-12-03T13:00:21.485 INFO:teuthology.orchestra.run.smithi003.stdout: bucket_name = get_new_bucket() 2023-12-03T13:00:21.485 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:21.485 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:21.485 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:21.485 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:21.485 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:21.485 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:21.485 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:21.485 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:21.486 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:21.486 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:21.486 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:21.486 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:21.486 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:21.486 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:21.486 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:21.486 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:21.486 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:21.486 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:21.486 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:21.486 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:21.486 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:21.486 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:21.486 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:21.486 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:21.487 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:21.487 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:21.487 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:21.487 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:21.487 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:21.487 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:21.487 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:21.487 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:21.487 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:21.487 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:21.487 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:21.487 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:21.487 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.487 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.487 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.487 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:21.488 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.488 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:21.488 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.488 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:21.488 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:21.488 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:21.488 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:21.488 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:21.488 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:21.488 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.488 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:21.488 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:21.488 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:21.488 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:21.488 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:21.488 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:21.489 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.489 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:21.489 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:21.489 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:21.489 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:21.489 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:21.489 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:21.489 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:21.489 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:21.489 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:21.489 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:21.489 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:21.489 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.489 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.489 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:21.489 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:21.489 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:21.490 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:21.490 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:21.490 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.490 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.490 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:21.490 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:21.490 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:21.490 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:21.490 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:21.490 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.490 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:21.490 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:21.490 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:21.490 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:21.490 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:21.490 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-451" 2023-12-03T13:00:21.491 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.491 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:21.491 INFO:teuthology.orchestra.run.smithi003.stdout:____________ test_versioning_bucket_atomic_upload_return_version_id ____________ 2023-12-03T13:00:21.491 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.491 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.491 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.491 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:21.491 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:21.491 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.491 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:21.491 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.491 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:21.491 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:21.491 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:21.491 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.491 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:21.492 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:21.492 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.492 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.492 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:21.492 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:21.492 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.492 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.492 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:21.492 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.492 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:21.492 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:21.492 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.492 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.492 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:21.492 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:21.492 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.493 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:21.493 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:21.493 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:21.493 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:21.493 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:21.493 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.493 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:21.493 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.493 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:21.493 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:21.493 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:21.493 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:21.493 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:21.493 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:21.493 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:21.494 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:21.494 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.494 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.494 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:21.494 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:21.494 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:21.494 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:21.494 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.494 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:21.494 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:21.494 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:21.494 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:21.494 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.494 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.494 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:21.494 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:21.495 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:21.495 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:21.495 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.495 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.495 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:21.495 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:21.495 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:21.495 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.495 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:21.495 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.495 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:21.495 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:21.495 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.495 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:21.495 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:21.495 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:21.496 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:21.496 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:21.496 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:21.496 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.496 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:21.496 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.496 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:21.496 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.496 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.496 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:21.496 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.496 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:21.496 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.496 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:21.496 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:21.497 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:21.497 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:21.497 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:21.497 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:21.497 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.497 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:21.497 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:21.497 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:21.497 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:21.497 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:21.497 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:21.497 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.497 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:21.497 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:21.497 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:21.497 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:21.497 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:21.498 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:21.498 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:21.498 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:21.498 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:21.498 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:21.498 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:21.498 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.498 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.498 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:21.498 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.498 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:21.498 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:21.498 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:21.498 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:21.498 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:21.498 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:21.499 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:21.499 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:21.499 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:21.499 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:21.499 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:21.499 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:21.499 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:21.499 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:21.499 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:21.499 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:21.499 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:21.499 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:21.499 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:21.499 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:21.499 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:21.499 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:21.500 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:21.500 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:21.500 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:21.500 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:21.500 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:21.500 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:21.500 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.500 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.500 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.500 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.500 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:21.500 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:21.500 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.500 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:21.500 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.500 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:21.501 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:21.501 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:21.501 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.501 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:21.501 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:21.501 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.501 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.501 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:21.501 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:21.501 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.501 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.501 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:21.501 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:21.501 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:21.501 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:21.501 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:21.501 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.502 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.502 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:21.502 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:21.502 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:21.502 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.502 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:21.502 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.502 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:21.502 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.502 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:21.502 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.502 INFO:teuthology.orchestra.run.smithi003.stdout: def test_versioning_bucket_atomic_upload_return_version_id(): 2023-12-03T13:00:21.502 INFO:teuthology.orchestra.run.smithi003.stdout:> bucket_name = get_new_bucket() 2023-12-03T13:00:21.502 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.502 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:10809: 2023-12-03T13:00:21.503 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.503 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:21.503 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:21.503 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:21.503 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:21.503 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:21.503 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:21.503 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:21.503 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:21.503 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:21.503 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:21.503 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:21.503 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:21.503 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:21.503 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:21.503 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:21.504 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:21.504 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:21.504 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:21.504 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:21.504 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:21.504 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:21.504 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:21.504 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:21.504 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:21.504 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:21.504 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:21.504 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:21.504 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:21.504 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:21.504 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:21.505 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:21.505 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:21.505 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:21.505 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:21.505 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:21.505 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:21.505 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.505 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.505 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.505 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:21.505 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.505 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:21.505 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.505 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:21.505 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:21.505 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:21.506 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:21.506 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:21.506 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:21.506 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.506 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:21.506 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:21.506 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:21.506 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:21.506 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:21.506 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:21.506 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.506 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:21.506 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:21.506 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:21.506 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:21.506 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:21.507 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:21.507 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:21.507 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:21.507 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:21.507 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:21.507 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:21.507 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.507 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.507 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:21.507 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:21.507 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:21.507 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:21.507 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:21.507 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.507 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.507 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:21.508 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:21.508 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:21.508 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:21.508 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:21.508 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.508 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:21.508 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:21.508 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:21.508 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:21.508 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:21.508 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-452" 2023-12-03T13:00:21.508 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.508 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:21.508 INFO:teuthology.orchestra.run.smithi003.stdout:__________ test_versioning_bucket_multipart_upload_return_version_id ___________ 2023-12-03T13:00:21.508 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.508 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.509 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.509 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:21.509 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:21.509 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.509 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:21.509 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.509 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:21.509 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:21.509 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:21.509 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.509 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:21.509 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:21.509 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.509 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.509 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:21.509 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:21.509 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.510 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.510 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:21.510 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.510 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:21.510 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:21.510 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.510 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.510 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:21.510 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:21.510 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.510 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:21.510 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:21.510 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:21.510 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:21.510 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:21.511 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.511 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:21.511 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.511 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:21.511 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:21.511 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:21.511 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:21.511 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:21.511 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:21.511 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:21.511 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:21.511 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.511 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.511 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:21.511 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:21.511 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:21.512 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:21.512 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.512 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:21.512 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:21.512 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:21.512 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:21.512 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.512 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.512 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:21.512 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:21.512 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:21.512 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:21.512 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.512 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.512 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:21.513 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:21.513 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:21.513 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.513 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:21.513 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.513 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:21.513 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:21.513 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.513 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:21.513 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:21.513 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:21.513 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:21.513 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:21.513 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:21.513 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.513 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:21.514 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.514 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:21.514 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.514 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.514 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:21.514 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.514 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:21.514 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.514 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:21.514 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:21.514 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:21.514 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:21.514 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:21.514 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:21.514 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.515 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:21.515 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:21.515 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:21.515 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:21.515 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:21.515 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:21.515 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.515 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:21.515 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:21.515 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:21.515 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:21.515 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:21.515 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:21.515 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:21.515 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:21.515 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:21.516 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:21.516 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:21.516 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.516 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.516 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:21.516 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.516 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:21.516 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:21.516 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:21.516 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:21.516 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:21.516 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:21.516 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:21.516 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:21.516 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:21.516 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:21.517 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:21.517 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:21.517 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:21.517 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:21.517 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:21.517 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:21.517 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:21.517 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:21.517 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:21.517 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:21.517 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:21.517 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:21.517 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:21.517 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:21.517 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:21.517 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:21.518 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:21.518 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:21.518 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.518 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.518 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.518 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.518 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:21.518 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:21.518 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.518 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:21.518 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.518 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:21.518 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:21.518 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:21.518 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.518 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:21.518 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:21.519 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.519 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.519 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:21.519 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:21.519 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.519 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.519 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:21.519 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:21.519 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:21.519 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:21.519 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:21.519 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.519 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.519 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:21.519 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:21.519 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:21.520 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.520 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:21.520 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.520 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:21.520 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.520 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:21.520 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.520 INFO:teuthology.orchestra.run.smithi003.stdout: def test_versioning_bucket_multipart_upload_return_version_id(): 2023-12-03T13:00:21.520 INFO:teuthology.orchestra.run.smithi003.stdout: content_type='text/bla' 2023-12-03T13:00:21.520 INFO:teuthology.orchestra.run.smithi003.stdout: objlen = 30 * 1024 * 1024 2023-12-03T13:00:21.520 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.520 INFO:teuthology.orchestra.run.smithi003.stdout:> bucket_name = get_new_bucket() 2023-12-03T13:00:21.520 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.520 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:10841: 2023-12-03T13:00:21.520 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.521 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:21.521 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:21.521 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:21.521 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:21.521 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:21.521 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:21.521 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:21.521 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:21.521 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:21.521 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:21.521 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:21.521 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:21.521 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:21.521 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:21.521 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:21.521 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:21.522 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:21.522 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:21.522 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:21.522 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:21.522 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:21.522 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:21.522 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:21.522 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:21.522 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:21.522 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:21.522 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:21.522 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:21.522 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:21.522 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:21.523 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:21.523 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:21.523 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:21.523 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:21.523 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:21.523 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:21.523 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.523 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.523 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.523 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:21.523 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.523 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:21.523 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.523 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:21.523 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:21.523 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:21.523 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:21.524 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:21.524 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:21.524 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.524 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:21.524 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:21.524 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:21.524 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:21.524 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:21.524 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:21.524 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.524 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:21.524 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:21.524 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:21.524 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:21.524 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:21.524 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:21.524 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:21.525 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:21.525 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:21.525 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:21.525 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:21.525 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.525 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.525 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:21.525 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:21.525 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:21.525 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:21.525 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:21.525 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.525 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.525 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:21.525 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:21.526 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:21.526 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:21.526 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:21.526 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.526 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:21.526 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:21.526 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:21.526 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:21.526 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:21.526 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-453" 2023-12-03T13:00:21.526 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.526 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:21.526 INFO:teuthology.orchestra.run.smithi003.stdout:___________________ test_bucket_policy_get_obj_existing_tag ____________________ 2023-12-03T13:00:21.526 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.526 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.526 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.527 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:21.527 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:21.527 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.527 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:21.527 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.527 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:21.527 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:21.527 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:21.527 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.527 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:21.527 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:21.527 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.527 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.527 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:21.527 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:21.527 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.528 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.528 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:21.528 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.528 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:21.528 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:21.528 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.528 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.528 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:21.528 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:21.528 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.528 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:21.528 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:21.528 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:21.528 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:21.528 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:21.528 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.529 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:21.529 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.529 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:21.529 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:21.529 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:21.529 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:21.529 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:21.529 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:21.529 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:21.529 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:21.529 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.529 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.529 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:21.529 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:21.529 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:21.529 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:21.530 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.530 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:21.530 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:21.530 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:21.530 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:21.530 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.530 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.530 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:21.530 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:21.530 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:21.530 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:21.530 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.530 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.530 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:21.530 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:21.530 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:21.531 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.531 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:21.531 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.531 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:21.531 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:21.531 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.531 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:21.531 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:21.531 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:21.531 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:21.531 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:21.531 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:21.531 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.531 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:21.531 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.531 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:21.532 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.532 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.532 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:21.532 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.532 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:21.532 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.532 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:21.532 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:21.532 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:21.532 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:21.532 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:21.532 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:21.532 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.532 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:21.532 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:21.532 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:21.533 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:21.533 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:21.533 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:21.533 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.533 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:21.533 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:21.533 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:21.533 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:21.533 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:21.533 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:21.533 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:21.533 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:21.533 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:21.533 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:21.533 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:21.533 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.534 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.534 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:21.534 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.534 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:21.534 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:21.534 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:21.534 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:21.534 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:21.534 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:21.534 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:21.534 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:21.534 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:21.534 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:21.534 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:21.534 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:21.534 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:21.535 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:21.535 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:21.535 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:21.535 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:21.535 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:21.535 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:21.535 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:21.535 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:21.535 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:21.535 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:21.535 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:21.535 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:21.535 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:21.535 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:21.535 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:21.535 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.536 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.536 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.536 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.536 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:21.536 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:21.536 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.536 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:21.536 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.536 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:21.536 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:21.536 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:21.536 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.536 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:21.536 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:21.536 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.536 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.537 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:21.537 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:21.537 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.537 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.537 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:21.537 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:21.537 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:21.537 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:21.537 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:21.537 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.537 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.537 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:21.537 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:21.537 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:21.537 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.537 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:21.538 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.538 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:21.538 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.538 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:21.538 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.538 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.tagging 2023-12-03T13:00:21.538 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.bucket_policy 2023-12-03T13:00:21.538 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T13:00:21.538 INFO:teuthology.orchestra.run.smithi003.stdout: def test_bucket_policy_get_obj_existing_tag(): 2023-12-03T13:00:21.538 INFO:teuthology.orchestra.run.smithi003.stdout:> bucket_name = _create_objects(keys=['publictag', 'privatetag', 'invalidtag']) 2023-12-03T13:00:21.538 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.538 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:10882: 2023-12-03T13:00:21.538 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.538 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:116: in _create_objects 2023-12-03T13:00:21.538 INFO:teuthology.orchestra.run.smithi003.stdout: bucket = get_new_bucket_resource(name=bucket_name) 2023-12-03T13:00:21.538 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:581: in get_new_bucket_resource 2023-12-03T13:00:21.538 INFO:teuthology.orchestra.run.smithi003.stdout: bucket_location = bucket.create() 2023-12-03T13:00:21.539 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/boto3/resources/factory.py:580: in do_action 2023-12-03T13:00:21.539 INFO:teuthology.orchestra.run.smithi003.stdout: response = action(self, *args, **kwargs) 2023-12-03T13:00:21.539 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/boto3/resources/action.py:88: in __call__ 2023-12-03T13:00:21.539 INFO:teuthology.orchestra.run.smithi003.stdout: response = getattr(parent.meta.client, operation_name)(*args, **params) 2023-12-03T13:00:21.539 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:21.539 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:21.539 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:21.539 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:21.539 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:21.539 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:21.539 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:21.539 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:21.539 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:21.539 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:21.539 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:21.539 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:21.540 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:21.540 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:21.540 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:21.540 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:21.540 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:21.540 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:21.540 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:21.540 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:21.540 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:21.540 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:21.540 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:21.540 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:21.540 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:21.540 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:21.540 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:21.540 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:21.540 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:21.541 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:21.541 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:21.541 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:21.541 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:21.541 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:21.541 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.541 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.541 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.541 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:21.541 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.541 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:21.541 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.541 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:21.541 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:21.541 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:21.542 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:21.542 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:21.542 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:21.542 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.542 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:21.542 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:21.542 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:21.542 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:21.542 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:21.542 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:21.542 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.542 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:21.542 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:21.542 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:21.542 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:21.542 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:21.543 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:21.543 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:21.543 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:21.543 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:21.543 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:21.543 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:21.543 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.543 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.543 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:21.543 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:21.543 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:21.543 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:21.543 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:21.543 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.543 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.543 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:21.543 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:21.544 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:21.544 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:21.544 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:21.544 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.544 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:21.544 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:21.544 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:21.544 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:21.544 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:21.544 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-454" 2023-12-03T13:00:21.544 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.544 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:21.544 INFO:teuthology.orchestra.run.smithi003.stdout:_______________ test_bucket_policy_get_obj_tagging_existing_tag ________________ 2023-12-03T13:00:21.544 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.544 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.544 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.544 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:21.545 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:21.545 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.545 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:21.545 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.545 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:21.545 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:21.545 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:21.545 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.545 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:21.545 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:21.545 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.545 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.545 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:21.545 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:21.545 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.545 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.546 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:21.546 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.546 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:21.546 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:21.546 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.546 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.546 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:21.546 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:21.546 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.546 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:21.546 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:21.546 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:21.546 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:21.546 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:21.546 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.546 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:21.547 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.547 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:21.547 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:21.547 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:21.547 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:21.547 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:21.547 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:21.547 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:21.547 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:21.547 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.547 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.547 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:21.547 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:21.547 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:21.547 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:21.547 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.548 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:21.548 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:21.548 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:21.548 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:21.548 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.548 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.548 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:21.548 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:21.548 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:21.548 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:21.548 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.548 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.548 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:21.548 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:21.548 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:21.549 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.549 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:21.549 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.549 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:21.549 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:21.549 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.549 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:21.549 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:21.549 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:21.549 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:21.549 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:21.549 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:21.549 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.549 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:21.549 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.550 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:21.550 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.550 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.550 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:21.550 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.550 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:21.550 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.550 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:21.550 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:21.550 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:21.550 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:21.550 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:21.550 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:21.550 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.551 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:21.551 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:21.551 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:21.551 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:21.551 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:21.551 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:21.551 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.551 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:21.551 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:21.551 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:21.551 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:21.551 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:21.551 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:21.551 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:21.551 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:21.552 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:21.552 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:21.552 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:21.552 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.552 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.552 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:21.552 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.552 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:21.552 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:21.552 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:21.552 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:21.552 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:21.552 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:21.552 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:21.553 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:21.553 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:21.553 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:21.553 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:21.553 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:21.553 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:21.553 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:21.553 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:21.553 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:21.553 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:21.553 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:21.553 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:21.553 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:21.553 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:21.553 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:21.554 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:21.554 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:21.554 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:21.554 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:21.554 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:21.554 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:21.554 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.554 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.554 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.554 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.554 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:21.554 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:21.554 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.554 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:21.555 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.555 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:21.555 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:21.555 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:21.555 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.555 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:21.555 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:21.555 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.555 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.555 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:21.555 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:21.555 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.555 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.555 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:21.555 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:21.556 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:21.556 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:21.556 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:21.556 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.556 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.556 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:21.556 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:21.556 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:21.556 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.556 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:21.556 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.556 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:21.556 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.556 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:21.556 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.557 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.tagging 2023-12-03T13:00:21.557 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.bucket_policy 2023-12-03T13:00:21.557 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T13:00:21.557 INFO:teuthology.orchestra.run.smithi003.stdout: def test_bucket_policy_get_obj_tagging_existing_tag(): 2023-12-03T13:00:21.557 INFO:teuthology.orchestra.run.smithi003.stdout:> bucket_name = _create_objects(keys=['publictag', 'privatetag', 'invalidtag']) 2023-12-03T13:00:21.557 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.557 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:10937: 2023-12-03T13:00:21.557 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.557 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:116: in _create_objects 2023-12-03T13:00:21.557 INFO:teuthology.orchestra.run.smithi003.stdout: bucket = get_new_bucket_resource(name=bucket_name) 2023-12-03T13:00:21.557 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:581: in get_new_bucket_resource 2023-12-03T13:00:21.557 INFO:teuthology.orchestra.run.smithi003.stdout: bucket_location = bucket.create() 2023-12-03T13:00:21.557 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/boto3/resources/factory.py:580: in do_action 2023-12-03T13:00:21.557 INFO:teuthology.orchestra.run.smithi003.stdout: response = action(self, *args, **kwargs) 2023-12-03T13:00:21.557 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/boto3/resources/action.py:88: in __call__ 2023-12-03T13:00:21.558 INFO:teuthology.orchestra.run.smithi003.stdout: response = getattr(parent.meta.client, operation_name)(*args, **params) 2023-12-03T13:00:21.558 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:21.558 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:21.558 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:21.558 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:21.558 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:21.558 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:21.558 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:21.558 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:21.558 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:21.558 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:21.558 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:21.558 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:21.558 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:21.559 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:21.559 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:21.559 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:21.559 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:21.559 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:21.559 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:21.559 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:21.559 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:21.559 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:21.559 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:21.559 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:21.559 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:21.559 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:21.559 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:21.559 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:21.560 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:21.560 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:21.560 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:21.560 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:21.560 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:21.560 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:21.560 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.560 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.560 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.560 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:21.560 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.560 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:21.560 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.560 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:21.560 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:21.560 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:21.561 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:21.561 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:21.561 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:21.561 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.561 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:21.561 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:21.561 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:21.561 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:21.561 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:21.561 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:21.561 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.561 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:21.561 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:21.561 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:21.561 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:21.562 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:21.562 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:21.562 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:21.562 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:21.562 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:21.562 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:21.562 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:21.562 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.562 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.562 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:21.562 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:21.562 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:21.562 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:21.562 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:21.562 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.562 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.563 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:21.563 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:21.563 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:21.563 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:21.563 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:21.563 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.563 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:21.563 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:21.563 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:21.563 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:21.563 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:21.563 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-455" 2023-12-03T13:00:21.563 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.563 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:21.563 INFO:teuthology.orchestra.run.smithi003.stdout:_______________ test_bucket_policy_put_obj_tagging_existing_tag ________________ 2023-12-03T13:00:21.563 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.564 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.564 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.564 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:21.564 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:21.564 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.564 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:21.564 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.564 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:21.564 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:21.564 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:21.564 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.564 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:21.564 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:21.564 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.564 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.564 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:21.565 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:21.565 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.565 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.565 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:21.565 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.565 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:21.565 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:21.565 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.565 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.565 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:21.565 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:21.565 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.565 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:21.565 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:21.565 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:21.565 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:21.566 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:21.566 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.566 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:21.566 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.566 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:21.566 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:21.566 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:21.566 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:21.566 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:21.566 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:21.566 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:21.566 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:21.566 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.566 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.566 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:21.566 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:21.567 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:21.567 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:21.567 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.567 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:21.567 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:21.567 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:21.567 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:21.567 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.567 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.567 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:21.567 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:21.567 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:21.567 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:21.567 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.567 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.568 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:21.568 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:21.568 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:21.568 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.568 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:21.568 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.568 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:21.568 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:21.568 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.568 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:21.568 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:21.568 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:21.568 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:21.568 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:21.568 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:21.569 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.569 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:21.569 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.569 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:21.569 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.569 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.569 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:21.569 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.569 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:21.569 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.569 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:21.569 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:21.569 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:21.569 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:21.569 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:21.570 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:21.570 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.570 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:21.570 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:21.570 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:21.570 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:21.570 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:21.570 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:21.570 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.570 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:21.570 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:21.570 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:21.570 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:21.570 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:21.571 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:21.571 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:21.571 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:21.571 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:21.571 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:21.571 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:21.571 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.571 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.571 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:21.571 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.571 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:21.571 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:21.571 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:21.571 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:21.571 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:21.572 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:21.572 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:21.572 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:21.572 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:21.572 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:21.572 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:21.572 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:21.572 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:21.572 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:21.572 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:21.572 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:21.572 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:21.572 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:21.572 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:21.572 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:21.573 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:21.573 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:21.573 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:21.573 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:21.573 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:21.573 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:21.573 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:21.573 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:21.573 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.573 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.573 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.573 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.573 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:21.573 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:21.573 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.573 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:21.573 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.574 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:21.574 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:21.574 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:21.574 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.574 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:21.574 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:21.574 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.574 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.574 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:21.574 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:21.574 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.574 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.574 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:21.574 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:21.574 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:21.574 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:21.575 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:21.575 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.575 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.575 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:21.575 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:21.575 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:21.575 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.575 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:21.575 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.575 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:21.575 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.575 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:21.575 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.575 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.tagging 2023-12-03T13:00:21.576 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.bucket_policy 2023-12-03T13:00:21.576 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T13:00:21.576 INFO:teuthology.orchestra.run.smithi003.stdout: def test_bucket_policy_put_obj_tagging_existing_tag(): 2023-12-03T13:00:21.576 INFO:teuthology.orchestra.run.smithi003.stdout:> bucket_name = _create_objects(keys=['publictag', 'privatetag', 'invalidtag']) 2023-12-03T13:00:21.576 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.576 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:10999: 2023-12-03T13:00:21.576 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.576 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:116: in _create_objects 2023-12-03T13:00:21.576 INFO:teuthology.orchestra.run.smithi003.stdout: bucket = get_new_bucket_resource(name=bucket_name) 2023-12-03T13:00:21.576 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:581: in get_new_bucket_resource 2023-12-03T13:00:21.576 INFO:teuthology.orchestra.run.smithi003.stdout: bucket_location = bucket.create() 2023-12-03T13:00:21.576 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/boto3/resources/factory.py:580: in do_action 2023-12-03T13:00:21.576 INFO:teuthology.orchestra.run.smithi003.stdout: response = action(self, *args, **kwargs) 2023-12-03T13:00:21.576 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/boto3/resources/action.py:88: in __call__ 2023-12-03T13:00:21.576 INFO:teuthology.orchestra.run.smithi003.stdout: response = getattr(parent.meta.client, operation_name)(*args, **params) 2023-12-03T13:00:21.576 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:21.577 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:21.577 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:21.577 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:21.577 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:21.577 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:21.577 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:21.577 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:21.577 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:21.577 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:21.577 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:21.577 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:21.577 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:21.577 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:21.577 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:21.577 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:21.577 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:21.578 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:21.578 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:21.578 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:21.578 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:21.578 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:21.578 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:21.578 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:21.578 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:21.578 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:21.578 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:21.578 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:21.578 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:21.578 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:21.578 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:21.578 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:21.578 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:21.578 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:21.579 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.579 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.579 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.579 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:21.579 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.579 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:21.579 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.579 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:21.579 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:21.579 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:21.579 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:21.579 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:21.579 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:21.580 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.580 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:21.580 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:21.580 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:21.580 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:21.580 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:21.580 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:21.580 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.580 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:21.580 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:21.580 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:21.580 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:21.580 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:21.580 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:21.580 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:21.580 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:21.580 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:21.581 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:21.581 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:21.581 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.581 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.581 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:21.581 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:21.581 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:21.581 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:21.581 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:21.581 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.581 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.581 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:21.581 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:21.581 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:21.581 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:21.582 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:21.582 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.582 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:21.582 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:21.582 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:21.582 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:21.582 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:21.582 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-456" 2023-12-03T13:00:21.582 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.582 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:21.582 INFO:teuthology.orchestra.run.smithi003.stdout:____________________ test_bucket_policy_put_obj_copy_source ____________________ 2023-12-03T13:00:21.582 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.582 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.582 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.582 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:21.583 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:21.583 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.583 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:21.583 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.583 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:21.583 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:21.583 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:21.583 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.583 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:21.583 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:21.583 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.583 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.583 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:21.583 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:21.583 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.583 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.584 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:21.584 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.584 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:21.584 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:21.584 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.584 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.584 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:21.584 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:21.584 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.584 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:21.584 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:21.584 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:21.584 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:21.584 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:21.584 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.584 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:21.585 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.585 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:21.585 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:21.585 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:21.585 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:21.585 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:21.585 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:21.585 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:21.585 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:21.585 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.585 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.585 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:21.585 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:21.585 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:21.585 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:21.585 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.586 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:21.586 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:21.586 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:21.586 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:21.586 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.586 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.586 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:21.586 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:21.586 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:21.586 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:21.586 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.586 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.586 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:21.586 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:21.586 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:21.587 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.587 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:21.587 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.587 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:21.587 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:21.587 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.587 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:21.587 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:21.587 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:21.587 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:21.587 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:21.587 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:21.587 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.587 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:21.587 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.587 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:21.588 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.588 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.588 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:21.588 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.588 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:21.588 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.588 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:21.588 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:21.588 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:21.588 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:21.588 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:21.588 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:21.588 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.588 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:21.588 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:21.588 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:21.589 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:21.589 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:21.589 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:21.589 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.589 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:21.589 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:21.589 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:21.589 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:21.589 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:21.589 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:21.589 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:21.589 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:21.590 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:21.590 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:21.590 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:21.590 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.590 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.590 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:21.590 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.590 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:21.590 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:21.590 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:21.590 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:21.590 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:21.590 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:21.590 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:21.590 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:21.591 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:21.591 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:21.591 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:21.591 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:21.591 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:21.591 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:21.591 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:21.591 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:21.591 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:21.591 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:21.591 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:21.591 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:21.591 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:21.591 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:21.592 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:21.592 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:21.592 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:21.592 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:21.592 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:21.592 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:21.592 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.592 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.592 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.592 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.592 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:21.592 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:21.592 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.592 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:21.592 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.592 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:21.593 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:21.593 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:21.593 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.593 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:21.593 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:21.593 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.593 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.593 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:21.593 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:21.593 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.593 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.593 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:21.593 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:21.593 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:21.593 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:21.593 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:21.594 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.594 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.594 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:21.594 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:21.594 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:21.594 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.594 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:21.594 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.594 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:21.594 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.594 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:21.594 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.594 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.tagging 2023-12-03T13:00:21.594 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.bucket_policy 2023-12-03T13:00:21.594 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T13:00:21.595 INFO:teuthology.orchestra.run.smithi003.stdout: def test_bucket_policy_put_obj_copy_source(): 2023-12-03T13:00:21.595 INFO:teuthology.orchestra.run.smithi003.stdout:> bucket_name = _create_objects(keys=['public/foo', 'public/bar', 'private/foo']) 2023-12-03T13:00:21.595 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.595 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:11068: 2023-12-03T13:00:21.595 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.595 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:116: in _create_objects 2023-12-03T13:00:21.595 INFO:teuthology.orchestra.run.smithi003.stdout: bucket = get_new_bucket_resource(name=bucket_name) 2023-12-03T13:00:21.595 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:581: in get_new_bucket_resource 2023-12-03T13:00:21.595 INFO:teuthology.orchestra.run.smithi003.stdout: bucket_location = bucket.create() 2023-12-03T13:00:21.595 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/boto3/resources/factory.py:580: in do_action 2023-12-03T13:00:21.595 INFO:teuthology.orchestra.run.smithi003.stdout: response = action(self, *args, **kwargs) 2023-12-03T13:00:21.595 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/boto3/resources/action.py:88: in __call__ 2023-12-03T13:00:21.595 INFO:teuthology.orchestra.run.smithi003.stdout: response = getattr(parent.meta.client, operation_name)(*args, **params) 2023-12-03T13:00:21.595 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:21.595 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:21.595 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:21.596 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:21.596 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:21.596 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:21.596 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:21.596 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:21.596 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:21.596 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:21.596 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:21.596 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:21.596 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:21.596 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:21.596 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:21.596 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:21.596 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:21.596 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:21.597 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:21.597 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:21.597 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:21.597 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:21.597 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:21.597 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:21.597 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:21.597 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:21.597 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:21.597 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:21.597 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:21.597 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:21.597 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:21.597 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:21.597 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:21.598 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:21.598 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.598 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.598 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.598 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:21.598 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.598 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:21.598 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.598 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:21.598 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:21.598 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:21.598 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:21.599 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:21.599 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:21.599 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.599 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:21.599 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:21.599 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:21.599 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:21.599 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:21.599 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:21.599 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.599 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:21.599 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:21.599 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:21.599 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:21.599 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:21.599 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:21.599 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:21.600 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:21.600 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:21.600 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:21.600 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:21.600 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.600 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.600 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:21.600 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:21.600 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:21.600 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:21.600 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:21.600 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.600 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.600 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:21.601 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:21.601 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:21.601 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:21.601 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:21.601 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.601 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:21.601 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:21.601 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:21.601 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:21.601 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:21.601 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-457" 2023-12-03T13:00:21.601 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.601 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:21.601 INFO:teuthology.orchestra.run.smithi003.stdout:_________________ test_bucket_policy_put_obj_copy_source_meta __________________ 2023-12-03T13:00:21.602 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.602 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.602 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.602 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:21.602 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:21.602 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.602 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:21.602 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.602 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:21.602 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:21.602 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:21.603 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.603 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:21.603 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:21.603 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.603 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.603 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:21.603 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:21.603 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.603 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.603 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:21.603 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.603 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:21.603 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:21.603 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.603 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.604 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:21.604 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:21.604 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.604 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:21.604 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:21.604 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:21.604 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:21.604 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:21.604 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.604 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:21.604 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.604 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:21.604 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:21.604 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:21.604 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:21.605 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:21.605 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:21.605 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:21.605 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:21.605 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.605 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.605 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:21.605 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:21.605 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:21.605 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:21.605 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.605 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:21.605 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:21.605 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:21.606 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:21.606 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.606 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.606 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:21.606 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:21.606 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:21.606 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:21.606 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.606 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.606 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:21.606 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:21.606 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:21.606 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.607 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:21.607 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.607 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:21.607 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:21.607 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.607 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:21.607 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:21.607 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:21.607 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:21.607 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:21.607 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:21.607 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.607 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:21.607 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.607 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:21.607 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.608 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.608 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:21.608 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.608 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:21.608 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.608 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:21.608 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:21.608 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:21.608 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:21.608 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:21.608 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:21.608 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.608 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:21.608 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:21.608 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:21.609 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:21.609 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:21.609 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:21.609 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.609 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:21.609 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:21.609 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:21.609 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:21.609 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:21.609 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:21.609 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:21.609 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:21.609 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:21.609 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:21.609 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:21.609 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.610 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.610 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:21.610 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.610 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:21.610 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:21.610 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:21.610 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:21.610 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:21.610 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:21.610 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:21.610 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:21.610 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:21.610 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:21.610 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:21.610 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:21.611 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:21.611 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:21.611 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:21.611 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:21.611 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:21.611 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:21.611 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:21.611 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:21.611 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:21.611 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:21.611 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:21.611 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:21.611 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:21.611 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:21.611 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:21.611 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:21.612 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.612 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.612 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.612 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.612 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:21.612 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:21.612 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.612 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:21.612 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.612 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:21.612 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:21.612 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:21.612 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.612 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:21.612 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:21.612 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.613 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.613 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:21.613 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:21.613 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.613 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.613 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:21.613 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:21.613 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:21.613 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:21.613 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:21.613 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.613 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.613 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:21.613 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:21.613 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:21.614 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.614 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:21.614 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.614 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:21.614 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.614 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:21.614 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.614 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.tagging 2023-12-03T13:00:21.614 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.bucket_policy 2023-12-03T13:00:21.614 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T13:00:21.614 INFO:teuthology.orchestra.run.smithi003.stdout: def test_bucket_policy_put_obj_copy_source_meta(): 2023-12-03T13:00:21.614 INFO:teuthology.orchestra.run.smithi003.stdout:> src_bucket_name = _create_objects(keys=['public/foo', 'public/bar']) 2023-12-03T13:00:21.614 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.614 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:11115: 2023-12-03T13:00:21.614 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.615 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:116: in _create_objects 2023-12-03T13:00:21.615 INFO:teuthology.orchestra.run.smithi003.stdout: bucket = get_new_bucket_resource(name=bucket_name) 2023-12-03T13:00:21.615 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:581: in get_new_bucket_resource 2023-12-03T13:00:21.615 INFO:teuthology.orchestra.run.smithi003.stdout: bucket_location = bucket.create() 2023-12-03T13:00:21.615 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/boto3/resources/factory.py:580: in do_action 2023-12-03T13:00:21.615 INFO:teuthology.orchestra.run.smithi003.stdout: response = action(self, *args, **kwargs) 2023-12-03T13:00:21.615 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/boto3/resources/action.py:88: in __call__ 2023-12-03T13:00:21.615 INFO:teuthology.orchestra.run.smithi003.stdout: response = getattr(parent.meta.client, operation_name)(*args, **params) 2023-12-03T13:00:21.615 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:21.615 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:21.615 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:21.615 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:21.615 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:21.615 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:21.615 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:21.615 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:21.616 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:21.616 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:21.616 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:21.616 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:21.616 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:21.616 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:21.616 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:21.616 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:21.616 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:21.616 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:21.616 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:21.616 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:21.616 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:21.616 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:21.616 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:21.617 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:21.617 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:21.617 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:21.617 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:21.617 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:21.617 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:21.617 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:21.617 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:21.617 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:21.617 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:21.617 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:21.617 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.617 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.617 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.617 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:21.617 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.618 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:21.618 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.618 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:21.618 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:21.618 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:21.618 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:21.618 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:21.618 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:21.618 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.618 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:21.618 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:21.618 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:21.618 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:21.618 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:21.618 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:21.619 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.619 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:21.619 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:21.619 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:21.619 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:21.619 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:21.619 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:21.619 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:21.619 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:21.619 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:21.619 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:21.619 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:21.619 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.619 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.619 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:21.619 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:21.620 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:21.620 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:21.620 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:21.620 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.620 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.620 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:21.620 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:21.620 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:21.620 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:21.620 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:21.620 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.620 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:21.620 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:21.620 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:21.620 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:21.620 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:21.621 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-458" 2023-12-03T13:00:21.621 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.621 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:21.621 INFO:teuthology.orchestra.run.smithi003.stdout:________________________ test_bucket_policy_put_obj_acl ________________________ 2023-12-03T13:00:21.621 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.621 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.621 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.621 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:21.621 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:21.621 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.621 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:21.621 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.621 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:21.621 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:21.622 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:21.622 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.622 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:21.622 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:21.622 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.622 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.622 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:21.622 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:21.622 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.622 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.622 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:21.622 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.622 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:21.622 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:21.622 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.623 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.623 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:21.623 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:21.623 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.623 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:21.623 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:21.623 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:21.623 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:21.623 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:21.623 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.623 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:21.623 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.623 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:21.623 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:21.623 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:21.623 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:21.624 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:21.624 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:21.624 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:21.624 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:21.624 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.624 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.624 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:21.624 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:21.624 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:21.624 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:21.624 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.624 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:21.624 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:21.624 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:21.624 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:21.624 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.624 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.625 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:21.625 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:21.625 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:21.625 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:21.625 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.625 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.625 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:21.625 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:21.625 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:21.625 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.625 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:21.625 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.625 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:21.625 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:21.625 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.626 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:21.626 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:21.626 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:21.626 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:21.626 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:21.626 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:21.626 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.626 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:21.626 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.626 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:21.626 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.626 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.626 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:21.626 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.626 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:21.627 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.627 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:21.627 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:21.627 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:21.627 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:21.627 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:21.627 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:21.627 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.627 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:21.627 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:21.627 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:21.627 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:21.627 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:21.627 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:21.627 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.628 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:21.628 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:21.628 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:21.628 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:21.628 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:21.628 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:21.628 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:21.628 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:21.628 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:21.628 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:21.628 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:21.628 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.628 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.628 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:21.628 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.628 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:21.629 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:21.629 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:21.629 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:21.629 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:21.629 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:21.629 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:21.629 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:21.629 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:21.629 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:21.629 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:21.629 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:21.629 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:21.629 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:21.629 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:21.629 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:21.629 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:21.630 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:21.630 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:21.630 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:21.630 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:21.630 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:21.630 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:21.630 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:21.630 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:21.630 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:21.630 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:21.630 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:21.630 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.630 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.630 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.630 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.630 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:21.631 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:21.631 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.631 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:21.631 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.631 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:21.631 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:21.631 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:21.631 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.631 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:21.631 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:21.631 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.631 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.631 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:21.631 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:21.631 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.631 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.632 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:21.632 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:21.632 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:21.632 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:21.632 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:21.632 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.632 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.632 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:21.632 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:21.632 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:21.632 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.632 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:21.632 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.632 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:21.632 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.632 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:21.632 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.633 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.tagging 2023-12-03T13:00:21.633 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.bucket_policy 2023-12-03T13:00:21.633 INFO:teuthology.orchestra.run.smithi003.stdout: def test_bucket_policy_put_obj_acl(): 2023-12-03T13:00:21.633 INFO:teuthology.orchestra.run.smithi003.stdout:> bucket_name = get_new_bucket() 2023-12-03T13:00:21.633 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.633 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:11165: 2023-12-03T13:00:21.633 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.633 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:21.633 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:21.633 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:21.633 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:21.633 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:21.633 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:21.633 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:21.633 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:21.633 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:21.634 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:21.634 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:21.634 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:21.634 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:21.634 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:21.634 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:21.634 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:21.634 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:21.634 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:21.634 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:21.634 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:21.634 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:21.634 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:21.634 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:21.634 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:21.635 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:21.635 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:21.635 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:21.635 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:21.635 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:21.635 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:21.635 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:21.635 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:21.635 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:21.635 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:21.635 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:21.635 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:21.635 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.635 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.635 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.635 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:21.636 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.636 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:21.636 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.636 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:21.636 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:21.636 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:21.636 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:21.636 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:21.636 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:21.636 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.636 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:21.636 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:21.636 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:21.637 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:21.637 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:21.637 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:21.637 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.637 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:21.637 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:21.637 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:21.637 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:21.637 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:21.637 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:21.637 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:21.637 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:21.637 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:21.637 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:21.637 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:21.637 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.638 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.638 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:21.638 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:21.638 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:21.638 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:21.638 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:21.638 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.638 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.638 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:21.638 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:21.638 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:21.638 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:21.638 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:21.638 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.638 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:21.639 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:21.639 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:21.639 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:21.639 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:21.639 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-459" 2023-12-03T13:00:21.639 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.639 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:21.639 INFO:teuthology.orchestra.run.smithi003.stdout:_______________________ test_bucket_policy_put_obj_grant _______________________ 2023-12-03T13:00:21.639 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.639 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.639 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.639 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:21.639 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:21.639 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.639 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:21.639 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.640 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:21.640 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:21.640 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:21.640 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.640 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:21.640 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:21.640 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.640 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.640 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:21.640 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:21.640 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.640 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.640 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:21.640 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.640 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:21.641 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:21.641 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.641 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.641 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:21.641 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:21.641 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.641 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:21.641 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:21.641 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:21.641 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:21.641 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:21.641 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.641 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:21.641 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.641 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:21.641 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:21.642 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:21.642 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:21.642 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:21.642 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:21.642 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:21.642 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:21.642 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.642 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.642 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:21.642 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:21.642 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:21.642 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:21.642 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.642 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:21.642 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:21.643 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:21.643 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:21.643 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.643 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.643 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:21.643 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:21.643 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:21.643 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:21.643 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.643 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.643 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:21.643 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:21.643 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:21.643 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.643 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:21.643 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.644 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:21.644 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:21.644 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.644 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:21.644 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:21.644 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:21.644 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:21.644 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:21.644 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:21.644 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.644 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:21.644 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.644 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:21.644 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.644 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.645 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:21.645 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.645 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:21.645 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.645 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:21.645 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:21.645 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:21.645 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:21.645 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:21.645 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:21.645 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.645 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:21.645 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:21.645 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:21.645 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:21.646 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:21.646 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:21.646 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.646 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:21.646 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:21.646 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:21.646 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:21.646 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:21.646 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:21.646 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:21.646 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:21.646 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:21.646 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:21.646 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:21.646 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.646 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.647 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:21.647 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.647 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:21.647 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:21.647 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:21.647 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:21.647 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:21.647 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:21.647 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:21.647 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:21.647 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:21.647 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:21.647 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:21.647 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:21.647 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:21.648 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:21.648 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:21.648 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:21.648 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:21.648 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:21.648 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:21.648 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:21.648 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:21.648 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:21.648 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:21.648 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:21.648 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:21.648 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:21.648 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:21.648 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:21.648 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.648 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.649 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.649 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.649 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:21.649 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:21.649 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.649 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:21.649 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.649 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:21.649 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:21.649 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:21.649 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.649 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:21.649 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:21.649 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.649 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.650 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:21.650 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:21.650 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.650 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.650 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:21.650 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:21.650 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:21.650 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:21.650 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:21.650 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.650 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.650 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:21.650 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:21.650 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:21.650 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.650 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:21.651 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.651 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:21.651 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.651 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:21.651 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.651 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.bucket_policy 2023-12-03T13:00:21.651 INFO:teuthology.orchestra.run.smithi003.stdout: def test_bucket_policy_put_obj_grant(): 2023-12-03T13:00:21.651 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.651 INFO:teuthology.orchestra.run.smithi003.stdout:> bucket_name = get_new_bucket() 2023-12-03T13:00:21.651 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.651 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:11206: 2023-12-03T13:00:21.651 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.651 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:21.651 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:21.651 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:21.652 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:21.652 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:21.652 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:21.652 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:21.652 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:21.652 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:21.652 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:21.652 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:21.652 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:21.652 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:21.652 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:21.652 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:21.652 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:21.652 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:21.652 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:21.652 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:21.653 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:21.653 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:21.653 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:21.653 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:21.653 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:21.653 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:21.653 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:21.653 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:21.653 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:21.653 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:21.653 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:21.653 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:21.653 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:21.653 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:21.653 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:21.653 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:21.653 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:21.654 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.654 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.654 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.654 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:21.654 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.654 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:21.654 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.654 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:21.654 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:21.654 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:21.654 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:21.654 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:21.654 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:21.654 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.654 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:21.654 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:21.655 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:21.655 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:21.655 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:21.655 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:21.655 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.655 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:21.655 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:21.655 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:21.655 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:21.655 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:21.655 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:21.655 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:21.655 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:21.655 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:21.655 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:21.655 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:21.656 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.656 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.656 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:21.656 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:21.656 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:21.656 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:21.656 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:21.656 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.656 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.656 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:21.656 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:21.656 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:21.656 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:21.656 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:21.657 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.657 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:21.657 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:21.657 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:21.657 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:21.657 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:21.657 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-460" 2023-12-03T13:00:21.657 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.657 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:21.657 INFO:teuthology.orchestra.run.smithi003.stdout:________________________ test_put_obj_enc_conflict_c_s3 ________________________ 2023-12-03T13:00:21.657 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.657 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.657 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.657 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:21.657 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:21.657 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.657 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:21.658 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.658 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:21.658 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:21.658 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:21.658 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.658 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:21.658 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:21.658 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.658 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.658 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:21.658 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:21.658 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.658 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.658 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:21.659 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.659 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:21.659 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:21.659 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.659 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.659 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:21.659 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:21.659 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.659 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:21.659 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:21.659 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:21.659 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:21.659 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:21.659 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.659 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:21.659 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.660 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:21.660 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:21.660 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:21.660 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:21.660 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:21.660 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:21.660 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:21.660 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:21.660 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.660 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.660 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:21.660 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:21.660 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:21.660 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:21.660 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.660 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:21.660 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:21.661 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:21.661 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:21.661 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.661 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.661 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:21.661 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:21.661 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:21.661 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:21.661 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.661 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.661 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:21.661 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:21.661 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:21.661 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.661 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:21.661 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.662 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:21.662 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:21.662 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.662 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:21.662 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:21.662 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:21.662 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:21.662 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:21.662 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:21.662 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.662 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:21.662 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.662 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:21.662 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.663 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.663 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:21.663 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.663 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:21.663 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.663 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:21.663 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:21.663 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:21.663 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:21.663 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:21.663 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:21.663 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.663 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:21.663 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:21.663 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:21.663 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:21.664 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:21.664 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:21.664 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.664 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:21.664 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:21.664 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:21.664 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:21.664 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:21.664 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:21.664 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:21.664 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:21.664 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:21.664 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:21.664 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:21.664 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.665 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.665 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:21.665 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.665 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:21.665 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:21.665 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:21.665 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:21.665 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:21.665 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:21.665 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:21.665 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:21.665 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:21.665 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:21.665 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:21.665 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:21.665 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:21.666 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:21.666 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:21.666 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:21.666 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:21.666 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:21.666 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:21.666 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:21.666 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:21.666 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:21.666 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:21.666 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:21.666 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:21.666 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:21.666 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:21.666 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:21.667 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.667 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.667 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.667 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.667 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:21.667 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:21.667 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.667 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:21.667 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.667 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:21.667 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:21.667 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:21.667 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.667 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:21.667 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:21.667 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.668 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.668 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:21.668 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:21.668 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.668 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.668 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:21.668 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:21.668 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:21.668 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:21.668 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:21.668 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.668 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.668 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:21.668 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:21.668 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:21.668 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.669 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:21.669 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.669 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:21.669 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.669 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:21.669 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.669 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.encryption 2023-12-03T13:00:21.669 INFO:teuthology.orchestra.run.smithi003.stdout: def test_put_obj_enc_conflict_c_s3(): 2023-12-03T13:00:21.669 INFO:teuthology.orchestra.run.smithi003.stdout:> bucket_name = get_new_bucket() 2023-12-03T13:00:21.669 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.669 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:11267: 2023-12-03T13:00:21.669 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.669 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:21.669 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:21.669 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:21.670 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:21.670 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:21.670 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:21.670 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:21.670 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:21.670 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:21.670 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:21.670 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:21.670 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:21.670 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:21.670 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:21.670 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:21.670 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:21.670 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:21.671 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:21.671 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:21.671 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:21.671 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:21.671 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:21.671 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:21.671 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:21.671 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:21.671 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:21.671 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:21.671 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:21.671 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:21.671 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:21.671 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:21.672 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:21.672 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:21.672 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:21.672 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:21.672 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:21.672 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.672 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.672 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.672 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:21.672 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.672 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:21.672 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.672 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:21.672 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:21.672 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:21.673 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:21.673 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:21.673 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:21.673 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.673 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:21.673 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:21.673 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:21.673 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:21.673 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:21.673 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:21.673 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.673 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:21.673 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:21.673 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:21.673 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:21.673 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:21.674 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:21.674 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:21.674 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:21.674 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:21.674 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:21.674 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:21.674 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.674 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.674 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:21.674 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:21.674 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:21.674 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:21.674 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:21.674 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.674 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.675 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:21.675 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:21.675 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:21.675 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:21.675 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:21.675 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.675 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:21.675 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:21.675 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:21.675 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:21.675 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:21.675 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-461" 2023-12-03T13:00:21.675 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.675 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:21.675 INFO:teuthology.orchestra.run.smithi003.stdout:_______________________ test_put_obj_enc_conflict_c_kms ________________________ 2023-12-03T13:00:21.675 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.676 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.676 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.676 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:21.676 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:21.676 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.676 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:21.676 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.676 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:21.676 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:21.676 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:21.676 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.676 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:21.676 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:21.676 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.677 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.677 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:21.677 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:21.677 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.677 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.677 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:21.677 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.677 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:21.677 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:21.677 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.677 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.677 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:21.677 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:21.677 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.677 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:21.677 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:21.678 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:21.678 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:21.678 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:21.678 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.678 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:21.678 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.678 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:21.678 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:21.678 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:21.678 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:21.678 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:21.678 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:21.678 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:21.678 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:21.678 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.679 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.679 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:21.679 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:21.679 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:21.679 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:21.679 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.679 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:21.679 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:21.679 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:21.679 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:21.679 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.679 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.679 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:21.679 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:21.679 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:21.679 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:21.679 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.680 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.680 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:21.680 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:21.680 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:21.680 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.680 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:21.680 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.680 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:21.680 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:21.680 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.680 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:21.680 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:21.680 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:21.680 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:21.680 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:21.681 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:21.681 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.681 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:21.681 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.681 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:21.681 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.681 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.681 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:21.681 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.681 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:21.681 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.681 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:21.681 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:21.681 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:21.682 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:21.682 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:21.682 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:21.682 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.682 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:21.682 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:21.682 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:21.682 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:21.682 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:21.682 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:21.682 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.682 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:21.682 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:21.682 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:21.682 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:21.682 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:21.683 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:21.683 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:21.683 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:21.683 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:21.683 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:21.683 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:21.683 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.683 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.683 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:21.683 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.683 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:21.683 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:21.683 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:21.683 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:21.683 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:21.684 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:21.684 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:21.684 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:21.684 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:21.684 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:21.684 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:21.684 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:21.684 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:21.684 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:21.684 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:21.684 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:21.684 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:21.684 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:21.684 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:21.684 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:21.685 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:21.685 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:21.685 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:21.685 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:21.685 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:21.685 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:21.685 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:21.685 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:21.685 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.685 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.685 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.685 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.685 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:21.685 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:21.685 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.685 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:21.686 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.686 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:21.686 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:21.686 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:21.686 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.686 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:21.686 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:21.686 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.686 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.686 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:21.686 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:21.686 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.686 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.686 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:21.686 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:21.686 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:21.687 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:21.687 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:21.687 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.687 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.687 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:21.687 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:21.687 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:21.687 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.687 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:21.687 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.687 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:21.687 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.687 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:21.687 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.687 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.encryption 2023-12-03T13:00:21.688 INFO:teuthology.orchestra.run.smithi003.stdout: def test_put_obj_enc_conflict_c_kms(): 2023-12-03T13:00:21.688 INFO:teuthology.orchestra.run.smithi003.stdout: kms_keyid = get_main_kms_keyid() 2023-12-03T13:00:21.688 INFO:teuthology.orchestra.run.smithi003.stdout: if kms_keyid is None: 2023-12-03T13:00:21.688 INFO:teuthology.orchestra.run.smithi003.stdout: kms_keyid = 'fool-me-once' 2023-12-03T13:00:21.688 INFO:teuthology.orchestra.run.smithi003.stdout:> bucket_name = get_new_bucket() 2023-12-03T13:00:21.688 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.688 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:11293: 2023-12-03T13:00:21.688 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.688 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:21.688 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:21.688 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:21.688 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:21.688 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:21.688 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:21.688 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:21.689 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:21.689 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:21.689 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:21.689 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:21.689 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:21.689 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:21.689 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:21.689 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:21.689 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:21.689 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:21.689 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:21.689 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:21.689 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:21.689 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:21.689 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:21.690 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:21.690 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:21.690 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:21.690 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:21.690 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:21.690 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:21.690 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:21.690 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:21.690 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:21.690 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:21.690 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:21.690 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:21.690 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:21.690 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:21.690 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.691 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.691 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.691 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:21.691 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.691 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:21.691 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.691 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:21.691 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:21.691 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:21.691 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:21.691 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:21.691 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:21.691 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.691 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:21.692 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:21.692 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:21.692 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:21.692 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:21.692 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:21.692 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.692 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:21.692 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:21.692 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:21.692 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:21.692 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:21.692 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:21.692 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:21.692 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:21.692 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:21.692 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:21.693 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:21.693 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.693 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.693 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:21.693 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:21.693 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:21.693 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:21.693 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:21.693 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.693 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.693 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:21.693 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:21.693 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:21.693 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:21.693 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:21.693 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.694 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:21.694 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:21.694 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:21.694 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:21.694 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:21.694 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-462" 2023-12-03T13:00:21.694 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.694 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:21.694 INFO:teuthology.orchestra.run.smithi003.stdout:_______________________ test_put_obj_enc_conflict_s3_kms _______________________ 2023-12-03T13:00:21.694 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.694 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.694 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.694 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:21.694 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:21.694 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.695 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:21.695 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.695 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:21.695 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:21.695 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:21.695 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.695 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:21.695 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:21.695 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.695 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.695 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:21.695 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:21.695 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.695 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.695 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:21.695 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.695 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:21.696 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:21.696 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.696 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.696 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:21.696 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:21.696 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.696 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:21.696 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:21.696 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:21.696 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:21.696 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:21.696 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.696 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:21.696 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.697 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:21.697 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:21.697 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:21.697 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:21.697 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:21.697 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:21.697 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:21.697 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:21.697 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.697 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.697 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:21.697 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:21.697 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:21.697 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:21.697 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.697 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:21.698 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:21.698 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:21.698 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:21.698 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.698 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.698 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:21.698 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:21.698 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:21.698 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:21.698 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.698 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.698 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:21.698 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:21.698 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:21.699 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.699 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:21.699 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.699 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:21.699 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:21.699 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.699 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:21.699 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:21.699 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:21.699 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:21.699 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:21.699 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:21.699 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.699 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:21.699 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.699 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:21.700 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.700 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.700 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:21.700 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.700 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:21.700 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.700 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:21.700 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:21.700 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:21.700 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:21.700 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:21.700 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:21.700 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.700 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:21.700 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:21.700 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:21.701 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:21.701 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:21.701 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:21.701 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.701 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:21.701 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:21.701 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:21.701 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:21.701 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:21.701 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:21.701 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:21.701 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:21.701 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:21.701 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:21.701 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:21.702 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.702 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.702 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:21.702 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.702 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:21.702 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:21.702 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:21.702 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:21.702 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:21.702 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:21.702 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:21.702 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:21.702 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:21.702 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:21.702 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:21.702 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:21.703 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:21.703 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:21.703 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:21.703 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:21.703 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:21.703 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:21.703 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:21.703 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:21.703 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:21.703 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:21.703 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:21.703 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:21.703 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:21.703 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:21.703 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:21.704 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:21.704 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.704 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.704 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.704 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.704 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:21.704 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:21.704 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.704 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:21.704 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.704 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:21.704 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:21.704 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:21.704 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.704 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:21.704 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:21.705 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.705 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.705 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:21.705 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:21.705 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.705 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.705 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:21.705 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:21.705 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:21.705 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:21.705 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:21.705 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.705 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.705 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:21.706 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:21.706 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:21.706 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.706 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:21.706 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.706 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:21.706 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.706 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:21.706 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.706 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.encryption 2023-12-03T13:00:21.706 INFO:teuthology.orchestra.run.smithi003.stdout: def test_put_obj_enc_conflict_s3_kms(): 2023-12-03T13:00:21.706 INFO:teuthology.orchestra.run.smithi003.stdout: kms_keyid = get_main_kms_keyid() 2023-12-03T13:00:21.706 INFO:teuthology.orchestra.run.smithi003.stdout: if kms_keyid is None: 2023-12-03T13:00:21.706 INFO:teuthology.orchestra.run.smithi003.stdout: kms_keyid = 'fool-me-once' 2023-12-03T13:00:21.706 INFO:teuthology.orchestra.run.smithi003.stdout:> bucket_name = get_new_bucket() 2023-12-03T13:00:21.707 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.707 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:11320: 2023-12-03T13:00:21.707 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.707 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:21.707 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:21.707 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:21.707 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:21.707 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:21.707 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:21.707 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:21.707 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:21.707 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:21.707 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:21.707 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:21.707 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:21.708 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:21.708 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:21.708 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:21.708 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:21.708 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:21.708 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:21.708 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:21.708 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:21.708 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:21.708 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:21.708 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:21.708 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:21.708 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:21.708 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:21.709 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:21.709 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:21.709 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:21.709 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:21.709 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:21.709 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:21.709 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:21.709 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:21.709 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:21.709 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:21.709 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.709 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.709 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.709 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:21.710 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.710 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:21.710 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.710 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:21.710 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:21.710 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:21.710 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:21.710 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:21.710 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:21.710 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.710 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:21.710 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:21.710 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:21.710 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:21.711 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:21.711 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:21.711 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.711 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:21.711 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:21.711 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:21.711 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:21.711 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:21.711 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:21.711 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:21.711 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:21.711 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:21.711 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:21.711 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:21.711 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.712 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.712 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:21.712 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:21.712 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:21.712 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:21.712 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:21.712 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.712 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.712 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:21.712 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:21.712 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:21.712 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:21.712 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:21.712 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.712 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:21.713 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:21.713 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:21.713 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:21.713 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:21.713 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-463" 2023-12-03T13:00:21.713 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.713 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:21.713 INFO:teuthology.orchestra.run.smithi003.stdout:____________________ test_put_obj_enc_conflict_bad_enc_kms _____________________ 2023-12-03T13:00:21.713 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.713 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.713 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.713 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:21.713 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:21.713 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.714 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:21.714 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.714 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:21.714 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:21.714 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:21.714 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.714 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:21.714 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:21.714 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.714 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.714 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:21.714 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:21.714 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.714 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.714 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:21.715 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.715 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:21.715 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:21.715 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.715 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.715 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:21.715 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:21.715 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.715 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:21.715 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:21.715 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:21.715 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:21.715 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:21.715 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.716 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:21.716 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.716 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:21.716 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:21.716 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:21.716 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:21.716 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:21.716 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:21.716 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:21.716 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:21.716 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.716 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.716 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:21.716 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:21.716 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:21.716 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:21.717 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.717 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:21.717 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:21.717 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:21.717 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:21.717 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.717 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.717 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:21.717 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:21.717 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:21.717 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:21.717 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.717 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.717 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:21.717 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:21.717 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:21.718 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.718 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:21.718 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.718 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:21.718 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:21.718 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.718 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:21.718 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:21.718 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:21.718 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:21.718 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:21.718 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:21.718 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.718 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:21.719 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.719 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:21.719 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.719 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.719 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:21.719 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.719 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:21.719 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.719 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:21.719 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:21.719 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:21.719 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:21.719 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:21.719 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:21.719 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.719 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:21.720 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:21.720 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:21.720 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:21.720 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:21.720 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:21.720 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.720 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:21.720 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:21.720 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:21.720 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:21.720 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:21.720 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:21.720 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:21.720 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:21.720 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:21.721 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:21.721 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:21.721 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.721 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.721 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:21.721 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.721 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:21.721 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:21.721 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:21.721 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:21.721 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:21.721 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:21.721 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:21.721 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:21.721 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:21.721 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:21.722 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:21.722 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:21.722 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:21.722 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:21.722 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:21.722 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:21.722 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:21.722 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:21.722 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:21.722 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:21.722 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:21.722 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:21.722 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:21.722 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:21.722 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:21.723 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:21.723 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:21.723 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:21.723 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.723 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.723 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.723 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.723 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:21.723 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:21.723 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.723 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:21.723 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.723 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:21.723 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:21.723 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:21.723 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.724 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:21.724 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:21.724 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.724 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.724 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:21.724 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:21.724 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.724 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.724 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:21.724 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:21.724 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:21.724 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:21.724 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:21.724 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.724 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.724 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:21.725 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:21.725 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:21.725 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.725 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:21.725 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.725 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:21.725 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.725 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:21.725 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.725 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.encryption 2023-12-03T13:00:21.725 INFO:teuthology.orchestra.run.smithi003.stdout: def test_put_obj_enc_conflict_bad_enc_kms(): 2023-12-03T13:00:21.725 INFO:teuthology.orchestra.run.smithi003.stdout: kms_keyid = get_main_kms_keyid() 2023-12-03T13:00:21.725 INFO:teuthology.orchestra.run.smithi003.stdout: if kms_keyid is None: 2023-12-03T13:00:21.725 INFO:teuthology.orchestra.run.smithi003.stdout: kms_keyid = 'fool-me-once' 2023-12-03T13:00:21.725 INFO:teuthology.orchestra.run.smithi003.stdout:> bucket_name = get_new_bucket() 2023-12-03T13:00:21.726 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.726 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:11344: 2023-12-03T13:00:21.726 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.726 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:21.726 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:21.726 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:21.726 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:21.726 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:21.726 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:21.726 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:21.726 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:21.726 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:21.726 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:21.726 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:21.726 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:21.727 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:21.727 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:21.727 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:21.727 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:21.727 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:21.727 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:21.727 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:21.727 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:21.727 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:21.727 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:21.727 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:21.727 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:21.727 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:21.727 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:21.728 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:21.728 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:21.728 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:21.728 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:21.728 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:21.728 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:21.728 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:21.728 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:21.728 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:21.728 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:21.728 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.728 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.728 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.728 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:21.728 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.728 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:21.729 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.729 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:21.729 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:21.729 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:21.729 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:21.729 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:21.729 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:21.729 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.729 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:21.729 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:21.729 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:21.729 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:21.729 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:21.729 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:21.729 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.730 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:21.730 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:21.730 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:21.730 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:21.730 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:21.730 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:21.730 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:21.730 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:21.730 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:21.730 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:21.730 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:21.730 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.730 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.730 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:21.731 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:21.731 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:21.731 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:21.731 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:21.731 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.731 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.731 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:21.731 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:21.731 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:21.731 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:21.731 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:21.731 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.731 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:21.731 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:21.731 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:21.731 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:21.732 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:21.732 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-464" 2023-12-03T13:00:21.732 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.732 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:21.732 INFO:teuthology.orchestra.run.smithi003.stdout:_____________________ test_bucket_policy_put_obj_kms_noenc _____________________ 2023-12-03T13:00:21.732 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.732 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.732 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.732 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:21.732 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:21.732 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.732 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:21.732 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.732 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:21.732 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:21.732 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:21.733 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.733 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:21.733 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:21.733 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.733 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.733 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:21.733 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:21.733 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.733 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.733 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:21.733 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.733 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:21.733 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:21.733 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.733 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.733 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:21.734 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:21.734 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.734 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:21.734 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:21.734 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:21.734 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:21.734 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:21.734 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.734 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:21.734 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.734 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:21.734 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:21.734 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:21.734 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:21.734 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:21.735 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:21.735 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:21.735 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:21.735 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.735 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.735 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:21.735 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:21.735 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:21.735 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:21.735 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.735 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:21.735 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:21.735 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:21.735 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:21.735 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.735 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.735 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:21.736 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:21.736 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:21.736 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:21.736 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.736 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.736 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:21.736 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:21.736 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:21.736 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.736 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:21.736 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.736 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:21.736 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:21.736 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.736 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:21.736 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:21.737 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:21.737 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:21.737 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:21.737 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:21.737 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.737 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:21.737 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.737 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:21.737 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.737 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.737 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:21.737 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.737 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:21.737 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.737 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:21.738 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:21.738 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:21.738 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:21.738 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:21.738 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:21.738 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.738 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:21.738 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:21.738 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:21.738 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:21.738 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:21.738 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:21.738 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.739 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:21.739 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:21.739 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:21.739 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:21.739 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:21.739 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:21.739 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:21.739 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:21.739 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:21.739 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:21.739 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:21.739 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.739 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.739 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:21.739 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.739 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:21.739 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:21.740 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:21.740 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:21.740 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:21.740 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:21.740 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:21.740 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:21.740 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:21.740 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:21.740 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:21.740 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:21.740 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:21.740 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:21.740 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:21.740 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:21.740 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:21.741 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:21.741 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:21.741 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:21.741 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:21.741 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:21.741 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:21.741 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:21.741 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:21.741 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:21.741 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:21.741 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:21.741 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.741 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.741 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.741 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.741 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:21.742 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:21.742 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.742 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:21.742 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.742 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:21.742 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:21.742 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:21.742 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.742 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:21.742 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:21.742 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.742 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.742 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:21.742 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:21.742 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.742 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.743 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:21.743 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:21.743 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:21.743 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:21.743 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:21.743 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.743 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.743 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:21.743 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:21.743 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:21.743 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.743 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:21.743 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.743 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:21.743 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.743 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:21.744 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.744 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.encryption 2023-12-03T13:00:21.744 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T13:00:21.744 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.bucket_policy 2023-12-03T13:00:21.744 INFO:teuthology.orchestra.run.smithi003.stdout: def test_bucket_policy_put_obj_kms_noenc(): 2023-12-03T13:00:21.744 INFO:teuthology.orchestra.run.smithi003.stdout: kms_keyid = get_main_kms_keyid() 2023-12-03T13:00:21.744 INFO:teuthology.orchestra.run.smithi003.stdout: if kms_keyid is None: 2023-12-03T13:00:21.744 INFO:teuthology.orchestra.run.smithi003.stdout: pytest.skip('[s3 main] section missing kms_keyid') 2023-12-03T13:00:21.744 INFO:teuthology.orchestra.run.smithi003.stdout:> bucket_name = get_new_bucket() 2023-12-03T13:00:21.744 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.744 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:11469: 2023-12-03T13:00:21.744 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.744 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:21.744 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:21.744 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:21.745 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:21.745 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:21.745 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:21.745 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:21.745 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:21.745 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:21.745 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:21.745 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:21.745 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:21.745 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:21.745 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:21.745 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:21.745 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:21.745 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:21.745 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:21.745 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:21.746 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:21.746 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:21.746 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:21.746 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:21.746 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:21.746 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:21.746 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:21.746 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:21.746 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:21.746 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:21.746 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:21.746 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:21.746 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:21.746 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:21.747 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:21.747 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:21.747 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:21.747 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.747 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.747 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.747 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:21.747 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.747 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:21.747 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.747 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:21.747 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:21.747 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:21.747 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:21.747 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:21.747 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:21.748 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.748 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:21.748 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:21.748 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:21.748 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:21.748 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:21.748 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:21.748 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.748 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:21.748 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:21.748 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:21.748 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:21.748 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:21.748 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:21.749 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:21.749 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:21.749 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:21.749 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:21.749 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:21.749 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.749 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.749 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:21.749 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:21.749 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:21.749 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:21.749 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:21.749 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.749 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.749 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:21.749 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:21.750 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:21.750 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:21.750 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:21.750 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.750 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:21.750 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:21.750 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:21.750 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:21.750 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:21.750 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-465" 2023-12-03T13:00:21.750 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.750 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:21.750 INFO:teuthology.orchestra.run.smithi003.stdout:______________________ test_bucket_policy_put_obj_kms_s3 _______________________ 2023-12-03T13:00:21.750 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.750 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.751 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.751 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:21.751 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:21.751 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.751 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:21.751 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.751 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:21.751 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:21.751 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:21.751 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.751 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:21.751 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:21.751 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.751 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.751 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:21.752 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:21.752 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.752 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.752 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:21.752 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.752 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:21.752 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:21.752 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.752 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.752 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:21.752 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:21.752 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.752 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:21.752 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:21.752 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:21.753 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:21.753 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:21.753 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.753 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:21.753 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.753 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:21.753 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:21.753 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:21.753 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:21.753 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:21.753 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:21.753 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:21.753 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:21.753 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.753 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.754 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:21.754 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:21.754 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:21.754 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:21.754 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.754 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:21.754 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:21.754 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:21.754 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:21.754 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.754 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.754 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:21.754 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:21.754 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:21.755 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:21.755 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.755 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.755 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:21.755 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:21.755 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:21.755 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.755 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:21.755 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.755 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:21.755 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:21.755 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.755 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:21.755 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:21.755 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:21.756 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:21.756 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:21.756 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:21.756 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.756 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:21.756 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.756 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:21.756 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.756 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.756 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:21.756 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.756 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:21.756 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.756 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:21.757 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:21.757 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:21.757 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:21.757 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:21.757 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:21.757 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.757 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:21.757 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:21.757 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:21.757 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:21.757 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:21.757 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:21.757 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.757 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:21.757 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:21.758 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:21.758 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:21.758 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:21.758 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:21.758 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:21.758 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:21.758 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:21.758 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:21.758 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:21.758 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.758 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.758 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:21.758 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.758 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:21.759 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:21.759 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:21.759 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:21.759 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:21.759 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:21.759 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:21.759 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:21.759 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:21.759 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:21.759 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:21.759 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:21.759 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:21.759 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:21.759 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:21.759 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:21.759 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:21.760 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:21.760 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:21.760 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:21.760 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:21.760 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:21.760 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:21.760 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:21.760 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:21.760 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:21.760 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:21.760 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:21.760 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.760 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.760 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.761 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.761 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:21.761 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:21.761 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.761 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:21.761 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.761 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:21.761 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:21.761 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:21.761 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.761 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:21.761 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:21.761 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.761 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.762 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:21.762 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:21.762 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.762 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.762 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:21.762 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:21.762 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:21.762 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:21.762 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:21.762 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.762 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.762 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:21.762 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:21.762 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:21.763 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.763 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:21.763 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.763 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:21.763 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.763 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:21.763 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.763 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.encryption 2023-12-03T13:00:21.763 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.bucket_policy 2023-12-03T13:00:21.763 INFO:teuthology.orchestra.run.smithi003.stdout: def test_bucket_policy_put_obj_kms_s3(): 2023-12-03T13:00:21.763 INFO:teuthology.orchestra.run.smithi003.stdout:> bucket_name = get_new_bucket() 2023-12-03T13:00:21.763 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.763 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:11512: 2023-12-03T13:00:21.763 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.764 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:21.764 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:21.764 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:21.764 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:21.764 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:21.764 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:21.764 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:21.764 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:21.764 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:21.764 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:21.764 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:21.764 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:21.764 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:21.764 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:21.764 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:21.765 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:21.765 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:21.765 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:21.765 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:21.765 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:21.765 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:21.765 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:21.765 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:21.765 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:21.765 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:21.765 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:21.765 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:21.765 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:21.765 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:21.765 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:21.766 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:21.766 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:21.766 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:21.766 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:21.766 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:21.766 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:21.766 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.766 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.766 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.766 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:21.766 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.766 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:21.766 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.766 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:21.766 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:21.767 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:21.767 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:21.767 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:21.767 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:21.767 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.767 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:21.767 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:21.767 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:21.767 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:21.767 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:21.767 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:21.767 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.767 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:21.767 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:21.768 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:21.768 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:21.768 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:21.768 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:21.768 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:21.768 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:21.768 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:21.768 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:21.768 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:21.768 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.768 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.768 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:21.768 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:21.768 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:21.768 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:21.769 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:21.769 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.769 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.769 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:21.769 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:21.769 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:21.769 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:21.769 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:21.769 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.769 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:21.769 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:21.769 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:21.769 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:21.769 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:21.769 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-466" 2023-12-03T13:00:21.770 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.770 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:21.770 INFO:teuthology.orchestra.run.smithi003.stdout:_________________ test_bucket_policy_get_obj_acl_existing_tag __________________ 2023-12-03T13:00:21.770 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.770 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.770 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.770 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:21.770 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:21.770 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.770 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:21.770 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.770 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:21.770 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:21.770 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:21.770 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.771 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:21.771 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:21.771 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.771 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.771 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:21.771 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:21.771 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.771 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.771 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:21.771 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.771 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:21.771 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:21.771 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.771 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.772 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:21.772 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:21.772 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.772 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:21.772 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:21.772 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:21.772 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:21.772 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:21.772 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.772 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:21.772 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.772 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:21.772 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:21.772 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:21.773 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:21.773 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:21.773 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:21.773 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:21.773 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:21.773 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.773 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.773 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:21.773 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:21.773 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:21.773 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:21.773 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.773 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:21.773 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:21.773 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:21.773 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:21.774 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.774 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.774 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:21.774 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:21.774 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:21.774 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:21.774 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.774 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.774 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:21.774 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:21.774 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:21.774 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.774 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:21.774 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.775 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:21.775 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:21.775 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.775 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:21.775 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:21.775 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:21.775 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:21.775 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:21.775 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:21.775 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.775 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:21.775 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.775 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:21.775 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.775 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.776 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:21.776 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.776 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:21.776 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.776 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:21.776 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:21.776 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:21.776 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:21.776 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:21.776 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:21.776 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.776 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:21.776 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:21.776 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:21.776 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:21.777 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:21.777 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:21.777 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.777 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:21.777 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:21.777 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:21.777 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:21.777 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:21.777 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:21.777 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:21.777 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:21.777 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:21.777 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:21.777 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:21.777 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.778 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.778 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:21.778 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.778 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:21.778 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:21.778 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:21.778 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:21.778 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:21.778 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:21.778 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:21.778 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:21.778 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:21.778 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:21.778 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:21.779 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:21.779 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:21.779 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:21.779 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:21.779 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:21.779 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:21.779 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:21.779 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:21.779 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:21.779 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:21.779 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:21.779 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:21.779 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:21.779 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:21.779 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:21.780 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:21.780 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:21.780 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.780 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.780 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.780 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.780 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:21.780 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:21.780 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.780 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:21.780 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.780 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:21.780 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:21.780 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:21.780 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.781 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:21.781 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:21.781 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.781 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.781 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:21.781 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:21.781 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.781 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.781 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:21.781 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:21.781 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:21.781 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:21.781 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:21.781 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.781 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.782 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:21.782 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:21.782 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:21.782 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.782 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:21.782 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.782 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:21.782 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.782 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:21.782 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.782 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.tagging 2023-12-03T13:00:21.782 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.bucket_policy 2023-12-03T13:00:21.782 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T13:00:21.782 INFO:teuthology.orchestra.run.smithi003.stdout: def test_bucket_policy_get_obj_acl_existing_tag(): 2023-12-03T13:00:21.783 INFO:teuthology.orchestra.run.smithi003.stdout:> bucket_name = _create_objects(keys=['publictag', 'privatetag', 'invalidtag']) 2023-12-03T13:00:21.783 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.783 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:11584: 2023-12-03T13:00:21.783 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.783 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:116: in _create_objects 2023-12-03T13:00:21.783 INFO:teuthology.orchestra.run.smithi003.stdout: bucket = get_new_bucket_resource(name=bucket_name) 2023-12-03T13:00:21.783 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:581: in get_new_bucket_resource 2023-12-03T13:00:21.783 INFO:teuthology.orchestra.run.smithi003.stdout: bucket_location = bucket.create() 2023-12-03T13:00:21.783 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/boto3/resources/factory.py:580: in do_action 2023-12-03T13:00:21.783 INFO:teuthology.orchestra.run.smithi003.stdout: response = action(self, *args, **kwargs) 2023-12-03T13:00:21.783 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/boto3/resources/action.py:88: in __call__ 2023-12-03T13:00:21.783 INFO:teuthology.orchestra.run.smithi003.stdout: response = getattr(parent.meta.client, operation_name)(*args, **params) 2023-12-03T13:00:21.783 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:21.783 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:21.784 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:21.784 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:21.784 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:21.784 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:21.784 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:21.784 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:21.784 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:21.784 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:21.784 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:21.784 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:21.784 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:21.784 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:21.784 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:21.785 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:21.785 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:21.785 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:21.785 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:21.785 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:21.785 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:21.785 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:21.785 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:21.785 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:21.785 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:21.785 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:21.785 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:21.785 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:21.785 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:21.786 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:21.786 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:21.786 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:21.786 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:21.786 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:21.786 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.786 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.786 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.786 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:21.786 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.786 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:21.786 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.786 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:21.786 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:21.787 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:21.787 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:21.787 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:21.787 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:21.787 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.787 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:21.787 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:21.787 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:21.787 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:21.787 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:21.787 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:21.787 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.787 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:21.787 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:21.787 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:21.788 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:21.788 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:21.788 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:21.788 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:21.788 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:21.788 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:21.788 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:21.788 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:21.788 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.788 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.788 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:21.788 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:21.788 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:21.788 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:21.788 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:21.789 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.789 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.789 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:21.789 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:21.789 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:21.789 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:21.789 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:21.789 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.789 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:21.789 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:21.789 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:21.789 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:21.789 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:21.789 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-467" 2023-12-03T13:00:21.789 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.790 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:21.790 INFO:teuthology.orchestra.run.smithi003.stdout:________________________ test_object_lock_put_obj_lock _________________________ 2023-12-03T13:00:21.790 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.790 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.790 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.790 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:21.790 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:21.790 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.790 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:21.790 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.790 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:21.790 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:21.790 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:21.791 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.791 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:21.791 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:21.791 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.791 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.791 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:21.791 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:21.791 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.791 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.791 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:21.791 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.791 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:21.791 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:21.791 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.791 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.793 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:21.793 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:21.793 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.793 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:21.793 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:21.793 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:21.793 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:21.793 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:21.793 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.793 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:21.794 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.794 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:21.794 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:21.794 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:21.794 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:21.794 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:21.794 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:21.794 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:21.794 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:21.794 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.794 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.794 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:21.794 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:21.794 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:21.794 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:21.795 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.795 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:21.795 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:21.795 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:21.795 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:21.795 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.795 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.795 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:21.795 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:21.795 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:21.795 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:21.795 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.795 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.795 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:21.795 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:21.796 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:21.796 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.796 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:21.796 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.796 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:21.796 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:21.796 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.796 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:21.796 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:21.796 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:21.796 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:21.796 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:21.796 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:21.796 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.796 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:21.797 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.797 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:21.797 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.797 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.797 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:21.797 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.797 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:21.797 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.797 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:21.797 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:21.797 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:21.797 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:21.797 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:21.797 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:21.798 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.798 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:21.798 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:21.798 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:21.798 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:21.798 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:21.798 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:21.798 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.798 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:21.798 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:21.798 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:21.798 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:21.798 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:21.798 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:21.799 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:21.799 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:21.799 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:21.799 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:21.799 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:21.799 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.799 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.799 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:21.799 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.799 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:21.799 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:21.799 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:21.799 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:21.799 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:21.799 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:21.800 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:21.800 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:21.800 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:21.800 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:21.800 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:21.800 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:21.800 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:21.800 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:21.800 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:21.800 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:21.800 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:21.800 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:21.800 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:21.801 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:21.801 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:21.801 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:21.801 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:21.801 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:21.801 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:21.801 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:21.801 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:21.801 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:21.801 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.801 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.801 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.801 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.801 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:21.801 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:21.801 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.802 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:21.802 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.802 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:21.802 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:21.802 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:21.802 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.802 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:21.802 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:21.802 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.802 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.802 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:21.802 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:21.802 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.802 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.803 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:21.803 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:21.803 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:21.803 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:21.803 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:21.803 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.803 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.803 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:21.803 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:21.803 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:21.803 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.803 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:21.803 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.803 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:21.803 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.804 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:21.804 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.804 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T13:00:21.804 INFO:teuthology.orchestra.run.smithi003.stdout: def test_object_lock_put_obj_lock(): 2023-12-03T13:00:21.804 INFO:teuthology.orchestra.run.smithi003.stdout: bucket_name = get_new_bucket_name() 2023-12-03T13:00:21.804 INFO:teuthology.orchestra.run.smithi003.stdout: client = get_client() 2023-12-03T13:00:21.804 INFO:teuthology.orchestra.run.smithi003.stdout:> client.create_bucket(Bucket=bucket_name, ObjectLockEnabledForBucket=True) 2023-12-03T13:00:21.804 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.804 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:11645: 2023-12-03T13:00:21.804 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.804 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:21.804 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:21.804 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:21.804 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:21.805 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:21.805 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:21.805 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:21.805 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:21.805 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:21.805 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:21.805 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:21.805 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:21.805 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:21.805 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:21.805 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:21.805 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:21.805 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:21.805 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:21.805 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:21.806 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:21.806 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:21.806 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:21.806 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:21.806 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:21.806 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:21.806 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:21.806 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:21.806 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:21.806 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:21.806 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:21.806 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:21.806 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:21.807 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:21.807 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:21.807 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.807 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.807 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.807 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:21.807 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.807 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:21.807 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.807 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:21.807 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:21.807 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:21.807 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:21.807 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:21.807 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:21.808 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.808 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:21.808 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:21.808 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:21.808 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:21.808 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:21.808 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:21.808 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.808 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:21.808 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:21.808 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:21.808 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:21.808 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:21.809 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:21.809 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:21.809 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:21.809 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:21.809 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:21.809 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:21.809 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.809 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.809 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:21.809 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:21.809 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:21.809 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:21.809 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:21.809 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.809 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.810 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:21.810 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:21.810 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:21.810 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:21.810 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:21.810 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.810 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:21.810 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:21.810 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:21.810 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:21.810 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:21.810 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-468" 2023-12-03T13:00:21.810 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.810 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:21.811 INFO:teuthology.orchestra.run.smithi003.stdout:_________________ test_object_lock_put_obj_lock_invalid_bucket _________________ 2023-12-03T13:00:21.811 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.811 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.811 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.811 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:21.811 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:21.811 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.811 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:21.811 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.811 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:21.811 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:21.811 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:21.811 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.811 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:21.812 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:21.812 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.812 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.812 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:21.812 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:21.812 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.812 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.812 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:21.812 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.812 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:21.812 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:21.812 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.812 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.812 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:21.812 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:21.813 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.813 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:21.813 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:21.813 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:21.813 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:21.813 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:21.813 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.813 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:21.813 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.813 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:21.813 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:21.813 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:21.813 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:21.813 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:21.814 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:21.814 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:21.814 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:21.814 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.814 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.814 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:21.814 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:21.814 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:21.814 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:21.814 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.814 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:21.814 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:21.814 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:21.814 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:21.815 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.815 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.815 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:21.815 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:21.815 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:21.815 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:21.815 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.815 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.815 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:21.815 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:21.815 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:21.815 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.815 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:21.815 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.816 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:21.816 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:21.816 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.816 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:21.816 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:21.816 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:21.816 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:21.816 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:21.816 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:21.816 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.816 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:21.816 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.816 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:21.816 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.816 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.817 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:21.817 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.817 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:21.817 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.817 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:21.817 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:21.817 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:21.817 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:21.817 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:21.817 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:21.817 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.817 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:21.817 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:21.817 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:21.817 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:21.818 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:21.818 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:21.818 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.818 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:21.818 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:21.818 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:21.818 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:21.818 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:21.818 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:21.818 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:21.818 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:21.818 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:21.818 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:21.818 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:21.819 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.819 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.819 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:21.819 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.819 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:21.819 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:21.819 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:21.819 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:21.819 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:21.819 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:21.819 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:21.819 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:21.819 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:21.819 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:21.820 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:21.820 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:21.820 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:21.820 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:21.820 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:21.820 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:21.820 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:21.820 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:21.820 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:21.820 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:21.820 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:21.820 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:21.820 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:21.820 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:21.820 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:21.821 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:21.821 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:21.821 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:21.821 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.821 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.821 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.821 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.821 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:21.821 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:21.821 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.821 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:21.821 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.821 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:21.822 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:21.822 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:21.822 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.822 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:21.822 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:21.822 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.822 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.822 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:21.822 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:21.822 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.822 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.822 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:21.822 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:21.822 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:21.823 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:21.823 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:21.823 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.823 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.823 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:21.823 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:21.823 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:21.823 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.823 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:21.823 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.823 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:21.823 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.823 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:21.823 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.824 INFO:teuthology.orchestra.run.smithi003.stdout: def test_object_lock_put_obj_lock_invalid_bucket(): 2023-12-03T13:00:21.824 INFO:teuthology.orchestra.run.smithi003.stdout: bucket_name = get_new_bucket_name() 2023-12-03T13:00:21.824 INFO:teuthology.orchestra.run.smithi003.stdout: client = get_client() 2023-12-03T13:00:21.824 INFO:teuthology.orchestra.run.smithi003.stdout:> client.create_bucket(Bucket=bucket_name) 2023-12-03T13:00:21.824 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.824 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:11677: 2023-12-03T13:00:21.824 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.824 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:21.824 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:21.824 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:21.824 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:21.824 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:21.824 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:21.824 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:21.824 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:21.825 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:21.825 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:21.825 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:21.825 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:21.825 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:21.825 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:21.825 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:21.825 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:21.825 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:21.825 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:21.825 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:21.825 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:21.825 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:21.825 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:21.826 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:21.826 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:21.826 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:21.826 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:21.826 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:21.826 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:21.826 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:21.826 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:21.826 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:21.826 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:21.826 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:21.826 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:21.826 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.826 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.827 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.827 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:21.827 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.827 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:21.827 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.827 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:21.827 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:21.827 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:21.827 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:21.827 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:21.827 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:21.827 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.827 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:21.827 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:21.828 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:21.828 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:21.828 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:21.828 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:21.828 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.828 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:21.828 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:21.828 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:21.828 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:21.828 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:21.828 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:21.828 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:21.828 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:21.828 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:21.828 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:21.829 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:21.829 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.829 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.829 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:21.829 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:21.829 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:21.829 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:21.829 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:21.829 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.829 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.829 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:21.829 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:21.829 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:21.829 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:21.830 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:21.830 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.830 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:21.830 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:21.830 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:21.830 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:21.830 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:21.830 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-469" 2023-12-03T13:00:21.830 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.830 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:21.830 INFO:teuthology.orchestra.run.smithi003.stdout:______________ test_object_lock_put_obj_lock_with_days_and_years _______________ 2023-12-03T13:00:21.830 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.830 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.830 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.830 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:21.831 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:21.831 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.831 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:21.831 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.831 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:21.831 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:21.831 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:21.831 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.831 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:21.831 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:21.831 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.831 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.831 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:21.831 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:21.832 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.832 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.832 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:21.832 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.832 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:21.832 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:21.832 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.832 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.832 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:21.832 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:21.832 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.832 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:21.832 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:21.832 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:21.833 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:21.833 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:21.833 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.833 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:21.833 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.833 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:21.833 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:21.833 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:21.833 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:21.833 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:21.833 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:21.833 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:21.833 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:21.834 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.834 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.834 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:21.834 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:21.834 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:21.834 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:21.834 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.834 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:21.834 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:21.834 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:21.834 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:21.834 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.834 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.834 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:21.835 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:21.835 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:21.835 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:21.835 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.835 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.835 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:21.835 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:21.835 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:21.835 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.835 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:21.835 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.835 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:21.835 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:21.835 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.835 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:21.836 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:21.836 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:21.836 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:21.836 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:21.836 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:21.836 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.836 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:21.836 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.836 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:21.836 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.836 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.836 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:21.836 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.837 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:21.837 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.837 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:21.837 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:21.837 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:21.837 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:21.837 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:21.837 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:21.837 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.837 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:21.837 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:21.837 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:21.837 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:21.837 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:21.837 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:21.838 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.838 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:21.838 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:21.838 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:21.838 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:21.838 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:21.838 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:21.838 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:21.838 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:21.838 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:21.838 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:21.838 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:21.838 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.838 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.839 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:21.839 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.839 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:21.839 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:21.839 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:21.839 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:21.839 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:21.839 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:21.839 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:21.839 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:21.839 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:21.839 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:21.839 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:21.839 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:21.840 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:21.840 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:21.840 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:21.840 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:21.840 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:21.840 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:21.840 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:21.840 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:21.840 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:21.840 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:21.840 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:21.840 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:21.840 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:21.840 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:21.840 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:21.841 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:21.841 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.841 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.841 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.841 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.841 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:21.841 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:21.841 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.841 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:21.841 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.841 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:21.841 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:21.841 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:21.841 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.842 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:21.842 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:21.842 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.842 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.842 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:21.842 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:21.842 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.842 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.842 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:21.842 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:21.842 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:21.842 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:21.842 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:21.842 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.842 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.843 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:21.843 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:21.843 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:21.843 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.843 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:21.843 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.843 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:21.843 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.843 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:21.843 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.843 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T13:00:21.843 INFO:teuthology.orchestra.run.smithi003.stdout: def test_object_lock_put_obj_lock_with_days_and_years(): 2023-12-03T13:00:21.843 INFO:teuthology.orchestra.run.smithi003.stdout: bucket_name = get_new_bucket_name() 2023-12-03T13:00:21.843 INFO:teuthology.orchestra.run.smithi003.stdout: client = get_client() 2023-12-03T13:00:21.844 INFO:teuthology.orchestra.run.smithi003.stdout:> client.create_bucket(Bucket=bucket_name, ObjectLockEnabledForBucket=True) 2023-12-03T13:00:21.844 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.844 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:11695: 2023-12-03T13:00:21.844 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.844 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:21.844 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:21.844 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:21.844 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:21.844 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:21.844 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:21.844 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:21.844 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:21.844 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:21.844 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:21.845 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:21.845 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:21.845 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:21.845 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:21.845 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:21.845 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:21.845 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:21.845 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:21.845 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:21.845 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:21.845 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:21.845 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:21.845 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:21.846 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:21.846 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:21.846 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:21.846 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:21.846 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:21.846 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:21.846 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:21.846 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:21.846 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:21.846 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:21.846 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:21.846 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.846 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.846 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.847 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:21.847 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.847 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:21.847 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.847 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:21.847 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:21.847 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:21.847 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:21.847 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:21.847 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:21.847 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.847 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:21.847 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:21.847 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:21.848 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:21.848 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:21.848 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:21.848 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.848 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:21.848 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:21.848 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:21.848 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:21.848 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:21.848 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:21.848 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:21.848 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:21.848 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:21.848 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:21.848 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:21.849 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.849 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.849 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:21.849 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:21.849 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:21.849 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:21.849 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:21.849 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.849 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.849 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:21.849 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:21.849 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:21.849 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:21.849 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:21.850 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.850 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:21.850 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:21.850 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:21.850 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:21.850 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:21.850 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-470" 2023-12-03T13:00:21.850 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.850 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:21.850 INFO:teuthology.orchestra.run.smithi003.stdout:__________________ test_object_lock_put_obj_lock_invalid_days __________________ 2023-12-03T13:00:21.850 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.850 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.850 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.850 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:21.851 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:21.851 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.851 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:21.851 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.851 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:21.851 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:21.851 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:21.851 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.851 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:21.851 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:21.851 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.851 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.851 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:21.851 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:21.852 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.852 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.852 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:21.852 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.852 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:21.852 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:21.852 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.852 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.852 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:21.852 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:21.852 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.852 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:21.852 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:21.852 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:21.853 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:21.853 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:21.853 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.853 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:21.853 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.853 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:21.853 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:21.853 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:21.853 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:21.853 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:21.853 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:21.853 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:21.853 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:21.853 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.853 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.854 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:21.854 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:21.854 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:21.854 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:21.854 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.854 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:21.854 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:21.854 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:21.854 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:21.854 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.854 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.854 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:21.854 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:21.854 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:21.854 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:21.855 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.855 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.855 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:21.855 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:21.855 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:21.855 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.855 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:21.855 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.855 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:21.855 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:21.855 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.855 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:21.855 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:21.855 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:21.855 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:21.856 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:21.856 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:21.856 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.856 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:21.856 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.856 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:21.856 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.856 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.856 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:21.856 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.856 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:21.856 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.856 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:21.856 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:21.857 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:21.857 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:21.857 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:21.857 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:21.857 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.857 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:21.857 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:21.857 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:21.857 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:21.857 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:21.857 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:21.857 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.857 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:21.857 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:21.858 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:21.858 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:21.858 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:21.858 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:21.858 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:21.858 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:21.858 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:21.858 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:21.858 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:21.858 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.858 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.858 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:21.858 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.859 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:21.859 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:21.859 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:21.859 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:21.859 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:21.859 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:21.859 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:21.859 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:21.859 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:21.859 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:21.859 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:21.859 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:21.859 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:21.859 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:21.860 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:21.860 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:21.860 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:21.860 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:21.860 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:21.860 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:21.860 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:21.860 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:21.860 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:21.860 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:21.860 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:21.860 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:21.860 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:21.860 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:21.861 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.861 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.861 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.861 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.861 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:21.861 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:21.861 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.861 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:21.861 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.861 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:21.861 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:21.861 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:21.861 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.861 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:21.862 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:21.862 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.862 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.862 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:21.862 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:21.862 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.862 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.862 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:21.862 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:21.862 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:21.862 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:21.862 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:21.862 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.862 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.862 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:21.863 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:21.863 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:21.863 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.863 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:21.863 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.863 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:21.863 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.863 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:21.863 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.863 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T13:00:21.863 INFO:teuthology.orchestra.run.smithi003.stdout: def test_object_lock_put_obj_lock_invalid_days(): 2023-12-03T13:00:21.863 INFO:teuthology.orchestra.run.smithi003.stdout: bucket_name = get_new_bucket_name() 2023-12-03T13:00:21.863 INFO:teuthology.orchestra.run.smithi003.stdout: client = get_client() 2023-12-03T13:00:21.863 INFO:teuthology.orchestra.run.smithi003.stdout:> client.create_bucket(Bucket=bucket_name, ObjectLockEnabledForBucket=True) 2023-12-03T13:00:21.864 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.864 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:11714: 2023-12-03T13:00:21.864 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.864 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:21.864 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:21.864 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:21.864 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:21.864 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:21.864 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:21.864 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:21.864 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:21.864 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:21.864 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:21.864 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:21.865 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:21.865 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:21.865 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:21.865 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:21.865 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:21.865 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:21.865 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:21.865 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:21.865 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:21.865 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:21.865 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:21.865 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:21.865 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:21.865 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:21.865 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:21.866 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:21.866 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:21.866 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:21.866 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:21.866 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:21.866 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:21.866 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:21.866 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:21.866 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.866 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.866 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.866 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:21.866 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.866 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:21.867 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.867 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:21.867 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:21.867 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:21.867 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:21.867 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:21.867 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:21.867 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.867 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:21.867 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:21.867 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:21.867 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:21.867 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:21.867 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:21.867 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.868 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:21.868 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:21.868 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:21.868 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:21.868 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:21.868 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:21.868 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:21.868 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:21.868 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:21.868 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:21.868 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:21.868 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.868 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.868 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:21.869 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:21.869 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:21.869 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:21.869 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:21.869 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.869 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.869 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:21.869 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:21.869 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:21.869 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:21.869 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:21.869 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.869 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:21.870 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:21.870 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:21.870 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:21.870 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:21.870 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-471" 2023-12-03T13:00:21.870 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.870 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:21.870 INFO:teuthology.orchestra.run.smithi003.stdout:_________________ test_object_lock_put_obj_lock_invalid_years __________________ 2023-12-03T13:00:21.870 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.870 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.870 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.870 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:21.870 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:21.871 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.871 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:21.871 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.871 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:21.871 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:21.871 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:21.871 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.871 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:21.871 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:21.871 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.871 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.871 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:21.871 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:21.871 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.872 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.872 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:21.872 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.872 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:21.872 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:21.872 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.872 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.872 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:21.872 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:21.872 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.872 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:21.872 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:21.872 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:21.872 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:21.873 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:21.873 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.873 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:21.873 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.873 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:21.873 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:21.873 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:21.873 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:21.873 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:21.873 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:21.873 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:21.873 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:21.873 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.873 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.873 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:21.874 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:21.874 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:21.874 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:21.874 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.874 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:21.874 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:21.874 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:21.874 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:21.874 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.874 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.874 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:21.874 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:21.874 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:21.874 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:21.875 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.875 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.875 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:21.875 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:21.875 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:21.875 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.875 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:21.875 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.875 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:21.875 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:21.875 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.875 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:21.875 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:21.875 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:21.876 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:21.876 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:21.876 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:21.876 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.876 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:21.876 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.876 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:21.876 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.876 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.876 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:21.876 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.876 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:21.876 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.876 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:21.877 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:21.877 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:21.877 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:21.877 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:21.877 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:21.877 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.877 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:21.877 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:21.877 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:21.877 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:21.877 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:21.877 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:21.877 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.877 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:21.878 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:21.878 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:21.878 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:21.878 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:21.878 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:21.878 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:21.878 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:21.878 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:21.878 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:21.878 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:21.878 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.878 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.878 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:21.878 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.879 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:21.879 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:21.879 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:21.879 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:21.879 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:21.879 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:21.879 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:21.879 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:21.879 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:21.879 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:21.879 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:21.879 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:21.879 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:21.879 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:21.879 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:21.880 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:21.880 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:21.880 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:21.880 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:21.880 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:21.880 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:21.880 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:21.880 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:21.880 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:21.880 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:21.880 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:21.880 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:21.880 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:21.880 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.880 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.881 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.881 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.881 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:21.881 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:21.881 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.881 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:21.881 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.881 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:21.881 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:21.881 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:21.881 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.881 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:21.881 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:21.881 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.882 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.882 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:21.882 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:21.882 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.882 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.882 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:21.882 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:21.882 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:21.882 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:21.882 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:21.882 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.882 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.882 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:21.883 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:21.883 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:21.883 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.883 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:21.883 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.883 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:21.883 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.883 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:21.883 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.883 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T13:00:21.883 INFO:teuthology.orchestra.run.smithi003.stdout: def test_object_lock_put_obj_lock_invalid_years(): 2023-12-03T13:00:21.883 INFO:teuthology.orchestra.run.smithi003.stdout: bucket_name = get_new_bucket_name() 2023-12-03T13:00:21.883 INFO:teuthology.orchestra.run.smithi003.stdout: client = get_client() 2023-12-03T13:00:21.883 INFO:teuthology.orchestra.run.smithi003.stdout:> client.create_bucket(Bucket=bucket_name, ObjectLockEnabledForBucket=True) 2023-12-03T13:00:21.884 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.884 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:11732: 2023-12-03T13:00:21.884 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.884 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:21.884 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:21.884 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:21.884 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:21.884 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:21.884 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:21.884 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:21.884 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:21.884 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:21.884 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:21.884 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:21.885 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:21.885 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:21.885 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:21.885 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:21.885 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:21.885 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:21.885 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:21.885 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:21.885 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:21.885 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:21.885 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:21.885 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:21.885 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:21.885 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:21.886 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:21.886 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:21.886 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:21.886 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:21.886 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:21.886 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:21.886 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:21.886 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:21.886 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:21.886 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.886 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.886 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.886 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:21.886 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.887 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:21.887 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.887 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:21.887 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:21.887 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:21.887 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:21.887 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:21.887 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:21.887 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.887 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:21.887 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:21.887 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:21.887 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:21.887 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:21.887 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:21.888 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.888 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:21.888 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:21.888 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:21.888 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:21.888 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:21.888 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:21.888 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:21.888 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:21.888 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:21.888 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:21.888 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:21.888 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.888 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.889 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:21.889 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:21.889 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:21.889 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:21.889 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:21.889 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.889 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.889 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:21.889 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:21.889 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:21.889 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:21.889 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:21.889 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.889 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:21.890 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:21.890 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:21.890 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:21.890 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:21.890 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-472" 2023-12-03T13:00:21.890 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.890 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:21.890 INFO:teuthology.orchestra.run.smithi003.stdout:__________________ test_object_lock_put_obj_lock_invalid_mode __________________ 2023-12-03T13:00:21.890 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.890 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.890 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.890 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:21.890 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:21.890 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.891 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:21.891 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.891 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:21.891 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:21.891 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:21.891 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.891 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:21.891 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:21.891 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.891 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.891 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:21.891 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:21.891 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.891 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.891 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:21.892 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.892 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:21.892 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:21.892 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.892 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.892 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:21.892 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:21.892 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.892 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:21.892 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:21.892 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:21.892 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:21.892 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:21.892 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.892 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:21.893 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.893 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:21.893 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:21.893 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:21.893 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:21.893 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:21.893 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:21.893 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:21.893 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:21.893 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.893 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.893 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:21.893 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:21.893 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:21.893 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:21.894 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.894 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:21.894 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:21.894 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:21.894 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:21.894 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.894 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.894 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:21.894 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:21.894 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:21.894 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:21.894 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.894 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.895 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:21.895 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:21.895 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:21.895 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.895 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:21.895 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.895 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:21.895 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:21.895 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.895 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:21.895 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:21.895 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:21.895 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:21.895 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:21.896 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:21.896 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.896 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:21.896 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.896 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:21.896 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.896 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.896 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:21.896 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.896 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:21.896 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.896 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:21.896 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:21.896 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:21.897 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:21.897 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:21.897 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:21.897 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.897 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:21.897 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:21.897 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:21.897 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:21.897 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:21.897 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:21.897 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.897 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:21.897 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:21.897 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:21.897 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:21.898 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:21.898 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:21.898 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:21.898 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:21.898 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:21.898 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:21.898 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:21.898 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.898 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.898 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:21.898 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.898 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:21.898 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:21.898 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:21.899 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:21.899 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:21.899 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:21.899 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:21.899 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:21.899 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:21.899 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:21.899 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:21.899 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:21.899 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:21.899 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:21.899 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:21.899 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:21.899 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:21.900 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:21.900 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:21.900 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:21.900 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:21.900 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:21.900 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:21.900 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:21.900 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:21.900 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:21.900 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:21.900 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:21.900 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.900 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.900 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.900 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.901 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:21.901 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:21.901 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.901 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:21.901 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.901 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:21.901 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:21.901 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:21.901 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.901 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:21.901 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:21.901 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.901 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.902 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:21.902 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:21.902 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.902 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.902 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:21.902 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:21.902 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:21.902 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:21.902 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:21.902 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.902 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.902 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:21.902 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:21.902 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:21.903 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.903 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:21.903 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.903 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:21.903 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.903 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:21.903 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.903 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T13:00:21.903 INFO:teuthology.orchestra.run.smithi003.stdout: def test_object_lock_put_obj_lock_invalid_mode(): 2023-12-03T13:00:21.903 INFO:teuthology.orchestra.run.smithi003.stdout: bucket_name = get_new_bucket_name() 2023-12-03T13:00:21.903 INFO:teuthology.orchestra.run.smithi003.stdout: client = get_client() 2023-12-03T13:00:21.903 INFO:teuthology.orchestra.run.smithi003.stdout:> client.create_bucket(Bucket=bucket_name, ObjectLockEnabledForBucket=True) 2023-12-03T13:00:21.903 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.903 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:11750: 2023-12-03T13:00:21.903 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.904 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:21.904 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:21.904 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:21.904 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:21.904 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:21.904 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:21.904 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:21.904 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:21.904 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:21.904 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:21.904 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:21.904 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:21.904 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:21.904 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:21.905 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:21.905 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:21.905 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:21.905 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:21.905 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:21.905 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:21.905 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:21.905 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:21.905 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:21.905 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:21.905 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:21.905 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:21.905 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:21.905 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:21.906 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:21.906 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:21.906 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:21.906 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:21.906 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:21.906 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:21.906 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.906 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.906 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.906 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:21.906 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.906 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:21.906 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.907 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:21.907 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:21.907 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:21.907 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:21.907 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:21.907 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:21.907 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.907 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:21.907 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:21.907 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:21.907 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:21.907 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:21.907 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:21.907 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.908 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:21.908 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:21.908 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:21.908 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:21.908 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:21.908 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:21.908 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:21.908 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:21.908 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:21.908 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:21.908 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:21.908 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.908 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.908 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:21.909 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:21.909 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:21.909 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:21.909 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:21.909 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.909 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.909 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:21.909 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:21.909 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:21.909 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:21.909 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:21.909 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.909 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:21.909 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:21.909 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:21.910 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:21.910 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:21.910 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-473" 2023-12-03T13:00:21.910 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.910 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:21.910 INFO:teuthology.orchestra.run.smithi003.stdout:_________________ test_object_lock_put_obj_lock_invalid_status _________________ 2023-12-03T13:00:21.910 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.910 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.910 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.910 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:21.910 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:21.910 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.910 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:21.910 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.911 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:21.911 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:21.911 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:21.911 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.911 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:21.911 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:21.911 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.911 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.911 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:21.911 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:21.911 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.911 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.911 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:21.911 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.911 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:21.912 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:21.912 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.912 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.912 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:21.912 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:21.912 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.912 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:21.912 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:21.912 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:21.912 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:21.912 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:21.912 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.912 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:21.912 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.913 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:21.913 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:21.913 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:21.913 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:21.913 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:21.913 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:21.913 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:21.913 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:21.913 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.913 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.913 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:21.913 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:21.913 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:21.913 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:21.913 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.914 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:21.914 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:21.914 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:21.914 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:21.914 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.914 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.914 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:21.914 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:21.914 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:21.914 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:21.914 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.914 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.914 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:21.914 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:21.915 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:21.915 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.915 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:21.915 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.915 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:21.915 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:21.915 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.915 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:21.915 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:21.915 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:21.915 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:21.915 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:21.915 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:21.915 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.916 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:21.916 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.916 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:21.916 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.916 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.916 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:21.916 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.916 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:21.916 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.916 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:21.916 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:21.916 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:21.916 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:21.916 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:21.916 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:21.917 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.917 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:21.917 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:21.917 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:21.917 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:21.917 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:21.917 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:21.917 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.917 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:21.917 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:21.917 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:21.917 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:21.917 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:21.917 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:21.917 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:21.918 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:21.918 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:21.918 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:21.918 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:21.918 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.918 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.918 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:21.918 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.918 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:21.918 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:21.918 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:21.918 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:21.918 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:21.919 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:21.919 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:21.919 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:21.919 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:21.919 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:21.919 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:21.919 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:21.919 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:21.919 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:21.919 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:21.919 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:21.919 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:21.919 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:21.919 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:21.919 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:21.920 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:21.920 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:21.920 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:21.920 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:21.920 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:21.920 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:21.920 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:21.920 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:21.920 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.920 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.920 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.920 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.920 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:21.920 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:21.921 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.921 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:21.921 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.921 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:21.921 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:21.921 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:21.921 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.921 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:21.921 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:21.921 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.921 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.921 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:21.921 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:21.921 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.922 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.922 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:21.922 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:21.922 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:21.922 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:21.922 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:21.922 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.922 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.922 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:21.922 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:21.922 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:21.922 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.922 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:21.922 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.923 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:21.923 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.923 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:21.923 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.923 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T13:00:21.923 INFO:teuthology.orchestra.run.smithi003.stdout: def test_object_lock_put_obj_lock_invalid_status(): 2023-12-03T13:00:21.923 INFO:teuthology.orchestra.run.smithi003.stdout: bucket_name = get_new_bucket_name() 2023-12-03T13:00:21.923 INFO:teuthology.orchestra.run.smithi003.stdout: client = get_client() 2023-12-03T13:00:21.923 INFO:teuthology.orchestra.run.smithi003.stdout:> client.create_bucket(Bucket=bucket_name, ObjectLockEnabledForBucket=True) 2023-12-03T13:00:21.923 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.923 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:11780: 2023-12-03T13:00:21.923 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.923 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:21.923 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:21.924 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:21.924 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:21.924 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:21.924 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:21.924 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:21.924 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:21.924 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:21.924 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:21.924 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:21.924 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:21.924 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:21.924 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:21.924 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:21.924 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:21.924 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:21.925 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:21.925 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:21.925 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:21.925 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:21.925 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:21.925 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:21.925 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:21.925 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:21.925 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:21.925 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:21.925 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:21.925 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:21.925 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:21.925 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:21.926 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:21.926 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:21.926 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:21.926 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.926 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.926 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.926 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:21.926 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.926 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:21.926 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.926 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:21.926 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:21.926 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:21.926 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:21.927 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:21.927 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:21.927 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.927 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:21.927 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:21.927 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:21.927 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:21.927 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:21.927 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:21.927 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.927 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:21.927 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:21.927 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:21.927 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:21.928 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:21.928 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:21.928 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:21.928 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:21.928 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:21.928 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:21.928 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:21.928 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.928 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.928 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:21.928 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:21.928 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:21.928 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:21.928 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:21.928 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.929 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.929 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:21.929 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:21.929 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:21.929 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:21.929 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:21.929 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.929 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:21.929 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:21.929 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:21.929 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:21.929 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:21.929 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-474" 2023-12-03T13:00:21.930 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.930 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:21.930 INFO:teuthology.orchestra.run.smithi003.stdout:_____________________ test_object_lock_suspend_versioning ______________________ 2023-12-03T13:00:21.930 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.930 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.930 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.930 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:21.930 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:21.930 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.930 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:21.930 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.930 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:21.930 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:21.930 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:21.931 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.931 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:21.931 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:21.931 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.931 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.931 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:21.931 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:21.931 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.931 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.931 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:21.931 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.931 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:21.931 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:21.931 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.932 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.932 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:21.932 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:21.932 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.932 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:21.932 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:21.932 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:21.932 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:21.932 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:21.932 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.932 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:21.932 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.932 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:21.932 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:21.933 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:21.933 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:21.933 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:21.933 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:21.933 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:21.933 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:21.933 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.933 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.933 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:21.933 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:21.933 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:21.933 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:21.933 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.933 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:21.933 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:21.934 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:21.934 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:21.934 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.934 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.934 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:21.934 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:21.934 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:21.934 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:21.934 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.934 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.934 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:21.934 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:21.934 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:21.934 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.934 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:21.935 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.935 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:21.935 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:21.935 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.935 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:21.935 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:21.935 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:21.935 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:21.935 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:21.935 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:21.935 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.935 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:21.935 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.935 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:21.936 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.936 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.936 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:21.936 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.936 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:21.936 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.936 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:21.936 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:21.936 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:21.936 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:21.936 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:21.936 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:21.936 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.936 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:21.937 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:21.937 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:21.937 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:21.937 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:21.937 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:21.937 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.937 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:21.937 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:21.937 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:21.937 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:21.937 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:21.937 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:21.937 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:21.937 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:21.938 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:21.938 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:21.938 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:21.938 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.938 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.938 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:21.938 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.938 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:21.938 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:21.938 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:21.938 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:21.938 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:21.938 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:21.938 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:21.938 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:21.939 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:21.939 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:21.939 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:21.939 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:21.939 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:21.939 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:21.939 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:21.939 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:21.939 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:21.939 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:21.939 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:21.939 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:21.939 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:21.939 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:21.939 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:21.940 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:21.940 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:21.940 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:21.940 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:21.940 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:21.940 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.940 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.940 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.940 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.940 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:21.940 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:21.940 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.940 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:21.940 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.941 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:21.941 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:21.941 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:21.941 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.941 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:21.941 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:21.941 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.941 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.941 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:21.941 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:21.941 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.941 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.941 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:21.941 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:21.941 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:21.942 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:21.942 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:21.942 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.942 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.942 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:21.942 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:21.942 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:21.942 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.942 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:21.942 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.942 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:21.942 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.942 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:21.943 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.943 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T13:00:21.943 INFO:teuthology.orchestra.run.smithi003.stdout: def test_object_lock_suspend_versioning(): 2023-12-03T13:00:21.943 INFO:teuthology.orchestra.run.smithi003.stdout: bucket_name = get_new_bucket_name() 2023-12-03T13:00:21.943 INFO:teuthology.orchestra.run.smithi003.stdout: client = get_client() 2023-12-03T13:00:21.943 INFO:teuthology.orchestra.run.smithi003.stdout:> client.create_bucket(Bucket=bucket_name, ObjectLockEnabledForBucket=True) 2023-12-03T13:00:21.943 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.943 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:11798: 2023-12-03T13:00:21.943 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.943 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:21.943 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:21.943 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:21.943 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:21.943 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:21.944 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:21.944 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:21.944 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:21.944 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:21.944 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:21.944 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:21.944 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:21.944 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:21.944 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:21.944 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:21.944 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:21.944 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:21.944 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:21.944 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:21.945 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:21.945 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:21.945 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:21.945 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:21.945 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:21.945 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:21.945 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:21.945 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:21.945 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:21.945 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:21.945 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:21.945 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:21.945 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:21.945 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:21.945 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:21.946 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.946 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.946 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.946 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:21.946 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.946 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:21.946 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.946 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:21.946 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:21.946 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:21.946 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:21.946 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:21.946 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:21.947 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.947 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:21.947 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:21.947 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:21.947 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:21.947 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:21.947 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:21.947 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.947 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:21.947 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:21.947 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:21.947 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:21.947 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:21.947 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:21.948 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:21.948 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:21.948 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:21.948 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:21.948 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:21.948 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.948 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.948 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:21.948 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:21.948 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:21.948 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:21.948 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:21.948 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.948 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.948 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:21.949 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:21.949 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:21.949 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:21.949 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:21.949 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.949 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:21.949 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:21.949 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:21.949 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:21.949 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:21.949 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-475" 2023-12-03T13:00:21.949 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.949 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:21.949 INFO:teuthology.orchestra.run.smithi003.stdout:________________________ test_object_lock_get_obj_lock _________________________ 2023-12-03T13:00:21.950 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.950 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.950 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.950 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:21.950 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:21.950 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.950 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:21.950 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.950 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:21.950 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:21.950 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:21.950 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.950 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:21.950 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:21.950 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.951 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.951 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:21.951 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:21.951 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.951 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.951 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:21.951 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.951 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:21.951 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:21.951 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.951 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.951 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:21.951 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:21.951 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.952 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:21.952 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:21.952 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:21.952 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:21.952 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:21.952 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.952 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:21.952 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.952 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:21.952 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:21.952 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:21.952 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:21.952 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:21.952 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:21.952 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:21.953 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:21.953 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.953 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.953 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:21.953 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:21.953 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:21.953 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:21.953 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.953 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:21.953 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:21.953 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:21.953 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:21.953 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.953 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.954 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:21.954 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:21.954 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:21.954 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:21.954 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.954 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.954 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:21.954 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:21.954 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:21.954 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.954 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:21.954 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.954 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:21.954 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:21.955 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.955 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:21.955 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:21.955 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:21.955 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:21.955 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:21.955 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:21.955 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.955 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:21.955 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.955 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:21.955 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.955 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.955 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:21.956 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.956 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:21.956 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.956 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:21.956 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:21.956 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:21.956 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:21.956 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:21.956 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:21.956 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.956 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:21.956 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:21.956 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:21.956 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:21.957 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:21.957 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:21.957 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.957 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:21.957 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:21.957 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:21.957 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:21.957 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:21.957 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:21.957 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:21.957 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:21.957 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:21.957 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:21.957 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:21.958 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.958 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.958 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:21.958 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.958 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:21.958 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:21.958 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:21.958 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:21.958 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:21.958 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:21.958 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:21.958 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:21.958 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:21.958 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:21.959 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:21.959 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:21.959 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:21.959 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:21.959 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:21.959 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:21.959 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:21.959 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:21.959 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:21.959 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:21.959 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:21.959 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:21.959 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:21.959 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:21.959 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:21.960 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:21.960 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:21.960 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:21.960 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.960 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.960 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.960 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.960 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:21.960 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:21.960 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.960 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:21.960 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.960 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:21.960 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:21.961 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:21.961 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.961 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:21.961 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:21.961 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.961 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.961 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:21.961 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:21.961 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.961 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.961 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:21.961 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:21.961 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:21.961 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:21.961 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:21.962 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.962 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.962 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:21.962 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:21.962 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:21.962 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.962 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:21.962 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.962 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:21.962 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.962 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:21.962 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.962 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T13:00:21.962 INFO:teuthology.orchestra.run.smithi003.stdout: def test_object_lock_get_obj_lock(): 2023-12-03T13:00:21.962 INFO:teuthology.orchestra.run.smithi003.stdout: bucket_name = get_new_bucket_name() 2023-12-03T13:00:21.963 INFO:teuthology.orchestra.run.smithi003.stdout: client = get_client() 2023-12-03T13:00:21.963 INFO:teuthology.orchestra.run.smithi003.stdout:> client.create_bucket(Bucket=bucket_name, ObjectLockEnabledForBucket=True) 2023-12-03T13:00:21.963 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.963 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:11809: 2023-12-03T13:00:21.963 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.963 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:21.963 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:21.963 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:21.963 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:21.963 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:21.963 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:21.963 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:21.963 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:21.963 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:21.963 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:21.964 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:21.964 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:21.964 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:21.964 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:21.964 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:21.964 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:21.964 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:21.964 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:21.964 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:21.964 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:21.964 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:21.964 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:21.964 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:21.964 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:21.964 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:21.965 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:21.965 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:21.965 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:21.965 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:21.965 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:21.965 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:21.965 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:21.965 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:21.965 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:21.965 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.965 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.965 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.965 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:21.965 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.966 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:21.966 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.966 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:21.966 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:21.966 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:21.966 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:21.966 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:21.966 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:21.966 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.966 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:21.966 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:21.966 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:21.966 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:21.967 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:21.967 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:21.967 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.967 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:21.967 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:21.967 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:21.967 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:21.967 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:21.967 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:21.967 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:21.967 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:21.967 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:21.967 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:21.967 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:21.967 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.968 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.968 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:21.968 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:21.968 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:21.968 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:21.968 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:21.968 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.968 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.968 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:21.968 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:21.968 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:21.968 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:21.968 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:21.968 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.968 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:21.969 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:21.969 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:21.969 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:21.969 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:21.969 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-476" 2023-12-03T13:00:21.969 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.969 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:21.969 INFO:teuthology.orchestra.run.smithi003.stdout:_________________ test_object_lock_get_obj_lock_invalid_bucket _________________ 2023-12-03T13:00:21.969 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.969 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.969 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.969 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:21.969 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:21.969 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.969 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:21.970 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.970 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:21.970 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:21.970 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:21.970 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.970 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:21.970 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:21.970 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.970 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.970 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:21.970 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:21.970 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.970 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.970 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:21.970 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.971 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:21.971 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:21.971 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.971 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.971 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:21.971 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:21.971 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.971 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:21.971 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:21.971 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:21.971 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:21.971 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:21.971 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.971 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:21.972 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.972 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:21.972 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:21.972 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:21.972 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:21.972 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:21.972 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:21.972 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:21.972 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:21.972 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.972 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.972 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:21.972 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:21.972 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:21.972 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:21.973 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.973 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:21.973 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:21.973 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:21.973 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:21.973 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.973 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.973 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:21.973 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:21.973 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:21.973 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:21.973 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.973 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.973 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:21.973 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:21.974 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:21.974 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.974 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:21.974 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.974 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:21.974 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:21.974 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.974 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:21.974 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:21.974 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:21.974 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:21.974 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:21.974 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:21.974 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.975 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:21.975 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.975 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:21.975 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.975 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.975 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:21.975 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.975 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:21.975 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.975 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:21.975 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:21.975 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:21.975 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:21.975 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:21.976 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:21.976 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.976 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:21.976 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:21.976 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:21.976 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:21.976 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:21.976 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:21.976 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.976 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:21.976 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:21.976 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:21.976 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:21.976 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:21.976 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:21.976 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:21.977 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:21.977 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:21.977 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:21.977 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:21.977 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.977 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.977 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:21.977 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.977 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:21.977 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:21.977 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:21.977 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:21.977 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:21.977 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:21.977 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:21.978 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:21.978 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:21.978 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:21.978 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:21.978 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:21.978 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:21.978 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:21.978 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:21.978 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:21.978 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:21.978 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:21.978 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:21.978 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:21.979 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:21.979 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:21.979 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:21.979 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:21.979 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:21.979 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:21.979 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:21.979 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:21.979 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.979 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.979 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.979 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.979 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:21.979 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:21.979 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.979 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:21.980 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.980 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:21.980 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:21.980 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:21.980 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.980 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:21.980 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:21.980 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.980 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.980 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:21.980 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:21.980 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.980 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.980 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:21.980 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:21.980 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:21.981 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:21.981 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:21.981 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.981 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.981 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:21.981 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:21.981 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:21.981 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.981 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:21.981 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.981 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:21.981 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.981 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:21.981 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.982 INFO:teuthology.orchestra.run.smithi003.stdout: def test_object_lock_get_obj_lock_invalid_bucket(): 2023-12-03T13:00:21.982 INFO:teuthology.orchestra.run.smithi003.stdout: bucket_name = get_new_bucket_name() 2023-12-03T13:00:21.982 INFO:teuthology.orchestra.run.smithi003.stdout: client = get_client() 2023-12-03T13:00:21.982 INFO:teuthology.orchestra.run.smithi003.stdout:> client.create_bucket(Bucket=bucket_name) 2023-12-03T13:00:21.982 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.982 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:11827: 2023-12-03T13:00:21.982 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.982 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:21.982 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:21.982 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:21.982 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:21.982 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:21.982 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:21.982 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:21.983 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:21.983 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:21.983 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:21.983 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:21.983 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:21.983 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:21.983 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:21.983 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:21.983 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:21.983 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:21.983 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:21.983 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:21.983 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:21.983 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:21.983 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:21.983 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:21.984 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:21.984 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:21.984 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:21.984 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:21.984 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:21.984 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:21.984 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:21.984 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:21.984 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:21.984 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:21.984 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:21.984 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.984 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.984 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.984 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:21.985 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.985 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:21.985 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.985 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:21.985 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:21.985 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:21.985 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:21.985 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:21.985 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:21.985 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.985 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:21.985 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:21.985 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:21.985 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:21.986 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:21.986 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:21.986 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.986 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:21.986 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:21.986 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:21.986 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:21.986 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:21.986 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:21.986 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:21.986 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:21.986 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:21.986 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:21.986 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:21.987 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.987 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.987 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:21.987 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:21.987 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:21.987 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:21.987 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:21.987 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.987 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.987 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:21.987 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:21.987 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:21.987 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:21.987 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:21.987 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.988 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:21.988 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:21.988 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:21.988 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:21.988 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:21.988 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-477" 2023-12-03T13:00:21.988 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.988 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:21.988 INFO:teuthology.orchestra.run.smithi003.stdout:______________________ test_object_lock_put_obj_retention ______________________ 2023-12-03T13:00:21.988 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.988 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.988 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.988 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:21.988 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:21.988 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.989 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:21.989 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.989 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:21.989 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:21.989 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:21.989 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.989 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:21.989 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:21.989 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.989 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.989 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:21.989 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:21.989 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.989 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.990 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:21.990 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.990 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:21.990 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:21.990 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.990 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.990 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:21.990 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:21.990 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.990 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:21.990 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:21.990 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:21.990 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:21.990 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:21.990 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.991 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:21.991 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.991 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:21.991 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:21.991 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:21.991 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:21.991 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:21.991 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:21.991 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:21.991 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:21.991 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:21.991 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.991 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:21.991 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:21.991 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:21.992 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:21.992 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.992 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:21.992 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:21.992 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:21.992 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:21.992 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.992 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.992 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:21.992 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:21.992 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:21.992 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:21.992 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.992 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.993 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:21.993 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:21.993 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:21.993 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.993 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:21.993 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.993 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:21.993 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:21.993 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.993 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:21.993 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:21.993 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:21.993 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:21.993 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:21.993 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:21.994 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.994 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:21.994 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.994 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:21.994 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.994 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:21.997 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:21.997 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.997 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:21.997 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:21.997 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:21.997 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:21.997 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:21.997 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:21.997 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:21.997 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:21.997 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:21.997 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:21.997 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:21.998 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:21.998 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:21.998 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:21.998 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:21.998 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.998 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:21.998 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:21.998 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:21.998 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:21.998 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:21.998 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:21.998 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:21.998 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:21.998 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:21.999 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:21.999 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:21.999 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:21.999 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:21.999 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:21.999 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:21.999 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:21.999 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:21.999 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:21.999 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:21.999 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:21.999 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:21.999 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:21.999 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:21.999 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:21.999 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:22.000 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:22.000 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:22.000 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:22.000 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:22.000 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:22.000 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:22.000 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:22.000 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:22.000 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:22.000 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:22.000 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:22.000 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:22.000 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:22.000 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:22.000 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:22.001 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:22.001 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:22.001 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:22.001 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.001 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.001 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.001 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.001 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:22.001 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:22.001 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.001 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:22.001 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:22.001 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:22.001 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:22.001 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:22.002 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.002 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:22.002 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:22.002 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.002 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.002 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:22.002 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:22.002 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.002 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.002 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:22.002 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:22.002 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:22.002 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:22.002 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:22.003 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.003 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.003 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:22.003 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:22.003 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:22.003 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.003 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:22.003 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.003 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:22.003 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.003 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:22.003 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.003 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T13:00:22.003 INFO:teuthology.orchestra.run.smithi003.stdout: def test_object_lock_put_obj_retention(): 2023-12-03T13:00:22.003 INFO:teuthology.orchestra.run.smithi003.stdout: bucket_name = get_new_bucket_name() 2023-12-03T13:00:22.003 INFO:teuthology.orchestra.run.smithi003.stdout: client = get_client() 2023-12-03T13:00:22.004 INFO:teuthology.orchestra.run.smithi003.stdout:> client.create_bucket(Bucket=bucket_name, ObjectLockEnabledForBucket=True) 2023-12-03T13:00:22.004 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.004 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:11838: 2023-12-03T13:00:22.004 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.004 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:22.004 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:22.004 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:22.004 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:22.004 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:22.004 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:22.004 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:22.004 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:22.004 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:22.004 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:22.005 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:22.005 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:22.005 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:22.005 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:22.005 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:22.005 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:22.005 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:22.005 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:22.005 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:22.005 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:22.005 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:22.005 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:22.005 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:22.005 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:22.006 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:22.006 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:22.006 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:22.006 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:22.006 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:22.006 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:22.006 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:22.006 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:22.006 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:22.006 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:22.006 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.006 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.006 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.006 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:22.007 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.007 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:22.007 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.007 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:22.007 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:22.007 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:22.007 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:22.007 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:22.007 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:22.007 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:22.007 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:22.007 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:22.007 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:22.007 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:22.007 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:22.008 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:22.008 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.008 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:22.008 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:22.008 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:22.008 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:22.008 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:22.008 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:22.008 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:22.008 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:22.008 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:22.008 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:22.008 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:22.008 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.008 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.009 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:22.009 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:22.009 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:22.009 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:22.009 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:22.009 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.009 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.009 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:22.009 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:22.009 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:22.009 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:22.009 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:22.009 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.009 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:22.010 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:22.010 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:22.010 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:22.010 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:22.010 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-478" 2023-12-03T13:00:22.010 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.010 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:22.010 INFO:teuthology.orchestra.run.smithi003.stdout:______________ test_object_lock_put_obj_retention_invalid_bucket _______________ 2023-12-03T13:00:22.010 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.010 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.010 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.010 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:22.010 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:22.010 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.011 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:22.011 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:22.011 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:22.011 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:22.011 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:22.011 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.011 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:22.011 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:22.011 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.011 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.011 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:22.011 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:22.011 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.011 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.011 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:22.012 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.012 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:22.012 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:22.012 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.012 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.012 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:22.012 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:22.012 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.012 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:22.012 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:22.012 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:22.012 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:22.012 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:22.012 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:22.012 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:22.013 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.013 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:22.013 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:22.013 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:22.013 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:22.013 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:22.013 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:22.013 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:22.013 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:22.013 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:22.013 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.013 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:22.013 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:22.013 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:22.014 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:22.014 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.014 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:22.014 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:22.014 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:22.014 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:22.014 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.014 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.014 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:22.014 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:22.014 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:22.014 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:22.014 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.014 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.015 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:22.015 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:22.015 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:22.015 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.015 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:22.015 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.015 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:22.015 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:22.015 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.015 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:22.015 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:22.015 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:22.015 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:22.015 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:22.015 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:22.015 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.016 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:22.016 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.016 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:22.016 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.016 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.016 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:22.016 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.016 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:22.016 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.016 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:22.016 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:22.016 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:22.016 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:22.017 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:22.017 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:22.017 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:22.017 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:22.017 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:22.017 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:22.017 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:22.017 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:22.017 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:22.017 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.017 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:22.017 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:22.017 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:22.017 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:22.017 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:22.018 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:22.018 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:22.018 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:22.018 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:22.018 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:22.018 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:22.018 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.018 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.018 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:22.018 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.018 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:22.018 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:22.018 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:22.018 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:22.018 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:22.019 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:22.019 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:22.019 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:22.019 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:22.019 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:22.019 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:22.019 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:22.019 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:22.019 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:22.019 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:22.019 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:22.019 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:22.019 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:22.019 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:22.020 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:22.020 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:22.020 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:22.020 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:22.020 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:22.020 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:22.020 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:22.020 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:22.020 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:22.020 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.020 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.020 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.020 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.020 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:22.021 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:22.021 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.021 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:22.021 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:22.021 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:22.021 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:22.021 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:22.021 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.021 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:22.021 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:22.021 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.021 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.021 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:22.021 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:22.021 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.022 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.022 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:22.022 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:22.022 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:22.022 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:22.022 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:22.022 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.022 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.022 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:22.022 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:22.022 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:22.022 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.022 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:22.022 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.023 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:22.023 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.023 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:22.023 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.023 INFO:teuthology.orchestra.run.smithi003.stdout: def test_object_lock_put_obj_retention_invalid_bucket(): 2023-12-03T13:00:22.023 INFO:teuthology.orchestra.run.smithi003.stdout: bucket_name = get_new_bucket_name() 2023-12-03T13:00:22.023 INFO:teuthology.orchestra.run.smithi003.stdout: client = get_client() 2023-12-03T13:00:22.023 INFO:teuthology.orchestra.run.smithi003.stdout:> client.create_bucket(Bucket=bucket_name) 2023-12-03T13:00:22.023 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.023 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:11854: 2023-12-03T13:00:22.023 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.023 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:22.023 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:22.023 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:22.024 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:22.024 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:22.024 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:22.024 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:22.024 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:22.024 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:22.024 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:22.024 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:22.024 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:22.024 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:22.024 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:22.024 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:22.024 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:22.024 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:22.024 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:22.025 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:22.025 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:22.025 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:22.025 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:22.025 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:22.025 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:22.025 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:22.025 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:22.025 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:22.025 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:22.025 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:22.025 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:22.025 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:22.025 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:22.025 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:22.026 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:22.026 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.026 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.026 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.026 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:22.026 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.026 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:22.026 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.026 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:22.026 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:22.026 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:22.026 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:22.026 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:22.026 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:22.027 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:22.027 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:22.027 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:22.027 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:22.027 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:22.027 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:22.027 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:22.027 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.027 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:22.027 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:22.027 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:22.027 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:22.027 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:22.028 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:22.028 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:22.028 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:22.028 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:22.028 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:22.028 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:22.028 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.028 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.028 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:22.028 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:22.028 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:22.028 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:22.028 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:22.028 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.028 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.029 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:22.029 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:22.029 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:22.029 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:22.029 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:22.029 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.029 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:22.029 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:22.029 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:22.029 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:22.029 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:22.029 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-479" 2023-12-03T13:00:22.029 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.029 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:22.029 INFO:teuthology.orchestra.run.smithi003.stdout:_______________ test_object_lock_put_obj_retention_invalid_mode ________________ 2023-12-03T13:00:22.030 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.030 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.030 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.030 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:22.030 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:22.030 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.030 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:22.030 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:22.030 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:22.030 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:22.030 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:22.030 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.030 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:22.030 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:22.031 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.031 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.031 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:22.031 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:22.031 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.031 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.031 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:22.031 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.031 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:22.031 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:22.031 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.031 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.031 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:22.031 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:22.031 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.032 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:22.032 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:22.032 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:22.032 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:22.032 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:22.032 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:22.032 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:22.032 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.032 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:22.032 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:22.032 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:22.032 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:22.032 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:22.032 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:22.032 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:22.033 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:22.033 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:22.033 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.033 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:22.033 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:22.033 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:22.033 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:22.033 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.033 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:22.033 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:22.033 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:22.033 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:22.033 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.033 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.034 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:22.034 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:22.034 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:22.034 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:22.034 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.034 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.034 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:22.034 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:22.034 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:22.034 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.034 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:22.034 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.034 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:22.034 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:22.035 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.035 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:22.035 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:22.035 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:22.035 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:22.035 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:22.035 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:22.035 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.035 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:22.035 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.035 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:22.035 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.035 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.035 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:22.035 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.036 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:22.036 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.036 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:22.036 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:22.036 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:22.036 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:22.036 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:22.036 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:22.036 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:22.036 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:22.036 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:22.036 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:22.036 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:22.036 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:22.036 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:22.037 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.037 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:22.037 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:22.037 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:22.037 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:22.037 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:22.037 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:22.037 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:22.037 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:22.037 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:22.037 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:22.037 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:22.037 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.037 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.038 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:22.038 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.038 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:22.038 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:22.038 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:22.038 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:22.038 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:22.038 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:22.038 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:22.038 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:22.038 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:22.038 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:22.038 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:22.038 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:22.038 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:22.039 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:22.039 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:22.039 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:22.039 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:22.039 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:22.039 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:22.039 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:22.039 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:22.039 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:22.039 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:22.039 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:22.039 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:22.039 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:22.039 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:22.040 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:22.040 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.040 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.040 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.040 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.040 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:22.040 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:22.040 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.040 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:22.040 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:22.040 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:22.040 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:22.040 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:22.040 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.041 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:22.041 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:22.041 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.041 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.041 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:22.041 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:22.041 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.041 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.041 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:22.041 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:22.041 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:22.041 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:22.041 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:22.041 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.042 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.042 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:22.042 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:22.042 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:22.042 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.042 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:22.042 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.042 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:22.042 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.042 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:22.042 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.042 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T13:00:22.042 INFO:teuthology.orchestra.run.smithi003.stdout: def test_object_lock_put_obj_retention_invalid_mode(): 2023-12-03T13:00:22.042 INFO:teuthology.orchestra.run.smithi003.stdout: bucket_name = get_new_bucket_name() 2023-12-03T13:00:22.043 INFO:teuthology.orchestra.run.smithi003.stdout: client = get_client() 2023-12-03T13:00:22.043 INFO:teuthology.orchestra.run.smithi003.stdout:> client.create_bucket(Bucket=bucket_name, ObjectLockEnabledForBucket=True) 2023-12-03T13:00:22.043 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.043 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:11868: 2023-12-03T13:00:22.043 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.043 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:22.043 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:22.043 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:22.043 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:22.043 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:22.043 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:22.043 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:22.043 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:22.043 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:22.044 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:22.044 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:22.044 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:22.044 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:22.044 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:22.044 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:22.044 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:22.044 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:22.044 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:22.044 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:22.044 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:22.044 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:22.044 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:22.044 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:22.044 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:22.045 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:22.045 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:22.045 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:22.045 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:22.045 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:22.045 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:22.045 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:22.045 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:22.045 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:22.045 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:22.045 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.045 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.045 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.045 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:22.046 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.046 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:22.046 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.046 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:22.046 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:22.046 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:22.046 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:22.046 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:22.046 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:22.046 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:22.046 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:22.046 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:22.046 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:22.046 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:22.047 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:22.047 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:22.047 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.047 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:22.047 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:22.047 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:22.047 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:22.047 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:22.047 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:22.047 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:22.047 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:22.047 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:22.047 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:22.047 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:22.048 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.048 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.048 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:22.048 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:22.048 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:22.048 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:22.048 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:22.048 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.048 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.048 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:22.048 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:22.048 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:22.048 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:22.048 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:22.048 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.049 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:22.049 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:22.049 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:22.049 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:22.049 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:22.049 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-480" 2023-12-03T13:00:22.049 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.049 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:22.049 INFO:teuthology.orchestra.run.smithi003.stdout:______________________ test_object_lock_get_obj_retention ______________________ 2023-12-03T13:00:22.049 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.049 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.049 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.049 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:22.049 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:22.049 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.050 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:22.050 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:22.050 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:22.050 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:22.050 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:22.050 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.050 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:22.050 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:22.050 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.050 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.050 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:22.050 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:22.050 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.050 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.051 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:22.051 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.051 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:22.051 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:22.051 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.051 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.051 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:22.051 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:22.051 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.051 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:22.051 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:22.051 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:22.051 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:22.052 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:22.052 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:22.052 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:22.052 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.052 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:22.052 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:22.052 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:22.052 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:22.052 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:22.052 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:22.052 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:22.052 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:22.052 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:22.052 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.052 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:22.053 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:22.053 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:22.053 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:22.053 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.053 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:22.053 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:22.053 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:22.053 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:22.053 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.053 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.053 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:22.053 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:22.053 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:22.053 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:22.054 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.054 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.054 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:22.054 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:22.054 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:22.054 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.054 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:22.054 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.054 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:22.054 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:22.054 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.054 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:22.054 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:22.054 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:22.055 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:22.055 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:22.055 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:22.055 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.055 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:22.055 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.055 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:22.055 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.055 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.055 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:22.055 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.055 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:22.055 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.055 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:22.055 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:22.056 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:22.056 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:22.056 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:22.056 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:22.056 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:22.056 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:22.056 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:22.056 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:22.056 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:22.056 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:22.056 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:22.056 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.056 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:22.056 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:22.057 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:22.057 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:22.057 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:22.057 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:22.057 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:22.057 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:22.057 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:22.057 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:22.057 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:22.057 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.057 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.057 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:22.057 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.057 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:22.058 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:22.058 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:22.058 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:22.058 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:22.058 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:22.058 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:22.058 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:22.058 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:22.058 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:22.058 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:22.058 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:22.058 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:22.058 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:22.058 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:22.059 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:22.059 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:22.059 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:22.059 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:22.059 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:22.059 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:22.059 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:22.059 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:22.059 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:22.059 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:22.059 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:22.059 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:22.059 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:22.059 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.059 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.060 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.060 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.060 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:22.060 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:22.060 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.060 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:22.060 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:22.060 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:22.060 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:22.060 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:22.060 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.060 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:22.060 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:22.060 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.061 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.061 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:22.061 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:22.061 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.061 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.061 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:22.061 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:22.061 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:22.061 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:22.061 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:22.061 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.061 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.061 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:22.061 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:22.062 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:22.062 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.062 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:22.062 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.062 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:22.062 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.062 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:22.062 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.062 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T13:00:22.062 INFO:teuthology.orchestra.run.smithi003.stdout: def test_object_lock_get_obj_retention(): 2023-12-03T13:00:22.062 INFO:teuthology.orchestra.run.smithi003.stdout: bucket_name = get_new_bucket_name() 2023-12-03T13:00:22.062 INFO:teuthology.orchestra.run.smithi003.stdout: client = get_client() 2023-12-03T13:00:22.062 INFO:teuthology.orchestra.run.smithi003.stdout:> client.create_bucket(Bucket=bucket_name, ObjectLockEnabledForBucket=True) 2023-12-03T13:00:22.062 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.063 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:11888: 2023-12-03T13:00:22.063 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.063 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:22.063 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:22.063 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:22.063 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:22.063 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:22.063 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:22.063 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:22.063 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:22.063 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:22.063 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:22.063 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:22.063 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:22.064 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:22.064 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:22.064 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:22.064 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:22.064 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:22.064 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:22.064 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:22.064 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:22.064 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:22.064 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:22.064 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:22.064 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:22.064 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:22.064 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:22.065 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:22.065 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:22.065 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:22.065 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:22.065 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:22.065 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:22.065 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:22.065 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:22.065 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.065 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.065 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.065 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:22.065 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.065 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:22.066 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.066 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:22.066 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:22.066 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:22.066 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:22.066 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:22.066 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:22.066 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:22.066 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:22.066 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:22.066 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:22.066 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:22.066 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:22.066 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:22.066 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.067 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:22.067 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:22.067 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:22.067 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:22.067 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:22.067 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:22.067 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:22.067 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:22.067 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:22.067 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:22.067 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:22.067 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.067 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.068 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:22.068 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:22.068 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:22.068 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:22.068 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:22.068 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.068 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.068 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:22.068 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:22.068 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:22.068 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:22.068 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:22.068 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.068 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:22.069 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:22.069 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:22.069 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:22.069 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:22.069 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-481" 2023-12-03T13:00:22.069 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.069 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:22.069 INFO:teuthology.orchestra.run.smithi003.stdout:__________________ test_object_lock_get_obj_retention_iso8601 __________________ 2023-12-03T13:00:22.069 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.069 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.069 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.069 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:22.069 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:22.069 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.069 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:22.070 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:22.070 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:22.070 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:22.070 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:22.070 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.070 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:22.070 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:22.070 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.070 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.070 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:22.070 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:22.070 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.070 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.070 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:22.071 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.071 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:22.071 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:22.071 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.071 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.071 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:22.071 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:22.071 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.071 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:22.071 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:22.071 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:22.071 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:22.071 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:22.071 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:22.072 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:22.072 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.072 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:22.072 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:22.072 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:22.072 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:22.072 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:22.072 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:22.072 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:22.072 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:22.072 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:22.072 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.072 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:22.072 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:22.072 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:22.073 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:22.073 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.073 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:22.073 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:22.073 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:22.073 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:22.073 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.073 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.073 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:22.073 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:22.073 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:22.073 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:22.073 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.073 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.073 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:22.074 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:22.074 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:22.074 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.074 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:22.074 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.074 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:22.074 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:22.074 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.074 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:22.074 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:22.074 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:22.074 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:22.074 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:22.074 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:22.075 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.075 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:22.075 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.075 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:22.075 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.075 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.075 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:22.075 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.075 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:22.075 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.075 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:22.075 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:22.075 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:22.075 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:22.076 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:22.076 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:22.076 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:22.076 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:22.076 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:22.076 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:22.076 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:22.076 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:22.076 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:22.076 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.076 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:22.076 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:22.076 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:22.076 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:22.077 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:22.077 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:22.077 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:22.077 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:22.077 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:22.077 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:22.077 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:22.077 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.077 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.077 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:22.077 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.077 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:22.077 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:22.077 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:22.078 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:22.078 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:22.078 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:22.078 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:22.078 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:22.078 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:22.078 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:22.078 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:22.078 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:22.078 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:22.078 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:22.078 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:22.078 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:22.078 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:22.078 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:22.079 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:22.079 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:22.079 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:22.079 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:22.079 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:22.079 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:22.079 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:22.079 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:22.079 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:22.079 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:22.079 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.079 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.079 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.079 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.080 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:22.080 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:22.080 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.080 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:22.080 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:22.080 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:22.080 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:22.080 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:22.080 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.080 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:22.080 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:22.080 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.080 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.080 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:22.080 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:22.081 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.081 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.081 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:22.081 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:22.081 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:22.081 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:22.081 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:22.081 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.081 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.081 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:22.081 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:22.081 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:22.081 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.081 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:22.082 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.082 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:22.082 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.082 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:22.082 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.082 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T13:00:22.082 INFO:teuthology.orchestra.run.smithi003.stdout: def test_object_lock_get_obj_retention_iso8601(): 2023-12-03T13:00:22.082 INFO:teuthology.orchestra.run.smithi003.stdout: bucket_name = get_new_bucket_name() 2023-12-03T13:00:22.082 INFO:teuthology.orchestra.run.smithi003.stdout: client = get_client() 2023-12-03T13:00:22.082 INFO:teuthology.orchestra.run.smithi003.stdout:> client.create_bucket(Bucket=bucket_name, ObjectLockEnabledForBucket=True) 2023-12-03T13:00:22.082 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.082 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:11903: 2023-12-03T13:00:22.082 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.082 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:22.083 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:22.083 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:22.083 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:22.083 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:22.083 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:22.083 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:22.083 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:22.083 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:22.083 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:22.083 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:22.083 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:22.083 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:22.083 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:22.083 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:22.084 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:22.084 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:22.084 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:22.084 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:22.084 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:22.084 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:22.084 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:22.084 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:22.084 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:22.084 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:22.084 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:22.084 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:22.084 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:22.084 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:22.085 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:22.085 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:22.085 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:22.085 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:22.085 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:22.085 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.085 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.085 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.085 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:22.085 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.085 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:22.085 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.085 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:22.085 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:22.086 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:22.086 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:22.086 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:22.086 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:22.086 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:22.086 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:22.086 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:22.086 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:22.086 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:22.086 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:22.086 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:22.086 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.086 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:22.086 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:22.086 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:22.087 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:22.087 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:22.087 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:22.087 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:22.087 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:22.087 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:22.087 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:22.087 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:22.087 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.087 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.087 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:22.087 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:22.088 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:22.088 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:22.088 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:22.088 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.088 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.088 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:22.088 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:22.088 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:22.088 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:22.088 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:22.088 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.088 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:22.088 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:22.088 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:22.088 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:22.089 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:22.089 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-482" 2023-12-03T13:00:22.089 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.089 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:22.089 INFO:teuthology.orchestra.run.smithi003.stdout:______________ test_object_lock_get_obj_retention_invalid_bucket _______________ 2023-12-03T13:00:22.089 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.089 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.089 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.089 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:22.089 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:22.089 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.089 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:22.089 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:22.089 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:22.090 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:22.090 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:22.090 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.090 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:22.090 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:22.090 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.090 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.090 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:22.090 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:22.090 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.090 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.090 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:22.090 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.090 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:22.091 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:22.091 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.091 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.091 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:22.091 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:22.091 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.091 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:22.091 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:22.091 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:22.091 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:22.091 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:22.091 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:22.091 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:22.091 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.092 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:22.092 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:22.092 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:22.092 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:22.092 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:22.092 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:22.092 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:22.092 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:22.092 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:22.092 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.092 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:22.092 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:22.092 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:22.092 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:22.092 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.093 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:22.093 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:22.093 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:22.093 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:22.093 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.093 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.093 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:22.093 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:22.093 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:22.093 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:22.093 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.093 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.093 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:22.093 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:22.093 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:22.094 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.094 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:22.094 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.094 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:22.094 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:22.094 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.094 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:22.094 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:22.094 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:22.094 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:22.094 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:22.094 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:22.094 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.095 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:22.095 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.095 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:22.095 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.095 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.095 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:22.095 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.095 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:22.095 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.095 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:22.095 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:22.095 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:22.095 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:22.095 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:22.096 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:22.096 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:22.096 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:22.096 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:22.096 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:22.096 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:22.096 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:22.096 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:22.096 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.096 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:22.096 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:22.096 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:22.096 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:22.096 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:22.096 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:22.097 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:22.097 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:22.097 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:22.097 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:22.097 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:22.097 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.097 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.097 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:22.097 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.097 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:22.097 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:22.097 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:22.097 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:22.097 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:22.098 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:22.098 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:22.098 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:22.098 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:22.098 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:22.098 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:22.098 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:22.098 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:22.098 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:22.098 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:22.098 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:22.098 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:22.098 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:22.098 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:22.099 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:22.099 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:22.099 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:22.099 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:22.099 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:22.099 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:22.099 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:22.099 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:22.099 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:22.099 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.099 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.099 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.099 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.099 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:22.099 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:22.100 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.100 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:22.100 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:22.100 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:22.100 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:22.100 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:22.100 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.100 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:22.100 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:22.100 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.100 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.100 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:22.100 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:22.100 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.101 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.101 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:22.101 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:22.101 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:22.101 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:22.101 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:22.101 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.101 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.101 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:22.101 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:22.101 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:22.101 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.101 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:22.101 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.101 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:22.102 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.102 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:22.102 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.102 INFO:teuthology.orchestra.run.smithi003.stdout: def test_object_lock_get_obj_retention_invalid_bucket(): 2023-12-03T13:00:22.102 INFO:teuthology.orchestra.run.smithi003.stdout: bucket_name = get_new_bucket_name() 2023-12-03T13:00:22.102 INFO:teuthology.orchestra.run.smithi003.stdout: client = get_client() 2023-12-03T13:00:22.102 INFO:teuthology.orchestra.run.smithi003.stdout:> client.create_bucket(Bucket=bucket_name) 2023-12-03T13:00:22.102 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.102 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:11920: 2023-12-03T13:00:22.102 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.102 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:22.102 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:22.102 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:22.102 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:22.103 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:22.103 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:22.103 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:22.103 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:22.103 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:22.103 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:22.103 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:22.103 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:22.103 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:22.103 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:22.103 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:22.103 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:22.103 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:22.103 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:22.103 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:22.104 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:22.104 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:22.104 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:22.104 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:22.104 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:22.104 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:22.104 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:22.104 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:22.104 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:22.104 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:22.104 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:22.104 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:22.104 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:22.104 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:22.104 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:22.105 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.105 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.105 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.105 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:22.105 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.105 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:22.105 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.105 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:22.105 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:22.105 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:22.105 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:22.105 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:22.105 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:22.106 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:22.106 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:22.106 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:22.106 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:22.106 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:22.106 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:22.106 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:22.106 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.106 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:22.106 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:22.106 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:22.106 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:22.106 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:22.106 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:22.106 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:22.107 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:22.107 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:22.107 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:22.107 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:22.107 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.107 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.107 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:22.107 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:22.107 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:22.107 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:22.107 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:22.107 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.107 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.107 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:22.108 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:22.108 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:22.108 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:22.108 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:22.108 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.108 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:22.108 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:22.108 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:22.108 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:22.108 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:22.108 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-483" 2023-12-03T13:00:22.108 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.108 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:22.108 INFO:teuthology.orchestra.run.smithi003.stdout:_________________ test_object_lock_put_obj_retention_versionid _________________ 2023-12-03T13:00:22.109 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.109 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.109 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.109 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:22.109 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:22.109 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.109 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:22.109 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:22.109 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:22.109 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:22.109 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:22.109 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.109 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:22.109 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:22.109 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.110 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.110 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:22.110 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:22.110 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.110 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.110 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:22.110 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.110 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:22.110 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:22.110 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.110 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.110 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:22.110 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:22.110 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.111 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:22.111 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:22.111 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:22.111 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:22.111 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:22.111 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:22.111 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:22.111 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.111 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:22.111 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:22.111 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:22.111 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:22.111 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:22.111 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:22.112 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:22.112 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:22.112 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:22.112 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.112 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:22.112 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:22.112 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:22.112 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:22.112 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.112 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:22.112 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:22.112 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:22.112 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:22.112 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.113 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.113 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:22.113 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:22.113 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:22.113 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:22.113 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.113 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.113 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:22.113 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:22.113 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:22.113 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.113 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:22.113 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.113 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:22.113 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:22.114 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.114 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:22.114 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:22.114 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:22.114 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:22.114 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:22.114 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:22.114 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.114 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:22.114 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.114 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:22.114 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.114 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.114 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:22.115 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.115 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:22.115 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.115 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:22.115 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:22.115 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:22.115 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:22.115 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:22.115 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:22.115 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:22.115 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:22.115 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:22.115 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:22.115 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:22.116 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:22.116 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:22.116 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.116 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:22.116 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:22.116 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:22.116 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:22.116 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:22.116 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:22.116 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:22.116 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:22.116 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:22.116 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:22.116 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:22.116 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.117 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.117 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:22.117 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.117 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:22.117 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:22.117 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:22.117 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:22.117 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:22.117 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:22.117 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:22.117 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:22.117 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:22.117 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:22.117 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:22.117 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:22.118 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:22.118 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:22.118 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:22.118 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:22.118 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:22.118 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:22.118 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:22.118 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:22.118 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:22.118 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:22.118 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:22.118 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:22.118 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:22.118 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:22.119 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:22.119 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:22.119 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.119 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.119 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.119 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.119 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:22.119 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:22.119 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.119 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:22.119 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:22.119 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:22.119 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:22.119 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:22.120 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.120 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:22.120 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:22.120 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.120 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.120 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:22.120 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:22.120 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.120 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.120 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:22.120 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:22.120 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:22.120 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:22.120 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:22.121 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.121 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.121 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:22.121 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:22.121 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:22.121 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.121 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:22.121 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.121 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:22.121 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.121 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:22.121 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.121 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T13:00:22.121 INFO:teuthology.orchestra.run.smithi003.stdout: def test_object_lock_put_obj_retention_versionid(): 2023-12-03T13:00:22.122 INFO:teuthology.orchestra.run.smithi003.stdout: bucket_name = get_new_bucket_name() 2023-12-03T13:00:22.122 INFO:teuthology.orchestra.run.smithi003.stdout: client = get_client() 2023-12-03T13:00:22.122 INFO:teuthology.orchestra.run.smithi003.stdout:> client.create_bucket(Bucket=bucket_name, ObjectLockEnabledForBucket=True) 2023-12-03T13:00:22.122 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.122 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:11933: 2023-12-03T13:00:22.122 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.122 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:22.122 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:22.122 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:22.122 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:22.122 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:22.122 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:22.122 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:22.122 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:22.123 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:22.123 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:22.123 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:22.123 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:22.123 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:22.123 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:22.123 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:22.123 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:22.123 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:22.123 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:22.123 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:22.123 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:22.123 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:22.123 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:22.123 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:22.124 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:22.124 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:22.124 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:22.124 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:22.124 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:22.124 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:22.124 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:22.124 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:22.124 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:22.124 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:22.124 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:22.124 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.124 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.124 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.125 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:22.125 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.125 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:22.125 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.125 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:22.125 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:22.125 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:22.125 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:22.125 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:22.125 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:22.125 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:22.125 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:22.125 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:22.125 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:22.126 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:22.126 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:22.126 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:22.126 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.126 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:22.126 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:22.126 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:22.126 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:22.126 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:22.126 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:22.126 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:22.126 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:22.126 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:22.127 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:22.127 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:22.127 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.127 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.127 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:22.127 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:22.127 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:22.127 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:22.127 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:22.127 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.127 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.127 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:22.127 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:22.127 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:22.127 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:22.128 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:22.128 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.128 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:22.128 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:22.128 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:22.128 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:22.128 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:22.128 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-484" 2023-12-03T13:00:22.128 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.128 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:22.128 INFO:teuthology.orchestra.run.smithi003.stdout:________ test_object_lock_put_obj_retention_override_default_retention _________ 2023-12-03T13:00:22.128 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.128 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.128 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.128 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:22.129 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:22.129 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.129 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:22.129 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:22.129 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:22.129 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:22.129 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:22.129 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.129 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:22.129 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:22.129 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.129 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.129 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:22.129 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:22.130 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.130 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.130 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:22.130 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.130 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:22.130 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:22.130 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.130 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.130 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:22.130 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:22.130 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.130 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:22.130 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:22.130 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:22.131 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:22.131 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:22.131 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:22.131 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:22.131 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.131 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:22.131 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:22.131 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:22.131 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:22.131 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:22.131 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:22.131 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:22.131 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:22.131 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:22.131 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.132 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:22.132 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:22.132 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:22.132 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:22.132 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.132 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:22.132 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:22.132 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:22.132 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:22.132 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.132 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.132 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:22.132 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:22.132 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:22.133 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:22.133 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.133 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.133 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:22.133 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:22.133 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:22.133 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.133 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:22.133 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.133 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:22.133 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:22.133 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.133 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:22.133 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:22.133 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:22.134 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:22.134 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:22.134 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:22.134 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.134 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:22.134 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.134 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:22.134 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.134 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.134 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:22.134 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.134 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:22.134 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.134 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:22.135 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:22.135 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:22.135 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:22.135 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:22.135 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:22.135 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:22.135 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:22.135 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:22.135 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:22.135 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:22.135 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:22.135 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:22.135 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.135 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:22.136 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:22.136 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:22.136 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:22.136 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:22.136 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:22.136 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:22.136 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:22.136 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:22.136 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:22.136 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:22.136 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.136 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.136 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:22.137 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.137 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:22.137 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:22.137 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:22.137 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:22.137 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:22.137 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:22.137 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:22.137 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:22.137 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:22.137 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:22.137 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:22.137 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:22.137 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:22.138 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:22.138 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:22.138 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:22.138 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:22.138 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:22.138 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:22.138 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:22.138 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:22.138 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:22.138 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:22.138 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:22.138 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:22.138 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:22.138 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:22.139 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:22.139 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.139 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.139 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.139 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.139 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:22.139 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:22.139 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.139 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:22.139 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:22.139 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:22.139 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:22.139 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:22.139 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.140 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:22.140 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:22.140 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.140 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.140 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:22.140 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:22.140 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.140 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.140 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:22.140 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:22.140 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:22.140 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:22.140 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:22.140 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.141 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.141 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:22.141 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:22.141 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:22.141 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.141 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:22.141 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.141 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:22.141 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.141 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:22.141 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.141 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T13:00:22.141 INFO:teuthology.orchestra.run.smithi003.stdout: def test_object_lock_put_obj_retention_override_default_retention(): 2023-12-03T13:00:22.141 INFO:teuthology.orchestra.run.smithi003.stdout: bucket_name = get_new_bucket_name() 2023-12-03T13:00:22.142 INFO:teuthology.orchestra.run.smithi003.stdout: client = get_client() 2023-12-03T13:00:22.142 INFO:teuthology.orchestra.run.smithi003.stdout:> client.create_bucket(Bucket=bucket_name, ObjectLockEnabledForBucket=True) 2023-12-03T13:00:22.142 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.142 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:11949: 2023-12-03T13:00:22.142 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.142 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:22.142 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:22.142 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:22.142 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:22.142 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:22.142 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:22.142 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:22.142 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:22.142 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:22.143 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:22.143 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:22.143 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:22.143 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:22.143 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:22.143 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:22.143 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:22.143 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:22.143 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:22.143 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:22.143 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:22.143 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:22.143 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:22.143 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:22.143 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:22.144 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:22.144 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:22.144 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:22.144 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:22.144 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:22.144 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:22.144 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:22.144 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:22.144 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:22.144 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:22.144 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.144 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.144 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.144 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:22.144 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.145 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:22.145 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.145 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:22.145 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:22.145 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:22.145 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:22.145 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:22.145 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:22.145 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:22.145 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:22.145 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:22.145 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:22.145 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:22.145 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:22.145 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:22.146 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.146 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:22.146 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:22.146 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:22.146 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:22.146 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:22.146 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:22.146 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:22.146 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:22.146 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:22.146 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:22.146 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:22.146 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.146 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.147 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:22.147 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:22.147 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:22.147 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:22.147 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:22.147 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.147 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.147 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:22.147 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:22.147 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:22.147 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:22.147 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:22.147 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.147 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:22.148 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:22.148 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:22.148 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:22.148 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:22.148 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-485" 2023-12-03T13:00:22.148 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.148 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:22.148 INFO:teuthology.orchestra.run.smithi003.stdout:______________ test_object_lock_put_obj_retention_increase_period ______________ 2023-12-03T13:00:22.148 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.148 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.148 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.148 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:22.148 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:22.148 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.149 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:22.149 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:22.149 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:22.149 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:22.149 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:22.149 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.149 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:22.149 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:22.149 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.149 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.149 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:22.149 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:22.149 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.149 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.150 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:22.150 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.150 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:22.150 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:22.150 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.150 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.150 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:22.150 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:22.150 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.150 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:22.150 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:22.150 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:22.150 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:22.150 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:22.151 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:22.151 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:22.151 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.151 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:22.151 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:22.151 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:22.151 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:22.151 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:22.151 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:22.151 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:22.151 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:22.151 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:22.151 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.151 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:22.151 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:22.152 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:22.152 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:22.152 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.152 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:22.152 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:22.152 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:22.152 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:22.152 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.152 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.152 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:22.152 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:22.152 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:22.152 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:22.152 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.153 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.153 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:22.153 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:22.153 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:22.153 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.153 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:22.153 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.153 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:22.153 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:22.153 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.153 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:22.153 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:22.153 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:22.153 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:22.154 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:22.154 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:22.154 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.154 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:22.154 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.154 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:22.154 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.154 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.154 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:22.154 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.154 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:22.154 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.154 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:22.154 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:22.154 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:22.155 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:22.155 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:22.155 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:22.155 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:22.155 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:22.155 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:22.155 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:22.155 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:22.155 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:22.155 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:22.155 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.155 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:22.155 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:22.155 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:22.155 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:22.156 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:22.156 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:22.156 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:22.156 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:22.156 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:22.156 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:22.156 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:22.156 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.156 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.156 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:22.156 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.156 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:22.156 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:22.156 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:22.156 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:22.157 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:22.157 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:22.157 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:22.157 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:22.157 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:22.157 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:22.157 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:22.157 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:22.157 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:22.157 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:22.157 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:22.157 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:22.157 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:22.158 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:22.158 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:22.158 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:22.158 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:22.158 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:22.158 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:22.158 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:22.158 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:22.158 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:22.158 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:22.158 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:22.158 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.158 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.158 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.158 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.159 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:22.159 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:22.159 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.159 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:22.159 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:22.159 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:22.159 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:22.159 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:22.159 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.159 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:22.159 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:22.159 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.159 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.159 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:22.159 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:22.160 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.160 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.160 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:22.160 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:22.160 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:22.160 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:22.160 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:22.160 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.160 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.160 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:22.160 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:22.160 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:22.160 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.160 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:22.161 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.161 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:22.161 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.161 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:22.161 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.161 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T13:00:22.161 INFO:teuthology.orchestra.run.smithi003.stdout: def test_object_lock_put_obj_retention_increase_period(): 2023-12-03T13:00:22.161 INFO:teuthology.orchestra.run.smithi003.stdout: bucket_name = get_new_bucket_name() 2023-12-03T13:00:22.161 INFO:teuthology.orchestra.run.smithi003.stdout: client = get_client() 2023-12-03T13:00:22.161 INFO:teuthology.orchestra.run.smithi003.stdout:> client.create_bucket(Bucket=bucket_name, ObjectLockEnabledForBucket=True) 2023-12-03T13:00:22.161 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.161 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:11974: 2023-12-03T13:00:22.161 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.161 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:22.161 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:22.162 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:22.162 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:22.162 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:22.162 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:22.162 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:22.162 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:22.162 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:22.162 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:22.162 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:22.162 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:22.162 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:22.162 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:22.162 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:22.162 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:22.163 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:22.163 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:22.163 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:22.163 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:22.163 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:22.163 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:22.163 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:22.163 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:22.163 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:22.163 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:22.163 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:22.163 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:22.163 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:22.163 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:22.164 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:22.164 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:22.164 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:22.164 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:22.164 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.164 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.164 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.164 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:22.164 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.164 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:22.164 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.164 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:22.164 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:22.164 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:22.164 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:22.165 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:22.165 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:22.165 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:22.165 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:22.165 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:22.165 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:22.165 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:22.165 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:22.165 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:22.165 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.165 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:22.165 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:22.165 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:22.165 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:22.166 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:22.166 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:22.166 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:22.166 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:22.166 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:22.166 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:22.166 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:22.166 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.166 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.166 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:22.166 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:22.166 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:22.166 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:22.166 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:22.167 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.167 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.167 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:22.167 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:22.167 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:22.167 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:22.167 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:22.167 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.167 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:22.167 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:22.167 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:22.167 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:22.167 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:22.167 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-486" 2023-12-03T13:00:22.168 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.168 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:22.168 INFO:teuthology.orchestra.run.smithi003.stdout:______________ test_object_lock_put_obj_retention_shorten_period _______________ 2023-12-03T13:00:22.168 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.168 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.168 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.168 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:22.168 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:22.168 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.168 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:22.168 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:22.168 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:22.168 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:22.168 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:22.168 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.168 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:22.169 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:22.169 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.169 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.169 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:22.169 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:22.169 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.169 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.169 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:22.169 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.169 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:22.169 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:22.169 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.169 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.169 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:22.170 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:22.170 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.170 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:22.170 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:22.170 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:22.170 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:22.170 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:22.170 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:22.170 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:22.170 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.170 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:22.170 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:22.170 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:22.170 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:22.170 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:22.171 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:22.171 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:22.171 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:22.171 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:22.171 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.171 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:22.171 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:22.171 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:22.171 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:22.171 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.171 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:22.171 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:22.171 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:22.171 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:22.171 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.172 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.172 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:22.172 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:22.172 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:22.172 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:22.172 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.172 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.172 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:22.172 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:22.172 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:22.172 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.172 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:22.172 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.173 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:22.173 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:22.173 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.173 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:22.173 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:22.173 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:22.173 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:22.173 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:22.173 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:22.173 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.173 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:22.173 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.173 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:22.173 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.173 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.174 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:22.174 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.174 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:22.174 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.174 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:22.174 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:22.174 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:22.174 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:22.174 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:22.174 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:22.174 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:22.174 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:22.174 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:22.174 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:22.174 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:22.175 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:22.175 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:22.175 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.175 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:22.175 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:22.175 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:22.175 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:22.175 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:22.175 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:22.175 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:22.175 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:22.175 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:22.175 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:22.175 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:22.176 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.176 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.176 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:22.176 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.176 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:22.176 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:22.176 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:22.176 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:22.176 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:22.176 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:22.176 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:22.176 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:22.176 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:22.176 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:22.177 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:22.177 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:22.177 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:22.177 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:22.177 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:22.177 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:22.177 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:22.177 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:22.177 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:22.177 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:22.177 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:22.177 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:22.177 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:22.177 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:22.177 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:22.178 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:22.178 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:22.178 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:22.178 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.178 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.178 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.178 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.178 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:22.178 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:22.178 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.178 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:22.178 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:22.178 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:22.178 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:22.179 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:22.179 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.179 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:22.179 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:22.179 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.179 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.179 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:22.179 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:22.179 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.179 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.179 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:22.179 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:22.179 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:22.179 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:22.179 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:22.180 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.180 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.180 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:22.180 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:22.180 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:22.180 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.180 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:22.180 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.180 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:22.180 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.180 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:22.180 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.180 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T13:00:22.180 INFO:teuthology.orchestra.run.smithi003.stdout: def test_object_lock_put_obj_retention_shorten_period(): 2023-12-03T13:00:22.181 INFO:teuthology.orchestra.run.smithi003.stdout: bucket_name = get_new_bucket_name() 2023-12-03T13:00:22.181 INFO:teuthology.orchestra.run.smithi003.stdout: client = get_client() 2023-12-03T13:00:22.181 INFO:teuthology.orchestra.run.smithi003.stdout:> client.create_bucket(Bucket=bucket_name, ObjectLockEnabledForBucket=True) 2023-12-03T13:00:22.181 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.181 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:11991: 2023-12-03T13:00:22.181 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.181 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:22.181 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:22.181 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:22.181 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:22.181 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:22.181 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:22.181 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:22.181 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:22.181 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:22.181 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:22.182 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:22.182 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:22.182 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:22.182 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:22.182 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:22.182 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:22.182 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:22.182 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:22.182 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:22.182 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:22.182 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:22.182 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:22.182 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:22.183 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:22.183 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:22.183 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:22.183 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:22.183 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:22.183 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:22.183 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:22.183 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:22.183 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:22.183 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:22.183 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:22.183 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.183 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.183 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.184 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:22.184 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.184 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:22.184 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.184 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:22.184 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:22.184 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:22.184 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:22.184 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:22.184 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:22.184 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:22.184 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:22.184 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:22.184 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:22.184 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:22.185 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:22.185 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:22.185 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.185 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:22.185 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:22.185 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:22.185 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:22.185 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:22.185 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:22.185 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:22.185 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:22.185 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:22.185 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:22.185 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:22.185 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.186 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.186 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:22.186 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:22.186 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:22.186 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:22.186 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:22.186 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.186 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.186 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:22.186 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:22.186 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:22.186 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:22.186 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:22.186 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.187 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:22.187 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:22.187 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:22.187 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:22.187 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:22.187 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-487" 2023-12-03T13:00:22.187 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.187 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:22.187 INFO:teuthology.orchestra.run.smithi003.stdout:___________ test_object_lock_put_obj_retention_shorten_period_bypass ___________ 2023-12-03T13:00:22.187 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.187 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.187 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.187 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:22.187 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:22.188 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.188 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:22.188 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:22.188 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:22.188 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:22.188 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:22.188 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.188 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:22.188 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:22.188 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.188 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.188 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:22.188 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:22.188 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.188 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.189 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:22.189 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.189 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:22.189 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:22.189 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.189 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.189 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:22.189 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:22.189 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.189 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:22.189 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:22.189 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:22.189 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:22.189 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:22.190 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:22.190 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:22.190 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.190 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:22.190 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:22.190 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:22.190 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:22.190 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:22.190 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:22.190 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:22.190 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:22.190 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:22.190 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.190 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:22.191 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:22.191 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:22.191 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:22.191 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.191 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:22.191 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:22.191 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:22.191 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:22.191 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.191 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.191 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:22.191 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:22.191 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:22.191 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:22.191 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.192 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.192 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:22.192 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:22.192 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:22.192 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.192 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:22.192 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.192 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:22.192 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:22.192 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.192 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:22.192 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:22.192 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:22.192 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:22.193 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:22.193 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:22.193 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.193 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:22.193 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.193 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:22.193 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.193 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.193 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:22.193 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.193 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:22.193 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.193 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:22.193 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:22.193 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:22.194 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:22.194 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:22.194 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:22.194 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:22.194 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:22.194 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:22.194 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:22.194 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:22.194 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:22.194 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:22.194 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.194 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:22.194 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:22.194 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:22.195 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:22.195 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:22.195 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:22.195 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:22.195 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:22.195 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:22.195 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:22.195 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:22.195 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.195 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.195 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:22.195 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.195 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:22.195 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:22.196 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:22.196 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:22.196 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:22.196 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:22.196 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:22.196 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:22.196 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:22.196 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:22.196 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:22.196 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:22.196 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:22.196 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:22.196 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:22.196 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:22.196 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:22.197 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:22.197 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:22.197 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:22.197 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:22.197 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:22.197 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:22.197 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:22.197 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:22.197 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:22.197 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:22.197 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:22.197 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.197 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.197 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.197 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.198 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:22.198 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:22.198 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.198 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:22.198 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:22.198 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:22.198 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:22.198 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:22.198 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.198 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:22.198 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:22.198 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.198 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.198 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:22.199 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:22.199 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.199 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.199 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:22.199 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:22.199 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:22.199 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:22.199 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:22.199 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.199 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.199 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:22.199 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:22.199 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:22.199 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.200 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:22.200 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.200 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:22.200 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.200 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:22.200 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.200 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T13:00:22.200 INFO:teuthology.orchestra.run.smithi003.stdout: def test_object_lock_put_obj_retention_shorten_period_bypass(): 2023-12-03T13:00:22.200 INFO:teuthology.orchestra.run.smithi003.stdout: bucket_name = get_new_bucket_name() 2023-12-03T13:00:22.200 INFO:teuthology.orchestra.run.smithi003.stdout: client = get_client() 2023-12-03T13:00:22.200 INFO:teuthology.orchestra.run.smithi003.stdout:> client.create_bucket(Bucket=bucket_name, ObjectLockEnabledForBucket=True) 2023-12-03T13:00:22.200 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.200 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:12009: 2023-12-03T13:00:22.200 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.200 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:22.200 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:22.201 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:22.201 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:22.201 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:22.201 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:22.201 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:22.201 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:22.201 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:22.201 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:22.201 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:22.201 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:22.201 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:22.201 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:22.201 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:22.201 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:22.202 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:22.202 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:22.202 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:22.202 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:22.202 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:22.202 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:22.202 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:22.202 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:22.202 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:22.202 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:22.202 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:22.202 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:22.202 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:22.202 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:22.202 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:22.203 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:22.203 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:22.203 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:22.203 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.203 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.203 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.203 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:22.203 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.203 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:22.203 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.203 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:22.203 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:22.203 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:22.203 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:22.204 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:22.204 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:22.204 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:22.204 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:22.204 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:22.204 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:22.204 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:22.204 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:22.204 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:22.204 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.204 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:22.204 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:22.204 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:22.204 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:22.204 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:22.205 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:22.205 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:22.205 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:22.205 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:22.205 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:22.205 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:22.205 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.205 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.205 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:22.205 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:22.205 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:22.205 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:22.205 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:22.205 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.205 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.206 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:22.206 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:22.206 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:22.206 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:22.206 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:22.206 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.206 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:22.206 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:22.206 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:22.206 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:22.206 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:22.206 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-488" 2023-12-03T13:00:22.206 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.206 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:22.207 INFO:teuthology.orchestra.run.smithi003.stdout:________________ test_object_lock_delete_object_with_retention _________________ 2023-12-03T13:00:22.207 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.207 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.207 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.207 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:22.207 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:22.207 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.207 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:22.207 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:22.207 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:22.207 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:22.207 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:22.207 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.208 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:22.208 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:22.208 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.208 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.208 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:22.208 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:22.208 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.208 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.208 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:22.208 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.208 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:22.208 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:22.208 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.208 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.209 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:22.209 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:22.209 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.209 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:22.209 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:22.209 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:22.209 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:22.209 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:22.209 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:22.209 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:22.209 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.209 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:22.209 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:22.209 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:22.209 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:22.210 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:22.210 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:22.210 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:22.210 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:22.210 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:22.210 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.210 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:22.210 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:22.210 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:22.210 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:22.210 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.210 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:22.210 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:22.210 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:22.211 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:22.211 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.211 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.211 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:22.211 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:22.211 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:22.211 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:22.211 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.211 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.211 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:22.211 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:22.211 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:22.211 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.211 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:22.212 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.212 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:22.212 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:22.212 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.212 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:22.212 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:22.212 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:22.212 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:22.212 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:22.212 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:22.212 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.212 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:22.212 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.212 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:22.212 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.213 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.213 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:22.213 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.213 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:22.213 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.213 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:22.213 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:22.213 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:22.213 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:22.213 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:22.213 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:22.213 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:22.213 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:22.213 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:22.213 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:22.214 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:22.214 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:22.214 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:22.214 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.214 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:22.214 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:22.214 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:22.214 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:22.214 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:22.214 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:22.214 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:22.214 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:22.214 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:22.214 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:22.215 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:22.215 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.215 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.215 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:22.215 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.215 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:22.215 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:22.215 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:22.215 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:22.215 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:22.215 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:22.215 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:22.215 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:22.215 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:22.215 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:22.215 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:22.216 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:22.216 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:22.216 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:22.216 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:22.216 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:22.216 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:22.216 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:22.216 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:22.216 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:22.216 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:22.216 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:22.216 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:22.216 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:22.216 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:22.216 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:22.216 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:22.217 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:22.217 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.217 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.217 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.217 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.217 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:22.217 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:22.217 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.217 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:22.217 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:22.217 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:22.217 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:22.217 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:22.217 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.218 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:22.218 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:22.218 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.218 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.218 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:22.218 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:22.218 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.218 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.218 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:22.218 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:22.218 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:22.218 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:22.218 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:22.218 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.219 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.219 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:22.219 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:22.219 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:22.219 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.219 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:22.219 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.219 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:22.219 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.219 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:22.219 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.219 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T13:00:22.219 INFO:teuthology.orchestra.run.smithi003.stdout: def test_object_lock_delete_object_with_retention(): 2023-12-03T13:00:22.219 INFO:teuthology.orchestra.run.smithi003.stdout: bucket_name = get_new_bucket_name() 2023-12-03T13:00:22.220 INFO:teuthology.orchestra.run.smithi003.stdout: client = get_client() 2023-12-03T13:00:22.220 INFO:teuthology.orchestra.run.smithi003.stdout:> client.create_bucket(Bucket=bucket_name, ObjectLockEnabledForBucket=True) 2023-12-03T13:00:22.220 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.220 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:12026: 2023-12-03T13:00:22.220 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.220 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:22.220 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:22.220 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:22.220 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:22.220 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:22.220 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:22.220 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:22.220 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:22.220 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:22.220 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:22.221 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:22.221 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:22.221 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:22.221 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:22.221 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:22.221 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:22.221 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:22.221 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:22.221 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:22.221 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:22.221 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:22.221 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:22.221 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:22.221 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:22.222 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:22.222 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:22.222 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:22.222 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:22.222 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:22.222 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:22.222 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:22.222 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:22.222 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:22.222 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:22.222 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.222 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.222 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.222 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:22.223 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.223 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:22.223 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.223 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:22.223 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:22.223 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:22.223 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:22.223 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:22.223 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:22.223 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:22.223 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:22.223 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:22.223 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:22.223 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:22.223 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:22.223 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:22.224 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.224 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:22.224 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:22.224 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:22.224 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:22.224 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:22.224 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:22.224 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:22.224 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:22.224 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:22.224 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:22.224 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:22.224 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.224 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.224 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:22.224 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:22.225 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:22.225 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:22.225 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:22.225 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.225 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.225 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:22.225 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:22.225 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:22.225 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:22.225 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:22.225 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.225 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:22.225 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:22.225 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:22.225 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:22.226 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:22.226 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-489" 2023-12-03T13:00:22.226 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.226 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:22.226 INFO:teuthology.orchestra.run.smithi003.stdout:___________ test_object_lock_delete_object_with_retention_and_marker ___________ 2023-12-03T13:00:22.226 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.226 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.226 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.226 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:22.226 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:22.226 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.226 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:22.226 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:22.226 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:22.227 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:22.227 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:22.227 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.227 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:22.227 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:22.227 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.227 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.227 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:22.227 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:22.227 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.227 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.227 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:22.227 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.227 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:22.227 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:22.227 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.228 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.228 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:22.228 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:22.228 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.228 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:22.228 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:22.228 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:22.228 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:22.228 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:22.228 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:22.228 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:22.228 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.228 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:22.228 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:22.229 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:22.229 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:22.229 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:22.229 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:22.229 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:22.229 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:22.229 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:22.229 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.229 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:22.229 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:22.229 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:22.229 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:22.229 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.229 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:22.229 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:22.230 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:22.230 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:22.230 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.230 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.230 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:22.230 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:22.230 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:22.230 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:22.230 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.230 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.230 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:22.230 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:22.230 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:22.230 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.230 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:22.231 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.231 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:22.231 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:22.231 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.231 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:22.231 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:22.231 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:22.231 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:22.231 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:22.231 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:22.231 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.231 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:22.231 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.231 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:22.232 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.232 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.232 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:22.232 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.232 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:22.232 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.232 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:22.232 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:22.232 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:22.232 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:22.232 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:22.232 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:22.232 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:22.232 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:22.232 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:22.233 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:22.233 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:22.233 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:22.233 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:22.233 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.233 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:22.233 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:22.233 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:22.233 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:22.233 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:22.233 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:22.233 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:22.233 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:22.233 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:22.233 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:22.234 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:22.234 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.234 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.234 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:22.234 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.234 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:22.234 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:22.234 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:22.234 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:22.234 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:22.234 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:22.234 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:22.234 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:22.234 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:22.234 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:22.235 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:22.235 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:22.235 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:22.235 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:22.235 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:22.235 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:22.235 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:22.235 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:22.235 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:22.235 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:22.235 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:22.235 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:22.235 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:22.235 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:22.236 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:22.236 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:22.236 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:22.236 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:22.236 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.236 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.236 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.236 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.236 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:22.236 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:22.236 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.236 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:22.236 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:22.236 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:22.236 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:22.237 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:22.237 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.237 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:22.237 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:22.237 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.237 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.237 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:22.237 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:22.237 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.237 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.237 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:22.237 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:22.237 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:22.237 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:22.237 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:22.238 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.238 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.238 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:22.238 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:22.238 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:22.238 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.238 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:22.238 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.238 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:22.238 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.238 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:22.238 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.238 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T13:00:22.238 INFO:teuthology.orchestra.run.smithi003.stdout: def test_object_lock_delete_object_with_retention_and_marker(): 2023-12-03T13:00:22.239 INFO:teuthology.orchestra.run.smithi003.stdout: bucket_name = get_new_bucket_name() 2023-12-03T13:00:22.239 INFO:teuthology.orchestra.run.smithi003.stdout: client = get_client() 2023-12-03T13:00:22.239 INFO:teuthology.orchestra.run.smithi003.stdout:> client.create_bucket(Bucket=bucket_name, ObjectLockEnabledForBucket=True) 2023-12-03T13:00:22.239 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.239 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:12044: 2023-12-03T13:00:22.239 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.239 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:22.239 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:22.239 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:22.239 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:22.239 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:22.239 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:22.239 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:22.239 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:22.239 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:22.239 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:22.240 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:22.240 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:22.240 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:22.240 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:22.240 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:22.240 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:22.240 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:22.240 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:22.240 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:22.240 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:22.240 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:22.240 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:22.240 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:22.240 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:22.240 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:22.241 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:22.241 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:22.241 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:22.241 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:22.241 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:22.241 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:22.241 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:22.241 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:22.241 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:22.241 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.241 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.241 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.241 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:22.241 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.241 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:22.242 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.242 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:22.242 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:22.242 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:22.242 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:22.242 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:22.242 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:22.242 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:22.242 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:22.242 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:22.242 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:22.242 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:22.242 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:22.243 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:22.243 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.243 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:22.243 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:22.243 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:22.243 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:22.243 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:22.243 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:22.243 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:22.243 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:22.243 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:22.243 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:22.243 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:22.243 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.243 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.244 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:22.244 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:22.244 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:22.244 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:22.244 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:22.244 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.244 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.244 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:22.244 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:22.244 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:22.244 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:22.244 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:22.244 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.244 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:22.244 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:22.245 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:22.245 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:22.245 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:22.245 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-490" 2023-12-03T13:00:22.245 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.245 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:22.245 INFO:teuthology.orchestra.run.smithi003.stdout:_____________ test_object_lock_multi_delete_object_with_retention ______________ 2023-12-03T13:00:22.245 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.245 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.245 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.245 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:22.245 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:22.245 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.245 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:22.245 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:22.246 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:22.246 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:22.246 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:22.246 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.246 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:22.246 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:22.246 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.246 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.246 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:22.246 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:22.246 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.246 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.246 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:22.246 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.246 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:22.247 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:22.247 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.247 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.247 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:22.247 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:22.247 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.247 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:22.247 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:22.247 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:22.247 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:22.247 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:22.247 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:22.247 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:22.247 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.247 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:22.248 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:22.248 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:22.248 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:22.248 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:22.248 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:22.248 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:22.248 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:22.248 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:22.248 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.248 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:22.248 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:22.248 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:22.248 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:22.248 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.248 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:22.249 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:22.249 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:22.249 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:22.249 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.249 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.249 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:22.249 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:22.249 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:22.249 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:22.249 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.249 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.249 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:22.249 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:22.249 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:22.249 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.250 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:22.250 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.250 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:22.250 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:22.250 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.250 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:22.250 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:22.250 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:22.250 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:22.250 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:22.250 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:22.250 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.250 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:22.250 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.250 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:22.251 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.251 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.251 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:22.251 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.251 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:22.251 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.251 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:22.251 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:22.251 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:22.251 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:22.251 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:22.251 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:22.251 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:22.251 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:22.251 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:22.251 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:22.252 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:22.252 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:22.252 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:22.252 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.252 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:22.252 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:22.252 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:22.252 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:22.252 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:22.252 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:22.252 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:22.252 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:22.252 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:22.252 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:22.252 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:22.253 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.253 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.253 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:22.253 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.253 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:22.253 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:22.253 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:22.253 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:22.253 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:22.253 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:22.253 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:22.253 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:22.253 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:22.253 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:22.254 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:22.254 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:22.254 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:22.254 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:22.254 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:22.254 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:22.254 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:22.254 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:22.254 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:22.254 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:22.254 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:22.254 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:22.254 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:22.254 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:22.254 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:22.255 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:22.255 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:22.255 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:22.255 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.255 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.255 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.255 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.255 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:22.255 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:22.255 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.255 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:22.255 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:22.255 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:22.255 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:22.255 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:22.256 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.256 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:22.256 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:22.256 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.256 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.256 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:22.256 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:22.256 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.256 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.256 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:22.256 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:22.256 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:22.256 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:22.256 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:22.256 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.257 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.257 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:22.257 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:22.257 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:22.257 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.257 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:22.257 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.257 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:22.257 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.257 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:22.257 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.257 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T13:00:22.257 INFO:teuthology.orchestra.run.smithi003.stdout: def test_object_lock_multi_delete_object_with_retention(): 2023-12-03T13:00:22.257 INFO:teuthology.orchestra.run.smithi003.stdout: bucket_name = get_new_bucket_name() 2023-12-03T13:00:22.257 INFO:teuthology.orchestra.run.smithi003.stdout: client = get_client() 2023-12-03T13:00:22.258 INFO:teuthology.orchestra.run.smithi003.stdout:> client.create_bucket(Bucket=bucket_name, ObjectLockEnabledForBucket=True) 2023-12-03T13:00:22.258 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.258 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:12069: 2023-12-03T13:00:22.258 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.258 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:22.258 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:22.258 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:22.258 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:22.258 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:22.258 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:22.258 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:22.258 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:22.258 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:22.258 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:22.258 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:22.259 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:22.259 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:22.259 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:22.259 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:22.259 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:22.259 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:22.259 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:22.259 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:22.259 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:22.259 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:22.259 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:22.259 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:22.259 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:22.259 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:22.259 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:22.260 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:22.260 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:22.260 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:22.260 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:22.260 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:22.260 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:22.260 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:22.260 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:22.260 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.260 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.260 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.260 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:22.260 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.260 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:22.260 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.261 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:22.261 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:22.261 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:22.261 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:22.261 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:22.261 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:22.261 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:22.261 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:22.261 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:22.261 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:22.261 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:22.261 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:22.261 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:22.261 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.261 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:22.262 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:22.262 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:22.262 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:22.262 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:22.262 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:22.262 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:22.262 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:22.262 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:22.262 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:22.262 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:22.262 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.262 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.262 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:22.262 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:22.262 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:22.263 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:22.263 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:22.263 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.263 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.263 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:22.263 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:22.263 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:22.263 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:22.263 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:22.263 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.263 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:22.263 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:22.263 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:22.263 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:22.264 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:22.264 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-491" 2023-12-03T13:00:22.264 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.264 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:22.264 INFO:teuthology.orchestra.run.smithi003.stdout:_______________________ test_object_lock_put_legal_hold ________________________ 2023-12-03T13:00:22.264 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.264 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.264 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.264 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:22.264 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:22.264 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.264 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:22.264 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:22.264 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:22.264 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:22.264 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:22.265 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.265 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:22.265 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:22.265 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.265 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.265 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:22.265 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:22.265 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.265 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.265 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:22.265 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.265 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:22.265 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:22.265 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.265 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.266 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:22.266 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:22.266 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.266 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:22.266 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:22.266 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:22.266 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:22.266 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:22.266 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:22.266 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:22.266 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.266 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:22.266 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:22.266 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:22.267 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:22.267 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:22.267 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:22.267 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:22.267 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:22.267 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:22.267 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.267 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:22.267 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:22.267 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:22.267 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:22.267 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.267 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:22.267 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:22.268 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:22.268 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:22.268 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.268 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.268 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:22.268 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:22.268 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:22.268 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:22.268 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.268 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.268 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:22.268 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:22.268 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:22.268 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.268 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:22.268 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.269 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:22.269 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:22.269 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.269 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:22.269 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:22.269 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:22.269 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:22.269 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:22.269 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:22.269 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.269 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:22.269 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.269 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:22.269 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.269 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.270 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:22.270 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.270 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:22.270 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.270 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:22.270 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:22.270 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:22.270 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:22.270 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:22.270 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:22.270 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:22.270 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:22.270 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:22.270 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:22.270 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:22.271 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:22.271 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:22.271 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.271 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:22.271 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:22.271 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:22.271 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:22.271 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:22.271 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:22.271 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:22.271 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:22.271 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:22.271 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:22.271 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:22.272 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.272 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.272 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:22.272 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.272 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:22.272 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:22.272 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:22.272 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:22.272 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:22.272 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:22.272 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:22.272 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:22.272 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:22.272 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:22.272 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:22.272 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:22.273 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:22.273 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:22.273 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:22.273 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:22.273 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:22.273 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:22.273 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:22.273 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:22.273 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:22.273 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:22.273 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:22.273 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:22.273 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:22.273 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:22.273 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:22.274 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:22.274 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.274 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.274 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.274 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.274 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:22.274 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:22.274 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.274 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:22.274 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:22.274 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:22.274 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:22.274 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:22.274 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.275 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:22.275 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:22.275 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.275 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.275 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:22.275 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:22.275 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.275 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.275 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:22.275 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:22.275 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:22.275 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:22.275 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:22.275 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.275 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.275 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:22.276 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:22.276 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:22.276 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.276 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:22.276 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.276 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:22.276 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.276 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:22.276 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.276 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T13:00:22.276 INFO:teuthology.orchestra.run.smithi003.stdout: def test_object_lock_put_legal_hold(): 2023-12-03T13:00:22.276 INFO:teuthology.orchestra.run.smithi003.stdout: bucket_name = get_new_bucket_name() 2023-12-03T13:00:22.276 INFO:teuthology.orchestra.run.smithi003.stdout: client = get_client() 2023-12-03T13:00:22.276 INFO:teuthology.orchestra.run.smithi003.stdout:> client.create_bucket(Bucket=bucket_name, ObjectLockEnabledForBucket=True) 2023-12-03T13:00:22.277 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.277 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:12136: 2023-12-03T13:00:22.277 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.277 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:22.277 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:22.277 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:22.277 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:22.277 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:22.277 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:22.277 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:22.277 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:22.277 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:22.277 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:22.277 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:22.277 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:22.278 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:22.278 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:22.278 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:22.278 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:22.278 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:22.278 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:22.278 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:22.278 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:22.278 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:22.278 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:22.278 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:22.278 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:22.278 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:22.278 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:22.279 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:22.279 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:22.279 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:22.279 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:22.279 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:22.279 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:22.279 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:22.279 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:22.279 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.279 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.279 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.279 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:22.279 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.279 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:22.279 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.280 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:22.280 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:22.280 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:22.280 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:22.280 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:22.280 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:22.280 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:22.280 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:22.280 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:22.280 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:22.280 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:22.280 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:22.280 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:22.280 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.281 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:22.281 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:22.281 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:22.281 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:22.281 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:22.281 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:22.281 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:22.281 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:22.281 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:22.281 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:22.281 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:22.281 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.281 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.281 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:22.281 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:22.282 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:22.282 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:22.282 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:22.282 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.282 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.282 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:22.282 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:22.282 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:22.282 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:22.282 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:22.282 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.282 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:22.282 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:22.282 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:22.282 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:22.283 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:22.283 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-492" 2023-12-03T13:00:22.283 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.283 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:22.283 INFO:teuthology.orchestra.run.smithi003.stdout:________________ test_object_lock_put_legal_hold_invalid_bucket ________________ 2023-12-03T13:00:22.283 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.283 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.283 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.283 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:22.283 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:22.283 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.283 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:22.283 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:22.283 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:22.283 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:22.284 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:22.284 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.284 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:22.284 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:22.284 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.284 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.284 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:22.284 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:22.284 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.284 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.284 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:22.284 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.284 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:22.284 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:22.285 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.285 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.285 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:22.285 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:22.285 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.285 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:22.285 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:22.285 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:22.285 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:22.285 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:22.285 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:22.285 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:22.285 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.285 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:22.286 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:22.286 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:22.286 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:22.286 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:22.286 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:22.286 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:22.286 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:22.286 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:22.286 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.286 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:22.286 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:22.286 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:22.286 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:22.286 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.287 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:22.287 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:22.287 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:22.287 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:22.287 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.287 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.287 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:22.287 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:22.287 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:22.287 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:22.287 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.287 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.287 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:22.287 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:22.287 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:22.288 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.288 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:22.288 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.288 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:22.288 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:22.288 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.288 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:22.288 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:22.288 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:22.288 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:22.288 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:22.288 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:22.288 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.288 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:22.288 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.289 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:22.289 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.289 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.289 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:22.289 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.289 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:22.289 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.289 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:22.289 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:22.289 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:22.289 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:22.289 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:22.289 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:22.289 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:22.289 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:22.290 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:22.290 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:22.290 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:22.290 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:22.290 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:22.290 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.290 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:22.290 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:22.290 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:22.290 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:22.290 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:22.290 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:22.290 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:22.290 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:22.291 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:22.291 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:22.291 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:22.291 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.291 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.291 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:22.291 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.291 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:22.291 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:22.291 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:22.291 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:22.291 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:22.291 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:22.291 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:22.292 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:22.292 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:22.292 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:22.292 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:22.292 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:22.292 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:22.292 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:22.292 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:22.292 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:22.292 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:22.292 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:22.292 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:22.292 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:22.292 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:22.292 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:22.292 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:22.293 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:22.293 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:22.293 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:22.293 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:22.293 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:22.293 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.293 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.293 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.293 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.293 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:22.293 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:22.293 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.293 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:22.293 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:22.293 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:22.294 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:22.294 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:22.294 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.294 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:22.294 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:22.294 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.294 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.294 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:22.294 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:22.294 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.294 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.294 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:22.294 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:22.294 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:22.295 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:22.295 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:22.295 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.295 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.295 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:22.295 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:22.295 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:22.295 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.295 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:22.295 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.295 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:22.295 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.295 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:22.295 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.296 INFO:teuthology.orchestra.run.smithi003.stdout: def test_object_lock_put_legal_hold_invalid_bucket(): 2023-12-03T13:00:22.296 INFO:teuthology.orchestra.run.smithi003.stdout: bucket_name = get_new_bucket_name() 2023-12-03T13:00:22.296 INFO:teuthology.orchestra.run.smithi003.stdout: client = get_client() 2023-12-03T13:00:22.296 INFO:teuthology.orchestra.run.smithi003.stdout:> client.create_bucket(Bucket=bucket_name) 2023-12-03T13:00:22.296 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.296 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:12149: 2023-12-03T13:00:22.296 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.296 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:22.296 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:22.296 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:22.296 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:22.296 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:22.296 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:22.296 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:22.296 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:22.296 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:22.297 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:22.297 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:22.297 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:22.297 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:22.297 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:22.297 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:22.297 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:22.297 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:22.297 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:22.297 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:22.297 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:22.297 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:22.297 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:22.297 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:22.297 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:22.298 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:22.298 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:22.298 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:22.298 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:22.298 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:22.298 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:22.298 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:22.298 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:22.298 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:22.298 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:22.298 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.298 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.298 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.298 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:22.299 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.299 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:22.299 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.299 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:22.299 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:22.299 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:22.299 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:22.299 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:22.299 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:22.299 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:22.299 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:22.299 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:22.299 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:22.299 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:22.300 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:22.300 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:22.300 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.300 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:22.300 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:22.300 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:22.300 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:22.300 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:22.300 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:22.300 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:22.300 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:22.300 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:22.300 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:22.300 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:22.300 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.301 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.301 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:22.301 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:22.301 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:22.301 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:22.301 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:22.301 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.301 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.301 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:22.301 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:22.301 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:22.301 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:22.301 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:22.301 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.302 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:22.302 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:22.302 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:22.302 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:22.302 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:22.302 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-493" 2023-12-03T13:00:22.302 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.302 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:22.302 INFO:teuthology.orchestra.run.smithi003.stdout:________________ test_object_lock_put_legal_hold_invalid_status ________________ 2023-12-03T13:00:22.302 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.302 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.302 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.302 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:22.302 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:22.303 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.303 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:22.303 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:22.303 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:22.303 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:22.303 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:22.303 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.303 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:22.303 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:22.303 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.303 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.303 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:22.303 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:22.303 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.303 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.304 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:22.304 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.304 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:22.304 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:22.304 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.304 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.304 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:22.304 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:22.304 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.304 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:22.304 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:22.304 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:22.304 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:22.304 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:22.304 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:22.305 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:22.305 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.305 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:22.305 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:22.305 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:22.305 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:22.305 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:22.305 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:22.305 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:22.305 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:22.305 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:22.305 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.305 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:22.305 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:22.305 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:22.306 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:22.306 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.306 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:22.306 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:22.306 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:22.306 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:22.306 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.306 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.306 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:22.306 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:22.306 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:22.306 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:22.306 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.306 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.307 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:22.307 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:22.307 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:22.307 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.307 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:22.307 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.307 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:22.307 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:22.307 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.307 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:22.307 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:22.307 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:22.307 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:22.308 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:22.308 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:22.308 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.308 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:22.308 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.308 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:22.308 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.308 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.308 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:22.308 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.308 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:22.308 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.308 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:22.308 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:22.308 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:22.309 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:22.309 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:22.309 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:22.309 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:22.309 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:22.309 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:22.309 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:22.309 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:22.309 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:22.309 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:22.309 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.309 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:22.309 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:22.309 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:22.310 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:22.310 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:22.310 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:22.310 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:22.310 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:22.310 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:22.310 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:22.310 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:22.310 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.310 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.310 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:22.310 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.310 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:22.310 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:22.311 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:22.311 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:22.311 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:22.311 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:22.311 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:22.311 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:22.311 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:22.311 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:22.311 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:22.311 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:22.311 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:22.311 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:22.311 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:22.311 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:22.311 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:22.312 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:22.312 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:22.312 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:22.312 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:22.312 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:22.312 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:22.312 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:22.312 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:22.312 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:22.312 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:22.312 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:22.312 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.312 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.313 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.313 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.313 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:22.313 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:22.313 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.313 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:22.313 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:22.313 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:22.313 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:22.313 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:22.313 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.313 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:22.313 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:22.313 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.314 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.314 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:22.314 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:22.314 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.314 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.314 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:22.314 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:22.314 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:22.314 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:22.314 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:22.314 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.314 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.314 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:22.314 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:22.314 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:22.315 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.315 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:22.315 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.315 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:22.315 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.315 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:22.315 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.315 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T13:00:22.315 INFO:teuthology.orchestra.run.smithi003.stdout: def test_object_lock_put_legal_hold_invalid_status(): 2023-12-03T13:00:22.315 INFO:teuthology.orchestra.run.smithi003.stdout: bucket_name = get_new_bucket_name() 2023-12-03T13:00:22.315 INFO:teuthology.orchestra.run.smithi003.stdout: client = get_client() 2023-12-03T13:00:22.315 INFO:teuthology.orchestra.run.smithi003.stdout:> client.create_bucket(Bucket=bucket_name, ObjectLockEnabledForBucket=True) 2023-12-03T13:00:22.315 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.315 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:12163: 2023-12-03T13:00:22.316 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.316 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:22.316 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:22.316 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:22.316 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:22.316 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:22.316 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:22.316 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:22.316 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:22.316 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:22.316 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:22.316 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:22.316 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:22.316 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:22.316 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:22.317 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:22.317 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:22.317 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:22.317 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:22.317 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:22.317 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:22.317 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:22.317 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:22.317 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:22.317 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:22.317 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:22.317 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:22.317 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:22.317 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:22.317 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:22.318 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:22.318 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:22.318 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:22.318 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:22.318 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:22.318 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.318 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.318 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.318 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:22.318 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.318 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:22.318 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.318 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:22.318 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:22.319 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:22.319 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:22.319 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:22.319 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:22.319 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:22.319 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:22.319 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:22.319 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:22.319 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:22.319 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:22.319 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:22.319 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.319 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:22.319 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:22.320 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:22.320 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:22.320 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:22.320 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:22.320 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:22.320 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:22.320 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:22.320 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:22.320 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:22.320 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.320 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.320 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:22.320 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:22.320 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:22.320 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:22.321 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:22.321 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.321 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.321 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:22.321 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:22.321 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:22.321 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:22.321 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:22.321 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.321 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:22.321 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:22.321 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:22.321 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:22.321 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:22.321 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-494" 2023-12-03T13:00:22.322 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.322 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:22.322 INFO:teuthology.orchestra.run.smithi003.stdout:_______________________ test_object_lock_get_legal_hold ________________________ 2023-12-03T13:00:22.322 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.322 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.322 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.322 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:22.322 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:22.322 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.322 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:22.322 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:22.322 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:22.322 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:22.322 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:22.323 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.323 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:22.323 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:22.323 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.323 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.323 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:22.323 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:22.323 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.323 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.323 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:22.323 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.323 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:22.323 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:22.323 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.323 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.323 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:22.324 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:22.324 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.324 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:22.324 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:22.324 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:22.324 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:22.324 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:22.324 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:22.324 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:22.324 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.324 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:22.324 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:22.324 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:22.324 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:22.325 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:22.325 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:22.325 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:22.325 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:22.325 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:22.325 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.325 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:22.325 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:22.325 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:22.325 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:22.325 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.325 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:22.325 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:22.325 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:22.325 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:22.326 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.326 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.326 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:22.326 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:22.326 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:22.326 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:22.326 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.326 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.326 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:22.326 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:22.326 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:22.326 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.326 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:22.326 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.327 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:22.327 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:22.327 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.327 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:22.327 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:22.327 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:22.327 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:22.327 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:22.327 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:22.327 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.327 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:22.327 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.327 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:22.327 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.327 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.328 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:22.328 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.328 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:22.328 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.328 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:22.328 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:22.328 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:22.328 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:22.328 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:22.328 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:22.328 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:22.328 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:22.328 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:22.328 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:22.329 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:22.329 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:22.329 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:22.329 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.329 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:22.329 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:22.329 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:22.329 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:22.329 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:22.329 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:22.329 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:22.329 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:22.329 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:22.329 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:22.330 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:22.330 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.330 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.330 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:22.330 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.330 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:22.330 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:22.330 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:22.330 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:22.330 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:22.330 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:22.330 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:22.330 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:22.330 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:22.331 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:22.331 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:22.331 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:22.331 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:22.331 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:22.331 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:22.331 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:22.331 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:22.331 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:22.331 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:22.331 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:22.331 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:22.331 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:22.331 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:22.332 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:22.332 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:22.332 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:22.332 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:22.332 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:22.332 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.332 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.332 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.332 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.332 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:22.332 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:22.332 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.332 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:22.332 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:22.333 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:22.333 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:22.333 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:22.333 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.333 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:22.333 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:22.333 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.333 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.333 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:22.333 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:22.333 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.333 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.333 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:22.333 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:22.333 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:22.334 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:22.334 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:22.334 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.334 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.334 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:22.334 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:22.334 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:22.334 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.334 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:22.334 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.334 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:22.334 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.334 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:22.334 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.334 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T13:00:22.335 INFO:teuthology.orchestra.run.smithi003.stdout: def test_object_lock_get_legal_hold(): 2023-12-03T13:00:22.335 INFO:teuthology.orchestra.run.smithi003.stdout: bucket_name = get_new_bucket_name() 2023-12-03T13:00:22.335 INFO:teuthology.orchestra.run.smithi003.stdout: client = get_client() 2023-12-03T13:00:22.335 INFO:teuthology.orchestra.run.smithi003.stdout:> client.create_bucket(Bucket=bucket_name, ObjectLockEnabledForBucket=True) 2023-12-03T13:00:22.335 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.335 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:12177: 2023-12-03T13:00:22.335 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.335 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:22.335 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:22.335 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:22.335 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:22.335 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:22.335 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:22.336 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:22.336 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:22.336 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:22.336 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:22.336 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:22.336 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:22.336 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:22.336 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:22.336 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:22.336 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:22.336 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:22.336 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:22.336 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:22.336 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:22.337 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:22.337 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:22.337 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:22.337 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:22.337 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:22.337 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:22.337 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:22.337 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:22.337 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:22.337 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:22.337 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:22.337 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:22.337 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:22.337 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:22.337 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.338 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.338 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.338 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:22.338 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.338 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:22.338 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.338 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:22.338 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:22.338 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:22.338 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:22.338 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:22.338 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:22.338 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:22.338 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:22.339 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:22.339 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:22.339 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:22.339 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:22.339 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:22.339 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.339 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:22.339 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:22.339 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:22.339 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:22.339 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:22.339 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:22.339 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:22.339 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:22.339 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:22.339 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:22.340 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:22.340 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.340 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.340 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:22.340 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:22.340 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:22.340 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:22.340 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:22.340 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.340 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.340 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:22.340 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:22.340 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:22.340 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:22.340 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:22.341 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.341 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:22.341 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:22.341 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:22.341 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:22.341 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:22.341 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-495" 2023-12-03T13:00:22.341 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.341 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:22.341 INFO:teuthology.orchestra.run.smithi003.stdout:________________ test_object_lock_get_legal_hold_invalid_bucket ________________ 2023-12-03T13:00:22.341 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.341 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.341 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.341 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:22.342 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:22.342 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.342 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:22.342 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:22.342 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:22.342 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:22.342 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:22.342 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.342 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:22.342 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:22.342 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.342 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.342 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:22.342 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:22.343 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.343 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.343 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:22.343 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.343 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:22.343 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:22.343 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.343 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.343 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:22.343 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:22.343 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.343 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:22.343 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:22.343 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:22.343 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:22.343 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:22.344 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:22.344 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:22.344 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.344 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:22.344 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:22.344 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:22.344 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:22.344 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:22.344 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:22.344 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:22.344 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:22.344 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:22.344 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.344 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:22.344 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:22.345 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:22.345 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:22.345 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.345 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:22.345 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:22.345 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:22.345 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:22.345 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.345 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.345 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:22.345 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:22.345 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:22.345 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:22.345 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.345 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.346 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:22.346 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:22.346 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:22.346 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.346 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:22.346 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.346 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:22.346 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:22.346 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.346 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:22.346 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:22.346 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:22.346 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:22.346 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:22.346 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:22.347 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.347 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:22.347 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.347 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:22.347 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.347 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.347 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:22.347 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.347 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:22.347 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.347 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:22.347 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:22.347 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:22.347 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:22.347 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:22.348 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:22.348 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:22.348 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:22.348 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:22.348 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:22.348 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:22.348 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:22.348 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:22.348 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.348 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:22.348 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:22.348 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:22.348 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:22.348 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:22.349 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:22.349 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:22.349 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:22.349 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:22.349 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:22.349 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:22.349 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.349 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.349 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:22.349 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.349 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:22.349 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:22.349 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:22.349 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:22.350 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:22.350 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:22.350 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:22.350 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:22.350 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:22.350 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:22.350 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:22.350 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:22.350 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:22.350 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:22.350 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:22.350 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:22.350 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:22.350 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:22.351 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:22.351 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:22.351 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:22.351 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:22.351 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:22.351 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:22.351 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:22.351 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:22.351 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:22.351 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:22.351 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.351 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.351 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.351 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.351 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:22.352 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:22.352 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.352 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:22.352 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:22.352 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:22.352 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:22.352 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:22.352 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.352 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:22.352 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:22.352 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.352 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.352 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:22.352 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:22.352 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.353 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.353 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:22.353 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:22.353 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:22.353 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:22.353 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:22.353 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.353 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.353 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:22.353 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:22.353 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:22.353 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.353 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:22.353 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.354 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:22.354 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.354 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:22.354 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.354 INFO:teuthology.orchestra.run.smithi003.stdout: def test_object_lock_get_legal_hold_invalid_bucket(): 2023-12-03T13:00:22.354 INFO:teuthology.orchestra.run.smithi003.stdout: bucket_name = get_new_bucket_name() 2023-12-03T13:00:22.354 INFO:teuthology.orchestra.run.smithi003.stdout: client = get_client() 2023-12-03T13:00:22.354 INFO:teuthology.orchestra.run.smithi003.stdout:> client.create_bucket(Bucket=bucket_name) 2023-12-03T13:00:22.354 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.354 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:12193: 2023-12-03T13:00:22.354 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.354 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:22.354 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:22.354 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:22.355 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:22.355 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:22.355 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:22.355 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:22.355 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:22.355 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:22.355 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:22.355 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:22.355 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:22.355 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:22.355 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:22.355 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:22.355 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:22.355 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:22.355 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:22.355 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:22.356 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:22.356 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:22.356 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:22.356 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:22.356 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:22.356 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:22.356 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:22.356 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:22.356 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:22.356 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:22.356 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:22.356 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:22.356 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:22.356 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:22.357 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:22.357 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.357 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.357 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.357 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:22.357 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.357 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:22.357 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.357 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:22.357 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:22.357 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:22.357 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:22.357 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:22.357 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:22.357 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:22.358 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:22.358 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:22.358 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:22.358 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:22.358 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:22.358 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:22.358 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.358 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:22.358 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:22.358 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:22.358 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:22.358 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:22.358 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:22.358 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:22.359 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:22.359 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:22.359 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:22.359 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:22.359 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.359 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.359 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:22.359 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:22.359 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:22.359 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:22.359 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:22.359 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.359 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.360 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:22.360 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:22.360 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:22.360 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:22.360 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:22.360 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.360 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:22.360 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:22.360 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:22.360 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:22.360 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:22.360 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-496" 2023-12-03T13:00:22.360 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.360 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:22.360 INFO:teuthology.orchestra.run.smithi003.stdout:______________ test_object_lock_delete_object_with_legal_hold_on _______________ 2023-12-03T13:00:22.361 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.361 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.361 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.361 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:22.361 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:22.361 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.361 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:22.361 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:22.361 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:22.361 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:22.361 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:22.361 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.361 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:22.361 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:22.362 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.362 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.362 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:22.362 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:22.362 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.362 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.362 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:22.362 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.362 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:22.362 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:22.362 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.362 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.362 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:22.362 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:22.363 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.363 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:22.363 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:22.363 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:22.363 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:22.363 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:22.363 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:22.363 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:22.363 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.363 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:22.363 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:22.363 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:22.363 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:22.363 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:22.363 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:22.364 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:22.364 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:22.364 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:22.364 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.364 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:22.364 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:22.364 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:22.364 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:22.364 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.364 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:22.364 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:22.364 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:22.364 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:22.364 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.364 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.365 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:22.365 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:22.365 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:22.365 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:22.365 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.365 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.365 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:22.365 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:22.365 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:22.365 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.365 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:22.365 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.365 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:22.365 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:22.365 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.366 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:22.366 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:22.366 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:22.366 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:22.366 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:22.366 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:22.366 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.366 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:22.366 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.366 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:22.366 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.366 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.366 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:22.366 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.367 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:22.367 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.367 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:22.367 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:22.367 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:22.367 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:22.367 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:22.367 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:22.367 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:22.367 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:22.367 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:22.367 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:22.367 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:22.367 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:22.367 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:22.367 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.368 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:22.368 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:22.368 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:22.368 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:22.368 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:22.368 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:22.368 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:22.368 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:22.368 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:22.368 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:22.368 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:22.368 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.368 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.368 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:22.369 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.369 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:22.369 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:22.369 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:22.369 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:22.369 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:22.369 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:22.369 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:22.369 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:22.369 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:22.369 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:22.369 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:22.369 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:22.369 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:22.370 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:22.370 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:22.370 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:22.370 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:22.370 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:22.370 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:22.370 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:22.370 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:22.370 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:22.370 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:22.370 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:22.370 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:22.370 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:22.370 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:22.371 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:22.371 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.371 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.371 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.371 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.371 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:22.371 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:22.371 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.371 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:22.371 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:22.371 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:22.371 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:22.371 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:22.371 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.371 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:22.372 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:22.372 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.372 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.372 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:22.372 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:22.372 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.372 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.372 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:22.372 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:22.372 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:22.372 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:22.372 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:22.372 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.373 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.373 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:22.373 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:22.373 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:22.373 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.373 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:22.373 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.373 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:22.373 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.373 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:22.373 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.373 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T13:00:22.373 INFO:teuthology.orchestra.run.smithi003.stdout: def test_object_lock_delete_object_with_legal_hold_on(): 2023-12-03T13:00:22.373 INFO:teuthology.orchestra.run.smithi003.stdout: bucket_name = get_new_bucket_name() 2023-12-03T13:00:22.373 INFO:teuthology.orchestra.run.smithi003.stdout: client = get_client() 2023-12-03T13:00:22.374 INFO:teuthology.orchestra.run.smithi003.stdout:> client.create_bucket(Bucket=bucket_name, ObjectLockEnabledForBucket=True) 2023-12-03T13:00:22.374 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.374 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:12206: 2023-12-03T13:00:22.374 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.374 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:22.374 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:22.374 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:22.374 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:22.374 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:22.374 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:22.374 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:22.374 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:22.374 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:22.374 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:22.374 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:22.375 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:22.375 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:22.375 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:22.375 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:22.375 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:22.375 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:22.375 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:22.375 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:22.375 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:22.375 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:22.375 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:22.375 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:22.375 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:22.375 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:22.376 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:22.376 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:22.376 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:22.376 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:22.376 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:22.376 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:22.376 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:22.376 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:22.376 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:22.376 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.376 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.376 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.376 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:22.376 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.376 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:22.377 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.377 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:22.377 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:22.377 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:22.377 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:22.377 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:22.377 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:22.377 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:22.377 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:22.377 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:22.377 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:22.377 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:22.377 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:22.377 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:22.377 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.378 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:22.378 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:22.378 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:22.378 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:22.378 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:22.378 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:22.378 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:22.378 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:22.378 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:22.378 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:22.378 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:22.378 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.378 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.378 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:22.378 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:22.379 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:22.379 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:22.379 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:22.379 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.379 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.379 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:22.379 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:22.379 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:22.379 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:22.379 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:22.379 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.379 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:22.379 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:22.379 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:22.380 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:22.380 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:22.380 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-497" 2023-12-03T13:00:22.380 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.380 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:22.380 INFO:teuthology.orchestra.run.smithi003.stdout:______________ test_object_lock_delete_object_with_legal_hold_off ______________ 2023-12-03T13:00:22.380 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.380 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.380 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.380 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:22.380 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:22.380 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.380 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:22.380 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:22.380 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:22.381 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:22.381 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:22.381 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.381 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:22.381 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:22.381 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.381 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.381 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:22.381 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:22.381 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.381 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.381 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:22.381 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.381 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:22.381 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:22.382 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.382 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.382 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:22.382 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:22.382 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.382 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:22.382 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:22.382 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:22.382 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:22.382 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:22.382 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:22.382 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:22.382 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.382 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:22.382 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:22.383 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:22.383 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:22.383 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:22.383 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:22.383 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:22.383 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:22.383 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:22.383 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.383 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:22.383 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:22.383 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:22.383 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:22.383 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.383 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:22.384 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:22.384 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:22.384 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:22.384 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.384 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.384 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:22.384 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:22.384 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:22.384 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:22.384 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.384 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.384 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:22.384 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:22.384 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:22.384 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.385 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:22.385 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.385 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:22.385 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:22.385 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.385 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:22.385 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:22.385 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:22.385 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:22.385 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:22.385 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:22.385 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.385 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:22.385 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.386 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:22.386 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.386 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.386 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:22.386 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.386 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:22.386 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.386 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:22.386 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:22.386 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:22.386 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:22.386 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:22.386 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:22.386 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:22.387 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:22.387 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:22.387 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:22.387 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:22.387 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:22.387 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:22.387 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.387 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:22.387 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:22.387 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:22.387 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:22.387 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:22.387 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:22.387 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:22.387 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:22.388 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:22.388 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:22.388 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:22.388 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.388 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.388 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:22.388 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.388 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:22.388 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:22.388 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:22.388 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:22.388 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:22.388 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:22.388 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:22.388 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:22.389 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:22.389 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:22.389 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:22.389 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:22.389 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:22.389 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:22.389 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:22.389 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:22.389 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:22.389 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:22.389 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:22.389 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:22.389 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:22.389 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:22.390 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:22.390 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:22.390 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:22.390 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:22.390 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:22.390 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:22.390 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.390 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.390 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.390 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.390 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:22.390 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:22.390 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.390 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:22.390 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:22.391 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:22.391 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:22.391 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:22.391 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.391 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:22.391 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:22.391 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.391 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.391 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:22.391 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:22.391 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.391 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.391 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:22.391 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:22.392 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:22.392 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:22.392 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:22.392 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.392 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.392 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:22.392 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:22.392 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:22.392 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.392 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:22.392 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.392 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:22.392 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.392 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:22.393 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.393 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T13:00:22.393 INFO:teuthology.orchestra.run.smithi003.stdout: def test_object_lock_delete_object_with_legal_hold_off(): 2023-12-03T13:00:22.393 INFO:teuthology.orchestra.run.smithi003.stdout: bucket_name = get_new_bucket_name() 2023-12-03T13:00:22.393 INFO:teuthology.orchestra.run.smithi003.stdout: client = get_client() 2023-12-03T13:00:22.393 INFO:teuthology.orchestra.run.smithi003.stdout:> client.create_bucket(Bucket=bucket_name, ObjectLockEnabledForBucket=True) 2023-12-03T13:00:22.393 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.393 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:12221: 2023-12-03T13:00:22.393 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.393 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:22.393 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:22.393 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:22.393 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:22.393 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:22.393 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:22.394 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:22.394 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:22.394 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:22.394 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:22.394 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:22.394 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:22.394 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:22.394 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:22.394 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:22.394 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:22.394 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:22.394 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:22.394 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:22.394 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:22.394 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:22.395 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:22.395 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:22.395 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:22.395 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:22.395 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:22.395 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:22.395 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:22.395 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:22.395 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:22.395 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:22.395 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:22.395 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:22.395 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:22.396 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.396 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.396 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.396 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:22.396 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.396 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:22.396 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.396 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:22.396 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:22.396 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:22.396 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:22.396 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:22.396 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:22.396 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:22.397 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:22.397 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:22.397 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:22.397 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:22.397 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:22.397 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:22.397 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.397 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:22.397 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:22.397 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:22.397 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:22.397 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:22.397 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:22.397 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:22.397 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:22.398 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:22.398 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:22.398 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:22.398 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.398 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.398 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:22.398 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:22.398 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:22.398 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:22.398 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:22.398 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.398 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.398 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:22.398 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:22.399 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:22.399 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:22.399 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:22.399 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.399 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:22.399 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:22.399 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:22.399 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:22.399 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:22.399 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-498" 2023-12-03T13:00:22.399 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.399 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:22.399 INFO:teuthology.orchestra.run.smithi003.stdout:______________________ test_object_lock_get_obj_metadata _______________________ 2023-12-03T13:00:22.399 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.400 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.400 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.400 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:22.400 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:22.400 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.400 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:22.400 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:22.400 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:22.400 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:22.400 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:22.400 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.400 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:22.400 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:22.400 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.400 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.400 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:22.401 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:22.401 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.401 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.401 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:22.401 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.401 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:22.401 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:22.401 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.401 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.401 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:22.401 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:22.401 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.401 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:22.401 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:22.401 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:22.402 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:22.402 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:22.402 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:22.402 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:22.402 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.402 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:22.402 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:22.402 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:22.402 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:22.402 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:22.402 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:22.402 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:22.402 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:22.403 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:22.403 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.403 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:22.403 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:22.403 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:22.403 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:22.403 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.403 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:22.403 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:22.403 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:22.403 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:22.403 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.403 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.403 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:22.404 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:22.404 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:22.404 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:22.404 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.404 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.404 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:22.404 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:22.404 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:22.404 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.404 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:22.404 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.404 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:22.404 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:22.404 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.404 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:22.404 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:22.405 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:22.405 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:22.405 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:22.405 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:22.405 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.405 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:22.405 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.405 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:22.405 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.405 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.405 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:22.405 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.405 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:22.405 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.406 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:22.406 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:22.406 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:22.406 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:22.406 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:22.406 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:22.406 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:22.406 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:22.406 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:22.406 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:22.406 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:22.406 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:22.406 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:22.406 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.407 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:22.407 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:22.407 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:22.407 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:22.407 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:22.407 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:22.407 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:22.407 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:22.407 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:22.407 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:22.407 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:22.407 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.407 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.407 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:22.408 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.408 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:22.408 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:22.408 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:22.408 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:22.408 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:22.408 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:22.408 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:22.408 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:22.408 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:22.408 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:22.408 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:22.408 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:22.408 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:22.409 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:22.409 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:22.409 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:22.409 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:22.409 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:22.409 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:22.409 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:22.409 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:22.409 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:22.409 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:22.409 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:22.409 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:22.409 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:22.409 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:22.409 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:22.410 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.410 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.410 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.410 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.410 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:22.410 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:22.410 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.410 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:22.410 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:22.410 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:22.410 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:22.410 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:22.410 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.410 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:22.411 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:22.411 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.411 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.411 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:22.411 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:22.411 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.411 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.411 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:22.411 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:22.411 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:22.411 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:22.411 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:22.411 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.411 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.411 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:22.412 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:22.412 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:22.412 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.412 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:22.412 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.412 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:22.412 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.412 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:22.412 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.412 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T13:00:22.412 INFO:teuthology.orchestra.run.smithi003.stdout: def test_object_lock_get_obj_metadata(): 2023-12-03T13:00:22.412 INFO:teuthology.orchestra.run.smithi003.stdout: bucket_name = get_new_bucket_name() 2023-12-03T13:00:22.412 INFO:teuthology.orchestra.run.smithi003.stdout: client = get_client() 2023-12-03T13:00:22.412 INFO:teuthology.orchestra.run.smithi003.stdout:> client.create_bucket(Bucket=bucket_name, ObjectLockEnabledForBucket=True) 2023-12-03T13:00:22.412 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.413 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:12233: 2023-12-03T13:00:22.413 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.413 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:22.413 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:22.413 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:22.413 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:22.413 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:22.413 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:22.413 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:22.413 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:22.413 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:22.413 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:22.413 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:22.413 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:22.414 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:22.414 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:22.414 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:22.414 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:22.414 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:22.414 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:22.414 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:22.414 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:22.414 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:22.414 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:22.414 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:22.414 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:22.414 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:22.414 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:22.415 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:22.415 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:22.415 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:22.415 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:22.415 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:22.415 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:22.415 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:22.415 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:22.415 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.415 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.415 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.415 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:22.415 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.416 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:22.416 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.416 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:22.416 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:22.416 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:22.416 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:22.416 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:22.416 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:22.416 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:22.416 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:22.416 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:22.416 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:22.416 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:22.416 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:22.416 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:22.417 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.417 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:22.417 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:22.417 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:22.417 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:22.417 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:22.417 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:22.417 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:22.417 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:22.417 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:22.417 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:22.417 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:22.417 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.417 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.418 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:22.418 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:22.418 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:22.418 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:22.418 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:22.418 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.418 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.418 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:22.418 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:22.418 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:22.418 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:22.418 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:22.418 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.418 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:22.418 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:22.419 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:22.419 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:22.419 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:22.419 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-499" 2023-12-03T13:00:22.419 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.419 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:22.419 INFO:teuthology.orchestra.run.smithi003.stdout:________________________ test_object_lock_uploading_obj ________________________ 2023-12-03T13:00:22.419 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.419 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.419 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.419 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:22.419 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:22.419 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.419 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:22.420 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:22.420 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:22.420 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:22.420 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:22.420 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.420 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:22.420 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:22.420 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.420 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.420 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:22.420 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:22.420 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.420 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.420 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:22.421 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.421 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:22.421 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:22.421 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.421 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.421 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:22.421 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:22.421 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.421 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:22.421 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:22.421 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:22.421 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:22.421 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:22.421 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:22.421 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:22.422 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.422 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:22.422 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:22.422 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:22.422 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:22.422 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:22.422 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:22.422 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:22.422 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:22.422 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:22.422 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.422 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:22.422 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:22.422 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:22.423 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:22.423 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.423 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:22.423 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:22.423 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:22.423 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:22.423 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.423 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.423 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:22.423 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:22.423 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:22.423 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:22.423 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.423 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.424 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:22.424 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:22.424 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:22.424 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.424 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:22.424 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.424 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:22.424 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:22.424 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.424 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:22.424 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:22.424 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:22.424 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:22.424 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:22.424 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:22.425 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.425 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:22.425 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.425 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:22.425 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.425 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.425 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:22.425 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.425 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:22.425 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.425 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:22.425 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:22.425 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:22.425 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:22.425 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:22.425 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:22.426 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:22.426 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:22.426 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:22.426 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:22.426 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:22.426 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:22.426 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:22.426 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.426 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:22.426 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:22.426 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:22.426 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:22.426 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:22.426 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:22.427 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:22.427 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:22.427 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:22.427 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:22.427 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:22.427 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.427 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.427 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:22.427 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.427 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:22.427 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:22.427 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:22.427 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:22.427 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:22.427 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:22.428 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:22.428 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:22.428 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:22.428 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:22.428 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:22.428 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:22.428 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:22.428 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:22.428 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:22.428 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:22.428 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:22.428 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:22.428 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:22.428 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:22.428 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:22.428 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:22.429 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:22.429 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:22.429 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:22.429 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:22.429 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:22.429 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:22.429 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.429 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.429 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.429 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.429 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:22.429 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:22.429 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.429 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:22.429 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:22.430 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:22.430 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:22.430 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:22.430 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.430 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:22.430 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:22.430 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.430 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.430 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:22.430 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:22.430 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.430 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.430 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:22.430 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:22.431 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:22.431 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:22.431 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:22.431 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.431 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.431 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:22.431 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:22.431 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:22.431 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.431 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:22.431 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.431 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:22.431 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.431 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:22.432 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.432 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T13:00:22.432 INFO:teuthology.orchestra.run.smithi003.stdout: def test_object_lock_uploading_obj(): 2023-12-03T13:00:22.432 INFO:teuthology.orchestra.run.smithi003.stdout: bucket_name = get_new_bucket_name() 2023-12-03T13:00:22.432 INFO:teuthology.orchestra.run.smithi003.stdout: client = get_client() 2023-12-03T13:00:22.432 INFO:teuthology.orchestra.run.smithi003.stdout:> client.create_bucket(Bucket=bucket_name, ObjectLockEnabledForBucket=True) 2023-12-03T13:00:22.432 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.432 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:12253: 2023-12-03T13:00:22.432 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.432 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:22.432 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:22.432 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:22.432 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:22.432 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:22.432 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:22.432 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:22.433 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:22.433 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:22.433 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:22.433 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:22.433 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:22.433 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:22.433 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:22.433 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:22.433 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:22.433 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:22.433 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:22.433 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:22.433 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:22.433 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:22.434 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:22.434 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:22.434 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:22.434 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:22.434 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:22.434 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:22.434 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:22.434 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:22.434 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:22.434 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:22.434 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:22.434 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:22.434 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:22.434 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.434 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.435 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.435 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:22.435 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.435 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:22.435 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.435 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:22.435 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:22.435 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:22.435 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:22.435 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:22.435 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:22.435 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:22.435 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:22.435 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:22.435 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:22.436 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:22.436 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:22.436 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:22.436 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.436 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:22.436 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:22.436 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:22.436 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:22.436 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:22.436 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:22.436 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:22.436 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:22.436 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:22.436 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:22.437 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:22.437 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.437 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.437 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:22.437 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:22.437 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:22.437 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:22.437 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:22.437 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.437 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.437 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:22.437 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:22.437 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:22.437 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:22.437 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:22.437 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.438 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:22.438 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:22.438 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:22.438 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:22.438 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:22.438 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-500" 2023-12-03T13:00:22.438 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.438 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:22.438 INFO:teuthology.orchestra.run.smithi003.stdout:__________ test_object_lock_changing_mode_from_governance_with_bypass __________ 2023-12-03T13:00:22.438 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.438 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.438 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.438 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:22.438 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:22.439 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.439 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:22.439 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:22.439 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:22.439 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:22.439 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:22.439 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.439 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:22.439 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:22.439 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.439 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.439 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:22.439 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:22.439 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.439 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.440 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:22.440 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.440 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:22.440 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:22.440 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.440 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.440 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:22.440 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:22.440 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.440 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:22.440 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:22.440 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:22.440 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:22.440 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:22.440 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:22.441 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:22.441 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.441 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:22.441 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:22.441 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:22.441 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:22.441 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:22.441 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:22.441 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:22.441 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:22.441 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:22.441 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.441 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:22.441 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:22.442 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:22.442 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:22.442 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.442 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:22.442 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:22.442 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:22.442 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:22.442 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.442 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.442 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:22.442 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:22.442 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:22.442 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:22.442 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.443 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.443 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:22.443 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:22.443 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:22.443 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.443 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:22.443 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.443 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:22.443 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:22.443 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.443 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:22.443 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:22.443 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:22.443 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:22.443 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:22.444 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:22.444 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.444 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:22.444 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.444 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:22.444 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.444 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.444 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:22.444 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.444 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:22.444 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.444 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:22.444 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:22.444 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:22.444 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:22.445 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:22.445 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:22.445 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:22.445 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:22.445 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:22.445 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:22.445 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:22.445 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:22.445 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:22.445 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.445 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:22.445 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:22.445 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:22.445 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:22.446 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:22.446 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:22.446 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:22.446 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:22.446 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:22.446 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:22.446 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:22.446 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.446 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.446 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:22.446 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.446 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:22.446 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:22.446 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:22.446 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:22.447 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:22.447 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:22.447 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:22.447 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:22.447 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:22.447 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:22.447 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:22.447 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:22.447 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:22.447 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:22.447 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:22.447 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:22.447 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:22.447 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:22.447 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:22.448 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:22.448 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:22.448 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:22.448 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:22.448 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:22.448 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:22.448 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:22.448 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:22.448 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:22.448 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.448 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.448 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.448 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.448 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:22.448 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:22.448 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.449 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:22.449 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:22.449 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:22.449 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:22.449 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:22.449 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.449 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:22.449 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:22.449 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.449 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.449 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:22.449 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:22.449 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.449 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.449 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:22.450 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:22.450 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:22.450 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:22.450 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:22.450 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.450 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.450 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:22.450 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:22.450 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:22.450 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.450 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:22.450 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.450 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:22.450 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.451 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:22.451 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.451 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T13:00:22.451 INFO:teuthology.orchestra.run.smithi003.stdout: def test_object_lock_changing_mode_from_governance_with_bypass(): 2023-12-03T13:00:22.451 INFO:teuthology.orchestra.run.smithi003.stdout: bucket_name = get_new_bucket_name() 2023-12-03T13:00:22.451 INFO:teuthology.orchestra.run.smithi003.stdout: key = 'file1' 2023-12-03T13:00:22.451 INFO:teuthology.orchestra.run.smithi003.stdout: client = get_client() 2023-12-03T13:00:22.451 INFO:teuthology.orchestra.run.smithi003.stdout:> client.create_bucket(Bucket=bucket_name, ObjectLockEnabledForBucket=True) 2023-12-03T13:00:22.451 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.451 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:12270: 2023-12-03T13:00:22.451 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.451 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:22.451 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:22.451 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:22.451 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:22.451 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:22.452 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:22.452 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:22.452 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:22.452 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:22.452 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:22.452 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:22.452 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:22.452 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:22.452 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:22.452 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:22.452 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:22.452 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:22.452 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:22.452 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:22.453 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:22.453 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:22.453 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:22.453 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:22.453 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:22.453 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:22.453 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:22.453 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:22.453 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:22.453 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:22.453 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:22.453 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:22.453 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:22.453 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:22.453 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:22.454 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.454 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.454 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.454 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:22.454 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.454 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:22.454 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.454 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:22.454 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:22.454 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:22.454 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:22.454 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:22.455 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:22.455 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:22.455 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:22.455 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:22.455 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:22.455 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:22.455 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:22.455 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:22.455 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.455 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:22.455 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:22.455 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:22.455 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:22.455 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:22.455 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:22.455 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:22.456 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:22.456 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:22.456 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:22.456 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:22.456 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.456 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.456 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:22.456 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:22.456 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:22.456 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:22.456 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:22.456 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.456 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.456 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:22.456 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:22.457 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:22.457 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:22.457 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:22.457 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.457 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:22.457 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:22.457 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:22.457 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:22.457 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:22.457 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-501" 2023-12-03T13:00:22.457 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.457 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:22.457 INFO:teuthology.orchestra.run.smithi003.stdout:________ test_object_lock_changing_mode_from_governance_without_bypass _________ 2023-12-03T13:00:22.457 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.457 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.458 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.458 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:22.458 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:22.458 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.458 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:22.458 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:22.458 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:22.458 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:22.458 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:22.458 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.458 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:22.458 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:22.458 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.458 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.459 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:22.459 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:22.459 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.459 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.459 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:22.459 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.459 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:22.459 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:22.459 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.459 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.459 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:22.459 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:22.459 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.459 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:22.459 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:22.460 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:22.460 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:22.460 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:22.460 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:22.460 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:22.460 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.460 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:22.460 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:22.460 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:22.460 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:22.460 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:22.460 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:22.460 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:22.460 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:22.460 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:22.461 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.461 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:22.461 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:22.461 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:22.461 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:22.461 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.461 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:22.461 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:22.461 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:22.461 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:22.461 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.461 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.461 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:22.461 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:22.461 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:22.462 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:22.462 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.462 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.462 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:22.462 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:22.462 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:22.462 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.462 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:22.462 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.462 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:22.462 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:22.462 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.462 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:22.462 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:22.463 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:22.463 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:22.463 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:22.463 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:22.463 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.463 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:22.463 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.463 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:22.463 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.463 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.463 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:22.463 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.463 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:22.463 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.463 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:22.464 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:22.464 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:22.464 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:22.464 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:22.464 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:22.464 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:22.464 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:22.464 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:22.464 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:22.464 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:22.464 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:22.464 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:22.464 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.464 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:22.464 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:22.465 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:22.465 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:22.465 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:22.465 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:22.465 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:22.465 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:22.465 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:22.465 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:22.465 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:22.465 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.465 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.465 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:22.465 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.465 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:22.465 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:22.465 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:22.466 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:22.466 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:22.466 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:22.466 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:22.466 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:22.466 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:22.466 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:22.466 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:22.466 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:22.466 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:22.466 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:22.466 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:22.466 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:22.467 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:22.467 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:22.467 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:22.467 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:22.467 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:22.467 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:22.467 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:22.467 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:22.467 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:22.467 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:22.467 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:22.467 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:22.467 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.467 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.468 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.468 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.468 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:22.468 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:22.468 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.468 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:22.468 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:22.468 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:22.468 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:22.468 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:22.468 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.468 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:22.468 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:22.468 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.468 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.468 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:22.469 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:22.469 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.469 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.469 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:22.469 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:22.469 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:22.469 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:22.469 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:22.469 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.469 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.469 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:22.469 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:22.469 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:22.469 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.469 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:22.470 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.470 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:22.470 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.470 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:22.470 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.470 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T13:00:22.470 INFO:teuthology.orchestra.run.smithi003.stdout: def test_object_lock_changing_mode_from_governance_without_bypass(): 2023-12-03T13:00:22.470 INFO:teuthology.orchestra.run.smithi003.stdout: bucket_name = get_new_bucket_name() 2023-12-03T13:00:22.470 INFO:teuthology.orchestra.run.smithi003.stdout: key = 'file1' 2023-12-03T13:00:22.470 INFO:teuthology.orchestra.run.smithi003.stdout: client = get_client() 2023-12-03T13:00:22.470 INFO:teuthology.orchestra.run.smithi003.stdout:> client.create_bucket(Bucket=bucket_name, ObjectLockEnabledForBucket=True) 2023-12-03T13:00:22.470 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.470 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:12284: 2023-12-03T13:00:22.470 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.471 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:22.471 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:22.471 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:22.471 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:22.471 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:22.471 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:22.471 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:22.471 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:22.471 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:22.471 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:22.471 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:22.471 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:22.471 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:22.471 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:22.472 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:22.472 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:22.472 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:22.472 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:22.472 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:22.472 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:22.472 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:22.472 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:22.472 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:22.472 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:22.472 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:22.472 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:22.472 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:22.472 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:22.472 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:22.473 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:22.473 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:22.473 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:22.473 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:22.473 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:22.473 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.473 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.473 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.473 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:22.473 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.473 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:22.473 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.473 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:22.473 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:22.474 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:22.474 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:22.474 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:22.474 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:22.474 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:22.474 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:22.474 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:22.474 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:22.474 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:22.474 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:22.474 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:22.474 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.474 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:22.474 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:22.475 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:22.475 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:22.475 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:22.475 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:22.475 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:22.475 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:22.475 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:22.475 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:22.475 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:22.475 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.475 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.475 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:22.475 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:22.475 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:22.476 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:22.476 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:22.476 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.476 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.476 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:22.476 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:22.476 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:22.476 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:22.476 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:22.476 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.476 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:22.476 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:22.476 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:22.476 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:22.476 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:22.477 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-502" 2023-12-03T13:00:22.477 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.477 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:22.477 INFO:teuthology.orchestra.run.smithi003.stdout:________________ test_object_lock_changing_mode_from_compliance ________________ 2023-12-03T13:00:22.477 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.477 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.477 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.477 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:22.477 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:22.477 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.477 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:22.477 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:22.477 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:22.477 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:22.478 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:22.478 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.478 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:22.478 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:22.478 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.478 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.478 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:22.478 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:22.478 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.478 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.478 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:22.478 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.478 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:22.478 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:22.478 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.479 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.479 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:22.479 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:22.479 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.479 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:22.479 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:22.479 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:22.479 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:22.479 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:22.479 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:22.479 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:22.479 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.479 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:22.479 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:22.479 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:22.480 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:22.480 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:22.480 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:22.480 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:22.480 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:22.480 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:22.480 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.480 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:22.480 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:22.480 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:22.480 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:22.480 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.480 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:22.480 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:22.481 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:22.481 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:22.481 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.481 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.481 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:22.481 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:22.481 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:22.481 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:22.481 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.481 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.481 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:22.481 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:22.481 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:22.481 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.481 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:22.481 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.482 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:22.482 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:22.482 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.482 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:22.482 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:22.482 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:22.482 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:22.482 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:22.482 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:22.482 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.482 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:22.482 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.482 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:22.482 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.483 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.483 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:22.483 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.483 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:22.483 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.483 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:22.483 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:22.483 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:22.483 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:22.483 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:22.483 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:22.483 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:22.483 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:22.484 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:22.484 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:22.484 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:22.484 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:22.484 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:22.484 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.484 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:22.484 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:22.484 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:22.484 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:22.484 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:22.484 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:22.484 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:22.484 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:22.484 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:22.484 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:22.485 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:22.485 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.485 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.485 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:22.485 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.485 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:22.485 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:22.485 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:22.485 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:22.485 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:22.485 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:22.485 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:22.485 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:22.485 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:22.485 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:22.486 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:22.486 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:22.486 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:22.486 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:22.486 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:22.486 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:22.486 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:22.486 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:22.486 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:22.486 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:22.486 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:22.486 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:22.486 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:22.486 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:22.486 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:22.487 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:22.487 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:22.487 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:22.487 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.487 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.487 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.487 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.487 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:22.487 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:22.487 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.487 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:22.487 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:22.487 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:22.487 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:22.487 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:22.488 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.488 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:22.488 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:22.488 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.488 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.488 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:22.488 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:22.488 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.488 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.488 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:22.488 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:22.488 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:22.488 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:22.488 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:22.488 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.488 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.488 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:22.489 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:22.489 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:22.489 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.489 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:22.489 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.489 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:22.489 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.489 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:22.489 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.489 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T13:00:22.489 INFO:teuthology.orchestra.run.smithi003.stdout: def test_object_lock_changing_mode_from_compliance(): 2023-12-03T13:00:22.489 INFO:teuthology.orchestra.run.smithi003.stdout: bucket_name = get_new_bucket_name() 2023-12-03T13:00:22.489 INFO:teuthology.orchestra.run.smithi003.stdout: key = 'file1' 2023-12-03T13:00:22.489 INFO:teuthology.orchestra.run.smithi003.stdout: client = get_client() 2023-12-03T13:00:22.489 INFO:teuthology.orchestra.run.smithi003.stdout:> client.create_bucket(Bucket=bucket_name, ObjectLockEnabledForBucket=True) 2023-12-03T13:00:22.490 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.490 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:12301: 2023-12-03T13:00:22.490 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.490 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:22.490 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:22.490 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:22.490 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:22.490 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:22.490 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:22.490 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:22.490 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:22.490 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:22.490 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:22.491 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:22.491 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:22.491 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:22.491 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:22.491 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:22.491 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:22.491 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:22.491 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:22.491 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:22.491 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:22.491 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:22.491 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:22.491 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:22.491 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:22.491 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:22.492 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:22.492 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:22.492 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:22.492 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:22.492 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:22.492 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:22.492 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:22.492 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:22.492 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:22.492 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.492 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.492 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.492 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:22.492 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.492 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:22.493 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.493 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:22.493 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:22.493 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:22.493 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:22.493 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:22.493 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:22.493 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:22.493 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:22.493 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:22.493 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:22.493 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:22.493 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:22.493 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:22.493 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.494 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:22.494 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:22.494 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:22.494 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:22.494 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:22.494 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:22.494 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:22.494 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:22.494 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:22.494 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:22.494 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:22.494 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.494 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.494 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:22.495 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:22.495 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:22.495 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:22.495 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:22.495 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.495 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.495 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:22.495 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:22.495 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:22.495 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:22.495 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:22.495 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.495 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:22.495 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:22.495 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:22.496 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:22.496 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:22.496 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-503" 2023-12-03T13:00:22.496 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.496 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:22.496 INFO:teuthology.orchestra.run.smithi003.stdout:________________________ test_copy_object_ifmatch_good _________________________ 2023-12-03T13:00:22.496 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.496 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.496 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.496 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:22.496 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:22.496 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.496 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:22.496 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:22.496 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:22.497 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:22.497 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:22.497 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.497 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:22.497 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:22.497 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.497 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.497 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:22.497 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:22.497 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.497 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.497 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:22.497 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.497 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:22.497 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:22.498 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.498 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.498 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:22.498 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:22.498 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.498 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:22.498 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:22.498 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:22.498 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:22.498 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:22.498 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:22.498 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:22.498 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.498 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:22.498 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:22.499 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:22.499 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:22.499 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:22.499 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:22.499 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:22.499 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:22.499 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:22.499 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.499 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:22.499 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:22.499 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:22.499 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:22.499 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.499 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:22.499 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:22.500 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:22.500 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:22.500 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.500 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.500 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:22.500 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:22.500 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:22.500 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:22.500 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.500 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.500 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:22.500 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:22.500 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:22.500 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.500 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:22.500 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.501 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:22.501 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:22.501 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.501 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:22.501 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:22.501 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:22.501 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:22.501 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:22.501 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:22.501 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.501 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:22.501 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.501 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:22.502 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.502 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.502 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:22.502 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.502 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:22.502 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.502 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:22.502 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:22.502 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:22.502 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:22.502 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:22.502 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:22.502 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:22.502 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:22.502 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:22.503 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:22.503 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:22.503 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:22.503 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:22.503 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.503 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:22.503 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:22.503 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:22.503 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:22.503 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:22.503 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:22.503 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:22.503 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:22.503 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:22.503 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:22.504 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:22.504 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.504 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.504 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:22.504 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.504 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:22.504 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:22.504 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:22.504 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:22.504 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:22.504 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:22.504 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:22.504 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:22.504 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:22.505 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:22.505 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:22.505 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:22.505 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:22.505 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:22.505 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:22.505 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:22.505 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:22.505 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:22.505 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:22.505 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:22.505 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:22.505 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:22.505 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:22.505 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:22.505 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:22.506 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:22.506 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:22.506 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:22.506 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.506 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.506 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.506 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.506 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:22.506 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:22.506 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.506 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:22.506 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:22.506 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:22.506 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:22.506 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:22.507 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.507 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:22.507 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:22.507 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.507 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.507 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:22.507 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:22.507 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.507 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.507 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:22.507 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:22.507 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:22.507 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:22.507 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:22.508 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.508 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.508 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:22.508 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:22.508 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:22.508 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.508 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:22.508 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.508 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:22.508 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.508 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:22.508 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.508 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T13:00:22.508 INFO:teuthology.orchestra.run.smithi003.stdout: def test_copy_object_ifmatch_good(): 2023-12-03T13:00:22.509 INFO:teuthology.orchestra.run.smithi003.stdout:> bucket_name = get_new_bucket() 2023-12-03T13:00:22.509 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.509 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:12315: 2023-12-03T13:00:22.509 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.509 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:22.509 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:22.509 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:22.509 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:22.509 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:22.509 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:22.509 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:22.509 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:22.509 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:22.509 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:22.509 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:22.510 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:22.510 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:22.510 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:22.510 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:22.510 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:22.510 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:22.510 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:22.510 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:22.510 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:22.510 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:22.510 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:22.510 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:22.510 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:22.510 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:22.511 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:22.511 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:22.511 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:22.511 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:22.511 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:22.511 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:22.511 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:22.511 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:22.511 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:22.511 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:22.511 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:22.511 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.511 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.511 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.511 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:22.512 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.512 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:22.512 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.512 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:22.512 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:22.512 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:22.512 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:22.512 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:22.512 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:22.512 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:22.512 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:22.512 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:22.512 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:22.512 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:22.513 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:22.513 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:22.513 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.513 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:22.513 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:22.513 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:22.513 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:22.513 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:22.513 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:22.513 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:22.513 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:22.513 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:22.513 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:22.513 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:22.513 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.513 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.514 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:22.514 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:22.514 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:22.514 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:22.514 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:22.514 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.514 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.514 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:22.514 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:22.514 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:22.514 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:22.514 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:22.514 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.514 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:22.515 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:22.515 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:22.515 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:22.515 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:22.515 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-504" 2023-12-03T13:00:22.515 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.515 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:22.515 INFO:teuthology.orchestra.run.smithi003.stdout:_____________________ test_copy_object_ifnonematch_failed ______________________ 2023-12-03T13:00:22.515 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.515 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.515 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.515 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:22.515 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:22.515 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.515 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:22.516 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:22.516 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:22.516 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:22.516 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:22.516 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.516 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:22.516 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:22.516 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.516 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.516 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:22.516 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:22.516 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.516 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.516 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:22.516 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.516 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:22.517 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:22.517 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.517 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.517 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:22.517 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:22.517 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.517 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:22.517 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:22.517 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:22.517 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:22.517 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:22.517 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:22.517 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:22.517 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.517 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:22.517 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:22.518 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:22.518 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:22.518 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:22.518 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:22.518 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:22.518 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:22.518 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:22.518 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.518 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:22.518 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:22.518 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:22.518 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:22.518 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.518 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:22.519 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:22.519 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:22.519 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:22.519 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.519 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.519 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:22.519 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:22.519 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:22.519 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:22.519 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.519 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.519 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:22.519 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:22.519 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:22.520 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.520 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:22.520 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.520 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:22.520 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:22.520 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.520 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:22.520 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:22.520 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:22.520 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:22.520 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:22.520 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:22.520 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.520 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:22.520 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.521 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:22.521 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.521 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.521 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:22.521 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.521 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:22.521 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.521 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:22.521 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:22.521 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:22.521 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:22.521 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:22.521 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:22.521 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:22.521 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:22.522 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:22.522 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:22.522 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:22.522 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:22.522 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:22.522 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.522 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:22.522 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:22.522 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:22.522 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:22.522 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:22.522 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:22.522 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:22.522 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:22.523 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:22.523 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:22.523 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:22.523 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.523 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.523 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:22.523 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.523 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:22.523 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:22.523 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:22.523 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:22.523 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:22.523 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:22.523 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:22.523 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:22.523 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:22.524 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:22.524 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:22.524 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:22.524 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:22.524 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:22.524 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:22.524 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:22.524 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:22.524 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:22.524 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:22.524 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:22.524 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:22.524 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:22.524 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:22.524 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:22.525 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:22.525 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:22.525 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:22.525 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:22.525 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.525 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.525 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.525 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.525 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:22.525 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:22.525 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.525 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:22.525 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:22.525 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:22.525 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:22.526 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:22.526 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.526 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:22.526 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:22.526 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.526 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.526 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:22.526 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:22.526 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.526 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.526 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:22.526 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:22.526 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:22.526 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:22.527 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:22.527 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.527 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.527 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:22.527 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:22.527 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:22.527 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.527 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:22.527 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.527 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:22.527 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.527 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:22.527 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.527 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T13:00:22.527 INFO:teuthology.orchestra.run.smithi003.stdout: def test_copy_object_ifnonematch_failed(): 2023-12-03T13:00:22.527 INFO:teuthology.orchestra.run.smithi003.stdout:> bucket_name = get_new_bucket() 2023-12-03T13:00:22.528 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.528 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:12350: 2023-12-03T13:00:22.528 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.528 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:22.528 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:22.528 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:22.528 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:22.528 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:22.528 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:22.528 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:22.528 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:22.528 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:22.528 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:22.528 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:22.528 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:22.528 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:22.529 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:22.529 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:22.529 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:22.529 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:22.529 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:22.529 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:22.529 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:22.529 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:22.529 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:22.529 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:22.529 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:22.529 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:22.529 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:22.529 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:22.529 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:22.530 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:22.530 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:22.530 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:22.530 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:22.530 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:22.530 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:22.530 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:22.530 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:22.530 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.530 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.530 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.530 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:22.530 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.530 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:22.531 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.531 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:22.531 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:22.531 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:22.531 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:22.531 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:22.531 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:22.531 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:22.531 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:22.531 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:22.531 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:22.531 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:22.531 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:22.531 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:22.531 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.532 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:22.532 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:22.532 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:22.532 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:22.532 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:22.532 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:22.532 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:22.532 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:22.532 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:22.532 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:22.532 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:22.532 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.532 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.532 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:22.532 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:22.533 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:22.533 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:22.533 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:22.533 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.533 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.533 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:22.533 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:22.533 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:22.533 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:22.533 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:22.533 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.533 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:22.533 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:22.533 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:22.533 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:22.534 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:22.534 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-505" 2023-12-03T13:00:22.534 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.534 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:22.534 INFO:teuthology.orchestra.run.smithi003.stdout:________________________ test_get_bucket_policy_status _________________________ 2023-12-03T13:00:22.534 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.534 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.534 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.534 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:22.534 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:22.534 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.534 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:22.534 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:22.534 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:22.534 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:22.535 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:22.535 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.535 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:22.535 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:22.535 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.535 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.535 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:22.535 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:22.535 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.535 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.535 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:22.535 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.535 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:22.535 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:22.535 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.535 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.536 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:22.536 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:22.536 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.536 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:22.536 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:22.536 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:22.536 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:22.536 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:22.536 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:22.536 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:22.536 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.536 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:22.536 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:22.536 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:22.537 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:22.537 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:22.537 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:22.537 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:22.537 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:22.537 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:22.537 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.537 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:22.537 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:22.537 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:22.537 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:22.537 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.537 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:22.537 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:22.537 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:22.537 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:22.538 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.538 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.538 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:22.538 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:22.538 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:22.538 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:22.538 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.538 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.538 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:22.538 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:22.538 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:22.538 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.538 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:22.538 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.539 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:22.539 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:22.539 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.539 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:22.539 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:22.539 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:22.539 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:22.539 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:22.539 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:22.539 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.539 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:22.539 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.539 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:22.539 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.540 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.540 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:22.540 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.540 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:22.540 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.540 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:22.540 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:22.540 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:22.540 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:22.540 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:22.540 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:22.540 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:22.540 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:22.540 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:22.540 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:22.541 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:22.541 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:22.541 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:22.541 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.541 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:22.541 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:22.541 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:22.541 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:22.541 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:22.541 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:22.541 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:22.541 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:22.541 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:22.541 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:22.541 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:22.542 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.542 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.542 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:22.542 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.542 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:22.542 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:22.542 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:22.542 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:22.542 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:22.542 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:22.542 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:22.542 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:22.542 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:22.543 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:22.543 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:22.543 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:22.543 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:22.543 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:22.543 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:22.543 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:22.543 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:22.543 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:22.543 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:22.543 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:22.543 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:22.543 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:22.543 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:22.543 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:22.543 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:22.544 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:22.544 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:22.544 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:22.544 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.544 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.544 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.544 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.544 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:22.544 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:22.544 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.544 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:22.544 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:22.544 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:22.544 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:22.544 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:22.545 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.545 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:22.545 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:22.545 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.545 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.545 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:22.545 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:22.545 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.545 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.545 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:22.545 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:22.545 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:22.545 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:22.545 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:22.545 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.546 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.546 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:22.546 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:22.546 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:22.546 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.546 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:22.546 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.546 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:22.546 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.546 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:22.546 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.546 INFO:teuthology.orchestra.run.smithi003.stdout: def test_get_bucket_policy_status(): 2023-12-03T13:00:22.546 INFO:teuthology.orchestra.run.smithi003.stdout:> bucket_name = get_new_bucket() 2023-12-03T13:00:22.546 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.546 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:12370: 2023-12-03T13:00:22.547 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.547 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:22.547 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:22.547 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:22.547 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:22.547 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:22.547 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:22.547 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:22.547 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:22.547 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:22.547 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:22.547 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:22.547 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:22.547 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:22.547 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:22.548 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:22.548 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:22.548 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:22.548 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:22.548 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:22.548 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:22.548 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:22.548 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:22.548 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:22.548 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:22.548 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:22.548 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:22.548 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:22.548 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:22.548 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:22.548 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:22.549 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:22.549 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:22.549 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:22.549 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:22.549 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:22.549 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:22.549 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.549 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.549 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.549 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:22.549 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.549 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:22.549 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.549 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:22.549 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:22.550 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:22.550 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:22.550 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:22.550 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:22.550 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:22.550 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:22.550 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:22.550 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:22.550 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:22.550 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:22.550 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:22.550 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.550 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:22.550 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:22.551 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:22.551 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:22.551 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:22.551 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:22.551 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:22.551 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:22.551 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:22.551 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:22.551 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:22.551 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.551 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.551 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:22.551 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:22.551 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:22.551 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:22.551 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:22.552 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.552 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.552 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:22.552 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:22.552 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:22.552 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:22.552 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:22.552 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.552 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:22.552 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:22.552 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:22.552 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:22.552 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:22.552 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-506" 2023-12-03T13:00:22.553 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.553 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:22.553 INFO:teuthology.orchestra.run.smithi003.stdout:___________________ test_get_public_acl_bucket_policy_status ___________________ 2023-12-03T13:00:22.553 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.553 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.553 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.553 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:22.553 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:22.553 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.553 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:22.553 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:22.553 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:22.553 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:22.553 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:22.553 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.553 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:22.554 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:22.554 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.554 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.554 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:22.554 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:22.554 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.554 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.554 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:22.554 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.554 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:22.554 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:22.554 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.554 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.554 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:22.555 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:22.555 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.555 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:22.555 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:22.555 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:22.555 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:22.555 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:22.555 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:22.555 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:22.555 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.555 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:22.555 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:22.555 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:22.555 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:22.555 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:22.555 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:22.556 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:22.556 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:22.556 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:22.556 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.556 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:22.556 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:22.556 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:22.556 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:22.556 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.556 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:22.556 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:22.556 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:22.556 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:22.556 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.556 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.557 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:22.557 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:22.557 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:22.557 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:22.557 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.557 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.557 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:22.557 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:22.557 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:22.557 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.557 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:22.557 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.557 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:22.557 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:22.557 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.557 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:22.558 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:22.558 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:22.558 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:22.558 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:22.558 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:22.558 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.558 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:22.558 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.558 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:22.558 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.558 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.558 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:22.558 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.558 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:22.559 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.559 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:22.559 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:22.559 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:22.559 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:22.559 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:22.559 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:22.559 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:22.559 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:22.559 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:22.559 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:22.559 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:22.559 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:22.559 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:22.560 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.560 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:22.560 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:22.560 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:22.560 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:22.560 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:22.560 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:22.560 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:22.560 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:22.560 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:22.560 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:22.560 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:22.560 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.560 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.560 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:22.560 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.561 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:22.561 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:22.561 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:22.561 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:22.561 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:22.561 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:22.561 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:22.561 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:22.561 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:22.561 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:22.561 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:22.561 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:22.561 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:22.561 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:22.561 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:22.562 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:22.562 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:22.562 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:22.562 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:22.562 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:22.562 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:22.562 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:22.562 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:22.562 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:22.562 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:22.562 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:22.562 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:22.562 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:22.562 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.562 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.563 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.563 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.563 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:22.563 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:22.563 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.563 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:22.563 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:22.563 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:22.563 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:22.563 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:22.563 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.563 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:22.563 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:22.563 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.564 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.564 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:22.564 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:22.564 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.564 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.564 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:22.564 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:22.564 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:22.564 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:22.564 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:22.564 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.564 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.564 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:22.564 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:22.564 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:22.565 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.565 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:22.565 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.565 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:22.565 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.565 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:22.565 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.565 INFO:teuthology.orchestra.run.smithi003.stdout: def test_get_public_acl_bucket_policy_status(): 2023-12-03T13:00:22.565 INFO:teuthology.orchestra.run.smithi003.stdout:> bucket_name = get_new_bucket() 2023-12-03T13:00:22.565 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.565 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:12376: 2023-12-03T13:00:22.565 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.565 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:22.565 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:22.565 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:22.565 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:22.566 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:22.566 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:22.566 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:22.566 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:22.566 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:22.566 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:22.566 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:22.566 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:22.566 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:22.566 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:22.566 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:22.566 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:22.566 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:22.566 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:22.567 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:22.567 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:22.567 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:22.567 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:22.567 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:22.567 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:22.567 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:22.567 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:22.567 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:22.567 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:22.567 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:22.567 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:22.567 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:22.567 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:22.567 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:22.567 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:22.568 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:22.568 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:22.568 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.568 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.568 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.568 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:22.568 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.568 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:22.568 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.568 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:22.568 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:22.568 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:22.568 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:22.568 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:22.568 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:22.569 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:22.569 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:22.569 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:22.569 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:22.569 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:22.569 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:22.569 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:22.569 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.569 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:22.569 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:22.569 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:22.569 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:22.569 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:22.569 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:22.570 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:22.570 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:22.570 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:22.570 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:22.570 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:22.570 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.570 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.570 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:22.570 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:22.570 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:22.570 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:22.570 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:22.570 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.570 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.570 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:22.571 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:22.571 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:22.571 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:22.571 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:22.571 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.571 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:22.571 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:22.571 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:22.571 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:22.571 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:22.571 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-507" 2023-12-03T13:00:22.571 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.571 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:22.571 INFO:teuthology.orchestra.run.smithi003.stdout:_________________ test_get_authpublic_acl_bucket_policy_status _________________ 2023-12-03T13:00:22.572 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.572 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.572 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.572 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:22.572 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:22.572 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.572 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:22.572 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:22.572 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:22.572 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:22.572 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:22.572 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.572 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:22.572 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:22.572 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.572 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.573 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:22.573 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:22.573 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.573 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.573 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:22.573 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.573 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:22.573 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:22.573 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.573 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.573 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:22.573 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:22.573 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.573 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:22.573 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:22.574 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:22.574 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:22.574 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:22.574 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:22.574 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:22.574 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.574 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:22.574 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:22.574 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:22.574 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:22.574 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:22.574 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:22.574 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:22.574 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:22.574 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:22.575 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.575 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:22.575 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:22.575 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:22.575 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:22.575 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.575 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:22.575 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:22.575 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:22.575 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:22.575 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.575 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.575 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:22.575 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:22.575 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:22.576 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:22.576 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.576 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.576 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:22.576 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:22.576 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:22.576 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.576 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:22.576 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.576 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:22.576 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:22.576 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.576 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:22.576 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:22.576 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:22.577 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:22.577 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:22.577 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:22.577 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.577 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:22.577 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.577 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:22.577 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.577 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.577 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:22.577 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.577 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:22.577 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.577 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:22.577 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:22.577 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:22.578 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:22.578 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:22.578 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:22.578 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:22.578 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:22.578 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:22.578 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:22.578 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:22.578 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:22.578 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:22.578 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.578 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:22.578 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:22.578 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:22.578 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:22.579 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:22.579 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:22.579 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:22.579 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:22.579 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:22.579 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:22.579 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:22.579 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.579 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.579 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:22.579 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.579 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:22.579 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:22.579 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:22.579 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:22.580 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:22.580 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:22.580 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:22.580 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:22.580 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:22.580 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:22.580 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:22.580 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:22.580 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:22.580 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:22.580 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:22.580 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:22.580 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:22.580 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:22.580 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:22.581 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:22.581 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:22.581 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:22.581 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:22.581 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:22.581 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:22.581 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:22.581 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:22.581 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:22.581 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.581 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.581 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.581 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.581 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:22.581 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:22.582 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.582 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:22.582 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:22.582 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:22.582 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:22.582 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:22.582 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.582 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:22.582 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:22.582 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.582 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.582 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:22.582 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:22.582 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.583 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.583 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:22.583 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:22.583 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:22.583 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:22.583 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:22.583 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.583 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.583 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:22.583 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:22.583 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:22.583 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.583 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:22.583 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.583 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:22.583 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.584 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:22.584 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.584 INFO:teuthology.orchestra.run.smithi003.stdout: def test_get_authpublic_acl_bucket_policy_status(): 2023-12-03T13:00:22.584 INFO:teuthology.orchestra.run.smithi003.stdout:> bucket_name = get_new_bucket() 2023-12-03T13:00:22.584 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.584 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:12383: 2023-12-03T13:00:22.584 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.584 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:22.584 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:22.584 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:22.584 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:22.584 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:22.584 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:22.584 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:22.584 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:22.585 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:22.585 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:22.585 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:22.585 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:22.585 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:22.585 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:22.585 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:22.585 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:22.585 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:22.585 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:22.585 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:22.585 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:22.585 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:22.585 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:22.585 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:22.586 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:22.586 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:22.586 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:22.586 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:22.586 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:22.586 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:22.586 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:22.586 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:22.586 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:22.586 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:22.586 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:22.586 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:22.586 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:22.586 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.586 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.587 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.587 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:22.587 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.587 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:22.587 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.587 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:22.587 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:22.587 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:22.587 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:22.587 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:22.587 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:22.587 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:22.587 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:22.587 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:22.587 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:22.588 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:22.588 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:22.588 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:22.588 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.588 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:22.588 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:22.588 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:22.588 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:22.588 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:22.588 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:22.588 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:22.588 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:22.588 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:22.588 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:22.588 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:22.588 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.589 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.589 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:22.589 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:22.589 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:22.589 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:22.589 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:22.589 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.589 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.589 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:22.589 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:22.589 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:22.589 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:22.589 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:22.589 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.589 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:22.589 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:22.590 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:22.590 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:22.590 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:22.590 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-508" 2023-12-03T13:00:22.590 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.590 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:22.590 INFO:teuthology.orchestra.run.smithi003.stdout:________________ test_get_publicpolicy_acl_bucket_policy_status ________________ 2023-12-03T13:00:22.590 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.590 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.590 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.590 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:22.590 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:22.590 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.590 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:22.590 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:22.591 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:22.591 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:22.591 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:22.591 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.591 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:22.591 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:22.591 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.591 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.591 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:22.591 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:22.591 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.591 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.591 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:22.591 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.592 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:22.592 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:22.592 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.592 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.592 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:22.592 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:22.592 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.592 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:22.592 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:22.592 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:22.592 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:22.592 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:22.592 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:22.592 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:22.592 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.592 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:22.593 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:22.593 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:22.593 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:22.593 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:22.593 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:22.593 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:22.593 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:22.593 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:22.593 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.593 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:22.593 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:22.593 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:22.593 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:22.593 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.593 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:22.594 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:22.594 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:22.594 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:22.594 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.594 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.594 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:22.594 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:22.594 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:22.594 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:22.594 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.594 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.594 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:22.594 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:22.594 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:22.594 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.595 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:22.595 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.595 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:22.595 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:22.595 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.595 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:22.595 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:22.595 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:22.595 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:22.595 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:22.595 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:22.595 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.595 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:22.595 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.595 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:22.596 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.596 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.596 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:22.596 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.596 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:22.596 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.596 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:22.596 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:22.596 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:22.596 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:22.596 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:22.596 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:22.596 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:22.596 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:22.596 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:22.597 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:22.597 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:22.597 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:22.597 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:22.597 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.597 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:22.597 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:22.597 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:22.597 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:22.597 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:22.597 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:22.597 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:22.597 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:22.597 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:22.597 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:22.597 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:22.597 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.598 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.598 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:22.598 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.598 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:22.598 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:22.598 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:22.598 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:22.598 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:22.598 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:22.598 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:22.598 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:22.598 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:22.598 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:22.598 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:22.599 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:22.599 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:22.599 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:22.599 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:22.599 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:22.599 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:22.599 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:22.599 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:22.599 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:22.599 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:22.599 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:22.599 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:22.599 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:22.599 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:22.599 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:22.600 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:22.600 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:22.600 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.600 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.600 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.600 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.600 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:22.600 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:22.600 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.600 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:22.600 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:22.600 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:22.600 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:22.600 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:22.600 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.601 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:22.601 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:22.601 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.601 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.601 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:22.601 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:22.601 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.601 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.601 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:22.601 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:22.601 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:22.601 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:22.601 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:22.601 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.601 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.601 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:22.602 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:22.602 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:22.602 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.602 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:22.602 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.602 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:22.602 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.602 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:22.602 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.602 INFO:teuthology.orchestra.run.smithi003.stdout: def test_get_publicpolicy_acl_bucket_policy_status(): 2023-12-03T13:00:22.602 INFO:teuthology.orchestra.run.smithi003.stdout:> bucket_name = get_new_bucket() 2023-12-03T13:00:22.602 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.602 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:12391: 2023-12-03T13:00:22.602 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.602 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:22.603 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:22.603 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:22.603 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:22.603 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:22.603 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:22.603 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:22.603 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:22.603 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:22.603 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:22.603 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:22.603 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:22.603 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:22.603 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:22.603 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:22.603 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:22.603 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:22.604 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:22.604 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:22.604 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:22.604 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:22.604 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:22.604 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:22.604 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:22.604 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:22.604 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:22.604 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:22.604 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:22.604 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:22.604 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:22.604 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:22.604 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:22.605 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:22.605 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:22.605 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:22.605 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:22.605 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.605 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.605 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.605 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:22.605 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.605 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:22.605 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.605 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:22.605 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:22.605 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:22.605 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:22.605 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:22.606 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:22.606 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:22.606 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:22.606 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:22.606 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:22.606 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:22.606 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:22.606 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:22.606 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.606 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:22.606 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:22.606 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:22.606 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:22.606 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:22.606 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:22.607 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:22.607 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:22.607 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:22.607 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:22.607 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:22.608 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.609 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.609 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:22.609 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:22.609 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:22.609 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:22.609 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:22.609 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.609 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.609 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:22.609 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:22.609 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:22.609 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:22.609 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:22.610 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.610 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:22.610 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:22.610 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:22.610 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:22.610 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:22.610 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-509" 2023-12-03T13:00:22.610 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.610 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:22.610 INFO:teuthology.orchestra.run.smithi003.stdout:______________ test_get_nonpublicpolicy_acl_bucket_policy_status _______________ 2023-12-03T13:00:22.610 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.610 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.610 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.610 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:22.611 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:22.611 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.611 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:22.611 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:22.611 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:22.611 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:22.611 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:22.611 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.611 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:22.611 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:22.611 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.611 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.611 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:22.611 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:22.611 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.611 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.612 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:22.612 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.612 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:22.612 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:22.612 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.612 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.612 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:22.612 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:22.612 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.612 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:22.612 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:22.612 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:22.612 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:22.612 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:22.613 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:22.613 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:22.613 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.613 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:22.613 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:22.613 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:22.613 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:22.613 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:22.613 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:22.613 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:22.613 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:22.613 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:22.613 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.613 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:22.613 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:22.613 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:22.614 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:22.614 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.614 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:22.614 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:22.614 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:22.614 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:22.614 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.614 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.614 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:22.614 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:22.614 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:22.614 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:22.614 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.614 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.615 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:22.615 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:22.615 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:22.615 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.615 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:22.615 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.615 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:22.615 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:22.615 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.615 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:22.615 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:22.615 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:22.615 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:22.615 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:22.615 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:22.615 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.615 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:22.616 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.616 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:22.616 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.616 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.616 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:22.616 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.616 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:22.616 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.616 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:22.616 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:22.616 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:22.616 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:22.616 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:22.616 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:22.617 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:22.617 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:22.617 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:22.617 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:22.617 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:22.617 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:22.617 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:22.617 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.617 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:22.617 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:22.617 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:22.617 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:22.617 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:22.617 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:22.618 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:22.618 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:22.618 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:22.618 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:22.618 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:22.618 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.618 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.618 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:22.618 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.618 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:22.618 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:22.618 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:22.618 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:22.618 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:22.618 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:22.619 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:22.619 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:22.619 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:22.619 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:22.619 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:22.619 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:22.619 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:22.619 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:22.619 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:22.619 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:22.619 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:22.619 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:22.619 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:22.619 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:22.619 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:22.619 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:22.620 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:22.620 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:22.620 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:22.620 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:22.620 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:22.620 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:22.620 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.620 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.620 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.620 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.620 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:22.620 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:22.620 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.620 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:22.621 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:22.621 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:22.621 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:22.621 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:22.621 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.621 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:22.621 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:22.621 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.621 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.621 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:22.621 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:22.621 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.621 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.621 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:22.621 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:22.622 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:22.622 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:22.622 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:22.622 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.622 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.622 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:22.622 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:22.622 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:22.622 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.622 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:22.622 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.622 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:22.622 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.622 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:22.623 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.623 INFO:teuthology.orchestra.run.smithi003.stdout: def test_get_nonpublicpolicy_acl_bucket_policy_status(): 2023-12-03T13:00:22.623 INFO:teuthology.orchestra.run.smithi003.stdout:> bucket_name = get_new_bucket() 2023-12-03T13:00:22.623 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.623 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:12419: 2023-12-03T13:00:22.623 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.623 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:22.623 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:22.623 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:22.623 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:22.623 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:22.623 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:22.623 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:22.623 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:22.623 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:22.624 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:22.624 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:22.624 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:22.624 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:22.624 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:22.624 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:22.624 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:22.624 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:22.624 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:22.624 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:22.624 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:22.624 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:22.624 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:22.624 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:22.624 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:22.625 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:22.625 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:22.625 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:22.625 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:22.625 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:22.625 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:22.625 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:22.625 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:22.625 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:22.625 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:22.625 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:22.625 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:22.625 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.625 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.625 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.626 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:22.626 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.626 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:22.626 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.626 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:22.626 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:22.626 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:22.626 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:22.626 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:22.626 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:22.626 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:22.626 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:22.626 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:22.626 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:22.626 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:22.627 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:22.627 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:22.627 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.627 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:22.627 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:22.627 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:22.627 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:22.627 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:22.627 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:22.627 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:22.627 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:22.627 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:22.627 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:22.627 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:22.627 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.627 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.628 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:22.628 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:22.628 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:22.628 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:22.628 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:22.628 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.628 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.628 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:22.628 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:22.628 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:22.628 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:22.628 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:22.628 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.628 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:22.628 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:22.629 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:22.629 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:22.629 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:22.629 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-510" 2023-12-03T13:00:22.629 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.629 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:22.629 INFO:teuthology.orchestra.run.smithi003.stdout:______________ test_get_nonpublicpolicy_deny_bucket_policy_status ______________ 2023-12-03T13:00:22.629 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.629 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.629 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.629 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:22.629 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:22.629 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.629 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:22.629 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:22.629 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:22.630 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:22.630 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:22.630 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.630 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:22.630 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:22.630 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.630 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.630 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:22.630 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:22.630 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.630 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.630 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:22.630 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.630 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:22.631 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:22.631 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.631 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.631 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:22.631 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:22.631 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.631 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:22.631 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:22.631 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:22.631 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:22.631 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:22.631 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:22.631 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:22.631 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.632 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:22.632 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:22.632 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:22.632 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:22.632 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:22.632 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:22.632 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:22.632 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:22.632 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:22.632 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.632 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:22.632 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:22.632 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:22.632 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:22.632 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.633 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:22.633 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:22.633 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:22.633 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:22.633 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.633 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.633 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:22.633 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:22.633 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:22.633 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:22.633 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.633 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.633 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:22.633 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:22.633 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:22.633 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.634 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:22.634 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.634 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:22.634 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:22.634 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.634 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:22.634 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:22.634 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:22.634 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:22.634 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:22.634 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:22.634 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.634 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:22.634 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.634 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:22.635 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.635 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.635 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:22.635 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.635 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:22.635 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.635 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:22.635 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:22.635 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:22.635 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:22.635 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:22.635 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:22.635 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:22.635 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:22.636 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:22.636 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:22.636 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:22.636 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:22.636 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:22.636 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.636 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:22.636 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:22.636 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:22.636 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:22.636 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:22.636 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:22.636 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:22.636 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:22.636 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:22.636 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:22.636 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:22.637 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.637 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.637 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:22.637 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.637 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:22.637 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:22.637 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:22.637 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:22.637 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:22.637 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:22.637 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:22.637 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:22.637 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:22.637 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:22.637 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:22.638 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:22.638 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:22.638 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:22.638 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:22.638 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:22.638 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:22.638 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:22.638 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:22.638 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:22.638 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:22.638 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:22.638 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:22.638 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:22.638 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:22.638 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:22.639 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:22.639 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:22.639 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.639 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.639 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.639 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.639 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:22.639 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:22.639 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.639 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:22.639 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:22.639 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:22.639 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:22.639 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:22.639 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.640 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:22.640 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:22.640 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.640 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.640 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:22.640 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:22.640 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.640 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.640 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:22.640 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:22.640 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:22.640 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:22.640 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:22.640 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.640 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.640 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:22.641 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:22.641 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:22.641 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.641 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:22.641 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.641 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:22.641 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.641 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:22.641 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.641 INFO:teuthology.orchestra.run.smithi003.stdout: def test_get_nonpublicpolicy_deny_bucket_policy_status(): 2023-12-03T13:00:22.641 INFO:teuthology.orchestra.run.smithi003.stdout:> bucket_name = get_new_bucket() 2023-12-03T13:00:22.641 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.641 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:12451: 2023-12-03T13:00:22.641 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.642 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:22.642 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:22.642 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:22.642 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:22.642 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:22.642 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:22.642 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:22.642 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:22.642 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:22.642 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:22.642 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:22.642 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:22.642 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:22.642 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:22.643 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:22.643 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:22.643 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:22.643 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:22.643 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:22.643 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:22.643 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:22.643 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:22.643 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:22.643 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:22.643 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:22.643 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:22.643 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:22.643 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:22.643 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:22.643 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:22.644 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:22.644 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:22.644 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:22.644 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:22.644 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:22.644 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:22.644 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.644 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.644 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.644 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:22.644 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.644 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:22.644 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.644 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:22.644 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:22.644 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:22.645 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:22.645 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:22.645 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:22.645 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:22.645 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:22.645 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:22.645 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:22.645 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:22.645 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:22.645 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:22.645 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.645 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:22.645 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:22.645 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:22.646 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:22.646 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:22.646 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:22.646 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:22.646 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:22.646 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:22.646 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:22.646 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:22.646 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.646 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.646 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:22.646 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:22.646 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:22.646 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:22.647 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:22.647 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.647 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.647 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:22.647 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:22.647 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:22.647 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:22.647 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:22.647 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.647 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:22.647 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:22.647 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:22.647 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:22.647 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:22.647 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-511" 2023-12-03T13:00:22.647 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.647 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:22.648 INFO:teuthology.orchestra.run.smithi003.stdout:________________________ test_get_default_public_block _________________________ 2023-12-03T13:00:22.648 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.648 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.648 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.648 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:22.648 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:22.648 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.648 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:22.648 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:22.648 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:22.648 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:22.648 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:22.648 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.648 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:22.648 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:22.648 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.649 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.649 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:22.649 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:22.649 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.649 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.649 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:22.649 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.649 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:22.649 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:22.649 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.649 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.649 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:22.649 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:22.649 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.649 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:22.650 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:22.650 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:22.650 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:22.650 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:22.650 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:22.650 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:22.650 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.650 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:22.650 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:22.650 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:22.650 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:22.650 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:22.650 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:22.650 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:22.650 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:22.651 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:22.651 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.651 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:22.651 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:22.651 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:22.651 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:22.651 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.651 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:22.651 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:22.651 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:22.651 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:22.651 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.651 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.651 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:22.652 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:22.652 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:22.652 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:22.652 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.652 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.652 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:22.652 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:22.652 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:22.652 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.652 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:22.652 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.652 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:22.652 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:22.652 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.652 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:22.653 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:22.653 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:22.653 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:22.653 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:22.653 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:22.653 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.653 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:22.653 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.653 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:22.653 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.653 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.653 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:22.653 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.653 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:22.653 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.654 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:22.654 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:22.654 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:22.654 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:22.654 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:22.654 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:22.654 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:22.654 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:22.654 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:22.654 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:22.654 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:22.654 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:22.654 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:22.654 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.655 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:22.655 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:22.655 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:22.655 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:22.655 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:22.655 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:22.655 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:22.655 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:22.655 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:22.655 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:22.655 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:22.655 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.655 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.655 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:22.655 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.656 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:22.656 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:22.656 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:22.656 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:22.656 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:22.656 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:22.656 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:22.656 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:22.656 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:22.656 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:22.656 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:22.656 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:22.656 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:22.656 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:22.656 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:22.656 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:22.657 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:22.657 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:22.657 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:22.657 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:22.657 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:22.657 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:22.657 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:22.657 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:22.657 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:22.657 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:22.657 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:22.657 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:22.657 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.657 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.657 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.657 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.658 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:22.658 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:22.658 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.658 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:22.658 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:22.658 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:22.658 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:22.658 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:22.658 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.658 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:22.658 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:22.658 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.658 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.658 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:22.658 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:22.659 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.659 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.659 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:22.659 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:22.659 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:22.659 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:22.659 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:22.659 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.659 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.659 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:22.659 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:22.659 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:22.659 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.659 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:22.659 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.660 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:22.660 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.660 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:22.660 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.660 INFO:teuthology.orchestra.run.smithi003.stdout: def test_get_default_public_block(): 2023-12-03T13:00:22.660 INFO:teuthology.orchestra.run.smithi003.stdout: #client = get_svc_client(svc='s3control', client_config=Config(s3={'addressing_style': 'path'})) 2023-12-03T13:00:22.660 INFO:teuthology.orchestra.run.smithi003.stdout:> bucket_name = get_new_bucket() 2023-12-03T13:00:22.660 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.660 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:12479: 2023-12-03T13:00:22.660 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.660 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:22.660 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:22.660 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:22.660 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:22.660 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:22.661 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:22.661 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:22.661 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:22.661 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:22.661 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:22.661 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:22.661 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:22.661 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:22.661 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:22.661 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:22.661 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:22.661 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:22.661 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:22.661 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:22.662 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:22.662 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:22.662 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:22.662 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:22.662 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:22.662 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:22.662 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:22.662 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:22.662 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:22.662 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:22.662 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:22.662 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:22.662 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:22.662 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:22.663 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:22.663 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:22.663 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:22.663 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.663 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.663 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.663 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:22.663 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.663 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:22.663 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.663 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:22.663 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:22.663 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:22.663 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:22.663 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:22.664 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:22.664 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:22.664 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:22.664 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:22.664 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:22.664 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:22.664 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:22.664 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:22.664 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.664 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:22.664 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:22.664 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:22.664 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:22.664 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:22.664 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:22.664 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:22.665 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:22.665 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:22.665 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:22.665 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:22.665 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.665 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.665 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:22.665 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:22.665 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:22.665 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:22.665 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:22.665 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.665 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.665 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:22.665 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:22.666 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:22.666 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:22.666 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:22.666 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.666 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:22.666 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:22.666 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:22.666 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:22.666 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:22.666 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-512" 2023-12-03T13:00:22.666 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.666 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:22.666 INFO:teuthology.orchestra.run.smithi003.stdout:____________________________ test_put_public_block _____________________________ 2023-12-03T13:00:22.666 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.667 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.667 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.667 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:22.667 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:22.667 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.667 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:22.667 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:22.667 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:22.667 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:22.667 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:22.667 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.667 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:22.667 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:22.667 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.667 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.667 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:22.668 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:22.668 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.668 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.668 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:22.668 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.668 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:22.668 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:22.668 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.668 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.668 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:22.668 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:22.668 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.668 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:22.668 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:22.668 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:22.669 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:22.669 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:22.669 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:22.669 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:22.669 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.669 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:22.669 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:22.669 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:22.669 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:22.669 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:22.669 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:22.669 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:22.669 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:22.669 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:22.669 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.670 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:22.670 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:22.670 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:22.670 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:22.670 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.670 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:22.670 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:22.670 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:22.670 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:22.670 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.670 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.670 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:22.670 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:22.670 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:22.670 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:22.671 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.671 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.671 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:22.671 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:22.671 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:22.671 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.671 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:22.671 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.671 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:22.671 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:22.671 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.671 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:22.671 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:22.671 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:22.671 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:22.672 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:22.672 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:22.672 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.672 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:22.672 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.672 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:22.672 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.672 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.672 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:22.672 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.672 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:22.672 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.672 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:22.672 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:22.672 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:22.673 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:22.673 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:22.673 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:22.673 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:22.673 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:22.673 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:22.673 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:22.673 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:22.673 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:22.673 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:22.673 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.673 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:22.673 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:22.673 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:22.673 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:22.674 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:22.674 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:22.674 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:22.674 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:22.674 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:22.674 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:22.674 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:22.674 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.674 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.674 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:22.674 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.674 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:22.674 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:22.674 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:22.674 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:22.675 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:22.675 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:22.675 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:22.675 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:22.675 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:22.675 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:22.675 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:22.675 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:22.675 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:22.675 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:22.675 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:22.675 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:22.675 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:22.675 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:22.675 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:22.676 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:22.676 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:22.676 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:22.676 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:22.676 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:22.676 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:22.676 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:22.676 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:22.676 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:22.676 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.676 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.676 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.676 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.676 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:22.676 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:22.677 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.677 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:22.677 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:22.677 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:22.677 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:22.677 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:22.677 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.677 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:22.677 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:22.677 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.677 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.677 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:22.677 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:22.677 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.677 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.677 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:22.678 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:22.678 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:22.678 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:22.678 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:22.678 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.678 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.678 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:22.678 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:22.678 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:22.678 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.678 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:22.678 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.678 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:22.678 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.679 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:22.679 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.679 INFO:teuthology.orchestra.run.smithi003.stdout: def test_put_public_block(): 2023-12-03T13:00:22.679 INFO:teuthology.orchestra.run.smithi003.stdout: #client = get_svc_client(svc='s3control', client_config=Config(s3={'addressing_style': 'path'})) 2023-12-03T13:00:22.679 INFO:teuthology.orchestra.run.smithi003.stdout:> bucket_name = get_new_bucket() 2023-12-03T13:00:22.679 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.679 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:12490: 2023-12-03T13:00:22.679 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.679 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:22.679 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:22.679 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:22.679 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:22.679 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:22.679 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:22.679 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:22.680 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:22.680 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:22.680 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:22.680 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:22.680 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:22.680 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:22.680 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:22.680 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:22.680 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:22.680 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:22.680 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:22.680 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:22.680 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:22.680 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:22.681 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:22.681 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:22.681 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:22.681 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:22.681 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:22.681 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:22.681 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:22.681 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:22.681 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:22.681 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:22.681 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:22.681 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:22.681 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:22.681 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:22.681 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:22.682 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.682 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.682 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.682 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:22.682 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.682 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:22.682 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.682 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:22.682 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:22.682 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:22.682 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:22.682 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:22.682 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:22.682 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:22.683 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:22.683 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:22.683 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:22.683 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:22.683 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:22.683 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:22.683 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.683 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:22.683 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:22.683 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:22.683 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:22.683 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:22.683 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:22.683 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:22.683 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:22.684 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:22.684 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:22.684 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:22.684 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.684 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.684 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:22.684 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:22.684 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:22.684 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:22.684 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:22.684 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.684 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.684 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:22.684 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:22.684 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:22.685 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:22.685 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:22.685 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.685 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:22.685 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:22.685 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:22.685 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:22.685 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:22.685 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-513" 2023-12-03T13:00:22.685 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.685 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:22.685 INFO:teuthology.orchestra.run.smithi003.stdout:______________________ test_block_public_put_bucket_acls _______________________ 2023-12-03T13:00:22.685 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.685 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.685 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.686 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:22.686 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:22.686 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.686 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:22.686 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:22.686 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:22.686 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:22.686 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:22.686 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.686 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:22.686 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:22.686 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.686 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.686 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:22.686 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:22.687 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.687 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.687 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:22.687 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.687 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:22.687 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:22.687 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.687 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.687 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:22.687 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:22.687 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.687 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:22.687 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:22.687 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:22.688 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:22.688 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:22.688 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:22.688 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:22.688 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.688 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:22.688 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:22.688 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:22.688 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:22.688 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:22.688 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:22.688 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:22.688 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:22.688 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:22.688 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.688 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:22.689 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:22.689 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:22.689 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:22.689 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.689 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:22.689 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:22.689 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:22.689 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:22.689 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.689 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.689 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:22.689 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:22.689 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:22.689 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:22.689 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.690 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.690 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:22.690 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:22.690 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:22.690 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.690 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:22.690 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.690 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:22.690 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:22.690 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.690 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:22.690 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:22.690 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:22.690 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:22.691 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:22.691 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:22.691 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.691 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:22.691 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.691 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:22.691 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.691 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.691 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:22.691 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.691 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:22.691 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.691 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:22.691 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:22.691 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:22.692 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:22.692 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:22.692 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:22.692 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:22.692 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:22.692 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:22.692 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:22.692 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:22.692 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:22.692 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:22.692 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.692 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:22.692 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:22.692 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:22.693 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:22.693 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:22.693 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:22.693 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:22.693 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:22.693 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:22.693 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:22.693 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:22.693 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.693 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.693 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:22.693 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.693 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:22.693 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:22.693 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:22.693 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:22.694 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:22.694 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:22.694 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:22.694 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:22.694 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:22.694 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:22.694 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:22.694 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:22.694 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:22.694 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:22.694 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:22.694 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:22.694 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:22.694 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:22.694 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:22.695 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:22.695 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:22.695 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:22.695 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:22.695 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:22.695 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:22.695 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:22.695 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:22.695 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:22.695 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.695 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.695 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.695 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.695 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:22.695 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:22.696 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.696 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:22.696 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:22.696 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:22.696 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:22.696 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:22.696 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.696 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:22.696 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:22.696 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.696 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.696 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:22.696 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:22.696 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.696 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.696 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:22.697 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:22.697 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:22.697 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:22.697 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:22.697 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.697 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.697 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:22.697 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:22.697 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:22.697 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.697 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:22.697 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.697 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:22.697 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.698 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:22.698 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.698 INFO:teuthology.orchestra.run.smithi003.stdout: def test_block_public_put_bucket_acls(): 2023-12-03T13:00:22.698 INFO:teuthology.orchestra.run.smithi003.stdout: #client = get_svc_client(svc='s3control', client_config=Config(s3={'addressing_style': 'path'})) 2023-12-03T13:00:22.698 INFO:teuthology.orchestra.run.smithi003.stdout:> bucket_name = get_new_bucket() 2023-12-03T13:00:22.698 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.698 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:12509: 2023-12-03T13:00:22.698 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.698 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:22.698 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:22.698 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:22.698 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:22.698 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:22.698 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:22.698 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:22.699 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:22.699 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:22.699 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:22.699 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:22.699 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:22.699 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:22.699 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:22.699 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:22.699 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:22.699 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:22.699 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:22.699 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:22.699 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:22.699 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:22.699 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:22.700 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:22.700 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:22.700 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:22.700 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:22.700 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:22.700 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:22.700 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:22.700 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:22.700 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:22.700 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:22.700 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:22.700 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:22.700 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:22.700 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:22.701 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.701 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.701 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.701 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:22.701 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.701 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:22.701 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.701 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:22.701 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:22.701 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:22.701 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:22.701 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:22.701 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:22.701 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:22.701 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:22.702 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:22.702 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:22.702 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:22.702 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:22.702 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:22.702 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.702 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:22.702 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:22.702 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:22.702 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:22.702 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:22.702 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:22.702 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:22.702 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:22.703 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:22.703 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:22.703 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:22.703 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.703 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.703 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:22.703 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:22.703 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:22.703 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:22.703 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:22.703 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.703 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.703 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:22.703 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:22.703 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:22.703 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:22.704 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:22.704 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.704 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:22.704 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:22.704 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:22.704 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:22.704 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:22.704 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-514" 2023-12-03T13:00:22.704 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.704 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:22.704 INFO:teuthology.orchestra.run.smithi003.stdout:_____________________ test_block_public_object_canned_acls _____________________ 2023-12-03T13:00:22.704 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.704 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.704 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.705 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:22.705 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:22.705 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.705 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:22.705 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:22.705 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:22.705 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:22.705 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:22.705 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.705 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:22.705 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:22.705 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.705 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.705 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:22.705 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:22.706 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.706 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.706 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:22.706 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.706 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:22.706 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:22.706 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.706 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.706 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:22.706 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:22.706 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.706 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:22.706 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:22.706 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:22.706 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:22.707 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:22.707 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:22.707 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:22.707 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.707 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:22.707 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:22.707 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:22.707 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:22.707 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:22.707 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:22.707 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:22.707 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:22.707 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:22.707 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.707 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:22.708 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:22.708 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:22.708 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:22.708 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.708 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:22.708 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:22.708 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:22.708 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:22.708 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.708 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.708 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:22.708 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:22.708 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:22.708 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:22.708 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.709 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.709 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:22.709 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:22.709 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:22.709 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.709 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:22.709 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.709 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:22.709 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:22.709 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.709 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:22.709 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:22.709 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:22.710 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:22.710 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:22.710 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:22.710 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.710 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:22.710 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.710 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:22.710 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.710 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.710 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:22.710 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.710 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:22.710 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.710 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:22.710 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:22.711 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:22.711 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:22.711 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:22.711 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:22.711 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:22.711 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:22.711 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:22.711 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:22.711 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:22.711 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:22.711 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:22.711 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.711 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:22.711 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:22.712 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:22.712 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:22.712 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:22.712 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:22.712 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:22.712 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:22.712 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:22.712 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:22.712 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:22.712 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.712 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.712 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:22.712 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.712 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:22.712 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:22.713 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:22.713 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:22.713 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:22.713 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:22.713 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:22.713 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:22.713 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:22.713 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:22.713 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:22.713 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:22.713 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:22.713 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:22.713 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:22.713 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:22.713 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:22.714 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:22.714 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:22.714 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:22.714 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:22.714 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:22.714 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:22.714 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:22.714 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:22.714 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:22.714 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:22.714 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:22.714 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.714 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.714 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.715 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.715 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:22.715 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:22.715 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.715 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:22.715 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:22.715 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:22.715 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:22.715 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:22.715 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.715 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:22.715 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:22.715 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.715 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.715 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:22.715 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:22.716 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.716 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.716 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:22.716 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:22.716 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:22.716 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:22.716 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:22.716 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.716 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.716 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:22.716 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:22.716 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:22.716 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.716 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:22.716 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.717 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:22.717 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.717 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:22.717 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.717 INFO:teuthology.orchestra.run.smithi003.stdout: def test_block_public_object_canned_acls(): 2023-12-03T13:00:22.717 INFO:teuthology.orchestra.run.smithi003.stdout:> bucket_name = get_new_bucket() 2023-12-03T13:00:22.717 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.717 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:12537: 2023-12-03T13:00:22.717 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.717 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:22.717 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:22.717 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:22.717 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:22.717 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:22.717 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:22.718 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:22.718 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:22.718 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:22.718 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:22.718 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:22.718 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:22.718 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:22.718 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:22.718 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:22.718 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:22.718 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:22.718 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:22.718 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:22.718 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:22.718 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:22.719 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:22.719 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:22.719 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:22.719 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:22.719 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:22.719 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:22.719 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:22.719 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:22.719 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:22.719 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:22.719 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:22.719 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:22.719 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:22.719 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:22.719 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:22.720 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.720 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.720 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.720 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:22.720 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.720 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:22.720 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.720 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:22.720 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:22.720 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:22.720 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:22.720 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:22.720 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:22.720 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:22.721 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:22.721 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:22.721 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:22.721 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:22.721 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:22.721 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:22.721 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.721 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:22.721 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:22.721 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:22.721 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:22.721 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:22.721 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:22.721 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:22.722 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:22.722 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:22.722 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:22.722 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:22.722 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.722 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.722 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:22.722 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:22.722 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:22.722 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:22.722 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:22.722 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.722 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.722 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:22.723 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:22.723 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:22.723 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:22.723 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:22.723 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.723 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:22.723 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:22.723 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:22.723 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:22.723 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:22.723 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-515" 2023-12-03T13:00:22.723 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.723 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:22.723 INFO:teuthology.orchestra.run.smithi003.stdout:___________________________ test_block_public_policy ___________________________ 2023-12-03T13:00:22.723 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.723 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.724 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.724 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:22.724 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:22.724 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.724 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:22.724 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:22.724 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:22.724 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:22.724 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:22.724 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.724 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:22.724 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:22.724 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.724 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.725 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:22.725 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:22.725 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.725 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.725 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:22.725 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.725 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:22.725 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:22.725 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.725 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.725 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:22.725 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:22.725 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.725 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:22.725 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:22.725 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:22.726 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:22.726 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:22.726 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:22.726 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:22.726 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.726 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:22.726 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:22.726 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:22.726 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:22.726 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:22.726 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:22.726 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:22.726 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:22.726 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:22.727 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.727 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:22.727 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:22.727 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:22.727 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:22.727 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.727 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:22.727 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:22.727 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:22.727 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:22.727 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.727 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.727 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:22.727 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:22.727 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:22.728 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:22.728 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.728 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.728 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:22.728 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:22.728 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:22.728 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.728 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:22.728 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.728 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:22.728 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:22.728 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.728 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:22.728 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:22.729 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:22.729 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:22.729 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:22.729 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:22.729 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.729 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:22.729 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.729 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:22.729 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.729 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.729 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:22.729 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.729 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:22.729 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.729 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:22.729 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:22.730 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:22.730 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:22.730 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:22.730 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:22.730 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:22.730 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:22.730 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:22.730 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:22.730 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:22.730 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:22.730 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:22.730 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.730 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:22.730 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:22.731 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:22.731 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:22.731 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:22.731 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:22.731 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:22.731 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:22.731 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:22.731 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:22.731 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:22.731 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.731 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.731 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:22.731 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.731 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:22.731 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:22.732 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:22.732 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:22.732 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:22.732 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:22.732 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:22.732 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:22.732 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:22.732 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:22.732 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:22.732 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:22.732 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:22.732 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:22.732 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:22.732 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:22.733 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:22.733 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:22.733 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:22.733 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:22.733 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:22.733 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:22.733 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:22.733 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:22.733 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:22.733 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:22.733 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:22.733 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:22.733 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.733 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.733 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.734 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.734 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:22.734 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:22.734 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.734 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:22.734 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:22.734 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:22.734 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:22.734 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:22.734 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.734 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:22.734 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:22.734 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.734 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.734 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:22.735 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:22.735 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.735 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.735 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:22.735 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:22.735 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:22.735 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:22.735 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:22.735 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.735 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.735 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:22.735 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:22.735 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:22.735 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.735 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:22.735 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.736 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:22.736 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.736 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:22.736 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.736 INFO:teuthology.orchestra.run.smithi003.stdout: def test_block_public_policy(): 2023-12-03T13:00:22.736 INFO:teuthology.orchestra.run.smithi003.stdout:> bucket_name = get_new_bucket() 2023-12-03T13:00:22.736 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.736 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:12566: 2023-12-03T13:00:22.736 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.736 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:22.736 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:22.736 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:22.736 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:22.736 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:22.736 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:22.737 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:22.737 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:22.737 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:22.737 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:22.737 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:22.737 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:22.737 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:22.737 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:22.737 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:22.737 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:22.737 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:22.737 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:22.737 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:22.737 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:22.737 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:22.738 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:22.738 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:22.738 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:22.738 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:22.738 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:22.738 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:22.738 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:22.738 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:22.738 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:22.738 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:22.738 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:22.738 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:22.738 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:22.738 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:22.739 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:22.739 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.739 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.739 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.739 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:22.739 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.739 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:22.739 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.739 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:22.739 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:22.739 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:22.739 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:22.739 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:22.739 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:22.739 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:22.740 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:22.740 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:22.740 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:22.740 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:22.740 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:22.740 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:22.740 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.740 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:22.740 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:22.740 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:22.740 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:22.740 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:22.740 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:22.740 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:22.740 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:22.741 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:22.741 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:22.741 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:22.741 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.741 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.741 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:22.741 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:22.741 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:22.741 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:22.741 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:22.741 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.741 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.741 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:22.741 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:22.742 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:22.742 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:22.742 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:22.742 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.742 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:22.742 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:22.742 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:22.742 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:22.742 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:22.742 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-516" 2023-12-03T13:00:22.742 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.742 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:22.742 INFO:teuthology.orchestra.run.smithi003.stdout:___________________________ test_ignore_public_acls ____________________________ 2023-12-03T13:00:22.742 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.742 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.743 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.743 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:22.743 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:22.743 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.743 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:22.743 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:22.743 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:22.743 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:22.743 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:22.743 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.743 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:22.743 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:22.743 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.743 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.743 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:22.744 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:22.744 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.744 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.744 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:22.744 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.744 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:22.744 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:22.744 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.744 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.744 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:22.744 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:22.744 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.744 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:22.744 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:22.744 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:22.744 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:22.745 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:22.745 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:22.745 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:22.745 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.745 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:22.745 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:22.745 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:22.745 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:22.745 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:22.745 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:22.745 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:22.745 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:22.745 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:22.745 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.745 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:22.746 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:22.746 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:22.746 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:22.746 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.746 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:22.746 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:22.746 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:22.746 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:22.746 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.746 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.746 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:22.746 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:22.746 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:22.746 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:22.747 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.747 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.747 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:22.747 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:22.747 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:22.747 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.747 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:22.747 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.747 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:22.747 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:22.747 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.747 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:22.747 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:22.747 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:22.747 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:22.748 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:22.748 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:22.748 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.748 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:22.748 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.748 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:22.748 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.748 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.748 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:22.748 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.748 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:22.748 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.748 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:22.748 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:22.748 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:22.749 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:22.749 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:22.749 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:22.749 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:22.749 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:22.749 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:22.749 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:22.749 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:22.749 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:22.749 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:22.749 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.749 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:22.749 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:22.749 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:22.749 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:22.749 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:22.750 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:22.750 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:22.750 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:22.750 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:22.750 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:22.750 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:22.750 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.750 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.750 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:22.750 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.750 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:22.750 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:22.750 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:22.750 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:22.751 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:22.751 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:22.751 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:22.751 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:22.751 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:22.751 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:22.751 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:22.751 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:22.751 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:22.751 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:22.751 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:22.751 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:22.751 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:22.751 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:22.751 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:22.752 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:22.752 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:22.752 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:22.752 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:22.752 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:22.752 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:22.752 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:22.752 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:22.752 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:22.752 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.752 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.752 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.752 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.752 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:22.752 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:22.752 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.753 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:22.753 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:22.753 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:22.753 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:22.753 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:22.753 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.753 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:22.753 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:22.753 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.753 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.753 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:22.753 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:22.753 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.753 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.753 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:22.754 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:22.754 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:22.754 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:22.754 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:22.754 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.754 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.754 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:22.754 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:22.754 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:22.754 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.754 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:22.754 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.754 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:22.754 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.755 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:22.755 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.755 INFO:teuthology.orchestra.run.smithi003.stdout: def test_ignore_public_acls(): 2023-12-03T13:00:22.755 INFO:teuthology.orchestra.run.smithi003.stdout:> bucket_name = get_new_bucket() 2023-12-03T13:00:22.755 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.755 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:12583: 2023-12-03T13:00:22.755 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.755 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:22.755 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:22.755 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:22.755 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:22.755 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:22.755 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:22.755 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:22.755 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:22.756 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:22.756 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:22.756 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:22.756 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:22.756 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:22.756 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:22.756 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:22.756 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:22.756 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:22.756 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:22.756 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:22.756 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:22.756 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:22.756 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:22.757 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:22.757 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:22.757 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:22.757 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:22.757 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:22.757 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:22.757 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:22.757 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:22.757 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:22.757 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:22.757 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:22.757 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:22.757 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:22.757 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:22.757 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.758 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.758 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.758 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:22.758 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.758 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:22.758 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.758 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:22.758 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:22.758 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:22.758 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:22.758 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:22.758 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:22.758 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:22.758 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:22.758 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:22.759 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:22.759 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:22.759 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:22.759 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:22.759 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.759 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:22.759 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:22.759 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:22.759 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:22.759 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:22.759 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:22.759 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:22.759 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:22.759 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:22.759 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:22.760 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:22.760 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.760 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.760 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:22.760 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:22.760 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:22.760 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:22.760 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:22.760 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.760 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.760 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:22.760 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:22.760 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:22.760 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:22.761 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:22.761 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.761 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:22.761 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:22.761 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:22.761 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:22.761 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:22.761 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-517" 2023-12-03T13:00:22.761 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.761 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:22.761 INFO:teuthology.orchestra.run.smithi003.stdout:________________ test_multipart_upload_on_a_bucket_with_policy _________________ 2023-12-03T13:00:22.761 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.761 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.761 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.761 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:22.762 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:22.762 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.762 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:22.762 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:22.762 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:22.762 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:22.762 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:22.762 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.762 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:22.762 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:22.762 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.762 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.762 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:22.762 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:22.763 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.763 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.763 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:22.763 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.763 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:22.763 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:22.763 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.763 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.763 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:22.763 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:22.763 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.763 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:22.763 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:22.763 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:22.763 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:22.764 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:22.764 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:22.764 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:22.764 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.764 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:22.764 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:22.764 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:22.764 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:22.764 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:22.764 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:22.764 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:22.764 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:22.764 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:22.764 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.764 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:22.765 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:22.765 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:22.765 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:22.765 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.765 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:22.765 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:22.765 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:22.765 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:22.765 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.765 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.765 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:22.765 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:22.765 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:22.765 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:22.765 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.766 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.766 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:22.766 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:22.766 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:22.766 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.766 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:22.766 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.766 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:22.766 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:22.766 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.766 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:22.766 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:22.766 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:22.766 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:22.766 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:22.767 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:22.767 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.767 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:22.767 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.767 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:22.767 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.767 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.767 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:22.767 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.767 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:22.767 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.767 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:22.767 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:22.767 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:22.767 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:22.768 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:22.768 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:22.768 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:22.768 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:22.768 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:22.768 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:22.768 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:22.768 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:22.768 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:22.768 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.768 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:22.768 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:22.768 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:22.768 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:22.768 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:22.769 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:22.769 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:22.769 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:22.769 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:22.769 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:22.769 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:22.769 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.769 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.769 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:22.769 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.769 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:22.769 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:22.769 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:22.769 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:22.769 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:22.770 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:22.770 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:22.770 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:22.770 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:22.770 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:22.770 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:22.770 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:22.770 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:22.770 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:22.770 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:22.770 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:22.770 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:22.770 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:22.770 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:22.770 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:22.771 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:22.771 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:22.771 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:22.771 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:22.771 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:22.771 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:22.771 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:22.771 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:22.771 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.771 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.771 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.771 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.771 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:22.771 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:22.772 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.772 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:22.772 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:22.772 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:22.772 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:22.772 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:22.772 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.772 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:22.772 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:22.772 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.772 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.772 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:22.772 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:22.772 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.772 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.773 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:22.773 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:22.773 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:22.773 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:22.773 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:22.773 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.773 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.773 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:22.773 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:22.773 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:22.773 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.773 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:22.773 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.773 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:22.773 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.773 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:22.774 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.774 INFO:teuthology.orchestra.run.smithi003.stdout: def test_multipart_upload_on_a_bucket_with_policy(): 2023-12-03T13:00:22.774 INFO:teuthology.orchestra.run.smithi003.stdout:> bucket_name = get_new_bucket() 2023-12-03T13:00:22.774 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.774 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:12610: 2023-12-03T13:00:22.774 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.774 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:22.774 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:22.774 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:22.774 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:22.774 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:22.774 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:22.774 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:22.774 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:22.775 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:22.775 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:22.775 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:22.775 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:22.775 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:22.775 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:22.775 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:22.775 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:22.775 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:22.775 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:22.775 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:22.775 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:22.775 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:22.775 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:22.775 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:22.775 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:22.776 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:22.776 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:22.776 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:22.776 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:22.776 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:22.776 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:22.776 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:22.776 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:22.776 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:22.776 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:22.776 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:22.776 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:22.776 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.776 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.776 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.776 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:22.777 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.777 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:22.777 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.777 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:22.777 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:22.777 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:22.777 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:22.777 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:22.777 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:22.777 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:22.777 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:22.777 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:22.777 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:22.777 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:22.778 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:22.778 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:22.778 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.778 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:22.778 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:22.778 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:22.778 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:22.778 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:22.778 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:22.778 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:22.778 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:22.778 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:22.778 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:22.778 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:22.778 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.779 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.779 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:22.779 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:22.779 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:22.779 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:22.779 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:22.779 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.779 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.779 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:22.779 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:22.779 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:22.779 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:22.779 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:22.779 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.779 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:22.780 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:22.780 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:22.780 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:22.780 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:22.780 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-518" 2023-12-03T13:00:22.780 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.780 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:22.780 INFO:teuthology.orchestra.run.smithi003.stdout:________________________ test_put_bucket_encryption_kms ________________________ 2023-12-03T13:00:22.780 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.780 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.780 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.780 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:22.780 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:22.780 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.780 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:22.780 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:22.781 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:22.781 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:22.781 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:22.781 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.781 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:22.781 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:22.781 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.781 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.781 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:22.781 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:22.781 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.781 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.781 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:22.781 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.782 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:22.782 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:22.782 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.782 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.782 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:22.782 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:22.782 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.782 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:22.782 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:22.782 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:22.782 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:22.782 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:22.782 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:22.782 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:22.783 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.783 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:22.783 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:22.783 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:22.783 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:22.783 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:22.783 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:22.783 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:22.783 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:22.783 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:22.783 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.783 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:22.783 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:22.783 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:22.783 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:22.783 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.784 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:22.784 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:22.784 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:22.784 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:22.784 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.784 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.784 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:22.784 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:22.784 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:22.784 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:22.784 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.784 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.784 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:22.784 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:22.785 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:22.785 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.785 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:22.785 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.785 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:22.785 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:22.785 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.785 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:22.785 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:22.785 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:22.785 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:22.785 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:22.785 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:22.785 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.785 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:22.785 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.786 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:22.786 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.786 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.786 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:22.786 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.786 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:22.786 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.786 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:22.786 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:22.786 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:22.786 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:22.786 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:22.786 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:22.786 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:22.787 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:22.787 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:22.787 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:22.787 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:22.787 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:22.787 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:22.787 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.787 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:22.787 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:22.787 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:22.787 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:22.787 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:22.787 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:22.787 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:22.787 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:22.788 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:22.788 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:22.788 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:22.788 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.788 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.788 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:22.788 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.788 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:22.788 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:22.788 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:22.788 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:22.788 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:22.788 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:22.788 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:22.788 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:22.789 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:22.789 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:22.789 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:22.789 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:22.789 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:22.789 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:22.789 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:22.789 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:22.789 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:22.789 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:22.789 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:22.789 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:22.789 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:22.789 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:22.789 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:22.790 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:22.790 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:22.790 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:22.790 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:22.790 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:22.790 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.790 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.790 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.790 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.790 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:22.790 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:22.790 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.790 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:22.790 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:22.791 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:22.791 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:22.791 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:22.791 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.791 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:22.791 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:22.791 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.791 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.791 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:22.791 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:22.791 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.791 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.791 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:22.791 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:22.791 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:22.792 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:22.792 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:22.792 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.792 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.792 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:22.792 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:22.792 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:22.792 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.792 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:22.792 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.792 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:22.792 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.792 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:22.792 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.792 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.encryption 2023-12-03T13:00:22.793 INFO:teuthology.orchestra.run.smithi003.stdout: def test_put_bucket_encryption_kms(): 2023-12-03T13:00:22.793 INFO:teuthology.orchestra.run.smithi003.stdout:> bucket_name = get_new_bucket() 2023-12-03T13:00:22.793 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.793 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:12679: 2023-12-03T13:00:22.793 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.793 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:22.793 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:22.793 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:22.793 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:22.793 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:22.793 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:22.793 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:22.793 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:22.793 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:22.793 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:22.793 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:22.793 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:22.794 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:22.794 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:22.794 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:22.794 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:22.794 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:22.794 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:22.794 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:22.794 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:22.794 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:22.794 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:22.794 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:22.794 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:22.794 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:22.794 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:22.795 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:22.795 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:22.795 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:22.795 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:22.795 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:22.795 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:22.795 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:22.795 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:22.795 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:22.795 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:22.795 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.795 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.795 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.795 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:22.795 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.796 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:22.796 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.796 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:22.796 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:22.796 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:22.796 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:22.796 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:22.796 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:22.796 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:22.796 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:22.796 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:22.796 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:22.796 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:22.796 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:22.796 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:22.796 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.797 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:22.797 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:22.797 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:22.797 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:22.797 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:22.797 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:22.797 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:22.797 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:22.797 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:22.797 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:22.797 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:22.797 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.797 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.797 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:22.797 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:22.797 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:22.798 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:22.798 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:22.798 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.798 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.798 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:22.798 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:22.798 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:22.798 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:22.798 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:22.798 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.798 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:22.798 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:22.798 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:22.798 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:22.798 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:22.799 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-519" 2023-12-03T13:00:22.799 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.799 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:22.799 INFO:teuthology.orchestra.run.smithi003.stdout:________________________ test_get_bucket_encryption_kms ________________________ 2023-12-03T13:00:22.799 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.799 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.799 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.799 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:22.799 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:22.799 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.799 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:22.799 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:22.799 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:22.799 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:22.799 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:22.799 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.800 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:22.800 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:22.800 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.800 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.800 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:22.800 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:22.800 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.800 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.800 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:22.800 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.800 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:22.800 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:22.800 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.800 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.800 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:22.801 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:22.801 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.801 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:22.801 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:22.801 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:22.801 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:22.801 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:22.801 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:22.801 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:22.801 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.801 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:22.801 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:22.801 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:22.802 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:22.802 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:22.802 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:22.802 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:22.802 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:22.802 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:22.802 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.802 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:22.802 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:22.802 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:22.802 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:22.802 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.802 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:22.802 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:22.802 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:22.803 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:22.803 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.803 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.803 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:22.803 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:22.803 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:22.803 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:22.803 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.803 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.803 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:22.803 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:22.803 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:22.803 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.803 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:22.803 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.803 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:22.804 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:22.804 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.804 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:22.804 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:22.804 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:22.804 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:22.804 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:22.804 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:22.804 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.804 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:22.804 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.804 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:22.804 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.804 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.804 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:22.805 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.805 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:22.805 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.805 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:22.805 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:22.805 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:22.805 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:22.805 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:22.805 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:22.805 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:22.805 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:22.805 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:22.805 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:22.805 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:22.805 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:22.806 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:22.806 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.806 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:22.806 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:22.806 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:22.806 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:22.806 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:22.806 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:22.806 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:22.806 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:22.806 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:22.806 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:22.806 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:22.806 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.806 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.806 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:22.807 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.807 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:22.807 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:22.807 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:22.807 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:22.807 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:22.807 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:22.807 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:22.807 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:22.807 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:22.807 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:22.807 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:22.807 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:22.807 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:22.807 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:22.808 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:22.808 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:22.808 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:22.808 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:22.808 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:22.808 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:22.808 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:22.808 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:22.808 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:22.808 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:22.808 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:22.808 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:22.808 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:22.808 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:22.808 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.808 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.809 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.809 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.809 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:22.809 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:22.809 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.809 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:22.809 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:22.809 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:22.809 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:22.809 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:22.809 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.809 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:22.809 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:22.809 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.810 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.810 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:22.810 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:22.810 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.810 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.810 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:22.810 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:22.810 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:22.810 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:22.810 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:22.810 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.810 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.810 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:22.810 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:22.810 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:22.811 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.811 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:22.811 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.811 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:22.811 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.811 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:22.811 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.811 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.encryption 2023-12-03T13:00:22.811 INFO:teuthology.orchestra.run.smithi003.stdout: def test_get_bucket_encryption_kms(): 2023-12-03T13:00:22.811 INFO:teuthology.orchestra.run.smithi003.stdout: kms_keyid = get_main_kms_keyid() 2023-12-03T13:00:22.811 INFO:teuthology.orchestra.run.smithi003.stdout: if kms_keyid is None: 2023-12-03T13:00:22.813 INFO:teuthology.orchestra.run.smithi003.stdout: kms_keyid = 'fool-me-again' 2023-12-03T13:00:22.813 INFO:teuthology.orchestra.run.smithi003.stdout:> bucket_name = get_new_bucket() 2023-12-03T13:00:22.813 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.813 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:12709: 2023-12-03T13:00:22.813 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.813 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:22.813 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:22.813 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:22.813 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:22.813 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:22.813 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:22.813 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:22.813 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:22.814 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:22.814 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:22.814 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:22.814 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:22.814 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:22.814 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:22.814 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:22.814 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:22.814 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:22.814 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:22.814 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:22.814 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:22.814 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:22.815 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:22.815 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:22.815 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:22.815 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:22.815 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:22.815 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:22.815 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:22.815 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:22.815 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:22.815 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:22.815 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:22.815 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:22.815 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:22.815 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:22.815 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:22.815 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.816 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.816 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.816 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:22.816 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.816 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:22.816 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.816 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:22.816 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:22.816 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:22.816 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:22.816 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:22.816 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:22.816 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:22.816 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:22.816 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:22.817 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:22.817 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:22.817 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:22.817 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:22.817 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.817 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:22.817 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:22.817 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:22.817 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:22.817 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:22.817 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:22.817 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:22.817 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:22.817 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:22.817 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:22.817 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:22.818 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.818 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.818 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:22.818 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:22.818 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:22.818 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:22.818 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:22.818 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.818 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.818 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:22.818 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:22.818 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:22.818 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:22.818 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:22.819 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.819 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:22.819 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:22.819 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:22.819 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:22.819 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:22.819 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-520" 2023-12-03T13:00:22.819 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.819 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:22.819 INFO:teuthology.orchestra.run.smithi003.stdout:______________________ test_delete_bucket_encryption_kms _______________________ 2023-12-03T13:00:22.819 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.819 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.819 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.819 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:22.819 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:22.819 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.819 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:22.820 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:22.820 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:22.820 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:22.820 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:22.820 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.820 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:22.820 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:22.820 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.820 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.820 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:22.820 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:22.820 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.820 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.820 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:22.821 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.821 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:22.821 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:22.821 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.821 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.821 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:22.821 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:22.821 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.821 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:22.821 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:22.821 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:22.821 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:22.821 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:22.822 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:22.822 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:22.822 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.822 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:22.822 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:22.822 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:22.822 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:22.822 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:22.822 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:22.822 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:22.822 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:22.822 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:22.822 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.822 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:22.822 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:22.823 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:22.823 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:22.823 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.823 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:22.823 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:22.823 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:22.823 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:22.823 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.823 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.823 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:22.823 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:22.823 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:22.823 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:22.823 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.824 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.824 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:22.824 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:22.824 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:22.824 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.824 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:22.824 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.824 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:22.824 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:22.824 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.824 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:22.824 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:22.824 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:22.824 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:22.824 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:22.825 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:22.825 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.825 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:22.825 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.825 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:22.825 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.825 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.825 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:22.825 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.825 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:22.825 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.825 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:22.825 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:22.825 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:22.825 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:22.825 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:22.826 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:22.826 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:22.826 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:22.826 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:22.826 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:22.826 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:22.826 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:22.826 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:22.826 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.826 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:22.826 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:22.826 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:22.826 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:22.826 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:22.827 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:22.827 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:22.827 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:22.827 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:22.827 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:22.827 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:22.827 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.827 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.827 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:22.827 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.827 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:22.827 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:22.827 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:22.827 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:22.827 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:22.827 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:22.828 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:22.828 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:22.828 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:22.828 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:22.828 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:22.828 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:22.828 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:22.828 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:22.828 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:22.828 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:22.828 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:22.828 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:22.828 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:22.828 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:22.828 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:22.829 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:22.829 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:22.829 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:22.829 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:22.829 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:22.829 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:22.829 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:22.829 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.829 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.829 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.829 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.829 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:22.829 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:22.829 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.829 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:22.829 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:22.830 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:22.830 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:22.830 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:22.830 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.830 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:22.830 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:22.830 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.830 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.830 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:22.830 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:22.830 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.830 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.830 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:22.830 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:22.831 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:22.831 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:22.831 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:22.831 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.831 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.831 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:22.831 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:22.831 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:22.831 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.831 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:22.831 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.831 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:22.831 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.831 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:22.831 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.832 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.encryption 2023-12-03T13:00:22.832 INFO:teuthology.orchestra.run.smithi003.stdout: def test_delete_bucket_encryption_kms(): 2023-12-03T13:00:22.832 INFO:teuthology.orchestra.run.smithi003.stdout:> bucket_name = get_new_bucket() 2023-12-03T13:00:22.832 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.832 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:12752: 2023-12-03T13:00:22.832 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.832 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:22.832 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:22.832 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:22.832 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:22.832 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:22.832 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:22.832 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:22.832 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:22.833 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:22.833 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:22.833 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:22.833 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:22.833 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:22.833 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:22.833 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:22.833 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:22.833 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:22.833 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:22.833 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:22.833 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:22.833 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:22.833 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:22.833 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:22.833 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:22.834 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:22.834 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:22.834 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:22.834 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:22.834 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:22.834 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:22.834 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:22.834 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:22.834 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:22.834 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:22.834 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:22.834 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:22.834 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.835 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.835 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.835 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:22.835 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.835 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:22.835 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.835 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:22.835 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:22.835 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:22.835 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:22.835 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:22.835 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:22.835 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:22.835 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:22.835 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:22.835 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:22.836 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:22.836 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:22.836 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:22.836 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.836 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:22.836 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:22.836 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:22.836 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:22.836 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:22.836 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:22.836 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:22.836 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:22.836 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:22.836 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:22.836 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:22.837 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.837 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.837 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:22.837 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:22.837 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:22.837 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:22.837 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:22.837 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.837 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.837 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:22.837 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:22.837 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:22.837 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:22.837 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:22.837 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.838 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:22.838 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:22.838 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:22.838 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:22.838 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:22.838 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-521" 2023-12-03T13:00:22.838 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.838 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:22.838 INFO:teuthology.orchestra.run.smithi003.stdout:____________ test_sse_kms_default_post_object_authenticated_request ____________ 2023-12-03T13:00:22.838 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.838 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.838 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.838 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:22.838 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:22.839 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.839 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:22.839 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:22.839 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:22.839 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:22.839 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:22.839 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.839 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:22.839 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:22.839 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.839 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.839 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:22.839 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:22.839 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.839 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.840 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:22.840 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.840 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:22.840 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:22.840 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.840 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.840 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:22.840 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:22.840 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.840 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:22.840 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:22.840 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:22.840 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:22.840 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:22.840 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:22.840 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:22.841 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.841 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:22.841 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:22.841 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:22.841 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:22.841 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:22.841 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:22.841 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:22.841 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:22.841 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:22.841 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.841 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:22.841 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:22.841 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:22.842 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:22.842 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.842 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:22.842 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:22.842 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:22.842 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:22.842 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.842 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.842 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:22.842 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:22.842 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:22.842 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:22.842 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.842 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.843 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:22.843 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:22.843 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:22.843 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.843 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:22.843 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.843 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:22.843 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:22.843 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.843 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:22.843 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:22.843 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:22.843 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:22.843 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:22.843 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:22.843 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.844 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:22.844 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.844 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:22.844 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.844 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.844 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:22.844 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.844 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:22.844 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.844 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:22.844 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:22.844 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:22.844 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:22.844 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:22.844 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:22.845 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:22.845 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:22.845 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:22.845 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:22.845 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:22.845 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:22.845 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:22.845 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.845 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:22.845 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:22.845 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:22.845 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:22.845 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:22.845 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:22.845 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:22.846 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:22.846 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:22.846 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:22.846 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:22.846 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.846 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.846 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:22.846 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.846 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:22.846 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:22.846 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:22.846 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:22.846 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:22.846 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:22.846 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:22.847 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:22.847 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:22.847 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:22.847 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:22.847 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:22.847 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:22.847 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:22.847 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:22.847 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:22.847 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:22.847 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:22.847 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:22.847 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:22.847 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:22.847 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:22.848 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:22.848 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:22.848 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:22.848 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:22.848 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:22.848 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:22.848 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.848 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.848 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.848 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.848 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:22.848 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:22.848 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.848 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:22.848 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:22.849 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:22.849 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:22.849 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:22.849 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.849 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:22.849 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:22.849 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.849 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.849 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:22.849 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:22.849 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.849 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.849 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:22.849 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:22.849 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:22.849 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:22.850 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:22.850 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.850 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.850 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:22.850 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:22.850 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:22.850 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.850 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:22.850 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.850 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:22.850 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.850 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:22.850 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.851 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.encryption 2023-12-03T13:00:22.851 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.bucket_encryption 2023-12-03T13:00:22.851 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T13:00:22.851 INFO:teuthology.orchestra.run.smithi003.stdout: def test_sse_kms_default_post_object_authenticated_request(): 2023-12-03T13:00:22.851 INFO:teuthology.orchestra.run.smithi003.stdout: kms_keyid = get_main_kms_keyid() 2023-12-03T13:00:22.851 INFO:teuthology.orchestra.run.smithi003.stdout: if kms_keyid is None: 2023-12-03T13:00:22.851 INFO:teuthology.orchestra.run.smithi003.stdout: pytest.skip('[s3 main] section missing kms_keyid') 2023-12-03T13:00:22.851 INFO:teuthology.orchestra.run.smithi003.stdout:> bucket_name = get_new_bucket() 2023-12-03T13:00:22.851 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.851 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:12996: 2023-12-03T13:00:22.851 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.851 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:22.851 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:22.851 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:22.851 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:22.852 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:22.852 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:22.852 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:22.852 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:22.852 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:22.852 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:22.852 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:22.852 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:22.852 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:22.852 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:22.852 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:22.852 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:22.852 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:22.852 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:22.852 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:22.852 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:22.853 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:22.853 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:22.853 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:22.853 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:22.853 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:22.853 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:22.853 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:22.853 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:22.853 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:22.853 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:22.853 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:22.853 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:22.853 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:22.853 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:22.853 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:22.853 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:22.854 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.854 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.854 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.854 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:22.854 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.854 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:22.854 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.854 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:22.854 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:22.854 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:22.854 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:22.854 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:22.854 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:22.854 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:22.855 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:22.855 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:22.855 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:22.855 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:22.855 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:22.855 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:22.855 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.855 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:22.855 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:22.855 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:22.855 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:22.855 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:22.855 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:22.855 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:22.855 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:22.855 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:22.856 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:22.856 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:22.856 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.856 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.856 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:22.856 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:22.856 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:22.856 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:22.856 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:22.856 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.856 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.856 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:22.856 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:22.856 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:22.857 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:22.857 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:22.857 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.857 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:22.857 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:22.857 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:22.857 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:22.857 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:22.857 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-522" 2023-12-03T13:00:22.857 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.857 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:22.857 INFO:teuthology.orchestra.run.smithi003.stdout:___________________________ test_get_object_torrent ____________________________ 2023-12-03T13:00:22.857 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.857 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.857 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.857 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:22.857 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:22.858 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.858 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:22.858 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:22.858 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:22.858 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:22.858 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:22.858 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.858 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:22.858 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:22.858 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.858 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.858 INFO:teuthology.orchestra.run.smithi003.stdout:> conn = connection.create_connection( 2023-12-03T13:00:22.858 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:22.858 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.858 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.859 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T13:00:22.859 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.859 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T13:00:22.859 INFO:teuthology.orchestra.run.smithi003.stdout: raise err 2023-12-03T13:00:22.859 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.859 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.859 INFO:teuthology.orchestra.run.smithi003.stdout:address = ('smithi003.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T13:00:22.859 INFO:teuthology.orchestra.run.smithi003.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T13:00:22.859 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.859 INFO:teuthology.orchestra.run.smithi003.stdout: def create_connection( 2023-12-03T13:00:22.859 INFO:teuthology.orchestra.run.smithi003.stdout: address, 2023-12-03T13:00:22.859 INFO:teuthology.orchestra.run.smithi003.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T13:00:22.859 INFO:teuthology.orchestra.run.smithi003.stdout: source_address=None, 2023-12-03T13:00:22.859 INFO:teuthology.orchestra.run.smithi003.stdout: socket_options=None, 2023-12-03T13:00:22.859 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:22.859 INFO:teuthology.orchestra.run.smithi003.stdout: """Connect to *address* and return the socket object. 2023-12-03T13:00:22.860 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.860 INFO:teuthology.orchestra.run.smithi003.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T13:00:22.860 INFO:teuthology.orchestra.run.smithi003.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T13:00:22.860 INFO:teuthology.orchestra.run.smithi003.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T13:00:22.860 INFO:teuthology.orchestra.run.smithi003.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T13:00:22.860 INFO:teuthology.orchestra.run.smithi003.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T13:00:22.860 INFO:teuthology.orchestra.run.smithi003.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T13:00:22.860 INFO:teuthology.orchestra.run.smithi003.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T13:00:22.860 INFO:teuthology.orchestra.run.smithi003.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T13:00:22.860 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:22.860 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.860 INFO:teuthology.orchestra.run.smithi003.stdout: host, port = address 2023-12-03T13:00:22.860 INFO:teuthology.orchestra.run.smithi003.stdout: if host.startswith("["): 2023-12-03T13:00:22.860 INFO:teuthology.orchestra.run.smithi003.stdout: host = host.strip("[]") 2023-12-03T13:00:22.860 INFO:teuthology.orchestra.run.smithi003.stdout: err = None 2023-12-03T13:00:22.861 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.861 INFO:teuthology.orchestra.run.smithi003.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T13:00:22.861 INFO:teuthology.orchestra.run.smithi003.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T13:00:22.861 INFO:teuthology.orchestra.run.smithi003.stdout: # The original create_connection function always returns all records. 2023-12-03T13:00:22.861 INFO:teuthology.orchestra.run.smithi003.stdout: family = allowed_gai_family() 2023-12-03T13:00:22.861 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.861 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.861 INFO:teuthology.orchestra.run.smithi003.stdout: host.encode("idna") 2023-12-03T13:00:22.861 INFO:teuthology.orchestra.run.smithi003.stdout: except UnicodeError: 2023-12-03T13:00:22.861 INFO:teuthology.orchestra.run.smithi003.stdout: return six.raise_from( 2023-12-03T13:00:22.861 INFO:teuthology.orchestra.run.smithi003.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T13:00:22.861 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.861 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.862 INFO:teuthology.orchestra.run.smithi003.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T13:00:22.862 INFO:teuthology.orchestra.run.smithi003.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T13:00:22.862 INFO:teuthology.orchestra.run.smithi003.stdout: sock = None 2023-12-03T13:00:22.862 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.862 INFO:teuthology.orchestra.run.smithi003.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T13:00:22.862 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.862 INFO:teuthology.orchestra.run.smithi003.stdout: # If provided, set socket level options before connecting. 2023-12-03T13:00:22.862 INFO:teuthology.orchestra.run.smithi003.stdout: _set_socket_options(sock, socket_options) 2023-12-03T13:00:22.862 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.862 INFO:teuthology.orchestra.run.smithi003.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T13:00:22.862 INFO:teuthology.orchestra.run.smithi003.stdout: sock.settimeout(timeout) 2023-12-03T13:00:22.862 INFO:teuthology.orchestra.run.smithi003.stdout: if source_address: 2023-12-03T13:00:22.862 INFO:teuthology.orchestra.run.smithi003.stdout: sock.bind(source_address) 2023-12-03T13:00:22.862 INFO:teuthology.orchestra.run.smithi003.stdout:> sock.connect(sa) 2023-12-03T13:00:22.863 INFO:teuthology.orchestra.run.smithi003.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T13:00:22.863 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.863 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T13:00:22.863 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.863 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:22.863 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.863 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.863 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:22.863 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.863 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:22.863 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.863 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:22.863 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:22.863 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:22.864 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:22.864 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:22.864 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:22.864 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:22.864 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:22.864 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:22.864 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:22.864 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:22.864 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:22.864 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:22.864 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.864 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:22.864 INFO:teuthology.orchestra.run.smithi003.stdout:> urllib_response = conn.urlopen( 2023-12-03T13:00:22.864 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:22.864 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:22.864 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:22.864 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:22.865 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:22.865 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:22.865 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:22.865 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:22.865 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:22.865 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.865 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.865 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T13:00:22.865 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.865 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T13:00:22.865 INFO:teuthology.orchestra.run.smithi003.stdout: retries = retries.increment( 2023-12-03T13:00:22.865 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T13:00:22.865 INFO:teuthology.orchestra.run.smithi003.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T13:00:22.865 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T13:00:22.865 INFO:teuthology.orchestra.run.smithi003.stdout: raise value 2023-12-03T13:00:22.865 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T13:00:22.866 INFO:teuthology.orchestra.run.smithi003.stdout: httplib_response = self._make_request( 2023-12-03T13:00:22.866 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T13:00:22.866 INFO:teuthology.orchestra.run.smithi003.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T13:00:22.866 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T13:00:22.866 INFO:teuthology.orchestra.run.smithi003.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T13:00:22.866 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T13:00:22.866 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T13:00:22.866 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T13:00:22.866 INFO:teuthology.orchestra.run.smithi003.stdout: rval = super()._send_request( 2023-12-03T13:00:22.866 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T13:00:22.866 INFO:teuthology.orchestra.run.smithi003.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T13:00:22.866 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T13:00:22.866 INFO:teuthology.orchestra.run.smithi003.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T13:00:22.866 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T13:00:22.866 INFO:teuthology.orchestra.run.smithi003.stdout: self.send(msg) 2023-12-03T13:00:22.867 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T13:00:22.867 INFO:teuthology.orchestra.run.smithi003.stdout: return super().send(str) 2023-12-03T13:00:22.867 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T13:00:22.867 INFO:teuthology.orchestra.run.smithi003.stdout: self.connect() 2023-12-03T13:00:22.867 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T13:00:22.867 INFO:teuthology.orchestra.run.smithi003.stdout: conn = self._new_conn() 2023-12-03T13:00:22.867 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.867 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.867 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.867 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.867 INFO:teuthology.orchestra.run.smithi003.stdout: def _new_conn(self): 2023-12-03T13:00:22.867 INFO:teuthology.orchestra.run.smithi003.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T13:00:22.867 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.867 INFO:teuthology.orchestra.run.smithi003.stdout: :return: New socket connection. 2023-12-03T13:00:22.867 INFO:teuthology.orchestra.run.smithi003.stdout: """ 2023-12-03T13:00:22.868 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw = {} 2023-12-03T13:00:22.868 INFO:teuthology.orchestra.run.smithi003.stdout: if self.source_address: 2023-12-03T13:00:22.868 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T13:00:22.868 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.868 INFO:teuthology.orchestra.run.smithi003.stdout: if self.socket_options: 2023-12-03T13:00:22.868 INFO:teuthology.orchestra.run.smithi003.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T13:00:22.868 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.868 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.868 INFO:teuthology.orchestra.run.smithi003.stdout: conn = connection.create_connection( 2023-12-03T13:00:22.868 INFO:teuthology.orchestra.run.smithi003.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T13:00:22.868 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.868 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.868 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketTimeout: 2023-12-03T13:00:22.868 INFO:teuthology.orchestra.run.smithi003.stdout: raise ConnectTimeoutError( 2023-12-03T13:00:22.868 INFO:teuthology.orchestra.run.smithi003.stdout: self, 2023-12-03T13:00:22.869 INFO:teuthology.orchestra.run.smithi003.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T13:00:22.869 INFO:teuthology.orchestra.run.smithi003.stdout: % (self.host, self.timeout), 2023-12-03T13:00:22.869 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.869 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.869 INFO:teuthology.orchestra.run.smithi003.stdout: except SocketError as e: 2023-12-03T13:00:22.869 INFO:teuthology.orchestra.run.smithi003.stdout:> raise NewConnectionError( 2023-12-03T13:00:22.869 INFO:teuthology.orchestra.run.smithi003.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T13:00:22.869 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.869 INFO:teuthology.orchestra.run.smithi003.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T13:00:22.869 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.869 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T13:00:22.869 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.869 INFO:teuthology.orchestra.run.smithi003.stdout:During handling of the above exception, another exception occurred: 2023-12-03T13:00:22.869 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.869 INFO:teuthology.orchestra.run.smithi003.stdout: def test_get_object_torrent(): 2023-12-03T13:00:22.870 INFO:teuthology.orchestra.run.smithi003.stdout: client = get_client() 2023-12-03T13:00:22.870 INFO:teuthology.orchestra.run.smithi003.stdout:> bucket_name = get_new_bucket() 2023-12-03T13:00:22.870 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.870 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:13081: 2023-12-03T13:00:22.870 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.870 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T13:00:22.870 INFO:teuthology.orchestra.run.smithi003.stdout: client.create_bucket(Bucket=name) 2023-12-03T13:00:22.870 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T13:00:22.870 INFO:teuthology.orchestra.run.smithi003.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T13:00:22.870 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T13:00:22.870 INFO:teuthology.orchestra.run.smithi003.stdout: http, parsed_response = self._make_request( 2023-12-03T13:00:22.870 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T13:00:22.870 INFO:teuthology.orchestra.run.smithi003.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T13:00:22.870 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T13:00:22.871 INFO:teuthology.orchestra.run.smithi003.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T13:00:22.871 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T13:00:22.871 INFO:teuthology.orchestra.run.smithi003.stdout: while self._needs_retry( 2023-12-03T13:00:22.871 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T13:00:22.871 INFO:teuthology.orchestra.run.smithi003.stdout: responses = self._event_emitter.emit( 2023-12-03T13:00:22.871 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T13:00:22.871 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T13:00:22.871 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T13:00:22.871 INFO:teuthology.orchestra.run.smithi003.stdout: return self._emit(event_name, kwargs) 2023-12-03T13:00:22.871 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T13:00:22.871 INFO:teuthology.orchestra.run.smithi003.stdout: response = handler(**kwargs) 2023-12-03T13:00:22.871 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T13:00:22.871 INFO:teuthology.orchestra.run.smithi003.stdout: if self._checker(**checker_kwargs): 2023-12-03T13:00:22.871 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T13:00:22.872 INFO:teuthology.orchestra.run.smithi003.stdout: should_retry = self._should_retry( 2023-12-03T13:00:22.872 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T13:00:22.872 INFO:teuthology.orchestra.run.smithi003.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T13:00:22.872 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T13:00:22.872 INFO:teuthology.orchestra.run.smithi003.stdout: checker_response = checker( 2023-12-03T13:00:22.872 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T13:00:22.872 INFO:teuthology.orchestra.run.smithi003.stdout: return self._check_caught_exception( 2023-12-03T13:00:22.872 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T13:00:22.872 INFO:teuthology.orchestra.run.smithi003.stdout: raise caught_exception 2023-12-03T13:00:22.872 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T13:00:22.872 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = self._send(request) 2023-12-03T13:00:22.872 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T13:00:22.872 INFO:teuthology.orchestra.run.smithi003.stdout: return self.http_session.send(request) 2023-12-03T13:00:22.872 INFO:teuthology.orchestra.run.smithi003.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T13:00:22.872 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.873 INFO:teuthology.orchestra.run.smithi003.stdout:self = 2023-12-03T13:00:22.873 INFO:teuthology.orchestra.run.smithi003.stdout:request = 2023-12-03T13:00:22.873 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.873 INFO:teuthology.orchestra.run.smithi003.stdout: def send(self, request): 2023-12-03T13:00:22.873 INFO:teuthology.orchestra.run.smithi003.stdout: try: 2023-12-03T13:00:22.873 INFO:teuthology.orchestra.run.smithi003.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T13:00:22.873 INFO:teuthology.orchestra.run.smithi003.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T13:00:22.873 INFO:teuthology.orchestra.run.smithi003.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T13:00:22.873 INFO:teuthology.orchestra.run.smithi003.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T13:00:22.873 INFO:teuthology.orchestra.run.smithi003.stdout: if ensure_boolean( 2023-12-03T13:00:22.873 INFO:teuthology.orchestra.run.smithi003.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T13:00:22.873 INFO:teuthology.orchestra.run.smithi003.stdout: ): 2023-12-03T13:00:22.873 INFO:teuthology.orchestra.run.smithi003.stdout: # This is currently an "experimental" feature which provides 2023-12-03T13:00:22.873 INFO:teuthology.orchestra.run.smithi003.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T13:00:22.873 INFO:teuthology.orchestra.run.smithi003.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T13:00:22.874 INFO:teuthology.orchestra.run.smithi003.stdout: # to this feature should strictly pin botocore. 2023-12-03T13:00:22.874 INFO:teuthology.orchestra.run.smithi003.stdout: host = urlparse(request.url).hostname 2023-12-03T13:00:22.874 INFO:teuthology.orchestra.run.smithi003.stdout: conn.proxy_headers['host'] = host 2023-12-03T13:00:22.874 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.874 INFO:teuthology.orchestra.run.smithi003.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T13:00:22.874 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response = conn.urlopen( 2023-12-03T13:00:22.874 INFO:teuthology.orchestra.run.smithi003.stdout: method=request.method, 2023-12-03T13:00:22.874 INFO:teuthology.orchestra.run.smithi003.stdout: url=request_target, 2023-12-03T13:00:22.874 INFO:teuthology.orchestra.run.smithi003.stdout: body=request.body, 2023-12-03T13:00:22.874 INFO:teuthology.orchestra.run.smithi003.stdout: headers=request.headers, 2023-12-03T13:00:22.874 INFO:teuthology.orchestra.run.smithi003.stdout: retries=Retry(False), 2023-12-03T13:00:22.874 INFO:teuthology.orchestra.run.smithi003.stdout: assert_same_host=False, 2023-12-03T13:00:22.874 INFO:teuthology.orchestra.run.smithi003.stdout: preload_content=False, 2023-12-03T13:00:22.874 INFO:teuthology.orchestra.run.smithi003.stdout: decode_content=False, 2023-12-03T13:00:22.875 INFO:teuthology.orchestra.run.smithi003.stdout: chunked=self._chunked(request.headers), 2023-12-03T13:00:22.875 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.875 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.875 INFO:teuthology.orchestra.run.smithi003.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T13:00:22.875 INFO:teuthology.orchestra.run.smithi003.stdout: request.url, 2023-12-03T13:00:22.875 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.status, 2023-12-03T13:00:22.875 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response.headers, 2023-12-03T13:00:22.875 INFO:teuthology.orchestra.run.smithi003.stdout: urllib_response, 2023-12-03T13:00:22.875 INFO:teuthology.orchestra.run.smithi003.stdout: ) 2023-12-03T13:00:22.875 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.875 INFO:teuthology.orchestra.run.smithi003.stdout: if not request.stream_output: 2023-12-03T13:00:22.875 INFO:teuthology.orchestra.run.smithi003.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T13:00:22.875 INFO:teuthology.orchestra.run.smithi003.stdout: # this way instead of using preload_content because 2023-12-03T13:00:22.875 INFO:teuthology.orchestra.run.smithi003.stdout: # preload_content will never buffer chunked responses 2023-12-03T13:00:22.875 INFO:teuthology.orchestra.run.smithi003.stdout: http_response.content 2023-12-03T13:00:22.875 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.876 INFO:teuthology.orchestra.run.smithi003.stdout: return http_response 2023-12-03T13:00:22.876 INFO:teuthology.orchestra.run.smithi003.stdout: except URLLib3SSLError as e: 2023-12-03T13:00:22.876 INFO:teuthology.orchestra.run.smithi003.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T13:00:22.876 INFO:teuthology.orchestra.run.smithi003.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T13:00:22.876 INFO:teuthology.orchestra.run.smithi003.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T13:00:22.876 INFO:teuthology.orchestra.run.smithi003.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi003.front.sepia.ceph.com:80/test-client.0-x6ti0ebgdtce8z6-523" 2023-12-03T13:00:22.876 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.876 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T13:00:22.876 INFO:teuthology.orchestra.run.smithi003.stdout:=============================== warnings summary =============================== 2023-12-03T13:00:22.876 INFO:teuthology.orchestra.run.smithi003.stdout:.tox/py/lib/python3.9/site-packages/boto/plugin.py:40 2023-12-03T13:00:22.876 INFO:teuthology.orchestra.run.smithi003.stdout: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/lib/python3.9/site-packages/boto/plugin.py:40: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses 2023-12-03T13:00:22.876 INFO:teuthology.orchestra.run.smithi003.stdout: import imp 2023-12-03T13:00:22.876 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.876 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests/functional/test_headers.py:124 2023-12-03T13:00:22.877 INFO:teuthology.orchestra.run.smithi003.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_headers.py:124: SyntaxWarning: "is" with a literal. Did you mean "=="? 2023-12-03T13:00:22.877 INFO:teuthology.orchestra.run.smithi003.stdout: if boto_type is 'S3Connection': 2023-12-03T13:00:22.877 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.877 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests/functional/test_headers.py:129 2023-12-03T13:00:22.877 INFO:teuthology.orchestra.run.smithi003.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_headers.py:129: SyntaxWarning: "is" with a literal. Did you mean "=="? 2023-12-03T13:00:22.877 INFO:teuthology.orchestra.run.smithi003.stdout: elif boto_type is 'HTTPRequest': 2023-12-03T13:00:22.877 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.877 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests/functional/test_s3.py:359 2023-12-03T13:00:22.877 INFO:teuthology.orchestra.run.smithi003.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3.py:359: DeprecationWarning: invalid escape sequence \W 2023-12-03T13:00:22.877 INFO:teuthology.orchestra.run.smithi003.stdout: extra_sc = re.split('\W+', config['main']['storage_classes']) 2023-12-03T13:00:22.877 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.877 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests/functional/test_s3_website.py:176 2023-12-03T13:00:22.877 INFO:teuthology.orchestra.run.smithi003.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3_website.py:176: SyntaxWarning: "is" with a literal. Did you mean "=="? 2023-12-03T13:00:22.877 INFO:teuthology.orchestra.run.smithi003.stdout: if k is 'BucketName': 2023-12-03T13:00:22.877 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.878 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests/functional/test_s3_website.py:253 2023-12-03T13:00:22.878 INFO:teuthology.orchestra.run.smithi003.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3_website.py:253: PytestUnknownMarkWarning: Unknown pytest.mark.timeout - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/stable/how-to/mark.html 2023-12-03T13:00:22.878 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.timeout(10) 2023-12-03T13:00:22.878 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.878 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests/functional/test_s3_website.py:1077 2023-12-03T13:00:22.878 INFO:teuthology.orchestra.run.smithi003.stdout: s3tests/functional/test_s3_website.py:1077: PytestCollectionWarning: yield tests were removed in pytest 4.0 - test_routing_generator will be ignored 2023-12-03T13:00:22.878 INFO:teuthology.orchestra.run.smithi003.stdout: @pytest.mark.s3website_routing_rules 2023-12-03T13:00:22.878 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.878 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:2212 2023-12-03T13:00:22.878 INFO:teuthology.orchestra.run.smithi003.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2212: DeprecationWarning: invalid escape sequence \$ 2023-12-03T13:00:22.878 INFO:teuthology.orchestra.run.smithi003.stdout: ["starts-with", "$key", "\$foo"],\ 2023-12-03T13:00:22.878 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.878 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:2227 2023-12-03T13:00:22.878 INFO:teuthology.orchestra.run.smithi003.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2227: DeprecationWarning: invalid escape sequence \$ 2023-12-03T13:00:22.878 INFO:teuthology.orchestra.run.smithi003.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2023-12-03T13:00:22.879 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.879 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:2233 2023-12-03T13:00:22.879 INFO:teuthology.orchestra.run.smithi003.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2233: DeprecationWarning: invalid escape sequence \$ 2023-12-03T13:00:22.879 INFO:teuthology.orchestra.run.smithi003.stdout: response = client.get_object(Bucket=bucket_name, Key='\$foo.txt') 2023-12-03T13:00:22.879 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.879 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:2290 2023-12-03T13:00:22.879 INFO:teuthology.orchestra.run.smithi003.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2290: DeprecationWarning: invalid escape sequence \$ 2023-12-03T13:00:22.879 INFO:teuthology.orchestra.run.smithi003.stdout: ["starts-with", "$key", "\$foo"],\ 2023-12-03T13:00:22.879 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.879 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:2305 2023-12-03T13:00:22.879 INFO:teuthology.orchestra.run.smithi003.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2305: DeprecationWarning: invalid escape sequence \$ 2023-12-03T13:00:22.879 INFO:teuthology.orchestra.run.smithi003.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2023-12-03T13:00:22.879 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.879 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:2323 2023-12-03T13:00:22.880 INFO:teuthology.orchestra.run.smithi003.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2323: DeprecationWarning: invalid escape sequence \$ 2023-12-03T13:00:22.880 INFO:teuthology.orchestra.run.smithi003.stdout: ["starts-with", "$key", "\$foo"],\ 2023-12-03T13:00:22.880 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.880 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:2338 2023-12-03T13:00:22.880 INFO:teuthology.orchestra.run.smithi003.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2338: DeprecationWarning: invalid escape sequence \$ 2023-12-03T13:00:22.880 INFO:teuthology.orchestra.run.smithi003.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id[::-1]),\ 2023-12-03T13:00:22.880 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.880 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:2356 2023-12-03T13:00:22.880 INFO:teuthology.orchestra.run.smithi003.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2356: DeprecationWarning: invalid escape sequence \$ 2023-12-03T13:00:22.880 INFO:teuthology.orchestra.run.smithi003.stdout: ["starts-with", "$key", "\$foo"],\ 2023-12-03T13:00:22.880 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.880 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:2371 2023-12-03T13:00:22.880 INFO:teuthology.orchestra.run.smithi003.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2371: DeprecationWarning: invalid escape sequence \$ 2023-12-03T13:00:22.880 INFO:teuthology.orchestra.run.smithi003.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2023-12-03T13:00:22.880 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.881 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:2421 2023-12-03T13:00:22.881 INFO:teuthology.orchestra.run.smithi003.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2421: DeprecationWarning: invalid escape sequence \$ 2023-12-03T13:00:22.881 INFO:teuthology.orchestra.run.smithi003.stdout: ["starts-with", "$key", "\$foo"],\ 2023-12-03T13:00:22.881 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.881 INFO:teuthology.orchestra.run.smithi003.stdout:s3tests_boto3/functional/test_s3.py:2453 2023-12-03T13:00:22.881 INFO:teuthology.orchestra.run.smithi003.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2453: DeprecationWarning: invalid escape sequence \$ 2023-12-03T13:00:22.881 INFO:teuthology.orchestra.run.smithi003.stdout: ["starts-with", "$key", "\$foo"],\ 2023-12-03T13:00:22.881 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-12-03T13:00:22.881 INFO:teuthology.orchestra.run.smithi003.stdout:-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html 2023-12-03T13:00:22.881 INFO:teuthology.orchestra.run.smithi003.stdout:=========================== short test summary info ============================ 2023-12-03T13:00:22.881 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_multipart_upload_empty - bot... 2023-12-03T13:00:22.881 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_multipart_upload_small - bot... 2023-12-03T13:00:22.881 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_multipart_copy_small - botoc... 2023-12-03T13:00:22.881 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_multipart_copy_invalid_range 2023-12-03T13:00:22.882 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_multipart_copy_without_range 2023-12-03T13:00:22.882 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_multipart_copy_special_names 2023-12-03T13:00:22.882 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_multipart_upload - botocore.... 2023-12-03T13:00:22.882 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_multipart_copy_versioned - b... 2023-12-03T13:00:22.882 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_multipart_upload_resend_part 2023-12-03T13:00:22.882 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_multipart_upload_multiple_sizes 2023-12-03T13:00:22.882 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_multipart_copy_multiple_sizes 2023-12-03T13:00:22.882 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_multipart_upload_size_too_small 2023-12-03T13:00:22.882 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_multipart_upload_contents - ... 2023-12-03T13:00:22.882 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_multipart_upload_overwrite_existing_object 2023-12-03T13:00:22.882 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_abort_multipart_upload - bot... 2023-12-03T13:00:22.882 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_abort_multipart_upload_not_found 2023-12-03T13:00:22.882 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_list_multipart_upload - boto... 2023-12-03T13:00:22.882 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_list_multipart_upload_owner 2023-12-03T13:00:22.882 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_multipart_upload_missing_part 2023-12-03T13:00:22.883 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_multipart_upload_incorrect_etag 2023-12-03T13:00:22.883 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_multipart_get_part - botocor... 2023-12-03T13:00:22.883 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_non_multipart_get_part - bot... 2023-12-03T13:00:22.883 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_100_continue - botocore.exce... 2023-12-03T13:00:22.883 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_set_cors - botocore.exceptio... 2023-12-03T13:00:22.883 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_cors_origin_response - botoc... 2023-12-03T13:00:22.883 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_cors_origin_wildcard - botoc... 2023-12-03T13:00:22.883 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_cors_header_option - botocor... 2023-12-03T13:00:22.883 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_cors_presigned_get_object - ... 2023-12-03T13:00:22.883 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_cors_presigned_get_object_tenant 2023-12-03T13:00:22.883 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_set_bucket_tagging - botocor... 2023-12-03T13:00:22.883 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_atomic_read_1mb - botocore.e... 2023-12-03T13:00:22.883 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_atomic_read_4mb - botocore.e... 2023-12-03T13:00:22.883 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_atomic_read_8mb - botocore.e... 2023-12-03T13:00:22.883 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_atomic_write_1mb - botocore.... 2023-12-03T13:00:22.884 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_atomic_write_4mb - botocore.... 2023-12-03T13:00:22.884 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_atomic_write_8mb - botocore.... 2023-12-03T13:00:22.884 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_1mb - boto... 2023-12-03T13:00:22.884 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_4mb - boto... 2023-12-03T13:00:22.884 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_8mb - boto... 2023-12-03T13:00:22.884 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_atomic_conditional_write_1mb 2023-12-03T13:00:22.884 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_atomic_multipart_upload_write 2023-12-03T13:00:22.884 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_multipart_resend_first_finishes_last 2023-12-03T13:00:22.884 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_ranged_request_response_code 2023-12-03T13:00:22.884 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_ranged_big_request_response_code 2023-12-03T13:00:22.884 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_ranged_request_skip_leading_bytes_response_code 2023-12-03T13:00:22.884 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_ranged_request_return_trailing_bytes_response_code 2023-12-03T13:00:22.884 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_ranged_request_invalid_range 2023-12-03T13:00:22.884 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_ranged_request_empty_object 2023-12-03T13:00:22.884 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_versioning_bucket_create_suspend 2023-12-03T13:00:22.885 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove 2023-12-03T13:00:22.885 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove_head 2023-12-03T13:00:22.885 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_removal 2023-12-03T13:00:22.885 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite 2023-12-03T13:00:22.885 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite_suspended 2023-12-03T13:00:22.885 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_versioning_obj_suspend_versions 2023-12-03T13:00:22.885 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_all 2023-12-03T13:00:22.885 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_special_names 2023-12-03T13:00:22.885 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_overwrite_multipart 2023-12-03T13:00:22.885 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_versioning_obj_list_marker 2023-12-03T13:00:22.885 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_versioning_copy_obj_version 2023-12-03T13:00:22.885 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete 2023-12-03T13:00:22.885 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker 2023-12-03T13:00:22.885 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker_create 2023-12-03T13:00:22.885 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_versioned_object_acl - botoc... 2023-12-03T13:00:22.886 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_versioned_object_acl_no_version_specified 2023-12-03T13:00:22.886 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_versioned_concurrent_object_create_and_remove 2023-12-03T13:00:22.886 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_lifecycle_set - botocore.exc... 2023-12-03T13:00:22.886 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_lifecycle_get - botocore.exc... 2023-12-03T13:00:22.886 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_lifecycle_get_no_id - botoco... 2023-12-03T13:00:22.886 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_lifecycle_id_too_long - boto... 2023-12-03T13:00:22.886 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_lifecycle_same_id - botocore... 2023-12-03T13:00:22.886 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_lifecycle_invalid_status - b... 2023-12-03T13:00:22.886 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_lifecycle_set_date - botocor... 2023-12-03T13:00:22.886 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_lifecycle_set_invalid_date 2023-12-03T13:00:22.886 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_lifecycle_set_noncurrent - b... 2023-12-03T13:00:22.886 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_lifecycle_set_deletemarker 2023-12-03T13:00:22.886 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_lifecycle_set_filter - botoc... 2023-12-03T13:00:22.886 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_lifecycle_set_empty_filter 2023-12-03T13:00:22.886 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_lifecycle_set_multipart - bo... 2023-12-03T13:00:22.887 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_lifecycle_transition_set_invalid_date 2023-12-03T13:00:22.887 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1b - boto... 2023-12-03T13:00:22.887 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1kb - bot... 2023-12-03T13:00:22.887 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1MB - bot... 2023-12-03T13:00:22.887 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_13b - bot... 2023-12-03T13:00:22.887 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_method_head 2023-12-03T13:00:22.887 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_present - b... 2023-12-03T13:00:22.887 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_other_key 2023-12-03T13:00:22.887 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_invalid_md5 2023-12-03T13:00:22.887 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_md5 - bo... 2023-12-03T13:00:22.887 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_key - bo... 2023-12-03T13:00:22.887 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_encryption_key_no_sse_c - bo... 2023-12-03T13:00:22.887 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_upload 2023-12-03T13:00:22.887 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_unaligned_multipart_upload 2023-12-03T13:00:22.887 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_bad_download 2023-12-03T13:00:22.888 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_post_object_authenticated_request 2023-12-03T13:00:22.888 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_sse_kms_method_head - botoco... 2023-12-03T13:00:22.888 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_sse_kms_present - botocore.e... 2023-12-03T13:00:22.888 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_sse_kms_no_key - botocore.ex... 2023-12-03T13:00:22.888 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_sse_kms_not_declared - botoc... 2023-12-03T13:00:22.888 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_upload - b... 2023-12-03T13:00:22.888 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_1 2023-12-03T13:00:22.888 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_2 2023-12-03T13:00:22.888 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_sse_kms_post_object_authenticated_request 2023-12-03T13:00:22.888 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1b - botoco... 2023-12-03T13:00:22.888 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1kb - botoc... 2023-12-03T13:00:22.888 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1MB - botoc... 2023-12-03T13:00:22.888 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_13b - botoc... 2023-12-03T13:00:22.888 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_sse_kms_read_declare - botoc... 2023-12-03T13:00:22.889 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_bucket_policy - botocore.exc... 2023-12-03T13:00:22.889 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_bucketv2_policy - botocore.e... 2023-12-03T13:00:22.889 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_bucket_policy_acl - botocore... 2023-12-03T13:00:22.889 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_acl - botoco... 2023-12-03T13:00:22.889 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_bucket_policy_another_bucket 2023-12-03T13:00:22.889 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_another_bucket 2023-12-03T13:00:22.889 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_get_obj_tagging - botocore.e... 2023-12-03T13:00:22.889 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_get_obj_head_tagging - botoc... 2023-12-03T13:00:22.889 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_put_max_tags - botocore.exce... 2023-12-03T13:00:22.889 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_put_excess_tags - botocore.e... 2023-12-03T13:00:22.889 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_put_max_kvsize_tags - botoco... 2023-12-03T13:00:22.889 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_put_excess_key_tags - botoco... 2023-12-03T13:00:22.889 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_put_excess_val_tags - botoco... 2023-12-03T13:00:22.889 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_put_modify_tags - botocore.e... 2023-12-03T13:00:22.889 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_put_delete_tags - botocore.e... 2023-12-03T13:00:22.890 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_post_object_tags_anonymous_request 2023-12-03T13:00:22.890 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_post_object_tags_authenticated_request 2023-12-03T13:00:22.890 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_put_obj_with_tags - botocore... 2023-12-03T13:00:22.890 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_get_tags_acl_public - botoco... 2023-12-03T13:00:22.890 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_put_tags_acl_public - botoco... 2023-12-03T13:00:22.890 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_delete_tags_obj_public - bot... 2023-12-03T13:00:22.890 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_versioning_bucket_atomic_upload_return_version_id 2023-12-03T13:00:22.890 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_versioning_bucket_multipart_upload_return_version_id 2023-12-03T13:00:22.890 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_existing_tag 2023-12-03T13:00:22.890 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_tagging_existing_tag 2023-12-03T13:00:22.890 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_tagging_existing_tag 2023-12-03T13:00:22.890 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source 2023-12-03T13:00:22.890 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source_meta 2023-12-03T13:00:22.890 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_acl - ... 2023-12-03T13:00:22.891 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_grant 2023-12-03T13:00:22.891 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_s3 - ... 2023-12-03T13:00:22.891 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_kms 2023-12-03T13:00:22.891 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_s3_kms 2023-12-03T13:00:22.891 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_bad_enc_kms 2023-12-03T13:00:22.891 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_noenc 2023-12-03T13:00:22.891 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_s3 2023-12-03T13:00:22.891 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_acl_existing_tag 2023-12-03T13:00:22.891 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock - b... 2023-12-03T13:00:22.891 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_bucket 2023-12-03T13:00:22.891 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_with_days_and_years 2023-12-03T13:00:22.891 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_days 2023-12-03T13:00:22.891 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_years 2023-12-03T13:00:22.891 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_mode 2023-12-03T13:00:22.891 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_status 2023-12-03T13:00:22.892 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_suspend_versioning 2023-12-03T13:00:22.892 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock - b... 2023-12-03T13:00:22.892 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock_invalid_bucket 2023-12-03T13:00:22.892 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention 2023-12-03T13:00:22.892 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_bucket 2023-12-03T13:00:22.892 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_mode 2023-12-03T13:00:22.892 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention 2023-12-03T13:00:22.892 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_iso8601 2023-12-03T13:00:22.892 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_invalid_bucket 2023-12-03T13:00:22.892 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_versionid 2023-12-03T13:00:22.892 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_override_default_retention 2023-12-03T13:00:22.892 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_increase_period 2023-12-03T13:00:22.892 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period 2023-12-03T13:00:22.892 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period_bypass 2023-12-03T13:00:22.892 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention 2023-12-03T13:00:22.893 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention_and_marker 2023-12-03T13:00:22.893 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_multi_delete_object_with_retention 2023-12-03T13:00:22.893 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold 2023-12-03T13:00:22.893 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_bucket 2023-12-03T13:00:22.893 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_status 2023-12-03T13:00:22.893 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold 2023-12-03T13:00:22.893 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold_invalid_bucket 2023-12-03T13:00:22.893 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_on 2023-12-03T13:00:22.893 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_off 2023-12-03T13:00:22.893 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_metadata 2023-12-03T13:00:22.893 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_uploading_obj - ... 2023-12-03T13:00:22.893 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_with_bypass 2023-12-03T13:00:22.893 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_without_bypass 2023-12-03T13:00:22.893 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_compliance 2023-12-03T13:00:22.893 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_copy_object_ifmatch_good - b... 2023-12-03T13:00:22.894 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_copy_object_ifnonematch_failed 2023-12-03T13:00:22.894 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_get_bucket_policy_status - b... 2023-12-03T13:00:22.894 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_get_public_acl_bucket_policy_status 2023-12-03T13:00:22.894 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_get_authpublic_acl_bucket_policy_status 2023-12-03T13:00:22.894 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_get_publicpolicy_acl_bucket_policy_status 2023-12-03T13:00:22.894 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_acl_bucket_policy_status 2023-12-03T13:00:22.894 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_deny_bucket_policy_status 2023-12-03T13:00:22.894 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_get_default_public_block - b... 2023-12-03T13:00:22.894 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_put_public_block - botocore.... 2023-12-03T13:00:22.894 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_block_public_put_bucket_acls 2023-12-03T13:00:22.894 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_block_public_object_canned_acls 2023-12-03T13:00:22.894 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_block_public_policy - botoco... 2023-12-03T13:00:22.894 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_ignore_public_acls - botocor... 2023-12-03T13:00:22.894 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_multipart_upload_on_a_bucket_with_policy 2023-12-03T13:00:22.895 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_put_bucket_encryption_kms - ... 2023-12-03T13:00:22.895 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_get_bucket_encryption_kms - ... 2023-12-03T13:00:22.895 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_delete_bucket_encryption_kms 2023-12-03T13:00:22.895 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_sse_kms_default_post_object_authenticated_request 2023-12-03T13:00:22.895 INFO:teuthology.orchestra.run.smithi003.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_get_object_torrent - botocor... 2023-12-03T13:00:22.895 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_multipart_upload_empty - boto... 2023-12-03T13:00:22.895 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_multipart_upload_small - boto... 2023-12-03T13:00:22.895 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_multipart_copy_small - botoco... 2023-12-03T13:00:22.895 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_multipart_copy_invalid_range 2023-12-03T13:00:22.895 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_multipart_copy_without_range 2023-12-03T13:00:22.895 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_multipart_copy_special_names 2023-12-03T13:00:22.895 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_multipart_upload - botocore.e... 2023-12-03T13:00:22.895 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_multipart_copy_versioned - bo... 2023-12-03T13:00:22.895 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_multipart_upload_resend_part 2023-12-03T13:00:22.895 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_multipart_upload_multiple_sizes 2023-12-03T13:00:22.896 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_multipart_copy_multiple_sizes 2023-12-03T13:00:22.896 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_multipart_upload_size_too_small 2023-12-03T13:00:22.896 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_multipart_upload_contents - b... 2023-12-03T13:00:22.896 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_multipart_upload_overwrite_existing_object 2023-12-03T13:00:22.896 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_abort_multipart_upload - boto... 2023-12-03T13:00:22.896 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_abort_multipart_upload_not_found 2023-12-03T13:00:22.896 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_list_multipart_upload - botoc... 2023-12-03T13:00:22.896 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_list_multipart_upload_owner 2023-12-03T13:00:22.896 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_multipart_upload_missing_part 2023-12-03T13:00:22.896 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_multipart_upload_incorrect_etag 2023-12-03T13:00:22.896 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_multipart_get_part - botocore... 2023-12-03T13:00:22.896 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_non_multipart_get_part - boto... 2023-12-03T13:00:22.896 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_100_continue - botocore.excep... 2023-12-03T13:00:22.896 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_set_cors - botocore.exception... 2023-12-03T13:00:22.896 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_cors_origin_response - botoco... 2023-12-03T13:00:22.896 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_cors_origin_wildcard - botoco... 2023-12-03T13:00:22.897 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_cors_header_option - botocore... 2023-12-03T13:00:22.897 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_cors_presigned_get_object - b... 2023-12-03T13:00:22.897 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_cors_presigned_get_object_tenant 2023-12-03T13:00:22.897 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_set_bucket_tagging - botocore... 2023-12-03T13:00:22.897 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_atomic_read_1mb - botocore.ex... 2023-12-03T13:00:22.897 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_atomic_read_4mb - botocore.ex... 2023-12-03T13:00:22.897 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_atomic_read_8mb - botocore.ex... 2023-12-03T13:00:22.897 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_atomic_write_1mb - botocore.e... 2023-12-03T13:00:22.897 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_atomic_write_4mb - botocore.e... 2023-12-03T13:00:22.897 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_atomic_write_8mb - botocore.e... 2023-12-03T13:00:22.897 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_1mb - botoc... 2023-12-03T13:00:22.897 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_4mb - botoc... 2023-12-03T13:00:22.897 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_8mb - botoc... 2023-12-03T13:00:22.897 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_atomic_conditional_write_1mb 2023-12-03T13:00:22.897 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_atomic_multipart_upload_write 2023-12-03T13:00:22.897 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_multipart_resend_first_finishes_last 2023-12-03T13:00:22.898 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_ranged_request_response_code 2023-12-03T13:00:22.898 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_ranged_big_request_response_code 2023-12-03T13:00:22.898 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_ranged_request_skip_leading_bytes_response_code 2023-12-03T13:00:22.898 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_ranged_request_return_trailing_bytes_response_code 2023-12-03T13:00:22.898 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_ranged_request_invalid_range 2023-12-03T13:00:22.898 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_ranged_request_empty_object 2023-12-03T13:00:22.898 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_versioning_bucket_create_suspend 2023-12-03T13:00:22.898 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove 2023-12-03T13:00:22.898 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove_head 2023-12-03T13:00:22.898 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_removal 2023-12-03T13:00:22.898 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite 2023-12-03T13:00:22.898 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite_suspended 2023-12-03T13:00:22.898 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_versioning_obj_suspend_versions 2023-12-03T13:00:22.898 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_all 2023-12-03T13:00:22.899 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_special_names 2023-12-03T13:00:22.899 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_overwrite_multipart 2023-12-03T13:00:22.899 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_versioning_obj_list_marker - ... 2023-12-03T13:00:22.899 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_versioning_copy_obj_version 2023-12-03T13:00:22.899 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete 2023-12-03T13:00:22.899 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker 2023-12-03T13:00:22.899 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker_create 2023-12-03T13:00:22.899 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_versioned_object_acl - botoco... 2023-12-03T13:00:22.899 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_versioned_object_acl_no_version_specified 2023-12-03T13:00:22.899 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_versioned_concurrent_object_create_and_remove 2023-12-03T13:00:22.899 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_lifecycle_set - botocore.exce... 2023-12-03T13:00:22.899 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_lifecycle_get - botocore.exce... 2023-12-03T13:00:22.899 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_lifecycle_get_no_id - botocor... 2023-12-03T13:00:22.899 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_lifecycle_id_too_long - botoc... 2023-12-03T13:00:22.899 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_lifecycle_same_id - botocore.... 2023-12-03T13:00:22.900 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_lifecycle_invalid_status - bo... 2023-12-03T13:00:22.900 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_lifecycle_set_date - botocore... 2023-12-03T13:00:22.900 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_lifecycle_set_invalid_date - ... 2023-12-03T13:00:22.900 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_lifecycle_set_noncurrent - bo... 2023-12-03T13:00:22.900 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_lifecycle_set_deletemarker - ... 2023-12-03T13:00:22.900 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_lifecycle_set_filter - botoco... 2023-12-03T13:00:22.900 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_lifecycle_set_empty_filter - ... 2023-12-03T13:00:22.900 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_lifecycle_set_multipart - bot... 2023-12-03T13:00:22.900 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_lifecycle_transition_set_invalid_date 2023-12-03T13:00:22.900 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1b - botoc... 2023-12-03T13:00:22.900 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1kb - boto... 2023-12-03T13:00:22.900 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1MB - boto... 2023-12-03T13:00:22.900 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_13b - boto... 2023-12-03T13:00:22.900 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_method_head 2023-12-03T13:00:22.900 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_present - bo... 2023-12-03T13:00:22.900 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_other_key - ... 2023-12-03T13:00:22.901 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_invalid_md5 2023-12-03T13:00:22.901 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_md5 - bot... 2023-12-03T13:00:22.901 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_key - bot... 2023-12-03T13:00:22.901 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_encryption_key_no_sse_c - bot... 2023-12-03T13:00:22.901 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_upload 2023-12-03T13:00:22.901 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_unaligned_multipart_upload 2023-12-03T13:00:22.901 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_bad_download 2023-12-03T13:00:22.901 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_post_object_authenticated_request 2023-12-03T13:00:22.901 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_sse_kms_method_head - botocor... 2023-12-03T13:00:22.901 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_sse_kms_present - botocore.ex... 2023-12-03T13:00:22.901 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_sse_kms_no_key - botocore.exc... 2023-12-03T13:00:22.901 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_sse_kms_not_declared - botoco... 2023-12-03T13:00:22.901 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_upload - bo... 2023-12-03T13:00:22.901 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_1 2023-12-03T13:00:22.902 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_2 2023-12-03T13:00:22.902 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_sse_kms_post_object_authenticated_request 2023-12-03T13:00:22.902 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1b - botocor... 2023-12-03T13:00:22.902 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1kb - botoco... 2023-12-03T13:00:22.902 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1MB - botoco... 2023-12-03T13:00:22.902 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_13b - botoco... 2023-12-03T13:00:22.902 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_sse_kms_read_declare - botoco... 2023-12-03T13:00:22.902 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_policy - botocore.exce... 2023-12-03T13:00:22.902 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucketv2_policy - botocore.ex... 2023-12-03T13:00:22.902 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_policy_acl - botocore.... 2023-12-03T13:00:22.902 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_acl - botocor... 2023-12-03T13:00:22.902 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_policy_another_bucket 2023-12-03T13:00:22.902 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_another_bucket 2023-12-03T13:00:22.902 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_get_obj_tagging - botocore.ex... 2023-12-03T13:00:22.903 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_get_obj_head_tagging - botoco... 2023-12-03T13:00:22.903 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_put_max_tags - botocore.excep... 2023-12-03T13:00:22.903 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_put_excess_tags - botocore.ex... 2023-12-03T13:00:22.903 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_put_max_kvsize_tags - botocor... 2023-12-03T13:00:22.903 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_put_excess_key_tags - botocor... 2023-12-03T13:00:22.903 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_put_excess_val_tags - botocor... 2023-12-03T13:00:22.903 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_put_modify_tags - botocore.ex... 2023-12-03T13:00:22.903 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_put_delete_tags - botocore.ex... 2023-12-03T13:00:22.903 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_post_object_tags_anonymous_request 2023-12-03T13:00:22.903 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_post_object_tags_authenticated_request 2023-12-03T13:00:22.903 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_put_obj_with_tags - botocore.... 2023-12-03T13:00:22.903 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_get_tags_acl_public - botocor... 2023-12-03T13:00:22.903 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_put_tags_acl_public - botocor... 2023-12-03T13:00:22.903 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_delete_tags_obj_public - boto... 2023-12-03T13:00:22.903 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_versioning_bucket_atomic_upload_return_version_id 2023-12-03T13:00:22.904 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_versioning_bucket_multipart_upload_return_version_id 2023-12-03T13:00:22.904 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_existing_tag 2023-12-03T13:00:22.904 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_tagging_existing_tag 2023-12-03T13:00:22.904 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_tagging_existing_tag 2023-12-03T13:00:22.904 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source 2023-12-03T13:00:22.904 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source_meta 2023-12-03T13:00:22.904 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_acl - b... 2023-12-03T13:00:22.904 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_grant 2023-12-03T13:00:22.904 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_s3 - b... 2023-12-03T13:00:22.904 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_kms - ... 2023-12-03T13:00:22.904 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_s3_kms 2023-12-03T13:00:22.904 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_bad_enc_kms 2023-12-03T13:00:22.904 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_noenc 2023-12-03T13:00:22.904 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_s3 2023-12-03T13:00:22.904 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_acl_existing_tag 2023-12-03T13:00:22.905 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock - bo... 2023-12-03T13:00:22.905 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_bucket 2023-12-03T13:00:22.905 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_with_days_and_years 2023-12-03T13:00:22.905 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_days 2023-12-03T13:00:22.905 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_years 2023-12-03T13:00:22.905 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_mode 2023-12-03T13:00:22.905 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_status 2023-12-03T13:00:22.905 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_suspend_versioning 2023-12-03T13:00:22.905 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock - bo... 2023-12-03T13:00:22.905 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock_invalid_bucket 2023-12-03T13:00:22.905 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention 2023-12-03T13:00:22.905 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_bucket 2023-12-03T13:00:22.905 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_mode 2023-12-03T13:00:22.905 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention 2023-12-03T13:00:22.905 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_iso8601 2023-12-03T13:00:22.906 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_invalid_bucket 2023-12-03T13:00:22.906 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_versionid 2023-12-03T13:00:22.906 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_override_default_retention 2023-12-03T13:00:22.906 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_increase_period 2023-12-03T13:00:22.906 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period 2023-12-03T13:00:22.906 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period_bypass 2023-12-03T13:00:22.906 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention 2023-12-03T13:00:22.906 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention_and_marker 2023-12-03T13:00:22.906 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_multi_delete_object_with_retention 2023-12-03T13:00:22.906 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold - ... 2023-12-03T13:00:22.906 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_bucket 2023-12-03T13:00:22.906 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_status 2023-12-03T13:00:22.906 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold - ... 2023-12-03T13:00:22.906 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold_invalid_bucket 2023-12-03T13:00:22.907 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_on 2023-12-03T13:00:22.907 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_off 2023-12-03T13:00:22.907 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_metadata 2023-12-03T13:00:22.907 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_uploading_obj - b... 2023-12-03T13:00:22.907 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_with_bypass 2023-12-03T13:00:22.907 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_without_bypass 2023-12-03T13:00:22.907 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_compliance 2023-12-03T13:00:22.907 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_copy_object_ifmatch_good - bo... 2023-12-03T13:00:22.907 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_copy_object_ifnonematch_failed 2023-12-03T13:00:22.907 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_get_bucket_policy_status - bo... 2023-12-03T13:00:22.907 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_get_public_acl_bucket_policy_status 2023-12-03T13:00:22.907 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_get_authpublic_acl_bucket_policy_status 2023-12-03T13:00:22.907 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_get_publicpolicy_acl_bucket_policy_status 2023-12-03T13:00:22.907 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_acl_bucket_policy_status 2023-12-03T13:00:22.908 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_deny_bucket_policy_status 2023-12-03T13:00:22.908 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_get_default_public_block - bo... 2023-12-03T13:00:22.908 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_put_public_block - botocore.e... 2023-12-03T13:00:22.908 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_block_public_put_bucket_acls 2023-12-03T13:00:22.908 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_block_public_object_canned_acls 2023-12-03T13:00:22.908 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_block_public_policy - botocor... 2023-12-03T13:00:22.908 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_ignore_public_acls - botocore... 2023-12-03T13:00:22.908 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_multipart_upload_on_a_bucket_with_policy 2023-12-03T13:00:22.908 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_put_bucket_encryption_kms - b... 2023-12-03T13:00:22.908 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_get_bucket_encryption_kms - b... 2023-12-03T13:00:22.908 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_delete_bucket_encryption_kms 2023-12-03T13:00:22.908 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_sse_kms_default_post_object_authenticated_request 2023-12-03T13:00:22.908 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_get_object_torrent - botocore... 2023-12-03T13:00:22.908 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_generate_where_clause 2023-12-03T13:00:22.908 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_generate_projection - b... 2023-12-03T13:00:22.909 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_count_operation - botoc... 2023-12-03T13:00:22.909 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_count_json_operation - ... 2023-12-03T13:00:22.909 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_json_column_sum_min_max 2023-12-03T13:00:22.909 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_json_nullif_expressions 2023-12-03T13:00:22.909 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_column_sum_min_max - bo... 2023-12-03T13:00:22.909 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_nullif_expressions - bo... 2023-12-03T13:00:22.909 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_nulliftrue_expressions 2023-12-03T13:00:22.909 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_is_not_null_expressions 2023-12-03T13:00:22.909 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_lowerupper_expressions 2023-12-03T13:00:22.909 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_in_expressions - botoco... 2023-12-03T13:00:22.909 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_true_false_in_expressions 2023-12-03T13:00:22.909 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_like_expressions - boto... 2023-12-03T13:00:22.909 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_truefalselike_expressions 2023-12-03T13:00:22.909 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_complex_expressions - b... 2023-12-03T13:00:22.909 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_alias - botocore.except... 2023-12-03T13:00:22.910 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_alias_cyclic_refernce 2023-12-03T13:00:22.910 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_datetime - botocore.exc... 2023-12-03T13:00:22.910 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_true_false_datetime - b... 2023-12-03T13:00:22.910 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_csv_parser - botocore.e... 2023-12-03T13:00:22.910 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_csv_definition - botoco... 2023-12-03T13:00:22.910 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_schema_definition - bot... 2023-12-03T13:00:22.910 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_when_then_else_expressions 2023-12-03T13:00:22.910 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_coalesce_expressions - ... 2023-12-03T13:00:22.910 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_cast_expressions - boto... 2023-12-03T13:00:22.910 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_version - botocore.exce... 2023-12-03T13:00:22.910 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_trim_expressions - boto... 2023-12-03T13:00:22.910 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_truefalse_trim_expressions 2023-12-03T13:00:22.910 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_escape_expressions - bo... 2023-12-03T13:00:22.911 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_case_value_expressions 2023-12-03T13:00:22.911 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_bool_cast_expressions 2023-12-03T13:00:22.911 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_progress_expressions - ... 2023-12-03T13:00:22.911 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_output_serial_expressions 2023-12-03T13:00:22.911 INFO:teuthology.orchestra.run.smithi003.stdout:= 201 failed, 362 passed, 65 skipped, 124 deselected, 1 xfailed, 18 warnings, 235 errors in 3659.64s (1:00:59) = 2023-12-03T13:00:22.911 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR: InvocationError for command /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/bin/pytest -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3' (exited with code 1) 2023-12-03T13:00:22.911 INFO:teuthology.orchestra.run.smithi003.stdout:___________________________________ summary ____________________________________ 2023-12-03T13:00:22.911 INFO:teuthology.orchestra.run.smithi003.stdout:ERROR: py: commands failed 2023-12-03T13:00:22.911 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/contextutil.py", line 30, in nested vars.append(enter()) File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/s3tests.py", line 437, in run_tests File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/s3tests.py", line 380, in toxvenv_sh File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/remote.py", line 97, in sh proc = self.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (s3 tests against rgw) on smithi003 with status 1: "source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt tox -- -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3'" 2023-12-03T13:00:22.914 INFO:tasks.s3tests:Cleaning up boto... 2023-12-03T13:00:22.915 DEBUG:teuthology.orchestra.run.smithi003:> rm /home/ubuntu/cephtest/boto-client.0.cfg 2023-12-03T13:00:22.950 INFO:tasks.s3tests:Removing s3-tests... 2023-12-03T13:00:22.950 DEBUG:teuthology.orchestra.run.smithi003:> rm -rf /home/ubuntu/cephtest/s3-tests-client.0 2023-12-03T13:00:23.154 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/s3tests.py", line 703, in task File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/s3tests.py", line 61, in download File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/contextutil.py", line 30, in nested vars.append(enter()) File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/s3tests.py", line 437, in run_tests File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/s3tests.py", line 380, in toxvenv_sh File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/remote.py", line 97, in sh proc = self.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (s3 tests against rgw) on smithi003 with status 1: "source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt tox -- -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3'" 2023-12-03T13:00:23.227 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=a8c9a07027df41339ea71dbf1a6c2a25 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/s3tests.py", line 703, in task File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/s3tests.py", line 61, in download File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/contextutil.py", line 30, in nested vars.append(enter()) File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/s3tests.py", line 437, in run_tests File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/s3tests.py", line 380, in toxvenv_sh File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/remote.py", line 97, in sh proc = self.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (s3 tests against rgw) on smithi003 with status 1: "source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt tox -- -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3'" 2023-12-03T13:00:23.230 DEBUG:teuthology.run_tasks:Unwinding manager s3tests 2023-12-03T13:00:23.240 DEBUG:teuthology.run_tasks:Unwinding manager s3tests-java 2023-12-03T13:00:23.249 DEBUG:tasks.s3tests_java:S3 Tests Java: END 2023-12-03T13:00:23.250 INFO:tasks.s3tests_java:S3 Tests Java: Cleaning up s3-tests-java... 2023-12-03T13:00:23.250 DEBUG:teuthology.orchestra.run.smithi003:> rm -rf /home/ubuntu/cephtest/s3-tests-java 2023-12-03T13:00:23.315 INFO:tasks.s3tests_java:S3 Tests Java: Deleting S3 users... 2023-12-03T13:00:23.315 DEBUG:teuthology.orchestra.run.smithi003:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid tester.client.0 --purge-data --cluster ceph 2023-12-03T13:00:23.370 INFO:teuthology.orchestra.run.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T13:00:23.370 INFO:teuthology.orchestra.run.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T13:05:23.373 INFO:teuthology.orchestra.run.smithi003.stderr:failed to fetch mon config (--no-mon-config to skip) 2023-12-03T13:05:23.374 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-03T13:05:23.375 ERROR:teuthology.run_tasks:Manager failed: s3tests-java Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/task/__init__.py", line 132, in __exit__ self.end() File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/s3tests_java.py", line 101, in end File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/s3tests_java.py", line 386, in delete_users File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/cluster.py", line 85, in run procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/cluster.py", line 85, in procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi003 with status 1: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid tester.client.0 --purge-data --cluster ceph' 2023-12-03T13:05:23.382 DEBUG:teuthology.run_tasks:Unwinding manager ragweed 2023-12-03T13:05:23.393 DEBUG:teuthology.run_tasks:Unwinding manager tox 2023-12-03T13:05:23.406 DEBUG:teuthology.orchestra.run.smithi003:> rm -rf /home/ubuntu/cephtest/tox-venv 2023-12-03T13:05:23.473 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2023-12-03T13:05:23.484 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/rgw.py", line 473, in task File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/task/__init__.py", line 132, in __exit__ self.end() File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/s3tests_java.py", line 101, in end File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/s3tests_java.py", line 386, in delete_users File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/cluster.py", line 85, in run procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/cluster.py", line 85, in procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi003 with status 1: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid tester.client.0 --purge-data --cluster ceph' 2023-12-03T13:05:23.486 DEBUG:tasks.rgw.client.0:waiting for process to exit 2023-12-03T13:05:23.486 INFO:teuthology.orchestra.run:waiting for 300 2023-12-03T13:05:23.486 INFO:tasks.rgw.client.0:Stopped 2023-12-03T13:05:23.486 DEBUG:teuthology.orchestra.run.smithi003:> rm -f /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock 2023-12-03T13:05:23.517 DEBUG:teuthology.orchestra.run.smithi003:> sudo rm -f /etc/ceph/vault-root-token 2023-12-03T13:05:23.605 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process', '--include-all'] 2023-12-03T13:05:23.605 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process', '--include-all'] 2023-12-03T13:05:23.605 DEBUG:teuthology.orchestra.run.smithi003:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all 2023-12-03T13:05:23.662 INFO:teuthology.orchestra.run.smithi003.stderr:ignoring --setuser ceph since I am not root 2023-12-03T13:05:23.662 INFO:teuthology.orchestra.run.smithi003.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T13:10:23.664 INFO:teuthology.orchestra.run.smithi003.stderr:2023-12-03T13:10:23.661+0000 7f542a325800 0 monclient(hunting): authenticate timed out after 300 2023-12-03T13:10:23.665 INFO:teuthology.orchestra.run.smithi003.stderr:failed to fetch mon config (--no-mon-config to skip) 2023-12-03T13:10:23.666 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-03T13:10:23.667 ERROR:teuthology.run_tasks:Manager failed: rgw Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/rgw.py", line 226, in start_rgw File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/rgw.py", line 473, in task File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/task/__init__.py", line 132, in __exit__ self.end() File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/s3tests_java.py", line 101, in end File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/s3tests_java.py", line 386, in delete_users File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/cluster.py", line 85, in run procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/cluster.py", line 85, in procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi003 with status 1: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid tester.client.0 --purge-data --cluster ceph' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/rgw.py", line 473, in task File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/rgw.py", line 300, in create_pools File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/rgw.py", line 242, in start_rgw File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/util/rgw.py", line 34, in rgwadmin File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi003 with status 1: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all' 2023-12-03T13:10:23.681 DEBUG:teuthology.run_tasks:Unwinding manager openssl_keys 2023-12-03T13:10:23.692 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-12-03T13:10:23.710 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-12-03T13:10:23.710 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-03T13:12:23.785 DEBUG:teuthology.orchestra.run:got remote process result: 124 2023-12-03T13:12:23.786 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/ceph.py", line 1918, in task File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/task/__init__.py", line 132, in __exit__ self.end() File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/s3tests_java.py", line 101, in end File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/s3tests_java.py", line 386, in delete_users File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/cluster.py", line 85, in run procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/cluster.py", line 85, in procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi003 with status 1: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid tester.client.0 --purge-data --cluster ceph' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/ceph.py", line 1928, in task File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi003 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2023-12-03T13:12:23.798 INFO:teuthology.misc:Shutting down mds daemons... 2023-12-03T13:12:23.798 INFO:teuthology.misc:Shutting down osd daemons... 2023-12-03T13:12:23.798 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-12-03T13:12:23.798 INFO:teuthology.orchestra.run:waiting for 300 2023-12-03T13:12:23.803 INFO:tasks.ceph.osd.0:Stopped 2023-12-03T13:12:23.803 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-12-03T13:12:23.803 INFO:teuthology.orchestra.run:waiting for 300 2023-12-03T13:12:23.804 INFO:tasks.ceph.osd.1:Stopped 2023-12-03T13:12:23.804 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-12-03T13:12:23.804 INFO:teuthology.orchestra.run:waiting for 300 2023-12-03T13:12:23.804 INFO:tasks.ceph.osd.2:Stopped 2023-12-03T13:12:23.804 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-12-03T13:12:23.804 INFO:teuthology.orchestra.run:waiting for 300 2023-12-03T13:12:23.805 INFO:tasks.ceph.osd.3:Stopped 2023-12-03T13:12:23.805 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-12-03T13:12:23.805 INFO:teuthology.orchestra.run:waiting for 300 2023-12-03T13:12:23.805 INFO:tasks.ceph.osd.4:Stopped 2023-12-03T13:12:23.805 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-12-03T13:12:23.805 INFO:teuthology.orchestra.run:waiting for 300 2023-12-03T13:12:23.805 INFO:tasks.ceph.osd.5:Stopped 2023-12-03T13:12:23.806 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-12-03T13:12:23.806 INFO:teuthology.orchestra.run:waiting for 300 2023-12-03T13:12:23.806 INFO:tasks.ceph.osd.6:Stopped 2023-12-03T13:12:23.806 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-12-03T13:12:23.806 INFO:teuthology.orchestra.run:waiting for 300 2023-12-03T13:12:23.806 INFO:tasks.ceph.osd.7:Stopped 2023-12-03T13:12:23.807 INFO:teuthology.misc:Shutting down mgr daemons... 2023-12-03T13:12:23.807 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-12-03T13:12:23.807 INFO:teuthology.orchestra.run:waiting for 300 2023-12-03T13:12:23.807 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-03T13:12:23.807 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/ceph.py", line 1918, in task File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/task/__init__.py", line 132, in __exit__ self.end() File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/s3tests_java.py", line 101, in end File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/s3tests_java.py", line 386, in delete_users File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/cluster.py", line 85, in run procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/cluster.py", line 85, in procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi003 with status 1: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid tester.client.0 --purge-data --cluster ceph' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/ceph.py", line 1447, in run_daemon File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/ceph.py", line 1928, in task File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi003 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi003 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y' 2023-12-03T13:12:23.819 INFO:tasks.ceph.mgr.y:Stopped 2023-12-03T13:12:23.820 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-12-03T13:12:23.820 INFO:teuthology.orchestra.run:waiting for 300 2023-12-03T13:12:23.820 INFO:tasks.ceph.mgr.x:Stopped 2023-12-03T13:12:23.820 INFO:teuthology.misc:Shutting down mon daemons... 2023-12-03T13:12:23.820 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-12-03T13:12:23.820 INFO:teuthology.orchestra.run:waiting for 300 2023-12-03T13:12:23.820 INFO:tasks.ceph.mon.a:Stopped 2023-12-03T13:12:23.821 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-12-03T13:12:23.821 INFO:teuthology.orchestra.run:waiting for 300 2023-12-03T13:12:23.821 INFO:tasks.ceph.mon.c:Stopped 2023-12-03T13:12:23.821 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-12-03T13:12:23.821 INFO:teuthology.orchestra.run:waiting for 300 2023-12-03T13:12:23.821 INFO:tasks.ceph.mon.b:Stopped 2023-12-03T13:12:23.822 INFO:tasks.ceph:Checking cluster log for badness... 2023-12-03T13:12:23.822 DEBUG:teuthology.orchestra.run.smithi003:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | egrep -v '\(OSD_SLOW_PING_TIME' | head -n 1 2023-12-03T13:12:23.878 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi003.front.sepia.ceph.com 2023-12-03T13:12:23.879 DEBUG:teuthology.orchestra.run.smithi003:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-12-03T13:12:23.988 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi003.front.sepia.ceph.com 2023-12-03T13:12:23.988 DEBUG:teuthology.orchestra.run.smithi003:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-12-03T13:12:24.074 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi003.front.sepia.ceph.com 2023-12-03T13:12:24.074 DEBUG:teuthology.orchestra.run.smithi003:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-12-03T13:12:24.314 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi003.front.sepia.ceph.com 2023-12-03T13:12:24.314 DEBUG:teuthology.orchestra.run.smithi003:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-12-03T13:12:24.404 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi037.front.sepia.ceph.com 2023-12-03T13:12:24.404 DEBUG:teuthology.orchestra.run.smithi037:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-12-03T13:12:24.468 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi037.front.sepia.ceph.com 2023-12-03T13:12:24.468 DEBUG:teuthology.orchestra.run.smithi037:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-12-03T13:12:24.531 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi037.front.sepia.ceph.com 2023-12-03T13:12:24.531 DEBUG:teuthology.orchestra.run.smithi037:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-12-03T13:12:24.605 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi037.front.sepia.ceph.com 2023-12-03T13:12:24.605 DEBUG:teuthology.orchestra.run.smithi037:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-12-03T13:12:24.676 INFO:tasks.ceph:Archiving mon data... 2023-12-03T13:12:24.677 DEBUG:teuthology.misc:Transferring archived files from smithi003:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/alimasa-2023-12-03_11:04:43-rgw-wip-alimasa-multi-pubsub-etag-distro-default-smithi/7476143/data/mon.a.tgz 2023-12-03T13:12:24.678 DEBUG:teuthology.orchestra.run.smithi003:> mktemp 2023-12-03T13:12:24.706 INFO:teuthology.orchestra.run.smithi003.stdout:/tmp/tmp.fr1fJ38xfg 2023-12-03T13:12:24.707 DEBUG:teuthology.orchestra.run.smithi003:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.fr1fJ38xfg 2023-12-03T13:12:24.928 DEBUG:teuthology.orchestra.run.smithi003:> sudo chmod 0666 /tmp/tmp.fr1fJ38xfg 2023-12-03T13:12:25.042 DEBUG:teuthology.orchestra.remote:smithi003:/tmp/tmp.fr1fJ38xfg is 483KB 2023-12-03T13:12:25.123 DEBUG:teuthology.orchestra.run.smithi003:> rm -fr /tmp/tmp.fr1fJ38xfg 2023-12-03T13:12:25.151 DEBUG:teuthology.misc:Transferring archived files from smithi003:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/alimasa-2023-12-03_11:04:43-rgw-wip-alimasa-multi-pubsub-etag-distro-default-smithi/7476143/data/mon.c.tgz 2023-12-03T13:12:25.152 DEBUG:teuthology.orchestra.run.smithi003:> mktemp 2023-12-03T13:12:25.218 INFO:teuthology.orchestra.run.smithi003.stdout:/tmp/tmp.bEmYgTvDzR 2023-12-03T13:12:25.219 DEBUG:teuthology.orchestra.run.smithi003:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.bEmYgTvDzR 2023-12-03T13:12:25.436 DEBUG:teuthology.orchestra.run.smithi003:> sudo chmod 0666 /tmp/tmp.bEmYgTvDzR 2023-12-03T13:12:25.551 DEBUG:teuthology.orchestra.remote:smithi003:/tmp/tmp.bEmYgTvDzR is 517KB 2023-12-03T13:12:25.633 DEBUG:teuthology.orchestra.run.smithi003:> rm -fr /tmp/tmp.bEmYgTvDzR 2023-12-03T13:12:25.660 DEBUG:teuthology.misc:Transferring archived files from smithi037:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/alimasa-2023-12-03_11:04:43-rgw-wip-alimasa-multi-pubsub-etag-distro-default-smithi/7476143/data/mon.b.tgz 2023-12-03T13:12:25.660 DEBUG:teuthology.orchestra.run.smithi037:> mktemp 2023-12-03T13:12:25.679 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/tmp.ggBVfakI8d 2023-12-03T13:12:25.679 DEBUG:teuthology.orchestra.run.smithi037:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.ggBVfakI8d 2023-12-03T13:12:25.913 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 0666 /tmp/tmp.ggBVfakI8d 2023-12-03T13:12:26.001 DEBUG:teuthology.orchestra.remote:smithi037:/tmp/tmp.ggBVfakI8d is 517KB 2023-12-03T13:12:26.098 DEBUG:teuthology.orchestra.run.smithi037:> rm -fr /tmp/tmp.ggBVfakI8d 2023-12-03T13:12:26.112 INFO:tasks.ceph:Cleaning ceph cluster... 2023-12-03T13:12:26.113 DEBUG:teuthology.orchestra.run.smithi003:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-12-03T13:12:26.115 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-12-03T13:12:26.371 DEBUG:tasks.ceph:valgrind exception message: valgrind error: InvalidRead RGWCompleteMultipart::complete() rgw_process_authenticated(RGWHandler_REST*, RGWOp*&, RGWRequest*, req_state*, optional_yield, rgw::sal::Driver*, bool) process_request(RGWProcessEnv const&, RGWRequest*, std::__cxx11::basic_string, std::allocator > const&, RGWRestfulIO*, optional_yield, rgw::dmclock::Scheduler*, std::__cxx11::basic_string, std::allocator >*, std::chrono::duration >*, int*) 2023-12-03T13:12:26.386 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2023-12-03T13:12:26.386 INFO:tasks.ceph:Archiving crash dumps... 2023-12-03T13:12:26.388 DEBUG:teuthology.misc:Transferring archived files from smithi003:/var/lib/ceph/crash to /home/teuthworker/archive/alimasa-2023-12-03_11:04:43-rgw-wip-alimasa-multi-pubsub-etag-distro-default-smithi/7476143/remote/smithi003/crash 2023-12-03T13:12:26.389 DEBUG:teuthology.orchestra.run.smithi003:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-12-03T13:12:26.465 DEBUG:teuthology.misc:Transferring archived files from smithi037:/var/lib/ceph/crash to /home/teuthworker/archive/alimasa-2023-12-03_11:04:43-rgw-wip-alimasa-multi-pubsub-etag-distro-default-smithi/7476143/remote/smithi037/crash 2023-12-03T13:12:26.466 DEBUG:teuthology.orchestra.run.smithi037:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-12-03T13:12:26.496 INFO:tasks.ceph:Compressing logs... 2023-12-03T13:12:26.496 DEBUG:teuthology.orchestra.run.smithi003:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-03T13:12:26.499 DEBUG:teuthology.orchestra.run.smithi037:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-03T13:12:26.540 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.91776.log 2023-12-03T13:12:26.540 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106204.log 2023-12-03T13:12:26.540 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.0.91776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104764.log 2023-12-03T13:12:26.580 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2023-12-03T13:12:26.580 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83478.log 2023-12-03T13:12:26.581 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-12-03T13:12:26.581 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-osd.6.log: /var/log/ceph/ceph-client.admin.83478.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83518.log 2023-12-03T13:12:26.581 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.83478.log.gz 2023-12-03T13:12:26.581 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2023-12-03T13:12:26.581 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.83518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83719.log 2023-12-03T13:12:26.581 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.83518.log.gz 2023-12-03T13:12:26.581 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83599.log 2023-12-03T13:12:26.581 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.83719.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.83719.log.gz 2023-12-03T13:12:26.581 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2023-12-03T13:12:26.582 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2023-12-03T13:12:26.582 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.83599.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.83599.log.gz 2023-12-03T13:12:26.582 INFO:teuthology.orchestra.run.smithi037.stderr: 90.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-12-03T13:12:26.582 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83639.log 2023-12-03T13:12:26.582 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83679.log 2023-12-03T13:12:26.582 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-osd.5.log: /var/log/ceph/ceph-client.admin.83639.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-12-03T13:12:26.582 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.83639.log.gz 2023-12-03T13:12:26.582 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.83679.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-12-03T13:12:26.583 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.83679.log.gz 2023-12-03T13:12:26.583 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83759.log 2023-12-03T13:12:26.583 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-12-03T13:12:26.583 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.83759.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.83759.log.gz 2023-12-03T13:12:26.583 INFO:teuthology.orchestra.run.smithi037.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.83558.log 2023-12-03T13:12:26.583 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-mon.b.log: /var/log/ceph/ceph-client.admin.83558.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.83558.log.gz 2023-12-03T13:12:26.583 INFO:teuthology.orchestra.run.smithi037.stderr: 88.4% -- replaced with /var/log/ceph/ceph.log.gz 2023-12-03T13:12:26.629 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.106204.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.112356.log 2023-12-03T13:12:26.629 INFO:teuthology.orchestra.run.smithi003.stderr: 80.2% -- replaced with /var/log/ceph/ceph-client.0.91776.log.gz 2023-12-03T13:12:26.629 INFO:teuthology.orchestra.run.smithi003.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.106204.log.gz 2023-12-03T13:12:26.629 INFO:teuthology.orchestra.run.smithi003.stderr:gzip/var/log/ceph/ceph-client.admin.104764.log: -5 --verbose -- /var/log/ceph/ceph-client.0.111948.log 2023-12-03T13:12:26.630 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.0.112356.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95551.log 2023-12-03T13:12:26.630 INFO:teuthology.orchestra.run.smithi003.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.104764.log.gz 2023-12-03T13:12:26.630 INFO:teuthology.orchestra.run.smithi003.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.0.112356.log.gz 2023-12-03T13:12:26.630 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.0.111948.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98571.log 2023-12-03T13:12:26.630 INFO:teuthology.orchestra.run.smithi003.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.0.111948.log.gz 2023-12-03T13:12:26.630 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94765.log 2023-12-03T13:12:26.630 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.95551.log: /var/log/ceph/ceph-client.admin.98571.log: gzip -5 85.4% --verbose -- /var/log/ceph/ceph-mon.a.log -- replaced with /var/log/ceph/ceph-client.admin.95551.log.gz 2023-12-03T13:12:26.630 INFO:teuthology.orchestra.run.smithi003.stderr: 2023-12-03T13:12:26.630 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.94765.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109256.log 2023-12-03T13:12:26.631 INFO:teuthology.orchestra.run.smithi003.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.94765.log.gz 2023-12-03T13:12:26.631 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.crash.112966.log 2023-12-03T13:12:26.631 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.109256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.crash.113050.log 2023-12-03T13:12:26.631 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.crash.112966.log: -- /var/log/ceph/ceph-client.0.100175.log 2023-12-03T13:12:26.631 INFO:teuthology.orchestra.run.smithi003.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.crash.112966.log.gz 2023-12-03T13:12:26.631 INFO:teuthology.orchestra.run.smithi003.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.98571.log.gz 2023-12-03T13:12:26.631 INFO:teuthology.orchestra.run.smithi003.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.109256.log.gz 2023-12-03T13:12:26.631 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.crash.113050.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97609.log 2023-12-03T13:12:26.631 INFO:teuthology.orchestra.run.smithi003.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.crash.113050.log.gz 2023-12-03T13:12:26.632 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.0.100175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93849.log 2023-12-03T13:12:26.632 INFO:teuthology.orchestra.run.smithi003.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.0.100175.log.gz 2023-12-03T13:12:26.632 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.97609.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93228.log 2023-12-03T13:12:26.632 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.93849.log: 83.8% -- replaced with /var/log/ceph/ceph-client.admin.97609.log.gz 2023-12-03T13:12:26.632 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103452.log 2023-12-03T13:12:26.632 INFO:teuthology.orchestra.run.smithi003.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.93849.log.gz 2023-12-03T13:12:26.632 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.93228.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.111642.log 2023-12-03T13:12:26.632 INFO:teuthology.orchestra.run.smithi003.stderr: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.93228.log.gz 2023-12-03T13:12:26.632 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.103452.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.crash.113009.log 2023-12-03T13:12:26.632 INFO:teuthology.orchestra.run.smithi003.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.103452.log.gz 2023-12-03T13:12:26.633 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.0.111642.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113360.log 2023-12-03T13:12:26.633 INFO:teuthology.orchestra.run.smithi003.stderr: 79.9% -- replaced with /var/log/ceph/ceph-client.0.111642.log.gz 2023-12-03T13:12:26.633 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.crash.113009.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.crash.113009.log.gz 2023-12-03T13:12:26.633 INFO:teuthology.orchestra.run.smithi003.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.90706.log 2023-12-03T13:12:26.633 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.113360.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99347.log 2023-12-03T13:12:26.633 INFO:teuthology.orchestra.run.smithi003.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.113360.log.gz 2023-12-03T13:12:26.633 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.90706.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94307.log 2023-12-03T13:12:26.633 INFO:teuthology.orchestra.run.smithi003.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90706.log.gz 2023-12-03T13:12:26.633 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.99347.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.91650.log 2023-12-03T13:12:26.634 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.94307.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.112458.log 2023-12-03T13:12:26.634 INFO:teuthology.orchestra.run.smithi003.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.99347.log.gz 2023-12-03T13:12:26.634 INFO:teuthology.orchestra.run.smithi003.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.94307.log.gz 2023-12-03T13:12:26.634 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.0.91650.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.crash.113090.log 2023-12-03T13:12:26.634 INFO:teuthology.orchestra.run.smithi003.stderr: 43.2% -- replaced with /var/log/ceph/ceph-client.0.91650.log.gz 2023-12-03T13:12:26.634 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.0.112458.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.111744.log 2023-12-03T13:12:26.634 INFO:teuthology.orchestra.run.smithi003.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.0.112458.log.gz 2023-12-03T13:12:26.634 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.crash.113090.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.77758.log 2023-12-03T13:12:26.634 INFO:teuthology.orchestra.run.smithi003.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.crash.113090.log.gz 2023-12-03T13:12:26.634 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.0.111744.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98461.log 2023-12-03T13:12:26.635 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph.tmp-client.admin.77758.log: 83.9% -- replaced with /var/log/ceph/ceph-client.0.111744.log.gz 2023-12-03T13:12:26.635 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113062.log 2023-12-03T13:12:26.635 INFO:teuthology.orchestra.run.smithi003.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.77758.log.gz 2023-12-03T13:12:26.635 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.98461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102631.log 2023-12-03T13:12:26.635 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.113062.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96938.log 2023-12-03T13:12:26.635 INFO:teuthology.orchestra.run.smithi003.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.113062.log.gz 2023-12-03T13:12:26.635 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.102631.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91070.log 2023-12-03T13:12:26.635 INFO:teuthology.orchestra.run.smithi003.stderr: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.102631.log.gz 2023-12-03T13:12:26.635 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.96938.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103123.log 2023-12-03T13:12:26.635 INFO:teuthology.orchestra.run.smithi003.stderr: 52.4% -- replaced with /var/log/ceph/ceph-client.admin.96938.log.gz 2023-12-03T13:12:26.636 INFO:teuthology.orchestra.run.smithi003.stderr:gzip/var/log/ceph/ceph-client.admin.91070.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.103370.log 2023-12-03T13:12:26.636 INFO:teuthology.orchestra.run.smithi003.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.91070.log.gz 2023-12-03T13:12:26.636 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.103123.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110785.log 2023-12-03T13:12:26.636 INFO:teuthology.orchestra.run.smithi003.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.103123.log.gz 2023-12-03T13:12:26.636 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.103370.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103041.log 2023-12-03T13:12:26.636 INFO:teuthology.orchestra.run.smithi003.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.103370.log.gz 2023-12-03T13:12:26.636 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/ceph.client.0.log 2023-12-03T13:12:26.636 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.110785.log: /var/log/ceph/ceph-client.admin.103041.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102549.log 2023-12-03T13:12:26.636 INFO:teuthology.orchestra.run.smithi003.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.110785.log.gz 2023-12-03T13:12:26.636 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/valgrind/ceph.client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94037.log 2023-12-03T13:12:26.637 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.102549.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94143.log 2023-12-03T13:12:26.637 INFO:teuthology.orchestra.run.smithi003.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.102549.log.gz 2023-12-03T13:12:26.637 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.94037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104190.log 2023-12-03T13:12:26.637 INFO:teuthology.orchestra.run.smithi003.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.94037.log.gz 2023-12-03T13:12:26.637 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.94143.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91409.log 2023-12-03T13:12:26.637 INFO:teuthology.orchestra.run.smithi003.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.103041.log.gz 2023-12-03T13:12:26.637 INFO:teuthology.orchestra.run.smithi003.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.94143.log.gz 2023-12-03T13:12:26.637 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.104190.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102138.log 2023-12-03T13:12:26.637 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100029.log 2023-12-03T13:12:26.638 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.91409.log: /var/log/ceph/ceph-client.admin.102138.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.91409.log.gz 2023-12-03T13:12:26.638 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.112254.log 2023-12-03T13:12:26.638 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.100029.log: 48.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98131.log 2023-12-03T13:12:26.638 INFO:teuthology.orchestra.run.smithi003.stderr: -- replaced with /var/log/ceph/ceph-client.admin.100029.log.gz 2023-12-03T13:12:26.638 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.0.112254.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91287.log 2023-12-03T13:12:26.638 INFO:teuthology.orchestra.run.smithi003.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.104190.log.gz 2023-12-03T13:12:26.638 INFO:teuthology.orchestra.run.smithi003.stderr: 79.9% -- replaced with /var/log/ceph/ceph-client.0.112254.log.gz 2023-12-03T13:12:26.638 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106310.log 2023-12-03T13:12:26.638 INFO:teuthology.orchestra.run.smithi003.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.102138.log.gz 2023-12-03T13:12:26.638 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.98131.log: /var/log/ceph/ceph-client.admin.91287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90712.log 2023-12-03T13:12:26.639 INFO:teuthology.orchestra.run.smithi003.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.91287.log.gz 2023-12-03T13:12:26.639 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.106310.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94929.log 2023-12-03T13:12:26.639 INFO:teuthology.orchestra.run.smithi003.stderr: 96.0% -- replaced with /var/log/ceph/valgrind/ceph.client.0.log.gz 2023-12-03T13:12:26.639 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.90712.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.106310.log.gz 2023-12-03T13:12:26.639 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96882.log 2023-12-03T13:12:26.639 INFO:teuthology.orchestra.run.smithi003.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90712.log.gz 2023-12-03T13:12:26.639 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.94929.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91069.log 2023-12-03T13:12:26.639 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.96882.log: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.94929.log.gz 2023-12-03T13:12:26.639 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98241.log 2023-12-03T13:12:26.639 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100498.log 2023-12-03T13:12:26.640 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.91069.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.91069.log.gz 2023-12-03T13:12:26.640 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.98241.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100990.log 2023-12-03T13:12:26.640 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.100498.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110482.log 2023-12-03T13:12:26.640 INFO:teuthology.orchestra.run.smithi003.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.100498.log.gz/var/log/ceph/ceph-client.admin.100990.log: 2023-12-03T13:12:26.640 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 81.9% -- replaced with /var/log/ceph/ceph-client.admin.100990.log.gz 2023-12-03T13:12:26.640 INFO:teuthology.orchestra.run.smithi003.stderr: --verbose -- /var/log/ceph/ceph-client.crash.smithi003.112997.log 2023-12-03T13:12:26.640 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.110482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.crash.smithi003.112914.log 2023-12-03T13:12:26.640 INFO:teuthology.orchestra.run.smithi003.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.98241.log.gz 92.3% -- replaced with /var/log/ceph/ceph-client.admin.110482.log.gz 2023-12-03T13:12:26.640 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.crash.smithi003.112997.log: 2023-12-03T13:12:26.640 INFO:teuthology.orchestra.run.smithi003.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.crash.smithi003.112997.log.gz 2023-12-03T13:12:26.641 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105666.log 2023-12-03T13:12:26.641 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.crash.smithi003.112914.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99514.log 2023-12-03T13:12:26.641 INFO:teuthology.orchestra.run.smithi003.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.crash.smithi003.112914.log.gz 2023-12-03T13:12:26.641 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.105666.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104436.log 2023-12-03T13:12:26.641 INFO:teuthology.orchestra.run.smithi003.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.105666.log.gz 2023-12-03T13:12:26.641 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.99514.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95763.log 2023-12-03T13:12:26.641 INFO:teuthology.orchestra.run.smithi003.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.98131.log.gz 2023-12-03T13:12:26.641 INFO:teuthology.orchestra.run.smithi003.stderr:gzip/var/log/ceph/ceph-client.admin.104436.log: 81.4% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.99514.log.gz -- 2023-12-03T13:12:26.641 INFO:teuthology.orchestra.run.smithi003.stderr: /var/log/ceph/ceph-client.0.92150.log 2023-12-03T13:12:26.642 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.95763.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.104436.log.gz 2023-12-03T13:12:26.642 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.113293.log 2023-12-03T13:12:26.642 INFO:teuthology.orchestra.run.smithi003.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.95763.log.gz 2023-12-03T13:12:26.642 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.0.92150.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.91552.log 2023-12-03T13:12:26.642 INFO:teuthology.orchestra.run.smithi003.stderr: 43.5% -- replaced with /var/log/ceph/ceph-client.0.92150.log.gz 2023-12-03T13:12:26.642 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95281.log 2023-12-03T13:12:26.642 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.0.113293.log: 9.2% -- replaced with /var/log/ceph/ceph-client.0.113293.log.gz 2023-12-03T13:12:26.642 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.0.91552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90951.log 2023-12-03T13:12:26.642 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.95281.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.95281.log.gz 2023-12-03T13:12:26.642 INFO:teuthology.orchestra.run.smithi003.stderr: --verbose -- /var/log/ceph/ceph-client.admin.100826.log 2023-12-03T13:12:26.643 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.90951.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90951.log.gz 2023-12-03T13:12:26.643 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110145.log 2023-12-03T13:12:26.643 INFO:teuthology.orchestra.run.smithi003.stderr: 95.8% -- replaced with /var/log/ceph/ceph-client.0.91552.log.gz 2023-12-03T13:12:26.643 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.100826.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90111.log 2023-12-03T13:12:26.643 INFO:teuthology.orchestra.run.smithi003.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.100826.log.gz 2023-12-03T13:12:26.643 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.110145.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97513.log 2023-12-03T13:12:26.643 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.90111.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.110145.log.gz 2023-12-03T13:12:26.643 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106016.log 2023-12-03T13:12:26.643 INFO:teuthology.orchestra.run.smithi003.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90111.log.gz 2023-12-03T13:12:26.644 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.97513.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91067.log 2023-12-03T13:12:26.644 INFO:teuthology.orchestra.run.smithi003.stderr: 21.2% -- replaced with /var/log/ceph/ceph-client.admin.97513.log.gz 2023-12-03T13:12:26.644 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.106016.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106686.log 2023-12-03T13:12:26.644 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.91067.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.106016.log.gz 2023-12-03T13:12:26.644 INFO:teuthology.orchestra.run.smithi003.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.91067.log.gz 2023-12-03T13:12:26.644 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.92058.log 2023-12-03T13:12:26.644 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106098.log 2023-12-03T13:12:26.644 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.106686.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.106686.log.gz 2023-12-03T13:12:26.644 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.0.92058.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104026.log 2023-12-03T13:12:26.644 INFO:teuthology.orchestra.run.smithi003.stderr: 43.2% -- replaced with /var/log/ceph/ceph-client.0.92058.log.gz 2023-12-03T13:12:26.645 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.106098.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105092.log 2023-12-03T13:12:26.645 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.104026.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97801.log 2023-12-03T13:12:26.645 INFO:teuthology.orchestra.run.smithi003.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.106098.log.gz 2023-12-03T13:12:26.645 INFO:teuthology.orchestra.run.smithi003.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.104026.log.gz 2023-12-03T13:12:26.645 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.105092.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105174.log 2023-12-03T13:12:26.645 INFO:teuthology.orchestra.run.smithi003.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.105092.log.gz 2023-12-03T13:12:26.645 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.97801.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105934.log 2023-12-03T13:12:26.645 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.105174.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102056.log 2023-12-03T13:12:26.646 INFO:teuthology.orchestra.run.smithi003.stderr: 77.7% -- replaced with /var/log/ceph/ceph-client.admin.97801.log.gz 2023-12-03T13:12:26.646 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.105934.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90069.log 2023-12-03T13:12:26.646 INFO:teuthology.orchestra.run.smithi003.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.105174.log.gz 2023-12-03T13:12:26.646 INFO:teuthology.orchestra.run.smithi003.stderr: 80.0% -- replaced with /var/log/ceph/ceph-client.admin.105934.log.gz 2023-12-03T13:12:26.646 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.102056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.crash.smithi003.113038.log 2023-12-03T13:12:26.646 INFO:teuthology.orchestra.run.smithi003.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.102056.log.gz 2023-12-03T13:12:26.646 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102467.log 2023-12-03T13:12:26.646 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.90069.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90069.log.gz 2023-12-03T13:12:26.646 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.crash.smithi003.113038.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104354.log 2023-12-03T13:12:26.646 INFO:teuthology.orchestra.run.smithi003.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.crash.smithi003.113038.log.gz 2023-12-03T13:12:26.647 INFO:teuthology.orchestra.run.smithi003.stderr: 94.8% -- replaced with /var/log/ceph/ceph-client.admin.98461.log.gz 2023-12-03T13:12:26.647 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.102467.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-12-03T13:12:26.647 INFO:teuthology.orchestra.run.smithi003.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.102467.log.gz 2023-12-03T13:12:26.647 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.104354.log: /var/log/ceph/ceph-client.admin.105584.log 2023-12-03T13:12:26.647 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95657.log 2023-12-03T13:12:26.647 INFO:teuthology.orchestra.run.smithi003.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.104354.log.gz 2023-12-03T13:12:26.647 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.105584.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95093.log 2023-12-03T13:12:26.647 INFO:teuthology.orchestra.run.smithi003.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.105584.log.gz 2023-12-03T13:12:26.647 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.95657.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90153.log 2023-12-03T13:12:26.648 INFO:teuthology.orchestra.run.smithi003.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.95657.log.gz 2023-12-03T13:12:26.648 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.95093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83917.log 2023-12-03T13:12:26.648 INFO:teuthology.orchestra.run.smithi003.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.95093.log.gz 2023-12-03T13:12:26.648 INFO:teuthology.orchestra.run.smithi003.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.96882.log.gz 2023-12-03T13:12:26.648 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.90153.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103698.log 2023-12-03T13:12:26.648 INFO:teuthology.orchestra.run.smithi003.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90153.log.gz 2023-12-03T13:12:26.648 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.83917.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91529.log 2023-12-03T13:12:26.648 INFO:teuthology.orchestra.run.smithi003.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.83917.log.gz 2023-12-03T13:12:26.648 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.103698.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96456.log 2023-12-03T13:12:26.648 INFO:teuthology.orchestra.run.smithi003.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.103698.log.gz 2023-12-03T13:12:26.649 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.91529.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104272.log 0.0% 2023-12-03T13:12:26.649 INFO:teuthology.orchestra.run.smithi003.stderr: -- replaced with /var/log/ceph/ceph-client.admin.91529.log.gz 2023-12-03T13:12:26.649 INFO:teuthology.orchestra.run.smithi003.stderr: 94.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-12-03T13:12:26.649 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103205.log 2023-12-03T13:12:26.649 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.96456.log: 57.8% -- replaced with /var/log/ceph/ceph-client.admin.96456.log.gz 2023-12-03T13:12:26.649 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.104272.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101892.log 2023-12-03T13:12:26.649 INFO:teuthology.orchestra.run.smithi003.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.104272.log.gz 2023-12-03T13:12:26.649 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.103205.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90573.log 2023-12-03T13:12:26.649 INFO:teuthology.orchestra.run.smithi003.stderr: 81.1%/var/log/ceph/ceph-client.admin.101892.log: -- replaced with /var/log/ceph/ceph-client.admin.103205.log.gz 2023-12-03T13:12:26.649 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99598.log 2023-12-03T13:12:26.650 INFO:teuthology.orchestra.run.smithi003.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.101892.log.gz/var/log/ceph/ceph-client.admin.90573.log: 2023-12-03T13:12:26.650 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105749.log 2023-12-03T13:12:26.650 INFO:teuthology.orchestra.run.smithi003.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90573.log.gz 2023-12-03T13:12:26.650 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.99598.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106474.log 2023-12-03T13:12:26.650 INFO:teuthology.orchestra.run.smithi003.stderr: 23.5% -- replaced with /var/log/ceph/ceph-client.admin.99598.log.gz 2023-12-03T13:12:26.650 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.105749.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98021.log 2023-12-03T13:12:26.650 INFO:teuthology.orchestra.run.smithi003.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.105749.log.gz 2023-12-03T13:12:26.650 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.106474.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83622.log 2023-12-03T13:12:26.651 INFO:teuthology.orchestra.run.smithi003.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.106474.log.gz 2023-12-03T13:12:26.651 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.98021.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106604.log 2023-12-03T13:12:26.651 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.83622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93767.log 2023-12-03T13:12:26.651 INFO:teuthology.orchestra.run.smithi003.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.83622.log.gz 2023-12-03T13:12:26.651 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.106604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106522.log 2023-12-03T13:12:26.651 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.93767.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.106604.log.gz 2023-12-03T13:12:26.651 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110583.log 2023-12-03T13:12:26.651 INFO:teuthology.orchestra.run.smithi003.stderr: 80.2% -- replaced with /var/log/ceph/ceph-client.admin.93767.log.gz 2023-12-03T13:12:26.651 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.106522.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112978.log 2023-12-03T13:12:26.652 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111408.log 2023-12-03T13:12:26.652 INFO:teuthology.orchestra.run.smithi003.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.106522.log.gz 2023-12-03T13:12:26.652 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.110583.log: /var/log/ceph/ceph-client.admin.112978.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.112050.log 0.0% 2023-12-03T13:12:26.652 INFO:teuthology.orchestra.run.smithi003.stderr: -- replaced with /var/log/ceph/ceph-client.admin.112978.log.gz 2023-12-03T13:12:26.652 INFO:teuthology.orchestra.run.smithi003.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.110583.log.gz 2023-12-03T13:12:26.652 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.111408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105010.log 2023-12-03T13:12:26.652 INFO:teuthology.orchestra.run.smithi003.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.111408.log.gz 2023-12-03T13:12:26.652 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.0.112050.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102959.log 2023-12-03T13:12:26.652 INFO:teuthology.orchestra.run.smithi003.stderr: 80.2% -- replaced with /var/log/ceph/ceph-client.0.112050.log.gz 2023-12-03T13:12:26.652 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104108.log 2023-12-03T13:12:26.653 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.105010.log: /var/log/ceph/ceph-client.admin.102959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100744.log 2023-12-03T13:12:26.653 INFO:teuthology.orchestra.run.smithi003.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.102959.log.gz 2023-12-03T13:12:26.653 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.104108.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95469.log 2023-12-03T13:12:26.653 INFO:teuthology.orchestra.run.smithi003.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.admin.98021.log.gz 2023-12-03T13:12:26.653 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.100744.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.104108.log.gz 2023-12-03T13:12:26.653 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91245.log 2023-12-03T13:12:26.653 INFO:teuthology.orchestra.run.smithi003.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.100744.log.gz 2023-12-03T13:12:26.653 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.91966.log 2023-12-03T13:12:26.653 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.95469.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.105010.log.gz 2023-12-03T13:12:26.653 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.91245.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106228.log 2023-12-03T13:12:26.654 INFO:teuthology.orchestra.run.smithi003.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.91245.log.gz 2023-12-03T13:12:26.654 INFO:teuthology.orchestra.run.smithi003.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.95469.log.gz 2023-12-03T13:12:26.654 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.0.91966.log: 42.8% -- replaced with /var/log/ceph/ceph-client.0.91966.log.gz 2023-12-03T13:12:26.654 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90377.log 2023-12-03T13:12:26.654 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.106228.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94013.log 2023-12-03T13:12:26.654 INFO:teuthology.orchestra.run.smithi003.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.106228.log.gz 2023-12-03T13:12:26.654 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.90377.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90373.log 2023-12-03T13:12:26.654 INFO:teuthology.orchestra.run.smithi003.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90377.log.gz 2023-12-03T13:12:26.654 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.94013.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-12-03T13:12:26.655 INFO:teuthology.orchestra.run.smithi003.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.94013.log.gz 2023-12-03T13:12:26.655 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.90373.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.99743.log 2023-12-03T13:12:26.655 INFO:teuthology.orchestra.run.smithi003.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90373.log.gz 2023-12-03T13:12:26.655 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102795.log 2023-12-03T13:12:26.655 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.0.99743.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90371.log 2023-12-03T13:12:26.655 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.102795.log: 83.9% -- replaced with /var/log/ceph/ceph-client.0.99743.log.gz 2023-12-03T13:12:26.655 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96992.log 2023-12-03T13:12:26.655 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101810.log 2023-12-03T13:12:26.655 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.90371.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.102795.log.gz 2023-12-03T13:12:26.655 INFO:teuthology.orchestra.run.smithi003.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90371.log.gz 2023-12-03T13:12:26.656 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.96992.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90711.log 2023-12-03T13:12:26.656 INFO:teuthology.orchestra.run.smithi003.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.96992.log.gz 2023-12-03T13:12:26.656 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.101810.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96828.log 2023-12-03T13:12:26.656 INFO:teuthology.orchestra.run.smithi003.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.101810.log.gz 2023-12-03T13:12:26.656 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96757.log 2023-12-03T13:12:26.656 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.90711.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90711.log.gz 2023-12-03T13:12:26.656 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.96828.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90374.log 2023-12-03T13:12:26.656 INFO:teuthology.orchestra.run.smithi003.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.96828.log.gz 2023-12-03T13:12:26.656 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.96757.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89973.log 2023-12-03T13:12:26.657 INFO:teuthology.orchestra.run.smithi003.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.96757.log.gz 2023-12-03T13:12:26.657 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.90374.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110044.log 2023-12-03T13:12:26.657 INFO:teuthology.orchestra.run.smithi003.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90374.log.gz 2023-12-03T13:12:26.657 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.89973.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.89973.log.gz 2023-12-03T13:12:26.657 INFO:teuthology.orchestra.run.smithi003.stderr: --verbose -- /var/log/ceph/ceph-client.admin.109943.log 2023-12-03T13:12:26.657 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.110044.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94601.log 2023-12-03T13:12:26.657 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.109943.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94413.log 2023-12-03T13:12:26.657 INFO:teuthology.orchestra.run.smithi003.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.110044.log.gz 2023-12-03T13:12:26.657 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.94601.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99179.log 2023-12-03T13:12:26.657 INFO:teuthology.orchestra.run.smithi003.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.94601.log.gz 2023-12-03T13:12:26.658 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.94413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94225.log 2023-12-03T13:12:26.658 INFO:teuthology.orchestra.run.smithi003.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.94413.log.gz 2023-12-03T13:12:26.658 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 93.0% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.109943.log.gz 2023-12-03T13:12:26.658 INFO:teuthology.orchestra.run.smithi003.stderr: /var/log/ceph/ceph-client.admin.90713.log 2023-12-03T13:12:26.658 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.99179.log: /var/log/ceph/ceph-client.admin.94225.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102220.log 2023-12-03T13:12:26.658 INFO:teuthology.orchestra.run.smithi003.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.99179.log.gz 2023-12-03T13:12:26.658 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.90713.log: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.94225.log.gz 2023-12-03T13:12:26.658 INFO:teuthology.orchestra.run.smithi003.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90713.log.gz 2023-12-03T13:12:26.658 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106498.log 2023-12-03T13:12:26.658 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.111846.log 2023-12-03T13:12:26.659 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.102220.log: gzip/var/log/ceph/ceph-client.admin.106498.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.105502.log 2023-12-03T13:12:26.659 INFO:teuthology.orchestra.run.smithi003.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.102220.log.gz 2023-12-03T13:12:26.659 INFO:teuthology.orchestra.run.smithi003.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.106498.log.gz 2023-12-03T13:12:26.659 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.0.111846.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97911.log 2023-12-03T13:12:26.659 INFO:teuthology.orchestra.run.smithi003.stderr: 80.1% -- replaced with /var/log/ceph/ceph-client.0.111846.log.gz 2023-12-03T13:12:26.659 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.105502.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91489.log 2023-12-03T13:12:26.659 INFO:teuthology.orchestra.run.smithi003.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.105502.log.gz 2023-12-03T13:12:26.659 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95845.log 2023-12-03T13:12:26.659 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.97911.log: /var/log/ceph/ceph-client.admin.91489.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90376.log 2023-12-03T13:12:26.660 INFO:teuthology.orchestra.run.smithi003.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.91489.log.gz 2023-12-03T13:12:26.660 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.95845.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103944.log 2023-12-03T13:12:26.660 INFO:teuthology.orchestra.run.smithi003.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.95845.log.gz 2023-12-03T13:12:26.660 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.90376.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101318.log 2023-12-03T13:12:26.660 INFO:teuthology.orchestra.run.smithi003.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90376.log.gz 2023-12-03T13:12:26.660 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.103944.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.113173.log 2023-12-03T13:12:26.660 INFO:teuthology.orchestra.run.smithi003.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.103944.log.gz 2023-12-03T13:12:26.660 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.101318.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-12-03T13:12:26.660 INFO:teuthology.orchestra.run.smithi003.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.101318.log.gz 2023-12-03T13:12:26.660 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.0.113173.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103862.log 2023-12-03T13:12:26.661 INFO:teuthology.orchestra.run.smithi003.stderr: 9.2% -- replaced with /var/log/ceph/ceph-client.0.113173.log.gz 2023-12-03T13:12:26.661 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94437.log 2023-12-03T13:12:26.661 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.103862.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93316.log 2023-12-03T13:12:26.661 INFO:teuthology.orchestra.run.smithi003.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.103862.log.gz 2023-12-03T13:12:26.661 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.94437.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101646.log 2023-12-03T13:12:26.661 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.93316.log: 84.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89886.log 2023-12-03T13:12:26.661 INFO:teuthology.orchestra.run.smithi003.stderr: -- replaced with /var/log/ceph/ceph-client.admin.94437.log.gz 2023-12-03T13:12:26.661 INFO:teuthology.orchestra.run.smithi003.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.93316.log.gz 2023-12-03T13:12:26.661 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.101646.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105338.log 2023-12-03T13:12:26.662 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.89886.log: gzip 88.0% -- replaced with /var/log/ceph/ceph-client.admin.101646.log.gz 2023-12-03T13:12:26.662 INFO:teuthology.orchestra.run.smithi003.stderr: -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.89886.log.gz 2023-12-03T13:12:26.662 INFO:teuthology.orchestra.run.smithi003.stderr: --verbose -- /var/log/ceph/ceph-client.admin.84037.log 2023-12-03T13:12:26.662 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.105338.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110684.log 2023-12-03T13:12:26.662 INFO:teuthology.orchestra.run.smithi003.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.105338.log.gz 2023-12-03T13:12:26.662 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.84037.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.84037.log.gz 2023-12-03T13:12:26.662 INFO:teuthology.orchestra.run.smithi003.stderr: --verbose -- /var/log/ceph/ceph-client.admin.104518.log 2023-12-03T13:12:26.662 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.110684.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95681.log 2023-12-03T13:12:26.662 INFO:teuthology.orchestra.run.smithi003.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.110684.log.gz 2023-12-03T13:12:26.663 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.104518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101154.log 2023-12-03T13:12:26.663 INFO:teuthology.orchestra.run.smithi003.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.104518.log.gz 2023-12-03T13:12:26.663 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.95681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90929.log 2023-12-03T13:12:26.663 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.101154.log: 80.2% -- replaced with /var/log/ceph/ceph-client.admin.95681.log.gz 2023-12-03T13:12:26.663 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102713.log 2023-12-03T13:12:26.663 INFO:teuthology.orchestra.run.smithi003.stderr: 80.2% -- replaced with /var/log/ceph/ceph-client.admin.101154.log.gz 2023-12-03T13:12:26.663 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.90929.log: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.97911.log.gz 2023-12-03T13:12:26.663 INFO:teuthology.orchestra.run.smithi003.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90929.log.gz 2023-12-03T13:12:26.663 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98681.log 2023-12-03T13:12:26.663 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.102713.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90195.log 2023-12-03T13:12:26.664 INFO:teuthology.orchestra.run.smithi003.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.102713.log.gz 2023-12-03T13:12:26.664 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.98681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104600.log 2023-12-03T13:12:26.664 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94683.log 2023-12-03T13:12:26.664 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.90195.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90195.log.gz 2023-12-03T13:12:26.664 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.104600.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113102.log 2023-12-03T13:12:26.664 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.94683.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90708.log 2023-12-03T13:12:26.664 INFO:teuthology.orchestra.run.smithi003.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.104600.log.gz 2023-12-03T13:12:26.664 INFO:teuthology.orchestra.run.smithi003.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.98681.log.gz 2023-12-03T13:12:26.664 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.113102.log: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.94683.log.gz 2023-12-03T13:12:26.665 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.109114.log 2023-12-03T13:12:26.665 INFO:teuthology.orchestra.run.smithi003.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.113102.log.gz 2023-12-03T13:12:26.665 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104928.log 2023-12-03T13:12:26.665 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.90708.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90708.log.gz 2023-12-03T13:12:26.665 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.0.109114.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95011.log 2023-12-03T13:12:26.665 INFO:teuthology.orchestra.run.smithi003.stderr: 83.9% -- replaced with /var/log/ceph/ceph-client.0.109114.log.gz 2023-12-03T13:12:26.665 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.104928.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94847.log 2023-12-03T13:12:26.665 INFO:teuthology.orchestra.run.smithi003.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.104928.log.gz 2023-12-03T13:12:26.665 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.95011.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101564.log 2023-12-03T13:12:26.665 INFO:teuthology.orchestra.run.smithi003.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.95011.log.gz 2023-12-03T13:12:26.666 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.94847.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.crash.smithi003.113078.log 2023-12-03T13:12:26.666 INFO:teuthology.orchestra.run.smithi003.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.94847.log.gz 2023-12-03T13:12:26.666 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.101564.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90707.log 2023-12-03T13:12:26.666 INFO:teuthology.orchestra.run.smithi003.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.101564.log.gz 2023-12-03T13:12:26.666 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.crash.smithi003.113078.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100662.log 2023-12-03T13:12:26.666 INFO:teuthology.orchestra.run.smithi003.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.crash.smithi003.113078.log.gz 2023-12-03T13:12:26.666 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.90707.log: gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.admin.log 2023-12-03T13:12:26.666 INFO:teuthology.orchestra.run.smithi003.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90707.log.gz 2023-12-03T13:12:26.666 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.100662.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.crash.smithi003.113323.log 2023-12-03T13:12:26.666 INFO:teuthology.orchestra.run.smithi003.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.100662.log.gz 2023-12-03T13:12:26.667 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ops-log-ceph-client.admin.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102385.log 2023-12-03T13:12:26.667 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.crash.smithi003.113323.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101236.log 2023-12-03T13:12:26.667 INFO:teuthology.orchestra.run.smithi003.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.crash.smithi003.113323.log.gz 2023-12-03T13:12:26.667 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.102385.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101974.log 2023-12-03T13:12:26.667 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.101236.log: gzip 88.0% -- replaced with /var/log/ceph/ceph-client.admin.102385.log.gz 2023-12-03T13:12:26.667 INFO:teuthology.orchestra.run.smithi003.stderr: -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2023-12-03T13:12:26.667 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.101974.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.101236.log.gz 2023-12-03T13:12:26.667 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 81.7% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.101974.log.gz 2023-12-03T13:12:26.667 INFO:teuthology.orchestra.run.smithi003.stderr: /var/log/ceph/ceph-client.admin.111307.log 2023-12-03T13:12:26.667 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112938.log 2023-12-03T13:12:26.668 INFO:teuthology.orchestra.run.smithi003.stderr:gzip/var/log/ceph/ceph-client.admin.111307.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.110246.log 2023-12-03T13:12:26.668 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.112938.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101400.log 2023-12-03T13:12:26.668 INFO:teuthology.orchestra.run.smithi003.stderr: -- replaced with /var/log/ceph/ceph-client.admin.112938.log.gz 2023-12-03T13:12:26.668 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106180.log 2023-12-03T13:12:26.668 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.110246.log: /var/log/ceph/ceph-client.admin.101400.log: 92.8% -- replaced with /var/log/ceph/ceph-client.admin.111307.log.gz 2023-12-03T13:12:26.668 INFO:teuthology.orchestra.run.smithi003.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.101400.log.gz 2023-12-03T13:12:26.668 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90029.log 2023-12-03T13:12:26.668 INFO:teuthology.orchestra.run.smithi003.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.110246.log.gz 2023-12-03T13:12:26.668 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.106180.log: gzip -5 --verbose -- 0.0% -- replaced with /var/log/ceph/ceph-client.admin.106180.log.gz 2023-12-03T13:12:26.669 INFO:teuthology.orchestra.run.smithi003.stderr: /var/log/ceph/ceph-client.admin.113021.log 2023-12-03T13:12:26.669 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.90029.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90029.log.gz 2023-12-03T13:12:26.669 INFO:teuthology.orchestra.run.smithi003.stderr: 94.3% -- replaced with /var/log/ceph/ops-log-ceph-client.admin.log.gz 2023-12-03T13:12:26.669 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90375.log 2023-12-03T13:12:26.669 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.113021.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99261.log 2023-12-03T13:12:26.669 INFO:teuthology.orchestra.run.smithi003.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.113021.log.gz 2023-12-03T13:12:26.669 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.90375.log: gzip -5 0.0% --verbose -- replaced with /var/log/ceph/ceph-client.admin.90375.log.gz 2023-12-03T13:12:26.669 INFO:teuthology.orchestra.run.smithi003.stderr: -- /var/log/ceph/ceph-client.admin.91071.log 2023-12-03T13:12:26.669 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.99261.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101072.log 2023-12-03T13:12:26.669 INFO:teuthology.orchestra.run.smithi003.stderr: 83.8% -- replaced with /var/log/ceph/ceph-client.admin.99261.log.gz 2023-12-03T13:12:26.669 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.91071.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109357.log 2023-12-03T13:12:26.670 INFO:teuthology.orchestra.run.smithi003.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.91071.log.gz 2023-12-03T13:12:26.670 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.101072.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104846.log 2023-12-03T13:12:26.670 INFO:teuthology.orchestra.run.smithi003.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.101072.log.gz 2023-12-03T13:12:26.670 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.109357.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97691.log 2023-12-03T13:12:26.670 INFO:teuthology.orchestra.run.smithi003.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.109357.log.gz 2023-12-03T13:12:26.670 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.104846.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90372.log 2023-12-03T13:12:26.670 INFO:teuthology.orchestra.run.smithi003.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.104846.log.gz 2023-12-03T13:12:26.670 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.97691.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102302.log 2023-12-03T13:12:26.670 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.90372.log: -- /var/log/ceph/ceph-client.admin.106392.log 2023-12-03T13:12:26.670 INFO:teuthology.orchestra.run.smithi003.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90372.log.gz 2023-12-03T13:12:26.671 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99430.log 2023-12-03T13:12:26.671 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.106392.log: /var/log/ceph/ceph-client.admin.102302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.100077.log 2023-12-03T13:12:26.671 INFO:teuthology.orchestra.run.smithi003.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.106392.log.gz 2023-12-03T13:12:26.671 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.99430.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.crash.112926.log 2023-12-03T13:12:26.671 INFO:teuthology.orchestra.run.smithi003.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.102302.log.gz 2023-12-03T13:12:26.671 INFO:teuthology.orchestra.run.smithi003.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.99430.log.gz 2023-12-03T13:12:26.671 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.0.100077.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93931.log 2023-12-03T13:12:26.671 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.crash.112926.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90710.log 2023-12-03T13:12:26.671 INFO:teuthology.orchestra.run.smithi003.stderr: -- replaced with /var/log/ceph/ceph-client.crash.112926.log.gz 2023-12-03T13:12:26.672 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-12-03T13:12:26.672 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.93931.log: /var/log/ceph/ceph-client.admin.90710.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90710.log.gz 2023-12-03T13:12:26.672 INFO:teuthology.orchestra.run.smithi003.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.93931.log.gz 2023-12-03T13:12:26.672 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105852.log 2023-12-03T13:12:26.672 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101482.log 2023-12-03T13:12:26.672 INFO:teuthology.orchestra.run.smithi003.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.0.100077.log.gz 2023-12-03T13:12:26.672 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.105852.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103616.log 2023-12-03T13:12:26.672 INFO:teuthology.orchestra.run.smithi003.stderr: 86.5%/var/log/ceph/ceph-client.admin.101482.log: -- replaced with /var/log/ceph/ceph-client.admin.105852.log.gz 2023-12-03T13:12:26.672 INFO:teuthology.orchestra.run.smithi003.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.101482.log.gz 2023-12-03T13:12:26.672 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91068.log 2023-12-03T13:12:26.673 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105770.log 2023-12-03T13:12:26.673 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.91068.log: /var/log/ceph/ceph-client.admin.103616.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.91068.log.gz 2023-12-03T13:12:26.673 INFO:teuthology.orchestra.run.smithi003.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.103616.log.gz 2023-12-03T13:12:26.673 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.0.log 2023-12-03T13:12:26.673 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.105770.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94389.log 2023-12-03T13:12:26.673 INFO:teuthology.orchestra.run.smithi003.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.105770.log.gz 2023-12-03T13:12:26.673 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ops-log-ceph-client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.crash.smithi003.112954.log 2023-12-03T13:12:26.673 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.94389.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.94389.log.gz 2023-12-03T13:12:26.673 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95633.log 2023-12-03T13:12:26.673 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.crash.smithi003.112954.log: 0.0% -- replaced with /var/log/ceph/ceph-client.crash.smithi003.112954.log.gz 2023-12-03T13:12:26.673 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-12-03T13:12:26.674 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.95633.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.95633.log.gz 2023-12-03T13:12:26.674 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105256.log 2023-12-03T13:12:26.674 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph.log: 93.9% -- replaced with /var/log/ceph/ceph-client.admin.97691.log.gz 2023-12-03T13:12:26.674 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-12-03T13:12:26.674 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.105256.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.105256.log.gz 2023-12-03T13:12:26.674 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94061.log 2023-12-03T13:12:26.674 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-osd.2.log: 93.8% -- replaced with /var/log/ceph/ceph.log.gz 2023-12-03T13:12:26.674 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96558.log 2023-12-03T13:12:26.674 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.94061.log: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.94061.log.gz 2023-12-03T13:12:26.675 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103780.log 2023-12-03T13:12:26.675 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.96558.log: 51.0% -- replaced with /var/log/ceph/ceph-client.admin.96558.log.gz 2023-12-03T13:12:26.675 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95175.log 2023-12-03T13:12:26.675 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.103780.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.103780.log.gz 2023-12-03T13:12:26.675 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102877.log 2023-12-03T13:12:26.675 INFO:teuthology.orchestra.run.smithi003.stderr: 94.8% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2023-12-03T13:12:26.675 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.95175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90909.log 2023-12-03T13:12:26.675 INFO:teuthology.orchestra.run.smithi003.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.95175.log.gz 2023-12-03T13:12:26.675 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.102877.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94519.log 2023-12-03T13:12:26.675 INFO:teuthology.orchestra.run.smithi003.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.102877.log.gz 2023-12-03T13:12:26.676 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.90909.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90909.log.gz 2023-12-03T13:12:26.676 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100580.log 2023-12-03T13:12:26.676 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.94519.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91369.log 2023-12-03T13:12:26.676 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.100580.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.94519.log.gz 2023-12-03T13:12:26.676 INFO:teuthology.orchestra.run.smithi003.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.100580.log.gz 2023-12-03T13:12:26.676 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/rgw.ceph.client.0.log 2023-12-03T13:12:26.676 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.91369.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.91369.log.gzgzip 2023-12-03T13:12:26.676 INFO:teuthology.orchestra.run.smithi003.stderr: -5 --verbose -- /var/log/ceph/ceph-client.0.99841.log 2023-12-03T13:12:26.676 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.91874.log 2023-12-03T13:12:26.676 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.0.99841.log: /var/log/ceph/rgw.ceph.client.0.log: 83.7% -- replaced with /var/log/ceph/ceph-client.0.99841.log.gz 2023-12-03T13:12:26.677 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98791.log 2023-12-03T13:12:26.677 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.0.91874.log: 43.2% -- replaced with /var/log/ceph/ceph-client.0.91874.log.gz 2023-12-03T13:12:26.692 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101728.log 2023-12-03T13:12:26.692 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.98791.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.98791.log.gz 2023-12-03T13:12:26.692 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105420.log 2023-12-03T13:12:26.692 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.101728.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.101728.log.gz 2023-12-03T13:12:26.692 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113384.log 2023-12-03T13:12:26.692 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.105420.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.105420.log.gz 2023-12-03T13:12:26.692 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104682.log 2023-12-03T13:12:26.693 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.113384.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.113384.log.gz 2023-12-03T13:12:26.693 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91329.log 2023-12-03T13:12:26.693 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.104682.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.104682.log.gz 2023-12-03T13:12:26.693 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103534.log 2023-12-03T13:12:26.693 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.91329.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.91329.log.gz 2023-12-03T13:12:26.693 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95387.log 2023-12-03T13:12:26.693 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.103534.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.103534.log.gz 2023-12-03T13:12:26.693 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100908.log 2023-12-03T13:12:26.693 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.95387.log: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.95387.log.gz 2023-12-03T13:12:26.693 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96205.log 2023-12-03T13:12:26.694 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.100908.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.100908.log.gz 2023-12-03T13:12:26.694 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.112152.log 2023-12-03T13:12:26.694 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.96205.log: 60.1% -- replaced with /var/log/ceph/ceph-client.admin.96205.log.gz 2023-12-03T13:12:26.694 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90370.log 2023-12-03T13:12:26.694 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.0.112152.log: 83.9% -- replaced with /var/log/ceph/ceph-client.0.112152.log.gz 2023-12-03T13:12:26.694 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95305.log 2023-12-03T13:12:26.694 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.90370.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90370.log.gz 2023-12-03T13:12:26.694 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95257.log 2023-12-03T13:12:26.694 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.95305.log: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.95305.log.gz 2023-12-03T13:12:26.695 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98351.log 2023-12-03T13:12:26.695 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.95257.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.95257.log.gz 2023-12-03T13:12:26.695 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103288.log 2023-12-03T13:12:26.695 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.98351.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.98351.log.gz 2023-12-03T13:12:26.695 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.111540.log 2023-12-03T13:12:26.695 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.103288.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.103288.log.gz 2023-12-03T13:12:26.695 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-12-03T13:12:26.695 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.0.111540.log: 83.8% -- replaced with /var/log/ceph/ceph-client.0.111540.log.gz 2023-12-03T13:12:26.695 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91449.log 2023-12-03T13:12:26.695 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-mon.c.log: 94.6% -- replaced with /var/log/ceph/ops-log-ceph-client.0.log.gz 2023-12-03T13:12:26.695 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.crash.113372.log 2023-12-03T13:12:26.696 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.91449.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.91449.log.gz 2023-12-03T13:12:26.696 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93685.log 2023-12-03T13:12:26.696 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.crash.113372.log: 0.0% -- replaced with /var/log/ceph/ceph-client.crash.113372.log.gz 2023-12-03T13:12:26.696 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.93685.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.93685.log.gz 2023-12-03T13:12:26.939 INFO:teuthology.orchestra.run.smithi037.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-12-03T13:12:27.123 INFO:teuthology.orchestra.run.smithi037.stderr: 92.5% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-12-03T13:12:27.229 INFO:teuthology.orchestra.run.smithi003.stderr: 92.7% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-12-03T13:12:28.357 INFO:teuthology.orchestra.run.smithi003.stderr: 91.7% -- replaced with /var/log/ceph/rgw.ceph.client.0.log.gz 2023-12-03T13:12:28.523 INFO:teuthology.orchestra.run.smithi003.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-12-03T13:12:32.119 INFO:teuthology.orchestra.run.smithi003.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-12-03T13:12:33.097 INFO:teuthology.orchestra.run.smithi037.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2023-12-03T13:12:33.198 INFO:teuthology.orchestra.run.smithi003.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-12-03T13:12:33.606 INFO:teuthology.orchestra.run.smithi037.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2023-12-03T13:12:33.768 INFO:teuthology.orchestra.run.smithi037.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2023-12-03T13:12:36.178 INFO:teuthology.orchestra.run.smithi003.stderr: 94.3% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-12-03T13:12:36.234 INFO:teuthology.orchestra.run.smithi037.stderr: 94.3% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2023-12-03T13:12:36.236 INFO:teuthology.orchestra.run.smithi037.stderr: 2023-12-03T13:12:36.236 INFO:teuthology.orchestra.run.smithi037.stderr:real 0m9.684s 2023-12-03T13:12:36.237 INFO:teuthology.orchestra.run.smithi037.stderr:user 0m30.324s 2023-12-03T13:12:36.237 INFO:teuthology.orchestra.run.smithi037.stderr:sys 0m1.014s 2023-12-03T13:12:42.670 INFO:teuthology.orchestra.run.smithi003.stderr: 94.9% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-12-03T13:12:42.672 INFO:teuthology.orchestra.run.smithi003.stderr: 2023-12-03T13:12:42.672 INFO:teuthology.orchestra.run.smithi003.stderr:real 0m16.147s 2023-12-03T13:12:42.672 INFO:teuthology.orchestra.run.smithi003.stderr:user 0m40.942s 2023-12-03T13:12:42.672 INFO:teuthology.orchestra.run.smithi003.stderr:sys 0m1.445s 2023-12-03T13:12:42.672 INFO:tasks.ceph:Archiving logs... 2023-12-03T13:12:42.673 DEBUG:teuthology.misc:Transferring archived files from smithi003:/var/log/ceph to /home/teuthworker/archive/alimasa-2023-12-03_11:04:43-rgw-wip-alimasa-multi-pubsub-etag-distro-default-smithi/7476143/remote/smithi003/log 2023-12-03T13:12:42.674 DEBUG:teuthology.orchestra.run.smithi003:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-03T13:12:47.812 DEBUG:teuthology.misc:Transferring archived files from smithi037:/var/log/ceph to /home/teuthworker/archive/alimasa-2023-12-03_11:04:43-rgw-wip-alimasa-multi-pubsub-etag-distro-default-smithi/7476143/remote/smithi037/log 2023-12-03T13:12:47.813 DEBUG:teuthology.orchestra.run.smithi037:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-03T13:12:51.585 ERROR:teuthology.run_tasks:Manager failed: ceph Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/ceph.py", line 1918, in task File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/task/__init__.py", line 132, in __exit__ self.end() File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/s3tests_java.py", line 101, in end File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/s3tests_java.py", line 386, in delete_users File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/cluster.py", line 85, in run procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/cluster.py", line 85, in procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi003 with status 1: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid tester.client.0 --purge-data --cluster ceph' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/ceph.py", line 329, in valgrind_post File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/ceph.py", line 1928, in task File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi003 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/ceph.py", line 1935, in task File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/ceph.py", line 252, in ceph_log File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/ceph.py", line 346, in valgrind_post Exception: valgrind error: InvalidRead RGWCompleteMultipart::complete() rgw_process_authenticated(RGWHandler_REST*, RGWOp*&, RGWRequest*, req_state*, optional_yield, rgw::sal::Driver*, bool) process_request(RGWProcessEnv const&, RGWRequest*, std::__cxx11::basic_string, std::allocator > const&, RGWRestfulIO*, optional_yield, rgw::dmclock::Scheduler*, std::__cxx11::basic_string, std::allocator >*, std::chrono::duration >*, int*) 2023-12-03T13:12:51.600 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-12-03T13:12:51.610 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/task/install/__init__.py", line 626, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/task/__init__.py", line 132, in __exit__ self.end() File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/s3tests_java.py", line 101, in end File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/s3tests_java.py", line 386, in delete_users File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/cluster.py", line 85, in run procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/cluster.py", line 85, in procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi003 with status 1: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid tester.client.0 --purge-data --cluster ceph' 2023-12-03T13:12:51.621 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-12-03T13:12:51.621 DEBUG:teuthology.orchestra.run.smithi003:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-12-03T13:12:51.624 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-12-03T13:12:51.721 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-12-03T13:12:51.731 INFO:teuthology.task.clock:Checking final clock skew... 2023-12-03T13:12:51.731 DEBUG:teuthology.orchestra.run.smithi003:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-03T13:12:51.733 DEBUG:teuthology.orchestra.run.smithi037:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-03T13:12:51.750 INFO:teuthology.orchestra.run.smithi037.stderr:bash: line 1: ntpq: command not found 2023-12-03T13:12:51.755 INFO:teuthology.orchestra.run.smithi037.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-03T13:12:51.756 INFO:teuthology.orchestra.run.smithi037.stdout:=============================================================================== 2023-12-03T13:12:51.756 INFO:teuthology.orchestra.run.smithi037.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 58 +1836us[+1836us] +/- 83ms 2023-12-03T13:12:51.756 INFO:teuthology.orchestra.run.smithi037.stdout:^* hv02.front.sepia.ceph.com 3 8 377 182 -1288us[-1305us] +/- 75ms 2023-12-03T13:12:51.756 INFO:teuthology.orchestra.run.smithi037.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 57 +113us[ +113us] +/- 77ms 2023-12-03T13:12:51.756 INFO:teuthology.orchestra.run.smithi037.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2023-12-03T13:12:51.761 INFO:teuthology.orchestra.run.smithi003.stderr:bash: line 1: ntpq: command not found 2023-12-03T13:12:51.766 INFO:teuthology.orchestra.run.smithi003.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-03T13:12:51.767 INFO:teuthology.orchestra.run.smithi003.stdout:=============================================================================== 2023-12-03T13:12:51.767 INFO:teuthology.orchestra.run.smithi003.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 55 +1795us[+1795us] +/- 83ms 2023-12-03T13:12:51.767 INFO:teuthology.orchestra.run.smithi003.stdout:^* hv02.front.sepia.ceph.com 3 7 377 66 -1340us[-1373us] +/- 77ms 2023-12-03T13:12:51.767 INFO:teuthology.orchestra.run.smithi003.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 60 +85us[ +85us] +/- 77ms 2023-12-03T13:12:51.767 INFO:teuthology.orchestra.run.smithi003.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2023-12-03T13:12:51.767 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-12-03T13:12:51.777 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-12-03T13:12:51.777 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-12-03T13:12:51.788 DEBUG:teuthology.orchestra.run.smithi003:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-12-03T13:12:51.927 DEBUG:teuthology.orchestra.run.smithi037:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-12-03T13:12:52.035 DEBUG:teuthology.orchestra.run.smithi003:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-03T13:12:52.084 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-03T13:12:52.084 DEBUG:teuthology.orchestra.run.smithi037:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-03T13:12:52.121 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-03T13:12:52.121 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-12-03T13:12:52.132 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-12-03T13:12:52.148 INFO:teuthology.task.internal:Duration was 6424.980984 seconds 2023-12-03T13:12:52.148 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-12-03T13:12:52.164 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-12-03T13:12:52.164 DEBUG:teuthology.orchestra.run.smithi003:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-12-03T13:12:52.167 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-12-03T13:12:52.218 INFO:teuthology.orchestra.run.smithi037.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-03T13:12:52.228 INFO:teuthology.orchestra.run.smithi003.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-03T13:12:52.645 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-12-03T13:12:52.645 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi003.front.sepia.ceph.com 2023-12-03T13:12:52.645 DEBUG:teuthology.orchestra.run.smithi003:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-12-03T13:12:52.679 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi037.front.sepia.ceph.com 2023-12-03T13:12:52.680 DEBUG:teuthology.orchestra.run.smithi037:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-12-03T13:12:52.702 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-12-03T13:12:52.702 DEBUG:teuthology.orchestra.run.smithi003:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-03T13:12:52.722 DEBUG:teuthology.orchestra.run.smithi037:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-03T13:12:52.776 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-12-03T13:12:52.777 DEBUG:teuthology.orchestra.run.smithi003:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-12-03T13:12:52.779 DEBUG:teuthology.orchestra.run.smithi037:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-12-03T13:12:52.916 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-12-03T13:12:52.928 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-12-03T13:12:52.928 DEBUG:teuthology.orchestra.run.smithi003:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-12-03T13:12:52.973 DEBUG:teuthology.orchestra.run.smithi037:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-12-03T13:12:53.004 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-12-03T13:12:53.018 DEBUG:teuthology.orchestra.run.smithi003:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-12-03T13:12:53.021 DEBUG:teuthology.orchestra.run.smithi037:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-12-03T13:12:53.062 INFO:teuthology.orchestra.run.smithi003.stdout:kernel.core_pattern = core 2023-12-03T13:12:53.073 INFO:teuthology.orchestra.run.smithi037.stdout:kernel.core_pattern = core 2023-12-03T13:12:53.097 DEBUG:teuthology.orchestra.run.smithi003:> test -e /home/ubuntu/cephtest/archive/coredump 2023-12-03T13:12:53.148 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-03T13:12:53.149 DEBUG:teuthology.orchestra.run.smithi037:> test -e /home/ubuntu/cephtest/archive/coredump 2023-12-03T13:12:53.163 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-03T13:12:53.164 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-12-03T13:12:53.176 INFO:teuthology.task.internal:Transferring archived files... 2023-12-03T13:12:53.177 DEBUG:teuthology.misc:Transferring archived files from smithi003:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/alimasa-2023-12-03_11:04:43-rgw-wip-alimasa-multi-pubsub-etag-distro-default-smithi/7476143/remote/smithi003 2023-12-03T13:12:53.177 DEBUG:teuthology.orchestra.run.smithi003:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-03T13:12:53.248 DEBUG:teuthology.misc:Transferring archived files from smithi037:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/alimasa-2023-12-03_11:04:43-rgw-wip-alimasa-multi-pubsub-etag-distro-default-smithi/7476143/remote/smithi037 2023-12-03T13:12:53.249 DEBUG:teuthology.orchestra.run.smithi037:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-03T13:12:53.291 INFO:teuthology.task.internal:Removing archive directory... 2023-12-03T13:12:53.291 DEBUG:teuthology.orchestra.run.smithi003:> rm -rf -- /home/ubuntu/cephtest/archive 2023-12-03T13:12:53.294 DEBUG:teuthology.orchestra.run.smithi037:> rm -rf -- /home/ubuntu/cephtest/archive 2023-12-03T13:12:53.340 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-12-03T13:12:53.354 INFO:teuthology.task.internal:Not uploading archives. 2023-12-03T13:12:53.354 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-12-03T13:12:53.369 INFO:teuthology.task.internal:Tidying up after the test... 2023-12-03T13:12:53.369 DEBUG:teuthology.orchestra.run.smithi003:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-12-03T13:12:53.372 DEBUG:teuthology.orchestra.run.smithi037:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-12-03T13:12:53.395 INFO:teuthology.orchestra.run.smithi037.stdout: 262166 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Dec 3 13:12 /home/ubuntu/cephtest 2023-12-03T13:12:53.397 INFO:teuthology.orchestra.run.smithi003.stdout: 262166 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Dec 3 13:12 /home/ubuntu/cephtest 2023-12-03T13:12:53.398 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-12-03T13:12:53.411 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-12-03T13:12:53.425 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: CommandFailedError: Command failed on smithi003 with status 1: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid tester.client.0 --purge-data --cluster ceph' 2023-12-03T13:12:53.425 INFO:teuthology.nuke:Checking targets against current locks 2023-12-03T13:12:53.452 DEBUG:teuthology.nuke:shortname: smithi003 2023-12-03T13:12:53.453 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-03T13:12:53.480 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi003.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/alimasa-2023-12-03_11:04:43-rgw-wip-alimasa-multi-pubsub-etag-distro-default-smithi/7476143', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-03 11:17:03.906617', 'locked_by': 'scheduled_alimasa@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCNTFuByklhnpO0+opNoVMJTsTqSn0lWxlFcRGAzHsBX5iZ1bcebClYz+q1Ny3AYlc7WRevHLnClzc45Au3wuN4='} 2023-12-03T13:12:53.481 DEBUG:teuthology.nuke:shortname: smithi037 2023-12-03T13:12:53.482 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-03T13:12:53.502 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi037.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/alimasa-2023-12-03_11:04:43-rgw-wip-alimasa-multi-pubsub-etag-distro-default-smithi/7476143', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-03 11:17:03.908545', 'locked_by': 'scheduled_alimasa@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFi1UWnXJSWurirYT2qCAUvkVy86eskTFZhVGp9xDcuSkRMKlGPj+peKsXJXoy2wdtO04GB8auqIP2xRc8mQ1Ws='} 2023-12-03T13:12:53.538 INFO:teuthology.orchestra.console.smithi003:Power off 2023-12-03T13:12:53.538 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-03T13:12:53.557 INFO:teuthology.orchestra.console.smithi037:Power off 2023-12-03T13:12:53.557 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-03T13:12:53.568 DEBUG:teuthology.orchestra.console.smithi003:power off output: Chassis Power Control: Down/Off 2023-12-03T13:12:53.568 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-03T13:12:53.583 DEBUG:teuthology.orchestra.console.smithi037:power off output: Chassis Power Control: Down/Off 2023-12-03T13:12:53.583 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-03T13:12:53.594 DEBUG:teuthology.orchestra.console.smithi003:check power output: Chassis Power is on 2023-12-03T13:12:53.610 DEBUG:teuthology.orchestra.console.smithi037:check power output: Chassis Power is on 2023-12-03T13:12:57.595 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-03T13:12:57.611 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-03T13:12:57.708 DEBUG:teuthology.orchestra.console.smithi003:check power output: Chassis Power is on 2023-12-03T13:12:57.720 DEBUG:teuthology.orchestra.console.smithi037:check power output: Chassis Power is on 2023-12-03T13:13:01.714 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-03T13:13:01.721 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-03T13:13:01.823 DEBUG:teuthology.orchestra.console.smithi003:check power output: Chassis Power is on 2023-12-03T13:13:01.829 DEBUG:teuthology.orchestra.console.smithi037:check power output: Chassis Power is off 2023-12-03T13:13:01.930 INFO:teuthology.orchestra.console.smithi037:Power off completed 2023-12-03T13:13:05.829 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-03T13:13:05.941 DEBUG:teuthology.orchestra.console.smithi003:check power output: Chassis Power is off 2023-12-03T13:13:06.042 INFO:teuthology.orchestra.console.smithi003:Power off completed 2023-12-03T13:13:06.149 INFO:teuthology.run:Summary data: description: rgw/verify/{0-install clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec s3tests-branch sharding$/{default} striping$/{stripe-greater-than-chunk} supported-random-distro$/{centos_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind} duration: 6424.980983734131 failure_reason: 'Command failed (s3 tests against rgw) on smithi003 with status 1: "source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt tox -- -v -m ''not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3''"' flavor: default owner: scheduled_alimasa@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=a8c9a07027df41339ea71dbf1a6c2a25 status: fail success: false 2023-12-03T13:13:06.149 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-03T13:13:06.243 INFO:teuthology.run:FAIL